-- Logs begin at Tue 2022-07-19 21:35:49 UTC, end at Wed 2022-07-20 00:06:19 UTC. -- Jul 19 22:14:16.181109 n-d-847009-3 systemd[1]: Starting Devstack devstack@n-api.service... Jul 19 22:14:16.191213 n-d-847009-3 devstack@n-api.service[103996]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 19 22:14:16.193144 n-d-847009-3 devstack@n-api.service[103996]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 19 22:14:16 2022] *** Jul 19 22:14:16.193144 n-d-847009-3 devstack@n-api.service[103996]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 19 22:14:16.193144 n-d-847009-3 devstack@n-api.service[103996]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 19 22:14:16.193144 n-d-847009-3 devstack@n-api.service[103996]: nodename: n-d-847009-3 Jul 19 22:14:16.193144 n-d-847009-3 devstack@n-api.service[103996]: machine: x86_64 Jul 19 22:14:16.193144 n-d-847009-3 devstack@n-api.service[103996]: clock source: unix Jul 19 22:14:16.193144 n-d-847009-3 devstack@n-api.service[103996]: pcre jit disabled Jul 19 22:14:16.193144 n-d-847009-3 devstack@n-api.service[103996]: detected number of CPU cores: 4 Jul 19 22:14:16.193144 n-d-847009-3 devstack@n-api.service[103996]: current working directory: / Jul 19 22:14:16.193144 n-d-847009-3 devstack@n-api.service[103996]: detected binary path: /usr/bin/uwsgi-core Jul 19 22:14:16.193816 n-d-847009-3 devstack@n-api.service[103996]: your processes number limit is 47680 Jul 19 22:14:16.193816 n-d-847009-3 devstack@n-api.service[103996]: your memory page size is 4096 bytes Jul 19 22:14:16.193816 n-d-847009-3 devstack@n-api.service[103996]: detected max file descriptor number: 2048 Jul 19 22:14:16.193816 n-d-847009-3 devstack@n-api.service[103996]: lock engine: pthread robust mutexes Jul 19 22:14:16.193816 n-d-847009-3 devstack@n-api.service[103996]: thunder lock: enabled Jul 19 22:14:16.193816 n-d-847009-3 devstack@n-api.service[103996]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 19 22:14:16.193816 n-d-847009-3 devstack@n-api.service[103996]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 19 22:14:16.244255 n-d-847009-3 devstack@n-api.service[103996]: Python main interpreter initialized at 0x55699f8d49c0 Jul 19 22:14:16.244255 n-d-847009-3 devstack@n-api.service[103996]: python threads support enabled Jul 19 22:14:16.244255 n-d-847009-3 devstack@n-api.service[103996]: your server socket listen backlog is limited to 100 connections Jul 19 22:14:16.244255 n-d-847009-3 devstack@n-api.service[103996]: your mercy for graceful operations on workers is 90 seconds Jul 19 22:14:16.244675 n-d-847009-3 devstack@n-api.service[103996]: mapped 403077 bytes (393 KB) for 2 cores Jul 19 22:14:16.244675 n-d-847009-3 devstack@n-api.service[103996]: *** Operational MODE: preforking *** Jul 19 22:14:16.244962 n-d-847009-3 devstack@n-api.service[103996]: *** uWSGI is running in multiple interpreter mode *** Jul 19 22:14:16.244962 n-d-847009-3 devstack@n-api.service[103996]: spawned uWSGI master process (pid: 103996) Jul 19 22:14:16.245191 n-d-847009-3 systemd[1]: Started Devstack devstack@n-api.service. Jul 19 22:14:16.245912 n-d-847009-3 devstack@n-api.service[103996]: spawned uWSGI worker 1 (pid: 103997, cores: 1) Jul 19 22:14:16.246095 n-d-847009-3 devstack@n-api.service[103996]: spawned uWSGI worker 2 (pid: 103998, cores: 1) Jul 19 22:14:16.246243 n-d-847009-3 devstack@n-api.service[103996]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 19 22:14:16.905779 n-d-847009-3 devstack@n-api.service[103998]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 22:14:16.916941 n-d-847009-3 devstack@n-api.service[103997]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 22:14:18.018080 n-d-847009-3 devstack@n-api.service[103998]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 22:14:18.018080 n-d-847009-3 devstack@n-api.service[103998]: from cryptography.utils import int_from_bytes Jul 19 22:14:18.018705 n-d-847009-3 devstack@n-api.service[103998]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 22:14:18.018705 n-d-847009-3 devstack@n-api.service[103998]: from cryptography.utils import int_from_bytes Jul 19 22:14:18.020442 n-d-847009-3 devstack@n-api.service[103997]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 22:14:18.020442 n-d-847009-3 devstack@n-api.service[103997]: from cryptography.utils import int_from_bytes Jul 19 22:14:18.020863 n-d-847009-3 devstack@n-api.service[103997]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 22:14:18.020863 n-d-847009-3 devstack@n-api.service[103997]: from cryptography.utils import int_from_bytes Jul 19 22:14:20.482470 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 22:14:20.483159 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 22:14:20.483265 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 22:14:20.483590 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 22:14:20.483844 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 22:14:20.484225 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.484375 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 22:14:20.484728 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.484818 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 22:14:20.484897 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.485139 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 22:14:20.485243 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.485462 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.485557 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 22:14:20.485739 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 22:14:20.485834 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.486068 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.486161 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.486381 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.486477 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.486706 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.486811 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.486966 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.487075 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.487307 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.487397 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.487627 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-847009-3 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.487722 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.487944 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.488040 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.488247 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.488333 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.488552 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.488639 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.488829 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.488960 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.489140 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.489275 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.489458 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.489670 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-847009-3 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.489797 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.489928 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.490054 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.490250 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.491517 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.491517 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.491798 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.491932 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.492057 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.492181 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.492317 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.492450 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.492574 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.492574 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.492809 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.492940 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.493072 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.493192 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.493315 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.493450 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.493587 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.493710 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.493834 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.493957 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.494088 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.494221 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-847009-3 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.494345 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.494468 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.494591 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.494713 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.494826 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.494995 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.495159 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.495159 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.495412 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.495412 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.495648 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-847009-3 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.495771 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.495896 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.496583 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.496793 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.497024 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.497312 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.497497 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.497629 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.497774 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.497900 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.498033 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.498159 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.498336 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.498476 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.498654 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.498784 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.498953 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.499096 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.499285 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.499433 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.499592 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.499728 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.499908 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.500040 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.500209 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.500348 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.500513 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.500642 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.500767 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.500898 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.501061 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.501200 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.501380 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.501510 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.501697 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.501826 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.501997 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.502126 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.502255 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.502380 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.502505 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.502630 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.502793 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.502936 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.503135 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.503282 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.503418 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.503554 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.503714 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.503842 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.503966 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.504091 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.504266 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.504405 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.504583 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.504714 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.504883 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.505010 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.505185 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.505316 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.505485 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.505619 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.505790 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.505925 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.506094 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.506233 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.506396 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.506525 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.506697 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.506826 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.507000 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.507166 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.507344 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.507497 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.507653 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.507761 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.507955 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.508048 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.508264 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.508362 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.508579 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.508675 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.508888 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.508972 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.509197 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.509292 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.509498 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.509592 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.509801 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.509893 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.510102 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.510195 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.510403 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.510507 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.510718 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.510805 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.511032 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.511136 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.511368 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.511474 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.511695 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.511786 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.512022 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.512107 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.512341 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.512480 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.512674 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.512818 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.512976 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.513107 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.513248 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.513375 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.513500 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.513670 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.513801 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.513969 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.514112 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.514272 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.514415 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.514574 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.514705 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.514877 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.515016 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.515200 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.515360 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.515486 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.515611 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.515790 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.516002 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.516131 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.516255 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.516379 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.516503 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.516664 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.516795 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.516978 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.517108 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.517283 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.517440 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.517645 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.517775 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.517910 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.518035 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.518159 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.518292 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.518431 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.518567 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.518740 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.518877 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.519024 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.519211 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.519351 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.519477 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.519657 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.519794 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.519962 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.520090 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.520260 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.520388 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.520562 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.520720 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.520847 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.520971 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.521151 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.521282 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.521463 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.521590 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.521755 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.521882 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.522057 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.522194 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.522354 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.522487 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.522656 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.522783 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.522952 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.523080 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.523253 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.523377 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.523555 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.523695 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.523851 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.523981 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.524149 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.524278 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.524442 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.524579 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.524739 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.524867 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.525030 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.525165 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.525327 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.525464 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.525624 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.525753 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.525922 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.526050 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.526215 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.526355 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.526514 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.526642 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.526828 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.526958 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.527677 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.527990 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.528197 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.528403 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.528568 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.528714 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.528852 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:14:20.528979 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.529104 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.529236 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.529379 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.529507 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.529641 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.529767 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.529891 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.530016 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.530140 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.530299 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.530438 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.530620 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.530750 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.530929 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.531058 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.531264 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.531397 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.531571 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.531702 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.531885 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.532027 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.532199 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.532329 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.532524 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.532656 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.532837 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.532980 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.533146 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.533274 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.533458 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.533649 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.533790 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.533923 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.534058 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.534183 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.534375 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.534511 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.534690 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.534820 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.534998 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.535171 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.535349 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.535476 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.535668 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.535816 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.535978 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.536107 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.536296 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.536432 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.536613 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.536823 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.536952 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.537077 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.537200 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.537324 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.537504 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.537635 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.537821 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.537965 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.538168 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.538304 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.538430 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.538563 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.538715 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.538846 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.539032 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.539178 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.539362 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.539504 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.539667 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.539803 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.539972 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.540100 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.540275 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.540410 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.540577 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.540705 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.540887 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.541017 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.541195 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.541325 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.541505 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.541633 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.541819 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.541955 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.542126 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.542262 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.542433 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.542562 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.542741 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.542896 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.543719 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.543874 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.544033 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.544168 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.544412 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.544566 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.544702 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.544828 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.544953 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.545084 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.545212 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.545345 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.545513 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.545643 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.545814 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.545950 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.546131 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.546271 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.546453 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.546584 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.546757 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.546887 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.547070 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.547243 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.547402 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.547531 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.547702 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.547838 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.548008 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.548151 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.548348 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.548477 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.548611 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.548737 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.548894 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.549023 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.549198 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.549334 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.549499 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.549627 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.549815 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.549937 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.550116 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.550245 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.550415 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.550542 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.550723 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.550851 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.551025 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.551186 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.551356 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.551496 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.551664 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.551792 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.551971 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.552108 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.552277 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.552414 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.552585 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.552713 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.552890 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.553018 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.553215 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.553360 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.553527 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.553657 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.553828 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.553956 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.554150 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.554289 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.554471 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.554601 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.554771 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.554899 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.555074 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.555223 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.555409 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.555540 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.555712 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.555841 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.556015 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.556169 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.556316 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.556453 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.556616 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.556753 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.556914 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.557043 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.557213 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.557341 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.557510 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.557638 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.557809 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.557940 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.558108 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.558235 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.558434 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.558566 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.558745 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.558847 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.559173 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.559283 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.559501 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.559613 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.559810 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.559900 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.560114 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.560200 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.560418 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.560518 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.560722 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.560807 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.561063 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.561150 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.561367 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.561467 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.561710 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.561803 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.562023 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.562109 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.562338 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.562424 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.562648 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.562733 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.562955 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.563041 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.563288 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.563386 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.563591 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.563683 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.563901 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.564007 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.564206 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.564291 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.564511 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.564594 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.564816 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.564908 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.565122 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.565208 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.565430 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.565515 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.565735 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.565828 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.566040 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.566128 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.566354 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.566523 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.566677 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.566827 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.566966 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.567156 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.567306 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.567445 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.567593 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.567741 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.567918 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.568066 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.568230 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.568374 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.568540 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.568760 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.568906 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.569045 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.569183 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.569321 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.569458 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.569604 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.569752 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.569891 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.570028 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.570166 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.570319 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.570468 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.570606 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.570742 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.570887 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.571028 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.571216 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.571360 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.571524 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.571670 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.571808 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.571945 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.572118 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.572266 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.572416 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.572553 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.572720 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.572866 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.573018 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.573157 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.573337 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.573484 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.573655 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.573801 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.573952 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.574110 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.574293 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.574456 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.574693 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.574846 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.574986 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.575171 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.575319 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.575457 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.575596 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.575751 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.575893 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.576031 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.576192 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.576339 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.576488 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.576637 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.576776 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.576921 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.577078 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.577217 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.577365 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.577504 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.577643 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.577780 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.577943 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.578090 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.578261 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.578401 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.578539 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.578685 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.578917 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.579133 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.579297 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.579437 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.579575 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.579714 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.579852 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.579990 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.580137 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.580286 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.580432 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.580570 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.580718 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.580858 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.581005 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.581155 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.581295 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.581433 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.581571 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.581718 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.581859 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.581995 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.582152 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.582292 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.582430 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.582578 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.582725 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.582863 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.583002 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.583167 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.583378 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.583546 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.583695 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.583833 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.583972 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.584131 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.584279 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.584431 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.584570 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.584707 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.584845 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.584983 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.585167 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.585315 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.585454 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.585599 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.585738 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.585883 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.586046 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.586186 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.586334 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.586473 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.586618 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.586756 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.586903 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.587043 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.587218 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.587369 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.587514 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.587659 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.587817 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.587956 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.588095 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.588232 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.588377 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.588524 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.588663 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.588806 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.589037 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.589185 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.589333 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.589481 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.590282 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.590450 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.590700 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.590845 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.591017 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.591194 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.591413 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.591558 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.591734 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.591892 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.592060 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.592215 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.592393 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.592631 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.592772 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.592918 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.593057 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.593288 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.593443 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.593593 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.593882 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.594038 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.594179 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.594362 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.594509 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.594763 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.594925 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.595143 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.595307 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.595450 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.595661 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.595815 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.596216 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.596489 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.596637 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.596810 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.597063 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.597221 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.597409 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.597627 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.597775 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.598021 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.598176 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.598317 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.598488 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.598635 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.598804 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.598950 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.599231 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.599381 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.599522 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.599662 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.599812 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.599959 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.600195 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.600351 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.600561 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.600744 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.600891 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.601154 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.601301 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.601477 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.601624 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.601772 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.601911 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.602069 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.602209 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.602354 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.602503 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.602642 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.602780 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.602939 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.603081 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.603301 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.603442 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.603580 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.603729 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.603889 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.604029 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.604167 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.604304 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.604442 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.604592 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.604731 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.604871 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.605016 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.605156 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.605314 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.606139 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.606310 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.606464 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.606603 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.606741 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.606880 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.607028 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.607194 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.607338 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.607476 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.607626 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.607765 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.607912 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.608053 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.608198 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.608348 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.608486 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.608640 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.608780 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.608918 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.609058 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.609213 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.609424 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.609579 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.609728 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.609875 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.610014 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.610162 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.610342 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.610548 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.610700 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.610839 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.610978 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.611156 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.611305 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.611470 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.611609 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.611747 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.611898 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.612037 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.612195 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.612336 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.612475 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.612613 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.612759 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.612912 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.613065 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.613205 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.613352 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.613491 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.613631 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.613776 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.613929 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.614078 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.614225 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.614366 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.614505 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.614643 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.614790 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.614930 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.615069 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.615236 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.615378 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.615533 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.615681 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.615828 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.615984 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.616123 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.616262 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.616414 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.616554 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.616693 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.616831 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.616969 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.617107 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.617255 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.617402 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.617550 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.617689 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.617840 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.617987 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.618134 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.618274 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.618420 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.618561 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.618699 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.618846 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.618986 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.619157 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.619315 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.619553 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.619702 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.619927 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.620068 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.620214 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.620352 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.620490 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.620629 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.620784 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.620982 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.621186 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.621338 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.621485 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.621633 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.621798 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.621798 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.622071 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.622209 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.622347 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.622495 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.622635 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.622775 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.622920 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.623064 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.623233 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.623388 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.623538 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.623688 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.623828 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.623966 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.624103 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.624254 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.624393 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.624538 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.624676 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.624815 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.624953 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.625099 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.625238 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.625384 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.625534 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.625672 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.625819 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.625958 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.626095 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.626233 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.626370 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.626515 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.626663 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.626802 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.626949 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.627087 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.627304 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.627456 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.627604 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.627744 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.627889 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.628035 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.628173 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.628319 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.628467 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.628606 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.628744 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.628882 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.629021 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.629021 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.629305 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.629305 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.629652 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.629799 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.629947 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.630096 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.630235 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.630373 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.630518 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.630518 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.630793 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.630946 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.631123 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.631279 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.631425 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.631425 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.631700 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.631862 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.632009 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.632155 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.632300 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.632445 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.632598 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.632744 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.632896 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.633060 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.633214 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.633366 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.633520 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.633665 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.633818 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.633963 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.634107 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.634253 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.634411 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.634558 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.634710 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.634863 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.635020 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.635225 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.635386 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.635533 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.635676 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.635827 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.635972 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.636125 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.636270 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.636422 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.636638 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.636804 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.637082 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.637250 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.637399 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.637545 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.637756 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.637907 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.638052 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.638206 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.638359 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.638506 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.638650 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.638802 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.638948 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.639134 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.639290 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.639435 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.639580 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.639825 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.639825 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.640124 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.640270 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.640415 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.640570 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.640716 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.640874 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.641019 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.641174 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.641326 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.641472 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.641626 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.641780 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.641939 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.642086 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.642231 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.642231 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.642515 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.642670 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.642816 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.642816 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.643159 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.643159 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.643461 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.643629 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.643784 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.643948 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.644094 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.644239 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.644384 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.644576 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.644748 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.644895 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.645050 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.645195 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.645415 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.645415 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.645721 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.645870 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.646014 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.646159 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.646304 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.646449 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.646602 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.646748 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.646901 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.647057 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.647235 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.647382 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.647540 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.647540 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.647817 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.647817 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.648103 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.648261 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.648414 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.648559 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.648704 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.648704 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.648998 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.649153 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.649300 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.649451 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.649596 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.649741 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.649972 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.650136 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.650284 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.650429 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.650581 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.650727 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.650884 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.651048 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.651250 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.651409 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.651563 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.651716 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.651871 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.652017 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.652682 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.652846 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.653010 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.653166 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.653321 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.653478 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.653623 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.653775 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.653921 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.654072 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.654227 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.654374 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.654519 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.654664 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.654809 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.654954 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.655136 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.655293 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.655449 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.655596 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.655741 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.655902 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.656050 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.656197 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.656343 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.656488 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.656764 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.656933 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.657082 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.657227 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.657372 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.657528 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.657674 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.657832 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.657977 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.657977 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.658253 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.658253 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.658531 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.658724 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.658872 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.659017 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.659209 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.659375 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.659538 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.659686 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.659831 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.659995 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.660213 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.660374 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.660531 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.660678 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.660830 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.660976 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.661121 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.661264 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.661429 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.661577 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.661722 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.661875 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.662020 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.662180 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.662336 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.662483 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.662675 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.662827 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.662983 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.663168 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.663323 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.663483 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.663630 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.663776 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.663921 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.664079 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.664225 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.664370 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.664515 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.664661 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.664805 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.664959 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.665104 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.665256 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.665413 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.665558 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.665704 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.665926 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.666075 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.666228 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.666374 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.666531 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.666686 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.666840 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.666993 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.667169 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.667337 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.667484 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.667641 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.667834 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.668514 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.668698 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.668897 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.669046 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.669201 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.669347 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.669491 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.669636 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.669780 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.669938 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.670092 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.670092 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.670476 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.670624 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.670778 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.670934 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.671080 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.671262 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.671426 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.671581 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.671727 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.671884 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.672050 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.672203 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.672356 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.672502 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.672646 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.672800 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.672956 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.673113 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.673258 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.673409 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.673597 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.673824 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.673991 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.674139 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.674284 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.674430 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.674587 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.674734 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.674879 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.675025 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.675215 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.675366 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.675523 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.675670 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.675825 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.675971 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.676122 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.676277 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.676438 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.676600 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.676747 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.676899 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.677052 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.677211 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.677358 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.677502 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.677657 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.677803 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.677948 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.678102 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.678248 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.678393 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.678538 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.678684 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.678837 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.678991 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.679183 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.679335 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.679481 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.679648 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.679807 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.679953 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.680104 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.680250 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.680481 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.680645 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.680801 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.680956 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.681102 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.681247 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.681402 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.681557 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.681704 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.681848 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.681992 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.682138 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.682283 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.682436 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.682584 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.682729 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.682881 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.683031 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.683235 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.683437 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.683437 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.683810 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.683963 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.684110 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.684110 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.684401 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.684547 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.684693 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.684846 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.684992 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.685144 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.685337 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.685488 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.685648 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.685794 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.685939 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.686092 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.686238 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.686384 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.686528 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.686686 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.686840 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.686986 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.687156 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.687335 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.687483 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.687628 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.687628 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.687925 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.687925 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.688200 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.688344 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.688487 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.688640 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.688788 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.688932 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.689077 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.689231 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.689376 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.689534 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.689680 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.689826 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.689970 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.690115 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.690271 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.690417 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.690649 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.690804 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.690951 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.691151 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.691336 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.691485 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.691631 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.691775 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.691921 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.691921 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.692205 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.692352 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.692497 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.692641 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.692786 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.692949 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.693117 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.693264 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.693408 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.693553 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.693697 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.693854 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.694008 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.694154 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.694298 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.694442 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.694587 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.694740 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.694885 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.695039 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.695219 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.695366 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.695511 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.695673 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.695827 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.695973 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.696118 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.696263 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.696407 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.696560 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.696705 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.696849 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.697004 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.697150 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.697303 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.697448 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.697600 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.697746 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.697890 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.698034 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.698188 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.698342 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.698529 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.698680 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.698835 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.698987 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.699305 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.699458 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.699611 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.699776 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.699923 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.700069 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.700223 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.700370 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.700515 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.700676 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.700904 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.701078 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.701224 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.701224 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.701501 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.701645 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.701798 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.702026 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.702174 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.702318 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.702464 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.702610 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.702754 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.702913 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.702913 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.703228 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.703331 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.703417 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.703499 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.703603 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.703688 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.703767 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.703845 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.703924 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.704012 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.704093 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.704093 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.704237 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.704324 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.704412 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.704501 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.704582 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.704685 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.704769 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.704847 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.704933 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.705025 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.705105 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.705190 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.705270 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.705347 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.705565 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.705679 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.705867 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.705957 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.706167 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.706257 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.706472 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.706563 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.706778 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.706867 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.707083 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.707185 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.707414 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.707529 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.707721 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.707808 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.708030 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.708125 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.708335 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.708425 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.708641 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.708730 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.708949 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.709046 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.709254 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.709340 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.709557 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.709663 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.709863 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.709967 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.710164 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.710251 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.710469 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.710556 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.710779 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.710885 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.711092 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.711203 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.711414 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.711504 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.711746 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.711835 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.712060 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.712148 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.712377 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.712549 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.712710 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.712858 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.713024 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.713170 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.713316 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.713461 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.713618 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.713772 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.713919 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.714064 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.714210 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.714366 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.714511 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.715220 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.715448 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.715599 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.715772 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.715941 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.716199 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.716351 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.716508 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.716663 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.716822 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.716977 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.717126 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.717271 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.717496 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.717685 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.717849 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.717997 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.718151 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.718298 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.718444 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.718588 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.718746 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.718893 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.719050 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.719256 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.719404 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.719561 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.719715 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.719899 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.720065 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.720212 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.720357 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.720510 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.720666 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.720812 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.721302 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.721458 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.721605 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.721760 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.721918 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.722072 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.722218 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.722372 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.722519 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.722676 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.722823 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.722968 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.723140 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.723295 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.723453 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.723609 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.723755 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.723910 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.724056 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.724201 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.724345 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.724500 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.724646 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.724790 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.724934 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.725078 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.725232 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.725378 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.725523 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.725678 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.725822 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.725967 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.726121 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.726267 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.726411 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.726556 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.726700 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.726852 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.727005 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.727170 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.727332 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.727478 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.727634 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.727780 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.727934 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.728079 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.728223 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.728223 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.728499 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.728499 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.728786 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.728950 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.729102 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.729248 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.729392 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.729631 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.729781 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.729927 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.730072 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.730216 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.730918 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.731079 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.731262 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.731498 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.731650 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.731796 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.731951 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.732110 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.732256 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.732401 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.732589 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.732744 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.732901 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.733055 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.733202 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.733346 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.733491 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.733636 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.733789 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.733937 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.734099 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.734245 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.734391 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.734536 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.734690 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.734843 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.734990 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.735176 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.735332 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.735495 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.735656 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.735808 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.735966 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.736112 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.736257 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.736415 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.736561 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.736714 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.736866 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.737013 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.737165 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.737319 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.737474 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.737619 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.737764 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.737927 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.738087 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.738234 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.738387 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.738538 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.738684 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.738829 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.738991 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.738991 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.739318 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.739465 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.739619 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.739780 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.739934 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.740081 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.740227 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.740371 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.740517 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.740517 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 22:14:20.740802 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.740802 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.740802 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.741216 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.741367 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.741708 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.742017 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.742365 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.742692 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.743004 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.743408 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.743715 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:14:20.743958 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 22:14:20.802532 n-d-847009-3 devstack@n-api.service[103997]: INFO dbcounter [None req-ea381e99-fc16-4128-bd23-448c88ef45b8 None None] Registered counter for database nova_api Jul 19 22:14:20.806516 n-d-847009-3 devstack@n-api.service[103998]: INFO dbcounter [None req-bdf40008-994e-4db5-b372-70d97a4c38f7 None None] Registered counter for database nova_api Jul 19 22:14:20.916695 n-d-847009-3 devstack@n-api.service[103997]: DEBUG oslo_db.sqlalchemy.engines [None req-ea381e99-fc16-4128-bd23-448c88ef45b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103997) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 22:14:20.918845 n-d-847009-3 devstack@n-api.service[103998]: DEBUG oslo_db.sqlalchemy.engines [None req-bdf40008-994e-4db5-b372-70d97a4c38f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 22:14:20.923915 n-d-847009-3 devstack@n-api.service[103997]: DEBUG dbcounter [-] [103997] Writer thread running {{(pid=103997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 22:14:20.925167 n-d-847009-3 devstack@n-api.service[103998]: DEBUG dbcounter [-] [103998] Writer thread running {{(pid=103998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 22:14:20.979884 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.context [None req-bdf40008-994e-4db5-b372-70d97a4c38f7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9ec50c5-1e53-4d76-a6eb-599548551fc7(cell1) {{(pid=103998) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 22:14:20.980094 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.context [None req-ea381e99-fc16-4128-bd23-448c88ef45b8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9ec50c5-1e53-4d76-a6eb-599548551fc7(cell1) {{(pid=103997) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 22:14:20.984436 n-d-847009-3 devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-bdf40008-994e-4db5-b372-70d97a4c38f7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:14:20.984553 n-d-847009-3 devstack@n-api.service[103997]: DEBUG oslo_concurrency.lockutils [None req-ea381e99-fc16-4128-bd23-448c88ef45b8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:14:20.986000 n-d-847009-3 devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-bdf40008-994e-4db5-b372-70d97a4c38f7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:14:20.986140 n-d-847009-3 devstack@n-api.service[103997]: DEBUG oslo_concurrency.lockutils [None req-ea381e99-fc16-4128-bd23-448c88ef45b8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:14:20.986790 n-d-847009-3 devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-bdf40008-994e-4db5-b372-70d97a4c38f7 None None] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:14:20.986911 n-d-847009-3 devstack@n-api.service[103997]: DEBUG oslo_concurrency.lockutils [None req-ea381e99-fc16-4128-bd23-448c88ef45b8 None None] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:14:20.988897 n-d-847009-3 devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-bdf40008-994e-4db5-b372-70d97a4c38f7 None None] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:14:20.989020 n-d-847009-3 devstack@n-api.service[103997]: DEBUG oslo_concurrency.lockutils [None req-ea381e99-fc16-4128-bd23-448c88ef45b8 None None] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:14:20.990838 n-d-847009-3 devstack@n-api.service[103998]: INFO dbcounter [None req-bdf40008-994e-4db5-b372-70d97a4c38f7 None None] Registered counter for database nova_cell0 Jul 19 22:14:20.990947 n-d-847009-3 devstack@n-api.service[103997]: INFO dbcounter [None req-ea381e99-fc16-4128-bd23-448c88ef45b8 None None] Registered counter for database nova_cell0 Jul 19 22:14:20.994629 n-d-847009-3 devstack@n-api.service[103997]: INFO dbcounter [None req-ea381e99-fc16-4128-bd23-448c88ef45b8 None None] Registered counter for database nova_cell1 Jul 19 22:14:20.994886 n-d-847009-3 devstack@n-api.service[103998]: INFO dbcounter [None req-bdf40008-994e-4db5-b372-70d97a4c38f7 None None] Registered counter for database nova_cell1 Jul 19 22:14:21.002545 n-d-847009-3 devstack@n-api.service[103998]: DEBUG oslo_db.sqlalchemy.engines [None req-bdf40008-994e-4db5-b372-70d97a4c38f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 22:14:21.004248 n-d-847009-3 devstack@n-api.service[103997]: DEBUG oslo_db.sqlalchemy.engines [None req-ea381e99-fc16-4128-bd23-448c88ef45b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103997) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 22:14:21.005885 n-d-847009-3 devstack@n-api.service[103997]: DEBUG oslo_db.sqlalchemy.engines [None req-ea381e99-fc16-4128-bd23-448c88ef45b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103997) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 22:14:21.007294 n-d-847009-3 devstack@n-api.service[103998]: DEBUG oslo_db.sqlalchemy.engines [None req-bdf40008-994e-4db5-b372-70d97a4c38f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 22:14:21.011182 n-d-847009-3 devstack@n-api.service[103998]: DEBUG dbcounter [-] [103998] Writer thread running {{(pid=103998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 22:14:21.011472 n-d-847009-3 devstack@n-api.service[103997]: DEBUG dbcounter [-] [103997] Writer thread running {{(pid=103997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 22:14:21.014259 n-d-847009-3 devstack@n-api.service[103997]: DEBUG dbcounter [-] [103997] Writer thread running {{(pid=103997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 22:14:21.151496 n-d-847009-3 devstack@n-api.service[103998]: DEBUG dbcounter [-] [103998] Writer thread running {{(pid=103998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 22:14:21.157881 n-d-847009-3 devstack@n-api.service[103997]: INFO dbcounter [None req-ea381e99-fc16-4128-bd23-448c88ef45b8 None None] Registered counter for database nova_cell0 Jul 19 22:14:21.160713 n-d-847009-3 devstack@n-api.service[103998]: INFO dbcounter [None req-bdf40008-994e-4db5-b372-70d97a4c38f7 None None] Registered counter for database nova_cell0 Jul 19 22:14:21.166637 n-d-847009-3 devstack@n-api.service[103997]: DEBUG oslo_db.sqlalchemy.engines [None req-ea381e99-fc16-4128-bd23-448c88ef45b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103997) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 22:14:21.171461 n-d-847009-3 devstack@n-api.service[103998]: DEBUG oslo_db.sqlalchemy.engines [None req-bdf40008-994e-4db5-b372-70d97a4c38f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 22:14:21.172328 n-d-847009-3 devstack@n-api.service[103997]: DEBUG dbcounter [-] [103997] Writer thread running {{(pid=103997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 22:14:21.175891 n-d-847009-3 devstack@n-api.service[103998]: DEBUG dbcounter [-] [103998] Writer thread running {{(pid=103998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 22:14:21.509411 n-d-847009-3 devstack@n-api.service[103997]: WARNING keystonemiddleware.auth_token [None req-ea381e99-fc16-4128-bd23-448c88ef45b8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 22:14:21.509976 n-d-847009-3 devstack@n-api.service[103998]: WARNING keystonemiddleware.auth_token [None req-bdf40008-994e-4db5-b372-70d97a4c38f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 22:14:21.516842 n-d-847009-3 devstack@n-api.service[103997]: WARNING keystonemiddleware.auth_token [None req-ea381e99-fc16-4128-bd23-448c88ef45b8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 22:14:21.517257 n-d-847009-3 devstack@n-api.service[103998]: WARNING keystonemiddleware.auth_token [None req-bdf40008-994e-4db5-b372-70d97a4c38f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 22:14:21.859392 n-d-847009-3 devstack@n-api.service[103998]: WARNING keystonemiddleware.auth_token [None req-bdf40008-994e-4db5-b372-70d97a4c38f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 22:14:21.860088 n-d-847009-3 devstack@n-api.service[103997]: WARNING keystonemiddleware.auth_token [None req-ea381e99-fc16-4128-bd23-448c88ef45b8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 22:14:21.865345 n-d-847009-3 devstack@n-api.service[103998]: WARNING keystonemiddleware.auth_token [None req-bdf40008-994e-4db5-b372-70d97a4c38f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 22:14:21.865950 n-d-847009-3 devstack@n-api.service[103997]: WARNING keystonemiddleware.auth_token [None req-ea381e99-fc16-4128-bd23-448c88ef45b8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 22:14:21.870567 n-d-847009-3 devstack@n-api.service[103998]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55699f8d49c0 pid: 103998 (default app) Jul 19 22:14:21.871201 n-d-847009-3 devstack@n-api.service[103997]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55699f8d49c0 pid: 103997 (default app) Jul 19 22:14:21.872929 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-bdf40008-994e-4db5-b372-70d97a4c38f7 None None] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:14:21.874111 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-bdf40008-994e-4db5-b372-70d97a4c38f7 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001757 Jul 19 22:14:21.874524 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Tue Jul 19 22:14:21 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:15:38.590430 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-ea381e99-fc16-4128-bd23-448c88ef45b8 None None] Calling method '>' {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:15:38.591793 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-ea381e99-fc16-4128-bd23-448c88ef45b8 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001983 Jul 19 22:15:38.592356 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 19 22:15:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:15:38.604212 n-d-847009-3 devstack@n-api.service[103998]: DEBUG dbcounter [-] [103998] Writing DB stats nova_api:SELECT=3 {{(pid=103998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:15:38.605377 n-d-847009-3 devstack@n-api.service[103998]: DEBUG dbcounter [-] [103998] Writing DB stats nova_cell0:SELECT=3 {{(pid=103998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:15:38.606106 n-d-847009-3 devstack@n-api.service[103998]: DEBUG dbcounter [-] [103998] Writing DB stats nova_cell1:SELECT=3 {{(pid=103998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:15:38.607297 n-d-847009-3 devstack@n-api.service[103998]: DEBUG dbcounter [-] [103998] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:15:39.482453 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-742d7671-cfbd-4db1-841a-17f90abd49d7 admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:15:39.512855 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-742d7671-cfbd-4db1-841a-17f90abd49d7 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.914140 Jul 19 22:15:39.513593 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 2/3] 10.222.0.25 () {60 vars in 1291 bytes} [Tue Jul 19 22:15:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:15:41.798253 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-ea381e99-fc16-4128-bd23-448c88ef45b8 None None] Calling method '>' {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:15:41.799329 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-ea381e99-fc16-4128-bd23-448c88ef45b8 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 19 22:15:41.799936 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 2/4] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 19 22:15:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:15:42.271860 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-0653b7f9-6d8e-4b93-bc20-113fbfe7bf22 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "id": "c1"}} {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:15:42.290858 n-d-847009-3 devstack@n-api.service[103998]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:15:42.290858 n-d-847009-3 devstack@n-api.service[103998]: warnings.warn(msg) Jul 19 22:15:42.320040 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-0653b7f9-6d8e-4b93-bc20-113fbfe7bf22 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.510631 Jul 19 22:15:42.323409 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 3/5] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 19 22:15:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:15:42.335324 n-d-847009-3 devstack@n-api.service[103997]: DEBUG dbcounter [-] [103997] Writing DB stats nova_api:SELECT=3 {{(pid=103997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:15:42.336496 n-d-847009-3 devstack@n-api.service[103997]: DEBUG dbcounter [-] [103997] Writing DB stats nova_cell0:SELECT=3 {{(pid=103997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:15:42.337304 n-d-847009-3 devstack@n-api.service[103997]: DEBUG dbcounter [-] [103997] Writing DB stats nova_cell1:SELECT=3 {{(pid=103997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:15:42.338260 n-d-847009-3 devstack@n-api.service[103997]: DEBUG dbcounter [-] [103997] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:15:42.548415 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-103233f7-50d0-4ff6-b4cc-a14f807b2e41 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:15:42.550828 n-d-847009-3 devstack@n-api.service[103997]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:15:42.550828 n-d-847009-3 devstack@n-api.service[103997]: warnings.warn(msg) Jul 19 22:15:42.620381 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-103233f7-50d0-4ff6-b4cc-a14f807b2e41 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290350 Jul 19 22:15:42.620977 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 3/6] 10.222.0.25 () {64 vars in 1335 bytes} [Tue Jul 19 22:15:42 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:15:44.954719 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-0653b7f9-6d8e-4b93-bc20-113fbfe7bf22 admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:15:44.955741 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-0653b7f9-6d8e-4b93-bc20-113fbfe7bf22 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Jul 19 22:15:44.956352 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 4/7] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 19 22:15:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:15:45.715683 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-c9631405-5e9d-4e30-8b41-4974ec19e589 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "disk": 5, "swap": 0, "ram": 512, "vcpus": 1}} {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:15:45.734346 n-d-847009-3 devstack@n-api.service[103997]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:15:45.734346 n-d-847009-3 devstack@n-api.service[103997]: warnings.warn(msg) Jul 19 22:15:45.754864 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-c9631405-5e9d-4e30-8b41-4974ec19e589 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.792760 Jul 19 22:15:45.755578 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 4/8] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 19 22:15:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 22:15:45.773115 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-eecccfc5-2c1c-4686-8060-cd394eb717f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:15:45.775191 n-d-847009-3 devstack@n-api.service[103998]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:15:45.775191 n-d-847009-3 devstack@n-api.service[103998]: warnings.warn(msg) Jul 19 22:15:45.824706 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-eecccfc5-2c1c-4686-8060-cd394eb717f3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.060333 Jul 19 22:15:45.825469 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 5/9] 10.222.0.25 () {64 vars in 1335 bytes} [Tue Jul 19 22:15:45 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:15:48.486811 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-c9631405-5e9d-4e30-8b41-4974ec19e589 admin admin] Calling method '>' {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:15:48.488503 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-c9631405-5e9d-4e30-8b41-4974ec19e589 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002131 Jul 19 22:15:48.489085 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 19 22:15:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:15:49.032162 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-ed61a333-45b6-4e5e-8bef-3ef31db1ca65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "id": "d2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "vcpus": 1}} {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:15:49.053275 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-ed61a333-45b6-4e5e-8bef-3ef31db1ca65 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.556648 Jul 19 22:15:49.061926 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 6/11] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 19 22:15:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:15:49.068718 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-44ebbeb9-6ff9-48e2-b3c6-363aa5c81ab4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:15:49.096345 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-44ebbeb9-6ff9-48e2-b3c6-363aa5c81ab4 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031738 Jul 19 22:15:49.106591 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 6/12] 10.222.0.25 () {64 vars in 1335 bytes} [Tue Jul 19 22:15:49 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:15:51.640541 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-ed61a333-45b6-4e5e-8bef-3ef31db1ca65 admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:15:51.641486 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-ed61a333-45b6-4e5e-8bef-3ef31db1ca65 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 19 22:15:51.641902 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 7/13] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 19 22:15:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:15:52.180241 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-c8c0b399-0a7e-41ec-9b60-fab842e7c937 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 10, "id": "d3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:15:52.201729 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-c8c0b399-0a7e-41ec-9b60-fab842e7c937 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.553788 Jul 19 22:15:52.203445 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 7/14] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 19 22:15:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:15:52.215067 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-8148297e-7c41-465b-9a55-bd273960851b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:15:52.240240 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-8148297e-7c41-465b-9a55-bd273960851b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029429 Jul 19 22:15:52.248065 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 8/15] 10.222.0.25 () {64 vars in 1335 bytes} [Tue Jul 19 22:15:52 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:15:54.500880 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-c8c0b399-0a7e-41ec-9b60-fab842e7c937 admin admin] Calling method '>' {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:15:54.501892 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-c8c0b399-0a7e-41ec-9b60-fab842e7c937 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 19 22:15:54.502487 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 8/16] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 19 22:15:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:15:54.997955 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-2f2f862a-960e-4140-b974-c23f0c7c858e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "name": "ds4G", "disk": 20, "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:15:55.027304 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-2f2f862a-960e-4140-b974-c23f0c7c858e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.511290 Jul 19 22:15:55.027998 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 9/17] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 19 22:15:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:15:55.039786 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-58150ad5-3db7-4038-9ee6-5b776e0fb2f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:15:55.065224 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-58150ad5-3db7-4038-9ee6-5b776e0fb2f6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028952 Jul 19 22:15:55.065813 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 9/18] 10.222.0.25 () {64 vars in 1335 bytes} [Tue Jul 19 22:15:55 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:15:57.432185 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-2f2f862a-960e-4140-b974-c23f0c7c858e admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:15:57.433918 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-2f2f862a-960e-4140-b974-c23f0c7c858e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002777 Jul 19 22:15:57.440047 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 10/19] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 19 22:15:57 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:15:57.905663 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-ed9a0c26-201a-4794-b6f1-5aabb61430b1 admin admin] Calling method '>' {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:15:57.930919 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-ed9a0c26-201a-4794-b6f1-5aabb61430b1 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.489673 Jul 19 22:15:57.931491 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 10/20] 10.222.0.25 () {60 vars in 1291 bytes} [Tue Jul 19 22:15:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:16:00.272698 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-2f2f862a-960e-4140-b974-c23f0c7c858e admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:00.273721 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-2f2f862a-960e-4140-b974-c23f0c7c858e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 19 22:16:00.274120 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 11/21] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 19 22:16:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:16:00.731124 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-e8bb6578-0e98-47e5-97f8-9de2e98cab19 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.tiny"}} {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:16:00.750364 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-e8bb6578-0e98-47e5-97f8-9de2e98cab19 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.468115 Jul 19 22:16:00.750920 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 11/22] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 19 22:16:00 2022] POST /compute/v2.1/flavors => generated 402 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:16:00.762735 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-c53bb348-9573-404b-8b31-44dc3357a220 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:16:00.786986 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-c53bb348-9573-404b-8b31-44dc3357a220 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027861 Jul 19 22:16:00.788325 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 12/23] 10.222.0.25 () {64 vars in 1332 bytes} [Tue Jul 19 22:16:00 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:16:03.461803 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-e8bb6578-0e98-47e5-97f8-9de2e98cab19 admin admin] Calling method '>' {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:03.463390 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-e8bb6578-0e98-47e5-97f8-9de2e98cab19 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002223 Jul 19 22:16:03.463922 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 12/24] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 19 22:16:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:16:03.923174 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-608105c7-a689-4496-a67d-60ba8289f978 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "2", "disk": 20, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:16:03.941187 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-608105c7-a689-4496-a67d-60ba8289f978 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.470333 Jul 19 22:16:03.941742 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 13/25] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 19 22:16:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:16:03.954958 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-120ffc27-51aa-4977-a733-3849e1976e2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:16:03.982839 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-120ffc27-51aa-4977-a733-3849e1976e2b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032743 Jul 19 22:16:03.983383 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 13/26] 10.222.0.25 () {64 vars in 1332 bytes} [Tue Jul 19 22:16:03 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:16:06.277255 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-608105c7-a689-4496-a67d-60ba8289f978 admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:06.278260 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-608105c7-a689-4496-a67d-60ba8289f978 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jul 19 22:16:06.278831 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 14/27] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 19 22:16:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:16:06.722284 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-566696a5-43ea-4252-b3ac-520a4e9b07ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "id": "3", "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:16:06.742179 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-566696a5-43ea-4252-b3ac-520a4e9b07ec admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.457826 Jul 19 22:16:06.742980 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 14/28] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 19 22:16:06 2022] POST /compute/v2.1/flavors => generated 406 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:16:06.755971 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-ed821aed-8a57-4ea7-9771-2a7ebcf1a03d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:16:06.778838 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-ed821aed-8a57-4ea7-9771-2a7ebcf1a03d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026620 Jul 19 22:16:06.783150 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 15/29] 10.222.0.25 () {64 vars in 1332 bytes} [Tue Jul 19 22:16:06 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:16:09.038416 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-566696a5-43ea-4252-b3ac-520a4e9b07ec admin admin] Calling method '>' {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:09.039648 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-566696a5-43ea-4252-b3ac-520a4e9b07ec admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002179 Jul 19 22:16:09.040058 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 15/30] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 19 22:16:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:16:09.443155 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-e9ae1e3f-ccbc-43d8-b8dc-ac25b709860b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "disk": 80, "vcpus": 4, "swap": 0, "ram": 8192, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "rxtx_factor": 1.0}} {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:16:09.449426 n-d-847009-3 devstack@n-api.service[103998]: DEBUG dbcounter [-] [103998] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:16:09.464014 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-e9ae1e3f-ccbc-43d8-b8dc-ac25b709860b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.417478 Jul 19 22:16:09.464572 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 16/31] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 19 22:16:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 22:16:09.476604 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-f2e5981b-8095-410d-bbd8-de42aa07847c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:16:09.501844 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-f2e5981b-8095-410d-bbd8-de42aa07847c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028875 Jul 19 22:16:09.502564 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 16/32] 10.222.0.25 () {64 vars in 1332 bytes} [Tue Jul 19 22:16:09 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:16:11.840451 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-e9ae1e3f-ccbc-43d8-b8dc-ac25b709860b admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:11.842298 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-e9ae1e3f-ccbc-43d8-b8dc-ac25b709860b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002275 Jul 19 22:16:11.842840 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 17/33] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 19 22:16:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:16:12.291614 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-7bcfce58-9926-4c5f-9e5f-43219b4ef558 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "id": "5", "name": "m1.xlarge", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "rxtx_factor": 1.0, "disk": 160}} {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:16:12.313874 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-7bcfce58-9926-4c5f-9e5f-43219b4ef558 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.463482 Jul 19 22:16:12.314602 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 17/34] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 19 22:16:11 2022] POST /compute/v2.1/flavors => generated 408 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:16:12.328430 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-78b338ba-de7a-4414-a54e-448219516b10 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:16:12.352973 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-78b338ba-de7a-4414-a54e-448219516b10 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029895 Jul 19 22:16:12.354180 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 18/35] 10.222.0.25 () {64 vars in 1332 bytes} [Tue Jul 19 22:16:12 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:16:35.609280 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-7bcfce58-9926-4c5f-9e5f-43219b4ef558 admin admin] Calling method '>' {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:35.610297 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-7bcfce58-9926-4c5f-9e5f-43219b4ef558 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 19 22:16:35.610700 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 18/36] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 19 22:16:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:16:35.621836 n-d-847009-3 devstack@n-api.service[103998]: DEBUG dbcounter [-] [103998] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:16:36.003283 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-053288fe-6c1f-49a3-a9c8-9d6cef6f03cf admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:36.019885 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-053288fe-6c1f-49a3-a9c8-9d6cef6f03cf admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403089 Jul 19 22:16:36.020420 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 19/37] 10.222.0.25 () {60 vars in 1291 bytes} [Tue Jul 19 22:16:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:16:37.082698 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-7bcfce58-9926-4c5f-9e5f-43219b4ef558 admin admin] Calling method '>' {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:37.083769 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-7bcfce58-9926-4c5f-9e5f-43219b4ef558 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 19 22:16:37.084177 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 19/38] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 19 22:16:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:16:37.620148 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-fa53ece4-fa58-4539-ae15-8179c380c835 admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:37.625692 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.wsgi [None req-fa53ece4-fa58-4539-ae15-8179c380c835 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 19 22:16:37.628931 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-fa53ece4-fa58-4539-ae15-8179c380c835 admin admin] Request method failure captured: Jul 19 22:16:37.628931 n-d-847009-3 devstack@n-api.service[103998]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 19 22:16:37.628931 n-d-847009-3 devstack@n-api.service[103998]: Accept: application/json Jul 19 22:16:37.628931 n-d-847009-3 devstack@n-api.service[103998]: Accept-Encoding: gzip, deflate Jul 19 22:16:37.628931 n-d-847009-3 devstack@n-api.service[103998]: Connection: keep-alive Jul 19 22:16:37.628931 n-d-847009-3 devstack@n-api.service[103998]: Content-Length: 0 Jul 19 22:16:37.628931 n-d-847009-3 devstack@n-api.service[103998]: Host: 10.222.0.25 Jul 19 22:16:37.628931 n-d-847009-3 devstack@n-api.service[103998]: Openstack-Api-Version: compute 2.90 Jul 19 22:16:37.628931 n-d-847009-3 devstack@n-api.service[103998]: Openstack-System-Scope: None Jul 19 22:16:37.628931 n-d-847009-3 devstack@n-api.service[103998]: User-Agent: python-novaclient Jul 19 22:16:37.628931 n-d-847009-3 devstack@n-api.service[103998]: X-Auth-Token: gAAAAABi1y1EDh0xaUtTAw4qOgR7NbB3NHw4kReafBSBktr79z9u9uBSHhYgHW0YXpKaoWTWVZrsQaqd60AvFCTWji6jo7ScBjmQjqvSBxPXYx5GFeV7SdsTwnzYuXbRdBLYxCZp4lGt264f-gvk_8fnEYMCHm1AE3kpyB-MSFwo8evApR0hNt8 Jul 19 22:16:37.628931 n-d-847009-3 devstack@n-api.service[103998]: X-Domain-Id: None Jul 19 22:16:37.628931 n-d-847009-3 devstack@n-api.service[103998]: X-Domain-Name: None Jul 19 22:16:37.628931 n-d-847009-3 devstack@n-api.service[103998]: X-Identity-Status: Confirmed Jul 19 22:16:37.628931 n-d-847009-3 devstack@n-api.service[103998]: X-Is-Admin-Project: True Jul 19 22:16:37.628931 n-d-847009-3 devstack@n-api.service[103998]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 22:16:37.628931 n-d-847009-3 devstack@n-api.service[103998]: X-Project-Domain-Id: default Jul 19 22:16:37.628931 n-d-847009-3 devstack@n-api.service[103998]: X-Project-Domain-Name: Default Jul 19 22:16:37.628931 n-d-847009-3 devstack@n-api.service[103998]: X-Project-Id: 63d26bd69e8044be9c3bf92e1191c21c Jul 19 22:16:37.628931 n-d-847009-3 devstack@n-api.service[103998]: X-Project-Name: admin Jul 19 22:16:37.628931 n-d-847009-3 devstack@n-api.service[103998]: X-Role: admin,member,reader Jul 19 22:16:37.628931 n-d-847009-3 devstack@n-api.service[103998]: X-Roles: admin,member,reader Jul 19 22:16:37.630440 n-d-847009-3 devstack@n-api.service[103998]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_63d26bd69e8044be9c3bf92e1191c21c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63d26bd69e8044be9c3bf92e1191c21c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/63d26bd69e8044be9c3bf92e1191c21c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63d26bd69e8044be9c3bf92e1191c21c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:16:37.630440 n-d-847009-3 devstack@n-api.service[103998]: X-Tenant: admin Jul 19 22:16:37.630440 n-d-847009-3 devstack@n-api.service[103998]: X-Tenant-Id: 63d26bd69e8044be9c3bf92e1191c21c Jul 19 22:16:37.630440 n-d-847009-3 devstack@n-api.service[103998]: X-Tenant-Name: admin Jul 19 22:16:37.630440 n-d-847009-3 devstack@n-api.service[103998]: X-User: admin Jul 19 22:16:37.630440 n-d-847009-3 devstack@n-api.service[103998]: X-User-Domain-Id: default Jul 19 22:16:37.630440 n-d-847009-3 devstack@n-api.service[103998]: X-User-Domain-Name: Default Jul 19 22:16:37.630440 n-d-847009-3 devstack@n-api.service[103998]: X-User-Id: 12852d24772640aa843a2d7b8bb9a978 Jul 19 22:16:37.630440 n-d-847009-3 devstack@n-api.service[103998]: X-User-Name: admin Jul 19 22:16:37.630440 n-d-847009-3 devstack@n-api.service[103998]: method: > Jul 19 22:16:37.630440 n-d-847009-3 devstack@n-api.service[103998]: exception: Flavor 42 could not be found. Jul 19 22:16:37.630440 n-d-847009-3 devstack@n-api.service[103998]: action_args: {'id': '42'} Jul 19 22:16:37.630440 n-d-847009-3 devstack@n-api.service[103998]: {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:16:37.630440 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:16:37.631358 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 22:16:37.631358 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 22:16:37.631358 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 22:16:37.631358 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 22:16:37.631358 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:16:37.631358 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:16:37.631358 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 22:16:37.631358 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 22:16:37.631358 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 22:16:37.631358 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:16:37.631358 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 22:16:37.631358 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 22:16:37.631358 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 19 22:16:37.631358 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Jul 19 22:16:37.631358 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:16:37.631358 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Jul 19 22:16:37.631358 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:16:37.631358 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:16:37.631358 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:16:37.632743 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:16:37.632743 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:16:37.632743 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:16:37.632743 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:16:37.632743 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 22:16:37.632743 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:16:37.632743 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 19 22:16:37.632743 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Jul 19 22:16:37.632743 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:16:37.632743 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Jul 19 22:16:37.632743 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:16:37.632743 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:16:37.632743 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:16:37.632743 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:16:37.632743 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:16:37.632743 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 19 22:16:37.632743 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Jul 19 22:16:37.632743 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-fa53ece4-fa58-4539-ae15-8179c380c835 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:16:37.634193 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-fa53ece4-fa58-4539-ae15-8179c380c835 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.390814 Jul 19 22:16:37.634193 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 20/39] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Jul 19 22:16:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 22:16:37.640878 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-5390177c-ff53-4efc-a8ab-10d594ef6abe admin admin] Calling method '>' {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:37.643830 n-d-847009-3 devstack@n-api.service[103997]: DEBUG dbcounter [-] [103997] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:16:37.663754 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-5390177c-ff53-4efc-a8ab-10d594ef6abe admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026690 Jul 19 22:16:37.664322 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 20/40] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Jul 19 22:16:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:16:37.686500 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-c692074b-6405-4205-b470-2222def13879 admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:37.708684 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-c692074b-6405-4205-b470-2222def13879 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025680 Jul 19 22:16:37.709245 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 21/41] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Jul 19 22:16:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:16:37.719704 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-e06097ae-ab0c-42a7-a0ae-5727191c114a admin admin] Calling method '>' {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:37.726163 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.wsgi [None req-e06097ae-ab0c-42a7-a0ae-5727191c114a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 19 22:16:37.730572 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-e06097ae-ab0c-42a7-a0ae-5727191c114a admin admin] Request method failure captured: Jul 19 22:16:37.730572 n-d-847009-3 devstack@n-api.service[103997]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 19 22:16:37.730572 n-d-847009-3 devstack@n-api.service[103997]: Accept: application/json Jul 19 22:16:37.730572 n-d-847009-3 devstack@n-api.service[103997]: Accept-Encoding: gzip, deflate Jul 19 22:16:37.730572 n-d-847009-3 devstack@n-api.service[103997]: Connection: keep-alive Jul 19 22:16:37.730572 n-d-847009-3 devstack@n-api.service[103997]: Content-Length: 0 Jul 19 22:16:37.730572 n-d-847009-3 devstack@n-api.service[103997]: Host: 10.222.0.25 Jul 19 22:16:37.730572 n-d-847009-3 devstack@n-api.service[103997]: Openstack-Api-Version: compute 2.90 Jul 19 22:16:37.730572 n-d-847009-3 devstack@n-api.service[103997]: Openstack-System-Scope: None Jul 19 22:16:37.730572 n-d-847009-3 devstack@n-api.service[103997]: User-Agent: python-novaclient Jul 19 22:16:37.730572 n-d-847009-3 devstack@n-api.service[103997]: X-Auth-Token: gAAAAABi1y1EDh0xaUtTAw4qOgR7NbB3NHw4kReafBSBktr79z9u9uBSHhYgHW0YXpKaoWTWVZrsQaqd60AvFCTWji6jo7ScBjmQjqvSBxPXYx5GFeV7SdsTwnzYuXbRdBLYxCZp4lGt264f-gvk_8fnEYMCHm1AE3kpyB-MSFwo8evApR0hNt8 Jul 19 22:16:37.730572 n-d-847009-3 devstack@n-api.service[103997]: X-Domain-Id: None Jul 19 22:16:37.730572 n-d-847009-3 devstack@n-api.service[103997]: X-Domain-Name: None Jul 19 22:16:37.730572 n-d-847009-3 devstack@n-api.service[103997]: X-Identity-Status: Confirmed Jul 19 22:16:37.730572 n-d-847009-3 devstack@n-api.service[103997]: X-Is-Admin-Project: True Jul 19 22:16:37.730572 n-d-847009-3 devstack@n-api.service[103997]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 22:16:37.730572 n-d-847009-3 devstack@n-api.service[103997]: X-Project-Domain-Id: default Jul 19 22:16:37.730572 n-d-847009-3 devstack@n-api.service[103997]: X-Project-Domain-Name: Default Jul 19 22:16:37.730572 n-d-847009-3 devstack@n-api.service[103997]: X-Project-Id: 63d26bd69e8044be9c3bf92e1191c21c Jul 19 22:16:37.730572 n-d-847009-3 devstack@n-api.service[103997]: X-Project-Name: admin Jul 19 22:16:37.730572 n-d-847009-3 devstack@n-api.service[103997]: X-Role: admin,member,reader Jul 19 22:16:37.730572 n-d-847009-3 devstack@n-api.service[103997]: X-Roles: admin,member,reader Jul 19 22:16:37.732155 n-d-847009-3 devstack@n-api.service[103997]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_63d26bd69e8044be9c3bf92e1191c21c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63d26bd69e8044be9c3bf92e1191c21c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/63d26bd69e8044be9c3bf92e1191c21c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63d26bd69e8044be9c3bf92e1191c21c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:16:37.732155 n-d-847009-3 devstack@n-api.service[103997]: X-Tenant: admin Jul 19 22:16:37.732155 n-d-847009-3 devstack@n-api.service[103997]: X-Tenant-Id: 63d26bd69e8044be9c3bf92e1191c21c Jul 19 22:16:37.732155 n-d-847009-3 devstack@n-api.service[103997]: X-Tenant-Name: admin Jul 19 22:16:37.732155 n-d-847009-3 devstack@n-api.service[103997]: X-User: admin Jul 19 22:16:37.732155 n-d-847009-3 devstack@n-api.service[103997]: X-User-Domain-Id: default Jul 19 22:16:37.732155 n-d-847009-3 devstack@n-api.service[103997]: X-User-Domain-Name: Default Jul 19 22:16:37.732155 n-d-847009-3 devstack@n-api.service[103997]: X-User-Id: 12852d24772640aa843a2d7b8bb9a978 Jul 19 22:16:37.732155 n-d-847009-3 devstack@n-api.service[103997]: X-User-Name: admin Jul 19 22:16:37.732155 n-d-847009-3 devstack@n-api.service[103997]: method: > Jul 19 22:16:37.732155 n-d-847009-3 devstack@n-api.service[103997]: exception: Flavor 42 could not be found. Jul 19 22:16:37.732155 n-d-847009-3 devstack@n-api.service[103997]: action_args: {'id': '42'} Jul 19 22:16:37.732155 n-d-847009-3 devstack@n-api.service[103997]: {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:16:37.732155 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:16:37.733112 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 22:16:37.733112 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 22:16:37.733112 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 22:16:37.733112 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 22:16:37.733112 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:16:37.733112 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:16:37.733112 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 22:16:37.733112 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 22:16:37.733112 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 22:16:37.733112 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:16:37.733112 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 22:16:37.733112 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 22:16:37.733112 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 19 22:16:37.733112 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi Jul 19 22:16:37.733112 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:16:37.733112 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi Jul 19 22:16:37.733112 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:16:37.733112 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:16:37.733112 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:16:37.734257 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:16:37.734257 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:16:37.734257 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:16:37.734257 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:16:37.734257 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 22:16:37.734257 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:16:37.734257 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 19 22:16:37.734257 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi Jul 19 22:16:37.734257 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:16:37.734257 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi Jul 19 22:16:37.734257 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:16:37.734257 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:16:37.734257 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:16:37.734257 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:16:37.734257 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:16:37.734257 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 19 22:16:37.734257 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi Jul 19 22:16:37.734257 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-e06097ae-ab0c-42a7-a0ae-5727191c114a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:16:37.735282 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-e06097ae-ab0c-42a7-a0ae-5727191c114a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016834 Jul 19 22:16:37.735282 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 21/42] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Jul 19 22:16:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 19 22:16:38.704160 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-c692074b-6405-4205-b470-2222def13879 admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:38.705205 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-c692074b-6405-4205-b470-2222def13879 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001785 Jul 19 22:16:38.705626 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 22/43] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 19 22:16:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:16:39.231144 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-42e7ad84-b2d8-4c9d-b4be-2f017cf187fe admin admin] Calling method '>' {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:39.236382 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.wsgi [None req-42e7ad84-b2d8-4c9d-b4be-2f017cf187fe admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 19 22:16:39.238256 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-42e7ad84-b2d8-4c9d-b4be-2f017cf187fe admin admin] Request method failure captured: Jul 19 22:16:39.238256 n-d-847009-3 devstack@n-api.service[103997]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 19 22:16:39.238256 n-d-847009-3 devstack@n-api.service[103997]: Accept: application/json Jul 19 22:16:39.238256 n-d-847009-3 devstack@n-api.service[103997]: Accept-Encoding: gzip, deflate Jul 19 22:16:39.238256 n-d-847009-3 devstack@n-api.service[103997]: Connection: keep-alive Jul 19 22:16:39.238256 n-d-847009-3 devstack@n-api.service[103997]: Content-Length: 0 Jul 19 22:16:39.238256 n-d-847009-3 devstack@n-api.service[103997]: Host: 10.222.0.25 Jul 19 22:16:39.238256 n-d-847009-3 devstack@n-api.service[103997]: Openstack-Api-Version: compute 2.90 Jul 19 22:16:39.238256 n-d-847009-3 devstack@n-api.service[103997]: Openstack-System-Scope: None Jul 19 22:16:39.238256 n-d-847009-3 devstack@n-api.service[103997]: User-Agent: python-novaclient Jul 19 22:16:39.238256 n-d-847009-3 devstack@n-api.service[103997]: X-Auth-Token: gAAAAABi1y1GNExwLkIKTDlAwLE-30gjChxRM2yrXYb5DxDmZJZ-uejDY_RBhhDTzKRO4jnR_5UHp3BmLKMYbpg_yRfMU5OXnuRnbHiXg6-ZsIKJkm19s02qlKjMHyCrx3gpILaqrk4TdGvL9eRrdIn8E6ZTXNaGy9G9Soq2gt0SeZRCcFVaHyw Jul 19 22:16:39.238256 n-d-847009-3 devstack@n-api.service[103997]: X-Domain-Id: None Jul 19 22:16:39.238256 n-d-847009-3 devstack@n-api.service[103997]: X-Domain-Name: None Jul 19 22:16:39.238256 n-d-847009-3 devstack@n-api.service[103997]: X-Identity-Status: Confirmed Jul 19 22:16:39.238256 n-d-847009-3 devstack@n-api.service[103997]: X-Is-Admin-Project: True Jul 19 22:16:39.238256 n-d-847009-3 devstack@n-api.service[103997]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 22:16:39.238256 n-d-847009-3 devstack@n-api.service[103997]: X-Project-Domain-Id: default Jul 19 22:16:39.238256 n-d-847009-3 devstack@n-api.service[103997]: X-Project-Domain-Name: Default Jul 19 22:16:39.238256 n-d-847009-3 devstack@n-api.service[103997]: X-Project-Id: 63d26bd69e8044be9c3bf92e1191c21c Jul 19 22:16:39.238256 n-d-847009-3 devstack@n-api.service[103997]: X-Project-Name: admin Jul 19 22:16:39.238256 n-d-847009-3 devstack@n-api.service[103997]: X-Role: admin,member,reader Jul 19 22:16:39.238256 n-d-847009-3 devstack@n-api.service[103997]: X-Roles: admin,member,reader Jul 19 22:16:39.239870 n-d-847009-3 devstack@n-api.service[103997]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_63d26bd69e8044be9c3bf92e1191c21c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63d26bd69e8044be9c3bf92e1191c21c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/63d26bd69e8044be9c3bf92e1191c21c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63d26bd69e8044be9c3bf92e1191c21c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:16:39.239870 n-d-847009-3 devstack@n-api.service[103997]: X-Tenant: admin Jul 19 22:16:39.239870 n-d-847009-3 devstack@n-api.service[103997]: X-Tenant-Id: 63d26bd69e8044be9c3bf92e1191c21c Jul 19 22:16:39.239870 n-d-847009-3 devstack@n-api.service[103997]: X-Tenant-Name: admin Jul 19 22:16:39.239870 n-d-847009-3 devstack@n-api.service[103997]: X-User: admin Jul 19 22:16:39.239870 n-d-847009-3 devstack@n-api.service[103997]: X-User-Domain-Id: default Jul 19 22:16:39.239870 n-d-847009-3 devstack@n-api.service[103997]: X-User-Domain-Name: Default Jul 19 22:16:39.239870 n-d-847009-3 devstack@n-api.service[103997]: X-User-Id: 12852d24772640aa843a2d7b8bb9a978 Jul 19 22:16:39.239870 n-d-847009-3 devstack@n-api.service[103997]: X-User-Name: admin Jul 19 22:16:39.239870 n-d-847009-3 devstack@n-api.service[103997]: method: > Jul 19 22:16:39.239870 n-d-847009-3 devstack@n-api.service[103997]: exception: Flavor 84 could not be found. Jul 19 22:16:39.239870 n-d-847009-3 devstack@n-api.service[103997]: action_args: {'id': '84'} Jul 19 22:16:39.239870 n-d-847009-3 devstack@n-api.service[103997]: {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:16:39.239870 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:16:39.240816 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 22:16:39.240816 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 22:16:39.240816 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 22:16:39.240816 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 22:16:39.240816 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:16:39.240816 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:16:39.240816 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 22:16:39.240816 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 22:16:39.240816 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 22:16:39.240816 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:16:39.240816 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 22:16:39.240816 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 22:16:39.240816 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 19 22:16:39.240816 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi Jul 19 22:16:39.240816 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:16:39.240816 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi Jul 19 22:16:39.240816 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:16:39.240816 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:16:39.240816 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:16:39.242081 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:16:39.242081 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:16:39.242081 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:16:39.242081 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:16:39.242081 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 22:16:39.242081 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:16:39.242081 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 19 22:16:39.242081 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi Jul 19 22:16:39.242081 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:16:39.242081 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi Jul 19 22:16:39.242081 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:16:39.242081 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:16:39.242081 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:16:39.242081 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:16:39.242081 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:16:39.242081 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 19 22:16:39.242081 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi Jul 19 22:16:39.242081 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-42e7ad84-b2d8-4c9d-b4be-2f017cf187fe admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:16:39.243434 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-42e7ad84-b2d8-4c9d-b4be-2f017cf187fe admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.392898 Jul 19 22:16:39.243434 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 22/44] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Jul 19 22:16:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 22:16:39.249558 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-47531be1-829a-4a63-9232-136afd0ddebf admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:39.263038 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-47531be1-829a-4a63-9232-136afd0ddebf admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017052 Jul 19 22:16:39.263574 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 23/45] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Jul 19 22:16:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:16:39.272801 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-c44d7dbd-da15-4490-b11b-df7f9bd8497d admin admin] Calling method '>' {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:39.288021 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-c44d7dbd-da15-4490-b11b-df7f9bd8497d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018766 Jul 19 22:16:39.288544 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 23/46] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Jul 19 22:16:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:16:39.298012 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-4e28c2da-6096-48ba-a542-4cd41fa6998a admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:39.303282 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.wsgi [None req-4e28c2da-6096-48ba-a542-4cd41fa6998a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 19 22:16:39.304757 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-4e28c2da-6096-48ba-a542-4cd41fa6998a admin admin] Request method failure captured: Jul 19 22:16:39.304757 n-d-847009-3 devstack@n-api.service[103998]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 19 22:16:39.304757 n-d-847009-3 devstack@n-api.service[103998]: Accept: application/json Jul 19 22:16:39.304757 n-d-847009-3 devstack@n-api.service[103998]: Accept-Encoding: gzip, deflate Jul 19 22:16:39.304757 n-d-847009-3 devstack@n-api.service[103998]: Connection: keep-alive Jul 19 22:16:39.304757 n-d-847009-3 devstack@n-api.service[103998]: Content-Length: 0 Jul 19 22:16:39.304757 n-d-847009-3 devstack@n-api.service[103998]: Host: 10.222.0.25 Jul 19 22:16:39.304757 n-d-847009-3 devstack@n-api.service[103998]: Openstack-Api-Version: compute 2.90 Jul 19 22:16:39.304757 n-d-847009-3 devstack@n-api.service[103998]: Openstack-System-Scope: None Jul 19 22:16:39.304757 n-d-847009-3 devstack@n-api.service[103998]: User-Agent: python-novaclient Jul 19 22:16:39.304757 n-d-847009-3 devstack@n-api.service[103998]: X-Auth-Token: gAAAAABi1y1GNExwLkIKTDlAwLE-30gjChxRM2yrXYb5DxDmZJZ-uejDY_RBhhDTzKRO4jnR_5UHp3BmLKMYbpg_yRfMU5OXnuRnbHiXg6-ZsIKJkm19s02qlKjMHyCrx3gpILaqrk4TdGvL9eRrdIn8E6ZTXNaGy9G9Soq2gt0SeZRCcFVaHyw Jul 19 22:16:39.304757 n-d-847009-3 devstack@n-api.service[103998]: X-Domain-Id: None Jul 19 22:16:39.304757 n-d-847009-3 devstack@n-api.service[103998]: X-Domain-Name: None Jul 19 22:16:39.304757 n-d-847009-3 devstack@n-api.service[103998]: X-Identity-Status: Confirmed Jul 19 22:16:39.304757 n-d-847009-3 devstack@n-api.service[103998]: X-Is-Admin-Project: True Jul 19 22:16:39.304757 n-d-847009-3 devstack@n-api.service[103998]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 22:16:39.304757 n-d-847009-3 devstack@n-api.service[103998]: X-Project-Domain-Id: default Jul 19 22:16:39.304757 n-d-847009-3 devstack@n-api.service[103998]: X-Project-Domain-Name: Default Jul 19 22:16:39.304757 n-d-847009-3 devstack@n-api.service[103998]: X-Project-Id: 63d26bd69e8044be9c3bf92e1191c21c Jul 19 22:16:39.304757 n-d-847009-3 devstack@n-api.service[103998]: X-Project-Name: admin Jul 19 22:16:39.304757 n-d-847009-3 devstack@n-api.service[103998]: X-Role: admin,member,reader Jul 19 22:16:39.304757 n-d-847009-3 devstack@n-api.service[103998]: X-Roles: admin,member,reader Jul 19 22:16:39.306319 n-d-847009-3 devstack@n-api.service[103998]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_63d26bd69e8044be9c3bf92e1191c21c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63d26bd69e8044be9c3bf92e1191c21c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/63d26bd69e8044be9c3bf92e1191c21c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63d26bd69e8044be9c3bf92e1191c21c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:16:39.306319 n-d-847009-3 devstack@n-api.service[103998]: X-Tenant: admin Jul 19 22:16:39.306319 n-d-847009-3 devstack@n-api.service[103998]: X-Tenant-Id: 63d26bd69e8044be9c3bf92e1191c21c Jul 19 22:16:39.306319 n-d-847009-3 devstack@n-api.service[103998]: X-Tenant-Name: admin Jul 19 22:16:39.306319 n-d-847009-3 devstack@n-api.service[103998]: X-User: admin Jul 19 22:16:39.306319 n-d-847009-3 devstack@n-api.service[103998]: X-User-Domain-Id: default Jul 19 22:16:39.306319 n-d-847009-3 devstack@n-api.service[103998]: X-User-Domain-Name: Default Jul 19 22:16:39.306319 n-d-847009-3 devstack@n-api.service[103998]: X-User-Id: 12852d24772640aa843a2d7b8bb9a978 Jul 19 22:16:39.306319 n-d-847009-3 devstack@n-api.service[103998]: X-User-Name: admin Jul 19 22:16:39.306319 n-d-847009-3 devstack@n-api.service[103998]: method: > Jul 19 22:16:39.306319 n-d-847009-3 devstack@n-api.service[103998]: exception: Flavor 84 could not be found. Jul 19 22:16:39.306319 n-d-847009-3 devstack@n-api.service[103998]: action_args: {'id': '84'} Jul 19 22:16:39.306319 n-d-847009-3 devstack@n-api.service[103998]: {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:16:39.306319 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:16:39.307391 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 22:16:39.307391 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 22:16:39.307391 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 22:16:39.307391 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 22:16:39.307391 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:16:39.307391 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:16:39.307391 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 22:16:39.307391 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 22:16:39.307391 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 22:16:39.307391 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:16:39.307391 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 22:16:39.307391 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 22:16:39.307391 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 19 22:16:39.307391 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Jul 19 22:16:39.307391 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:16:39.307391 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Jul 19 22:16:39.307391 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:16:39.307391 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:16:39.307391 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:16:39.308842 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:16:39.308842 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:16:39.308842 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:16:39.308842 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:16:39.308842 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 22:16:39.308842 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:16:39.308842 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 19 22:16:39.308842 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Jul 19 22:16:39.308842 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:16:39.308842 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Jul 19 22:16:39.308842 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:16:39.308842 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:16:39.308842 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:16:39.308842 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:16:39.308842 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:16:39.308842 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 19 22:16:39.308842 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Jul 19 22:16:39.308842 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-4e28c2da-6096-48ba-a542-4cd41fa6998a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:16:39.310447 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-4e28c2da-6096-48ba-a542-4cd41fa6998a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011587 Jul 19 22:16:39.310447 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 24/47] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Jul 19 22:16:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 22:16:40.284975 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-c44d7dbd-da15-4490-b11b-df7f9bd8497d admin admin] Calling method '>' {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:40.285968 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-c44d7dbd-da15-4490-b11b-df7f9bd8497d admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jul 19 22:16:40.286357 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 24/48] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 19 22:16:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:16:40.814038 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-c8b6f6b5-7f8c-4b5b-9669-ab87359f93bc admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:40.819693 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.wsgi [None req-c8b6f6b5-7f8c-4b5b-9669-ab87359f93bc admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 19 22:16:40.821177 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-c8b6f6b5-7f8c-4b5b-9669-ab87359f93bc admin admin] Request method failure captured: Jul 19 22:16:40.821177 n-d-847009-3 devstack@n-api.service[103998]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 19 22:16:40.821177 n-d-847009-3 devstack@n-api.service[103998]: Accept: application/json Jul 19 22:16:40.821177 n-d-847009-3 devstack@n-api.service[103998]: Accept-Encoding: gzip, deflate Jul 19 22:16:40.821177 n-d-847009-3 devstack@n-api.service[103998]: Connection: keep-alive Jul 19 22:16:40.821177 n-d-847009-3 devstack@n-api.service[103998]: Content-Length: 0 Jul 19 22:16:40.821177 n-d-847009-3 devstack@n-api.service[103998]: Host: 10.222.0.25 Jul 19 22:16:40.821177 n-d-847009-3 devstack@n-api.service[103998]: Openstack-Api-Version: compute 2.90 Jul 19 22:16:40.821177 n-d-847009-3 devstack@n-api.service[103998]: Openstack-System-Scope: None Jul 19 22:16:40.821177 n-d-847009-3 devstack@n-api.service[103998]: User-Agent: python-novaclient Jul 19 22:16:40.821177 n-d-847009-3 devstack@n-api.service[103998]: X-Auth-Token: gAAAAABi1y1IhnxOzSMhldKeXj-GByNYmkDitFULC6BUGqluW5Ja6--YHLnckgs_C-ee2DQlWbs-OpWrehec7htVdKLojckdnp2_P4aQU1QqJXOxN5ce2AC5ivpnGiB1rE8AVR84wS5kMURKTgvte-lYhG-zoiR_YCsKEl3bz6NI6NufRst_dWk Jul 19 22:16:40.821177 n-d-847009-3 devstack@n-api.service[103998]: X-Domain-Id: None Jul 19 22:16:40.821177 n-d-847009-3 devstack@n-api.service[103998]: X-Domain-Name: None Jul 19 22:16:40.821177 n-d-847009-3 devstack@n-api.service[103998]: X-Identity-Status: Confirmed Jul 19 22:16:40.821177 n-d-847009-3 devstack@n-api.service[103998]: X-Is-Admin-Project: True Jul 19 22:16:40.821177 n-d-847009-3 devstack@n-api.service[103998]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 22:16:40.821177 n-d-847009-3 devstack@n-api.service[103998]: X-Project-Domain-Id: default Jul 19 22:16:40.821177 n-d-847009-3 devstack@n-api.service[103998]: X-Project-Domain-Name: Default Jul 19 22:16:40.821177 n-d-847009-3 devstack@n-api.service[103998]: X-Project-Id: 63d26bd69e8044be9c3bf92e1191c21c Jul 19 22:16:40.821177 n-d-847009-3 devstack@n-api.service[103998]: X-Project-Name: admin Jul 19 22:16:40.821177 n-d-847009-3 devstack@n-api.service[103998]: X-Role: admin,member,reader Jul 19 22:16:40.821177 n-d-847009-3 devstack@n-api.service[103998]: X-Roles: admin,member,reader Jul 19 22:16:40.823078 n-d-847009-3 devstack@n-api.service[103998]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_63d26bd69e8044be9c3bf92e1191c21c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63d26bd69e8044be9c3bf92e1191c21c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/63d26bd69e8044be9c3bf92e1191c21c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63d26bd69e8044be9c3bf92e1191c21c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:16:40.823078 n-d-847009-3 devstack@n-api.service[103998]: X-Tenant: admin Jul 19 22:16:40.823078 n-d-847009-3 devstack@n-api.service[103998]: X-Tenant-Id: 63d26bd69e8044be9c3bf92e1191c21c Jul 19 22:16:40.823078 n-d-847009-3 devstack@n-api.service[103998]: X-Tenant-Name: admin Jul 19 22:16:40.823078 n-d-847009-3 devstack@n-api.service[103998]: X-User: admin Jul 19 22:16:40.823078 n-d-847009-3 devstack@n-api.service[103998]: X-User-Domain-Id: default Jul 19 22:16:40.823078 n-d-847009-3 devstack@n-api.service[103998]: X-User-Domain-Name: Default Jul 19 22:16:40.823078 n-d-847009-3 devstack@n-api.service[103998]: X-User-Id: 12852d24772640aa843a2d7b8bb9a978 Jul 19 22:16:40.823078 n-d-847009-3 devstack@n-api.service[103998]: X-User-Name: admin Jul 19 22:16:40.823078 n-d-847009-3 devstack@n-api.service[103998]: method: > Jul 19 22:16:40.823078 n-d-847009-3 devstack@n-api.service[103998]: exception: Flavor 451 could not be found. Jul 19 22:16:40.823078 n-d-847009-3 devstack@n-api.service[103998]: action_args: {'id': '451'} Jul 19 22:16:40.823078 n-d-847009-3 devstack@n-api.service[103998]: {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:16:40.823078 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:16:40.824139 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 22:16:40.824139 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 22:16:40.824139 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 22:16:40.824139 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 22:16:40.824139 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:16:40.824139 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:16:40.824139 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 22:16:40.824139 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 22:16:40.824139 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 22:16:40.824139 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:16:40.824139 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 22:16:40.824139 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 22:16:40.824139 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 19 22:16:40.824139 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Jul 19 22:16:40.824139 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:16:40.824139 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Jul 19 22:16:40.824139 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:16:40.824139 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:16:40.824139 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:16:40.825471 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:16:40.825471 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:16:40.825471 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:16:40.825471 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:16:40.825471 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 22:16:40.825471 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:16:40.825471 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 19 22:16:40.825471 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Jul 19 22:16:40.825471 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:16:40.825471 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Jul 19 22:16:40.825471 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:16:40.825471 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:16:40.825471 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:16:40.825471 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:16:40.825471 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:16:40.825471 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 19 22:16:40.825471 n-d-847009-3 devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Jul 19 22:16:40.825471 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-c8b6f6b5-7f8c-4b5b-9669-ab87359f93bc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:16:40.826715 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-c8b6f6b5-7f8c-4b5b-9669-ab87359f93bc admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.399495 Jul 19 22:16:40.826715 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 25/49] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 19 22:16:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 22:16:40.832936 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-b566c2a6-7356-4376-bf6e-c53df28b4bbd admin admin] Calling method '>' {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:40.846495 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-b566c2a6-7356-4376-bf6e-c53df28b4bbd admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017212 Jul 19 22:16:40.847360 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 25/50] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Jul 19 22:16:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:16:40.856641 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-c98dfb43-e53a-47e4-ad97-c1f8eb6b5395 admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:40.871780 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-c98dfb43-e53a-47e4-ad97-c1f8eb6b5395 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018753 Jul 19 22:16:40.872308 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 26/51] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Jul 19 22:16:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:16:40.881564 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-ab08744a-7ea8-474e-a902-5c25dd176065 admin admin] Calling method '>' {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:40.887488 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.wsgi [None req-ab08744a-7ea8-474e-a902-5c25dd176065 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 19 22:16:40.888964 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-ab08744a-7ea8-474e-a902-5c25dd176065 admin admin] Request method failure captured: Jul 19 22:16:40.888964 n-d-847009-3 devstack@n-api.service[103997]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 19 22:16:40.888964 n-d-847009-3 devstack@n-api.service[103997]: Accept: application/json Jul 19 22:16:40.888964 n-d-847009-3 devstack@n-api.service[103997]: Accept-Encoding: gzip, deflate Jul 19 22:16:40.888964 n-d-847009-3 devstack@n-api.service[103997]: Connection: keep-alive Jul 19 22:16:40.888964 n-d-847009-3 devstack@n-api.service[103997]: Content-Length: 0 Jul 19 22:16:40.888964 n-d-847009-3 devstack@n-api.service[103997]: Host: 10.222.0.25 Jul 19 22:16:40.888964 n-d-847009-3 devstack@n-api.service[103997]: Openstack-Api-Version: compute 2.90 Jul 19 22:16:40.888964 n-d-847009-3 devstack@n-api.service[103997]: Openstack-System-Scope: None Jul 19 22:16:40.888964 n-d-847009-3 devstack@n-api.service[103997]: User-Agent: python-novaclient Jul 19 22:16:40.888964 n-d-847009-3 devstack@n-api.service[103997]: X-Auth-Token: gAAAAABi1y1IhnxOzSMhldKeXj-GByNYmkDitFULC6BUGqluW5Ja6--YHLnckgs_C-ee2DQlWbs-OpWrehec7htVdKLojckdnp2_P4aQU1QqJXOxN5ce2AC5ivpnGiB1rE8AVR84wS5kMURKTgvte-lYhG-zoiR_YCsKEl3bz6NI6NufRst_dWk Jul 19 22:16:40.888964 n-d-847009-3 devstack@n-api.service[103997]: X-Domain-Id: None Jul 19 22:16:40.888964 n-d-847009-3 devstack@n-api.service[103997]: X-Domain-Name: None Jul 19 22:16:40.888964 n-d-847009-3 devstack@n-api.service[103997]: X-Identity-Status: Confirmed Jul 19 22:16:40.888964 n-d-847009-3 devstack@n-api.service[103997]: X-Is-Admin-Project: True Jul 19 22:16:40.888964 n-d-847009-3 devstack@n-api.service[103997]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 22:16:40.888964 n-d-847009-3 devstack@n-api.service[103997]: X-Project-Domain-Id: default Jul 19 22:16:40.888964 n-d-847009-3 devstack@n-api.service[103997]: X-Project-Domain-Name: Default Jul 19 22:16:40.888964 n-d-847009-3 devstack@n-api.service[103997]: X-Project-Id: 63d26bd69e8044be9c3bf92e1191c21c Jul 19 22:16:40.888964 n-d-847009-3 devstack@n-api.service[103997]: X-Project-Name: admin Jul 19 22:16:40.888964 n-d-847009-3 devstack@n-api.service[103997]: X-Role: admin,member,reader Jul 19 22:16:40.888964 n-d-847009-3 devstack@n-api.service[103997]: X-Roles: admin,member,reader Jul 19 22:16:40.890484 n-d-847009-3 devstack@n-api.service[103997]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_63d26bd69e8044be9c3bf92e1191c21c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63d26bd69e8044be9c3bf92e1191c21c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/63d26bd69e8044be9c3bf92e1191c21c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63d26bd69e8044be9c3bf92e1191c21c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:16:40.890484 n-d-847009-3 devstack@n-api.service[103997]: X-Tenant: admin Jul 19 22:16:40.890484 n-d-847009-3 devstack@n-api.service[103997]: X-Tenant-Id: 63d26bd69e8044be9c3bf92e1191c21c Jul 19 22:16:40.890484 n-d-847009-3 devstack@n-api.service[103997]: X-Tenant-Name: admin Jul 19 22:16:40.890484 n-d-847009-3 devstack@n-api.service[103997]: X-User: admin Jul 19 22:16:40.890484 n-d-847009-3 devstack@n-api.service[103997]: X-User-Domain-Id: default Jul 19 22:16:40.890484 n-d-847009-3 devstack@n-api.service[103997]: X-User-Domain-Name: Default Jul 19 22:16:40.890484 n-d-847009-3 devstack@n-api.service[103997]: X-User-Id: 12852d24772640aa843a2d7b8bb9a978 Jul 19 22:16:40.890484 n-d-847009-3 devstack@n-api.service[103997]: X-User-Name: admin Jul 19 22:16:40.890484 n-d-847009-3 devstack@n-api.service[103997]: method: > Jul 19 22:16:40.890484 n-d-847009-3 devstack@n-api.service[103997]: exception: Flavor 451 could not be found. Jul 19 22:16:40.890484 n-d-847009-3 devstack@n-api.service[103997]: action_args: {'id': '451'} Jul 19 22:16:40.890484 n-d-847009-3 devstack@n-api.service[103997]: {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:16:40.890484 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:16:40.891699 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 22:16:40.891699 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 22:16:40.891699 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 22:16:40.891699 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 22:16:40.891699 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:16:40.891699 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:16:40.891699 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 22:16:40.891699 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 22:16:40.891699 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 22:16:40.891699 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:16:40.891699 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 22:16:40.891699 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 22:16:40.891699 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 19 22:16:40.891699 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi Jul 19 22:16:40.891699 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:16:40.891699 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi Jul 19 22:16:40.891699 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:16:40.891699 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:16:40.891699 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:16:40.892795 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:16:40.892795 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:16:40.892795 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:16:40.892795 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:16:40.892795 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 22:16:40.892795 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:16:40.892795 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 19 22:16:40.892795 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi Jul 19 22:16:40.892795 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:16:40.892795 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi Jul 19 22:16:40.892795 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:16:40.892795 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:16:40.892795 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:16:40.892795 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:16:40.892795 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:16:40.892795 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 19 22:16:40.892795 n-d-847009-3 devstack@n-api.service[103997]: ERROR nova.api.openstack.wsgi Jul 19 22:16:40.892795 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-ab08744a-7ea8-474e-a902-5c25dd176065 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:16:40.893793 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-ab08744a-7ea8-474e-a902-5c25dd176065 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012320 Jul 19 22:16:40.893793 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 26/52] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 19 22:16:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 19 22:16:41.858485 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-c98dfb43-e53a-47e4-ad97-c1f8eb6b5395 admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:41.859514 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-c98dfb43-e53a-47e4-ad97-c1f8eb6b5395 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jul 19 22:16:41.859906 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 27/53] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 19 22:16:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:16:42.498031 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-7799ab0a-1ccd-423a-ac72-78d38e29f6d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:16:42.515991 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-7799ab0a-1ccd-423a-ac72-78d38e29f6d5 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.519056 Jul 19 22:16:42.516531 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 27/54] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Jul 19 22:16:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:16:43.489246 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-c98dfb43-e53a-47e4-ad97-c1f8eb6b5395 admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:43.490284 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-c98dfb43-e53a-47e4-ad97-c1f8eb6b5395 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jul 19 22:16:43.490672 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 28/55] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 19 22:16:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:16:44.020779 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-ba9ce2bd-14b6-4719-8321-82e3d7684128 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:16:44.037843 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-ba9ce2bd-14b6-4719-8321-82e3d7684128 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.401985 Jul 19 22:16:44.038400 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 28/56] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Jul 19 22:16:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:16:45.005987 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-c98dfb43-e53a-47e4-ad97-c1f8eb6b5395 admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:45.006988 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-c98dfb43-e53a-47e4-ad97-c1f8eb6b5395 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jul 19 22:16:45.007423 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 29/57] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 19 22:16:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:16:45.542091 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-bfabe398-fb4f-4ba3-abcc-aa38a7126804 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:16:45.559917 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-bfabe398-fb4f-4ba3-abcc-aa38a7126804 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.414638 Jul 19 22:16:45.560454 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 29/58] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Jul 19 22:16:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:16:46.547568 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-c98dfb43-e53a-47e4-ad97-c1f8eb6b5395 admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:46.548587 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-c98dfb43-e53a-47e4-ad97-c1f8eb6b5395 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Jul 19 22:16:46.548975 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 30/59] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 19 22:16:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:16:47.072152 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-23601588-cd55-41a0-b189-dd175c663985 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:16:47.091804 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-23601588-cd55-41a0-b189-dd175c663985 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.401783 Jul 19 22:16:47.092344 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 30/60] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Jul 19 22:16:46 2022] POST /compute/v2.1/flavors => generated 409 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:16:48.060902 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-c98dfb43-e53a-47e4-ad97-c1f8eb6b5395 admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:48.061908 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-c98dfb43-e53a-47e4-ad97-c1f8eb6b5395 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jul 19 22:16:48.062304 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 31/61] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 19 22:16:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:16:48.585115 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-4e771ce5-e70a-460f-a343-7836ab95569d admin admin] Calling method '>' {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:16:48.604406 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-4e771ce5-e70a-460f-a343-7836ab95569d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.404888 Jul 19 22:16:48.604868 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 31/62] 10.222.0.25 () {60 vars in 1202 bytes} [Tue Jul 19 22:16:48 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:17:40.682350 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-c98dfb43-e53a-47e4-ad97-c1f8eb6b5395 admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:17:40.683433 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-c98dfb43-e53a-47e4-ad97-c1f8eb6b5395 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 19 22:17:40.683834 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 32/63] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 19 22:17:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:17:40.694047 n-d-847009-3 devstack@n-api.service[103997]: DEBUG dbcounter [-] [103997] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:17:41.088734 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-e50d6bc5-8b64-4041-aa25-dfb457a860c6 admin admin] Calling method '>' {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:17:41.108695 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-e50d6bc5-8b64-4041-aa25-dfb457a860c6 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.419098 Jul 19 22:17:41.109231 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 32/64] 10.222.0.25 () {60 vars in 1291 bytes} [Tue Jul 19 22:17:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:17:41.130645 n-d-847009-3 devstack@n-api.service[103998]: DEBUG dbcounter [-] [103998] Writing DB stats nova_api:SELECT=14 {{(pid=103998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:17:41.134945 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-db68050e-a287-47e6-818e-72cb0c65ec5c admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:17:41.142467 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-db68050e-a287-47e6-818e-72cb0c65ec5c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013207 Jul 19 22:17:41.142994 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 33/65] 10.222.0.25 () {60 vars in 1282 bytes} [Tue Jul 19 22:17:41 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:17:41.154805 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-117fe306-fab8-47da-bab2-7d904adf416e admin admin] Calling method '>' {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:17:41.162302 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-117fe306-fab8-47da-bab2-7d904adf416e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011046 Jul 19 22:17:41.162808 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 33/66] 10.222.0.25 () {60 vars in 1285 bytes} [Tue Jul 19 22:17:41 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:17:41.174411 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-13ca2d0f-4df9-4123-bfc5-d5c9eecbefdb admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:17:41.183047 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-13ca2d0f-4df9-4123-bfc5-d5c9eecbefdb admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012142 Jul 19 22:17:41.183623 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 34/67] 10.222.0.25 () {60 vars in 1285 bytes} [Tue Jul 19 22:17:41 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:17:41.194719 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-cf99cf8f-b77e-4628-be6f-af65c9809d59 admin admin] Calling method '>' {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:17:41.202542 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-cf99cf8f-b77e-4628-be6f-af65c9809d59 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011343 Jul 19 22:17:41.203058 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 34/68] 10.222.0.25 () {60 vars in 1282 bytes} [Tue Jul 19 22:17:41 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:23:13.020670 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-13ca2d0f-4df9-4123-bfc5-d5c9eecbefdb admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:23:13.021674 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-13ca2d0f-4df9-4123-bfc5-d5c9eecbefdb admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 19 22:23:13.022071 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 35/69] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 19 22:23:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:23:13.160939 n-d-847009-3 devstack@n-api.service[103997]: DEBUG dbcounter [-] [103997] Writing DB stats nova_api:SELECT=6 {{(pid=103997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:23:13.308166 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-a52540c7-5cf5-4ac2-952d-e9e433d85674 admin admin] Calling method '>' {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:23:13.309400 n-d-847009-3 devstack@n-api.service[103997]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:23:13.309400 n-d-847009-3 devstack@n-api.service[103997]: warnings.warn(msg) Jul 19 22:23:13.310601 n-d-847009-3 devstack@n-api.service[103997]: DEBUG oslo_concurrency.lockutils [None req-a52540c7-5cf5-4ac2-952d-e9e433d85674 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:23:13.311045 n-d-847009-3 devstack@n-api.service[103997]: DEBUG oslo_concurrency.lockutils [None req-a52540c7-5cf5-4ac2-952d-e9e433d85674 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:23:13.311868 n-d-847009-3 devstack@n-api.service[103997]: DEBUG oslo_concurrency.lockutils [None req-a52540c7-5cf5-4ac2-952d-e9e433d85674 admin admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:23:13.312297 n-d-847009-3 devstack@n-api.service[103997]: DEBUG oslo_concurrency.lockutils [None req-a52540c7-5cf5-4ac2-952d-e9e433d85674 admin admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:23:13.354179 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-a52540c7-5cf5-4ac2-952d-e9e433d85674 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.194775 Jul 19 22:23:13.354750 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 35/70] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 19 22:23:13 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:23:14.196433 n-d-847009-3 devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-13ca2d0f-4df9-4123-bfc5-d5c9eecbefdb admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:23:14.197434 n-d-847009-3 devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-13ca2d0f-4df9-4123-bfc5-d5c9eecbefdb admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 19 22:23:14.197826 n-d-847009-3 devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 36/71] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 19 22:23:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:23:14.397915 n-d-847009-3 devstack@n-api.service[103997]: DEBUG nova.api.openstack.wsgi [None req-2a29b909-e0e8-4c9e-99dd-3a4a2bfc6c21 admin admin] Calling method '>' {{(pid=103997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:23:14.399100 n-d-847009-3 devstack@n-api.service[103997]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:23:14.399100 n-d-847009-3 devstack@n-api.service[103997]: warnings.warn(msg) Jul 19 22:23:14.400315 n-d-847009-3 devstack@n-api.service[103997]: DEBUG oslo_concurrency.lockutils [None req-2a29b909-e0e8-4c9e-99dd-3a4a2bfc6c21 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:23:14.400762 n-d-847009-3 devstack@n-api.service[103997]: DEBUG oslo_concurrency.lockutils [None req-2a29b909-e0e8-4c9e-99dd-3a4a2bfc6c21 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:23:14.401571 n-d-847009-3 devstack@n-api.service[103997]: DEBUG oslo_concurrency.lockutils [None req-2a29b909-e0e8-4c9e-99dd-3a4a2bfc6c21 admin admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:23:14.402006 n-d-847009-3 devstack@n-api.service[103997]: DEBUG oslo_concurrency.lockutils [None req-2a29b909-e0e8-4c9e-99dd-3a4a2bfc6c21 admin admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:23:14.425035 n-d-847009-3 devstack@n-api.service[103997]: INFO nova.api.openstack.requestlog [None req-2a29b909-e0e8-4c9e-99dd-3a4a2bfc6c21 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.078399 Jul 19 22:23:14.425523 n-d-847009-3 devstack@n-api.service[103997]: [pid: 103997|app: 0|req: 36/72] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 19 22:23:14 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:24:00.561253 n-d-847009-3 devstack@n-api.service[103996]: Tue Jul 19 22:24:00 2022 - graceful shutdown triggered... Jul 19 22:24:00.561393 n-d-847009-3 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 19 22:24:00.562366 n-d-847009-3 devstack@n-api.service[103997]: Gracefully killing worker 1 (pid: 103997)... Jul 19 22:24:00.562860 n-d-847009-3 devstack@n-api.service[103998]: Gracefully killing worker 2 (pid: 103998)... Jul 19 22:24:01.563216 n-d-847009-3 devstack@n-api.service[103996]: worker 1 buried after 1 seconds Jul 19 22:24:01.563216 n-d-847009-3 devstack@n-api.service[103996]: worker 2 buried after 1 seconds Jul 19 22:24:01.563216 n-d-847009-3 devstack@n-api.service[103996]: goodbye to uWSGI. Jul 19 22:24:01.564768 n-d-847009-3 systemd[1]: devstack@n-api.service: Succeeded. Jul 19 22:24:01.565375 n-d-847009-3 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 19 22:24:01.568265 n-d-847009-3 systemd[1]: Starting Devstack devstack@n-api.service... Jul 19 22:24:01.585148 n-d-847009-3 devstack@n-api.service[119324]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 19 22:24:01.601957 n-d-847009-3 devstack@n-api.service[119324]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 19 22:24:01 2022] *** Jul 19 22:24:01.601957 n-d-847009-3 devstack@n-api.service[119324]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 19 22:24:01.601957 n-d-847009-3 devstack@n-api.service[119324]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 19 22:24:01.601957 n-d-847009-3 devstack@n-api.service[119324]: nodename: n-d-847009-3 Jul 19 22:24:01.601957 n-d-847009-3 devstack@n-api.service[119324]: machine: x86_64 Jul 19 22:24:01.601957 n-d-847009-3 devstack@n-api.service[119324]: clock source: unix Jul 19 22:24:01.601957 n-d-847009-3 devstack@n-api.service[119324]: pcre jit disabled Jul 19 22:24:01.601957 n-d-847009-3 devstack@n-api.service[119324]: detected number of CPU cores: 4 Jul 19 22:24:01.601957 n-d-847009-3 devstack@n-api.service[119324]: current working directory: / Jul 19 22:24:01.601957 n-d-847009-3 devstack@n-api.service[119324]: detected binary path: /usr/bin/uwsgi-core Jul 19 22:24:01.601957 n-d-847009-3 devstack@n-api.service[119324]: your processes number limit is 47680 Jul 19 22:24:01.602788 n-d-847009-3 devstack@n-api.service[119324]: your memory page size is 4096 bytes Jul 19 22:24:01.602788 n-d-847009-3 devstack@n-api.service[119324]: detected max file descriptor number: 2048 Jul 19 22:24:01.602788 n-d-847009-3 devstack@n-api.service[119324]: lock engine: pthread robust mutexes Jul 19 22:24:01.602788 n-d-847009-3 devstack@n-api.service[119324]: thunder lock: enabled Jul 19 22:24:01.602788 n-d-847009-3 devstack@n-api.service[119324]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 19 22:24:01.602788 n-d-847009-3 devstack@n-api.service[119324]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 19 22:24:01.650188 n-d-847009-3 devstack@n-api.service[119324]: Python main interpreter initialized at 0x5602f55529c0 Jul 19 22:24:01.650188 n-d-847009-3 devstack@n-api.service[119324]: python threads support enabled Jul 19 22:24:01.650188 n-d-847009-3 devstack@n-api.service[119324]: your server socket listen backlog is limited to 100 connections Jul 19 22:24:01.650188 n-d-847009-3 devstack@n-api.service[119324]: your mercy for graceful operations on workers is 90 seconds Jul 19 22:24:01.650623 n-d-847009-3 devstack@n-api.service[119324]: mapped 403077 bytes (393 KB) for 2 cores Jul 19 22:24:01.650623 n-d-847009-3 devstack@n-api.service[119324]: *** Operational MODE: preforking *** Jul 19 22:24:01.650895 n-d-847009-3 devstack@n-api.service[119324]: *** uWSGI is running in multiple interpreter mode *** Jul 19 22:24:01.650895 n-d-847009-3 devstack@n-api.service[119324]: spawned uWSGI master process (pid: 119324) Jul 19 22:24:01.651316 n-d-847009-3 systemd[1]: Started Devstack devstack@n-api.service. Jul 19 22:24:01.652441 n-d-847009-3 devstack@n-api.service[119324]: spawned uWSGI worker 1 (pid: 119337, cores: 1) Jul 19 22:24:01.652441 n-d-847009-3 devstack@n-api.service[119324]: spawned uWSGI worker 2 (pid: 119338, cores: 1) Jul 19 22:24:01.652441 n-d-847009-3 devstack@n-api.service[119324]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 19 22:24:02.316334 n-d-847009-3 devstack@n-api.service[119337]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 22:24:02.319193 n-d-847009-3 devstack@n-api.service[119338]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 22:24:03.524045 n-d-847009-3 devstack@n-api.service[119338]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 22:24:03.524045 n-d-847009-3 devstack@n-api.service[119338]: from cryptography.utils import int_from_bytes Jul 19 22:24:03.524806 n-d-847009-3 devstack@n-api.service[119338]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 22:24:03.524806 n-d-847009-3 devstack@n-api.service[119338]: from cryptography.utils import int_from_bytes Jul 19 22:24:03.526125 n-d-847009-3 devstack@n-api.service[119337]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 22:24:03.526125 n-d-847009-3 devstack@n-api.service[119337]: from cryptography.utils import int_from_bytes Jul 19 22:24:03.526560 n-d-847009-3 devstack@n-api.service[119337]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 22:24:03.526560 n-d-847009-3 devstack@n-api.service[119337]: from cryptography.utils import int_from_bytes Jul 19 22:24:05.845505 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 22:24:05.846047 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 22:24:05.846274 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 22:24:05.846641 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 22:24:05.846900 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 22:24:05.847324 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.848283 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.848610 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.848934 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.849269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.849582 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.849906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.850493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.850827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.851090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.851434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.851761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-847009-3 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.852084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.852394 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.852707 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.853035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.853334 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.853658 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.853965 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.854470 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.854927 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.855042 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 22:24:05.855444 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.855533 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 22:24:05.855612 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.855838 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 22:24:05.855955 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.856200 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 22:24:05.856299 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.856478 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 22:24:05.856589 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.856826 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.856937 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.857140 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.857239 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.857467 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.857574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.857778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.857892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.858155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.858252 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-847009-3 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.858467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.858578 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.858784 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.858923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.859100 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.859243 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.859450 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.859566 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.859711 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.859860 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.860020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.860167 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.860343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-847009-3 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.860483 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.860661 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.860763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.860965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.861069 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.861275 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.861380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.861591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.861707 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.861892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.862031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.862211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.862355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.862513 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.862660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.862971 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.863076 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.863948 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.864050 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.864320 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.864672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.864806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.864906 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.864999 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.865084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.865168 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.865302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.865485 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.865603 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.865812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.865924 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.866146 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.866247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.866476 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.866587 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.866732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.866835 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.866986 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.867224 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-847009-3 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.867322 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.867540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.867642 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.867851 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.867953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.868162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.868256 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.868537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.868642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.868846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.869000 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.869155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.869258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.869463 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.869565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.869771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.869880 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.870076 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.870221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.870397 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.870499 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.870718 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.870822 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.871037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.871181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.871373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.871467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.871673 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.871780 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.871981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.872123 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.872329 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.872433 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.872640 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.872742 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.872974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.873066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.873278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.873381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.873526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.873631 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.873831 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.873926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.874150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.874243 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.874469 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.874574 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.874788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.874889 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.875038 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.875191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.875297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.875435 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.875613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.875776 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.875935 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.876089 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.876242 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.876336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.876550 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.876651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.876859 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.876962 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.877162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.877256 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.877465 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.877565 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.877769 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.877864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.878074 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.878180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.878378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.878478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.878729 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.878835 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.879043 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.879358 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.879455 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.879697 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.879805 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.880007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.880104 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.880329 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.880473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.880684 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.880790 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.880964 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.881056 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.881271 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.881422 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.881602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.881708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.881919 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.882013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.882228 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.882329 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.882540 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.882634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.882847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.882950 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.883170 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.883284 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.883482 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.883582 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.883785 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.883892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.884093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.884195 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.884417 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.884519 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.884720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.884826 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.884970 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.885063 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.885270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.885370 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.885585 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.885754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.885898 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.886037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.886169 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.886309 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.886468 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.886581 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.886779 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.886872 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.887080 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.887188 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.887406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.887501 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.887769 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.887872 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.888076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.888172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.888385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.888482 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.888687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.888786 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.888990 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.889082 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.889293 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.889396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.889595 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.889688 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.889896 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.890045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.890195 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.890338 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.890516 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.890620 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.890821 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.890928 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.891155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.891269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.891454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.891596 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.891753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.891885 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.892066 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.892201 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.892370 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.892506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.892673 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.892779 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.892992 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.893093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.893297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.893405 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.893602 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.893696 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.893920 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.894020 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.894225 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.894516 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.894651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.894749 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.895317 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.895455 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.895548 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.895649 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.895736 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.895831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.895930 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.896024 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.896179 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.896312 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.896488 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.896604 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.896796 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.896905 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.897099 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.897192 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.897402 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.897503 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.897708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.897815 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.898009 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.898111 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.898311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.898411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.898610 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.898704 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.898926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.899027 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.899267 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.899362 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.899575 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.899677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.899881 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.900011 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.900185 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.900327 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.900502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 22:24:05.900655 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.900836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.900985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.901168 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.901264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.901508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.901616 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.901822 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.901923 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.902156 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.902260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.902485 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.902589 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.902798 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.902890 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.903133 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.903230 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.903440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.903546 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.903756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.903848 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.904063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.904155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.904374 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.904468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.904683 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.904775 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.904997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.905088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.905315 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.905415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.905632 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.905731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.905945 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.906044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.906264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.906389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.906578 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.906691 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.906888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.906996 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.907222 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.907331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.907532 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.907639 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.907840 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.907950 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.908146 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.908245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.908459 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.908566 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.908766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.908881 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.909087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.909198 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.909415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.909534 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.909726 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.909831 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.910614 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.910767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.911004 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.911159 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.911346 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.911514 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.911656 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.911756 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.911960 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.912066 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.912270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.912366 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.912585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.912679 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.912896 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.912986 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.913202 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.913303 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.913509 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.913612 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.913821 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.913915 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.914128 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.914228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.914452 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.914556 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.914762 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.914856 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.915071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.915190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.915405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.915498 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.915723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.915830 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.916032 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.916124 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.916456 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.916563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.916660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.916759 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.916950 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.917044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.917260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.917364 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.917565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.917668 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.917874 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.917976 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.918177 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.918279 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.918494 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.918601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.918817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.918910 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.919137 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.919248 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.919470 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.919613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.919775 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.919867 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.920086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.920178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.920393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.920487 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.920699 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.920836 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.921003 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.921140 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.921312 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.921418 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.921617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.921760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.921920 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.922053 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.922223 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.922324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.922531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.922631 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.922830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.922931 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.923175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.923286 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.923483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.923584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.923785 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.923892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.924091 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.924184 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.924398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.924493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.924703 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.924814 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.925014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.925107 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.925322 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.925415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.926238 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.926353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.926613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.926714 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.926981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.927073 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.927333 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.927430 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.927660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.927754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.927965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.928062 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.928279 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.928372 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.928593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.928695 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.928908 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.929000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.929216 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.929311 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.929526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.929619 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.929830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.929934 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.930134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.930235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.930438 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.930575 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.930748 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.930878 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.931054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.931212 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.931384 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.931489 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.931689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.931790 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.931992 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.932093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.932296 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.932390 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.932619 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.932727 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.932929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.933023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.933232 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.933327 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.933535 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.933705 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.933837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.933932 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.934188 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.934327 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.934484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.934605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.934794 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.934894 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.935153 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.935252 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.935455 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.935550 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.935777 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.935872 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.936086 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.936185 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.936402 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.936497 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.936713 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.936802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.937023 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.937113 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.937330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.937423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.937638 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.937718 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.937956 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.938035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.938265 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.938355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.938583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.938664 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.938893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.938988 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.939241 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.939337 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.939553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.939641 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.939866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.939969 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.940168 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.940269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.940478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.940579 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.940791 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.940894 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.941105 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.941246 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.941497 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.941593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.941884 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.942004 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.942200 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.942296 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.942512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.942613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.942820 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.942920 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.943149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.943258 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.943459 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.943559 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.943767 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.943860 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.944081 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.944175 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.944386 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.944477 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.944703 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.944796 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.945011 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.945110 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.945332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.945433 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.945639 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.945732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.945947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.946040 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.946250 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.946343 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.946564 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.946669 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.946876 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.946977 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.947210 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.947323 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.947522 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.947626 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.947829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.947930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.948148 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.948250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.948458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.948560 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.948766 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.948860 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.949079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.949196 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.949384 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.949478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.949690 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.949790 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.949999 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.950089 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.950358 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.950466 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.950619 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.950712 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.950928 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.951021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.951253 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.951390 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.951570 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.951666 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.951875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.951967 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.952177 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.952278 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.952479 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.952573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.952788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.952882 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.953104 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.953204 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.953407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.953498 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.953719 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.953820 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.954030 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.954132 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.954329 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.954436 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.954631 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.954725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.954952 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.955240 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.955338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.955574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.955676 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.955876 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.955977 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.956178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.956271 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.956511 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.956605 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.957328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.957435 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.957671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.957780 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.958060 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.958166 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.958382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.958484 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.958692 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.958797 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.959003 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.959232 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.959334 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.959437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.959635 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.959730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.959947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.960048 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.960258 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.960366 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.960563 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.960657 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.960871 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.960974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.961177 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.961278 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.961483 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.961611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.961789 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.961885 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.962094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.962211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.962402 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.962505 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.962708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.962808 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.963018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.963135 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.963345 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.963439 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.963654 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.963762 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.963971 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.964073 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.964281 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.964532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.964625 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.964861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.964956 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.965173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.965274 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.965490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.965584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.965806 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.965902 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.966122 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.966225 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.966451 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.966554 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.966775 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.966869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.967093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.967234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.967428 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.967538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.967742 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.967842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.968047 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.968150 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.968351 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.968453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.968656 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.968759 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.968956 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.969068 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.969326 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.969434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.969560 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.969656 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.969867 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.969971 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.970169 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.970320 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.970472 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.970567 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.970773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.970868 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.971076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.971193 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.971412 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.971507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.971716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.971807 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.972024 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.972118 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.972326 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.972421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.972741 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.972837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.973055 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.973187 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.973374 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.973482 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.973691 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.973788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.974000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.974144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.974316 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.974422 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.974623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.974726 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.975223 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.975342 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.975536 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.975647 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.975845 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.975947 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.976156 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.976260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.976472 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.976575 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.976785 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.976881 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.977096 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.977192 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.977410 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.977504 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.977721 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.977823 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.978026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.978119 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.978331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.978425 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.978633 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.978776 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.978942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.979064 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.979271 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.979376 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.979583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.979690 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.979895 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.979988 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.980200 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.980318 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.980505 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.980606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.980806 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.980911 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.981112 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.981212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.981419 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.981514 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.981720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.981850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.982025 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.982128 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.982328 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.982428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.982633 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.982735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.982935 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.983036 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.983263 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.983521 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.983630 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.983733 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.983887 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.983993 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.984192 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.984339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.984494 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.984590 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.984796 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.984895 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.985100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.985194 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.985404 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.985506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.985708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.985802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.986030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.986124 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.986339 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.986434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.986642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.986735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.986946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.987041 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.987277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.987382 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.987586 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.987681 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.987888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.987995 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.988722 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.988902 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.989181 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.989339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.989496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.989599 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.990212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.990290 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.990371 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.990443 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.990524 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.990603 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.990675 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.990744 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.990969 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.991062 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.991300 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.991393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.991604 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.991699 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.991905 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.991998 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.992205 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.992315 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.992508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.992627 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.992811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.992971 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.993150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.993233 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.993429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.993527 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.993731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.993840 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.994031 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.994155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.994332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.994471 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.994677 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.994788 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.994980 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.995188 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.995362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.995454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.995667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.995806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.996075 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.996179 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.996274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.996369 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.996586 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.996682 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.996898 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.997003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.997213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.997308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.997521 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.997618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.997838 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.997983 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.998150 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.998271 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.998460 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.998566 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.998762 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.998863 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.999068 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.999205 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.999417 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.999533 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.999725 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:05.999831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.000033 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.000128 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.000354 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.000449 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.000676 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.000772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.000997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.001100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.001301 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.001396 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.001610 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.001704 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.001918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.002066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.002224 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.002355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.002533 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.002634 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.002841 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.002935 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.003174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.003287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.003489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.003591 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.003878 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.004056 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.004187 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.004298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.004496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.004598 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.004805 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.004899 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.005110 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.005218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.005416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.005509 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.005721 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.005814 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.006032 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.006134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.006342 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.006482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.006646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.006767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.006954 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.007094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.007280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.007430 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.007593 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.007853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.007959 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.008171 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.008319 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.008486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.008630 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.008813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.008940 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.009140 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.009244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.009480 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.009599 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.009765 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.009862 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.010084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.010189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.010399 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.010501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.010720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.010814 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.011046 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.011160 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.011413 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.011509 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.011737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.011841 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.012046 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.012147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.012350 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.012480 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.012668 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.012772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.012996 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.013095 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.013323 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.013431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.013649 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.013742 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.013951 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.014044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.014254 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.014434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.014577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.014673 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.014880 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.014987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.015224 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.015335 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.015602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.015704 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.015919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.016024 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.016228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.016321 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.016535 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.016669 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.016869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.016972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.017180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.017274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.017495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.017590 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.017812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.017925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.018126 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.018221 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.018435 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.018537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.018744 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.018839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.019071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.019182 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.020010 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.020108 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.020281 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.020414 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.020606 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.020738 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.020935 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.021031 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.021263 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.021365 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.021575 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.021678 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.021905 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.022000 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.022219 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.022324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.022529 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.022653 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.022840 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.022950 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.023175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.023368 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.023526 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.023679 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.023837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.024004 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.024160 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.024331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.024494 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.024638 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.024829 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.024934 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.025145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.025240 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.025483 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.025579 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.025809 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.025915 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.026132 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.026235 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.026434 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.026530 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.026745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.026877 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.027053 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.027203 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.027387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.027495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.027698 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.027802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.028004 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.028106 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.028310 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.028411 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.028618 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.028720 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.028930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.029023 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.029241 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.029370 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.029550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.029681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.029858 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.029957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.030164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.030267 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.030480 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.030611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.030787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.030891 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.031094 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.031228 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.031420 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.031518 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.031723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.031857 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.032028 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.032131 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.032357 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.032452 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.032670 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.032791 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.032997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.033105 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.033317 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.033418 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.033623 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.033715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.033955 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.034050 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.034267 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.034369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.034584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.034676 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.034918 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.035102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.035340 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.035434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.035649 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.035857 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.035962 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.036181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.036276 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.036519 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.036648 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.036809 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.036915 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.037135 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.037238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.037444 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.037547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.037753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.037849 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.038055 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.038186 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.038356 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.038453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.038680 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.038921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.039024 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.039280 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.039390 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.039601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.039716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.039904 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.040006 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.040208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.040310 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.040509 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.040613 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.040822 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.040923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.041137 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.041231 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.041453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.041548 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.041766 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.041865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.042077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.042172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.042399 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.042529 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.042707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.042840 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.043030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.043154 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.043370 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.043467 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.043686 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.043780 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.044025 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.044172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.044346 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.044482 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.044665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.044799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.045026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.045133 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.045345 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.045440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.045653 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.045761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.045968 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.046076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.046280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.046381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.046594 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.046695 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.046910 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.047160 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.047275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.047491 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.047587 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.047812 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.047917 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.048126 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.048228 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.048438 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.048534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.048749 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.048856 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.049060 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.049162 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.049371 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.049474 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.049681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.049785 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.049993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.050094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.050300 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.050395 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.051161 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.051307 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.051489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.051714 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.051884 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.052139 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.052312 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.052455 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.052549 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.052770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.052886 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.053083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.053220 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.053396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.053552 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.053751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.053876 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.054065 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.054199 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.054372 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.054530 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.054686 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.054842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.054999 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.055173 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.055339 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.055483 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.055649 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.055800 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.055958 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.056111 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.056270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.056440 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.056581 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.056758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.056891 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.057067 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.057199 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.057391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.057510 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.057713 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.057816 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.058132 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.058255 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.058467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.058613 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.058785 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.058934 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.059096 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.059294 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.059429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.059626 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.059826 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.059948 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.060260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.060353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.060589 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.060695 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.060903 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.060997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.061214 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.061310 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.061536 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.061644 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.061854 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.061950 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.062165 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.062258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.062474 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.062583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.062791 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.062942 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.063120 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.063265 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.063439 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.063542 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.063752 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.063847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.064057 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.064159 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.064379 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.064475 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.064689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.064793 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.064992 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.065086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.065300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.065401 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.065607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.065700 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.065912 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.066140 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.066318 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.066559 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.066758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.066881 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.067070 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.067245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.067415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.067511 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.067732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.067833 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.068048 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.068151 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.068356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.068452 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.068671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.068765 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.068978 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.069087 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.069291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.069387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.069621 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.069714 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.069928 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.070031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.070233 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.070328 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.070543 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.070691 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.070851 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.070953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.071174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.071272 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.071489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.071593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.071793 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.071897 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.072116 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.072212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.072418 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.072553 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.072723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.072846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.073025 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.073300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.073423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.073623 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.073726 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.073927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.074023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.074231 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.074333 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.074533 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.074635 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.074843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.074944 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.075196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.075294 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.075507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.075602 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.075833 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.075928 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.076141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.076235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.095587 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.095791 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.095947 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.096035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.096035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.096256 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.096356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.096457 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.096546 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.096675 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.096807 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.096930 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.097029 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.097177 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.097290 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.097559 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.097673 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.101660 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.101888 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.102120 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.102375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.102709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.102986 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.103329 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.103596 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.103875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.104247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.104247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.104674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.104914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.105196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.105486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.105737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.105985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.106218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.106458 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.106734 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.107046 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.107377 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.107650 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.107819 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.107994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.108186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.108993 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.109131 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.109248 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.109444 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.109625 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.109720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.109720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.109841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.109952 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.110031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.110089 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.110155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.110213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.110290 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.110356 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.110411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.110411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.110411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.110644 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.110700 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.110755 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.110897 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.111028 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.111028 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.111183 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.111280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.111402 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.111477 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.111552 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.111611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.111667 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.111854 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.111930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.112154 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.112264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.112341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.112400 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.112463 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.112521 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.112619 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.112689 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.112755 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.112824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.112918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.113071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.113152 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.113211 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.113275 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.113333 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.113387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.113454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.113522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.113592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.113668 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.113737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.113805 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.113873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.113940 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.114005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.114062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.114116 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.114171 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.114226 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.114281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.114344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.114400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.114454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.114508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.114562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.114616 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.114679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.114736 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.114790 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.114844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.114943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.115016 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.115085 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.115085 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.115085 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.115276 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.115443 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.115526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.115606 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.115606 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.115606 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.115764 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.115819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.115819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.115938 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.116008 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.116077 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.116146 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.116215 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.116215 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.116407 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.116482 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.116482 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.116608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.116608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.116608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.116784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.116854 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.116923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.116992 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.116992 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.117112 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.117181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.117249 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.117318 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.117387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.117455 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.117455 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.117588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.117657 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.117725 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.117794 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.117862 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.117939 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.118014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.118083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.118152 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.118221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.118290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.118367 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.118438 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.118507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.118576 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.118645 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.118722 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.118792 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.118860 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.119010 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.119085 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.119085 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.119223 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.119283 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.119339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.119393 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.119448 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.119502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.119565 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.119622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.119677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.119677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.119774 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.119904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.119964 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.120020 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.120075 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.120130 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.120184 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.120263 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.120335 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.120404 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.120473 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.120543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.120611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.120689 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.120759 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.120828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.120897 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.120966 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.121023 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.121088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.121147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.121147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.121247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.121302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.121366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.121423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.121479 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.121535 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.121590 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.121658 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.121735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.121806 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.121876 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.121933 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.121990 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.122045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.122109 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 22:24:06.122382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.122382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.122382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.122382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.122382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.122382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.122382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.122382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.122829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.122829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.122829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.122829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.122829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.123148 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.123253 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.123666 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.123995 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.124378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.124717 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.125057 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.125376 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.125711 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.126044 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.126403 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.126720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.127073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.127437 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.127760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.128076 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.128390 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 22:24:06.128637 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 22:24:06.273422 n-d-847009-3 devstack@n-api.service[119338]: INFO dbcounter [None req-7bab8f36-c5df-4028-94c3-2a36ac5decff None None] Registered counter for database nova_api Jul 19 22:24:06.285714 n-d-847009-3 devstack@n-api.service[119337]: INFO dbcounter [None req-88326767-5cee-4b23-bf8b-e52ffe63fc52 None None] Registered counter for database nova_api Jul 19 22:24:06.294351 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_db.sqlalchemy.engines [None req-7bab8f36-c5df-4028-94c3-2a36ac5decff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 22:24:06.301641 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writer thread running {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 22:24:06.306582 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_db.sqlalchemy.engines [None req-88326767-5cee-4b23-bf8b-e52ffe63fc52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 22:24:06.313183 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writer thread running {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 22:24:06.360052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.context [None req-7bab8f36-c5df-4028-94c3-2a36ac5decff None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9ec50c5-1e53-4d76-a6eb-599548551fc7(cell1) {{(pid=119338) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 22:24:06.364523 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bab8f36-c5df-4028-94c3-2a36ac5decff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:06.366162 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bab8f36-c5df-4028-94c3-2a36ac5decff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:06.367148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bab8f36-c5df-4028-94c3-2a36ac5decff None None] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:06.369182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bab8f36-c5df-4028-94c3-2a36ac5decff None None] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:06.371297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.context [None req-88326767-5cee-4b23-bf8b-e52ffe63fc52 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9ec50c5-1e53-4d76-a6eb-599548551fc7(cell1) {{(pid=119337) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 22:24:06.371409 n-d-847009-3 devstack@n-api.service[119338]: INFO dbcounter [None req-7bab8f36-c5df-4028-94c3-2a36ac5decff None None] Registered counter for database nova_cell0 Jul 19 22:24:06.375494 n-d-847009-3 devstack@n-api.service[119338]: INFO dbcounter [None req-7bab8f36-c5df-4028-94c3-2a36ac5decff None None] Registered counter for database nova_cell1 Jul 19 22:24:06.375601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88326767-5cee-4b23-bf8b-e52ffe63fc52 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:06.377186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88326767-5cee-4b23-bf8b-e52ffe63fc52 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:06.378105 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88326767-5cee-4b23-bf8b-e52ffe63fc52 None None] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:06.380685 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88326767-5cee-4b23-bf8b-e52ffe63fc52 None None] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:06.382779 n-d-847009-3 devstack@n-api.service[119337]: INFO dbcounter [None req-88326767-5cee-4b23-bf8b-e52ffe63fc52 None None] Registered counter for database nova_cell0 Jul 19 22:24:06.383659 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_db.sqlalchemy.engines [None req-7bab8f36-c5df-4028-94c3-2a36ac5decff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 22:24:06.387314 n-d-847009-3 devstack@n-api.service[119337]: INFO dbcounter [None req-88326767-5cee-4b23-bf8b-e52ffe63fc52 None None] Registered counter for database nova_cell1 Jul 19 22:24:06.388826 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writer thread running {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 22:24:06.389510 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_db.sqlalchemy.engines [None req-7bab8f36-c5df-4028-94c3-2a36ac5decff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 22:24:06.395363 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_db.sqlalchemy.engines [None req-88326767-5cee-4b23-bf8b-e52ffe63fc52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 22:24:06.400452 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writer thread running {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 22:24:06.541950 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_db.sqlalchemy.engines [None req-88326767-5cee-4b23-bf8b-e52ffe63fc52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 22:24:06.552469 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writer thread running {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 22:24:06.555773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writer thread running {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 22:24:06.562750 n-d-847009-3 devstack@n-api.service[119337]: INFO dbcounter [None req-88326767-5cee-4b23-bf8b-e52ffe63fc52 None None] Registered counter for database nova_cell0 Jul 19 22:24:06.566912 n-d-847009-3 devstack@n-api.service[119338]: INFO dbcounter [None req-7bab8f36-c5df-4028-94c3-2a36ac5decff None None] Registered counter for database nova_cell0 Jul 19 22:24:06.570294 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_db.sqlalchemy.engines [None req-88326767-5cee-4b23-bf8b-e52ffe63fc52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 22:24:06.573818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_db.sqlalchemy.engines [None req-7bab8f36-c5df-4028-94c3-2a36ac5decff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 22:24:06.575426 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writer thread running {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 22:24:06.578200 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writer thread running {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 22:24:06.902889 n-d-847009-3 devstack@n-api.service[119338]: WARNING keystonemiddleware.auth_token [None req-7bab8f36-c5df-4028-94c3-2a36ac5decff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 22:24:06.905001 n-d-847009-3 devstack@n-api.service[119337]: WARNING keystonemiddleware.auth_token [None req-88326767-5cee-4b23-bf8b-e52ffe63fc52 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 22:24:06.910652 n-d-847009-3 devstack@n-api.service[119338]: WARNING keystonemiddleware.auth_token [None req-7bab8f36-c5df-4028-94c3-2a36ac5decff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 22:24:06.912385 n-d-847009-3 devstack@n-api.service[119337]: WARNING keystonemiddleware.auth_token [None req-88326767-5cee-4b23-bf8b-e52ffe63fc52 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 22:24:07.259362 n-d-847009-3 devstack@n-api.service[119338]: WARNING keystonemiddleware.auth_token [None req-7bab8f36-c5df-4028-94c3-2a36ac5decff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 22:24:07.265342 n-d-847009-3 devstack@n-api.service[119338]: WARNING keystonemiddleware.auth_token [None req-7bab8f36-c5df-4028-94c3-2a36ac5decff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 22:24:07.268754 n-d-847009-3 devstack@n-api.service[119337]: WARNING keystonemiddleware.auth_token [None req-88326767-5cee-4b23-bf8b-e52ffe63fc52 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 22:24:07.271548 n-d-847009-3 devstack@n-api.service[119338]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5602f55529c0 pid: 119338 (default app) Jul 19 22:24:07.274808 n-d-847009-3 devstack@n-api.service[119337]: WARNING keystonemiddleware.auth_token [None req-88326767-5cee-4b23-bf8b-e52ffe63fc52 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 22:24:07.280988 n-d-847009-3 devstack@n-api.service[119337]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5602f55529c0 pid: 119337 (default app) Jul 19 22:24:51.998982 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:24:52.001400 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:24:52.002858 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:24:52.004197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:24:53.349493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f97beed1-91b1-4f5d-b2f2-38ec5d617193 tempest-HypervisorAdminNegativeTestJSON-1714270727 tempest-HypervisorAdminNegativeTestJSON-1714270727-project] Calling method '.version_select at 0x7f7a12eb4ca0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:53.351934 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:53.351934 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:24:53.353647 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f97beed1-91b1-4f5d-b2f2-38ec5d617193 tempest-HypervisorAdminNegativeTestJSON-1714270727 tempest-HypervisorAdminNegativeTestJSON-1714270727-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '9fcc0c6484be4dd0a543c689e0acfbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce87399236e445d8cf54618fa08fc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:24:53.359458 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f97beed1-91b1-4f5d-b2f2-38ec5d617193 tempest-HypervisorAdminNegativeTestJSON-1714270727 tempest-HypervisorAdminNegativeTestJSON-1714270727-project] Request method failure captured: Jul 19 22:24:53.359458 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 19 22:24:53.359458 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:24:53.359458 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:24:53.359458 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:24:53.359458 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:24:53.359458 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:24:53.359458 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:24:53.359458 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:24:53.359458 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:24:53.359458 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y8xUJcV77BK4PeQB_i_S1SF1__BY1otorjqTMezXLxQnLukpoFRdG-P9hi9e3oJH-ZAIX69jErTnLeKU_zpMIYQwY3ISUkzhIENRTCdUfCV28VZGnW9iOMvq7yb7TQ-J_fEfjIZmHmN2EPYGrxetwG7zr6dOtdqnuOlmQ1MiIDnpEg Jul 19 22:24:53.359458 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:24:53.359458 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:24:53.359458 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:24:53.359458 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:24:53.359458 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:24:53.359458 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:24:53.359458 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 2ce87399236e445d8cf54618fa08fc5d Jul 19 22:24:53.359458 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1714270727 Jul 19 22:24:53.359458 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:24:53.359458 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:24:53.360723 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ce87399236e445d8cf54618fa08fc5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ce87399236e445d8cf54618fa08fc5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ce87399236e445d8cf54618fa08fc5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ce87399236e445d8cf54618fa08fc5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:24:53.360723 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1714270727 Jul 19 22:24:53.360723 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 2ce87399236e445d8cf54618fa08fc5d Jul 19 22:24:53.360723 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1714270727 Jul 19 22:24:53.360723 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-HypervisorAdminNegativeTestJSON-1714270727-project Jul 19 22:24:53.360723 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:24:53.360723 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:24:53.360723 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 9fcc0c6484be4dd0a543c689e0acfbdc Jul 19 22:24:53.360723 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1714270727-project Jul 19 22:24:53.360723 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:24:53.360723 n-d-847009-3 devstack@n-api.service[119338]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 19 22:24:53.360723 n-d-847009-3 devstack@n-api.service[119338]: action_args: {} Jul 19 22:24:53.360723 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:24:53.361508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:53.361508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:53.361508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:53.361508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:24:53.361508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:24:53.361508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:24:53.361508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:24:53.361508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:24:53.361508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:24:53.361508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 19 22:24:53.361508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 19 22:24:53.361508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 19 22:24:53.361508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 19 22:24:53.361508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:24:53.361508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:24:53.361508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:24:53.361508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:24:53.361508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:24:53.361508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:24:53.363366 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:24:53.363366 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:24:53.363366 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:24:53.363366 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:24:53.363366 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:24:53.363366 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:24:53.363366 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:24:53.363366 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:24:53.363366 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 19 22:24:53.363366 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:24:53.363366 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:53.363366 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:24:53.363366 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:53.363366 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:53.363366 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:53.363366 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:24:53.363366 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:24:53.363366 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 19 22:24:53.363366 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:24:53.365549 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f97beed1-91b1-4f5d-b2f2-38ec5d617193 tempest-HypervisorAdminNegativeTestJSON-1714270727 tempest-HypervisorAdminNegativeTestJSON-1714270727-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:24:53.371446 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f97beed1-91b1-4f5d-b2f2-38ec5d617193 tempest-HypervisorAdminNegativeTestJSON-1714270727 tempest-HypervisorAdminNegativeTestJSON-1714270727-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 1.383068 Jul 19 22:24:53.372629 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1/1] 10.222.0.25 () {58 vars in 1166 bytes} [Tue Jul 19 22:24:51 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 1386 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:24:53.408922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:24:53.410481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:24:53.413607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:24:53.415373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:24:53.704367 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4f277217-aa65-4e02-adcd-a2f7739a9458 tempest-HypervisorAdminNegativeTestJSON-1714270727 tempest-HypervisorAdminNegativeTestJSON-1714270727-project] Calling method '.version_select at 0x7f7a12f065e0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:53.707399 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:53.707399 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:24:53.708999 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4f277217-aa65-4e02-adcd-a2f7739a9458 tempest-HypervisorAdminNegativeTestJSON-1714270727 tempest-HypervisorAdminNegativeTestJSON-1714270727-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '9fcc0c6484be4dd0a543c689e0acfbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce87399236e445d8cf54618fa08fc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:24:53.712380 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4f277217-aa65-4e02-adcd-a2f7739a9458 tempest-HypervisorAdminNegativeTestJSON-1714270727 tempest-HypervisorAdminNegativeTestJSON-1714270727-project] Request method failure captured: Jul 19 22:24:53.712380 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 19 22:24:53.712380 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:24:53.712380 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:24:53.712380 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:24:53.712380 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:24:53.712380 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:24:53.712380 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:24:53.712380 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:24:53.712380 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:24:53.712380 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y8xUJcV77BK4PeQB_i_S1SF1__BY1otorjqTMezXLxQnLukpoFRdG-P9hi9e3oJH-ZAIX69jErTnLeKU_zpMIYQwY3ISUkzhIENRTCdUfCV28VZGnW9iOMvq7yb7TQ-J_fEfjIZmHmN2EPYGrxetwG7zr6dOtdqnuOlmQ1MiIDnpEg Jul 19 22:24:53.712380 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:24:53.712380 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:24:53.712380 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:24:53.712380 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:24:53.712380 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:24:53.712380 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:24:53.712380 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 2ce87399236e445d8cf54618fa08fc5d Jul 19 22:24:53.712380 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1714270727 Jul 19 22:24:53.712380 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:24:53.712380 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:24:53.713386 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ce87399236e445d8cf54618fa08fc5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ce87399236e445d8cf54618fa08fc5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ce87399236e445d8cf54618fa08fc5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ce87399236e445d8cf54618fa08fc5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:24:53.713386 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1714270727 Jul 19 22:24:53.713386 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 2ce87399236e445d8cf54618fa08fc5d Jul 19 22:24:53.713386 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1714270727 Jul 19 22:24:53.713386 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-HypervisorAdminNegativeTestJSON-1714270727-project Jul 19 22:24:53.713386 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:24:53.713386 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:24:53.713386 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 9fcc0c6484be4dd0a543c689e0acfbdc Jul 19 22:24:53.713386 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1714270727-project Jul 19 22:24:53.713386 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:24:53.713386 n-d-847009-3 devstack@n-api.service[119337]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 19 22:24:53.713386 n-d-847009-3 devstack@n-api.service[119337]: action_args: {} Jul 19 22:24:53.713386 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:24:53.713994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:53.713994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:53.713994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:53.713994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:24:53.713994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:24:53.713994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:24:53.713994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:24:53.713994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:24:53.713994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:24:53.713994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 19 22:24:53.713994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 19 22:24:53.713994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 19 22:24:53.713994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 19 22:24:53.713994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:24:53.713994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:24:53.713994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:24:53.713994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:24:53.713994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:24:53.713994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:24:53.714842 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:24:53.714842 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:24:53.714842 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:24:53.714842 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:24:53.714842 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:24:53.714842 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:24:53.714842 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:24:53.714842 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:24:53.714842 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 19 22:24:53.714842 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:53.714842 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:53.714842 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:53.714842 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:53.714842 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:53.714842 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:53.714842 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:24:53.714842 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:24:53.714842 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 19 22:24:53.714842 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:53.717360 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4f277217-aa65-4e02-adcd-a2f7739a9458 tempest-HypervisorAdminNegativeTestJSON-1714270727 tempest-HypervisorAdminNegativeTestJSON-1714270727-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:24:53.718575 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4f277217-aa65-4e02-adcd-a2f7739a9458 tempest-HypervisorAdminNegativeTestJSON-1714270727 tempest-HypervisorAdminNegativeTestJSON-1714270727-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.332316 Jul 19 22:24:53.726033 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1/2] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:24:53 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 344 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:24:53.733762 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-83395b7d-56a4-4914-865b-42f860e7486d tempest-HypervisorAdminNegativeTestJSON-1714270727 tempest-HypervisorAdminNegativeTestJSON-1714270727-project] Calling method '.version_select at 0x7f7a12d7d670>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:53.734875 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:53.734875 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:24:53.736407 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-83395b7d-56a4-4914-865b-42f860e7486d tempest-HypervisorAdminNegativeTestJSON-1714270727 tempest-HypervisorAdminNegativeTestJSON-1714270727-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '9fcc0c6484be4dd0a543c689e0acfbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce87399236e445d8cf54618fa08fc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:24:53.738631 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-83395b7d-56a4-4914-865b-42f860e7486d tempest-HypervisorAdminNegativeTestJSON-1714270727 tempest-HypervisorAdminNegativeTestJSON-1714270727-project] Request method failure captured: Jul 19 22:24:53.738631 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 19 22:24:53.738631 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:24:53.738631 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:24:53.738631 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:24:53.738631 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:24:53.738631 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:24:53.738631 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:24:53.738631 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:24:53.738631 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:24:53.738631 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y8xUJcV77BK4PeQB_i_S1SF1__BY1otorjqTMezXLxQnLukpoFRdG-P9hi9e3oJH-ZAIX69jErTnLeKU_zpMIYQwY3ISUkzhIENRTCdUfCV28VZGnW9iOMvq7yb7TQ-J_fEfjIZmHmN2EPYGrxetwG7zr6dOtdqnuOlmQ1MiIDnpEg Jul 19 22:24:53.738631 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:24:53.738631 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:24:53.738631 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:24:53.738631 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:24:53.738631 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:24:53.738631 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:24:53.738631 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 2ce87399236e445d8cf54618fa08fc5d Jul 19 22:24:53.738631 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1714270727 Jul 19 22:24:53.738631 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:24:53.738631 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:24:53.739669 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ce87399236e445d8cf54618fa08fc5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ce87399236e445d8cf54618fa08fc5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ce87399236e445d8cf54618fa08fc5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ce87399236e445d8cf54618fa08fc5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:24:53.739669 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1714270727 Jul 19 22:24:53.739669 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 2ce87399236e445d8cf54618fa08fc5d Jul 19 22:24:53.739669 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1714270727 Jul 19 22:24:53.739669 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-HypervisorAdminNegativeTestJSON-1714270727-project Jul 19 22:24:53.739669 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:24:53.739669 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:24:53.739669 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 9fcc0c6484be4dd0a543c689e0acfbdc Jul 19 22:24:53.739669 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1714270727-project Jul 19 22:24:53.739669 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:24:53.739669 n-d-847009-3 devstack@n-api.service[119338]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 19 22:24:53.739669 n-d-847009-3 devstack@n-api.service[119338]: action_args: {} Jul 19 22:24:53.739669 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:24:53.740274 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:53.740274 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:53.740274 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:53.740274 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:24:53.740274 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:24:53.740274 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:24:53.740274 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:24:53.740274 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:24:53.740274 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:24:53.740274 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 19 22:24:53.740274 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 19 22:24:53.740274 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:24:53.740274 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:24:53.740274 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:24:53.740274 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:24:53.740274 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:24:53.740274 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:24:53.740274 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:24:53.740274 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:24:53.741117 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:24:53.741117 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:24:53.741117 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:24:53.741117 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:24:53.741117 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:24:53.741117 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:24:53.741117 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 19 22:24:53.741117 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:24:53.741117 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:53.741117 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:24:53.741117 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:53.741117 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:53.741117 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:53.741117 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:24:53.741117 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:24:53.741117 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 19 22:24:53.741117 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:24:53.743896 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-83395b7d-56a4-4914-865b-42f860e7486d tempest-HypervisorAdminNegativeTestJSON-1714270727 tempest-HypervisorAdminNegativeTestJSON-1714270727-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:24:53.744840 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-83395b7d-56a4-4914-865b-42f860e7486d tempest-HypervisorAdminNegativeTestJSON-1714270727 tempest-HypervisorAdminNegativeTestJSON-1714270727-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.016607 Jul 19 22:24:53.750841 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1178 bytes} [Tue Jul 19 22:24:53 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:24:54.465321 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-15c988ba-9486-4faf-b3da-e093a738165b tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:54.466967 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:54.466967 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:24:54.468587 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-15c988ba-9486-4faf-b3da-e093a738165b tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:54.469200 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-15c988ba-9486-4faf-b3da-e093a738165b tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:54.470218 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-15c988ba-9486-4faf-b3da-e093a738165b tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:54.470661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-15c988ba-9486-4faf-b3da-e093a738165b tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:54.530466 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-15c988ba-9486-4faf-b3da-e093a738165b tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.680043 Jul 19 22:24:54.531612 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3/4] 10.222.0.25 () {58 vars in 1175 bytes} [Tue Jul 19 22:24:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:24:54.897066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4f7efbaa-4d9c-4fe5-9a4f-4e0dbd852bf2 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Calling method '.version_select at 0x7f7a12d453a0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:54.898862 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:54.898862 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:24:54.904561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fa2b2970-3644-4328-8922-39db5877c5c9 tempest-HypervisorAdminNegativeTestJSON-1963237076 tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin] Calling method '.version_select at 0x7f7a13719040>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:54.908803 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4f7efbaa-4d9c-4fe5-9a4f-4e0dbd852bf2 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9ec50c5-1e53-4d76-a6eb-599548551fc7(cell1) {{(pid=119338) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 19 22:24:54.910041 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f7efbaa-4d9c-4fe5-9a4f-4e0dbd852bf2 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:54.910665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f7efbaa-4d9c-4fe5-9a4f-4e0dbd852bf2 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:54.913469 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fa2b2970-3644-4328-8922-39db5877c5c9 tempest-HypervisorAdminNegativeTestJSON-1963237076 tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9ec50c5-1e53-4d76-a6eb-599548551fc7(cell1) {{(pid=119337) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 19 22:24:54.914461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa2b2970-3644-4328-8922-39db5877c5c9 tempest-HypervisorAdminNegativeTestJSON-1963237076 tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:54.915221 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa2b2970-3644-4328-8922-39db5877c5c9 tempest-HypervisorAdminNegativeTestJSON-1963237076 tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:54.946493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa2b2970-3644-4328-8922-39db5877c5c9 tempest-HypervisorAdminNegativeTestJSON-1963237076 tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:54.946928 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f7efbaa-4d9c-4fe5-9a4f-4e0dbd852bf2 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:54.950332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f7efbaa-4d9c-4fe5-9a4f-4e0dbd852bf2 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:54.951491 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa2b2970-3644-4328-8922-39db5877c5c9 tempest-HypervisorAdminNegativeTestJSON-1963237076 tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:54.968152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f7efbaa-4d9c-4fe5-9a4f-4e0dbd852bf2 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:54.968610 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa2b2970-3644-4328-8922-39db5877c5c9 tempest-HypervisorAdminNegativeTestJSON-1963237076 tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:54.968726 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f7efbaa-4d9c-4fe5-9a4f-4e0dbd852bf2 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:54.969335 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa2b2970-3644-4328-8922-39db5877c5c9 tempest-HypervisorAdminNegativeTestJSON-1963237076 tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:54.978845 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4f7efbaa-4d9c-4fe5-9a4f-4e0dbd852bf2 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.445911 Jul 19 22:24:54.981197 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fa2b2970-3644-4328-8922-39db5877c5c9 tempest-HypervisorAdminNegativeTestJSON-1963237076 tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.229125 Jul 19 22:24:54.982045 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2/5] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:24:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:24:54.990017 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 4/6] 10.222.0.25 () {58 vars in 1166 bytes} [Tue Jul 19 22:24:54 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:24:54.997123 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0d7e24a7-256a-40e8-bbe4-9c37f413594b tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-268008183"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:24:55.023354 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:55.023354 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:24:55.024392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.aggregate [None req-0d7e24a7-256a-40e8-bbe4-9c37f413594b tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Generated uuid 1d86816b-1e9f-432f-909b-54846d1df5ad for aggregate {{(pid=119338) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 22:24:55.063504 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-00f15025-8d59-44bc-8bff-999d0450620b tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1901342565", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:24:55.147431 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0d7e24a7-256a-40e8-bbe4-9c37f413594b tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.155609 Jul 19 22:24:55.149540 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 5/7] 10.222.0.25 () {60 vars in 1163 bytes} [Tue Jul 19 22:24:54 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:24:55.418750 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a0f4eba3-4df0-4047-907d-235c91b28759 tempest-FlavorsV261TestJSON-1222550244 tempest-FlavorsV261TestJSON-1222550244-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-34206840", "id": 2503276, "os-flavor-access:is_public": "True"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:24:55.420490 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:55.420490 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:24:55.492196 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a0f4eba3-4df0-4047-907d-235c91b28759 tempest-FlavorsV261TestJSON-1222550244 tempest-FlavorsV261TestJSON-1222550244-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 457 microversion: 2.61 time: 0.340354 Jul 19 22:24:55.501102 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 6/8] 10.222.0.25 () {62 vars in 1187 bytes} [Tue Jul 19 22:24:55 2022] POST /compute/v2.1/flavors => generated 457 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:24:55.540002 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-00f15025-8d59-44bc-8bff-999d0450620b tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] validate_networks() for None {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:24:55.909398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9724be56-ccd8-473b-9a3c-2a491267d739 tempest-AggregatesAdminTestV241-2009819940 tempest-AggregatesAdminTestV241-2009819940-project-admin] Calling method '.version_select at 0x7f7a124e1040>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:55.910875 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:55.910875 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:24:55.912344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9724be56-ccd8-473b-9a3c-2a491267d739 tempest-AggregatesAdminTestV241-2009819940 tempest-AggregatesAdminTestV241-2009819940-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:55.914418 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9724be56-ccd8-473b-9a3c-2a491267d739 tempest-AggregatesAdminTestV241-2009819940 tempest-AggregatesAdminTestV241-2009819940-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:55.963207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9724be56-ccd8-473b-9a3c-2a491267d739 tempest-AggregatesAdminTestV241-2009819940 tempest-AggregatesAdminTestV241-2009819940-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:55.963679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9724be56-ccd8-473b-9a3c-2a491267d739 tempest-AggregatesAdminTestV241-2009819940 tempest-AggregatesAdminTestV241-2009819940-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:55.989580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9724be56-ccd8-473b-9a3c-2a491267d739 tempest-AggregatesAdminTestV241-2009819940 tempest-AggregatesAdminTestV241-2009819940-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:55.991954 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9724be56-ccd8-473b-9a3c-2a491267d739 tempest-AggregatesAdminTestV241-2009819940 tempest-AggregatesAdminTestV241-2009819940-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:56.014018 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9724be56-ccd8-473b-9a3c-2a491267d739 tempest-AggregatesAdminTestV241-2009819940 tempest-AggregatesAdminTestV241-2009819940-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.508667 Jul 19 22:24:56.015376 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 7/9] 10.222.0.25 () {60 vars in 1207 bytes} [Tue Jul 19 22:24:55 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:24:56.027095 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-21d79515-e7e0-4219-b290-b9486c57c8fd tempest-HypervisorAdminNegativeTestJSON-1714270727 tempest-HypervisorAdminNegativeTestJSON-1714270727-project] Calling method '.version_select at 0x7f7a11487550>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:56.030164 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:56.030164 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:24:56.030703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-21d79515-e7e0-4219-b290-b9486c57c8fd tempest-HypervisorAdminNegativeTestJSON-1714270727 tempest-HypervisorAdminNegativeTestJSON-1714270727-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '9fcc0c6484be4dd0a543c689e0acfbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce87399236e445d8cf54618fa08fc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:24:56.037275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-21d79515-e7e0-4219-b290-b9486c57c8fd tempest-HypervisorAdminNegativeTestJSON-1714270727 tempest-HypervisorAdminNegativeTestJSON-1714270727-project] Request method failure captured: Jul 19 22:24:56.037275 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 19 22:24:56.037275 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:24:56.037275 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:24:56.037275 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:24:56.037275 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:24:56.037275 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:24:56.037275 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:24:56.037275 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:24:56.037275 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:24:56.037275 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y8xUJcV77BK4PeQB_i_S1SF1__BY1otorjqTMezXLxQnLukpoFRdG-P9hi9e3oJH-ZAIX69jErTnLeKU_zpMIYQwY3ISUkzhIENRTCdUfCV28VZGnW9iOMvq7yb7TQ-J_fEfjIZmHmN2EPYGrxetwG7zr6dOtdqnuOlmQ1MiIDnpEg Jul 19 22:24:56.037275 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:24:56.037275 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:24:56.037275 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:24:56.037275 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:24:56.037275 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:24:56.037275 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:24:56.037275 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 2ce87399236e445d8cf54618fa08fc5d Jul 19 22:24:56.037275 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1714270727 Jul 19 22:24:56.037275 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:24:56.037275 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:24:56.038485 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ce87399236e445d8cf54618fa08fc5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ce87399236e445d8cf54618fa08fc5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ce87399236e445d8cf54618fa08fc5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ce87399236e445d8cf54618fa08fc5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:24:56.038485 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1714270727 Jul 19 22:24:56.038485 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 2ce87399236e445d8cf54618fa08fc5d Jul 19 22:24:56.038485 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1714270727 Jul 19 22:24:56.038485 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-HypervisorAdminNegativeTestJSON-1714270727-project Jul 19 22:24:56.038485 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:24:56.038485 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:24:56.038485 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 9fcc0c6484be4dd0a543c689e0acfbdc Jul 19 22:24:56.038485 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1714270727-project Jul 19 22:24:56.038485 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:24:56.038485 n-d-847009-3 devstack@n-api.service[119338]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 19 22:24:56.038485 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '1'} Jul 19 22:24:56.038485 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:24:56.039599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:56.039599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:56.039599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:56.039599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:24:56.039599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:24:56.039599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:24:56.039599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:24:56.039599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:24:56.039599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:24:56.039599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 19 22:24:56.039599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 19 22:24:56.039599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:24:56.039599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:24:56.039599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:24:56.039599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:24:56.039599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:24:56.039599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:24:56.039599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:24:56.039599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:24:56.040729 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:24:56.040729 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:24:56.040729 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:24:56.040729 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:24:56.040729 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:24:56.040729 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:24:56.040729 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 19 22:24:56.040729 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:24:56.040729 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:56.040729 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:24:56.040729 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:56.040729 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:56.040729 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:56.040729 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:24:56.040729 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:24:56.040729 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 19 22:24:56.040729 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:24:56.042147 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-21d79515-e7e0-4219-b290-b9486c57c8fd tempest-HypervisorAdminNegativeTestJSON-1714270727 tempest-HypervisorAdminNegativeTestJSON-1714270727-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:24:56.042147 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-21d79515-e7e0-4219-b290-b9486c57c8fd tempest-HypervisorAdminNegativeTestJSON-1714270727 tempest-HypervisorAdminNegativeTestJSON-1714270727-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.023140 Jul 19 22:24:56.044023 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 8/10] 10.222.0.25 () {58 vars in 1172 bytes} [Tue Jul 19 22:24:56 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:24:56.048551 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-00f15025-8d59-44bc-8bff-999d0450620b tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:24:56.048982 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-00f15025-8d59-44bc-8bff-999d0450620b tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:24:56.050202 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-00f15025-8d59-44bc-8bff-999d0450620b tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:24:56.051191 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-00f15025-8d59-44bc-8bff-999d0450620b tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:24:56.051892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-00f15025-8d59-44bc-8bff-999d0450620b tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:24:56.068851 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-00f15025-8d59-44bc-8bff-999d0450620b tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:56.069712 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-00f15025-8d59-44bc-8bff-999d0450620b tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:56.070816 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-00f15025-8d59-44bc-8bff-999d0450620b tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:56.071464 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-00f15025-8d59-44bc-8bff-999d0450620b tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:56.079455 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5a3b7f7a-117f-441a-a94a-1994edd75801 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-847009-3"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:24:56.095084 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:56.095084 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:24:56.112176 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-00f15025-8d59-44bc-8bff-999d0450620b tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Getting quotas for project 8809f0e3adc6408fb52877e942b68811. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:24:56.120141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-00f15025-8d59-44bc-8bff-999d0450620b tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Getting quotas for user a8c2f7f94a524d80a1a3c2e105d488b4 and project 8809f0e3adc6408fb52877e942b68811. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:24:56.133017 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5a3b7f7a-117f-441a-a94a-1994edd75801 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:56.133457 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5a3b7f7a-117f-441a-a94a-1994edd75801 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:56.134114 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-00f15025-8d59-44bc-8bff-999d0450620b tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:24:56.137533 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-00f15025-8d59-44bc-8bff-999d0450620b tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:24:56.246974 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-00f15025-8d59-44bc-8bff-999d0450620b tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.262615 Jul 19 22:24:56.248272 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3/11] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:24:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1265 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:24:56.524059 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-93e51285-82ae-4954-ab51-7bc5568d0e92 tempest-FlavorsV261TestJSON-94961840 tempest-FlavorsV261TestJSON-94961840-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:56.545921 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-93e51285-82ae-4954-ab51-7bc5568d0e92 tempest-FlavorsV261TestJSON-94961840 tempest-FlavorsV261TestJSON-94961840-project] 10.222.0.25 "GET /compute/v2.1/flavors/2503276" status: 200 len: 457 microversion: 2.61 time: 0.296195 Jul 19 22:24:56.546922 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 4/12] 10.222.0.25 () {60 vars in 1189 bytes} [Tue Jul 19 22:24:56 2022] GET /compute/v2.1/flavors/2503276 => generated 457 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:24:56.554622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-50347e6c-4836-4761-8a86-5642675eed83 tempest-HypervisorAdminNegativeTestJSON-1963237076 tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin] Calling method '.version_select at 0x7f7a12ca7b80>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:56.556475 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:56.556475 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:24:56.558617 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-50347e6c-4836-4761-8a86-5642675eed83 tempest-HypervisorAdminNegativeTestJSON-1963237076 tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin] HTTP exception thrown: Hypervisor with ID 'c99d0b76-4b7e-4532-9f70-0fd84398ff6d' could not be found. Jul 19 22:24:56.561761 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-50347e6c-4836-4761-8a86-5642675eed83 tempest-HypervisorAdminNegativeTestJSON-1963237076 tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin] Request method failure captured: Jul 19 22:24:56.561761 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/os-hypervisors/c99d0b76-4b7e-4532-9f70-0fd84398ff6d/uptime HTTP/1.1 Jul 19 22:24:56.561761 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:24:56.561761 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:24:56.561761 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:24:56.561761 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:24:56.561761 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:24:56.561761 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:24:56.561761 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:24:56.561761 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:24:56.561761 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y8zMOpEdparMJjhLLCQfsVcXVKyWMxWGMkaKK0DvqxYkt_aLbWzRRH4anFqVvxxyTmt8KAivSLx9ykLsWd5yDi1kptLbJTPOqPtIqaIbRRUcow4vHPZPQS6KX-AfblqHeR9YGgnO2gv0Io9abeRIHPx8pv3pmKUoNPuI7DZEsfx98s Jul 19 22:24:56.561761 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:24:56.561761 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:24:56.561761 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:24:56.561761 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:24:56.561761 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:24:56.561761 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:24:56.561761 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 09347139dff74db39b4bf136d70fb204 Jul 19 22:24:56.561761 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1963237076 Jul 19 22:24:56.561761 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:24:56.561761 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:24:56.563015 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_09347139dff74db39b4bf136d70fb204"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09347139dff74db39b4bf136d70fb204"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/09347139dff74db39b4bf136d70fb204"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09347139dff74db39b4bf136d70fb204"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:24:56.563015 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1963237076 Jul 19 22:24:56.563015 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 09347139dff74db39b4bf136d70fb204 Jul 19 22:24:56.563015 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1963237076 Jul 19 22:24:56.563015 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin Jul 19 22:24:56.563015 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:24:56.563015 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:24:56.563015 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: d3505206f155404fb077331210a1fc9a Jul 19 22:24:56.563015 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin Jul 19 22:24:56.563015 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:24:56.563015 n-d-847009-3 devstack@n-api.service[119337]: exception: Hypervisor with ID 'c99d0b76-4b7e-4532-9f70-0fd84398ff6d' could not be found. Jul 19 22:24:56.563015 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'c99d0b76-4b7e-4532-9f70-0fd84398ff6d'} Jul 19 22:24:56.563780 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:24:56.563780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:56.563780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 19 22:24:56.563780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 19 22:24:56.563780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'c99d0b76-4b7e-4532-9f70-0fd84398ff6d' Jul 19 22:24:56.563780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:56.563780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:56.563780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:56.563780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:56.563780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 19 22:24:56.563780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 19 22:24:56.563780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 19 22:24:56.563780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 19 22:24:56.563780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 19 22:24:56.563780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:56.563780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:56.563780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:56.563780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:56.563780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 19 22:24:56.563780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 19 22:24:56.563780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 19 22:24:56.563780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 19 22:24:56.564932 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 19 22:24:56.564932 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:56.564932 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:56.564932 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:56.564932 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:56.564932 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:56.564932 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:56.564932 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:24:56.564932 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:24:56.564932 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:24:56.564932 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:24:56.564932 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:24:56.564932 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:24:56.564932 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 19 22:24:56.564932 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 19 22:24:56.564932 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 19 22:24:56.564932 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 22:24:56.564932 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'c99d0b76-4b7e-4532-9f70-0fd84398ff6d' could not be found. Jul 19 22:24:56.564932 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:56.564932 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:56.564932 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:56.566467 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:56.566467 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:56.566467 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:56.566467 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:24:56.566467 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:24:56.566467 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'c99d0b76-4b7e-4532-9f70-0fd84398ff6d' could not be found. Jul 19 22:24:56.566467 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:56.567895 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-50347e6c-4836-4761-8a86-5642675eed83 tempest-HypervisorAdminNegativeTestJSON-1963237076 tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin] Returning 404 to user: Hypervisor with ID 'c99d0b76-4b7e-4532-9f70-0fd84398ff6d' could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:24:56.569096 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-50347e6c-4836-4761-8a86-5642675eed83 tempest-HypervisorAdminNegativeTestJSON-1963237076 tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/c99d0b76-4b7e-4532-9f70-0fd84398ff6d/uptime" status: 404 len: 123 microversion: 2.1 time: 0.020619 Jul 19 22:24:56.570121 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 5/13] 10.222.0.25 () {58 vars in 1277 bytes} [Tue Jul 19 22:24:56 2022] GET /compute/v2.1/os-hypervisors/c99d0b76-4b7e-4532-9f70-0fd84398ff6d/uptime => generated 123 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:24:56.578134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9e017e77-7f89-4433-b46f-c4703d2f48a8 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:56.579005 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9e017e77-7f89-4433-b46f-c4703d2f48a8 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:24:56.720731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9e017e77-7f89-4433-b46f-c4703d2f48a8 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:24:56.756856 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9e017e77-7f89-4433-b46f-c4703d2f48a8 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a" status: 200 len: 1220 microversion: 2.1 time: 0.184427 Jul 19 22:24:56.757663 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 6/14] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:24:56 2022] GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a => generated 1220 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:24:56.780063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e9d77a47-596c-4268-8dc1-0b88f656bb6e tempest-FlavorsV261TestJSON-1222550244 tempest-FlavorsV261TestJSON-1222550244-project-admin] Action: 'update', calling method: .version_select at 0x7f7a13270b80>, body: {"flavor": {"description": "new"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:24:56.801206 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:56.801206 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:24:56.890689 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5a3b7f7a-117f-441a-a94a-1994edd75801 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 241 microversion: 2.1 time: 0.838953 Jul 19 22:24:56.895623 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 9/15] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Jul 19 22:24:56 2022] POST /compute/v2.1/os-aggregates/1/action => generated 241 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:24:56.895696 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e9d77a47-596c-4268-8dc1-0b88f656bb6e tempest-FlavorsV261TestJSON-1222550244 tempest-FlavorsV261TestJSON-1222550244-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/2503276" status: 200 len: 458 microversion: 2.61 time: 0.132299 Jul 19 22:24:56.895696 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 7/16] 10.222.0.25 () {62 vars in 1209 bytes} [Tue Jul 19 22:24:56 2022] PUT /compute/v2.1/flavors/2503276 => generated 458 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:24:56.905594 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a51374a9-e0e6-4b19-9a21-1070c2d3cfb8 tempest-HypervisorAdminNegativeTestJSON-1963237076 tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin] Calling method '.version_select at 0x7f7a114a4af0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:56.906705 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:56.906705 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:24:56.906957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fa9ffaa9-ce30-4448-bee5-6036451410e5 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-847009-3"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:24:56.908561 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:56.908561 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:24:56.911786 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a51374a9-e0e6-4b19-9a21-1070c2d3cfb8 tempest-HypervisorAdminNegativeTestJSON-1963237076 tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:56.912260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a51374a9-e0e6-4b19-9a21-1070c2d3cfb8 tempest-HypervisorAdminNegativeTestJSON-1963237076 tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:56.949295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa9ffaa9-ce30-4448-bee5-6036451410e5 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:56.949751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa9ffaa9-ce30-4448-bee5-6036451410e5 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:56.952622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a51374a9-e0e6-4b19-9a21-1070c2d3cfb8 tempest-HypervisorAdminNegativeTestJSON-1963237076 tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:56.953087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a51374a9-e0e6-4b19-9a21-1070c2d3cfb8 tempest-HypervisorAdminNegativeTestJSON-1963237076 tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:56.981512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a51374a9-e0e6-4b19-9a21-1070c2d3cfb8 tempest-HypervisorAdminNegativeTestJSON-1963237076 tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:56.982138 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a51374a9-e0e6-4b19-9a21-1070c2d3cfb8 tempest-HypervisorAdminNegativeTestJSON-1963237076 tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:56.997729 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a51374a9-e0e6-4b19-9a21-1070c2d3cfb8 tempest-HypervisorAdminNegativeTestJSON-1963237076 tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.104432 Jul 19 22:24:57.000550 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 10/17] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:24:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:24:57.013218 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-90166188-7bd8-487c-9150-3ff21a4a7ae2 tempest-FlavorsV261TestJSON-94961840 tempest-FlavorsV261TestJSON-94961840-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:57.045579 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-fa9ffaa9-ce30-4448-bee5-6036451410e5 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h2-847009-3. Jul 19 22:24:57.075429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fa9ffaa9-ce30-4448-bee5-6036451410e5 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Request method failure captured: Jul 19 22:24:57.075429 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Jul 19 22:24:57.075429 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:24:57.075429 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:24:57.075429 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:24:57.075429 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 39 Jul 19 22:24:57.075429 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:24:57.075429 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:24:57.075429 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:24:57.075429 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:24:57.075429 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y81Qs9JvaAZnrS4VbNUHxxjUFQE7JtDZIbISYxrWDTHdy8rIWodbqWizg6UVSK1Q3r9K5pTr-Anomm7iYDlZitnwUfb6vWTOmOK63iGS2yq2Kw5it3fuIyk8WaGJfLPNhRwsg01AOX91Z7vnzPzc0eGX4iDhbbMeNbvN28thNsgcXE Jul 19 22:24:57.075429 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:24:57.075429 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:24:57.075429 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:24:57.075429 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:24:57.075429 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:24:57.075429 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:24:57.075429 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: e6146daaf5e6495bb32f49b6c1b7d9ba Jul 19 22:24:57.075429 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-586313377 Jul 19 22:24:57.075429 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:24:57.075429 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:24:57.077009 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:24:57.077009 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-586313377 Jul 19 22:24:57.077009 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: e6146daaf5e6495bb32f49b6c1b7d9ba Jul 19 22:24:57.077009 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-586313377 Jul 19 22:24:57.077009 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin Jul 19 22:24:57.077009 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:24:57.077009 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:24:57.077009 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 04fe391b67c14afeb3adf9e7540481e8 Jul 19 22:24:57.077009 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin Jul 19 22:24:57.077009 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:24:57.077009 n-d-847009-3 devstack@n-api.service[119337]: {"add_host": {"host": "n-h2-847009-3"}} Jul 19 22:24:57.077009 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:24:57.077009 n-d-847009-3 devstack@n-api.service[119337]: exception: Aggregate 1 already has host n-h2-847009-3. Jul 19 22:24:57.077668 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h2-847009-3'}}} Jul 19 22:24:57.077668 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:24:57.077668 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:57.077668 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 22:24:57.077668 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 19 22:24:57.077668 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 22:24:57.077668 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 19 22:24:57.077668 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 22:24:57.077668 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 19 22:24:57.077668 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 22:24:57.077668 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 19 22:24:57.077668 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 22:24:57.077668 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 22:24:57.077668 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 22:24:57.077668 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result.read() Jul 19 22:24:57.077668 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 22:24:57.077668 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 19 22:24:57.077668 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 22:24:57.077668 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 19 22:24:57.078560 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 22:24:57.078560 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 19 22:24:57.078560 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 22:24:57.078560 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 19 22:24:57.078560 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-847009-3-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 19 22:24:57.078560 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:57.078560 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 19 22:24:57.078560 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:57.078560 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:57.078560 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 19 22:24:57.078560 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 19 22:24:57.078560 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 19 22:24:57.078560 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi session.flush() Jul 19 22:24:57.078560 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 22:24:57.078560 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 19 22:24:57.078560 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 22:24:57.078560 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 19 22:24:57.078560 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 22:24:57.078560 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 19 22:24:57.079481 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 22:24:57.079481 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception Jul 19 22:24:57.079481 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 22:24:57.079481 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 19 22:24:57.079481 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 22:24:57.079481 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 19 22:24:57.079481 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 22:24:57.079481 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 19 22:24:57.079481 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 22:24:57.079481 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 19 22:24:57.079481 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 19 22:24:57.079481 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 19 22:24:57.079481 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 22:24:57.079481 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 22:24:57.079481 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 22:24:57.079481 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 19 22:24:57.079481 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 22:24:57.079481 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 19 22:24:57.080390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 22:24:57.080390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 19 22:24:57.080390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 22:24:57.080390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 22:24:57.080390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 22:24:57.080390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception Jul 19 22:24:57.080390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 22:24:57.080390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 19 22:24:57.080390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 22:24:57.080390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 19 22:24:57.080390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 22:24:57.080390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 19 22:24:57.080390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 22:24:57.080390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 19 22:24:57.080390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 22:24:57.080390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 22:24:57.080390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 22:24:57.080390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result.read() Jul 19 22:24:57.082845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 22:24:57.082845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 19 22:24:57.082845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 22:24:57.082845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 19 22:24:57.082845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 22:24:57.082845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 19 22:24:57.082845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 22:24:57.082845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 19 22:24:57.082845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-847009-3-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 19 22:24:57.082845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 19 22:24:57.082845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 19, 22, 24, 57, 27906), 'updated_at': None, 'host': 'n-h2-847009-3', 'aggregate_id': 1}] Jul 19 22:24:57.082845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 22:24:57.082845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:57.082845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:57.082845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:57.082845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:57.082845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 19 22:24:57.084611 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 19 22:24:57.084611 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 22:24:57.084611 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 22:24:57.084611 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:24:57.084611 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:24:57.084611 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:24:57.084611 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:24:57.084611 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 22:24:57.084611 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 22:24:57.084611 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jul 19 22:24:57.084611 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 19 22:24:57.084611 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 19 22:24:57.084611 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 19 22:24:57.084611 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 19 22:24:57.084611 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 19 22:24:57.084611 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 19 22:24:57.084611 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 19 22:24:57.084611 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h2-847009-3. Jul 19 22:24:57.084611 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:57.084611 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:57.086562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:57.086562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:57.086562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:57.086562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:57.086562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:24:57.086562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:24:57.086562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:24:57.086562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:24:57.086562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:24:57.086562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:24:57.086562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 19 22:24:57.086562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 19 22:24:57.086562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h2-847009-3. Jul 19 22:24:57.086562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:57.086562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:57.086562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:57.086562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:57.086562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:57.086562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:57.086562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:24:57.086562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:24:57.088573 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h2-847009-3. Jul 19 22:24:57.088573 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:57.088573 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fa9ffaa9-ce30-4448-bee5-6036451410e5 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Returning 409 to user: Aggregate 1 already has host n-h2-847009-3. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:24:57.088573 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fa9ffaa9-ce30-4448-bee5-6036451410e5 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.183500 Jul 19 22:24:57.088573 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 8/18] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Jul 19 22:24:56 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 185 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jul 19 22:24:57.091761 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-43edfdd3-ef2e-4403-a84d-39c03d9a51d6 tempest-HypervisorAdminNegativeTestJSON-1714270727 tempest-HypervisorAdminNegativeTestJSON-1714270727-project] Calling method '.version_select at 0x7f7a110eb280>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:57.092039 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:57.092039 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:24:57.097249 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-43edfdd3-ef2e-4403-a84d-39c03d9a51d6 tempest-HypervisorAdminNegativeTestJSON-1714270727 tempest-HypervisorAdminNegativeTestJSON-1714270727-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '9fcc0c6484be4dd0a543c689e0acfbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce87399236e445d8cf54618fa08fc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:24:57.099758 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-43edfdd3-ef2e-4403-a84d-39c03d9a51d6 tempest-HypervisorAdminNegativeTestJSON-1714270727 tempest-HypervisorAdminNegativeTestJSON-1714270727-project] Request method failure captured: Jul 19 22:24:57.099758 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 19 22:24:57.099758 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:24:57.099758 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:24:57.099758 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:24:57.099758 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:24:57.099758 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:24:57.099758 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:24:57.099758 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:24:57.099758 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:24:57.099758 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y8xUJcV77BK4PeQB_i_S1SF1__BY1otorjqTMezXLxQnLukpoFRdG-P9hi9e3oJH-ZAIX69jErTnLeKU_zpMIYQwY3ISUkzhIENRTCdUfCV28VZGnW9iOMvq7yb7TQ-J_fEfjIZmHmN2EPYGrxetwG7zr6dOtdqnuOlmQ1MiIDnpEg Jul 19 22:24:57.099758 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:24:57.099758 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:24:57.099758 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:24:57.099758 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:24:57.099758 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:24:57.099758 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:24:57.099758 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 2ce87399236e445d8cf54618fa08fc5d Jul 19 22:24:57.099758 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1714270727 Jul 19 22:24:57.099758 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:24:57.099758 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:24:57.102037 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ce87399236e445d8cf54618fa08fc5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ce87399236e445d8cf54618fa08fc5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ce87399236e445d8cf54618fa08fc5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ce87399236e445d8cf54618fa08fc5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:24:57.102037 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1714270727 Jul 19 22:24:57.102037 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 2ce87399236e445d8cf54618fa08fc5d Jul 19 22:24:57.102037 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1714270727 Jul 19 22:24:57.102037 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-HypervisorAdminNegativeTestJSON-1714270727-project Jul 19 22:24:57.102037 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:24:57.102037 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:24:57.102037 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 9fcc0c6484be4dd0a543c689e0acfbdc Jul 19 22:24:57.102037 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1714270727-project Jul 19 22:24:57.102037 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:24:57.102037 n-d-847009-3 devstack@n-api.service[119337]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 19 22:24:57.102037 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '1'} Jul 19 22:24:57.102037 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:24:57.103316 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:57.103316 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:57.103316 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:57.103316 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:24:57.103316 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:24:57.103316 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:24:57.103316 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:24:57.103316 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:24:57.103316 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:24:57.103316 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 19 22:24:57.103316 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 19 22:24:57.103316 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 19 22:24:57.103316 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 19 22:24:57.103316 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:24:57.103316 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:24:57.103316 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:24:57.103316 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:24:57.103316 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:24:57.103316 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:24:57.105720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:24:57.105720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:24:57.105720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:24:57.105720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:24:57.105720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:24:57.105720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:24:57.105720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:24:57.105720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:24:57.105720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 19 22:24:57.105720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:57.105720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:57.105720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:57.105720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:57.105720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:57.105720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:57.105720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:24:57.105720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:24:57.105720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 19 22:24:57.105720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:57.109322 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-43edfdd3-ef2e-4403-a84d-39c03d9a51d6 tempest-HypervisorAdminNegativeTestJSON-1714270727 tempest-HypervisorAdminNegativeTestJSON-1714270727-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:24:57.109322 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-43edfdd3-ef2e-4403-a84d-39c03d9a51d6 tempest-HypervisorAdminNegativeTestJSON-1714270727 tempest-HypervisorAdminNegativeTestJSON-1714270727-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.015290 Jul 19 22:24:57.109322 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 9/19] 10.222.0.25 () {58 vars in 1151 bytes} [Tue Jul 19 22:24:57 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:24:57.109322 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fa7b5a90-7406-4b34-8d38-bc41d370de49 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-847009-3"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:24:57.109322 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:57.109322 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:24:57.116722 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa7b5a90-7406-4b34-8d38-bc41d370de49 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:57.116868 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-90166188-7bd8-487c-9150-3ff21a4a7ae2 tempest-FlavorsV261TestJSON-94961840 tempest-FlavorsV261TestJSON-94961840-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6239 microversion: 2.61 time: 0.113423 Jul 19 22:24:57.117167 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa7b5a90-7406-4b34-8d38-bc41d370de49 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:57.120093 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1186 bytes} [Tue Jul 19 22:24:57 2022] GET /compute/v2.1/flavors/detail => generated 6239 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:24:57.348862 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cd2dfea3-b681-4aeb-a463-330ba1174715 tempest-AZAdminV2TestJSON-441404322 tempest-AZAdminV2TestJSON-441404322-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:57.350912 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd2dfea3-b681-4aeb-a463-330ba1174715 tempest-AZAdminV2TestJSON-441404322 tempest-AZAdminV2TestJSON-441404322-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:57.351492 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd2dfea3-b681-4aeb-a463-330ba1174715 tempest-AZAdminV2TestJSON-441404322 tempest-AZAdminV2TestJSON-441404322-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:57.352369 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd2dfea3-b681-4aeb-a463-330ba1174715 tempest-AZAdminV2TestJSON-441404322 tempest-AZAdminV2TestJSON-441404322-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:57.352811 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd2dfea3-b681-4aeb-a463-330ba1174715 tempest-AZAdminV2TestJSON-441404322 tempest-AZAdminV2TestJSON-441404322-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:57.387705 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cd2dfea3-b681-4aeb-a463-330ba1174715 tempest-AZAdminV2TestJSON-441404322 tempest-AZAdminV2TestJSON-441404322-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.265830 Jul 19 22:24:57.396292 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 12/21] 10.222.0.25 () {58 vars in 1163 bytes} [Tue Jul 19 22:24:57 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:24:57.401625 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3680fd1c-4511-49c7-b90c-580c240e2354 tempest-HypervisorAdminNegativeTestJSON-1963237076 tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin] Calling method '.version_select at 0x7f7a114a4f70>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:57.403174 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:57.403174 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:24:57.405122 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-3680fd1c-4511-49c7-b90c-580c240e2354 tempest-HypervisorAdminNegativeTestJSON-1963237076 tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin] HTTP exception thrown: Hypervisor with ID 'd81e6366-1a39-4f87-9ab6-e8afe3edf98e' could not be found. Jul 19 22:24:57.408382 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3680fd1c-4511-49c7-b90c-580c240e2354 tempest-HypervisorAdminNegativeTestJSON-1963237076 tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin] Request method failure captured: Jul 19 22:24:57.408382 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/os-hypervisors/d81e6366-1a39-4f87-9ab6-e8afe3edf98e HTTP/1.1 Jul 19 22:24:57.408382 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:24:57.408382 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:24:57.408382 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:24:57.408382 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:24:57.408382 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:24:57.408382 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:24:57.408382 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:24:57.408382 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:24:57.408382 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y8zMOpEdparMJjhLLCQfsVcXVKyWMxWGMkaKK0DvqxYkt_aLbWzRRH4anFqVvxxyTmt8KAivSLx9ykLsWd5yDi1kptLbJTPOqPtIqaIbRRUcow4vHPZPQS6KX-AfblqHeR9YGgnO2gv0Io9abeRIHPx8pv3pmKUoNPuI7DZEsfx98s Jul 19 22:24:57.408382 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:24:57.408382 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:24:57.408382 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:24:57.408382 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:24:57.408382 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:24:57.408382 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:24:57.408382 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 09347139dff74db39b4bf136d70fb204 Jul 19 22:24:57.408382 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1963237076 Jul 19 22:24:57.408382 n-d-847009-3 devstack@n-api.service[119338]: X-Role: admin,member,reader Jul 19 22:24:57.408382 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: admin,member,reader Jul 19 22:24:57.410357 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_09347139dff74db39b4bf136d70fb204"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09347139dff74db39b4bf136d70fb204"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/09347139dff74db39b4bf136d70fb204"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09347139dff74db39b4bf136d70fb204"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:24:57.410357 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1963237076 Jul 19 22:24:57.410357 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 09347139dff74db39b4bf136d70fb204 Jul 19 22:24:57.410357 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1963237076 Jul 19 22:24:57.410357 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin Jul 19 22:24:57.410357 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:24:57.410357 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:24:57.410357 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: d3505206f155404fb077331210a1fc9a Jul 19 22:24:57.410357 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin Jul 19 22:24:57.410357 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:24:57.410357 n-d-847009-3 devstack@n-api.service[119338]: exception: Hypervisor with ID 'd81e6366-1a39-4f87-9ab6-e8afe3edf98e' could not be found. Jul 19 22:24:57.410357 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'd81e6366-1a39-4f87-9ab6-e8afe3edf98e'} Jul 19 22:24:57.411983 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:24:57.411983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:57.411983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 19 22:24:57.411983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 19 22:24:57.411983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'd81e6366-1a39-4f87-9ab6-e8afe3edf98e' Jul 19 22:24:57.411983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:24:57.411983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:57.411983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:24:57.411983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:57.411983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 19 22:24:57.411983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 19 22:24:57.411983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 19 22:24:57.411983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 19 22:24:57.411983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 19 22:24:57.411983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:24:57.411983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:57.411983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:24:57.411983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:57.411983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 19 22:24:57.411983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 19 22:24:57.411983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 19 22:24:57.411983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 19 22:24:57.413393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 19 22:24:57.413393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:24:57.413393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:57.413393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:24:57.413393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:57.413393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:57.413393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:57.413393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:24:57.413393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:24:57.413393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:24:57.413393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:24:57.413393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:24:57.413393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:24:57.413393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 19 22:24:57.413393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 19 22:24:57.413393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 19 22:24:57.413393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 19 22:24:57.413393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 19 22:24:57.413393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 22:24:57.413393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'd81e6366-1a39-4f87-9ab6-e8afe3edf98e' could not be found. Jul 19 22:24:57.414571 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:24:57.414571 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:57.414571 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:24:57.414571 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:57.414571 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:57.414571 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:57.414571 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:24:57.414571 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:24:57.414571 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'd81e6366-1a39-4f87-9ab6-e8afe3edf98e' could not be found. Jul 19 22:24:57.414571 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:24:57.421147 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3680fd1c-4511-49c7-b90c-580c240e2354 tempest-HypervisorAdminNegativeTestJSON-1963237076 tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin] Returning 404 to user: Hypervisor with ID 'd81e6366-1a39-4f87-9ab6-e8afe3edf98e' could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:24:57.422827 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3680fd1c-4511-49c7-b90c-580c240e2354 tempest-HypervisorAdminNegativeTestJSON-1963237076 tempest-HypervisorAdminNegativeTestJSON-1963237076-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/d81e6366-1a39-4f87-9ab6-e8afe3edf98e" status: 404 len: 123 microversion: 2.1 time: 0.025274 Jul 19 22:24:57.429533 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 13/22] 10.222.0.25 () {58 vars in 1256 bytes} [Tue Jul 19 22:24:57 2022] GET /compute/v2.1/os-hypervisors/d81e6366-1a39-4f87-9ab6-e8afe3edf98e => generated 123 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:24:57.436197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e3b75cbb-0df0-4d87-8fb6-b15dcb2ec984 tempest-FlavorsV261TestJSON-94961840 tempest-FlavorsV261TestJSON-94961840-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:57.491176 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e3b75cbb-0df0-4d87-8fb6-b15dcb2ec984 tempest-FlavorsV261TestJSON-94961840 tempest-FlavorsV261TestJSON-94961840-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 3146 microversion: 2.61 time: 0.059706 Jul 19 22:24:57.494577 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 14/23] 10.222.0.25 () {60 vars in 1165 bytes} [Tue Jul 19 22:24:57 2022] GET /compute/v2.1/flavors => generated 3146 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:24:57.510937 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-87cc7489-33f4-43ed-a815-3ac913452fa1 tempest-AZAdminV2TestJSON-441404322 tempest-AZAdminV2TestJSON-441404322-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:57.512468 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:57.512468 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:24:57.513999 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87cc7489-33f4-43ed-a815-3ac913452fa1 tempest-AZAdminV2TestJSON-441404322 tempest-AZAdminV2TestJSON-441404322-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:57.514708 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87cc7489-33f4-43ed-a815-3ac913452fa1 tempest-AZAdminV2TestJSON-441404322 tempest-AZAdminV2TestJSON-441404322-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:57.521847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87cc7489-33f4-43ed-a815-3ac913452fa1 tempest-AZAdminV2TestJSON-441404322 tempest-AZAdminV2TestJSON-441404322-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:57.522610 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87cc7489-33f4-43ed-a815-3ac913452fa1 tempest-AZAdminV2TestJSON-441404322 tempest-AZAdminV2TestJSON-441404322-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:57.588110 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-87cc7489-33f4-43ed-a815-3ac913452fa1 tempest-AZAdminV2TestJSON-441404322 tempest-AZAdminV2TestJSON-441404322-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.092115 Jul 19 22:24:57.590156 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 15/24] 10.222.0.25 () {58 vars in 1184 bytes} [Tue Jul 19 22:24:57 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:24:57.598193 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-68a6e919-6827-432e-a63e-d77a86455d33 tempest-FlavorsV261TestJSON-1222550244 tempest-FlavorsV261TestJSON-1222550244-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:57.614459 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:57.614459 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:24:57.683348 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-68a6e919-6827-432e-a63e-d77a86455d33 tempest-FlavorsV261TestJSON-1222550244 tempest-FlavorsV261TestJSON-1222550244-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2503276" status: 202 len: 0 microversion: 2.61 time: 0.091751 Jul 19 22:24:57.684415 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 16/25] 10.222.0.25 () {60 vars in 1192 bytes} [Tue Jul 19 22:24:57 2022] DELETE /compute/v2.1/flavors/2503276 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:24:57.692300 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fa7b5a90-7406-4b34-8d38-bc41d370de49 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 226 microversion: 2.1 time: 0.588943 Jul 19 22:24:57.692477 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f2ea6ebd-832c-4d90-9bc3-a4fc47e62680 tempest-FlavorsV261TestJSON-1222550244 tempest-FlavorsV261TestJSON-1222550244-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:57.692947 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 10/26] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Jul 19 22:24:57 2022] POST /compute/v2.1/os-aggregates/1/action => generated 226 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:24:57.705046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-feae10ac-e628-4586-8fe2-83828c3b25a9 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:57.708090 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:57.708090 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:24:57.746313 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-feae10ac-e628-4586-8fe2-83828c3b25a9 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.045911 Jul 19 22:24:57.752868 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 11/27] 10.222.0.25 () {58 vars in 1151 bytes} [Tue Jul 19 22:24:57 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 22:24:57.759870 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4d6323a2-28c3-4e64-8b15-31045a25e523 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-469010644"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:24:57.764124 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:57.764124 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:24:57.765561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.aggregate [None req-4d6323a2-28c3-4e64-8b15-31045a25e523 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Generated uuid 880ddf7e-9c2f-4a8a-ad0b-522b23607ce4 for aggregate {{(pid=119337) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 22:24:57.814364 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f2ea6ebd-832c-4d90-9bc3-a4fc47e62680 tempest-FlavorsV261TestJSON-1222550244 tempest-FlavorsV261TestJSON-1222550244-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.119554 Jul 19 22:24:57.817577 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 17/28] 10.222.0.25 () {60 vars in 1186 bytes} [Tue Jul 19 22:24:57 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:24:57.840519 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4d6323a2-28c3-4e64-8b15-31045a25e523 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.085867 Jul 19 22:24:57.849986 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 12/29] 10.222.0.25 () {60 vars in 1163 bytes} [Tue Jul 19 22:24:57 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:24:57.853700 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9dcd5b87-0d9c-4f73-b854-93ace198fbbf tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:57.857308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9dcd5b87-0d9c-4f73-b854-93ace198fbbf tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:24:57.859281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0630074f-b44c-4f59-91a0-04f17e4d8fce tempest-AggregatesAdminTestV241-2009819940 tempest-AggregatesAdminTestV241-2009819940-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1712161"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:24:57.863494 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:57.863494 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:24:57.868378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.aggregate [None req-0630074f-b44c-4f59-91a0-04f17e4d8fce tempest-AggregatesAdminTestV241-2009819940 tempest-AggregatesAdminTestV241-2009819940-project-admin] Generated uuid 0efdba5f-10ff-488d-842f-448c3f29a02b for aggregate {{(pid=119337) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 22:24:57.921962 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0630074f-b44c-4f59-91a0-04f17e4d8fce tempest-AggregatesAdminTestV241-2009819940 tempest-AggregatesAdminTestV241-2009819940-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 243 microversion: 2.41 time: 0.069409 Jul 19 22:24:57.933960 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 13/30] 10.222.0.25 () {62 vars in 1204 bytes} [Tue Jul 19 22:24:57 2022] POST /compute/v2.1/os-aggregates => generated 243 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:24:58.658330 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-06fa7b97-d585-45cb-a79f-235865dcba6c tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-847009-3"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:24:58.660953 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:58.660953 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:24:58.662187 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-06fa7b97-d585-45cb-a79f-235865dcba6c tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '4cfacbfbca68443d944d60a09ca94ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcb9b5f20f14968b56ac51fc90b7a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:24:58.683526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-06fa7b97-d585-45cb-a79f-235865dcba6c tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] Request method failure captured: Jul 19 22:24:58.683526 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Jul 19 22:24:58.683526 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:24:58.683526 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:24:58.683526 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:24:58.683526 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 39 Jul 19 22:24:58.683526 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:24:58.683526 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:24:58.683526 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:24:58.683526 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:24:58.683526 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y8zlaeR4rkXAoUxmG4nY36-53G1oISDPY9pdB6vyXUUfPLrQhqp4U-nubLjYRLoSTKTIqYyZ4JBtFHXAdGaZ2W8gCVJwxLC0D3vL02qzGQN6WZVu5Vt3fnlUQiDfr4-rjH9x2KUeQ7aGy8EvA8xoG5pLwdW_2QRt85n9rcqjHCmYSA Jul 19 22:24:58.683526 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:24:58.683526 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:24:58.683526 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:24:58.683526 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:24:58.683526 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:24:58.683526 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:24:58.683526 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: fbcb9b5f20f14968b56ac51fc90b7a24 Jul 19 22:24:58.683526 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-56836165 Jul 19 22:24:58.683526 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:24:58.683526 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:24:58.684612 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fbcb9b5f20f14968b56ac51fc90b7a24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fbcb9b5f20f14968b56ac51fc90b7a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fbcb9b5f20f14968b56ac51fc90b7a24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fbcb9b5f20f14968b56ac51fc90b7a24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:24:58.684612 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-56836165 Jul 19 22:24:58.684612 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: fbcb9b5f20f14968b56ac51fc90b7a24 Jul 19 22:24:58.684612 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-56836165 Jul 19 22:24:58.684612 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AggregatesAdminNegativeTestJSON-56836165-project Jul 19 22:24:58.684612 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:24:58.684612 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:24:58.684612 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 4cfacbfbca68443d944d60a09ca94ed2 Jul 19 22:24:58.684612 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-56836165-project Jul 19 22:24:58.684612 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:24:58.684612 n-d-847009-3 devstack@n-api.service[119337]: {"add_host": {"host": "n-h2-847009-3"}} Jul 19 22:24:58.684612 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:24:58.684612 n-d-847009-3 devstack@n-api.service[119337]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 19 22:24:58.685278 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-847009-3'}}} Jul 19 22:24:58.685278 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:24:58.685278 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:58.685278 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:58.685278 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:58.685278 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:24:58.685278 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:24:58.685278 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:24:58.685278 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:24:58.685278 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:24:58.685278 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:24:58.685278 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 19 22:24:58.685278 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 19 22:24:58.685278 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:24:58.685278 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:24:58.685278 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:24:58.685278 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:24:58.685278 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:24:58.685278 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:24:58.686191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:24:58.686191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:24:58.686191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:24:58.686191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:24:58.686191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:24:58.686191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:24:58.686191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:24:58.686191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:24:58.686191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 19 22:24:58.686191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:58.686191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:58.686191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:58.686191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:58.686191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:58.686191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:58.686191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:24:58.686191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:24:58.686191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 19 22:24:58.686191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:58.689718 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-06fa7b97-d585-45cb-a79f-235865dcba6c tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:24:58.697703 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-06fa7b97-d585-45cb-a79f-235865dcba6c tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.759589 Jul 19 22:24:58.700334 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 14/31] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Jul 19 22:24:57 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 766 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:24:58.729169 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-08907deb-5eb1-41c2-9f3c-f9b41ec86c66 tempest-AggregatesAdminTestV241-2009819940 tempest-AggregatesAdminTestV241-2009819940-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-413471191"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:24:58.974003 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:58.974003 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:24:59.025466 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-08907deb-5eb1-41c2-9f3c-f9b41ec86c66 tempest-AggregatesAdminTestV241-2009819940 tempest-AggregatesAdminTestV241-2009819940-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/3" status: 200 len: 298 microversion: 2.41 time: 0.320741 Jul 19 22:24:59.027382 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 15/32] 10.222.0.25 () {62 vars in 1209 bytes} [Tue Jul 19 22:24:58 2022] PUT /compute/v2.1/os-aggregates/3 => generated 298 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:24:59.035682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-aea48429-aa14-46e6-9deb-95e12212de3f tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:59.036767 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:59.036767 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:24:59.061662 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-aea48429-aa14-46e6-9deb-95e12212de3f tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.031693 Jul 19 22:24:59.062677 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 16/33] 10.222.0.25 () {58 vars in 1151 bytes} [Tue Jul 19 22:24:59 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 22:24:59.069811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b407bf98-5ca7-4c78-8dd6-ccf747059b7d tempest-AggregatesAdminTestV241-2009819940 tempest-AggregatesAdminTestV241-2009819940-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:59.070977 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:59.070977 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:24:59.071754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9dcd5b87-0d9c-4f73-b854-93ace198fbbf tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:24:59.079846 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b407bf98-5ca7-4c78-8dd6-ccf747059b7d tempest-AggregatesAdminTestV241-2009819940 tempest-AggregatesAdminTestV241-2009819940-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 298 microversion: 2.41 time: 0.015973 Jul 19 22:24:59.081745 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 17/34] 10.222.0.25 () {60 vars in 1189 bytes} [Tue Jul 19 22:24:59 2022] GET /compute/v2.1/os-aggregates/3 => generated 298 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:24:59.088349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-154ba0e8-1262-4de3-88c4-6eea35adfffe tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-313378105"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:24:59.090083 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:59.090083 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:24:59.091433 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.aggregate [None req-154ba0e8-1262-4de3-88c4-6eea35adfffe tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Generated uuid 05e6428b-5a6c-4368-9422-5048f5831860 for aggregate {{(pid=119337) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 22:24:59.107630 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9dcd5b87-0d9c-4f73-b854-93ace198fbbf tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a" status: 200 len: 1220 microversion: 2.1 time: 1.281410 Jul 19 22:24:59.118655 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 18/35] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:24:57 2022] GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a => generated 1220 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:24:59.127625 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-be7b774a-2576-4be4-b29e-b349200a16fb tempest-AggregatesAdminTestV241-2009819940 tempest-AggregatesAdminTestV241-2009819940-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-847009-3"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:24:59.136461 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:59.136461 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:24:59.136986 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-154ba0e8-1262-4de3-88c4-6eea35adfffe tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.052288 Jul 19 22:24:59.138805 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 18/36] 10.222.0.25 () {60 vars in 1163 bytes} [Tue Jul 19 22:24:59 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:24:59.153078 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9fb0a091-4744-4807-8a7d-ad08dc7acf6f tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1455033376"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:24:59.154453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be7b774a-2576-4be4-b29e-b349200a16fb tempest-AggregatesAdminTestV241-2009819940 tempest-AggregatesAdminTestV241-2009819940-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:59.154922 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be7b774a-2576-4be4-b29e-b349200a16fb tempest-AggregatesAdminTestV241-2009819940 tempest-AggregatesAdminTestV241-2009819940-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:59.156971 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:59.156971 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:24:59.176726 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9fb0a091-4744-4807-8a7d-ad08dc7acf6f tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:59.177468 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9fb0a091-4744-4807-8a7d-ad08dc7acf6f tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:59.195577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9fb0a091-4744-4807-8a7d-ad08dc7acf6f tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:59.196765 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9fb0a091-4744-4807-8a7d-ad08dc7acf6f tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:59.207275 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-9fb0a091-4744-4807-8a7d-ad08dc7acf6f tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1455033376 could not be found. Jul 19 22:24:59.210284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9fb0a091-4744-4807-8a7d-ad08dc7acf6f tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Request method failure captured: Jul 19 22:24:59.210284 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Jul 19 22:24:59.210284 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:24:59.210284 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:24:59.210284 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:24:59.210284 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 58 Jul 19 22:24:59.210284 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:24:59.210284 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:24:59.210284 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:24:59.210284 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:24:59.210284 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y81Qs9JvaAZnrS4VbNUHxxjUFQE7JtDZIbISYxrWDTHdy8rIWodbqWizg6UVSK1Q3r9K5pTr-Anomm7iYDlZitnwUfb6vWTOmOK63iGS2yq2Kw5it3fuIyk8WaGJfLPNhRwsg01AOX91Z7vnzPzc0eGX4iDhbbMeNbvN28thNsgcXE Jul 19 22:24:59.210284 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:24:59.210284 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:24:59.210284 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:24:59.210284 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:24:59.210284 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:24:59.210284 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:24:59.210284 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: e6146daaf5e6495bb32f49b6c1b7d9ba Jul 19 22:24:59.210284 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-586313377 Jul 19 22:24:59.210284 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:24:59.210284 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:24:59.211513 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:24:59.211513 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-586313377 Jul 19 22:24:59.211513 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: e6146daaf5e6495bb32f49b6c1b7d9ba Jul 19 22:24:59.211513 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-586313377 Jul 19 22:24:59.211513 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin Jul 19 22:24:59.211513 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:24:59.211513 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:24:59.211513 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 04fe391b67c14afeb3adf9e7540481e8 Jul 19 22:24:59.211513 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin Jul 19 22:24:59.211513 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:24:59.211513 n-d-847009-3 devstack@n-api.service[119337]: {"add_host": {"host": "tempest-nonexist_host-1455033376"}} Jul 19 22:24:59.211513 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:24:59.211513 n-d-847009-3 devstack@n-api.service[119337]: exception: Compute host tempest-nonexist_host-1455033376 could not be found. Jul 19 22:24:59.212254 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-1455033376'}}} Jul 19 22:24:59.212254 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:24:59.212254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:59.212254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 19 22:24:59.212254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 19 22:24:59.212254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:24:59.212254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:24:59.212254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 19 22:24:59.212254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 19 22:24:59.212254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 22:24:59.212254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 22:24:59.212254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 19 22:24:59.212254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 19 22:24:59.212254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1455033376' is not mapped to any cell Jul 19 22:24:59.212254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.212254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:59.212254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.212254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:59.212254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 19 22:24:59.213321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 19 22:24:59.213321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 19 22:24:59.213321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 19 22:24:59.213321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 19 22:24:59.213321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.213321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:59.213321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.213321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:59.213321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 19 22:24:59.213321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 19 22:24:59.213321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 22:24:59.213321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 22:24:59.213321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:24:59.213321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:24:59.213321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:24:59.213321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:24:59.213321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 22:24:59.213321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 22:24:59.213321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jul 19 22:24:59.213321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 19 22:24:59.214527 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 19 22:24:59.214527 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 19 22:24:59.214527 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1455033376 could not be found. Jul 19 22:24:59.214527 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.214527 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:59.214527 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.214527 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:59.214527 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:59.214527 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:59.214527 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:24:59.214527 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:24:59.214527 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:24:59.214527 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:24:59.214527 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:24:59.214527 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:24:59.214527 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 19 22:24:59.214527 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:24:59.214527 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1455033376 could not be found. Jul 19 22:24:59.214527 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.214527 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:59.214527 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.215775 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:59.215775 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:59.215775 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:59.215775 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:24:59.215775 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:24:59.215775 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1455033376 could not be found. Jul 19 22:24:59.215775 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.217160 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9fb0a091-4744-4807-8a7d-ad08dc7acf6f tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1455033376 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:24:59.218193 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9fb0a091-4744-4807-8a7d-ad08dc7acf6f tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.072817 Jul 19 22:24:59.219443 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 19/37] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Jul 19 22:24:59 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:24:59.228500 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-37e32038-7412-4c6e-b2c0-3dcfb46cfb80 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:59.229680 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:59.229680 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:24:59.272233 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-37e32038-7412-4c6e-b2c0-3dcfb46cfb80 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.047380 Jul 19 22:24:59.273852 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 20/38] 10.222.0.25 () {58 vars in 1151 bytes} [Tue Jul 19 22:24:59 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 22:24:59.299463 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-57b78015-368e-4fa5-a558-d8d1d50b907f tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:24:59.326473 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-57b78015-368e-4fa5-a558-d8d1d50b907f tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Request method failure captured: Jul 19 22:24:59.326473 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 19 22:24:59.326473 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:24:59.326473 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:24:59.326473 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:24:59.326473 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 283 Jul 19 22:24:59.326473 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:24:59.326473 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:24:59.326473 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:24:59.326473 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:24:59.326473 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y81Qs9JvaAZnrS4VbNUHxxjUFQE7JtDZIbISYxrWDTHdy8rIWodbqWizg6UVSK1Q3r9K5pTr-Anomm7iYDlZitnwUfb6vWTOmOK63iGS2yq2Kw5it3fuIyk8WaGJfLPNhRwsg01AOX91Z7vnzPzc0eGX4iDhbbMeNbvN28thNsgcXE Jul 19 22:24:59.326473 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:24:59.326473 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:24:59.326473 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:24:59.326473 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:24:59.326473 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:24:59.326473 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:24:59.326473 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: e6146daaf5e6495bb32f49b6c1b7d9ba Jul 19 22:24:59.326473 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-586313377 Jul 19 22:24:59.326473 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:24:59.326473 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:24:59.327674 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:24:59.327674 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-586313377 Jul 19 22:24:59.327674 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: e6146daaf5e6495bb32f49b6c1b7d9ba Jul 19 22:24:59.327674 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-586313377 Jul 19 22:24:59.327674 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin Jul 19 22:24:59.327674 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:24:59.327674 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:24:59.327674 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 04fe391b67c14afeb3adf9e7540481e8 Jul 19 22:24:59.327674 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin Jul 19 22:24:59.327674 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:24:59.327674 n-d-847009-3 devstack@n-api.service[119337]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 19 22:24:59.328235 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:24:59.328235 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 22:24:59.328235 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 19 22:24:59.328235 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:24:59.328235 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:59.328235 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:24:59.328235 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:24:59.328235 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:24:59.328235 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:24:59.328235 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 22:24:59.328235 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.329186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 19 22:24:59.329186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 22:24:59.329186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.329186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 19 22:24:59.329186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 19 22:24:59.329186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.329186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:59.329186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.329186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:59.329186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:59.329186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:59.329186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:24:59.329186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:24:59.329186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:24:59.329186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:24:59.329186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:24:59.329186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:24:59.329186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:24:59.329186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:24:59.330202 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:24:59.330202 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:24:59.330202 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:24:59.330202 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:24:59.330202 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 22:24:59.330202 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.330202 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:59.330202 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.330202 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:59.330202 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:59.330202 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:59.330202 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:24:59.330202 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:24:59.332230 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 22:24:59.332230 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.332230 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-57b78015-368e-4fa5-a558-d8d1d50b907f tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:24:59.332230 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-57b78015-368e-4fa5-a558-d8d1d50b907f tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.048916 Jul 19 22:24:59.332633 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 21/39] 10.222.0.25 () {60 vars in 1164 bytes} [Tue Jul 19 22:24:59 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:24:59.338228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b158af99-a49d-4a3f-ab66-0ec2d0cab517 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:24:59.344908 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b158af99-a49d-4a3f-ab66-0ec2d0cab517 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Request method failure captured: Jul 19 22:24:59.344908 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 19 22:24:59.344908 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:24:59.344908 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:24:59.344908 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:24:59.344908 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 27 Jul 19 22:24:59.344908 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:24:59.344908 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:24:59.344908 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:24:59.344908 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:24:59.344908 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y81Qs9JvaAZnrS4VbNUHxxjUFQE7JtDZIbISYxrWDTHdy8rIWodbqWizg6UVSK1Q3r9K5pTr-Anomm7iYDlZitnwUfb6vWTOmOK63iGS2yq2Kw5it3fuIyk8WaGJfLPNhRwsg01AOX91Z7vnzPzc0eGX4iDhbbMeNbvN28thNsgcXE Jul 19 22:24:59.344908 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:24:59.344908 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:24:59.344908 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:24:59.344908 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:24:59.344908 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:24:59.344908 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:24:59.344908 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: e6146daaf5e6495bb32f49b6c1b7d9ba Jul 19 22:24:59.344908 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-586313377 Jul 19 22:24:59.344908 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:24:59.344908 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:24:59.346254 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:24:59.346254 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-586313377 Jul 19 22:24:59.346254 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: e6146daaf5e6495bb32f49b6c1b7d9ba Jul 19 22:24:59.346254 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-586313377 Jul 19 22:24:59.346254 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin Jul 19 22:24:59.346254 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:24:59.346254 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:24:59.346254 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 04fe391b67c14afeb3adf9e7540481e8 Jul 19 22:24:59.346254 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin Jul 19 22:24:59.346254 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:24:59.346254 n-d-847009-3 devstack@n-api.service[119337]: {"aggregate": {"name": ""}} Jul 19 22:24:59.346254 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:24:59.346254 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 19 22:24:59.348164 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 19 22:24:59.348164 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:24:59.348164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:59.348164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:24:59.348164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:24:59.348164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:24:59.348164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:24:59.348164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 19 22:24:59.348164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.348164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 19 22:24:59.348164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 22:24:59.348164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.348164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 19 22:24:59.348164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi '' Jul 19 22:24:59.348164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.348164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:59.348164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.348164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:59.348164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:59.348164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:59.348164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:24:59.348164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:24:59.348164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:24:59.349705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:24:59.349705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:24:59.349705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:24:59.349705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:24:59.349705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:24:59.349705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:24:59.349705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:24:59.349705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:24:59.349705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:24:59.349705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 19 22:24:59.349705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.349705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:59.349705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.349705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:59.349705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:59.349705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:59.349705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:24:59.349705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:24:59.349705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 19 22:24:59.349705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.353895 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b158af99-a49d-4a3f-ab66-0ec2d0cab517 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:24:59.355362 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b158af99-a49d-4a3f-ab66-0ec2d0cab517 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.020948 Jul 19 22:24:59.361163 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 22/40] 10.222.0.25 () {60 vars in 1163 bytes} [Tue Jul 19 22:24:59 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 22:24:59.373065 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-be7b774a-2576-4be4-b29e-b349200a16fb tempest-AggregatesAdminTestV241-2009819940 tempest-AggregatesAdminTestV241-2009819940-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 313 microversion: 2.41 time: 0.261724 Jul 19 22:24:59.374702 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 19/41] 10.222.0.25 () {62 vars in 1231 bytes} [Tue Jul 19 22:24:59 2022] POST /compute/v2.1/os-aggregates/3/action => generated 313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:24:59.382737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b778526a-9bce-4a4d-8f94-9dc7b903aa5a tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-245420105"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:24:59.384369 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:59.384369 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:24:59.385459 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b778526a-9bce-4a4d-8f94-9dc7b903aa5a tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '4cfacbfbca68443d944d60a09ca94ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcb9b5f20f14968b56ac51fc90b7a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:24:59.387868 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-39f4f959-113f-4ae9-b4ed-55f3e4c7e795 tempest-AggregatesAdminTestV241-2009819940 tempest-AggregatesAdminTestV241-2009819940-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-847009-3"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:24:59.388106 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b778526a-9bce-4a4d-8f94-9dc7b903aa5a tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] Request method failure captured: Jul 19 22:24:59.388106 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 19 22:24:59.388106 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:24:59.388106 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:24:59.388106 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:24:59.388106 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 59 Jul 19 22:24:59.388106 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:24:59.388106 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:24:59.388106 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:24:59.388106 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:24:59.388106 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y8zlaeR4rkXAoUxmG4nY36-53G1oISDPY9pdB6vyXUUfPLrQhqp4U-nubLjYRLoSTKTIqYyZ4JBtFHXAdGaZ2W8gCVJwxLC0D3vL02qzGQN6WZVu5Vt3fnlUQiDfr4-rjH9x2KUeQ7aGy8EvA8xoG5pLwdW_2QRt85n9rcqjHCmYSA Jul 19 22:24:59.388106 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:24:59.388106 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:24:59.388106 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:24:59.388106 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:24:59.388106 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:24:59.388106 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:24:59.388106 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: fbcb9b5f20f14968b56ac51fc90b7a24 Jul 19 22:24:59.388106 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-56836165 Jul 19 22:24:59.388106 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:24:59.388106 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:24:59.389303 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fbcb9b5f20f14968b56ac51fc90b7a24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fbcb9b5f20f14968b56ac51fc90b7a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fbcb9b5f20f14968b56ac51fc90b7a24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fbcb9b5f20f14968b56ac51fc90b7a24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:24:59.389303 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-56836165 Jul 19 22:24:59.389303 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: fbcb9b5f20f14968b56ac51fc90b7a24 Jul 19 22:24:59.389303 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-56836165 Jul 19 22:24:59.389303 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AggregatesAdminNegativeTestJSON-56836165-project Jul 19 22:24:59.389303 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:24:59.389303 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:24:59.389303 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 4cfacbfbca68443d944d60a09ca94ed2 Jul 19 22:24:59.389303 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-56836165-project Jul 19 22:24:59.389303 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:24:59.389303 n-d-847009-3 devstack@n-api.service[119337]: {"aggregate": {"name": "tempest-test_aggregate-245420105"}} Jul 19 22:24:59.389303 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:24:59.389303 n-d-847009-3 devstack@n-api.service[119337]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 19 22:24:59.389939 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-245420105'}}} Jul 19 22:24:59.389939 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:24:59.389939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:59.389939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:59.389939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:59.389939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:24:59.389939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:24:59.389939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:24:59.389939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:24:59.389939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:24:59.389939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:24:59.389939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:24:59.389939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:24:59.389939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 19 22:24:59.389939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 19 22:24:59.389939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:24:59.389939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:24:59.389939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:24:59.389939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:24:59.390865 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:24:59.390865 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:24:59.390865 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:24:59.390865 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:24:59.390865 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:24:59.390865 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:24:59.390865 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:24:59.390865 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:24:59.390865 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:24:59.390865 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:24:59.390865 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 19 22:24:59.390865 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.390865 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:59.390865 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.390865 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:59.390865 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:59.390865 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:59.390865 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:24:59.390865 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:24:59.390865 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 19 22:24:59.392419 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.392419 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b778526a-9bce-4a4d-8f94-9dc7b903aa5a tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:24:59.392419 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b778526a-9bce-4a4d-8f94-9dc7b903aa5a tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.018797 Jul 19 22:24:59.395435 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:59.395435 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:24:59.395960 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 23/42] 10.222.0.25 () {60 vars in 1163 bytes} [Tue Jul 19 22:24:59 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:24:59.403796 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a5a577b8-d80c-4195-b075-e411e942cd9b tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1594327912"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:24:59.406284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.aggregate [None req-a5a577b8-d80c-4195-b075-e411e942cd9b tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Generated uuid 04effd4e-9893-4c61-9271-6550141b5463 for aggregate {{(pid=119337) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 22:24:59.423152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-39f4f959-113f-4ae9-b4ed-55f3e4c7e795 tempest-AggregatesAdminTestV241-2009819940 tempest-AggregatesAdminTestV241-2009819940-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:24:59.426124 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-39f4f959-113f-4ae9-b4ed-55f3e4c7e795 tempest-AggregatesAdminTestV241-2009819940 tempest-AggregatesAdminTestV241-2009819940-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:24:59.453131 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a5a577b8-d80c-4195-b075-e411e942cd9b tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.052980 Jul 19 22:24:59.461767 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 24/43] 10.222.0.25 () {60 vars in 1163 bytes} [Tue Jul 19 22:24:59 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:24:59.472223 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8552b590-65f9-4099-b113-4e8ac09c0271 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1594327912"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:24:59.474808 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:59.474808 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:24:59.479058 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.aggregate [None req-8552b590-65f9-4099-b113-4e8ac09c0271 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Generated uuid dd551bc5-784b-4173-ba9b-ad103271cae4 for aggregate {{(pid=119337) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 22:24:59.497315 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-8552b590-65f9-4099-b113-4e8ac09c0271 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1594327912 already exists. Jul 19 22:24:59.499077 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8552b590-65f9-4099-b113-4e8ac09c0271 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Request method failure captured: Jul 19 22:24:59.499077 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 19 22:24:59.499077 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:24:59.499077 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:24:59.499077 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:24:59.499077 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 60 Jul 19 22:24:59.499077 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:24:59.499077 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:24:59.499077 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:24:59.499077 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:24:59.499077 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y81Qs9JvaAZnrS4VbNUHxxjUFQE7JtDZIbISYxrWDTHdy8rIWodbqWizg6UVSK1Q3r9K5pTr-Anomm7iYDlZitnwUfb6vWTOmOK63iGS2yq2Kw5it3fuIyk8WaGJfLPNhRwsg01AOX91Z7vnzPzc0eGX4iDhbbMeNbvN28thNsgcXE Jul 19 22:24:59.499077 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:24:59.499077 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:24:59.499077 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:24:59.499077 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:24:59.499077 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:24:59.499077 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:24:59.499077 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: e6146daaf5e6495bb32f49b6c1b7d9ba Jul 19 22:24:59.499077 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-586313377 Jul 19 22:24:59.499077 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:24:59.499077 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:24:59.500217 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:24:59.500217 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-586313377 Jul 19 22:24:59.500217 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: e6146daaf5e6495bb32f49b6c1b7d9ba Jul 19 22:24:59.500217 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-586313377 Jul 19 22:24:59.500217 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin Jul 19 22:24:59.500217 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:24:59.500217 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:24:59.500217 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 04fe391b67c14afeb3adf9e7540481e8 Jul 19 22:24:59.500217 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin Jul 19 22:24:59.500217 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:24:59.500217 n-d-847009-3 devstack@n-api.service[119337]: {"aggregate": {"name": "tempest-test_aggregate-1594327912"}} Jul 19 22:24:59.500217 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:24:59.500217 n-d-847009-3 devstack@n-api.service[119337]: exception: Aggregate tempest-test_aggregate-1594327912 already exists. Jul 19 22:24:59.500845 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1594327912'}}} Jul 19 22:24:59.500845 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:24:59.500845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:59.500845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 19 22:24:59.500845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 19 22:24:59.500845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 22:24:59.500845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 22:24:59.500845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:24:59.500845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:24:59.500845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:24:59.500845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:24:59.500845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 22:24:59.500845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 22:24:59.500845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jul 19 22:24:59.500845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 19 22:24:59.500845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 19 22:24:59.500845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 19 22:24:59.500845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 19 22:24:59.500845 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 19 22:24:59.501754 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 22:24:59.501754 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 22:24:59.501754 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 19 22:24:59.501754 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 19 22:24:59.501754 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1594327912 already exists. Jul 19 22:24:59.501754 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.501754 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:59.501754 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.501754 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:59.501754 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:59.501754 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:59.501754 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:24:59.501754 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:24:59.501754 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:24:59.501754 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:24:59.501754 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:24:59.501754 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:24:59.501754 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:24:59.501754 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:24:59.501754 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 19 22:24:59.502837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 19 22:24:59.502837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1594327912 already exists. Jul 19 22:24:59.502837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.502837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:59.502837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.502837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:59.502837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:59.502837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:59.502837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:24:59.502837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:24:59.502837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1594327912 already exists. Jul 19 22:24:59.502837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.502837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8552b590-65f9-4099-b113-4e8ac09c0271 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1594327912 already exists. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:24:59.502837 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8552b590-65f9-4099-b113-4e8ac09c0271 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.040060 Jul 19 22:24:59.510790 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 25/44] 10.222.0.25 () {60 vars in 1163 bytes} [Tue Jul 19 22:24:59 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:24:59.518768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2b91e146-80a6-488b-9a17-2fbfc31801fd tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:59.519579 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:59.519579 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:24:59.542846 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=8,nova_api:UPDATE=2,nova_api:DELETE=8 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:24:59.565377 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2b91e146-80a6-488b-9a17-2fbfc31801fd tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.051828 Jul 19 22:24:59.571667 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 26/45] 10.222.0.25 () {58 vars in 1151 bytes} [Tue Jul 19 22:24:59 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 22:24:59.588859 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f1485723-1530-4c95-b1bb-8ef33295e99f tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1709659882"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:24:59.593269 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:59.593269 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:24:59.596259 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.aggregate [None req-f1485723-1530-4c95-b1bb-8ef33295e99f tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Generated uuid 4c64c359-4845-40b4-8c7a-8a3d3cfb7726 for aggregate {{(pid=119337) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 22:24:59.648228 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f1485723-1530-4c95-b1bb-8ef33295e99f tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.073775 Jul 19 22:24:59.649174 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 27/46] 10.222.0.25 () {60 vars in 1163 bytes} [Tue Jul 19 22:24:59 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:24:59.650929 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-39f4f959-113f-4ae9-b4ed-55f3e4c7e795 tempest-AggregatesAdminTestV241-2009819940 tempest-AggregatesAdminTestV241-2009819940-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 298 microversion: 2.41 time: 0.269668 Jul 19 22:24:59.651565 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 20/47] 10.222.0.25 () {62 vars in 1231 bytes} [Tue Jul 19 22:24:59 2022] POST /compute/v2.1/os-aggregates/3/action => generated 298 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 22:24:59.662792 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ea94c085-48c1-4aae-9c10-f81046c86deb tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:59.663601 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:59.663601 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:24:59.664448 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ea94c085-48c1-4aae-9c10-f81046c86deb tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '4cfacbfbca68443d944d60a09ca94ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcb9b5f20f14968b56ac51fc90b7a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:24:59.668938 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f97ba6d9-570f-4a77-931f-e31a90850d92 tempest-AggregatesAdminTestV241-2009819940 tempest-AggregatesAdminTestV241-2009819940-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:59.675692 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:59.675692 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:24:59.677245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ea94c085-48c1-4aae-9c10-f81046c86deb tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] Request method failure captured: Jul 19 22:24:59.677245 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Jul 19 22:24:59.677245 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:24:59.677245 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:24:59.677245 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:24:59.677245 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:24:59.677245 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:24:59.677245 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:24:59.677245 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:24:59.677245 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:24:59.677245 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y8zlaeR4rkXAoUxmG4nY36-53G1oISDPY9pdB6vyXUUfPLrQhqp4U-nubLjYRLoSTKTIqYyZ4JBtFHXAdGaZ2W8gCVJwxLC0D3vL02qzGQN6WZVu5Vt3fnlUQiDfr4-rjH9x2KUeQ7aGy8EvA8xoG5pLwdW_2QRt85n9rcqjHCmYSA Jul 19 22:24:59.677245 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:24:59.677245 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:24:59.677245 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:24:59.677245 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:24:59.677245 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:24:59.677245 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:24:59.677245 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: fbcb9b5f20f14968b56ac51fc90b7a24 Jul 19 22:24:59.677245 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-56836165 Jul 19 22:24:59.677245 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:24:59.677245 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:24:59.678380 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fbcb9b5f20f14968b56ac51fc90b7a24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fbcb9b5f20f14968b56ac51fc90b7a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fbcb9b5f20f14968b56ac51fc90b7a24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fbcb9b5f20f14968b56ac51fc90b7a24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:24:59.678380 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-56836165 Jul 19 22:24:59.678380 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: fbcb9b5f20f14968b56ac51fc90b7a24 Jul 19 22:24:59.678380 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-56836165 Jul 19 22:24:59.678380 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AggregatesAdminNegativeTestJSON-56836165-project Jul 19 22:24:59.678380 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:24:59.678380 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:24:59.678380 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 4cfacbfbca68443d944d60a09ca94ed2 Jul 19 22:24:59.678380 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-56836165-project Jul 19 22:24:59.678380 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:24:59.678380 n-d-847009-3 devstack@n-api.service[119337]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 19 22:24:59.678380 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '6'} Jul 19 22:24:59.678984 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:24:59.678984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:59.678984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:59.678984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:59.678984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:24:59.678984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:24:59.678984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:24:59.678984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:24:59.678984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 19 22:24:59.678984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 19 22:24:59.678984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:24:59.678984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:24:59.678984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:24:59.678984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:24:59.678984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:24:59.678984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:24:59.678984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:24:59.678984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:24:59.678984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:24:59.679944 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:24:59.679944 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:24:59.679944 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:24:59.679944 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:24:59.679944 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:24:59.679944 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 19 22:24:59.679944 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.679944 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:59.679944 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.679944 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:59.679944 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:59.679944 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:59.679944 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:24:59.679944 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:24:59.679944 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 19 22:24:59.679944 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.679944 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ea94c085-48c1-4aae-9c10-f81046c86deb tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:24:59.684257 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ea94c085-48c1-4aae-9c10-f81046c86deb tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.026173 Jul 19 22:24:59.692910 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 28/48] 10.222.0.25 () {58 vars in 1151 bytes} [Tue Jul 19 22:24:59 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:24:59.710711 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c69b9a4d-fbd3-49ce-9d5c-dbd1b8ee32e8 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:59.754377 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f97ba6d9-570f-4a77-931f-e31a90850d92 tempest-AggregatesAdminTestV241-2009819940 tempest-AggregatesAdminTestV241-2009819940-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.41 time: 0.089726 Jul 19 22:24:59.755646 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 21/49] 10.222.0.25 () {60 vars in 1192 bytes} [Tue Jul 19 22:24:59 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:24:59.782607 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c69b9a4d-fbd3-49ce-9d5c-dbd1b8ee32e8 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.088621 Jul 19 22:24:59.793657 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4a1a92e6-6d0b-4aa5-901b-fc849ccbef49 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:59.794591 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:59.794591 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:24:59.796397 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 29/50] 10.222.0.25 () {58 vars in 1151 bytes} [Tue Jul 19 22:24:59 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 22:24:59.822176 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-4a1a92e6-6d0b-4aa5-901b-fc849ccbef49 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 19 22:24:59.828112 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4a1a92e6-6d0b-4aa5-901b-fc849ccbef49 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Request method failure captured: Jul 19 22:24:59.828112 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 19 22:24:59.828112 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:24:59.828112 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:24:59.828112 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:24:59.828112 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:24:59.828112 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:24:59.828112 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:24:59.828112 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:24:59.828112 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:24:59.828112 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y81Qs9JvaAZnrS4VbNUHxxjUFQE7JtDZIbISYxrWDTHdy8rIWodbqWizg6UVSK1Q3r9K5pTr-Anomm7iYDlZitnwUfb6vWTOmOK63iGS2yq2Kw5it3fuIyk8WaGJfLPNhRwsg01AOX91Z7vnzPzc0eGX4iDhbbMeNbvN28thNsgcXE Jul 19 22:24:59.828112 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:24:59.828112 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:24:59.828112 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:24:59.828112 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:24:59.828112 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:24:59.828112 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:24:59.828112 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: e6146daaf5e6495bb32f49b6c1b7d9ba Jul 19 22:24:59.828112 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-586313377 Jul 19 22:24:59.828112 n-d-847009-3 devstack@n-api.service[119338]: X-Role: admin,member,reader Jul 19 22:24:59.828112 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: admin,member,reader Jul 19 22:24:59.829261 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:24:59.829261 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-586313377 Jul 19 22:24:59.829261 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: e6146daaf5e6495bb32f49b6c1b7d9ba Jul 19 22:24:59.829261 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-586313377 Jul 19 22:24:59.829261 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin Jul 19 22:24:59.829261 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:24:59.829261 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:24:59.829261 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 04fe391b67c14afeb3adf9e7540481e8 Jul 19 22:24:59.829261 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin Jul 19 22:24:59.829261 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:24:59.829261 n-d-847009-3 devstack@n-api.service[119338]: exception: Aggregate -1 could not be found. Jul 19 22:24:59.829261 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '-1'} Jul 19 22:24:59.829987 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:24:59.829987 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:59.829987 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 19 22:24:59.829987 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 19 22:24:59.829987 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 22:24:59.829987 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 22:24:59.829987 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:24:59.829987 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:24:59.829987 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:24:59.829987 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:24:59.829987 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 22:24:59.829987 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 22:24:59.829987 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 19 22:24:59.829987 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 19 22:24:59.829987 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:24:59.829987 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:24:59.829987 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 19 22:24:59.829987 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 19 22:24:59.829987 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 22:24:59.831285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 22:24:59.831285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 19 22:24:59.831285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 19 22:24:59.831285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 19 22:24:59.831285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.831285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:59.831285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.831285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:59.831285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:59.831285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:59.831285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:24:59.831285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:24:59.831285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:24:59.831285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:24:59.831285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 19 22:24:59.831285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:24:59.831285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 19 22:24:59.831285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.831285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:59.831285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.831285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:59.832634 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:59.832634 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:59.832634 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:24:59.832634 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:24:59.832634 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 19 22:24:59.832634 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.838540 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4a1a92e6-6d0b-4aa5-901b-fc849ccbef49 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:24:59.840147 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4a1a92e6-6d0b-4aa5-901b-fc849ccbef49 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.050837 Jul 19 22:24:59.840716 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 22/51] 10.222.0.25 () {58 vars in 1154 bytes} [Tue Jul 19 22:24:59 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:24:59.853581 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e49cda41-7df1-4ae1-8d9e-9239697752d6 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-147761044"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:24:59.856620 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9f53fd01-191f-4801-8c2a-8807d95c5828 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1109626333", "name": "tempest-test_aggregate-149940464"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:24:59.857449 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:59.857449 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:24:59.859707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.aggregate [None req-e49cda41-7df1-4ae1-8d9e-9239697752d6 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Generated uuid 2a1be175-27cd-4f1f-bc19-42742f8b29a9 for aggregate {{(pid=119337) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 22:24:59.907228 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:59.907228 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:24:59.908318 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.aggregate [None req-9f53fd01-191f-4801-8c2a-8807d95c5828 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Generated uuid 3b2cdcf1-2808-4fe7-9a01-e7b6dba738c5 for aggregate {{(pid=119338) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 22:24:59.938665 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e49cda41-7df1-4ae1-8d9e-9239697752d6 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.092422 Jul 19 22:24:59.939782 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 30/52] 10.222.0.25 () {60 vars in 1163 bytes} [Tue Jul 19 22:24:59 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:24:59.963396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-237298ca-245a-4693-99a3-d69cf5fb6262 tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:59.964734 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:59.964734 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:24:59.970589 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-237298ca-245a-4693-99a3-d69cf5fb6262 tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '4cfacbfbca68443d944d60a09ca94ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcb9b5f20f14968b56ac51fc90b7a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:24:59.974150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-237298ca-245a-4693-99a3-d69cf5fb6262 tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] Request method failure captured: Jul 19 22:24:59.974150 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 19 22:24:59.974150 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:24:59.974150 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:24:59.974150 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:24:59.974150 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:24:59.974150 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:24:59.974150 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:24:59.974150 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:24:59.974150 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:24:59.974150 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y8zlaeR4rkXAoUxmG4nY36-53G1oISDPY9pdB6vyXUUfPLrQhqp4U-nubLjYRLoSTKTIqYyZ4JBtFHXAdGaZ2W8gCVJwxLC0D3vL02qzGQN6WZVu5Vt3fnlUQiDfr4-rjH9x2KUeQ7aGy8EvA8xoG5pLwdW_2QRt85n9rcqjHCmYSA Jul 19 22:24:59.974150 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:24:59.974150 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:24:59.974150 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:24:59.974150 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:24:59.974150 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:24:59.974150 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:24:59.974150 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: fbcb9b5f20f14968b56ac51fc90b7a24 Jul 19 22:24:59.974150 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-56836165 Jul 19 22:24:59.974150 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:24:59.974150 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:24:59.975824 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fbcb9b5f20f14968b56ac51fc90b7a24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fbcb9b5f20f14968b56ac51fc90b7a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fbcb9b5f20f14968b56ac51fc90b7a24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fbcb9b5f20f14968b56ac51fc90b7a24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:24:59.975824 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-56836165 Jul 19 22:24:59.975824 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: fbcb9b5f20f14968b56ac51fc90b7a24 Jul 19 22:24:59.975824 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-56836165 Jul 19 22:24:59.975824 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AggregatesAdminNegativeTestJSON-56836165-project Jul 19 22:24:59.975824 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:24:59.975824 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:24:59.975824 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 4cfacbfbca68443d944d60a09ca94ed2 Jul 19 22:24:59.975824 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-56836165-project Jul 19 22:24:59.975824 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:24:59.975824 n-d-847009-3 devstack@n-api.service[119337]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 19 22:24:59.975824 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '7'} Jul 19 22:24:59.976592 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:24:59.976592 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:59.976592 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:59.976592 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:59.976592 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:24:59.976592 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:24:59.976592 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:24:59.976592 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:24:59.976592 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 19 22:24:59.976592 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 19 22:24:59.976592 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:24:59.976592 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:24:59.976592 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:24:59.976592 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:24:59.976592 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:24:59.976592 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:24:59.976592 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:24:59.976592 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:24:59.976592 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:24:59.977622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:24:59.977622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:24:59.977622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:24:59.977622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:24:59.977622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:24:59.977622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 19 22:24:59.977622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.977622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:24:59.977622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.977622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:24:59.977622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:24:59.977622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:24:59.977622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:24:59.977622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:24:59.977622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 19 22:24:59.977622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:24:59.982893 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9f53fd01-191f-4801-8c2a-8807d95c5828 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.129090 Jul 19 22:24:59.984131 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 23/53] 10.222.0.25 () {60 vars in 1164 bytes} [Tue Jul 19 22:24:59 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:24:59.997304 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1b0d99a5-0737-461b-9ba3-5537c922d984 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:24:59.999917 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:24:59.999917 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:00.002613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-237298ca-245a-4693-99a3-d69cf5fb6262 tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:00.006730 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-237298ca-245a-4693-99a3-d69cf5fb6262 tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] 10.222.0.25 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.051069 Jul 19 22:25:00.007407 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 31/54] 10.222.0.25 () {58 vars in 1148 bytes} [Tue Jul 19 22:24:59 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 57 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:25:00.016536 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-31c50174-4a17-4f74-aeac-74d47ef0e0fa tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:00.019043 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:00.019043 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:00.031462 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1b0d99a5-0737-461b-9ba3-5537c922d984 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 515 microversion: 2.1 time: 0.035437 Jul 19 22:25:00.034106 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 24/55] 10.222.0.25 () {58 vars in 1142 bytes} [Tue Jul 19 22:24:59 2022] GET /compute/v2.1/os-aggregates => generated 515 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:00.045638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b7bdfaee-571f-4ac6-a4f5-18c4fb988ee0 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-847009-3"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:00.051065 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:00.051065 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:00.075008 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b7bdfaee-571f-4ac6-a4f5-18c4fb988ee0 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:00.076186 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b7bdfaee-571f-4ac6-a4f5-18c4fb988ee0 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:00.082124 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-31c50174-4a17-4f74-aeac-74d47ef0e0fa tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.070020 Jul 19 22:25:00.082768 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 32/56] 10.222.0.25 () {58 vars in 1151 bytes} [Tue Jul 19 22:25:00 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 22:25:00.100714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5bc38dee-bb2a-4ebf-af90-56ab9389b8f5 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:00.102071 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:00.102071 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:00.116847 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-5bc38dee-bb2a-4ebf-af90-56ab9389b8f5 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 19 22:25:00.128047 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5bc38dee-bb2a-4ebf-af90-56ab9389b8f5 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Request method failure captured: Jul 19 22:25:00.128047 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 19 22:25:00.128047 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:25:00.128047 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:25:00.128047 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:25:00.128047 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:25:00.128047 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:25:00.128047 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:25:00.128047 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:25:00.128047 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:00.128047 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y81Qs9JvaAZnrS4VbNUHxxjUFQE7JtDZIbISYxrWDTHdy8rIWodbqWizg6UVSK1Q3r9K5pTr-Anomm7iYDlZitnwUfb6vWTOmOK63iGS2yq2Kw5it3fuIyk8WaGJfLPNhRwsg01AOX91Z7vnzPzc0eGX4iDhbbMeNbvN28thNsgcXE Jul 19 22:25:00.128047 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:25:00.128047 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:25:00.128047 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:25:00.128047 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:25:00.128047 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:25:00.128047 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:25:00.128047 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: e6146daaf5e6495bb32f49b6c1b7d9ba Jul 19 22:25:00.128047 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-586313377 Jul 19 22:25:00.128047 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:25:00.128047 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:25:00.130030 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:00.130030 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-586313377 Jul 19 22:25:00.130030 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: e6146daaf5e6495bb32f49b6c1b7d9ba Jul 19 22:25:00.130030 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-586313377 Jul 19 22:25:00.130030 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin Jul 19 22:25:00.130030 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:25:00.130030 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:25:00.130030 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 04fe391b67c14afeb3adf9e7540481e8 Jul 19 22:25:00.130030 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin Jul 19 22:25:00.130030 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:25:00.130030 n-d-847009-3 devstack@n-api.service[119337]: exception: Aggregate -1 could not be found. Jul 19 22:25:00.130030 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '-1'} Jul 19 22:25:00.130775 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:00.130775 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:00.130775 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 19 22:25:00.130775 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 19 22:25:00.130775 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 19 22:25:00.130775 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 19 22:25:00.130775 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:25:00.130775 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:25:00.130775 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 19 22:25:00.130775 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 19 22:25:00.130775 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 22:25:00.130775 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 22:25:00.130775 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 19 22:25:00.130775 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 19 22:25:00.130775 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 19 22:25:00.130775 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:00.130775 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:00.130775 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:00.130775 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:00.130775 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:00.131971 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:00.131971 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:00.131971 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:00.131971 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:00.131971 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:00.131971 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 19 22:25:00.131971 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:25:00.131971 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 19 22:25:00.131971 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:00.131971 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:00.131971 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:00.131971 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:00.131971 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:00.131971 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:00.131971 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:25:00.131971 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:25:00.131971 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 19 22:25:00.131971 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:00.136019 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5bc38dee-bb2a-4ebf-af90-56ab9389b8f5 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:00.139480 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5bc38dee-bb2a-4ebf-af90-56ab9389b8f5 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.050409 Jul 19 22:25:00.150893 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 33/57] 10.222.0.25 () {58 vars in 1151 bytes} [Tue Jul 19 22:25:00 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:25:00.162657 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b18aca3e-5862-4189-a2b2-52bbda9af483 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:00.165497 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b18aca3e-5862-4189-a2b2-52bbda9af483 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:00.181185 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b18aca3e-5862-4189-a2b2-52bbda9af483 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:00.182060 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b18aca3e-5862-4189-a2b2-52bbda9af483 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:00.186281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b18aca3e-5862-4189-a2b2-52bbda9af483 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:00.186841 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b18aca3e-5862-4189-a2b2-52bbda9af483 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:00.275321 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:00.301893 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b7bdfaee-571f-4ac6-a4f5-18c4fb988ee0 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 314 microversion: 2.1 time: 0.262239 Jul 19 22:25:00.303273 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 25/58] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Jul 19 22:25:00 2022] POST /compute/v2.1/os-aggregates/8/action => generated 314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:25:00.308141 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-20ab6a5c-13ec-4a4d-b6fb-99e92d7d7baa tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:00.309482 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:00.309482 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:00.311539 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-20ab6a5c-13ec-4a4d-b6fb-99e92d7d7baa tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '4cfacbfbca68443d944d60a09ca94ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcb9b5f20f14968b56ac51fc90b7a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:00.314569 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-20ab6a5c-13ec-4a4d-b6fb-99e92d7d7baa tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] Request method failure captured: Jul 19 22:25:00.314569 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 19 22:25:00.314569 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:25:00.314569 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:25:00.314569 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:25:00.314569 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:25:00.314569 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:25:00.314569 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:25:00.314569 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:25:00.314569 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:00.314569 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y8zlaeR4rkXAoUxmG4nY36-53G1oISDPY9pdB6vyXUUfPLrQhqp4U-nubLjYRLoSTKTIqYyZ4JBtFHXAdGaZ2W8gCVJwxLC0D3vL02qzGQN6WZVu5Vt3fnlUQiDfr4-rjH9x2KUeQ7aGy8EvA8xoG5pLwdW_2QRt85n9rcqjHCmYSA Jul 19 22:25:00.314569 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:25:00.314569 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:25:00.314569 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:25:00.314569 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:25:00.314569 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:25:00.314569 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:25:00.314569 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: fbcb9b5f20f14968b56ac51fc90b7a24 Jul 19 22:25:00.314569 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-56836165 Jul 19 22:25:00.314569 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:25:00.314569 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:25:00.316447 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fbcb9b5f20f14968b56ac51fc90b7a24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fbcb9b5f20f14968b56ac51fc90b7a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fbcb9b5f20f14968b56ac51fc90b7a24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fbcb9b5f20f14968b56ac51fc90b7a24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:00.316447 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-56836165 Jul 19 22:25:00.316447 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: fbcb9b5f20f14968b56ac51fc90b7a24 Jul 19 22:25:00.316447 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-56836165 Jul 19 22:25:00.316447 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-AggregatesAdminNegativeTestJSON-56836165-project Jul 19 22:25:00.316447 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:25:00.316447 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:25:00.316447 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 4cfacbfbca68443d944d60a09ca94ed2 Jul 19 22:25:00.316447 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-56836165-project Jul 19 22:25:00.316447 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:25:00.316447 n-d-847009-3 devstack@n-api.service[119338]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 19 22:25:00.316447 n-d-847009-3 devstack@n-api.service[119338]: action_args: {} Jul 19 22:25:00.317183 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:00.317183 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:00.317183 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:00.317183 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:00.317183 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:00.317183 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:00.317183 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:00.317183 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:00.317183 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 19 22:25:00.317183 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 19 22:25:00.317183 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:25:00.317183 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:25:00.317183 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:25:00.317183 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:25:00.317183 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:25:00.317183 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:25:00.317183 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:25:00.317183 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:25:00.317183 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:25:00.318286 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:25:00.318286 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:25:00.318286 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:25:00.318286 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:25:00.318286 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:25:00.318286 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 19 22:25:00.318286 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:00.318286 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:00.318286 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:00.318286 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:00.318286 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:00.318286 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:00.318286 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:25:00.318286 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:25:00.318286 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 19 22:25:00.318286 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:00.318286 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-20ab6a5c-13ec-4a4d-b6fb-99e92d7d7baa tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:00.321402 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-20ab6a5c-13ec-4a4d-b6fb-99e92d7d7baa tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.014880 Jul 19 22:25:00.321402 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 26/59] 10.222.0.25 () {58 vars in 1142 bytes} [Tue Jul 19 22:25:00 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:25:00.473332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b18aca3e-5862-4189-a2b2-52bbda9af483 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:00.507990 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b18aca3e-5862-4189-a2b2-52bbda9af483 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a" status: 200 len: 1300 microversion: 2.1 time: 0.354006 Jul 19 22:25:00.509153 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 34/60] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:00 2022] GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a => generated 1300 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:01.528030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3c6e5c5e-3332-4dae-9688-2b3215aaeb8e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:01.530014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3c6e5c5e-3332-4dae-9688-2b3215aaeb8e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:01.572019 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c6e5c5e-3332-4dae-9688-2b3215aaeb8e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:01.575522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c6e5c5e-3332-4dae-9688-2b3215aaeb8e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:01.583991 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c6e5c5e-3332-4dae-9688-2b3215aaeb8e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:01.588614 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c6e5c5e-3332-4dae-9688-2b3215aaeb8e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:01.822403 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2d7ac2f3-7b40-4e98-be64-3411d3e1c77d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-541951473", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "availability_zone": "tempest-test_az-1109626333"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:01.883034 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d7ac2f3-7b40-4e98-be64-3411d3e1c77d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:01.889756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d7ac2f3-7b40-4e98-be64-3411d3e1c77d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:01.890705 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d7ac2f3-7b40-4e98-be64-3411d3e1c77d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:01.894995 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d7ac2f3-7b40-4e98-be64-3411d3e1c77d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:02.204615 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-2d7ac2f3-7b40-4e98-be64-3411d3e1c77d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] validate_networks() for None {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:25:03.029638 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3c6e5c5e-3332-4dae-9688-2b3215aaeb8e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:03.040888 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3c6e5c5e-3332-4dae-9688-2b3215aaeb8e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a" status: 200 len: 1342 microversion: 2.1 time: 1.518888 Jul 19 22:25:03.056084 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 35/61] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:01 2022] GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a => generated 1342 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:25:03.455303 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-2d7ac2f3-7b40-4e98-be64-3411d3e1c77d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:25:03.456797 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-2d7ac2f3-7b40-4e98-be64-3411d3e1c77d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:25:03.457632 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-2d7ac2f3-7b40-4e98-be64-3411d3e1c77d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:25:03.458121 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-2d7ac2f3-7b40-4e98-be64-3411d3e1c77d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:25:03.458815 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-2d7ac2f3-7b40-4e98-be64-3411d3e1c77d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:25:03.504470 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d7ac2f3-7b40-4e98-be64-3411d3e1c77d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:03.505548 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d7ac2f3-7b40-4e98-be64-3411d3e1c77d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:03.509250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d7ac2f3-7b40-4e98-be64-3411d3e1c77d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:03.510628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d7ac2f3-7b40-4e98-be64-3411d3e1c77d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:03.575283 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-2d7ac2f3-7b40-4e98-be64-3411d3e1c77d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Getting quotas for project 1be6ce11f1034a36b533ebc223be834a. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:25:03.584820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-2d7ac2f3-7b40-4e98-be64-3411d3e1c77d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Getting quotas for user 0eabe2a2d3164f168cfaf69623ffe96e and project 1be6ce11f1034a36b533ebc223be834a. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:25:03.615418 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2d7ac2f3-7b40-4e98-be64-3411d3e1c77d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:25:03.622193 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2d7ac2f3-7b40-4e98-be64-3411d3e1c77d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] [instance: e1dfa154-2d44-47cb-8e04-3c45c04cd96b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:25:03.720172 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2d7ac2f3-7b40-4e98-be64-3411d3e1c77d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.972971 Jul 19 22:25:03.722462 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 27/62] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:25:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:25:03.734729 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dc3d3b54-e331-466c-bda9-09ff80c299cd tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:03.736032 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dc3d3b54-e331-466c-bda9-09ff80c299cd tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] [instance: e1dfa154-2d44-47cb-8e04-3c45c04cd96b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:03.960626 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dc3d3b54-e331-466c-bda9-09ff80c299cd tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eabe2a2d3164f168cfaf69623ffe96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6ce11f1034a36b533ebc223be834a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:03.987353 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dc3d3b54-e331-466c-bda9-09ff80c299cd tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b" status: 200 len: 1242 microversion: 2.1 time: 0.258624 Jul 19 22:25:03.988577 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 36/63] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:03 2022] GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b => generated 1242 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:04.064158 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6e11203a-3439-4353-8d7c-9b99e869a575 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:04.064970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6e11203a-3439-4353-8d7c-9b99e869a575 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:04.092803 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e11203a-3439-4353-8d7c-9b99e869a575 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:04.093403 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e11203a-3439-4353-8d7c-9b99e869a575 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:04.094376 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e11203a-3439-4353-8d7c-9b99e869a575 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:04.094827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e11203a-3439-4353-8d7c-9b99e869a575 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:04.680831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6e11203a-3439-4353-8d7c-9b99e869a575 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:04.721589 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6e11203a-3439-4353-8d7c-9b99e869a575 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a" status: 200 len: 1342 microversion: 2.1 time: 0.655010 Jul 19 22:25:04.722673 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 28/64] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:04 2022] GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a => generated 1342 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:05.010242 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1d006cd3-f803-4324-830f-1ce859d09ed6 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:05.011849 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1d006cd3-f803-4324-830f-1ce859d09ed6 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] [instance: e1dfa154-2d44-47cb-8e04-3c45c04cd96b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:05.153304 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1d006cd3-f803-4324-830f-1ce859d09ed6 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eabe2a2d3164f168cfaf69623ffe96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6ce11f1034a36b533ebc223be834a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:05.166486 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1d006cd3-f803-4324-830f-1ce859d09ed6 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b" status: 200 len: 1242 microversion: 2.1 time: 0.162097 Jul 19 22:25:05.182274 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 37/65] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:05 2022] GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b => generated 1242 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:05.748344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6d25dc19-d754-4577-8bd3-869651be04f0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:05.753108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6d25dc19-d754-4577-8bd3-869651be04f0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:05.776229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6d25dc19-d754-4577-8bd3-869651be04f0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:05.778812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6d25dc19-d754-4577-8bd3-869651be04f0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:05.780197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6d25dc19-d754-4577-8bd3-869651be04f0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:05.782684 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6d25dc19-d754-4577-8bd3-869651be04f0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:06.178032 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6d25dc19-d754-4577-8bd3-869651be04f0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:06.190092 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0d153e24-24a7-4886-930c-346eebca227d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:06.190974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0d153e24-24a7-4886-930c-346eebca227d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] [instance: e1dfa154-2d44-47cb-8e04-3c45c04cd96b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:06.193489 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6d25dc19-d754-4577-8bd3-869651be04f0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a" status: 200 len: 1342 microversion: 2.1 time: 0.452867 Jul 19 22:25:06.207942 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 29/66] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:05 2022] GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a => generated 1342 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:06.214353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d153e24-24a7-4886-930c-346eebca227d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:06.214888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d153e24-24a7-4886-930c-346eebca227d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:06.215855 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d153e24-24a7-4886-930c-346eebca227d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:06.216373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d153e24-24a7-4886-930c-346eebca227d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:06.440850 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0d153e24-24a7-4886-930c-346eebca227d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eabe2a2d3164f168cfaf69623ffe96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6ce11f1034a36b533ebc223be834a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:06.468930 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0d153e24-24a7-4886-930c-346eebca227d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b" status: 200 len: 1242 microversion: 2.1 time: 0.283371 Jul 19 22:25:06.470355 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 38/67] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:06 2022] GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b => generated 1242 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:07.213956 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5a37dc9c-ca26-46da-ae7b-4d5a5d83eba1 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:07.214578 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5a37dc9c-ca26-46da-ae7b-4d5a5d83eba1 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:07.224324 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5a37dc9c-ca26-46da-ae7b-4d5a5d83eba1 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:07.224782 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5a37dc9c-ca26-46da-ae7b-4d5a5d83eba1 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:07.225843 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5a37dc9c-ca26-46da-ae7b-4d5a5d83eba1 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:07.226264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5a37dc9c-ca26-46da-ae7b-4d5a5d83eba1 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:07.493481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b8788953-d626-434e-8466-46103b8de6f9 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:07.494591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b8788953-d626-434e-8466-46103b8de6f9 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] [instance: e1dfa154-2d44-47cb-8e04-3c45c04cd96b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:07.501711 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8788953-d626-434e-8466-46103b8de6f9 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:07.503128 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8788953-d626-434e-8466-46103b8de6f9 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:07.518741 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8788953-d626-434e-8466-46103b8de6f9 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:07.520139 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8788953-d626-434e-8466-46103b8de6f9 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:08.467396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b8788953-d626-434e-8466-46103b8de6f9 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eabe2a2d3164f168cfaf69623ffe96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6ce11f1034a36b533ebc223be834a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:08.483016 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b8788953-d626-434e-8466-46103b8de6f9 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b" status: 200 len: 1290 microversion: 2.1 time: 0.998187 Jul 19 22:25:08.487506 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 39/68] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:07 2022] GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b => generated 1290 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:08.793079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5a37dc9c-ca26-46da-ae7b-4d5a5d83eba1 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:08.811582 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5a37dc9c-ca26-46da-ae7b-4d5a5d83eba1 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a" status: 200 len: 1342 microversion: 2.1 time: 1.601438 Jul 19 22:25:08.815941 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 30/69] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:07 2022] GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a => generated 1342 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:08.893369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-368d9287-6324-4a1b-99a1-9ff33555e81b tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1393409816", "ram": 512, "vcpus": 1, "disk": 10, "id": 1776842924, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:08.900935 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:08.900935 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:08.939434 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-368d9287-6324-4a1b-99a1-9ff33555e81b tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.450278 Jul 19 22:25:08.942375 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 40/70] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:25:08 2022] POST /compute/v2.1/flavors => generated 416 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:09.184500 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=4 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:09.485566 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-7c7eb3a9-4b8c-4120-8a37-30ce5f82a2a4 req-cd7c0f6b-e454-45cd-87f7-ffaebd5cf7e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a", "tag": "9d2342e4-4686-4dad-9000-088369a4e47b"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:09.539675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7c7eb3a9-4b8c-4120-8a37-30ce5f82a2a4 req-cd7c0f6b-e454-45cd-87f7-ffaebd5cf7e4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:09.541779 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7c7eb3a9-4b8c-4120-8a37-30ce5f82a2a4 req-cd7c0f6b-e454-45cd-87f7-ffaebd5cf7e4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:09.608307 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-7c7eb3a9-4b8c-4120-8a37-30ce5f82a2a4 req-cd7c0f6b-e454-45cd-87f7-ffaebd5cf7e4 service nova] Creating event network-changed:9d2342e4-4686-4dad-9000-088369a4e47b for instance b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a on n-h2-847009-3 Jul 19 22:25:09.610457 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7c7eb3a9-4b8c-4120-8a37-30ce5f82a2a4 req-cd7c0f6b-e454-45cd-87f7-ffaebd5cf7e4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119338) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 22:25:09.615652 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd343726-8af6-4e66-bed5-d5830ca08c51 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:09.617453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd343726-8af6-4e66-bed5-d5830ca08c51 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:09.619890 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd343726-8af6-4e66-bed5-d5830ca08c51 None None] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:09.622717 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd343726-8af6-4e66-bed5-d5830ca08c51 None None] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:09.653358 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.compute.rpcapi [None req-fd343726-8af6-4e66-bed5-d5830ca08c51 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 19 22:25:09.658631 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd343726-8af6-4e66-bed5-d5830ca08c51 None None] Releasing lock "compute-rpcapi-router" {{(pid=119338) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 22:25:09.719885 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fd343726-8af6-4e66-bed5-d5830ca08c51 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.899661 Jul 19 22:25:09.720797 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 31/71] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:09.728087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5e370606-9d72-4b45-ba83-f51d61bd7d6e tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:09.734100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5e370606-9d72-4b45-ba83-f51d61bd7d6e tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] [instance: e1dfa154-2d44-47cb-8e04-3c45c04cd96b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:09.759351 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e370606-9d72-4b45-ba83-f51d61bd7d6e tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:09.762933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e370606-9d72-4b45-ba83-f51d61bd7d6e tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:09.766168 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e370606-9d72-4b45-ba83-f51d61bd7d6e tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:09.768060 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e370606-9d72-4b45-ba83-f51d61bd7d6e tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:09.991575 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5e370606-9d72-4b45-ba83-f51d61bd7d6e tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eabe2a2d3164f168cfaf69623ffe96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6ce11f1034a36b533ebc223be834a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:10.070856 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5e370606-9d72-4b45-ba83-f51d61bd7d6e tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b" status: 200 len: 1296 microversion: 2.1 time: 0.340434 Jul 19 22:25:10.075695 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 32/72] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:09 2022] GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b => generated 1296 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:10.106720 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-46f72214-0e0e-4feb-abd7-00863bbd1f4e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:10.109105 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-46f72214-0e0e-4feb-abd7-00863bbd1f4e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:10.125557 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-36388f30-f29b-4f08-a61b-52ef4821dca0 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:10.140790 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-46f72214-0e0e-4feb-abd7-00863bbd1f4e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:10.142218 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-46f72214-0e0e-4feb-abd7-00863bbd1f4e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:10.144183 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-36388f30-f29b-4f08-a61b-52ef4821dca0 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project] HTTP exception thrown: Flavor 1776842924 has no extra specs with key hw:cpu_thread_policy. Jul 19 22:25:10.147087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-46f72214-0e0e-4feb-abd7-00863bbd1f4e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:10.148592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-46f72214-0e0e-4feb-abd7-00863bbd1f4e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:10.161566 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-36388f30-f29b-4f08-a61b-52ef4821dca0 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project] Request method failure captured: Jul 19 22:25:10.161566 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/flavors/1776842924/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 19 22:25:10.161566 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:25:10.161566 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:25:10.161566 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:25:10.161566 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:25:10.161566 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:25:10.161566 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:25:10.161566 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:25:10.161566 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:10.161566 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y9A4upS-M0u2AuVBWMYX30vCDm2l65cCBzSsSLlrEYr3sxG1wkjLhHv31GqlGFUAGYv-Jvy74lS1HAggvwbuP8zlzoUsjE2fRWH-_nZ0uVL68Ky_U1PB1Zg73-s0-omQjdTlveYequ-b4NyGxLG8zdv0lH_uRQ0mZopQUGWzuB3OJ4 Jul 19 22:25:10.161566 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:25:10.161566 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:25:10.161566 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:25:10.161566 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:25:10.161566 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:25:10.161566 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:25:10.161566 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 395fd534a2bd4527a1de733d02ba31cc Jul 19 22:25:10.161566 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 Jul 19 22:25:10.161566 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:25:10.161566 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:25:10.164007 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_395fd534a2bd4527a1de733d02ba31cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/395fd534a2bd4527a1de733d02ba31cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/395fd534a2bd4527a1de733d02ba31cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/395fd534a2bd4527a1de733d02ba31cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:10.164007 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 Jul 19 22:25:10.164007 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 395fd534a2bd4527a1de733d02ba31cc Jul 19 22:25:10.164007 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 Jul 19 22:25:10.164007 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project Jul 19 22:25:10.164007 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:25:10.164007 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:25:10.164007 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: fc96444b98db426aabd54c9bdecc1ed5 Jul 19 22:25:10.164007 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project Jul 19 22:25:10.164007 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:25:10.164007 n-d-847009-3 devstack@n-api.service[119337]: exception: Flavor 1776842924 has no extra specs with key hw:cpu_thread_policy. Jul 19 22:25:10.164851 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'flavor_id': '1776842924', 'id': 'hw:cpu_thread_policy'} Jul 19 22:25:10.164851 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:10.164851 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:10.164851 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 19 22:25:10.164851 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 19 22:25:10.164851 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 19 22:25:10.164851 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.164851 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:10.164851 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.164851 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:10.164851 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:10.164851 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:10.164851 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:10.164851 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:10.164851 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:10.164851 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:10.164851 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 19 22:25:10.164851 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 22:25:10.164851 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1776842924 has no extra specs with key hw:cpu_thread_policy. Jul 19 22:25:10.164851 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.164851 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:10.164851 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.166783 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:10.166783 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:10.166783 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:10.166783 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:25:10.166783 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:25:10.166783 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1776842924 has no extra specs with key hw:cpu_thread_policy. Jul 19 22:25:10.166783 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.166783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-36388f30-f29b-4f08-a61b-52ef4821dca0 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project] Returning 404 to user: Flavor 1776842924 has no extra specs with key hw:cpu_thread_policy. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:10.186892 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-36388f30-f29b-4f08-a61b-52ef4821dca0 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project] 10.222.0.25 "GET /compute/v2.1/flavors/1776842924/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 1.212512 Jul 19 22:25:10.190262 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 41/73] 10.222.0.25 () {58 vars in 1265 bytes} [Tue Jul 19 22:25:08 2022] GET /compute/v2.1/flavors/1776842924/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 1238 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:25:10.210378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ebe36ecd-108d-44a9-820e-b5077fc5cc4b tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:10.223733 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:10.223733 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:10.235189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ebe36ecd-108d-44a9-820e-b5077fc5cc4b tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'fc96444b98db426aabd54c9bdecc1ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395fd534a2bd4527a1de733d02ba31cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:10.238947 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ebe36ecd-108d-44a9-820e-b5077fc5cc4b tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project] Request method failure captured: Jul 19 22:25:10.238947 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/flavors/1776842924/os-extra_specs HTTP/1.1 Jul 19 22:25:10.238947 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:25:10.238947 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:25:10.238947 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:25:10.238947 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 66 Jul 19 22:25:10.238947 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:25:10.238947 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:25:10.238947 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:25:10.238947 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:10.238947 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y9A4upS-M0u2AuVBWMYX30vCDm2l65cCBzSsSLlrEYr3sxG1wkjLhHv31GqlGFUAGYv-Jvy74lS1HAggvwbuP8zlzoUsjE2fRWH-_nZ0uVL68Ky_U1PB1Zg73-s0-omQjdTlveYequ-b4NyGxLG8zdv0lH_uRQ0mZopQUGWzuB3OJ4 Jul 19 22:25:10.238947 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:25:10.238947 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:25:10.238947 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:25:10.238947 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:25:10.238947 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:25:10.238947 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:25:10.238947 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 395fd534a2bd4527a1de733d02ba31cc Jul 19 22:25:10.238947 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 Jul 19 22:25:10.238947 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:25:10.238947 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:25:10.240083 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_395fd534a2bd4527a1de733d02ba31cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/395fd534a2bd4527a1de733d02ba31cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/395fd534a2bd4527a1de733d02ba31cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/395fd534a2bd4527a1de733d02ba31cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:10.240083 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 Jul 19 22:25:10.240083 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 395fd534a2bd4527a1de733d02ba31cc Jul 19 22:25:10.240083 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 Jul 19 22:25:10.240083 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project Jul 19 22:25:10.240083 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:25:10.240083 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:25:10.240083 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: fc96444b98db426aabd54c9bdecc1ed5 Jul 19 22:25:10.240083 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project Jul 19 22:25:10.240083 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:25:10.240083 n-d-847009-3 devstack@n-api.service[119337]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 19 22:25:10.240083 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:25:10.240705 n-d-847009-3 devstack@n-api.service[119337]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 19 22:25:10.240705 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'flavor_id': '1776842924', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 19 22:25:10.240705 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:10.240705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:10.240705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:10.240705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:10.240705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:10.240705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:10.240705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:10.240705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:10.240705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:25:10.240705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:25:10.240705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 19 22:25:10.240705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 19 22:25:10.240705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:25:10.240705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:25:10.240705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:25:10.240705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:25:10.240705 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:25:10.241881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:25:10.241881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:25:10.241881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:25:10.241881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:25:10.241881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:25:10.241881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:25:10.241881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:25:10.241881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:25:10.241881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:25:10.241881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 19 22:25:10.241881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.241881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:10.241881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.241881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:10.241881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:10.241881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:10.241881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:25:10.241881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:25:10.241881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 19 22:25:10.241881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.243204 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ebe36ecd-108d-44a9-820e-b5077fc5cc4b tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:10.243204 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ebe36ecd-108d-44a9-820e-b5077fc5cc4b tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project] 10.222.0.25 "POST /compute/v2.1/flavors/1776842924/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.042909 Jul 19 22:25:10.257687 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 42/74] 10.222.0.25 () {60 vars in 1223 bytes} [Tue Jul 19 22:25:10 2022] POST /compute/v2.1/flavors/1776842924/os-extra_specs => generated 124 bytes in 61 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:25:10.290519 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-84bc1548-fe2c-42da-9495-ce36336c0f7f tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:10.406321 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-84bc1548-fe2c-42da-9495-ce36336c0f7f tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1776842924/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.141252 Jul 19 22:25:10.413307 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 43/75] 10.222.0.25 () {60 vars in 1223 bytes} [Tue Jul 19 22:25:10 2022] POST /compute/v2.1/flavors/1776842924/os-extra_specs => generated 66 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:25:10.428687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-39283969-11a3-4670-9788-c5cc24703f3f tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:10.430892 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:10.430892 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:10.432287 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-39283969-11a3-4670-9788-c5cc24703f3f tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'fc96444b98db426aabd54c9bdecc1ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395fd534a2bd4527a1de733d02ba31cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:10.435909 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-39283969-11a3-4670-9788-c5cc24703f3f tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project] Request method failure captured: Jul 19 22:25:10.435909 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/flavors/1776842924/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 19 22:25:10.435909 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:25:10.435909 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:25:10.435909 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:25:10.435909 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:25:10.435909 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:25:10.435909 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:25:10.435909 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:25:10.435909 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:10.435909 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y9A4upS-M0u2AuVBWMYX30vCDm2l65cCBzSsSLlrEYr3sxG1wkjLhHv31GqlGFUAGYv-Jvy74lS1HAggvwbuP8zlzoUsjE2fRWH-_nZ0uVL68Ky_U1PB1Zg73-s0-omQjdTlveYequ-b4NyGxLG8zdv0lH_uRQ0mZopQUGWzuB3OJ4 Jul 19 22:25:10.435909 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:25:10.435909 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:25:10.435909 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:25:10.435909 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:25:10.435909 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:25:10.435909 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:25:10.435909 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 395fd534a2bd4527a1de733d02ba31cc Jul 19 22:25:10.435909 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 Jul 19 22:25:10.435909 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:25:10.435909 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:25:10.436942 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_395fd534a2bd4527a1de733d02ba31cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/395fd534a2bd4527a1de733d02ba31cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/395fd534a2bd4527a1de733d02ba31cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/395fd534a2bd4527a1de733d02ba31cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:10.436942 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 Jul 19 22:25:10.436942 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 395fd534a2bd4527a1de733d02ba31cc Jul 19 22:25:10.436942 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 Jul 19 22:25:10.436942 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project Jul 19 22:25:10.436942 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:25:10.436942 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:25:10.436942 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: fc96444b98db426aabd54c9bdecc1ed5 Jul 19 22:25:10.436942 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project Jul 19 22:25:10.436942 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:25:10.436942 n-d-847009-3 devstack@n-api.service[119337]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 19 22:25:10.437554 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'flavor_id': '1776842924', 'id': 'hw:numa_nodes'} Jul 19 22:25:10.437554 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:10.437554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:10.437554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:10.437554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:10.437554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:10.437554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:10.437554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:10.437554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:10.437554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 19 22:25:10.437554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 19 22:25:10.437554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:25:10.437554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:25:10.437554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:25:10.437554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:25:10.437554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:25:10.437554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:25:10.437554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:25:10.437554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:25:10.437554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:25:10.438519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:25:10.438519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:25:10.438519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:25:10.438519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:25:10.438519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:25:10.438519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 19 22:25:10.438519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.438519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:10.438519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.438519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:10.438519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:10.438519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:10.438519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:25:10.438519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:25:10.438519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 19 22:25:10.438519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.438519 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-39283969-11a3-4670-9788-c5cc24703f3f tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:10.440515 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-39283969-11a3-4670-9788-c5cc24703f3f tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project] 10.222.0.25 "DELETE /compute/v2.1/flavors/1776842924/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.024112 Jul 19 22:25:10.442625 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 44/76] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 19 22:25:10 2022] DELETE /compute/v2.1/flavors/1776842924/os-extra_specs/hw:numa_nodes => generated 124 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:25:10.469151 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bc6db814-1cee-43a3-99cd-32276d73ceb0 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:10.563955 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bc6db814-1cee-43a3-99cd-32276d73ceb0 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1776842924/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.116421 Jul 19 22:25:10.570424 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 45/77] 10.222.0.25 () {60 vars in 1223 bytes} [Tue Jul 19 22:25:10 2022] POST /compute/v2.1/flavors/1776842924/os-extra_specs => generated 66 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:25:10.592837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-829895dc-5f56-430a-adc9-5bc90e9f79d8 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:10.598284 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:10.598284 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:10.604069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-829895dc-5f56-430a-adc9-5bc90e9f79d8 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'fc96444b98db426aabd54c9bdecc1ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395fd534a2bd4527a1de733d02ba31cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:10.613252 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-829895dc-5f56-430a-adc9-5bc90e9f79d8 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project] Request method failure captured: Jul 19 22:25:10.613252 n-d-847009-3 devstack@n-api.service[119337]: request: PUT /compute/v2.1/flavors/1776842924/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 19 22:25:10.613252 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:25:10.613252 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:25:10.613252 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:25:10.613252 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 22 Jul 19 22:25:10.613252 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:25:10.613252 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:25:10.613252 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:25:10.613252 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:10.613252 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y9A4upS-M0u2AuVBWMYX30vCDm2l65cCBzSsSLlrEYr3sxG1wkjLhHv31GqlGFUAGYv-Jvy74lS1HAggvwbuP8zlzoUsjE2fRWH-_nZ0uVL68Ky_U1PB1Zg73-s0-omQjdTlveYequ-b4NyGxLG8zdv0lH_uRQ0mZopQUGWzuB3OJ4 Jul 19 22:25:10.613252 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:25:10.613252 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:25:10.613252 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:25:10.613252 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:25:10.613252 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:25:10.613252 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:25:10.613252 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 395fd534a2bd4527a1de733d02ba31cc Jul 19 22:25:10.613252 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 Jul 19 22:25:10.613252 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:25:10.613252 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:25:10.614878 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_395fd534a2bd4527a1de733d02ba31cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/395fd534a2bd4527a1de733d02ba31cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/395fd534a2bd4527a1de733d02ba31cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/395fd534a2bd4527a1de733d02ba31cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:10.614878 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 Jul 19 22:25:10.614878 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 395fd534a2bd4527a1de733d02ba31cc Jul 19 22:25:10.614878 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 Jul 19 22:25:10.614878 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project Jul 19 22:25:10.614878 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:25:10.614878 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:25:10.614878 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: fc96444b98db426aabd54c9bdecc1ed5 Jul 19 22:25:10.614878 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project Jul 19 22:25:10.614878 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:25:10.614878 n-d-847009-3 devstack@n-api.service[119337]: {"hw:numa_nodes": "1"} Jul 19 22:25:10.614878 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:25:10.614878 n-d-847009-3 devstack@n-api.service[119337]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 19 22:25:10.615725 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'flavor_id': '1776842924', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 19 22:25:10.615725 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:10.615725 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:10.615725 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:10.615725 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:10.615725 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:10.615725 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:10.615725 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:10.615725 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:10.615725 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:25:10.615725 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:25:10.615725 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 19 22:25:10.615725 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 19 22:25:10.615725 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:25:10.615725 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:25:10.615725 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:25:10.615725 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:25:10.615725 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:25:10.615725 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:25:10.616704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:25:10.616704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:25:10.616704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:25:10.616704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:25:10.616704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:25:10.616704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:25:10.616704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:25:10.616704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:25:10.616704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 19 22:25:10.616704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.616704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:10.616704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.616704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:10.616704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:10.616704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:10.616704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:25:10.616704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:25:10.616704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 19 22:25:10.616704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.621423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-829895dc-5f56-430a-adc9-5bc90e9f79d8 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:10.622700 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-829895dc-5f56-430a-adc9-5bc90e9f79d8 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265 tempest-FlavorsExtraSpecsNegativeTestJSON-639581265-project] 10.222.0.25 "PUT /compute/v2.1/flavors/1776842924/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.047299 Jul 19 22:25:10.626003 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 46/78] 10.222.0.25 () {60 vars in 1264 bytes} [Tue Jul 19 22:25:10 2022] PUT /compute/v2.1/flavors/1776842924/os-extra_specs/hw:numa_nodes => generated 124 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:25:10.648099 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3a64387c-6130-4b4f-a3e9-ba7558d56387 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:10.678639 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-3a64387c-6130-4b4f-a3e9-ba7558d56387 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin] HTTP exception thrown: Flavor 1776842924 has no extra specs with key hw:cpu_thread_policy. Jul 19 22:25:10.686679 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3a64387c-6130-4b4f-a3e9-ba7558d56387 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin] Request method failure captured: Jul 19 22:25:10.686679 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/flavors/1776842924/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 19 22:25:10.686679 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:25:10.686679 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:25:10.686679 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:25:10.686679 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:25:10.686679 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:25:10.686679 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:25:10.686679 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:25:10.686679 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:10.686679 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y9DdaXUl0IqJvqt0HJ3QmM1hsxQjB_qOTMRREgyDlBjpf0OOyI3PhHN80aEl6O6aXBRn0KW9fgV1qpPqq_719x8_rmwBnCTsnAtdw9Tx7Ce6jj1wbl6UVQcMBvK6MHoiJBkdAuT6-1IB3-RZljiSJyzi02P6ja1-r8m8ErvR7kJJuI Jul 19 22:25:10.686679 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:25:10.686679 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:25:10.686679 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:25:10.686679 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:25:10.686679 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:25:10.686679 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:25:10.686679 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 7ab8b137904e42aaaca7378b5c01f72b Jul 19 22:25:10.686679 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 Jul 19 22:25:10.686679 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:25:10.686679 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:25:10.688214 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7ab8b137904e42aaaca7378b5c01f72b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ab8b137904e42aaaca7378b5c01f72b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7ab8b137904e42aaaca7378b5c01f72b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ab8b137904e42aaaca7378b5c01f72b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:10.688214 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 Jul 19 22:25:10.688214 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 7ab8b137904e42aaaca7378b5c01f72b Jul 19 22:25:10.688214 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 Jul 19 22:25:10.688214 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin Jul 19 22:25:10.688214 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:25:10.688214 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:25:10.688214 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 880404a71b4b4bb0a29af98c93af17ce Jul 19 22:25:10.688214 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin Jul 19 22:25:10.688214 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:25:10.688214 n-d-847009-3 devstack@n-api.service[119337]: exception: Flavor 1776842924 has no extra specs with key hw:cpu_thread_policy. Jul 19 22:25:10.688939 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'flavor_id': '1776842924', 'id': 'hw:cpu_thread_policy'} Jul 19 22:25:10.688939 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:10.688939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:10.688939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 19 22:25:10.688939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 19 22:25:10.688939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 19 22:25:10.688939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.688939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:10.688939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.688939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:10.688939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:10.688939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:10.688939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:10.688939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:10.688939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:10.688939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:10.688939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 19 22:25:10.688939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 22:25:10.688939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1776842924 has no extra specs with key hw:cpu_thread_policy. Jul 19 22:25:10.688939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.688939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:10.688939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.690695 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:10.690695 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:10.690695 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:10.690695 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:25:10.690695 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:25:10.690695 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1776842924 has no extra specs with key hw:cpu_thread_policy. Jul 19 22:25:10.690695 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.695717 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3a64387c-6130-4b4f-a3e9-ba7558d56387 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin] Returning 404 to user: Flavor 1776842924 has no extra specs with key hw:cpu_thread_policy. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:10.698649 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3a64387c-6130-4b4f-a3e9-ba7558d56387 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1776842924/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.065397 Jul 19 22:25:10.710428 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 47/79] 10.222.0.25 () {58 vars in 1268 bytes} [Tue Jul 19 22:25:10 2022] DELETE /compute/v2.1/flavors/1776842924/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:25:10.731078 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-00b7bcd2-c74c-44cd-913f-5b89ab48125b tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:10.735160 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-00b7bcd2-c74c-44cd-913f-5b89ab48125b tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 19 22:25:10.743148 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-00b7bcd2-c74c-44cd-913f-5b89ab48125b tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin] Request method failure captured: Jul 19 22:25:10.743148 n-d-847009-3 devstack@n-api.service[119337]: request: PUT /compute/v2.1/flavors/1776842924/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 19 22:25:10.743148 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:25:10.743148 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:25:10.743148 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:25:10.743148 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 27 Jul 19 22:25:10.743148 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:25:10.743148 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:25:10.743148 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:25:10.743148 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:10.743148 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y9DdaXUl0IqJvqt0HJ3QmM1hsxQjB_qOTMRREgyDlBjpf0OOyI3PhHN80aEl6O6aXBRn0KW9fgV1qpPqq_719x8_rmwBnCTsnAtdw9Tx7Ce6jj1wbl6UVQcMBvK6MHoiJBkdAuT6-1IB3-RZljiSJyzi02P6ja1-r8m8ErvR7kJJuI Jul 19 22:25:10.743148 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:25:10.743148 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:25:10.743148 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:25:10.743148 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:25:10.743148 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:25:10.743148 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:25:10.743148 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 7ab8b137904e42aaaca7378b5c01f72b Jul 19 22:25:10.743148 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 Jul 19 22:25:10.743148 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:25:10.743148 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:25:10.744329 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7ab8b137904e42aaaca7378b5c01f72b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ab8b137904e42aaaca7378b5c01f72b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7ab8b137904e42aaaca7378b5c01f72b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ab8b137904e42aaaca7378b5c01f72b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:10.744329 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 Jul 19 22:25:10.744329 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 7ab8b137904e42aaaca7378b5c01f72b Jul 19 22:25:10.744329 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 Jul 19 22:25:10.744329 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin Jul 19 22:25:10.744329 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:25:10.744329 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:25:10.744329 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 880404a71b4b4bb0a29af98c93af17ce Jul 19 22:25:10.744329 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin Jul 19 22:25:10.744329 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:25:10.744329 n-d-847009-3 devstack@n-api.service[119337]: {"hw:cpu_policy": "shared"} Jul 19 22:25:10.744329 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:25:10.744329 n-d-847009-3 devstack@n-api.service[119337]: exception: Request body and URI mismatch Jul 19 22:25:10.744957 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'flavor_id': '1776842924', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 19 22:25:10.744957 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:10.744957 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:10.744957 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:10.744957 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:10.744957 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:10.744957 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:10.744957 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:10.744957 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:10.744957 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:25:10.744957 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:25:10.744957 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 19 22:25:10.744957 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 19 22:25:10.744957 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 19 22:25:10.744957 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.744957 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:10.744957 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.744957 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:10.744957 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:10.744957 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:10.745895 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:25:10.745895 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:25:10.745895 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 19 22:25:10.745895 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.752686 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-00b7bcd2-c74c-44cd-913f-5b89ab48125b tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:10.756192 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-00b7bcd2-c74c-44cd-913f-5b89ab48125b tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/1776842924/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.043177 Jul 19 22:25:10.756727 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 48/80] 10.222.0.25 () {60 vars in 1264 bytes} [Tue Jul 19 22:25:10 2022] PUT /compute/v2.1/flavors/1776842924/os-extra_specs/hw:numa_nodes => generated 73 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 22:25:10.773039 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-adce6983-7a33-4676-99a4-91dfe3cfa4af tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:10.794639 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-adce6983-7a33-4676-99a4-91dfe3cfa4af tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin] Request method failure captured: Jul 19 22:25:10.794639 n-d-847009-3 devstack@n-api.service[119337]: request: PUT /compute/v2.1/flavors/1776842924/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 19 22:25:10.794639 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:25:10.794639 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:25:10.794639 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:25:10.794639 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 49 Jul 19 22:25:10.794639 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:25:10.794639 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:25:10.794639 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:25:10.794639 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:10.794639 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y9DdaXUl0IqJvqt0HJ3QmM1hsxQjB_qOTMRREgyDlBjpf0OOyI3PhHN80aEl6O6aXBRn0KW9fgV1qpPqq_719x8_rmwBnCTsnAtdw9Tx7Ce6jj1wbl6UVQcMBvK6MHoiJBkdAuT6-1IB3-RZljiSJyzi02P6ja1-r8m8ErvR7kJJuI Jul 19 22:25:10.794639 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:25:10.794639 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:25:10.794639 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:25:10.794639 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:25:10.794639 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:25:10.794639 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:25:10.794639 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 7ab8b137904e42aaaca7378b5c01f72b Jul 19 22:25:10.794639 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 Jul 19 22:25:10.794639 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:25:10.794639 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:25:10.795967 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7ab8b137904e42aaaca7378b5c01f72b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ab8b137904e42aaaca7378b5c01f72b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7ab8b137904e42aaaca7378b5c01f72b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ab8b137904e42aaaca7378b5c01f72b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:10.795967 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 Jul 19 22:25:10.795967 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 7ab8b137904e42aaaca7378b5c01f72b Jul 19 22:25:10.795967 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 Jul 19 22:25:10.795967 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin Jul 19 22:25:10.795967 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:25:10.795967 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:25:10.795967 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 880404a71b4b4bb0a29af98c93af17ce Jul 19 22:25:10.795967 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin Jul 19 22:25:10.795967 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:25:10.795967 n-d-847009-3 devstack@n-api.service[119337]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 19 22:25:10.795967 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:25:10.796644 n-d-847009-3 devstack@n-api.service[119337]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 19 22:25:10.796644 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'flavor_id': '1776842924', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 19 22:25:10.796644 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:10.796644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:10.796644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:25:10.796644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:25:10.796644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:25:10.796644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:25:10.796644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 19 22:25:10.796644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.796644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 19 22:25:10.796644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 19 22:25:10.796644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 19 22:25:10.796644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 19 22:25:10.796644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 19 22:25:10.796644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 19 22:25:10.796644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 19 22:25:10.796644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 19 22:25:10.796644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.796644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi On instance: Jul 19 22:25:10.796644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 19 22:25:10.796644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.798000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:10.798000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.798000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:10.798000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:10.798000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:10.798000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:10.798000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:10.798000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:10.798000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:10.798000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:25:10.798000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:25:10.798000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:25:10.798000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:25:10.798000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:25:10.798000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:25:10.798000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 19 22:25:10.798000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.798000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:10.798000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.798000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:10.799689 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:10.799689 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:10.799689 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:25:10.799689 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:25:10.799689 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 19 22:25:10.799689 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:10.802569 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-adce6983-7a33-4676-99a4-91dfe3cfa4af tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:10.806436 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-adce6983-7a33-4676-99a4-91dfe3cfa4af tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/1776842924/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.040555 Jul 19 22:25:10.810485 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 49/81] 10.222.0.25 () {60 vars in 1264 bytes} [Tue Jul 19 22:25:10 2022] PUT /compute/v2.1/flavors/1776842924/os-extra_specs/hw:numa_nodes => generated 117 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:25:10.832141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-08ea8bfe-3910-4c9c-a8ea-618d18f40e30 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:10.834388 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:10.834388 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:10.910950 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-08ea8bfe-3910-4c9c-a8ea-618d18f40e30 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1776842924" status: 202 len: 0 microversion: 2.1 time: 0.094389 Jul 19 22:25:10.912460 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 50/82] 10.222.0.25 () {58 vars in 1160 bytes} [Tue Jul 19 22:25:10 2022] DELETE /compute/v2.1/flavors/1776842924 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:25:10.922803 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9c2d47d9-5a12-4356-839e-26b16cc9a4d0 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:11.024650 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9c2d47d9-5a12-4356-839e-26b16cc9a4d0 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496 tempest-FlavorsExtraSpecsNegativeTestJSON-1565831496-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.106479 Jul 19 22:25:11.025267 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 51/83] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:25:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:25:11.091974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a5c8ddc8-7ad7-4f2c-81f0-94c36e953680 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:11.093553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a5c8ddc8-7ad7-4f2c-81f0-94c36e953680 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] [instance: e1dfa154-2d44-47cb-8e04-3c45c04cd96b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:11.106923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5c8ddc8-7ad7-4f2c-81f0-94c36e953680 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:11.108213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5c8ddc8-7ad7-4f2c-81f0-94c36e953680 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:11.112080 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5c8ddc8-7ad7-4f2c-81f0-94c36e953680 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:11.113885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5c8ddc8-7ad7-4f2c-81f0-94c36e953680 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:12.224054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a5c8ddc8-7ad7-4f2c-81f0-94c36e953680 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eabe2a2d3164f168cfaf69623ffe96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6ce11f1034a36b533ebc223be834a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:12.266394 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a5c8ddc8-7ad7-4f2c-81f0-94c36e953680 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b" status: 200 len: 1296 microversion: 2.1 time: 1.173311 Jul 19 22:25:12.274121 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 52/84] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:11 2022] GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b => generated 1296 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:25:12.372666 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-46f72214-0e0e-4feb-abd7-00863bbd1f4e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:12.384893 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-46f72214-0e0e-4feb-abd7-00863bbd1f4e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a" status: 200 len: 1342 microversion: 2.1 time: 2.305391 Jul 19 22:25:12.386168 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 33/85] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:10 2022] GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a => generated 1342 bytes in 2309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:13.290738 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-44ac747f-6c2d-442a-8029-2a9fb87a092d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:13.292937 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-44ac747f-6c2d-442a-8029-2a9fb87a092d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] [instance: e1dfa154-2d44-47cb-8e04-3c45c04cd96b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:13.333253 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44ac747f-6c2d-442a-8029-2a9fb87a092d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:13.335699 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44ac747f-6c2d-442a-8029-2a9fb87a092d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:13.344114 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44ac747f-6c2d-442a-8029-2a9fb87a092d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:13.348602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44ac747f-6c2d-442a-8029-2a9fb87a092d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:13.452313 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-732e22d5-8d2b-46b1-947d-9cd95c23b9c3 tempest-AZAdminNegativeTestJSON-1309666975 tempest-AZAdminNegativeTestJSON-1309666975-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:13.453934 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:13.453934 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:13.459588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-732e22d5-8d2b-46b1-947d-9cd95c23b9c3 tempest-AZAdminNegativeTestJSON-1309666975 tempest-AZAdminNegativeTestJSON-1309666975-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'eba4ee744f1c47fc84271e3fd1cd5b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa285721014b72acbdc6d5a09b29c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:13.474555 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-732e22d5-8d2b-46b1-947d-9cd95c23b9c3 tempest-AZAdminNegativeTestJSON-1309666975 tempest-AZAdminNegativeTestJSON-1309666975-project] Request method failure captured: Jul 19 22:25:13.474555 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 19 22:25:13.474555 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:25:13.474555 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:25:13.474555 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:25:13.474555 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:25:13.474555 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:25:13.474555 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:25:13.474555 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:25:13.474555 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:13.474555 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y9FAchy7LHgWvYmljUJ6bVPnmmvtevRYJac3WK5dyrglxkx9Epnwz39xj0gK5xs5zn0-jFeaK1zoWBBGgz9aOBFWL3efev6-UzAwlEv3qNOQdVz1VAlYlI-QzwXGZ1qkX8GnjHG3i9ZORgFEr3bWkBWRQ7rjuc6sR1Qb2kjlFJ3iCY Jul 19 22:25:13.474555 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:25:13.474555 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:25:13.474555 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:25:13.474555 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:25:13.474555 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:25:13.474555 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:25:13.474555 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 7baa285721014b72acbdc6d5a09b29c8 Jul 19 22:25:13.474555 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1309666975 Jul 19 22:25:13.474555 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:25:13.474555 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:25:13.476509 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7baa285721014b72acbdc6d5a09b29c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7baa285721014b72acbdc6d5a09b29c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7baa285721014b72acbdc6d5a09b29c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7baa285721014b72acbdc6d5a09b29c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:13.476509 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AZAdminNegativeTestJSON-1309666975 Jul 19 22:25:13.476509 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 7baa285721014b72acbdc6d5a09b29c8 Jul 19 22:25:13.476509 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1309666975 Jul 19 22:25:13.476509 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AZAdminNegativeTestJSON-1309666975-project Jul 19 22:25:13.476509 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:25:13.476509 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:25:13.476509 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: eba4ee744f1c47fc84271e3fd1cd5b0a Jul 19 22:25:13.476509 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AZAdminNegativeTestJSON-1309666975-project Jul 19 22:25:13.476509 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:25:13.476509 n-d-847009-3 devstack@n-api.service[119337]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 19 22:25:13.476509 n-d-847009-3 devstack@n-api.service[119337]: action_args: {} Jul 19 22:25:13.477409 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:13.477409 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:13.477409 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:13.477409 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:13.477409 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:13.477409 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:13.477409 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:13.477409 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:13.477409 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 19 22:25:13.477409 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 19 22:25:13.477409 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:25:13.477409 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:25:13.477409 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:25:13.477409 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:25:13.477409 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:25:13.477409 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:25:13.477409 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:25:13.477409 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:25:13.477409 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:25:13.478523 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:25:13.478523 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:25:13.478523 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:25:13.478523 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:25:13.478523 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:25:13.478523 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 19 22:25:13.478523 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:13.478523 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:13.478523 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:13.478523 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:13.478523 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:13.478523 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:13.478523 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:25:13.478523 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:25:13.478523 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 19 22:25:13.478523 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:13.487315 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-732e22d5-8d2b-46b1-947d-9cd95c23b9c3 tempest-AZAdminNegativeTestJSON-1309666975 tempest-AZAdminNegativeTestJSON-1309666975-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:13.493690 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-732e22d5-8d2b-46b1-947d-9cd95c23b9c3 tempest-AZAdminNegativeTestJSON-1309666975 tempest-AZAdminNegativeTestJSON-1309666975-project] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.838330 Jul 19 22:25:13.498977 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 53/86] 10.222.0.25 () {58 vars in 1184 bytes} [Tue Jul 19 22:25:12 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 847 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:25:13.510764 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f3761f9d-9d04-49ba-9dfe-7e2a230f2d5c tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:13.515421 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f3761f9d-9d04-49ba-9dfe-7e2a230f2d5c tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:13.547344 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3761f9d-9d04-49ba-9dfe-7e2a230f2d5c tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:13.548087 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3761f9d-9d04-49ba-9dfe-7e2a230f2d5c tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:13.549999 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3761f9d-9d04-49ba-9dfe-7e2a230f2d5c tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:13.554515 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3761f9d-9d04-49ba-9dfe-7e2a230f2d5c tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:13.601370 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=8 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:14.221735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-44ac747f-6c2d-442a-8029-2a9fb87a092d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eabe2a2d3164f168cfaf69623ffe96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6ce11f1034a36b533ebc223be834a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:14.233147 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-44ac747f-6c2d-442a-8029-2a9fb87a092d tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b" status: 200 len: 1338 microversion: 2.1 time: 0.946476 Jul 19 22:25:14.234855 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 34/87] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:13 2022] GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b => generated 1338 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:14.436320 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f3761f9d-9d04-49ba-9dfe-7e2a230f2d5c tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:14.454861 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f3761f9d-9d04-49ba-9dfe-7e2a230f2d5c tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a" status: 200 len: 1342 microversion: 2.1 time: 0.950037 Jul 19 22:25:14.458355 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 54/88] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:13 2022] GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a => generated 1342 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:15.101246 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2a725d1a-3ae5-4f98-b808-d76b7327a76c tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Calling method '.version_select at 0x7f7a10f510d0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:15.102397 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:15.102397 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:15.103738 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2a725d1a-3ae5-4f98-b808-d76b7327a76c tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:15.104229 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2a725d1a-3ae5-4f98-b808-d76b7327a76c tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:15.126425 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2a725d1a-3ae5-4f98-b808-d76b7327a76c tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:15.127693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2a725d1a-3ae5-4f98-b808-d76b7327a76c tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:15.129393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c5eb3866-0aa9-466c-afe2-1edc3364ccf7 tempest-InstanceUsageAuditLogNegativeTestJSON-1756709534 tempest-InstanceUsageAuditLogNegativeTestJSON-1756709534-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:15.130834 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:15.130834 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:15.138275 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-c5eb3866-0aa9-466c-afe2-1edc3364ccf7 tempest-InstanceUsageAuditLogNegativeTestJSON-1756709534 tempest-InstanceUsageAuditLogNegativeTestJSON-1756709534-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 19 22:25:15.145195 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2a725d1a-3ae5-4f98-b808-d76b7327a76c tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:15.145902 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2a725d1a-3ae5-4f98-b808-d76b7327a76c tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:15.148437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c5eb3866-0aa9-466c-afe2-1edc3364ccf7 tempest-InstanceUsageAuditLogNegativeTestJSON-1756709534 tempest-InstanceUsageAuditLogNegativeTestJSON-1756709534-project-admin] Request method failure captured: Jul 19 22:25:15.148437 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 19 22:25:15.148437 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:25:15.148437 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:25:15.148437 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:25:15.148437 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:25:15.148437 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:25:15.148437 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:25:15.148437 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:25:15.148437 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:15.148437 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y9KdJv8QBhcby-O1Jy51gmGUXa2jGUmplG9CNBmi091yFRdNR1h-2kaCw8soJfa6t328iZ7WYbat4LwjFvmiJB-mNQHRGdHKluOCvMmCwVILQsy3jMnM-rxRHdLKNFtACQwt-I6RINKQ7lmtQv8kcnRC4c8LMjiEOdUtLnqcpNg9Ow Jul 19 22:25:15.148437 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:25:15.148437 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:25:15.148437 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:25:15.148437 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:25:15.148437 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:25:15.148437 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:25:15.148437 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 43f04d9fd3fe4198bad077f7d0c4eaba Jul 19 22:25:15.148437 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1756709534 Jul 19 22:25:15.148437 n-d-847009-3 devstack@n-api.service[119338]: X-Role: admin,member,reader Jul 19 22:25:15.148437 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: admin,member,reader Jul 19 22:25:15.149586 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_43f04d9fd3fe4198bad077f7d0c4eaba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/43f04d9fd3fe4198bad077f7d0c4eaba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/43f04d9fd3fe4198bad077f7d0c4eaba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/43f04d9fd3fe4198bad077f7d0c4eaba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:15.149586 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1756709534 Jul 19 22:25:15.149586 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 43f04d9fd3fe4198bad077f7d0c4eaba Jul 19 22:25:15.149586 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1756709534 Jul 19 22:25:15.149586 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1756709534-project-admin Jul 19 22:25:15.149586 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:25:15.149586 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:25:15.149586 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 69f33d6bdeb54a2cb2042fcfc958fb96 Jul 19 22:25:15.149586 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1756709534-project-admin Jul 19 22:25:15.149586 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:25:15.149586 n-d-847009-3 devstack@n-api.service[119338]: exception: Invalid timestamp for date invalid_time Jul 19 22:25:15.150221 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'invalid_time'} Jul 19 22:25:15.150221 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:15.150221 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:15.150221 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 19 22:25:15.150221 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 19 22:25:15.150221 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 19 22:25:15.150221 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 19 22:25:15.150221 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 19 22:25:15.150221 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 19 22:25:15.150221 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 19 22:25:15.150221 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:15.150221 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:15.150221 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:15.150221 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:15.150221 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:15.150221 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:15.150221 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:15.150221 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:15.150221 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:15.150221 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:15.151755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 19 22:25:15.151755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 19 22:25:15.151755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 19 22:25:15.151755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:15.151755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:15.151755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:15.151755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:15.151755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:15.151755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:15.151755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:25:15.151755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:25:15.151755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 19 22:25:15.151755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:15.157006 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c5eb3866-0aa9-466c-afe2-1edc3364ccf7 tempest-InstanceUsageAuditLogNegativeTestJSON-1756709534 tempest-InstanceUsageAuditLogNegativeTestJSON-1756709534-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:15.158844 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c5eb3866-0aa9-466c-afe2-1edc3364ccf7 tempest-InstanceUsageAuditLogNegativeTestJSON-1756709534 tempest-InstanceUsageAuditLogNegativeTestJSON-1756709534-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.668108 Jul 19 22:25:15.162186 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 35/89] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 22:25:14 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 673 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 22:25:15.171181 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2a725d1a-3ae5-4f98-b808-d76b7327a76c tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.184907 Jul 19 22:25:15.172995 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 55/90] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:25:14 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:15.188047 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-508c49ae-ab65-40f4-bd21-b210286e35f9 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Calling method '.version_select at 0x7f7a12ca7f70>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:15.188858 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:15.188858 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:15.190798 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-508c49ae-ab65-40f4-bd21-b210286e35f9 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:15.191432 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-508c49ae-ab65-40f4-bd21-b210286e35f9 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:15.198538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=12 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:15.208981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-508c49ae-ab65-40f4-bd21-b210286e35f9 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:15.209442 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-508c49ae-ab65-40f4-bd21-b210286e35f9 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:15.229301 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-508c49ae-ab65-40f4-bd21-b210286e35f9 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:15.229760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-508c49ae-ab65-40f4-bd21-b210286e35f9 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:15.239937 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-508c49ae-ab65-40f4-bd21-b210286e35f9 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.055612 Jul 19 22:25:15.240557 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 56/91] 10.222.0.25 () {58 vars in 1166 bytes} [Tue Jul 19 22:25:15 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:25:15.256746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2aecf88f-5b51-42e2-9b56-4876fc4beaf0 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:15.257653 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2aecf88f-5b51-42e2-9b56-4876fc4beaf0 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] [instance: e1dfa154-2d44-47cb-8e04-3c45c04cd96b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:15.274730 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2aecf88f-5b51-42e2-9b56-4876fc4beaf0 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:15.275495 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2aecf88f-5b51-42e2-9b56-4876fc4beaf0 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:15.276432 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2aecf88f-5b51-42e2-9b56-4876fc4beaf0 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:15.277012 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2aecf88f-5b51-42e2-9b56-4876fc4beaf0 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:15.411708 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-14825ba3-5627-4eed-bc2b-eaf751aa77ab tempest-InstanceUsageAuditLogNegativeTestJSON-684470350 tempest-InstanceUsageAuditLogNegativeTestJSON-684470350-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:15.412452 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:15.412452 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:15.413679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-14825ba3-5627-4eed-bc2b-eaf751aa77ab tempest-InstanceUsageAuditLogNegativeTestJSON-684470350 tempest-InstanceUsageAuditLogNegativeTestJSON-684470350-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '40da52289c66465ba39c8513c86e48ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3411066710d417b846e1d28a8e4dad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:15.415182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-14825ba3-5627-4eed-bc2b-eaf751aa77ab tempest-InstanceUsageAuditLogNegativeTestJSON-684470350 tempest-InstanceUsageAuditLogNegativeTestJSON-684470350-project] Request method failure captured: Jul 19 22:25:15.415182 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 19 22:25:15.415182 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:25:15.415182 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:25:15.415182 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:25:15.415182 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:25:15.415182 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:25:15.415182 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:25:15.415182 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:25:15.415182 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:15.415182 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y9GEr467FceyHTgDxByzVU6ole5P-XlZBe85qgBm5rAOm-OhjcjFkEiW_2gkO0sNvbcYW-vRbJSkwVjW-i4vZlC2Ohj_k36WW0rT7ppaL9VI_Rx6ocP0oiiHhIPP5UEX9J3QPJSH8-pg_To0hp2L34sZcKRWRNWuLcy5_P_foHqY0I Jul 19 22:25:15.415182 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:25:15.415182 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:25:15.415182 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:25:15.415182 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:25:15.415182 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:25:15.415182 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:25:15.415182 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: f3411066710d417b846e1d28a8e4dad7 Jul 19 22:25:15.415182 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-684470350 Jul 19 22:25:15.415182 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:25:15.415182 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:25:15.416550 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f3411066710d417b846e1d28a8e4dad7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3411066710d417b846e1d28a8e4dad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f3411066710d417b846e1d28a8e4dad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3411066710d417b846e1d28a8e4dad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:15.416550 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-684470350 Jul 19 22:25:15.416550 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: f3411066710d417b846e1d28a8e4dad7 Jul 19 22:25:15.416550 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-684470350 Jul 19 22:25:15.416550 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-684470350-project Jul 19 22:25:15.416550 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:25:15.416550 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:25:15.416550 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 40da52289c66465ba39c8513c86e48ca Jul 19 22:25:15.416550 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-684470350-project Jul 19 22:25:15.416550 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:25:15.416550 n-d-847009-3 devstack@n-api.service[119338]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 19 22:25:15.417241 n-d-847009-3 devstack@n-api.service[119338]: action_args: {} Jul 19 22:25:15.417241 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:15.417241 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:15.417241 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:15.417241 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:15.417241 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:15.417241 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:15.417241 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:15.417241 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:15.417241 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 19 22:25:15.417241 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 19 22:25:15.417241 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:25:15.417241 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:25:15.417241 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:25:15.417241 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:25:15.417241 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:25:15.417241 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:25:15.417241 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:25:15.417241 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:25:15.417241 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:25:15.418251 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:25:15.418251 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:25:15.418251 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:25:15.418251 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:25:15.418251 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:25:15.418251 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 19 22:25:15.418251 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:15.418251 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:15.418251 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:15.418251 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:15.418251 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:15.418251 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:15.418251 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:25:15.418251 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:25:15.418251 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 19 22:25:15.418251 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:15.418251 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-14825ba3-5627-4eed-bc2b-eaf751aa77ab tempest-InstanceUsageAuditLogNegativeTestJSON-684470350 tempest-InstanceUsageAuditLogNegativeTestJSON-684470350-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:15.419939 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-14825ba3-5627-4eed-bc2b-eaf751aa77ab tempest-InstanceUsageAuditLogNegativeTestJSON-684470350 tempest-InstanceUsageAuditLogNegativeTestJSON-684470350-project] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.246904 Jul 19 22:25:15.421598 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 36/92] 10.222.0.25 () {58 vars in 1184 bytes} [Tue Jul 19 22:25:15 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 252 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:25:15.427518 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-15595a47-f138-4607-8f35-35186a7920f8 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Calling method '.version_select at 0x7f7a110c6d30>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:15.428335 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:15.428335 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:15.429537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-15595a47-f138-4607-8f35-35186a7920f8 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:15.429988 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-15595a47-f138-4607-8f35-35186a7920f8 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:15.477351 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-15595a47-f138-4607-8f35-35186a7920f8 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:15.477811 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-15595a47-f138-4607-8f35-35186a7920f8 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:15.490734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-15595a47-f138-4607-8f35-35186a7920f8 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:15.491220 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-15595a47-f138-4607-8f35-35186a7920f8 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:15.497776 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-15595a47-f138-4607-8f35-35186a7920f8 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.074512 Jul 19 22:25:15.503055 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 37/93] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:25:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:15.504566 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e7a8a299-c059-4468-b10f-81f6be64cbb3 tempest-InstanceUsageAuditLogNegativeTestJSON-684470350 tempest-InstanceUsageAuditLogNegativeTestJSON-684470350-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:15.505365 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:15.505365 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:15.506481 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e7a8a299-c059-4468-b10f-81f6be64cbb3 tempest-InstanceUsageAuditLogNegativeTestJSON-684470350 tempest-InstanceUsageAuditLogNegativeTestJSON-684470350-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '40da52289c66465ba39c8513c86e48ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3411066710d417b846e1d28a8e4dad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:15.508184 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e7a8a299-c059-4468-b10f-81f6be64cbb3 tempest-InstanceUsageAuditLogNegativeTestJSON-684470350 tempest-InstanceUsageAuditLogNegativeTestJSON-684470350-project] Request method failure captured: Jul 19 22:25:15.508184 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-19%2022:25:15 HTTP/1.1 Jul 19 22:25:15.508184 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:25:15.508184 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:25:15.508184 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:25:15.508184 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:25:15.508184 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:25:15.508184 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:25:15.508184 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:25:15.508184 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:15.508184 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y9GEr467FceyHTgDxByzVU6ole5P-XlZBe85qgBm5rAOm-OhjcjFkEiW_2gkO0sNvbcYW-vRbJSkwVjW-i4vZlC2Ohj_k36WW0rT7ppaL9VI_Rx6ocP0oiiHhIPP5UEX9J3QPJSH8-pg_To0hp2L34sZcKRWRNWuLcy5_P_foHqY0I Jul 19 22:25:15.508184 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:25:15.508184 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:25:15.508184 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:25:15.508184 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:25:15.508184 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:25:15.508184 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:25:15.508184 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: f3411066710d417b846e1d28a8e4dad7 Jul 19 22:25:15.508184 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-684470350 Jul 19 22:25:15.508184 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:25:15.508184 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:25:15.509324 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f3411066710d417b846e1d28a8e4dad7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3411066710d417b846e1d28a8e4dad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f3411066710d417b846e1d28a8e4dad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3411066710d417b846e1d28a8e4dad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:15.509324 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-684470350 Jul 19 22:25:15.509324 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: f3411066710d417b846e1d28a8e4dad7 Jul 19 22:25:15.509324 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-684470350 Jul 19 22:25:15.509324 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-684470350-project Jul 19 22:25:15.509324 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:25:15.509324 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:25:15.509324 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 40da52289c66465ba39c8513c86e48ca Jul 19 22:25:15.509324 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-684470350-project Jul 19 22:25:15.509324 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:25:15.509324 n-d-847009-3 devstack@n-api.service[119338]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 19 22:25:15.509970 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '2022-07-19 22:25:15'} Jul 19 22:25:15.509970 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:15.509970 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:15.509970 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:15.509970 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:15.509970 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:15.509970 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:15.509970 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:15.509970 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:15.509970 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 19 22:25:15.509970 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 19 22:25:15.509970 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:25:15.509970 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:25:15.509970 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:25:15.509970 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:25:15.509970 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:25:15.509970 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:25:15.509970 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:25:15.509970 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:25:15.509970 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:25:15.511003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:25:15.511003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:25:15.511003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:25:15.511003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:25:15.511003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:25:15.511003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 19 22:25:15.511003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:15.511003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:15.511003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:15.511003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:15.511003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:15.511003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:15.511003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:25:15.511003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:25:15.511003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 19 22:25:15.511003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:15.511003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e7a8a299-c059-4468-b10f-81f6be64cbb3 tempest-InstanceUsageAuditLogNegativeTestJSON-684470350 tempest-InstanceUsageAuditLogNegativeTestJSON-684470350-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:15.511958 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e7a8a299-c059-4468-b10f-81f6be64cbb3 tempest-InstanceUsageAuditLogNegativeTestJSON-684470350 tempest-InstanceUsageAuditLogNegativeTestJSON-684470350-project] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-19 22:25:15" status: 403 len: 128 microversion: 2.1 time: 0.009820 Jul 19 22:25:15.515580 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 38/94] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 19 22:25:15 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-19%2022%3A25%3A15 => generated 128 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:25:15.521492 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-21ff5969-05f0-4230-9e1b-b789c169d277 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:15.522119 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-21ff5969-05f0-4230-9e1b-b789c169d277 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:15.528816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-21ff5969-05f0-4230-9e1b-b789c169d277 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:15.529280 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-21ff5969-05f0-4230-9e1b-b789c169d277 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:15.530054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-21ff5969-05f0-4230-9e1b-b789c169d277 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:15.530493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-21ff5969-05f0-4230-9e1b-b789c169d277 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:16.030518 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2aecf88f-5b51-42e2-9b56-4876fc4beaf0 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eabe2a2d3164f168cfaf69623ffe96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6ce11f1034a36b533ebc223be834a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:16.043130 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2aecf88f-5b51-42e2-9b56-4876fc4beaf0 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b" status: 200 len: 1338 microversion: 2.1 time: 0.791320 Jul 19 22:25:16.045869 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 57/95] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:15 2022] GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b => generated 1338 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:16.062710 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-35002ed6-1524-41b9-aec4-6c726b3c3e49 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Calling method '.version_select at 0x7f7a10faa430>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:16.068268 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:16.068268 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:16.074686 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-35002ed6-1524-41b9-aec4-6c726b3c3e49 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:16.077759 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-35002ed6-1524-41b9-aec4-6c726b3c3e49 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:16.122907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:DELETE=8,nova_api:SELECT=79,nova_api:INSERT=5,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:16.131528 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-35002ed6-1524-41b9-aec4-6c726b3c3e49 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:16.132257 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-35002ed6-1524-41b9-aec4-6c726b3c3e49 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:16.151948 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-35002ed6-1524-41b9-aec4-6c726b3c3e49 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.098655 Jul 19 22:25:16.160435 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 58/96] 10.222.0.25 () {58 vars in 1151 bytes} [Tue Jul 19 22:25:16 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:16.167141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d220d306-c95e-4ea4-879f-8ecbab8b4cbc tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Calling method '.version_select at 0x7f7a10faa940>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:16.178036 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:16.178036 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:16.179964 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d220d306-c95e-4ea4-879f-8ecbab8b4cbc tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:16.180523 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d220d306-c95e-4ea4-879f-8ecbab8b4cbc tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:16.218335 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d220d306-c95e-4ea4-879f-8ecbab8b4cbc tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.055394 Jul 19 22:25:16.219417 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 59/97] 10.222.0.25 () {58 vars in 1178 bytes} [Tue Jul 19 22:25:16 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:16.231893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fc5676a5-154b-4617-bdc5-74be0a7a1c82 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Calling method '.version_select at 0x7f7a10f3cee0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:16.233110 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:16.233110 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:16.234743 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc5676a5-154b-4617-bdc5-74be0a7a1c82 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:16.239787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc5676a5-154b-4617-bdc5-74be0a7a1c82 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:16.275683 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc5676a5-154b-4617-bdc5-74be0a7a1c82 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:16.275683 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc5676a5-154b-4617-bdc5-74be0a7a1c82 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:16.293506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-21ff5969-05f0-4230-9e1b-b789c169d277 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:16.302393 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc5676a5-154b-4617-bdc5-74be0a7a1c82 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:16.303809 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc5676a5-154b-4617-bdc5-74be0a7a1c82 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:16.310224 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-21ff5969-05f0-4230-9e1b-b789c169d277 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a" status: 200 len: 1342 microversion: 2.1 time: 0.793044 Jul 19 22:25:16.312462 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 39/98] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:15 2022] GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a => generated 1342 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:16.318272 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fc5676a5-154b-4617-bdc5-74be0a7a1c82 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.090365 Jul 19 22:25:16.320293 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 60/99] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:25:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:25:16.331265 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e1ba1509-dbf1-42ef-893e-40600e3546c8 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Calling method '.version_select at 0x7f7a11109940>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:16.337684 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:16.337684 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:16.340464 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1ba1509-dbf1-42ef-893e-40600e3546c8 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:16.341477 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1ba1509-dbf1-42ef-893e-40600e3546c8 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:16.376776 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1ba1509-dbf1-42ef-893e-40600e3546c8 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:16.381174 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1ba1509-dbf1-42ef-893e-40600e3546c8 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:16.384779 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:16.405859 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e1ba1509-dbf1-42ef-893e-40600e3546c8 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.077771 Jul 19 22:25:16.408004 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 40/100] 10.222.0.25 () {58 vars in 1151 bytes} [Tue Jul 19 22:25:16 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:16.419918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1973c700-e4d4-4809-9a40-9811fb5c551a tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Calling method '.version_select at 0x7f7a10faaa60>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:16.420792 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:16.420792 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:16.422393 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1973c700-e4d4-4809-9a40-9811fb5c551a tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:16.423037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1973c700-e4d4-4809-9a40-9811fb5c551a tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:16.463339 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1973c700-e4d4-4809-9a40-9811fb5c551a tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:16.463804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1973c700-e4d4-4809-9a40-9811fb5c551a tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:16.489270 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1973c700-e4d4-4809-9a40-9811fb5c551a tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.073289 Jul 19 22:25:16.489908 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 61/101] 10.222.0.25 () {58 vars in 1151 bytes} [Tue Jul 19 22:25:16 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:16.501672 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-194c71a4-0831-47a6-8b81-d79318c7e738 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Calling method '.version_select at 0x7f7a11109160>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:16.503068 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:16.503068 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:16.504686 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-194c71a4-0831-47a6-8b81-d79318c7e738 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:16.505145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-194c71a4-0831-47a6-8b81-d79318c7e738 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:16.536465 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-194c71a4-0831-47a6-8b81-d79318c7e738 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:16.536935 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-194c71a4-0831-47a6-8b81-d79318c7e738 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:16.567785 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-194c71a4-0831-47a6-8b81-d79318c7e738 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:16.568255 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-194c71a4-0831-47a6-8b81-d79318c7e738 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:16.679668 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-194c71a4-0831-47a6-8b81-d79318c7e738 tempest-HypervisorAdminTestJSON-1129171522 tempest-HypervisorAdminTestJSON-1129171522-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.180763 Jul 19 22:25:16.680979 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 41/102] 10.222.0.25 () {58 vars in 1172 bytes} [Tue Jul 19 22:25:16 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:25:17.062667 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d3b3ba66-a694-4593-bd6c-a4d5cf23965f tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:17.063489 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d3b3ba66-a694-4593-bd6c-a4d5cf23965f tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] [instance: e1dfa154-2d44-47cb-8e04-3c45c04cd96b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:17.083354 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3b3ba66-a694-4593-bd6c-a4d5cf23965f tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:17.083822 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3b3ba66-a694-4593-bd6c-a4d5cf23965f tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:17.086037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3b3ba66-a694-4593-bd6c-a4d5cf23965f tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:17.088668 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3b3ba66-a694-4593-bd6c-a4d5cf23965f tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:17.113289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-005ff3ce-4db6-4d01-b448-9013e279e171 req-2cd98408-7ea6-4e6c-944e-a66b86cda117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1dfa154-2d44-47cb-8e04-3c45c04cd96b", "tag": "b2c0b4f7-8344-4a9f-b2f6-0fa372d569b8"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:17.142843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-005ff3ce-4db6-4d01-b448-9013e279e171 req-2cd98408-7ea6-4e6c-944e-a66b86cda117 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:17.144531 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-005ff3ce-4db6-4d01-b448-9013e279e171 req-2cd98408-7ea6-4e6c-944e-a66b86cda117 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:17.197971 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-005ff3ce-4db6-4d01-b448-9013e279e171 req-2cd98408-7ea6-4e6c-944e-a66b86cda117 service nova] Creating event network-changed:b2c0b4f7-8344-4a9f-b2f6-0fa372d569b8 for instance e1dfa154-2d44-47cb-8e04-3c45c04cd96b on n-h2-847009-3 Jul 19 22:25:17.201303 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-005ff3ce-4db6-4d01-b448-9013e279e171 req-2cd98408-7ea6-4e6c-944e-a66b86cda117 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119337) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 22:25:17.202756 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4bd684c0-ca15-4967-8e88-038dc966a5e2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:17.211775 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4bd684c0-ca15-4967-8e88-038dc966a5e2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:17.212821 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4bd684c0-ca15-4967-8e88-038dc966a5e2 None None] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:17.213282 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4bd684c0-ca15-4967-8e88-038dc966a5e2 None None] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:17.222760 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.compute.rpcapi [None req-4bd684c0-ca15-4967-8e88-038dc966a5e2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 19 22:25:17.234879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4bd684c0-ca15-4967-8e88-038dc966a5e2 None None] Releasing lock "compute-rpcapi-router" {{(pid=119337) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 22:25:17.263718 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4bd684c0-ca15-4967-8e88-038dc966a5e2 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.336178 Jul 19 22:25:17.264679 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 62/103] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:17.330894 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-18e8a6fd-46f9-401a-9469-5306f08b2782 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:17.331953 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-18e8a6fd-46f9-401a-9469-5306f08b2782 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:17.348748 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-18e8a6fd-46f9-401a-9469-5306f08b2782 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:17.352321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-18e8a6fd-46f9-401a-9469-5306f08b2782 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:17.353469 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-18e8a6fd-46f9-401a-9469-5306f08b2782 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:17.354357 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-18e8a6fd-46f9-401a-9469-5306f08b2782 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:17.720359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d3b3ba66-a694-4593-bd6c-a4d5cf23965f tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eabe2a2d3164f168cfaf69623ffe96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6ce11f1034a36b533ebc223be834a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:17.741434 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d3b3ba66-a694-4593-bd6c-a4d5cf23965f tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b" status: 200 len: 1338 microversion: 2.1 time: 0.683106 Jul 19 22:25:17.753532 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 42/104] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:17 2022] GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b => generated 1338 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:25:17.911196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-18e8a6fd-46f9-401a-9469-5306f08b2782 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:17.929123 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-18e8a6fd-46f9-401a-9469-5306f08b2782 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a" status: 200 len: 1342 microversion: 2.1 time: 0.600466 Jul 19 22:25:17.932544 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 63/105] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:17 2022] GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a => generated 1342 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:25:18.761489 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fd3813fc-4de3-4e50-a0b3-b66eafbd8d1f tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:18.762292 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fd3813fc-4de3-4e50-a0b3-b66eafbd8d1f tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] [instance: e1dfa154-2d44-47cb-8e04-3c45c04cd96b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:18.804276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd3813fc-4de3-4e50-a0b3-b66eafbd8d1f tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:18.805591 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd3813fc-4de3-4e50-a0b3-b66eafbd8d1f tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:18.810270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd3813fc-4de3-4e50-a0b3-b66eafbd8d1f tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:18.812208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd3813fc-4de3-4e50-a0b3-b66eafbd8d1f tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:18.950339 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d7fbefed-ee6f-4ab0-aa29-eb7550b660ae tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:18.953451 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d7fbefed-ee6f-4ab0-aa29-eb7550b660ae tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:18.983468 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d7fbefed-ee6f-4ab0-aa29-eb7550b660ae tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:18.984538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d7fbefed-ee6f-4ab0-aa29-eb7550b660ae tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:18.985745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d7fbefed-ee6f-4ab0-aa29-eb7550b660ae tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:18.987035 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d7fbefed-ee6f-4ab0-aa29-eb7550b660ae tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:19.031247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:19.629258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d7fbefed-ee6f-4ab0-aa29-eb7550b660ae tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:19.642284 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d7fbefed-ee6f-4ab0-aa29-eb7550b660ae tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a" status: 200 len: 1342 microversion: 2.1 time: 0.694472 Jul 19 22:25:19.644674 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=12 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:19.645098 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 64/106] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:18 2022] GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a => generated 1342 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:19.715923 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fd3813fc-4de3-4e50-a0b3-b66eafbd8d1f tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eabe2a2d3164f168cfaf69623ffe96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6ce11f1034a36b533ebc223be834a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:19.724448 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fd3813fc-4de3-4e50-a0b3-b66eafbd8d1f tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b" status: 200 len: 1338 microversion: 2.1 time: 0.968375 Jul 19 22:25:19.725164 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 43/107] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:18 2022] GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b => generated 1338 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:20.151209 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e1cc80af-5aa4-443d-9097-af094e34e001 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:20.165717 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e1cc80af-5aa4-443d-9097-af094e34e001 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.519301 Jul 19 22:25:20.166777 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 65/108] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:25:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:20.474356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4d26f42d-f02d-4ba3-9ca5-3341513a06be tempest-NetworksTest-118858738 tempest-NetworksTest-118858738-project-admin] Calling method '.version_select at 0x7f7a11109b80>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:20.625990 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3b9acdcd-3946-4929-8045-e449f04f7efb tempest-ServersWithSpecificFlavorTestJSON-467401142 tempest-ServersWithSpecificFlavorTestJSON-467401142-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-980005152", "id": 1091004659, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:20.628660 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:20.628660 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:20.673144 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4d26f42d-f02d-4ba3-9ca5-3341513a06be tempest-NetworksTest-118858738 tempest-NetworksTest-118858738-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks" status: 200 len: 3328 microversion: 2.1 time: 0.837151 Jul 19 22:25:20.673842 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 44/109] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:25:19 2022] GET /compute/v2.1/os-networks => generated 3328 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:20.680262 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ad214c37-deca-4496-b3c3-033a6be115b1 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:20.680902 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ad214c37-deca-4496-b3c3-033a6be115b1 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:20.688027 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3b9acdcd-3946-4929-8045-e449f04f7efb tempest-ServersWithSpecificFlavorTestJSON-467401142 tempest-ServersWithSpecificFlavorTestJSON-467401142-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.507423 Jul 19 22:25:20.690581 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad214c37-deca-4496-b3c3-033a6be115b1 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:20.691795 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad214c37-deca-4496-b3c3-033a6be115b1 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:20.693860 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad214c37-deca-4496-b3c3-033a6be115b1 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:20.695005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad214c37-deca-4496-b3c3-033a6be115b1 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:20.698749 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 66/110] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:25:20 2022] POST /compute/v2.1/flavors => generated 424 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:20.706024 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-027beb97-bf00-46f3-b4d1-08309708a5f8 tempest-NetworksTest-118858738 tempest-NetworksTest-118858738-project-admin] Calling method '.version_select at 0x7f7a10f31c10>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:20.922576 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-027beb97-bf00-46f3-b4d1-08309708a5f8 tempest-NetworksTest-118858738 tempest-NetworksTest-118858738-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks/43456dc5-a081-4e58-9850-97923d9b3e3e" status: 200 len: 652 microversion: 2.1 time: 0.221723 Jul 19 22:25:20.923248 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 67/111] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 19 22:25:20 2022] GET /compute/v2.1/os-networks/43456dc5-a081-4e58-9850-97923d9b3e3e => generated 652 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:20.929034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-be0b1fc6-8df7-4639-ab54-8aa7b3421aa7 tempest-ServersWithSpecificFlavorTestJSON-467401142 tempest-ServersWithSpecificFlavorTestJSON-467401142-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:20.950442 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-be0b1fc6-8df7-4639-ab54-8aa7b3421aa7 tempest-ServersWithSpecificFlavorTestJSON-467401142 tempest-ServersWithSpecificFlavorTestJSON-467401142-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025951 Jul 19 22:25:20.951026 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 68/112] 10.222.0.25 () {58 vars in 1181 bytes} [Tue Jul 19 22:25:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:25:20.971099 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ad214c37-deca-4496-b3c3-033a6be115b1 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:20.972444 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3327d91d-5712-4fc7-8372-4d290638d3d8 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:20.973104 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3327d91d-5712-4fc7-8372-4d290638d3d8 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] [instance: e1dfa154-2d44-47cb-8e04-3c45c04cd96b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:20.981907 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ad214c37-deca-4496-b3c3-033a6be115b1 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a" status: 200 len: 1342 microversion: 2.1 time: 0.306607 Jul 19 22:25:20.982992 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 45/113] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:20 2022] GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a => generated 1342 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:20.992718 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3327d91d-5712-4fc7-8372-4d290638d3d8 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:20.993006 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5c56ce3d-fb40-49ec-b6d2-0a6d57018920 tempest-NetworksTest-118858738 tempest-NetworksTest-118858738-project-admin] Calling method '.version_select at 0x7f7a1106bb80>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:20.993105 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3327d91d-5712-4fc7-8372-4d290638d3d8 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:20.993105 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3327d91d-5712-4fc7-8372-4d290638d3d8 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:20.993105 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3327d91d-5712-4fc7-8372-4d290638d3d8 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:21.289314 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3327d91d-5712-4fc7-8372-4d290638d3d8 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eabe2a2d3164f168cfaf69623ffe96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6ce11f1034a36b533ebc223be834a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:21.293488 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5c56ce3d-fb40-49ec-b6d2-0a6d57018920 tempest-NetworksTest-118858738 tempest-NetworksTest-118858738-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks" status: 200 len: 3328 microversion: 2.1 time: 0.309069 Jul 19 22:25:21.294734 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 46/114] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:25:20 2022] GET /compute/v2.1/os-networks => generated 3328 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:21.303339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-89d2b1ef-0910-4622-8d66-87a503914ca5 tempest-ServersWithSpecificFlavorTestJSON-467401142 tempest-ServersWithSpecificFlavorTestJSON-467401142-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1656631428", "id": 308599732, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:21.304050 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3327d91d-5712-4fc7-8372-4d290638d3d8 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b" status: 200 len: 1338 microversion: 2.1 time: 0.337706 Jul 19 22:25:21.306612 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 69/115] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:20 2022] GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b => generated 1338 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:21.306935 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:21.306935 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:21.332695 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-89d2b1ef-0910-4622-8d66-87a503914ca5 tempest-ServersWithSpecificFlavorTestJSON-467401142 tempest-ServersWithSpecificFlavorTestJSON-467401142-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.036705 Jul 19 22:25:21.334037 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 47/116] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:25:21 2022] POST /compute/v2.1/flavors => generated 422 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:21.344819 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4af4005a-70d3-4017-a573-9ea29c3374f3 tempest-ServersWithSpecificFlavorTestJSON-467401142 tempest-ServersWithSpecificFlavorTestJSON-467401142-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:21.357976 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4af4005a-70d3-4017-a573-9ea29c3374f3 tempest-ServersWithSpecificFlavorTestJSON-467401142 tempest-ServersWithSpecificFlavorTestJSON-467401142-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016860 Jul 19 22:25:21.366015 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 70/117] 10.222.0.25 () {58 vars in 1181 bytes} [Tue Jul 19 22:25:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:25:21.375256 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-79012374-cd36-42b8-b785-c558cfe39692 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Action: 'create', calling method: .version_select at 0x7f7a11133dc0>, body: {"keypair": {"name": "tempest-keypair-750221889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgF43m8EETiFElyOGoXfJAxkJmqPE7ibBKqgkY+e5C4ZqgD+itLw748m7JGBWgKfhmCOP9RcE3vv7Dz2yUQbJJ3b4+LBGJwou5Sg6w8W12yX1N+l1HUQdVY5ub4U2nDEA=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:21.410391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-79012374-cd36-42b8-b785-c558cfe39692 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Getting quotas for project dbc98e9ff0b84256bf722b6ca82f76c1. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:25:21.416255 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-79012374-cd36-42b8-b785-c558cfe39692 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Getting quotas for user d9580b63c415471a8faa6b536f9c44fb and project dbc98e9ff0b84256bf722b6ca82f76c1. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:25:21.451815 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-79012374-cd36-42b8-b785-c558cfe39692 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.080995 Jul 19 22:25:21.460371 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 48/118] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:25:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:22.002875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cd23070d-2691-49ae-b127-8360223ef352 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:22.003981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cd23070d-2691-49ae-b127-8360223ef352 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:22.017246 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd23070d-2691-49ae-b127-8360223ef352 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:22.020169 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd23070d-2691-49ae-b127-8360223ef352 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:22.021531 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd23070d-2691-49ae-b127-8360223ef352 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:22.021943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd23070d-2691-49ae-b127-8360223ef352 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:22.324319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-43a00c02-c18f-43bf-8bd4-070bebba9311 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:22.325700 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-43a00c02-c18f-43bf-8bd4-070bebba9311 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] [instance: e1dfa154-2d44-47cb-8e04-3c45c04cd96b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:22.340223 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43a00c02-c18f-43bf-8bd4-070bebba9311 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:22.340676 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43a00c02-c18f-43bf-8bd4-070bebba9311 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:22.341472 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43a00c02-c18f-43bf-8bd4-070bebba9311 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:22.351643 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43a00c02-c18f-43bf-8bd4-070bebba9311 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:22.412758 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cd23070d-2691-49ae-b127-8360223ef352 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:22.431996 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cd23070d-2691-49ae-b127-8360223ef352 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a" status: 200 len: 1342 microversion: 2.1 time: 0.433249 Jul 19 22:25:22.444054 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 71/119] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:21 2022] GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a => generated 1342 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:22.706510 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-43a00c02-c18f-43bf-8bd4-070bebba9311 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eabe2a2d3164f168cfaf69623ffe96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6ce11f1034a36b533ebc223be834a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:22.717230 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-43a00c02-c18f-43bf-8bd4-070bebba9311 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b" status: 200 len: 1338 microversion: 2.1 time: 0.397650 Jul 19 22:25:22.718306 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 49/120] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:22 2022] GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b => generated 1338 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:25:23.010784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-09650360-c4c8-4fba-ab45-8d0d40a48f02 req-afcbcfdb-758d-471e-9a9e-631faf4e7940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a", "name": "network-vif-plugged", "status": "completed", "tag": "9d2342e4-4686-4dad-9000-088369a4e47b"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:23.038115 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-09650360-c4c8-4fba-ab45-8d0d40a48f02 req-afcbcfdb-758d-471e-9a9e-631faf4e7940 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:23.038852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-09650360-c4c8-4fba-ab45-8d0d40a48f02 req-afcbcfdb-758d-471e-9a9e-631faf4e7940 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:23.055187 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-09650360-c4c8-4fba-ab45-8d0d40a48f02 req-afcbcfdb-758d-471e-9a9e-631faf4e7940 service nova] Creating event network-vif-plugged:9d2342e4-4686-4dad-9000-088369a4e47b for instance b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a on n-h2-847009-3 Jul 19 22:25:23.070577 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-09650360-c4c8-4fba-ab45-8d0d40a48f02 req-afcbcfdb-758d-471e-9a9e-631faf4e7940 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.549270 Jul 19 22:25:23.071701 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 72/121] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:23.451904 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4f536ca0-bfca-4b56-91d0-f2caa6597a59 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:23.452796 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4f536ca0-bfca-4b56-91d0-f2caa6597a59 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:23.463795 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f536ca0-bfca-4b56-91d0-f2caa6597a59 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:23.470773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f536ca0-bfca-4b56-91d0-f2caa6597a59 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:23.472091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f536ca0-bfca-4b56-91d0-f2caa6597a59 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:23.472690 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f536ca0-bfca-4b56-91d0-f2caa6597a59 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:23.701029 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-62070f4d-b517-4ae2-af7a-2cf6363c251c tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] Calling method '.version_select at 0x7f7a110a00d0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:23.705587 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:23.705587 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:23.708237 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62070f4d-b517-4ae2-af7a-2cf6363c251c tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:23.710271 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62070f4d-b517-4ae2-af7a-2cf6363c251c tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:23.759050 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62070f4d-b517-4ae2-af7a-2cf6363c251c tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:23.765794 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62070f4d-b517-4ae2-af7a-2cf6363c251c tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:23.889629 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4f536ca0-bfca-4b56-91d0-f2caa6597a59 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:23.903719 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4f536ca0-bfca-4b56-91d0-f2caa6597a59 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a" status: 200 len: 1342 microversion: 2.1 time: 0.456859 Jul 19 22:25:23.906776 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 73/122] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:23 2022] GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a => generated 1342 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:23.906944 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62070f4d-b517-4ae2-af7a-2cf6363c251c tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:23.908611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62070f4d-b517-4ae2-af7a-2cf6363c251c tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:23.919446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-72c18a83-ec25-4ed5-bdbe-c426f4b4fb41 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:23.920400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-72c18a83-ec25-4ed5-bdbe-c426f4b4fb41 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] [instance: e1dfa154-2d44-47cb-8e04-3c45c04cd96b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:23.938884 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-72c18a83-ec25-4ed5-bdbe-c426f4b4fb41 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:23.943267 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-72c18a83-ec25-4ed5-bdbe-c426f4b4fb41 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:23.943405 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62070f4d-b517-4ae2-af7a-2cf6363c251c tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:23.943773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62070f4d-b517-4ae2-af7a-2cf6363c251c tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:23.944814 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-72c18a83-ec25-4ed5-bdbe-c426f4b4fb41 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:23.945410 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-72c18a83-ec25-4ed5-bdbe-c426f4b4fb41 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:23.989592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62070f4d-b517-4ae2-af7a-2cf6363c251c tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:23.993136 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62070f4d-b517-4ae2-af7a-2cf6363c251c tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:24.032510 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-62070f4d-b517-4ae2-af7a-2cf6363c251c tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1743 microversion: 2.53 time: 0.958514 Jul 19 22:25:24.035010 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 50/123] 10.222.0.25 () {60 vars in 1242 bytes} [Tue Jul 19 22:25:23 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1743 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:25:24.049169 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-adbb6e9d-a70f-48b1-8b58-e20608bd5bd6 tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] Calling method '.version_select at 0x7f7a11133310>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:24.054074 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:24.054074 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:24.056226 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-adbb6e9d-a70f-48b1-8b58-e20608bd5bd6 tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:24.056879 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-adbb6e9d-a70f-48b1-8b58-e20608bd5bd6 tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:24.119885 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-adbb6e9d-a70f-48b1-8b58-e20608bd5bd6 tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:24.120340 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-adbb6e9d-a70f-48b1-8b58-e20608bd5bd6 tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:24.203303 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-adbb6e9d-a70f-48b1-8b58-e20608bd5bd6 tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:24.207321 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-adbb6e9d-a70f-48b1-8b58-e20608bd5bd6 tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:24.255216 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-adbb6e9d-a70f-48b1-8b58-e20608bd5bd6 tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:24.255905 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-adbb6e9d-a70f-48b1-8b58-e20608bd5bd6 tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:24.275215 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-adbb6e9d-a70f-48b1-8b58-e20608bd5bd6 tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:24.276166 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-adbb6e9d-a70f-48b1-8b58-e20608bd5bd6 tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:24.286342 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-adbb6e9d-a70f-48b1-8b58-e20608bd5bd6 tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 436 microversion: 2.53 time: 0.242410 Jul 19 22:25:24.287898 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 51/124] 10.222.0.25 () {60 vars in 1221 bytes} [Tue Jul 19 22:25:24 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 436 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:25:24.306129 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7cfa8adc-d7f8-4e2f-b6c8-940715686d05 tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] Calling method '.version_select at 0x7f7a11133dc0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:24.308793 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:24.308793 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:24.310681 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7cfa8adc-d7f8-4e2f-b6c8-940715686d05 tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:24.319849 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7cfa8adc-d7f8-4e2f-b6c8-940715686d05 tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:24.349932 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:24.352929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7cfa8adc-d7f8-4e2f-b6c8-940715686d05 tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:24.353582 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7cfa8adc-d7f8-4e2f-b6c8-940715686d05 tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:24.365591 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7cfa8adc-d7f8-4e2f-b6c8-940715686d05 tempest-HypervisorAdminV253TestBase-1996309344 tempest-HypervisorAdminV253TestBase-1996309344-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/61f9b644-6e55-4786-88a0-34454a8d9074" status: 200 len: 792 microversion: 2.53 time: 0.067146 Jul 19 22:25:24.375933 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 52/125] 10.222.0.25 () {60 vars in 1297 bytes} [Tue Jul 19 22:25:24 2022] GET /compute/v2.1/os-hypervisors/61f9b644-6e55-4786-88a0-34454a8d9074 => generated 792 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:25:24.481284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-72c18a83-ec25-4ed5-bdbe-c426f4b4fb41 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eabe2a2d3164f168cfaf69623ffe96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6ce11f1034a36b533ebc223be834a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:24.490755 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-72c18a83-ec25-4ed5-bdbe-c426f4b4fb41 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b" status: 200 len: 1338 microversion: 2.1 time: 0.582557 Jul 19 22:25:24.518763 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 74/126] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:23 2022] GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b => generated 1338 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:24.632073 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8aefdf35-5de3-446b-b4f3-895a620358df tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1955143607", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "308599732", "adminPass": "***", "networks": [{"uuid": "aa474abb-d615-457e-b8f9-e55f1cc03bb6"}], "security_groups": [{"name": "tempest-securitygroup--1089620621"}], "key_name": "tempest-keypair-750221889", "user_data": "}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:24.861047 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-8aefdf35-5de3-446b-b4f3-895a620358df tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] validate_networks() for [('aa474abb-d615-457e-b8f9-e55f1cc03bb6', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:25:24.930830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b2948542-e3e4-41d2-bf45-556335088ff0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:24.933825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b2948542-e3e4-41d2-bf45-556335088ff0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:24.951655 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b2948542-e3e4-41d2-bf45-556335088ff0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:24.954234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b2948542-e3e4-41d2-bf45-556335088ff0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:24.957710 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b2948542-e3e4-41d2-bf45-556335088ff0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:24.959153 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b2948542-e3e4-41d2-bf45-556335088ff0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:25.610769 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b2948542-e3e4-41d2-bf45-556335088ff0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:25.625479 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b2948542-e3e4-41d2-bf45-556335088ff0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a" status: 200 len: 1342 microversion: 2.1 time: 0.705660 Jul 19 22:25:25.626119 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 75/127] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:24 2022] GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a => generated 1342 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:25:25.636397 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-be0c8047-d6dc-4a9f-990a-e7fe6533b306 req-19110da3-0e72-4243-8b2d-50faee7a22ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1dfa154-2d44-47cb-8e04-3c45c04cd96b", "name": "network-vif-plugged", "status": "completed", "tag": "b2c0b4f7-8344-4a9f-b2f6-0fa372d569b8"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:25.650693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-be0c8047-d6dc-4a9f-990a-e7fe6533b306 req-19110da3-0e72-4243-8b2d-50faee7a22ba service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:25.651369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-be0c8047-d6dc-4a9f-990a-e7fe6533b306 req-19110da3-0e72-4243-8b2d-50faee7a22ba service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:25.678161 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-be0c8047-d6dc-4a9f-990a-e7fe6533b306 req-19110da3-0e72-4243-8b2d-50faee7a22ba service nova] Creating event network-vif-plugged:b2c0b4f7-8344-4a9f-b2f6-0fa372d569b8 for instance e1dfa154-2d44-47cb-8e04-3c45c04cd96b on n-h2-847009-3 Jul 19 22:25:25.694497 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-be0c8047-d6dc-4a9f-990a-e7fe6533b306 req-19110da3-0e72-4243-8b2d-50faee7a22ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066380 Jul 19 22:25:25.716672 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 76/128] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:26.385494 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2f44a2e4-af52-4168-8c51-14212c88dd69 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1776338694", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:26.548439 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-2f44a2e4-af52-4168-8c51-14212c88dd69 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] validate_networks() for None {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:25:27.110877 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-8aefdf35-5de3-446b-b4f3-895a620358df tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:25:27.113113 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-8aefdf35-5de3-446b-b4f3-895a620358df tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:25:27.114002 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-8aefdf35-5de3-446b-b4f3-895a620358df tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:25:27.114507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-8aefdf35-5de3-446b-b4f3-895a620358df tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:25:27.116220 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-8aefdf35-5de3-446b-b4f3-895a620358df tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:25:27.130320 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8aefdf35-5de3-446b-b4f3-895a620358df tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:27.131057 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8aefdf35-5de3-446b-b4f3-895a620358df tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:27.137070 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8aefdf35-5de3-446b-b4f3-895a620358df tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:27.137890 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8aefdf35-5de3-446b-b4f3-895a620358df tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:27.164375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-8aefdf35-5de3-446b-b4f3-895a620358df tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Getting quotas for project dbc98e9ff0b84256bf722b6ca82f76c1. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:25:27.169446 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-8aefdf35-5de3-446b-b4f3-895a620358df tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Getting quotas for user d9580b63c415471a8faa6b536f9c44fb and project dbc98e9ff0b84256bf722b6ca82f76c1. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:25:27.185693 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8aefdf35-5de3-446b-b4f3-895a620358df tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:25:27.189131 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8aefdf35-5de3-446b-b4f3-895a620358df tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:25:27.223018 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:27.308775 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-2f44a2e4-af52-4168-8c51-14212c88dd69 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:25:27.309651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-2f44a2e4-af52-4168-8c51-14212c88dd69 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:25:27.310088 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-2f44a2e4-af52-4168-8c51-14212c88dd69 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:25:27.310815 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-2f44a2e4-af52-4168-8c51-14212c88dd69 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:25:27.311461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-2f44a2e4-af52-4168-8c51-14212c88dd69 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:25:27.327478 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2f44a2e4-af52-4168-8c51-14212c88dd69 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:27.328328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2f44a2e4-af52-4168-8c51-14212c88dd69 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:27.329304 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2f44a2e4-af52-4168-8c51-14212c88dd69 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:27.330019 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2f44a2e4-af52-4168-8c51-14212c88dd69 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:27.366698 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-2f44a2e4-af52-4168-8c51-14212c88dd69 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Getting quotas for project eed5e83db4ae4156ae9635b84ca7ff4a. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:25:27.371100 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8aefdf35-5de3-446b-b4f3-895a620358df tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.743766 Jul 19 22:25:27.371692 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-2f44a2e4-af52-4168-8c51-14212c88dd69 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Getting quotas for user e3ef9d4c38d547a1a1532d964195144a and project eed5e83db4ae4156ae9635b84ca7ff4a. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:25:27.382086 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 53/129] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:25:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 2751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:25:27.394808 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2f44a2e4-af52-4168-8c51-14212c88dd69 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:25:27.398020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2f44a2e4-af52-4168-8c51-14212c88dd69 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:25:27.401931 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-de981d44-a864-4792-8ef6-d297be58e758 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:27.402735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-de981d44-a864-4792-8ef6-d297be58e758 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] [instance: e1dfa154-2d44-47cb-8e04-3c45c04cd96b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:27.418465 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de981d44-a864-4792-8ef6-d297be58e758 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:27.419048 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de981d44-a864-4792-8ef6-d297be58e758 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:27.420217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de981d44-a864-4792-8ef6-d297be58e758 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:27.420560 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de981d44-a864-4792-8ef6-d297be58e758 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:27.491753 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2f44a2e4-af52-4168-8c51-14212c88dd69 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.771884 Jul 19 22:25:27.493433 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 77/130] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:25:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:25:27.842100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-de981d44-a864-4792-8ef6-d297be58e758 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eabe2a2d3164f168cfaf69623ffe96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6ce11f1034a36b533ebc223be834a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:27.872059 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-de981d44-a864-4792-8ef6-d297be58e758 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b" status: 200 len: 1338 microversion: 2.1 time: 0.485190 Jul 19 22:25:27.883822 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 54/131] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:27 2022] GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b => generated 1338 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:27.912005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1ed4f90d-b3e5-44b9-adc1-f9692bff08ef tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:27.913379 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1ed4f90d-b3e5-44b9-adc1-f9692bff08ef tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:27.947320 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1ed4f90d-b3e5-44b9-adc1-f9692bff08ef tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:27.947816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1ed4f90d-b3e5-44b9-adc1-f9692bff08ef tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:27.949351 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1ed4f90d-b3e5-44b9-adc1-f9692bff08ef tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:27.950281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ac3fc64f-7d26-40f1-8c8b-2ba62c528470 tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] Calling method '.version_select at 0x7f7a10ee4310>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:27.951100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1ed4f90d-b3e5-44b9-adc1-f9692bff08ef tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:27.952037 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:27.952037 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:27.953850 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac3fc64f-7d26-40f1-8c8b-2ba62c528470 tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:27.954408 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac3fc64f-7d26-40f1-8c8b-2ba62c528470 tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:28.017558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac3fc64f-7d26-40f1-8c8b-2ba62c528470 tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:28.018701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac3fc64f-7d26-40f1-8c8b-2ba62c528470 tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:28.034244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac3fc64f-7d26-40f1-8c8b-2ba62c528470 tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:28.034904 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac3fc64f-7d26-40f1-8c8b-2ba62c528470 tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:28.042801 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ac3fc64f-7d26-40f1-8c8b-2ba62c528470 tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.547078 Jul 19 22:25:28.043958 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 78/132] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:25:27 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:28.051779 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ebee86ce-be2d-4a1a-b8c4-727bb93a930c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:28.053002 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ebee86ce-be2d-4a1a-b8c4-727bb93a930c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:28.193974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ebee86ce-be2d-4a1a-b8c4-727bb93a930c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:28.204408 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ebee86ce-be2d-4a1a-b8c4-727bb93a930c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a" status: 200 len: 1262 microversion: 2.1 time: 0.158734 Jul 19 22:25:28.206949 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 79/133] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:28 2022] GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a => generated 1262 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:28.213861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-67c86cd2-8ebe-4700-b7a1-fb0ba85e2578 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:28.214703 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-67c86cd2-8ebe-4700-b7a1-fb0ba85e2578 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:28.331888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-67c86cd2-8ebe-4700-b7a1-fb0ba85e2578 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:28.341500 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-67c86cd2-8ebe-4700-b7a1-fb0ba85e2578 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1213 microversion: 2.1 time: 0.133038 Jul 19 22:25:28.354017 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 80/134] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:28 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1213 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:28.380977 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1ed4f90d-b3e5-44b9-adc1-f9692bff08ef tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:28.390505 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1ed4f90d-b3e5-44b9-adc1-f9692bff08ef tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a" status: 200 len: 1492 microversion: 2.1 time: 0.504842 Jul 19 22:25:28.391545 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 55/135] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:27 2022] GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a => generated 1492 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:28.646898 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-87b38227-756e-4389-8493-3053d0d90be0 tempest-HypervisorAdminNegativeUnderV252Test-666222861 tempest-HypervisorAdminNegativeUnderV252Test-666222861-project] Calling method '.version_select at 0x7f7a10f15940>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:28.647816 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:28.647816 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:28.649042 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-87b38227-756e-4389-8493-3053d0d90be0 tempest-HypervisorAdminNegativeUnderV252Test-666222861 tempest-HypervisorAdminNegativeUnderV252Test-666222861-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '0aa6eac1b83043a1a054c21419b845e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9fa79b4af14c479e1b01d2d72b95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:28.649452 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9ca02188-5dda-4aba-8b8f-05110d2e5c3a tempest-DeleteServersAdminTestJSON-1655448443 tempest-DeleteServersAdminTestJSON-1655448443-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:28.650502 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9ca02188-5dda-4aba-8b8f-05110d2e5c3a tempest-DeleteServersAdminTestJSON-1655448443 tempest-DeleteServersAdminTestJSON-1655448443-project-admin] [instance: b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:28.655443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-87b38227-756e-4389-8493-3053d0d90be0 tempest-HypervisorAdminNegativeUnderV252Test-666222861 tempest-HypervisorAdminNegativeUnderV252Test-666222861-project] Request method failure captured: Jul 19 22:25:28.655443 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/os-hypervisors/n-h2-847009-3/search HTTP/1.1 Jul 19 22:25:28.655443 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:25:28.655443 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:25:28.655443 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:25:28.655443 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:25:28.655443 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:25:28.655443 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:25:28.655443 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:25:28.655443 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:28.655443 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y9TERkxNfRK9u2ImCKz0MInDljHHg7UnMtwAoSRpbdfFv2FKF1NHyRTrxqjW8uU7hDBr8RfpZ5IL2g5PXuWrUCKjACi3lLH00vp13yc_2M88BoIgM4cyZ4V0phT3tDxbmgY-QMTdHdz0sLuJBVXCMl3eU-910W_D3ZktRFTBIRxLPU Jul 19 22:25:28.655443 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:25:28.655443 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:25:28.655443 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:25:28.655443 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:25:28.655443 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:25:28.655443 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:25:28.655443 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 3e9fa79b4af14c479e1b01d2d72b95d7 Jul 19 22:25:28.655443 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-666222861 Jul 19 22:25:28.655443 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:25:28.655443 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:25:28.656898 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3e9fa79b4af14c479e1b01d2d72b95d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e9fa79b4af14c479e1b01d2d72b95d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3e9fa79b4af14c479e1b01d2d72b95d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e9fa79b4af14c479e1b01d2d72b95d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:28.656898 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-666222861 Jul 19 22:25:28.656898 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 3e9fa79b4af14c479e1b01d2d72b95d7 Jul 19 22:25:28.656898 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-666222861 Jul 19 22:25:28.656898 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-666222861-project Jul 19 22:25:28.656898 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:25:28.656898 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:25:28.656898 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 0aa6eac1b83043a1a054c21419b845e1 Jul 19 22:25:28.656898 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-666222861-project Jul 19 22:25:28.656898 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:25:28.656898 n-d-847009-3 devstack@n-api.service[119337]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 19 22:25:28.656898 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'n-h2-847009-3'} Jul 19 22:25:28.657692 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:28.657692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:28.657692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:28.657692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:28.657692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:28.657692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:28.657692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:25:28.657692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:25:28.657692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:28.657692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:28.657692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 19 22:25:28.657692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 19 22:25:28.657692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:25:28.657692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:25:28.657692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:25:28.657692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:25:28.657692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:25:28.657692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:25:28.657692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:25:28.660174 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:25:28.660174 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:25:28.660174 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:25:28.660174 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:25:28.660174 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:25:28.660174 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:25:28.660174 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:25:28.660174 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 19 22:25:28.660174 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:28.660174 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:28.660174 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:28.660174 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:28.660174 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:28.660174 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:28.660174 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:25:28.660174 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:25:28.660174 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 19 22:25:28.660174 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:28.661332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ca02188-5dda-4aba-8b8f-05110d2e5c3a tempest-DeleteServersAdminTestJSON-1655448443 tempest-DeleteServersAdminTestJSON-1655448443-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:28.661332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ca02188-5dda-4aba-8b8f-05110d2e5c3a tempest-DeleteServersAdminTestJSON-1655448443 tempest-DeleteServersAdminTestJSON-1655448443-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:28.661919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ca02188-5dda-4aba-8b8f-05110d2e5c3a tempest-DeleteServersAdminTestJSON-1655448443 tempest-DeleteServersAdminTestJSON-1655448443-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:28.662362 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ca02188-5dda-4aba-8b8f-05110d2e5c3a tempest-DeleteServersAdminTestJSON-1655448443 tempest-DeleteServersAdminTestJSON-1655448443-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:28.662728 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-87b38227-756e-4389-8493-3053d0d90be0 tempest-HypervisorAdminNegativeUnderV252Test-666222861 tempest-HypervisorAdminNegativeUnderV252Test-666222861-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:28.663907 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-87b38227-756e-4389-8493-3053d0d90be0 tempest-HypervisorAdminNegativeUnderV252Test-666222861 tempest-HypervisorAdminNegativeUnderV252Test-666222861-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h2-847009-3/search" status: 403 len: 117 microversion: 2.1 time: 0.308314 Jul 19 22:25:28.670676 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 81/136] 10.222.0.25 () {58 vars in 1208 bytes} [Tue Jul 19 22:25:28 2022] GET /compute/v2.1/os-hypervisors/n-h2-847009-3/search => generated 117 bytes in 312 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:25:28.681413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-76323de5-a46d-4556-b479-450a5796da23 tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] Calling method '.version_select at 0x7f7a10f514c0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:28.686093 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-76323de5-a46d-4556-b479-450a5796da23 tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:28.687042 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-76323de5-a46d-4556-b479-450a5796da23 tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:28.718256 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-76323de5-a46d-4556-b479-450a5796da23 tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 19 22:25:28.720283 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-76323de5-a46d-4556-b479-450a5796da23 tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] Request method failure captured: Jul 19 22:25:28.720283 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 19 22:25:28.720283 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:25:28.720283 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:25:28.720283 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:25:28.720283 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:25:28.720283 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:25:28.720283 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:25:28.720283 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:25:28.720283 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:28.720283 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y9VV3aZFvQtkFouB8PzrTBuYPDWDIPumj8MRYecWoT7CFeHGjkmOKxIO8jQBAGCR_HzXDTzRobmIohkfb6utJEj8eLXsx8dtotY46WMK7lNr_zkz5uwJf5-0hg8kWacH4EikdO9DihtilYxlf1li4ZTtutyNMreQnbf91R3FEiZK_0 Jul 19 22:25:28.720283 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:25:28.720283 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:25:28.720283 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:25:28.720283 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:25:28.720283 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:25:28.720283 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:25:28.720283 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 4425baeb08c04eaf9c0b5a86cb2043a3 Jul 19 22:25:28.720283 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1228835266 Jul 19 22:25:28.720283 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:25:28.720283 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:25:28.723326 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4425baeb08c04eaf9c0b5a86cb2043a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4425baeb08c04eaf9c0b5a86cb2043a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4425baeb08c04eaf9c0b5a86cb2043a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4425baeb08c04eaf9c0b5a86cb2043a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:28.723326 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1228835266 Jul 19 22:25:28.723326 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 4425baeb08c04eaf9c0b5a86cb2043a3 Jul 19 22:25:28.723326 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1228835266 Jul 19 22:25:28.723326 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin Jul 19 22:25:28.723326 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:25:28.723326 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:25:28.723326 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: d32c3944225c4cb3bc2aeb87f07ed989 Jul 19 22:25:28.723326 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin Jul 19 22:25:28.723326 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:25:28.723326 n-d-847009-3 devstack@n-api.service[119337]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 19 22:25:28.723326 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 19 22:25:28.724317 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:28.724317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:28.724317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:28.724317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:28.724317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:28.724317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:28.724317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:25:28.724317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:25:28.724317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:28.724317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:28.724317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 19 22:25:28.724317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 19 22:25:28.724317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 19 22:25:28.724317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 22:25:28.724317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 19 22:25:28.724317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:28.724317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:28.724317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:28.724317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:28.724317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:28.725874 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:28.725874 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:25:28.725874 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:25:28.725874 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 19 22:25:28.725874 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:28.728668 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-76323de5-a46d-4556-b479-450a5796da23 tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:28.745723 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-76323de5-a46d-4556-b479-450a5796da23 tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.058331 Jul 19 22:25:28.747392 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 82/137] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 19 22:25:28 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:25:28.758619 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-61d1f9cc-59e3-4c91-bbb8-e9b717e2bf0a tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] Calling method '.version_select at 0x7f7a10ee44c0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:28.759889 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:28.759889 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:28.762537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61d1f9cc-59e3-4c91-bbb8-e9b717e2bf0a tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:28.763343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61d1f9cc-59e3-4c91-bbb8-e9b717e2bf0a tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:28.787223 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61d1f9cc-59e3-4c91-bbb8-e9b717e2bf0a tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:28.788007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61d1f9cc-59e3-4c91-bbb8-e9b717e2bf0a tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:28.802114 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61d1f9cc-59e3-4c91-bbb8-e9b717e2bf0a tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:28.802567 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61d1f9cc-59e3-4c91-bbb8-e9b717e2bf0a tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:28.808717 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-61d1f9cc-59e3-4c91-bbb8-e9b717e2bf0a tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.055379 Jul 19 22:25:28.809311 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 83/138] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:25:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:25:28.818085 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9ca02188-5dda-4aba-8b8f-05110d2e5c3a tempest-DeleteServersAdminTestJSON-1655448443 tempest-DeleteServersAdminTestJSON-1655448443-project-admin] [instance: b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:25:28.821812 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-54d4de95-a0b0-46b2-99f7-f6a673aa0064 tempest-HypervisorAdminNegativeUnderV252Test-666222861 tempest-HypervisorAdminNegativeUnderV252Test-666222861-project] Calling method '.version_select at 0x7f7a10f51040>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:28.823524 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:28.823524 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:28.824909 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-54d4de95-a0b0-46b2-99f7-f6a673aa0064 tempest-HypervisorAdminNegativeUnderV252Test-666222861 tempest-HypervisorAdminNegativeUnderV252Test-666222861-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '0aa6eac1b83043a1a054c21419b845e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9fa79b4af14c479e1b01d2d72b95d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:28.827586 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-54d4de95-a0b0-46b2-99f7-f6a673aa0064 tempest-HypervisorAdminNegativeUnderV252Test-666222861 tempest-HypervisorAdminNegativeUnderV252Test-666222861-project] Request method failure captured: Jul 19 22:25:28.827586 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 19 22:25:28.827586 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:25:28.827586 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:25:28.827586 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:25:28.827586 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:25:28.827586 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:25:28.827586 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:25:28.827586 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:25:28.827586 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:28.827586 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y9TERkxNfRK9u2ImCKz0MInDljHHg7UnMtwAoSRpbdfFv2FKF1NHyRTrxqjW8uU7hDBr8RfpZ5IL2g5PXuWrUCKjACi3lLH00vp13yc_2M88BoIgM4cyZ4V0phT3tDxbmgY-QMTdHdz0sLuJBVXCMl3eU-910W_D3ZktRFTBIRxLPU Jul 19 22:25:28.827586 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:25:28.827586 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:25:28.827586 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:25:28.827586 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:25:28.827586 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:25:28.827586 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:25:28.827586 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 3e9fa79b4af14c479e1b01d2d72b95d7 Jul 19 22:25:28.827586 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-666222861 Jul 19 22:25:28.827586 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:25:28.827586 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:25:28.828798 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3e9fa79b4af14c479e1b01d2d72b95d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e9fa79b4af14c479e1b01d2d72b95d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3e9fa79b4af14c479e1b01d2d72b95d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e9fa79b4af14c479e1b01d2d72b95d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:28.828798 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-666222861 Jul 19 22:25:28.828798 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 3e9fa79b4af14c479e1b01d2d72b95d7 Jul 19 22:25:28.828798 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-666222861 Jul 19 22:25:28.828798 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-666222861-project Jul 19 22:25:28.828798 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:25:28.828798 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:25:28.828798 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 0aa6eac1b83043a1a054c21419b845e1 Jul 19 22:25:28.828798 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-666222861-project Jul 19 22:25:28.828798 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:25:28.828798 n-d-847009-3 devstack@n-api.service[119337]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 19 22:25:28.828798 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '1'} Jul 19 22:25:28.828798 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:28.829494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:28.829494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:28.829494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:28.829494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:28.829494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:28.829494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:25:28.829494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:25:28.829494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:28.829494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:28.829494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 19 22:25:28.829494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 19 22:25:28.829494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:25:28.829494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:25:28.829494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:25:28.829494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:25:28.829494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:25:28.829494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:25:28.829494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:25:28.829494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:25:28.831847 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:25:28.831847 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:25:28.831847 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:25:28.831847 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:25:28.831847 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:25:28.831847 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:25:28.831847 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 19 22:25:28.831847 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:28.831847 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:28.831847 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:28.831847 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:28.831847 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:28.831847 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:28.831847 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:25:28.831847 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:25:28.831847 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 19 22:25:28.831847 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:28.834203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-54d4de95-a0b0-46b2-99f7-f6a673aa0064 tempest-HypervisorAdminNegativeUnderV252Test-666222861 tempest-HypervisorAdminNegativeUnderV252Test-666222861-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:28.835497 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-54d4de95-a0b0-46b2-99f7-f6a673aa0064 tempest-HypervisorAdminNegativeUnderV252Test-666222861 tempest-HypervisorAdminNegativeUnderV252Test-666222861-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.018534 Jul 19 22:25:28.836048 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 84/139] 10.222.0.25 () {58 vars in 1175 bytes} [Tue Jul 19 22:25:28 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:25:28.852010 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6798137d-091e-46bb-8478-2d69fc66d035 tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] Calling method '.version_select at 0x7f7a10e8f0d0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:28.854669 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6798137d-091e-46bb-8478-2d69fc66d035 tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:28.855340 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6798137d-091e-46bb-8478-2d69fc66d035 tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:28.865747 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-6798137d-091e-46bb-8478-2d69fc66d035 tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] HTTP exception thrown: No hypervisor matching '65226a41-4ae0-47fb-895e-899efc5ed654' could be found. Jul 19 22:25:28.867672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6798137d-091e-46bb-8478-2d69fc66d035 tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] Request method failure captured: Jul 19 22:25:28.867672 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/os-hypervisors/65226a41-4ae0-47fb-895e-899efc5ed654/servers HTTP/1.1 Jul 19 22:25:28.867672 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:25:28.867672 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:25:28.867672 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:25:28.867672 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:25:28.867672 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:25:28.867672 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:25:28.867672 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:25:28.867672 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:28.867672 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y9VV3aZFvQtkFouB8PzrTBuYPDWDIPumj8MRYecWoT7CFeHGjkmOKxIO8jQBAGCR_HzXDTzRobmIohkfb6utJEj8eLXsx8dtotY46WMK7lNr_zkz5uwJf5-0hg8kWacH4EikdO9DihtilYxlf1li4ZTtutyNMreQnbf91R3FEiZK_0 Jul 19 22:25:28.867672 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:25:28.867672 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:25:28.867672 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:25:28.867672 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:25:28.867672 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:25:28.867672 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:25:28.867672 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 4425baeb08c04eaf9c0b5a86cb2043a3 Jul 19 22:25:28.867672 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1228835266 Jul 19 22:25:28.867672 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:25:28.867672 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:25:28.869068 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4425baeb08c04eaf9c0b5a86cb2043a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4425baeb08c04eaf9c0b5a86cb2043a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4425baeb08c04eaf9c0b5a86cb2043a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4425baeb08c04eaf9c0b5a86cb2043a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:28.869068 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1228835266 Jul 19 22:25:28.869068 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 4425baeb08c04eaf9c0b5a86cb2043a3 Jul 19 22:25:28.869068 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1228835266 Jul 19 22:25:28.869068 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin Jul 19 22:25:28.869068 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:25:28.869068 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:25:28.869068 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: d32c3944225c4cb3bc2aeb87f07ed989 Jul 19 22:25:28.869068 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin Jul 19 22:25:28.869068 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:25:28.869068 n-d-847009-3 devstack@n-api.service[119337]: exception: No hypervisor matching '65226a41-4ae0-47fb-895e-899efc5ed654' could be found. Jul 19 22:25:28.869068 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '65226a41-4ae0-47fb-895e-899efc5ed654'} Jul 19 22:25:28.870431 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:28.870431 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:28.870431 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:28.870431 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:28.870431 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:28.870431 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:28.870431 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:25:28.870431 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:25:28.870431 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:28.870431 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:28.870431 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 19 22:25:28.870431 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 19 22:25:28.870431 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 19 22:25:28.870431 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 22:25:28.870431 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '65226a41-4ae0-47fb-895e-899efc5ed654' could be found. Jul 19 22:25:28.870431 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:28.870431 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:28.870431 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:28.870431 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:28.871750 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:28.871750 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:28.871750 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:25:28.871750 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:25:28.871750 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '65226a41-4ae0-47fb-895e-899efc5ed654' could be found. Jul 19 22:25:28.871750 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:28.872334 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6798137d-091e-46bb-8478-2d69fc66d035 tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] Returning 404 to user: No hypervisor matching '65226a41-4ae0-47fb-895e-899efc5ed654' could be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:28.875310 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6798137d-091e-46bb-8478-2d69fc66d035 tempest-HypervisorAdminNegativeUnderV252Test-1228835266 tempest-HypervisorAdminNegativeUnderV252Test-1228835266-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/65226a41-4ae0-47fb-895e-899efc5ed654/servers" status: 404 len: 123 microversion: 2.1 time: 0.032146 Jul 19 22:25:28.881092 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 85/140] 10.222.0.25 () {58 vars in 1280 bytes} [Tue Jul 19 22:25:28 2022] GET /compute/v2.1/os-hypervisors/65226a41-4ae0-47fb-895e-899efc5ed654/servers => generated 123 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:25:28.903385 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c6ef97fd-b06f-4a6a-918a-e4474f84413c tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:28.904134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c6ef97fd-b06f-4a6a-918a-e4474f84413c tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] [instance: e1dfa154-2d44-47cb-8e04-3c45c04cd96b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:28.911302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c6ef97fd-b06f-4a6a-918a-e4474f84413c tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:28.912056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c6ef97fd-b06f-4a6a-918a-e4474f84413c tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:28.913292 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c6ef97fd-b06f-4a6a-918a-e4474f84413c tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:28.914036 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c6ef97fd-b06f-4a6a-918a-e4474f84413c tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:29.018634 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9ca02188-5dda-4aba-8b8f-05110d2e5c3a tempest-DeleteServersAdminTestJSON-1655448443 tempest-DeleteServersAdminTestJSON-1655448443-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a" status: 204 len: 0 microversion: 2.1 time: 0.598631 Jul 19 22:25:29.018634 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 56/141] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:25:28 2022] DELETE /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a => generated 0 bytes in 601 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:25:29.104514 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c6ef97fd-b06f-4a6a-918a-e4474f84413c tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eabe2a2d3164f168cfaf69623ffe96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6ce11f1034a36b533ebc223be834a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:29.114616 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c6ef97fd-b06f-4a6a-918a-e4474f84413c tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b" status: 200 len: 1488 microversion: 2.1 time: 0.215384 Jul 19 22:25:29.118348 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 86/142] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:28 2022] GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b => generated 1488 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:25:29.131387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ae5cb2cd-a587-4767-947f-1d201377f148 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:29.133525 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ae5cb2cd-a587-4767-947f-1d201377f148 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:29.145574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae5cb2cd-a587-4767-947f-1d201377f148 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:29.146549 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae5cb2cd-a587-4767-947f-1d201377f148 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:29.147428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae5cb2cd-a587-4767-947f-1d201377f148 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:29.151338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae5cb2cd-a587-4767-947f-1d201377f148 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:29.334649 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ae5cb2cd-a587-4767-947f-1d201377f148 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:29.346974 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ae5cb2cd-a587-4767-947f-1d201377f148 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a" status: 200 len: 1498 microversion: 2.1 time: 0.227028 Jul 19 22:25:29.347774 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 87/143] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:29 2022] GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a => generated 1498 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:29.352807 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-018737e1-c998-42e1-a0ec-9af21a88de99 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:29.353610 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-018737e1-c998-42e1-a0ec-9af21a88de99 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] [instance: e1dfa154-2d44-47cb-8e04-3c45c04cd96b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:29.358772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5d3ea797-ae2b-4fbc-9926-a1dde202d9dd tempest-QuotaClassesAdminTestJSON-1519081866 tempest-QuotaClassesAdminTestJSON-1519081866-project-admin] Calling method '.version_select at 0x7f7a1104b430>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:29.359905 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:29.359905 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:29.364115 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-018737e1-c998-42e1-a0ec-9af21a88de99 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:29.375483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-018737e1-c998-42e1-a0ec-9af21a88de99 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:29.377291 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-018737e1-c998-42e1-a0ec-9af21a88de99 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:29.379664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-018737e1-c998-42e1-a0ec-9af21a88de99 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:29.402936 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5d3ea797-ae2b-4fbc-9926-a1dde202d9dd tempest-QuotaClassesAdminTestJSON-1519081866 tempest-QuotaClassesAdminTestJSON-1519081866-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.385758 Jul 19 22:25:29.404819 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 57/144] 10.222.0.25 () {58 vars in 1184 bytes} [Tue Jul 19 22:25:29 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:29.410771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0481f698-1c88-4bd0-8aff-f3bbf52f45aa tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:29.412103 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0481f698-1c88-4bd0-8aff-f3bbf52f45aa tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:29.422415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0481f698-1c88-4bd0-8aff-f3bbf52f45aa tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:29.423402 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0481f698-1c88-4bd0-8aff-f3bbf52f45aa tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:29.425832 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0481f698-1c88-4bd0-8aff-f3bbf52f45aa tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:29.426518 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0481f698-1c88-4bd0-8aff-f3bbf52f45aa tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:29.785087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0481f698-1c88-4bd0-8aff-f3bbf52f45aa tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:29.800000 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0481f698-1c88-4bd0-8aff-f3bbf52f45aa tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a" status: 200 len: 1322 microversion: 2.1 time: 0.393713 Jul 19 22:25:29.803545 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 58/145] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:29 2022] GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a => generated 1322 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:29.824202 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c5e6edfa-7c24-44b6-8bff-3418da3b5022 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:29.829223 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c5e6edfa-7c24-44b6-8bff-3418da3b5022 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:29.847423 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c5e6edfa-7c24-44b6-8bff-3418da3b5022 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:29.847889 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c5e6edfa-7c24-44b6-8bff-3418da3b5022 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:29.848694 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c5e6edfa-7c24-44b6-8bff-3418da3b5022 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:29.849754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c5e6edfa-7c24-44b6-8bff-3418da3b5022 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:29.965260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c5e6edfa-7c24-44b6-8bff-3418da3b5022 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:29.969587 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:29.982518 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c5e6edfa-7c24-44b6-8bff-3418da3b5022 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1283 microversion: 2.1 time: 0.176784 Jul 19 22:25:29.983986 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 59/146] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:29 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1283 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:29.999225 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b412724c-a400-4f58-b8f8-1568a616011e tempest-QuotaClassesAdminTestJSON-1519081866 tempest-QuotaClassesAdminTestJSON-1519081866-project-admin] Action: 'update', calling method: .version_select at 0x7f7a11212ee0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:30.002697 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:30.002697 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:30.310525 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-018737e1-c998-42e1-a0ec-9af21a88de99 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b" status: 200 len: 1639 microversion: 2.1 time: 0.961199 Jul 19 22:25:30.331664 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 88/147] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:29 2022] GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b => generated 1639 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:30.343191 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-48fe8abb-b959-42b5-b7f9-2bb3e436c093 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:30.347949 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-48fe8abb-b959-42b5-b7f9-2bb3e436c093 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] [instance: e1dfa154-2d44-47cb-8e04-3c45c04cd96b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:30.367270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-48fe8abb-b959-42b5-b7f9-2bb3e436c093 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:30.368319 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-48fe8abb-b959-42b5-b7f9-2bb3e436c093 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:30.369617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-48fe8abb-b959-42b5-b7f9-2bb3e436c093 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:30.370283 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-48fe8abb-b959-42b5-b7f9-2bb3e436c093 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:30.444242 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-48fe8abb-b959-42b5-b7f9-2bb3e436c093 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] [instance: e1dfa154-2d44-47cb-8e04-3c45c04cd96b] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:25:30.854206 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=15,nova_api:UPDATE=13 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:30.874117 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-48fe8abb-b959-42b5-b7f9-2bb3e436c093 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b" status: 204 len: 0 microversion: 2.1 time: 0.537725 Jul 19 22:25:30.879793 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 89/148] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:25:30 2022] DELETE /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:25:30.886419 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-deff383e-b63a-40eb-9c6f-6862ed60140b tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:30.889387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-deff383e-b63a-40eb-9c6f-6862ed60140b tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:30.893890 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b412724c-a400-4f58-b8f8-1568a616011e tempest-QuotaClassesAdminTestJSON-1519081866 tempest-QuotaClassesAdminTestJSON-1519081866-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.908376 Jul 19 22:25:30.899424 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 60/149] 10.222.0.25 () {60 vars in 1205 bytes} [Tue Jul 19 22:25:29 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:30.905892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-245e5af8-11c9-459b-aca4-a683f8521245 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:30.912574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-deff383e-b63a-40eb-9c6f-6862ed60140b tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:30.912787 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-245e5af8-11c9-459b-aca4-a683f8521245 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:30.912914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-deff383e-b63a-40eb-9c6f-6862ed60140b tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:30.913190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-deff383e-b63a-40eb-9c6f-6862ed60140b tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:30.914579 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-deff383e-b63a-40eb-9c6f-6862ed60140b tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:30.924682 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-245e5af8-11c9-459b-aca4-a683f8521245 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:30.928092 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-245e5af8-11c9-459b-aca4-a683f8521245 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:30.929226 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-245e5af8-11c9-459b-aca4-a683f8521245 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:30.929683 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-245e5af8-11c9-459b-aca4-a683f8521245 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:31.177978 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-245e5af8-11c9-459b-aca4-a683f8521245 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:31.196923 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-245e5af8-11c9-459b-aca4-a683f8521245 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a" status: 200 len: 1320 microversion: 2.1 time: 0.291406 Jul 19 22:25:31.218917 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 61/150] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:30 2022] GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a => generated 1320 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:31.254028 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4e8da427-245e-4ad4-94f5-47f483e68098 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:31.254391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4e8da427-245e-4ad4-94f5-47f483e68098 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] [instance: e1dfa154-2d44-47cb-8e04-3c45c04cd96b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:31.281051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4e8da427-245e-4ad4-94f5-47f483e68098 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:31.281864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4e8da427-245e-4ad4-94f5-47f483e68098 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:31.284457 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4e8da427-245e-4ad4-94f5-47f483e68098 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:31.294939 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4e8da427-245e-4ad4-94f5-47f483e68098 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:31.317808 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-deff383e-b63a-40eb-9c6f-6862ed60140b tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:31.333827 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-deff383e-b63a-40eb-9c6f-6862ed60140b tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a" status: 200 len: 1498 microversion: 2.1 time: 0.456615 Jul 19 22:25:31.335376 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 90/151] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:30 2022] GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a => generated 1498 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:31.351189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-39c08299-f9ca-4d52-a42e-0fefebabcff0 tempest-QuotaClassesAdminTestJSON-1519081866 tempest-QuotaClassesAdminTestJSON-1519081866-project-admin] Calling method '.version_select at 0x7f7a10ee45e0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:31.353020 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:31.353020 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:31.357110 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:31.371328 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-39c08299-f9ca-4d52-a42e-0fefebabcff0 tempest-QuotaClassesAdminTestJSON-1519081866 tempest-QuotaClassesAdminTestJSON-1519081866-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.025495 Jul 19 22:25:31.372187 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 91/152] 10.222.0.25 () {58 vars in 1184 bytes} [Tue Jul 19 22:25:31 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:31.378438 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c6050ff9-fee8-4900-87ae-03d2c5221e81 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:31.379867 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c6050ff9-fee8-4900-87ae-03d2c5221e81 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:31.404993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c6050ff9-fee8-4900-87ae-03d2c5221e81 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:31.406016 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c6050ff9-fee8-4900-87ae-03d2c5221e81 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:31.407053 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c6050ff9-fee8-4900-87ae-03d2c5221e81 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:31.407728 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c6050ff9-fee8-4900-87ae-03d2c5221e81 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:31.544723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c6050ff9-fee8-4900-87ae-03d2c5221e81 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:31.550409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:31.561400 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c6050ff9-fee8-4900-87ae-03d2c5221e81 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1271 microversion: 2.1 time: 0.187966 Jul 19 22:25:31.561988 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 92/153] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:31 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1271 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:31.835342 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4e8da427-245e-4ad4-94f5-47f483e68098 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eabe2a2d3164f168cfaf69623ffe96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6ce11f1034a36b533ebc223be834a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:31.852912 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4e8da427-245e-4ad4-94f5-47f483e68098 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b" status: 200 len: 1494 microversion: 2.1 time: 0.624577 Jul 19 22:25:31.872814 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 62/154] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:31 2022] GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b => generated 1494 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:31.878281 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-43f073f6-fed2-4a80-b752-9d7849e19fe7 tempest-QuotaClassesAdminTestJSON-1519081866 tempest-QuotaClassesAdminTestJSON-1519081866-project-admin] Action: 'update', calling method: .version_select at 0x7f7a111091f0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:31.881019 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:31.881019 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:31.911444 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ecbe5eb2-1dd5-4c7e-847c-65d9a552b1d0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1957741877", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:32.037718 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-ecbe5eb2-1dd5-4c7e-847c-65d9a552b1d0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] validate_networks() for None {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:25:32.130463 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-43f073f6-fed2-4a80-b752-9d7849e19fe7 tempest-QuotaClassesAdminTestJSON-1519081866 tempest-QuotaClassesAdminTestJSON-1519081866-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.262355 Jul 19 22:25:32.131444 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 63/155] 10.222.0.25 () {60 vars in 1205 bytes} [Tue Jul 19 22:25:31 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:32.233818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a21d1e3d-4c59-404b-9f76-e1f9300534c5 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:32.235247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a21d1e3d-4c59-404b-9f76-e1f9300534c5 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:32.248218 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a21d1e3d-4c59-404b-9f76-e1f9300534c5 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:32.248680 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a21d1e3d-4c59-404b-9f76-e1f9300534c5 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:32.252697 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a21d1e3d-4c59-404b-9f76-e1f9300534c5 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:32.253132 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a21d1e3d-4c59-404b-9f76-e1f9300534c5 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:32.486483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ecbe5eb2-1dd5-4c7e-847c-65d9a552b1d0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:25:32.491242 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ecbe5eb2-1dd5-4c7e-847c-65d9a552b1d0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:25:32.492715 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ecbe5eb2-1dd5-4c7e-847c-65d9a552b1d0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:25:32.493117 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ecbe5eb2-1dd5-4c7e-847c-65d9a552b1d0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:25:32.493539 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ecbe5eb2-1dd5-4c7e-847c-65d9a552b1d0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:25:32.513617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ecbe5eb2-1dd5-4c7e-847c-65d9a552b1d0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:32.514493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ecbe5eb2-1dd5-4c7e-847c-65d9a552b1d0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:32.516400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ecbe5eb2-1dd5-4c7e-847c-65d9a552b1d0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:32.518443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ecbe5eb2-1dd5-4c7e-847c-65d9a552b1d0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:32.592591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-ecbe5eb2-1dd5-4c7e-847c-65d9a552b1d0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Getting quotas for project cf9f0d3bd470463abf724fc6b043caac. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:25:32.600256 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-ecbe5eb2-1dd5-4c7e-847c-65d9a552b1d0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Getting quotas for user 715c3a84a6f64cf485cadcc983e4dd77 and project cf9f0d3bd470463abf724fc6b043caac. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:25:32.623323 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ecbe5eb2-1dd5-4c7e-847c-65d9a552b1d0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:25:32.625882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ecbe5eb2-1dd5-4c7e-847c-65d9a552b1d0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: b5b01010-9fd2-4092-ad1d-29edac4ecaa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:25:32.692465 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a21d1e3d-4c59-404b-9f76-e1f9300534c5 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:32.704148 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a21d1e3d-4c59-404b-9f76-e1f9300534c5 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a" status: 200 len: 1388 microversion: 2.1 time: 0.476360 Jul 19 22:25:32.725401 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 64/156] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:32 2022] GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a => generated 1388 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:32.731969 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e9bf0129-5b26-44ba-92a5-82c29fa7d881 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:32.733067 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e9bf0129-5b26-44ba-92a5-82c29fa7d881 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:32.746644 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9bf0129-5b26-44ba-92a5-82c29fa7d881 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:32.747451 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9bf0129-5b26-44ba-92a5-82c29fa7d881 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:32.748590 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9bf0129-5b26-44ba-92a5-82c29fa7d881 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:32.749234 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9bf0129-5b26-44ba-92a5-82c29fa7d881 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:32.756075 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ecbe5eb2-1dd5-4c7e-847c-65d9a552b1d0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.177765 Jul 19 22:25:32.756758 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 93/157] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:25:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:25:32.766241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-17a4a4f3-4117-4ab9-a29b-68efdcc5660b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:32.772580 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-17a4a4f3-4117-4ab9-a29b-68efdcc5660b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:32.803915 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-17a4a4f3-4117-4ab9-a29b-68efdcc5660b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:32.804359 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-17a4a4f3-4117-4ab9-a29b-68efdcc5660b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:32.805133 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-17a4a4f3-4117-4ab9-a29b-68efdcc5660b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:32.805565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-17a4a4f3-4117-4ab9-a29b-68efdcc5660b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:33.364260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e9bf0129-5b26-44ba-92a5-82c29fa7d881 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:33.389160 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e9bf0129-5b26-44ba-92a5-82c29fa7d881 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a" status: 200 len: 1498 microversion: 2.1 time: 0.661799 Jul 19 22:25:33.389770 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 65/158] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:32 2022] GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a => generated 1498 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:33.399005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c4ef0a47-12f1-4843-aebc-d83434d3ae85 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:33.415914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c4ef0a47-12f1-4843-aebc-d83434d3ae85 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: b5b01010-9fd2-4092-ad1d-29edac4ecaa4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:33.470611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-17a4a4f3-4117-4ab9-a29b-68efdcc5660b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:33.489948 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-17a4a4f3-4117-4ab9-a29b-68efdcc5660b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1313 microversion: 2.1 time: 0.727026 Jul 19 22:25:33.491853 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 94/159] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:32 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1313 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:33.509527 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9f91e548-b8c8-4b90-bb45-7b72ba48a983 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:33.511711 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9f91e548-b8c8-4b90-bb45-7b72ba48a983 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] [instance: e1dfa154-2d44-47cb-8e04-3c45c04cd96b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:33.525952 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9f91e548-b8c8-4b90-bb45-7b72ba48a983 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:33.526783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9f91e548-b8c8-4b90-bb45-7b72ba48a983 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:33.527861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9f91e548-b8c8-4b90-bb45-7b72ba48a983 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:33.528552 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9f91e548-b8c8-4b90-bb45-7b72ba48a983 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:33.558640 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c4ef0a47-12f1-4843-aebc-d83434d3ae85 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:33.566610 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c4ef0a47-12f1-4843-aebc-d83434d3ae85 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4" status: 200 len: 1219 microversion: 2.1 time: 0.175543 Jul 19 22:25:33.567236 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 66/160] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:33 2022] GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4 => generated 1219 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:33.729321 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d7929eb1-e132-46d6-b1ba-6b6281dbf96b tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:33.729950 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d7929eb1-e132-46d6-b1ba-6b6281dbf96b tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:33.741721 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7929eb1-e132-46d6-b1ba-6b6281dbf96b tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:33.743187 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7929eb1-e132-46d6-b1ba-6b6281dbf96b tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:33.744848 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7929eb1-e132-46d6-b1ba-6b6281dbf96b tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:33.751630 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7929eb1-e132-46d6-b1ba-6b6281dbf96b tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:34.105563 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9f91e548-b8c8-4b90-bb45-7b72ba48a983 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eabe2a2d3164f168cfaf69623ffe96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6ce11f1034a36b533ebc223be834a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:34.129075 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9f91e548-b8c8-4b90-bb45-7b72ba48a983 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b" status: 200 len: 1494 microversion: 2.1 time: 0.633598 Jul 19 22:25:34.144695 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 95/161] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:33 2022] GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b => generated 1494 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:34.158597 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-7626bfdf-ea61-43bf-8d5d-7848916ae0ea req-2f55c47f-9d9f-4b2f-bbc6-484cee78c752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a", "name": "network-vif-deleted", "tag": "9d2342e4-4686-4dad-9000-088369a4e47b"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:34.217425 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d7929eb1-e132-46d6-b1ba-6b6281dbf96b tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:34.223691 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-7626bfdf-ea61-43bf-8d5d-7848916ae0ea req-2f55c47f-9d9f-4b2f-bbc6-484cee78c752 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:34.225294 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-7626bfdf-ea61-43bf-8d5d-7848916ae0ea req-2f55c47f-9d9f-4b2f-bbc6-484cee78c752 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:34.228654 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d7929eb1-e132-46d6-b1ba-6b6281dbf96b tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a" status: 200 len: 1388 microversion: 2.1 time: 0.505265 Jul 19 22:25:34.235374 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 67/162] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:33 2022] GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a => generated 1388 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:34.253504 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-7283dce8-c9ec-44f1-bcd6-21d2f89fe96d req-053652cc-47bb-4936-99e8-31c073ebf7c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1dfa154-2d44-47cb-8e04-3c45c04cd96b", "name": "network-vif-deleted", "tag": "b2c0b4f7-8344-4a9f-b2f6-0fa372d569b8"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:34.255353 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-7626bfdf-ea61-43bf-8d5d-7848916ae0ea req-2f55c47f-9d9f-4b2f-bbc6-484cee78c752 service nova] Creating event network-vif-deleted:9d2342e4-4686-4dad-9000-088369a4e47b for instance b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a on n-h2-847009-3 Jul 19 22:25:34.260946 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-7626bfdf-ea61-43bf-8d5d-7848916ae0ea req-2f55c47f-9d9f-4b2f-bbc6-484cee78c752 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114660 Jul 19 22:25:34.262212 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 96/163] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:34.278835 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7283dce8-c9ec-44f1-bcd6-21d2f89fe96d req-053652cc-47bb-4936-99e8-31c073ebf7c4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:34.280059 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7283dce8-c9ec-44f1-bcd6-21d2f89fe96d req-053652cc-47bb-4936-99e8-31c073ebf7c4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:34.303483 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-7283dce8-c9ec-44f1-bcd6-21d2f89fe96d req-053652cc-47bb-4936-99e8-31c073ebf7c4 service nova] Creating event network-vif-deleted:b2c0b4f7-8344-4a9f-b2f6-0fa372d569b8 for instance e1dfa154-2d44-47cb-8e04-3c45c04cd96b on n-h2-847009-3 Jul 19 22:25:34.312892 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-7283dce8-c9ec-44f1-bcd6-21d2f89fe96d req-053652cc-47bb-4936-99e8-31c073ebf7c4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075445 Jul 19 22:25:34.313807 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 68/164] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:34.411283 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-884c88f8-e2dd-4062-b97d-b672c0566387 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:34.413232 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-884c88f8-e2dd-4062-b97d-b672c0566387 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:34.422737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-884c88f8-e2dd-4062-b97d-b672c0566387 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:34.423307 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-884c88f8-e2dd-4062-b97d-b672c0566387 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:34.424799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-884c88f8-e2dd-4062-b97d-b672c0566387 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:34.425493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-884c88f8-e2dd-4062-b97d-b672c0566387 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:34.476173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-884c88f8-e2dd-4062-b97d-b672c0566387 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:34.476797 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-884c88f8-e2dd-4062-b97d-b672c0566387 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:34.477284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-884c88f8-e2dd-4062-b97d-b672c0566387 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lazy-loading 'fault' on Instance uuid b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:25:34.513462 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e71fcc82-1459-40fc-b7d9-8009997d9cba tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:34.515066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e71fcc82-1459-40fc-b7d9-8009997d9cba tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:34.528491 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e71fcc82-1459-40fc-b7d9-8009997d9cba tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:34.529568 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e71fcc82-1459-40fc-b7d9-8009997d9cba tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:34.531502 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e71fcc82-1459-40fc-b7d9-8009997d9cba tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:34.533648 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e71fcc82-1459-40fc-b7d9-8009997d9cba tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:34.550808 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-884c88f8-e2dd-4062-b97d-b672c0566387 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:34.562150 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-884c88f8-e2dd-4062-b97d-b672c0566387 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a" status: 200 len: 1332 microversion: 2.1 time: 0.157584 Jul 19 22:25:34.563176 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 97/165] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:34 2022] GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a => generated 1332 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:34.588289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-735e98fb-1c93-44a5-bfab-28d5cf77da62 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:34.590815 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-735e98fb-1c93-44a5-bfab-28d5cf77da62 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: b5b01010-9fd2-4092-ad1d-29edac4ecaa4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:34.615720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-735e98fb-1c93-44a5-bfab-28d5cf77da62 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:34.616563 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-735e98fb-1c93-44a5-bfab-28d5cf77da62 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:34.617361 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-735e98fb-1c93-44a5-bfab-28d5cf77da62 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:34.617847 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-735e98fb-1c93-44a5-bfab-28d5cf77da62 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:34.737615 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-735e98fb-1c93-44a5-bfab-28d5cf77da62 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:34.745735 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-735e98fb-1c93-44a5-bfab-28d5cf77da62 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4" status: 200 len: 1293 microversion: 2.1 time: 0.163576 Jul 19 22:25:34.746659 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 98/166] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:34 2022] GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4 => generated 1293 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:34.840492 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e71fcc82-1459-40fc-b7d9-8009997d9cba tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:34.857533 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e71fcc82-1459-40fc-b7d9-8009997d9cba tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1313 microversion: 2.1 time: 0.351914 Jul 19 22:25:34.860603 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 69/167] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:34 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1313 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:25:35.146828 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9eb472e0-e901-4ef0-893a-89efb1c2c270 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:35.147501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9eb472e0-e901-4ef0-893a-89efb1c2c270 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] [instance: e1dfa154-2d44-47cb-8e04-3c45c04cd96b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:35.158486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9eb472e0-e901-4ef0-893a-89efb1c2c270 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:35.158950 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9eb472e0-e901-4ef0-893a-89efb1c2c270 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:35.159777 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9eb472e0-e901-4ef0-893a-89efb1c2c270 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:35.160216 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9eb472e0-e901-4ef0-893a-89efb1c2c270 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:35.201875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9eb472e0-e901-4ef0-893a-89efb1c2c270 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:35.202475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9eb472e0-e901-4ef0-893a-89efb1c2c270 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:35.202932 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-9eb472e0-e901-4ef0-893a-89efb1c2c270 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lazy-loading 'fault' on Instance uuid e1dfa154-2d44-47cb-8e04-3c45c04cd96b {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:25:35.247289 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d95b9274-059f-46c8-9456-2b7bb2995804 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:35.247924 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d95b9274-059f-46c8-9456-2b7bb2995804 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:35.257568 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d95b9274-059f-46c8-9456-2b7bb2995804 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:35.258339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d95b9274-059f-46c8-9456-2b7bb2995804 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:35.259355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d95b9274-059f-46c8-9456-2b7bb2995804 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:35.260035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d95b9274-059f-46c8-9456-2b7bb2995804 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:35.260431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9eb472e0-e901-4ef0-893a-89efb1c2c270 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eabe2a2d3164f168cfaf69623ffe96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6ce11f1034a36b533ebc223be834a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:35.275153 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9eb472e0-e901-4ef0-893a-89efb1c2c270 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b" status: 200 len: 1328 microversion: 2.1 time: 0.132921 Jul 19 22:25:35.276324 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 99/168] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:35 2022] GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b => generated 1328 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:35.582924 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fa1f3d42-8e45-4967-a102-70e6519c5dcc tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:35.584079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d95b9274-059f-46c8-9456-2b7bb2995804 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:35.584500 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fa1f3d42-8e45-4967-a102-70e6519c5dcc tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:35.592587 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d95b9274-059f-46c8-9456-2b7bb2995804 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a" status: 200 len: 1388 microversion: 2.1 time: 0.349383 Jul 19 22:25:35.593674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa1f3d42-8e45-4967-a102-70e6519c5dcc tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:35.594098 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa1f3d42-8e45-4967-a102-70e6519c5dcc tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:35.594398 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 70/169] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:35 2022] GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a => generated 1388 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:25:35.596622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa1f3d42-8e45-4967-a102-70e6519c5dcc tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:35.597230 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa1f3d42-8e45-4967-a102-70e6519c5dcc tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:35.624613 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-fa1f3d42-8e45-4967-a102-70e6519c5dcc tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] HTTP exception thrown: Instance b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a could not be found. Jul 19 22:25:35.628916 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fa1f3d42-8e45-4967-a102-70e6519c5dcc tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Request method failure captured: Jul 19 22:25:35.628916 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a HTTP/1.1 Jul 19 22:25:35.628916 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:25:35.628916 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:25:35.628916 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:25:35.628916 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:25:35.628916 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:25:35.628916 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:25:35.628916 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:25:35.628916 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:35.628916 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y8zA8Q0U5dKHPrsdDmmbYCZgUF_QmLnb1kTooW1HmCzQ4gJEPBVLB7BP-G0JQtyILw5E9-8G30NU_GXJG9Zr2m75QN9b8FjcwIGg4-E6irLN-35y0puUn5z-4Kcdj77wmiarKmqKdNqNgNGcRxYPtFvToKO8PIjPHLopknMgyg6mp8 Jul 19 22:25:35.628916 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:25:35.628916 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:25:35.628916 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:25:35.628916 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:25:35.628916 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:25:35.628916 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:25:35.628916 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 8809f0e3adc6408fb52877e942b68811 Jul 19 22:25:35.628916 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1564258133 Jul 19 22:25:35.628916 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:25:35.628916 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:25:35.630156 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8809f0e3adc6408fb52877e942b68811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8809f0e3adc6408fb52877e942b68811"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8809f0e3adc6408fb52877e942b68811"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8809f0e3adc6408fb52877e942b68811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:35.630156 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-DeleteServersAdminTestJSON-1564258133 Jul 19 22:25:35.630156 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 8809f0e3adc6408fb52877e942b68811 Jul 19 22:25:35.630156 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1564258133 Jul 19 22:25:35.630156 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-DeleteServersAdminTestJSON-1564258133-project Jul 19 22:25:35.630156 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:25:35.630156 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:25:35.630156 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: a8c2f7f94a524d80a1a3c2e105d488b4 Jul 19 22:25:35.630156 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-DeleteServersAdminTestJSON-1564258133-project Jul 19 22:25:35.630156 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:25:35.630156 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a could not be found. Jul 19 22:25:35.630156 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a'} Jul 19 22:25:35.630800 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:35.630800 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:35.630800 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:25:35.630800 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:25:35.630800 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:25:35.630800 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:25:35.630800 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:25:35.630800 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:25:35.630800 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:25:35.630800 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:25:35.630800 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a could not be found. Jul 19 22:25:35.630800 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:35.630800 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:35.630800 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:35.630800 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:35.630800 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:35.630800 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:35.630800 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:35.630800 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:35.630800 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:35.631873 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:35.631873 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:25:35.631873 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:25:35.631873 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:25:35.631873 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:25:35.631873 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:25:35.631873 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:25:35.631873 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a could not be found. Jul 19 22:25:35.631873 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:35.631873 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:35.631873 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:35.631873 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:35.631873 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:35.631873 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:35.631873 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:25:35.631873 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:25:35.631873 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a could not be found. Jul 19 22:25:35.631873 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:35.636067 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fa1f3d42-8e45-4967-a102-70e6519c5dcc tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Returning 404 to user: Instance b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:35.638711 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fa1f3d42-8e45-4967-a102-70e6519c5dcc tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a" status: 404 len: 111 microversion: 2.1 time: 0.063593 Jul 19 22:25:35.649082 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 100/170] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:35 2022] GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:25:35.765608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-50bb1189-fe9d-472a-a086-7430cc576051 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:35.766236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-50bb1189-fe9d-472a-a086-7430cc576051 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: b5b01010-9fd2-4092-ad1d-29edac4ecaa4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:35.777821 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50bb1189-fe9d-472a-a086-7430cc576051 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:35.778870 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50bb1189-fe9d-472a-a086-7430cc576051 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:35.779866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50bb1189-fe9d-472a-a086-7430cc576051 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:35.780462 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50bb1189-fe9d-472a-a086-7430cc576051 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:35.830419 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c5d05c7e-512b-4b73-94e9-7a24e7272768 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1809167113", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:35.916029 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-c5d05c7e-512b-4b73-94e9-7a24e7272768 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] validate_networks() for None {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:25:35.935540 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-50bb1189-fe9d-472a-a086-7430cc576051 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:35.955738 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-50bb1189-fe9d-472a-a086-7430cc576051 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4" status: 200 len: 1299 microversion: 2.1 time: 0.188148 Jul 19 22:25:35.968265 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 71/171] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:35 2022] GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4 => generated 1299 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:35.980338 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a66e88da-41f3-44d9-8165-6d8b60fedeb3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:35.981257 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a66e88da-41f3-44d9-8165-6d8b60fedeb3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:35.993566 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a66e88da-41f3-44d9-8165-6d8b60fedeb3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:35.994264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a66e88da-41f3-44d9-8165-6d8b60fedeb3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:35.995272 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a66e88da-41f3-44d9-8165-6d8b60fedeb3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:35.996065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a66e88da-41f3-44d9-8165-6d8b60fedeb3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:36.607236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-c5d05c7e-512b-4b73-94e9-7a24e7272768 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:25:36.607731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-c5d05c7e-512b-4b73-94e9-7a24e7272768 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:25:36.608048 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-c5d05c7e-512b-4b73-94e9-7a24e7272768 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:25:36.608463 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-c5d05c7e-512b-4b73-94e9-7a24e7272768 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:25:36.608876 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-c5d05c7e-512b-4b73-94e9-7a24e7272768 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:25:36.628794 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a66e88da-41f3-44d9-8165-6d8b60fedeb3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:36.630976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5d05c7e-512b-4b73-94e9-7a24e7272768 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:36.631451 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5d05c7e-512b-4b73-94e9-7a24e7272768 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:36.640981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5d05c7e-512b-4b73-94e9-7a24e7272768 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:36.641575 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5d05c7e-512b-4b73-94e9-7a24e7272768 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:36.643177 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a66e88da-41f3-44d9-8165-6d8b60fedeb3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1313 microversion: 2.1 time: 0.673466 Jul 19 22:25:36.643998 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 72/172] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:35 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1313 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:36.655929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-54cf22f2-8c22-4175-b4c6-4c12934e4bc6 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:36.656835 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-54cf22f2-8c22-4175-b4c6-4c12934e4bc6 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] [instance: e1dfa154-2d44-47cb-8e04-3c45c04cd96b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:36.669157 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-c5d05c7e-512b-4b73-94e9-7a24e7272768 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Getting quotas for project 8809f0e3adc6408fb52877e942b68811. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:25:36.670694 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54cf22f2-8c22-4175-b4c6-4c12934e4bc6 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:36.671418 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54cf22f2-8c22-4175-b4c6-4c12934e4bc6 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:36.672319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54cf22f2-8c22-4175-b4c6-4c12934e4bc6 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:36.672864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54cf22f2-8c22-4175-b4c6-4c12934e4bc6 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:36.679870 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-c5d05c7e-512b-4b73-94e9-7a24e7272768 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Getting quotas for user a8c2f7f94a524d80a1a3c2e105d488b4 and project 8809f0e3adc6408fb52877e942b68811. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:25:36.699434 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-54cf22f2-8c22-4175-b4c6-4c12934e4bc6 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] HTTP exception thrown: Instance e1dfa154-2d44-47cb-8e04-3c45c04cd96b could not be found. Jul 19 22:25:36.702298 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c5d05c7e-512b-4b73-94e9-7a24e7272768 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:25:36.706868 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c5d05c7e-512b-4b73-94e9-7a24e7272768 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: 0c5f1490-8946-4758-baa2-3eacd9b32d5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:25:36.713780 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-54cf22f2-8c22-4175-b4c6-4c12934e4bc6 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Request method failure captured: Jul 19 22:25:36.713780 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b HTTP/1.1 Jul 19 22:25:36.713780 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:25:36.713780 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:25:36.713780 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:25:36.713780 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:25:36.713780 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:25:36.713780 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:25:36.713780 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:25:36.713780 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:36.713780 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y8zxv-atTTzt1s0FmqK7gbcSEou1FOq2xXIwbHXvDtWRXiJCCmVOpTYRqRvwjlkJsgafkrcHfG3I5L-gabXDHgSqhxPJc1Jh4cx6-4u98Sc12RWTcRa9CgaFPacwH1RSqWBTUBgZhS0MqLtL0uzqAyOJzjnQ1I280W_GugwR8zz0QQ Jul 19 22:25:36.713780 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:25:36.713780 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:25:36.713780 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:25:36.713780 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:25:36.713780 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:25:36.713780 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:25:36.713780 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 1be6ce11f1034a36b533ebc223be834a Jul 19 22:25:36.713780 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-AggregatesAdminTestJSON-954529987 Jul 19 22:25:36.713780 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:25:36.713780 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:25:36.716627 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1be6ce11f1034a36b533ebc223be834a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1be6ce11f1034a36b533ebc223be834a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1be6ce11f1034a36b533ebc223be834a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1be6ce11f1034a36b533ebc223be834a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:36.716627 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-AggregatesAdminTestJSON-954529987 Jul 19 22:25:36.716627 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 1be6ce11f1034a36b533ebc223be834a Jul 19 22:25:36.716627 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-954529987 Jul 19 22:25:36.716627 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-AggregatesAdminTestJSON-954529987-project Jul 19 22:25:36.716627 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:25:36.716627 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:25:36.716627 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 0eabe2a2d3164f168cfaf69623ffe96e Jul 19 22:25:36.716627 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-AggregatesAdminTestJSON-954529987-project Jul 19 22:25:36.716627 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:25:36.716627 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance e1dfa154-2d44-47cb-8e04-3c45c04cd96b could not be found. Jul 19 22:25:36.716627 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'e1dfa154-2d44-47cb-8e04-3c45c04cd96b'} Jul 19 22:25:36.718047 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:36.718047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:36.718047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:25:36.718047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:25:36.718047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:25:36.718047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:25:36.718047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:25:36.718047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:25:36.718047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:25:36.718047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:25:36.718047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1dfa154-2d44-47cb-8e04-3c45c04cd96b could not be found. Jul 19 22:25:36.718047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:36.718047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:36.718047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:36.718047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:36.718047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:36.718047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:36.718047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:36.718047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:36.718047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:36.719612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:36.719612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:25:36.719612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:25:36.719612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:25:36.719612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:25:36.719612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:25:36.719612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:25:36.719612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1dfa154-2d44-47cb-8e04-3c45c04cd96b could not be found. Jul 19 22:25:36.719612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:36.719612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:36.719612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:36.719612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:36.719612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:36.719612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:36.719612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:25:36.719612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:25:36.719612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1dfa154-2d44-47cb-8e04-3c45c04cd96b could not be found. Jul 19 22:25:36.719612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:36.721457 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-54cf22f2-8c22-4175-b4c6-4c12934e4bc6 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Returning 404 to user: Instance e1dfa154-2d44-47cb-8e04-3c45c04cd96b could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:36.721457 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-54cf22f2-8c22-4175-b4c6-4c12934e4bc6 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b" status: 404 len: 111 microversion: 2.1 time: 0.072725 Jul 19 22:25:36.722920 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 73/173] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:36 2022] GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:25:36.730880 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-83b74f3e-74ea-4978-9528-98901b4b1796 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:36.734065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-83b74f3e-74ea-4978-9528-98901b4b1796 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:36.755178 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-83b74f3e-74ea-4978-9528-98901b4b1796 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:36.755892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-83b74f3e-74ea-4978-9528-98901b4b1796 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:36.756987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-83b74f3e-74ea-4978-9528-98901b4b1796 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:36.758277 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-83b74f3e-74ea-4978-9528-98901b4b1796 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:36.817074 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c5d05c7e-512b-4b73-94e9-7a24e7272768 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.991322 Jul 19 22:25:36.820684 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 101/174] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:25:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:25:36.832008 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5c1b5e1b-4deb-47af-a1eb-e9c29bdc201a tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-847009-3"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:36.836198 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:36.836198 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:36.866575 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c1b5e1b-4deb-47af-a1eb-e9c29bdc201a tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:36.868707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c1b5e1b-4deb-47af-a1eb-e9c29bdc201a tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:37.151638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:37.165232 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-83b74f3e-74ea-4978-9528-98901b4b1796 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:37.179286 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-83b74f3e-74ea-4978-9528-98901b4b1796 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a" status: 200 len: 1388 microversion: 2.1 time: 0.454302 Jul 19 22:25:37.180021 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 74/175] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:36 2022] GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a => generated 1388 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:37.193052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-11af4d6b-b65e-4720-a035-f1f631ebca87 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:37.195435 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-11af4d6b-b65e-4720-a035-f1f631ebca87 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: 0c5f1490-8946-4758-baa2-3eacd9b32d5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:37.217151 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5c1b5e1b-4deb-47af-a1eb-e9c29bdc201a tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 299 microversion: 2.1 time: 0.393127 Jul 19 22:25:37.218125 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 102/176] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Jul 19 22:25:36 2022] POST /compute/v2.1/os-aggregates/8/action => generated 299 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:37.238165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-43b64d2f-f15b-4db8-85bb-c4ab4aff2250 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:37.238806 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-43b64d2f-f15b-4db8-85bb-c4ab4aff2250 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: b5b01010-9fd2-4092-ad1d-29edac4ecaa4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:37.266306 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-43b64d2f-f15b-4db8-85bb-c4ab4aff2250 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:37.268651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-43b64d2f-f15b-4db8-85bb-c4ab4aff2250 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:37.273753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-43b64d2f-f15b-4db8-85bb-c4ab4aff2250 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:37.278402 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-43b64d2f-f15b-4db8-85bb-c4ab4aff2250 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:37.308720 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-11af4d6b-b65e-4720-a035-f1f631ebca87 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:37.322626 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-11af4d6b-b65e-4720-a035-f1f631ebca87 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a" status: 200 len: 1220 microversion: 2.1 time: 0.139580 Jul 19 22:25:37.324769 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 75/177] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:37 2022] GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a => generated 1220 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:37.339035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-00c6daa0-257d-45c1-a8e9-15905d4259f3 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:37.340158 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:37.340158 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:37.399694 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-00c6daa0-257d-45c1-a8e9-15905d4259f3 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.072410 Jul 19 22:25:37.407640 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 76/178] 10.222.0.25 () {58 vars in 1151 bytes} [Tue Jul 19 22:25:37 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 22:25:37.414507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2e993162-bbb9-4efb-b205-6968199d12f3 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-256181465"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:37.420992 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:37.420992 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:37.422310 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.aggregate [None req-2e993162-bbb9-4efb-b205-6968199d12f3 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Generated uuid ef4f5f63-5a32-4749-a665-ca9b92108895 for aggregate {{(pid=119338) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 22:25:37.467725 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2e993162-bbb9-4efb-b205-6968199d12f3 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.054780 Jul 19 22:25:37.468467 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 77/179] 10.222.0.25 () {60 vars in 1163 bytes} [Tue Jul 19 22:25:37 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:25:37.506262 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b49a2e65-3a63-460f-88f9-97fb2b85ca44 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-847009-3"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:37.507832 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:37.507832 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:37.535731 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b49a2e65-3a63-460f-88f9-97fb2b85ca44 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:37.536192 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b49a2e65-3a63-460f-88f9-97fb2b85ca44 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:37.782491 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b49a2e65-3a63-460f-88f9-97fb2b85ca44 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.282312 Jul 19 22:25:37.783279 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 78/180] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Jul 19 22:25:37 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:37.795439 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cf137127-f4e3-4299-967b-edf88dad2f55 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:37.796078 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cf137127-f4e3-4299-967b-edf88dad2f55 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:37.822461 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf137127-f4e3-4299-967b-edf88dad2f55 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:37.822916 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf137127-f4e3-4299-967b-edf88dad2f55 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:37.823742 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf137127-f4e3-4299-967b-edf88dad2f55 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:37.824358 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf137127-f4e3-4299-967b-edf88dad2f55 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:37.941917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-43b64d2f-f15b-4db8-85bb-c4ab4aff2250 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:37.954831 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-43b64d2f-f15b-4db8-85bb-c4ab4aff2250 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4" status: 200 len: 1319 microversion: 2.1 time: 0.731935 Jul 19 22:25:37.957045 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 103/181] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:37 2022] GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4 => generated 1319 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:37.968126 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-043f919b-71a0-4d04-9121-6c33a138f9cb tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:37.979592 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:37.979592 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:37.994179 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-043f919b-71a0-4d04-9121-6c33a138f9cb tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.035620 Jul 19 22:25:37.998152 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 104/182] 10.222.0.25 () {58 vars in 1148 bytes} [Tue Jul 19 22:25:37 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:38.009543 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1d2aa487-1624-4397-ae00-7897fe81701b tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-847009-3"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:38.011320 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:38.011320 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:38.038085 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d2aa487-1624-4397-ae00-7897fe81701b tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:38.038553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d2aa487-1624-4397-ae00-7897fe81701b tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:38.292642 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cf137127-f4e3-4299-967b-edf88dad2f55 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:38.317501 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1d2aa487-1624-4397-ae00-7897fe81701b tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.311737 Jul 19 22:25:38.320117 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 105/183] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Jul 19 22:25:38 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:38.328814 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-99dd60d3-cfe0-4eef-a197-ef669281cf32 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:38.331031 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-99dd60d3-cfe0-4eef-a197-ef669281cf32 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:38.339221 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cf137127-f4e3-4299-967b-edf88dad2f55 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1313 microversion: 2.1 time: 0.549433 Jul 19 22:25:38.341696 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99dd60d3-cfe0-4eef-a197-ef669281cf32 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:38.342309 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99dd60d3-cfe0-4eef-a197-ef669281cf32 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:38.344319 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99dd60d3-cfe0-4eef-a197-ef669281cf32 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:38.346377 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99dd60d3-cfe0-4eef-a197-ef669281cf32 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:38.347735 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 79/184] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:37 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1313 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:38.370420 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-26f67052-230c-472b-a6ea-3ff1297d9e63 req-2ba05d1b-2711-49cd-9da0-f74b5c05374f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18dfb53a-18ce-4ad5-a226-dff0410f00eb", "tag": "c7157193-94b5-4be3-a477-21afd3984d48"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:38.392977 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-26f67052-230c-472b-a6ea-3ff1297d9e63 req-2ba05d1b-2711-49cd-9da0-f74b5c05374f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:38.395598 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-26f67052-230c-472b-a6ea-3ff1297d9e63 req-2ba05d1b-2711-49cd-9da0-f74b5c05374f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:38.430678 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-26f67052-230c-472b-a6ea-3ff1297d9e63 req-2ba05d1b-2711-49cd-9da0-f74b5c05374f service nova] Creating event network-changed:c7157193-94b5-4be3-a477-21afd3984d48 for instance 18dfb53a-18ce-4ad5-a226-dff0410f00eb on n-h1-847009-3 Jul 19 22:25:38.447094 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-26f67052-230c-472b-a6ea-3ff1297d9e63 req-2ba05d1b-2711-49cd-9da0-f74b5c05374f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096183 Jul 19 22:25:38.447984 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 80/185] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:38.478398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-726a877e-9a51-407d-9715-80be0d2c3079 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:38.479391 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:38.479391 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:38.542109 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-726a877e-9a51-407d-9715-80be0d2c3079 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.091024 Jul 19 22:25:38.543580 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 81/186] 10.222.0.25 () {58 vars in 1151 bytes} [Tue Jul 19 22:25:38 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 22:25:38.550979 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e02c1188-0605-44fd-82df-6ea776cb7ef3 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:38.553633 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e02c1188-0605-44fd-82df-6ea776cb7ef3 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: 0c5f1490-8946-4758-baa2-3eacd9b32d5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:38.567576 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e02c1188-0605-44fd-82df-6ea776cb7ef3 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:38.568265 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e02c1188-0605-44fd-82df-6ea776cb7ef3 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:38.569556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e02c1188-0605-44fd-82df-6ea776cb7ef3 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:38.570138 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e02c1188-0605-44fd-82df-6ea776cb7ef3 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:38.741006 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e02c1188-0605-44fd-82df-6ea776cb7ef3 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:38.752102 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e02c1188-0605-44fd-82df-6ea776cb7ef3 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a" status: 200 len: 1272 microversion: 2.1 time: 0.206430 Jul 19 22:25:38.753418 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 82/187] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:38 2022] GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a => generated 1272 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:38.760677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7a129ac4-a464-437f-a068-0c82040fbf77 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-404678102"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:38.762027 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:38.762027 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:38.764051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.aggregate [None req-7a129ac4-a464-437f-a068-0c82040fbf77 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Generated uuid 3b3c5eeb-5c1f-4bef-8a7c-4003019bf110 for aggregate {{(pid=119338) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 22:25:38.796473 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7a129ac4-a464-437f-a068-0c82040fbf77 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.041737 Jul 19 22:25:38.797217 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 83/188] 10.222.0.25 () {60 vars in 1163 bytes} [Tue Jul 19 22:25:38 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:38.863389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-99dd60d3-cfe0-4eef-a197-ef669281cf32 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:38.878682 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-99dd60d3-cfe0-4eef-a197-ef669281cf32 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a" status: 200 len: 1388 microversion: 2.1 time: 0.555778 Jul 19 22:25:38.879314 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 106/189] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:38 2022] GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a => generated 1388 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:38.892873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a6b121d9-f636-40d1-9505-7693ab81f297 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-847009-3"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:38.896277 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:38.896277 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:38.917161 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6b121d9-f636-40d1-9505-7693ab81f297 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:38.918148 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6b121d9-f636-40d1-9505-7693ab81f297 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:39.151150 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a6b121d9-f636-40d1-9505-7693ab81f297 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.263918 Jul 19 22:25:39.158402 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 107/190] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 19 22:25:38 2022] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:39.158402 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3d8fbf78-00e8-4932-8492-9e41e817f4a1 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:39.158687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3d8fbf78-00e8-4932-8492-9e41e817f4a1 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: b5b01010-9fd2-4092-ad1d-29edac4ecaa4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:39.168010 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d8fbf78-00e8-4932-8492-9e41e817f4a1 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:39.168392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d8fbf78-00e8-4932-8492-9e41e817f4a1 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:39.169183 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d8fbf78-00e8-4932-8492-9e41e817f4a1 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:39.169622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d8fbf78-00e8-4932-8492-9e41e817f4a1 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:39.215329 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3205be25-efcf-4ddf-9b25-c2217a9a1ec4 tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:39.216823 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:39.216823 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:39.218307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3205be25-efcf-4ddf-9b25-c2217a9a1ec4 tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:39.218868 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3205be25-efcf-4ddf-9b25-c2217a9a1ec4 tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:39.222208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3205be25-efcf-4ddf-9b25-c2217a9a1ec4 tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:39.223540 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3205be25-efcf-4ddf-9b25-c2217a9a1ec4 tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:39.294170 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3205be25-efcf-4ddf-9b25-c2217a9a1ec4 tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.495987 Jul 19 22:25:39.297420 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 84/191] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:25:38 2022] GET /compute/v2.1/os-services => generated 944 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:39.313783 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c0b35bb5-84f4-4317-b40d-19f3212d3d1f tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:39.314967 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:39.314967 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:39.323146 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=12,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:39.332210 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c0b35bb5-84f4-4317-b40d-19f3212d3d1f tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.027097 Jul 19 22:25:39.333107 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 85/192] 10.222.0.25 () {58 vars in 1142 bytes} [Tue Jul 19 22:25:39 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:39.341508 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c6f9833e-e362-495c-9c12-c32fcdbf0057 tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:39.343480 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:39.343480 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:39.345661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6f9833e-e362-495c-9c12-c32fcdbf0057 tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:39.347250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6f9833e-e362-495c-9c12-c32fcdbf0057 tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:39.348381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6f9833e-e362-495c-9c12-c32fcdbf0057 tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:39.349042 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6f9833e-e362-495c-9c12-c32fcdbf0057 tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:39.385423 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c6f9833e-e362-495c-9c12-c32fcdbf0057 tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.050382 Jul 19 22:25:39.386544 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 86/193] 10.222.0.25 () {58 vars in 1169 bytes} [Tue Jul 19 22:25:39 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:39.399405 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5d19bfcd-37f7-45ba-9d23-c900cccdfed7 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-847009-3"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:39.405044 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:39.405044 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:39.422574 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d19bfcd-37f7-45ba-9d23-c900cccdfed7 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:39.424376 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d19bfcd-37f7-45ba-9d23-c900cccdfed7 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:39.634651 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5d19bfcd-37f7-45ba-9d23-c900cccdfed7 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.246362 Jul 19 22:25:39.635290 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 87/194] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 19 22:25:39 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:39.644752 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3d8fbf78-00e8-4932-8492-9e41e817f4a1 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:39.654784 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fc7b5cc4-2d96-4e04-9957-864539435bb8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:39.655505 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fc7b5cc4-2d96-4e04-9957-864539435bb8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:39.665482 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3d8fbf78-00e8-4932-8492-9e41e817f4a1 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4" status: 200 len: 1319 microversion: 2.1 time: 0.512402 Jul 19 22:25:39.666578 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 108/195] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:39 2022] GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4 => generated 1319 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:39.667574 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc7b5cc4-2d96-4e04-9957-864539435bb8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:39.668090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc7b5cc4-2d96-4e04-9957-864539435bb8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:39.668891 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc7b5cc4-2d96-4e04-9957-864539435bb8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:39.671764 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc7b5cc4-2d96-4e04-9957-864539435bb8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:39.673118 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-93848395-0654-4a87-93fd-5b5d22b53710 tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:39.676212 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:39.676212 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:39.677927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-93848395-0654-4a87-93fd-5b5d22b53710 tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:39.679093 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-93848395-0654-4a87-93fd-5b5d22b53710 tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:39.680211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-93848395-0654-4a87-93fd-5b5d22b53710 tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:39.680970 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-93848395-0654-4a87-93fd-5b5d22b53710 tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:39.761805 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-93848395-0654-4a87-93fd-5b5d22b53710 tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.093742 Jul 19 22:25:39.764504 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 109/196] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:25:39 2022] GET /compute/v2.1/os-services => generated 944 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:39.788784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-fb76a8f2-d622-402c-b0ee-985a4ccd6bb8 req-780904fd-26de-448e-b76c-a37eb0d3f810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a", "tag": "466d0f1d-6d97-46a8-ab3c-6441661159ed"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:39.816501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-fb76a8f2-d622-402c-b0ee-985a4ccd6bb8 req-780904fd-26de-448e-b76c-a37eb0d3f810 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:39.816949 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-fb76a8f2-d622-402c-b0ee-985a4ccd6bb8 req-780904fd-26de-448e-b76c-a37eb0d3f810 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:39.829847 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-fb76a8f2-d622-402c-b0ee-985a4ccd6bb8 req-780904fd-26de-448e-b76c-a37eb0d3f810 service nova] Creating event network-changed:466d0f1d-6d97-46a8-ab3c-6441661159ed for instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a on n-h1-847009-3 Jul 19 22:25:39.835971 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-fb76a8f2-d622-402c-b0ee-985a4ccd6bb8 req-780904fd-26de-448e-b76c-a37eb0d3f810 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060348 Jul 19 22:25:39.836885 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 110/197] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:39.842701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ef3c4573-33b1-4d6c-b90b-df8f28734ecb tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:39.843791 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:39.843791 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:39.871681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=4 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:39.900613 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ef3c4573-33b1-4d6c-b90b-df8f28734ecb tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.062281 Jul 19 22:25:39.901513 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 111/198] 10.222.0.25 () {58 vars in 1154 bytes} [Tue Jul 19 22:25:39 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 22:25:39.911291 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e2f78dd0-a648-4e36-8109-9b87d25ece7e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:39.912151 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e2f78dd0-a648-4e36-8109-9b87d25ece7e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: 0c5f1490-8946-4758-baa2-3eacd9b32d5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:39.921154 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e2f78dd0-a648-4e36-8109-9b87d25ece7e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:39.921612 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e2f78dd0-a648-4e36-8109-9b87d25ece7e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:39.922407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e2f78dd0-a648-4e36-8109-9b87d25ece7e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:39.923410 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e2f78dd0-a648-4e36-8109-9b87d25ece7e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:40.040290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e2f78dd0-a648-4e36-8109-9b87d25ece7e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:40.051303 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e2f78dd0-a648-4e36-8109-9b87d25ece7e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a" status: 200 len: 1278 microversion: 2.1 time: 0.146629 Jul 19 22:25:40.065310 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 112/199] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:39 2022] GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:40.065310 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2eb925db-9be2-45df-bfb4-4bbfd20e6eba tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:40.072644 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:40.072644 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:40.074080 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2eb925db-9be2-45df-bfb4-4bbfd20e6eba tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:40.074529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2eb925db-9be2-45df-bfb4-4bbfd20e6eba tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:40.075373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2eb925db-9be2-45df-bfb4-4bbfd20e6eba tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:40.076972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2eb925db-9be2-45df-bfb4-4bbfd20e6eba tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:40.129406 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2eb925db-9be2-45df-bfb4-4bbfd20e6eba tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-847009-3&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.071461 Jul 19 22:25:40.130305 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 113/200] 10.222.0.25 () {58 vars in 1193 bytes} [Tue Jul 19 22:25:40 2022] GET /compute/v2.1/os-services?host=n-d-847009-3&binary=xxx => generated 16 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:25:40.137271 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9dfd9e86-8e7c-49bc-b468-93c604896fb6 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:40.138115 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9dfd9e86-8e7c-49bc-b468-93c604896fb6 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:40.149872 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fc7b5cc4-2d96-4e04-9957-864539435bb8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:40.159173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9dfd9e86-8e7c-49bc-b468-93c604896fb6 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:40.166440 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fc7b5cc4-2d96-4e04-9957-864539435bb8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1313 microversion: 2.1 time: 0.524453 Jul 19 22:25:40.166644 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9dfd9e86-8e7c-49bc-b468-93c604896fb6 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:40.169753 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 88/201] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:39 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1313 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:40.178839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9dfd9e86-8e7c-49bc-b468-93c604896fb6 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:40.178839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9dfd9e86-8e7c-49bc-b468-93c604896fb6 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:40.185623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-01997839-b6fc-423a-b3c4-e7cccb2342e0 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1586665916"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:40.191671 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:40.191671 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:40.194482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.aggregate [None req-01997839-b6fc-423a-b3c4-e7cccb2342e0 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Generated uuid 09fe750a-3fcf-424b-81f7-e22920bfba22 for aggregate {{(pid=119338) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 22:25:40.237665 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-01997839-b6fc-423a-b3c4-e7cccb2342e0 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.055763 Jul 19 22:25:40.238942 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 89/202] 10.222.0.25 () {60 vars in 1163 bytes} [Tue Jul 19 22:25:40 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:40.243877 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2d4e5825-4f0f-4d16-bb2e-23391328d74e tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:40.245455 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:40.245455 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:40.247248 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d4e5825-4f0f-4d16-bb2e-23391328d74e tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:40.247895 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d4e5825-4f0f-4d16-bb2e-23391328d74e tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:40.248883 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d4e5825-4f0f-4d16-bb2e-23391328d74e tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:40.249524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d4e5825-4f0f-4d16-bb2e-23391328d74e tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:40.277377 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2d4e5825-4f0f-4d16-bb2e-23391328d74e tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.037094 Jul 19 22:25:40.278221 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 90/203] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:25:40 2022] GET /compute/v2.1/os-services => generated 944 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:40.290969 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-75cbb792-7964-41ac-b08d-68383c9ca86f tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-847009-3"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:40.295102 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:40.295102 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:40.303693 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75cbb792-7964-41ac-b08d-68383c9ca86f tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:40.304145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75cbb792-7964-41ac-b08d-68383c9ca86f tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:40.307759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:40.496789 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-75cbb792-7964-41ac-b08d-68383c9ca86f tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.217191 Jul 19 22:25:40.500626 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 91/204] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 19 22:25:40 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:40.508691 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-41257615-0ee7-4fc0-a401-ae3b141e9353 tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:40.511688 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:40.511688 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:40.520063 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-41257615-0ee7-4fc0-a401-ae3b141e9353 tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:40.520850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-41257615-0ee7-4fc0-a401-ae3b141e9353 tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:40.521921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-41257615-0ee7-4fc0-a401-ae3b141e9353 tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:40.523213 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-41257615-0ee7-4fc0-a401-ae3b141e9353 tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:40.565806 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-41257615-0ee7-4fc0-a401-ae3b141e9353 tempest-ServicesAdminNegativeTestJSON-1182619653 tempest-ServicesAdminNegativeTestJSON-1182619653-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.063148 Jul 19 22:25:40.574760 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 92/205] 10.222.0.25 () {58 vars in 1197 bytes} [Tue Jul 19 22:25:40 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:25:40.587002 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b37d3818-02bf-4b18-b8cc-6810c6bbcfaa tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-847009-3"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:40.589226 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:40.589226 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:40.591078 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9dfd9e86-8e7c-49bc-b468-93c604896fb6 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:40.602584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b37d3818-02bf-4b18-b8cc-6810c6bbcfaa tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:40.603242 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b37d3818-02bf-4b18-b8cc-6810c6bbcfaa tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:40.604443 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9dfd9e86-8e7c-49bc-b468-93c604896fb6 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a" status: 200 len: 1388 microversion: 2.1 time: 0.471798 Jul 19 22:25:40.605376 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 114/206] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:40 2022] GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a => generated 1388 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:40.774128 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b37d3818-02bf-4b18-b8cc-6810c6bbcfaa tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.201408 Jul 19 22:25:40.775310 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 93/207] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 19 22:25:40 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:40.783834 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fc13ea7f-19ad-40da-b29d-37a7cfc93546 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:40.784970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fc13ea7f-19ad-40da-b29d-37a7cfc93546 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: b5b01010-9fd2-4092-ad1d-29edac4ecaa4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:40.793472 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc13ea7f-19ad-40da-b29d-37a7cfc93546 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:40.793982 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc13ea7f-19ad-40da-b29d-37a7cfc93546 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:40.794803 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc13ea7f-19ad-40da-b29d-37a7cfc93546 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:40.795100 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d8e9c2ec-65cd-4edc-b5cc-8cfeec740af7 tempest-ServicesAdminNegativeTestJSON-973968381 tempest-ServicesAdminNegativeTestJSON-973968381-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:40.795444 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc13ea7f-19ad-40da-b29d-37a7cfc93546 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:40.797586 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:40.797586 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:40.799628 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d8e9c2ec-65cd-4edc-b5cc-8cfeec740af7 tempest-ServicesAdminNegativeTestJSON-973968381 tempest-ServicesAdminNegativeTestJSON-973968381-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '3fc60be0a6d24fd4977583b17224cc44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3109d9f5eca94daca2b77c165e6fcf24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:40.801852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d8e9c2ec-65cd-4edc-b5cc-8cfeec740af7 tempest-ServicesAdminNegativeTestJSON-973968381 tempest-ServicesAdminNegativeTestJSON-973968381-project] Request method failure captured: Jul 19 22:25:40.801852 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 19 22:25:40.801852 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:25:40.801852 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:25:40.801852 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:25:40.801852 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:25:40.801852 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:25:40.801852 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:25:40.801852 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:25:40.801852 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:40.801852 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y9gc8_cpvsiMDj3kmtoVuwW93pBBnC8rntKvv9u5XkUqWfP09ZGhXpeqHXTJowTUljL805OBfISPSdUsqX6MUj-2hlJh_-A1d6WNPc5kLRWpfWCAqhTDfTAzCgbFJqZovrroSfZEUjE_iTgeJaMlbHuQ5y1EN8fnK_kfVADklcBMHc Jul 19 22:25:40.801852 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:25:40.801852 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:25:40.801852 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:25:40.801852 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:25:40.801852 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:25:40.801852 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:25:40.801852 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 3109d9f5eca94daca2b77c165e6fcf24 Jul 19 22:25:40.801852 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-973968381 Jul 19 22:25:40.801852 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:25:40.801852 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:25:40.803086 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3109d9f5eca94daca2b77c165e6fcf24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3109d9f5eca94daca2b77c165e6fcf24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3109d9f5eca94daca2b77c165e6fcf24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3109d9f5eca94daca2b77c165e6fcf24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:40.803086 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-973968381 Jul 19 22:25:40.803086 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 3109d9f5eca94daca2b77c165e6fcf24 Jul 19 22:25:40.803086 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-973968381 Jul 19 22:25:40.803086 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServicesAdminNegativeTestJSON-973968381-project Jul 19 22:25:40.803086 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:25:40.803086 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:25:40.803086 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 3fc60be0a6d24fd4977583b17224cc44 Jul 19 22:25:40.803086 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-973968381-project Jul 19 22:25:40.803086 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:25:40.803086 n-d-847009-3 devstack@n-api.service[119337]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 19 22:25:40.803086 n-d-847009-3 devstack@n-api.service[119337]: action_args: {} Jul 19 22:25:40.803772 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:40.803772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:40.803772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:40.803772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:40.803772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:40.803772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:40.803772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 22:25:40.803772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:25:40.803772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 22:25:40.803772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:25:40.803772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:40.803772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:40.803772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 19 22:25:40.803772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 19 22:25:40.803772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:25:40.803772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:25:40.803772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:25:40.803772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:25:40.803772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:25:40.804730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:25:40.804730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:25:40.804730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:25:40.804730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:25:40.804730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:25:40.804730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:25:40.804730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:25:40.804730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:25:40.804730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:25:40.804730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 19 22:25:40.804730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:40.804730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:40.804730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:40.804730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:40.804730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:40.804730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:40.804730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:25:40.804730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:25:40.804730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 19 22:25:40.804730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:40.807517 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d8e9c2ec-65cd-4edc-b5cc-8cfeec740af7 tempest-ServicesAdminNegativeTestJSON-973968381 tempest-ServicesAdminNegativeTestJSON-973968381-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:40.808555 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d8e9c2ec-65cd-4edc-b5cc-8cfeec740af7 tempest-ServicesAdminNegativeTestJSON-973968381 tempest-ServicesAdminNegativeTestJSON-973968381-project] 10.222.0.25 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.202260 Jul 19 22:25:40.813699 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 115/208] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:25:40 2022] GET /compute/v2.1/os-services => generated 112 bytes in 208 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:25:40.819268 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8403c376-15b5-4efa-9cc3-d90d82f383cc tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:40.820257 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:40.820257 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:40.849388 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8403c376-15b5-4efa-9cc3-d90d82f383cc tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.033325 Jul 19 22:25:40.851338 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 116/209] 10.222.0.25 () {58 vars in 1154 bytes} [Tue Jul 19 22:25:40 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 22:25:40.866822 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-43f94b7d-5ba7-4df8-b2f6-a3a1b37c7652 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-451046252"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:40.868517 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:40.868517 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:40.872397 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.aggregate [None req-43f94b7d-5ba7-4df8-b2f6-a3a1b37c7652 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Generated uuid 0db957de-8495-4a2f-b5b0-d3cd20d9bf55 for aggregate {{(pid=119337) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 22:25:40.905863 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-43f94b7d-5ba7-4df8-b2f6-a3a1b37c7652 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.043862 Jul 19 22:25:40.911858 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 117/210] 10.222.0.25 () {60 vars in 1163 bytes} [Tue Jul 19 22:25:40 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:40.917291 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f82ae4fb-16cd-461e-a6f9-79f5b67e1fe8 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2230427"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:40.922714 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:40.922714 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:40.923816 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.aggregate [None req-f82ae4fb-16cd-461e-a6f9-79f5b67e1fe8 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Generated uuid 53b22839-65e0-4813-bd06-ece718178217 for aggregate {{(pid=119337) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 22:25:40.990949 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f82ae4fb-16cd-461e-a6f9-79f5b67e1fe8 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.076557 Jul 19 22:25:40.993293 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 118/211] 10.222.0.25 () {60 vars in 1163 bytes} [Tue Jul 19 22:25:40 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:40.999834 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a5c6492e-9dca-48fe-96b4-538e00ba52cb tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:41.003094 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:41.003094 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:41.057027 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a5c6492e-9dca-48fe-96b4-538e00ba52cb tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.062336 Jul 19 22:25:41.062551 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 119/212] 10.222.0.25 () {58 vars in 1154 bytes} [Tue Jul 19 22:25:40 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 22:25:41.069596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7e5215a9-e446-4e99-a545-0e6f8e795090 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-847009-3"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:41.072679 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:41.072679 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:41.083988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e5215a9-e446-4e99-a545-0e6f8e795090 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:41.084622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e5215a9-e446-4e99-a545-0e6f8e795090 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:41.239531 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7e5215a9-e446-4e99-a545-0e6f8e795090 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 240 microversion: 2.1 time: 0.175446 Jul 19 22:25:41.240202 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 120/213] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 19 22:25:41 2022] POST /compute/v2.1/os-aggregates/13/action => generated 240 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:41.256388 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-edb4eb52-8f67-4f56-ba7d-b7b684c0a061 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:41.265413 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:41.265413 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:41.272687 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fc13ea7f-19ad-40da-b29d-37a7cfc93546 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:41.280260 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fc13ea7f-19ad-40da-b29d-37a7cfc93546 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4" status: 200 len: 1319 microversion: 2.1 time: 0.503671 Jul 19 22:25:41.286451 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 94/214] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:40 2022] GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4 => generated 1319 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:41.292030 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8148f4ea-cecc-477e-a7b9-77b005066fee tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:41.292613 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-edb4eb52-8f67-4f56-ba7d-b7b684c0a061 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Jul 19 22:25:41.295282 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-edb4eb52-8f67-4f56-ba7d-b7b684c0a061 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Request method failure captured: Jul 19 22:25:41.295282 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Jul 19 22:25:41.295282 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:25:41.295282 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:25:41.295282 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:25:41.295282 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:25:41.295282 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:25:41.295282 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:25:41.295282 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:25:41.295282 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:41.295282 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y81RP0Ws0mji-a5J9SW4DQISAg5gPwE-j7tTfg5g8kCmtU3azMWnDJzVj4eYxMuebWQMk58wC6rUtdx7truue0XbdnjCVrApf6-sa07RaC6XMMvRiSGppzl1uUDs2GXebeYsN7vdRKb6aVLbN4s03XnrbrU4QhVQM51cKJGHdnpefA Jul 19 22:25:41.295282 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:25:41.295282 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:25:41.295282 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:25:41.295282 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:25:41.295282 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:25:41.295282 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:25:41.295282 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: f7eee17b13f443a482ac55d0929c0939 Jul 19 22:25:41.295282 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AggregatesAdminTestJSON-402493731 Jul 19 22:25:41.295282 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:25:41.295282 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:25:41.296414 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f7eee17b13f443a482ac55d0929c0939"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7eee17b13f443a482ac55d0929c0939"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f7eee17b13f443a482ac55d0929c0939"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7eee17b13f443a482ac55d0929c0939"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:41.296414 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AggregatesAdminTestJSON-402493731 Jul 19 22:25:41.296414 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: f7eee17b13f443a482ac55d0929c0939 Jul 19 22:25:41.296414 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-402493731 Jul 19 22:25:41.296414 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AggregatesAdminTestJSON-402493731-project-admin Jul 19 22:25:41.296414 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:25:41.296414 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:25:41.296414 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 2628aefdd055487bb0135a355334c256 Jul 19 22:25:41.296414 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AggregatesAdminTestJSON-402493731-project-admin Jul 19 22:25:41.296414 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:25:41.296414 n-d-847009-3 devstack@n-api.service[119337]: exception: Aggregate 12 could not be found. Jul 19 22:25:41.296414 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '12'} Jul 19 22:25:41.296414 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:41.297120 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:41.297120 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 19 22:25:41.297120 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 19 22:25:41.297120 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 19 22:25:41.297120 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 19 22:25:41.297120 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:25:41.297120 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:25:41.297120 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 19 22:25:41.297120 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 19 22:25:41.297120 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 22:25:41.297120 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 22:25:41.297120 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 19 22:25:41.297120 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 19 22:25:41.297120 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Jul 19 22:25:41.297120 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:41.297120 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:41.297120 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:41.297120 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:41.297120 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:41.298132 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:41.298132 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:41.298132 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:41.298132 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:41.298132 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:41.298132 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 19 22:25:41.298132 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:25:41.298132 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Jul 19 22:25:41.298132 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:41.298132 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:41.298132 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:41.298132 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:41.298132 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:41.298132 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:41.298132 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:25:41.298132 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:25:41.298132 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Jul 19 22:25:41.298132 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:41.299838 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8148f4ea-cecc-477e-a7b9-77b005066fee tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: 0c5f1490-8946-4758-baa2-3eacd9b32d5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:41.302062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-edb4eb52-8f67-4f56-ba7d-b7b684c0a061 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:41.303206 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-edb4eb52-8f67-4f56-ba7d-b7b684c0a061 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.061882 Jul 19 22:25:41.303987 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 121/215] 10.222.0.25 () {58 vars in 1151 bytes} [Tue Jul 19 22:25:41 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:25:41.310457 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8148f4ea-cecc-477e-a7b9-77b005066fee tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:41.310639 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-47b284a1-1a40-41c5-b50e-675b5ae69417 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:41.310912 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8148f4ea-cecc-477e-a7b9-77b005066fee tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:41.311757 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8148f4ea-cecc-477e-a7b9-77b005066fee tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:41.312175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8148f4ea-cecc-477e-a7b9-77b005066fee tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:41.317795 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-47b284a1-1a40-41c5-b50e-675b5ae69417 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:41.324963 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-47b284a1-1a40-41c5-b50e-675b5ae69417 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:41.326200 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-47b284a1-1a40-41c5-b50e-675b5ae69417 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:41.329049 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-47b284a1-1a40-41c5-b50e-675b5ae69417 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:41.332206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-47b284a1-1a40-41c5-b50e-675b5ae69417 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:42.062638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8148f4ea-cecc-477e-a7b9-77b005066fee tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:42.083514 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-47b284a1-1a40-41c5-b50e-675b5ae69417 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:42.104912 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8148f4ea-cecc-477e-a7b9-77b005066fee tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a" status: 200 len: 1320 microversion: 2.1 time: 0.816661 Jul 19 22:25:42.108629 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:42.111365 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 95/216] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:41 2022] GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a => generated 1320 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:42.118587 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-47b284a1-1a40-41c5-b50e-675b5ae69417 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1313 microversion: 2.1 time: 0.813159 Jul 19 22:25:42.119681 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 122/217] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:41 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1313 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:42.125004 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0eb6c50c-607a-4370-b6de-98893ef03cba tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-847009-3"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:42.129055 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:42.129055 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:42.136318 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0eb6c50c-607a-4370-b6de-98893ef03cba tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '4cfacbfbca68443d944d60a09ca94ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcb9b5f20f14968b56ac51fc90b7a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:42.136840 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-56cf6129-4cde-454b-ab85-1589f2c2e534 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:42.137967 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:42.137967 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:42.138331 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0eb6c50c-607a-4370-b6de-98893ef03cba tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] Request method failure captured: Jul 19 22:25:42.138331 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Jul 19 22:25:42.138331 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:25:42.138331 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:25:42.138331 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:25:42.138331 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 42 Jul 19 22:25:42.138331 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:25:42.138331 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:25:42.138331 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:25:42.138331 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:42.138331 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y8zlaeR4rkXAoUxmG4nY36-53G1oISDPY9pdB6vyXUUfPLrQhqp4U-nubLjYRLoSTKTIqYyZ4JBtFHXAdGaZ2W8gCVJwxLC0D3vL02qzGQN6WZVu5Vt3fnlUQiDfr4-rjH9x2KUeQ7aGy8EvA8xoG5pLwdW_2QRt85n9rcqjHCmYSA Jul 19 22:25:42.138331 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:25:42.138331 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:25:42.138331 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:25:42.138331 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:25:42.138331 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:25:42.138331 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:25:42.138331 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: fbcb9b5f20f14968b56ac51fc90b7a24 Jul 19 22:25:42.138331 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-56836165 Jul 19 22:25:42.138331 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:25:42.138331 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:25:42.139513 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fbcb9b5f20f14968b56ac51fc90b7a24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fbcb9b5f20f14968b56ac51fc90b7a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fbcb9b5f20f14968b56ac51fc90b7a24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fbcb9b5f20f14968b56ac51fc90b7a24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:42.139513 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-56836165 Jul 19 22:25:42.139513 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: fbcb9b5f20f14968b56ac51fc90b7a24 Jul 19 22:25:42.139513 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-56836165 Jul 19 22:25:42.139513 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-AggregatesAdminNegativeTestJSON-56836165-project Jul 19 22:25:42.139513 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:25:42.139513 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:25:42.139513 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 4cfacbfbca68443d944d60a09ca94ed2 Jul 19 22:25:42.139513 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-56836165-project Jul 19 22:25:42.139513 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:25:42.139513 n-d-847009-3 devstack@n-api.service[119338]: {"remove_host": {"host": "n-h2-847009-3"}} Jul 19 22:25:42.139513 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:25:42.139513 n-d-847009-3 devstack@n-api.service[119338]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 19 22:25:42.140317 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h2-847009-3'}}} Jul 19 22:25:42.140317 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:42.140317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:42.140317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:42.140317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:42.140317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:42.140317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:42.140317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:42.140317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:42.140317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:25:42.140317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:25:42.140317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 19 22:25:42.140317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 19 22:25:42.140317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:25:42.140317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:25:42.140317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:25:42.140317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:25:42.140317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:25:42.140317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:25:42.145300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:25:42.145300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:25:42.145300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:25:42.145300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:25:42.145300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:25:42.145300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:25:42.145300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:25:42.145300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:25:42.145300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 19 22:25:42.145300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:42.145300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:42.145300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:42.145300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:42.145300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:42.145300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:42.145300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:25:42.145300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:25:42.145300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 19 22:25:42.145300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:42.146387 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0eb6c50c-607a-4370-b6de-98893ef03cba tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:42.146387 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0eb6c50c-607a-4370-b6de-98893ef03cba tempest-AggregatesAdminNegativeTestJSON-56836165 tempest-AggregatesAdminNegativeTestJSON-56836165-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.024048 Jul 19 22:25:42.146387 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 96/218] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 19 22:25:42 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:25:42.148036 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cf9b9845-98da-47dd-ad72-2fad0c97a69d tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:42.148662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cf9b9845-98da-47dd-ad72-2fad0c97a69d tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:42.158890 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf9b9845-98da-47dd-ad72-2fad0c97a69d tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:42.159370 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf9b9845-98da-47dd-ad72-2fad0c97a69d tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:42.160165 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf9b9845-98da-47dd-ad72-2fad0c97a69d tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:42.160608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf9b9845-98da-47dd-ad72-2fad0c97a69d tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:42.161101 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-56cf6129-4cde-454b-ab85-1589f2c2e534 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Jul 19 22:25:42.163584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-56cf6129-4cde-454b-ab85-1589f2c2e534 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Request method failure captured: Jul 19 22:25:42.163584 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Jul 19 22:25:42.163584 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:25:42.163584 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:25:42.163584 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:25:42.163584 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:25:42.163584 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:25:42.163584 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:25:42.163584 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:25:42.163584 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:42.163584 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y81RP0Ws0mji-a5J9SW4DQISAg5gPwE-j7tTfg5g8kCmtU3azMWnDJzVj4eYxMuebWQMk58wC6rUtdx7truue0XbdnjCVrApf6-sa07RaC6XMMvRiSGppzl1uUDs2GXebeYsN7vdRKb6aVLbN4s03XnrbrU4QhVQM51cKJGHdnpefA Jul 19 22:25:42.163584 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:25:42.163584 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:25:42.163584 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:25:42.163584 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:25:42.163584 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:25:42.163584 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:25:42.163584 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: f7eee17b13f443a482ac55d0929c0939 Jul 19 22:25:42.163584 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AggregatesAdminTestJSON-402493731 Jul 19 22:25:42.163584 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:25:42.163584 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:25:42.164877 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f7eee17b13f443a482ac55d0929c0939"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7eee17b13f443a482ac55d0929c0939"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f7eee17b13f443a482ac55d0929c0939"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7eee17b13f443a482ac55d0929c0939"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:42.164877 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AggregatesAdminTestJSON-402493731 Jul 19 22:25:42.164877 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: f7eee17b13f443a482ac55d0929c0939 Jul 19 22:25:42.164877 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-402493731 Jul 19 22:25:42.164877 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AggregatesAdminTestJSON-402493731-project-admin Jul 19 22:25:42.164877 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:25:42.164877 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:25:42.164877 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 2628aefdd055487bb0135a355334c256 Jul 19 22:25:42.164877 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AggregatesAdminTestJSON-402493731-project-admin Jul 19 22:25:42.164877 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:25:42.164877 n-d-847009-3 devstack@n-api.service[119337]: exception: Aggregate 12 could not be found. Jul 19 22:25:42.164877 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '12'} Jul 19 22:25:42.164877 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:42.165552 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:42.165552 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 19 22:25:42.165552 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 19 22:25:42.165552 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 22:25:42.165552 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 22:25:42.165552 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:25:42.165552 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:25:42.165552 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:25:42.165552 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:25:42.165552 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 22:25:42.165552 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 22:25:42.165552 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 19 22:25:42.165552 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 19 22:25:42.165552 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:25:42.165552 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:25:42.165552 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 19 22:25:42.165552 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 19 22:25:42.165552 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 22:25:42.165552 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 22:25:42.166777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 19 22:25:42.166777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 19 22:25:42.166777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Jul 19 22:25:42.166777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:42.166777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:42.166777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:42.166777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:42.166777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:42.166777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:42.166777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:42.166777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:42.166777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:42.166777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:42.166777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 19 22:25:42.166777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:25:42.166777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Jul 19 22:25:42.166777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:42.166777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:42.166777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:42.166777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:42.166777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:42.168141 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:42.168141 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:25:42.168141 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:25:42.168141 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Jul 19 22:25:42.168141 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:42.171529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-56cf6129-4cde-454b-ab85-1589f2c2e534 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:42.172883 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-56cf6129-4cde-454b-ab85-1589f2c2e534 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.040055 Jul 19 22:25:42.174661 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 123/219] 10.222.0.25 () {58 vars in 1154 bytes} [Tue Jul 19 22:25:42 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:25:42.183375 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-c41e5213-53d9-4bcd-95d9-41cb6187a117 req-42094744-5a61-49a6-ab51-354a0993ce36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5b01010-9fd2-4092-ad1d-29edac4ecaa4", "tag": "af2c8e0c-cf95-4771-afa6-6ab97dd37a99"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:42.195752 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-c41e5213-53d9-4bcd-95d9-41cb6187a117 req-42094744-5a61-49a6-ab51-354a0993ce36 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:42.197092 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-c41e5213-53d9-4bcd-95d9-41cb6187a117 req-42094744-5a61-49a6-ab51-354a0993ce36 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:42.233143 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-c41e5213-53d9-4bcd-95d9-41cb6187a117 req-42094744-5a61-49a6-ab51-354a0993ce36 service nova] Creating event network-changed:af2c8e0c-cf95-4771-afa6-6ab97dd37a99 for instance b5b01010-9fd2-4092-ad1d-29edac4ecaa4 on n-h2-847009-3 Jul 19 22:25:42.246237 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-c41e5213-53d9-4bcd-95d9-41cb6187a117 req-42094744-5a61-49a6-ab51-354a0993ce36 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069943 Jul 19 22:25:42.246854 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 124/220] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:42.260730 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-53526195-8fcc-4790-95d3-bdb003521a62 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-847009-3"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:42.262084 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:42.262084 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:42.273983 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-53526195-8fcc-4790-95d3-bdb003521a62 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:42.274628 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-53526195-8fcc-4790-95d3-bdb003521a62 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:42.441950 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-53526195-8fcc-4790-95d3-bdb003521a62 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 225 microversion: 2.1 time: 0.185363 Jul 19 22:25:42.442954 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 125/221] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 19 22:25:42 2022] POST /compute/v2.1/os-aggregates/13/action => generated 225 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:42.456258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5bb34c29-ab3a-44d1-931f-ca52d5fb7a43 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-736233296", "name": "tempest-test_aggregate-1036383479"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:42.481740 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:42.481740 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:42.482942 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.aggregate [None req-5bb34c29-ab3a-44d1-931f-ca52d5fb7a43 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Generated uuid 28c172e4-ccad-4958-bfe4-e15ff944e567 for aggregate {{(pid=119337) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 22:25:42.546144 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5bb34c29-ab3a-44d1-931f-ca52d5fb7a43 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.093866 Jul 19 22:25:42.549044 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 126/222] 10.222.0.25 () {60 vars in 1164 bytes} [Tue Jul 19 22:25:42 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:42.558413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-49cdba2b-ce88-4697-a06c-04cca78876d1 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:42.560773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-49cdba2b-ce88-4697-a06c-04cca78876d1 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: b5b01010-9fd2-4092-ad1d-29edac4ecaa4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:42.588433 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49cdba2b-ce88-4697-a06c-04cca78876d1 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:42.589241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49cdba2b-ce88-4697-a06c-04cca78876d1 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:42.590453 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49cdba2b-ce88-4697-a06c-04cca78876d1 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:42.590952 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49cdba2b-ce88-4697-a06c-04cca78876d1 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:42.629642 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cf9b9845-98da-47dd-ad72-2fad0c97a69d tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:42.648474 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cf9b9845-98da-47dd-ad72-2fad0c97a69d tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a" status: 200 len: 1388 microversion: 2.1 time: 0.507100 Jul 19 22:25:42.666766 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 97/223] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:42 2022] GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a => generated 1388 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:42.686424 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0e05b70b-e19a-406e-a94f-863af24c8a88 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:42.689677 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:42.689677 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:42.787941 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0e05b70b-e19a-406e-a94f-863af24c8a88 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.118811 Jul 19 22:25:42.794666 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 98/224] 10.222.0.25 () {58 vars in 1154 bytes} [Tue Jul 19 22:25:42 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 22:25:42.805933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-64bb3f29-9531-4c43-aa70-25ad6478326e tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:42.806768 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:42.806768 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:42.883625 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-64bb3f29-9531-4c43-aa70-25ad6478326e tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.092280 Jul 19 22:25:42.896323 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 99/225] 10.222.0.25 () {58 vars in 1154 bytes} [Tue Jul 19 22:25:42 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 22:25:42.906291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-21f70ef4-ed4c-4066-98b6-fd86d68f1672 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1627962332"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:42.908419 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:42.908419 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:42.909584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.aggregate [None req-21f70ef4-ed4c-4066-98b6-fd86d68f1672 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Generated uuid 6f4af420-58bb-400a-a365-29f618a90156 for aggregate {{(pid=119338) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 22:25:42.952189 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-21f70ef4-ed4c-4066-98b6-fd86d68f1672 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.054587 Jul 19 22:25:42.955733 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 100/226] 10.222.0.25 () {60 vars in 1163 bytes} [Tue Jul 19 22:25:42 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:42.969027 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f0e0ff02-5e16-4896-9f50-9382bcd98a8b tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:42.971861 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:42.971861 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:42.990010 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-f0e0ff02-5e16-4896-9f50-9382bcd98a8b tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jul 19 22:25:42.994732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f0e0ff02-5e16-4896-9f50-9382bcd98a8b tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Request method failure captured: Jul 19 22:25:42.994732 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Jul 19 22:25:42.994732 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:25:42.994732 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:25:42.994732 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:25:42.994732 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:25:42.994732 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:25:42.994732 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:25:42.994732 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:25:42.994732 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:42.994732 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y81RP0Ws0mji-a5J9SW4DQISAg5gPwE-j7tTfg5g8kCmtU3azMWnDJzVj4eYxMuebWQMk58wC6rUtdx7truue0XbdnjCVrApf6-sa07RaC6XMMvRiSGppzl1uUDs2GXebeYsN7vdRKb6aVLbN4s03XnrbrU4QhVQM51cKJGHdnpefA Jul 19 22:25:42.994732 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:25:42.994732 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:25:42.994732 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:25:42.994732 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:25:42.994732 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:25:42.994732 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:25:42.994732 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: f7eee17b13f443a482ac55d0929c0939 Jul 19 22:25:42.994732 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-AggregatesAdminTestJSON-402493731 Jul 19 22:25:42.994732 n-d-847009-3 devstack@n-api.service[119338]: X-Role: admin,member,reader Jul 19 22:25:42.994732 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: admin,member,reader Jul 19 22:25:42.996341 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f7eee17b13f443a482ac55d0929c0939"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7eee17b13f443a482ac55d0929c0939"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f7eee17b13f443a482ac55d0929c0939"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7eee17b13f443a482ac55d0929c0939"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:42.996341 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-AggregatesAdminTestJSON-402493731 Jul 19 22:25:42.996341 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: f7eee17b13f443a482ac55d0929c0939 Jul 19 22:25:42.996341 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-402493731 Jul 19 22:25:42.996341 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-AggregatesAdminTestJSON-402493731-project-admin Jul 19 22:25:42.996341 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:25:42.996341 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:25:42.996341 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 2628aefdd055487bb0135a355334c256 Jul 19 22:25:42.996341 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-AggregatesAdminTestJSON-402493731-project-admin Jul 19 22:25:42.996341 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:25:42.996341 n-d-847009-3 devstack@n-api.service[119338]: exception: Aggregate 14 could not be found. Jul 19 22:25:42.996341 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '14'} Jul 19 22:25:42.996341 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:42.997035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:42.997035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 19 22:25:42.997035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 19 22:25:42.997035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 19 22:25:42.997035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 19 22:25:42.997035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:25:42.997035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:25:42.997035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 19 22:25:42.997035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 19 22:25:42.997035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 22:25:42.997035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 22:25:42.997035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 19 22:25:42.997035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 19 22:25:42.997035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jul 19 22:25:42.997035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:42.997035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:42.997035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:42.997035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:42.997035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:42.998129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:42.998129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:42.998129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:42.998129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:42.998129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:42.998129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 19 22:25:42.998129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:25:42.998129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jul 19 22:25:42.998129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:42.998129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:42.998129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:42.998129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:42.998129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:42.998129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:42.998129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:25:42.998129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:25:42.998129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jul 19 22:25:42.998129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:42.999099 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f0e0ff02-5e16-4896-9f50-9382bcd98a8b tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:42.999099 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f0e0ff02-5e16-4896-9f50-9382bcd98a8b tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.040428 Jul 19 22:25:42.999099 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 101/227] 10.222.0.25 () {58 vars in 1151 bytes} [Tue Jul 19 22:25:42 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:25:43.017844 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-29306f34-ec98-43a1-8d89-9536d0790026 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:43.019962 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:43.019962 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:43.041135 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29306f34-ec98-43a1-8d89-9536d0790026 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:43.042803 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29306f34-ec98-43a1-8d89-9536d0790026 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:43.055373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29306f34-ec98-43a1-8d89-9536d0790026 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:43.056057 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29306f34-ec98-43a1-8d89-9536d0790026 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:43.066306 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.compute.aggregates [None req-29306f34-ec98-43a1-8d89-9536d0790026 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 19 22:25:43.067058 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-29306f34-ec98-43a1-8d89-9536d0790026 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Jul 19 22:25:43.069813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-29306f34-ec98-43a1-8d89-9536d0790026 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Request method failure captured: Jul 19 22:25:43.069813 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Jul 19 22:25:43.069813 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:25:43.069813 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:25:43.069813 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:25:43.069813 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 42 Jul 19 22:25:43.069813 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:25:43.069813 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:25:43.069813 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:25:43.069813 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:43.069813 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y81Qs9JvaAZnrS4VbNUHxxjUFQE7JtDZIbISYxrWDTHdy8rIWodbqWizg6UVSK1Q3r9K5pTr-Anomm7iYDlZitnwUfb6vWTOmOK63iGS2yq2Kw5it3fuIyk8WaGJfLPNhRwsg01AOX91Z7vnzPzc0eGX4iDhbbMeNbvN28thNsgcXE Jul 19 22:25:43.069813 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:25:43.069813 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:25:43.069813 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:25:43.069813 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:25:43.069813 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:25:43.069813 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:25:43.069813 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: e6146daaf5e6495bb32f49b6c1b7d9ba Jul 19 22:25:43.069813 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-586313377 Jul 19 22:25:43.069813 n-d-847009-3 devstack@n-api.service[119338]: X-Role: admin,member,reader Jul 19 22:25:43.069813 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: admin,member,reader Jul 19 22:25:43.071274 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e6146daaf5e6495bb32f49b6c1b7d9ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:43.071274 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-586313377 Jul 19 22:25:43.071274 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: e6146daaf5e6495bb32f49b6c1b7d9ba Jul 19 22:25:43.071274 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-586313377 Jul 19 22:25:43.071274 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin Jul 19 22:25:43.071274 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:25:43.071274 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:25:43.071274 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 04fe391b67c14afeb3adf9e7540481e8 Jul 19 22:25:43.071274 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin Jul 19 22:25:43.071274 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:25:43.071274 n-d-847009-3 devstack@n-api.service[119338]: {"remove_host": {"host": "nonexist_host"}} Jul 19 22:25:43.071274 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:25:43.071274 n-d-847009-3 devstack@n-api.service[119338]: exception: Cannot remove host nonexist_host in aggregate 15 Jul 19 22:25:43.072125 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 19 22:25:43.072125 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:43.072125 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:43.072125 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 19 22:25:43.072125 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 19 22:25:43.072125 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:25:43.072125 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:25:43.072125 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 19 22:25:43.072125 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 19 22:25:43.072125 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 22:25:43.072125 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 22:25:43.072125 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 19 22:25:43.072125 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 19 22:25:43.072125 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 19 22:25:43.072125 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:43.072125 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:43.072125 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:43.072125 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:43.072125 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 19 22:25:43.072125 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 19 22:25:43.073374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 19 22:25:43.073374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 19 22:25:43.073374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 19 22:25:43.073374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:43.073374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:43.073374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:43.073374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:43.073374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 19 22:25:43.073374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 19 22:25:43.073374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 22:25:43.073374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 22:25:43.073374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:25:43.073374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:25:43.073374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:25:43.073374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:25:43.073374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 22:25:43.073374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 22:25:43.073374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jul 19 22:25:43.073374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 19 22:25:43.073374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 19 22:25:43.076206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 19 22:25:43.076206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 19 22:25:43.076206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:43.076206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:43.076206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:43.076206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:43.076206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:43.076206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:43.076206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:43.076206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:43.076206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:43.076206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:43.076206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:25:43.076206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:25:43.076206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 19 22:25:43.076206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 22:25:43.076206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Jul 19 22:25:43.076206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:43.076206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:43.076206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:43.076206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:43.078317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:43.078317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:43.078317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:25:43.078317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:25:43.078317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Jul 19 22:25:43.078317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:43.080578 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-29306f34-ec98-43a1-8d89-9536d0790026 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:43.081677 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-29306f34-ec98-43a1-8d89-9536d0790026 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.075301 Jul 19 22:25:43.086179 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 102/228] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 19 22:25:42 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:25:43.093735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-147076a4-9faa-47a2-928b-17babfd80df4 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:43.098261 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:43.098261 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:43.118766 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-147076a4-9faa-47a2-928b-17babfd80df4 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jul 19 22:25:43.121233 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-147076a4-9faa-47a2-928b-17babfd80df4 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Request method failure captured: Jul 19 22:25:43.121233 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Jul 19 22:25:43.121233 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:25:43.121233 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:25:43.121233 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:25:43.121233 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:25:43.121233 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:25:43.121233 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:25:43.121233 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:25:43.121233 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:43.121233 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y81RP0Ws0mji-a5J9SW4DQISAg5gPwE-j7tTfg5g8kCmtU3azMWnDJzVj4eYxMuebWQMk58wC6rUtdx7truue0XbdnjCVrApf6-sa07RaC6XMMvRiSGppzl1uUDs2GXebeYsN7vdRKb6aVLbN4s03XnrbrU4QhVQM51cKJGHdnpefA Jul 19 22:25:43.121233 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:25:43.121233 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:25:43.121233 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:25:43.121233 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:25:43.121233 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:25:43.121233 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:25:43.121233 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: f7eee17b13f443a482ac55d0929c0939 Jul 19 22:25:43.121233 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-AggregatesAdminTestJSON-402493731 Jul 19 22:25:43.121233 n-d-847009-3 devstack@n-api.service[119338]: X-Role: admin,member,reader Jul 19 22:25:43.121233 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: admin,member,reader Jul 19 22:25:43.122519 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f7eee17b13f443a482ac55d0929c0939"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7eee17b13f443a482ac55d0929c0939"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f7eee17b13f443a482ac55d0929c0939"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7eee17b13f443a482ac55d0929c0939"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:43.122519 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-AggregatesAdminTestJSON-402493731 Jul 19 22:25:43.122519 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: f7eee17b13f443a482ac55d0929c0939 Jul 19 22:25:43.122519 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-402493731 Jul 19 22:25:43.122519 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-AggregatesAdminTestJSON-402493731-project-admin Jul 19 22:25:43.122519 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:25:43.122519 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:25:43.122519 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 2628aefdd055487bb0135a355334c256 Jul 19 22:25:43.122519 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-AggregatesAdminTestJSON-402493731-project-admin Jul 19 22:25:43.122519 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:25:43.122519 n-d-847009-3 devstack@n-api.service[119338]: exception: Aggregate 14 could not be found. Jul 19 22:25:43.122519 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '14'} Jul 19 22:25:43.122519 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:43.123292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:43.123292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 19 22:25:43.123292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 19 22:25:43.123292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 22:25:43.123292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 22:25:43.123292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:25:43.123292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:25:43.123292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:25:43.123292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:25:43.123292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 22:25:43.123292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 22:25:43.123292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 19 22:25:43.123292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 19 22:25:43.123292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:25:43.123292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:25:43.123292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 19 22:25:43.123292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 19 22:25:43.123292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 22:25:43.123292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 22:25:43.124313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 19 22:25:43.124313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 19 22:25:43.124313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jul 19 22:25:43.124313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:43.124313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:43.124313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:43.124313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:43.124313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:43.124313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:43.124313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:43.124313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:43.124313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:43.124313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:43.124313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 19 22:25:43.124313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:25:43.124313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jul 19 22:25:43.124313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:43.124313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:43.124313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:43.124313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:43.124313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:43.125424 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:43.125424 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:25:43.125424 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:25:43.125424 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jul 19 22:25:43.125424 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:43.125424 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-147076a4-9faa-47a2-928b-17babfd80df4 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:43.125424 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-147076a4-9faa-47a2-928b-17babfd80df4 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.035531 Jul 19 22:25:43.129299 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 103/229] 10.222.0.25 () {58 vars in 1154 bytes} [Tue Jul 19 22:25:43 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:25:43.137033 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b7af3dbe-f180-45e6-8898-6edc2dee5ef4 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:43.181065 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b7af3dbe-f180-45e6-8898-6edc2dee5ef4 tempest-AggregatesAdminNegativeTestJSON-586313377 tempest-AggregatesAdminNegativeTestJSON-586313377-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.049588 Jul 19 22:25:43.187943 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 104/230] 10.222.0.25 () {58 vars in 1154 bytes} [Tue Jul 19 22:25:43 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 22:25:43.196183 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-56080bb2-1f40-4b46-a797-db012035a0aa tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:43.197039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-56080bb2-1f40-4b46-a797-db012035a0aa tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: 0c5f1490-8946-4758-baa2-3eacd9b32d5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:43.207425 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56080bb2-1f40-4b46-a797-db012035a0aa tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:43.208236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56080bb2-1f40-4b46-a797-db012035a0aa tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:43.209283 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56080bb2-1f40-4b46-a797-db012035a0aa tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:43.209867 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56080bb2-1f40-4b46-a797-db012035a0aa tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:43.405173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-49cdba2b-ce88-4697-a06c-04cca78876d1 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:43.448314 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-49cdba2b-ce88-4697-a06c-04cca78876d1 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4" status: 200 len: 1319 microversion: 2.1 time: 0.898012 Jul 19 22:25:43.450813 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 127/231] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:42 2022] GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4 => generated 1319 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:43.466117 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b1401d2f-54b0-4982-b681-dde6c76e744d tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1278506503"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:43.472879 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:43.472879 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:43.478343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.aggregate [None req-b1401d2f-54b0-4982-b681-dde6c76e744d tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Generated uuid b5ed20aa-a5cb-4d80-aa5b-6c99eef11f2f for aggregate {{(pid=119337) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 22:25:43.563388 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b1401d2f-54b0-4982-b681-dde6c76e744d tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.104674 Jul 19 22:25:43.563581 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 128/232] 10.222.0.25 () {60 vars in 1163 bytes} [Tue Jul 19 22:25:43 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:43.578233 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-901a33a4-c1de-4391-be77-90b13d491f51 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:43.581304 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-901a33a4-c1de-4391-be77-90b13d491f51 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:43.598308 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-901a33a4-c1de-4391-be77-90b13d491f51 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:43.602544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-901a33a4-c1de-4391-be77-90b13d491f51 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:43.606291 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-901a33a4-c1de-4391-be77-90b13d491f51 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:43.606747 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-901a33a4-c1de-4391-be77-90b13d491f51 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:43.908804 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-56080bb2-1f40-4b46-a797-db012035a0aa tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:43.928271 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-56080bb2-1f40-4b46-a797-db012035a0aa tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a" status: 200 len: 1320 microversion: 2.1 time: 0.738844 Jul 19 22:25:43.928878 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 105/233] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:43 2022] GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a => generated 1320 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:43.943486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6e685a4a-0953-4133-908c-ef4d2fca710c tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:43.945240 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:43.945240 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:43.984265 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6e685a4a-0953-4133-908c-ef4d2fca710c tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.053461 Jul 19 22:25:43.984870 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 106/234] 10.222.0.25 () {58 vars in 1151 bytes} [Tue Jul 19 22:25:43 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:44.021447 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d27c0d71-6000-4da1-b22b-e11239e8d86b tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:44.022078 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d27c0d71-6000-4da1-b22b-e11239e8d86b tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:44.045692 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d27c0d71-6000-4da1-b22b-e11239e8d86b tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:44.046837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d27c0d71-6000-4da1-b22b-e11239e8d86b tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:44.047759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d27c0d71-6000-4da1-b22b-e11239e8d86b tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:44.048235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d27c0d71-6000-4da1-b22b-e11239e8d86b tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:44.286436 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-901a33a4-c1de-4391-be77-90b13d491f51 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:44.300218 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-901a33a4-c1de-4391-be77-90b13d491f51 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1313 microversion: 2.1 time: 0.732895 Jul 19 22:25:44.301465 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 129/235] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:43 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1313 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:44.307334 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-11a7dbe3-4b2c-4d2c-9e01-d355c209e20d tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:44.309765 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:44.309765 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:44.350449 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-11a7dbe3-4b2c-4d2c-9e01-d355c209e20d tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.047317 Jul 19 22:25:44.353123 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 130/236] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 19 22:25:44 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:44.366696 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-a31dc1b3-9dee-4429-8ec9-3a5088f9dbb7 req-569215ac-2527-40b8-8484-eb30b3ef53d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c5f1490-8946-4758-baa2-3eacd9b32d5a", "tag": "6366737f-b1f3-4ca4-94f8-95967a79d789"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:44.390052 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a31dc1b3-9dee-4429-8ec9-3a5088f9dbb7 req-569215ac-2527-40b8-8484-eb30b3ef53d1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:44.390541 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a31dc1b3-9dee-4429-8ec9-3a5088f9dbb7 req-569215ac-2527-40b8-8484-eb30b3ef53d1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:44.436394 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-a31dc1b3-9dee-4429-8ec9-3a5088f9dbb7 req-569215ac-2527-40b8-8484-eb30b3ef53d1 service nova] Creating event network-changed:6366737f-b1f3-4ca4-94f8-95967a79d789 for instance 0c5f1490-8946-4758-baa2-3eacd9b32d5a on n-h2-847009-3 Jul 19 22:25:44.447163 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-a31dc1b3-9dee-4429-8ec9-3a5088f9dbb7 req-569215ac-2527-40b8-8484-eb30b3ef53d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092278 Jul 19 22:25:44.450776 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 131/237] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:44.463620 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-23a96d70-28dd-4c84-82b3-f534c536aa92 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:44.465817 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:44.465817 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:44.481097 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-23a96d70-28dd-4c84-82b3-f534c536aa92 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.028406 Jul 19 22:25:44.481681 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 132/238] 10.222.0.25 () {58 vars in 1151 bytes} [Tue Jul 19 22:25:44 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:44.487757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d2a56912-6015-4191-8b18-d89c94abb9c0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:44.488795 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d2a56912-6015-4191-8b18-d89c94abb9c0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: b5b01010-9fd2-4092-ad1d-29edac4ecaa4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:44.495841 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d2a56912-6015-4191-8b18-d89c94abb9c0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:44.496773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d2a56912-6015-4191-8b18-d89c94abb9c0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:44.498335 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d2a56912-6015-4191-8b18-d89c94abb9c0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:44.499044 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d2a56912-6015-4191-8b18-d89c94abb9c0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:45.122007 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d27c0d71-6000-4da1-b22b-e11239e8d86b tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:45.131473 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d27c0d71-6000-4da1-b22b-e11239e8d86b tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a" status: 200 len: 1388 microversion: 2.1 time: 1.127015 Jul 19 22:25:45.134220 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 107/239] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:43 2022] GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a => generated 1388 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:45.145767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-efca095c-418e-4384-9b6b-cc7f5618f1c6 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:45.147420 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:45.147420 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:45.197670 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-efca095c-418e-4384-9b6b-cc7f5618f1c6 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.062157 Jul 19 22:25:45.199724 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 108/240] 10.222.0.25 () {58 vars in 1154 bytes} [Tue Jul 19 22:25:45 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 22:25:45.208973 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2db3ed65-f5a1-4179-a83e-d2184c2888e7 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:45.209895 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2db3ed65-f5a1-4179-a83e-d2184c2888e7 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: 0c5f1490-8946-4758-baa2-3eacd9b32d5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:45.228995 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2db3ed65-f5a1-4179-a83e-d2184c2888e7 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:45.238766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2db3ed65-f5a1-4179-a83e-d2184c2888e7 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:45.239895 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2db3ed65-f5a1-4179-a83e-d2184c2888e7 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:45.240521 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2db3ed65-f5a1-4179-a83e-d2184c2888e7 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:45.946488 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d2a56912-6015-4191-8b18-d89c94abb9c0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:45.973375 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d2a56912-6015-4191-8b18-d89c94abb9c0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4" status: 200 len: 1319 microversion: 2.1 time: 1.485120 Jul 19 22:25:45.975913 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 133/241] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:44 2022] GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4 => generated 1319 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:45.989285 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4d94b07e-6593-4385-a99b-8b022a3d99be tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-706097934", "availability_zone": "tempest-test_az-384124479"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:45.992337 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:45.992337 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:45.993967 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.aggregate [None req-4d94b07e-6593-4385-a99b-8b022a3d99be tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Generated uuid d6ae371a-6173-4ae3-b40c-6dc0acd6ea97 for aggregate {{(pid=119337) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 22:25:46.035159 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4d94b07e-6593-4385-a99b-8b022a3d99be tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.056835 Jul 19 22:25:46.038385 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 134/242] 10.222.0.25 () {60 vars in 1164 bytes} [Tue Jul 19 22:25:45 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:46.050622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fff05b3e-44d2-45b9-9a72-3b261bdf45d4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:46.052503 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fff05b3e-44d2-45b9-9a72-3b261bdf45d4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:46.064895 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fff05b3e-44d2-45b9-9a72-3b261bdf45d4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:46.066172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fff05b3e-44d2-45b9-9a72-3b261bdf45d4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:46.067928 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fff05b3e-44d2-45b9-9a72-3b261bdf45d4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:46.069172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fff05b3e-44d2-45b9-9a72-3b261bdf45d4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:46.086021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2db3ed65-f5a1-4179-a83e-d2184c2888e7 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:46.100998 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2db3ed65-f5a1-4179-a83e-d2184c2888e7 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a" status: 200 len: 1320 microversion: 2.1 time: 0.899753 Jul 19 22:25:46.101671 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 109/243] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:45 2022] GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a => generated 1320 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:46.132437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-7d1e628c-7b87-4254-a474-7007f2bcd265 req-341af779-d27a-445c-83c5-72b5c8fb8e04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18dfb53a-18ce-4ad5-a226-dff0410f00eb", "name": "network-vif-plugged", "status": "completed", "tag": "c7157193-94b5-4be3-a477-21afd3984d48"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:46.148509 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7d1e628c-7b87-4254-a474-7007f2bcd265 req-341af779-d27a-445c-83c5-72b5c8fb8e04 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:46.148972 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7d1e628c-7b87-4254-a474-7007f2bcd265 req-341af779-d27a-445c-83c5-72b5c8fb8e04 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:46.187304 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-7d1e628c-7b87-4254-a474-7007f2bcd265 req-341af779-d27a-445c-83c5-72b5c8fb8e04 service nova] Creating event network-vif-plugged:c7157193-94b5-4be3-a477-21afd3984d48 for instance 18dfb53a-18ce-4ad5-a226-dff0410f00eb on n-h1-847009-3 Jul 19 22:25:46.195345 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-7d1e628c-7b87-4254-a474-7007f2bcd265 req-341af779-d27a-445c-83c5-72b5c8fb8e04 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078951 Jul 19 22:25:46.196400 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 110/244] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:46.205696 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1b919d88-2463-4273-a1de-1a6dc80d0165 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-706097934_new", "availability_zone": "tempest-test_az-384124479_new"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:46.339958 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:46.339958 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:46.383902 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b919d88-2463-4273-a1de-1a6dc80d0165 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:46.384409 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b919d88-2463-4273-a1de-1a6dc80d0165 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:46.417108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=10,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:46.446726 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1b919d88-2463-4273-a1de-1a6dc80d0165 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 334 microversion: 2.1 time: 0.247846 Jul 19 22:25:46.453840 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 111/245] 10.222.0.25 () {60 vars in 1172 bytes} [Tue Jul 19 22:25:46 2022] PUT /compute/v2.1/os-aggregates/17 => generated 334 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:46.464084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1dcb7456-1041-40b5-b024-a3caee9d0c2a tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:46.465580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1dcb7456-1041-40b5-b024-a3caee9d0c2a tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:46.485211 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1dcb7456-1041-40b5-b024-a3caee9d0c2a tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:46.486738 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1dcb7456-1041-40b5-b024-a3caee9d0c2a tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:46.488260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1dcb7456-1041-40b5-b024-a3caee9d0c2a tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:46.488883 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1dcb7456-1041-40b5-b024-a3caee9d0c2a tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:46.698321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=24 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:46.854398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1dcb7456-1041-40b5-b024-a3caee9d0c2a tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:46.863742 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1dcb7456-1041-40b5-b024-a3caee9d0c2a tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a" status: 200 len: 1388 microversion: 2.1 time: 0.408609 Jul 19 22:25:46.864336 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 112/246] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:46 2022] GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a => generated 1388 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:46.873011 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fff05b3e-44d2-45b9-9a72-3b261bdf45d4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:46.885775 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fff05b3e-44d2-45b9-9a72-3b261bdf45d4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1313 microversion: 2.1 time: 0.845759 Jul 19 22:25:46.886365 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 135/247] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:46 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1313 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:46.892069 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-07ab1a24-47ef-45b9-a709-3b7395227bbf tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:46.893197 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:46.893197 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:46.905940 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-07ab1a24-47ef-45b9-a709-3b7395227bbf tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.027574 Jul 19 22:25:46.910504 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 113/248] 10.222.0.25 () {58 vars in 1142 bytes} [Tue Jul 19 22:25:46 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:46.921606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a934cea5-9b6f-492f-8e21-4a989668dba4 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:46.922405 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:46.922405 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:46.962917 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a934cea5-9b6f-492f-8e21-4a989668dba4 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.044797 Jul 19 22:25:46.965376 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 136/249] 10.222.0.25 () {58 vars in 1154 bytes} [Tue Jul 19 22:25:46 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 22:25:46.976560 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-96c0197b-d06a-416c-b1f3-a1854dae82a2 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1759119533"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:46.985206 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:46.985206 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:46.986816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.aggregate [None req-96c0197b-d06a-416c-b1f3-a1854dae82a2 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Generated uuid 0e1d3d95-a44b-4c65-a835-584fc68d0ff6 for aggregate {{(pid=119338) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 22:25:46.992967 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ca6a279a-dede-4c55-b198-4106b1f6b68f tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:46.994197 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ca6a279a-dede-4c55-b198-4106b1f6b68f tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: b5b01010-9fd2-4092-ad1d-29edac4ecaa4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:47.008671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca6a279a-dede-4c55-b198-4106b1f6b68f tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:47.013060 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca6a279a-dede-4c55-b198-4106b1f6b68f tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:47.014267 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca6a279a-dede-4c55-b198-4106b1f6b68f tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:47.015580 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca6a279a-dede-4c55-b198-4106b1f6b68f tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:47.034404 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-96c0197b-d06a-416c-b1f3-a1854dae82a2 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.062311 Jul 19 22:25:47.035552 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 114/250] 10.222.0.25 () {60 vars in 1163 bytes} [Tue Jul 19 22:25:46 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:47.045381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0e746a76-43de-436a-9d02-8badbb6fe7e6 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:47.046101 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:47.046101 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:47.068974 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0e746a76-43de-436a-9d02-8badbb6fe7e6 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.027743 Jul 19 22:25:47.069687 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 115/251] 10.222.0.25 () {58 vars in 1142 bytes} [Tue Jul 19 22:25:47 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:25:47.082683 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7f2cf9b9-cc19-4f1a-9868-0bb85b1c0d85 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:47.089226 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:47.089226 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:47.097820 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=7,nova_api:INSERT=9 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:47.159135 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7f2cf9b9-cc19-4f1a-9868-0bb85b1c0d85 tempest-AggregatesAdminTestJSON-402493731 tempest-AggregatesAdminTestJSON-402493731-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.082000 Jul 19 22:25:47.161563 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 116/252] 10.222.0.25 () {58 vars in 1154 bytes} [Tue Jul 19 22:25:47 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 22:25:47.169308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d972331d-3b1a-4270-a9a2-1a3eae823929 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:47.170407 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d972331d-3b1a-4270-a9a2-1a3eae823929 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: 0c5f1490-8946-4758-baa2-3eacd9b32d5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:47.182650 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d972331d-3b1a-4270-a9a2-1a3eae823929 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:47.183347 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d972331d-3b1a-4270-a9a2-1a3eae823929 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:47.184380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d972331d-3b1a-4270-a9a2-1a3eae823929 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:47.185133 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d972331d-3b1a-4270-a9a2-1a3eae823929 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:47.316025 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=56,nova_cell0:UPDATE=12 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:47.568440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ca6a279a-dede-4c55-b198-4106b1f6b68f tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:47.583440 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ca6a279a-dede-4c55-b198-4106b1f6b68f tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4" status: 200 len: 1319 microversion: 2.1 time: 0.594877 Jul 19 22:25:47.584446 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 137/253] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:46 2022] GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4 => generated 1319 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:25:47.600420 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e595b9fb-dd90-4b0f-a2d3-683326916613 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:47.601675 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e595b9fb-dd90-4b0f-a2d3-683326916613 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] [instance: e1dfa154-2d44-47cb-8e04-3c45c04cd96b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:47.612943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e595b9fb-dd90-4b0f-a2d3-683326916613 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:47.614384 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e595b9fb-dd90-4b0f-a2d3-683326916613 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:47.615534 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e595b9fb-dd90-4b0f-a2d3-683326916613 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:47.616084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e595b9fb-dd90-4b0f-a2d3-683326916613 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:47.645413 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-e595b9fb-dd90-4b0f-a2d3-683326916613 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] HTTP exception thrown: Instance e1dfa154-2d44-47cb-8e04-3c45c04cd96b could not be found. Jul 19 22:25:47.647899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e595b9fb-dd90-4b0f-a2d3-683326916613 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Request method failure captured: Jul 19 22:25:47.647899 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b HTTP/1.1 Jul 19 22:25:47.647899 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:25:47.647899 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:25:47.647899 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:25:47.647899 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:25:47.647899 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:25:47.647899 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:25:47.647899 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:25:47.647899 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:47.647899 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y8zxv-atTTzt1s0FmqK7gbcSEou1FOq2xXIwbHXvDtWRXiJCCmVOpTYRqRvwjlkJsgafkrcHfG3I5L-gabXDHgSqhxPJc1Jh4cx6-4u98Sc12RWTcRa9CgaFPacwH1RSqWBTUBgZhS0MqLtL0uzqAyOJzjnQ1I280W_GugwR8zz0QQ Jul 19 22:25:47.647899 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:25:47.647899 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:25:47.647899 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:25:47.647899 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:25:47.647899 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:25:47.647899 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:25:47.647899 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 1be6ce11f1034a36b533ebc223be834a Jul 19 22:25:47.647899 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AggregatesAdminTestJSON-954529987 Jul 19 22:25:47.647899 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:25:47.647899 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:25:47.657082 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1be6ce11f1034a36b533ebc223be834a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1be6ce11f1034a36b533ebc223be834a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1be6ce11f1034a36b533ebc223be834a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1be6ce11f1034a36b533ebc223be834a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:47.657082 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AggregatesAdminTestJSON-954529987 Jul 19 22:25:47.657082 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 1be6ce11f1034a36b533ebc223be834a Jul 19 22:25:47.657082 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-954529987 Jul 19 22:25:47.657082 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AggregatesAdminTestJSON-954529987-project Jul 19 22:25:47.657082 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:25:47.657082 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:25:47.657082 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 0eabe2a2d3164f168cfaf69623ffe96e Jul 19 22:25:47.657082 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AggregatesAdminTestJSON-954529987-project Jul 19 22:25:47.657082 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:25:47.657082 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance e1dfa154-2d44-47cb-8e04-3c45c04cd96b could not be found. Jul 19 22:25:47.657082 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'e1dfa154-2d44-47cb-8e04-3c45c04cd96b'} Jul 19 22:25:47.658595 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:47.658595 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:47.658595 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:25:47.658595 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:25:47.658595 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:25:47.658595 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:25:47.658595 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:25:47.658595 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:25:47.658595 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:25:47.658595 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:25:47.658595 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1dfa154-2d44-47cb-8e04-3c45c04cd96b could not be found. Jul 19 22:25:47.658595 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:47.658595 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:47.658595 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:47.658595 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:47.658595 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:47.658595 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:47.658595 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:47.658595 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:47.658595 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:47.661564 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:47.661564 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:25:47.661564 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:25:47.661564 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:25:47.661564 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:25:47.661564 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:25:47.661564 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:25:47.661564 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:25:47.661564 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:25:47.661564 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1dfa154-2d44-47cb-8e04-3c45c04cd96b could not be found. Jul 19 22:25:47.661564 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:47.661564 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:47.661564 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:47.661564 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:47.661564 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:47.661564 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:47.661564 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:25:47.661564 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:25:47.661564 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1dfa154-2d44-47cb-8e04-3c45c04cd96b could not be found. Jul 19 22:25:47.661564 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:47.672715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d972331d-3b1a-4270-a9a2-1a3eae823929 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:47.672873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e595b9fb-dd90-4b0f-a2d3-683326916613 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Returning 404 to user: Instance e1dfa154-2d44-47cb-8e04-3c45c04cd96b could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:47.681410 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e595b9fb-dd90-4b0f-a2d3-683326916613 tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b" status: 404 len: 111 microversion: 2.1 time: 0.092919 Jul 19 22:25:47.683485 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 138/254] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:25:47 2022] DELETE /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:25:47.684356 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d972331d-3b1a-4270-a9a2-1a3eae823929 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a" status: 200 len: 1320 microversion: 2.1 time: 0.519659 Jul 19 22:25:47.695361 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 117/255] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:47 2022] GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a => generated 1320 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:47.695561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-049ff6cb-6125-4675-9e0e-ddaefcf94faf tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:47.695561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-049ff6cb-6125-4675-9e0e-ddaefcf94faf tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] [instance: e1dfa154-2d44-47cb-8e04-3c45c04cd96b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:47.716211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-049ff6cb-6125-4675-9e0e-ddaefcf94faf tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:47.716663 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-049ff6cb-6125-4675-9e0e-ddaefcf94faf tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:47.717454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-049ff6cb-6125-4675-9e0e-ddaefcf94faf tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:47.717903 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-049ff6cb-6125-4675-9e0e-ddaefcf94faf tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:47.739477 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-049ff6cb-6125-4675-9e0e-ddaefcf94faf tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] HTTP exception thrown: Instance e1dfa154-2d44-47cb-8e04-3c45c04cd96b could not be found. Jul 19 22:25:47.741686 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-049ff6cb-6125-4675-9e0e-ddaefcf94faf tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Request method failure captured: Jul 19 22:25:47.741686 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b HTTP/1.1 Jul 19 22:25:47.741686 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:25:47.741686 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:25:47.741686 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:25:47.741686 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:25:47.741686 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:25:47.741686 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:25:47.741686 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:25:47.741686 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:47.741686 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y8zxv-atTTzt1s0FmqK7gbcSEou1FOq2xXIwbHXvDtWRXiJCCmVOpTYRqRvwjlkJsgafkrcHfG3I5L-gabXDHgSqhxPJc1Jh4cx6-4u98Sc12RWTcRa9CgaFPacwH1RSqWBTUBgZhS0MqLtL0uzqAyOJzjnQ1I280W_GugwR8zz0QQ Jul 19 22:25:47.741686 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:25:47.741686 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:25:47.741686 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:25:47.741686 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:25:47.741686 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:25:47.741686 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:25:47.741686 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 1be6ce11f1034a36b533ebc223be834a Jul 19 22:25:47.741686 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AggregatesAdminTestJSON-954529987 Jul 19 22:25:47.741686 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:25:47.741686 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:25:47.743028 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1be6ce11f1034a36b533ebc223be834a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1be6ce11f1034a36b533ebc223be834a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1be6ce11f1034a36b533ebc223be834a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1be6ce11f1034a36b533ebc223be834a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:47.743028 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AggregatesAdminTestJSON-954529987 Jul 19 22:25:47.743028 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 1be6ce11f1034a36b533ebc223be834a Jul 19 22:25:47.743028 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-954529987 Jul 19 22:25:47.743028 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AggregatesAdminTestJSON-954529987-project Jul 19 22:25:47.743028 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:25:47.743028 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:25:47.743028 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 0eabe2a2d3164f168cfaf69623ffe96e Jul 19 22:25:47.743028 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AggregatesAdminTestJSON-954529987-project Jul 19 22:25:47.743028 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:25:47.743028 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance e1dfa154-2d44-47cb-8e04-3c45c04cd96b could not be found. Jul 19 22:25:47.743028 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'e1dfa154-2d44-47cb-8e04-3c45c04cd96b'} Jul 19 22:25:47.743730 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:47.743730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:47.743730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:25:47.743730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:25:47.743730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:25:47.743730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:25:47.743730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:25:47.743730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:25:47.743730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:25:47.743730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:25:47.743730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1dfa154-2d44-47cb-8e04-3c45c04cd96b could not be found. Jul 19 22:25:47.743730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:47.743730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:47.743730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:47.743730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:47.743730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:47.743730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:47.743730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:47.743730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:47.743730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:47.748104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:47.748104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:25:47.748104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:25:47.748104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:25:47.748104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:25:47.748104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:25:47.748104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:25:47.748104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1dfa154-2d44-47cb-8e04-3c45c04cd96b could not be found. Jul 19 22:25:47.748104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:47.748104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:47.748104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:47.748104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:47.748104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:47.748104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:47.748104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:25:47.748104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:25:47.748104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1dfa154-2d44-47cb-8e04-3c45c04cd96b could not be found. Jul 19 22:25:47.748104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:25:47.749905 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-049ff6cb-6125-4675-9e0e-ddaefcf94faf tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] Returning 404 to user: Instance e1dfa154-2d44-47cb-8e04-3c45c04cd96b could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:47.749905 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-049ff6cb-6125-4675-9e0e-ddaefcf94faf tempest-AggregatesAdminTestJSON-954529987 tempest-AggregatesAdminTestJSON-954529987-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b" status: 404 len: 111 microversion: 2.1 time: 0.054985 Jul 19 22:25:47.749905 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 139/256] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:47 2022] GET /compute/v2.1/servers/e1dfa154-2d44-47cb-8e04-3c45c04cd96b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:25:47.883349 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6d9e94fe-27f0-443f-9d28-2e32b0c19b47 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:47.884085 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6d9e94fe-27f0-443f-9d28-2e32b0c19b47 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:47.894341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6d9e94fe-27f0-443f-9d28-2e32b0c19b47 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:47.894941 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6d9e94fe-27f0-443f-9d28-2e32b0c19b47 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:47.896567 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6d9e94fe-27f0-443f-9d28-2e32b0c19b47 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:47.897193 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6d9e94fe-27f0-443f-9d28-2e32b0c19b47 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:47.916344 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2e6eb4ba-bfcc-4207-863b-f19253478ebf tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:47.917726 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2e6eb4ba-bfcc-4207-863b-f19253478ebf tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:47.933770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e6eb4ba-bfcc-4207-863b-f19253478ebf tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:47.936533 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e6eb4ba-bfcc-4207-863b-f19253478ebf tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:47.937498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e6eb4ba-bfcc-4207-863b-f19253478ebf tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:47.942479 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e6eb4ba-bfcc-4207-863b-f19253478ebf tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:48.524022 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2e6eb4ba-bfcc-4207-863b-f19253478ebf tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:48.532952 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2e6eb4ba-bfcc-4207-863b-f19253478ebf tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1313 microversion: 2.1 time: 0.622193 Jul 19 22:25:48.533771 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 140/257] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:47 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1313 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:48.541961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-247a4cac-bff2-49fe-bdd9-e5b6f161bf93 req-e1007eae-8684-461b-bd1f-45313823d67b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a", "name": "network-vif-plugged", "status": "completed", "tag": "466d0f1d-6d97-46a8-ab3c-6441661159ed"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:48.560650 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-247a4cac-bff2-49fe-bdd9-e5b6f161bf93 req-e1007eae-8684-461b-bd1f-45313823d67b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:48.561614 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-247a4cac-bff2-49fe-bdd9-e5b6f161bf93 req-e1007eae-8684-461b-bd1f-45313823d67b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:48.578758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6d9e94fe-27f0-443f-9d28-2e32b0c19b47 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:48.581127 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-247a4cac-bff2-49fe-bdd9-e5b6f161bf93 req-e1007eae-8684-461b-bd1f-45313823d67b service nova] Creating event network-vif-plugged:466d0f1d-6d97-46a8-ab3c-6441661159ed for instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a on n-h1-847009-3 Jul 19 22:25:48.588977 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-247a4cac-bff2-49fe-bdd9-e5b6f161bf93 req-e1007eae-8684-461b-bd1f-45313823d67b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053820 Jul 19 22:25:48.590602 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 141/258] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:48.592428 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6d9e94fe-27f0-443f-9d28-2e32b0c19b47 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a" status: 200 len: 1388 microversion: 2.1 time: 0.712778 Jul 19 22:25:48.595909 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 118/259] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:47 2022] GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a => generated 1388 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:48.608597 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-707932b9-0870-4731-8705-e729560134ee tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:48.609579 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-707932b9-0870-4731-8705-e729560134ee tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: b5b01010-9fd2-4092-ad1d-29edac4ecaa4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:48.620108 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-707932b9-0870-4731-8705-e729560134ee tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:48.632343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-707932b9-0870-4731-8705-e729560134ee tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:48.633424 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-707932b9-0870-4731-8705-e729560134ee tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:48.634012 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-707932b9-0870-4731-8705-e729560134ee tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:48.707263 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-854a1a74-d2bd-49ff-9eab-a4499a7162af tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:48.711659 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-854a1a74-d2bd-49ff-9eab-a4499a7162af tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: 0c5f1490-8946-4758-baa2-3eacd9b32d5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:48.726433 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-854a1a74-d2bd-49ff-9eab-a4499a7162af tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:48.727143 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-854a1a74-d2bd-49ff-9eab-a4499a7162af tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:48.728617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-854a1a74-d2bd-49ff-9eab-a4499a7162af tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:48.729493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-854a1a74-d2bd-49ff-9eab-a4499a7162af tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:49.391676 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-854a1a74-d2bd-49ff-9eab-a4499a7162af tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:49.404013 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-707932b9-0870-4731-8705-e729560134ee tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:49.407184 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-854a1a74-d2bd-49ff-9eab-a4499a7162af tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a" status: 200 len: 1320 microversion: 2.1 time: 0.706350 Jul 19 22:25:49.427347 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 119/260] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:48 2022] GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a => generated 1320 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:49.473611 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-707932b9-0870-4731-8705-e729560134ee tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4" status: 200 len: 1319 microversion: 2.1 time: 0.872280 Jul 19 22:25:49.496539 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 142/261] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:48 2022] GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4 => generated 1319 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:49.559725 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b1e5644b-5119-4546-b4af-3e9c465d37ad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:49.561409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b1e5644b-5119-4546-b4af-3e9c465d37ad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:49.576852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b1e5644b-5119-4546-b4af-3e9c465d37ad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:49.578136 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b1e5644b-5119-4546-b4af-3e9c465d37ad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:49.579664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b1e5644b-5119-4546-b4af-3e9c465d37ad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:49.580303 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b1e5644b-5119-4546-b4af-3e9c465d37ad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:49.728259 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3e3d208b-02e6-470a-ab26-f2b2af16e7fe tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-590912825", "id": 921466164, "os-flavor-access:is_public": "True"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:49.731970 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:49.731970 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:49.762535 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3e3d208b-02e6-470a-ab26-f2b2af16e7fe tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.337318 Jul 19 22:25:49.780636 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 120/262] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:25:49 2022] POST /compute/v2.1/flavors => generated 426 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:49.788251 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-712d877d-2859-4cec-acfd-5e8df4aa927d tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:49.789110 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-712d877d-2859-4cec-acfd-5e8df4aa927d tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:49.802839 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-712d877d-2859-4cec-acfd-5e8df4aa927d tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:49.803782 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-712d877d-2859-4cec-acfd-5e8df4aa927d tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:49.806437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-712d877d-2859-4cec-acfd-5e8df4aa927d tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:49.807554 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-712d877d-2859-4cec-acfd-5e8df4aa927d tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:49.977246 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b1e5644b-5119-4546-b4af-3e9c465d37ad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:49.987550 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b1e5644b-5119-4546-b4af-3e9c465d37ad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1463 microversion: 2.1 time: 0.436221 Jul 19 22:25:50.003755 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 143/263] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:49 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1463 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:50.020953 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5caf4bd9-5311-4bc0-97d6-633416377571 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:50.025418 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:50.025418 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:50.061544 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5caf4bd9-5311-4bc0-97d6-633416377571 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/921466164" status: 202 len: 0 microversion: 2.1 time: 0.052058 Jul 19 22:25:50.064608 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 144/264] 10.222.0.25 () {58 vars in 1157 bytes} [Tue Jul 19 22:25:50 2022] DELETE /compute/v2.1/flavors/921466164 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:25:50.080292 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-712d877d-2859-4cec-acfd-5e8df4aa927d tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:50.090816 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-712d877d-2859-4cec-acfd-5e8df4aa927d tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a" status: 200 len: 1388 microversion: 2.1 time: 0.308124 Jul 19 22:25:50.091802 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=10 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:50.091956 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 121/265] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:49 2022] GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a => generated 1388 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:50.101676 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a431293c-88bb-4f81-aa30-5ab62b0438bd tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:50.134212 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a431293c-88bb-4f81-aa30-5ab62b0438bd tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.040148 Jul 19 22:25:50.148519 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 122/266] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:25:50 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:50.158811 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2e6de1da-5be0-4fbf-8ba6-770993f0564a tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-282938582", "id": 1706869981, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:50.160717 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:50.160717 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:50.199030 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2e6de1da-5be0-4fbf-8ba6-770993f0564a tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.049303 Jul 19 22:25:50.207316 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 123/267] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:25:50 2022] POST /compute/v2.1/flavors => generated 416 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:50.219356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d0a61377-b4f5-429c-9a9e-11fee2c3622f tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:50.272855 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d0a61377-b4f5-429c-9a9e-11fee2c3622f tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.063992 Jul 19 22:25:50.287811 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 124/268] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:25:50 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:50.301594 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2e77bc5a-ec8f-400d-86e9-c83b8accfc57 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:50.305074 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:50.305074 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:50.347763 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2e77bc5a-ec8f-400d-86e9-c83b8accfc57 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1706869981" status: 202 len: 0 microversion: 2.1 time: 0.057193 Jul 19 22:25:50.354052 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 125/269] 10.222.0.25 () {58 vars in 1160 bytes} [Tue Jul 19 22:25:50 2022] DELETE /compute/v2.1/flavors/1706869981 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:25:50.366330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ad3b3a8b-1450-4bf0-9be9-b481471fafce tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:50.415375 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ad3b3a8b-1450-4bf0-9be9-b481471fafce tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.058019 Jul 19 22:25:50.432333 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 126/270] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:25:50 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:50.449305 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-75b89eec-7e5b-470c-a530-76e8d12816ee tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:50.452879 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-75b89eec-7e5b-470c-a530-76e8d12816ee tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: 0c5f1490-8946-4758-baa2-3eacd9b32d5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:50.470976 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75b89eec-7e5b-470c-a530-76e8d12816ee tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:50.472825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75b89eec-7e5b-470c-a530-76e8d12816ee tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:50.474369 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75b89eec-7e5b-470c-a530-76e8d12816ee tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:50.477205 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75b89eec-7e5b-470c-a530-76e8d12816ee tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:50.799571 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-922733a2-6e22-4811-b465-426bbb65d23d tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:50.800753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-922733a2-6e22-4811-b465-426bbb65d23d tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:50.818561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-922733a2-6e22-4811-b465-426bbb65d23d tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:50.820234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-922733a2-6e22-4811-b465-426bbb65d23d tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:50.824217 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-922733a2-6e22-4811-b465-426bbb65d23d tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:50.825210 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-922733a2-6e22-4811-b465-426bbb65d23d tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:50.851908 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-75b89eec-7e5b-470c-a530-76e8d12816ee tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:50.861618 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-75b89eec-7e5b-470c-a530-76e8d12816ee tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a" status: 200 len: 1320 microversion: 2.1 time: 0.427826 Jul 19 22:25:50.866350 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 127/271] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:50 2022] GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a => generated 1320 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:50.873288 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0242fae8-47a9-42dc-b9ff-f8d2111caadd tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1412423522", "id": 1642438003, "os-flavor-access:is_public": "True"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:50.880689 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:50.880689 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:50.908311 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0242fae8-47a9-42dc-b9ff-f8d2111caadd tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.040523 Jul 19 22:25:50.916626 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 128/272] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:25:50 2022] POST /compute/v2.1/flavors => generated 429 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:50.923493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c7e67b10-4478-4e74-aef5-e39e03500ac5 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:50.924152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c7e67b10-4478-4e74-aef5-e39e03500ac5 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: b5b01010-9fd2-4092-ad1d-29edac4ecaa4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:50.948253 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7e67b10-4478-4e74-aef5-e39e03500ac5 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:50.949200 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7e67b10-4478-4e74-aef5-e39e03500ac5 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:50.950488 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7e67b10-4478-4e74-aef5-e39e03500ac5 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:50.950935 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7e67b10-4478-4e74-aef5-e39e03500ac5 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:51.335268 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-922733a2-6e22-4811-b465-426bbb65d23d tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1614 microversion: 2.1 time: 1.253132 Jul 19 22:25:51.339541 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 145/273] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:50 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1614 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:51.356932 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-afb9b1cd-d7c1-4f99-bc7e-0e6f860e9559 req-2a94a320-0c2c-4761-a911-8afef1a00054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b01010-9fd2-4092-ad1d-29edac4ecaa4", "name": "network-vif-plugged", "status": "completed", "tag": "af2c8e0c-cf95-4771-afa6-6ab97dd37a99"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:51.388360 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-afb9b1cd-d7c1-4f99-bc7e-0e6f860e9559 req-2a94a320-0c2c-4761-a911-8afef1a00054 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:51.389637 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-afb9b1cd-d7c1-4f99-bc7e-0e6f860e9559 req-2a94a320-0c2c-4761-a911-8afef1a00054 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:51.442815 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-afb9b1cd-d7c1-4f99-bc7e-0e6f860e9559 req-2a94a320-0c2c-4761-a911-8afef1a00054 service nova] Creating event network-vif-plugged:af2c8e0c-cf95-4771-afa6-6ab97dd37a99 for instance b5b01010-9fd2-4092-ad1d-29edac4ecaa4 on n-h2-847009-3 Jul 19 22:25:51.456319 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-afb9b1cd-d7c1-4f99-bc7e-0e6f860e9559 req-2a94a320-0c2c-4761-a911-8afef1a00054 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113638 Jul 19 22:25:51.456937 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 146/274] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:51.476491 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-74d8cba6-c324-482e-b9e0-004ef4c442af tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:51.477716 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:51.477716 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:51.479774 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c7e67b10-4478-4e74-aef5-e39e03500ac5 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:51.493141 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c7e67b10-4478-4e74-aef5-e39e03500ac5 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4" status: 200 len: 1319 microversion: 2.1 time: 0.575039 Jul 19 22:25:51.493947 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 129/275] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:50 2022] GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4 => generated 1319 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:51.510794 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ebf8baea-9f7b-4057-bb94-5b3c93e4923c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:51.512410 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-74d8cba6-c324-482e-b9e0-004ef4c442af tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1642438003" status: 202 len: 0 microversion: 2.1 time: 0.049677 Jul 19 22:25:51.513952 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 147/276] 10.222.0.25 () {58 vars in 1160 bytes} [Tue Jul 19 22:25:51 2022] DELETE /compute/v2.1/flavors/1642438003 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:25:51.522069 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ebf8baea-9f7b-4057-bb94-5b3c93e4923c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:51.527073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5c078cf7-ce1a-4736-99bb-834d3ba3372e tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:51.527861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5c078cf7-ce1a-4736-99bb-834d3ba3372e tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:51.542879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c078cf7-ce1a-4736-99bb-834d3ba3372e tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:51.550281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c078cf7-ce1a-4736-99bb-834d3ba3372e tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:51.552950 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ebf8baea-9f7b-4057-bb94-5b3c93e4923c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:51.553114 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c078cf7-ce1a-4736-99bb-834d3ba3372e tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:51.554835 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c078cf7-ce1a-4736-99bb-834d3ba3372e tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:51.556083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ebf8baea-9f7b-4057-bb94-5b3c93e4923c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:51.558220 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ebf8baea-9f7b-4057-bb94-5b3c93e4923c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:51.558954 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ebf8baea-9f7b-4057-bb94-5b3c93e4923c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:52.034405 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ebf8baea-9f7b-4057-bb94-5b3c93e4923c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:52.050597 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ebf8baea-9f7b-4057-bb94-5b3c93e4923c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a" status: 200 len: 1587 microversion: 2.1 time: 0.552869 Jul 19 22:25:52.051544 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 130/277] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:51 2022] GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a => generated 1587 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:52.069468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-375fe43e-1ecd-47dc-b99b-5b434c1bd6e0 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:52.098943 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-375fe43e-1ecd-47dc-b99b-5b434c1bd6e0 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.033027 Jul 19 22:25:52.100004 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 131/278] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:25:52 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:52.105617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-473d366e-1743-4bbe-8b61-06c2eab9ec39 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:52.106719 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-473d366e-1743-4bbe-8b61-06c2eab9ec39 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: 0c5f1490-8946-4758-baa2-3eacd9b32d5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:52.115889 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-473d366e-1743-4bbe-8b61-06c2eab9ec39 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:52.116939 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-473d366e-1743-4bbe-8b61-06c2eab9ec39 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:52.117925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-473d366e-1743-4bbe-8b61-06c2eab9ec39 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:52.118569 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-473d366e-1743-4bbe-8b61-06c2eab9ec39 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:52.124169 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:52.276406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5c078cf7-ce1a-4736-99bb-834d3ba3372e tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8c849cd3f1e44096aec522948f87ce7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85fc2601da774e8392b1ff78a3ffea0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:52.276991 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5c078cf7-ce1a-4736-99bb-834d3ba3372e tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] flavor_id is None. Assuming migration. {{(pid=119337) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 19 22:25:52.277436 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5c078cf7-ce1a-4736-99bb-834d3ba3372e tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119337) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 22:25:52.572082 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-473d366e-1743-4bbe-8b61-06c2eab9ec39 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:52.584059 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-473d366e-1743-4bbe-8b61-06c2eab9ec39 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a" status: 200 len: 1320 microversion: 2.1 time: 0.482427 Jul 19 22:25:52.590620 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 132/279] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:52 2022] GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a => generated 1320 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:52.612669 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f162064f-ca70-49e7-81b9-b9e035871411 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:52.620586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f162064f-ca70-49e7-81b9-b9e035871411 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:52.648290 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f162064f-ca70-49e7-81b9-b9e035871411 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:52.650271 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f162064f-ca70-49e7-81b9-b9e035871411 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:52.651302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f162064f-ca70-49e7-81b9-b9e035871411 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:52.653116 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f162064f-ca70-49e7-81b9-b9e035871411 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:53.054757 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=10 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:53.101743 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f162064f-ca70-49e7-81b9-b9e035871411 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.507419 Jul 19 22:25:53.102663 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 133/280] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 19 22:25:52 2022] GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a/os-interface => generated 284 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:53.107443 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c40a8f46-c632-497f-add9-ffe7d1aaa112 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1959356477", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:53.110717 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:53.110717 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:53.159061 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c40a8f46-c632-497f-add9-ffe7d1aaa112 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.055054 Jul 19 22:25:53.165478 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 134/281] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:25:53 2022] POST /compute/v2.1/flavors => generated 507 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:53.170513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-815360b2-1f05-42a4-873e-49b9c9a287b4 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:53.175225 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-815360b2-1f05-42a4-873e-49b9c9a287b4 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: b5b01010-9fd2-4092-ad1d-29edac4ecaa4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:53.190901 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-815360b2-1f05-42a4-873e-49b9c9a287b4 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:53.191996 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-815360b2-1f05-42a4-873e-49b9c9a287b4 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:53.192987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-815360b2-1f05-42a4-873e-49b9c9a287b4 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:53.193421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-815360b2-1f05-42a4-873e-49b9c9a287b4 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:53.280542 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5c078cf7-ce1a-4736-99bb-834d3ba3372e tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb/action" status: 202 len: 0 microversion: 2.1 time: 1.764024 Jul 19 22:25:53.282045 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 148/282] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:25:51 2022] POST /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb/action => generated 0 bytes in 1767 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:25:53.297895 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-85447003-4a75-4daa-8e62-4775917de1d6 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:53.299850 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:53.299850 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:53.343458 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-85447003-4a75-4daa-8e62-4775917de1d6 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/606410c0-d4ec-4c8c-8081-0da6b5402ddc" status: 202 len: 0 microversion: 2.1 time: 0.059475 Jul 19 22:25:53.349883 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 149/283] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:25:53 2022] DELETE /compute/v2.1/flavors/606410c0-d4ec-4c8c-8081-0da6b5402ddc => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:25:53.365949 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4df9497f-f26a-4d21-92a9-63c346c78350 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:53.366922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4df9497f-f26a-4d21-92a9-63c346c78350 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:53.388730 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4df9497f-f26a-4d21-92a9-63c346c78350 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:53.390034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4df9497f-f26a-4d21-92a9-63c346c78350 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:53.394452 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4df9497f-f26a-4d21-92a9-63c346c78350 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:53.396671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4df9497f-f26a-4d21-92a9-63c346c78350 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:54.038549 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4df9497f-f26a-4d21-92a9-63c346c78350 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:54.054828 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4df9497f-f26a-4d21-92a9-63c346c78350 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1472 microversion: 2.1 time: 0.701969 Jul 19 22:25:54.056687 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 150/284] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:53 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1472 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:54.075043 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2c1cddfd-e6c2-4b87-92f4-88708b003c59 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:54.128936 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2c1cddfd-e6c2-4b87-92f4-88708b003c59 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.070918 Jul 19 22:25:54.131846 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 151/285] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:25:54 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:54.144386 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6d1ff84a-99b3-4033-8992-4d702973310e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:54.147265 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6d1ff84a-99b3-4033-8992-4d702973310e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: 0c5f1490-8946-4758-baa2-3eacd9b32d5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:54.162048 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d1ff84a-99b3-4033-8992-4d702973310e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:54.165034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d1ff84a-99b3-4033-8992-4d702973310e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:54.173677 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d1ff84a-99b3-4033-8992-4d702973310e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:54.178239 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d1ff84a-99b3-4033-8992-4d702973310e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:54.738663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-815360b2-1f05-42a4-873e-49b9c9a287b4 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:54.750708 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-815360b2-1f05-42a4-873e-49b9c9a287b4 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4" status: 200 len: 1319 microversion: 2.1 time: 1.582900 Jul 19 22:25:54.756137 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 135/286] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:53 2022] GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4 => generated 1319 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:54.772081 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a4c1dd42-e34e-4b3b-80d9-479ca64be1c2 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1198824630", "id": "316891e6-6b3d-47ec-a35f-a49eb87c566d", "os-flavor-access:is_public": "True"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:54.778347 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:54.778347 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:54.814785 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a4c1dd42-e34e-4b3b-80d9-479ca64be1c2 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.056871 Jul 19 22:25:54.816048 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 136/287] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:25:54 2022] POST /compute/v2.1/flavors => generated 507 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:55.039010 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e341a54b-016c-4fa3-89f9-44f794bc07b7 tempest-FlavorsAccessTestJSON-1052961089 tempest-FlavorsAccessTestJSON-1052961089-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-350977165", "id": 529921738, "os-flavor-access:is_public": "False"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:55.099279 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e341a54b-016c-4fa3-89f9-44f794bc07b7 tempest-FlavorsAccessTestJSON-1052961089 tempest-FlavorsAccessTestJSON-1052961089-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.276683 Jul 19 22:25:55.101205 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 137/288] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:25:54 2022] POST /compute/v2.1/flavors => generated 427 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:55.111172 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-926f8c77-9736-46d7-a2de-534dd0de0bc9 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:55.114657 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:55.114657 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:55.141420 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-926f8c77-9736-46d7-a2de-534dd0de0bc9 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/316891e6-6b3d-47ec-a35f-a49eb87c566d" status: 202 len: 0 microversion: 2.1 time: 0.038610 Jul 19 22:25:55.143684 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 138/289] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:25:55 2022] DELETE /compute/v2.1/flavors/316891e6-6b3d-47ec-a35f-a49eb87c566d => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:25:55.155381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-b1ebe971-804d-4802-8fb8-4bef341b3b51 req-93d5902e-19f9-4842-b8c2-6e2cf912cd64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c5f1490-8946-4758-baa2-3eacd9b32d5a", "name": "network-vif-plugged", "status": "completed", "tag": "6366737f-b1f3-4ca4-94f8-95967a79d789"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:55.175526 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b1ebe971-804d-4802-8fb8-4bef341b3b51 req-93d5902e-19f9-4842-b8c2-6e2cf912cd64 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:55.176463 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b1ebe971-804d-4802-8fb8-4bef341b3b51 req-93d5902e-19f9-4842-b8c2-6e2cf912cd64 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:55.212937 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-b1ebe971-804d-4802-8fb8-4bef341b3b51 req-93d5902e-19f9-4842-b8c2-6e2cf912cd64 service nova] Creating event network-vif-plugged:6366737f-b1f3-4ca4-94f8-95967a79d789 for instance 0c5f1490-8946-4758-baa2-3eacd9b32d5a on n-h2-847009-3 Jul 19 22:25:55.225424 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-b1ebe971-804d-4802-8fb8-4bef341b3b51 req-93d5902e-19f9-4842-b8c2-6e2cf912cd64 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078823 Jul 19 22:25:55.232967 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 139/290] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:55.254732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2ab46625-3b34-47a6-bca0-46faca2d9a8d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:55.267500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2ab46625-3b34-47a6-bca0-46faca2d9a8d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:55.335344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2ab46625-3b34-47a6-bca0-46faca2d9a8d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:55.336688 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2ab46625-3b34-47a6-bca0-46faca2d9a8d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:55.340154 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2ab46625-3b34-47a6-bca0-46faca2d9a8d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:55.342473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2ab46625-3b34-47a6-bca0-46faca2d9a8d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:56.009486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6d1ff84a-99b3-4033-8992-4d702973310e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:56.021899 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6d1ff84a-99b3-4033-8992-4d702973310e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a" status: 200 len: 1320 microversion: 2.1 time: 1.887595 Jul 19 22:25:56.022482 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 152/291] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:54 2022] GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a => generated 1320 bytes in 1889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:56.027872 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-95023501-88c3-402d-b91c-507bbc2345cf tempest-FlavorsAccessTestJSON-1052961089 tempest-FlavorsAccessTestJSON-1052961089-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "03fb8f34a5b24f9fa9255bbfd7d35f5a"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:56.029079 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:56.029079 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:56.182021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2ab46625-3b34-47a6-bca0-46faca2d9a8d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:56.208817 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2ab46625-3b34-47a6-bca0-46faca2d9a8d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1472 microversion: 2.1 time: 0.973023 Jul 19 22:25:56.210561 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 140/292] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:55 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1472 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:56.216293 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b6bba5c8-9479-4586-a4ce-e55d15276a39 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:56.337882 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b6bba5c8-9479-4586-a4ce-e55d15276a39 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.125848 Jul 19 22:25:56.339239 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 141/293] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:25:56 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:56.356611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-501b9fba-b8fa-43bb-8a97-2bc7d4c5c1c7 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:56.359583 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-501b9fba-b8fa-43bb-8a97-2bc7d4c5c1c7 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: b5b01010-9fd2-4092-ad1d-29edac4ecaa4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:56.381666 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-501b9fba-b8fa-43bb-8a97-2bc7d4c5c1c7 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:56.382279 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-501b9fba-b8fa-43bb-8a97-2bc7d4c5c1c7 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:56.383388 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-501b9fba-b8fa-43bb-8a97-2bc7d4c5c1c7 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:56.385461 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-501b9fba-b8fa-43bb-8a97-2bc7d4c5c1c7 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:56.709768 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-95023501-88c3-402d-b91c-507bbc2345cf tempest-FlavorsAccessTestJSON-1052961089 tempest-FlavorsAccessTestJSON-1052961089-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/529921738/action" status: 200 len: 96 microversion: 2.1 time: 0.685946 Jul 19 22:25:56.717356 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 153/294] 10.222.0.25 () {60 vars in 1196 bytes} [Tue Jul 19 22:25:56 2022] POST /compute/v2.1/flavors/529921738/action => generated 96 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:25:56.748281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b99af880-1ece-4d11-883e-c5e58d1796f5 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2109655010", "id": 509797794, "os-flavor-access:is_public": "True"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:56.767922 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:56.767922 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:56.809114 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b99af880-1ece-4d11-883e-c5e58d1796f5 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.088644 Jul 19 22:25:56.812523 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 154/295] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:25:56 2022] POST /compute/v2.1/flavors => generated 411 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:56.962911 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-501b9fba-b8fa-43bb-8a97-2bc7d4c5c1c7 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:56.973724 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-501b9fba-b8fa-43bb-8a97-2bc7d4c5c1c7 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4" status: 200 len: 1469 microversion: 2.1 time: 0.627377 Jul 19 22:25:56.987847 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 142/296] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:56 2022] GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4 => generated 1469 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:56.998122 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3d16ebd6-3ac1-4f11-b369-5b47ae959edb tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:57.041878 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3d16ebd6-3ac1-4f11-b369-5b47ae959edb tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/509797794" status: 200 len: 411 microversion: 2.1 time: 0.048393 Jul 19 22:25:57.042608 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 143/297] 10.222.0.25 () {58 vars in 1154 bytes} [Tue Jul 19 22:25:56 2022] GET /compute/v2.1/flavors/509797794 => generated 411 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:57.131535 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b8911961-4210-4c3b-995a-7ec04d218027 tempest-FlavorsAccessTestJSON-1296441442 tempest-FlavorsAccessTestJSON-1296441442-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:57.239546 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b8911961-4210-4c3b-995a-7ec04d218027 tempest-FlavorsAccessTestJSON-1296441442 tempest-FlavorsAccessTestJSON-1296441442-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6635 microversion: 2.1 time: 0.422994 Jul 19 22:25:57.242049 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 155/298] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:25:56 2022] GET /compute/v2.1/flavors/detail => generated 6635 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:57.294810 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6bde8c8c-7d86-468a-8da4-05efef3d2e49 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:57.299744 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6bde8c8c-7d86-468a-8da4-05efef3d2e49 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: 0c5f1490-8946-4758-baa2-3eacd9b32d5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:57.330330 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6bde8c8c-7d86-468a-8da4-05efef3d2e49 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:57.334498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6bde8c8c-7d86-468a-8da4-05efef3d2e49 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:57.338187 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6bde8c8c-7d86-468a-8da4-05efef3d2e49 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:57.340439 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6bde8c8c-7d86-468a-8da4-05efef3d2e49 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:57.361580 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:57.462064 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0046eaa4-746b-4096-be8d-1a93f8e0ed59 tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-784649564", "block_migration": true, "disk_over_commit": false}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:57.463429 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0046eaa4-746b-4096-be8d-1a93f8e0ed59 tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] [instance: b5b01010-9fd2-4092-ad1d-29edac4ecaa4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:57.474115 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:DELETE=8 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:25:57.492547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0046eaa4-746b-4096-be8d-1a93f8e0ed59 tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:57.497793 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0046eaa4-746b-4096-be8d-1a93f8e0ed59 tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:57.498993 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0046eaa4-746b-4096-be8d-1a93f8e0ed59 tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:57.500896 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0046eaa4-746b-4096-be8d-1a93f8e0ed59 tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:57.793169 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-0046eaa4-746b-4096-be8d-1a93f8e0ed59 tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Lazy-loading 'flavor' on Instance uuid b5b01010-9fd2-4092-ad1d-29edac4ecaa4 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:25:57.860019 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6bde8c8c-7d86-468a-8da4-05efef3d2e49 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:57.869206 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6bde8c8c-7d86-468a-8da4-05efef3d2e49 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a" status: 200 len: 1320 microversion: 2.1 time: 0.623115 Jul 19 22:25:57.874402 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 156/299] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:57 2022] GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a => generated 1320 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:57.958411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0046eaa4-746b-4096-be8d-1a93f8e0ed59 tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] [instance: b5b01010-9fd2-4092-ad1d-29edac4ecaa4] Going to try to live migrate instance to tempest-host-784649564 {{(pid=119338) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 22:25:57.986153 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-0046eaa4-746b-4096-be8d-1a93f8e0ed59 tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] HTTP exception thrown: Compute host tempest-host-784649564 could not be found. Jul 19 22:25:57.993499 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0046eaa4-746b-4096-be8d-1a93f8e0ed59 tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Request method failure captured: Jul 19 22:25:57.993499 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4/action HTTP/1.1 Jul 19 22:25:57.993499 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:25:57.993499 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:25:57.993499 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:25:57.993499 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 106 Jul 19 22:25:57.993499 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:25:57.993499 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:25:57.993499 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:25:57.993499 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:25:57.993499 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y9aBBxfdQcUZLicibB3ped9ja0hN4VBobhieI2igBFVvKbrpyDlFHcgiPFSIsVXc7OQHyfNkPyCQzYCwK-6sdtgR2RJTM3eEqKDCaswTPhG0aK6I1WZp1FRJ3ZW3YtHfKZhJFV1Xi-OUUbLRHIq1xLpZgNjdOoQl-VyCc47XDvajpg Jul 19 22:25:57.993499 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:25:57.993499 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:25:57.993499 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:25:57.993499 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:25:57.993499 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:25:57.993499 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:25:57.993499 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: cbb7434655ef402a9f06de2536290f98 Jul 19 22:25:57.993499 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-LiveMigrationNegativeTest-1941312689 Jul 19 22:25:57.993499 n-d-847009-3 devstack@n-api.service[119338]: X-Role: admin,member,reader Jul 19 22:25:57.993499 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: admin,member,reader Jul 19 22:25:57.994683 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cbb7434655ef402a9f06de2536290f98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cbb7434655ef402a9f06de2536290f98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cbb7434655ef402a9f06de2536290f98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cbb7434655ef402a9f06de2536290f98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:25:57.994683 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-LiveMigrationNegativeTest-1941312689 Jul 19 22:25:57.994683 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: cbb7434655ef402a9f06de2536290f98 Jul 19 22:25:57.994683 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1941312689 Jul 19 22:25:57.994683 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-LiveMigrationNegativeTest-1941312689-project-admin Jul 19 22:25:57.994683 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:25:57.994683 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:25:57.994683 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: b5ae3676ec164be6a88ebc82b2dea078 Jul 19 22:25:57.994683 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-LiveMigrationNegativeTest-1941312689-project-admin Jul 19 22:25:57.994683 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:25:57.994683 n-d-847009-3 devstack@n-api.service[119338]: {"os-migrateLive": {"host": "tempest-host-784649564", "block_migration": true, "disk_over_commit": false}} Jul 19 22:25:57.994683 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:25:57.995599 n-d-847009-3 devstack@n-api.service[119338]: exception: Compute host tempest-host-784649564 could not be found. Jul 19 22:25:57.995599 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'b5b01010-9fd2-4092-ad1d-29edac4ecaa4', 'body': {'os-migrateLive': {'host': 'tempest-host-784649564', 'block_migration': True, 'disk_over_commit': False}}} Jul 19 22:25:57.995599 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:25:57.995599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:57.995599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 19 22:25:57.995599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 19 22:25:57.995599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 19 22:25:57.995599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 22:25:57.995599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 19 22:25:57.995599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 22:25:57.995599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 19 22:25:57.995599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 22:25:57.995599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 19 22:25:57.995599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 22:25:57.995599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 19 22:25:57.995599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 22:25:57.995599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 19 22:25:57.995599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 22:25:57.995599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 22:25:57.996601 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 22:25:57.996601 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 22:25:57.996601 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 22:25:57.996601 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jul 19 22:25:57.996601 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 19 22:25:57.996601 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:25:57.996601 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:25:57.996601 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 19 22:25:57.996601 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 19 22:25:57.996601 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 19 22:25:57.996601 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:57.996601 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 19 22:25:57.996601 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 19 22:25:57.996601 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 19 22:25:57.996601 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 19 22:25:57.996601 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 19 22:25:57.996601 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 19 22:25:57.996601 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-784649564 could not be found. Jul 19 22:25:57.996601 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:57.997657 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:57.997657 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:57.997657 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:57.997657 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:57.997657 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:57.997657 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:25:57.997657 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:25:57.997657 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:25:57.997657 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:25:57.997657 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:25:57.997657 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:25:57.997657 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:25:57.997657 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:25:57.997657 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:25:57.997657 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:25:57.997657 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 19 22:25:57.997657 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 19 22:25:57.997657 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 22:25:57.997657 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-784649564 could not be found. Jul 19 22:25:57.997657 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:57.998843 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:25:57.998843 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:57.998843 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:25:57.998843 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:25:57.998843 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:25:57.998843 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:25:57.998843 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:25:57.998843 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-784649564 could not be found. Jul 19 22:25:57.998843 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:25:57.999485 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0046eaa4-746b-4096-be8d-1a93f8e0ed59 tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Returning 400 to user: Compute host tempest-host-784649564 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:25:58.002799 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0046eaa4-746b-4096-be8d-1a93f8e0ed59 tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4/action" status: 400 len: 99 microversion: 2.1 time: 0.956882 Jul 19 22:25:58.004089 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 144/300] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Jul 19 22:25:57 2022] POST /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4/action => generated 99 bytes in 961 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 22:25:58.010731 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8762bfa4-af1f-403e-9c64-d65aca2c84cd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:58.011874 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8762bfa4-af1f-403e-9c64-d65aca2c84cd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:58.026233 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8762bfa4-af1f-403e-9c64-d65aca2c84cd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:58.026927 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8762bfa4-af1f-403e-9c64-d65aca2c84cd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:58.027943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8762bfa4-af1f-403e-9c64-d65aca2c84cd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:58.028693 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8762bfa4-af1f-403e-9c64-d65aca2c84cd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:58.108760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9f2e3561-e18e-4dd6-ad82-52d928da3adb tempest-FlavorsAdminTestJSON-1917082048 tempest-FlavorsAdminTestJSON-1917082048-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:58.153524 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9f2e3561-e18e-4dd6-ad82-52d928da3adb tempest-FlavorsAdminTestJSON-1917082048 tempest-FlavorsAdminTestJSON-1917082048-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6218 microversion: 2.1 time: 0.277693 Jul 19 22:25:58.169874 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 157/301] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:25:57 2022] GET /compute/v2.1/flavors/detail => generated 6218 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:58.176203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-425b8c47-971a-423d-bf67-828eb9c47399 tempest-FlavorsAccessTestJSON-1052961089 tempest-FlavorsAccessTestJSON-1052961089-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "03fb8f34a5b24f9fa9255bbfd7d35f5a"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:58.178190 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:58.178190 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:58.303091 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-425b8c47-971a-423d-bf67-828eb9c47399 tempest-FlavorsAccessTestJSON-1052961089 tempest-FlavorsAccessTestJSON-1052961089-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/529921738/action" status: 200 len: 21 microversion: 2.1 time: 0.129039 Jul 19 22:25:58.304402 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 158/302] 10.222.0.25 () {60 vars in 1196 bytes} [Tue Jul 19 22:25:58 2022] POST /compute/v2.1/flavors/529921738/action => generated 21 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:25:58.315666 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-82bc5fb5-02d3-41e6-ab75-b257618d0ec6 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:58.318175 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-82bc5fb5-02d3-41e6-ab75-b257618d0ec6 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:58.335200 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-82bc5fb5-02d3-41e6-ab75-b257618d0ec6 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:58.335910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-82bc5fb5-02d3-41e6-ab75-b257618d0ec6 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:58.336852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-82bc5fb5-02d3-41e6-ab75-b257618d0ec6 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:58.337475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-82bc5fb5-02d3-41e6-ab75-b257618d0ec6 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:58.431246 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8762bfa4-af1f-403e-9c64-d65aca2c84cd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:58.444289 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8762bfa4-af1f-403e-9c64-d65aca2c84cd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1472 microversion: 2.1 time: 0.438639 Jul 19 22:25:58.445093 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 145/303] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:58 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1472 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:58.457866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-fa7bba02-7f1b-4c08-81e9-6e908d60e3ab req-0c332e50-68ee-4515-bac6-3106dc7fc2da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a", "tag": "466d0f1d-6d97-46a8-ab3c-6441661159ed"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:25:58.470868 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-fa7bba02-7f1b-4c08-81e9-6e908d60e3ab req-0c332e50-68ee-4515-bac6-3106dc7fc2da service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:58.471540 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-fa7bba02-7f1b-4c08-81e9-6e908d60e3ab req-0c332e50-68ee-4515-bac6-3106dc7fc2da service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:58.507076 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-fa7bba02-7f1b-4c08-81e9-6e908d60e3ab req-0c332e50-68ee-4515-bac6-3106dc7fc2da service nova] Creating event network-changed:466d0f1d-6d97-46a8-ab3c-6441661159ed for instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a on n-h1-847009-3 Jul 19 22:25:58.522380 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-fa7bba02-7f1b-4c08-81e9-6e908d60e3ab req-0c332e50-68ee-4515-bac6-3106dc7fc2da service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073512 Jul 19 22:25:58.523402 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 146/304] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:25:58.538812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ca9cbb01-3f32-45a7-a924-f62907c97017 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:58.545649 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ca9cbb01-3f32-45a7-a924-f62907c97017 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: b5b01010-9fd2-4092-ad1d-29edac4ecaa4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:58.561490 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca9cbb01-3f32-45a7-a924-f62907c97017 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:58.561950 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca9cbb01-3f32-45a7-a924-f62907c97017 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:58.562744 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca9cbb01-3f32-45a7-a924-f62907c97017 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:58.563208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca9cbb01-3f32-45a7-a924-f62907c97017 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:59.223766 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-82bc5fb5-02d3-41e6-ab75-b257618d0ec6 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:59.237528 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-82bc5fb5-02d3-41e6-ab75-b257618d0ec6 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a" status: 200 len: 1587 microversion: 2.1 time: 0.929181 Jul 19 22:25:59.238345 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 159/305] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:58 2022] GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a => generated 1587 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:59.243716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bfb3a377-57a6-4d59-9b8f-3d3528e5680e tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:59.251711 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:59.251711 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:25:59.287349 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bfb3a377-57a6-4d59-9b8f-3d3528e5680e tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/509797794" status: 202 len: 0 microversion: 2.1 time: 0.046706 Jul 19 22:25:59.287998 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 160/306] 10.222.0.25 () {58 vars in 1157 bytes} [Tue Jul 19 22:25:59 2022] DELETE /compute/v2.1/flavors/509797794 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:25:59.304331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-357dc507-a7f5-44d2-9f85-320b3cc603a4 tempest-FlavorsAccessTestJSON-1296441442 tempest-FlavorsAccessTestJSON-1296441442-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:59.346931 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-357dc507-a7f5-44d2-9f85-320b3cc603a4 tempest-FlavorsAccessTestJSON-1296441442 tempest-FlavorsAccessTestJSON-1296441442-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.057497 Jul 19 22:25:59.355740 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 161/307] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:25:59 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:59.380862 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-749efcc8-569e-4e90-bb7d-f6e80aec1fad tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:59.381498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-749efcc8-569e-4e90-bb7d-f6e80aec1fad tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: 0c5f1490-8946-4758-baa2-3eacd9b32d5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:59.391038 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-749efcc8-569e-4e90-bb7d-f6e80aec1fad tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:59.392090 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-749efcc8-569e-4e90-bb7d-f6e80aec1fad tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:59.402188 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-749efcc8-569e-4e90-bb7d-f6e80aec1fad tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:59.403263 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-749efcc8-569e-4e90-bb7d-f6e80aec1fad tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:59.449051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ca9cbb01-3f32-45a7-a924-f62907c97017 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:25:59.459913 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ca9cbb01-3f32-45a7-a924-f62907c97017 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4" status: 200 len: 1469 microversion: 2.1 time: 0.929392 Jul 19 22:25:59.460493 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 147/308] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:58 2022] GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4 => generated 1469 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:59.479832 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7b866ca6-e947-453b-86a9-df2b6f17d069 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:59.545005 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7b866ca6-e947-453b-86a9-df2b6f17d069 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.077749 Jul 19 22:25:59.546259 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 148/309] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:25:59 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:25:59.603677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dda51fb7-2665-4ab4-9153-510cd1e8a9ca tempest-FlavorsAccessTestJSON-1052961089 tempest-FlavorsAccessTestJSON-1052961089-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:59.604660 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:25:59.604660 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:25:59.625138 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dda51fb7-2665-4ab4-9153-510cd1e8a9ca tempest-FlavorsAccessTestJSON-1052961089 tempest-FlavorsAccessTestJSON-1052961089-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/529921738" status: 202 len: 0 microversion: 2.1 time: 0.077509 Jul 19 22:25:59.627217 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 149/310] 10.222.0.25 () {58 vars in 1157 bytes} [Tue Jul 19 22:25:59 2022] DELETE /compute/v2.1/flavors/529921738 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:25:59.650361 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-68b2db6e-1686-4de4-b8c6-abbc87e8e58c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:25:59.651299 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-68b2db6e-1686-4de4-b8c6-abbc87e8e58c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:25:59.668459 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-68b2db6e-1686-4de4-b8c6-abbc87e8e58c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:59.668915 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-68b2db6e-1686-4de4-b8c6-abbc87e8e58c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:25:59.669875 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-68b2db6e-1686-4de4-b8c6-abbc87e8e58c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:25:59.671218 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-68b2db6e-1686-4de4-b8c6-abbc87e8e58c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:00.078787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-749efcc8-569e-4e90-bb7d-f6e80aec1fad tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:00.092159 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-749efcc8-569e-4e90-bb7d-f6e80aec1fad tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a" status: 200 len: 1470 microversion: 2.1 time: 0.722879 Jul 19 22:26:00.122071 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 162/311] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:59 2022] GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a => generated 1470 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:00.145677 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c76b9258-123a-4642-ba95-bb479fc43496 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-300860651", "id": 1821355873, "os-flavor-access:is_public": "False"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:00.159398 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:00.159398 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:00.208321 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-68b2db6e-1686-4de4-b8c6-abbc87e8e58c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:00.217835 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-68b2db6e-1686-4de4-b8c6-abbc87e8e58c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1477 microversion: 2.1 time: 0.590310 Jul 19 22:26:00.238155 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c76b9258-123a-4642-ba95-bb479fc43496 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.113211 Jul 19 22:26:00.239747 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 150/312] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:25:59 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1477 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:00.251623 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 163/313] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:26:00 2022] POST /compute/v2.1/flavors => generated 429 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:00.257652 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-72223969-688e-4e5a-8595-4716fc2b7916 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1830479794", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:00.305927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-50a1730b-0170-4985-aadf-e82cbdb55eb8 tempest-FlavorsAccessTestJSON-1052961089 tempest-FlavorsAccessTestJSON-1052961089-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:00.347539 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-72223969-688e-4e5a-8595-4716fc2b7916 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] validate_networks() for None {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:26:00.356829 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-50a1730b-0170-4985-aadf-e82cbdb55eb8 tempest-FlavorsAccessTestJSON-1052961089 tempest-FlavorsAccessTestJSON-1052961089-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.090121 Jul 19 22:26:00.358131 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 164/314] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:26:00 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:00.389974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bc0d86ce-33a1-453c-a1b7-9f232f51c669 tempest-DeleteServersAdminTestJSON-1655448443 tempest-DeleteServersAdminTestJSON-1655448443-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:00.392136 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bc0d86ce-33a1-453c-a1b7-9f232f51c669 tempest-DeleteServersAdminTestJSON-1655448443 tempest-DeleteServersAdminTestJSON-1655448443-project-admin] [instance: 0c5f1490-8946-4758-baa2-3eacd9b32d5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:00.411351 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc0d86ce-33a1-453c-a1b7-9f232f51c669 tempest-DeleteServersAdminTestJSON-1655448443 tempest-DeleteServersAdminTestJSON-1655448443-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:00.412447 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc0d86ce-33a1-453c-a1b7-9f232f51c669 tempest-DeleteServersAdminTestJSON-1655448443 tempest-DeleteServersAdminTestJSON-1655448443-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:00.414715 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc0d86ce-33a1-453c-a1b7-9f232f51c669 tempest-DeleteServersAdminTestJSON-1655448443 tempest-DeleteServersAdminTestJSON-1655448443-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:00.415932 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc0d86ce-33a1-453c-a1b7-9f232f51c669 tempest-DeleteServersAdminTestJSON-1655448443 tempest-DeleteServersAdminTestJSON-1655448443-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:00.660789 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bc0d86ce-33a1-453c-a1b7-9f232f51c669 tempest-DeleteServersAdminTestJSON-1655448443 tempest-DeleteServersAdminTestJSON-1655448443-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a/action" status: 202 len: 0 microversion: 2.1 time: 0.280451 Jul 19 22:26:00.664316 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 165/315] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:26:00 2022] POST /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:26:00.670553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-83eef41e-7918-418d-a08f-8b883de8327d tempest-FlavorsAdminTestJSON-1917082048 tempest-FlavorsAdminTestJSON-1917082048-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "1821355873"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:00.685165 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-83eef41e-7918-418d-a08f-8b883de8327d tempest-FlavorsAdminTestJSON-1917082048 tempest-FlavorsAdminTestJSON-1917082048-project] HTTP exception thrown: Flavor 1821355873 could not be found. Jul 19 22:26:00.689730 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-83eef41e-7918-418d-a08f-8b883de8327d tempest-FlavorsAdminTestJSON-1917082048 tempest-FlavorsAdminTestJSON-1917082048-project] Request method failure captured: Jul 19 22:26:00.689730 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:26:00.689730 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:26:00.689730 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:26:00.689730 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:26:00.689730 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 107 Jul 19 22:26:00.689730 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:26:00.689730 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:26:00.689730 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:26:00.689730 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:00.689730 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y9sXPoNPDOQR7-Xx658EPnsooje82mYJs7v-iHq4TFIgZYRRLfeqAC_7vVgoRZ9fI8pikIx5KhhvfuYG5YFnmognWAlaLBa0PYs1GB-9R82l92cLJjSxGrZ0Y6H429REWyTdMHmbyUsPpa6pBr4en4Ru9dAaNPcJVYikuAAW_9qFqg Jul 19 22:26:00.689730 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:26:00.689730 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:26:00.689730 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:26:00.689730 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:26:00.689730 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:26:00.689730 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:26:00.689730 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: d3563a84f1c544cdafa8b14f3d16c36e Jul 19 22:26:00.689730 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-FlavorsAdminTestJSON-1917082048 Jul 19 22:26:00.689730 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:26:00.689730 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:26:00.690997 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3563a84f1c544cdafa8b14f3d16c36e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3563a84f1c544cdafa8b14f3d16c36e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3563a84f1c544cdafa8b14f3d16c36e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3563a84f1c544cdafa8b14f3d16c36e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:00.690997 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-FlavorsAdminTestJSON-1917082048 Jul 19 22:26:00.690997 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: d3563a84f1c544cdafa8b14f3d16c36e Jul 19 22:26:00.690997 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1917082048 Jul 19 22:26:00.690997 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-FlavorsAdminTestJSON-1917082048-project Jul 19 22:26:00.690997 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:26:00.690997 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:26:00.690997 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: e71f342c8c784085801fc8a003eff518 Jul 19 22:26:00.690997 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-FlavorsAdminTestJSON-1917082048-project Jul 19 22:26:00.690997 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:26:00.690997 n-d-847009-3 devstack@n-api.service[119337]: {"server": {"name": "test", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "1821355873"}} Jul 19 22:26:00.690997 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:26:00.690997 n-d-847009-3 devstack@n-api.service[119337]: exception: Flavor 1821355873 could not be found. Jul 19 22:26:00.691979 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691', 'flavorRef': '1821355873'}}} Jul 19 22:26:00.691979 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:00.691979 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:00.691979 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 19 22:26:00.691979 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 19 22:26:00.691979 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 22:26:00.691979 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 22:26:00.691979 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:26:00.691979 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:26:00.691979 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 22:26:00.691979 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 22:26:00.691979 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 22:26:00.691979 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:00.691979 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 22:26:00.691979 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 22:26:00.691979 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1821355873 could not be found. Jul 19 22:26:00.691979 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:00.691979 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:00.691979 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:00.691979 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:00.693038 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:00.693038 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:00.693038 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:00.693038 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:00.693038 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:00.693038 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:00.693038 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:26:00.693038 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:26:00.693038 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:26:00.693038 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:26:00.693038 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:26:00.693038 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:26:00.693038 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 22:26:00.693038 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 19 22:26:00.693038 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 19 22:26:00.693038 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1821355873 could not be found. Jul 19 22:26:00.693038 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:00.693038 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:00.693038 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:00.693038 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:00.693038 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:00.694098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:00.694098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:26:00.694098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:26:00.694098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1821355873 could not be found. Jul 19 22:26:00.694098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:00.696113 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-83eef41e-7918-418d-a08f-8b883de8327d tempest-FlavorsAdminTestJSON-1917082048 tempest-FlavorsAdminTestJSON-1917082048-project] Returning 400 to user: Flavor 1821355873 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:00.697446 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-83eef41e-7918-418d-a08f-8b883de8327d tempest-FlavorsAdminTestJSON-1917082048 tempest-FlavorsAdminTestJSON-1917082048-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.034529 Jul 19 22:26:00.699981 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 166/316] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:26:00 2022] POST /compute/v2.1/servers => generated 81 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 22:26:00.713005 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a9adcf4c-919f-4136-b478-c6d95cb228fc tempest-FlavorsAccessTestJSON-1052961089 tempest-FlavorsAccessTestJSON-1052961089-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1153607924", "id": 2079091671, "os-flavor-access:is_public": "False"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:00.715960 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:00.715960 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:00.757680 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a9adcf4c-919f-4136-b478-c6d95cb228fc tempest-FlavorsAccessTestJSON-1052961089 tempest-FlavorsAccessTestJSON-1052961089-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.056289 Jul 19 22:26:00.760695 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 167/317] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:26:00 2022] POST /compute/v2.1/flavors => generated 431 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:00.765854 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b385e772-c6fb-4edf-bcc9-17ef645b3609 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:00.767379 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b385e772-c6fb-4edf-bcc9-17ef645b3609 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: 0c5f1490-8946-4758-baa2-3eacd9b32d5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:00.776727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=13,nova_api:INSERT=4 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:26:00.785373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b385e772-c6fb-4edf-bcc9-17ef645b3609 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:00.788342 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b385e772-c6fb-4edf-bcc9-17ef645b3609 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:00.789169 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b385e772-c6fb-4edf-bcc9-17ef645b3609 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:00.789609 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b385e772-c6fb-4edf-bcc9-17ef645b3609 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:00.890866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b385e772-c6fb-4edf-bcc9-17ef645b3609 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:00.893182 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b385e772-c6fb-4edf-bcc9-17ef645b3609 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:00.893182 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-b385e772-c6fb-4edf-bcc9-17ef645b3609 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lazy-loading 'fault' on Instance uuid 0c5f1490-8946-4758-baa2-3eacd9b32d5a {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:26:01.127970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-72223969-688e-4e5a-8595-4716fc2b7916 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:26:01.128515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-72223969-688e-4e5a-8595-4716fc2b7916 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:26:01.128838 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-72223969-688e-4e5a-8595-4716fc2b7916 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:26:01.129405 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-72223969-688e-4e5a-8595-4716fc2b7916 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:26:01.129990 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-72223969-688e-4e5a-8595-4716fc2b7916 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:26:01.150477 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-72223969-688e-4e5a-8595-4716fc2b7916 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:01.151436 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-72223969-688e-4e5a-8595-4716fc2b7916 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:01.152417 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-72223969-688e-4e5a-8595-4716fc2b7916 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:01.152857 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-72223969-688e-4e5a-8595-4716fc2b7916 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:01.208618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-72223969-688e-4e5a-8595-4716fc2b7916 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Getting quotas for project cf9f0d3bd470463abf724fc6b043caac. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:26:01.223946 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-72223969-688e-4e5a-8595-4716fc2b7916 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Getting quotas for user 715c3a84a6f64cf485cadcc983e4dd77 and project cf9f0d3bd470463abf724fc6b043caac. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:26:01.246098 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-72223969-688e-4e5a-8595-4716fc2b7916 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:26:01.248895 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-72223969-688e-4e5a-8595-4716fc2b7916 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: 04279b5f-973f-463f-9bdc-29eab24edeb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:26:01.368479 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-72223969-688e-4e5a-8595-4716fc2b7916 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.116211 Jul 19 22:26:01.377786 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 151/318] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:26:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:26:01.386894 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8a49a649-b7ed-46f9-8f55-7f888805841e tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:01.393527 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:01.393527 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:01.436931 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8a49a649-b7ed-46f9-8f55-7f888805841e tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1821355873" status: 202 len: 0 microversion: 2.1 time: 0.057817 Jul 19 22:26:01.439679 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 152/319] 10.222.0.25 () {58 vars in 1160 bytes} [Tue Jul 19 22:26:01 2022] DELETE /compute/v2.1/flavors/1821355873 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:26:01.453690 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8be2694b-f4df-4952-9abc-ec22273f6103 tempest-FlavorsAccessTestJSON-1052961089 tempest-FlavorsAccessTestJSON-1052961089-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:01.460189 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:01.460189 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:01.507267 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8be2694b-f4df-4952-9abc-ec22273f6103 tempest-FlavorsAccessTestJSON-1052961089 tempest-FlavorsAccessTestJSON-1052961089-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/2079091671/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.066164 Jul 19 22:26:01.508417 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 153/320] 10.222.0.25 () {58 vars in 1208 bytes} [Tue Jul 19 22:26:01 2022] GET /compute/v2.1/flavors/2079091671/os-flavor-access => generated 21 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:26:01.517801 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2c9235a6-ec0f-48c3-a273-b666f149d169 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:01.518794 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2c9235a6-ec0f-48c3-a273-b666f149d169 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:01.528336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c9235a6-ec0f-48c3-a273-b666f149d169 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:01.539945 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c9235a6-ec0f-48c3-a273-b666f149d169 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:01.542875 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c9235a6-ec0f-48c3-a273-b666f149d169 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:01.545543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c9235a6-ec0f-48c3-a273-b666f149d169 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:02.007821 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b385e772-c6fb-4edf-bcc9-17ef645b3609 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:02.019236 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b385e772-c6fb-4edf-bcc9-17ef645b3609 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a" status: 200 len: 1453 microversion: 2.1 time: 1.255901 Jul 19 22:26:02.022187 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 168/321] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:00 2022] GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a => generated 1453 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:02.034329 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-05dff95d-2f24-49e3-8322-1d84fe3695cf tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:02.035945 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-05dff95d-2f24-49e3-8322-1d84fe3695cf tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: 04279b5f-973f-463f-9bdc-29eab24edeb2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:02.357130 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-05dff95d-2f24-49e3-8322-1d84fe3695cf tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:02.364853 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-05dff95d-2f24-49e3-8322-1d84fe3695cf tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2" status: 200 len: 1219 microversion: 2.1 time: 0.341323 Jul 19 22:26:02.366984 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 169/322] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:02 2022] GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2 => generated 1219 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:02.380477 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6a345d65-a9ee-4214-94fc-454157ae255d tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:02.459194 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6a345d65-a9ee-4214-94fc-454157ae255d tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.090684 Jul 19 22:26:02.477410 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 170/323] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:26:02 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:02.484481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fe189b31-459d-4d54-ba9d-df202585b42e tempest-FlavorsAccessTestJSON-1052961089 tempest-FlavorsAccessTestJSON-1052961089-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:02.486218 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:02.486218 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:02.557487 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fe189b31-459d-4d54-ba9d-df202585b42e tempest-FlavorsAccessTestJSON-1052961089 tempest-FlavorsAccessTestJSON-1052961089-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2079091671" status: 202 len: 0 microversion: 2.1 time: 0.078220 Jul 19 22:26:02.583940 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 171/324] 10.222.0.25 () {58 vars in 1160 bytes} [Tue Jul 19 22:26:02 2022] DELETE /compute/v2.1/flavors/2079091671 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:26:02.600359 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1a6b8f99-1fc0-408c-926e-64361e23c0c0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:02.601266 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1a6b8f99-1fc0-408c-926e-64361e23c0c0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: 0c5f1490-8946-4758-baa2-3eacd9b32d5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:02.616899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a6b8f99-1fc0-408c-926e-64361e23c0c0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:02.623993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a6b8f99-1fc0-408c-926e-64361e23c0c0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:02.625183 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a6b8f99-1fc0-408c-926e-64361e23c0c0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:02.626646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a6b8f99-1fc0-408c-926e-64361e23c0c0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:02.695309 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1a6b8f99-1fc0-408c-926e-64361e23c0c0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: 0c5f1490-8946-4758-baa2-3eacd9b32d5a] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:26:02.962684 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1a6b8f99-1fc0-408c-926e-64361e23c0c0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a" status: 204 len: 0 microversion: 2.1 time: 0.375830 Jul 19 22:26:02.990381 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 172/325] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:26:02 2022] DELETE /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:26:03.007274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b5fe6c5e-eafa-498b-8e9a-7e56db594542 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2146563738", "id": 1582912549, "os-flavor-access:is_public": "False"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:03.012873 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:03.012873 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:03.040990 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b5fe6c5e-eafa-498b-8e9a-7e56db594542 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.051835 Jul 19 22:26:03.046735 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 173/326] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:26:02 2022] POST /compute/v2.1/flavors => generated 415 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:03.061867 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-47a82d4f-7936-4489-aa92-58513a2fbfff tempest-FlavorsAccessTestJSON-1052961089 tempest-FlavorsAccessTestJSON-1052961089-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:03.098359 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-47a82d4f-7936-4489-aa92-58513a2fbfff tempest-FlavorsAccessTestJSON-1052961089 tempest-FlavorsAccessTestJSON-1052961089-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.048701 Jul 19 22:26:03.099299 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 174/327] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:26:03 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:03.114043 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9376e27b-2a1c-4f27-aec5-6851d42fda5a tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:03.128255 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9376e27b-2a1c-4f27-aec5-6851d42fda5a tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: 0c5f1490-8946-4758-baa2-3eacd9b32d5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:03.160341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9376e27b-2a1c-4f27-aec5-6851d42fda5a tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:03.161104 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9376e27b-2a1c-4f27-aec5-6851d42fda5a tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:03.162133 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9376e27b-2a1c-4f27-aec5-6851d42fda5a tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:03.163272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9376e27b-2a1c-4f27-aec5-6851d42fda5a tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:03.265616 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9376e27b-2a1c-4f27-aec5-6851d42fda5a tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:03.266332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9376e27b-2a1c-4f27-aec5-6851d42fda5a tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:03.268187 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-9376e27b-2a1c-4f27-aec5-6851d42fda5a tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lazy-loading 'fault' on Instance uuid 0c5f1490-8946-4758-baa2-3eacd9b32d5a {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:26:03.316956 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2c9235a6-ec0f-48c3-a273-b666f149d169 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:03.360457 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2c9235a6-ec0f-48c3-a273-b666f149d169 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1477 microversion: 2.1 time: 1.844656 Jul 19 22:26:03.362232 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 154/328] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:01 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1477 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:03.367720 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-153229ad-7258-4483-afdd-8034dc125bfe tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-204964121", "id": 557342515, "os-flavor-access:is_public": "True"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:03.371078 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:03.371078 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:03.467050 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-153229ad-7258-4483-afdd-8034dc125bfe tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.103060 Jul 19 22:26:03.468264 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 155/329] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:26:03 2022] POST /compute/v2.1/flavors => generated 410 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:03.473729 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6efae9c7-2e11-4a08-a29a-0fc48853bd3b tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:03.478506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6efae9c7-2e11-4a08-a29a-0fc48853bd3b tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: 04279b5f-973f-463f-9bdc-29eab24edeb2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:03.499997 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6efae9c7-2e11-4a08-a29a-0fc48853bd3b tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:03.500672 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6efae9c7-2e11-4a08-a29a-0fc48853bd3b tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:03.505093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6efae9c7-2e11-4a08-a29a-0fc48853bd3b tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:03.505819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6efae9c7-2e11-4a08-a29a-0fc48853bd3b tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:04.202328 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6efae9c7-2e11-4a08-a29a-0fc48853bd3b tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:04.215890 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6efae9c7-2e11-4a08-a29a-0fc48853bd3b tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2" status: 200 len: 1271 microversion: 2.1 time: 0.746373 Jul 19 22:26:04.216473 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 156/330] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:03 2022] GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2 => generated 1271 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:04.257349 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bdf7aaa0-b3d1-42fe-93bc-470b4d8b12ae tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:04.339597 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bdf7aaa0-b3d1-42fe-93bc-470b4d8b12ae tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.111920 Jul 19 22:26:04.345743 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 157/331] 10.222.0.25 () {58 vars in 1168 bytes} [Tue Jul 19 22:26:04 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:04.361751 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e4f23ad7-6827-4861-8842-444ad0a64c18 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:04.398954 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e4f23ad7-6827-4861-8842-444ad0a64c18 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.043653 Jul 19 22:26:04.403998 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 158/332] 10.222.0.25 () {58 vars in 1176 bytes} [Tue Jul 19 22:26:04 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:04.421842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-db56e75a-da44-4010-bcc3-ecf69b20544b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:04.423848 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-db56e75a-da44-4010-bcc3-ecf69b20544b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:04.442204 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-db56e75a-da44-4010-bcc3-ecf69b20544b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:04.445298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-db56e75a-da44-4010-bcc3-ecf69b20544b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:04.446988 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-db56e75a-da44-4010-bcc3-ecf69b20544b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:04.449700 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-db56e75a-da44-4010-bcc3-ecf69b20544b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:04.566206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9376e27b-2a1c-4f27-aec5-6851d42fda5a tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:04.598351 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9376e27b-2a1c-4f27-aec5-6851d42fda5a tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a" status: 200 len: 1459 microversion: 2.1 time: 1.497602 Jul 19 22:26:04.599435 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 175/333] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:03 2022] GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a => generated 1459 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:04.612919 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-34bbf215-dd1b-48fb-8dc2-4f9818d7dd2e tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:04.662899 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-34bbf215-dd1b-48fb-8dc2-4f9818d7dd2e tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.054373 Jul 19 22:26:04.664596 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 176/334] 10.222.0.25 () {58 vars in 1170 bytes} [Tue Jul 19 22:26:04 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:04.685943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d5343559-83ab-4ffd-8dec-23a5228e10d7 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:04.702400 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d5343559-83ab-4ffd-8dec-23a5228e10d7 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.024626 Jul 19 22:26:04.714691 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 177/335] 10.222.0.25 () {58 vars in 1168 bytes} [Tue Jul 19 22:26:04 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:04.724522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fb319635-17a9-41a0-bfe0-8763ff3740a6 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:04.759248 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fb319635-17a9-41a0-bfe0-8763ff3740a6 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6217 microversion: 2.1 time: 0.043202 Jul 19 22:26:04.760054 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 178/336] 10.222.0.25 () {58 vars in 1168 bytes} [Tue Jul 19 22:26:04 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6217 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:04.776325 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d9068931-8583-4a30-a8b4-bde0f450f238 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:04.807570 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d9068931-8583-4a30-a8b4-bde0f450f238 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6217 microversion: 2.1 time: 0.034919 Jul 19 22:26:04.809093 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 179/337] 10.222.0.25 () {58 vars in 1174 bytes} [Tue Jul 19 22:26:04 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6217 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:26:04.831682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3c1c3865-308f-45a9-851b-0421af93faa6 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:04.833048 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-db56e75a-da44-4010-bcc3-ecf69b20544b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:04.843678 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-db56e75a-da44-4010-bcc3-ecf69b20544b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1477 microversion: 2.1 time: 0.438338 Jul 19 22:26:04.848556 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 159/338] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:04 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1477 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:04.877995 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3c1c3865-308f-45a9-851b-0421af93faa6 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6217 microversion: 2.1 time: 0.057163 Jul 19 22:26:04.879292 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 180/339] 10.222.0.25 () {58 vars in 1172 bytes} [Tue Jul 19 22:26:04 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6217 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:26:04.895043 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d72613ea-d5e2-48fd-b328-348375c94eae tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:04.923074 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d72613ea-d5e2-48fd-b328-348375c94eae tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6217 microversion: 2.1 time: 0.031680 Jul 19 22:26:04.935164 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 160/340] 10.222.0.25 () {58 vars in 1168 bytes} [Tue Jul 19 22:26:04 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6217 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:04.940300 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eab70739-0cd6-4bd6-8689-0a3ac145628b tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:04.941173 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:04.941173 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:04.965805 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eab70739-0cd6-4bd6-8689-0a3ac145628b tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/557342515" status: 202 len: 0 microversion: 2.1 time: 0.029907 Jul 19 22:26:04.978103 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6c750cf6-e8b6-4059-b80e-e582d8c50330 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:04.983526 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 181/341] 10.222.0.25 () {58 vars in 1157 bytes} [Tue Jul 19 22:26:04 2022] DELETE /compute/v2.1/flavors/557342515 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:26:05.003907 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6c750cf6-e8b6-4059-b80e-e582d8c50330 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.030678 Jul 19 22:26:05.014827 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 161/342] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:26:04 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:05.021889 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9da2788c-08dd-4f15-a021-03323cfeeda4 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:05.045139 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9da2788c-08dd-4f15-a021-03323cfeeda4 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1582912549" status: 202 len: 0 microversion: 2.1 time: 0.026742 Jul 19 22:26:05.051742 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 182/343] 10.222.0.25 () {58 vars in 1160 bytes} [Tue Jul 19 22:26:05 2022] DELETE /compute/v2.1/flavors/1582912549 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:26:05.056104 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b048852e-e037-4a3d-9654-b805455599a0 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:05.102170 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b048852e-e037-4a3d-9654-b805455599a0 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.049847 Jul 19 22:26:05.103278 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 162/344] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:26:05 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:05.127346 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-744db9e4-397e-4d11-91f8-7031c63d6d42 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-83582522", "id": 2021466657, "os-flavor-access:is_public": "False"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:05.129792 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:05.129792 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:05.152140 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-744db9e4-397e-4d11-91f8-7031c63d6d42 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.033264 Jul 19 22:26:05.161046 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 183/345] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:26:05 2022] POST /compute/v2.1/flavors => generated 413 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:05.168360 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f0f77cc8-3747-411b-a05a-f04552e6c146 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:05.236770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-765727a9-cdbc-48d7-929a-fa29f13b6969 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:05.237617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-765727a9-cdbc-48d7-929a-fa29f13b6969 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: 04279b5f-973f-463f-9bdc-29eab24edeb2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:05.242021 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f0f77cc8-3747-411b-a05a-f04552e6c146 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.081148 Jul 19 22:26:05.246374 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 163/346] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:26:05 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:05.256420 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-765727a9-cdbc-48d7-929a-fa29f13b6969 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:05.257014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-765727a9-cdbc-48d7-929a-fa29f13b6969 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:05.257932 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-765727a9-cdbc-48d7-929a-fa29f13b6969 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:05.258475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-765727a9-cdbc-48d7-929a-fa29f13b6969 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:05.268057 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f94381b5-c5dd-404a-aabe-456e13ac07a2 tempest-FlavorsAdminTestJSON-1917082048 tempest-FlavorsAdminTestJSON-1917082048-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:05.354074 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f94381b5-c5dd-404a-aabe-456e13ac07a2 tempest-FlavorsAdminTestJSON-1917082048 tempest-FlavorsAdminTestJSON-1917082048-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.097432 Jul 19 22:26:05.360907 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 164/347] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:26:05 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:05.383680 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1e7151b9-a1c6-4bc7-8b76-a5d397b85d9a tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:05.387269 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-765727a9-cdbc-48d7-929a-fa29f13b6969 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:05.389095 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:05.389095 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:05.408851 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-765727a9-cdbc-48d7-929a-fa29f13b6969 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2" status: 200 len: 1277 microversion: 2.1 time: 0.172900 Jul 19 22:26:05.412867 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 184/348] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:05 2022] GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2 => generated 1277 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:05.471805 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1e7151b9-a1c6-4bc7-8b76-a5d397b85d9a tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2021466657" status: 202 len: 0 microversion: 2.1 time: 0.097437 Jul 19 22:26:05.473522 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 165/349] 10.222.0.25 () {58 vars in 1160 bytes} [Tue Jul 19 22:26:05 2022] DELETE /compute/v2.1/flavors/2021466657 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 22:26:05.485915 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c9edb2ae-83be-4ecc-ac85-6e66e440353c tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:05.529753 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c9edb2ae-83be-4ecc-ac85-6e66e440353c tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.050689 Jul 19 22:26:05.543181 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 185/350] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:26:05 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:05.553178 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d53ffd30-f6c2-4094-b50c-ebf304a1a1eb tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-741901913", "id": 1791279693, "os-flavor-access:is_public": "True"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:05.555741 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:05.555741 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:05.600601 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d53ffd30-f6c2-4094-b50c-ebf304a1a1eb tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.054638 Jul 19 22:26:05.604613 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 166/351] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:26:05 2022] POST /compute/v2.1/flavors => generated 413 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:05.623034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b1ed2838-c2a7-49ce-bdc9-ca8b13cc188d tempest-FlavorsAdminTestJSON-1917082048 tempest-FlavorsAdminTestJSON-1917082048-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:05.630147 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9efd15bd-6421-479f-b322-0a5fd8ed1061 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:05.631446 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9efd15bd-6421-479f-b322-0a5fd8ed1061 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: 0c5f1490-8946-4758-baa2-3eacd9b32d5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:05.655233 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9efd15bd-6421-479f-b322-0a5fd8ed1061 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:05.657637 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9efd15bd-6421-479f-b322-0a5fd8ed1061 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:05.658915 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9efd15bd-6421-479f-b322-0a5fd8ed1061 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:05.659964 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9efd15bd-6421-479f-b322-0a5fd8ed1061 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:05.663603 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b1ed2838-c2a7-49ce-bdc9-ca8b13cc188d tempest-FlavorsAdminTestJSON-1917082048 tempest-FlavorsAdminTestJSON-1917082048-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6220 microversion: 2.1 time: 0.049561 Jul 19 22:26:05.664942 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 186/352] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:26:05 2022] GET /compute/v2.1/flavors/detail => generated 6220 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:05.764477 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9efd15bd-6421-479f-b322-0a5fd8ed1061 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:05.765124 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9efd15bd-6421-479f-b322-0a5fd8ed1061 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:05.765875 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-9efd15bd-6421-479f-b322-0a5fd8ed1061 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lazy-loading 'fault' on Instance uuid 0c5f1490-8946-4758-baa2-3eacd9b32d5a {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:26:05.955723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7c3001bf-5922-4ddd-9e33-7f1f018b6e88 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1611622996", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "f8e64135-274c-4e94-95ba-a2d0adec94fe"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:06.038359 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-7c3001bf-5922-4ddd-9e33-7f1f018b6e88 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] validate_networks() for [('f8e64135-274c-4e94-95ba-a2d0adec94fe', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:26:06.136357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9efd15bd-6421-479f-b322-0a5fd8ed1061 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:06.148355 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9efd15bd-6421-479f-b322-0a5fd8ed1061 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a" status: 200 len: 1459 microversion: 2.1 time: 0.527663 Jul 19 22:26:06.158190 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 167/353] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:05 2022] GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a => generated 1459 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:06.158190 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f298a835-eea3-43b4-8547-c983010a810c tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:06.158190 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:06.158190 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:06.221690 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f298a835-eea3-43b4-8547-c983010a810c tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1791279693" status: 202 len: 0 microversion: 2.1 time: 0.069899 Jul 19 22:26:06.223164 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 168/354] 10.222.0.25 () {58 vars in 1160 bytes} [Tue Jul 19 22:26:06 2022] DELETE /compute/v2.1/flavors/1791279693 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:26:06.230721 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ed6c31f9-63e8-4d9f-bb65-beca09914633 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:06.233042 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ed6c31f9-63e8-4d9f-bb65-beca09914633 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:06.249837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ed6c31f9-63e8-4d9f-bb65-beca09914633 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:06.263866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ed6c31f9-63e8-4d9f-bb65-beca09914633 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:06.265283 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ed6c31f9-63e8-4d9f-bb65-beca09914633 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:06.265932 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ed6c31f9-63e8-4d9f-bb65-beca09914633 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:06.640819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ed6c31f9-63e8-4d9f-bb65-beca09914633 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:06.654984 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ed6c31f9-63e8-4d9f-bb65-beca09914633 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1477 microversion: 2.1 time: 0.430124 Jul 19 22:26:06.669145 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 169/355] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:06 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1477 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:06.674962 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6e32336b-3e58-41b9-af0d-c64046243b28 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:06.713474 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6e32336b-3e58-41b9-af0d-c64046243b28 tempest-FlavorsAdminTestJSON-1239744396 tempest-FlavorsAdminTestJSON-1239744396-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.042776 Jul 19 22:26:06.714806 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 170/356] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:26:06 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:06.747355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-efc011c1-e45a-4d45-8c82-813105dc4d28 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:06.751308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-efc011c1-e45a-4d45-8c82-813105dc4d28 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: 04279b5f-973f-463f-9bdc-29eab24edeb2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:06.781024 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-efc011c1-e45a-4d45-8c82-813105dc4d28 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:06.782199 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-efc011c1-e45a-4d45-8c82-813105dc4d28 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:06.784407 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-efc011c1-e45a-4d45-8c82-813105dc4d28 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:06.786108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-efc011c1-e45a-4d45-8c82-813105dc4d28 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:07.192418 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-efc011c1-e45a-4d45-8c82-813105dc4d28 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:07.203621 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-efc011c1-e45a-4d45-8c82-813105dc4d28 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2" status: 200 len: 1319 microversion: 2.1 time: 0.487345 Jul 19 22:26:07.215988 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 171/357] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:06 2022] GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2 => generated 1319 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:07.221707 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-022ec617-dbc8-47ff-9d22-f8eec0d4f1bf req-6dd11d36-85e0-4a68-9d13-65961f512db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c5f1490-8946-4758-baa2-3eacd9b32d5a", "name": "network-vif-deleted", "tag": "6366737f-b1f3-4ca4-94f8-95967a79d789"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:07.229802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=12,nova_api:INSERT=5 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:26:07.245020 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-022ec617-dbc8-47ff-9d22-f8eec0d4f1bf req-6dd11d36-85e0-4a68-9d13-65961f512db5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:07.245818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-022ec617-dbc8-47ff-9d22-f8eec0d4f1bf req-6dd11d36-85e0-4a68-9d13-65961f512db5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:07.272350 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-022ec617-dbc8-47ff-9d22-f8eec0d4f1bf req-6dd11d36-85e0-4a68-9d13-65961f512db5 service nova] Creating event network-vif-deleted:6366737f-b1f3-4ca4-94f8-95967a79d789 for instance 0c5f1490-8946-4758-baa2-3eacd9b32d5a on n-h2-847009-3 Jul 19 22:26:07.281042 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-022ec617-dbc8-47ff-9d22-f8eec0d4f1bf req-6dd11d36-85e0-4a68-9d13-65961f512db5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063301 Jul 19 22:26:07.292818 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 172/358] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:07.303436 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d5a495ba-55d2-4949-9742-26a816264b1e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:07.307770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d5a495ba-55d2-4949-9742-26a816264b1e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: 0c5f1490-8946-4758-baa2-3eacd9b32d5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:07.334254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5a495ba-55d2-4949-9742-26a816264b1e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:07.335006 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5a495ba-55d2-4949-9742-26a816264b1e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:07.336098 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5a495ba-55d2-4949-9742-26a816264b1e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:07.336738 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5a495ba-55d2-4949-9742-26a816264b1e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:07.369365 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:26:07.383544 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5a495ba-55d2-4949-9742-26a816264b1e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:07.384363 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5a495ba-55d2-4949-9742-26a816264b1e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:07.385021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-d5a495ba-55d2-4949-9742-26a816264b1e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lazy-loading 'fault' on Instance uuid 0c5f1490-8946-4758-baa2-3eacd9b32d5a {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:26:07.603253 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d5a495ba-55d2-4949-9742-26a816264b1e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c2f7f94a524d80a1a3c2e105d488b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8809f0e3adc6408fb52877e942b68811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:07.614131 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d5a495ba-55d2-4949-9742-26a816264b1e tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a" status: 200 len: 1310 microversion: 2.1 time: 0.316883 Jul 19 22:26:07.618320 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 173/359] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:07 2022] GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a => generated 1310 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:07.676083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-11ad1b8a-d4ef-4857-a6a4-8c534ba3f7f6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:07.677418 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-11ad1b8a-d4ef-4857-a6a4-8c534ba3f7f6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:07.689661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-11ad1b8a-d4ef-4857-a6a4-8c534ba3f7f6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:07.708036 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-11ad1b8a-d4ef-4857-a6a4-8c534ba3f7f6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:07.709409 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-11ad1b8a-d4ef-4857-a6a4-8c534ba3f7f6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:07.710053 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-11ad1b8a-d4ef-4857-a6a4-8c534ba3f7f6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:07.754748 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-7c3001bf-5922-4ddd-9e33-7f1f018b6e88 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:26:07.756422 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-7c3001bf-5922-4ddd-9e33-7f1f018b6e88 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:26:07.757109 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-7c3001bf-5922-4ddd-9e33-7f1f018b6e88 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:26:07.758477 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-7c3001bf-5922-4ddd-9e33-7f1f018b6e88 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:26:07.759499 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-7c3001bf-5922-4ddd-9e33-7f1f018b6e88 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:26:07.775970 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7c3001bf-5922-4ddd-9e33-7f1f018b6e88 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:07.776767 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7c3001bf-5922-4ddd-9e33-7f1f018b6e88 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:07.777804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7c3001bf-5922-4ddd-9e33-7f1f018b6e88 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:07.784330 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7c3001bf-5922-4ddd-9e33-7f1f018b6e88 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:07.837851 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-7c3001bf-5922-4ddd-9e33-7f1f018b6e88 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Getting quotas for project 2619b807c1ee4dca858dae47c4686ba2. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:26:07.848842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-7c3001bf-5922-4ddd-9e33-7f1f018b6e88 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Getting quotas for user 55a214cbc1ec4cdb80ccf736f4251964 and project 2619b807c1ee4dca858dae47c4686ba2. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:26:07.883833 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7c3001bf-5922-4ddd-9e33-7f1f018b6e88 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:26:07.890797 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7c3001bf-5922-4ddd-9e33-7f1f018b6e88 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:26:07.979906 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7c3001bf-5922-4ddd-9e33-7f1f018b6e88 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.313326 Jul 19 22:26:07.981031 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 187/360] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:26:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:26:07.992898 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6586d144-abb3-4599-825c-fefe0a87c544 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:07.993809 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6586d144-abb3-4599-825c-fefe0a87c544 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:08.182653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-11ad1b8a-d4ef-4857-a6a4-8c534ba3f7f6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:08.197646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6586d144-abb3-4599-825c-fefe0a87c544 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:08.198439 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-11ad1b8a-d4ef-4857-a6a4-8c534ba3f7f6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1477 microversion: 2.1 time: 0.526727 Jul 19 22:26:08.200039 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 174/361] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:07 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1477 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:08.209488 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6586d144-abb3-4599-825c-fefe0a87c544 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 200 len: 1211 microversion: 2.1 time: 0.221187 Jul 19 22:26:08.211592 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 188/362] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:07 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 1211 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:26:08.235737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c8911846-121f-4fa9-a72e-bd61de6bcc53 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:08.236761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c8911846-121f-4fa9-a72e-bd61de6bcc53 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: 04279b5f-973f-463f-9bdc-29eab24edeb2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:08.251242 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8911846-121f-4fa9-a72e-bd61de6bcc53 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:08.252151 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8911846-121f-4fa9-a72e-bd61de6bcc53 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:08.253559 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8911846-121f-4fa9-a72e-bd61de6bcc53 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:08.254266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8911846-121f-4fa9-a72e-bd61de6bcc53 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:08.401061 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-090757d1-3273-4754-8c1e-39712a4d5c30 req-f739d046-8c6e-48b0-921e-6bb96c3cf624 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04279b5f-973f-463f-9bdc-29eab24edeb2", "tag": "1c896c40-d9ec-432a-a0c2-e37479954f2a"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:08.448525 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-090757d1-3273-4754-8c1e-39712a4d5c30 req-f739d046-8c6e-48b0-921e-6bb96c3cf624 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:08.452120 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-090757d1-3273-4754-8c1e-39712a4d5c30 req-f739d046-8c6e-48b0-921e-6bb96c3cf624 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:08.528003 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-090757d1-3273-4754-8c1e-39712a4d5c30 req-f739d046-8c6e-48b0-921e-6bb96c3cf624 service nova] Creating event network-changed:1c896c40-d9ec-432a-a0c2-e37479954f2a for instance 04279b5f-973f-463f-9bdc-29eab24edeb2 on n-h1-847009-3 Jul 19 22:26:08.538804 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-090757d1-3273-4754-8c1e-39712a4d5c30 req-f739d046-8c6e-48b0-921e-6bb96c3cf624 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165403 Jul 19 22:26:08.540446 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 189/363] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:08.638321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-46e42926-5d78-471c-a7e9-e7c98ba8a959 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:08.642387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-46e42926-5d78-471c-a7e9-e7c98ba8a959 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: 0c5f1490-8946-4758-baa2-3eacd9b32d5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:08.689960 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46e42926-5d78-471c-a7e9-e7c98ba8a959 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:08.690870 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46e42926-5d78-471c-a7e9-e7c98ba8a959 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:08.696433 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46e42926-5d78-471c-a7e9-e7c98ba8a959 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:08.697352 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46e42926-5d78-471c-a7e9-e7c98ba8a959 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:08.792560 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-46e42926-5d78-471c-a7e9-e7c98ba8a959 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] HTTP exception thrown: Instance 0c5f1490-8946-4758-baa2-3eacd9b32d5a could not be found. Jul 19 22:26:08.823855 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-46e42926-5d78-471c-a7e9-e7c98ba8a959 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Request method failure captured: Jul 19 22:26:08.823855 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a HTTP/1.1 Jul 19 22:26:08.823855 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:26:08.823855 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:26:08.823855 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:26:08.823855 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:26:08.823855 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:26:08.823855 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:26:08.823855 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:26:08.823855 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:08.823855 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y8zA8Q0U5dKHPrsdDmmbYCZgUF_QmLnb1kTooW1HmCzQ4gJEPBVLB7BP-G0JQtyILw5E9-8G30NU_GXJG9Zr2m75QN9b8FjcwIGg4-E6irLN-35y0puUn5z-4Kcdj77wmiarKmqKdNqNgNGcRxYPtFvToKO8PIjPHLopknMgyg6mp8 Jul 19 22:26:08.823855 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:26:08.823855 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:26:08.823855 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:26:08.823855 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:26:08.823855 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:26:08.823855 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:26:08.823855 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 8809f0e3adc6408fb52877e942b68811 Jul 19 22:26:08.823855 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1564258133 Jul 19 22:26:08.823855 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:26:08.823855 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:26:08.826527 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8809f0e3adc6408fb52877e942b68811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8809f0e3adc6408fb52877e942b68811"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8809f0e3adc6408fb52877e942b68811"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8809f0e3adc6408fb52877e942b68811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:08.826527 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-DeleteServersAdminTestJSON-1564258133 Jul 19 22:26:08.826527 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 8809f0e3adc6408fb52877e942b68811 Jul 19 22:26:08.826527 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1564258133 Jul 19 22:26:08.826527 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-DeleteServersAdminTestJSON-1564258133-project Jul 19 22:26:08.826527 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:26:08.826527 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:26:08.826527 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: a8c2f7f94a524d80a1a3c2e105d488b4 Jul 19 22:26:08.826527 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-DeleteServersAdminTestJSON-1564258133-project Jul 19 22:26:08.826527 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:26:08.826527 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 0c5f1490-8946-4758-baa2-3eacd9b32d5a could not be found. Jul 19 22:26:08.826527 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '0c5f1490-8946-4758-baa2-3eacd9b32d5a'} Jul 19 22:26:08.828012 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:08.828012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:08.828012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:26:08.828012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:26:08.828012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:26:08.828012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:26:08.828012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:26:08.828012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:26:08.828012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:26:08.828012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:26:08.828012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c5f1490-8946-4758-baa2-3eacd9b32d5a could not be found. Jul 19 22:26:08.828012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:08.828012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:08.828012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:08.828012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:08.828012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:08.828012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:08.828012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:08.828012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:08.828012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:08.830445 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:08.830445 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:26:08.830445 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:26:08.830445 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:26:08.830445 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:26:08.830445 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:26:08.830445 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:26:08.830445 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c5f1490-8946-4758-baa2-3eacd9b32d5a could not be found. Jul 19 22:26:08.830445 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:08.830445 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:08.830445 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:08.830445 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:08.830445 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:08.830445 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:08.830445 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:26:08.830445 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:26:08.830445 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c5f1490-8946-4758-baa2-3eacd9b32d5a could not be found. Jul 19 22:26:08.830445 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:08.834062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-46e42926-5d78-471c-a7e9-e7c98ba8a959 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Returning 404 to user: Instance 0c5f1490-8946-4758-baa2-3eacd9b32d5a could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:08.848744 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-46e42926-5d78-471c-a7e9-e7c98ba8a959 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a" status: 404 len: 111 microversion: 2.1 time: 0.218390 Jul 19 22:26:08.859452 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 190/364] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:08 2022] GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a => generated 111 bytes in 227 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:26:08.895450 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1a936c32-5d88-4b2c-a8d7-6f3bf7f600b0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:08.902421 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1a936c32-5d88-4b2c-a8d7-6f3bf7f600b0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: 0c5f1490-8946-4758-baa2-3eacd9b32d5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:08.954331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a936c32-5d88-4b2c-a8d7-6f3bf7f600b0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:08.959279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a936c32-5d88-4b2c-a8d7-6f3bf7f600b0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:08.964453 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a936c32-5d88-4b2c-a8d7-6f3bf7f600b0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:08.966995 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a936c32-5d88-4b2c-a8d7-6f3bf7f600b0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:09.069391 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-1a936c32-5d88-4b2c-a8d7-6f3bf7f600b0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] HTTP exception thrown: Instance 0c5f1490-8946-4758-baa2-3eacd9b32d5a could not be found. Jul 19 22:26:09.073552 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1a936c32-5d88-4b2c-a8d7-6f3bf7f600b0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Request method failure captured: Jul 19 22:26:09.073552 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a HTTP/1.1 Jul 19 22:26:09.073552 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:26:09.073552 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:26:09.073552 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:26:09.073552 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:26:09.073552 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:26:09.073552 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:26:09.073552 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:26:09.073552 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:09.073552 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y8zA8Q0U5dKHPrsdDmmbYCZgUF_QmLnb1kTooW1HmCzQ4gJEPBVLB7BP-G0JQtyILw5E9-8G30NU_GXJG9Zr2m75QN9b8FjcwIGg4-E6irLN-35y0puUn5z-4Kcdj77wmiarKmqKdNqNgNGcRxYPtFvToKO8PIjPHLopknMgyg6mp8 Jul 19 22:26:09.073552 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:26:09.073552 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:26:09.073552 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:26:09.073552 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:26:09.073552 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:26:09.073552 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:26:09.073552 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 8809f0e3adc6408fb52877e942b68811 Jul 19 22:26:09.073552 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1564258133 Jul 19 22:26:09.073552 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:26:09.073552 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:26:09.075957 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8809f0e3adc6408fb52877e942b68811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8809f0e3adc6408fb52877e942b68811"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8809f0e3adc6408fb52877e942b68811"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8809f0e3adc6408fb52877e942b68811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:09.075957 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-DeleteServersAdminTestJSON-1564258133 Jul 19 22:26:09.075957 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 8809f0e3adc6408fb52877e942b68811 Jul 19 22:26:09.075957 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1564258133 Jul 19 22:26:09.075957 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-DeleteServersAdminTestJSON-1564258133-project Jul 19 22:26:09.075957 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:26:09.075957 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:26:09.075957 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: a8c2f7f94a524d80a1a3c2e105d488b4 Jul 19 22:26:09.075957 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-DeleteServersAdminTestJSON-1564258133-project Jul 19 22:26:09.075957 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:26:09.075957 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 0c5f1490-8946-4758-baa2-3eacd9b32d5a could not be found. Jul 19 22:26:09.075957 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '0c5f1490-8946-4758-baa2-3eacd9b32d5a'} Jul 19 22:26:09.079489 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:09.079489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:09.079489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:26:09.079489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:26:09.079489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:26:09.079489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:26:09.079489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:26:09.079489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:26:09.079489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:26:09.079489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:26:09.079489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c5f1490-8946-4758-baa2-3eacd9b32d5a could not be found. Jul 19 22:26:09.079489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:09.079489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:09.079489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:09.079489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:09.079489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:09.079489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:09.079489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:09.079489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:09.079489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:09.084034 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:09.084034 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:26:09.084034 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:26:09.084034 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:26:09.084034 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:26:09.084034 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:26:09.084034 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:26:09.084034 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:26:09.084034 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:26:09.084034 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c5f1490-8946-4758-baa2-3eacd9b32d5a could not be found. Jul 19 22:26:09.084034 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:09.084034 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:09.084034 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:09.084034 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:09.084034 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:09.084034 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:09.084034 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:26:09.084034 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:26:09.084034 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c5f1490-8946-4758-baa2-3eacd9b32d5a could not be found. Jul 19 22:26:09.084034 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:09.091072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1a936c32-5d88-4b2c-a8d7-6f3bf7f600b0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Returning 404 to user: Instance 0c5f1490-8946-4758-baa2-3eacd9b32d5a could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:09.094847 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1a936c32-5d88-4b2c-a8d7-6f3bf7f600b0 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a" status: 404 len: 111 microversion: 2.1 time: 0.231995 Jul 19 22:26:09.102053 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 191/365] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:26:08 2022] DELETE /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a => generated 111 bytes in 241 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:26:09.114133 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-49d827d7-cf22-48e3-bb25-0577119812fb tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:09.115772 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-49d827d7-cf22-48e3-bb25-0577119812fb tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: 0c5f1490-8946-4758-baa2-3eacd9b32d5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:09.145407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49d827d7-cf22-48e3-bb25-0577119812fb tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:09.150511 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49d827d7-cf22-48e3-bb25-0577119812fb tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:09.152662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c8911846-121f-4fa9-a72e-bd61de6bcc53 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:09.167988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49d827d7-cf22-48e3-bb25-0577119812fb tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:09.168899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49d827d7-cf22-48e3-bb25-0577119812fb tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:09.182514 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c8911846-121f-4fa9-a72e-bd61de6bcc53 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2" status: 200 len: 1319 microversion: 2.1 time: 0.952672 Jul 19 22:26:09.188919 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 175/366] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:08 2022] GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2 => generated 1319 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:09.221375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cf1130a1-e347-4944-8b26-222fb3585da8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:09.222095 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cf1130a1-e347-4944-8b26-222fb3585da8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:09.243906 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-49d827d7-cf22-48e3-bb25-0577119812fb tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] HTTP exception thrown: Instance 0c5f1490-8946-4758-baa2-3eacd9b32d5a could not be found. Jul 19 22:26:09.247089 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-49d827d7-cf22-48e3-bb25-0577119812fb tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Request method failure captured: Jul 19 22:26:09.247089 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a HTTP/1.1 Jul 19 22:26:09.247089 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:26:09.247089 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:26:09.247089 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:26:09.247089 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:26:09.247089 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:26:09.247089 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:26:09.247089 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:26:09.247089 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:09.247089 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y8zA8Q0U5dKHPrsdDmmbYCZgUF_QmLnb1kTooW1HmCzQ4gJEPBVLB7BP-G0JQtyILw5E9-8G30NU_GXJG9Zr2m75QN9b8FjcwIGg4-E6irLN-35y0puUn5z-4Kcdj77wmiarKmqKdNqNgNGcRxYPtFvToKO8PIjPHLopknMgyg6mp8 Jul 19 22:26:09.247089 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:26:09.247089 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:26:09.247089 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:26:09.247089 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:26:09.247089 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:26:09.247089 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:26:09.247089 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 8809f0e3adc6408fb52877e942b68811 Jul 19 22:26:09.247089 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1564258133 Jul 19 22:26:09.247089 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:26:09.247089 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:26:09.248279 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8809f0e3adc6408fb52877e942b68811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8809f0e3adc6408fb52877e942b68811"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8809f0e3adc6408fb52877e942b68811"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8809f0e3adc6408fb52877e942b68811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:09.248279 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-DeleteServersAdminTestJSON-1564258133 Jul 19 22:26:09.248279 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 8809f0e3adc6408fb52877e942b68811 Jul 19 22:26:09.248279 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1564258133 Jul 19 22:26:09.248279 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-DeleteServersAdminTestJSON-1564258133-project Jul 19 22:26:09.248279 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:26:09.248279 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:26:09.248279 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: a8c2f7f94a524d80a1a3c2e105d488b4 Jul 19 22:26:09.248279 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-DeleteServersAdminTestJSON-1564258133-project Jul 19 22:26:09.248279 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:26:09.248279 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 0c5f1490-8946-4758-baa2-3eacd9b32d5a could not be found. Jul 19 22:26:09.248279 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '0c5f1490-8946-4758-baa2-3eacd9b32d5a'} Jul 19 22:26:09.248922 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:09.248922 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:09.248922 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:26:09.248922 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:26:09.248922 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:26:09.248922 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:26:09.248922 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:26:09.248922 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:26:09.248922 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:26:09.248922 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:26:09.248922 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c5f1490-8946-4758-baa2-3eacd9b32d5a could not be found. Jul 19 22:26:09.248922 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:09.248922 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:09.248922 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:09.248922 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:09.248922 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:09.248922 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:09.248922 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:09.248922 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:09.248922 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:09.249959 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:09.249959 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:26:09.249959 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:26:09.249959 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:26:09.249959 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:26:09.249959 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:26:09.249959 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:26:09.249959 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c5f1490-8946-4758-baa2-3eacd9b32d5a could not be found. Jul 19 22:26:09.249959 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:09.249959 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:09.249959 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:09.249959 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:09.249959 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:09.249959 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:09.249959 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:26:09.249959 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:26:09.249959 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c5f1490-8946-4758-baa2-3eacd9b32d5a could not be found. Jul 19 22:26:09.249959 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:09.250950 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-49d827d7-cf22-48e3-bb25-0577119812fb tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Returning 404 to user: Instance 0c5f1490-8946-4758-baa2-3eacd9b32d5a could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:09.250950 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-49d827d7-cf22-48e3-bb25-0577119812fb tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a" status: 404 len: 111 microversion: 2.1 time: 0.145344 Jul 19 22:26:09.261429 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 192/367] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:09 2022] GET /compute/v2.1/servers/0c5f1490-8946-4758-baa2-3eacd9b32d5a => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:26:09.279226 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf1130a1-e347-4944-8b26-222fb3585da8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:09.279853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf1130a1-e347-4944-8b26-222fb3585da8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:09.279962 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-08a3cbab-e85b-4193-b99d-a5e91804dd78 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:09.280976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-08a3cbab-e85b-4193-b99d-a5e91804dd78 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:09.281103 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf1130a1-e347-4944-8b26-222fb3585da8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:09.281779 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf1130a1-e347-4944-8b26-222fb3585da8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:09.334702 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=9,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:26:09.552453 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-08a3cbab-e85b-4193-b99d-a5e91804dd78 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:09.582239 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-08a3cbab-e85b-4193-b99d-a5e91804dd78 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 200 len: 1211 microversion: 2.1 time: 0.307945 Jul 19 22:26:09.584226 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 193/368] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:09 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 1211 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:09.600043 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4d45362b-624e-4ba9-9629-ea462ef82ee8 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:09.605178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4d45362b-624e-4ba9-9629-ea462ef82ee8 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:09.654578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4d45362b-624e-4ba9-9629-ea462ef82ee8 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:09.655811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4d45362b-624e-4ba9-9629-ea462ef82ee8 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:09.664136 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4d45362b-624e-4ba9-9629-ea462ef82ee8 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:09.665098 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4d45362b-624e-4ba9-9629-ea462ef82ee8 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:09.734162 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-4d45362b-624e-4ba9-9629-ea462ef82ee8 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] HTTP exception thrown: Instance b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a could not be found. Jul 19 22:26:09.738842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4d45362b-624e-4ba9-9629-ea462ef82ee8 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Request method failure captured: Jul 19 22:26:09.738842 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a HTTP/1.1 Jul 19 22:26:09.738842 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:26:09.738842 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:26:09.738842 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:26:09.738842 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:26:09.738842 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:26:09.738842 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:26:09.738842 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:26:09.738842 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:09.738842 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y8zA8Q0U5dKHPrsdDmmbYCZgUF_QmLnb1kTooW1HmCzQ4gJEPBVLB7BP-G0JQtyILw5E9-8G30NU_GXJG9Zr2m75QN9b8FjcwIGg4-E6irLN-35y0puUn5z-4Kcdj77wmiarKmqKdNqNgNGcRxYPtFvToKO8PIjPHLopknMgyg6mp8 Jul 19 22:26:09.738842 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:26:09.738842 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:26:09.738842 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:26:09.738842 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:26:09.738842 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:26:09.738842 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:26:09.738842 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 8809f0e3adc6408fb52877e942b68811 Jul 19 22:26:09.738842 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1564258133 Jul 19 22:26:09.738842 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:26:09.738842 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:26:09.740308 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8809f0e3adc6408fb52877e942b68811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8809f0e3adc6408fb52877e942b68811"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8809f0e3adc6408fb52877e942b68811"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8809f0e3adc6408fb52877e942b68811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:09.740308 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-DeleteServersAdminTestJSON-1564258133 Jul 19 22:26:09.740308 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 8809f0e3adc6408fb52877e942b68811 Jul 19 22:26:09.740308 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1564258133 Jul 19 22:26:09.740308 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-DeleteServersAdminTestJSON-1564258133-project Jul 19 22:26:09.740308 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:26:09.740308 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:26:09.740308 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: a8c2f7f94a524d80a1a3c2e105d488b4 Jul 19 22:26:09.740308 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-DeleteServersAdminTestJSON-1564258133-project Jul 19 22:26:09.740308 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:26:09.740308 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a could not be found. Jul 19 22:26:09.740308 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a'} Jul 19 22:26:09.740939 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:09.740939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:09.740939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:26:09.740939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:26:09.740939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:26:09.740939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:26:09.740939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:26:09.740939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:26:09.740939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:26:09.740939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:26:09.740939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a could not be found. Jul 19 22:26:09.740939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:09.740939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:09.740939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:09.740939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:09.740939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:09.740939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:09.740939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:09.740939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:09.740939 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:09.741953 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:09.741953 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:26:09.741953 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:26:09.741953 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:26:09.741953 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:26:09.741953 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:26:09.741953 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:26:09.741953 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:26:09.741953 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:26:09.741953 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a could not be found. Jul 19 22:26:09.741953 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:09.741953 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:09.741953 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:09.741953 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:09.741953 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:09.741953 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:09.741953 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:26:09.741953 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:26:09.741953 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a could not be found. Jul 19 22:26:09.741953 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:09.742991 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4d45362b-624e-4ba9-9629-ea462ef82ee8 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Returning 404 to user: Instance b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:09.742991 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4d45362b-624e-4ba9-9629-ea462ef82ee8 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a" status: 404 len: 111 microversion: 2.1 time: 0.155250 Jul 19 22:26:09.758307 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 194/369] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:26:09 2022] DELETE /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:26:09.766861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0ca8d4ab-1ee0-4cc2-a760-d0f15d85c5a4 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:09.778417 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0ca8d4ab-1ee0-4cc2-a760-d0f15d85c5a4 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] [instance: b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:09.807274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ca8d4ab-1ee0-4cc2-a760-d0f15d85c5a4 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:09.810966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ca8d4ab-1ee0-4cc2-a760-d0f15d85c5a4 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:09.812722 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ca8d4ab-1ee0-4cc2-a760-d0f15d85c5a4 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:09.814665 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ca8d4ab-1ee0-4cc2-a760-d0f15d85c5a4 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:09.855472 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-0ca8d4ab-1ee0-4cc2-a760-d0f15d85c5a4 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] HTTP exception thrown: Instance b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a could not be found. Jul 19 22:26:09.859567 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0ca8d4ab-1ee0-4cc2-a760-d0f15d85c5a4 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Request method failure captured: Jul 19 22:26:09.859567 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a HTTP/1.1 Jul 19 22:26:09.859567 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:26:09.859567 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:26:09.859567 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:26:09.859567 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:26:09.859567 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:26:09.859567 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:26:09.859567 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:26:09.859567 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:09.859567 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y8zA8Q0U5dKHPrsdDmmbYCZgUF_QmLnb1kTooW1HmCzQ4gJEPBVLB7BP-G0JQtyILw5E9-8G30NU_GXJG9Zr2m75QN9b8FjcwIGg4-E6irLN-35y0puUn5z-4Kcdj77wmiarKmqKdNqNgNGcRxYPtFvToKO8PIjPHLopknMgyg6mp8 Jul 19 22:26:09.859567 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:26:09.859567 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:26:09.859567 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:26:09.859567 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:26:09.859567 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:26:09.859567 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:26:09.859567 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 8809f0e3adc6408fb52877e942b68811 Jul 19 22:26:09.859567 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1564258133 Jul 19 22:26:09.859567 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:26:09.859567 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:26:09.862649 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8809f0e3adc6408fb52877e942b68811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8809f0e3adc6408fb52877e942b68811"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8809f0e3adc6408fb52877e942b68811"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8809f0e3adc6408fb52877e942b68811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:09.862649 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-DeleteServersAdminTestJSON-1564258133 Jul 19 22:26:09.862649 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 8809f0e3adc6408fb52877e942b68811 Jul 19 22:26:09.862649 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1564258133 Jul 19 22:26:09.862649 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-DeleteServersAdminTestJSON-1564258133-project Jul 19 22:26:09.862649 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:26:09.862649 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:26:09.862649 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: a8c2f7f94a524d80a1a3c2e105d488b4 Jul 19 22:26:09.862649 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-DeleteServersAdminTestJSON-1564258133-project Jul 19 22:26:09.862649 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:26:09.862649 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a could not be found. Jul 19 22:26:09.862649 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a'} Jul 19 22:26:09.864016 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:09.864016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:09.864016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:26:09.864016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:26:09.864016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:26:09.864016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:26:09.864016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:26:09.864016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:26:09.864016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:26:09.864016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:26:09.864016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a could not be found. Jul 19 22:26:09.864016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:09.864016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:09.864016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:09.864016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:09.864016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:09.864016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:09.864016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:09.864016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:09.864016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:09.866275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:09.866275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:26:09.866275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:26:09.866275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:26:09.866275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:26:09.866275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:26:09.866275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:26:09.866275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a could not be found. Jul 19 22:26:09.866275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:09.866275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:09.866275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:09.866275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:09.866275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:09.866275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:09.866275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:26:09.866275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:26:09.866275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a could not be found. Jul 19 22:26:09.866275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:09.870876 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0ca8d4ab-1ee0-4cc2-a760-d0f15d85c5a4 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] Returning 404 to user: Instance b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:09.872726 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0ca8d4ab-1ee0-4cc2-a760-d0f15d85c5a4 tempest-DeleteServersAdminTestJSON-1564258133 tempest-DeleteServersAdminTestJSON-1564258133-project] 10.222.0.25 "GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a" status: 404 len: 111 microversion: 2.1 time: 0.112986 Jul 19 22:26:09.879053 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 195/370] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:09 2022] GET /compute/v2.1/servers/b2ccc7a6-112d-4c26-b36e-9ac8b8883a5a => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:26:09.905152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cf1130a1-e347-4944-8b26-222fb3585da8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:09.918467 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cf1130a1-e347-4944-8b26-222fb3585da8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1477 microversion: 2.1 time: 0.702051 Jul 19 22:26:09.927219 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 176/371] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:09 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1477 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:10.214047 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-502b743a-92f3-4d30-998b-89613c9379d3 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:10.226307 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-502b743a-92f3-4d30-998b-89613c9379d3 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: 04279b5f-973f-463f-9bdc-29eab24edeb2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:10.257394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-502b743a-92f3-4d30-998b-89613c9379d3 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:10.258358 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-502b743a-92f3-4d30-998b-89613c9379d3 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:10.259831 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-502b743a-92f3-4d30-998b-89613c9379d3 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:10.260618 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-502b743a-92f3-4d30-998b-89613c9379d3 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:10.604543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6f9d216e-1884-442d-8eef-992fb88069a2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:10.607219 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6f9d216e-1884-442d-8eef-992fb88069a2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:10.626227 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f9d216e-1884-442d-8eef-992fb88069a2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:10.627039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f9d216e-1884-442d-8eef-992fb88069a2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:10.639274 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f9d216e-1884-442d-8eef-992fb88069a2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:10.644599 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f9d216e-1884-442d-8eef-992fb88069a2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:11.175849 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:26:11.233128 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6f9d216e-1884-442d-8eef-992fb88069a2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:11.236858 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:26:11.255207 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6f9d216e-1884-442d-8eef-992fb88069a2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 200 len: 1271 microversion: 2.1 time: 0.658191 Jul 19 22:26:11.274641 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 177/372] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:10 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 1271 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:11.292631 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d458733d-4d34-4e36-b9b5-a9f94bb4a846 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:11.295725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d458733d-4d34-4e36-b9b5-a9f94bb4a846 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:11.315067 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d458733d-4d34-4e36-b9b5-a9f94bb4a846 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:11.318821 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d458733d-4d34-4e36-b9b5-a9f94bb4a846 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:11.320071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d458733d-4d34-4e36-b9b5-a9f94bb4a846 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:11.320609 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d458733d-4d34-4e36-b9b5-a9f94bb4a846 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:11.963678 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-502b743a-92f3-4d30-998b-89613c9379d3 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:11.977403 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-502b743a-92f3-4d30-998b-89613c9379d3 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2" status: 200 len: 1319 microversion: 2.1 time: 1.773746 Jul 19 22:26:11.978091 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 196/373] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:10 2022] GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2 => generated 1319 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:12.196620 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d458733d-4d34-4e36-b9b5-a9f94bb4a846 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:12.216689 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d458733d-4d34-4e36-b9b5-a9f94bb4a846 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1477 microversion: 2.1 time: 0.937992 Jul 19 22:26:12.230046 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 178/374] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:11 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1477 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:12.278472 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-643eae57-2853-41db-a2af-f43cdf8b7259 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:12.279211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-643eae57-2853-41db-a2af-f43cdf8b7259 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:12.291405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-643eae57-2853-41db-a2af-f43cdf8b7259 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:12.292043 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-643eae57-2853-41db-a2af-f43cdf8b7259 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:12.294856 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-643eae57-2853-41db-a2af-f43cdf8b7259 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:12.295524 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-643eae57-2853-41db-a2af-f43cdf8b7259 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:12.505500 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-643eae57-2853-41db-a2af-f43cdf8b7259 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:12.527645 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-643eae57-2853-41db-a2af-f43cdf8b7259 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 200 len: 1269 microversion: 2.1 time: 0.255369 Jul 19 22:26:12.538253 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 197/375] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:12 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 1269 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:12.997978 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3cf4ecb3-7074-43a5-b69a-162f4246d153 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:12.998729 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3cf4ecb3-7074-43a5-b69a-162f4246d153 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: 04279b5f-973f-463f-9bdc-29eab24edeb2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:13.010853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3cf4ecb3-7074-43a5-b69a-162f4246d153 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:13.013865 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3cf4ecb3-7074-43a5-b69a-162f4246d153 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:13.016572 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3cf4ecb3-7074-43a5-b69a-162f4246d153 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:13.018254 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3cf4ecb3-7074-43a5-b69a-162f4246d153 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:13.386979 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3cf4ecb3-7074-43a5-b69a-162f4246d153 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:13.389982 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:26:13.397518 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3cf4ecb3-7074-43a5-b69a-162f4246d153 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2" status: 200 len: 1319 microversion: 2.1 time: 0.403369 Jul 19 22:26:13.409023 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 198/376] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:12 2022] GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2 => generated 1319 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:13.426654 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4a5b62a4-c4e5-4584-bc32-fe503278b57b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:13.427316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4a5b62a4-c4e5-4584-bc32-fe503278b57b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:13.459364 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-53298b22-ce76-4e38-b56e-7364cfa47447 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Calling method '.version_select at 0x7f7a10cd8e50>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:13.461507 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:13.461507 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:13.464563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53298b22-ce76-4e38-b56e-7364cfa47447 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:13.467723 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53298b22-ce76-4e38-b56e-7364cfa47447 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:13.468591 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53298b22-ce76-4e38-b56e-7364cfa47447 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:13.469033 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53298b22-ce76-4e38-b56e-7364cfa47447 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:13.491967 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4a5b62a4-c4e5-4584-bc32-fe503278b57b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:13.492426 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4a5b62a4-c4e5-4584-bc32-fe503278b57b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:13.493233 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4a5b62a4-c4e5-4584-bc32-fe503278b57b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:13.493669 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4a5b62a4-c4e5-4584-bc32-fe503278b57b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:13.679533 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-53298b22-ce76-4e38-b56e-7364cfa47447 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.871142 Jul 19 22:26:13.693626 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 179/377] 10.222.0.25 () {58 vars in 1127 bytes} [Tue Jul 19 22:26:12 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:13.729468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f95de88e-b594-40a9-90e6-04ad9ed02c0c tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:13.746288 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f95de88e-b594-40a9-90e6-04ad9ed02c0c tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:13.773432 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f95de88e-b594-40a9-90e6-04ad9ed02c0c tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:13.774098 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f95de88e-b594-40a9-90e6-04ad9ed02c0c tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:13.776470 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f95de88e-b594-40a9-90e6-04ad9ed02c0c tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:13.777546 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f95de88e-b594-40a9-90e6-04ad9ed02c0c tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:14.272005 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4a5b62a4-c4e5-4584-bc32-fe503278b57b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:14.285588 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4a5b62a4-c4e5-4584-bc32-fe503278b57b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1477 microversion: 2.1 time: 0.875189 Jul 19 22:26:14.286313 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 199/378] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:13 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1477 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:14.304583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-beaa7c6f-58ad-4109-85d9-32844d3d8c1c tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Calling method '.version_select at 0x7f7a10c15b80>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:14.310606 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:14.310606 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:14.312341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-beaa7c6f-58ad-4109-85d9-32844d3d8c1c tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:14.314013 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-beaa7c6f-58ad-4109-85d9-32844d3d8c1c tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:14.325239 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-beaa7c6f-58ad-4109-85d9-32844d3d8c1c tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:14.325783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-beaa7c6f-58ad-4109-85d9-32844d3d8c1c tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:14.385026 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-beaa7c6f-58ad-4109-85d9-32844d3d8c1c tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.094367 Jul 19 22:26:14.396931 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 200/379] 10.222.0.25 () {58 vars in 1138 bytes} [Tue Jul 19 22:26:14 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:14.416226 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dcd7afcb-dd6c-440a-ab20-b92cb79b2980 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Calling method '.version_select at 0x7f7a10e4e940>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:14.425592 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:14.425592 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:14.427246 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dcd7afcb-dd6c-440a-ab20-b92cb79b2980 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:14.427891 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dcd7afcb-dd6c-440a-ab20-b92cb79b2980 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:14.428869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dcd7afcb-dd6c-440a-ab20-b92cb79b2980 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:14.430290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dcd7afcb-dd6c-440a-ab20-b92cb79b2980 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:14.546983 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dcd7afcb-dd6c-440a-ab20-b92cb79b2980 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.136683 Jul 19 22:26:14.559992 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 201/380] 10.222.0.25 () {58 vars in 1144 bytes} [Tue Jul 19 22:26:14 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:26:14.564241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5eb193af-d296-4fbd-9b38-e7a03b0602c4 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:14.564881 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5eb193af-d296-4fbd-9b38-e7a03b0602c4 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: 04279b5f-973f-463f-9bdc-29eab24edeb2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:14.582741 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f95de88e-b594-40a9-90e6-04ad9ed02c0c tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:14.607766 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f95de88e-b594-40a9-90e6-04ad9ed02c0c tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 200 len: 1311 microversion: 2.1 time: 0.911083 Jul 19 22:26:14.625000 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 180/381] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:13 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 1311 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:14.633390 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5eb193af-d296-4fbd-9b38-e7a03b0602c4 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:14.633895 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5eb193af-d296-4fbd-9b38-e7a03b0602c4 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:14.635065 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5eb193af-d296-4fbd-9b38-e7a03b0602c4 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:14.637507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-68bc88c9-434d-449e-9f7b-5b90be8bf500 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Calling method '.version_select at 0x7f7a10cd2430>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:14.639617 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:14.639617 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:14.644078 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-68bc88c9-434d-449e-9f7b-5b90be8bf500 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:14.644901 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-68bc88c9-434d-449e-9f7b-5b90be8bf500 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:14.646203 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-68bc88c9-434d-449e-9f7b-5b90be8bf500 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:14.647380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-68bc88c9-434d-449e-9f7b-5b90be8bf500 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:14.652200 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5eb193af-d296-4fbd-9b38-e7a03b0602c4 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:14.714502 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-68bc88c9-434d-449e-9f7b-5b90be8bf500 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.086407 Jul 19 22:26:14.726387 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 181/382] 10.222.0.25 () {58 vars in 1127 bytes} [Tue Jul 19 22:26:14 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:14.751063 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-02b697b6-6317-421f-9c67-87b7064e039a tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Calling method '.version_select at 0x7f7a10ce59d0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:14.762634 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:14.762634 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:14.765325 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02b697b6-6317-421f-9c67-87b7064e039a tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:14.767947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02b697b6-6317-421f-9c67-87b7064e039a tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:14.769206 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02b697b6-6317-421f-9c67-87b7064e039a tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:14.770030 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02b697b6-6317-421f-9c67-87b7064e039a tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:14.874154 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-02b697b6-6317-421f-9c67-87b7064e039a tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.133841 Jul 19 22:26:14.887778 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 182/383] 10.222.0.25 () {58 vars in 1154 bytes} [Tue Jul 19 22:26:14 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:14.910898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-48e211a5-0764-41fe-a248-287a2ffa2426 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Calling method '.version_select at 0x7f7a10cd89d0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:14.914586 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:14.914586 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:14.927959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48e211a5-0764-41fe-a248-287a2ffa2426 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:14.934619 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48e211a5-0764-41fe-a248-287a2ffa2426 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:14.935580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48e211a5-0764-41fe-a248-287a2ffa2426 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:14.936021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48e211a5-0764-41fe-a248-287a2ffa2426 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:15.107356 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-48e211a5-0764-41fe-a248-287a2ffa2426 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.204984 Jul 19 22:26:15.118203 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 183/384] 10.222.0.25 () {58 vars in 1127 bytes} [Tue Jul 19 22:26:14 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:15.132067 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ebc4f7bb-1b78-411b-8a12-eebaa91a20d8 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Calling method '.version_select at 0x7f7a10cd8040>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:15.133785 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:15.133785 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:15.148923 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ebc4f7bb-1b78-411b-8a12-eebaa91a20d8 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:15.150636 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ebc4f7bb-1b78-411b-8a12-eebaa91a20d8 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:15.191194 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ebc4f7bb-1b78-411b-8a12-eebaa91a20d8 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:15.191921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ebc4f7bb-1b78-411b-8a12-eebaa91a20d8 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:15.243344 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ebc4f7bb-1b78-411b-8a12-eebaa91a20d8 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-h2-847009-3" status: 200 len: 598 microversion: 2.1 time: 0.124180 Jul 19 22:26:15.249393 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 184/385] 10.222.0.25 () {58 vars in 1169 bytes} [Tue Jul 19 22:26:15 2022] GET /compute/v2.1/os-hosts/n-h2-847009-3 => generated 598 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:15.260774 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d42ece8b-ea85-48d1-b46c-15999f890c11 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Calling method '.version_select at 0x7f7a10cd8310>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:15.261757 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:15.261757 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:15.279443 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d42ece8b-ea85-48d1-b46c-15999f890c11 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:15.279895 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d42ece8b-ea85-48d1-b46c-15999f890c11 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:15.319040 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d42ece8b-ea85-48d1-b46c-15999f890c11 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:15.322184 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d42ece8b-ea85-48d1-b46c-15999f890c11 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:15.380465 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d42ece8b-ea85-48d1-b46c-15999f890c11 tempest-HostsAdminTestJSON-70700445 tempest-HostsAdminTestJSON-70700445-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-h1-847009-3" status: 200 len: 729 microversion: 2.1 time: 0.128962 Jul 19 22:26:15.387553 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 185/386] 10.222.0.25 () {58 vars in 1169 bytes} [Tue Jul 19 22:26:15 2022] GET /compute/v2.1/os-hosts/n-h1-847009-3 => generated 729 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:15.396792 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c5420cf0-6170-44df-90cc-0e76c95fce1c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:15.397852 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c5420cf0-6170-44df-90cc-0e76c95fce1c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:15.424529 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c5420cf0-6170-44df-90cc-0e76c95fce1c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:15.425016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c5420cf0-6170-44df-90cc-0e76c95fce1c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:15.428167 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c5420cf0-6170-44df-90cc-0e76c95fce1c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:15.428989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c5420cf0-6170-44df-90cc-0e76c95fce1c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:15.553017 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5eb193af-d296-4fbd-9b38-e7a03b0602c4 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:15.565315 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5eb193af-d296-4fbd-9b38-e7a03b0602c4 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2" status: 200 len: 1319 microversion: 2.1 time: 1.007496 Jul 19 22:26:15.579020 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 202/387] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:14 2022] GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2 => generated 1319 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:15.637249 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-63e09eac-d350-44bc-92ac-b7e7d8b8f6c3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:15.640516 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-63e09eac-d350-44bc-92ac-b7e7d8b8f6c3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:15.670140 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63e09eac-d350-44bc-92ac-b7e7d8b8f6c3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:15.671250 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63e09eac-d350-44bc-92ac-b7e7d8b8f6c3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:15.676607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63e09eac-d350-44bc-92ac-b7e7d8b8f6c3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:15.677169 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63e09eac-d350-44bc-92ac-b7e7d8b8f6c3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:16.396605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c5420cf0-6170-44df-90cc-0e76c95fce1c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:16.413635 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c5420cf0-6170-44df-90cc-0e76c95fce1c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1477 microversion: 2.1 time: 1.027467 Jul 19 22:26:16.415271 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 186/388] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:15 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1477 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:16.480499 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-63e09eac-d350-44bc-92ac-b7e7d8b8f6c3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:16.518207 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-63e09eac-d350-44bc-92ac-b7e7d8b8f6c3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 200 len: 1311 microversion: 2.1 time: 0.889919 Jul 19 22:26:16.520596 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 203/389] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:15 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 1311 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:26:16.606456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-864c7afe-24e1-48f6-94a6-f6eeedaedbc0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:16.609353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-864c7afe-24e1-48f6-94a6-f6eeedaedbc0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: 04279b5f-973f-463f-9bdc-29eab24edeb2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:16.634495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-864c7afe-24e1-48f6-94a6-f6eeedaedbc0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:16.636556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-864c7afe-24e1-48f6-94a6-f6eeedaedbc0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:16.640676 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-864c7afe-24e1-48f6-94a6-f6eeedaedbc0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:16.642481 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-864c7afe-24e1-48f6-94a6-f6eeedaedbc0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:17.288307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-864c7afe-24e1-48f6-94a6-f6eeedaedbc0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:17.308770 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-864c7afe-24e1-48f6-94a6-f6eeedaedbc0 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2" status: 200 len: 1319 microversion: 2.1 time: 0.727117 Jul 19 22:26:17.311819 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 187/390] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:16 2022] GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2 => generated 1319 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:17.436606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c6a405bc-2d45-4adf-9a92-de466ee3c7e9 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:17.437986 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c6a405bc-2d45-4adf-9a92-de466ee3c7e9 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:17.464229 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c6a405bc-2d45-4adf-9a92-de466ee3c7e9 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:17.464752 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c6a405bc-2d45-4adf-9a92-de466ee3c7e9 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:17.465600 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c6a405bc-2d45-4adf-9a92-de466ee3c7e9 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:17.466047 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c6a405bc-2d45-4adf-9a92-de466ee3c7e9 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:17.550683 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-309b581d-6301-4a3f-bdf6-336a0a8e9c99 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:17.551880 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-309b581d-6301-4a3f-bdf6-336a0a8e9c99 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:17.566208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-309b581d-6301-4a3f-bdf6-336a0a8e9c99 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:17.568839 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-309b581d-6301-4a3f-bdf6-336a0a8e9c99 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:17.570719 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-309b581d-6301-4a3f-bdf6-336a0a8e9c99 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:17.571973 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-309b581d-6301-4a3f-bdf6-336a0a8e9c99 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:18.292239 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c6a405bc-2d45-4adf-9a92-de466ee3c7e9 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:18.303549 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c6a405bc-2d45-4adf-9a92-de466ee3c7e9 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1477 microversion: 2.1 time: 0.871499 Jul 19 22:26:18.306805 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 204/391] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:17 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1477 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:18.319516 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-754d2a72-ffeb-4185-92ca-d8d6d7f30d70 req-0783aab2-90d7-4baf-90c2-c3bc778f4655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04279b5f-973f-463f-9bdc-29eab24edeb2", "name": "network-vif-plugged", "status": "completed", "tag": "1c896c40-d9ec-432a-a0c2-e37479954f2a"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:18.352766 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-754d2a72-ffeb-4185-92ca-d8d6d7f30d70 req-0783aab2-90d7-4baf-90c2-c3bc778f4655 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:18.360383 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-754d2a72-ffeb-4185-92ca-d8d6d7f30d70 req-0783aab2-90d7-4baf-90c2-c3bc778f4655 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:18.418535 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-754d2a72-ffeb-4185-92ca-d8d6d7f30d70 req-0783aab2-90d7-4baf-90c2-c3bc778f4655 service nova] Creating event network-vif-plugged:1c896c40-d9ec-432a-a0c2-e37479954f2a for instance 04279b5f-973f-463f-9bdc-29eab24edeb2 on n-h1-847009-3 Jul 19 22:26:18.434511 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-754d2a72-ffeb-4185-92ca-d8d6d7f30d70 req-0783aab2-90d7-4baf-90c2-c3bc778f4655 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125093 Jul 19 22:26:18.459331 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 205/392] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:18.482037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-fdf862c5-1024-47c7-8b6f-da4296ef624f req-81c7a2d3-5022-4dc8-9963-d0346e9084e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dc2efca-6346-4a22-999b-5a1fa57dcee9", "tag": "b2782aff-48f6-4b84-8432-a744c2cd70bd"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:18.513434 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-fdf862c5-1024-47c7-8b6f-da4296ef624f req-81c7a2d3-5022-4dc8-9963-d0346e9084e5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:18.520849 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-fdf862c5-1024-47c7-8b6f-da4296ef624f req-81c7a2d3-5022-4dc8-9963-d0346e9084e5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:18.529974 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-309b581d-6301-4a3f-bdf6-336a0a8e9c99 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:18.565441 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-309b581d-6301-4a3f-bdf6-336a0a8e9c99 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 200 len: 1311 microversion: 2.1 time: 1.019375 Jul 19 22:26:18.581007 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 188/393] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:17 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 1311 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:18.593529 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e6b1fc0f-ca0a-406f-8c29-3c4259c3575b tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:18.594687 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e6b1fc0f-ca0a-406f-8c29-3c4259c3575b tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: 04279b5f-973f-463f-9bdc-29eab24edeb2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:18.602302 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-fdf862c5-1024-47c7-8b6f-da4296ef624f req-81c7a2d3-5022-4dc8-9963-d0346e9084e5 service nova] Creating event network-changed:b2782aff-48f6-4b84-8432-a744c2cd70bd for instance 6dc2efca-6346-4a22-999b-5a1fa57dcee9 on n-h2-847009-3 Jul 19 22:26:18.627313 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-fdf862c5-1024-47c7-8b6f-da4296ef624f req-81c7a2d3-5022-4dc8-9963-d0346e9084e5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152611 Jul 19 22:26:18.632991 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e6b1fc0f-ca0a-406f-8c29-3c4259c3575b tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:18.632991 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e6b1fc0f-ca0a-406f-8c29-3c4259c3575b tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:18.633417 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e6b1fc0f-ca0a-406f-8c29-3c4259c3575b tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:18.636252 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 206/394] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:18.637824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e6b1fc0f-ca0a-406f-8c29-3c4259c3575b tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:19.296220 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e6b1fc0f-ca0a-406f-8c29-3c4259c3575b tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:19.315073 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e6b1fc0f-ca0a-406f-8c29-3c4259c3575b tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2" status: 200 len: 1319 microversion: 2.1 time: 0.732770 Jul 19 22:26:19.326436 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 189/395] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:18 2022] GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2 => generated 1319 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:19.332157 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4a8e992c-28ab-4269-96b1-7f0fb4604303 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:19.333124 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4a8e992c-28ab-4269-96b1-7f0fb4604303 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:19.361844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4a8e992c-28ab-4269-96b1-7f0fb4604303 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:19.364141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4a8e992c-28ab-4269-96b1-7f0fb4604303 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:19.365277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4a8e992c-28ab-4269-96b1-7f0fb4604303 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:19.371784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4a8e992c-28ab-4269-96b1-7f0fb4604303 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:19.574658 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=12 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:26:19.709135 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4a8e992c-28ab-4269-96b1-7f0fb4604303 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:19.722911 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4a8e992c-28ab-4269-96b1-7f0fb4604303 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1477 microversion: 2.1 time: 0.395977 Jul 19 22:26:19.724499 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 207/396] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:19 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1477 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:19.732934 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4db1e406-c3b1-433a-a64a-d41799e60bc1 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:19.735426 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4db1e406-c3b1-433a-a64a-d41799e60bc1 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:19.755998 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4db1e406-c3b1-433a-a64a-d41799e60bc1 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:19.757939 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4db1e406-c3b1-433a-a64a-d41799e60bc1 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:19.761070 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4db1e406-c3b1-433a-a64a-d41799e60bc1 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:19.763486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4db1e406-c3b1-433a-a64a-d41799e60bc1 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:19.902551 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7e51e58c-7d32-431e-a76e-09ea1738f572 tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-787093200", "id": 1285384534, "os-flavor-access:is_public": "False"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:19.904539 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:19.904539 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:19.946010 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7e51e58c-7d32-431e-a76e-09ea1738f572 tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.497741 Jul 19 22:26:19.957070 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 190/397] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:26:19 2022] POST /compute/v2.1/flavors => generated 438 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:19.977078 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6c716a7c-2862-4ad5-b294-847e15a71cc0 tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "6024b5130104455f9af67c84c49f08ea"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:19.980623 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:19.980623 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:20.118510 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4db1e406-c3b1-433a-a64a-d41799e60bc1 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:20.135290 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4db1e406-c3b1-433a-a64a-d41799e60bc1 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 200 len: 1311 microversion: 2.1 time: 0.407131 Jul 19 22:26:20.138879 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 208/398] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:19 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 1311 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:20.334473 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2d504492-a372-4e0c-88d4-75f5a530aafb tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:20.335121 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2d504492-a372-4e0c-88d4-75f5a530aafb tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: 04279b5f-973f-463f-9bdc-29eab24edeb2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:20.349186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2d504492-a372-4e0c-88d4-75f5a530aafb tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:20.350658 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2d504492-a372-4e0c-88d4-75f5a530aafb tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:20.352190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2d504492-a372-4e0c-88d4-75f5a530aafb tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:20.356721 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2d504492-a372-4e0c-88d4-75f5a530aafb tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:20.673045 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6c716a7c-2862-4ad5-b294-847e15a71cc0 tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1285384534/action" status: 200 len: 97 microversion: 2.1 time: 0.712608 Jul 19 22:26:20.676269 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 191/399] 10.222.0.25 () {60 vars in 1199 bytes} [Tue Jul 19 22:26:19 2022] POST /compute/v2.1/flavors/1285384534/action => generated 97 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:26:20.690673 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c5a1db9d-3e33-4fef-b3f6-3b73a195bd4d tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "6024b5130104455f9af67c84c49f08ea"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:21.010416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2d504492-a372-4e0c-88d4-75f5a530aafb tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:21.021889 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2d504492-a372-4e0c-88d4-75f5a530aafb tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2" status: 200 len: 1469 microversion: 2.1 time: 0.691741 Jul 19 22:26:21.031475 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 209/400] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:20 2022] GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2 => generated 1469 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:21.040536 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-295650de-6ff1-4d75-a0b5-caa10530841f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:21.041241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-295650de-6ff1-4d75-a0b5-caa10530841f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:21.057078 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-295650de-6ff1-4d75-a0b5-caa10530841f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:21.057769 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-295650de-6ff1-4d75-a0b5-caa10530841f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:21.058723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-295650de-6ff1-4d75-a0b5-caa10530841f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:21.059368 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-295650de-6ff1-4d75-a0b5-caa10530841f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:21.318446 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-c5a1db9d-3e33-4fef-b3f6-3b73a195bd4d tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] HTTP exception thrown: Flavor access already exists for flavor 32 and project 6024b5130104455f9af67c84c49f08ea combination. Jul 19 22:26:21.352233 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c5a1db9d-3e33-4fef-b3f6-3b73a195bd4d tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Request method failure captured: Jul 19 22:26:21.352233 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/flavors/1285384534/action HTTP/1.1 Jul 19 22:26:21.352233 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:26:21.352233 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:26:21.352233 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:26:21.352233 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 67 Jul 19 22:26:21.352233 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:26:21.352233 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:26:21.352233 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:26:21.352233 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:21.352233 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y-IVjK0GBlozK-VLIOKQBMr-frMvSVgMrNoJHywGuy_5nxeyxrCrMt-VStlAKMkKffIxupee-KwE0Cg52-pcU_kAAuworTB2Be0w-L5_SqetKTE9s_CO5ZTpqCyYSFAI1jghCqTb81sxJuQA1aKVUa9LWOR2G9AyFSxsflbTLwIaKo Jul 19 22:26:21.352233 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:26:21.352233 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:26:21.352233 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:26:21.352233 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:26:21.352233 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:26:21.352233 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:26:21.352233 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: c241e66ac93b4363a65e820da2f5d646 Jul 19 22:26:21.352233 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-918820361 Jul 19 22:26:21.352233 n-d-847009-3 devstack@n-api.service[119338]: X-Role: admin,member,reader Jul 19 22:26:21.352233 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: admin,member,reader Jul 19 22:26:21.353589 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c241e66ac93b4363a65e820da2f5d646"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c241e66ac93b4363a65e820da2f5d646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c241e66ac93b4363a65e820da2f5d646"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c241e66ac93b4363a65e820da2f5d646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:21.353589 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-918820361 Jul 19 22:26:21.353589 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: c241e66ac93b4363a65e820da2f5d646 Jul 19 22:26:21.353589 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-918820361 Jul 19 22:26:21.353589 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin Jul 19 22:26:21.353589 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:26:21.353589 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:26:21.353589 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: e273f2032cf74d848a9ac336e977a1b1 Jul 19 22:26:21.353589 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin Jul 19 22:26:21.353589 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:26:21.353589 n-d-847009-3 devstack@n-api.service[119338]: {"addTenantAccess": {"tenant": "6024b5130104455f9af67c84c49f08ea"}} Jul 19 22:26:21.353589 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:26:21.354399 n-d-847009-3 devstack@n-api.service[119338]: exception: Flavor access already exists for flavor 32 and project 6024b5130104455f9af67c84c49f08ea combination. Jul 19 22:26:21.354399 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '1285384534', 'body': {'addTenantAccess': {'tenant': '6024b5130104455f9af67c84c49f08ea'}}} Jul 19 22:26:21.354399 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:21.354399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:21.354399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 22:26:21.354399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 19 22:26:21.354399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 22:26:21.354399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 19 22:26:21.354399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 22:26:21.354399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 19 22:26:21.354399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 22:26:21.354399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 19 22:26:21.354399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 22:26:21.354399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 22:26:21.354399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 22:26:21.354399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result.read() Jul 19 22:26:21.354399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 22:26:21.354399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 19 22:26:21.355393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 22:26:21.355393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 19 22:26:21.355393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 22:26:21.355393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 19 22:26:21.355393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 22:26:21.355393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 19 22:26:21.355393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '32-6024b5130104455f9af67c84c49f08ea' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 19 22:26:21.355393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:21.355393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 19 22:26:21.355393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:21.355393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:21.355393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 19 22:26:21.355393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 19 22:26:21.355393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 19 22:26:21.355393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi session.flush() Jul 19 22:26:21.355393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 22:26:21.355393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 19 22:26:21.355393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 22:26:21.355393 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 19 22:26:21.356399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 22:26:21.356399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 19 22:26:21.356399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 22:26:21.356399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception Jul 19 22:26:21.356399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 22:26:21.356399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 19 22:26:21.356399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 22:26:21.356399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 19 22:26:21.356399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 22:26:21.356399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 19 22:26:21.356399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 22:26:21.356399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 19 22:26:21.356399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 19 22:26:21.356399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 19 22:26:21.356399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 22:26:21.356399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 22:26:21.356399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 22:26:21.356399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 19 22:26:21.357327 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 22:26:21.357327 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 19 22:26:21.357327 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 22:26:21.357327 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 19 22:26:21.357327 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 22:26:21.357327 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 22:26:21.357327 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 22:26:21.357327 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception Jul 19 22:26:21.357327 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 22:26:21.357327 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 19 22:26:21.357327 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 22:26:21.357327 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 19 22:26:21.357327 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 22:26:21.357327 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 19 22:26:21.357327 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 22:26:21.357327 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 19 22:26:21.357327 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 22:26:21.357327 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 22:26:21.358342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 22:26:21.358342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result.read() Jul 19 22:26:21.358342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 22:26:21.358342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 19 22:26:21.358342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 22:26:21.358342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 19 22:26:21.358342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 22:26:21.358342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 19 22:26:21.358342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 22:26:21.358342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 19 22:26:21.358342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '32-6024b5130104455f9af67c84c49f08ea' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 19 22:26:21.358342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 19 22:26:21.358342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 19, 22, 26, 21, 307817), 'updated_at': None, 'flavor_id': 32, 'project_id': '6024b5130104455f9af67c84c49f08ea'}] Jul 19 22:26:21.358342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 22:26:21.358342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:21.358342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:21.358342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:21.359300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:21.359300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 19 22:26:21.359300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 19 22:26:21.359300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 19 22:26:21.359300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 19 22:26:21.359300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 19 22:26:21.359300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 19 22:26:21.359300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 19 22:26:21.359300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 19 22:26:21.359300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 19 22:26:21.359300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 19 22:26:21.359300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 22:26:21.359300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 22:26:21.359300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 19 22:26:21.359300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 19 22:26:21.359300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 32 and project 6024b5130104455f9af67c84c49f08ea combination. Jul 19 22:26:21.359300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:21.359300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:21.359300 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:21.360733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:21.360733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:21.360733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:21.360733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:21.360733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:21.360733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:21.360733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:21.360733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:26:21.360733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:26:21.360733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 19 22:26:21.360733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 19 22:26:21.360733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 32 and project 6024b5130104455f9af67c84c49f08ea combination. Jul 19 22:26:21.360733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:21.360733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:21.360733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:21.360733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:21.360733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:21.360733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:21.360733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:26:21.360733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:26:21.366008 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 32 and project 6024b5130104455f9af67c84c49f08ea combination. Jul 19 22:26:21.366008 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:21.366008 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c5a1db9d-3e33-4fef-b3f6-3b73a195bd4d tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Returning 409 to user: Flavor access already exists for flavor 32 and project 6024b5130104455f9af67c84c49f08ea combination. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:21.366008 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c5a1db9d-3e33-4fef-b3f6-3b73a195bd4d tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1285384534/action" status: 409 len: 152 microversion: 2.1 time: 0.674180 Jul 19 22:26:21.366008 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 192/401] 10.222.0.25 () {60 vars in 1199 bytes} [Tue Jul 19 22:26:20 2022] POST /compute/v2.1/flavors/1285384534/action => generated 152 bytes in 681 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:26:21.391883 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-78e1948f-75c6-49b1-8955-afb4cb84d715 tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:21.393463 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-78e1948f-75c6-49b1-8955-afb4cb84d715 tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] [instance: 04279b5f-973f-463f-9bdc-29eab24edeb2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:21.409261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78e1948f-75c6-49b1-8955-afb4cb84d715 tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:21.409730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78e1948f-75c6-49b1-8955-afb4cb84d715 tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:21.411625 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78e1948f-75c6-49b1-8955-afb4cb84d715 tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:21.412077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78e1948f-75c6-49b1-8955-afb4cb84d715 tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:21.474124 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-78e1948f-75c6-49b1-8955-afb4cb84d715 tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Lazy-loading 'flavor' on Instance uuid 04279b5f-973f-463f-9bdc-29eab24edeb2 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:26:21.652670 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:26:21.687637 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-295650de-6ff1-4d75-a0b5-caa10530841f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:21.702115 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-295650de-6ff1-4d75-a0b5-caa10530841f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1477 microversion: 2.1 time: 0.664995 Jul 19 22:26:21.703586 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 210/402] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:21 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1477 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:21.709605 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-78e1948f-75c6-49b1-8955-afb4cb84d715 tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2/action" status: 202 len: 0 microversion: 2.1 time: 0.342974 Jul 19 22:26:21.710842 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 193/403] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:26:21 2022] POST /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:26:21.729617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e86a99fd-1bf6-4bd6-aecb-b8651aaff37b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:21.730563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e86a99fd-1bf6-4bd6-aecb-b8651aaff37b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:21.744864 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5c241253-5874-4f7a-9c30-8c78f5133c07 tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "6024b5130104455f9af67c84c49f08ea"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:21.749112 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:21.749112 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:21.749327 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e86a99fd-1bf6-4bd6-aecb-b8651aaff37b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:21.751449 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e86a99fd-1bf6-4bd6-aecb-b8651aaff37b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:21.752215 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e86a99fd-1bf6-4bd6-aecb-b8651aaff37b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:21.752658 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e86a99fd-1bf6-4bd6-aecb-b8651aaff37b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:22.208342 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5c241253-5874-4f7a-9c30-8c78f5133c07 tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1285384534/action" status: 200 len: 21 microversion: 2.1 time: 0.476024 Jul 19 22:26:22.213852 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 211/404] 10.222.0.25 () {60 vars in 1199 bytes} [Tue Jul 19 22:26:21 2022] POST /compute/v2.1/flavors/1285384534/action => generated 21 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:26:22.410590 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-939ef1bb-e431-47c8-848a-6d5555d53a5e tempest-FlavorsExtraSpecsTestJSON-23359928 tempest-FlavorsExtraSpecsTestJSON-23359928-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1488546665", "ram": 512, "vcpus": 1, "disk": 10, "id": 1914038228, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:22.412461 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:22.412461 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:22.467473 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-939ef1bb-e431-47c8-848a-6d5555d53a5e tempest-FlavorsExtraSpecsTestJSON-23359928 tempest-FlavorsExtraSpecsTestJSON-23359928-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.252080 Jul 19 22:26:22.472315 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 212/405] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:26:22 2022] POST /compute/v2.1/flavors => generated 416 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:22.498539 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-54ac1bea-f7b7-4514-8cf6-05dd0ec852df tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:22.499227 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-54ac1bea-f7b7-4514-8cf6-05dd0ec852df tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: 04279b5f-973f-463f-9bdc-29eab24edeb2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:22.524905 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-54ac1bea-f7b7-4514-8cf6-05dd0ec852df tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:22.525351 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-54ac1bea-f7b7-4514-8cf6-05dd0ec852df tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:22.533536 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-54ac1bea-f7b7-4514-8cf6-05dd0ec852df tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:22.534189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-54ac1bea-f7b7-4514-8cf6-05dd0ec852df tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:22.758961 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e86a99fd-1bf6-4bd6-aecb-b8651aaff37b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:22.788164 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e86a99fd-1bf6-4bd6-aecb-b8651aaff37b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 200 len: 1311 microversion: 2.1 time: 1.075127 Jul 19 22:26:22.790397 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 194/406] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:21 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 1311 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:22.808159 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-372ba4ec-c2ca-461f-a999-d37f628ed1d1 tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:22.809685 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:22.809685 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:22.854689 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-372ba4ec-c2ca-461f-a999-d37f628ed1d1 tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1285384534" status: 202 len: 0 microversion: 2.1 time: 0.059744 Jul 19 22:26:22.856024 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 195/407] 10.222.0.25 () {58 vars in 1160 bytes} [Tue Jul 19 22:26:22 2022] DELETE /compute/v2.1/flavors/1285384534 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:26:22.863703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c8861f7a-9606-424d-a965-0fa2dacb6698 tempest-FlavorsExtraSpecsTestJSON-23359928 tempest-FlavorsExtraSpecsTestJSON-23359928-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:22.872310 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:22.872310 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:22.880839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-54ac1bea-f7b7-4514-8cf6-05dd0ec852df tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:22.911462 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-54ac1bea-f7b7-4514-8cf6-05dd0ec852df tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2" status: 200 len: 1460 microversion: 2.1 time: 0.437043 Jul 19 22:26:22.912833 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 213/408] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:22 2022] GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2 => generated 1460 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:22.930557 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fc74eba0-c479-45e9-bb11-991c68abf300 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:22.931640 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fc74eba0-c479-45e9-bb11-991c68abf300 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:22.942849 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc74eba0-c479-45e9-bb11-991c68abf300 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:22.943825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc74eba0-c479-45e9-bb11-991c68abf300 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:22.944816 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc74eba0-c479-45e9-bb11-991c68abf300 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:22.946948 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc74eba0-c479-45e9-bb11-991c68abf300 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:22.957791 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c8861f7a-9606-424d-a965-0fa2dacb6698 tempest-FlavorsExtraSpecsTestJSON-23359928 tempest-FlavorsExtraSpecsTestJSON-23359928-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1914038228/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.100290 Jul 19 22:26:22.962822 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 196/409] 10.222.0.25 () {60 vars in 1223 bytes} [Tue Jul 19 22:26:22 2022] POST /compute/v2.1/flavors/1914038228/os-extra_specs => generated 66 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:26:22.972745 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bd606b81-71d3-4cf8-ad8a-d79b081804df tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:23.037906 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bd606b81-71d3-4cf8-ad8a-d79b081804df tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.077610 Jul 19 22:26:23.039693 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 197/410] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:26:22 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:23.045293 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c68da9b8-907f-4ab0-b9a2-fec477d74ca1 tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:23.047910 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c68da9b8-907f-4ab0-b9a2-fec477d74ca1 tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] [instance: 04279b5f-973f-463f-9bdc-29eab24edeb2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:23.057366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c68da9b8-907f-4ab0-b9a2-fec477d74ca1 tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:23.057983 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c68da9b8-907f-4ab0-b9a2-fec477d74ca1 tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:23.059285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c68da9b8-907f-4ab0-b9a2-fec477d74ca1 tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:23.060307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c68da9b8-907f-4ab0-b9a2-fec477d74ca1 tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:23.629209 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fc74eba0-c479-45e9-bb11-991c68abf300 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:23.638134 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fc74eba0-c479-45e9-bb11-991c68abf300 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1476 microversion: 2.1 time: 0.719866 Jul 19 22:26:23.642425 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 214/411] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:22 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1476 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:23.944331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bed246f9-a209-46de-b832-c7a0e3cabacc tempest-FlavorsExtraSpecsTestJSON-103640398 tempest-FlavorsExtraSpecsTestJSON-103640398-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:23.960678 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bed246f9-a209-46de-b832-c7a0e3cabacc tempest-FlavorsExtraSpecsTestJSON-103640398 tempest-FlavorsExtraSpecsTestJSON-103640398-project] 10.222.0.25 "GET /compute/v2.1/flavors/1914038228/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.315020 Jul 19 22:26:23.969645 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 215/412] 10.222.0.25 () {58 vars in 1202 bytes} [Tue Jul 19 22:26:23 2022] GET /compute/v2.1/flavors/1914038228/os-extra_specs => generated 66 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:26:23.978806 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0fa8f8f8-1a51-4d1c-a8cb-5e30432ec968 tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-561280215", "id": 129842405, "os-flavor-access:is_public": "True"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:23.982589 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:23.982589 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:24.011083 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0fa8f8f8-1a51-4d1c-a8cb-5e30432ec968 tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.045026 Jul 19 22:26:24.013433 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 216/413] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:26:23 2022] POST /compute/v2.1/flavors => generated 434 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:24.019077 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-1f5399ba-92fd-43d2-b09a-22bea07874bf req-e4debc9e-162d-4b3c-b7e7-552896c56613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18dfb53a-18ce-4ad5-a226-dff0410f00eb", "name": "network-vif-unplugged", "status": "completed", "tag": "c7157193-94b5-4be3-a477-21afd3984d48"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:24.067245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1f5399ba-92fd-43d2-b09a-22bea07874bf req-e4debc9e-162d-4b3c-b7e7-552896c56613 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:24.071429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1f5399ba-92fd-43d2-b09a-22bea07874bf req-e4debc9e-162d-4b3c-b7e7-552896c56613 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:24.104672 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-1f5399ba-92fd-43d2-b09a-22bea07874bf req-e4debc9e-162d-4b3c-b7e7-552896c56613 service nova] Creating event network-vif-unplugged:c7157193-94b5-4be3-a477-21afd3984d48 for instance 18dfb53a-18ce-4ad5-a226-dff0410f00eb on n-h2-847009-3 Jul 19 22:26:24.146489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [req-1f5399ba-92fd-43d2-b09a-22bea07874bf req-e4debc9e-162d-4b3c-b7e7-552896c56613 service nova] Instance 18dfb53a-18ce-4ad5-a226-dff0410f00eb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119337) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 22:26:24.175363 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-1f5399ba-92fd-43d2-b09a-22bea07874bf req-e4debc9e-162d-4b3c-b7e7-552896c56613 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.160602 Jul 19 22:26:24.185140 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 217/414] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:24.221011 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e6fc0e3d-70c5-41f9-820b-2ef934a0b2d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:24.222482 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e6fc0e3d-70c5-41f9-820b-2ef934a0b2d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:24.244921 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6fc0e3d-70c5-41f9-820b-2ef934a0b2d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:24.245865 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6fc0e3d-70c5-41f9-820b-2ef934a0b2d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:24.246840 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6fc0e3d-70c5-41f9-820b-2ef934a0b2d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:24.247622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6fc0e3d-70c5-41f9-820b-2ef934a0b2d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:24.455458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:26:24.779820 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e6fc0e3d-70c5-41f9-820b-2ef934a0b2d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:24.819015 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e6fc0e3d-70c5-41f9-820b-2ef934a0b2d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 200 len: 1311 microversion: 2.1 time: 0.631833 Jul 19 22:26:24.835523 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 218/415] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:24 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 1311 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:24.885292 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f78906a2-de2d-47ef-9e2f-58ff94b0dbca tempest-FlavorsExtraSpecsTestJSON-23359928 tempest-FlavorsExtraSpecsTestJSON-23359928-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:24.895737 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:24.895737 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:24.950568 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c68da9b8-907f-4ab0-b9a2-fec477d74ca1 tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2" status: 200 len: 1611 microversion: 2.1 time: 1.908714 Jul 19 22:26:24.956662 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 198/416] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:23 2022] GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2 => generated 1611 bytes in 1916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:24.974237 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-03119384-57a9-4486-b8fb-89b79a04f12f tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:24.976986 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:24.976986 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:25.000166 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-03119384-57a9-4486-b8fb-89b79a04f12f tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 19 22:26:25.004803 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-03119384-57a9-4486-b8fb-89b79a04f12f tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Request method failure captured: Jul 19 22:26:25.004803 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/flavors/129842405/os-flavor-access HTTP/1.1 Jul 19 22:26:25.004803 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:26:25.004803 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:26:25.004803 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:26:25.004803 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:26:25.004803 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:26:25.004803 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:26:25.004803 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:26:25.004803 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:25.004803 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y-IVjK0GBlozK-VLIOKQBMr-frMvSVgMrNoJHywGuy_5nxeyxrCrMt-VStlAKMkKffIxupee-KwE0Cg52-pcU_kAAuworTB2Be0w-L5_SqetKTE9s_CO5ZTpqCyYSFAI1jghCqTb81sxJuQA1aKVUa9LWOR2G9AyFSxsflbTLwIaKo Jul 19 22:26:25.004803 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:26:25.004803 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:26:25.004803 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:26:25.004803 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:26:25.004803 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:26:25.004803 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:26:25.004803 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: c241e66ac93b4363a65e820da2f5d646 Jul 19 22:26:25.004803 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-918820361 Jul 19 22:26:25.004803 n-d-847009-3 devstack@n-api.service[119338]: X-Role: admin,member,reader Jul 19 22:26:25.004803 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: admin,member,reader Jul 19 22:26:25.007191 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c241e66ac93b4363a65e820da2f5d646"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c241e66ac93b4363a65e820da2f5d646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c241e66ac93b4363a65e820da2f5d646"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c241e66ac93b4363a65e820da2f5d646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:25.007191 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-918820361 Jul 19 22:26:25.007191 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: c241e66ac93b4363a65e820da2f5d646 Jul 19 22:26:25.007191 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-918820361 Jul 19 22:26:25.007191 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin Jul 19 22:26:25.007191 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:26:25.007191 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:26:25.007191 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: e273f2032cf74d848a9ac336e977a1b1 Jul 19 22:26:25.007191 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin Jul 19 22:26:25.007191 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:26:25.007191 n-d-847009-3 devstack@n-api.service[119338]: exception: Access list not available for public flavors. Jul 19 22:26:25.007191 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'flavor_id': '129842405'} Jul 19 22:26:25.008458 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:25.008458 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:25.008458 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:25.008458 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:25.008458 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:25.008458 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:25.008458 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:25.008458 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:25.008458 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 19 22:26:25.008458 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 22:26:25.008458 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 19 22:26:25.008458 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:25.008458 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:25.008458 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:25.008458 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:25.008458 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:25.008458 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:25.008458 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:26:25.008458 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:26:25.008458 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 19 22:26:25.008458 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:25.015455 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-03119384-57a9-4486-b8fb-89b79a04f12f tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:25.017799 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-03119384-57a9-4486-b8fb-89b79a04f12f tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/129842405/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.055754 Jul 19 22:26:25.019806 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 199/417] 10.222.0.25 () {58 vars in 1205 bytes} [Tue Jul 19 22:26:24 2022] GET /compute/v2.1/flavors/129842405/os-flavor-access => generated 91 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:26:25.032259 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4b7f6458-b9f2-409a-adff-050a60550882 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:25.034403 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4b7f6458-b9f2-409a-adff-050a60550882 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:25.036153 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f78906a2-de2d-47ef-9e2f-58ff94b0dbca tempest-FlavorsExtraSpecsTestJSON-23359928 tempest-FlavorsExtraSpecsTestJSON-23359928-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1914038228/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.180544 Jul 19 22:26:25.037232 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 219/418] 10.222.0.25 () {60 vars in 1223 bytes} [Tue Jul 19 22:26:24 2022] POST /compute/v2.1/flavors/1914038228/os-extra_specs => generated 66 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:26:25.053370 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-aae3d91d-0160-460c-aced-195c8a2e304c tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:25.061559 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=8 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:26:25.067084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b7f6458-b9f2-409a-adff-050a60550882 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:25.068107 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:25.068107 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:25.068865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b7f6458-b9f2-409a-adff-050a60550882 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:25.070370 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b7f6458-b9f2-409a-adff-050a60550882 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:25.070532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aae3d91d-0160-460c-aced-195c8a2e304c tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:25.071343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aae3d91d-0160-460c-aced-195c8a2e304c tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:25.072049 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b7f6458-b9f2-409a-adff-050a60550882 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:25.072842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aae3d91d-0160-460c-aced-195c8a2e304c tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:25.087135 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aae3d91d-0160-460c-aced-195c8a2e304c tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:25.164993 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-aae3d91d-0160-460c-aced-195c8a2e304c tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.122871 Jul 19 22:26:25.177432 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 220/419] 10.222.0.25 () {58 vars in 1175 bytes} [Tue Jul 19 22:26:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:25.194599 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ce9c61d2-4fa4-4ee4-a512-a2795b263b1f tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:25.196827 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:25.196827 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:25.256853 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ce9c61d2-4fa4-4ee4-a512-a2795b263b1f tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/129842405" status: 202 len: 0 microversion: 2.1 time: 0.074692 Jul 19 22:26:25.268928 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 221/420] 10.222.0.25 () {58 vars in 1157 bytes} [Tue Jul 19 22:26:25 2022] DELETE /compute/v2.1/flavors/129842405 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:26:25.297651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c747d946-d7ec-48b3-b6de-d0ddeb1956b3 tempest-FlavorsExtraSpecsTestJSON-103640398 tempest-FlavorsExtraSpecsTestJSON-103640398-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:25.331783 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c747d946-d7ec-48b3-b6de-d0ddeb1956b3 tempest-FlavorsExtraSpecsTestJSON-103640398 tempest-FlavorsExtraSpecsTestJSON-103640398-project] 10.222.0.25 "GET /compute/v2.1/flavors/1914038228/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.058951 Jul 19 22:26:25.332860 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 222/421] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 19 22:26:25 2022] GET /compute/v2.1/flavors/1914038228/os-extra_specs/hw:numa_nodes => generated 22 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:26:25.346578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a15fa195-50c5-423c-be70-7ecbec1c2a2e tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-847009-3", "block_migration": true, "disk_over_commit": false}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:25.349273 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a15fa195-50c5-423c-be70-7ecbec1c2a2e tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] [instance: 04279b5f-973f-463f-9bdc-29eab24edeb2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:25.367951 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a15fa195-50c5-423c-be70-7ecbec1c2a2e tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:25.369531 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a15fa195-50c5-423c-be70-7ecbec1c2a2e tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:25.373270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a15fa195-50c5-423c-be70-7ecbec1c2a2e tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:25.374122 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a15fa195-50c5-423c-be70-7ecbec1c2a2e tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:25.403144 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4b7f6458-b9f2-409a-adff-050a60550882 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:25.415659 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4b7f6458-b9f2-409a-adff-050a60550882 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1476 microversion: 2.1 time: 0.393958 Jul 19 22:26:25.417141 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 200/422] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:25 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1476 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:25.423845 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-98100fd3-c0ba-41df-af06-7d2f875042ef tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:25.477675 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-98100fd3-c0ba-41df-af06-7d2f875042ef tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.056073 Jul 19 22:26:25.478679 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 201/423] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:26:25 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:25.523505 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f7a8c5ed-d367-48d6-b10c-647f38184d95 tempest-FlavorsExtraSpecsTestJSON-23359928 tempest-FlavorsExtraSpecsTestJSON-23359928-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:25.528337 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:25.528337 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:25.590031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=5,nova_api:DELETE=3,nova_api:SAVEPOINT=3,nova_api:RELEASE=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:26:25.596616 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-a15fa195-50c5-423c-be70-7ecbec1c2a2e tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Lazy-loading 'flavor' on Instance uuid 04279b5f-973f-463f-9bdc-29eab24edeb2 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:26:25.616282 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f7a8c5ed-d367-48d6-b10c-647f38184d95 tempest-FlavorsExtraSpecsTestJSON-23359928 tempest-FlavorsExtraSpecsTestJSON-23359928-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1914038228/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.117741 Jul 19 22:26:25.617637 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 202/424] 10.222.0.25 () {60 vars in 1223 bytes} [Tue Jul 19 22:26:25 2022] POST /compute/v2.1/flavors/1914038228/os-extra_specs => generated 66 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:26:25.627548 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5953bfb4-ee61-4d0b-859f-7b94e10e444e tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1494717627", "id": 729512706, "os-flavor-access:is_public": "False"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:25.640596 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:25.640596 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:25.671402 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5953bfb4-ee61-4d0b-859f-7b94e10e444e tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.047849 Jul 19 22:26:25.673415 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 203/425] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:26:25 2022] POST /compute/v2.1/flavors => generated 436 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:25.682373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c4e5f81c-b0b3-4261-b31c-98d9839c2480 tempest-FlavorsExtraSpecsTestJSON-23359928 tempest-FlavorsExtraSpecsTestJSON-23359928-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:25.682993 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-a15fa195-50c5-423c-be70-7ecbec1c2a2e tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 04279b5f-973f-463f-9bdc-29eab24edeb2 while it is in vm_state suspended Jul 19 22:26:25.686338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a15fa195-50c5-423c-be70-7ecbec1c2a2e tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Request method failure captured: Jul 19 22:26:25.686338 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2/action HTTP/1.1 Jul 19 22:26:25.686338 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:26:25.686338 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:26:25.686338 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:26:25.686338 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 97 Jul 19 22:26:25.686338 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:26:25.686338 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:26:25.686338 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:26:25.686338 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:25.686338 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y9aBBxfdQcUZLicibB3ped9ja0hN4VBobhieI2igBFVvKbrpyDlFHcgiPFSIsVXc7OQHyfNkPyCQzYCwK-6sdtgR2RJTM3eEqKDCaswTPhG0aK6I1WZp1FRJ3ZW3YtHfKZhJFV1Xi-OUUbLRHIq1xLpZgNjdOoQl-VyCc47XDvajpg Jul 19 22:26:25.686338 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:26:25.686338 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:26:25.686338 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:26:25.686338 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:26:25.686338 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:26:25.686338 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:26:25.686338 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: cbb7434655ef402a9f06de2536290f98 Jul 19 22:26:25.686338 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-LiveMigrationNegativeTest-1941312689 Jul 19 22:26:25.686338 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:26:25.686338 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:26:25.687713 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cbb7434655ef402a9f06de2536290f98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cbb7434655ef402a9f06de2536290f98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cbb7434655ef402a9f06de2536290f98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cbb7434655ef402a9f06de2536290f98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:25.687713 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-LiveMigrationNegativeTest-1941312689 Jul 19 22:26:25.687713 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: cbb7434655ef402a9f06de2536290f98 Jul 19 22:26:25.687713 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1941312689 Jul 19 22:26:25.687713 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-LiveMigrationNegativeTest-1941312689-project-admin Jul 19 22:26:25.687713 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:26:25.687713 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:26:25.687713 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: b5ae3676ec164be6a88ebc82b2dea078 Jul 19 22:26:25.687713 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-LiveMigrationNegativeTest-1941312689-project-admin Jul 19 22:26:25.687713 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:26:25.687713 n-d-847009-3 devstack@n-api.service[119337]: {"os-migrateLive": {"host": "n-h2-847009-3", "block_migration": true, "disk_over_commit": false}} Jul 19 22:26:25.687713 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:26:25.688483 n-d-847009-3 devstack@n-api.service[119337]: exception: Cannot 'os-migrateLive' instance 04279b5f-973f-463f-9bdc-29eab24edeb2 while it is in vm_state suspended Jul 19 22:26:25.688483 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '04279b5f-973f-463f-9bdc-29eab24edeb2', 'body': {'os-migrateLive': {'host': 'n-h2-847009-3', 'block_migration': True, 'disk_over_commit': False}}} Jul 19 22:26:25.688483 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:25.688483 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:25.688483 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 19 22:26:25.688483 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 19 22:26:25.688483 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 19 22:26:25.688483 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 22:26:25.688483 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 19 22:26:25.688483 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 22:26:25.688483 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 19 22:26:25.688483 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 22:26:25.688483 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 19 22:26:25.688483 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 22:26:25.688483 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 19 22:26:25.688483 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 22:26:25.688483 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 19 22:26:25.688483 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 22:26:25.689663 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 22:26:25.689663 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 22:26:25.689663 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 22:26:25.689663 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 22:26:25.689663 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 04279b5f-973f-463f-9bdc-29eab24edeb2 in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 19 22:26:25.689663 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:25.689663 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:25.689663 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:25.689663 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:25.689663 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:25.689663 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:25.689663 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:25.689663 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:25.689663 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:25.689663 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:25.689663 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:26:25.689663 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:26:25.689663 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:26:25.689663 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:26:25.689663 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:26:25.690789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:26:25.690789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 19 22:26:25.690789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 19 22:26:25.690789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 22:26:25.690789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 22:26:25.690789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 22:26:25.690789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 04279b5f-973f-463f-9bdc-29eab24edeb2 while it is in vm_state suspended Jul 19 22:26:25.690789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:25.690789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:25.690789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:25.690789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:25.690789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:25.690789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:25.690789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:26:25.690789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:26:25.690789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 04279b5f-973f-463f-9bdc-29eab24edeb2 while it is in vm_state suspended Jul 19 22:26:25.690789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:25.691773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a15fa195-50c5-423c-be70-7ecbec1c2a2e tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 04279b5f-973f-463f-9bdc-29eab24edeb2 while it is in vm_state suspended {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:25.691773 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a15fa195-50c5-423c-be70-7ecbec1c2a2e tempest-LiveMigrationNegativeTest-1941312689 tempest-LiveMigrationNegativeTest-1941312689-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2/action" status: 409 len: 155 microversion: 2.1 time: 0.353801 Jul 19 22:26:25.691773 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 223/426] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:26:25 2022] POST /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2/action => generated 155 bytes in 355 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:26:25.700332 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c4e5f81c-b0b3-4261-b31c-98d9839c2480 tempest-FlavorsExtraSpecsTestJSON-23359928 tempest-FlavorsExtraSpecsTestJSON-23359928-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/1914038228/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.025113 Jul 19 22:26:25.706750 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 204/427] 10.222.0.25 () {58 vars in 1202 bytes} [Tue Jul 19 22:26:25 2022] GET /compute/v2.1/flavors/1914038228/os-extra_specs => generated 66 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:26:25.728780 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0737297d-d133-4cef-8b16-61c031cfc3f8 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:25.737239 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0737297d-d133-4cef-8b16-61c031cfc3f8 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: 04279b5f-973f-463f-9bdc-29eab24edeb2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:25.753430 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0737297d-d133-4cef-8b16-61c031cfc3f8 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:25.756493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0737297d-d133-4cef-8b16-61c031cfc3f8 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:25.759684 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0737297d-d133-4cef-8b16-61c031cfc3f8 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:25.762109 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0737297d-d133-4cef-8b16-61c031cfc3f8 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:25.848216 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0737297d-d133-4cef-8b16-61c031cfc3f8 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: 04279b5f-973f-463f-9bdc-29eab24edeb2] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:26:26.013000 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-57ba8c4e-e657-4144-b97f-dffbec568086 tempest-FlavorsAccessNegativeTestJSON-2048909862 tempest-FlavorsAccessNegativeTestJSON-2048909862-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "6024b5130104455f9af67c84c49f08ea"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:26.014178 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:26.014178 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:26.015359 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-57ba8c4e-e657-4144-b97f-dffbec568086 tempest-FlavorsAccessNegativeTestJSON-2048909862 tempest-FlavorsAccessNegativeTestJSON-2048909862-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '64a71bfada3c46e4b0928b3bf54fe7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6024b5130104455f9af67c84c49f08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:26.019778 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-57ba8c4e-e657-4144-b97f-dffbec568086 tempest-FlavorsAccessNegativeTestJSON-2048909862 tempest-FlavorsAccessNegativeTestJSON-2048909862-project] Request method failure captured: Jul 19 22:26:26.019778 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/flavors/729512706/action HTTP/1.1 Jul 19 22:26:26.019778 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:26:26.019778 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:26:26.019778 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:26:26.019778 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 67 Jul 19 22:26:26.019778 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:26:26.019778 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:26:26.019778 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:26:26.019778 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:26.019778 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y-Hw3b8ioJs9dk1K-Y3BQhbIPKGP5X0Z34vR6-UE6V1egFORvdfDUve7JCJuGjN_q5q71damuAzkPA0DUKiyehFo4ifFD4nVyD7f7KzPbyWZh8TvJ8t_mAVr462m7qClBGBoPk3SzxsuEUV5zrFQR6i0rEbzZTycZM8MVKR8tstCBs Jul 19 22:26:26.019778 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:26:26.019778 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:26:26.019778 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:26:26.019778 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:26:26.019778 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:26:26.019778 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:26:26.019778 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 6024b5130104455f9af67c84c49f08ea Jul 19 22:26:26.019778 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2048909862 Jul 19 22:26:26.019778 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:26:26.019778 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:26:26.021809 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6024b5130104455f9af67c84c49f08ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6024b5130104455f9af67c84c49f08ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6024b5130104455f9af67c84c49f08ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6024b5130104455f9af67c84c49f08ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:26.021809 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2048909862 Jul 19 22:26:26.021809 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 6024b5130104455f9af67c84c49f08ea Jul 19 22:26:26.021809 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2048909862 Jul 19 22:26:26.021809 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-FlavorsAccessNegativeTestJSON-2048909862-project Jul 19 22:26:26.021809 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:26:26.021809 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:26:26.021809 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 64a71bfada3c46e4b0928b3bf54fe7ae Jul 19 22:26:26.021809 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2048909862-project Jul 19 22:26:26.021809 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:26:26.021809 n-d-847009-3 devstack@n-api.service[119337]: {"addTenantAccess": {"tenant": "6024b5130104455f9af67c84c49f08ea"}} Jul 19 22:26:26.021809 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:26:26.022568 n-d-847009-3 devstack@n-api.service[119337]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 19 22:26:26.022568 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '729512706', 'body': {'addTenantAccess': {'tenant': '6024b5130104455f9af67c84c49f08ea'}}} Jul 19 22:26:26.022568 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:26.022568 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:26.022568 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:26.022568 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:26.022568 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:26.022568 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:26.022568 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:26.022568 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:26.022568 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:26:26.022568 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:26:26.022568 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 19 22:26:26.022568 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 19 22:26:26.022568 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:26:26.022568 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:26:26.022568 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:26:26.022568 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:26:26.022568 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:26:26.023777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:26:26.023777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:26:26.023777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:26:26.023777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:26:26.023777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:26:26.023777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:26:26.023777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:26:26.023777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:26:26.023777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:26:26.023777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 19 22:26:26.023777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:26.023777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:26.023777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:26.023777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:26.023777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:26.023777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:26.023777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:26:26.023777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:26:26.023777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 19 22:26:26.023777 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:26.025097 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-57ba8c4e-e657-4144-b97f-dffbec568086 tempest-FlavorsAccessNegativeTestJSON-2048909862 tempest-FlavorsAccessNegativeTestJSON-2048909862-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:26.025097 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-57ba8c4e-e657-4144-b97f-dffbec568086 tempest-FlavorsAccessNegativeTestJSON-2048909862 tempest-FlavorsAccessNegativeTestJSON-2048909862-project] 10.222.0.25 "POST /compute/v2.1/flavors/729512706/action" status: 403 len: 130 microversion: 2.1 time: 0.333575 Jul 19 22:26:26.026708 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 224/428] 10.222.0.25 () {60 vars in 1196 bytes} [Tue Jul 19 22:26:25 2022] POST /compute/v2.1/flavors/729512706/action => generated 130 bytes in 337 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:26:26.042845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fe526282-1722-41b3-a385-d26f13ce3201 tempest-FlavorsExtraSpecsTestJSON-23359928 tempest-FlavorsExtraSpecsTestJSON-23359928-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:26.044256 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:26.044256 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:26.109337 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fe526282-1722-41b3-a385-d26f13ce3201 tempest-FlavorsExtraSpecsTestJSON-23359928 tempest-FlavorsExtraSpecsTestJSON-23359928-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/1914038228/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.078131 Jul 19 22:26:26.109882 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 225/429] 10.222.0.25 () {60 vars in 1264 bytes} [Tue Jul 19 22:26:26 2022] PUT /compute/v2.1/flavors/1914038228/os-extra_specs/hw:numa_nodes => generated 22 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:26:26.120492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c90731e9-56ba-49a8-b6bf-df551133a7c5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:26.121026 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c90731e9-56ba-49a8-b6bf-df551133a7c5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:26.124780 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0737297d-d133-4cef-8b16-61c031cfc3f8 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "DELETE /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2" status: 204 len: 0 microversion: 2.1 time: 0.415970 Jul 19 22:26:26.127508 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 205/430] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:26:25 2022] DELETE /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:26:26.133433 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-10f5370b-0f97-4815-a69e-6e8275cef316 tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:26.134512 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:26.134512 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:26.135977 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=4,nova_api:INSERT=2,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:26:26.140034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c90731e9-56ba-49a8-b6bf-df551133a7c5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:26.140491 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c90731e9-56ba-49a8-b6bf-df551133a7c5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:26.141482 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c90731e9-56ba-49a8-b6bf-df551133a7c5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:26.142145 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c90731e9-56ba-49a8-b6bf-df551133a7c5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:26.196729 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-10f5370b-0f97-4815-a69e-6e8275cef316 tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/729512706" status: 202 len: 0 microversion: 2.1 time: 0.067758 Jul 19 22:26:26.198642 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 206/431] 10.222.0.25 () {58 vars in 1157 bytes} [Tue Jul 19 22:26:26 2022] DELETE /compute/v2.1/flavors/729512706 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:26:26.206690 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6971e532-8c72-411f-a856-22dedbcef6a9 tempest-FlavorsExtraSpecsTestJSON-23359928 tempest-FlavorsExtraSpecsTestJSON-23359928-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:26.220994 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6971e532-8c72-411f-a856-22dedbcef6a9 tempest-FlavorsExtraSpecsTestJSON-23359928 tempest-FlavorsExtraSpecsTestJSON-23359928-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/1914038228/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.018530 Jul 19 22:26:26.222008 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 207/432] 10.222.0.25 () {58 vars in 1202 bytes} [Tue Jul 19 22:26:26 2022] GET /compute/v2.1/flavors/1914038228/os-extra_specs => generated 66 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:26:26.227653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ce75fb2d-86aa-425d-96a3-cfb43117bfb8 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:26.228796 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ce75fb2d-86aa-425d-96a3-cfb43117bfb8 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: 04279b5f-973f-463f-9bdc-29eab24edeb2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:26.258534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ce75fb2d-86aa-425d-96a3-cfb43117bfb8 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:26.259461 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ce75fb2d-86aa-425d-96a3-cfb43117bfb8 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:26.261058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ce75fb2d-86aa-425d-96a3-cfb43117bfb8 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:26.262706 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ce75fb2d-86aa-425d-96a3-cfb43117bfb8 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:26.843419 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c90731e9-56ba-49a8-b6bf-df551133a7c5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:26.854621 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c90731e9-56ba-49a8-b6bf-df551133a7c5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 200 len: 1311 microversion: 2.1 time: 0.743602 Jul 19 22:26:26.865036 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 226/433] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:26 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 1311 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:26.896830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b2a69c86-285e-46bb-b820-4468ec7135f5 tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:26.944194 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b2a69c86-285e-46bb-b820-4468ec7135f5 tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.077690 Jul 19 22:26:26.945294 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 227/434] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:26:26 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:26.950493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a89e2bd2-10c8-4d6c-924d-b83e2e1163e9 tempest-FlavorsExtraSpecsTestJSON-23359928 tempest-FlavorsExtraSpecsTestJSON-23359928-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:26.951295 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:26.951295 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:26.964581 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ce75fb2d-86aa-425d-96a3-cfb43117bfb8 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:26.979344 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ce75fb2d-86aa-425d-96a3-cfb43117bfb8 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2" status: 200 len: 1466 microversion: 2.1 time: 0.755918 Jul 19 22:26:26.996494 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 208/435] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:26 2022] GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2 => generated 1466 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:27.023996 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-0dcdfb00-e6ad-4187-9067-987f11262527 req-3c8b46d2-be4a-4fb2-b1fe-a588b98d0c6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18dfb53a-18ce-4ad5-a226-dff0410f00eb", "tag": "c7157193-94b5-4be3-a477-21afd3984d48"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:27.040756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0dcdfb00-e6ad-4187-9067-987f11262527 req-3c8b46d2-be4a-4fb2-b1fe-a588b98d0c6c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:27.041206 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0dcdfb00-e6ad-4187-9067-987f11262527 req-3c8b46d2-be4a-4fb2-b1fe-a588b98d0c6c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:27.051971 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a89e2bd2-10c8-4d6c-924d-b83e2e1163e9 tempest-FlavorsExtraSpecsTestJSON-23359928 tempest-FlavorsExtraSpecsTestJSON-23359928-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1914038228/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.105263 Jul 19 22:26:27.052571 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 228/436] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 19 22:26:26 2022] DELETE /compute/v2.1/flavors/1914038228/os-extra_specs/hw:numa_nodes => generated 0 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 22:26:27.063138 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c57cd696-e29f-40ad-98bb-4199adfafdb4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:27.064106 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c57cd696-e29f-40ad-98bb-4199adfafdb4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:27.069997 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-0dcdfb00-e6ad-4187-9067-987f11262527 req-3c8b46d2-be4a-4fb2-b1fe-a588b98d0c6c service nova] Creating event network-changed:c7157193-94b5-4be3-a477-21afd3984d48 for instance 18dfb53a-18ce-4ad5-a226-dff0410f00eb on n-h2-847009-3 Jul 19 22:26:27.074862 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c57cd696-e29f-40ad-98bb-4199adfafdb4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:27.075439 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c57cd696-e29f-40ad-98bb-4199adfafdb4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:27.076103 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c57cd696-e29f-40ad-98bb-4199adfafdb4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:27.086207 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c57cd696-e29f-40ad-98bb-4199adfafdb4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:27.117120 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [req-0dcdfb00-e6ad-4187-9067-987f11262527 req-3c8b46d2-be4a-4fb2-b1fe-a588b98d0c6c service nova] Instance 18dfb53a-18ce-4ad5-a226-dff0410f00eb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119338) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 22:26:27.138855 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-0dcdfb00-e6ad-4187-9067-987f11262527 req-3c8b46d2-be4a-4fb2-b1fe-a588b98d0c6c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134512 Jul 19 22:26:27.139519 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 209/437] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:27.148586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-545259ae-8f27-4554-8298-5ee5114982b7 req-908e50c1-e03d-484c-8e11-c895c570bf28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc2efca-6346-4a22-999b-5a1fa57dcee9", "name": "network-vif-plugged", "status": "completed", "tag": "b2782aff-48f6-4b84-8432-a744c2cd70bd"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:27.163101 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-545259ae-8f27-4554-8298-5ee5114982b7 req-908e50c1-e03d-484c-8e11-c895c570bf28 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:27.163919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-545259ae-8f27-4554-8298-5ee5114982b7 req-908e50c1-e03d-484c-8e11-c895c570bf28 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:27.185626 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-545259ae-8f27-4554-8298-5ee5114982b7 req-908e50c1-e03d-484c-8e11-c895c570bf28 service nova] Creating event network-vif-plugged:b2782aff-48f6-4b84-8432-a744c2cd70bd for instance 6dc2efca-6346-4a22-999b-5a1fa57dcee9 on n-h2-847009-3 Jul 19 22:26:27.191844 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-545259ae-8f27-4554-8298-5ee5114982b7 req-908e50c1-e03d-484c-8e11-c895c570bf28 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051008 Jul 19 22:26:27.193177 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 210/438] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:27.200178 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0b6871db-4ced-4e56-9172-b9e03ca08793 tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-102757066", "id": 1296636393, "os-flavor-access:is_public": "False"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:27.205663 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:27.205663 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:27.226527 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0b6871db-4ced-4e56-9172-b9e03ca08793 tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.031604 Jul 19 22:26:27.227755 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 211/439] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:26:27 2022] POST /compute/v2.1/flavors => generated 438 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:27.232909 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-385a43dc-9348-4e77-8c59-ac14c7eba1cb tempest-FlavorsExtraSpecsTestJSON-23359928 tempest-FlavorsExtraSpecsTestJSON-23359928-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:27.233985 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:27.233985 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:27.258038 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-385a43dc-9348-4e77-8c59-ac14c7eba1cb tempest-FlavorsExtraSpecsTestJSON-23359928 tempest-FlavorsExtraSpecsTestJSON-23359928-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1914038228/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.028541 Jul 19 22:26:27.259608 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 212/440] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 19 22:26:27 2022] DELETE /compute/v2.1/flavors/1914038228/os-extra_specs/hw:cpu_policy => generated 0 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 22:26:27.264961 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-56998cae-38c5-40de-be95-56e52063176b tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "6024b5130104455f9af67c84c49f08ea"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:27.267408 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:27.267408 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:27.322445 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c57cd696-e29f-40ad-98bb-4199adfafdb4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:27.343936 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c57cd696-e29f-40ad-98bb-4199adfafdb4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1476 microversion: 2.1 time: 0.285742 Jul 19 22:26:27.347686 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 229/441] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:27 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1476 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:27.365832 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a9afb0cd-c0e3-474c-b22b-9f8380957ea2 tempest-FlavorsExtraSpecsTestJSON-23359928 tempest-FlavorsExtraSpecsTestJSON-23359928-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:27.396421 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a9afb0cd-c0e3-474c-b22b-9f8380957ea2 tempest-FlavorsExtraSpecsTestJSON-23359928 tempest-FlavorsExtraSpecsTestJSON-23359928-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/1914038228/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.047535 Jul 19 22:26:27.399987 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 230/442] 10.222.0.25 () {58 vars in 1202 bytes} [Tue Jul 19 22:26:27 2022] GET /compute/v2.1/flavors/1914038228/os-extra_specs => generated 19 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:26:27.422934 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e7d4d8e9-0c47-4d96-884d-97093447cea1 tempest-FlavorsExtraSpecsTestJSON-23359928 tempest-FlavorsExtraSpecsTestJSON-23359928-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:27.423444 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:27.423444 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:27.457514 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e7d4d8e9-0c47-4d96-884d-97093447cea1 tempest-FlavorsExtraSpecsTestJSON-23359928 tempest-FlavorsExtraSpecsTestJSON-23359928-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1914038228" status: 202 len: 0 microversion: 2.1 time: 0.051342 Jul 19 22:26:27.458383 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 231/443] 10.222.0.25 () {58 vars in 1160 bytes} [Tue Jul 19 22:26:27 2022] DELETE /compute/v2.1/flavors/1914038228 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:26:27.469963 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d875168e-32f2-4ad8-8a90-d79565583467 tempest-FlavorsExtraSpecsTestJSON-23359928 tempest-FlavorsExtraSpecsTestJSON-23359928-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:27.479690 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-56998cae-38c5-40de-be95-56e52063176b tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1296636393/action" status: 200 len: 97 microversion: 2.1 time: 0.214116 Jul 19 22:26:27.480345 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 213/444] 10.222.0.25 () {60 vars in 1199 bytes} [Tue Jul 19 22:26:27 2022] POST /compute/v2.1/flavors/1296636393/action => generated 97 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:26:27.493283 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8667c185-d423-41e2-8496-5358a220e364 tempest-FlavorsAccessNegativeTestJSON-2048909862 tempest-FlavorsAccessNegativeTestJSON-2048909862-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "6024b5130104455f9af67c84c49f08ea"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:27.497155 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:27.497155 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:27.500102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8667c185-d423-41e2-8496-5358a220e364 tempest-FlavorsAccessNegativeTestJSON-2048909862 tempest-FlavorsAccessNegativeTestJSON-2048909862-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '64a71bfada3c46e4b0928b3bf54fe7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6024b5130104455f9af67c84c49f08ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:27.505981 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8667c185-d423-41e2-8496-5358a220e364 tempest-FlavorsAccessNegativeTestJSON-2048909862 tempest-FlavorsAccessNegativeTestJSON-2048909862-project] Request method failure captured: Jul 19 22:26:27.505981 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/flavors/1296636393/action HTTP/1.1 Jul 19 22:26:27.505981 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:26:27.505981 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:26:27.505981 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:26:27.505981 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 70 Jul 19 22:26:27.505981 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:26:27.505981 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:26:27.505981 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:26:27.505981 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:27.505981 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y-Hw3b8ioJs9dk1K-Y3BQhbIPKGP5X0Z34vR6-UE6V1egFORvdfDUve7JCJuGjN_q5q71damuAzkPA0DUKiyehFo4ifFD4nVyD7f7KzPbyWZh8TvJ8t_mAVr462m7qClBGBoPk3SzxsuEUV5zrFQR6i0rEbzZTycZM8MVKR8tstCBs Jul 19 22:26:27.505981 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:26:27.505981 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:26:27.505981 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:26:27.505981 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:26:27.505981 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:26:27.505981 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:26:27.505981 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 6024b5130104455f9af67c84c49f08ea Jul 19 22:26:27.505981 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2048909862 Jul 19 22:26:27.505981 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:26:27.505981 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:26:27.507480 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6024b5130104455f9af67c84c49f08ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6024b5130104455f9af67c84c49f08ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6024b5130104455f9af67c84c49f08ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6024b5130104455f9af67c84c49f08ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:27.507480 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2048909862 Jul 19 22:26:27.507480 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 6024b5130104455f9af67c84c49f08ea Jul 19 22:26:27.507480 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2048909862 Jul 19 22:26:27.507480 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-FlavorsAccessNegativeTestJSON-2048909862-project Jul 19 22:26:27.507480 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:26:27.507480 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:26:27.507480 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 64a71bfada3c46e4b0928b3bf54fe7ae Jul 19 22:26:27.507480 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2048909862-project Jul 19 22:26:27.507480 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:26:27.507480 n-d-847009-3 devstack@n-api.service[119338]: {"removeTenantAccess": {"tenant": "6024b5130104455f9af67c84c49f08ea"}} Jul 19 22:26:27.507480 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:26:27.508305 n-d-847009-3 devstack@n-api.service[119338]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 19 22:26:27.508305 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '1296636393', 'body': {'removeTenantAccess': {'tenant': '6024b5130104455f9af67c84c49f08ea'}}} Jul 19 22:26:27.508305 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:27.508305 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:27.508305 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:27.508305 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:27.508305 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:27.508305 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:27.508305 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:27.508305 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:27.508305 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:26:27.508305 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:26:27.508305 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 19 22:26:27.508305 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi context.can( Jul 19 22:26:27.508305 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:26:27.508305 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:26:27.508305 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:26:27.508305 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:26:27.508305 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:26:27.508305 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:26:27.509527 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:26:27.509527 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:26:27.509527 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:26:27.509527 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:26:27.509527 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:26:27.509527 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:26:27.509527 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:26:27.509527 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:26:27.509527 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 19 22:26:27.509527 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:27.509527 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:27.509527 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:27.509527 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:27.509527 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:27.509527 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:27.509527 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:26:27.509527 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:26:27.509527 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 19 22:26:27.509527 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:27.512161 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d875168e-32f2-4ad8-8a90-d79565583467 tempest-FlavorsExtraSpecsTestJSON-23359928 tempest-FlavorsExtraSpecsTestJSON-23359928-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.045720 Jul 19 22:26:27.512161 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 232/445] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:26:27 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:26:27.513725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8667c185-d423-41e2-8496-5358a220e364 tempest-FlavorsAccessNegativeTestJSON-2048909862 tempest-FlavorsAccessNegativeTestJSON-2048909862-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:27.514918 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8667c185-d423-41e2-8496-5358a220e364 tempest-FlavorsAccessNegativeTestJSON-2048909862 tempest-FlavorsAccessNegativeTestJSON-2048909862-project] 10.222.0.25 "POST /compute/v2.1/flavors/1296636393/action" status: 403 len: 133 microversion: 2.1 time: 0.028523 Jul 19 22:26:27.533318 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 214/446] 10.222.0.25 () {60 vars in 1199 bytes} [Tue Jul 19 22:26:27 2022] POST /compute/v2.1/flavors/1296636393/action => generated 133 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:26:27.548837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-234066cb-568d-4bad-82c1-9968036baad3 tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "6024b5130104455f9af67c84c49f08ea"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:27.553786 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:27.553786 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:27.779256 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-234066cb-568d-4bad-82c1-9968036baad3 tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1296636393/action" status: 200 len: 21 microversion: 2.1 time: 0.243593 Jul 19 22:26:27.781846 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 233/447] 10.222.0.25 () {60 vars in 1199 bytes} [Tue Jul 19 22:26:27 2022] POST /compute/v2.1/flavors/1296636393/action => generated 21 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:26:27.791001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-99c4f653-10c0-4885-b7a1-a001924237da tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:27.796725 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:27.796725 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:27.836788 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-99c4f653-10c0-4885-b7a1-a001924237da tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1296636393" status: 202 len: 0 microversion: 2.1 time: 0.049417 Jul 19 22:26:27.841087 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 215/448] 10.222.0.25 () {58 vars in 1160 bytes} [Tue Jul 19 22:26:27 2022] DELETE /compute/v2.1/flavors/1296636393 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:26:27.848436 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-15b0072d-a948-48b9-93bf-55c9563eb272 tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:27.874318 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3855ab65-9c27-461f-887b-9473a9ceb9c4 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:27.875062 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3855ab65-9c27-461f-887b-9473a9ceb9c4 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:27.901300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3855ab65-9c27-461f-887b-9473a9ceb9c4 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:27.901763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3855ab65-9c27-461f-887b-9473a9ceb9c4 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:27.902561 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3855ab65-9c27-461f-887b-9473a9ceb9c4 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:27.902999 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3855ab65-9c27-461f-887b-9473a9ceb9c4 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:27.914057 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-15b0072d-a948-48b9-93bf-55c9563eb272 tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.071696 Jul 19 22:26:27.927816 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 234/449] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:26:27 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:27.937444 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7f045d1d-17bb-41e9-824a-cef85a38d7ab tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-758893973", "id": 975050487, "os-flavor-access:is_public": "False"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:27.940148 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:27.940148 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:27.978027 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7f045d1d-17bb-41e9-824a-cef85a38d7ab tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.047229 Jul 19 22:26:27.988361 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 235/450] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:26:27 2022] POST /compute/v2.1/flavors => generated 435 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:27.997544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a73e4a6e-3220-4bdb-9ae0-1b029526b718 tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e0fd28f8930341e9a759332c109fac3b"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:28.353061 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3855ab65-9c27-461f-887b-9473a9ceb9c4 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:28.374191 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3855ab65-9c27-461f-887b-9473a9ceb9c4 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 200 len: 1311 microversion: 2.1 time: 0.504852 Jul 19 22:26:28.374777 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 216/451] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:27 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 1311 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:26:28.379922 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-829af7e2-3e86-4f33-9bcf-1341645265f8 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:28.400265 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-829af7e2-3e86-4f33-9bcf-1341645265f8 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: 04279b5f-973f-463f-9bdc-29eab24edeb2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:28.414792 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-a73e4a6e-3220-4bdb-9ae0-1b029526b718 tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] HTTP exception thrown: Flavor access not found for 37 / e0fd28f8930341e9a759332c109fac3b combination. Jul 19 22:26:28.418900 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a73e4a6e-3220-4bdb-9ae0-1b029526b718 tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Request method failure captured: Jul 19 22:26:28.418900 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/flavors/975050487/action HTTP/1.1 Jul 19 22:26:28.418900 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:26:28.418900 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:26:28.418900 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:26:28.418900 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 70 Jul 19 22:26:28.418900 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:26:28.418900 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:26:28.418900 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:26:28.418900 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:28.418900 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y-IVjK0GBlozK-VLIOKQBMr-frMvSVgMrNoJHywGuy_5nxeyxrCrMt-VStlAKMkKffIxupee-KwE0Cg52-pcU_kAAuworTB2Be0w-L5_SqetKTE9s_CO5ZTpqCyYSFAI1jghCqTb81sxJuQA1aKVUa9LWOR2G9AyFSxsflbTLwIaKo Jul 19 22:26:28.418900 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:26:28.418900 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:26:28.418900 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:26:28.418900 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:26:28.418900 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:26:28.418900 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:26:28.418900 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: c241e66ac93b4363a65e820da2f5d646 Jul 19 22:26:28.418900 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-918820361 Jul 19 22:26:28.418900 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:26:28.418900 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:26:28.420429 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c241e66ac93b4363a65e820da2f5d646"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c241e66ac93b4363a65e820da2f5d646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c241e66ac93b4363a65e820da2f5d646"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c241e66ac93b4363a65e820da2f5d646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:28.420429 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-918820361 Jul 19 22:26:28.420429 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: c241e66ac93b4363a65e820da2f5d646 Jul 19 22:26:28.420429 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-918820361 Jul 19 22:26:28.420429 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin Jul 19 22:26:28.420429 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:26:28.420429 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:26:28.420429 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: e273f2032cf74d848a9ac336e977a1b1 Jul 19 22:26:28.420429 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin Jul 19 22:26:28.420429 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:26:28.420429 n-d-847009-3 devstack@n-api.service[119337]: {"removeTenantAccess": {"tenant": "e0fd28f8930341e9a759332c109fac3b"}} Jul 19 22:26:28.420429 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:26:28.421246 n-d-847009-3 devstack@n-api.service[119337]: exception: Flavor access not found for 37 / e0fd28f8930341e9a759332c109fac3b combination. Jul 19 22:26:28.421246 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '975050487', 'body': {'removeTenantAccess': {'tenant': 'e0fd28f8930341e9a759332c109fac3b'}}} Jul 19 22:26:28.421246 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:28.421246 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:28.421246 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 19 22:26:28.421246 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 19 22:26:28.421246 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 19 22:26:28.421246 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 19 22:26:28.421246 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 19 22:26:28.421246 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 19 22:26:28.421246 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 19 22:26:28.421246 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 19 22:26:28.421246 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 19 22:26:28.421246 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 19 22:26:28.421246 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 22:26:28.421246 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 22:26:28.421246 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 19 22:26:28.421246 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 19 22:26:28.422590 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 37 / e0fd28f8930341e9a759332c109fac3b combination. Jul 19 22:26:28.422590 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:28.422590 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:28.422590 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:28.422590 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:28.422590 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:28.422590 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:28.422590 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:28.422590 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:28.422590 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:28.422590 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:28.422590 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:26:28.422590 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:26:28.422590 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 19 22:26:28.422590 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:26:28.422590 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 37 / e0fd28f8930341e9a759332c109fac3b combination. Jul 19 22:26:28.422590 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:28.422590 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:28.422590 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:28.422590 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:28.423923 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:28.423923 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:28.423923 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:26:28.423923 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:26:28.423923 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 37 / e0fd28f8930341e9a759332c109fac3b combination. Jul 19 22:26:28.423923 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:28.426269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-829af7e2-3e86-4f33-9bcf-1341645265f8 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:28.426576 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a73e4a6e-3220-4bdb-9ae0-1b029526b718 tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Returning 404 to user: Flavor access not found for 37 / e0fd28f8930341e9a759332c109fac3b combination. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:28.427090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-829af7e2-3e86-4f33-9bcf-1341645265f8 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:28.427911 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a73e4a6e-3220-4bdb-9ae0-1b029526b718 tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/975050487/action" status: 404 len: 124 microversion: 2.1 time: 0.438290 Jul 19 22:26:28.433456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-829af7e2-3e86-4f33-9bcf-1341645265f8 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:28.433456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-829af7e2-3e86-4f33-9bcf-1341645265f8 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:28.433828 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 236/452] 10.222.0.25 () {60 vars in 1196 bytes} [Tue Jul 19 22:26:27 2022] POST /compute/v2.1/flavors/975050487/action => generated 124 bytes in 442 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:26:28.445634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3c0d6ca4-c5b7-497d-93fe-5158f74a2f66 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:28.446387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3c0d6ca4-c5b7-497d-93fe-5158f74a2f66 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:28.475143 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c0d6ca4-c5b7-497d-93fe-5158f74a2f66 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:28.480458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c0d6ca4-c5b7-497d-93fe-5158f74a2f66 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:28.481893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c0d6ca4-c5b7-497d-93fe-5158f74a2f66 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:28.482708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c0d6ca4-c5b7-497d-93fe-5158f74a2f66 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:28.535373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:26:28.916685 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3c0d6ca4-c5b7-497d-93fe-5158f74a2f66 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:28.942788 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3c0d6ca4-c5b7-497d-93fe-5158f74a2f66 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1474 microversion: 2.1 time: 0.505046 Jul 19 22:26:28.949680 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 237/453] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:28 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1474 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:28.982507 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6e6628dc-222b-43d9-86e9-511579630b2e tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:28.988826 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:28.988826 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:29.052777 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6e6628dc-222b-43d9-86e9-511579630b2e tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/975050487" status: 202 len: 0 microversion: 2.1 time: 0.099695 Jul 19 22:26:29.057404 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 238/454] 10.222.0.25 () {58 vars in 1157 bytes} [Tue Jul 19 22:26:28 2022] DELETE /compute/v2.1/flavors/975050487 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:26:29.074301 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ac00716e-6270-44b4-b724-ff8729c0613d tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:29.133188 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ac00716e-6270-44b4-b724-ff8729c0613d tempest-FlavorsAccessNegativeTestJSON-918820361 tempest-FlavorsAccessNegativeTestJSON-918820361-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.073873 Jul 19 22:26:29.154219 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 239/455] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:26:29 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:29.275839 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-829af7e2-3e86-4f33-9bcf-1341645265f8 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:29.291786 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-829af7e2-3e86-4f33-9bcf-1341645265f8 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2" status: 200 len: 1466 microversion: 2.1 time: 0.912329 Jul 19 22:26:29.293648 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 217/456] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:28 2022] GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2 => generated 1466 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:29.396099 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-be44beef-cf62-46c6-84c7-76e9d3701ccc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:29.397013 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-be44beef-cf62-46c6-84c7-76e9d3701ccc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:29.411678 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be44beef-cf62-46c6-84c7-76e9d3701ccc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:29.415206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be44beef-cf62-46c6-84c7-76e9d3701ccc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:29.416532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be44beef-cf62-46c6-84c7-76e9d3701ccc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:29.423018 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be44beef-cf62-46c6-84c7-76e9d3701ccc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:29.952417 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-be44beef-cf62-46c6-84c7-76e9d3701ccc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:29.973770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bcb53b4b-9170-4ca8-a617-ad19d0f3ed9a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:29.974364 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-be44beef-cf62-46c6-84c7-76e9d3701ccc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 200 len: 1311 microversion: 2.1 time: 0.583222 Jul 19 22:26:29.975194 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bcb53b4b-9170-4ca8-a617-ad19d0f3ed9a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:29.989826 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 240/457] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:29 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 1311 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:29.998866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bcb53b4b-9170-4ca8-a617-ad19d0f3ed9a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:29.999993 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bcb53b4b-9170-4ca8-a617-ad19d0f3ed9a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:30.002288 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bcb53b4b-9170-4ca8-a617-ad19d0f3ed9a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:30.005951 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bcb53b4b-9170-4ca8-a617-ad19d0f3ed9a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:30.320611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4ef69388-22b1-4d39-bd33-2aee4b2941ff tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:30.321301 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4ef69388-22b1-4d39-bd33-2aee4b2941ff tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: 04279b5f-973f-463f-9bdc-29eab24edeb2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:30.336715 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ef69388-22b1-4d39-bd33-2aee4b2941ff tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:30.336982 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ef69388-22b1-4d39-bd33-2aee4b2941ff tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:30.357952 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ef69388-22b1-4d39-bd33-2aee4b2941ff tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:30.361159 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ef69388-22b1-4d39-bd33-2aee4b2941ff tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:30.540907 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bcb53b4b-9170-4ca8-a617-ad19d0f3ed9a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:30.591291 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bcb53b4b-9170-4ca8-a617-ad19d0f3ed9a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1471 microversion: 2.1 time: 0.618492 Jul 19 22:26:30.591983 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 218/458] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:29 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1471 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:30.618054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-191e258c-2e77-40a7-bbdd-728064e39bac req-72ce903e-6233-4c66-9fd2-ab72591ceedd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04279b5f-973f-463f-9bdc-29eab24edeb2", "name": "network-vif-deleted", "tag": "1c896c40-d9ec-432a-a0c2-e37479954f2a"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:30.637408 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-191e258c-2e77-40a7-bbdd-728064e39bac req-72ce903e-6233-4c66-9fd2-ab72591ceedd service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:30.637846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-191e258c-2e77-40a7-bbdd-728064e39bac req-72ce903e-6233-4c66-9fd2-ab72591ceedd service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:30.671228 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-191e258c-2e77-40a7-bbdd-728064e39bac req-72ce903e-6233-4c66-9fd2-ab72591ceedd service nova] Creating event network-vif-deleted:1c896c40-d9ec-432a-a0c2-e37479954f2a for instance 04279b5f-973f-463f-9bdc-29eab24edeb2 on n-h1-847009-3 Jul 19 22:26:30.689429 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-191e258c-2e77-40a7-bbdd-728064e39bac req-72ce903e-6233-4c66-9fd2-ab72591ceedd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087500 Jul 19 22:26:30.694763 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 219/459] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:30.709557 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4ef69388-22b1-4d39-bd33-2aee4b2941ff tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:30.712390 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e2c8215b-162f-4c6e-be32-7daaf6bf1d22 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:30.713043 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e2c8215b-162f-4c6e-be32-7daaf6bf1d22 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:30.725603 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2c8215b-162f-4c6e-be32-7daaf6bf1d22 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:30.728106 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2c8215b-162f-4c6e-be32-7daaf6bf1d22 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:30.729511 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2c8215b-162f-4c6e-be32-7daaf6bf1d22 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:30.730072 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2c8215b-162f-4c6e-be32-7daaf6bf1d22 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:30.742736 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4ef69388-22b1-4d39-bd33-2aee4b2941ff tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2" status: 200 len: 1295 microversion: 2.1 time: 0.426756 Jul 19 22:26:30.748689 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 241/460] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:30 2022] GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2 => generated 1295 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:30.985297 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e2c8215b-162f-4c6e-be32-7daaf6bf1d22 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "POST /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb/action" status: 204 len: 0 microversion: 2.1 time: 0.288512 Jul 19 22:26:30.996347 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-875e1787-59e9-43ba-ba33-ffe86c7b1dfe tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:30.997029 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-875e1787-59e9-43ba-ba33-ffe86c7b1dfe tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:31.000413 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 220/461] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:26:30 2022] POST /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb/action => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:26:31.008645 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-505f32bd-5d3a-44e3-ac32-e90eb601e9f8 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:31.009349 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-505f32bd-5d3a-44e3-ac32-e90eb601e9f8 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:31.015638 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-875e1787-59e9-43ba-ba33-ffe86c7b1dfe tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:31.016804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-875e1787-59e9-43ba-ba33-ffe86c7b1dfe tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:31.017970 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-875e1787-59e9-43ba-ba33-ffe86c7b1dfe tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:31.018402 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-875e1787-59e9-43ba-ba33-ffe86c7b1dfe tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:31.061262 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-505f32bd-5d3a-44e3-ac32-e90eb601e9f8 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:31.065372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-505f32bd-5d3a-44e3-ac32-e90eb601e9f8 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:31.066230 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-505f32bd-5d3a-44e3-ac32-e90eb601e9f8 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:31.070506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-505f32bd-5d3a-44e3-ac32-e90eb601e9f8 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:31.718111 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-875e1787-59e9-43ba-ba33-ffe86c7b1dfe tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:31.749182 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-875e1787-59e9-43ba-ba33-ffe86c7b1dfe tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1471 microversion: 2.1 time: 0.744658 Jul 19 22:26:31.751060 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 242/462] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:30 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1471 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:26:31.766540 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-505f32bd-5d3a-44e3-ac32-e90eb601e9f8 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:31.790055 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-93fbf727-b1c3-41a4-8c5f-f73e35e00bdb tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:31.803931 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-93fbf727-b1c3-41a4-8c5f-f73e35e00bdb tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: 04279b5f-973f-463f-9bdc-29eab24edeb2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:31.809355 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-505f32bd-5d3a-44e3-ac32-e90eb601e9f8 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 200 len: 1494 microversion: 2.1 time: 0.804918 Jul 19 22:26:31.819232 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 221/463] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:30 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 1494 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:31.841195 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-93fbf727-b1c3-41a4-8c5f-f73e35e00bdb tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:31.850891 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-93fbf727-b1c3-41a4-8c5f-f73e35e00bdb tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:31.855601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-93fbf727-b1c3-41a4-8c5f-f73e35e00bdb tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:31.857787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-93fbf727-b1c3-41a4-8c5f-f73e35e00bdb tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:31.892489 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-93fbf727-b1c3-41a4-8c5f-f73e35e00bdb tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] HTTP exception thrown: Instance 04279b5f-973f-463f-9bdc-29eab24edeb2 could not be found. Jul 19 22:26:31.896988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-93fbf727-b1c3-41a4-8c5f-f73e35e00bdb tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Request method failure captured: Jul 19 22:26:31.896988 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2 HTTP/1.1 Jul 19 22:26:31.896988 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:26:31.896988 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:26:31.896988 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:26:31.896988 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:26:31.896988 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:26:31.896988 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:26:31.896988 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:26:31.896988 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:31.896988 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y9Z-vbTVgKTjDVfKFiOIbA9rRZ4LTUOZL54khJFhaW6YwbSUt5urhUTdAdGE6SkdiqZcXfxltsF6SteaOfa1nFo3kWUDBSwAiW_-yslCxy0NA1Mb2YT1Ctiuw2oHyCk4rKRT_-CBmN8rOYxB8qK3aWoT6fXut_axIQy-YBQ6sp8WvI Jul 19 22:26:31.896988 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:26:31.896988 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:26:31.896988 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:26:31.896988 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:26:31.896988 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:26:31.896988 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:26:31.896988 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: cf9f0d3bd470463abf724fc6b043caac Jul 19 22:26:31.896988 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-LiveMigrationNegativeTest-1484579517 Jul 19 22:26:31.896988 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:26:31.896988 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:26:31.899713 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cf9f0d3bd470463abf724fc6b043caac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cf9f0d3bd470463abf724fc6b043caac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cf9f0d3bd470463abf724fc6b043caac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cf9f0d3bd470463abf724fc6b043caac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:31.899713 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-LiveMigrationNegativeTest-1484579517 Jul 19 22:26:31.899713 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: cf9f0d3bd470463abf724fc6b043caac Jul 19 22:26:31.899713 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1484579517 Jul 19 22:26:31.899713 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-LiveMigrationNegativeTest-1484579517-project Jul 19 22:26:31.899713 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:26:31.899713 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:26:31.899713 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 715c3a84a6f64cf485cadcc983e4dd77 Jul 19 22:26:31.899713 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-LiveMigrationNegativeTest-1484579517-project Jul 19 22:26:31.899713 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:26:31.899713 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 04279b5f-973f-463f-9bdc-29eab24edeb2 could not be found. Jul 19 22:26:31.899713 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '04279b5f-973f-463f-9bdc-29eab24edeb2'} Jul 19 22:26:31.901218 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:31.901218 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:31.901218 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:26:31.901218 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:26:31.901218 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:26:31.901218 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:26:31.901218 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:26:31.901218 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:26:31.901218 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:26:31.901218 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:26:31.901218 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04279b5f-973f-463f-9bdc-29eab24edeb2 could not be found. Jul 19 22:26:31.901218 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:31.901218 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:31.901218 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:31.901218 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:31.901218 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:31.901218 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:31.901218 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:31.901218 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:31.901218 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:31.903622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:31.903622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:26:31.903622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:26:31.903622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:26:31.903622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:26:31.903622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:26:31.903622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:26:31.903622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04279b5f-973f-463f-9bdc-29eab24edeb2 could not be found. Jul 19 22:26:31.903622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:31.903622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:31.903622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:31.903622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:31.903622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:31.903622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:31.903622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:26:31.903622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:26:31.903622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04279b5f-973f-463f-9bdc-29eab24edeb2 could not be found. Jul 19 22:26:31.903622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:31.907747 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-93fbf727-b1c3-41a4-8c5f-f73e35e00bdb tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Returning 404 to user: Instance 04279b5f-973f-463f-9bdc-29eab24edeb2 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:31.909438 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-93fbf727-b1c3-41a4-8c5f-f73e35e00bdb tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2" status: 404 len: 111 microversion: 2.1 time: 0.140573 Jul 19 22:26:31.910617 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 243/464] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:31 2022] GET /compute/v2.1/servers/04279b5f-973f-463f-9bdc-29eab24edeb2 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:26:31.927249 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e6e6c4c5-591f-4e34-89aa-6892ff553410 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:31.928413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e6e6c4c5-591f-4e34-89aa-6892ff553410 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: b5b01010-9fd2-4092-ad1d-29edac4ecaa4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:31.942351 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6e6c4c5-591f-4e34-89aa-6892ff553410 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:31.944948 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6e6c4c5-591f-4e34-89aa-6892ff553410 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:31.946675 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6e6c4c5-591f-4e34-89aa-6892ff553410 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:31.947674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6e6c4c5-591f-4e34-89aa-6892ff553410 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:32.034410 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e6e6c4c5-591f-4e34-89aa-6892ff553410 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: b5b01010-9fd2-4092-ad1d-29edac4ecaa4] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:26:32.244135 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e6e6c4c5-591f-4e34-89aa-6892ff553410 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4" status: 204 len: 0 microversion: 2.1 time: 0.325486 Jul 19 22:26:32.246295 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 244/465] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:26:31 2022] DELETE /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:26:32.259348 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6ca3a185-85be-498b-9526-bbf9ce4cac20 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:32.259612 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6ca3a185-85be-498b-9526-bbf9ce4cac20 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: b5b01010-9fd2-4092-ad1d-29edac4ecaa4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:32.269924 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6ca3a185-85be-498b-9526-bbf9ce4cac20 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:32.270458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6ca3a185-85be-498b-9526-bbf9ce4cac20 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:32.271365 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6ca3a185-85be-498b-9526-bbf9ce4cac20 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:32.271907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6ca3a185-85be-498b-9526-bbf9ce4cac20 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:32.554103 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-83b7ba35-b2d4-43bb-a7b4-93175806e98d tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:32.554903 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-83b7ba35-b2d4-43bb-a7b4-93175806e98d tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:32.572169 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-83b7ba35-b2d4-43bb-a7b4-93175806e98d tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:32.575552 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-83b7ba35-b2d4-43bb-a7b4-93175806e98d tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:32.578813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-83b7ba35-b2d4-43bb-a7b4-93175806e98d tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:32.579396 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-83b7ba35-b2d4-43bb-a7b4-93175806e98d tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:33.673008 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6ca3a185-85be-498b-9526-bbf9ce4cac20 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:33.708788 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6ca3a185-85be-498b-9526-bbf9ce4cac20 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4" status: 200 len: 1475 microversion: 2.1 time: 1.456044 Jul 19 22:26:33.717830 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 245/466] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:32 2022] GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4 => generated 1475 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:33.733339 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-566046fa-f92a-4655-b33e-d18b7bd5bb4a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:33.739048 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-566046fa-f92a-4655-b33e-d18b7bd5bb4a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:33.794961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-566046fa-f92a-4655-b33e-d18b7bd5bb4a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:33.795873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-566046fa-f92a-4655-b33e-d18b7bd5bb4a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:33.798141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-566046fa-f92a-4655-b33e-d18b7bd5bb4a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:33.798994 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-566046fa-f92a-4655-b33e-d18b7bd5bb4a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:33.992264 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-83b7ba35-b2d4-43bb-a7b4-93175806e98d tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 200 len: 1645 microversion: 2.1 time: 2.159670 Jul 19 22:26:34.007311 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 222/467] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:31 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 1645 bytes in 2176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:34.029719 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-00d01c8e-0b7a-42ca-9a29-b1957fee4d83 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:34.034276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-00d01c8e-0b7a-42ca-9a29-b1957fee4d83 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:34.057174 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00d01c8e-0b7a-42ca-9a29-b1957fee4d83 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:34.058703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00d01c8e-0b7a-42ca-9a29-b1957fee4d83 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:34.060585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00d01c8e-0b7a-42ca-9a29-b1957fee4d83 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:34.082055 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00d01c8e-0b7a-42ca-9a29-b1957fee4d83 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:34.174900 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-00d01c8e-0b7a-42ca-9a29-b1957fee4d83 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:26:34.301507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:26:34.447019 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-00d01c8e-0b7a-42ca-9a29-b1957fee4d83 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a" status: 204 len: 0 microversion: 2.1 time: 0.436503 Jul 19 22:26:34.456561 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 223/468] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:26:34 2022] DELETE /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:26:34.461835 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f12ea81f-6467-4c26-b424-df5750860f56 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:34.462548 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f12ea81f-6467-4c26-b424-df5750860f56 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:34.505044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f12ea81f-6467-4c26-b424-df5750860f56 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:34.505525 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f12ea81f-6467-4c26-b424-df5750860f56 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:34.513421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f12ea81f-6467-4c26-b424-df5750860f56 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:34.515055 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f12ea81f-6467-4c26-b424-df5750860f56 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:34.825689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-566046fa-f92a-4655-b33e-d18b7bd5bb4a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:34.843464 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-566046fa-f92a-4655-b33e-d18b7bd5bb4a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1471 microversion: 2.1 time: 1.118675 Jul 19 22:26:34.847097 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 246/469] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:33 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1471 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:34.875766 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-81d9a823-25c4-4c91-ae6b-b954a0256cae req-0c18fa0f-bfcb-4c6f-b624-fd76d814311e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18dfb53a-18ce-4ad5-a226-dff0410f00eb", "name": "network-vif-plugged", "status": "completed", "tag": "c7157193-94b5-4be3-a477-21afd3984d48"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:34.899321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-81d9a823-25c4-4c91-ae6b-b954a0256cae req-0c18fa0f-bfcb-4c6f-b624-fd76d814311e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:34.901707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-81d9a823-25c4-4c91-ae6b-b954a0256cae req-0c18fa0f-bfcb-4c6f-b624-fd76d814311e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:34.938257 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-81d9a823-25c4-4c91-ae6b-b954a0256cae req-0c18fa0f-bfcb-4c6f-b624-fd76d814311e service nova] Creating event network-vif-plugged:c7157193-94b5-4be3-a477-21afd3984d48 for instance 18dfb53a-18ce-4ad5-a226-dff0410f00eb on n-h2-847009-3 Jul 19 22:26:34.954280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [req-81d9a823-25c4-4c91-ae6b-b954a0256cae req-0c18fa0f-bfcb-4c6f-b624-fd76d814311e service nova] Instance 18dfb53a-18ce-4ad5-a226-dff0410f00eb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119337) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 22:26:34.976714 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-81d9a823-25c4-4c91-ae6b-b954a0256cae req-0c18fa0f-bfcb-4c6f-b624-fd76d814311e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125562 Jul 19 22:26:34.984013 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 247/470] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:35.003954 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-efa3e031-ff3b-4534-9e9c-3ed180a78b86 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:35.009202 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-efa3e031-ff3b-4534-9e9c-3ed180a78b86 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: b5b01010-9fd2-4092-ad1d-29edac4ecaa4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:35.038447 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-efa3e031-ff3b-4534-9e9c-3ed180a78b86 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:35.042382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-efa3e031-ff3b-4534-9e9c-3ed180a78b86 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:35.046772 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-efa3e031-ff3b-4534-9e9c-3ed180a78b86 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:35.047709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-efa3e031-ff3b-4534-9e9c-3ed180a78b86 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:35.053322 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f12ea81f-6467-4c26-b424-df5750860f56 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 200 len: 1645 microversion: 2.1 time: 0.591734 Jul 19 22:26:35.056306 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 224/471] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:34 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 1645 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:35.084450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-67a0a2b4-4da5-4bb6-a2ff-ba8354faf1d4 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-455649339", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "1091004659", "adminPass": "***", "networks": [{"uuid": "aa474abb-d615-457e-b8f9-e55f1cc03bb6"}], "security_groups": [{"name": "tempest-securitygroup--1089620621"}], "key_name": "tempest-keypair-750221889", "user_data": "}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:35.145824 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:26:35.345600 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-67a0a2b4-4da5-4bb6-a2ff-ba8354faf1d4 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] validate_networks() for [('aa474abb-d615-457e-b8f9-e55f1cc03bb6', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:26:35.750696 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-efa3e031-ff3b-4534-9e9c-3ed180a78b86 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715c3a84a6f64cf485cadcc983e4dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9f0d3bd470463abf724fc6b043caac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:35.765133 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-efa3e031-ff3b-4534-9e9c-3ed180a78b86 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4" status: 200 len: 1475 microversion: 2.1 time: 0.779386 Jul 19 22:26:35.785273 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 248/472] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:34 2022] GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4 => generated 1475 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:35.785273 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5cf42e03-40fb-4bef-ab27-e71367836f59 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:35.785273 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:35.785273 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:35.788578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5cf42e03-40fb-4bef-ab27-e71367836f59 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:35.805055 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5cf42e03-40fb-4bef-ab27-e71367836f59 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:35.806168 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5cf42e03-40fb-4bef-ab27-e71367836f59 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:35.806725 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5cf42e03-40fb-4bef-ab27-e71367836f59 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:35.841270 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5cf42e03-40fb-4bef-ab27-e71367836f59 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.065881 Jul 19 22:26:35.842650 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 249/473] 10.222.0.25 () {58 vars in 1175 bytes} [Tue Jul 19 22:26:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:35.849096 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-b4310e0f-9d86-4035-b045-01aefdb18d2f req-c6151924-5f45-4fc6-8ffd-ad45e0c4bcd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b01010-9fd2-4092-ad1d-29edac4ecaa4", "name": "network-vif-deleted", "tag": "af2c8e0c-cf95-4771-afa6-6ab97dd37a99"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:35.861117 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b4310e0f-9d86-4035-b045-01aefdb18d2f req-c6151924-5f45-4fc6-8ffd-ad45e0c4bcd0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:35.861998 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b4310e0f-9d86-4035-b045-01aefdb18d2f req-c6151924-5f45-4fc6-8ffd-ad45e0c4bcd0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:35.876145 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-b4310e0f-9d86-4035-b045-01aefdb18d2f req-c6151924-5f45-4fc6-8ffd-ad45e0c4bcd0 service nova] Creating event network-vif-deleted:af2c8e0c-cf95-4771-afa6-6ab97dd37a99 for instance b5b01010-9fd2-4092-ad1d-29edac4ecaa4 on n-h2-847009-3 Jul 19 22:26:35.897561 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-b4310e0f-9d86-4035-b045-01aefdb18d2f req-c6151924-5f45-4fc6-8ffd-ad45e0c4bcd0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051336 Jul 19 22:26:35.900133 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 250/474] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:35.912702 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-effc37a1-15d2-48c0-8833-ffa7225becd2 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-847009-3", "block_migration": true, "disk_over_commit": false}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:35.920215 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-effc37a1-15d2-48c0-8833-ffa7225becd2 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:35.944993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-effc37a1-15d2-48c0-8833-ffa7225becd2 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:35.949090 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-effc37a1-15d2-48c0-8833-ffa7225becd2 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:35.952569 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-effc37a1-15d2-48c0-8833-ffa7225becd2 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:35.958440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-effc37a1-15d2-48c0-8833-ffa7225becd2 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:36.003984 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-effc37a1-15d2-48c0-8833-ffa7225becd2 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lazy-loading 'flavor' on Instance uuid 6dc2efca-6346-4a22-999b-5a1fa57dcee9 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:26:36.052322 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-effc37a1-15d2-48c0-8833-ffa7225becd2 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Going to try to live migrate instance to n-h1-847009-3 {{(pid=119337) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 22:26:37.954260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-67a0a2b4-4da5-4bb6-a2ff-ba8354faf1d4 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:26:37.954842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-67a0a2b4-4da5-4bb6-a2ff-ba8354faf1d4 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:26:37.955180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-67a0a2b4-4da5-4bb6-a2ff-ba8354faf1d4 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:26:37.955600 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-67a0a2b4-4da5-4bb6-a2ff-ba8354faf1d4 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:26:37.956201 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-67a0a2b4-4da5-4bb6-a2ff-ba8354faf1d4 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:26:37.978362 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67a0a2b4-4da5-4bb6-a2ff-ba8354faf1d4 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:37.985915 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67a0a2b4-4da5-4bb6-a2ff-ba8354faf1d4 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:37.987093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67a0a2b4-4da5-4bb6-a2ff-ba8354faf1d4 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:37.989214 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67a0a2b4-4da5-4bb6-a2ff-ba8354faf1d4 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:38.052877 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-67a0a2b4-4da5-4bb6-a2ff-ba8354faf1d4 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Getting quotas for project dbc98e9ff0b84256bf722b6ca82f76c1. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:26:38.065620 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-67a0a2b4-4da5-4bb6-a2ff-ba8354faf1d4 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Getting quotas for user d9580b63c415471a8faa6b536f9c44fb and project dbc98e9ff0b84256bf722b6ca82f76c1. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:26:38.105767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-67a0a2b4-4da5-4bb6-a2ff-ba8354faf1d4 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:26:38.108354 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-67a0a2b4-4da5-4bb6-a2ff-ba8354faf1d4 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:26:38.218760 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-67a0a2b4-4da5-4bb6-a2ff-ba8354faf1d4 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.161270 Jul 19 22:26:38.228055 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 225/475] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:26:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 3167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:26:38.237699 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-529359fb-3ca7-487e-b5d3-e78d7e19b7cd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:38.239079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-529359fb-3ca7-487e-b5d3-e78d7e19b7cd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:38.242132 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:RELEASE=2,nova_api:SAVEPOINT=1,nova_api:SELECT=82,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=7 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:26:38.256272 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-529359fb-3ca7-487e-b5d3-e78d7e19b7cd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:38.266832 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-529359fb-3ca7-487e-b5d3-e78d7e19b7cd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:38.269760 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-529359fb-3ca7-487e-b5d3-e78d7e19b7cd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:38.273894 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-529359fb-3ca7-487e-b5d3-e78d7e19b7cd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:39.600427 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-529359fb-3ca7-487e-b5d3-e78d7e19b7cd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:39.609127 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-529359fb-3ca7-487e-b5d3-e78d7e19b7cd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1463 microversion: 2.1 time: 1.379782 Jul 19 22:26:39.623589 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 226/476] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:38 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1463 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:39.647165 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2e44df36-543e-4de0-aeb1-c9e61d778397 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:39.648220 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2e44df36-543e-4de0-aeb1-c9e61d778397 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] [instance: b5b01010-9fd2-4092-ad1d-29edac4ecaa4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:39.669913 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2e44df36-543e-4de0-aeb1-c9e61d778397 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:39.672270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2e44df36-543e-4de0-aeb1-c9e61d778397 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:39.674387 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2e44df36-543e-4de0-aeb1-c9e61d778397 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:39.677708 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2e44df36-543e-4de0-aeb1-c9e61d778397 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:39.723926 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-2e44df36-543e-4de0-aeb1-c9e61d778397 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] HTTP exception thrown: Instance b5b01010-9fd2-4092-ad1d-29edac4ecaa4 could not be found. Jul 19 22:26:39.733859 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2e44df36-543e-4de0-aeb1-c9e61d778397 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Request method failure captured: Jul 19 22:26:39.733859 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4 HTTP/1.1 Jul 19 22:26:39.733859 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:26:39.733859 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:26:39.733859 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:26:39.733859 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:26:39.733859 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:26:39.733859 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:26:39.733859 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:26:39.733859 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:39.733859 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y9Z-vbTVgKTjDVfKFiOIbA9rRZ4LTUOZL54khJFhaW6YwbSUt5urhUTdAdGE6SkdiqZcXfxltsF6SteaOfa1nFo3kWUDBSwAiW_-yslCxy0NA1Mb2YT1Ctiuw2oHyCk4rKRT_-CBmN8rOYxB8qK3aWoT6fXut_axIQy-YBQ6sp8WvI Jul 19 22:26:39.733859 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:26:39.733859 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:26:39.733859 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:26:39.733859 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:26:39.733859 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:26:39.733859 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:26:39.733859 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: cf9f0d3bd470463abf724fc6b043caac Jul 19 22:26:39.733859 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-LiveMigrationNegativeTest-1484579517 Jul 19 22:26:39.733859 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:26:39.733859 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:26:39.736002 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cf9f0d3bd470463abf724fc6b043caac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cf9f0d3bd470463abf724fc6b043caac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cf9f0d3bd470463abf724fc6b043caac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cf9f0d3bd470463abf724fc6b043caac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:39.736002 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-LiveMigrationNegativeTest-1484579517 Jul 19 22:26:39.736002 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: cf9f0d3bd470463abf724fc6b043caac Jul 19 22:26:39.736002 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1484579517 Jul 19 22:26:39.736002 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-LiveMigrationNegativeTest-1484579517-project Jul 19 22:26:39.736002 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:26:39.736002 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:26:39.736002 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 715c3a84a6f64cf485cadcc983e4dd77 Jul 19 22:26:39.736002 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-LiveMigrationNegativeTest-1484579517-project Jul 19 22:26:39.736002 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:26:39.736002 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance b5b01010-9fd2-4092-ad1d-29edac4ecaa4 could not be found. Jul 19 22:26:39.736002 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'b5b01010-9fd2-4092-ad1d-29edac4ecaa4'} Jul 19 22:26:39.736932 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:39.736932 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:39.736932 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:26:39.736932 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:26:39.736932 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:26:39.736932 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:26:39.736932 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:26:39.736932 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:26:39.736932 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:26:39.736932 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:26:39.736932 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5b01010-9fd2-4092-ad1d-29edac4ecaa4 could not be found. Jul 19 22:26:39.736932 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:39.736932 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:39.736932 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:39.736932 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:39.736932 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:39.736932 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:39.736932 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:39.736932 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:39.736932 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:39.738324 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:39.738324 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:26:39.738324 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:26:39.738324 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:26:39.738324 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:26:39.738324 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:26:39.738324 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:26:39.738324 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5b01010-9fd2-4092-ad1d-29edac4ecaa4 could not be found. Jul 19 22:26:39.738324 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:39.738324 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:39.738324 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:39.738324 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:39.738324 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:39.738324 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:39.738324 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:26:39.738324 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:26:39.738324 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5b01010-9fd2-4092-ad1d-29edac4ecaa4 could not be found. Jul 19 22:26:39.738324 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:39.740151 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2e44df36-543e-4de0-aeb1-c9e61d778397 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] Returning 404 to user: Instance b5b01010-9fd2-4092-ad1d-29edac4ecaa4 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:39.741987 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2e44df36-543e-4de0-aeb1-c9e61d778397 tempest-LiveMigrationNegativeTest-1484579517 tempest-LiveMigrationNegativeTest-1484579517-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4" status: 404 len: 111 microversion: 2.1 time: 0.114841 Jul 19 22:26:39.743372 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 227/477] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:39 2022] GET /compute/v2.1/servers/b5b01010-9fd2-4092-ad1d-29edac4ecaa4 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:26:40.735936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-77dac0af-8ff9-4307-b2df-184e24b313c7 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Calling method '.version_select at 0x7f7a109f0b80>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:40.738422 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:40.738422 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:40.740230 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-77dac0af-8ff9-4307-b2df-184e24b313c7 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:40.740957 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-77dac0af-8ff9-4307-b2df-184e24b313c7 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:40.743917 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-77dac0af-8ff9-4307-b2df-184e24b313c7 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:40.750985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-77dac0af-8ff9-4307-b2df-184e24b313c7 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:40.866764 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-77dac0af-8ff9-4307-b2df-184e24b313c7 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 1.119251 Jul 19 22:26:40.879224 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 228/478] 10.222.0.25 () {58 vars in 1127 bytes} [Tue Jul 19 22:26:39 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:40.893582 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1b59ad0f-1e48-47b5-97ec-0707d68150d2 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:40.901188 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1b59ad0f-1e48-47b5-97ec-0707d68150d2 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:40.937196 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b59ad0f-1e48-47b5-97ec-0707d68150d2 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:40.943216 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b59ad0f-1e48-47b5-97ec-0707d68150d2 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:40.945734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b59ad0f-1e48-47b5-97ec-0707d68150d2 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:40.951224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b59ad0f-1e48-47b5-97ec-0707d68150d2 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:41.175077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1b59ad0f-1e48-47b5-97ec-0707d68150d2 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:41.192037 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1b59ad0f-1e48-47b5-97ec-0707d68150d2 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3" status: 200 len: 1323 microversion: 2.1 time: 0.309798 Jul 19 22:26:41.194271 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 229/479] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:40 2022] GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 => generated 1323 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:41.224183 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dc83f889-a7a0-4c3d-855d-6eb6d31f97af tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:41.224826 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dc83f889-a7a0-4c3d-855d-6eb6d31f97af tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:41.293386 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dc83f889-a7a0-4c3d-855d-6eb6d31f97af tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:41.296520 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dc83f889-a7a0-4c3d-855d-6eb6d31f97af tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:41.298567 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dc83f889-a7a0-4c3d-855d-6eb6d31f97af tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:41.299404 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dc83f889-a7a0-4c3d-855d-6eb6d31f97af tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:42.454977 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dc83f889-a7a0-4c3d-855d-6eb6d31f97af tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1614 microversion: 2.1 time: 1.254100 Jul 19 22:26:42.471279 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 230/480] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:41 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1614 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:42.478984 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-bdbff933-20d8-41d0-a31b-bc97b7240743 req-12a46e6e-f474-45af-ae67-08d92ec9a097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a", "name": "network-vif-deleted", "tag": "466d0f1d-6d97-46a8-ab3c-6441661159ed"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:42.511973 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-bdbff933-20d8-41d0-a31b-bc97b7240743 req-12a46e6e-f474-45af-ae67-08d92ec9a097 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:42.512859 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-bdbff933-20d8-41d0-a31b-bc97b7240743 req-12a46e6e-f474-45af-ae67-08d92ec9a097 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:42.553977 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-bdbff933-20d8-41d0-a31b-bc97b7240743 req-12a46e6e-f474-45af-ae67-08d92ec9a097 service nova] Creating event network-vif-deleted:466d0f1d-6d97-46a8-ab3c-6441661159ed for instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a on n-h1-847009-3 Jul 19 22:26:42.565275 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-bdbff933-20d8-41d0-a31b-bc97b7240743 req-12a46e6e-f474-45af-ae67-08d92ec9a097 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098532 Jul 19 22:26:42.566210 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 231/481] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:43.298714 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-01bad23d-64fc-463f-8877-de97760a29f1 tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] Calling method '.version_select at 0x7f7a10f26790>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:43.300619 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:43.300619 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:43.302153 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-01bad23d-64fc-463f-8877-de97760a29f1 tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '8426cecbcfed4ad4995b2ef2f407277f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fe902f6ed645a099e963946da2783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:43.318754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-01bad23d-64fc-463f-8877-de97760a29f1 tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] Request method failure captured: Jul 19 22:26:43.318754 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 19 22:26:43.318754 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:26:43.318754 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:26:43.318754 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:26:43.318754 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:26:43.318754 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:26:43.318754 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:26:43.318754 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:26:43.318754 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:43.318754 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y-bXipjRIzo7yvAU6kr-ZZ-k9aSgE1uSyPldulNVP-KyRio8UkdQYOB7nzsrTULs6rzbhPX55kdnFcGuztQ5q770bVuV5QqmsNJ0iAhJOrwTmooGHk-lEKPUT40oH9tTzf6o77DUFaZX2v7XdNULAdbJv-WPZO9kKcaxgiJJwvkXVA Jul 19 22:26:43.318754 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:26:43.318754 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:26:43.318754 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:26:43.318754 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:26:43.318754 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:26:43.318754 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:26:43.318754 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: d5fe902f6ed645a099e963946da2783e Jul 19 22:26:43.318754 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1318394948 Jul 19 22:26:43.318754 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:26:43.318754 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:26:43.320136 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d5fe902f6ed645a099e963946da2783e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5fe902f6ed645a099e963946da2783e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d5fe902f6ed645a099e963946da2783e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5fe902f6ed645a099e963946da2783e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:43.320136 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1318394948 Jul 19 22:26:43.320136 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: d5fe902f6ed645a099e963946da2783e Jul 19 22:26:43.320136 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1318394948 Jul 19 22:26:43.320136 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-HostsAdminNegativeTestJSON-1318394948-project Jul 19 22:26:43.320136 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:26:43.320136 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:26:43.320136 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 8426cecbcfed4ad4995b2ef2f407277f Jul 19 22:26:43.320136 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1318394948-project Jul 19 22:26:43.320136 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:26:43.320136 n-d-847009-3 devstack@n-api.service[119338]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 19 22:26:43.320136 n-d-847009-3 devstack@n-api.service[119338]: action_args: {} Jul 19 22:26:43.320136 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:43.321018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:43.321018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:43.321018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:43.321018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:43.321018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:43.321018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:26:43.321018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:26:43.321018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 22:26:43.321018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:26:43.321018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:43.321018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:43.321018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 19 22:26:43.321018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 19 22:26:43.321018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:26:43.321018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:26:43.321018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:26:43.321018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:26:43.321018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:26:43.321018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:26:43.322101 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:26:43.322101 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:26:43.322101 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:26:43.322101 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:26:43.322101 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:26:43.322101 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:26:43.322101 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:26:43.322101 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:26:43.322101 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 19 22:26:43.322101 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:43.322101 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:43.322101 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:43.322101 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:43.322101 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:43.322101 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:43.322101 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:26:43.322101 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:26:43.322101 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 19 22:26:43.322101 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:43.324888 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-01bad23d-64fc-463f-8877-de97760a29f1 tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:43.326031 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-01bad23d-64fc-463f-8877-de97760a29f1 tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.758517 Jul 19 22:26:43.327409 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 232/482] 10.222.0.25 () {58 vars in 1127 bytes} [Tue Jul 19 22:26:42 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 760 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:26:43.337716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c4c22da1-216f-4800-9d66-6b65e2a78f2d tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:43.338801 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c4c22da1-216f-4800-9d66-6b65e2a78f2d tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:43.351348 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4c22da1-216f-4800-9d66-6b65e2a78f2d tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:43.352168 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4c22da1-216f-4800-9d66-6b65e2a78f2d tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:43.353438 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4c22da1-216f-4800-9d66-6b65e2a78f2d tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:43.354960 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4c22da1-216f-4800-9d66-6b65e2a78f2d tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:43.854786 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c4c22da1-216f-4800-9d66-6b65e2a78f2d tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:43.865255 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c4c22da1-216f-4800-9d66-6b65e2a78f2d tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3" status: 200 len: 1321 microversion: 2.1 time: 0.536231 Jul 19 22:26:43.873128 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 233/483] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:43 2022] GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 => generated 1321 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:43.878549 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6cce10ae-87f6-4201-a430-6dc628f6d13e tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Calling method '.version_select at 0x7f7a109f08b0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:43.892518 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6cce10ae-87f6-4201-a430-6dc628f6d13e tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:43.907789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6cce10ae-87f6-4201-a430-6dc628f6d13e tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:43.927471 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6cce10ae-87f6-4201-a430-6dc628f6d13e tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 746 microversion: 2.1 time: 0.052554 Jul 19 22:26:43.958692 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 234/484] 10.222.0.25 () {58 vars in 1142 bytes} [Tue Jul 19 22:26:43 2022] GET /compute/v2.1/os-migrations => generated 746 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:43.971975 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1ad4fb9a-044a-4562-9816-fdb0256227a4 tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] Calling method '.version_select at 0x7f7a109f0550>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:43.983827 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:43.983827 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:43.987536 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1ad4fb9a-044a-4562-9816-fdb0256227a4 tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '8426cecbcfed4ad4995b2ef2f407277f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fe902f6ed645a099e963946da2783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:43.989419 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1ad4fb9a-044a-4562-9816-fdb0256227a4 tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] Request method failure captured: Jul 19 22:26:43.989419 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/os-hosts/n-d-847009-3/reboot HTTP/1.1 Jul 19 22:26:43.989419 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:26:43.989419 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:26:43.989419 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:26:43.989419 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:26:43.989419 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:26:43.989419 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:26:43.989419 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:26:43.989419 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:43.989419 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y-bXipjRIzo7yvAU6kr-ZZ-k9aSgE1uSyPldulNVP-KyRio8UkdQYOB7nzsrTULs6rzbhPX55kdnFcGuztQ5q770bVuV5QqmsNJ0iAhJOrwTmooGHk-lEKPUT40oH9tTzf6o77DUFaZX2v7XdNULAdbJv-WPZO9kKcaxgiJJwvkXVA Jul 19 22:26:43.989419 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:26:43.989419 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:26:43.989419 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:26:43.989419 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:26:43.989419 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:26:43.989419 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:26:43.989419 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: d5fe902f6ed645a099e963946da2783e Jul 19 22:26:43.989419 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1318394948 Jul 19 22:26:43.989419 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:26:43.989419 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:26:43.990696 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d5fe902f6ed645a099e963946da2783e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5fe902f6ed645a099e963946da2783e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d5fe902f6ed645a099e963946da2783e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5fe902f6ed645a099e963946da2783e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:43.990696 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1318394948 Jul 19 22:26:43.990696 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: d5fe902f6ed645a099e963946da2783e Jul 19 22:26:43.990696 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1318394948 Jul 19 22:26:43.990696 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-HostsAdminNegativeTestJSON-1318394948-project Jul 19 22:26:43.990696 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:26:43.990696 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:26:43.990696 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 8426cecbcfed4ad4995b2ef2f407277f Jul 19 22:26:43.990696 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1318394948-project Jul 19 22:26:43.990696 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:26:43.990696 n-d-847009-3 devstack@n-api.service[119338]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 19 22:26:43.990696 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'n-d-847009-3'} Jul 19 22:26:43.990696 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:43.991430 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:43.991430 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:43.991430 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:43.991430 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:43.991430 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:43.991430 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:26:43.991430 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:26:43.991430 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:43.991430 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:43.991430 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 19 22:26:43.991430 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 19 22:26:43.991430 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:26:43.991430 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:26:43.991430 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:26:43.991430 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:26:43.991430 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:26:43.991430 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:26:43.991430 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:26:43.991430 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:26:43.992450 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:26:43.992450 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:26:43.992450 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:26:43.992450 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:26:43.992450 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:26:43.992450 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:26:43.992450 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 19 22:26:43.992450 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:43.992450 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:43.992450 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:43.992450 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:43.992450 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:43.992450 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:43.992450 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:26:43.992450 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:26:43.992450 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 19 22:26:43.992450 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:43.996255 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1ad4fb9a-044a-4562-9816-fdb0256227a4 tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:43.997838 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1ad4fb9a-044a-4562-9816-fdb0256227a4 tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-847009-3/reboot" status: 403 len: 111 microversion: 2.1 time: 0.037807 Jul 19 22:26:44.000344 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 235/485] 10.222.0.25 () {58 vars in 1187 bytes} [Tue Jul 19 22:26:43 2022] GET /compute/v2.1/os-hosts/n-d-847009-3/reboot => generated 111 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:26:44.377343 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e315f754-8af4-401b-a157-f32b1b61c433 tempest-FlavorsV255TestJSON-892955961 tempest-FlavorsV255TestJSON-892955961-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-51291174", "id": 1107863960, "os-flavor-access:is_public": "True"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:44.382414 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:44.382414 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:44.418599 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e315f754-8af4-401b-a157-f32b1b61c433 tempest-FlavorsV255TestJSON-892955961 tempest-FlavorsV255TestJSON-892955961-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 447 microversion: 2.55 time: 0.411445 Jul 19 22:26:44.421442 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 236/486] 10.222.0.25 () {62 vars in 1187 bytes} [Tue Jul 19 22:26:44 2022] POST /compute/v2.1/flavors => generated 447 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:26:44.428855 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-21e33055-8a12-4463-8ce9-7a91b9a65879 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Calling method '.version_select at 0x7f7a10cd8550>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:44.459492 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-21e33055-8a12-4463-8ce9-7a91b9a65879 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 22:26:44.461525 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-21e33055-8a12-4463-8ce9-7a91b9a65879 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Request method failure captured: Jul 19 22:26:44.461525 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 19 22:26:44.461525 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:26:44.461525 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:26:44.461525 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:26:44.461525 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:26:44.461525 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:26:44.461525 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:26:44.461525 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:26:44.461525 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:44.461525 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y-dW-P2Jeso8zwyGgAWnyO4uzd1B96l0ScGjGjGu9f27Zzp85LMOl5Rhn-l6ku98qb2NB-EvoyEVAoFYBcn_fdbSBPufpqW7ymlbXK5Ts9Mk266ZnlwgN9cGKOtwTr2JE6LvJeZNI-Ydvd08txnnjnrYgWojsH_-M62oFDaLDL_VJ4 Jul 19 22:26:44.461525 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:26:44.461525 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:26:44.461525 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:26:44.461525 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:26:44.461525 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:26:44.461525 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:26:44.461525 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: bb55d030ea924050a36d1c954c6de0d8 Jul 19 22:26:44.461525 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-316895026 Jul 19 22:26:44.461525 n-d-847009-3 devstack@n-api.service[119338]: X-Role: admin,member,reader Jul 19 22:26:44.461525 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: admin,member,reader Jul 19 22:26:44.463045 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:44.463045 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-HostsAdminNegativeTestJSON-316895026 Jul 19 22:26:44.463045 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: bb55d030ea924050a36d1c954c6de0d8 Jul 19 22:26:44.463045 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-316895026 Jul 19 22:26:44.463045 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-HostsAdminNegativeTestJSON-316895026-project-admin Jul 19 22:26:44.463045 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:26:44.463045 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:26:44.463045 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 41ce57a82f654b1e812cc48343d768dc Jul 19 22:26:44.463045 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-HostsAdminNegativeTestJSON-316895026-project-admin Jul 19 22:26:44.463045 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:26:44.463045 n-d-847009-3 devstack@n-api.service[119338]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 22:26:44.463045 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'nonexistent_hostname'} Jul 19 22:26:44.463045 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:44.463976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:44.463976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 19 22:26:44.463976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 19 22:26:44.463976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 22:26:44.463976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 22:26:44.463976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:26:44.463976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:26:44.463976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:26:44.463976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:26:44.463976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 22:26:44.463976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 22:26:44.463976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 19 22:26:44.463976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 19 22:26:44.463976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:26:44.463976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:26:44.463976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 19 22:26:44.463976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 19 22:26:44.463976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 22:26:44.463976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 22:26:44.465319 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 19 22:26:44.465319 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 19 22:26:44.465319 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 22:26:44.465319 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:44.465319 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:44.465319 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:44.465319 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:44.465319 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:44.465319 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:44.465319 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:44.465319 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:44.465319 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:26:44.465319 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:26:44.465319 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:44.465319 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:44.465319 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 19 22:26:44.465319 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 19 22:26:44.465319 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 19 22:26:44.465319 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:26:44.466668 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 22:26:44.466668 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:44.466668 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:44.466668 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:44.466668 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:44.466668 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:44.466668 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:44.466668 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:26:44.466668 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:26:44.466668 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 22:26:44.466668 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:44.472026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-21e33055-8a12-4463-8ce9-7a91b9a65879 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:44.473125 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-21e33055-8a12-4463-8ce9-7a91b9a65879 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.050020 Jul 19 22:26:44.475200 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 237/487] 10.222.0.25 () {58 vars in 1211 bytes} [Tue Jul 19 22:26:44 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:26:44.849389 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-62345870-7710-427b-9bae-d118a1b790d8 tempest-FlavorsV255TestJSON-606115029 tempest-FlavorsV255TestJSON-606115029-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:44.871723 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-62345870-7710-427b-9bae-d118a1b790d8 tempest-FlavorsV255TestJSON-606115029 tempest-FlavorsV255TestJSON-606115029-project] 10.222.0.25 "GET /compute/v2.1/flavors/1107863960" status: 200 len: 447 microversion: 2.55 time: 0.392765 Jul 19 22:26:44.887594 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 238/488] 10.222.0.25 () {60 vars in 1198 bytes} [Tue Jul 19 22:26:44 2022] GET /compute/v2.1/flavors/1107863960 => generated 447 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:26:44.892486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fa0c92dd-8951-449f-b65b-f40b27f7db8a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-124711208", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:44.975231 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-effc37a1-15d2-48c0-8833-ffa7225becd2 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9/action" status: 202 len: 0 microversion: 2.1 time: 9.071311 Jul 19 22:26:44.979277 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 251/489] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:26:35 2022] POST /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9/action => generated 0 bytes in 9078 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:26:44.984940 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cfb94b04-c7ea-4c17-a0c8-6a0ececba2ef tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] Calling method '.version_select at 0x7f7a10a800d0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:44.985894 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:44.985894 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:44.987150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cfb94b04-c7ea-4c17-a0c8-6a0ececba2ef tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '8426cecbcfed4ad4995b2ef2f407277f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fe902f6ed645a099e963946da2783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:44.996792 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cfb94b04-c7ea-4c17-a0c8-6a0ececba2ef tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] Request method failure captured: Jul 19 22:26:44.996792 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/os-hosts/n-d-847009-3 HTTP/1.1 Jul 19 22:26:44.996792 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:26:44.996792 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:26:44.996792 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:26:44.996792 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:26:44.996792 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:26:44.996792 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:26:44.996792 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:26:44.996792 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:44.996792 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y-bXipjRIzo7yvAU6kr-ZZ-k9aSgE1uSyPldulNVP-KyRio8UkdQYOB7nzsrTULs6rzbhPX55kdnFcGuztQ5q770bVuV5QqmsNJ0iAhJOrwTmooGHk-lEKPUT40oH9tTzf6o77DUFaZX2v7XdNULAdbJv-WPZO9kKcaxgiJJwvkXVA Jul 19 22:26:44.996792 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:26:44.996792 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:26:44.996792 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:26:44.996792 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:26:44.996792 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:26:44.996792 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:26:44.996792 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: d5fe902f6ed645a099e963946da2783e Jul 19 22:26:44.996792 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1318394948 Jul 19 22:26:44.996792 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:26:44.996792 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:26:44.999420 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d5fe902f6ed645a099e963946da2783e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5fe902f6ed645a099e963946da2783e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d5fe902f6ed645a099e963946da2783e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5fe902f6ed645a099e963946da2783e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:44.999420 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1318394948 Jul 19 22:26:44.999420 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: d5fe902f6ed645a099e963946da2783e Jul 19 22:26:44.999420 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1318394948 Jul 19 22:26:44.999420 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-HostsAdminNegativeTestJSON-1318394948-project Jul 19 22:26:44.999420 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:26:44.999420 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:26:44.999420 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 8426cecbcfed4ad4995b2ef2f407277f Jul 19 22:26:44.999420 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1318394948-project Jul 19 22:26:44.999420 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:26:44.999420 n-d-847009-3 devstack@n-api.service[119337]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 19 22:26:44.999420 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'n-d-847009-3'} Jul 19 22:26:44.999420 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:45.001906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:45.001906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:45.001906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:45.001906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:45.001906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:45.001906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:26:45.001906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:26:45.001906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:45.001906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:45.001906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 19 22:26:45.001906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 19 22:26:45.001906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:26:45.001906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:26:45.001906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:26:45.001906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:26:45.001906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:26:45.001906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:26:45.001906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:26:45.001906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:26:45.004720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:26:45.004720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:26:45.004720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:26:45.004720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:26:45.004720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:26:45.004720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:26:45.004720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 19 22:26:45.004720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:45.004720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:45.004720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:45.004720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:45.004720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:45.004720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:45.004720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:26:45.004720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:26:45.004720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 19 22:26:45.004720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:45.006406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cfb94b04-c7ea-4c17-a0c8-6a0ececba2ef tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:45.006406 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cfb94b04-c7ea-4c17-a0c8-6a0ececba2ef tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-847009-3" status: 403 len: 109 microversion: 2.1 time: 0.017724 Jul 19 22:26:45.006406 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 252/490] 10.222.0.25 () {58 vars in 1166 bytes} [Tue Jul 19 22:26:44 2022] GET /compute/v2.1/os-hosts/n-d-847009-3 => generated 109 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:26:45.009531 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fb3c9b45-a499-4f6d-8362-03d4279f3956 tempest-FlavorsV255TestJSON-892955961 tempest-FlavorsV255TestJSON-892955961-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:45.010865 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:45.010865 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:45.064835 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fb3c9b45-a499-4f6d-8362-03d4279f3956 tempest-FlavorsV255TestJSON-892955961 tempest-FlavorsV255TestJSON-892955961-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/1107863960" status: 200 len: 448 microversion: 2.55 time: 0.059241 Jul 19 22:26:45.082976 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 253/491] 10.222.0.25 () {62 vars in 1218 bytes} [Tue Jul 19 22:26:44 2022] PUT /compute/v2.1/flavors/1107863960 => generated 448 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:26:45.090212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c1ec0eac-2c16-49a5-835f-85b4681cff48 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:45.091095 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c1ec0eac-2c16-49a5-835f-85b4681cff48 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:45.107306 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c1ec0eac-2c16-49a5-835f-85b4681cff48 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:45.118454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-fa0c92dd-8951-449f-b65b-f40b27f7db8a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] validate_networks() for None {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:26:45.129046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c1ec0eac-2c16-49a5-835f-85b4681cff48 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:45.130241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c1ec0eac-2c16-49a5-835f-85b4681cff48 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:45.130845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c1ec0eac-2c16-49a5-835f-85b4681cff48 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:45.816532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:26:46.666918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c1ec0eac-2c16-49a5-835f-85b4681cff48 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:46.679744 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c1ec0eac-2c16-49a5-835f-85b4681cff48 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3" status: 200 len: 1389 microversion: 2.1 time: 1.594249 Jul 19 22:26:46.682666 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 254/492] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:45 2022] GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 => generated 1389 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:46.700495 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2ac49a29-655f-4dbf-9003-9d2c314f2e29 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:46.701443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2ac49a29-655f-4dbf-9003-9d2c314f2e29 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:46.705359 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=86,nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:DELETE=9,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:26:46.728438 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2ac49a29-655f-4dbf-9003-9d2c314f2e29 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:46.729275 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2ac49a29-655f-4dbf-9003-9d2c314f2e29 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:46.730277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2ac49a29-655f-4dbf-9003-9d2c314f2e29 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:46.730943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2ac49a29-655f-4dbf-9003-9d2c314f2e29 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:47.076260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-fa0c92dd-8951-449f-b65b-f40b27f7db8a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:26:47.078408 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-fa0c92dd-8951-449f-b65b-f40b27f7db8a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:26:47.083460 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-fa0c92dd-8951-449f-b65b-f40b27f7db8a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:26:47.088930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-fa0c92dd-8951-449f-b65b-f40b27f7db8a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:26:47.090889 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-fa0c92dd-8951-449f-b65b-f40b27f7db8a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:26:47.136810 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2ac49a29-655f-4dbf-9003-9d2c314f2e29 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:47.146669 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2ac49a29-655f-4dbf-9003-9d2c314f2e29 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 200 len: 1504 microversion: 2.1 time: 0.462333 Jul 19 22:26:47.152550 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 255/493] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:46 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 1504 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:47.163474 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-44209b1d-f3c1-4db0-a2d8-29329b845783 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Calling method '.version_select at 0x7f7a10ad4940>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:47.168365 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:47.168365 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:47.182221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa0c92dd-8951-449f-b65b-f40b27f7db8a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:47.183190 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa0c92dd-8951-449f-b65b-f40b27f7db8a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:47.183871 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-44209b1d-f3c1-4db0-a2d8-29329b845783 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 22:26:47.184475 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa0c92dd-8951-449f-b65b-f40b27f7db8a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:47.185255 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa0c92dd-8951-449f-b65b-f40b27f7db8a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:47.189184 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-44209b1d-f3c1-4db0-a2d8-29329b845783 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Request method failure captured: Jul 19 22:26:47.189184 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 19 22:26:47.189184 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:26:47.189184 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:26:47.189184 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:26:47.189184 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:26:47.189184 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:26:47.189184 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:26:47.189184 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:26:47.189184 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:47.189184 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y-dW-P2Jeso8zwyGgAWnyO4uzd1B96l0ScGjGjGu9f27Zzp85LMOl5Rhn-l6ku98qb2NB-EvoyEVAoFYBcn_fdbSBPufpqW7ymlbXK5Ts9Mk266ZnlwgN9cGKOtwTr2JE6LvJeZNI-Ydvd08txnnjnrYgWojsH_-M62oFDaLDL_VJ4 Jul 19 22:26:47.189184 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:26:47.189184 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:26:47.189184 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:26:47.189184 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:26:47.189184 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:26:47.189184 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:26:47.189184 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: bb55d030ea924050a36d1c954c6de0d8 Jul 19 22:26:47.189184 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-316895026 Jul 19 22:26:47.189184 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:26:47.189184 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:26:47.190425 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:47.190425 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-HostsAdminNegativeTestJSON-316895026 Jul 19 22:26:47.190425 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: bb55d030ea924050a36d1c954c6de0d8 Jul 19 22:26:47.190425 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-316895026 Jul 19 22:26:47.190425 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-HostsAdminNegativeTestJSON-316895026-project-admin Jul 19 22:26:47.190425 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:26:47.190425 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:26:47.190425 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 41ce57a82f654b1e812cc48343d768dc Jul 19 22:26:47.190425 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-HostsAdminNegativeTestJSON-316895026-project-admin Jul 19 22:26:47.190425 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:26:47.190425 n-d-847009-3 devstack@n-api.service[119337]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 22:26:47.190425 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'nonexistent_hostname'} Jul 19 22:26:47.190425 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:47.191172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:47.191172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 19 22:26:47.191172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 19 22:26:47.191172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:26:47.191172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:26:47.191172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 19 22:26:47.191172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 19 22:26:47.191172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 22:26:47.191172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 22:26:47.191172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 19 22:26:47.191172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 19 22:26:47.191172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 22:26:47.191172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.191172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:47.191172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.191172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:47.191172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:47.191172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:47.191172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:47.192232 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:47.192232 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:26:47.192232 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:26:47.192232 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:47.192232 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:47.192232 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 19 22:26:47.192232 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:26:47.192232 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 22:26:47.192232 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.192232 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:47.192232 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.192232 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:47.192232 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:47.192232 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:47.192232 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:26:47.192232 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:26:47.192232 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 22:26:47.192232 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.197439 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-44209b1d-f3c1-4db0-a2d8-29329b845783 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:47.198574 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-44209b1d-f3c1-4db0-a2d8-29329b845783 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.044729 Jul 19 22:26:47.209751 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 256/494] 10.222.0.25 () {58 vars in 1190 bytes} [Tue Jul 19 22:26:47 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:26:47.214804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a2f9757e-0cb9-43d0-af0d-a33d1a055ba4 tempest-FlavorsV255TestJSON-606115029 tempest-FlavorsV255TestJSON-606115029-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:47.249111 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-fa0c92dd-8951-449f-b65b-f40b27f7db8a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Getting quotas for project eed5e83db4ae4156ae9635b84ca7ff4a. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:26:47.262456 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a2f9757e-0cb9-43d0-af0d-a33d1a055ba4 tempest-FlavorsV255TestJSON-606115029 tempest-FlavorsV255TestJSON-606115029-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6591 microversion: 2.55 time: 0.051313 Jul 19 22:26:47.264269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-fa0c92dd-8951-449f-b65b-f40b27f7db8a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Getting quotas for user e3ef9d4c38d547a1a1532d964195144a and project eed5e83db4ae4156ae9635b84ca7ff4a. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:26:47.267542 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 257/495] 10.222.0.25 () {60 vars in 1186 bytes} [Tue Jul 19 22:26:47 2022] GET /compute/v2.1/flavors/detail => generated 6591 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:26:47.274022 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-8fd1890c-72d6-445a-a21e-e933ae375fe9 req-8b8c43ef-bfbd-4f47-b5f8-194b2321c262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3", "tag": "b1477d1a-c2f1-4c8c-b3a5-db002ad3db13"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:47.329467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-8fd1890c-72d6-445a-a21e-e933ae375fe9 req-8b8c43ef-bfbd-4f47-b5f8-194b2321c262 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:47.332710 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-8fd1890c-72d6-445a-a21e-e933ae375fe9 req-8b8c43ef-bfbd-4f47-b5f8-194b2321c262 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:47.353147 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fa0c92dd-8951-449f-b65b-f40b27f7db8a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:26:47.356427 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fa0c92dd-8951-449f-b65b-f40b27f7db8a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:26:47.368548 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-8fd1890c-72d6-445a-a21e-e933ae375fe9 req-8b8c43ef-bfbd-4f47-b5f8-194b2321c262 service nova] Creating event network-changed:b1477d1a-c2f1-4c8c-b3a5-db002ad3db13 for instance 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 on n-h2-847009-3 Jul 19 22:26:47.375484 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-8fd1890c-72d6-445a-a21e-e933ae375fe9 req-8b8c43ef-bfbd-4f47-b5f8-194b2321c262 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105197 Jul 19 22:26:47.376835 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 258/496] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:47.384437 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-657ba1d2-ff51-4d9b-8b29-166a349246ef tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] Calling method '.version_select at 0x7f7a10ad49d0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:47.385928 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:47.385928 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:47.387591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-657ba1d2-ff51-4d9b-8b29-166a349246ef tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '8426cecbcfed4ad4995b2ef2f407277f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fe902f6ed645a099e963946da2783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:47.389601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-657ba1d2-ff51-4d9b-8b29-166a349246ef tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] Request method failure captured: Jul 19 22:26:47.389601 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/os-hosts/n-d-847009-3/shutdown HTTP/1.1 Jul 19 22:26:47.389601 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:26:47.389601 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:26:47.389601 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:26:47.389601 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:26:47.389601 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:26:47.389601 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:26:47.389601 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:26:47.389601 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:47.389601 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y-bXipjRIzo7yvAU6kr-ZZ-k9aSgE1uSyPldulNVP-KyRio8UkdQYOB7nzsrTULs6rzbhPX55kdnFcGuztQ5q770bVuV5QqmsNJ0iAhJOrwTmooGHk-lEKPUT40oH9tTzf6o77DUFaZX2v7XdNULAdbJv-WPZO9kKcaxgiJJwvkXVA Jul 19 22:26:47.389601 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:26:47.389601 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:26:47.389601 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:26:47.389601 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:26:47.389601 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:26:47.389601 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:26:47.389601 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: d5fe902f6ed645a099e963946da2783e Jul 19 22:26:47.389601 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1318394948 Jul 19 22:26:47.389601 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:26:47.389601 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:26:47.391384 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d5fe902f6ed645a099e963946da2783e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5fe902f6ed645a099e963946da2783e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d5fe902f6ed645a099e963946da2783e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5fe902f6ed645a099e963946da2783e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:47.391384 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1318394948 Jul 19 22:26:47.391384 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: d5fe902f6ed645a099e963946da2783e Jul 19 22:26:47.391384 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1318394948 Jul 19 22:26:47.391384 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-HostsAdminNegativeTestJSON-1318394948-project Jul 19 22:26:47.391384 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:26:47.391384 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:26:47.391384 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 8426cecbcfed4ad4995b2ef2f407277f Jul 19 22:26:47.391384 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1318394948-project Jul 19 22:26:47.391384 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:26:47.391384 n-d-847009-3 devstack@n-api.service[119337]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 19 22:26:47.391384 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'n-d-847009-3'} Jul 19 22:26:47.391384 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:47.392173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:47.392173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:47.392173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:47.392173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:47.392173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:47.392173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:26:47.392173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:26:47.392173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:47.392173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:47.392173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 19 22:26:47.392173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 19 22:26:47.392173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:26:47.392173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:26:47.392173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:26:47.392173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:26:47.392173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:26:47.392173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:26:47.392173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:26:47.392173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:26:47.393223 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:26:47.393223 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:26:47.393223 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:26:47.393223 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:26:47.393223 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:26:47.393223 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:26:47.393223 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 19 22:26:47.393223 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.393223 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:47.393223 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.393223 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:47.393223 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:47.393223 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:47.393223 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:26:47.393223 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:26:47.393223 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 19 22:26:47.393223 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.397648 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-657ba1d2-ff51-4d9b-8b29-166a349246ef tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:47.406133 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-657ba1d2-ff51-4d9b-8b29-166a349246ef tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-847009-3/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.027745 Jul 19 22:26:47.413959 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 259/497] 10.222.0.25 () {58 vars in 1193 bytes} [Tue Jul 19 22:26:47 2022] GET /compute/v2.1/os-hosts/n-d-847009-3/shutdown => generated 113 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:26:47.419774 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-11ef71cc-0577-4dba-bd9a-287321757ab3 tempest-FlavorsV255TestJSON-606115029 tempest-FlavorsV255TestJSON-606115029-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:47.454370 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-11ef71cc-0577-4dba-bd9a-287321757ab3 tempest-FlavorsV255TestJSON-606115029 tempest-FlavorsV255TestJSON-606115029-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 3681 microversion: 2.55 time: 0.038741 Jul 19 22:26:47.455768 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 260/498] 10.222.0.25 () {60 vars in 1165 bytes} [Tue Jul 19 22:26:47 2022] GET /compute/v2.1/flavors => generated 3681 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:26:47.461234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-89efdba2-5927-4e92-83e8-b3117043c88c tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Calling method '.version_select at 0x7f7a10ad4700>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:47.477849 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-89efdba2-5927-4e92-83e8-b3117043c88c tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 22:26:47.479976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-89efdba2-5927-4e92-83e8-b3117043c88c tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Request method failure captured: Jul 19 22:26:47.479976 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 19 22:26:47.479976 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:26:47.479976 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:26:47.479976 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:26:47.479976 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:26:47.479976 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:26:47.479976 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:26:47.479976 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:26:47.479976 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:47.479976 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y-dW-P2Jeso8zwyGgAWnyO4uzd1B96l0ScGjGjGu9f27Zzp85LMOl5Rhn-l6ku98qb2NB-EvoyEVAoFYBcn_fdbSBPufpqW7ymlbXK5Ts9Mk266ZnlwgN9cGKOtwTr2JE6LvJeZNI-Ydvd08txnnjnrYgWojsH_-M62oFDaLDL_VJ4 Jul 19 22:26:47.479976 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:26:47.479976 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:26:47.479976 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:26:47.479976 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:26:47.479976 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:26:47.479976 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:26:47.479976 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: bb55d030ea924050a36d1c954c6de0d8 Jul 19 22:26:47.479976 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-316895026 Jul 19 22:26:47.479976 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:26:47.479976 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:26:47.482076 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:47.482076 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-HostsAdminNegativeTestJSON-316895026 Jul 19 22:26:47.482076 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: bb55d030ea924050a36d1c954c6de0d8 Jul 19 22:26:47.482076 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-316895026 Jul 19 22:26:47.482076 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-HostsAdminNegativeTestJSON-316895026-project-admin Jul 19 22:26:47.482076 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:26:47.482076 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:26:47.482076 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 41ce57a82f654b1e812cc48343d768dc Jul 19 22:26:47.482076 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-HostsAdminNegativeTestJSON-316895026-project-admin Jul 19 22:26:47.482076 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:26:47.482076 n-d-847009-3 devstack@n-api.service[119337]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 22:26:47.482076 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'nonexistent_hostname'} Jul 19 22:26:47.482076 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:47.483531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:47.483531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 19 22:26:47.483531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 19 22:26:47.483531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 22:26:47.483531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 22:26:47.483531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:26:47.483531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:26:47.483531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:26:47.483531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:26:47.483531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 22:26:47.483531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 22:26:47.483531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 19 22:26:47.483531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 19 22:26:47.483531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:26:47.483531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:26:47.483531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 19 22:26:47.483531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 19 22:26:47.483531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 22:26:47.483531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 22:26:47.485892 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 19 22:26:47.485892 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 19 22:26:47.485892 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 22:26:47.485892 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.485892 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:47.485892 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.485892 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:47.485892 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:47.485892 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:47.485892 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:47.485892 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:47.485892 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:26:47.485892 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:26:47.485892 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:47.485892 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:47.485892 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 19 22:26:47.485892 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 19 22:26:47.485892 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 19 22:26:47.485892 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:26:47.491124 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 22:26:47.491124 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.491124 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:47.491124 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.491124 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:47.491124 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:47.491124 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:47.491124 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:26:47.491124 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:26:47.491124 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 22:26:47.491124 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.491124 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-89efdba2-5927-4e92-83e8-b3117043c88c tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:47.491124 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-89efdba2-5927-4e92-83e8-b3117043c88c tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.025230 Jul 19 22:26:47.492793 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 261/499] 10.222.0.25 () {58 vars in 1217 bytes} [Tue Jul 19 22:26:47 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:26:47.505246 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3227436c-89a2-4549-bc2e-aa87d5e15ce4 tempest-FlavorsV255TestJSON-892955961 tempest-FlavorsV255TestJSON-892955961-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:47.506430 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:47.506430 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:47.543621 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3227436c-89a2-4549-bc2e-aa87d5e15ce4 tempest-FlavorsV255TestJSON-892955961 tempest-FlavorsV255TestJSON-892955961-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1107863960" status: 202 len: 0 microversion: 2.55 time: 0.049750 Jul 19 22:26:47.544973 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 262/500] 10.222.0.25 () {60 vars in 1201 bytes} [Tue Jul 19 22:26:47 2022] DELETE /compute/v2.1/flavors/1107863960 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:26:47.554885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-818c5925-0f61-4a43-b538-cadb8ecbc96d tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] Calling method '.version_select at 0x7f7a1096a0d0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:47.556550 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:47.556550 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:47.566009 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-818c5925-0f61-4a43-b538-cadb8ecbc96d tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '8426cecbcfed4ad4995b2ef2f407277f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fe902f6ed645a099e963946da2783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:47.576335 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fa0c92dd-8951-449f-b65b-f40b27f7db8a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.686761 Jul 19 22:26:47.586260 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 239/501] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:26:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:26:47.588340 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-818c5925-0f61-4a43-b538-cadb8ecbc96d tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] Request method failure captured: Jul 19 22:26:47.588340 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/os-hosts/n-d-847009-3/startup HTTP/1.1 Jul 19 22:26:47.588340 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:26:47.588340 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:26:47.588340 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:26:47.588340 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:26:47.588340 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:26:47.588340 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:26:47.588340 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:26:47.588340 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:47.588340 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y-bXipjRIzo7yvAU6kr-ZZ-k9aSgE1uSyPldulNVP-KyRio8UkdQYOB7nzsrTULs6rzbhPX55kdnFcGuztQ5q770bVuV5QqmsNJ0iAhJOrwTmooGHk-lEKPUT40oH9tTzf6o77DUFaZX2v7XdNULAdbJv-WPZO9kKcaxgiJJwvkXVA Jul 19 22:26:47.588340 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:26:47.588340 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:26:47.588340 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:26:47.588340 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:26:47.588340 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:26:47.588340 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:26:47.588340 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: d5fe902f6ed645a099e963946da2783e Jul 19 22:26:47.588340 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1318394948 Jul 19 22:26:47.588340 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:26:47.588340 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:26:47.589788 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d5fe902f6ed645a099e963946da2783e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5fe902f6ed645a099e963946da2783e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d5fe902f6ed645a099e963946da2783e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5fe902f6ed645a099e963946da2783e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:47.589788 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1318394948 Jul 19 22:26:47.589788 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: d5fe902f6ed645a099e963946da2783e Jul 19 22:26:47.589788 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1318394948 Jul 19 22:26:47.589788 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-HostsAdminNegativeTestJSON-1318394948-project Jul 19 22:26:47.589788 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:26:47.589788 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:26:47.589788 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 8426cecbcfed4ad4995b2ef2f407277f Jul 19 22:26:47.589788 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1318394948-project Jul 19 22:26:47.589788 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:26:47.589788 n-d-847009-3 devstack@n-api.service[119337]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 19 22:26:47.589788 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'n-d-847009-3'} Jul 19 22:26:47.589788 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:47.590656 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:47.590656 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:47.590656 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:47.590656 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:47.590656 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:47.590656 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:26:47.590656 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:26:47.590656 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:47.590656 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:47.590656 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 19 22:26:47.590656 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 19 22:26:47.590656 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:26:47.590656 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:26:47.590656 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:26:47.590656 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:26:47.590656 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:26:47.590656 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:26:47.590656 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:26:47.590656 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:26:47.591975 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:26:47.591975 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:26:47.591975 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:26:47.591975 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:26:47.591975 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:26:47.591975 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:26:47.591975 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 19 22:26:47.591975 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.591975 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:47.591975 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.591975 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:47.591975 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:47.591975 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:47.591975 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:26:47.591975 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:26:47.591975 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 19 22:26:47.591975 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.594853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-818c5925-0f61-4a43-b538-cadb8ecbc96d tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:47.603011 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c7955b8f-3ca9-4d90-a64c-a3e9e9142982 tempest-FlavorsV255TestJSON-892955961 tempest-FlavorsV255TestJSON-892955961-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:47.606560 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-818c5925-0f61-4a43-b538-cadb8ecbc96d tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-847009-3/startup" status: 403 len: 110 microversion: 2.1 time: 0.056237 Jul 19 22:26:47.617386 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 263/502] 10.222.0.25 () {58 vars in 1190 bytes} [Tue Jul 19 22:26:47 2022] GET /compute/v2.1/os-hosts/n-d-847009-3/startup => generated 110 bytes in 71 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:26:47.640221 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0a7abfb4-aec7-40e8-8ee3-22e235dd4719 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:47.651298 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0a7abfb4-aec7-40e8-8ee3-22e235dd4719 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:47.654715 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c7955b8f-3ca9-4d90-a64c-a3e9e9142982 tempest-FlavorsV255TestJSON-892955961 tempest-FlavorsV255TestJSON-892955961-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6153 microversion: 2.55 time: 0.063515 Jul 19 22:26:47.667522 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 240/503] 10.222.0.25 () {60 vars in 1186 bytes} [Tue Jul 19 22:26:47 2022] GET /compute/v2.1/flavors/detail => generated 6153 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:26:47.692813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ab93da06-37a9-4690-81e7-bcdcf0ee52ee tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Calling method '.version_select at 0x7f7a10a114c0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:47.693699 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:47.693699 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:47.736225 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-ab93da06-37a9-4690-81e7-bcdcf0ee52ee tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 22:26:47.738230 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ab93da06-37a9-4690-81e7-bcdcf0ee52ee tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Request method failure captured: Jul 19 22:26:47.738230 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 19 22:26:47.738230 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:26:47.738230 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:26:47.738230 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:26:47.738230 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:26:47.738230 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:26:47.738230 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:26:47.738230 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:26:47.738230 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:47.738230 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y-dW-P2Jeso8zwyGgAWnyO4uzd1B96l0ScGjGjGu9f27Zzp85LMOl5Rhn-l6ku98qb2NB-EvoyEVAoFYBcn_fdbSBPufpqW7ymlbXK5Ts9Mk266ZnlwgN9cGKOtwTr2JE6LvJeZNI-Ydvd08txnnjnrYgWojsH_-M62oFDaLDL_VJ4 Jul 19 22:26:47.738230 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:26:47.738230 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:26:47.738230 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:26:47.738230 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:26:47.738230 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:26:47.738230 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:26:47.738230 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: bb55d030ea924050a36d1c954c6de0d8 Jul 19 22:26:47.738230 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-316895026 Jul 19 22:26:47.738230 n-d-847009-3 devstack@n-api.service[119338]: X-Role: admin,member,reader Jul 19 22:26:47.738230 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: admin,member,reader Jul 19 22:26:47.739747 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:47.739747 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-HostsAdminNegativeTestJSON-316895026 Jul 19 22:26:47.739747 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: bb55d030ea924050a36d1c954c6de0d8 Jul 19 22:26:47.739747 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-316895026 Jul 19 22:26:47.739747 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-HostsAdminNegativeTestJSON-316895026-project-admin Jul 19 22:26:47.739747 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:26:47.739747 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:26:47.739747 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 41ce57a82f654b1e812cc48343d768dc Jul 19 22:26:47.739747 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-HostsAdminNegativeTestJSON-316895026-project-admin Jul 19 22:26:47.739747 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:26:47.739747 n-d-847009-3 devstack@n-api.service[119338]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 22:26:47.739747 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'nonexistent_hostname'} Jul 19 22:26:47.739747 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:47.740642 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:47.740642 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 19 22:26:47.740642 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 19 22:26:47.740642 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 22:26:47.740642 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 22:26:47.740642 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:26:47.740642 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:26:47.740642 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:26:47.740642 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:26:47.740642 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 22:26:47.740642 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 22:26:47.740642 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 19 22:26:47.740642 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 19 22:26:47.740642 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:26:47.740642 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:26:47.740642 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 19 22:26:47.740642 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 19 22:26:47.740642 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 22:26:47.740642 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 22:26:47.741917 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 19 22:26:47.741917 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 19 22:26:47.741917 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 22:26:47.741917 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.741917 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:47.741917 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.741917 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:47.741917 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:47.741917 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:47.741917 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:47.741917 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:47.741917 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:26:47.741917 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:26:47.741917 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:47.741917 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:47.741917 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 19 22:26:47.741917 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 19 22:26:47.741917 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 19 22:26:47.741917 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:26:47.743043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 22:26:47.743043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.743043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:47.743043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.743043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:47.743043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:47.743043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:47.743043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:26:47.743043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:26:47.743043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 22:26:47.743043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.752039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ab93da06-37a9-4690-81e7-bcdcf0ee52ee tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:47.753228 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ab93da06-37a9-4690-81e7-bcdcf0ee52ee tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.084647 Jul 19 22:26:47.754287 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 241/504] 10.222.0.25 () {58 vars in 1214 bytes} [Tue Jul 19 22:26:47 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:26:47.779528 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-55bdc9f2-83ce-4766-8c9a-c93cef03b629 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:47.782902 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-55bdc9f2-83ce-4766-8c9a-c93cef03b629 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:47.802174 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55bdc9f2-83ce-4766-8c9a-c93cef03b629 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:47.815933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55bdc9f2-83ce-4766-8c9a-c93cef03b629 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:47.817208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55bdc9f2-83ce-4766-8c9a-c93cef03b629 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:47.817894 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55bdc9f2-83ce-4766-8c9a-c93cef03b629 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:47.870097 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0a7abfb4-aec7-40e8-8ee3-22e235dd4719 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:47.890823 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0a7abfb4-aec7-40e8-8ee3-22e235dd4719 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1212 microversion: 2.1 time: 0.266054 Jul 19 22:26:47.895100 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 264/505] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:47 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1212 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:47.921498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6980288d-d9e2-41c3-9d71-470af5b662a5 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Action: 'update', calling method: .version_select at 0x7f7a10ad4e50>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:47.939923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6980288d-d9e2-41c3-9d71-470af5b662a5 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Request method failure captured: Jul 19 22:26:47.939923 n-d-847009-3 devstack@n-api.service[119337]: request: PUT /compute/v2.1/os-hosts/n-d-847009-3 HTTP/1.1 Jul 19 22:26:47.939923 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:26:47.939923 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:26:47.939923 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:26:47.939923 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 51 Jul 19 22:26:47.939923 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:26:47.939923 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:26:47.939923 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:26:47.939923 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:47.939923 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y-dW-P2Jeso8zwyGgAWnyO4uzd1B96l0ScGjGjGu9f27Zzp85LMOl5Rhn-l6ku98qb2NB-EvoyEVAoFYBcn_fdbSBPufpqW7ymlbXK5Ts9Mk266ZnlwgN9cGKOtwTr2JE6LvJeZNI-Ydvd08txnnjnrYgWojsH_-M62oFDaLDL_VJ4 Jul 19 22:26:47.939923 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:26:47.939923 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:26:47.939923 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:26:47.939923 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:26:47.939923 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:26:47.939923 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:26:47.939923 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: bb55d030ea924050a36d1c954c6de0d8 Jul 19 22:26:47.939923 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-316895026 Jul 19 22:26:47.939923 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:26:47.939923 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:26:47.941382 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:47.941382 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-HostsAdminNegativeTestJSON-316895026 Jul 19 22:26:47.941382 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: bb55d030ea924050a36d1c954c6de0d8 Jul 19 22:26:47.941382 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-316895026 Jul 19 22:26:47.941382 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-HostsAdminNegativeTestJSON-316895026-project-admin Jul 19 22:26:47.941382 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:26:47.941382 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:26:47.941382 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 41ce57a82f654b1e812cc48343d768dc Jul 19 22:26:47.941382 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-HostsAdminNegativeTestJSON-316895026-project-admin Jul 19 22:26:47.941382 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:26:47.941382 n-d-847009-3 devstack@n-api.service[119337]: {"status": "enable", "maintenance_mode": "invalid"} Jul 19 22:26:47.941382 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:26:47.941382 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 19 22:26:47.942213 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'n-d-847009-3', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 19 22:26:47.942213 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:47.942213 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:47.942213 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:26:47.942213 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:26:47.942213 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:26:47.942213 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:26:47.942213 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 19 22:26:47.942213 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.942213 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 19 22:26:47.942213 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 19 22:26:47.942213 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'disable', Jul 19 22:26:47.942213 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'Enable', Jul 19 22:26:47.942213 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'Disable', Jul 19 22:26:47.942213 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 19 22:26:47.942213 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 19 22:26:47.942213 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 19 22:26:47.942213 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.942213 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi On instance: Jul 19 22:26:47.942213 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'invalid' Jul 19 22:26:47.942213 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.942213 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:47.942213 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.942213 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:47.942213 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:47.943877 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:47.943877 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:47.943877 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:47.943877 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:26:47.943877 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:26:47.943877 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:47.943877 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:47.943877 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:26:47.943877 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:26:47.943877 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:26:47.943877 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:26:47.943877 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:26:47.943877 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:26:47.943877 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 19 22:26:47.943877 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.943877 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:47.943877 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.943877 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:47.943877 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:47.947315 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:47.947315 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:26:47.947315 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:26:47.947315 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 19 22:26:47.947315 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.947315 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6980288d-d9e2-41c3-9d71-470af5b662a5 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:47.951740 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6980288d-d9e2-41c3-9d71-470af5b662a5 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-847009-3" status: 400 len: 199 microversion: 2.1 time: 0.050296 Jul 19 22:26:47.963844 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 265/506] 10.222.0.25 () {60 vars in 1186 bytes} [Tue Jul 19 22:26:47 2022] PUT /compute/v2.1/os-hosts/n-d-847009-3 => generated 199 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:26:47.985803 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7a372d3a-b568-4311-bc69-995c7a66fa08 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Action: 'update', calling method: .version_select at 0x7f7a10cbdd30>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:47.988240 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7a372d3a-b568-4311-bc69-995c7a66fa08 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Request method failure captured: Jul 19 22:26:47.988240 n-d-847009-3 devstack@n-api.service[119337]: request: PUT /compute/v2.1/os-hosts/n-d-847009-3 HTTP/1.1 Jul 19 22:26:47.988240 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:26:47.988240 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:26:47.988240 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:26:47.988240 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 51 Jul 19 22:26:47.988240 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:26:47.988240 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:26:47.988240 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:26:47.988240 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:47.988240 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y-dW-P2Jeso8zwyGgAWnyO4uzd1B96l0ScGjGjGu9f27Zzp85LMOl5Rhn-l6ku98qb2NB-EvoyEVAoFYBcn_fdbSBPufpqW7ymlbXK5Ts9Mk266ZnlwgN9cGKOtwTr2JE6LvJeZNI-Ydvd08txnnjnrYgWojsH_-M62oFDaLDL_VJ4 Jul 19 22:26:47.988240 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:26:47.988240 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:26:47.988240 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:26:47.988240 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:26:47.988240 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:26:47.988240 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:26:47.988240 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: bb55d030ea924050a36d1c954c6de0d8 Jul 19 22:26:47.988240 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-316895026 Jul 19 22:26:47.988240 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:26:47.988240 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:26:47.990566 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:47.990566 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-HostsAdminNegativeTestJSON-316895026 Jul 19 22:26:47.990566 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: bb55d030ea924050a36d1c954c6de0d8 Jul 19 22:26:47.990566 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-316895026 Jul 19 22:26:47.990566 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-HostsAdminNegativeTestJSON-316895026-project-admin Jul 19 22:26:47.990566 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:26:47.990566 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:26:47.990566 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 41ce57a82f654b1e812cc48343d768dc Jul 19 22:26:47.990566 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-HostsAdminNegativeTestJSON-316895026-project-admin Jul 19 22:26:47.990566 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:26:47.990566 n-d-847009-3 devstack@n-api.service[119337]: {"status": "invalid", "maintenance_mode": "enable"} Jul 19 22:26:47.990566 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:26:47.990566 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 19 22:26:47.992046 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'n-d-847009-3', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 19 22:26:47.992046 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:47.992046 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:47.992046 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:26:47.992046 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:26:47.992046 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:26:47.992046 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:26:47.992046 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 19 22:26:47.992046 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.992046 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 19 22:26:47.992046 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 19 22:26:47.992046 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'disable', Jul 19 22:26:47.992046 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'Enable', Jul 19 22:26:47.992046 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'Disable', Jul 19 22:26:47.992046 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 19 22:26:47.992046 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 19 22:26:47.992046 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 19 22:26:47.992046 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.992046 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi On instance: Jul 19 22:26:47.992046 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'invalid' Jul 19 22:26:47.992046 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.992046 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:47.992046 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.992046 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:47.992046 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:47.996837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:47.996837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:47.996837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:47.996837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:26:47.996837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:26:47.996837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:47.996837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:47.996837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:26:47.996837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:26:47.996837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:26:47.996837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:26:47.996837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:26:47.996837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:26:47.996837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 19 22:26:47.996837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.996837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:47.996837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:47.996837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:47.996837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:48.007557 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:48.007557 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:26:48.007557 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:26:48.007557 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 19 22:26:48.007557 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:48.022979 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7a372d3a-b568-4311-bc69-995c7a66fa08 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:48.024965 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7a372d3a-b568-4311-bc69-995c7a66fa08 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-847009-3" status: 400 len: 189 microversion: 2.1 time: 0.059797 Jul 19 22:26:48.026627 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 266/507] 10.222.0.25 () {60 vars in 1186 bytes} [Tue Jul 19 22:26:47 2022] PUT /compute/v2.1/os-hosts/n-d-847009-3 => generated 189 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:26:48.042390 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1670b628-6cea-4e6e-9bbc-bb347b8a0471 tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] Action: 'update', calling method: .version_select at 0x7f7a10ab2f70>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:48.046287 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:48.046287 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:26:48.057126 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1670b628-6cea-4e6e-9bbc-bb347b8a0471 tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '8426cecbcfed4ad4995b2ef2f407277f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fe902f6ed645a099e963946da2783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:48.063561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1670b628-6cea-4e6e-9bbc-bb347b8a0471 tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] Request method failure captured: Jul 19 22:26:48.063561 n-d-847009-3 devstack@n-api.service[119337]: request: PUT /compute/v2.1/os-hosts/n-d-847009-3 HTTP/1.1 Jul 19 22:26:48.063561 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:26:48.063561 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:26:48.063561 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:26:48.063561 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 50 Jul 19 22:26:48.063561 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:26:48.063561 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:26:48.063561 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:26:48.063561 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:48.063561 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y-bXipjRIzo7yvAU6kr-ZZ-k9aSgE1uSyPldulNVP-KyRio8UkdQYOB7nzsrTULs6rzbhPX55kdnFcGuztQ5q770bVuV5QqmsNJ0iAhJOrwTmooGHk-lEKPUT40oH9tTzf6o77DUFaZX2v7XdNULAdbJv-WPZO9kKcaxgiJJwvkXVA Jul 19 22:26:48.063561 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:26:48.063561 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:26:48.063561 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:26:48.063561 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:26:48.063561 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:26:48.063561 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:26:48.063561 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: d5fe902f6ed645a099e963946da2783e Jul 19 22:26:48.063561 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1318394948 Jul 19 22:26:48.063561 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:26:48.063561 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:26:48.066097 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d5fe902f6ed645a099e963946da2783e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5fe902f6ed645a099e963946da2783e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d5fe902f6ed645a099e963946da2783e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5fe902f6ed645a099e963946da2783e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:48.066097 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1318394948 Jul 19 22:26:48.066097 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: d5fe902f6ed645a099e963946da2783e Jul 19 22:26:48.066097 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1318394948 Jul 19 22:26:48.066097 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-HostsAdminNegativeTestJSON-1318394948-project Jul 19 22:26:48.066097 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:26:48.066097 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:26:48.066097 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 8426cecbcfed4ad4995b2ef2f407277f Jul 19 22:26:48.066097 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1318394948-project Jul 19 22:26:48.066097 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:26:48.066097 n-d-847009-3 devstack@n-api.service[119337]: {"status": "enable", "maintenance_mode": "enable"} Jul 19 22:26:48.066097 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:26:48.066097 n-d-847009-3 devstack@n-api.service[119337]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 19 22:26:48.066097 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'n-d-847009-3', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 19 22:26:48.067711 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:48.067711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:48.067711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:48.067711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:48.067711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:48.067711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:48.067711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:26:48.067711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:26:48.067711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:48.067711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:48.067711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:26:48.067711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:26:48.067711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 19 22:26:48.067711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 19 22:26:48.067711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:26:48.067711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:26:48.067711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:26:48.067711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:26:48.067711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:26:48.067711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:26:48.070888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:26:48.070888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:26:48.070888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:26:48.070888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:26:48.070888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:26:48.070888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:26:48.070888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:26:48.070888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:26:48.070888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 19 22:26:48.070888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:48.070888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:48.070888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:48.070888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:48.070888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:48.070888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:48.070888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:26:48.070888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:26:48.070888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 19 22:26:48.070888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:48.085349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1670b628-6cea-4e6e-9bbc-bb347b8a0471 tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:48.089853 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1670b628-6cea-4e6e-9bbc-bb347b8a0471 tempest-HostsAdminNegativeTestJSON-1318394948 tempest-HostsAdminNegativeTestJSON-1318394948-project] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-847009-3" status: 403 len: 111 microversion: 2.1 time: 0.053120 Jul 19 22:26:48.091837 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 267/508] 10.222.0.25 () {60 vars in 1186 bytes} [Tue Jul 19 22:26:48 2022] PUT /compute/v2.1/os-hosts/n-d-847009-3 => generated 111 bytes in 58 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:26:48.103882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ff8c31c4-ce2c-4b1f-b1b6-fde1dbe9f40b tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Action: 'update', calling method: .version_select at 0x7f7a10ad4040>, body: {"status": null, "maintenance_mode": null} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:48.112642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ff8c31c4-ce2c-4b1f-b1b6-fde1dbe9f40b tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Request method failure captured: Jul 19 22:26:48.112642 n-d-847009-3 devstack@n-api.service[119337]: request: PUT /compute/v2.1/os-hosts/n-d-847009-3 HTTP/1.1 Jul 19 22:26:48.112642 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:26:48.112642 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:26:48.112642 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:26:48.112642 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 42 Jul 19 22:26:48.112642 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:26:48.112642 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:26:48.112642 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:26:48.112642 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:48.112642 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y-dW-P2Jeso8zwyGgAWnyO4uzd1B96l0ScGjGjGu9f27Zzp85LMOl5Rhn-l6ku98qb2NB-EvoyEVAoFYBcn_fdbSBPufpqW7ymlbXK5Ts9Mk266ZnlwgN9cGKOtwTr2JE6LvJeZNI-Ydvd08txnnjnrYgWojsH_-M62oFDaLDL_VJ4 Jul 19 22:26:48.112642 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:26:48.112642 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:26:48.112642 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:26:48.112642 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:26:48.112642 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:26:48.112642 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:26:48.112642 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: bb55d030ea924050a36d1c954c6de0d8 Jul 19 22:26:48.112642 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-316895026 Jul 19 22:26:48.112642 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:26:48.112642 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:26:48.114521 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:48.114521 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-HostsAdminNegativeTestJSON-316895026 Jul 19 22:26:48.114521 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: bb55d030ea924050a36d1c954c6de0d8 Jul 19 22:26:48.114521 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-316895026 Jul 19 22:26:48.114521 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-HostsAdminNegativeTestJSON-316895026-project-admin Jul 19 22:26:48.114521 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:26:48.114521 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:26:48.114521 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 41ce57a82f654b1e812cc48343d768dc Jul 19 22:26:48.114521 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-HostsAdminNegativeTestJSON-316895026-project-admin Jul 19 22:26:48.114521 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:26:48.114521 n-d-847009-3 devstack@n-api.service[119337]: {"status": null, "maintenance_mode": null} Jul 19 22:26:48.114521 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:26:48.114521 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 19 22:26:48.114521 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'n-d-847009-3', 'body': {'status': None, 'maintenance_mode': None}} Jul 19 22:26:48.115680 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:48.115680 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:48.115680 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:26:48.115680 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:26:48.115680 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:26:48.115680 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:26:48.115680 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 19 22:26:48.115680 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:48.115680 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 19 22:26:48.115680 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 19 22:26:48.115680 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'disable', Jul 19 22:26:48.115680 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'Enable', Jul 19 22:26:48.115680 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'Disable', Jul 19 22:26:48.115680 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 19 22:26:48.115680 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 19 22:26:48.115680 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 19 22:26:48.115680 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:48.115680 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi On instance: Jul 19 22:26:48.115680 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi None Jul 19 22:26:48.115680 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:48.115680 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:48.115680 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:48.115680 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:48.115680 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:48.115680 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:48.117419 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:48.117419 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:48.117419 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:26:48.117419 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:26:48.117419 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:48.117419 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:48.117419 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:26:48.117419 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:26:48.117419 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:26:48.117419 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:26:48.117419 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:26:48.117419 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:26:48.117419 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 19 22:26:48.117419 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:48.117419 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:48.117419 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:48.117419 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:48.117419 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:48.117419 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:48.118696 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:26:48.118696 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:26:48.118696 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 19 22:26:48.118696 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:48.120583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ff8c31c4-ce2c-4b1f-b1b6-fde1dbe9f40b tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:48.126573 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ff8c31c4-ce2c-4b1f-b1b6-fde1dbe9f40b tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-847009-3" status: 400 len: 127 microversion: 2.1 time: 0.027658 Jul 19 22:26:48.132629 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 268/509] 10.222.0.25 () {60 vars in 1186 bytes} [Tue Jul 19 22:26:48 2022] PUT /compute/v2.1/os-hosts/n-d-847009-3 => generated 127 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 22:26:48.158654 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-caeb6da9-fd5f-4a8b-9579-67e82ae7d028 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Action: 'update', calling method: .version_select at 0x7f7a109801f0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:48.163920 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.hosts [None req-caeb6da9-fd5f-4a8b-9579-67e82ae7d028 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Enabling host nonexistent_hostname. Jul 19 22:26:48.196266 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-caeb6da9-fd5f-4a8b-9579-67e82ae7d028 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 22:26:48.201972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-caeb6da9-fd5f-4a8b-9579-67e82ae7d028 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Request method failure captured: Jul 19 22:26:48.201972 n-d-847009-3 devstack@n-api.service[119337]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 19 22:26:48.201972 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:26:48.201972 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:26:48.201972 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:26:48.201972 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 50 Jul 19 22:26:48.201972 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:26:48.201972 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:26:48.201972 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:26:48.201972 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:26:48.201972 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y-dW-P2Jeso8zwyGgAWnyO4uzd1B96l0ScGjGjGu9f27Zzp85LMOl5Rhn-l6ku98qb2NB-EvoyEVAoFYBcn_fdbSBPufpqW7ymlbXK5Ts9Mk266ZnlwgN9cGKOtwTr2JE6LvJeZNI-Ydvd08txnnjnrYgWojsH_-M62oFDaLDL_VJ4 Jul 19 22:26:48.201972 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:26:48.201972 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:26:48.201972 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:26:48.201972 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:26:48.201972 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:26:48.201972 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:26:48.201972 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: bb55d030ea924050a36d1c954c6de0d8 Jul 19 22:26:48.201972 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-316895026 Jul 19 22:26:48.201972 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:26:48.201972 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:26:48.204011 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb55d030ea924050a36d1c954c6de0d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:26:48.204011 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-HostsAdminNegativeTestJSON-316895026 Jul 19 22:26:48.204011 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: bb55d030ea924050a36d1c954c6de0d8 Jul 19 22:26:48.204011 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-316895026 Jul 19 22:26:48.204011 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-HostsAdminNegativeTestJSON-316895026-project-admin Jul 19 22:26:48.204011 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:26:48.204011 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:26:48.204011 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 41ce57a82f654b1e812cc48343d768dc Jul 19 22:26:48.204011 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-HostsAdminNegativeTestJSON-316895026-project-admin Jul 19 22:26:48.204011 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:26:48.204011 n-d-847009-3 devstack@n-api.service[119337]: {"status": "enable", "maintenance_mode": "enable"} Jul 19 22:26:48.204011 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:26:48.204011 n-d-847009-3 devstack@n-api.service[119337]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 22:26:48.204011 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 19 22:26:48.205348 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:26:48.205348 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:48.205348 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 19 22:26:48.205348 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 19 22:26:48.205348 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 22:26:48.205348 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 22:26:48.205348 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:26:48.205348 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:26:48.205348 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:26:48.205348 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:26:48.205348 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 22:26:48.205348 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 22:26:48.205348 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 19 22:26:48.205348 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 19 22:26:48.205348 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:26:48.205348 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:26:48.205348 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 19 22:26:48.205348 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 19 22:26:48.207597 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 22:26:48.207597 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 22:26:48.207597 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 19 22:26:48.207597 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 19 22:26:48.207597 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 22:26:48.207597 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:48.207597 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:48.207597 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:48.207597 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:48.207597 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:48.207597 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:48.207597 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:26:48.207597 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:26:48.207597 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:26:48.207597 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:26:48.207597 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:26:48.207597 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:26:48.207597 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:26:48.207597 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:26:48.207597 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 19 22:26:48.210127 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 19 22:26:48.210127 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 19 22:26:48.210127 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:26:48.210127 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 22:26:48.210127 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:48.210127 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:26:48.210127 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:48.210127 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:26:48.210127 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:26:48.210127 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:26:48.210127 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:26:48.210127 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:26:48.210127 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 19 22:26:48.210127 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:26:48.215218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-caeb6da9-fd5f-4a8b-9579-67e82ae7d028 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:26:48.219445 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-caeb6da9-fd5f-4a8b-9579-67e82ae7d028 tempest-HostsAdminNegativeTestJSON-316895026 tempest-HostsAdminNegativeTestJSON-316895026-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.080378 Jul 19 22:26:48.223223 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 269/510] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Jul 19 22:26:48 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:26:48.246517 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-769f6ab9-8e7d-4fd1-a0b9-751bc8e2ad5b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:48.247332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-769f6ab9-8e7d-4fd1-a0b9-751bc8e2ad5b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:48.261879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-769f6ab9-8e7d-4fd1-a0b9-751bc8e2ad5b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:48.263936 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-769f6ab9-8e7d-4fd1-a0b9-751bc8e2ad5b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:48.267674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-769f6ab9-8e7d-4fd1-a0b9-751bc8e2ad5b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:48.270246 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-769f6ab9-8e7d-4fd1-a0b9-751bc8e2ad5b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:48.279561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:26:49.091336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-55bdc9f2-83ce-4766-8c9a-c93cef03b629 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:49.101615 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-55bdc9f2-83ce-4766-8c9a-c93cef03b629 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3" status: 200 len: 1389 microversion: 2.1 time: 1.344647 Jul 19 22:26:49.108584 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 242/511] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:47 2022] GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 => generated 1389 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:49.130085 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7963e217-de2e-4e6e-96b9-ea7f97f21455 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:49.133958 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7963e217-de2e-4e6e-96b9-ea7f97f21455 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:49.154832 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7963e217-de2e-4e6e-96b9-ea7f97f21455 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:49.159073 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7963e217-de2e-4e6e-96b9-ea7f97f21455 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:49.162951 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7963e217-de2e-4e6e-96b9-ea7f97f21455 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:49.164686 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7963e217-de2e-4e6e-96b9-ea7f97f21455 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:50.010771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7963e217-de2e-4e6e-96b9-ea7f97f21455 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:50.069850 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7963e217-de2e-4e6e-96b9-ea7f97f21455 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1208 microversion: 2.1 time: 0.958428 Jul 19 22:26:50.088010 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 243/512] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:49 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1208 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:50.117183 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-bd8ed6c6-0279-4ba0-b6a3-4f7958c423f2 req-d1c1a787-9ca7-459b-88df-53c4ee275734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc2efca-6346-4a22-999b-5a1fa57dcee9", "name": "network-vif-unplugged", "status": "completed", "tag": "b2782aff-48f6-4b84-8432-a744c2cd70bd"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:50.149141 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-bd8ed6c6-0279-4ba0-b6a3-4f7958c423f2 req-d1c1a787-9ca7-459b-88df-53c4ee275734 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:50.149589 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-bd8ed6c6-0279-4ba0-b6a3-4f7958c423f2 req-d1c1a787-9ca7-459b-88df-53c4ee275734 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:50.162038 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-769f6ab9-8e7d-4fd1-a0b9-751bc8e2ad5b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:50.178621 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-769f6ab9-8e7d-4fd1-a0b9-751bc8e2ad5b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 200 len: 1504 microversion: 2.1 time: 1.952666 Jul 19 22:26:50.189824 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 270/513] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:48 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 1504 bytes in 1966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:50.202561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-aecae825-e7f7-4d6a-8f00-cc7baaaaef14 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:50.210398 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-aecae825-e7f7-4d6a-8f00-cc7baaaaef14 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:50.228975 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-bd8ed6c6-0279-4ba0-b6a3-4f7958c423f2 req-d1c1a787-9ca7-459b-88df-53c4ee275734 service nova] Creating event network-vif-unplugged:b2782aff-48f6-4b84-8432-a744c2cd70bd for instance 6dc2efca-6346-4a22-999b-5a1fa57dcee9 on n-h2-847009-3 Jul 19 22:26:50.246989 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aecae825-e7f7-4d6a-8f00-cc7baaaaef14 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:50.252614 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-bd8ed6c6-0279-4ba0-b6a3-4f7958c423f2 req-d1c1a787-9ca7-459b-88df-53c4ee275734 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.160784 Jul 19 22:26:50.268516 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aecae825-e7f7-4d6a-8f00-cc7baaaaef14 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:50.270464 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aecae825-e7f7-4d6a-8f00-cc7baaaaef14 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:50.271167 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aecae825-e7f7-4d6a-8f00-cc7baaaaef14 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:50.271632 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 244/514] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:51.112760 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-206ff35f-79f1-4f02-a837-84de53c43ef1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:51.120765 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-206ff35f-79f1-4f02-a837-84de53c43ef1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:51.145586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-206ff35f-79f1-4f02-a837-84de53c43ef1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:51.146987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-206ff35f-79f1-4f02-a837-84de53c43ef1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:51.151377 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-206ff35f-79f1-4f02-a837-84de53c43ef1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:51.152135 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-206ff35f-79f1-4f02-a837-84de53c43ef1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:51.614203 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-206ff35f-79f1-4f02-a837-84de53c43ef1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:51.662314 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-206ff35f-79f1-4f02-a837-84de53c43ef1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1270 microversion: 2.1 time: 0.560303 Jul 19 22:26:51.674272 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 245/515] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:51 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1270 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:51.682487 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8c5943bf-0922-4dd7-9642-edfc246df8a9 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:51.685001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8c5943bf-0922-4dd7-9642-edfc246df8a9 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:51.697360 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8c5943bf-0922-4dd7-9642-edfc246df8a9 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:51.698479 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8c5943bf-0922-4dd7-9642-edfc246df8a9 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:51.699971 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8c5943bf-0922-4dd7-9642-edfc246df8a9 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:51.700656 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8c5943bf-0922-4dd7-9642-edfc246df8a9 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:51.881190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-aecae825-e7f7-4d6a-8f00-cc7baaaaef14 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:51.935488 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-aecae825-e7f7-4d6a-8f00-cc7baaaaef14 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3" status: 200 len: 1389 microversion: 2.1 time: 1.740523 Jul 19 22:26:51.937260 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 271/516] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:50 2022] GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 => generated 1389 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:52.497760 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8c5943bf-0922-4dd7-9642-edfc246df8a9 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:52.542731 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8c5943bf-0922-4dd7-9642-edfc246df8a9 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 200 len: 1504 microversion: 2.1 time: 0.866015 Jul 19 22:26:52.552630 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 246/517] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:51 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 1504 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:52.669107 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-8a510902-2d1e-43a1-b9a8-5bdaf0230ecc req-16eb5ad9-dd5f-45e1-9637-3e99fc153da3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dc2efca-6346-4a22-999b-5a1fa57dcee9", "tag": "b2782aff-48f6-4b84-8432-a744c2cd70bd"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:52.689869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-669c1783-b4a2-418b-b983-d2428e44899b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:52.696462 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-669c1783-b4a2-418b-b983-d2428e44899b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:52.708840 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-8a510902-2d1e-43a1-b9a8-5bdaf0230ecc req-16eb5ad9-dd5f-45e1-9637-3e99fc153da3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:52.709556 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-8a510902-2d1e-43a1-b9a8-5bdaf0230ecc req-16eb5ad9-dd5f-45e1-9637-3e99fc153da3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:52.749249 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-669c1783-b4a2-418b-b983-d2428e44899b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:52.754319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-669c1783-b4a2-418b-b983-d2428e44899b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:52.757321 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-669c1783-b4a2-418b-b983-d2428e44899b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:52.758458 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-669c1783-b4a2-418b-b983-d2428e44899b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:52.790884 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-8a510902-2d1e-43a1-b9a8-5bdaf0230ecc req-16eb5ad9-dd5f-45e1-9637-3e99fc153da3 service nova] Creating event network-changed:b2782aff-48f6-4b84-8432-a744c2cd70bd for instance 6dc2efca-6346-4a22-999b-5a1fa57dcee9 on n-h2-847009-3 Jul 19 22:26:52.809971 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-8a510902-2d1e-43a1-b9a8-5bdaf0230ecc req-16eb5ad9-dd5f-45e1-9637-3e99fc153da3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145381 Jul 19 22:26:52.814833 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 272/518] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:52.967935 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1d480924-cac9-4c26-9f7d-99491e3b7521 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:52.987602 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1d480924-cac9-4c26-9f7d-99491e3b7521 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:53.008299 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d480924-cac9-4c26-9f7d-99491e3b7521 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:53.012993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d480924-cac9-4c26-9f7d-99491e3b7521 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:53.014222 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d480924-cac9-4c26-9f7d-99491e3b7521 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:53.014817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d480924-cac9-4c26-9f7d-99491e3b7521 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:53.251441 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-669c1783-b4a2-418b-b983-d2428e44899b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:53.264406 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-669c1783-b4a2-418b-b983-d2428e44899b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1270 microversion: 2.1 time: 0.587162 Jul 19 22:26:53.279687 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 247/519] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:52 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1270 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:26:53.976527 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1d480924-cac9-4c26-9f7d-99491e3b7521 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:53.989000 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1d480924-cac9-4c26-9f7d-99491e3b7521 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3" status: 200 len: 1389 microversion: 2.1 time: 1.026829 Jul 19 22:26:53.999722 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 273/520] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:52 2022] GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 => generated 1389 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:54.008062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-62f0aeca-6fe3-4d6f-b07d-601ec266a454 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:54.009307 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-62f0aeca-6fe3-4d6f-b07d-601ec266a454 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:54.029974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62f0aeca-6fe3-4d6f-b07d-601ec266a454 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:54.030807 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62f0aeca-6fe3-4d6f-b07d-601ec266a454 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:54.032404 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62f0aeca-6fe3-4d6f-b07d-601ec266a454 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:54.033211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62f0aeca-6fe3-4d6f-b07d-601ec266a454 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:54.161173 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-398464f0-73cc-4c95-88db-054a92dedbac tempest-QuotasAdminTestV257-782151837 tempest-QuotasAdminTestV257-782151837-project-admin] Action: 'update', calling method: .version_select at 0x7f7a10a1d940>, body: {"quota_set": {"ram": "5120"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:54.516914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-398464f0-73cc-4c95-88db-054a92dedbac tempest-QuotasAdminTestV257-782151837 tempest-QuotasAdminTestV257-782151837-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:54.525728 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-398464f0-73cc-4c95-88db-054a92dedbac tempest-QuotasAdminTestV257-782151837 tempest-QuotasAdminTestV257-782151837-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:54.540858 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-398464f0-73cc-4c95-88db-054a92dedbac tempest-QuotasAdminTestV257-782151837 tempest-QuotasAdminTestV257-782151837-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:54.541590 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-398464f0-73cc-4c95-88db-054a92dedbac tempest-QuotasAdminTestV257-782151837 tempest-QuotasAdminTestV257-782151837-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:54.811905 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-398464f0-73cc-4c95-88db-054a92dedbac tempest-QuotasAdminTestV257-782151837 tempest-QuotasAdminTestV257-782151837-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/359060a8a4504a46a906230527ef1173" status: 200 len: 148 microversion: 2.57 time: 1.530554 Jul 19 22:26:54.813422 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 248/521] 10.222.0.25 () {62 vars in 1302 bytes} [Tue Jul 19 22:26:53 2022] PUT /compute/v2.1/os-quota-sets/359060a8a4504a46a906230527ef1173 => generated 148 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:26:54.820216 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8e370c3f-4865-426f-ae30-4b1811b4f2a2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:54.822058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8e370c3f-4865-426f-ae30-4b1811b4f2a2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:54.831324 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8e370c3f-4865-426f-ae30-4b1811b4f2a2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:54.832058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8e370c3f-4865-426f-ae30-4b1811b4f2a2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:54.833077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8e370c3f-4865-426f-ae30-4b1811b4f2a2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:54.833683 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8e370c3f-4865-426f-ae30-4b1811b4f2a2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:55.575745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-62f0aeca-6fe3-4d6f-b07d-601ec266a454 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:55.604035 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-62f0aeca-6fe3-4d6f-b07d-601ec266a454 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 200 len: 1504 microversion: 2.1 time: 1.602660 Jul 19 22:26:55.612542 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 274/522] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:53 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 1504 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:55.626860 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ca2607bc-b375-47c9-8efc-b04477a99923 tempest-QuotasAdminTestV257-782151837 tempest-QuotasAdminTestV257-782151837-project-admin] Calling method '.version_select at 0x7f7a10af2040>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:56.096171 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8e370c3f-4865-426f-ae30-4b1811b4f2a2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:56.119017 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8e370c3f-4865-426f-ae30-4b1811b4f2a2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1312 microversion: 2.1 time: 1.303874 Jul 19 22:26:56.120162 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 249/523] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:54 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1312 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:56.140391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-eee8bd21-20f1-4526-8da3-ea8d2642716b tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:56.144227 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-eee8bd21-20f1-4526-8da3-ea8d2642716b tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:56.162515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eee8bd21-20f1-4526-8da3-ea8d2642716b tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:56.162855 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eee8bd21-20f1-4526-8da3-ea8d2642716b tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:56.163743 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eee8bd21-20f1-4526-8da3-ea8d2642716b tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:56.164371 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eee8bd21-20f1-4526-8da3-ea8d2642716b tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:56.216506 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca2607bc-b375-47c9-8efc-b04477a99923 tempest-QuotasAdminTestV257-782151837 tempest-QuotasAdminTestV257-782151837-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:56.217193 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca2607bc-b375-47c9-8efc-b04477a99923 tempest-QuotasAdminTestV257-782151837 tempest-QuotasAdminTestV257-782151837-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:56.219928 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca2607bc-b375-47c9-8efc-b04477a99923 tempest-QuotasAdminTestV257-782151837 tempest-QuotasAdminTestV257-782151837-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:56.220974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca2607bc-b375-47c9-8efc-b04477a99923 tempest-QuotasAdminTestV257-782151837 tempest-QuotasAdminTestV257-782151837-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:56.275207 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ca2607bc-b375-47c9-8efc-b04477a99923 tempest-QuotasAdminTestV257-782151837 tempest-QuotasAdminTestV257-782151837-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/359060a8a4504a46a906230527ef1173/detail" status: 200 len: 463 microversion: 2.57 time: 0.661288 Jul 19 22:26:56.284691 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 275/524] 10.222.0.25 () {60 vars in 1303 bytes} [Tue Jul 19 22:26:55 2022] GET /compute/v2.1/os-quota-sets/359060a8a4504a46a906230527ef1173/detail => generated 463 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:26:56.635363 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d15b4199-73b8-44de-a46a-5d645034bd76 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:56.637548 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d15b4199-73b8-44de-a46a-5d645034bd76 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:56.697273 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d15b4199-73b8-44de-a46a-5d645034bd76 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:56.700615 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d15b4199-73b8-44de-a46a-5d645034bd76 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:56.708983 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d15b4199-73b8-44de-a46a-5d645034bd76 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:56.715032 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d15b4199-73b8-44de-a46a-5d645034bd76 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:56.858105 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-eee8bd21-20f1-4526-8da3-ea8d2642716b tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:56.887148 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-eee8bd21-20f1-4526-8da3-ea8d2642716b tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3" status: 200 len: 1389 microversion: 2.1 time: 0.765078 Jul 19 22:26:56.895229 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 250/525] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:56 2022] GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 => generated 1389 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:56.996554 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e840ea73-79ac-4bd7-90e8-8a3c2c92a710 tempest-QuotasAdminTestV257-782151837 tempest-QuotasAdminTestV257-782151837-project-admin] Action: 'update', calling method: .version_select at 0x7f7a10a11a60>, body: {"quota_set": {"ram": "2048"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:57.315593 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d15b4199-73b8-44de-a46a-5d645034bd76 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:57.332767 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d15b4199-73b8-44de-a46a-5d645034bd76 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 200 len: 1504 microversion: 2.1 time: 0.705032 Jul 19 22:26:57.334444 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 276/526] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:56 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 1504 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:26:57.345782 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-3c992669-c1b7-47b3-a93a-82272470d552 req-0c23761e-7782-4b97-80bc-feb744f7f0f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3", "name": "network-vif-plugged", "status": "completed", "tag": "b1477d1a-c2f1-4c8c-b3a5-db002ad3db13"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:57.358553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-3c992669-c1b7-47b3-a93a-82272470d552 req-0c23761e-7782-4b97-80bc-feb744f7f0f2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:57.360365 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-3c992669-c1b7-47b3-a93a-82272470d552 req-0c23761e-7782-4b97-80bc-feb744f7f0f2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:57.375547 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-3c992669-c1b7-47b3-a93a-82272470d552 req-0c23761e-7782-4b97-80bc-feb744f7f0f2 service nova] Creating event network-vif-plugged:b1477d1a-c2f1-4c8c-b3a5-db002ad3db13 for instance 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 on n-h2-847009-3 Jul 19 22:26:57.382596 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-3c992669-c1b7-47b3-a93a-82272470d552 req-0c23761e-7782-4b97-80bc-feb744f7f0f2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046117 Jul 19 22:26:57.384607 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 277/527] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:57.403606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7a6c32fe-05fb-4c63-b9a7-737adabbbe7f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:57.403606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7a6c32fe-05fb-4c63-b9a7-737adabbbe7f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:57.411713 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a6c32fe-05fb-4c63-b9a7-737adabbbe7f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:57.412217 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a6c32fe-05fb-4c63-b9a7-737adabbbe7f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:57.413018 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a6c32fe-05fb-4c63-b9a7-737adabbbe7f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:57.413447 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a6c32fe-05fb-4c63-b9a7-737adabbbe7f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:57.586310 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e840ea73-79ac-4bd7-90e8-8a3c2c92a710 tempest-QuotasAdminTestV257-782151837 tempest-QuotasAdminTestV257-782151837-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:57.587779 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e840ea73-79ac-4bd7-90e8-8a3c2c92a710 tempest-QuotasAdminTestV257-782151837 tempest-QuotasAdminTestV257-782151837-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:57.589441 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e840ea73-79ac-4bd7-90e8-8a3c2c92a710 tempest-QuotasAdminTestV257-782151837 tempest-QuotasAdminTestV257-782151837-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:57.590144 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e840ea73-79ac-4bd7-90e8-8a3c2c92a710 tempest-QuotasAdminTestV257-782151837 tempest-QuotasAdminTestV257-782151837-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:57.674692 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e840ea73-79ac-4bd7-90e8-8a3c2c92a710 tempest-QuotasAdminTestV257-782151837 tempest-QuotasAdminTestV257-782151837-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:57.675920 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e840ea73-79ac-4bd7-90e8-8a3c2c92a710 tempest-QuotasAdminTestV257-782151837 tempest-QuotasAdminTestV257-782151837-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:57.677137 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e840ea73-79ac-4bd7-90e8-8a3c2c92a710 tempest-QuotasAdminTestV257-782151837 tempest-QuotasAdminTestV257-782151837-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:57.677959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e840ea73-79ac-4bd7-90e8-8a3c2c92a710 tempest-QuotasAdminTestV257-782151837 tempest-QuotasAdminTestV257-782151837-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:57.720755 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:26:57.784549 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7a6c32fe-05fb-4c63-b9a7-737adabbbe7f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:57.797097 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7a6c32fe-05fb-4c63-b9a7-737adabbbe7f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1312 microversion: 2.1 time: 0.402613 Jul 19 22:26:57.798206 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 278/528] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:57 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1312 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:57.863463 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e840ea73-79ac-4bd7-90e8-8a3c2c92a710 tempest-QuotasAdminTestV257-782151837 tempest-QuotasAdminTestV257-782151837-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/359060a8a4504a46a906230527ef1173?user_id=56a09bd2c03c4106abc46aebd0fc5df4" status: 200 len: 148 microversion: 2.57 time: 0.871686 Jul 19 22:26:57.864460 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 251/529] 10.222.0.25 () {62 vars in 1383 bytes} [Tue Jul 19 22:26:56 2022] PUT /compute/v2.1/os-quota-sets/359060a8a4504a46a906230527ef1173?user_id=56a09bd2c03c4106abc46aebd0fc5df4 => generated 148 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 22:26:57.876651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e96e71cd-1fee-4834-be9f-4c8b6198f365 tempest-QuotasAdminTestV257-782151837 tempest-QuotasAdminTestV257-782151837-project-admin] Calling method '.version_select at 0x7f7a109f0f70>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:58.332843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0e08daef-554f-427a-b9e1-fed177ffe30d tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Action: 'create', calling method: .version_select at 0x7f7a109805e0>, body: {"keypair": {"name": "tempest-keypair-1655168498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRy8Zwe2Cx/QN05nwbK5tWpLfN2t5Uq5auTA1sSyyaLMDAmD5/U6UDv4l2AemruZw9iIwIIrvc9corNy7/zw5LSMK1yhe4bnnSCH56I4kbRn9bW/iW6lVw1zBKtUbcwMg=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:58.430368 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-0e08daef-554f-427a-b9e1-fed177ffe30d tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Getting quotas for project 3d53b71f56584a28b7b82c799fb96673. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:26:58.448229 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-0e08daef-554f-427a-b9e1-fed177ffe30d tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Getting quotas for user e66a794a5a4c41498472dd994128703f and project 3d53b71f56584a28b7b82c799fb96673. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:26:58.524871 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0e08daef-554f-427a-b9e1-fed177ffe30d tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.724427 Jul 19 22:26:58.531334 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 279/530] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:26:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:58.537015 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5a5b8bab-0855-4aa2-88e1-c67cc5db0bd1 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:58.540713 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5a5b8bab-0855-4aa2-88e1-c67cc5db0bd1 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:58.556561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a5b8bab-0855-4aa2-88e1-c67cc5db0bd1 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:58.557023 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a5b8bab-0855-4aa2-88e1-c67cc5db0bd1 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:58.557817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a5b8bab-0855-4aa2-88e1-c67cc5db0bd1 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:58.558262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a5b8bab-0855-4aa2-88e1-c67cc5db0bd1 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:58.631092 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:26:58.674719 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e96e71cd-1fee-4834-be9f-4c8b6198f365 tempest-QuotasAdminTestV257-782151837 tempest-QuotasAdminTestV257-782151837-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/359060a8a4504a46a906230527ef1173?user_id=56a09bd2c03c4106abc46aebd0fc5df4" status: 200 len: 190 microversion: 2.57 time: 0.802987 Jul 19 22:26:58.680772 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 252/531] 10.222.0.25 () {60 vars in 1363 bytes} [Tue Jul 19 22:26:57 2022] GET /compute/v2.1/os-quota-sets/359060a8a4504a46a906230527ef1173?user_id=56a09bd2c03c4106abc46aebd0fc5df4 => generated 190 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:26:59.505011 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5a5b8bab-0855-4aa2-88e1-c67cc5db0bd1 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:26:59.561701 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5a5b8bab-0855-4aa2-88e1-c67cc5db0bd1 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3" status: 200 len: 1389 microversion: 2.1 time: 1.025089 Jul 19 22:26:59.567593 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 280/532] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:58 2022] GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 => generated 1389 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:26:59.608574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-bb923a16-3d1e-49d4-a89b-de1647012c7f req-c6e61ed2-4758-4688-ab0f-02dca56ea868 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40f7dcd8-59a5-4e02-8774-9d5e8b4616f5", "tag": "ecd96882-feb4-4205-a4ed-b44495364c7d"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:26:59.675699 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7c06af74-0d5d-457b-bf9b-37c2eb171854 tempest-HypervisorAdminV228Test-342548985 tempest-HypervisorAdminV228Test-342548985-project-admin] Calling method '.version_select at 0x7f7a1097e5e0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:59.685650 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:26:59.685650 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:26:59.688293 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-bb923a16-3d1e-49d4-a89b-de1647012c7f req-c6e61ed2-4758-4688-ab0f-02dca56ea868 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:59.691643 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-bb923a16-3d1e-49d4-a89b-de1647012c7f req-c6e61ed2-4758-4688-ab0f-02dca56ea868 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:59.695136 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7c06af74-0d5d-457b-bf9b-37c2eb171854 tempest-HypervisorAdminV228Test-342548985 tempest-HypervisorAdminV228Test-342548985-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:59.696288 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7c06af74-0d5d-457b-bf9b-37c2eb171854 tempest-HypervisorAdminV228Test-342548985 tempest-HypervisorAdminV228Test-342548985-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:59.758959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7c06af74-0d5d-457b-bf9b-37c2eb171854 tempest-HypervisorAdminV228Test-342548985 tempest-HypervisorAdminV228Test-342548985-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:59.761272 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7c06af74-0d5d-457b-bf9b-37c2eb171854 tempest-HypervisorAdminV228Test-342548985 tempest-HypervisorAdminV228Test-342548985-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:59.797044 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-bb923a16-3d1e-49d4-a89b-de1647012c7f req-c6e61ed2-4758-4688-ab0f-02dca56ea868 service nova] Creating event network-changed:ecd96882-feb4-4205-a4ed-b44495364c7d for instance 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 on n-h1-847009-3 Jul 19 22:26:59.839760 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7c06af74-0d5d-457b-bf9b-37c2eb171854 tempest-HypervisorAdminV228Test-342548985 tempest-HypervisorAdminV228Test-342548985-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:59.840506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7c06af74-0d5d-457b-bf9b-37c2eb171854 tempest-HypervisorAdminV228Test-342548985 tempest-HypervisorAdminV228Test-342548985-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:59.845454 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-bb923a16-3d1e-49d4-a89b-de1647012c7f req-c6e61ed2-4758-4688-ab0f-02dca56ea868 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.259466 Jul 19 22:26:59.847415 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 281/533] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:26:59.868521 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7c06af74-0d5d-457b-bf9b-37c2eb171854 tempest-HypervisorAdminV228Test-342548985 tempest-HypervisorAdminV228Test-342548985-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 1.185929 Jul 19 22:26:59.868740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0178c6cd-5ce2-4f20-b834-937b5c235bd7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:59.881813 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 253/534] 10.222.0.25 () {60 vars in 1186 bytes} [Tue Jul 19 22:26:58 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:26:59.882986 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0178c6cd-5ce2-4f20-b834-937b5c235bd7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:59.907325 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d5a75710-08b5-460e-b9e8-39e58edf780f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:26:59.912275 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0178c6cd-5ce2-4f20-b834-937b5c235bd7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:59.912923 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d5a75710-08b5-460e-b9e8-39e58edf780f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:26:59.913920 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0178c6cd-5ce2-4f20-b834-937b5c235bd7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:59.915650 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0178c6cd-5ce2-4f20-b834-937b5c235bd7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:59.918358 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0178c6cd-5ce2-4f20-b834-937b5c235bd7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:59.946862 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5a75710-08b5-460e-b9e8-39e58edf780f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:59.947737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5a75710-08b5-460e-b9e8-39e58edf780f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:26:59.949229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5a75710-08b5-460e-b9e8-39e58edf780f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:26:59.954305 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5a75710-08b5-460e-b9e8-39e58edf780f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:00.831326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d5a75710-08b5-460e-b9e8-39e58edf780f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:00.850344 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d5a75710-08b5-460e-b9e8-39e58edf780f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1312 microversion: 2.1 time: 0.963754 Jul 19 22:27:00.851704 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 254/535] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:59 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1312 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:00.875729 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-be4e213c-6c63-4be7-9baa-2cb7b28f8aca tempest-HypervisorAdminV228Test-342548985 tempest-HypervisorAdminV228Test-342548985-project-admin] Calling method '.version_select at 0x7f7a10a51b80>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:00.893369 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:27:00.893369 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:27:00.895333 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0178c6cd-5ce2-4f20-b834-937b5c235bd7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:00.895982 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be4e213c-6c63-4be7-9baa-2cb7b28f8aca tempest-HypervisorAdminV228Test-342548985 tempest-HypervisorAdminV228Test-342548985-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:00.896796 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be4e213c-6c63-4be7-9baa-2cb7b28f8aca tempest-HypervisorAdminV228Test-342548985 tempest-HypervisorAdminV228Test-342548985-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:00.913180 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0178c6cd-5ce2-4f20-b834-937b5c235bd7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 200 len: 1504 microversion: 2.1 time: 1.063171 Jul 19 22:27:00.915704 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 282/536] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:26:59 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 1504 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:00.934480 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cc2e3f5b-1343-4929-a83a-1726fd084607 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:00.940854 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cc2e3f5b-1343-4929-a83a-1726fd084607 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:00.954768 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be4e213c-6c63-4be7-9baa-2cb7b28f8aca tempest-HypervisorAdminV228Test-342548985 tempest-HypervisorAdminV228Test-342548985-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:00.955405 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be4e213c-6c63-4be7-9baa-2cb7b28f8aca tempest-HypervisorAdminV228Test-342548985 tempest-HypervisorAdminV228Test-342548985-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:00.957637 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc2e3f5b-1343-4929-a83a-1726fd084607 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:00.963153 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc2e3f5b-1343-4929-a83a-1726fd084607 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:00.970958 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-be4e213c-6c63-4be7-9baa-2cb7b28f8aca tempest-HypervisorAdminV228Test-342548985 tempest-HypervisorAdminV228Test-342548985-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.110861 Jul 19 22:27:00.971258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc2e3f5b-1343-4929-a83a-1726fd084607 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:00.972174 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 255/537] 10.222.0.25 () {60 vars in 1192 bytes} [Tue Jul 19 22:27:00 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:27:00.973209 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-be4e213c-6c63-4be7-9baa-2cb7b28f8aca tempest-HypervisorAdminV228Test-342548985 tempest-HypervisorAdminV228Test-342548985-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:00.974113 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-be4e213c-6c63-4be7-9baa-2cb7b28f8aca tempest-HypervisorAdminV228Test-342548985 tempest-HypervisorAdminV228Test-342548985-project-admin] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001143 Jul 19 22:27:00.983151 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 256/538] 10.222.0.25 () {56 vars in 885 bytes} [Tue Jul 19 22:27:00 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 19 22:27:00.983395 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc2e3f5b-1343-4929-a83a-1726fd084607 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:01.213579 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cc2e3f5b-1343-4929-a83a-1726fd084607 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:01.228518 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cc2e3f5b-1343-4929-a83a-1726fd084607 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3" status: 200 len: 1588 microversion: 2.1 time: 0.310959 Jul 19 22:27:01.229166 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 283/539] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:00 2022] GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 => generated 1588 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:01.247805 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1d24c601-b572-427b-a030-345f0a488e09 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:01.248517 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1d24c601-b572-427b-a030-345f0a488e09 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:01.256765 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d24c601-b572-427b-a030-345f0a488e09 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:01.257462 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d24c601-b572-427b-a030-345f0a488e09 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:01.258405 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d24c601-b572-427b-a030-345f0a488e09 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:01.259054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d24c601-b572-427b-a030-345f0a488e09 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:01.616755 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1d24c601-b572-427b-a030-345f0a488e09 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.373254 Jul 19 22:27:01.617573 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 257/540] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 19 22:27:01 2022] GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3/os-interface => generated 284 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:01.869828 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ecc27b65-3f50-4fe2-8dde-521b85f89c14 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:01.870937 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ecc27b65-3f50-4fe2-8dde-521b85f89c14 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:01.882471 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ecc27b65-3f50-4fe2-8dde-521b85f89c14 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:01.886472 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ecc27b65-3f50-4fe2-8dde-521b85f89c14 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:01.892939 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ecc27b65-3f50-4fe2-8dde-521b85f89c14 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:01.895466 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ecc27b65-3f50-4fe2-8dde-521b85f89c14 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:01.933373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e3b7c0b3-5f24-4d9e-a145-4d7c9c0213f4 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:01.933988 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e3b7c0b3-5f24-4d9e-a145-4d7c9c0213f4 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:01.950783 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e3b7c0b3-5f24-4d9e-a145-4d7c9c0213f4 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:01.951284 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e3b7c0b3-5f24-4d9e-a145-4d7c9c0213f4 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:01.952097 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e3b7c0b3-5f24-4d9e-a145-4d7c9c0213f4 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:01.952562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e3b7c0b3-5f24-4d9e-a145-4d7c9c0213f4 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:02.797895 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ecc27b65-3f50-4fe2-8dde-521b85f89c14 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:02.806212 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ecc27b65-3f50-4fe2-8dde-521b85f89c14 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1312 microversion: 2.1 time: 0.940217 Jul 19 22:27:02.811420 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 284/541] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:01 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1312 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:02.816549 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e3b7c0b3-5f24-4d9e-a145-4d7c9c0213f4 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:02.827803 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-61a58dd9-0d56-492d-a1d5-5e97a9a0706c req-9132dc86-fb7b-4807-bbab-cce68563e7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc2efca-6346-4a22-999b-5a1fa57dcee9", "name": "network-vif-unplugged", "status": "completed", "tag": "b2782aff-48f6-4b84-8432-a744c2cd70bd"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:02.835587 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e3b7c0b3-5f24-4d9e-a145-4d7c9c0213f4 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 200 len: 1504 microversion: 2.1 time: 0.905914 Jul 19 22:27:02.838295 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 258/542] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:01 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 1504 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:02.855035 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-61a58dd9-0d56-492d-a1d5-5e97a9a0706c req-9132dc86-fb7b-4807-bbab-cce68563e7d9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:02.855795 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-61a58dd9-0d56-492d-a1d5-5e97a9a0706c req-9132dc86-fb7b-4807-bbab-cce68563e7d9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:02.912417 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-61a58dd9-0d56-492d-a1d5-5e97a9a0706c req-9132dc86-fb7b-4807-bbab-cce68563e7d9 service nova] Creating event network-vif-unplugged:b2782aff-48f6-4b84-8432-a744c2cd70bd for instance 6dc2efca-6346-4a22-999b-5a1fa57dcee9 on n-h2-847009-3 Jul 19 22:27:02.943673 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-61a58dd9-0d56-492d-a1d5-5e97a9a0706c req-9132dc86-fb7b-4807-bbab-cce68563e7d9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122465 Jul 19 22:27:02.945739 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 285/543] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:03.457471 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6f6fd353-ca62-49c5-a9ab-5fec8bb08f72 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-409173440", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "69dde816-f623-484f-b274-67b5a7bbba5e"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:03.556441 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-6f6fd353-ca62-49c5-a9ab-5fec8bb08f72 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] validate_networks() for [('69dde816-f623-484f-b274-67b5a7bbba5e', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:27:03.839583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-20c21b6c-cf40-4b58-9ced-44800043730d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:03.841866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-20c21b6c-cf40-4b58-9ced-44800043730d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:03.880257 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-20c21b6c-cf40-4b58-9ced-44800043730d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:03.881688 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-20c21b6c-cf40-4b58-9ced-44800043730d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:03.884977 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-20c21b6c-cf40-4b58-9ced-44800043730d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:03.886328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-20c21b6c-cf40-4b58-9ced-44800043730d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:04.224823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-20c21b6c-cf40-4b58-9ced-44800043730d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:04.244059 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-20c21b6c-cf40-4b58-9ced-44800043730d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1312 microversion: 2.1 time: 0.416439 Jul 19 22:27:04.263827 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 286/544] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:03 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1312 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:04.277392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a1c94224-78c5-4fd9-8b25-6a2690fa3de9 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:04.279083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a1c94224-78c5-4fd9-8b25-6a2690fa3de9 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:04.298477 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a1c94224-78c5-4fd9-8b25-6a2690fa3de9 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:04.298934 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a1c94224-78c5-4fd9-8b25-6a2690fa3de9 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:04.300060 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a1c94224-78c5-4fd9-8b25-6a2690fa3de9 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:04.300544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a1c94224-78c5-4fd9-8b25-6a2690fa3de9 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:05.142668 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a1c94224-78c5-4fd9-8b25-6a2690fa3de9 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:05.153614 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a1c94224-78c5-4fd9-8b25-6a2690fa3de9 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 200 len: 1494 microversion: 2.1 time: 0.887565 Jul 19 22:27:05.154571 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 287/545] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:04 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 1494 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:05.170987 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3044655f-c53c-4ce1-a448-a2657979268d tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1421699925", "imageRef": "33f4abcd-395f-46df-bb33-588987dbac9e", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b7105197-afae-4c0d-858c-7960273516d9"}], "security_groups": [{"name": "tempest-securitygroup--938550128"}], "key_name": "tempest-keypair-1655168498", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:05.604563 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-3044655f-c53c-4ce1-a448-a2657979268d tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] validate_networks() for [('b7105197-afae-4c0d-858c-7960273516d9', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:27:06.099823 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-6f6fd353-ca62-49c5-a9ab-5fec8bb08f72 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:27:06.100397 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-6f6fd353-ca62-49c5-a9ab-5fec8bb08f72 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:27:06.100885 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-6f6fd353-ca62-49c5-a9ab-5fec8bb08f72 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:27:06.101549 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-6f6fd353-ca62-49c5-a9ab-5fec8bb08f72 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:27:06.102059 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-6f6fd353-ca62-49c5-a9ab-5fec8bb08f72 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:27:06.116897 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=37 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:27:06.119848 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f6fd353-ca62-49c5-a9ab-5fec8bb08f72 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:06.121270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f6fd353-ca62-49c5-a9ab-5fec8bb08f72 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:06.122142 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f6fd353-ca62-49c5-a9ab-5fec8bb08f72 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:06.122651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f6fd353-ca62-49c5-a9ab-5fec8bb08f72 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:06.143328 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=14 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:27:06.179965 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-6f6fd353-ca62-49c5-a9ab-5fec8bb08f72 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Getting quotas for project d0aa317147bd4c878b3c5e4480ae6289. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:27:06.219511 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-6f6fd353-ca62-49c5-a9ab-5fec8bb08f72 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Getting quotas for user 113e94f3bdbc4a2bb284a82b0b410d68 and project d0aa317147bd4c878b3c5e4480ae6289. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:27:06.236926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:27:06.262813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6f6fd353-ca62-49c5-a9ab-5fec8bb08f72 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:27:06.274382 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6f6fd353-ca62-49c5-a9ab-5fec8bb08f72 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:27:06.395784 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6f6fd353-ca62-49c5-a9ab-5fec8bb08f72 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.555336 Jul 19 22:27:06.397239 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 259/546] 10.222.0.25 () {62 vars in 1187 bytes} [Tue Jul 19 22:27:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3558 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 22:27:06.408847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ac2801d5-f571-473f-a622-44a7a555318b tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Calling method '.version_select at 0x7f7a1097e4c0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:06.413842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac2801d5-f571-473f-a622-44a7a555318b tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:06.415136 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac2801d5-f571-473f-a622-44a7a555318b tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:06.464136 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ac2801d5-f571-473f-a622-44a7a555318b tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.065628 Jul 19 22:27:06.479343 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 260/547] 10.222.0.25 () {58 vars in 1142 bytes} [Tue Jul 19 22:27:06 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:06.492212 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3d47f3bc-00e5-49e2-a5d5-c0b296c0218c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:06.495417 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3d47f3bc-00e5-49e2-a5d5-c0b296c0218c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:06.509015 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d47f3bc-00e5-49e2-a5d5-c0b296c0218c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:06.510649 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d47f3bc-00e5-49e2-a5d5-c0b296c0218c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:06.514205 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d47f3bc-00e5-49e2-a5d5-c0b296c0218c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:06.516328 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d47f3bc-00e5-49e2-a5d5-c0b296c0218c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:06.876885 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3d47f3bc-00e5-49e2-a5d5-c0b296c0218c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:06.899987 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3d47f3bc-00e5-49e2-a5d5-c0b296c0218c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1312 microversion: 2.1 time: 0.408849 Jul 19 22:27:06.903090 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 261/548] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:06 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1312 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:06.920055 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fefa7df7-fa41-456c-bc4d-17f8a66990ac tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:06.928539 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fefa7df7-fa41-456c-bc4d-17f8a66990ac tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:06.941036 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-3044655f-c53c-4ce1-a448-a2657979268d tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:27:06.941537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-3044655f-c53c-4ce1-a448-a2657979268d tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:27:06.941917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-3044655f-c53c-4ce1-a448-a2657979268d tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:27:06.942428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-3044655f-c53c-4ce1-a448-a2657979268d tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:27:06.943759 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-3044655f-c53c-4ce1-a448-a2657979268d tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:27:06.947342 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fefa7df7-fa41-456c-bc4d-17f8a66990ac tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:06.948003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fefa7df7-fa41-456c-bc4d-17f8a66990ac tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:06.948966 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fefa7df7-fa41-456c-bc4d-17f8a66990ac tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:06.949556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fefa7df7-fa41-456c-bc4d-17f8a66990ac tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:06.965286 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3044655f-c53c-4ce1-a448-a2657979268d tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:06.967598 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3044655f-c53c-4ce1-a448-a2657979268d tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:06.969942 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3044655f-c53c-4ce1-a448-a2657979268d tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:06.972191 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3044655f-c53c-4ce1-a448-a2657979268d tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:07.053420 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-3044655f-c53c-4ce1-a448-a2657979268d tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Getting quotas for project 3d53b71f56584a28b7b82c799fb96673. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:27:07.069023 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-3044655f-c53c-4ce1-a448-a2657979268d tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Getting quotas for user e66a794a5a4c41498472dd994128703f and project 3d53b71f56584a28b7b82c799fb96673. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:27:07.086111 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3044655f-c53c-4ce1-a448-a2657979268d tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:27:07.088605 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3044655f-c53c-4ce1-a448-a2657979268d tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33f4abcd-395f-46df-bb33-588987dbac9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:27:07.213481 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3044655f-c53c-4ce1-a448-a2657979268d tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.049053 Jul 19 22:27:07.217213 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 288/549] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:27:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 2060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:27:07.229349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-06cde667-58a7-41ce-8018-fbf4e8aea0a7 req-15ccffd4-81b7-4def-adc5-d0c45910a3e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3", "tag": "b1477d1a-c2f1-4c8c-b3a5-db002ad3db13"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:07.241624 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-06cde667-58a7-41ce-8018-fbf4e8aea0a7 req-15ccffd4-81b7-4def-adc5-d0c45910a3e9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:07.244173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-06cde667-58a7-41ce-8018-fbf4e8aea0a7 req-15ccffd4-81b7-4def-adc5-d0c45910a3e9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:07.288353 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-06cde667-58a7-41ce-8018-fbf4e8aea0a7 req-15ccffd4-81b7-4def-adc5-d0c45910a3e9 service nova] Creating event network-changed:b1477d1a-c2f1-4c8c-b3a5-db002ad3db13 for instance 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 on n-h2-847009-3 Jul 19 22:27:07.289111 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fefa7df7-fa41-456c-bc4d-17f8a66990ac tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:07.308514 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fefa7df7-fa41-456c-bc4d-17f8a66990ac tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3" status: 200 len: 1588 microversion: 2.1 time: 0.391043 Jul 19 22:27:07.308794 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-06cde667-58a7-41ce-8018-fbf4e8aea0a7 req-15ccffd4-81b7-4def-adc5-d0c45910a3e9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087640 Jul 19 22:27:07.310158 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 289/550] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:07.321510 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 262/551] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:06 2022] GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 => generated 1588 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:07.327067 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-260de7b7-efc0-4c63-b995-b86075eb4ca5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:07.328474 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-260de7b7-efc0-4c63-b995-b86075eb4ca5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:07.333890 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-56d2f223-6b08-479c-911f-52275d3a303d req-bb478f97-20b5-4c55-ab4b-6bb23fad9269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f7dcd8-59a5-4e02-8774-9d5e8b4616f5", "name": "network-vif-plugged", "status": "completed", "tag": "ecd96882-feb4-4205-a4ed-b44495364c7d"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:07.356844 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-56d2f223-6b08-479c-911f-52275d3a303d req-bb478f97-20b5-4c55-ab4b-6bb23fad9269 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:07.366372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-56d2f223-6b08-479c-911f-52275d3a303d req-bb478f97-20b5-4c55-ab4b-6bb23fad9269 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:07.398331 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-56d2f223-6b08-479c-911f-52275d3a303d req-bb478f97-20b5-4c55-ab4b-6bb23fad9269 service nova] Creating event network-vif-plugged:ecd96882-feb4-4205-a4ed-b44495364c7d for instance 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 on n-h1-847009-3 Jul 19 22:27:07.413571 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-56d2f223-6b08-479c-911f-52275d3a303d req-bb478f97-20b5-4c55-ab4b-6bb23fad9269 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086607 Jul 19 22:27:07.417841 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 263/552] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:07.425959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-36ee841b-4ab6-42cd-ad77-7711961fc736 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:07.428689 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-36ee841b-4ab6-42cd-ad77-7711961fc736 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:07.445907 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-36ee841b-4ab6-42cd-ad77-7711961fc736 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:07.455503 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-36ee841b-4ab6-42cd-ad77-7711961fc736 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:07.455503 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-36ee841b-4ab6-42cd-ad77-7711961fc736 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:07.455814 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-36ee841b-4ab6-42cd-ad77-7711961fc736 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:07.547834 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-260de7b7-efc0-4c63-b995-b86075eb4ca5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:07.568393 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-260de7b7-efc0-4c63-b995-b86075eb4ca5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:07.570836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-260de7b7-efc0-4c63-b995-b86075eb4ca5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:07.575343 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-260de7b7-efc0-4c63-b995-b86075eb4ca5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 1261 microversion: 2.25 time: 0.261072 Jul 19 22:27:07.582501 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 290/553] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:27:07 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 1261 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:27:07.606848 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9849912a-9dbf-4db7-b7ba-c964368c9735 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:07.607631 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9849912a-9dbf-4db7-b7ba-c964368c9735 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:07.613859 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:27:08.074584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9849912a-9dbf-4db7-b7ba-c964368c9735 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66a794a5a4c41498472dd994128703f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53b71f56584a28b7b82c799fb96673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:08.087512 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9849912a-9dbf-4db7-b7ba-c964368c9735 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5" status: 200 len: 1246 microversion: 2.1 time: 0.498079 Jul 19 22:27:08.091079 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 291/554] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:07 2022] GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5 => generated 1246 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:08.104854 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5686cb82-a744-4987-a101-3325ebff6880 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:08.120471 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5686cb82-a744-4987-a101-3325ebff6880 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:08.163657 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5686cb82-a744-4987-a101-3325ebff6880 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:08.164513 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5686cb82-a744-4987-a101-3325ebff6880 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:08.165704 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5686cb82-a744-4987-a101-3325ebff6880 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:08.166949 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5686cb82-a744-4987-a101-3325ebff6880 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:08.319234 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-36ee841b-4ab6-42cd-ad77-7711961fc736 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 200 len: 1645 microversion: 2.1 time: 0.899461 Jul 19 22:27:08.323587 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 264/555] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:07 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 1645 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:08.603449 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bcae5a67-2921-4c5b-8ce3-64f63c2e37a3 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:08.604067 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bcae5a67-2921-4c5b-8ce3-64f63c2e37a3 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:08.621426 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bcae5a67-2921-4c5b-8ce3-64f63c2e37a3 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:08.627297 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bcae5a67-2921-4c5b-8ce3-64f63c2e37a3 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:08.628671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bcae5a67-2921-4c5b-8ce3-64f63c2e37a3 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:08.635555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bcae5a67-2921-4c5b-8ce3-64f63c2e37a3 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:08.652716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5686cb82-a744-4987-a101-3325ebff6880 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:08.684242 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5686cb82-a744-4987-a101-3325ebff6880 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1312 microversion: 2.1 time: 0.590913 Jul 19 22:27:08.710551 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 292/556] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:08 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1312 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:08.804170 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-03b305a4-3645-4a9e-8363-9de5188815fa tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-797790091", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "f8e64135-274c-4e94-95ba-a2d0adec94fe"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:08.936634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-03b305a4-3645-4a9e-8363-9de5188815fa tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] validate_networks() for [('f8e64135-274c-4e94-95ba-a2d0adec94fe', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:27:09.068476 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bcae5a67-2921-4c5b-8ce3-64f63c2e37a3 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:09.086960 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bcae5a67-2921-4c5b-8ce3-64f63c2e37a3 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:09.095550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bcae5a67-2921-4c5b-8ce3-64f63c2e37a3 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:09.102286 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bcae5a67-2921-4c5b-8ce3-64f63c2e37a3 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 1321 microversion: 2.25 time: 0.502827 Jul 19 22:27:09.104813 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 265/557] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:27:08 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 1321 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:27:09.128422 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a16a25f3-2c4e-4476-aefd-3a4bdcfc29d2 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:09.132179 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a16a25f3-2c4e-4476-aefd-3a4bdcfc29d2 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:09.164381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a16a25f3-2c4e-4476-aefd-3a4bdcfc29d2 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:09.165187 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a16a25f3-2c4e-4476-aefd-3a4bdcfc29d2 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:09.176849 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a16a25f3-2c4e-4476-aefd-3a4bdcfc29d2 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:09.177353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a16a25f3-2c4e-4476-aefd-3a4bdcfc29d2 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:09.482512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a16a25f3-2c4e-4476-aefd-3a4bdcfc29d2 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66a794a5a4c41498472dd994128703f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53b71f56584a28b7b82c799fb96673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:09.499056 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a16a25f3-2c4e-4476-aefd-3a4bdcfc29d2 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5" status: 200 len: 1242 microversion: 2.1 time: 0.392760 Jul 19 22:27:09.501139 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 266/558] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:09 2022] GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5 => generated 1242 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:09.737618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-abab9586-aabb-47f2-b046-a3f636e56404 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:09.739285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-abab9586-aabb-47f2-b046-a3f636e56404 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:09.770837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-abab9586-aabb-47f2-b046-a3f636e56404 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:09.771755 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-abab9586-aabb-47f2-b046-a3f636e56404 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:09.772672 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-abab9586-aabb-47f2-b046-a3f636e56404 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:09.788671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-abab9586-aabb-47f2-b046-a3f636e56404 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:10.940384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-abab9586-aabb-47f2-b046-a3f636e56404 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:10.948704 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-abab9586-aabb-47f2-b046-a3f636e56404 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1461 microversion: 2.1 time: 1.236342 Jul 19 22:27:10.960910 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 267/559] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:09 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1461 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:11.420594 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0df9a5ee-a3de-4d94-813d-7cd21acf5b3c tempest-InstanceUsageAuditLogTestJSON-647179237 tempest-InstanceUsageAuditLogTestJSON-647179237-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:11.423178 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:27:11.423178 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:27:11.539465 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0df9a5ee-a3de-4d94-813d-7cd21acf5b3c tempest-InstanceUsageAuditLogTestJSON-647179237 tempest-InstanceUsageAuditLogTestJSON-647179237-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-19 22:27:09" status: 200 len: 318 microversion: 2.1 time: 0.571096 Jul 19 22:27:11.557497 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 268/560] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 19 22:27:10 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-19%2022%3A27%3A09 => generated 318 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:11.575026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8d6588d4-efeb-4e27-93a7-df572c0b8e71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:11.576607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8d6588d4-efeb-4e27-93a7-df572c0b8e71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:11.597232 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-03b305a4-3645-4a9e-8363-9de5188815fa tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:27:11.598830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-03b305a4-3645-4a9e-8363-9de5188815fa tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:27:11.599940 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-03b305a4-3645-4a9e-8363-9de5188815fa tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:27:11.603918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-03b305a4-3645-4a9e-8363-9de5188815fa tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:27:11.605315 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-03b305a4-3645-4a9e-8363-9de5188815fa tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:27:11.616888 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d6588d4-efeb-4e27-93a7-df572c0b8e71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:11.627026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d6588d4-efeb-4e27-93a7-df572c0b8e71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:11.637871 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d6588d4-efeb-4e27-93a7-df572c0b8e71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:11.638989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d6588d4-efeb-4e27-93a7-df572c0b8e71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:11.643221 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=19 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:27:11.674278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-03b305a4-3645-4a9e-8363-9de5188815fa tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:11.683892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-03b305a4-3645-4a9e-8363-9de5188815fa tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:11.686194 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-03b305a4-3645-4a9e-8363-9de5188815fa tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:11.693077 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-03b305a4-3645-4a9e-8363-9de5188815fa tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:11.770840 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-03b305a4-3645-4a9e-8363-9de5188815fa tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Getting quotas for project 2619b807c1ee4dca858dae47c4686ba2. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:27:11.814247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-03b305a4-3645-4a9e-8363-9de5188815fa tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Getting quotas for user 55a214cbc1ec4cdb80ccf736f4251964 and project 2619b807c1ee4dca858dae47c4686ba2. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:27:11.847069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-03b305a4-3645-4a9e-8363-9de5188815fa tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:27:11.852903 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-03b305a4-3645-4a9e-8363-9de5188815fa tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:27:12.010883 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8d6588d4-efeb-4e27-93a7-df572c0b8e71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:12.013545 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-03b305a4-3645-4a9e-8363-9de5188815fa tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.213481 Jul 19 22:27:12.018123 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 293/561] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:27:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 3219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:27:12.022581 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8d6588d4-efeb-4e27-93a7-df572c0b8e71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:12.027578 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8d6588d4-efeb-4e27-93a7-df572c0b8e71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:12.032255 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-529fd51a-0fc0-4684-8bc8-e93f9030e6ca tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:12.034487 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8d6588d4-efeb-4e27-93a7-df572c0b8e71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 1361 microversion: 2.25 time: 0.474648 Jul 19 22:27:12.034951 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-529fd51a-0fc0-4684-8bc8-e93f9030e6ca tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:12.037359 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 269/562] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:27:11 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 1361 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:27:12.043501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-529fd51a-0fc0-4684-8bc8-e93f9030e6ca tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:12.044996 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-529fd51a-0fc0-4684-8bc8-e93f9030e6ca tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:12.046656 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-529fd51a-0fc0-4684-8bc8-e93f9030e6ca tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:12.047452 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-529fd51a-0fc0-4684-8bc8-e93f9030e6ca tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:12.055188 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f699f927-4019-4028-8eb5-bf521b49ce53 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:12.058725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f699f927-4019-4028-8eb5-bf521b49ce53 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:12.083081 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f699f927-4019-4028-8eb5-bf521b49ce53 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:12.083577 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f699f927-4019-4028-8eb5-bf521b49ce53 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:12.084392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f699f927-4019-4028-8eb5-bf521b49ce53 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:12.087640 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f699f927-4019-4028-8eb5-bf521b49ce53 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:12.222297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-529fd51a-0fc0-4684-8bc8-e93f9030e6ca tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66a794a5a4c41498472dd994128703f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53b71f56584a28b7b82c799fb96673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:12.233964 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-529fd51a-0fc0-4684-8bc8-e93f9030e6ca tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5" status: 200 len: 1304 microversion: 2.1 time: 0.213487 Jul 19 22:27:12.239403 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 294/563] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:12 2022] GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5 => generated 1304 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:12.253854 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-89579b03-62c9-4e6a-8491-02c1b9951b3d tempest-InstanceUsageAuditLogTestJSON-647179237 tempest-InstanceUsageAuditLogTestJSON-647179237-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:12.260403 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:27:12.260403 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:27:12.332673 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-89579b03-62c9-4e6a-8491-02c1b9951b3d tempest-InstanceUsageAuditLogTestJSON-647179237 tempest-InstanceUsageAuditLogTestJSON-647179237-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.086802 Jul 19 22:27:12.336154 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 295/564] 10.222.0.25 () {58 vars in 1184 bytes} [Tue Jul 19 22:27:12 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:12.346956 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5916f0d8-df59-4b0a-aafa-0b82ca042aea tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:12.362015 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5916f0d8-df59-4b0a-aafa-0b82ca042aea tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:12.397284 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f699f927-4019-4028-8eb5-bf521b49ce53 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:12.420735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f699f927-4019-4028-8eb5-bf521b49ce53 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Old instance type m1.heat2, new instance type m1.heat {{(pid=119338) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 22:27:12.430592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-f699f927-4019-4028-8eb5-bf521b49ce53 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:27:12.430592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-f699f927-4019-4028-8eb5-bf521b49ce53 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:27:12.430592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-f699f927-4019-4028-8eb5-bf521b49ce53 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:27:12.430592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-f699f927-4019-4028-8eb5-bf521b49ce53 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:27:12.439253 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-f699f927-4019-4028-8eb5-bf521b49ce53 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:27:12.499916 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5916f0d8-df59-4b0a-aafa-0b82ca042aea tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:12.514274 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5916f0d8-df59-4b0a-aafa-0b82ca042aea tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1210 microversion: 2.1 time: 0.176519 Jul 19 22:27:12.515697 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 296/565] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:12 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1210 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:12.800918 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f699f927-4019-4028-8eb5-bf521b49ce53 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "POST /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5/action" status: 202 len: 0 microversion: 2.1 time: 0.762164 Jul 19 22:27:12.801552 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 270/566] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:27:12 2022] POST /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5/action => generated 0 bytes in 763 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:27:12.812145 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ba26a3f9-cf46-4b83-8ab1-f7a5e9f968fd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:12.812988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ba26a3f9-cf46-4b83-8ab1-f7a5e9f968fd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:12.830087 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba26a3f9-cf46-4b83-8ab1-f7a5e9f968fd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:12.830583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba26a3f9-cf46-4b83-8ab1-f7a5e9f968fd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:12.831654 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba26a3f9-cf46-4b83-8ab1-f7a5e9f968fd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:12.832104 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba26a3f9-cf46-4b83-8ab1-f7a5e9f968fd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:12.838842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:27:13.070825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-da413623-fa27-48d5-849f-1a32943a78ae tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:13.072555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-da413623-fa27-48d5-849f-1a32943a78ae tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:13.104943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da413623-fa27-48d5-849f-1a32943a78ae tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:13.105398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da413623-fa27-48d5-849f-1a32943a78ae tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:13.106774 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da413623-fa27-48d5-849f-1a32943a78ae tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:13.108411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da413623-fa27-48d5-849f-1a32943a78ae tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:13.521174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ba26a3f9-cf46-4b83-8ab1-f7a5e9f968fd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:13.530313 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ba26a3f9-cf46-4b83-8ab1-f7a5e9f968fd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1470 microversion: 2.1 time: 0.722093 Jul 19 22:27:13.537068 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 297/567] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:12 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1470 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:27:13.553341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-feb44aad-eaf3-49e3-8bd9-631e3ed31862 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:13.556098 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-feb44aad-eaf3-49e3-8bd9-631e3ed31862 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:13.576839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-feb44aad-eaf3-49e3-8bd9-631e3ed31862 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:13.581207 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-feb44aad-eaf3-49e3-8bd9-631e3ed31862 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:13.582355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-feb44aad-eaf3-49e3-8bd9-631e3ed31862 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:13.583309 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-feb44aad-eaf3-49e3-8bd9-631e3ed31862 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:13.592993 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-da413623-fa27-48d5-849f-1a32943a78ae tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:13.603481 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-da413623-fa27-48d5-849f-1a32943a78ae tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:13.615529 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-da413623-fa27-48d5-849f-1a32943a78ae tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:13.617428 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-da413623-fa27-48d5-849f-1a32943a78ae tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 1361 microversion: 2.25 time: 0.553009 Jul 19 22:27:13.618430 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 271/568] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:27:13 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 1361 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:27:13.636009 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e41fd8e1-b235-453d-b93b-abaec4c786a8 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:13.637200 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e41fd8e1-b235-453d-b93b-abaec4c786a8 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:13.660033 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e41fd8e1-b235-453d-b93b-abaec4c786a8 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:13.660959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e41fd8e1-b235-453d-b93b-abaec4c786a8 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:13.664447 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e41fd8e1-b235-453d-b93b-abaec4c786a8 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:13.665453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e41fd8e1-b235-453d-b93b-abaec4c786a8 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:13.786538 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:27:13.951578 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e41fd8e1-b235-453d-b93b-abaec4c786a8 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:13.963953 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e41fd8e1-b235-453d-b93b-abaec4c786a8 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1206 microversion: 2.1 time: 0.344154 Jul 19 22:27:13.964577 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 272/569] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:13 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1206 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:14.408525 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-feb44aad-eaf3-49e3-8bd9-631e3ed31862 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66a794a5a4c41498472dd994128703f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53b71f56584a28b7b82c799fb96673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:14.423296 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-feb44aad-eaf3-49e3-8bd9-631e3ed31862 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5" status: 200 len: 1371 microversion: 2.1 time: 0.884793 Jul 19 22:27:14.432838 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 298/570] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:13 2022] GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5 => generated 1371 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:14.553036 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6cc4a4b6-0697-4d1f-89de-e8cc1a209ec6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:14.554620 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6cc4a4b6-0697-4d1f-89de-e8cc1a209ec6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:14.575133 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6cc4a4b6-0697-4d1f-89de-e8cc1a209ec6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:14.576067 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6cc4a4b6-0697-4d1f-89de-e8cc1a209ec6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:14.583307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6cc4a4b6-0697-4d1f-89de-e8cc1a209ec6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:14.583935 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6cc4a4b6-0697-4d1f-89de-e8cc1a209ec6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:14.649769 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-51b924e1-57ad-40de-8fbe-1dcc8819ea73 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:14.654839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-51b924e1-57ad-40de-8fbe-1dcc8819ea73 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:14.694972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51b924e1-57ad-40de-8fbe-1dcc8819ea73 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:14.695852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51b924e1-57ad-40de-8fbe-1dcc8819ea73 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:14.697190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51b924e1-57ad-40de-8fbe-1dcc8819ea73 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:14.718921 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51b924e1-57ad-40de-8fbe-1dcc8819ea73 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:15.892381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-51b924e1-57ad-40de-8fbe-1dcc8819ea73 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:15.913882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-51b924e1-57ad-40de-8fbe-1dcc8819ea73 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:15.916242 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6cc4a4b6-0697-4d1f-89de-e8cc1a209ec6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:15.918651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-51b924e1-57ad-40de-8fbe-1dcc8819ea73 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:15.923843 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-51b924e1-57ad-40de-8fbe-1dcc8819ea73 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 1361 microversion: 2.25 time: 1.285274 Jul 19 22:27:15.925645 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 299/571] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:27:14 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 1361 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:27:15.930835 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-83c88005-e894-474c-a163-bc6c0fc2c43a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:15.962300 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-83c88005-e894-474c-a163-bc6c0fc2c43a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:15.988975 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6cc4a4b6-0697-4d1f-89de-e8cc1a209ec6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1470 microversion: 2.1 time: 1.440150 Jul 19 22:27:15.993927 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 273/572] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:14 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1470 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:16.000058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8d4d767a-c703-4cc6-b711-593d67750ed7 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:16.001456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8d4d767a-c703-4cc6-b711-593d67750ed7 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:16.004223 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-83c88005-e894-474c-a163-bc6c0fc2c43a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:16.005021 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-83c88005-e894-474c-a163-bc6c0fc2c43a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:16.006001 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-83c88005-e894-474c-a163-bc6c0fc2c43a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:16.006552 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-83c88005-e894-474c-a163-bc6c0fc2c43a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:16.041153 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d4d767a-c703-4cc6-b711-593d67750ed7 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:16.041868 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d4d767a-c703-4cc6-b711-593d67750ed7 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:16.043354 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d4d767a-c703-4cc6-b711-593d67750ed7 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:16.044441 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d4d767a-c703-4cc6-b711-593d67750ed7 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:16.153007 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:27:16.330391 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-83c88005-e894-474c-a163-bc6c0fc2c43a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:16.351187 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-83c88005-e894-474c-a163-bc6c0fc2c43a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1268 microversion: 2.1 time: 0.424130 Jul 19 22:27:16.352197 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 300/573] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:15 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1268 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:16.697402 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8d4d767a-c703-4cc6-b711-593d67750ed7 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66a794a5a4c41498472dd994128703f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53b71f56584a28b7b82c799fb96673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:16.724583 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8d4d767a-c703-4cc6-b711-593d67750ed7 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5" status: 200 len: 1371 microversion: 2.1 time: 0.729088 Jul 19 22:27:16.730421 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 274/574] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:15 2022] GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5 => generated 1371 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:16.956336 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-66575a59-68d1-4da0-a26a-df60c055649c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:16.957579 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-66575a59-68d1-4da0-a26a-df60c055649c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:16.973512 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-66575a59-68d1-4da0-a26a-df60c055649c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:16.976772 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-66575a59-68d1-4da0-a26a-df60c055649c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:16.979271 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-66575a59-68d1-4da0-a26a-df60c055649c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:16.982096 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-66575a59-68d1-4da0-a26a-df60c055649c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:17.010112 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-28a30b37-c062-4cc0-8478-b57a4a324c3c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:17.010940 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-28a30b37-c062-4cc0-8478-b57a4a324c3c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:17.023925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-28a30b37-c062-4cc0-8478-b57a4a324c3c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:17.025236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-28a30b37-c062-4cc0-8478-b57a4a324c3c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:17.027088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-28a30b37-c062-4cc0-8478-b57a4a324c3c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:17.028165 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-28a30b37-c062-4cc0-8478-b57a4a324c3c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:17.587166 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-28a30b37-c062-4cc0-8478-b57a4a324c3c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:17.601992 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-28a30b37-c062-4cc0-8478-b57a4a324c3c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1470 microversion: 2.1 time: 0.596027 Jul 19 22:27:17.612625 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 275/575] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:17 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1470 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:17.626818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e16fd0e0-719c-44a5-abbd-43aa22a4c847 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:17.627504 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e16fd0e0-719c-44a5-abbd-43aa22a4c847 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:17.636273 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e16fd0e0-719c-44a5-abbd-43aa22a4c847 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:17.637090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e16fd0e0-719c-44a5-abbd-43aa22a4c847 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:17.638106 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e16fd0e0-719c-44a5-abbd-43aa22a4c847 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:17.638774 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e16fd0e0-719c-44a5-abbd-43aa22a4c847 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:17.709302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-66575a59-68d1-4da0-a26a-df60c055649c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:17.731931 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-66575a59-68d1-4da0-a26a-df60c055649c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:17.737137 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-66575a59-68d1-4da0-a26a-df60c055649c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:17.739001 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-66575a59-68d1-4da0-a26a-df60c055649c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 1361 microversion: 2.25 time: 0.788360 Jul 19 22:27:17.740900 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 301/576] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:27:16 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 1361 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:27:17.753321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c42e116e-fbc6-4c60-a621-86d2c778db93 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:17.754242 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c42e116e-fbc6-4c60-a621-86d2c778db93 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:17.769995 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c42e116e-fbc6-4c60-a621-86d2c778db93 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:17.770635 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c42e116e-fbc6-4c60-a621-86d2c778db93 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:17.772119 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c42e116e-fbc6-4c60-a621-86d2c778db93 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:17.776882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c42e116e-fbc6-4c60-a621-86d2c778db93 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:17.802287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e16fd0e0-719c-44a5-abbd-43aa22a4c847 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:17.820535 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e16fd0e0-719c-44a5-abbd-43aa22a4c847 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1268 microversion: 2.1 time: 0.206154 Jul 19 22:27:17.821762 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 276/577] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:17 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1268 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:18.279604 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c42e116e-fbc6-4c60-a621-86d2c778db93 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66a794a5a4c41498472dd994128703f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53b71f56584a28b7b82c799fb96673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:18.297967 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c42e116e-fbc6-4c60-a621-86d2c778db93 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5" status: 200 len: 1371 microversion: 2.1 time: 0.552250 Jul 19 22:27:18.298579 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 302/578] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:17 2022] GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5 => generated 1371 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:18.626082 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f1459af5-c12d-473f-a51a-7ec364e013ad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:18.629524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f1459af5-c12d-473f-a51a-7ec364e013ad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:18.689386 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1459af5-c12d-473f-a51a-7ec364e013ad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:18.693413 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1459af5-c12d-473f-a51a-7ec364e013ad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:18.699551 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1459af5-c12d-473f-a51a-7ec364e013ad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:18.703964 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1459af5-c12d-473f-a51a-7ec364e013ad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:18.759645 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-390b1351-75e7-4d5e-bd59-ae1f1f24c847 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:18.760266 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-390b1351-75e7-4d5e-bd59-ae1f1f24c847 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:18.789103 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-390b1351-75e7-4d5e-bd59-ae1f1f24c847 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:18.789870 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-390b1351-75e7-4d5e-bd59-ae1f1f24c847 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:18.801481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-390b1351-75e7-4d5e-bd59-ae1f1f24c847 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:18.801481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-390b1351-75e7-4d5e-bd59-ae1f1f24c847 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:20.113011 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f1459af5-c12d-473f-a51a-7ec364e013ad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:20.149053 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f1459af5-c12d-473f-a51a-7ec364e013ad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1470 microversion: 2.1 time: 1.530155 Jul 19 22:27:20.152545 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 277/579] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:18 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1470 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:20.165816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e08946cc-9632-4975-b4ea-c61035cbc5d6 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:20.175265 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e08946cc-9632-4975-b4ea-c61035cbc5d6 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:20.198539 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e08946cc-9632-4975-b4ea-c61035cbc5d6 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:20.199908 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e08946cc-9632-4975-b4ea-c61035cbc5d6 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:20.201539 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e08946cc-9632-4975-b4ea-c61035cbc5d6 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:20.204597 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e08946cc-9632-4975-b4ea-c61035cbc5d6 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:20.384077 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-390b1351-75e7-4d5e-bd59-ae1f1f24c847 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:20.416249 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-390b1351-75e7-4d5e-bd59-ae1f1f24c847 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:20.417922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-390b1351-75e7-4d5e-bd59-ae1f1f24c847 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:20.420314 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-390b1351-75e7-4d5e-bd59-ae1f1f24c847 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 1361 microversion: 2.25 time: 1.664536 Jul 19 22:27:20.423464 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 303/580] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:27:18 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 1361 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:27:20.445834 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-47761b6b-019d-4a2b-9034-d87bb50664be req-46cad0a0-a627-4c88-9d8c-704d3bec5ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "374ab7ad-b415-4516-8aa8-282bdfaa6600", "tag": "726ca660-8b38-4bdc-a645-af1d096b28e4"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:20.462474 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-47761b6b-019d-4a2b-9034-d87bb50664be req-46cad0a0-a627-4c88-9d8c-704d3bec5ba7 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:20.465620 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-47761b6b-019d-4a2b-9034-d87bb50664be req-46cad0a0-a627-4c88-9d8c-704d3bec5ba7 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:20.502021 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-47761b6b-019d-4a2b-9034-d87bb50664be req-46cad0a0-a627-4c88-9d8c-704d3bec5ba7 service nova] Creating event network-changed:726ca660-8b38-4bdc-a645-af1d096b28e4 for instance 374ab7ad-b415-4516-8aa8-282bdfaa6600 on n-h2-847009-3 Jul 19 22:27:20.515076 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-47761b6b-019d-4a2b-9034-d87bb50664be req-46cad0a0-a627-4c88-9d8c-704d3bec5ba7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088230 Jul 19 22:27:20.516649 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 304/581] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:20.523146 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d917b681-7d10-4c76-a82d-8aee6834ebfb tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:20.525065 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d917b681-7d10-4c76-a82d-8aee6834ebfb tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:20.536365 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d917b681-7d10-4c76-a82d-8aee6834ebfb tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:20.537173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d917b681-7d10-4c76-a82d-8aee6834ebfb tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:20.538262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d917b681-7d10-4c76-a82d-8aee6834ebfb tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:20.538933 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d917b681-7d10-4c76-a82d-8aee6834ebfb tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:21.394511 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d917b681-7d10-4c76-a82d-8aee6834ebfb tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66a794a5a4c41498472dd994128703f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53b71f56584a28b7b82c799fb96673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:21.413869 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d917b681-7d10-4c76-a82d-8aee6834ebfb tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5" status: 200 len: 1371 microversion: 2.1 time: 0.895615 Jul 19 22:27:21.414974 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 305/582] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:20 2022] GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5 => generated 1371 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:21.429957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-28ec7c6f-8ba2-4fe5-bc1a-1de0f534771b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:21.431198 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-28ec7c6f-8ba2-4fe5-bc1a-1de0f534771b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:21.451929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28ec7c6f-8ba2-4fe5-bc1a-1de0f534771b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:21.458688 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28ec7c6f-8ba2-4fe5-bc1a-1de0f534771b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:21.459818 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28ec7c6f-8ba2-4fe5-bc1a-1de0f534771b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:21.460421 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28ec7c6f-8ba2-4fe5-bc1a-1de0f534771b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:21.498111 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=9 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:27:21.690385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e08946cc-9632-4975-b4ea-c61035cbc5d6 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:21.701460 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e08946cc-9632-4975-b4ea-c61035cbc5d6 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1310 microversion: 2.1 time: 1.547085 Jul 19 22:27:21.712769 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 278/583] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:20 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1310 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:21.722478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-820ffe03-f1da-4e31-bc7f-68364b68b240 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:21.725927 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-820ffe03-f1da-4e31-bc7f-68364b68b240 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:21.734791 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=4 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:27:21.743547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-820ffe03-f1da-4e31-bc7f-68364b68b240 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:21.747586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-820ffe03-f1da-4e31-bc7f-68364b68b240 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:21.748756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-820ffe03-f1da-4e31-bc7f-68364b68b240 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:21.752559 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-820ffe03-f1da-4e31-bc7f-68364b68b240 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:22.071500 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-28ec7c6f-8ba2-4fe5-bc1a-1de0f534771b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:22.081957 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-28ec7c6f-8ba2-4fe5-bc1a-1de0f534771b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1475 microversion: 2.1 time: 0.665847 Jul 19 22:27:22.086583 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 306/584] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:21 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1475 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:22.226551 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-820ffe03-f1da-4e31-bc7f-68364b68b240 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:22.240300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-820ffe03-f1da-4e31-bc7f-68364b68b240 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:22.244775 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-820ffe03-f1da-4e31-bc7f-68364b68b240 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:22.250735 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-820ffe03-f1da-4e31-bc7f-68364b68b240 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 1361 microversion: 2.25 time: 0.536319 Jul 19 22:27:22.254415 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 279/585] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:27:21 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 1361 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:27:22.443306 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-aa29e995-7530-4c94-b694-e48159d92844 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:22.444020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-aa29e995-7530-4c94-b694-e48159d92844 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:22.456389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa29e995-7530-4c94-b694-e48159d92844 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:22.462641 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa29e995-7530-4c94-b694-e48159d92844 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:22.464516 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa29e995-7530-4c94-b694-e48159d92844 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:22.471966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa29e995-7530-4c94-b694-e48159d92844 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:22.525894 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=11 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:27:22.722333 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7a826e78-3566-4176-9e1e-16c0b789e290 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:22.722980 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7a826e78-3566-4176-9e1e-16c0b789e290 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:22.748219 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a826e78-3566-4176-9e1e-16c0b789e290 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:22.749247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a826e78-3566-4176-9e1e-16c0b789e290 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:22.750876 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a826e78-3566-4176-9e1e-16c0b789e290 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:22.755807 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a826e78-3566-4176-9e1e-16c0b789e290 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:23.164953 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-aa29e995-7530-4c94-b694-e48159d92844 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66a794a5a4c41498472dd994128703f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53b71f56584a28b7b82c799fb96673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:23.185505 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-aa29e995-7530-4c94-b694-e48159d92844 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5" status: 200 len: 1371 microversion: 2.1 time: 0.746222 Jul 19 22:27:23.187024 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 307/586] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:22 2022] GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5 => generated 1371 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:23.212211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-043880c4-913d-4d17-87cb-90fd9b62772c req-cb09995d-fa27-43e2-9445-d2ea7d39766b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40ce1872-5f47-4acc-ba80-696b87b062b5", "tag": "ea7d48d9-65be-47a1-9821-5c0e56f6eed7"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:23.241299 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-043880c4-913d-4d17-87cb-90fd9b62772c req-cb09995d-fa27-43e2-9445-d2ea7d39766b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:23.241783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-043880c4-913d-4d17-87cb-90fd9b62772c req-cb09995d-fa27-43e2-9445-d2ea7d39766b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:23.341752 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-043880c4-913d-4d17-87cb-90fd9b62772c req-cb09995d-fa27-43e2-9445-d2ea7d39766b service nova] Creating event network-changed:ea7d48d9-65be-47a1-9821-5c0e56f6eed7 for instance 40ce1872-5f47-4acc-ba80-696b87b062b5 on n-h2-847009-3 Jul 19 22:27:23.379344 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-043880c4-913d-4d17-87cb-90fd9b62772c req-cb09995d-fa27-43e2-9445-d2ea7d39766b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181203 Jul 19 22:27:23.386390 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 308/587] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:23.398694 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a018bb05-06e8-4416-9814-8eab8d5eb9fb tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:23.400203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a018bb05-06e8-4416-9814-8eab8d5eb9fb tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:23.432306 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a018bb05-06e8-4416-9814-8eab8d5eb9fb tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:23.432826 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a018bb05-06e8-4416-9814-8eab8d5eb9fb tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:23.433693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a018bb05-06e8-4416-9814-8eab8d5eb9fb tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:23.434198 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a018bb05-06e8-4416-9814-8eab8d5eb9fb tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:23.794615 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7a826e78-3566-4176-9e1e-16c0b789e290 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:23.808440 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7a826e78-3566-4176-9e1e-16c0b789e290 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1310 microversion: 2.1 time: 1.091887 Jul 19 22:27:23.830963 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 280/588] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:22 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1310 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:23.835994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4ad1ae1b-4987-4ad9-9346-16c800d9b196 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:23.836602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4ad1ae1b-4987-4ad9-9346-16c800d9b196 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:23.843455 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ad1ae1b-4987-4ad9-9346-16c800d9b196 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:23.844000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ad1ae1b-4987-4ad9-9346-16c800d9b196 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:23.844792 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ad1ae1b-4987-4ad9-9346-16c800d9b196 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:23.847742 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ad1ae1b-4987-4ad9-9346-16c800d9b196 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:24.518120 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a018bb05-06e8-4416-9814-8eab8d5eb9fb tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:24.520121 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4ad1ae1b-4987-4ad9-9346-16c800d9b196 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:24.528782 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4ad1ae1b-4987-4ad9-9346-16c800d9b196 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:24.530844 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4ad1ae1b-4987-4ad9-9346-16c800d9b196 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:24.557514 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4ad1ae1b-4987-4ad9-9346-16c800d9b196 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 1361 microversion: 2.25 time: 0.723706 Jul 19 22:27:24.561145 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 281/589] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:27:23 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 1361 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:27:24.585899 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a018bb05-06e8-4416-9814-8eab8d5eb9fb tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1475 microversion: 2.1 time: 1.179888 Jul 19 22:27:24.608326 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 309/590] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:23 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1475 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:24.643246 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7a60c192-ee65-4ef4-8ad5-e1754d9510b9 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:24.649930 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7a60c192-ee65-4ef4-8ad5-e1754d9510b9 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:24.658883 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a60c192-ee65-4ef4-8ad5-e1754d9510b9 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:24.659730 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a60c192-ee65-4ef4-8ad5-e1754d9510b9 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:24.660744 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a60c192-ee65-4ef4-8ad5-e1754d9510b9 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:24.661400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a60c192-ee65-4ef4-8ad5-e1754d9510b9 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:24.866392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-006a7752-e7ee-4181-b680-2304db53dc0d tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Calling method '.version_select at 0x7f7a10941d30>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:24.949898 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7a60c192-ee65-4ef4-8ad5-e1754d9510b9 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66a794a5a4c41498472dd994128703f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53b71f56584a28b7b82c799fb96673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:24.961436 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7a60c192-ee65-4ef4-8ad5-e1754d9510b9 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5" status: 200 len: 1371 microversion: 2.1 time: 0.333456 Jul 19 22:27:24.979193 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 310/591] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:24 2022] GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5 => generated 1371 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:24.986614 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a152989f-2f4d-4fa9-ad48-ab5e21c61abf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:24.987288 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a152989f-2f4d-4fa9-ad48-ab5e21c61abf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:25.008507 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a152989f-2f4d-4fa9-ad48-ab5e21c61abf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:25.012032 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a152989f-2f4d-4fa9-ad48-ab5e21c61abf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:25.013457 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a152989f-2f4d-4fa9-ad48-ab5e21c61abf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:25.025402 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a152989f-2f4d-4fa9-ad48-ab5e21c61abf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:25.029415 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-006a7752-e7ee-4181-b680-2304db53dc0d tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/ef13183f8c6448bdb5b227b85b638cb8" status: 200 len: 371 microversion: 2.1 time: 0.462932 Jul 19 22:27:25.030297 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 282/592] 10.222.0.25 () {58 vars in 1241 bytes} [Tue Jul 19 22:27:24 2022] GET /compute/v2.1/os-quota-sets/ef13183f8c6448bdb5b227b85b638cb8 => generated 371 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:25.044743 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3c3ae9f2-5b9c-4435-9f3a-ac6a9fcacdaa tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Action: 'update', calling method: .version_select at 0x7f7a109f0700>, body: {"quota_set": {"ram": "5120"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:25.227468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3c3ae9f2-5b9c-4435-9f3a-ac6a9fcacdaa tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:25.231188 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3c3ae9f2-5b9c-4435-9f3a-ac6a9fcacdaa tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:25.236274 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3c3ae9f2-5b9c-4435-9f3a-ac6a9fcacdaa tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:25.238212 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3c3ae9f2-5b9c-4435-9f3a-ac6a9fcacdaa tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:25.451068 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3c3ae9f2-5b9c-4435-9f3a-ac6a9fcacdaa tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/ef13183f8c6448bdb5b227b85b638cb8" status: 200 len: 328 microversion: 2.1 time: 0.413286 Jul 19 22:27:25.454616 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 283/593] 10.222.0.25 () {60 vars in 1261 bytes} [Tue Jul 19 22:27:25 2022] PUT /compute/v2.1/os-quota-sets/ef13183f8c6448bdb5b227b85b638cb8 => generated 328 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:27:25.470454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dbb21784-21e2-4e2a-a0ed-0bae6aaf7981 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:25.511710 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dbb21784-21e2-4e2a-a0ed-0bae6aaf7981 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-quota-sets/ef13183f8c6448bdb5b227b85b638cb8" status: 202 len: 0 microversion: 2.1 time: 0.049658 Jul 19 22:27:25.512623 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 284/594] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 19 22:27:25 2022] DELETE /compute/v2.1/os-quota-sets/ef13183f8c6448bdb5b227b85b638cb8 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:27:25.527770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-485040bd-a4cf-40ba-b935-750d25e7dc10 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Calling method '.version_select at 0x7f7a10a51b80>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:25.646495 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-485040bd-a4cf-40ba-b935-750d25e7dc10 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/ef13183f8c6448bdb5b227b85b638cb8" status: 200 len: 371 microversion: 2.1 time: 0.129579 Jul 19 22:27:25.647807 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 285/595] 10.222.0.25 () {58 vars in 1241 bytes} [Tue Jul 19 22:27:25 2022] GET /compute/v2.1/os-quota-sets/ef13183f8c6448bdb5b227b85b638cb8 => generated 371 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:27:25.664370 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dfb6cc45-dce8-40b7-86d0-f3f8542eec75 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:25.666734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dfb6cc45-dce8-40b7-86d0-f3f8542eec75 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:25.672244 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:27:25.690414 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfb6cc45-dce8-40b7-86d0-f3f8542eec75 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:25.690414 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfb6cc45-dce8-40b7-86d0-f3f8542eec75 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:25.690414 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfb6cc45-dce8-40b7-86d0-f3f8542eec75 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:25.690414 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfb6cc45-dce8-40b7-86d0-f3f8542eec75 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:25.813303 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a152989f-2f4d-4fa9-ad48-ab5e21c61abf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:25.825144 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a152989f-2f4d-4fa9-ad48-ab5e21c61abf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1310 microversion: 2.1 time: 0.844316 Jul 19 22:27:25.833479 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 311/596] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:24 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1310 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:25.854796 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-072a0f21-db74-421d-af49-928ad4b513e7 req-ee949183-db69-42f1-bed1-8b8b993ea6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f752d932-1177-43ae-89b0-86a439bb446a", "tag": "9795f500-4e5c-483d-95e2-204859a4140a"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:25.873112 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-072a0f21-db74-421d-af49-928ad4b513e7 req-ee949183-db69-42f1-bed1-8b8b993ea6d5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:25.876186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-072a0f21-db74-421d-af49-928ad4b513e7 req-ee949183-db69-42f1-bed1-8b8b993ea6d5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:25.912647 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-072a0f21-db74-421d-af49-928ad4b513e7 req-ee949183-db69-42f1-bed1-8b8b993ea6d5 service nova] Creating event network-changed:9795f500-4e5c-483d-95e2-204859a4140a for instance f752d932-1177-43ae-89b0-86a439bb446a on n-h1-847009-3 Jul 19 22:27:25.925015 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-072a0f21-db74-421d-af49-928ad4b513e7 req-ee949183-db69-42f1-bed1-8b8b993ea6d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087289 Jul 19 22:27:25.930744 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 312/597] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:25.949583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cf56f5a1-7cef-40ec-9947-9045cafbaa16 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:25.950745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cf56f5a1-7cef-40ec-9947-9045cafbaa16 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:25.968681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cf56f5a1-7cef-40ec-9947-9045cafbaa16 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:25.972936 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cf56f5a1-7cef-40ec-9947-9045cafbaa16 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:25.974512 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cf56f5a1-7cef-40ec-9947-9045cafbaa16 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:25.975239 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cf56f5a1-7cef-40ec-9947-9045cafbaa16 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:26.278444 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dfb6cc45-dce8-40b7-86d0-f3f8542eec75 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:26.290684 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dfb6cc45-dce8-40b7-86d0-f3f8542eec75 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:26.293081 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dfb6cc45-dce8-40b7-86d0-f3f8542eec75 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:26.295193 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dfb6cc45-dce8-40b7-86d0-f3f8542eec75 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 1361 microversion: 2.25 time: 0.645766 Jul 19 22:27:26.307597 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 286/598] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:27:25 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 1361 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:27:26.307597 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0f8e6c57-834c-45da-bf70-addb83a95512 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Calling method '.version_select at 0x7f7a1089e550>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:26.513233 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cf56f5a1-7cef-40ec-9947-9045cafbaa16 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:26.525510 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cf56f5a1-7cef-40ec-9947-9045cafbaa16 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1475 microversion: 2.1 time: 0.589563 Jul 19 22:27:26.537928 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 313/599] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:25 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1475 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:26.568026 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3672824b-2c3f-47a5-b9de-e955307467b1 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:26.569360 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3672824b-2c3f-47a5-b9de-e955307467b1 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:26.583635 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3672824b-2c3f-47a5-b9de-e955307467b1 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:26.587443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3672824b-2c3f-47a5-b9de-e955307467b1 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:26.589532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3672824b-2c3f-47a5-b9de-e955307467b1 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:26.592264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3672824b-2c3f-47a5-b9de-e955307467b1 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:26.835399 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0f8e6c57-834c-45da-bf70-addb83a95512 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/fc195ae4fa9145ab94256a4a0ff6f33a/defaults" status: 200 len: 371 microversion: 2.1 time: 0.536214 Jul 19 22:27:26.836313 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 287/600] 10.222.0.25 () {58 vars in 1268 bytes} [Tue Jul 19 22:27:26 2022] GET /compute/v2.1/os-quota-sets/fc195ae4fa9145ab94256a4a0ff6f33a/defaults => generated 371 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:26.853129 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d7cd9b06-48c1-44e4-8cca-e7b3ed4ed3e3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:26.853921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d7cd9b06-48c1-44e4-8cca-e7b3ed4ed3e3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:26.865756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7cd9b06-48c1-44e4-8cca-e7b3ed4ed3e3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:26.866565 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7cd9b06-48c1-44e4-8cca-e7b3ed4ed3e3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:26.867707 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7cd9b06-48c1-44e4-8cca-e7b3ed4ed3e3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:26.875534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7cd9b06-48c1-44e4-8cca-e7b3ed4ed3e3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:27.125129 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3672824b-2c3f-47a5-b9de-e955307467b1 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66a794a5a4c41498472dd994128703f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53b71f56584a28b7b82c799fb96673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:27.140461 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3672824b-2c3f-47a5-b9de-e955307467b1 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5" status: 200 len: 1371 microversion: 2.1 time: 0.596055 Jul 19 22:27:27.141275 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 314/601] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:26 2022] GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5 => generated 1371 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:27.254426 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e19410f2-a5df-456c-9a5d-4a1123cf72ae tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Action: 'update', calling method: .version_select at 0x7f7a108fa430>, body: {"quota_set": {"ram": "5120"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:27.392547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d7cd9b06-48c1-44e4-8cca-e7b3ed4ed3e3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:27.403761 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d7cd9b06-48c1-44e4-8cca-e7b3ed4ed3e3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1310 microversion: 2.1 time: 0.554439 Jul 19 22:27:27.415591 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 288/602] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:26 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1310 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:27:27.424469 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b12ada0a-8868-4bb0-9939-54a58f01ed27 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:27.425342 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b12ada0a-8868-4bb0-9939-54a58f01ed27 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:27.433683 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b12ada0a-8868-4bb0-9939-54a58f01ed27 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:27.434664 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b12ada0a-8868-4bb0-9939-54a58f01ed27 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:27.435966 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b12ada0a-8868-4bb0-9939-54a58f01ed27 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:27.438208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b12ada0a-8868-4bb0-9939-54a58f01ed27 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:27.621003 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e19410f2-a5df-456c-9a5d-4a1123cf72ae tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:27.621745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e19410f2-a5df-456c-9a5d-4a1123cf72ae tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:27.625500 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e19410f2-a5df-456c-9a5d-4a1123cf72ae tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:27.628737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e19410f2-a5df-456c-9a5d-4a1123cf72ae tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:27.776876 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e19410f2-a5df-456c-9a5d-4a1123cf72ae tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/a43183b5d45245139678f9c498b8a77e" status: 200 len: 328 microversion: 2.1 time: 0.531856 Jul 19 22:27:27.777848 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 315/603] 10.222.0.25 () {60 vars in 1261 bytes} [Tue Jul 19 22:27:27 2022] PUT /compute/v2.1/os-quota-sets/a43183b5d45245139678f9c498b8a77e => generated 328 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:27.783971 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d775b311-493a-490d-ab0f-c9eb7561885e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:27.785753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d775b311-493a-490d-ab0f-c9eb7561885e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:27.800085 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d775b311-493a-490d-ab0f-c9eb7561885e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:27.802441 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d775b311-493a-490d-ab0f-c9eb7561885e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:27.804882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d775b311-493a-490d-ab0f-c9eb7561885e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:27.806090 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d775b311-493a-490d-ab0f-c9eb7561885e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:27.839235 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:27:28.527713 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b12ada0a-8868-4bb0-9939-54a58f01ed27 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:28.548208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b12ada0a-8868-4bb0-9939-54a58f01ed27 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:28.551266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b12ada0a-8868-4bb0-9939-54a58f01ed27 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:28.554053 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b12ada0a-8868-4bb0-9939-54a58f01ed27 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 1361 microversion: 2.25 time: 1.136950 Jul 19 22:27:28.555165 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 289/604] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:27:27 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 1361 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:27:28.561654 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7303e14b-2a41-4630-8035-97bbe10a3766 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Calling method '.version_select at 0x7f7a10891430>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:28.621291 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d775b311-493a-490d-ab0f-c9eb7561885e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:28.634612 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d775b311-493a-490d-ab0f-c9eb7561885e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1475 microversion: 2.1 time: 0.854694 Jul 19 22:27:28.645835 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 316/605] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:27 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1475 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:28.653640 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4139916b-5293-4f0a-9699-d37d25815752 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:28.658513 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4139916b-5293-4f0a-9699-d37d25815752 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:28.677937 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4139916b-5293-4f0a-9699-d37d25815752 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:28.678717 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4139916b-5293-4f0a-9699-d37d25815752 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:28.679856 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4139916b-5293-4f0a-9699-d37d25815752 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:28.680456 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4139916b-5293-4f0a-9699-d37d25815752 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:28.693925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7303e14b-2a41-4630-8035-97bbe10a3766 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:28.694734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7303e14b-2a41-4630-8035-97bbe10a3766 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:28.696332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7303e14b-2a41-4630-8035-97bbe10a3766 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:28.699914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7303e14b-2a41-4630-8035-97bbe10a3766 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:28.754203 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7303e14b-2a41-4630-8035-97bbe10a3766 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/a43183b5d45245139678f9c498b8a77e/detail" status: 200 len: 916 microversion: 2.1 time: 0.197462 Jul 19 22:27:28.759101 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 290/606] 10.222.0.25 () {58 vars in 1262 bytes} [Tue Jul 19 22:27:28 2022] GET /compute/v2.1/os-quota-sets/a43183b5d45245139678f9c498b8a77e/detail => generated 916 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:28.765689 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0cf12316-03c4-4169-b077-27516ebeb41f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:28.767077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0cf12316-03c4-4169-b077-27516ebeb41f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:28.784167 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cf12316-03c4-4169-b077-27516ebeb41f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:28.784753 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cf12316-03c4-4169-b077-27516ebeb41f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:28.785791 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cf12316-03c4-4169-b077-27516ebeb41f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:28.794186 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cf12316-03c4-4169-b077-27516ebeb41f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:28.867290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4139916b-5293-4f0a-9699-d37d25815752 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66a794a5a4c41498472dd994128703f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53b71f56584a28b7b82c799fb96673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:28.882427 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4139916b-5293-4f0a-9699-d37d25815752 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5" status: 200 len: 1371 microversion: 2.1 time: 0.235477 Jul 19 22:27:28.896174 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 317/607] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:28 2022] GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5 => generated 1371 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:29.112803 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8158e445-75b3-4ba7-b10b-0faebeb94e98 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Action: 'update', calling method: .version_select at 0x7f7a1096a280>, body: {"quota_set": {"ram": "2048"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:29.214340 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0cf12316-03c4-4169-b077-27516ebeb41f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:29.228185 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0cf12316-03c4-4169-b077-27516ebeb41f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1310 microversion: 2.1 time: 0.467661 Jul 19 22:27:29.239543 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 291/608] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:28 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1310 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:29.274815 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8158e445-75b3-4ba7-b10b-0faebeb94e98 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:29.277059 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8158e445-75b3-4ba7-b10b-0faebeb94e98 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:29.278106 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8158e445-75b3-4ba7-b10b-0faebeb94e98 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:29.280250 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8158e445-75b3-4ba7-b10b-0faebeb94e98 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:29.370767 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8158e445-75b3-4ba7-b10b-0faebeb94e98 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:29.377621 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8158e445-75b3-4ba7-b10b-0faebeb94e98 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:29.378671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8158e445-75b3-4ba7-b10b-0faebeb94e98 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:29.383282 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8158e445-75b3-4ba7-b10b-0faebeb94e98 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:29.459760 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-094c60c0-a807-4ae9-83d3-60ed1cf8be9d req-8409b791-3ca4-4a64-85ac-ad1586e468d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374ab7ad-b415-4516-8aa8-282bdfaa6600", "name": "network-vif-plugged", "status": "completed", "tag": "726ca660-8b38-4bdc-a645-af1d096b28e4"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:29.478255 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-094c60c0-a807-4ae9-83d3-60ed1cf8be9d req-8409b791-3ca4-4a64-85ac-ad1586e468d0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:29.486398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-094c60c0-a807-4ae9-83d3-60ed1cf8be9d req-8409b791-3ca4-4a64-85ac-ad1586e468d0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:29.506122 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:27:29.552118 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-094c60c0-a807-4ae9-83d3-60ed1cf8be9d req-8409b791-3ca4-4a64-85ac-ad1586e468d0 service nova] Creating event network-vif-plugged:726ca660-8b38-4bdc-a645-af1d096b28e4 for instance 374ab7ad-b415-4516-8aa8-282bdfaa6600 on n-h2-847009-3 Jul 19 22:27:29.565916 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-094c60c0-a807-4ae9-83d3-60ed1cf8be9d req-8409b791-3ca4-4a64-85ac-ad1586e468d0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112206 Jul 19 22:27:29.569204 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 292/609] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:27:29.595207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3dc8632e-184c-4cfa-9944-fd5833b4e3f1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:29.598984 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8158e445-75b3-4ba7-b10b-0faebeb94e98 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/a43183b5d45245139678f9c498b8a77e?user_id=ebb7240c375c4921876f0e3bb3e57da7" status: 200 len: 328 microversion: 2.1 time: 0.489568 Jul 19 22:27:29.600801 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 318/610] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 19 22:27:29 2022] PUT /compute/v2.1/os-quota-sets/a43183b5d45245139678f9c498b8a77e?user_id=ebb7240c375c4921876f0e3bb3e57da7 => generated 328 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:29.602951 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3dc8632e-184c-4cfa-9944-fd5833b4e3f1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:29.611865 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9d555177-bae7-47c2-b1bc-1d96dbac6b68 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Calling method '.version_select at 0x7f7a109300d0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:29.627132 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3dc8632e-184c-4cfa-9944-fd5833b4e3f1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:29.628069 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3dc8632e-184c-4cfa-9944-fd5833b4e3f1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:29.630925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3dc8632e-184c-4cfa-9944-fd5833b4e3f1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:29.633497 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3dc8632e-184c-4cfa-9944-fd5833b4e3f1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:29.956316 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9d555177-bae7-47c2-b1bc-1d96dbac6b68 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/a43183b5d45245139678f9c498b8a77e?user_id=ebb7240c375c4921876f0e3bb3e57da7" status: 200 len: 370 microversion: 2.1 time: 0.348785 Jul 19 22:27:29.958194 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 319/611] 10.222.0.25 () {58 vars in 1322 bytes} [Tue Jul 19 22:27:29 2022] GET /compute/v2.1/os-quota-sets/a43183b5d45245139678f9c498b8a77e?user_id=ebb7240c375c4921876f0e3bb3e57da7 => generated 370 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:27:29.963570 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-324ddbc2-02a2-4a9a-b8cf-ca253b0b987b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:29.965010 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-324ddbc2-02a2-4a9a-b8cf-ca253b0b987b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:29.973224 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-324ddbc2-02a2-4a9a-b8cf-ca253b0b987b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:29.974023 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-324ddbc2-02a2-4a9a-b8cf-ca253b0b987b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:29.975023 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-324ddbc2-02a2-4a9a-b8cf-ca253b0b987b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:29.976151 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-324ddbc2-02a2-4a9a-b8cf-ca253b0b987b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:30.476201 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-324ddbc2-02a2-4a9a-b8cf-ca253b0b987b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:30.486285 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-324ddbc2-02a2-4a9a-b8cf-ca253b0b987b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1475 microversion: 2.1 time: 0.526802 Jul 19 22:27:30.491887 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 320/612] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:29 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1475 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:30.505584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bafc8e5b-23c4-4086-a44d-3d5835a086e1 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:30.506463 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bafc8e5b-23c4-4086-a44d-3d5835a086e1 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:30.522486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bafc8e5b-23c4-4086-a44d-3d5835a086e1 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:30.523939 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bafc8e5b-23c4-4086-a44d-3d5835a086e1 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:30.525128 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bafc8e5b-23c4-4086-a44d-3d5835a086e1 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:30.534416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bafc8e5b-23c4-4086-a44d-3d5835a086e1 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:30.551712 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3dc8632e-184c-4cfa-9944-fd5833b4e3f1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:30.570799 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3dc8632e-184c-4cfa-9944-fd5833b4e3f1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:30.575977 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3dc8632e-184c-4cfa-9944-fd5833b4e3f1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:30.579928 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3dc8632e-184c-4cfa-9944-fd5833b4e3f1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 1361 microversion: 2.25 time: 0.999416 Jul 19 22:27:30.581469 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 293/613] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:27:29 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 1361 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:27:30.588027 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-da513b39-a19d-419e-af12-9e24e6d3fdde tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:30.588901 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-da513b39-a19d-419e-af12-9e24e6d3fdde tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:30.604838 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da513b39-a19d-419e-af12-9e24e6d3fdde tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:30.606419 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da513b39-a19d-419e-af12-9e24e6d3fdde tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:30.608451 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da513b39-a19d-419e-af12-9e24e6d3fdde tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:30.609792 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da513b39-a19d-419e-af12-9e24e6d3fdde tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:31.108894 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bafc8e5b-23c4-4086-a44d-3d5835a086e1 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66a794a5a4c41498472dd994128703f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53b71f56584a28b7b82c799fb96673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:31.137452 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bafc8e5b-23c4-4086-a44d-3d5835a086e1 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5" status: 200 len: 1371 microversion: 2.1 time: 0.644161 Jul 19 22:27:31.150936 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 321/614] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:30 2022] GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5 => generated 1371 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:31.156984 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-24f0db1b-78a1-4a3d-a302-d26f7e5245e8 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Calling method '.version_select at 0x7f7a10914700>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:31.301853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-da513b39-a19d-419e-af12-9e24e6d3fdde tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:31.314522 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-da513b39-a19d-419e-af12-9e24e6d3fdde tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1310 microversion: 2.1 time: 0.731732 Jul 19 22:27:31.318094 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 294/615] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:30 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1310 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:31.636558 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-897a5ceb-d755-4148-bc4b-3279888a4f7b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-692385182", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "5684cb20-bc75-42db-91c0-b2fe6d252169"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:31.743461 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-24f0db1b-78a1-4a3d-a302-d26f7e5245e8 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/fc195ae4fa9145ab94256a4a0ff6f33a/defaults" status: 200 len: 371 microversion: 2.1 time: 0.590822 Jul 19 22:27:31.759156 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 322/616] 10.222.0.25 () {58 vars in 1268 bytes} [Tue Jul 19 22:27:31 2022] GET /compute/v2.1/os-quota-sets/fc195ae4fa9145ab94256a4a0ff6f33a/defaults => generated 371 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:31.759450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-897a5ceb-d755-4148-bc4b-3279888a4f7b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] validate_networks() for [('5684cb20-bc75-42db-91c0-b2fe6d252169', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:27:31.783179 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-26c17c83-8ebc-44b0-8c3e-bf245a33ab8f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:31.789267 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-26c17c83-8ebc-44b0-8c3e-bf245a33ab8f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:31.820844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-26c17c83-8ebc-44b0-8c3e-bf245a33ab8f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:31.822070 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-26c17c83-8ebc-44b0-8c3e-bf245a33ab8f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:31.823742 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-26c17c83-8ebc-44b0-8c3e-bf245a33ab8f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:31.824815 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-26c17c83-8ebc-44b0-8c3e-bf245a33ab8f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:32.413461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-26c17c83-8ebc-44b0-8c3e-bf245a33ab8f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:32.425587 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-26c17c83-8ebc-44b0-8c3e-bf245a33ab8f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1475 microversion: 2.1 time: 0.671455 Jul 19 22:27:32.429187 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 323/617] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:31 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1475 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:32.438692 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-62d88079-7fa9-4c17-83a6-612f28619f72 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:32.446481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-62d88079-7fa9-4c17-83a6-612f28619f72 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:32.461770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62d88079-7fa9-4c17-83a6-612f28619f72 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:32.462591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62d88079-7fa9-4c17-83a6-612f28619f72 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:32.465628 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62d88079-7fa9-4c17-83a6-612f28619f72 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:32.469912 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62d88079-7fa9-4c17-83a6-612f28619f72 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:32.720197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-897a5ceb-d755-4148-bc4b-3279888a4f7b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:27:32.721238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-897a5ceb-d755-4148-bc4b-3279888a4f7b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:27:32.721877 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-897a5ceb-d755-4148-bc4b-3279888a4f7b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:27:32.722503 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-897a5ceb-d755-4148-bc4b-3279888a4f7b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:27:32.723092 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-897a5ceb-d755-4148-bc4b-3279888a4f7b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:27:32.744701 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-897a5ceb-d755-4148-bc4b-3279888a4f7b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:32.746245 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-897a5ceb-d755-4148-bc4b-3279888a4f7b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:32.748055 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-897a5ceb-d755-4148-bc4b-3279888a4f7b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:32.749398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-897a5ceb-d755-4148-bc4b-3279888a4f7b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:32.768014 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:27:32.786057 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-897a5ceb-d755-4148-bc4b-3279888a4f7b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Getting quotas for project 5e91c72f8cf5406a9662a29ee25780e6. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:27:32.808889 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-897a5ceb-d755-4148-bc4b-3279888a4f7b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Getting quotas for user 22b46b207cdb40c7b325bdc42baae246 and project 5e91c72f8cf5406a9662a29ee25780e6. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:27:32.809781 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-62d88079-7fa9-4c17-83a6-612f28619f72 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:32.824737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-62d88079-7fa9-4c17-83a6-612f28619f72 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:32.826888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-62d88079-7fa9-4c17-83a6-612f28619f72 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:32.828020 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-897a5ceb-d755-4148-bc4b-3279888a4f7b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:27:32.830981 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-62d88079-7fa9-4c17-83a6-612f28619f72 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 1557 microversion: 2.25 time: 0.399228 Jul 19 22:27:32.832948 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-897a5ceb-d755-4148-bc4b-3279888a4f7b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: c63853a7-f403-42e3-9a4b-fb322a8decd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:27:32.838390 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 324/618] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:27:32 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 1557 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:27:32.845678 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fd6bbd89-2c33-4f79-8733-03de88f582a2 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Action: 'update', calling method: .version_select at 0x7f7a109148b0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:32.921355 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-897a5ceb-d755-4148-bc4b-3279888a4f7b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.458928 Jul 19 22:27:32.935168 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 295/619] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:27:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 22:27:32.941845 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5787a469-aa53-479d-8cde-3a4569f385ee tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:32.949680 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5787a469-aa53-479d-8cde-3a4569f385ee tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:32.970507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5787a469-aa53-479d-8cde-3a4569f385ee tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:32.972350 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5787a469-aa53-479d-8cde-3a4569f385ee tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:32.973359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5787a469-aa53-479d-8cde-3a4569f385ee tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:32.974793 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5787a469-aa53-479d-8cde-3a4569f385ee tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:33.002212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd6bbd89-2c33-4f79-8733-03de88f582a2 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:33.003560 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd6bbd89-2c33-4f79-8733-03de88f582a2 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:33.006765 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd6bbd89-2c33-4f79-8733-03de88f582a2 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:33.007364 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd6bbd89-2c33-4f79-8733-03de88f582a2 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:33.317123 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5787a469-aa53-479d-8cde-3a4569f385ee tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66a794a5a4c41498472dd994128703f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53b71f56584a28b7b82c799fb96673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:33.325554 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5787a469-aa53-479d-8cde-3a4569f385ee tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5" status: 200 len: 1371 microversion: 2.1 time: 0.388976 Jul 19 22:27:33.328404 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 296/620] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:32 2022] GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5 => generated 1371 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:33.333181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-58afaba7-ebc7-44a4-b0a6-d5f246518600 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:33.333793 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-58afaba7-ebc7-44a4-b0a6-d5f246518600 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:33.353365 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58afaba7-ebc7-44a4-b0a6-d5f246518600 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:33.353950 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58afaba7-ebc7-44a4-b0a6-d5f246518600 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:33.354787 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58afaba7-ebc7-44a4-b0a6-d5f246518600 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:33.364149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58afaba7-ebc7-44a4-b0a6-d5f246518600 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:33.654181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-58afaba7-ebc7-44a4-b0a6-d5f246518600 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:33.655804 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fd6bbd89-2c33-4f79-8733-03de88f582a2 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/fc195ae4fa9145ab94256a4a0ff6f33a" status: 200 len: 329 microversion: 2.1 time: 0.814286 Jul 19 22:27:33.664267 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 325/621] 10.222.0.25 () {60 vars in 1262 bytes} [Tue Jul 19 22:27:32 2022] PUT /compute/v2.1/os-quota-sets/fc195ae4fa9145ab94256a4a0ff6f33a => generated 329 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:33.671823 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-58afaba7-ebc7-44a4-b0a6-d5f246518600 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1310 microversion: 2.1 time: 0.342287 Jul 19 22:27:33.673666 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 297/622] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:33 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1310 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:33.680521 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7e3ddf95-f7ac-4627-92a7-c506f2372e65 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:33.681796 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7e3ddf95-f7ac-4627-92a7-c506f2372e65 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: c63853a7-f403-42e3-9a4b-fb322a8decd6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:33.760254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7e3ddf95-f7ac-4627-92a7-c506f2372e65 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:33.771935 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7e3ddf95-f7ac-4627-92a7-c506f2372e65 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6" status: 200 len: 1207 microversion: 2.1 time: 0.095649 Jul 19 22:27:33.772790 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 298/623] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:33 2022] GET /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6 => generated 1207 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:33.792317 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ea6dec65-7eec-4027-b641-2a95f1977501 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:33.793283 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ea6dec65-7eec-4027-b641-2a95f1977501 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:33.807164 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea6dec65-7eec-4027-b641-2a95f1977501 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:33.807914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea6dec65-7eec-4027-b641-2a95f1977501 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:33.810421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea6dec65-7eec-4027-b641-2a95f1977501 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:33.811065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea6dec65-7eec-4027-b641-2a95f1977501 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:34.084985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-febeb8a3-49cd-4500-9473-f3341b5adc5b tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:34.085984 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-febeb8a3-49cd-4500-9473-f3341b5adc5b tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:34.097663 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-febeb8a3-49cd-4500-9473-f3341b5adc5b tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:34.099394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-febeb8a3-49cd-4500-9473-f3341b5adc5b tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:34.100800 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-febeb8a3-49cd-4500-9473-f3341b5adc5b tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:34.101879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-febeb8a3-49cd-4500-9473-f3341b5adc5b tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:34.243278 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ea6dec65-7eec-4027-b641-2a95f1977501 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:34.270957 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ea6dec65-7eec-4027-b641-2a95f1977501 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1475 microversion: 2.1 time: 0.484675 Jul 19 22:27:34.285089 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 299/624] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:33 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1475 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:34.292960 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a9312ad4-5701-4034-aeb7-f92cd6aeb3d9 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Action: 'update', calling method: .version_select at 0x7f7a109a7430>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:34.376750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-febeb8a3-49cd-4500-9473-f3341b5adc5b tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lazy-loading 'services' on Instance uuid 374ab7ad-b415-4516-8aa8-282bdfaa6600 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:27:34.521857 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-febeb8a3-49cd-4500-9473-f3341b5adc5b tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 2049 microversion: 2.25 time: 0.856377 Jul 19 22:27:34.530630 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 326/625] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:27:33 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 2049 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:27:34.536871 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4ba39b3a-93d3-4b6b-9dfa-04f70e05b441 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:34.537515 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4ba39b3a-93d3-4b6b-9dfa-04f70e05b441 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:34.567347 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ba39b3a-93d3-4b6b-9dfa-04f70e05b441 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:34.567804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ba39b3a-93d3-4b6b-9dfa-04f70e05b441 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:34.571166 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ba39b3a-93d3-4b6b-9dfa-04f70e05b441 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:34.572114 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ba39b3a-93d3-4b6b-9dfa-04f70e05b441 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:34.681579 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a9312ad4-5701-4034-aeb7-f92cd6aeb3d9 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:34.682539 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a9312ad4-5701-4034-aeb7-f92cd6aeb3d9 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:34.683431 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a9312ad4-5701-4034-aeb7-f92cd6aeb3d9 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:34.684027 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a9312ad4-5701-4034-aeb7-f92cd6aeb3d9 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:34.863088 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4ba39b3a-93d3-4b6b-9dfa-04f70e05b441 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66a794a5a4c41498472dd994128703f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53b71f56584a28b7b82c799fb96673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:34.873517 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4ba39b3a-93d3-4b6b-9dfa-04f70e05b441 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5" status: 200 len: 1371 microversion: 2.1 time: 0.341158 Jul 19 22:27:34.874716 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 327/626] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:34 2022] GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5 => generated 1371 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:34.899724 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2b8fd5c5-b882-4741-b384-e1930bc49903 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:34.902688 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2b8fd5c5-b882-4741-b384-e1930bc49903 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:34.913297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2b8fd5c5-b882-4741-b384-e1930bc49903 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:34.913746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2b8fd5c5-b882-4741-b384-e1930bc49903 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:34.914690 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2b8fd5c5-b882-4741-b384-e1930bc49903 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:34.915130 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2b8fd5c5-b882-4741-b384-e1930bc49903 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:35.212066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=14,nova_api:UPDATE=11 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:27:35.362037 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a9312ad4-5701-4034-aeb7-f92cd6aeb3d9 tempest-QuotasAdminTestJSON-404395139 tempest-QuotasAdminTestJSON-404395139-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/fc195ae4fa9145ab94256a4a0ff6f33a" status: 200 len: 329 microversion: 2.1 time: 1.075140 Jul 19 22:27:35.364725 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-2b8fd5c5-b882-4741-b384-e1930bc49903 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lazy-loading 'services' on Instance uuid 374ab7ad-b415-4516-8aa8-282bdfaa6600 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:27:35.371691 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 300/627] 10.222.0.25 () {60 vars in 1262 bytes} [Tue Jul 19 22:27:34 2022] PUT /compute/v2.1/os-quota-sets/fc195ae4fa9145ab94256a4a0ff6f33a => generated 329 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:35.381414 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-989be1eb-1475-4a5e-bb9b-9575497ad373 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:35.382149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-989be1eb-1475-4a5e-bb9b-9575497ad373 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:35.400715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-989be1eb-1475-4a5e-bb9b-9575497ad373 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:35.401170 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-989be1eb-1475-4a5e-bb9b-9575497ad373 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:35.401965 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-989be1eb-1475-4a5e-bb9b-9575497ad373 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:35.402573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-989be1eb-1475-4a5e-bb9b-9575497ad373 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:35.422339 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2b8fd5c5-b882-4741-b384-e1930bc49903 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 2049 microversion: 2.25 time: 0.546463 Jul 19 22:27:35.424717 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 328/628] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:27:34 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 2049 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:27:35.435297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-03975931-6802-496c-a01d-527e729f578c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:35.438189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-03975931-6802-496c-a01d-527e729f578c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: c63853a7-f403-42e3-9a4b-fb322a8decd6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:35.454599 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-03975931-6802-496c-a01d-527e729f578c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:35.456408 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-03975931-6802-496c-a01d-527e729f578c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:35.469154 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-03975931-6802-496c-a01d-527e729f578c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:35.469991 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-03975931-6802-496c-a01d-527e729f578c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:35.639443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-03975931-6802-496c-a01d-527e729f578c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:35.658064 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-03975931-6802-496c-a01d-527e729f578c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6" status: 200 len: 1265 microversion: 2.1 time: 0.231695 Jul 19 22:27:35.658927 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 329/629] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:35 2022] GET /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6 => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:35.664079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-c8038df0-096c-453e-8ce4-35b7a1176cc8 req-dd0e84db-1f09-428d-bd00-989b52e2e077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ce1872-5f47-4acc-ba80-696b87b062b5", "name": "network-vif-plugged", "status": "completed", "tag": "ea7d48d9-65be-47a1-9821-5c0e56f6eed7"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:35.688602 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-c8038df0-096c-453e-8ce4-35b7a1176cc8 req-dd0e84db-1f09-428d-bd00-989b52e2e077 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:35.689249 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-c8038df0-096c-453e-8ce4-35b7a1176cc8 req-dd0e84db-1f09-428d-bd00-989b52e2e077 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:35.719945 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-c8038df0-096c-453e-8ce4-35b7a1176cc8 req-dd0e84db-1f09-428d-bd00-989b52e2e077 service nova] Creating event network-vif-plugged:ea7d48d9-65be-47a1-9821-5c0e56f6eed7 for instance 40ce1872-5f47-4acc-ba80-696b87b062b5 on n-h2-847009-3 Jul 19 22:27:35.733860 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-c8038df0-096c-453e-8ce4-35b7a1176cc8 req-dd0e84db-1f09-428d-bd00-989b52e2e077 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073508 Jul 19 22:27:35.740155 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 330/630] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:35.751821 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-77b81a6e-3e36-47da-9e03-6d1a56575d60 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:35.757134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-77b81a6e-3e36-47da-9e03-6d1a56575d60 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:35.772360 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-77b81a6e-3e36-47da-9e03-6d1a56575d60 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:35.781555 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-77b81a6e-3e36-47da-9e03-6d1a56575d60 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:35.782479 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-77b81a6e-3e36-47da-9e03-6d1a56575d60 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:35.782935 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-77b81a6e-3e36-47da-9e03-6d1a56575d60 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:35.928110 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-989be1eb-1475-4a5e-bb9b-9575497ad373 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:35.937249 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-989be1eb-1475-4a5e-bb9b-9575497ad373 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1310 microversion: 2.1 time: 0.570716 Jul 19 22:27:35.946154 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 301/631] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:35 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1310 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:35.951375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4e46cb64-d483-443d-b6b8-bace52006ea3 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:35.953832 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:27:35.953832 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:27:35.955612 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4e46cb64-d483-443d-b6b8-bace52006ea3 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:35.956227 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4e46cb64-d483-443d-b6b8-bace52006ea3 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:35.957362 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4e46cb64-d483-443d-b6b8-bace52006ea3 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:35.961183 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4e46cb64-d483-443d-b6b8-bace52006ea3 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:36.037092 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4e46cb64-d483-443d-b6b8-bace52006ea3 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.087418 Jul 19 22:27:36.038463 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 302/632] 10.222.0.25 () {60 vars in 1216 bytes} [Tue Jul 19 22:27:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:27:36.043809 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f908bb80-c2c2-439d-8488-f494a7eb42f6 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:36.044846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f908bb80-c2c2-439d-8488-f494a7eb42f6 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:36.055801 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f908bb80-c2c2-439d-8488-f494a7eb42f6 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:36.056571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f908bb80-c2c2-439d-8488-f494a7eb42f6 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:36.057688 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f908bb80-c2c2-439d-8488-f494a7eb42f6 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:36.058340 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f908bb80-c2c2-439d-8488-f494a7eb42f6 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:36.374517 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-77b81a6e-3e36-47da-9e03-6d1a56575d60 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:36.382596 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-77b81a6e-3e36-47da-9e03-6d1a56575d60 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1475 microversion: 2.1 time: 0.640997 Jul 19 22:27:36.392664 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 331/633] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:35 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1475 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:36.398386 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1855bbd5-9837-411b-912e-86c8e36f62ef tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-847009-3", "block_migration": "auto"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:36.399874 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1855bbd5-9837-411b-912e-86c8e36f62ef tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:36.406956 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1855bbd5-9837-411b-912e-86c8e36f62ef tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:36.407683 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1855bbd5-9837-411b-912e-86c8e36f62ef tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:36.408629 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1855bbd5-9837-411b-912e-86c8e36f62ef tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:36.409223 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1855bbd5-9837-411b-912e-86c8e36f62ef tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:36.438351 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-1855bbd5-9837-411b-912e-86c8e36f62ef tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lazy-loading 'flavor' on Instance uuid 374ab7ad-b415-4516-8aa8-282bdfaa6600 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:27:36.453356 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1855bbd5-9837-411b-912e-86c8e36f62ef tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Going to try to live migrate instance to n-h1-847009-3 {{(pid=119337) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 22:27:37.261522 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f908bb80-c2c2-439d-8488-f494a7eb42f6 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66a794a5a4c41498472dd994128703f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53b71f56584a28b7b82c799fb96673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:37.279582 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f908bb80-c2c2-439d-8488-f494a7eb42f6 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5" status: 200 len: 1371 microversion: 2.1 time: 1.238919 Jul 19 22:27:37.283310 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 303/634] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:36 2022] GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5 => generated 1371 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:37.306291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-503a7f47-8f11-49a4-9e46-40820b413d82 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:37.307139 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-503a7f47-8f11-49a4-9e46-40820b413d82 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: c63853a7-f403-42e3-9a4b-fb322a8decd6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:37.327574 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-503a7f47-8f11-49a4-9e46-40820b413d82 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:37.329395 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-503a7f47-8f11-49a4-9e46-40820b413d82 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:37.330960 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-503a7f47-8f11-49a4-9e46-40820b413d82 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:37.333796 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-503a7f47-8f11-49a4-9e46-40820b413d82 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:38.091025 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-503a7f47-8f11-49a4-9e46-40820b413d82 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:38.105814 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-503a7f47-8f11-49a4-9e46-40820b413d82 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6" status: 200 len: 1307 microversion: 2.1 time: 0.813671 Jul 19 22:27:38.106661 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 304/635] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:37 2022] GET /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6 => generated 1307 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:38.123233 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-55d8c540-cf41-4660-983d-e83b6b8f482b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:38.124452 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-55d8c540-cf41-4660-983d-e83b6b8f482b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:38.133146 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55d8c540-cf41-4660-983d-e83b6b8f482b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:38.135455 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55d8c540-cf41-4660-983d-e83b6b8f482b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:38.136530 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55d8c540-cf41-4660-983d-e83b6b8f482b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:38.140811 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55d8c540-cf41-4660-983d-e83b6b8f482b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:38.905576 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-55d8c540-cf41-4660-983d-e83b6b8f482b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:38.950449 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-55d8c540-cf41-4660-983d-e83b6b8f482b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1310 microversion: 2.1 time: 0.836420 Jul 19 22:27:38.956110 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 305/636] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:38 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1310 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:38.972987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d214ffb1-d860-4ec8-8fbb-3756fd6a6078 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:38.976317 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d214ffb1-d860-4ec8-8fbb-3756fd6a6078 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:39.005767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d214ffb1-d860-4ec8-8fbb-3756fd6a6078 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:39.006501 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d214ffb1-d860-4ec8-8fbb-3756fd6a6078 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:39.007341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d214ffb1-d860-4ec8-8fbb-3756fd6a6078 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:39.009287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d214ffb1-d860-4ec8-8fbb-3756fd6a6078 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:39.394080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d214ffb1-d860-4ec8-8fbb-3756fd6a6078 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:39.420564 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d214ffb1-d860-4ec8-8fbb-3756fd6a6078 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1475 microversion: 2.1 time: 0.461182 Jul 19 22:27:39.421562 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 306/637] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:38 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1475 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:39.441791 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-fd2e9c30-de3b-42d4-95b1-7167a44d6e16 req-b8c86335-cd5c-42bb-8f01-4685b63171fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f752d932-1177-43ae-89b0-86a439bb446a", "name": "network-vif-plugged", "status": "completed", "tag": "9795f500-4e5c-483d-95e2-204859a4140a"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:39.471253 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-fd2e9c30-de3b-42d4-95b1-7167a44d6e16 req-b8c86335-cd5c-42bb-8f01-4685b63171fa service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:39.472717 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-fd2e9c30-de3b-42d4-95b1-7167a44d6e16 req-b8c86335-cd5c-42bb-8f01-4685b63171fa service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:39.505444 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-fd2e9c30-de3b-42d4-95b1-7167a44d6e16 req-b8c86335-cd5c-42bb-8f01-4685b63171fa service nova] Creating event network-vif-plugged:9795f500-4e5c-483d-95e2-204859a4140a for instance f752d932-1177-43ae-89b0-86a439bb446a on n-h1-847009-3 Jul 19 22:27:39.511257 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-fd2e9c30-de3b-42d4-95b1-7167a44d6e16 req-b8c86335-cd5c-42bb-8f01-4685b63171fa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083606 Jul 19 22:27:39.511878 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 307/638] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:39.518466 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-89f731a4-bcc0-48f6-a41b-c1316a79b614 req-724a7699-b87b-49e1-aa2c-4088255ad82a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c63853a7-f403-42e3-9a4b-fb322a8decd6", "tag": "a4f5bb99-23dd-4735-9565-0e8ced8c4323"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:39.532860 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-89f731a4-bcc0-48f6-a41b-c1316a79b614 req-724a7699-b87b-49e1-aa2c-4088255ad82a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:39.533315 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-89f731a4-bcc0-48f6-a41b-c1316a79b614 req-724a7699-b87b-49e1-aa2c-4088255ad82a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:39.559342 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-89f731a4-bcc0-48f6-a41b-c1316a79b614 req-724a7699-b87b-49e1-aa2c-4088255ad82a service nova] Creating event network-changed:a4f5bb99-23dd-4735-9565-0e8ced8c4323 for instance c63853a7-f403-42e3-9a4b-fb322a8decd6 on n-h1-847009-3 Jul 19 22:27:39.566621 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-89f731a4-bcc0-48f6-a41b-c1316a79b614 req-724a7699-b87b-49e1-aa2c-4088255ad82a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053137 Jul 19 22:27:39.567323 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 308/639] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:39.579429 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ad6f5ec2-825c-43d1-94f3-ff6be2060254 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:39.583387 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ad6f5ec2-825c-43d1-94f3-ff6be2060254 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:39.591456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad6f5ec2-825c-43d1-94f3-ff6be2060254 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:39.592755 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad6f5ec2-825c-43d1-94f3-ff6be2060254 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:39.593760 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad6f5ec2-825c-43d1-94f3-ff6be2060254 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:39.594419 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad6f5ec2-825c-43d1-94f3-ff6be2060254 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:40.031594 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ad6f5ec2-825c-43d1-94f3-ff6be2060254 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66a794a5a4c41498472dd994128703f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53b71f56584a28b7b82c799fb96673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:40.073635 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ad6f5ec2-825c-43d1-94f3-ff6be2060254 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5" status: 200 len: 1558 microversion: 2.1 time: 0.504508 Jul 19 22:27:40.074679 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 309/640] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:39 2022] GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5 => generated 1558 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:40.088129 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a53d97a5-494c-4767-8c91-d12fedb67bd4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:40.089276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a53d97a5-494c-4767-8c91-d12fedb67bd4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: c63853a7-f403-42e3-9a4b-fb322a8decd6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:40.104945 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1855bbd5-9837-411b-912e-86c8e36f62ef tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600/action" status: 202 len: 0 microversion: 2.25 time: 3.710351 Jul 19 22:27:40.107540 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 332/641] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Jul 19 22:27:36 2022] POST /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600/action => generated 0 bytes in 3714 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:27:40.120207 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e09f419e-7efe-4775-bd18-bb2ab27919b2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:40.121468 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e09f419e-7efe-4775-bd18-bb2ab27919b2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:40.127984 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a53d97a5-494c-4767-8c91-d12fedb67bd4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:40.131316 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a53d97a5-494c-4767-8c91-d12fedb67bd4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:40.132748 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a53d97a5-494c-4767-8c91-d12fedb67bd4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:40.133984 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e09f419e-7efe-4775-bd18-bb2ab27919b2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:40.135162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e09f419e-7efe-4775-bd18-bb2ab27919b2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:40.138440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e09f419e-7efe-4775-bd18-bb2ab27919b2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:40.139282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a53d97a5-494c-4767-8c91-d12fedb67bd4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:40.141631 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e09f419e-7efe-4775-bd18-bb2ab27919b2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:40.701059 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a53d97a5-494c-4767-8c91-d12fedb67bd4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:40.703047 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e09f419e-7efe-4775-bd18-bb2ab27919b2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:40.740582 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:27:40.748368 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e09f419e-7efe-4775-bd18-bb2ab27919b2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1310 microversion: 2.1 time: 0.638787 Jul 19 22:27:40.751057 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a53d97a5-494c-4767-8c91-d12fedb67bd4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6" status: 200 len: 1307 microversion: 2.1 time: 0.670302 Jul 19 22:27:40.764212 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 333/642] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:40 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1310 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:40.766109 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 310/643] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:40 2022] GET /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6 => generated 1307 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:40.782371 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-67f9e277-8253-49b7-a788-8d259ab0cf9f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:40.793246 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f35a0107-36d9-4985-afa0-34dd7156be02 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:40.793803 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f35a0107-36d9-4985-afa0-34dd7156be02 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:40.798052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-67f9e277-8253-49b7-a788-8d259ab0cf9f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:40.807674 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67f9e277-8253-49b7-a788-8d259ab0cf9f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:40.808561 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67f9e277-8253-49b7-a788-8d259ab0cf9f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:40.809506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67f9e277-8253-49b7-a788-8d259ab0cf9f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:40.809951 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67f9e277-8253-49b7-a788-8d259ab0cf9f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:40.810319 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f35a0107-36d9-4985-afa0-34dd7156be02 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:40.812629 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f35a0107-36d9-4985-afa0-34dd7156be02 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:40.813730 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f35a0107-36d9-4985-afa0-34dd7156be02 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:40.814535 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f35a0107-36d9-4985-afa0-34dd7156be02 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:41.257267 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f35a0107-36d9-4985-afa0-34dd7156be02 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.491859 Jul 19 22:27:41.266208 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 334/644] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 19 22:27:40 2022] GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5/os-interface => generated 285 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:41.266208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e976c280-58af-4272-b6c7-c475320049ad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:41.266208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e976c280-58af-4272-b6c7-c475320049ad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:41.281289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e976c280-58af-4272-b6c7-c475320049ad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:41.281741 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e976c280-58af-4272-b6c7-c475320049ad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:41.282522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e976c280-58af-4272-b6c7-c475320049ad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:41.282960 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e976c280-58af-4272-b6c7-c475320049ad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:41.473001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-67f9e277-8253-49b7-a788-8d259ab0cf9f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:41.483469 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-67f9e277-8253-49b7-a788-8d259ab0cf9f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:41.484973 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-67f9e277-8253-49b7-a788-8d259ab0cf9f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:41.486143 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-67f9e277-8253-49b7-a788-8d259ab0cf9f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 1567 microversion: 2.25 time: 0.719048 Jul 19 22:27:41.501449 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 311/645] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:27:40 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 1567 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:27:41.778970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d5ac6d36-2bf6-49c7-8d68-3d9bd42dab84 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:41.779615 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d5ac6d36-2bf6-49c7-8d68-3d9bd42dab84 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: c63853a7-f403-42e3-9a4b-fb322a8decd6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:41.794859 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5ac6d36-2bf6-49c7-8d68-3d9bd42dab84 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:41.796501 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5ac6d36-2bf6-49c7-8d68-3d9bd42dab84 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:41.797960 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5ac6d36-2bf6-49c7-8d68-3d9bd42dab84 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:41.798603 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5ac6d36-2bf6-49c7-8d68-3d9bd42dab84 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:41.819882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e976c280-58af-4272-b6c7-c475320049ad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:41.830618 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e976c280-58af-4272-b6c7-c475320049ad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1475 microversion: 2.1 time: 0.571296 Jul 19 22:27:41.842205 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 335/646] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:41 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1475 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:41.852087 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2e770408-7938-477b-aabd-bd9fb9caffa6 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:41.859326 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2e770408-7938-477b-aabd-bd9fb9caffa6 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:41.872051 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e770408-7938-477b-aabd-bd9fb9caffa6 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:41.874863 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e770408-7938-477b-aabd-bd9fb9caffa6 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:41.890462 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e770408-7938-477b-aabd-bd9fb9caffa6 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:41.891193 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e770408-7938-477b-aabd-bd9fb9caffa6 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:42.942696 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2e770408-7938-477b-aabd-bd9fb9caffa6 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:42.959025 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2e770408-7938-477b-aabd-bd9fb9caffa6 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1310 microversion: 2.1 time: 1.113523 Jul 19 22:27:42.968977 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 336/647] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:41 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1310 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:43.005624 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-36f4b30f-c80b-4ceb-9228-654b064d5026 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:43.008030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-36f4b30f-c80b-4ceb-9228-654b064d5026 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:43.019688 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d5ac6d36-2bf6-49c7-8d68-3d9bd42dab84 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:43.033206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=9 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:27:43.034852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36f4b30f-c80b-4ceb-9228-654b064d5026 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:43.035492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36f4b30f-c80b-4ceb-9228-654b064d5026 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:43.036260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36f4b30f-c80b-4ceb-9228-654b064d5026 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:43.036836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36f4b30f-c80b-4ceb-9228-654b064d5026 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:43.090780 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d5ac6d36-2bf6-49c7-8d68-3d9bd42dab84 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6" status: 200 len: 1307 microversion: 2.1 time: 1.309079 Jul 19 22:27:43.104618 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 312/648] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:41 2022] GET /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6 => generated 1307 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:27:43.132920 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4cd7449e-8d06-405a-8468-93dffa38f9c3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:43.139393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4cd7449e-8d06-405a-8468-93dffa38f9c3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:43.150471 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4cd7449e-8d06-405a-8468-93dffa38f9c3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:43.151201 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4cd7449e-8d06-405a-8468-93dffa38f9c3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:43.152601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4cd7449e-8d06-405a-8468-93dffa38f9c3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:43.153200 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4cd7449e-8d06-405a-8468-93dffa38f9c3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:43.642557 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=58 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:27:44.176586 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-36f4b30f-c80b-4ceb-9228-654b064d5026 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:44.186513 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-36f4b30f-c80b-4ceb-9228-654b064d5026 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:44.193065 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-36f4b30f-c80b-4ceb-9228-654b064d5026 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:44.199800 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-36f4b30f-c80b-4ceb-9228-654b064d5026 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 1567 microversion: 2.25 time: 1.223188 Jul 19 22:27:44.200839 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 337/649] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:27:42 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 1567 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:27:44.206436 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-86a60035-e019-4b1e-9063-1ef1194a9260 req-b6e1c5d7-8420-486a-ae81-3efb8371f50e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63853a7-f403-42e3-9a4b-fb322a8decd6", "name": "network-vif-plugged", "status": "completed", "tag": "a4f5bb99-23dd-4735-9565-0e8ced8c4323"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:44.232504 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-86a60035-e019-4b1e-9063-1ef1194a9260 req-b6e1c5d7-8420-486a-ae81-3efb8371f50e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:44.233515 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-86a60035-e019-4b1e-9063-1ef1194a9260 req-b6e1c5d7-8420-486a-ae81-3efb8371f50e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:44.256122 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-86a60035-e019-4b1e-9063-1ef1194a9260 req-b6e1c5d7-8420-486a-ae81-3efb8371f50e service nova] Creating event network-vif-plugged:a4f5bb99-23dd-4735-9565-0e8ced8c4323 for instance c63853a7-f403-42e3-9a4b-fb322a8decd6 on n-h1-847009-3 Jul 19 22:27:44.271427 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-86a60035-e019-4b1e-9063-1ef1194a9260 req-b6e1c5d7-8420-486a-ae81-3efb8371f50e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068269 Jul 19 22:27:44.272289 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 338/650] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:44.286960 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fff1d774-af1e-4b85-9e36-47e777cda8cc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:44.290047 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fff1d774-af1e-4b85-9e36-47e777cda8cc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:44.304195 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fff1d774-af1e-4b85-9e36-47e777cda8cc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:44.311249 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fff1d774-af1e-4b85-9e36-47e777cda8cc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:44.312328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fff1d774-af1e-4b85-9e36-47e777cda8cc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:44.317960 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fff1d774-af1e-4b85-9e36-47e777cda8cc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:44.365740 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4cd7449e-8d06-405a-8468-93dffa38f9c3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:44.401376 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4cd7449e-8d06-405a-8468-93dffa38f9c3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1474 microversion: 2.1 time: 1.293661 Jul 19 22:27:44.403034 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 313/651] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:43 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1474 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:44.413474 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4758b8c4-a1ab-4824-a198-09581a76d604 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:44.414605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4758b8c4-a1ab-4824-a198-09581a76d604 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: c63853a7-f403-42e3-9a4b-fb322a8decd6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:44.426470 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4758b8c4-a1ab-4824-a198-09581a76d604 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:44.427325 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4758b8c4-a1ab-4824-a198-09581a76d604 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:44.435429 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4758b8c4-a1ab-4824-a198-09581a76d604 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:44.436731 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4758b8c4-a1ab-4824-a198-09581a76d604 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:45.343794 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=56 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:27:45.416851 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fff1d774-af1e-4b85-9e36-47e777cda8cc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:45.444282 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fff1d774-af1e-4b85-9e36-47e777cda8cc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1494 microversion: 2.1 time: 1.170557 Jul 19 22:27:45.445221 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 339/652] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:44 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1494 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:45.456705 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ed3fa777-77ac-4a2f-aae9-31bcb9c7a2d7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:45.457890 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ed3fa777-77ac-4a2f-aae9-31bcb9c7a2d7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:45.468724 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ed3fa777-77ac-4a2f-aae9-31bcb9c7a2d7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:45.469735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ed3fa777-77ac-4a2f-aae9-31bcb9c7a2d7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:45.470890 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ed3fa777-77ac-4a2f-aae9-31bcb9c7a2d7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:45.472342 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ed3fa777-77ac-4a2f-aae9-31bcb9c7a2d7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:45.629166 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4758b8c4-a1ab-4824-a198-09581a76d604 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:45.657063 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4758b8c4-a1ab-4824-a198-09581a76d604 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6" status: 200 len: 1307 microversion: 2.1 time: 1.251463 Jul 19 22:27:45.659474 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 314/653] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:44 2022] GET /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6 => generated 1307 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:45.670046 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-d3178e5c-7d4a-4724-a62c-29d063c2c44d req-e9607c3c-fb2a-48fc-919a-38f85834fa02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40ce1872-5f47-4acc-ba80-696b87b062b5", "tag": "ea7d48d9-65be-47a1-9821-5c0e56f6eed7"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:45.689749 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d3178e5c-7d4a-4724-a62c-29d063c2c44d req-e9607c3c-fb2a-48fc-919a-38f85834fa02 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:45.691647 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d3178e5c-7d4a-4724-a62c-29d063c2c44d req-e9607c3c-fb2a-48fc-919a-38f85834fa02 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:45.745787 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-d3178e5c-7d4a-4724-a62c-29d063c2c44d req-e9607c3c-fb2a-48fc-919a-38f85834fa02 service nova] Creating event network-changed:ea7d48d9-65be-47a1-9821-5c0e56f6eed7 for instance 40ce1872-5f47-4acc-ba80-696b87b062b5 on n-h2-847009-3 Jul 19 22:27:45.773370 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-d3178e5c-7d4a-4724-a62c-29d063c2c44d req-e9607c3c-fb2a-48fc-919a-38f85834fa02 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110879 Jul 19 22:27:45.785148 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 315/654] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:45.790908 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c51a1e0e-e1b5-4100-9553-4d3db824e0ee tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:45.791651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c51a1e0e-e1b5-4100-9553-4d3db824e0ee tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:45.800678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c51a1e0e-e1b5-4100-9553-4d3db824e0ee tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:45.802005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c51a1e0e-e1b5-4100-9553-4d3db824e0ee tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:45.803259 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c51a1e0e-e1b5-4100-9553-4d3db824e0ee tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:45.803953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c51a1e0e-e1b5-4100-9553-4d3db824e0ee tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:45.820313 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ed3fa777-77ac-4a2f-aae9-31bcb9c7a2d7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:45.843621 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ed3fa777-77ac-4a2f-aae9-31bcb9c7a2d7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:45.873249 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ed3fa777-77ac-4a2f-aae9-31bcb9c7a2d7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:45.887470 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ed3fa777-77ac-4a2f-aae9-31bcb9c7a2d7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 1567 microversion: 2.25 time: 0.428375 Jul 19 22:27:45.888159 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 340/655] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:27:45 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 1567 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:27:45.913801 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-96096697-0058-49aa-912a-743d37cbb997 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:45.923125 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-96096697-0058-49aa-912a-743d37cbb997 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:45.933496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-96096697-0058-49aa-912a-743d37cbb997 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:45.940075 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-96096697-0058-49aa-912a-743d37cbb997 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:45.941228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-96096697-0058-49aa-912a-743d37cbb997 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:45.942006 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-96096697-0058-49aa-912a-743d37cbb997 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:45.992061 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=10 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:27:46.627589 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-96096697-0058-49aa-912a-743d37cbb997 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1645 microversion: 2.1 time: 0.734060 Jul 19 22:27:46.628885 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 341/656] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:45 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1645 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:46.641658 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-aa072105-6b47-4119-82a4-ed1ba2251eb0 req-b8754d39-e89f-4869-a85b-a44595f6c319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f7dcd8-59a5-4e02-8774-9d5e8b4616f5", "name": "network-vif-unplugged", "status": "completed", "tag": "ecd96882-feb4-4205-a4ed-b44495364c7d"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:46.661797 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-aa072105-6b47-4119-82a4-ed1ba2251eb0 req-b8754d39-e89f-4869-a85b-a44595f6c319 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:46.662238 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-aa072105-6b47-4119-82a4-ed1ba2251eb0 req-b8754d39-e89f-4869-a85b-a44595f6c319 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:46.688804 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-aa072105-6b47-4119-82a4-ed1ba2251eb0 req-b8754d39-e89f-4869-a85b-a44595f6c319 service nova] Creating event network-vif-unplugged:ecd96882-feb4-4205-a4ed-b44495364c7d for instance 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 on n-h1-847009-3 Jul 19 22:27:46.710928 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [req-aa072105-6b47-4119-82a4-ed1ba2251eb0 req-b8754d39-e89f-4869-a85b-a44595f6c319 service nova] Instance 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3'} {{(pid=119337) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 22:27:46.736860 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-aa072105-6b47-4119-82a4-ed1ba2251eb0 req-b8754d39-e89f-4869-a85b-a44595f6c319 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105322 Jul 19 22:27:46.744904 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 342/657] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:46.762348 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-23e1d9d9-de9a-49ed-a1a7-09d309ef074a tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:46.767586 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-23e1d9d9-de9a-49ed-a1a7-09d309ef074a tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:46.782525 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-23e1d9d9-de9a-49ed-a1a7-09d309ef074a tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:46.783078 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-23e1d9d9-de9a-49ed-a1a7-09d309ef074a tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:46.785026 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-23e1d9d9-de9a-49ed-a1a7-09d309ef074a tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:46.787434 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-23e1d9d9-de9a-49ed-a1a7-09d309ef074a tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:46.840689 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c51a1e0e-e1b5-4100-9553-4d3db824e0ee tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:46.849027 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:27:46.854179 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c51a1e0e-e1b5-4100-9553-4d3db824e0ee tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1474 microversion: 2.1 time: 1.067693 Jul 19 22:27:46.863034 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 316/658] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:45 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1474 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:46.869348 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ee940a84-9da8-4522-88c2-9f8633b14e54 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:46.870271 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ee940a84-9da8-4522-88c2-9f8633b14e54 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: c63853a7-f403-42e3-9a4b-fb322a8decd6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:46.886791 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee940a84-9da8-4522-88c2-9f8633b14e54 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:46.887796 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee940a84-9da8-4522-88c2-9f8633b14e54 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:46.888796 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee940a84-9da8-4522-88c2-9f8633b14e54 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:46.893525 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee940a84-9da8-4522-88c2-9f8633b14e54 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:47.788257 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-23e1d9d9-de9a-49ed-a1a7-09d309ef074a tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1645 microversion: 2.1 time: 1.041890 Jul 19 22:27:47.792826 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 343/659] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:46 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1645 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:47.816419 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c0100b3a-30e6-466f-a126-a490eb58ac85 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:47.817448 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c0100b3a-30e6-466f-a126-a490eb58ac85 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:47.818768 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ee940a84-9da8-4522-88c2-9f8633b14e54 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:47.829844 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ee940a84-9da8-4522-88c2-9f8633b14e54 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6" status: 200 len: 1488 microversion: 2.1 time: 0.964925 Jul 19 22:27:47.830447 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 317/660] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:46 2022] GET /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6 => generated 1488 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:47.832590 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c0100b3a-30e6-466f-a126-a490eb58ac85 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:47.835799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c0100b3a-30e6-466f-a126-a490eb58ac85 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:47.838189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c0100b3a-30e6-466f-a126-a490eb58ac85 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:47.841574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c0100b3a-30e6-466f-a126-a490eb58ac85 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:47.863370 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cdc4798a-80f8-4c80-b298-b2831f711726 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:47.867628 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:27:47.867628 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:27:47.869718 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cdc4798a-80f8-4c80-b298-b2831f711726 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:47.870588 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cdc4798a-80f8-4c80-b298-b2831f711726 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:47.873244 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cdc4798a-80f8-4c80-b298-b2831f711726 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:47.876265 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cdc4798a-80f8-4c80-b298-b2831f711726 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:47.971721 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cdc4798a-80f8-4c80-b298-b2831f711726 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.121999 Jul 19 22:27:47.978515 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 318/661] 10.222.0.25 () {58 vars in 1175 bytes} [Tue Jul 19 22:27:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:47.993389 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ff1498b3-33a3-45eb-a45c-2b924ce7d277 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:47.994287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ff1498b3-33a3-45eb-a45c-2b924ce7d277 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: c63853a7-f403-42e3-9a4b-fb322a8decd6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:48.010074 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ff1498b3-33a3-45eb-a45c-2b924ce7d277 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:48.010537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ff1498b3-33a3-45eb-a45c-2b924ce7d277 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:48.011375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ff1498b3-33a3-45eb-a45c-2b924ce7d277 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:48.011819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ff1498b3-33a3-45eb-a45c-2b924ce7d277 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:48.246170 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ff1498b3-33a3-45eb-a45c-2b924ce7d277 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "POST /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6/action" status: 202 len: 0 microversion: 2.1 time: 0.270310 Jul 19 22:27:48.250778 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 319/662] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:27:47 2022] POST /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:27:48.279942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b875f28a-9f10-4ac8-a838-f8d22f0fa8b6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:48.282749 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b875f28a-9f10-4ac8-a838-f8d22f0fa8b6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:48.317809 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b875f28a-9f10-4ac8-a838-f8d22f0fa8b6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:48.323399 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b875f28a-9f10-4ac8-a838-f8d22f0fa8b6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:48.332594 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b875f28a-9f10-4ac8-a838-f8d22f0fa8b6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:48.334358 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b875f28a-9f10-4ac8-a838-f8d22f0fa8b6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:48.590460 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c0100b3a-30e6-466f-a126-a490eb58ac85 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:48.616701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c0100b3a-30e6-466f-a126-a490eb58ac85 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:48.620666 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c0100b3a-30e6-466f-a126-a490eb58ac85 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:48.622135 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c0100b3a-30e6-466f-a126-a490eb58ac85 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 1567 microversion: 2.25 time: 0.824055 Jul 19 22:27:48.622995 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 344/663] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:27:47 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 1567 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:27:48.633984 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-512159e3-d8d2-4b36-87d0-0b9bffd596c4 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:48.634828 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-512159e3-d8d2-4b36-87d0-0b9bffd596c4 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:48.638825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=14 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:27:48.647349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-512159e3-d8d2-4b36-87d0-0b9bffd596c4 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:48.648219 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-512159e3-d8d2-4b36-87d0-0b9bffd596c4 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:48.649521 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-512159e3-d8d2-4b36-87d0-0b9bffd596c4 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:48.650385 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-512159e3-d8d2-4b36-87d0-0b9bffd596c4 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:48.772171 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-512159e3-d8d2-4b36-87d0-0b9bffd596c4 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a/action" status: 202 len: 0 microversion: 2.1 time: 0.145715 Jul 19 22:27:48.772890 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 345/664] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:27:48 2022] POST /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:27:48.800633 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9aa1ab4b-ab90-4a05-805c-f98eda75b85f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:48.803051 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9aa1ab4b-ab90-4a05-805c-f98eda75b85f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: c63853a7-f403-42e3-9a4b-fb322a8decd6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:48.813372 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9aa1ab4b-ab90-4a05-805c-f98eda75b85f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:48.814188 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9aa1ab4b-ab90-4a05-805c-f98eda75b85f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:48.815754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9aa1ab4b-ab90-4a05-805c-f98eda75b85f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:48.816455 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9aa1ab4b-ab90-4a05-805c-f98eda75b85f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:48.905962 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b875f28a-9f10-4ac8-a838-f8d22f0fa8b6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:48.921443 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b875f28a-9f10-4ac8-a838-f8d22f0fa8b6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1472 microversion: 2.1 time: 0.657809 Jul 19 22:27:48.938582 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 320/665] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:48 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1472 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:48.946489 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-de12a575-0cc8-426b-a442-d276a2170d57 req-aeea8604-d6c4-4fa3-8824-efdd3e704b2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374ab7ad-b415-4516-8aa8-282bdfaa6600", "name": "network-vif-unplugged", "status": "completed", "tag": "726ca660-8b38-4bdc-a645-af1d096b28e4"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:48.959063 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-de12a575-0cc8-426b-a442-d276a2170d57 req-aeea8604-d6c4-4fa3-8824-efdd3e704b2f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:48.959570 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-de12a575-0cc8-426b-a442-d276a2170d57 req-aeea8604-d6c4-4fa3-8824-efdd3e704b2f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:48.987306 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-de12a575-0cc8-426b-a442-d276a2170d57 req-aeea8604-d6c4-4fa3-8824-efdd3e704b2f service nova] Creating event network-vif-unplugged:726ca660-8b38-4bdc-a645-af1d096b28e4 for instance 374ab7ad-b415-4516-8aa8-282bdfaa6600 on n-h2-847009-3 Jul 19 22:27:48.993222 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-de12a575-0cc8-426b-a442-d276a2170d57 req-aeea8604-d6c4-4fa3-8824-efdd3e704b2f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053223 Jul 19 22:27:48.994347 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 321/666] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:49.003238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ecaaeefe-5a1b-4ab2-80e7-763f59861e7a tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:49.005044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ecaaeefe-5a1b-4ab2-80e7-763f59861e7a tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:49.015174 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ecaaeefe-5a1b-4ab2-80e7-763f59861e7a tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:49.016189 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ecaaeefe-5a1b-4ab2-80e7-763f59861e7a tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:49.017331 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ecaaeefe-5a1b-4ab2-80e7-763f59861e7a tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:49.017954 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ecaaeefe-5a1b-4ab2-80e7-763f59861e7a tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:49.383926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9aa1ab4b-ab90-4a05-805c-f98eda75b85f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:49.394869 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9aa1ab4b-ab90-4a05-805c-f98eda75b85f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6" status: 200 len: 1493 microversion: 2.1 time: 0.611134 Jul 19 22:27:49.399808 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 346/667] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:48 2022] GET /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6 => generated 1493 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:49.504723 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ecaaeefe-5a1b-4ab2-80e7-763f59861e7a tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1650 microversion: 2.1 time: 0.508065 Jul 19 22:27:49.504723 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 322/668] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:48 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1650 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:49.645863 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d1c5a5e7-ef28-4008-85dd-3fc644524200 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:49.646701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d1c5a5e7-ef28-4008-85dd-3fc644524200 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:49.658364 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d1c5a5e7-ef28-4008-85dd-3fc644524200 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:49.659006 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d1c5a5e7-ef28-4008-85dd-3fc644524200 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:49.660728 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d1c5a5e7-ef28-4008-85dd-3fc644524200 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:49.661538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d1c5a5e7-ef28-4008-85dd-3fc644524200 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:49.951572 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0b6638e1-f466-4c6c-a0f1-f78b826b8e29 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:49.953399 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0b6638e1-f466-4c6c-a0f1-f78b826b8e29 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:49.973373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b6638e1-f466-4c6c-a0f1-f78b826b8e29 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:49.974436 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b6638e1-f466-4c6c-a0f1-f78b826b8e29 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:49.981161 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b6638e1-f466-4c6c-a0f1-f78b826b8e29 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:49.982197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b6638e1-f466-4c6c-a0f1-f78b826b8e29 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:50.491577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d1c5a5e7-ef28-4008-85dd-3fc644524200 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:50.521482 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d1c5a5e7-ef28-4008-85dd-3fc644524200 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:50.525894 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d1c5a5e7-ef28-4008-85dd-3fc644524200 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:50.530380 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d1c5a5e7-ef28-4008-85dd-3fc644524200 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 1567 microversion: 2.25 time: 0.889463 Jul 19 22:27:50.533473 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 347/669] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:27:49 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 1567 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:27:50.543879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c2bb23da-4852-4848-b703-a877ad140a62 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:50.545657 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c2bb23da-4852-4848-b703-a877ad140a62 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: c63853a7-f403-42e3-9a4b-fb322a8decd6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:50.564138 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c2bb23da-4852-4848-b703-a877ad140a62 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:50.565721 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c2bb23da-4852-4848-b703-a877ad140a62 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:50.568353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c2bb23da-4852-4848-b703-a877ad140a62 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:50.572178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c2bb23da-4852-4848-b703-a877ad140a62 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:50.603217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0b6638e1-f466-4c6c-a0f1-f78b826b8e29 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:50.621267 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0b6638e1-f466-4c6c-a0f1-f78b826b8e29 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1472 microversion: 2.1 time: 0.681203 Jul 19 22:27:50.640277 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 323/670] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:49 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1472 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:27:50.651881 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c105a97d-e80a-40c7-b182-d702cfb5eff1 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:50.653566 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c105a97d-e80a-40c7-b182-d702cfb5eff1 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:50.666375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c105a97d-e80a-40c7-b182-d702cfb5eff1 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:50.667551 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c105a97d-e80a-40c7-b182-d702cfb5eff1 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:50.669313 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c105a97d-e80a-40c7-b182-d702cfb5eff1 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:50.672446 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c105a97d-e80a-40c7-b182-d702cfb5eff1 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:50.901613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c2bb23da-4852-4848-b703-a877ad140a62 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:50.917073 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c2bb23da-4852-4848-b703-a877ad140a62 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6" status: 200 len: 1473 microversion: 2.1 time: 0.381588 Jul 19 22:27:50.917720 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 348/671] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:50 2022] GET /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6 => generated 1473 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:51.009873 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c105a97d-e80a-40c7-b182-d702cfb5eff1 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1630 microversion: 2.1 time: 0.367374 Jul 19 22:27:51.028052 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 324/672] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:50 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1630 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:51.035266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c16d2877-1c39-424c-a937-a3c4830b56cf tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1840554315"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:51.036695 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c16d2877-1c39-424c-a937-a3c4830b56cf tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: c63853a7-f403-42e3-9a4b-fb322a8decd6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:51.047182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c16d2877-1c39-424c-a937-a3c4830b56cf tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:51.047921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c16d2877-1c39-424c-a937-a3c4830b56cf tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:51.048909 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c16d2877-1c39-424c-a937-a3c4830b56cf tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:51.049531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c16d2877-1c39-424c-a937-a3c4830b56cf tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:51.121729 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e59b4f44-94b4-4696-9189-15016c4efda1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1072157960", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:51.216491 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-e59b4f44-94b4-4696-9189-15016c4efda1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] validate_networks() for None {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:27:51.575985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-e59b4f44-94b4-4696-9189-15016c4efda1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:27:51.576934 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-e59b4f44-94b4-4696-9189-15016c4efda1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:27:51.577492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-e59b4f44-94b4-4696-9189-15016c4efda1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:27:51.578053 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-e59b4f44-94b4-4696-9189-15016c4efda1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:27:51.578569 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-e59b4f44-94b4-4696-9189-15016c4efda1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:27:51.590622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e59b4f44-94b4-4696-9189-15016c4efda1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:51.591183 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e59b4f44-94b4-4696-9189-15016c4efda1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:51.593152 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e59b4f44-94b4-4696-9189-15016c4efda1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:51.593660 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e59b4f44-94b4-4696-9189-15016c4efda1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:51.593786 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c16d2877-1c39-424c-a937-a3c4830b56cf tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "POST /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6/action" status: 202 len: 0 microversion: 2.1 time: 0.539803 Jul 19 22:27:51.598125 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 325/673] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:27:51 2022] POST /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6/action => generated 0 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 22:27:51.620818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7efc987e-ad2f-41bf-81ab-120b10467244 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-847009-3", "block_migration": true, "disk_over_commit": false}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:51.624143 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7efc987e-ad2f-41bf-81ab-120b10467244 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:51.635328 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7efc987e-ad2f-41bf-81ab-120b10467244 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:51.635787 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7efc987e-ad2f-41bf-81ab-120b10467244 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:51.636711 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7efc987e-ad2f-41bf-81ab-120b10467244 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:51.637158 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7efc987e-ad2f-41bf-81ab-120b10467244 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:51.664859 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-e59b4f44-94b4-4696-9189-15016c4efda1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for project 791e176b6751415ca1472c109b3ce011. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:27:51.678792 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-e59b4f44-94b4-4696-9189-15016c4efda1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for user bd5fb561f7bd429e8c6b2cc30ed76f13 and project 791e176b6751415ca1472c109b3ce011. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:27:51.691801 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-7efc987e-ad2f-41bf-81ab-120b10467244 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lazy-loading 'flavor' on Instance uuid f752d932-1177-43ae-89b0-86a439bb446a {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:27:51.709020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e59b4f44-94b4-4696-9189-15016c4efda1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:27:51.710213 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7efc987e-ad2f-41bf-81ab-120b10467244 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Going to try to live migrate instance to n-h2-847009-3 {{(pid=119338) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 22:27:51.712317 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e59b4f44-94b4-4696-9189-15016c4efda1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 9d261177-b837-4836-959b-2b419921e90c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:27:51.819518 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e59b4f44-94b4-4696-9189-15016c4efda1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.900033 Jul 19 22:27:51.826866 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 349/674] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:27:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:27:51.843030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-009ace5d-67b2-4439-b990-65040a41e73d req-544c9182-96ef-4892-9729-6e2cd8449614 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "374ab7ad-b415-4516-8aa8-282bdfaa6600", "tag": "726ca660-8b38-4bdc-a645-af1d096b28e4"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:51.878900 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-009ace5d-67b2-4439-b990-65040a41e73d req-544c9182-96ef-4892-9729-6e2cd8449614 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:51.880247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-009ace5d-67b2-4439-b990-65040a41e73d req-544c9182-96ef-4892-9729-6e2cd8449614 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:51.912962 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-009ace5d-67b2-4439-b990-65040a41e73d req-544c9182-96ef-4892-9729-6e2cd8449614 service nova] Creating event network-changed:726ca660-8b38-4bdc-a645-af1d096b28e4 for instance 374ab7ad-b415-4516-8aa8-282bdfaa6600 on n-h2-847009-3 Jul 19 22:27:51.921168 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-009ace5d-67b2-4439-b990-65040a41e73d req-544c9182-96ef-4892-9729-6e2cd8449614 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088756 Jul 19 22:27:51.922660 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 350/675] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:51.934713 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6d13de14-f214-40e0-8d51-27dc19df41a2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:51.936686 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6d13de14-f214-40e0-8d51-27dc19df41a2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:51.979765 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d13de14-f214-40e0-8d51-27dc19df41a2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:51.983226 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d13de14-f214-40e0-8d51-27dc19df41a2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:51.985258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d13de14-f214-40e0-8d51-27dc19df41a2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:51.988281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d13de14-f214-40e0-8d51-27dc19df41a2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:52.344757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6d13de14-f214-40e0-8d51-27dc19df41a2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:52.378200 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6d13de14-f214-40e0-8d51-27dc19df41a2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:52.387298 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6d13de14-f214-40e0-8d51-27dc19df41a2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:52.390848 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6d13de14-f214-40e0-8d51-27dc19df41a2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 1567 microversion: 2.25 time: 0.464180 Jul 19 22:27:52.392214 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 351/676] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:27:51 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 1567 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:27:52.410413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-78ce02d8-a8ab-48f9-a248-4e16ad05c7cd tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a1083fee0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:52.535764 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-78ce02d8-a8ab-48f9-a248-4e16ad05c7cd tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5" status: 200 len: 1414 microversion: 2.1 time: 0.142275 Jul 19 22:27:52.536543 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 352/677] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:27:52 2022] GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5 => generated 1414 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:52.561747 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0dd808f0-a7dc-46b2-b500-110a6d251ae8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:52.566816 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0dd808f0-a7dc-46b2-b500-110a6d251ae8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:52.589540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0dd808f0-a7dc-46b2-b500-110a6d251ae8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:52.590808 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0dd808f0-a7dc-46b2-b500-110a6d251ae8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:52.591296 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0dd808f0-a7dc-46b2-b500-110a6d251ae8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:52.591851 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0dd808f0-a7dc-46b2-b500-110a6d251ae8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:52.701976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:27:53.019083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0dd808f0-a7dc-46b2-b500-110a6d251ae8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:53.035717 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0dd808f0-a7dc-46b2-b500-110a6d251ae8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1469 microversion: 2.1 time: 0.497875 Jul 19 22:27:53.036978 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 353/678] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:52 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1469 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:53.043805 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2c316ee1-7842-461a-8348-35de039c5fac tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:53.045148 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2c316ee1-7842-461a-8348-35de039c5fac tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 9d261177-b837-4836-959b-2b419921e90c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:53.058328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2c316ee1-7842-461a-8348-35de039c5fac tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:53.059765 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2c316ee1-7842-461a-8348-35de039c5fac tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:53.062528 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2c316ee1-7842-461a-8348-35de039c5fac tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:53.063973 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2c316ee1-7842-461a-8348-35de039c5fac tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:53.276748 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2c316ee1-7842-461a-8348-35de039c5fac tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:53.297321 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2c316ee1-7842-461a-8348-35de039c5fac tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c" status: 200 len: 1213 microversion: 2.1 time: 0.258925 Jul 19 22:27:53.308575 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 354/679] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:53 2022] GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c => generated 1213 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:53.325953 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ce7c7974-5810-4a2d-97d7-5c2a86387796 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:53.329537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ce7c7974-5810-4a2d-97d7-5c2a86387796 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:53.355925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ce7c7974-5810-4a2d-97d7-5c2a86387796 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:53.356601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ce7c7974-5810-4a2d-97d7-5c2a86387796 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:53.365013 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ce7c7974-5810-4a2d-97d7-5c2a86387796 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:53.365806 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ce7c7974-5810-4a2d-97d7-5c2a86387796 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:53.439975 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ce7c7974-5810-4a2d-97d7-5c2a86387796 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:27:53.579953 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ce7c7974-5810-4a2d-97d7-5c2a86387796 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3" status: 204 len: 0 microversion: 2.1 time: 0.276562 Jul 19 22:27:53.581613 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 355/680] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:27:53 2022] DELETE /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:27:53.591042 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-30558584-7eb1-4e27-b0a5-df876deb7343 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:53.594370 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-30558584-7eb1-4e27-b0a5-df876deb7343 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:53.605851 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-30558584-7eb1-4e27-b0a5-df876deb7343 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:53.606697 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-30558584-7eb1-4e27-b0a5-df876deb7343 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:53.608262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-30558584-7eb1-4e27-b0a5-df876deb7343 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:53.609604 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-30558584-7eb1-4e27-b0a5-df876deb7343 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:53.759861 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-30558584-7eb1-4e27-b0a5-df876deb7343 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "POST /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5/action" status: 204 len: 0 microversion: 2.1 time: 0.176029 Jul 19 22:27:53.760541 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 356/681] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:27:53 2022] POST /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5/action => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:27:53.770492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1ff2a680-9ca2-4e2e-a281-694881315856 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:53.770833 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1ff2a680-9ca2-4e2e-a281-694881315856 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:53.789889 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1ff2a680-9ca2-4e2e-a281-694881315856 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:53.790343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1ff2a680-9ca2-4e2e-a281-694881315856 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:53.791179 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1ff2a680-9ca2-4e2e-a281-694881315856 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:53.791736 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1ff2a680-9ca2-4e2e-a281-694881315856 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:54.224397 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1ff2a680-9ca2-4e2e-a281-694881315856 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:54.235810 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1ff2a680-9ca2-4e2e-a281-694881315856 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:54.237710 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1ff2a680-9ca2-4e2e-a281-694881315856 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:54.239223 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1ff2a680-9ca2-4e2e-a281-694881315856 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 1567 microversion: 2.25 time: 0.473898 Jul 19 22:27:54.240145 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 357/682] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:27:53 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 1567 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:27:54.268044 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-25413f7a-add4-4d5e-bac5-7eaf4003c4a9 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a108faa60>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:54.332118 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-25413f7a-add4-4d5e-bac5-7eaf4003c4a9 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5" status: 200 len: 1414 microversion: 2.1 time: 0.090591 Jul 19 22:27:54.333498 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 358/683] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:27:54 2022] GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5 => generated 1414 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:54.343597 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6e479175-d176-4430-8837-5ab1a826b0bd tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:54.345091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6e479175-d176-4430-8837-5ab1a826b0bd tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:54.352265 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e479175-d176-4430-8837-5ab1a826b0bd tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:54.352920 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e479175-d176-4430-8837-5ab1a826b0bd tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:54.353907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e479175-d176-4430-8837-5ab1a826b0bd tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:54.354558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e479175-d176-4430-8837-5ab1a826b0bd tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:54.724858 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6e479175-d176-4430-8837-5ab1a826b0bd tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:54.750186 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6e479175-d176-4430-8837-5ab1a826b0bd tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3" status: 200 len: 1713 microversion: 2.1 time: 0.415381 Jul 19 22:27:54.767290 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 359/684] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:54 2022] GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 => generated 1713 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:54.776006 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-82b6926c-abca-49ca-ab79-63210329f743 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:54.776793 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-82b6926c-abca-49ca-ab79-63210329f743 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:54.785430 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-82b6926c-abca-49ca-ab79-63210329f743 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:54.785904 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-82b6926c-abca-49ca-ab79-63210329f743 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:54.786829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-82b6926c-abca-49ca-ab79-63210329f743 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:54.787296 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-82b6926c-abca-49ca-ab79-63210329f743 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:55.323191 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-82b6926c-abca-49ca-ab79-63210329f743 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:55.335178 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-82b6926c-abca-49ca-ab79-63210329f743 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1469 microversion: 2.1 time: 0.579487 Jul 19 22:27:55.338852 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 360/685] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:54 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1469 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:55.347676 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e463e6de-9f60-4c8c-be60-c4ac61a7527d tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:55.350947 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e463e6de-9f60-4c8c-be60-c4ac61a7527d tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 9d261177-b837-4836-959b-2b419921e90c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:55.364331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e463e6de-9f60-4c8c-be60-c4ac61a7527d tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:55.367229 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e463e6de-9f60-4c8c-be60-c4ac61a7527d tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:55.368700 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e463e6de-9f60-4c8c-be60-c4ac61a7527d tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:55.370958 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e463e6de-9f60-4c8c-be60-c4ac61a7527d tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:55.517141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e463e6de-9f60-4c8c-be60-c4ac61a7527d tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:55.528298 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e463e6de-9f60-4c8c-be60-c4ac61a7527d tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c" status: 200 len: 1277 microversion: 2.1 time: 0.187993 Jul 19 22:27:55.537519 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 361/686] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:55 2022] GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c => generated 1277 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:55.542764 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d295cef5-3bb1-431f-bafc-60111c852db7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:55.543868 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d295cef5-3bb1-431f-bafc-60111c852db7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:55.553440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d295cef5-3bb1-431f-bafc-60111c852db7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:55.554955 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d295cef5-3bb1-431f-bafc-60111c852db7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:55.556048 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d295cef5-3bb1-431f-bafc-60111c852db7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:55.556706 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d295cef5-3bb1-431f-bafc-60111c852db7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:56.233180 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d295cef5-3bb1-431f-bafc-60111c852db7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:56.260197 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d295cef5-3bb1-431f-bafc-60111c852db7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:56.269792 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d295cef5-3bb1-431f-bafc-60111c852db7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:56.274043 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d295cef5-3bb1-431f-bafc-60111c852db7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 1567 microversion: 2.25 time: 0.732214 Jul 19 22:27:56.274667 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 362/687] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:27:55 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 1567 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:27:56.333471 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3da9a6a4-12c6-45d2-8784-5156ca368172 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a108fa940>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:56.440744 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3da9a6a4-12c6-45d2-8784-5156ca368172 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5" status: 200 len: 1414 microversion: 2.1 time: 0.161345 Jul 19 22:27:56.448976 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 363/688] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:27:56 2022] GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5 => generated 1414 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:56.454882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1c1f99c5-e6f1-4104-ad4b-87afbca1fe35 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:56.455915 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1c1f99c5-e6f1-4104-ad4b-87afbca1fe35 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:56.463565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1c1f99c5-e6f1-4104-ad4b-87afbca1fe35 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:56.464248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1c1f99c5-e6f1-4104-ad4b-87afbca1fe35 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:56.465503 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1c1f99c5-e6f1-4104-ad4b-87afbca1fe35 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:56.466349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1c1f99c5-e6f1-4104-ad4b-87afbca1fe35 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:57.384296 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1c1f99c5-e6f1-4104-ad4b-87afbca1fe35 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:57.398341 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1c1f99c5-e6f1-4104-ad4b-87afbca1fe35 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3" status: 200 len: 1713 microversion: 2.1 time: 0.947722 Jul 19 22:27:57.399540 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 364/689] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:56 2022] GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 => generated 1713 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:57.404278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-53877815-e8d3-47f4-9191-fac911b4aa26 req-4a5132c1-5343-455e-bb44-60b6cc81676f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f7dcd8-59a5-4e02-8774-9d5e8b4616f5", "name": "network-vif-plugged", "status": "completed", "tag": "ecd96882-feb4-4205-a4ed-b44495364c7d"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:57.425419 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-53877815-e8d3-47f4-9191-fac911b4aa26 req-4a5132c1-5343-455e-bb44-60b6cc81676f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:57.429911 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-53877815-e8d3-47f4-9191-fac911b4aa26 req-4a5132c1-5343-455e-bb44-60b6cc81676f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:57.465867 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-53877815-e8d3-47f4-9191-fac911b4aa26 req-4a5132c1-5343-455e-bb44-60b6cc81676f service nova] Creating event network-vif-plugged:ecd96882-feb4-4205-a4ed-b44495364c7d for instance 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 on n-h1-847009-3 Jul 19 22:27:57.474625 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-53877815-e8d3-47f4-9191-fac911b4aa26 req-4a5132c1-5343-455e-bb44-60b6cc81676f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073127 Jul 19 22:27:57.479843 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 365/690] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:57.492496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-789d6f83-4e40-4cd7-9ecc-b570fd4c422e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:57.493667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-789d6f83-4e40-4cd7-9ecc-b570fd4c422e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:57.504805 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-789d6f83-4e40-4cd7-9ecc-b570fd4c422e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:57.505773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-789d6f83-4e40-4cd7-9ecc-b570fd4c422e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:57.506745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-789d6f83-4e40-4cd7-9ecc-b570fd4c422e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:57.507627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-789d6f83-4e40-4cd7-9ecc-b570fd4c422e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:57.893287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:27:58.016515 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-789d6f83-4e40-4cd7-9ecc-b570fd4c422e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:58.024960 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-789d6f83-4e40-4cd7-9ecc-b570fd4c422e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1461 microversion: 2.1 time: 0.543563 Jul 19 22:27:58.039715 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 366/691] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:57 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1461 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:58.046945 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7efc987e-ad2f-41bf-81ab-120b10467244 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a/action" status: 202 len: 0 microversion: 2.1 time: 6.447304 Jul 19 22:27:58.050502 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 326/692] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:27:51 2022] POST /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a/action => generated 0 bytes in 6452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:27:58.051670 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ab3486be-2ced-4a8a-bb9e-ca0c865d8a9f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:58.052482 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ab3486be-2ced-4a8a-bb9e-ca0c865d8a9f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 9d261177-b837-4836-959b-2b419921e90c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:58.064556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f06d1812-57a2-44a4-afc6-48614053bea2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:58.066450 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab3486be-2ced-4a8a-bb9e-ca0c865d8a9f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:58.067064 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab3486be-2ced-4a8a-bb9e-ca0c865d8a9f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:58.069421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f06d1812-57a2-44a4-afc6-48614053bea2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:58.071016 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab3486be-2ced-4a8a-bb9e-ca0c865d8a9f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:58.072099 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab3486be-2ced-4a8a-bb9e-ca0c865d8a9f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:58.132873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f06d1812-57a2-44a4-afc6-48614053bea2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:58.136075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f06d1812-57a2-44a4-afc6-48614053bea2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:58.136876 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f06d1812-57a2-44a4-afc6-48614053bea2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:58.146115 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f06d1812-57a2-44a4-afc6-48614053bea2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:58.350190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ab3486be-2ced-4a8a-bb9e-ca0c865d8a9f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:58.364957 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ab3486be-2ced-4a8a-bb9e-ca0c865d8a9f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c" status: 200 len: 1275 microversion: 2.1 time: 0.323750 Jul 19 22:27:58.366001 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 367/693] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:58 2022] GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c => generated 1275 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:58.383402 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-22b9807c-97f2-4aa2-b5b7-3ed4074a0d65 req-32f9a552-ceb1-4466-9775-4f9a9ac695e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374ab7ad-b415-4516-8aa8-282bdfaa6600", "name": "network-vif-unplugged", "status": "completed", "tag": "726ca660-8b38-4bdc-a645-af1d096b28e4"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:27:58.401397 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-22b9807c-97f2-4aa2-b5b7-3ed4074a0d65 req-32f9a552-ceb1-4466-9775-4f9a9ac695e7 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:58.402512 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-22b9807c-97f2-4aa2-b5b7-3ed4074a0d65 req-32f9a552-ceb1-4466-9775-4f9a9ac695e7 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:58.420034 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-22b9807c-97f2-4aa2-b5b7-3ed4074a0d65 req-32f9a552-ceb1-4466-9775-4f9a9ac695e7 service nova] Creating event network-vif-unplugged:726ca660-8b38-4bdc-a645-af1d096b28e4 for instance 374ab7ad-b415-4516-8aa8-282bdfaa6600 on n-h2-847009-3 Jul 19 22:27:58.440367 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-22b9807c-97f2-4aa2-b5b7-3ed4074a0d65 req-32f9a552-ceb1-4466-9775-4f9a9ac695e7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072507 Jul 19 22:27:58.441584 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 368/694] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:27:58.446831 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6d4e8706-1c4a-4160-ab77-ef876f89b679 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a1080f670>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:58.574262 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6d4e8706-1c4a-4160-ab77-ef876f89b679 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5" status: 200 len: 1414 microversion: 2.1 time: 0.130287 Jul 19 22:27:58.575417 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 369/695] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:27:58 2022] GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5 => generated 1414 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:58.602162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-99369e96-fe27-424d-ade5-1d095acf7432 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:58.604360 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-99369e96-fe27-424d-ade5-1d095acf7432 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:58.615870 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99369e96-fe27-424d-ade5-1d095acf7432 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:58.621698 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99369e96-fe27-424d-ade5-1d095acf7432 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:58.623101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99369e96-fe27-424d-ade5-1d095acf7432 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:58.624872 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99369e96-fe27-424d-ade5-1d095acf7432 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:59.759483 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f06d1812-57a2-44a4-afc6-48614053bea2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:59.773666 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f06d1812-57a2-44a4-afc6-48614053bea2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:59.789184 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f06d1812-57a2-44a4-afc6-48614053bea2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:59.793511 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f06d1812-57a2-44a4-afc6-48614053bea2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 1567 microversion: 2.25 time: 1.741475 Jul 19 22:27:59.796918 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 327/696] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:27:58 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 1567 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:27:59.818926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-55fc2ec0-585f-4dcf-8d7a-bcd9e4ac2f73 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:59.822914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-55fc2ec0-585f-4dcf-8d7a-bcd9e4ac2f73 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:59.850737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55fc2ec0-585f-4dcf-8d7a-bcd9e4ac2f73 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:59.851231 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55fc2ec0-585f-4dcf-8d7a-bcd9e4ac2f73 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:59.857107 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55fc2ec0-585f-4dcf-8d7a-bcd9e4ac2f73 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:59.857677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55fc2ec0-585f-4dcf-8d7a-bcd9e4ac2f73 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:59.900933 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-99369e96-fe27-424d-ade5-1d095acf7432 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:27:59.916151 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-99369e96-fe27-424d-ade5-1d095acf7432 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1461 microversion: 2.1 time: 1.336422 Jul 19 22:27:59.931650 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 370/697] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:58 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1461 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:27:59.939471 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7696670e-b699-40fd-8e9d-68bae7f8ed33 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:27:59.943800 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7696670e-b699-40fd-8e9d-68bae7f8ed33 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:27:59.966339 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7696670e-b699-40fd-8e9d-68bae7f8ed33 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:59.967747 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7696670e-b699-40fd-8e9d-68bae7f8ed33 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:27:59.968811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7696670e-b699-40fd-8e9d-68bae7f8ed33 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:27:59.969362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7696670e-b699-40fd-8e9d-68bae7f8ed33 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:00.003128 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:00.071424 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7696670e-b699-40fd-8e9d-68bae7f8ed33 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:00.071884 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7696670e-b699-40fd-8e9d-68bae7f8ed33 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:00.072351 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-7696670e-b699-40fd-8e9d-68bae7f8ed33 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lazy-loading 'fault' on Instance uuid 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:28:00.159390 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7696670e-b699-40fd-8e9d-68bae7f8ed33 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9580b63c415471a8faa6b536f9c44fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc98e9ff0b84256bf722b6ca82f76c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:00.173307 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7696670e-b699-40fd-8e9d-68bae7f8ed33 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3" status: 200 len: 1353 microversion: 2.1 time: 0.238611 Jul 19 22:28:00.177055 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 371/698] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:59 2022] GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 => generated 1353 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:00.191895 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e1c26a6a-ef58-410b-ba1a-7c25ff73c0fa tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:00.192407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e1c26a6a-ef58-410b-ba1a-7c25ff73c0fa tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 9d261177-b837-4836-959b-2b419921e90c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:00.211072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e1c26a6a-ef58-410b-ba1a-7c25ff73c0fa tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:00.211682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e1c26a6a-ef58-410b-ba1a-7c25ff73c0fa tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:00.212515 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e1c26a6a-ef58-410b-ba1a-7c25ff73c0fa tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:00.212957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e1c26a6a-ef58-410b-ba1a-7c25ff73c0fa tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:00.593061 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-55fc2ec0-585f-4dcf-8d7a-bcd9e4ac2f73 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:00.608529 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-55fc2ec0-585f-4dcf-8d7a-bcd9e4ac2f73 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1504 microversion: 2.1 time: 0.798049 Jul 19 22:28:00.619004 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 328/699] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:27:59 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1504 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:00.628268 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-bb1b8b47-53e2-4234-a7b8-c9fd73e963dc req-f219e50d-363d-4988-a4b9-fd8640ef1f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3", "name": "network-vif-deleted", "tag": "b1477d1a-c2f1-4c8c-b3a5-db002ad3db13"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:00.656967 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-bb1b8b47-53e2-4234-a7b8-c9fd73e963dc req-f219e50d-363d-4988-a4b9-fd8640ef1f93 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:00.661629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-bb1b8b47-53e2-4234-a7b8-c9fd73e963dc req-f219e50d-363d-4988-a4b9-fd8640ef1f93 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:00.690407 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-bb1b8b47-53e2-4234-a7b8-c9fd73e963dc req-f219e50d-363d-4988-a4b9-fd8640ef1f93 service nova] Creating event network-vif-deleted:b1477d1a-c2f1-4c8c-b3a5-db002ad3db13 for instance 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 on n-h2-847009-3 Jul 19 22:28:00.704084 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-bb1b8b47-53e2-4234-a7b8-c9fd73e963dc req-f219e50d-363d-4988-a4b9-fd8640ef1f93 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081088 Jul 19 22:28:00.708013 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 329/700] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:00.719278 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d825b74d-7b8d-4a5b-b500-4b6e22093de8 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a107ab700>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:00.812209 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d825b74d-7b8d-4a5b-b500-4b6e22093de8 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5" status: 200 len: 1414 microversion: 2.1 time: 0.102581 Jul 19 22:28:00.818316 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 330/701] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:28:00 2022] GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5 => generated 1414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:00.825586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-3339ef18-385a-4f6f-9a6c-ecaac4dee5bc req-83ab60cc-a530-4d60-bc31-f1cc6594812f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63853a7-f403-42e3-9a4b-fb322a8decd6", "name": "network-vif-plugged", "status": "completed", "tag": "a4f5bb99-23dd-4735-9565-0e8ced8c4323"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:00.849380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-3339ef18-385a-4f6f-9a6c-ecaac4dee5bc req-83ab60cc-a530-4d60-bc31-f1cc6594812f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:00.849975 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-3339ef18-385a-4f6f-9a6c-ecaac4dee5bc req-83ab60cc-a530-4d60-bc31-f1cc6594812f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:00.878468 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-3339ef18-385a-4f6f-9a6c-ecaac4dee5bc req-83ab60cc-a530-4d60-bc31-f1cc6594812f service nova] Creating event network-vif-plugged:a4f5bb99-23dd-4735-9565-0e8ced8c4323 for instance c63853a7-f403-42e3-9a4b-fb322a8decd6 on n-h1-847009-3 Jul 19 22:28:00.892118 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-3339ef18-385a-4f6f-9a6c-ecaac4dee5bc req-83ab60cc-a530-4d60-bc31-f1cc6594812f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075640 Jul 19 22:28:00.892761 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 331/702] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:00.905083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a597be63-9730-4107-a1d0-226ce12810d6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Action: 'create', calling method: .version_select at 0x7f7a107abe50>, body: {"keypair": {"name": "tempest-keypair-628086489", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMhnk0g0em8E097JWcGLiJ9FVof6GKc81U5He1IwbqaOAIke8sIvR/++3UkdgYLXRjvAvxYG/OgjThO1lRciVg1czJgJ4bNHomA2aFy/3MQ+GY6VoRGqzv55c8tmFpfXw=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:00.935987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-a597be63-9730-4107-a1d0-226ce12810d6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Getting quotas for project eed5e83db4ae4156ae9635b84ca7ff4a. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:28:00.945411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-a597be63-9730-4107-a1d0-226ce12810d6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Getting quotas for user e3ef9d4c38d547a1a1532d964195144a and project eed5e83db4ae4156ae9635b84ca7ff4a. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:28:01.004977 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a597be63-9730-4107-a1d0-226ce12810d6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.106210 Jul 19 22:28:01.007565 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 332/703] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:28:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:01.020291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ea013285-fead-4785-aa3f-365f55716d0a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:01.023895 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ea013285-fead-4785-aa3f-365f55716d0a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:01.037296 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea013285-fead-4785-aa3f-365f55716d0a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:01.037758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea013285-fead-4785-aa3f-365f55716d0a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:01.044017 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea013285-fead-4785-aa3f-365f55716d0a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:01.045627 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea013285-fead-4785-aa3f-365f55716d0a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:01.125587 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e1c26a6a-ef58-410b-ba1a-7c25ff73c0fa tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:01.148103 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e1c26a6a-ef58-410b-ba1a-7c25ff73c0fa tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c" status: 200 len: 1317 microversion: 2.1 time: 0.969790 Jul 19 22:28:01.161511 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 372/704] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:00 2022] GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c => generated 1317 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:01.192843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e545f9df-bdcb-4300-a8fa-24a8e378fc3c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:01.193734 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e545f9df-bdcb-4300-a8fa-24a8e378fc3c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:01.209223 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e545f9df-bdcb-4300-a8fa-24a8e378fc3c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:01.209993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e545f9df-bdcb-4300-a8fa-24a8e378fc3c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:01.210973 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e545f9df-bdcb-4300-a8fa-24a8e378fc3c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:01.211604 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e545f9df-bdcb-4300-a8fa-24a8e378fc3c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:01.230118 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-e545f9df-bdcb-4300-a8fa-24a8e378fc3c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] HTTP exception thrown: Instance 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 could not be found. Jul 19 22:28:01.232112 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e545f9df-bdcb-4300-a8fa-24a8e378fc3c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Request method failure captured: Jul 19 22:28:01.232112 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 HTTP/1.1 Jul 19 22:28:01.232112 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:28:01.232112 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:28:01.232112 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:28:01.232112 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:28:01.232112 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:28:01.232112 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:28:01.232112 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:28:01.232112 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:28:01.232112 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y87U-6s_bSiSfhAyXKaY5mj5eHgn2rlISOjxAuPNHvO9ylUsemY5Ob9-7ANP15Gh0Xk7wn61vLFTbUn5NBGZb3IctoOKZrWhMLII0mWA0DREKbd2JdMgp4x8Itnh1ytOLEvzyaExw7G6UFB8kfq8FVdbOb0Agsr12EzNTgsysmVrzY Jul 19 22:28:01.232112 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:28:01.232112 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:28:01.232112 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:28:01.232112 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:28:01.232112 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:28:01.232112 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:28:01.232112 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: dbc98e9ff0b84256bf722b6ca82f76c1 Jul 19 22:28:01.232112 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1717169581 Jul 19 22:28:01.232112 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:28:01.232112 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:28:01.234775 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:28:01.234775 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1717169581 Jul 19 22:28:01.234775 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: dbc98e9ff0b84256bf722b6ca82f76c1 Jul 19 22:28:01.234775 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1717169581 Jul 19 22:28:01.234775 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1717169581-project Jul 19 22:28:01.234775 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:28:01.234775 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:28:01.234775 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: d9580b63c415471a8faa6b536f9c44fb Jul 19 22:28:01.234775 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1717169581-project Jul 19 22:28:01.234775 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:28:01.234775 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 could not be found. Jul 19 22:28:01.234775 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3'} Jul 19 22:28:01.235906 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:28:01.235906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:28:01.235906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:28:01.235906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:28:01.235906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:28:01.235906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:28:01.235906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:28:01.235906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:28:01.235906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:28:01.235906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:28:01.235906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 could not be found. Jul 19 22:28:01.235906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:01.235906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:28:01.235906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:01.235906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:28:01.235906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:28:01.235906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:28:01.235906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:28:01.235906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:28:01.235906 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:28:01.237236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:28:01.237236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:28:01.237236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:28:01.237236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:28:01.237236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:28:01.237236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:28:01.237236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:28:01.237236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 could not be found. Jul 19 22:28:01.237236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:01.237236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:28:01.237236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:01.237236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:28:01.237236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:28:01.237236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:28:01.237236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:28:01.237236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:28:01.237236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 could not be found. Jul 19 22:28:01.237236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:01.239288 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e545f9df-bdcb-4300-a8fa-24a8e378fc3c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Returning 404 to user: Instance 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:28:01.240342 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e545f9df-bdcb-4300-a8fa-24a8e378fc3c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3" status: 404 len: 111 microversion: 2.1 time: 0.051406 Jul 19 22:28:01.244574 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 373/705] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:01 2022] GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:28:01.250244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8b64c886-5605-4db4-aa6a-52934106864c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:01.251010 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8b64c886-5605-4db4-aa6a-52934106864c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:01.257866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b64c886-5605-4db4-aa6a-52934106864c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:01.258591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b64c886-5605-4db4-aa6a-52934106864c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:01.259582 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b64c886-5605-4db4-aa6a-52934106864c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:01.260189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b64c886-5605-4db4-aa6a-52934106864c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:01.281536 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-8b64c886-5605-4db4-aa6a-52934106864c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] HTTP exception thrown: Instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a could not be found. Jul 19 22:28:01.283952 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8b64c886-5605-4db4-aa6a-52934106864c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Request method failure captured: Jul 19 22:28:01.283952 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a HTTP/1.1 Jul 19 22:28:01.283952 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:28:01.283952 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:28:01.283952 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:28:01.283952 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:28:01.283952 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:28:01.283952 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:28:01.283952 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:28:01.283952 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:28:01.283952 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y87U-6s_bSiSfhAyXKaY5mj5eHgn2rlISOjxAuPNHvO9ylUsemY5Ob9-7ANP15Gh0Xk7wn61vLFTbUn5NBGZb3IctoOKZrWhMLII0mWA0DREKbd2JdMgp4x8Itnh1ytOLEvzyaExw7G6UFB8kfq8FVdbOb0Agsr12EzNTgsysmVrzY Jul 19 22:28:01.283952 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:28:01.283952 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:28:01.283952 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:28:01.283952 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:28:01.283952 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:28:01.283952 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:28:01.283952 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: dbc98e9ff0b84256bf722b6ca82f76c1 Jul 19 22:28:01.283952 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1717169581 Jul 19 22:28:01.283952 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:28:01.283952 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:28:01.285630 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:28:01.285630 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1717169581 Jul 19 22:28:01.285630 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: dbc98e9ff0b84256bf722b6ca82f76c1 Jul 19 22:28:01.285630 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1717169581 Jul 19 22:28:01.285630 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1717169581-project Jul 19 22:28:01.285630 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:28:01.285630 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:28:01.285630 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: d9580b63c415471a8faa6b536f9c44fb Jul 19 22:28:01.285630 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1717169581-project Jul 19 22:28:01.285630 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:28:01.285630 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a could not be found. Jul 19 22:28:01.285630 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a'} Jul 19 22:28:01.286384 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:28:01.286384 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:28:01.286384 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:28:01.286384 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:28:01.286384 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:28:01.286384 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:28:01.286384 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:28:01.286384 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:28:01.286384 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:28:01.286384 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:28:01.286384 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a could not be found. Jul 19 22:28:01.286384 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:01.286384 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:28:01.286384 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:01.286384 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:28:01.286384 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:28:01.286384 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:28:01.286384 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:28:01.286384 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:28:01.286384 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:28:01.287588 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:28:01.287588 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:28:01.287588 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:28:01.287588 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:28:01.287588 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:28:01.287588 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:28:01.287588 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:28:01.287588 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:28:01.287588 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:28:01.287588 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a could not be found. Jul 19 22:28:01.287588 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:01.287588 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:28:01.287588 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:01.287588 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:28:01.287588 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:28:01.287588 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:28:01.287588 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:28:01.287588 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:28:01.287588 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a could not be found. Jul 19 22:28:01.287588 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:01.289547 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8b64c886-5605-4db4-aa6a-52934106864c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Returning 404 to user: Instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:28:01.290591 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8b64c886-5605-4db4-aa6a-52934106864c tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a" status: 404 len: 111 microversion: 2.1 time: 0.044735 Jul 19 22:28:01.291498 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 374/706] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:28:01 2022] DELETE /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:28:01.312413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-df0b103f-de0b-49fd-90c8-8d7292c3b8a3 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:01.318020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-df0b103f-de0b-49fd-90c8-8d7292c3b8a3 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:01.338640 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-df0b103f-de0b-49fd-90c8-8d7292c3b8a3 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:01.339369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-df0b103f-de0b-49fd-90c8-8d7292c3b8a3 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:01.339936 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-df0b103f-de0b-49fd-90c8-8d7292c3b8a3 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:01.340381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-df0b103f-de0b-49fd-90c8-8d7292c3b8a3 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:01.392050 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-df0b103f-de0b-49fd-90c8-8d7292c3b8a3 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] HTTP exception thrown: Instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a could not be found. Jul 19 22:28:01.394278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-df0b103f-de0b-49fd-90c8-8d7292c3b8a3 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Request method failure captured: Jul 19 22:28:01.394278 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a HTTP/1.1 Jul 19 22:28:01.394278 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:28:01.394278 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:28:01.394278 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:28:01.394278 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:28:01.394278 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:28:01.394278 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:28:01.394278 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:28:01.394278 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:28:01.394278 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y87U-6s_bSiSfhAyXKaY5mj5eHgn2rlISOjxAuPNHvO9ylUsemY5Ob9-7ANP15Gh0Xk7wn61vLFTbUn5NBGZb3IctoOKZrWhMLII0mWA0DREKbd2JdMgp4x8Itnh1ytOLEvzyaExw7G6UFB8kfq8FVdbOb0Agsr12EzNTgsysmVrzY Jul 19 22:28:01.394278 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:28:01.394278 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:28:01.394278 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:28:01.394278 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:28:01.394278 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:28:01.394278 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:28:01.394278 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: dbc98e9ff0b84256bf722b6ca82f76c1 Jul 19 22:28:01.394278 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1717169581 Jul 19 22:28:01.394278 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:28:01.394278 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:28:01.395973 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:28:01.395973 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1717169581 Jul 19 22:28:01.395973 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: dbc98e9ff0b84256bf722b6ca82f76c1 Jul 19 22:28:01.395973 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1717169581 Jul 19 22:28:01.395973 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1717169581-project Jul 19 22:28:01.395973 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:28:01.395973 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:28:01.395973 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: d9580b63c415471a8faa6b536f9c44fb Jul 19 22:28:01.395973 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1717169581-project Jul 19 22:28:01.395973 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:28:01.395973 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a could not be found. Jul 19 22:28:01.395973 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a'} Jul 19 22:28:01.396803 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:28:01.396803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:28:01.396803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:28:01.396803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:28:01.396803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:28:01.396803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:28:01.396803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:28:01.396803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:28:01.396803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:28:01.396803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:28:01.396803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a could not be found. Jul 19 22:28:01.396803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:01.396803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:28:01.396803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:01.396803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:28:01.396803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:28:01.396803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:28:01.396803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:28:01.396803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:28:01.396803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:28:01.398125 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:28:01.398125 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:28:01.398125 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:28:01.398125 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:28:01.398125 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:28:01.398125 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:28:01.398125 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:28:01.398125 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a could not be found. Jul 19 22:28:01.398125 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:01.398125 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:28:01.398125 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:01.398125 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:28:01.398125 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:28:01.398125 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:28:01.398125 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:28:01.398125 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:28:01.398125 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a could not be found. Jul 19 22:28:01.398125 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:01.400997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-df0b103f-de0b-49fd-90c8-8d7292c3b8a3 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Returning 404 to user: Instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:28:01.402041 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-df0b103f-de0b-49fd-90c8-8d7292c3b8a3 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a" status: 404 len: 111 microversion: 2.1 time: 0.103905 Jul 19 22:28:01.403083 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 375/707] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:01 2022] GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:28:01.412761 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-56c4e394-9a8c-4960-ba32-22ffaae1f326 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '.version_select at 0x7f7a10834c10>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:01.441738 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-56c4e394-9a8c-4960-ba32-22ffaae1f326 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-750221889" status: 202 len: 0 microversion: 2.1 time: 0.033140 Jul 19 22:28:01.447650 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 376/708] 10.222.0.25 () {58 vars in 1217 bytes} [Tue Jul 19 22:28:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-750221889 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:28:01.630326 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0b2aa816-151b-4289-ab53-5e5a86314e66 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:01.630853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0b2aa816-151b-4289-ab53-5e5a86314e66 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:01.638607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:01.663846 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0b2aa816-151b-4289-ab53-5e5a86314e66 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:01.664604 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0b2aa816-151b-4289-ab53-5e5a86314e66 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:01.666079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0b2aa816-151b-4289-ab53-5e5a86314e66 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:01.666615 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0b2aa816-151b-4289-ab53-5e5a86314e66 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:01.699418 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:01.896825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ea013285-fead-4785-aa3f-365f55716d0a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:01.901943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:01.917174 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ea013285-fead-4785-aa3f-365f55716d0a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:01.921379 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ea013285-fead-4785-aa3f-365f55716d0a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:01.922827 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ea013285-fead-4785-aa3f-365f55716d0a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 1567 microversion: 2.25 time: 0.914206 Jul 19 22:28:01.925795 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 333/709] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:01 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 1567 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:01.933199 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-518a2af9-a731-4377-9efd-6b9a35dd09e0 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a107abca0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:02.053432 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-518a2af9-a731-4377-9efd-6b9a35dd09e0 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5" status: 200 len: 1414 microversion: 2.1 time: 0.125998 Jul 19 22:28:02.055468 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 334/710] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:28:01 2022] GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5 => generated 1414 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:02.166904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d65604ab-fd47-4017-92d5-f0ee064a2ec5 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:02.167776 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d65604ab-fd47-4017-92d5-f0ee064a2ec5 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 9d261177-b837-4836-959b-2b419921e90c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:02.184819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d65604ab-fd47-4017-92d5-f0ee064a2ec5 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:02.187144 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d65604ab-fd47-4017-92d5-f0ee064a2ec5 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:02.191099 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d65604ab-fd47-4017-92d5-f0ee064a2ec5 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:02.194170 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d65604ab-fd47-4017-92d5-f0ee064a2ec5 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:02.549149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0b2aa816-151b-4289-ab53-5e5a86314e66 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:02.562230 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0b2aa816-151b-4289-ab53-5e5a86314e66 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1504 microversion: 2.1 time: 0.939793 Jul 19 22:28:02.571967 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 377/711] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:01 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1504 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:02.790577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-c5b168f2-2811-4785-8911-0ee6a856dc8b req-4c8d568d-2838-46f9-a990-b256e45952b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f752d932-1177-43ae-89b0-86a439bb446a", "name": "network-vif-unplugged", "status": "completed", "tag": "9795f500-4e5c-483d-95e2-204859a4140a"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:02.814531 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-c5b168f2-2811-4785-8911-0ee6a856dc8b req-4c8d568d-2838-46f9-a990-b256e45952b2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:02.814986 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-c5b168f2-2811-4785-8911-0ee6a856dc8b req-4c8d568d-2838-46f9-a990-b256e45952b2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:02.841539 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-c5b168f2-2811-4785-8911-0ee6a856dc8b req-4c8d568d-2838-46f9-a990-b256e45952b2 service nova] Creating event network-vif-unplugged:9795f500-4e5c-483d-95e2-204859a4140a for instance f752d932-1177-43ae-89b0-86a439bb446a on n-h1-847009-3 Jul 19 22:28:02.848355 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-c5b168f2-2811-4785-8911-0ee6a856dc8b req-4c8d568d-2838-46f9-a990-b256e45952b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061931 Jul 19 22:28:02.849962 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 378/712] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:02.950306 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3d38415d-b739-4ae1-b396-56bf1276a79c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:02.952137 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3d38415d-b739-4ae1-b396-56bf1276a79c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:02.976108 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d38415d-b739-4ae1-b396-56bf1276a79c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:02.977072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d38415d-b739-4ae1-b396-56bf1276a79c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:02.979460 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d38415d-b739-4ae1-b396-56bf1276a79c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:02.980093 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d38415d-b739-4ae1-b396-56bf1276a79c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:03.057687 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d65604ab-fd47-4017-92d5-f0ee064a2ec5 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:03.072916 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d65604ab-fd47-4017-92d5-f0ee064a2ec5 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c" status: 200 len: 1317 microversion: 2.1 time: 0.910592 Jul 19 22:28:03.089545 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 335/713] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:02 2022] GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c => generated 1317 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:03.095971 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5ab70750-08ae-48e0-af18-cdeb75a68e4f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a107e13a0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:03.217284 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5ab70750-08ae-48e0-af18-cdeb75a68e4f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5" status: 200 len: 1414 microversion: 2.1 time: 0.126124 Jul 19 22:28:03.227119 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 336/714] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:28:03 2022] GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5 => generated 1414 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:03.582990 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ff6a32cd-e15e-4a68-ab25-3731b6c8807c tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:03.584178 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ff6a32cd-e15e-4a68-ab25-3731b6c8807c tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:03.602882 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ff6a32cd-e15e-4a68-ab25-3731b6c8807c tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:03.606436 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ff6a32cd-e15e-4a68-ab25-3731b6c8807c tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:03.609126 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ff6a32cd-e15e-4a68-ab25-3731b6c8807c tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:03.612475 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ff6a32cd-e15e-4a68-ab25-3731b6c8807c tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:03.661397 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3d38415d-b739-4ae1-b396-56bf1276a79c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:03.673756 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3d38415d-b739-4ae1-b396-56bf1276a79c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:03.688588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3d38415d-b739-4ae1-b396-56bf1276a79c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:03.691049 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3d38415d-b739-4ae1-b396-56bf1276a79c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 1567 microversion: 2.25 time: 0.748425 Jul 19 22:28:03.698157 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 379/715] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:02 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 1567 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:04.098278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1de8d30f-c1fd-4d0f-9040-b47629fa2346 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:04.098924 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1de8d30f-c1fd-4d0f-9040-b47629fa2346 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 9d261177-b837-4836-959b-2b419921e90c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:04.118025 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1de8d30f-c1fd-4d0f-9040-b47629fa2346 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:04.120045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1de8d30f-c1fd-4d0f-9040-b47629fa2346 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:04.122461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1de8d30f-c1fd-4d0f-9040-b47629fa2346 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:04.128745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1de8d30f-c1fd-4d0f-9040-b47629fa2346 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:04.364945 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ff6a32cd-e15e-4a68-ab25-3731b6c8807c tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:04.377156 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ff6a32cd-e15e-4a68-ab25-3731b6c8807c tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1504 microversion: 2.1 time: 0.800621 Jul 19 22:28:04.378308 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 337/716] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:03 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1504 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:04.384011 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7cdc2aca-bfee-494e-9ad0-35641feee0d6 tempest-ServersWithSpecificFlavorTestJSON-467401142 tempest-ServersWithSpecificFlavorTestJSON-467401142-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:04.385557 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:28:04.385557 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:28:04.417001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=93,nova_api:UPDATE=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:04.427856 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7cdc2aca-bfee-494e-9ad0-35641feee0d6 tempest-ServersWithSpecificFlavorTestJSON-467401142 tempest-ServersWithSpecificFlavorTestJSON-467401142-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/308599732" status: 202 len: 0 microversion: 2.1 time: 0.046877 Jul 19 22:28:04.428786 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 338/717] 10.222.0.25 () {58 vars in 1157 bytes} [Tue Jul 19 22:28:04 2022] DELETE /compute/v2.1/flavors/308599732 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:28:04.440956 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0f24b2e7-aacb-49d7-a379-83b0565fa624 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a107d9af0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:04.519067 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0f24b2e7-aacb-49d7-a379-83b0565fa624 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5" status: 200 len: 1414 microversion: 2.1 time: 0.085806 Jul 19 22:28:04.520510 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 339/718] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:28:04 2022] GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5 => generated 1414 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:04.526348 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-148bae19-00bb-4903-b8da-ce95e2c49085 tempest-ServersWithSpecificFlavorTestJSON-467401142 tempest-ServersWithSpecificFlavorTestJSON-467401142-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:04.559868 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-148bae19-00bb-4903-b8da-ce95e2c49085 tempest-ServersWithSpecificFlavorTestJSON-467401142 tempest-ServersWithSpecificFlavorTestJSON-467401142-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.037829 Jul 19 22:28:04.561217 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 340/719] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:28:04 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:04.589737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3f498499-6fc6-4f80-9e71-f0ff441b0621 tempest-ServersWithSpecificFlavorTestJSON-467401142 tempest-ServersWithSpecificFlavorTestJSON-467401142-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:04.621107 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3f498499-6fc6-4f80-9e71-f0ff441b0621 tempest-ServersWithSpecificFlavorTestJSON-467401142 tempest-ServersWithSpecificFlavorTestJSON-467401142-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1091004659" status: 202 len: 0 microversion: 2.1 time: 0.040427 Jul 19 22:28:04.626564 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 341/720] 10.222.0.25 () {58 vars in 1160 bytes} [Tue Jul 19 22:28:04 2022] DELETE /compute/v2.1/flavors/1091004659 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:28:04.634533 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-63c9847d-ddfb-4b77-9cd7-1ad0164e433d tempest-ServersWithSpecificFlavorTestJSON-467401142 tempest-ServersWithSpecificFlavorTestJSON-467401142-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:04.680314 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-63c9847d-ddfb-4b77-9cd7-1ad0164e433d tempest-ServersWithSpecificFlavorTestJSON-467401142 tempest-ServersWithSpecificFlavorTestJSON-467401142-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051173 Jul 19 22:28:04.681723 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 342/721] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:28:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:04.719748 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fc713536-a002-4abd-83fd-e0abbe5f54fa tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:04.720556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fc713536-a002-4abd-83fd-e0abbe5f54fa tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:04.728917 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc713536-a002-4abd-83fd-e0abbe5f54fa tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:04.729813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc713536-a002-4abd-83fd-e0abbe5f54fa tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:04.730684 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc713536-a002-4abd-83fd-e0abbe5f54fa tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:04.731208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc713536-a002-4abd-83fd-e0abbe5f54fa tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:04.758967 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-fc713536-a002-4abd-83fd-e0abbe5f54fa tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] HTTP exception thrown: Instance 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 could not be found. Jul 19 22:28:04.761285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fc713536-a002-4abd-83fd-e0abbe5f54fa tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Request method failure captured: Jul 19 22:28:04.761285 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 HTTP/1.1 Jul 19 22:28:04.761285 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:28:04.761285 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:28:04.761285 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:28:04.761285 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:28:04.761285 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:28:04.761285 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:28:04.761285 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:28:04.761285 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:28:04.761285 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y87U-6s_bSiSfhAyXKaY5mj5eHgn2rlISOjxAuPNHvO9ylUsemY5Ob9-7ANP15Gh0Xk7wn61vLFTbUn5NBGZb3IctoOKZrWhMLII0mWA0DREKbd2JdMgp4x8Itnh1ytOLEvzyaExw7G6UFB8kfq8FVdbOb0Agsr12EzNTgsysmVrzY Jul 19 22:28:04.761285 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:28:04.761285 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:28:04.761285 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:28:04.761285 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:28:04.761285 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:28:04.761285 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:28:04.761285 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: dbc98e9ff0b84256bf722b6ca82f76c1 Jul 19 22:28:04.761285 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1717169581 Jul 19 22:28:04.761285 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:28:04.761285 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:28:04.769757 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:28:04.769757 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1717169581 Jul 19 22:28:04.769757 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: dbc98e9ff0b84256bf722b6ca82f76c1 Jul 19 22:28:04.769757 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1717169581 Jul 19 22:28:04.769757 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1717169581-project Jul 19 22:28:04.769757 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:28:04.769757 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:28:04.769757 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: d9580b63c415471a8faa6b536f9c44fb Jul 19 22:28:04.769757 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1717169581-project Jul 19 22:28:04.769757 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:28:04.769757 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 could not be found. Jul 19 22:28:04.769757 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3'} Jul 19 22:28:04.771250 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:28:04.771250 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:28:04.771250 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:28:04.771250 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:28:04.771250 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:28:04.771250 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:28:04.771250 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:28:04.771250 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:28:04.771250 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:28:04.771250 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:28:04.771250 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 could not be found. Jul 19 22:28:04.771250 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:28:04.771250 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:28:04.771250 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:28:04.771250 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:28:04.771250 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:28:04.771250 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:28:04.771250 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:28:04.771250 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:28:04.771250 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:28:04.773015 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:28:04.773015 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:28:04.773015 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:28:04.773015 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:28:04.773015 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:28:04.773015 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:28:04.773015 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:28:04.773015 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:28:04.773015 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:28:04.773015 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 could not be found. Jul 19 22:28:04.773015 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:28:04.773015 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:28:04.773015 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:28:04.773015 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:28:04.773015 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:28:04.773015 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:28:04.773015 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:28:04.773015 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:28:04.773015 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 could not be found. Jul 19 22:28:04.773015 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:28:04.775990 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fc713536-a002-4abd-83fd-e0abbe5f54fa tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Returning 404 to user: Instance 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:28:04.775990 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fc713536-a002-4abd-83fd-e0abbe5f54fa tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3" status: 404 len: 111 microversion: 2.1 time: 0.049500 Jul 19 22:28:04.775990 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 343/722] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:28:04 2022] DELETE /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:28:04.775990 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1a225c29-7c5b-4ba3-b6ca-199da78a74cf tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:04.775990 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1a225c29-7c5b-4ba3-b6ca-199da78a74cf tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:04.782749 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a225c29-7c5b-4ba3-b6ca-199da78a74cf tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:04.783249 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a225c29-7c5b-4ba3-b6ca-199da78a74cf tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:04.784078 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a225c29-7c5b-4ba3-b6ca-199da78a74cf tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:04.784551 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a225c29-7c5b-4ba3-b6ca-199da78a74cf tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:05.048191 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1de8d30f-c1fd-4d0f-9040-b47629fa2346 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:05.057750 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1de8d30f-c1fd-4d0f-9040-b47629fa2346 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c" status: 200 len: 1317 microversion: 2.1 time: 0.964330 Jul 19 22:28:05.058337 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 380/723] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:04 2022] GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c => generated 1317 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:05.069944 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-56f1894d-3872-44b1-bbc1-1472ad5bf371 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:05.077624 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-56f1894d-3872-44b1-bbc1-1472ad5bf371 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:05.091691 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-56f1894d-3872-44b1-bbc1-1472ad5bf371 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:05.092529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-56f1894d-3872-44b1-bbc1-1472ad5bf371 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:05.093462 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-56f1894d-3872-44b1-bbc1-1472ad5bf371 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:05.093983 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-56f1894d-3872-44b1-bbc1-1472ad5bf371 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:05.113732 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-56f1894d-3872-44b1-bbc1-1472ad5bf371 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] HTTP exception thrown: Instance 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 could not be found. Jul 19 22:28:05.117453 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-56f1894d-3872-44b1-bbc1-1472ad5bf371 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Request method failure captured: Jul 19 22:28:05.117453 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 HTTP/1.1 Jul 19 22:28:05.117453 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:28:05.117453 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:28:05.117453 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:28:05.117453 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:28:05.117453 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:28:05.117453 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:28:05.117453 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:28:05.117453 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:28:05.117453 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y87U-6s_bSiSfhAyXKaY5mj5eHgn2rlISOjxAuPNHvO9ylUsemY5Ob9-7ANP15Gh0Xk7wn61vLFTbUn5NBGZb3IctoOKZrWhMLII0mWA0DREKbd2JdMgp4x8Itnh1ytOLEvzyaExw7G6UFB8kfq8FVdbOb0Agsr12EzNTgsysmVrzY Jul 19 22:28:05.117453 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:28:05.117453 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:28:05.117453 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:28:05.117453 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:28:05.117453 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:28:05.117453 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:28:05.117453 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: dbc98e9ff0b84256bf722b6ca82f76c1 Jul 19 22:28:05.117453 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1717169581 Jul 19 22:28:05.117453 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:28:05.117453 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:28:05.119292 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:28:05.119292 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1717169581 Jul 19 22:28:05.119292 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: dbc98e9ff0b84256bf722b6ca82f76c1 Jul 19 22:28:05.119292 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1717169581 Jul 19 22:28:05.119292 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1717169581-project Jul 19 22:28:05.119292 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:28:05.119292 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:28:05.119292 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: d9580b63c415471a8faa6b536f9c44fb Jul 19 22:28:05.119292 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1717169581-project Jul 19 22:28:05.119292 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:28:05.119292 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 could not be found. Jul 19 22:28:05.119292 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3'} Jul 19 22:28:05.128511 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:28:05.128511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:28:05.128511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:28:05.128511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:28:05.128511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:28:05.128511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:28:05.128511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:28:05.128511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:28:05.128511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:28:05.128511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:28:05.128511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 could not be found. Jul 19 22:28:05.128511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:05.128511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:28:05.128511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:05.128511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:28:05.128511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:28:05.128511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:28:05.128511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:28:05.128511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:28:05.128511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:28:05.131997 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:28:05.131997 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:28:05.131997 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:28:05.131997 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:28:05.131997 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:28:05.131997 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:28:05.131997 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:28:05.131997 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 could not be found. Jul 19 22:28:05.131997 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:05.131997 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:28:05.131997 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:05.131997 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:28:05.131997 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:28:05.131997 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:28:05.131997 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:28:05.131997 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:28:05.131997 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 could not be found. Jul 19 22:28:05.131997 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:05.136482 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-56f1894d-3872-44b1-bbc1-1472ad5bf371 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Returning 404 to user: Instance 1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:28:05.136482 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-56f1894d-3872-44b1-bbc1-1472ad5bf371 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3" status: 404 len: 111 microversion: 2.1 time: 0.055765 Jul 19 22:28:05.136482 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 381/724] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:05 2022] GET /compute/v2.1/servers/1aa5dd8f-9bbd-4d43-b30e-bd87554cb9f3 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:28:05.157188 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-7bc25ee9-092c-4d2d-a0e2-68c993f04269 req-8a7a0dbc-55c4-4585-9249-cf479facc4f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f752d932-1177-43ae-89b0-86a439bb446a", "tag": "9795f500-4e5c-483d-95e2-204859a4140a"}, {"name": "network-changed", "server_uuid": "9d261177-b837-4836-959b-2b419921e90c", "tag": "6fdf2740-fff6-48fb-b225-03f5d4b86d01"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:05.181480 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-7bc25ee9-092c-4d2d-a0e2-68c993f04269 req-8a7a0dbc-55c4-4585-9249-cf479facc4f7 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:05.186633 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-7bc25ee9-092c-4d2d-a0e2-68c993f04269 req-8a7a0dbc-55c4-4585-9249-cf479facc4f7 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:05.219719 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-7bc25ee9-092c-4d2d-a0e2-68c993f04269 req-8a7a0dbc-55c4-4585-9249-cf479facc4f7 service nova] Creating event network-changed:9795f500-4e5c-483d-95e2-204859a4140a for instance f752d932-1177-43ae-89b0-86a439bb446a on n-h1-847009-3 Jul 19 22:28:05.220945 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-7bc25ee9-092c-4d2d-a0e2-68c993f04269 req-8a7a0dbc-55c4-4585-9249-cf479facc4f7 service nova] Creating event network-changed:6fdf2740-fff6-48fb-b225-03f5d4b86d01 for instance 9d261177-b837-4836-959b-2b419921e90c on n-h2-847009-3 Jul 19 22:28:05.246492 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1a225c29-7c5b-4ba3-b6ca-199da78a74cf tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:05.254184 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-7bc25ee9-092c-4d2d-a0e2-68c993f04269 req-8a7a0dbc-55c4-4585-9249-cf479facc4f7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.128831 Jul 19 22:28:05.255744 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 382/725] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:05.271926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-00fe4dfa-92ab-45ee-ae35-1471801fcba6 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:05.273195 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-00fe4dfa-92ab-45ee-ae35-1471801fcba6 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:05.274948 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1a225c29-7c5b-4ba3-b6ca-199da78a74cf tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:05.278920 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1a225c29-7c5b-4ba3-b6ca-199da78a74cf tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:05.284051 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1a225c29-7c5b-4ba3-b6ca-199da78a74cf tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 1557 microversion: 2.25 time: 0.515561 Jul 19 22:28:05.292844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-00fe4dfa-92ab-45ee-ae35-1471801fcba6 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:05.294222 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-00fe4dfa-92ab-45ee-ae35-1471801fcba6 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:05.297701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-00fe4dfa-92ab-45ee-ae35-1471801fcba6 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:05.299187 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-00fe4dfa-92ab-45ee-ae35-1471801fcba6 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:05.300052 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 344/726] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:04 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 1557 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:05.306642 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-602f2e0c-c0e1-498a-bfe5-842fe054aa5e tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Calling method '.version_select at 0x7f7a107e1700>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:05.313376 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-602f2e0c-c0e1-498a-bfe5-842fe054aa5e tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:05.314357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-602f2e0c-c0e1-498a-bfe5-842fe054aa5e tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:05.332962 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-602f2e0c-c0e1-498a-bfe5-842fe054aa5e tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 2609 microversion: 2.25 time: 0.027976 Jul 19 22:28:05.343331 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 345/727] 10.222.0.25 () {60 vars in 1183 bytes} [Tue Jul 19 22:28:05 2022] GET /compute/v2.1/os-migrations => generated 2609 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:05.348162 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-10f4e9cc-6d3c-4f0e-aed2-c01d9dcd1e98 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:05.350066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-10f4e9cc-6d3c-4f0e-aed2-c01d9dcd1e98 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:05.364962 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-10f4e9cc-6d3c-4f0e-aed2-c01d9dcd1e98 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:05.365720 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-10f4e9cc-6d3c-4f0e-aed2-c01d9dcd1e98 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:05.366424 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-10f4e9cc-6d3c-4f0e-aed2-c01d9dcd1e98 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:05.366891 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-10f4e9cc-6d3c-4f0e-aed2-c01d9dcd1e98 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:05.370763 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-00fe4dfa-92ab-45ee-ae35-1471801fcba6 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] HTTP exception thrown: Instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a could not be found. Jul 19 22:28:05.375424 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-00fe4dfa-92ab-45ee-ae35-1471801fcba6 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Request method failure captured: Jul 19 22:28:05.375424 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a HTTP/1.1 Jul 19 22:28:05.375424 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:28:05.375424 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:28:05.375424 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:28:05.375424 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:28:05.375424 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:28:05.375424 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:28:05.375424 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:28:05.375424 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:28:05.375424 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y87U-6s_bSiSfhAyXKaY5mj5eHgn2rlISOjxAuPNHvO9ylUsemY5Ob9-7ANP15Gh0Xk7wn61vLFTbUn5NBGZb3IctoOKZrWhMLII0mWA0DREKbd2JdMgp4x8Itnh1ytOLEvzyaExw7G6UFB8kfq8FVdbOb0Agsr12EzNTgsysmVrzY Jul 19 22:28:05.375424 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:28:05.375424 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:28:05.375424 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:28:05.375424 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:28:05.375424 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:28:05.375424 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:28:05.375424 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: dbc98e9ff0b84256bf722b6ca82f76c1 Jul 19 22:28:05.375424 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1717169581 Jul 19 22:28:05.375424 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:28:05.375424 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:28:05.376779 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:28:05.376779 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1717169581 Jul 19 22:28:05.376779 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: dbc98e9ff0b84256bf722b6ca82f76c1 Jul 19 22:28:05.376779 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1717169581 Jul 19 22:28:05.376779 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1717169581-project Jul 19 22:28:05.376779 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:28:05.376779 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:28:05.376779 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: d9580b63c415471a8faa6b536f9c44fb Jul 19 22:28:05.376779 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1717169581-project Jul 19 22:28:05.376779 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:28:05.376779 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a could not be found. Jul 19 22:28:05.376779 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a'} Jul 19 22:28:05.377489 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:28:05.377489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:28:05.377489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:28:05.377489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:28:05.377489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:28:05.377489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:28:05.377489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:28:05.377489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:28:05.377489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:28:05.377489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:28:05.377489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a could not be found. Jul 19 22:28:05.377489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:05.377489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:28:05.377489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:05.377489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:28:05.377489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:28:05.377489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:28:05.377489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:28:05.377489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:28:05.377489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:28:05.379994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:28:05.379994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:28:05.379994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:28:05.379994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:28:05.379994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:28:05.379994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:28:05.379994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:28:05.379994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:28:05.379994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:28:05.379994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a could not be found. Jul 19 22:28:05.379994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:05.379994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:28:05.379994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:05.379994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:28:05.379994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:28:05.379994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:28:05.379994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:28:05.379994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:28:05.379994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a could not be found. Jul 19 22:28:05.379994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:05.384361 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-00fe4dfa-92ab-45ee-ae35-1471801fcba6 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Returning 404 to user: Instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:28:05.386036 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-00fe4dfa-92ab-45ee-ae35-1471801fcba6 tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a" status: 404 len: 111 microversion: 2.1 time: 0.128262 Jul 19 22:28:05.387485 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 383/728] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:28:05 2022] DELETE /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:28:05.400864 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-60bf62e4-9b9c-4c2a-8d44-8eb063ab5297 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:05.401449 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-60bf62e4-9b9c-4c2a-8d44-8eb063ab5297 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:05.434677 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60bf62e4-9b9c-4c2a-8d44-8eb063ab5297 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:05.436887 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60bf62e4-9b9c-4c2a-8d44-8eb063ab5297 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:05.438203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60bf62e4-9b9c-4c2a-8d44-8eb063ab5297 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:05.438957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60bf62e4-9b9c-4c2a-8d44-8eb063ab5297 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:05.893615 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-10f4e9cc-6d3c-4f0e-aed2-c01d9dcd1e98 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lazy-loading 'services' on Instance uuid 374ab7ad-b415-4516-8aa8-282bdfaa6600 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:28:05.978958 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-10f4e9cc-6d3c-4f0e-aed2-c01d9dcd1e98 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 2049 microversion: 2.25 time: 0.634443 Jul 19 22:28:05.979857 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 346/729] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:05 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 2049 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:05.986472 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ca509145-92f9-410a-8329-6165631357bb tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:05.987529 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ca509145-92f9-410a-8329-6165631357bb tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] [instance: f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:05.995547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca509145-92f9-410a-8329-6165631357bb tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:05.996507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca509145-92f9-410a-8329-6165631357bb tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:05.997849 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca509145-92f9-410a-8329-6165631357bb tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:05.999046 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca509145-92f9-410a-8329-6165631357bb tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:06.038691 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-ca509145-92f9-410a-8329-6165631357bb tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] HTTP exception thrown: Instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a could not be found. Jul 19 22:28:06.040452 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ca509145-92f9-410a-8329-6165631357bb tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Request method failure captured: Jul 19 22:28:06.040452 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a HTTP/1.1 Jul 19 22:28:06.040452 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:28:06.040452 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:28:06.040452 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:28:06.040452 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:28:06.040452 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:28:06.040452 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:28:06.040452 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:28:06.040452 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:28:06.040452 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y87U-6s_bSiSfhAyXKaY5mj5eHgn2rlISOjxAuPNHvO9ylUsemY5Ob9-7ANP15Gh0Xk7wn61vLFTbUn5NBGZb3IctoOKZrWhMLII0mWA0DREKbd2JdMgp4x8Itnh1ytOLEvzyaExw7G6UFB8kfq8FVdbOb0Agsr12EzNTgsysmVrzY Jul 19 22:28:06.040452 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:28:06.040452 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:28:06.040452 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:28:06.040452 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:28:06.040452 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:28:06.040452 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:28:06.040452 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: dbc98e9ff0b84256bf722b6ca82f76c1 Jul 19 22:28:06.040452 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1717169581 Jul 19 22:28:06.040452 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:28:06.040452 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:28:06.043067 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dbc98e9ff0b84256bf722b6ca82f76c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:28:06.043067 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1717169581 Jul 19 22:28:06.043067 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: dbc98e9ff0b84256bf722b6ca82f76c1 Jul 19 22:28:06.043067 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1717169581 Jul 19 22:28:06.043067 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1717169581-project Jul 19 22:28:06.043067 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:28:06.043067 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:28:06.043067 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: d9580b63c415471a8faa6b536f9c44fb Jul 19 22:28:06.043067 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1717169581-project Jul 19 22:28:06.043067 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:28:06.043067 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a could not be found. Jul 19 22:28:06.043067 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a'} Jul 19 22:28:06.044027 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:28:06.044027 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:28:06.044027 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:28:06.044027 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:28:06.044027 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:28:06.044027 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:28:06.044027 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:28:06.044027 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:28:06.044027 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:28:06.044027 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:28:06.044027 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a could not be found. Jul 19 22:28:06.044027 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:28:06.044027 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:28:06.044027 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:28:06.044027 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:28:06.044027 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:28:06.044027 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:28:06.044027 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:28:06.044027 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:28:06.044027 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:28:06.045951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:28:06.045951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:28:06.045951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:28:06.045951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:28:06.045951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:28:06.045951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:28:06.045951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:28:06.045951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a could not be found. Jul 19 22:28:06.045951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:28:06.045951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:28:06.045951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:28:06.045951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:28:06.045951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:28:06.045951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:28:06.045951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:28:06.045951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:28:06.045951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a could not be found. Jul 19 22:28:06.045951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:28:06.060216 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ca509145-92f9-410a-8329-6165631357bb tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] Returning 404 to user: Instance f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:28:06.061963 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ca509145-92f9-410a-8329-6165631357bb tempest-ServersWithSpecificFlavorTestJSON-1717169581 tempest-ServersWithSpecificFlavorTestJSON-1717169581-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a" status: 404 len: 111 microversion: 2.1 time: 0.080768 Jul 19 22:28:06.073836 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 347/730] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:05 2022] GET /compute/v2.1/servers/f4e4e2c3-ebcd-4535-ad17-f8efa6c7fa5a => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:28:06.089237 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1d393092-5af3-4336-a05e-260a4a411b03 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a107c2b80>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:06.201484 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1d393092-5af3-4336-a05e-260a4a411b03 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5" status: 200 len: 1414 microversion: 2.1 time: 0.125810 Jul 19 22:28:06.203149 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 348/731] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:28:06 2022] GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5 => generated 1414 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:06.226306 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-52540ec6-f204-4d07-9069-d21def2a9c1a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:06.228730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-52540ec6-f204-4d07-9069-d21def2a9c1a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 9d261177-b837-4836-959b-2b419921e90c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:06.247948 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-52540ec6-f204-4d07-9069-d21def2a9c1a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:06.248936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-52540ec6-f204-4d07-9069-d21def2a9c1a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:06.250842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-52540ec6-f204-4d07-9069-d21def2a9c1a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:06.251401 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-52540ec6-f204-4d07-9069-d21def2a9c1a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:06.412502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-60bf62e4-9b9c-4c2a-8d44-8eb063ab5297 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:06.440584 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-60bf62e4-9b9c-4c2a-8d44-8eb063ab5297 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1504 microversion: 2.1 time: 1.047686 Jul 19 22:28:06.455924 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 384/732] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:05 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1504 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:28:06.469538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4f76927b-be2a-47fc-8c3d-b450a154f015 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-614737226", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "69dde816-f623-484f-b274-67b5a7bbba5e"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:06.730875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-4f76927b-be2a-47fc-8c3d-b450a154f015 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] validate_networks() for [('69dde816-f623-484f-b274-67b5a7bbba5e', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:28:06.856530 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-52540ec6-f204-4d07-9069-d21def2a9c1a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:06.877885 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-52540ec6-f204-4d07-9069-d21def2a9c1a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c" status: 200 len: 1317 microversion: 2.1 time: 0.674219 Jul 19 22:28:06.888140 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 349/733] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:06 2022] GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c => generated 1317 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:07.221202 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3b47b945-9ddb-4903-92b1-a6dc34af56b7 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a10866310>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:07.417743 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3b47b945-9ddb-4903-92b1-a6dc34af56b7 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5" status: 200 len: 1414 microversion: 2.1 time: 0.201489 Jul 19 22:28:07.418482 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 350/734] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:28:07 2022] GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5 => generated 1414 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:28:07.463735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-80db373c-4c1a-4100-9e34-34102f0fb228 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:07.464862 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-80db373c-4c1a-4100-9e34-34102f0fb228 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:07.478033 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-80db373c-4c1a-4100-9e34-34102f0fb228 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:07.482997 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-80db373c-4c1a-4100-9e34-34102f0fb228 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:07.484590 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-80db373c-4c1a-4100-9e34-34102f0fb228 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:07.485249 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-80db373c-4c1a-4100-9e34-34102f0fb228 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:07.892422 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-80db373c-4c1a-4100-9e34-34102f0fb228 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:07.903197 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-80db373c-4c1a-4100-9e34-34102f0fb228 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1504 microversion: 2.1 time: 0.443835 Jul 19 22:28:07.906268 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 351/735] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:07 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1504 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:28:07.914237 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3789c3bb-08d7-42b5-b2b6-56342d327fb4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:07.915809 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3789c3bb-08d7-42b5-b2b6-56342d327fb4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 9d261177-b837-4836-959b-2b419921e90c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:07.925436 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3789c3bb-08d7-42b5-b2b6-56342d327fb4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:07.926225 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3789c3bb-08d7-42b5-b2b6-56342d327fb4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:07.927442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3789c3bb-08d7-42b5-b2b6-56342d327fb4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:07.928125 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3789c3bb-08d7-42b5-b2b6-56342d327fb4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:07.970622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4f76927b-be2a-47fc-8c3d-b450a154f015 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:28:07.971725 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4f76927b-be2a-47fc-8c3d-b450a154f015 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:28:07.972378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4f76927b-be2a-47fc-8c3d-b450a154f015 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:28:07.972956 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4f76927b-be2a-47fc-8c3d-b450a154f015 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:28:07.973709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4f76927b-be2a-47fc-8c3d-b450a154f015 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:28:08.002898 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f76927b-be2a-47fc-8c3d-b450a154f015 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:08.003391 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f76927b-be2a-47fc-8c3d-b450a154f015 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:08.004263 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f76927b-be2a-47fc-8c3d-b450a154f015 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:08.004698 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f76927b-be2a-47fc-8c3d-b450a154f015 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:08.032762 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:08.049267 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-4f76927b-be2a-47fc-8c3d-b450a154f015 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Getting quotas for project d0aa317147bd4c878b3c5e4480ae6289. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:28:08.059451 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-4f76927b-be2a-47fc-8c3d-b450a154f015 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Getting quotas for user 113e94f3bdbc4a2bb284a82b0b410d68 and project d0aa317147bd4c878b3c5e4480ae6289. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:28:08.091492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4f76927b-be2a-47fc-8c3d-b450a154f015 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:28:08.098235 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4f76927b-be2a-47fc-8c3d-b450a154f015 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:28:08.208722 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4f76927b-be2a-47fc-8c3d-b450a154f015 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.749707 Jul 19 22:28:08.213447 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 385/736] 10.222.0.25 () {62 vars in 1187 bytes} [Tue Jul 19 22:28:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1756 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 22:28:08.230691 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fa36f043-e795-4465-960e-e4f7572c2aea tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:08.235467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fa36f043-e795-4465-960e-e4f7572c2aea tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:08.583435 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fa36f043-e795-4465-960e-e4f7572c2aea tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:08.592737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fa36f043-e795-4465-960e-e4f7572c2aea tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:08.603571 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fa36f043-e795-4465-960e-e4f7572c2aea tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:08.614149 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fa36f043-e795-4465-960e-e4f7572c2aea tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 200 len: 1261 microversion: 2.25 time: 0.384620 Jul 19 22:28:08.615374 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 386/737] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:08 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 1261 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:08.629069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ea10b364-f3d7-4c43-a5ec-7c60d10ba0cc tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a1085fd30>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:08.731424 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3789c3bb-08d7-42b5-b2b6-56342d327fb4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:08.740573 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3789c3bb-08d7-42b5-b2b6-56342d327fb4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c" status: 200 len: 1317 microversion: 2.1 time: 0.832200 Jul 19 22:28:08.760578 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 352/738] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:07 2022] GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c => generated 1317 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:08.770586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0caab54a-56ac-4b53-9cf4-ae4a9f61ff99 tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Calling method '.version_select at 0x7f7a107d94c0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:08.782954 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0caab54a-56ac-4b53-9cf4-ae4a9f61ff99 tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:08.787840 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0caab54a-56ac-4b53-9cf4-ae4a9f61ff99 tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:08.828819 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0caab54a-56ac-4b53-9cf4-ae4a9f61ff99 tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1952 microversion: 2.1 time: 0.067240 Jul 19 22:28:08.829047 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ea10b364-f3d7-4c43-a5ec-7c60d10ba0cc tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5" status: 200 len: 1414 microversion: 2.1 time: 0.211270 Jul 19 22:28:08.829512 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 387/739] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:28:08 2022] GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5 => generated 1414 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:08.830378 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 353/740] 10.222.0.25 () {58 vars in 1142 bytes} [Tue Jul 19 22:28:08 2022] GET /compute/v2.1/os-migrations => generated 1952 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:08.862019 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ecb08ea5-5f02-47b6-9d49-140aeb549fd0 tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:08.895797 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ecb08ea5-5f02-47b6-9d49-140aeb549fd0 tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.039652 Jul 19 22:28:08.897021 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 388/741] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:28:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:08.907764 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9d500347-7a6d-44d7-945e-344836422908 tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1374020207", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:08.909257 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:28:08.909257 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:28:08.927988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5c02638c-7634-41bf-b242-7181cab58cee tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:08.929042 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5c02638c-7634-41bf-b242-7181cab58cee tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:08.946712 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c02638c-7634-41bf-b242-7181cab58cee tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:08.947837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c02638c-7634-41bf-b242-7181cab58cee tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:08.950840 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c02638c-7634-41bf-b242-7181cab58cee tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:08.952738 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c02638c-7634-41bf-b242-7181cab58cee tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:08.953518 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9d500347-7a6d-44d7-945e-344836422908 tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.049594 Jul 19 22:28:08.962870 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 354/742] 10.222.0.25 () {60 vars in 1145 bytes} [Tue Jul 19 22:28:08 2022] POST /compute/v2.1/flavors => generated 499 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:08.974318 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d6bb9476-17dd-4d24-8e34-27ba12ef0752 tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:09.005386 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d6bb9476-17dd-4d24-8e34-27ba12ef0752 tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.041226 Jul 19 22:28:09.013990 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 355/743] 10.222.0.25 () {58 vars in 1181 bytes} [Tue Jul 19 22:28:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:28:09.218165 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-57aa2539-cf6a-47eb-bc57-e7ec135edf72 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-117764137", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "41955a04-02ae-48d8-a418-8fe76c81baed"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:09.319770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-57aa2539-cf6a-47eb-bc57-e7ec135edf72 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] validate_networks() for None {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:28:09.695486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5c02638c-7634-41bf-b242-7181cab58cee tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:09.715891 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5c02638c-7634-41bf-b242-7181cab58cee tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1504 microversion: 2.1 time: 0.792876 Jul 19 22:28:09.720155 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 389/744] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:08 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1504 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:09.731999 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d11ba4da-7d97-4a4d-b382-8195c46821b9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:09.735069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d11ba4da-7d97-4a4d-b382-8195c46821b9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:09.760845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d11ba4da-7d97-4a4d-b382-8195c46821b9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:09.761851 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d11ba4da-7d97-4a4d-b382-8195c46821b9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:09.764295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d11ba4da-7d97-4a4d-b382-8195c46821b9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:09.765082 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d11ba4da-7d97-4a4d-b382-8195c46821b9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:09.925909 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d11ba4da-7d97-4a4d-b382-8195c46821b9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:09.955856 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d11ba4da-7d97-4a4d-b382-8195c46821b9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:09.958571 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d11ba4da-7d97-4a4d-b382-8195c46821b9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:09.960809 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d11ba4da-7d97-4a4d-b382-8195c46821b9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 200 len: 1313 microversion: 2.25 time: 0.239005 Jul 19 22:28:09.983283 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 390/745] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:09 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:09.989957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8e3853d4-6142-4722-8722-1b0ed739f1dd tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:09.991779 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8e3853d4-6142-4722-8722-1b0ed739f1dd tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 9d261177-b837-4836-959b-2b419921e90c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:10.002192 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8e3853d4-6142-4722-8722-1b0ed739f1dd tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:10.006072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8e3853d4-6142-4722-8722-1b0ed739f1dd tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:10.007844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8e3853d4-6142-4722-8722-1b0ed739f1dd tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:10.008616 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8e3853d4-6142-4722-8722-1b0ed739f1dd tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:10.279888 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-57aa2539-cf6a-47eb-bc57-e7ec135edf72 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:28:10.281282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-57aa2539-cf6a-47eb-bc57-e7ec135edf72 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:28:10.282279 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-57aa2539-cf6a-47eb-bc57-e7ec135edf72 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:28:10.283326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-57aa2539-cf6a-47eb-bc57-e7ec135edf72 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:28:10.283990 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-57aa2539-cf6a-47eb-bc57-e7ec135edf72 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:28:10.306534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-57aa2539-cf6a-47eb-bc57-e7ec135edf72 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:10.312581 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-57aa2539-cf6a-47eb-bc57-e7ec135edf72 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:10.313873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-57aa2539-cf6a-47eb-bc57-e7ec135edf72 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:10.314593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-57aa2539-cf6a-47eb-bc57-e7ec135edf72 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:10.379391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-57aa2539-cf6a-47eb-bc57-e7ec135edf72 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Getting quotas for project eed5e83db4ae4156ae9635b84ca7ff4a. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:28:10.389764 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-57aa2539-cf6a-47eb-bc57-e7ec135edf72 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Getting quotas for user e3ef9d4c38d547a1a1532d964195144a and project eed5e83db4ae4156ae9635b84ca7ff4a. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:28:10.426197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-57aa2539-cf6a-47eb-bc57-e7ec135edf72 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:28:10.431458 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-57aa2539-cf6a-47eb-bc57-e7ec135edf72 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:28:10.572339 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-57aa2539-cf6a-47eb-bc57-e7ec135edf72 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.356562 Jul 19 22:28:10.582201 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 356/746] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:28:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 22:28:10.597021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1783c5d0-5554-4b5a-b648-e021fa47c2dd tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a107f5310>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:10.714194 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1783c5d0-5554-4b5a-b648-e021fa47c2dd tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5" status: 200 len: 1414 microversion: 2.1 time: 0.129031 Jul 19 22:28:10.723924 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 357/747] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:28:10 2022] GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5 => generated 1414 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:10.746293 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-614a9b35-e78d-4b73-97fb-3cdc42bb4b92 req-94e1981d-1257-42b6-beba-1d741a23ac5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d261177-b837-4836-959b-2b419921e90c", "name": "network-vif-plugged", "status": "completed", "tag": "6fdf2740-fff6-48fb-b225-03f5d4b86d01"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:10.796436 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-614a9b35-e78d-4b73-97fb-3cdc42bb4b92 req-94e1981d-1257-42b6-beba-1d741a23ac5d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:10.796985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-614a9b35-e78d-4b73-97fb-3cdc42bb4b92 req-94e1981d-1257-42b6-beba-1d741a23ac5d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:10.835938 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8e3853d4-6142-4722-8722-1b0ed739f1dd tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:10.847676 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8e3853d4-6142-4722-8722-1b0ed739f1dd tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c" status: 200 len: 1317 microversion: 2.1 time: 0.862509 Jul 19 22:28:10.850766 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-614a9b35-e78d-4b73-97fb-3cdc42bb4b92 req-94e1981d-1257-42b6-beba-1d741a23ac5d service nova] Creating event network-vif-plugged:6fdf2740-fff6-48fb-b225-03f5d4b86d01 for instance 9d261177-b837-4836-959b-2b419921e90c on n-h2-847009-3 Jul 19 22:28:10.851435 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 391/748] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:09 2022] GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c => generated 1317 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:10.875194 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-614a9b35-e78d-4b73-97fb-3cdc42bb4b92 req-94e1981d-1257-42b6-beba-1d741a23ac5d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142115 Jul 19 22:28:10.886131 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 358/749] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:10.926537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-bc5d4618-6b4e-4c36-a7f7-845ffb2ad1e4 req-13736171-ddce-4624-9e32-1a9ed214e81d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f752d932-1177-43ae-89b0-86a439bb446a", "name": "network-vif-unplugged", "status": "completed", "tag": "9795f500-4e5c-483d-95e2-204859a4140a"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:10.927387 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3aa361ee-ff1b-4f7d-8469-8701053a7256 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:10.928241 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3aa361ee-ff1b-4f7d-8469-8701053a7256 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:10.965376 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-bc5d4618-6b4e-4c36-a7f7-845ffb2ad1e4 req-13736171-ddce-4624-9e32-1a9ed214e81d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:10.971902 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-bc5d4618-6b4e-4c36-a7f7-845ffb2ad1e4 req-13736171-ddce-4624-9e32-1a9ed214e81d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:11.020066 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-bc5d4618-6b4e-4c36-a7f7-845ffb2ad1e4 req-13736171-ddce-4624-9e32-1a9ed214e81d service nova] Creating event network-vif-unplugged:9795f500-4e5c-483d-95e2-204859a4140a for instance f752d932-1177-43ae-89b0-86a439bb446a on n-h1-847009-3 Jul 19 22:28:11.033930 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-bc5d4618-6b4e-4c36-a7f7-845ffb2ad1e4 req-13736171-ddce-4624-9e32-1a9ed214e81d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.180288 Jul 19 22:28:11.042607 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 392/750] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:11.085606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-41523958-86bc-4698-8c48-aa46204f6090 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:11.090653 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-41523958-86bc-4698-8c48-aa46204f6090 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:11.111910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41523958-86bc-4698-8c48-aa46204f6090 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:11.112598 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41523958-86bc-4698-8c48-aa46204f6090 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:11.114215 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41523958-86bc-4698-8c48-aa46204f6090 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:11.114943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41523958-86bc-4698-8c48-aa46204f6090 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:11.306187 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3aa361ee-ff1b-4f7d-8469-8701053a7256 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:11.324719 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3aa361ee-ff1b-4f7d-8469-8701053a7256 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1278 microversion: 2.1 time: 0.440842 Jul 19 22:28:11.329091 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 359/751] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:10 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1278 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:11.340717 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cdc564c2-e3ab-4dd1-851e-0d26657aa40c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:11.341366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cdc564c2-e3ab-4dd1-851e-0d26657aa40c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:11.362437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cdc564c2-e3ab-4dd1-851e-0d26657aa40c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:11.363057 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cdc564c2-e3ab-4dd1-851e-0d26657aa40c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:11.366537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cdc564c2-e3ab-4dd1-851e-0d26657aa40c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:11.368389 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cdc564c2-e3ab-4dd1-851e-0d26657aa40c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:11.781571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cdc564c2-e3ab-4dd1-851e-0d26657aa40c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:11.809149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cdc564c2-e3ab-4dd1-851e-0d26657aa40c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:11.814061 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cdc564c2-e3ab-4dd1-851e-0d26657aa40c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:11.815962 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cdc564c2-e3ab-4dd1-851e-0d26657aa40c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 200 len: 1319 microversion: 2.25 time: 0.485631 Jul 19 22:28:11.822373 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 360/752] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:11 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 1319 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:11.829571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f479c707-05c2-432e-8541-579c3c2fbd68 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a107f5670>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:11.905330 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f479c707-05c2-432e-8541-579c3c2fbd68 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5" status: 200 len: 1414 microversion: 2.1 time: 0.080226 Jul 19 22:28:11.906163 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 361/753] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:28:11 2022] GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5 => generated 1414 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:11.910682 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e0e8cf8b-8d76-4dca-a0eb-f2efe4b206ca tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:11.911622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e0e8cf8b-8d76-4dca-a0eb-f2efe4b206ca tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 9d261177-b837-4836-959b-2b419921e90c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:11.918010 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e0e8cf8b-8d76-4dca-a0eb-f2efe4b206ca tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:11.918704 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e0e8cf8b-8d76-4dca-a0eb-f2efe4b206ca tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:11.920322 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e0e8cf8b-8d76-4dca-a0eb-f2efe4b206ca tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:11.921198 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e0e8cf8b-8d76-4dca-a0eb-f2efe4b206ca tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:12.222631 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-41523958-86bc-4698-8c48-aa46204f6090 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:12.230974 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-41523958-86bc-4698-8c48-aa46204f6090 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1504 microversion: 2.1 time: 1.178018 Jul 19 22:28:12.231604 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 393/754] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:11 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1504 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:12.346861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9b61bc65-fd68-4990-bcf5-d1099ca1f628 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:12.347627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9b61bc65-fd68-4990-bcf5-d1099ca1f628 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:12.350289 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e0e8cf8b-8d76-4dca-a0eb-f2efe4b206ca tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:12.365860 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e0e8cf8b-8d76-4dca-a0eb-f2efe4b206ca tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c" status: 200 len: 1317 microversion: 2.1 time: 0.452426 Jul 19 22:28:12.366654 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 362/755] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:11 2022] GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c => generated 1317 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:12.369088 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b61bc65-fd68-4990-bcf5-d1099ca1f628 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:12.369600 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b61bc65-fd68-4990-bcf5-d1099ca1f628 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:12.370446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b61bc65-fd68-4990-bcf5-d1099ca1f628 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:12.370897 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b61bc65-fd68-4990-bcf5-d1099ca1f628 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:12.843243 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c2ca8cf1-0d68-48d0-8a7e-f775cbc2544a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:12.843243 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c2ca8cf1-0d68-48d0-8a7e-f775cbc2544a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:12.846651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9b61bc65-fd68-4990-bcf5-d1099ca1f628 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:12.861285 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9b61bc65-fd68-4990-bcf5-d1099ca1f628 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1330 microversion: 2.1 time: 0.519558 Jul 19 22:28:12.879029 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c2ca8cf1-0d68-48d0-8a7e-f775cbc2544a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:12.889028 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 394/756] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:12 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1330 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:28:12.892590 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c2ca8cf1-0d68-48d0-8a7e-f775cbc2544a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:12.894810 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c2ca8cf1-0d68-48d0-8a7e-f775cbc2544a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:12.899637 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c2ca8cf1-0d68-48d0-8a7e-f775cbc2544a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:12.917718 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cc7c17e4-22fc-4ccc-9058-0debb1ad22ac tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a108faee0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:13.063987 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cc7c17e4-22fc-4ccc-9058-0debb1ad22ac tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5" status: 200 len: 1414 microversion: 2.1 time: 0.149836 Jul 19 22:28:13.070384 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 395/757] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:28:12 2022] GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5 => generated 1414 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:28:13.253692 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2d980d63-ca48-457c-8f21-eb3bbf4a7c18 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:13.254946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2d980d63-ca48-457c-8f21-eb3bbf4a7c18 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:13.288822 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2d980d63-ca48-457c-8f21-eb3bbf4a7c18 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:13.289583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2d980d63-ca48-457c-8f21-eb3bbf4a7c18 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:13.290662 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2d980d63-ca48-457c-8f21-eb3bbf4a7c18 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:13.291292 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2d980d63-ca48-457c-8f21-eb3bbf4a7c18 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:13.767862 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c2ca8cf1-0d68-48d0-8a7e-f775cbc2544a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:13.777970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c2ca8cf1-0d68-48d0-8a7e-f775cbc2544a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:13.791218 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c2ca8cf1-0d68-48d0-8a7e-f775cbc2544a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:13.792859 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c2ca8cf1-0d68-48d0-8a7e-f775cbc2544a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 200 len: 1361 microversion: 2.25 time: 0.954598 Jul 19 22:28:13.835568 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 363/758] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:12 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 1361 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:13.855450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b40418a5-7a2c-4438-a1c9-a2b2eadee041 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:13.856514 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b40418a5-7a2c-4438-a1c9-a2b2eadee041 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 9d261177-b837-4836-959b-2b419921e90c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:13.878253 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b40418a5-7a2c-4438-a1c9-a2b2eadee041 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:13.879164 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b40418a5-7a2c-4438-a1c9-a2b2eadee041 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:13.880166 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b40418a5-7a2c-4438-a1c9-a2b2eadee041 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:13.880765 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b40418a5-7a2c-4438-a1c9-a2b2eadee041 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:14.775423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2d980d63-ca48-457c-8f21-eb3bbf4a7c18 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:14.789967 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2d980d63-ca48-457c-8f21-eb3bbf4a7c18 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1504 microversion: 2.1 time: 1.542676 Jul 19 22:28:14.790853 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 396/759] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:13 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1504 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:14.801679 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-08fb49bb-bcfc-47a4-9cb4-acd32ea5e5e5 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:14.808801 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-08fb49bb-bcfc-47a4-9cb4-acd32ea5e5e5 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:14.825874 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08fb49bb-bcfc-47a4-9cb4-acd32ea5e5e5 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:14.835483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08fb49bb-bcfc-47a4-9cb4-acd32ea5e5e5 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:14.838167 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08fb49bb-bcfc-47a4-9cb4-acd32ea5e5e5 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:14.839080 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08fb49bb-bcfc-47a4-9cb4-acd32ea5e5e5 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:15.130182 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-08fb49bb-bcfc-47a4-9cb4-acd32ea5e5e5 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:15.151644 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-08fb49bb-bcfc-47a4-9cb4-acd32ea5e5e5 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1336 microversion: 2.1 time: 0.355312 Jul 19 22:28:15.152937 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 397/760] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:14 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1336 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:15.163813 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f3569b88-973a-43fb-a17b-1dbd1affc9eb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a10a56160>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:15.192322 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b40418a5-7a2c-4438-a1c9-a2b2eadee041 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:15.210022 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b40418a5-7a2c-4438-a1c9-a2b2eadee041 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c" status: 200 len: 1466 microversion: 2.1 time: 1.370044 Jul 19 22:28:15.218913 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 364/761] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:13 2022] GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c => generated 1466 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:15.239016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-8b1e87c1-91c7-4679-92f6-1dfaa1b1476a req-314c30cc-c2c4-42e0-aebf-1b13dad7cd8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef1f3571-2f57-4f5b-b607-16d82d41d8d2", "tag": "01a778f9-5da2-424c-9cea-9f854afa416c"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:15.287775 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-8b1e87c1-91c7-4679-92f6-1dfaa1b1476a req-314c30cc-c2c4-42e0-aebf-1b13dad7cd8b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:15.288589 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-8b1e87c1-91c7-4679-92f6-1dfaa1b1476a req-314c30cc-c2c4-42e0-aebf-1b13dad7cd8b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:15.300964 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f3569b88-973a-43fb-a17b-1dbd1affc9eb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5" status: 200 len: 1414 microversion: 2.1 time: 0.143231 Jul 19 22:28:15.305063 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 398/762] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:28:15 2022] GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5 => generated 1414 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:15.311893 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-8b1e87c1-91c7-4679-92f6-1dfaa1b1476a req-314c30cc-c2c4-42e0-aebf-1b13dad7cd8b service nova] Creating event network-changed:01a778f9-5da2-424c-9cea-9f854afa416c for instance ef1f3571-2f57-4f5b-b607-16d82d41d8d2 on n-h2-847009-3 Jul 19 22:28:15.322238 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3e50db51-a517-4d11-821a-925e0ec311cb tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:15.324310 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3e50db51-a517-4d11-821a-925e0ec311cb tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:15.327990 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-8b1e87c1-91c7-4679-92f6-1dfaa1b1476a req-314c30cc-c2c4-42e0-aebf-1b13dad7cd8b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107076 Jul 19 22:28:15.330269 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 365/763] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:15.346026 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e50db51-a517-4d11-821a-925e0ec311cb tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:15.346592 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e50db51-a517-4d11-821a-925e0ec311cb tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:15.347466 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e50db51-a517-4d11-821a-925e0ec311cb tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:15.347906 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e50db51-a517-4d11-821a-925e0ec311cb tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:15.522616 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d40d47f9-ac17-4c20-a51f-9f067cb389cc tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:15.523762 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d40d47f9-ac17-4c20-a51f-9f067cb389cc tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] [instance: 9d261177-b837-4836-959b-2b419921e90c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:15.542712 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d40d47f9-ac17-4c20-a51f-9f067cb389cc tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:15.543810 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d40d47f9-ac17-4c20-a51f-9f067cb389cc tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:15.545411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d40d47f9-ac17-4c20-a51f-9f067cb389cc tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:15.546930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d40d47f9-ac17-4c20-a51f-9f067cb389cc tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:16.084715 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3e50db51-a517-4d11-821a-925e0ec311cb tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:16.089817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:16.110432 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3e50db51-a517-4d11-821a-925e0ec311cb tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:16.123505 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3e50db51-a517-4d11-821a-925e0ec311cb tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:16.125251 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3e50db51-a517-4d11-821a-925e0ec311cb tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 200 len: 1361 microversion: 2.25 time: 0.817114 Jul 19 22:28:16.126522 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 399/764] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:15 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 1361 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:16.132134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6d5e6411-8080-4230-ad79-5540eb1d65bf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:16.132803 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6d5e6411-8080-4230-ad79-5540eb1d65bf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:16.151296 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d5e6411-8080-4230-ad79-5540eb1d65bf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:16.152054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d5e6411-8080-4230-ad79-5540eb1d65bf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:16.153094 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d5e6411-8080-4230-ad79-5540eb1d65bf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:16.153837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d5e6411-8080-4230-ad79-5540eb1d65bf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:16.848807 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6d5e6411-8080-4230-ad79-5540eb1d65bf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:16.876142 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6d5e6411-8080-4230-ad79-5540eb1d65bf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1479 microversion: 2.1 time: 0.736412 Jul 19 22:28:16.877974 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 400/765] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:16 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1479 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:16.890078 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a9f163e1-cf5a-4d43-be83-2f1da3071c1c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:16.900094 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a9f163e1-cf5a-4d43-be83-2f1da3071c1c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:16.913978 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9f163e1-cf5a-4d43-be83-2f1da3071c1c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:16.924624 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9f163e1-cf5a-4d43-be83-2f1da3071c1c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:16.925633 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9f163e1-cf5a-4d43-be83-2f1da3071c1c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:16.926999 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9f163e1-cf5a-4d43-be83-2f1da3071c1c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:16.983640 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d40d47f9-ac17-4c20-a51f-9f067cb389cc tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c" status: 200 len: 1617 microversion: 2.1 time: 1.651528 Jul 19 22:28:16.986723 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 366/766] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:15 2022] GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c => generated 1617 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:17.020932 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b71489d8-8d3c-4634-8a5e-0cfb40138215 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a109f0700>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:17.169803 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b71489d8-8d3c-4634-8a5e-0cfb40138215 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5" status: 200 len: 1414 microversion: 2.1 time: 0.177440 Jul 19 22:28:17.183484 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 367/767] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:28:16 2022] GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5 => generated 1414 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:17.196923 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fcf80004-9595-496f-bf46-b1bd8cbe7825 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Calling method '.version_select at 0x7f7a1073b310>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:17.218212 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fcf80004-9595-496f-bf46-b1bd8cbe7825 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:17.223305 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a9f163e1-cf5a-4d43-be83-2f1da3071c1c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:17.224570 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fcf80004-9595-496f-bf46-b1bd8cbe7825 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:17.257033 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a9f163e1-cf5a-4d43-be83-2f1da3071c1c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1336 microversion: 2.1 time: 0.372084 Jul 19 22:28:17.259379 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 401/768] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:16 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1336 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:17.272554 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-69bba897-5a01-448f-b492-3fea4642934f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Action: 'create', calling method: .version_select at 0x7f7a1080faf0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-212064050", "policies": ["affinity"]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:17.334915 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fcf80004-9595-496f-bf46-b1bd8cbe7825 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1954 microversion: 2.1 time: 0.149796 Jul 19 22:28:17.336718 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 368/769] 10.222.0.25 () {58 vars in 1142 bytes} [Tue Jul 19 22:28:17 2022] GET /compute/v2.1/os-migrations => generated 1954 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:17.350609 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-752e4396-9822-4e41-ba79-1aab33f30b50 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:17.351301 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-752e4396-9822-4e41-ba79-1aab33f30b50 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:17.352568 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-69bba897-5a01-448f-b492-3fea4642934f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for project 791e176b6751415ca1472c109b3ce011. Resources: {'server_groups'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:28:17.365931 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-752e4396-9822-4e41-ba79-1aab33f30b50 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:17.366694 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-752e4396-9822-4e41-ba79-1aab33f30b50 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:17.368730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-752e4396-9822-4e41-ba79-1aab33f30b50 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:17.369564 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-752e4396-9822-4e41-ba79-1aab33f30b50 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:17.369691 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-69bba897-5a01-448f-b492-3fea4642934f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for user bd5fb561f7bd429e8c6b2cc30ed76f13 and project 791e176b6751415ca1472c109b3ce011. Resources: {'server_groups'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:28:17.516941 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-69bba897-5a01-448f-b492-3fea4642934f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for project 791e176b6751415ca1472c109b3ce011. Resources: {'server_groups'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:28:17.527678 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-69bba897-5a01-448f-b492-3fea4642934f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for user bd5fb561f7bd429e8c6b2cc30ed76f13 and project 791e176b6751415ca1472c109b3ce011. Resources: {'server_groups'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:28:17.556086 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-69bba897-5a01-448f-b492-3fea4642934f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.292120 Jul 19 22:28:17.570183 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 402/770] 10.222.0.25 () {60 vars in 1173 bytes} [Tue Jul 19 22:28:17 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:17.570183 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b87cdc06-53ab-479d-8e73-18d30b1f03d8 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:17.570183 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b87cdc06-53ab-479d-8e73-18d30b1f03d8 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:17.576410 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b87cdc06-53ab-479d-8e73-18d30b1f03d8 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:17.577274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b87cdc06-53ab-479d-8e73-18d30b1f03d8 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:17.578295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b87cdc06-53ab-479d-8e73-18d30b1f03d8 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:17.580783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b87cdc06-53ab-479d-8e73-18d30b1f03d8 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:18.026136 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:18.151844 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-752e4396-9822-4e41-ba79-1aab33f30b50 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:18.175544 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-752e4396-9822-4e41-ba79-1aab33f30b50 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:18.181619 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-752e4396-9822-4e41-ba79-1aab33f30b50 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:18.184990 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-752e4396-9822-4e41-ba79-1aab33f30b50 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 200 len: 1361 microversion: 2.25 time: 0.845616 Jul 19 22:28:18.188579 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 369/771] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:17 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 1361 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:18.206580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-233ee6a3-9f80-43c4-b215-94accff2ee50 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1065494251", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "cd67c25a-4da8-4c0b-9e4e-8e7b07cc4a71"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:18.232570 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b87cdc06-53ab-479d-8e73-18d30b1f03d8 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1630 microversion: 2.1 time: 0.672027 Jul 19 22:28:18.233895 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 403/772] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:17 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1630 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:18.272923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3c0fd433-e9ee-4b10-8dad-aa39487d90a4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a10930dc0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:18.381959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-233ee6a3-9f80-43c4-b215-94accff2ee50 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] validate_networks() for None {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:28:18.394508 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3c0fd433-e9ee-4b10-8dad-aa39487d90a4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5" status: 200 len: 1414 microversion: 2.1 time: 0.138517 Jul 19 22:28:18.396178 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 404/773] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:28:18 2022] GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5 => generated 1414 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:18.430795 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6cbc357a-886e-4c17-ba87-ba2ab461f76d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Action: 'create', calling method: .version_select at 0x7f7a1085f5e0>, body: {"keypair": {"name": "tempest-keypair-1745561648", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPq9ID0J6juTx63PVY7uv9RDfW5Ia48lkJwvK76TcBW2tw/z02uPBh7otkOL5h6BNwuiFETLxcgedTiLR1NkG2nqsmwRQ8cf+gRcYiYOpzgLNzAT1V3UgWR+zNmpYs6b2w=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:18.470155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-6cbc357a-886e-4c17-ba87-ba2ab461f76d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Getting quotas for project 2619b807c1ee4dca858dae47c4686ba2. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:28:18.493306 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-6cbc357a-886e-4c17-ba87-ba2ab461f76d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Getting quotas for user 55a214cbc1ec4cdb80ccf736f4251964 and project 2619b807c1ee4dca858dae47c4686ba2. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:28:18.566380 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6cbc357a-886e-4c17-ba87-ba2ab461f76d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.160037 Jul 19 22:28:18.567734 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 405/774] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:28:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:18.575441 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-77a88ef0-3db5-4b81-bd96-d406ffdd34f1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:18.577420 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-77a88ef0-3db5-4b81-bd96-d406ffdd34f1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:18.586284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-77a88ef0-3db5-4b81-bd96-d406ffdd34f1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:18.586966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-77a88ef0-3db5-4b81-bd96-d406ffdd34f1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:18.588192 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-77a88ef0-3db5-4b81-bd96-d406ffdd34f1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:18.588821 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-77a88ef0-3db5-4b81-bd96-d406ffdd34f1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:19.268328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-77a88ef0-3db5-4b81-bd96-d406ffdd34f1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:19.276086 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-77a88ef0-3db5-4b81-bd96-d406ffdd34f1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1378 microversion: 2.1 time: 0.706886 Jul 19 22:28:19.277231 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 406/775] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:18 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1378 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:19.283007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ad4f33f3-5cb9-4162-86aa-aa6d50862f39 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:19.283661 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ad4f33f3-5cb9-4162-86aa-aa6d50862f39 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:19.290348 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad4f33f3-5cb9-4162-86aa-aa6d50862f39 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:19.291231 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad4f33f3-5cb9-4162-86aa-aa6d50862f39 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:19.292029 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad4f33f3-5cb9-4162-86aa-aa6d50862f39 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:19.292473 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad4f33f3-5cb9-4162-86aa-aa6d50862f39 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:19.324654 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-233ee6a3-9f80-43c4-b215-94accff2ee50 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:28:19.325231 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-233ee6a3-9f80-43c4-b215-94accff2ee50 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:28:19.325611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-233ee6a3-9f80-43c4-b215-94accff2ee50 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:28:19.326981 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-233ee6a3-9f80-43c4-b215-94accff2ee50 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:28:19.327442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-233ee6a3-9f80-43c4-b215-94accff2ee50 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:28:19.391138 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-233ee6a3-9f80-43c4-b215-94accff2ee50 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:19.392016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-233ee6a3-9f80-43c4-b215-94accff2ee50 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:19.393081 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-233ee6a3-9f80-43c4-b215-94accff2ee50 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:19.393724 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-233ee6a3-9f80-43c4-b215-94accff2ee50 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:19.417579 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-233ee6a3-9f80-43c4-b215-94accff2ee50 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for project 791e176b6751415ca1472c109b3ce011. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:28:19.428610 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-233ee6a3-9f80-43c4-b215-94accff2ee50 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for user bd5fb561f7bd429e8c6b2cc30ed76f13 and project 791e176b6751415ca1472c109b3ce011. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:28:19.454261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-233ee6a3-9f80-43c4-b215-94accff2ee50 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Going to run 2 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:28:19.458385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-233ee6a3-9f80-43c4-b215-94accff2ee50 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 2df991c2-a91f-4de1-96a1-8c36ae7ce9be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:28:19.521228 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-233ee6a3-9f80-43c4-b215-94accff2ee50 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119338) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 19 22:28:19.564064 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-233ee6a3-9f80-43c4-b215-94accff2ee50 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for project 791e176b6751415ca1472c109b3ce011. Resources: {'server_group_members'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:28:19.586545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=6,nova_api:INSERT=7 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:19.590054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-233ee6a3-9f80-43c4-b215-94accff2ee50 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for user bd5fb561f7bd429e8c6b2cc30ed76f13 and project 791e176b6751415ca1472c109b3ce011. Resources: {'server_group_members'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:28:19.669300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-233ee6a3-9f80-43c4-b215-94accff2ee50 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for project 791e176b6751415ca1472c109b3ce011. Resources: {'server_group_members'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:28:19.683645 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-233ee6a3-9f80-43c4-b215-94accff2ee50 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for user bd5fb561f7bd429e8c6b2cc30ed76f13 and project 791e176b6751415ca1472c109b3ce011. Resources: {'server_group_members'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:28:19.710181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-233ee6a3-9f80-43c4-b215-94accff2ee50 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 7a5c8094-ecd0-4423-bbfd-43d136f1f443] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=2df991c2-a91f-4de1-96a1-8c36ae7ce9be,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:28:19.788905 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-233ee6a3-9f80-43c4-b215-94accff2ee50 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for project 791e176b6751415ca1472c109b3ce011. Resources: {'server_group_members'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:28:19.795533 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-233ee6a3-9f80-43c4-b215-94accff2ee50 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for user bd5fb561f7bd429e8c6b2cc30ed76f13 and project 791e176b6751415ca1472c109b3ce011. Resources: {'server_group_members'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:28:19.861188 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-233ee6a3-9f80-43c4-b215-94accff2ee50 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for project 791e176b6751415ca1472c109b3ce011. Resources: {'server_group_members'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:28:19.867023 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ad4f33f3-5cb9-4162-86aa-aa6d50862f39 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:19.876714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ad4f33f3-5cb9-4162-86aa-aa6d50862f39 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:19.878243 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ad4f33f3-5cb9-4162-86aa-aa6d50862f39 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:19.879438 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ad4f33f3-5cb9-4162-86aa-aa6d50862f39 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 200 len: 1361 microversion: 2.25 time: 0.600987 Jul 19 22:28:19.880011 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 407/776] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:19 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 1361 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:19.880937 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-233ee6a3-9f80-43c4-b215-94accff2ee50 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for user bd5fb561f7bd429e8c6b2cc30ed76f13 and project 791e176b6751415ca1472c109b3ce011. Resources: {'server_group_members'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:28:19.904600 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0b14c4f6-9792-4b4e-9899-2c469d80b706 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a1085fca0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:19.999646 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0b14c4f6-9792-4b4e-9899-2c469d80b706 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5" status: 200 len: 1423 microversion: 2.1 time: 0.099217 Jul 19 22:28:20.000938 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 408/777] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:28:19 2022] GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5 => generated 1423 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:20.020264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-037e046c-17d0-412b-9f4c-61b6e54012d6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a109443a0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:20.034954 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-233ee6a3-9f80-43c4-b215-94accff2ee50 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.843280 Jul 19 22:28:20.036380 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 370/778] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:28:18 2022] POST /compute/v2.1/servers => generated 32 bytes in 1847 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 19 22:28:20.057637 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-73b4c5b3-5417-48ef-9ec1-b1240079a956 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:20.069190 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-73b4c5b3-5417-48ef-9ec1-b1240079a956 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:20.074601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-73b4c5b3-5417-48ef-9ec1-b1240079a956 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Searching by: {'deleted': False, 'project_id': '791e176b6751415ca1472c109b3ce011'} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:28:20.105128 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-037e046c-17d0-412b-9f4c-61b6e54012d6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5" status: 200 len: 1423 microversion: 2.1 time: 0.088769 Jul 19 22:28:20.105933 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 409/779] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:28:20 2022] GET /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5 => generated 1423 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:20.126521 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e646c709-e805-4c0c-a99c-11307575277a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a10915af0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:20.175490 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-73b4c5b3-5417-48ef-9ec1-b1240079a956 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:20.175961 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-73b4c5b3-5417-48ef-9ec1-b1240079a956 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:20.182284 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-73b4c5b3-5417-48ef-9ec1-b1240079a956 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:20.182959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-73b4c5b3-5417-48ef-9ec1-b1240079a956 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:20.335344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:20.338092 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.multi_cell_list [None req-73b4c5b3-5417-48ef-9ec1-b1240079a956 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=119338) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:28:21.137129 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-73b4c5b3-5417-48ef-9ec1-b1240079a956 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 1.095816 Jul 19 22:28:21.157390 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 371/780] 10.222.0.25 () {58 vars in 1124 bytes} [Tue Jul 19 22:28:20 2022] GET /compute/v2.1/servers => generated 1004 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:21.164145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9c9c7428-522a-43db-8a27-43e99a2478d2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:21.165045 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9c9c7428-522a-43db-8a27-43e99a2478d2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:21.184835 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9c9c7428-522a-43db-8a27-43e99a2478d2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:21.185528 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9c9c7428-522a-43db-8a27-43e99a2478d2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:21.186526 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9c9c7428-522a-43db-8a27-43e99a2478d2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:21.187059 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9c9c7428-522a-43db-8a27-43e99a2478d2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:21.956450 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e646c709-e805-4c0c-a99c-11307575277a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "DELETE /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5" status: 204 len: 0 microversion: 2.1 time: 1.840693 Jul 19 22:28:21.958553 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 410/781] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:20 2022] DELETE /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5 => generated 0 bytes in 1843 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 22:28:21.967594 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-af2d3663-6bdb-4838-bb5e-95cf1c7930ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:21.968500 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-af2d3663-6bdb-4838-bb5e-95cf1c7930ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:21.991977 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af2d3663-6bdb-4838-bb5e-95cf1c7930ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:22.000269 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af2d3663-6bdb-4838-bb5e-95cf1c7930ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:22.005822 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af2d3663-6bdb-4838-bb5e-95cf1c7930ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:22.007519 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af2d3663-6bdb-4838-bb5e-95cf1c7930ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:22.406476 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9c9c7428-522a-43db-8a27-43e99a2478d2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:22.420290 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9c9c7428-522a-43db-8a27-43e99a2478d2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1378 microversion: 2.1 time: 1.260434 Jul 19 22:28:22.421661 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 372/782] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:21 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1378 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:22.429628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9d1754c3-f0ac-49bf-9efb-fc2a60265752 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:22.430648 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9d1754c3-f0ac-49bf-9efb-fc2a60265752 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 7a5c8094-ecd0-4423-bbfd-43d136f1f443] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:22.444895 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d1754c3-f0ac-49bf-9efb-fc2a60265752 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:22.446280 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d1754c3-f0ac-49bf-9efb-fc2a60265752 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:22.447795 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d1754c3-f0ac-49bf-9efb-fc2a60265752 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:22.449305 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d1754c3-f0ac-49bf-9efb-fc2a60265752 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:22.675307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9d1754c3-f0ac-49bf-9efb-fc2a60265752 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:22.688915 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9d1754c3-f0ac-49bf-9efb-fc2a60265752 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443" status: 200 len: 1271 microversion: 2.1 time: 0.265320 Jul 19 22:28:22.689711 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 373/783] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:22 2022] GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443 => generated 1271 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:22.696332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-7c0a1510-d427-4dcc-92dd-49b013202936 req-9108f702-8199-4481-871a-91c1c36e9385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d191bac-6976-461e-9def-4f839a59331e", "tag": "c456a7c4-6281-40e9-846b-1f8734a09c76"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:22.708663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7c0a1510-d427-4dcc-92dd-49b013202936 req-9108f702-8199-4481-871a-91c1c36e9385 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:22.709439 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7c0a1510-d427-4dcc-92dd-49b013202936 req-9108f702-8199-4481-871a-91c1c36e9385 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:22.727213 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-7c0a1510-d427-4dcc-92dd-49b013202936 req-9108f702-8199-4481-871a-91c1c36e9385 service nova] Creating event network-changed:c456a7c4-6281-40e9-846b-1f8734a09c76 for instance 3d191bac-6976-461e-9def-4f839a59331e on n-h1-847009-3 Jul 19 22:28:22.734279 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-7c0a1510-d427-4dcc-92dd-49b013202936 req-9108f702-8199-4481-871a-91c1c36e9385 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042851 Jul 19 22:28:22.736043 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 374/784] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:22.742537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-60185ad6-4ade-401f-9469-5853855f7c27 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:22.744155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-60185ad6-4ade-401f-9469-5853855f7c27 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: c63853a7-f403-42e3-9a4b-fb322a8decd6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:22.759175 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-af2d3663-6bdb-4838-bb5e-95cf1c7930ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:22.767864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-60185ad6-4ade-401f-9469-5853855f7c27 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:22.769997 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-60185ad6-4ade-401f-9469-5853855f7c27 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:22.772149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-60185ad6-4ade-401f-9469-5853855f7c27 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:22.778261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-60185ad6-4ade-401f-9469-5853855f7c27 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:22.801245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-af2d3663-6bdb-4838-bb5e-95cf1c7930ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:22.804753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-af2d3663-6bdb-4838-bb5e-95cf1c7930ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:22.807193 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-af2d3663-6bdb-4838-bb5e-95cf1c7930ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 200 len: 1361 microversion: 2.25 time: 0.846642 Jul 19 22:28:22.808629 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 411/785] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:21 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 1361 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:22.817830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-0b0dfaa0-bffa-4462-8cef-58532cd207b4 req-5bf26a90-9195-4682-a9d4-33fad04fcded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef1f3571-2f57-4f5b-b607-16d82d41d8d2", "name": "network-vif-plugged", "status": "completed", "tag": "01a778f9-5da2-424c-9cea-9f854afa416c"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:22.831757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-0b0dfaa0-bffa-4462-8cef-58532cd207b4 req-5bf26a90-9195-4682-a9d4-33fad04fcded service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:22.832842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-0b0dfaa0-bffa-4462-8cef-58532cd207b4 req-5bf26a90-9195-4682-a9d4-33fad04fcded service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:22.852222 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-0b0dfaa0-bffa-4462-8cef-58532cd207b4 req-5bf26a90-9195-4682-a9d4-33fad04fcded service nova] Creating event network-vif-plugged:01a778f9-5da2-424c-9cea-9f854afa416c for instance ef1f3571-2f57-4f5b-b607-16d82d41d8d2 on n-h2-847009-3 Jul 19 22:28:22.859662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-60185ad6-4ade-401f-9469-5853855f7c27 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: c63853a7-f403-42e3-9a4b-fb322a8decd6] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:28:22.861360 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-0b0dfaa0-bffa-4462-8cef-58532cd207b4 req-5bf26a90-9195-4682-a9d4-33fad04fcded service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050105 Jul 19 22:28:22.886714 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 412/786] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:23.061056 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-60185ad6-4ade-401f-9469-5853855f7c27 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6" status: 204 len: 0 microversion: 2.1 time: 0.319725 Jul 19 22:28:23.076861 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 375/787] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:28:22 2022] DELETE /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:28:23.304350 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6f15e078-e0b0-46a9-b853-12a0b7157d66 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1696927276", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "5684cb20-bc75-42db-91c0-b2fe6d252169"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:23.411844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-6f15e078-e0b0-46a9-b853-12a0b7157d66 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] validate_networks() for [('5684cb20-bc75-42db-91c0-b2fe6d252169', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:28:23.442097 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ab6fff3e-cee1-4202-ba9c-47f7571c78fc tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:23.443546 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ab6fff3e-cee1-4202-ba9c-47f7571c78fc tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:23.454929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab6fff3e-cee1-4202-ba9c-47f7571c78fc tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:23.456077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab6fff3e-cee1-4202-ba9c-47f7571c78fc tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:23.457873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab6fff3e-cee1-4202-ba9c-47f7571c78fc tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:23.459275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab6fff3e-cee1-4202-ba9c-47f7571c78fc tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:23.828923 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ab6fff3e-cee1-4202-ba9c-47f7571c78fc tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:23.841934 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ab6fff3e-cee1-4202-ba9c-47f7571c78fc tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1378 microversion: 2.1 time: 0.404583 Jul 19 22:28:23.844694 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 376/788] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:23 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1378 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:23.849705 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e6220381-ee7a-4ff5-a7f0-f291aa411af1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:23.856832 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e6220381-ee7a-4ff5-a7f0-f291aa411af1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 7a5c8094-ecd0-4423-bbfd-43d136f1f443] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:23.879015 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e6220381-ee7a-4ff5-a7f0-f291aa411af1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:23.879426 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e6220381-ee7a-4ff5-a7f0-f291aa411af1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:23.880242 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e6220381-ee7a-4ff5-a7f0-f291aa411af1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:23.880689 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e6220381-ee7a-4ff5-a7f0-f291aa411af1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:24.040703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e6220381-ee7a-4ff5-a7f0-f291aa411af1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:24.059096 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e6220381-ee7a-4ff5-a7f0-f291aa411af1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443" status: 200 len: 1279 microversion: 2.1 time: 0.212776 Jul 19 22:28:24.067594 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 377/789] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:23 2022] GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443 => generated 1279 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:24.081054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-04b05b48-d5af-4750-98c4-03ca9ae467dd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:24.083601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-04b05b48-d5af-4750-98c4-03ca9ae467dd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:24.096498 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04b05b48-d5af-4750-98c4-03ca9ae467dd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:24.097441 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04b05b48-d5af-4750-98c4-03ca9ae467dd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:24.098674 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04b05b48-d5af-4750-98c4-03ca9ae467dd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:24.099565 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04b05b48-d5af-4750-98c4-03ca9ae467dd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:24.499287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-04b05b48-d5af-4750-98c4-03ca9ae467dd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:24.517805 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-04b05b48-d5af-4750-98c4-03ca9ae467dd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:24.520490 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-04b05b48-d5af-4750-98c4-03ca9ae467dd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:24.528585 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-04b05b48-d5af-4750-98c4-03ca9ae467dd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 200 len: 1361 microversion: 2.25 time: 0.453831 Jul 19 22:28:24.531926 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 378/790] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:24 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 1361 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:24.542610 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-724c71ef-598a-42de-801b-bf6090e386f5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-239859740", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "f8e64135-274c-4e94-95ba-a2d0adec94fe"}], "security_groups": [{"name": "tempest-securitygroup--2126403757"}], "key_name": "tempest-keypair-1745561648", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:24.561666 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-6f15e078-e0b0-46a9-b853-12a0b7157d66 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:28:24.562219 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-6f15e078-e0b0-46a9-b853-12a0b7157d66 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:28:24.562688 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-6f15e078-e0b0-46a9-b853-12a0b7157d66 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:28:24.563378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-6f15e078-e0b0-46a9-b853-12a0b7157d66 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:28:24.564038 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-6f15e078-e0b0-46a9-b853-12a0b7157d66 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:28:24.579976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6f15e078-e0b0-46a9-b853-12a0b7157d66 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:24.583809 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6f15e078-e0b0-46a9-b853-12a0b7157d66 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:24.586155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6f15e078-e0b0-46a9-b853-12a0b7157d66 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:24.587627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6f15e078-e0b0-46a9-b853-12a0b7157d66 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:24.645338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-6f15e078-e0b0-46a9-b853-12a0b7157d66 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Getting quotas for project 5e91c72f8cf5406a9662a29ee25780e6. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:28:24.666675 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-6f15e078-e0b0-46a9-b853-12a0b7157d66 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Getting quotas for user 22b46b207cdb40c7b325bdc42baae246 and project 5e91c72f8cf5406a9662a29ee25780e6. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:28:24.693994 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:24.699997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6f15e078-e0b0-46a9-b853-12a0b7157d66 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:28:24.704314 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6f15e078-e0b0-46a9-b853-12a0b7157d66 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:28:24.796976 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-724c71ef-598a-42de-801b-bf6090e386f5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] validate_networks() for [('f8e64135-274c-4e94-95ba-a2d0adec94fe', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:28:24.821058 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6f15e078-e0b0-46a9-b853-12a0b7157d66 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.520350 Jul 19 22:28:24.822520 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 413/791] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:28:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 22:28:25.400656 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-98fbe0f2-f0b0-4f76-822c-645e67eebd26 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-782231318", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:25.530576 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-98fbe0f2-f0b0-4f76-822c-645e67eebd26 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] validate_networks() for None {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:28:26.897809 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-98fbe0f2-f0b0-4f76-822c-645e67eebd26 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:28:26.902292 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-98fbe0f2-f0b0-4f76-822c-645e67eebd26 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:28:26.905528 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-98fbe0f2-f0b0-4f76-822c-645e67eebd26 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:28:26.906430 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-98fbe0f2-f0b0-4f76-822c-645e67eebd26 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:28:26.906861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-98fbe0f2-f0b0-4f76-822c-645e67eebd26 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:28:26.922024 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-98fbe0f2-f0b0-4f76-822c-645e67eebd26 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:26.922957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-98fbe0f2-f0b0-4f76-822c-645e67eebd26 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:26.924258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-98fbe0f2-f0b0-4f76-822c-645e67eebd26 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:26.924885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-98fbe0f2-f0b0-4f76-822c-645e67eebd26 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:26.957798 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-98fbe0f2-f0b0-4f76-822c-645e67eebd26 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Getting quotas for project e5ad9b6d4ffc446bbe411c040b4aef80. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:28:26.977634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-98fbe0f2-f0b0-4f76-822c-645e67eebd26 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Getting quotas for user 95538027b9ea43dd877a396003416933 and project e5ad9b6d4ffc446bbe411c040b4aef80. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:28:26.999533 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-98fbe0f2-f0b0-4f76-822c-645e67eebd26 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:28:27.001710 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-98fbe0f2-f0b0-4f76-822c-645e67eebd26 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] [instance: 30cffef5-6254-4e63-b322-dcbbb4812bcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:28:27.133712 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-98fbe0f2-f0b0-4f76-822c-645e67eebd26 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.301909 Jul 19 22:28:27.143749 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 414/792] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:28:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:28:27.143749 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7a835d37-5a71-42bd-bfcb-b92afe3b1af2 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:27.143749 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7a835d37-5a71-42bd-bfcb-b92afe3b1af2 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:27.158474 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a835d37-5a71-42bd-bfcb-b92afe3b1af2 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:27.159338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a835d37-5a71-42bd-bfcb-b92afe3b1af2 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:27.160425 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a835d37-5a71-42bd-bfcb-b92afe3b1af2 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:27.161131 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a835d37-5a71-42bd-bfcb-b92afe3b1af2 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:27.333638 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7a835d37-5a71-42bd-bfcb-b92afe3b1af2 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:27.344733 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7a835d37-5a71-42bd-bfcb-b92afe3b1af2 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1266 microversion: 2.1 time: 0.208441 Jul 19 22:28:27.350100 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 415/793] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:27 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:27.360751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4f324a6c-4a39-47da-bbaf-33dca9e61f41 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:27.361617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4f324a6c-4a39-47da-bbaf-33dca9e61f41 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:27.391083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f324a6c-4a39-47da-bbaf-33dca9e61f41 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:27.391895 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f324a6c-4a39-47da-bbaf-33dca9e61f41 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:27.393453 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f324a6c-4a39-47da-bbaf-33dca9e61f41 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:27.397812 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f324a6c-4a39-47da-bbaf-33dca9e61f41 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:27.681530 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-724c71ef-598a-42de-801b-bf6090e386f5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:28:27.682405 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-724c71ef-598a-42de-801b-bf6090e386f5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:28:27.682828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-724c71ef-598a-42de-801b-bf6090e386f5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:28:27.683299 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-724c71ef-598a-42de-801b-bf6090e386f5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:28:27.683720 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-724c71ef-598a-42de-801b-bf6090e386f5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:28:27.690833 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=35 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:27.704161 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-724c71ef-598a-42de-801b-bf6090e386f5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:27.704611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-724c71ef-598a-42de-801b-bf6090e386f5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:27.710145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-724c71ef-598a-42de-801b-bf6090e386f5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:27.710864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-724c71ef-598a-42de-801b-bf6090e386f5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:27.765122 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-724c71ef-598a-42de-801b-bf6090e386f5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Getting quotas for project 2619b807c1ee4dca858dae47c4686ba2. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:28:27.780794 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-724c71ef-598a-42de-801b-bf6090e386f5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Getting quotas for user 55a214cbc1ec4cdb80ccf736f4251964 and project 2619b807c1ee4dca858dae47c4686ba2. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:28:27.803946 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-724c71ef-598a-42de-801b-bf6090e386f5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:28:27.807048 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-724c71ef-598a-42de-801b-bf6090e386f5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:28:27.872626 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-724c71ef-598a-42de-801b-bf6090e386f5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.338500 Jul 19 22:28:27.873561 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 379/794] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:28:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 3341 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:28:27.880413 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-273ef594-792e-414b-9dd4-21b2653f454c req-3e7ab032-2d3d-42ab-8639-1dc23d965f72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63853a7-f403-42e3-9a4b-fb322a8decd6", "name": "network-vif-unplugged", "status": "completed", "tag": "a4f5bb99-23dd-4735-9565-0e8ced8c4323"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:27.892687 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-273ef594-792e-414b-9dd4-21b2653f454c req-3e7ab032-2d3d-42ab-8639-1dc23d965f72 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:27.893464 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-273ef594-792e-414b-9dd4-21b2653f454c req-3e7ab032-2d3d-42ab-8639-1dc23d965f72 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:27.907071 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-273ef594-792e-414b-9dd4-21b2653f454c req-3e7ab032-2d3d-42ab-8639-1dc23d965f72 service nova] Creating event network-vif-unplugged:a4f5bb99-23dd-4735-9565-0e8ced8c4323 for instance c63853a7-f403-42e3-9a4b-fb322a8decd6 on n-h1-847009-3 Jul 19 22:28:27.932928 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-273ef594-792e-414b-9dd4-21b2653f454c req-3e7ab032-2d3d-42ab-8639-1dc23d965f72 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056616 Jul 19 22:28:27.936735 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 380/795] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:27.947909 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4d961970-7b6d-4ede-9045-a93d380d3cda tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:27.949007 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4d961970-7b6d-4ede-9045-a93d380d3cda tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 7a5c8094-ecd0-4423-bbfd-43d136f1f443] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:27.963670 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d961970-7b6d-4ede-9045-a93d380d3cda tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:27.964345 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d961970-7b6d-4ede-9045-a93d380d3cda tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:27.965883 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d961970-7b6d-4ede-9045-a93d380d3cda tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:27.966575 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d961970-7b6d-4ede-9045-a93d380d3cda tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:29.089349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4f324a6c-4a39-47da-bbaf-33dca9e61f41 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:29.128039 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4f324a6c-4a39-47da-bbaf-33dca9e61f41 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1378 microversion: 2.1 time: 1.774333 Jul 19 22:28:29.129176 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 416/796] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:27 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1378 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:29.148508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-854809bd-3a71-4662-ad60-7e0cabc60b77 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:29.149279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-854809bd-3a71-4662-ad60-7e0cabc60b77 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:29.186617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-854809bd-3a71-4662-ad60-7e0cabc60b77 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:29.187082 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-854809bd-3a71-4662-ad60-7e0cabc60b77 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:29.187924 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-854809bd-3a71-4662-ad60-7e0cabc60b77 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:29.188369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-854809bd-3a71-4662-ad60-7e0cabc60b77 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:29.568315 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4d961970-7b6d-4ede-9045-a93d380d3cda tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:29.583607 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4d961970-7b6d-4ede-9045-a93d380d3cda tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443" status: 200 len: 1319 microversion: 2.1 time: 1.644855 Jul 19 22:28:29.585676 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 381/797] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:27 2022] GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443 => generated 1319 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:29.598795 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-49b74bd5-b00b-4ca9-888f-ecbf86cdea48 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:29.599863 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-49b74bd5-b00b-4ca9-888f-ecbf86cdea48 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] [instance: 30cffef5-6254-4e63-b322-dcbbb4812bcb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:29.621214 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49b74bd5-b00b-4ca9-888f-ecbf86cdea48 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:29.621889 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49b74bd5-b00b-4ca9-888f-ecbf86cdea48 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:29.623805 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49b74bd5-b00b-4ca9-888f-ecbf86cdea48 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:29.628061 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49b74bd5-b00b-4ca9-888f-ecbf86cdea48 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:30.021225 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-49b74bd5-b00b-4ca9-888f-ecbf86cdea48 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95538027b9ea43dd877a396003416933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad9b6d4ffc446bbe411c040b4aef80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:30.031930 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-49b74bd5-b00b-4ca9-888f-ecbf86cdea48 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] 10.222.0.25 "GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb" status: 200 len: 1292 microversion: 2.1 time: 0.444824 Jul 19 22:28:30.032532 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 382/798] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:29 2022] GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb => generated 1292 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:30.056562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6b1a3092-7512-4e0b-91cd-d4625e897151 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:30.062345 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6b1a3092-7512-4e0b-91cd-d4625e897151 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:30.078504 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b1a3092-7512-4e0b-91cd-d4625e897151 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:30.079341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b1a3092-7512-4e0b-91cd-d4625e897151 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:30.080372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b1a3092-7512-4e0b-91cd-d4625e897151 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:30.080965 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b1a3092-7512-4e0b-91cd-d4625e897151 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:30.180332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-854809bd-3a71-4662-ad60-7e0cabc60b77 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:30.195303 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-854809bd-3a71-4662-ad60-7e0cabc60b77 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:30.196921 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-854809bd-3a71-4662-ad60-7e0cabc60b77 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:30.201517 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-854809bd-3a71-4662-ad60-7e0cabc60b77 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 200 len: 1558 microversion: 2.25 time: 1.070127 Jul 19 22:28:30.206408 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 417/799] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:29 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 1558 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:30.227499 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d795bd94-5f2c-4495-a860-09453b750725 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:30.228149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d795bd94-5f2c-4495-a860-09453b750725 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:30.239132 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d795bd94-5f2c-4495-a860-09453b750725 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:30.239671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d795bd94-5f2c-4495-a860-09453b750725 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:30.240481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d795bd94-5f2c-4495-a860-09453b750725 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:30.240955 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d795bd94-5f2c-4495-a860-09453b750725 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:30.312557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6b1a3092-7512-4e0b-91cd-d4625e897151 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:30.358572 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6b1a3092-7512-4e0b-91cd-d4625e897151 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1286 microversion: 2.1 time: 0.316065 Jul 19 22:28:30.381905 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 383/800] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:30 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1286 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:30.405669 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-8ca346f2-2ec0-4d4a-8809-115dd40ec976 req-c1f7e20e-0d82-4db2-8c35-cd188bef0528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63853a7-f403-42e3-9a4b-fb322a8decd6", "name": "network-vif-deleted", "tag": "a4f5bb99-23dd-4735-9565-0e8ced8c4323"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:30.442123 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-8ca346f2-2ec0-4d4a-8809-115dd40ec976 req-c1f7e20e-0d82-4db2-8c35-cd188bef0528 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:30.443459 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-8ca346f2-2ec0-4d4a-8809-115dd40ec976 req-c1f7e20e-0d82-4db2-8c35-cd188bef0528 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:30.467525 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-8ca346f2-2ec0-4d4a-8809-115dd40ec976 req-c1f7e20e-0d82-4db2-8c35-cd188bef0528 service nova] Creating event network-vif-deleted:a4f5bb99-23dd-4735-9565-0e8ced8c4323 for instance c63853a7-f403-42e3-9a4b-fb322a8decd6 on n-h1-847009-3 Jul 19 22:28:30.474549 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-8ca346f2-2ec0-4d4a-8809-115dd40ec976 req-c1f7e20e-0d82-4db2-8c35-cd188bef0528 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090674 Jul 19 22:28:30.476060 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 384/801] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:30.484557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f3faa94c-3e39-4fae-a808-629a61cd63f3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:30.485952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f3faa94c-3e39-4fae-a808-629a61cd63f3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:30.507102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f3faa94c-3e39-4fae-a808-629a61cd63f3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:30.508522 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f3faa94c-3e39-4fae-a808-629a61cd63f3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:30.511460 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f3faa94c-3e39-4fae-a808-629a61cd63f3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:30.513833 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f3faa94c-3e39-4fae-a808-629a61cd63f3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:31.129035 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d795bd94-5f2c-4495-a860-09453b750725 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:31.135696 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f3faa94c-3e39-4fae-a808-629a61cd63f3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:31.144926 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d795bd94-5f2c-4495-a860-09453b750725 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1308 microversion: 2.1 time: 0.931602 Jul 19 22:28:31.157883 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 418/802] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:30 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1308 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:31.158163 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f3faa94c-3e39-4fae-a808-629a61cd63f3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1378 microversion: 2.1 time: 0.679924 Jul 19 22:28:31.160927 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 385/803] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:30 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1378 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:31.171355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-01bd6fb8-d8b5-4629-9b3f-44aa545a3cdf tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:31.171355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-01bd6fb8-d8b5-4629-9b3f-44aa545a3cdf tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:31.177819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5199105d-18eb-4d86-86fc-054a7b74bac1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:31.178807 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5199105d-18eb-4d86-86fc-054a7b74bac1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 7a5c8094-ecd0-4423-bbfd-43d136f1f443] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:31.187940 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5199105d-18eb-4d86-86fc-054a7b74bac1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:31.188394 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5199105d-18eb-4d86-86fc-054a7b74bac1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:31.189195 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01bd6fb8-d8b5-4629-9b3f-44aa545a3cdf tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:31.189727 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5199105d-18eb-4d86-86fc-054a7b74bac1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:31.189727 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5199105d-18eb-4d86-86fc-054a7b74bac1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:31.189896 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01bd6fb8-d8b5-4629-9b3f-44aa545a3cdf tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:31.190447 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01bd6fb8-d8b5-4629-9b3f-44aa545a3cdf tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:31.190896 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01bd6fb8-d8b5-4629-9b3f-44aa545a3cdf tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:31.646205 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5199105d-18eb-4d86-86fc-054a7b74bac1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:31.657946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-01bd6fb8-d8b5-4629-9b3f-44aa545a3cdf tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lazy-loading 'services' on Instance uuid ef1f3571-2f57-4f5b-b607-16d82d41d8d2 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:28:31.687513 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5199105d-18eb-4d86-86fc-054a7b74bac1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443" status: 200 len: 1319 microversion: 2.1 time: 0.514362 Jul 19 22:28:31.690352 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 386/804] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:31 2022] GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443 => generated 1319 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:31.709314 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-01bd6fb8-d8b5-4629-9b3f-44aa545a3cdf tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 200 len: 2050 microversion: 2.25 time: 0.550220 Jul 19 22:28:31.709718 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ad951374-d3cd-45b9-bbe2-24e2d6f7d24b tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:31.710682 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 419/805] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:31 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 2050 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:31.715783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4ca652c0-797c-4c0c-96ee-f368cd060b9e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:31.716682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4ca652c0-797c-4c0c-96ee-f368cd060b9e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:31.720031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ad951374-d3cd-45b9-bbe2-24e2d6f7d24b tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] [instance: 30cffef5-6254-4e63-b322-dcbbb4812bcb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:31.727596 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:31.731010 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ca652c0-797c-4c0c-96ee-f368cd060b9e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:31.738736 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ca652c0-797c-4c0c-96ee-f368cd060b9e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:31.740208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ca652c0-797c-4c0c-96ee-f368cd060b9e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:31.741335 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ca652c0-797c-4c0c-96ee-f368cd060b9e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:31.767019 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad951374-d3cd-45b9-bbe2-24e2d6f7d24b tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:31.767973 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad951374-d3cd-45b9-bbe2-24e2d6f7d24b tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:31.771774 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad951374-d3cd-45b9-bbe2-24e2d6f7d24b tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:31.779500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad951374-d3cd-45b9-bbe2-24e2d6f7d24b tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:31.935393 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4ca652c0-797c-4c0c-96ee-f368cd060b9e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:31.951177 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4ca652c0-797c-4c0c-96ee-f368cd060b9e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1292 microversion: 2.1 time: 0.239081 Jul 19 22:28:31.955198 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 420/806] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:31 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1292 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:31.987824 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-82ec3e8b-e174-40ca-b0e0-5de9acdafefd tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:31.990930 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-82ec3e8b-e174-40ca-b0e0-5de9acdafefd tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:32.013501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-82ec3e8b-e174-40ca-b0e0-5de9acdafefd tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:32.019004 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-82ec3e8b-e174-40ca-b0e0-5de9acdafefd tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:32.020480 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-82ec3e8b-e174-40ca-b0e0-5de9acdafefd tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:32.021436 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-82ec3e8b-e174-40ca-b0e0-5de9acdafefd tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:32.151297 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ad951374-d3cd-45b9-bbe2-24e2d6f7d24b tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95538027b9ea43dd877a396003416933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad9b6d4ffc446bbe411c040b4aef80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:32.170801 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ad951374-d3cd-45b9-bbe2-24e2d6f7d24b tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] 10.222.0.25 "GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb" status: 200 len: 1280 microversion: 2.1 time: 0.475928 Jul 19 22:28:32.173225 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 387/807] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:31 2022] GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb => generated 1280 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:32.198801 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7e810cc1-f0d9-4ec6-8ab9-6f6b653a0eff tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:32.202150 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7e810cc1-f0d9-4ec6-8ab9-6f6b653a0eff tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:32.219197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e810cc1-f0d9-4ec6-8ab9-6f6b653a0eff tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:32.219868 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e810cc1-f0d9-4ec6-8ab9-6f6b653a0eff tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:32.220894 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e810cc1-f0d9-4ec6-8ab9-6f6b653a0eff tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:32.221540 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e810cc1-f0d9-4ec6-8ab9-6f6b653a0eff tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:32.276253 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:32.526780 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-82ec3e8b-e174-40ca-b0e0-5de9acdafefd tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lazy-loading 'services' on Instance uuid ef1f3571-2f57-4f5b-b607-16d82d41d8d2 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:28:32.588127 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-82ec3e8b-e174-40ca-b0e0-5de9acdafefd tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 200 len: 2050 microversion: 2.25 time: 0.630822 Jul 19 22:28:32.588984 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 421/808] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:31 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 2050 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:32.597165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8c3a5647-48b2-4c3f-96f7-bbc5cac39a14 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:32.598033 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8c3a5647-48b2-4c3f-96f7-bbc5cac39a14 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:32.618189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c3a5647-48b2-4c3f-96f7-bbc5cac39a14 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:32.618646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c3a5647-48b2-4c3f-96f7-bbc5cac39a14 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:32.619489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c3a5647-48b2-4c3f-96f7-bbc5cac39a14 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:32.619933 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c3a5647-48b2-4c3f-96f7-bbc5cac39a14 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:32.954948 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7e810cc1-f0d9-4ec6-8ab9-6f6b653a0eff tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:32.974938 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7e810cc1-f0d9-4ec6-8ab9-6f6b653a0eff tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1308 microversion: 2.1 time: 0.784005 Jul 19 22:28:32.976517 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 388/809] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:32 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1308 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:32.982219 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-05ff24cb-f250-4368-b4bb-6b94a6581541 req-471f9a62-dd56-4bb3-bd54-5edab51fb316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d191bac-6976-461e-9def-4f839a59331e", "name": "network-vif-plugged", "status": "completed", "tag": "c456a7c4-6281-40e9-846b-1f8734a09c76"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:32.992052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-05ff24cb-f250-4368-b4bb-6b94a6581541 req-471f9a62-dd56-4bb3-bd54-5edab51fb316 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:32.992709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-05ff24cb-f250-4368-b4bb-6b94a6581541 req-471f9a62-dd56-4bb3-bd54-5edab51fb316 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:33.009228 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-05ff24cb-f250-4368-b4bb-6b94a6581541 req-471f9a62-dd56-4bb3-bd54-5edab51fb316 service nova] Creating event network-vif-plugged:c456a7c4-6281-40e9-846b-1f8734a09c76 for instance 3d191bac-6976-461e-9def-4f839a59331e on n-h1-847009-3 Jul 19 22:28:33.017486 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-05ff24cb-f250-4368-b4bb-6b94a6581541 req-471f9a62-dd56-4bb3-bd54-5edab51fb316 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038636 Jul 19 22:28:33.019074 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 389/810] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:33.026115 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ecb4617e-7fca-4a74-bfef-43682ce12ab7 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:33.029828 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:28:33.029828 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:28:33.031784 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ecb4617e-7fca-4a74-bfef-43682ce12ab7 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:33.033770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ecb4617e-7fca-4a74-bfef-43682ce12ab7 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:33.035377 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ecb4617e-7fca-4a74-bfef-43682ce12ab7 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:33.036031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ecb4617e-7fca-4a74-bfef-43682ce12ab7 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:33.069500 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ecb4617e-7fca-4a74-bfef-43682ce12ab7 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.048663 Jul 19 22:28:33.076627 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 390/811] 10.222.0.25 () {60 vars in 1216 bytes} [Tue Jul 19 22:28:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:28:33.082801 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3ad49b22-f84b-4e43-ad49-dcc3ae172b12 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:33.083733 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3ad49b22-f84b-4e43-ad49-dcc3ae172b12 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 7a5c8094-ecd0-4423-bbfd-43d136f1f443] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:33.092081 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3ad49b22-f84b-4e43-ad49-dcc3ae172b12 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:33.092849 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3ad49b22-f84b-4e43-ad49-dcc3ae172b12 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:33.093576 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3ad49b22-f84b-4e43-ad49-dcc3ae172b12 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:33.094297 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3ad49b22-f84b-4e43-ad49-dcc3ae172b12 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:33.126997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8c3a5647-48b2-4c3f-96f7-bbc5cac39a14 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:33.137063 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8c3a5647-48b2-4c3f-96f7-bbc5cac39a14 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1378 microversion: 2.1 time: 0.544225 Jul 19 22:28:33.138855 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 422/812] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:32 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1378 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:33.149211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1e4a45ee-4228-46cb-b830-827beaca038f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:33.150352 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1e4a45ee-4228-46cb-b830-827beaca038f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:33.161186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e4a45ee-4228-46cb-b830-827beaca038f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:33.162924 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e4a45ee-4228-46cb-b830-827beaca038f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:33.163883 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e4a45ee-4228-46cb-b830-827beaca038f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:33.165336 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e4a45ee-4228-46cb-b830-827beaca038f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:33.442145 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1e4a45ee-4228-46cb-b830-827beaca038f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:33.445798 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:33.466545 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1e4a45ee-4228-46cb-b830-827beaca038f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1292 microversion: 2.1 time: 0.317897 Jul 19 22:28:33.476728 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 423/813] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:33 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1292 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:33.483825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e35b0cfc-fed6-4f36-b482-513990420b91 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:33.486035 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e35b0cfc-fed6-4f36-b482-513990420b91 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:33.493958 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e35b0cfc-fed6-4f36-b482-513990420b91 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:33.494675 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e35b0cfc-fed6-4f36-b482-513990420b91 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:33.496373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e35b0cfc-fed6-4f36-b482-513990420b91 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:33.499854 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e35b0cfc-fed6-4f36-b482-513990420b91 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:33.596690 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e35b0cfc-fed6-4f36-b482-513990420b91 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2/action" status: 202 len: 0 microversion: 2.25 time: 0.117171 Jul 19 22:28:33.605265 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 424/814] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Jul 19 22:28:33 2022] POST /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:28:33.633095 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e5bf775d-83ec-41bb-803c-cd75705c7a1b tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:33.634134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e5bf775d-83ec-41bb-803c-cd75705c7a1b tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] [instance: 30cffef5-6254-4e63-b322-dcbbb4812bcb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:33.655841 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5bf775d-83ec-41bb-803c-cd75705c7a1b tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:33.658505 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5bf775d-83ec-41bb-803c-cd75705c7a1b tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:33.659461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5bf775d-83ec-41bb-803c-cd75705c7a1b tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:33.659907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5bf775d-83ec-41bb-803c-cd75705c7a1b tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:33.972085 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e5bf775d-83ec-41bb-803c-cd75705c7a1b tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95538027b9ea43dd877a396003416933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad9b6d4ffc446bbe411c040b4aef80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:33.980925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3ad49b22-f84b-4e43-ad49-dcc3ae172b12 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:33.985180 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e5bf775d-83ec-41bb-803c-cd75705c7a1b tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] 10.222.0.25 "GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb" status: 200 len: 1280 microversion: 2.1 time: 0.363574 Jul 19 22:28:33.988493 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 425/815] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:33 2022] GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb => generated 1280 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:33.996244 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3ad49b22-f84b-4e43-ad49-dcc3ae172b12 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443" status: 200 len: 1319 microversion: 2.1 time: 0.924972 Jul 19 22:28:33.996832 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 391/816] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:33 2022] GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443 => generated 1319 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:34.007469 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-22f0256f-fde4-48ea-a24f-e186d18759c6 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de9fa399-c5b5-4d78-baca-2f326f3343d2"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:34.007469 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-22f0256f-fde4-48ea-a24f-e186d18759c6 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:34.007968 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22f0256f-fde4-48ea-a24f-e186d18759c6 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:34.008533 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22f0256f-fde4-48ea-a24f-e186d18759c6 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:34.009666 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22f0256f-fde4-48ea-a24f-e186d18759c6 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:34.010215 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22f0256f-fde4-48ea-a24f-e186d18759c6 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:34.014735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4ba55306-5a0f-4249-a084-db9271c24a76 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:34.015725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4ba55306-5a0f-4249-a084-db9271c24a76 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:34.024618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ba55306-5a0f-4249-a084-db9271c24a76 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:34.025258 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ba55306-5a0f-4249-a084-db9271c24a76 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:34.026211 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ba55306-5a0f-4249-a084-db9271c24a76 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:34.026801 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ba55306-5a0f-4249-a084-db9271c24a76 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:34.307701 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-4ba55306-5a0f-4249-a084-db9271c24a76 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lazy-loading 'services' on Instance uuid ef1f3571-2f57-4f5b-b607-16d82d41d8d2 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:28:34.340611 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4ba55306-5a0f-4249-a084-db9271c24a76 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 200 len: 2035 microversion: 2.25 time: 0.328081 Jul 19 22:28:34.342530 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 392/817] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:34 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 2035 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:34.363704 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-d32d807a-9826-41e5-86ed-b5b832ea8003 req-60f6f54d-921e-4007-af68-4d5d72b13cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5c8094-ecd0-4423-bbfd-43d136f1f443", "tag": "fdcfb6b1-ce54-4c4c-9b5f-fd0ab666672e"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:34.384980 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d32d807a-9826-41e5-86ed-b5b832ea8003 req-60f6f54d-921e-4007-af68-4d5d72b13cc9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:34.385315 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d32d807a-9826-41e5-86ed-b5b832ea8003 req-60f6f54d-921e-4007-af68-4d5d72b13cc9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:34.408032 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-d32d807a-9826-41e5-86ed-b5b832ea8003 req-60f6f54d-921e-4007-af68-4d5d72b13cc9 service nova] Creating event network-changed:fdcfb6b1-ce54-4c4c-9b5f-fd0ab666672e for instance 7a5c8094-ecd0-4423-bbfd-43d136f1f443 on n-h1-847009-3 Jul 19 22:28:34.425891 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-d32d807a-9826-41e5-86ed-b5b832ea8003 req-60f6f54d-921e-4007-af68-4d5d72b13cc9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077355 Jul 19 22:28:34.426979 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 393/818] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:34.432801 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0ac87ea6-4232-4910-ba41-a83cbb11d2c4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:34.433437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0ac87ea6-4232-4910-ba41-a83cbb11d2c4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:34.460081 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ac87ea6-4232-4910-ba41-a83cbb11d2c4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:34.460749 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ac87ea6-4232-4910-ba41-a83cbb11d2c4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:34.464522 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ac87ea6-4232-4910-ba41-a83cbb11d2c4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:34.465384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ac87ea6-4232-4910-ba41-a83cbb11d2c4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:34.522749 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-22f0256f-fde4-48ea-a24f-e186d18759c6 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "POST /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.532109 Jul 19 22:28:34.523527 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 426/819] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 19 22:28:33 2022] POST /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5/os-volume_attachments => generated 194 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:34.540881 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7423ad1e-8ff2-4406-b9ce-845ba006c57c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:34.541961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7423ad1e-8ff2-4406-b9ce-845ba006c57c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:34.564083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7423ad1e-8ff2-4406-b9ce-845ba006c57c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:34.565226 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7423ad1e-8ff2-4406-b9ce-845ba006c57c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:34.566800 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7423ad1e-8ff2-4406-b9ce-845ba006c57c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:34.568316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7423ad1e-8ff2-4406-b9ce-845ba006c57c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:34.752258 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0ac87ea6-4232-4910-ba41-a83cbb11d2c4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:34.767953 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0ac87ea6-4232-4910-ba41-a83cbb11d2c4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1308 microversion: 2.1 time: 0.336068 Jul 19 22:28:34.770374 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 394/820] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:34 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1308 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:34.775495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-54107a93-d6cb-4688-b265-ebe7f59ffc8e req-594a73be-5a1b-419a-a584-2e0009cbd12c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2df991c2-a91f-4de1-96a1-8c36ae7ce9be", "tag": "0292746c-2df0-4aad-a561-ebf4daa4f8d7"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:34.800636 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-54107a93-d6cb-4688-b265-ebe7f59ffc8e req-594a73be-5a1b-419a-a584-2e0009cbd12c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:34.801859 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-54107a93-d6cb-4688-b265-ebe7f59ffc8e req-594a73be-5a1b-419a-a584-2e0009cbd12c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:34.827820 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-54107a93-d6cb-4688-b265-ebe7f59ffc8e req-594a73be-5a1b-419a-a584-2e0009cbd12c service nova] Creating event network-changed:0292746c-2df0-4aad-a561-ebf4daa4f8d7 for instance 2df991c2-a91f-4de1-96a1-8c36ae7ce9be on n-h1-847009-3 Jul 19 22:28:34.843433 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-54107a93-d6cb-4688-b265-ebe7f59ffc8e req-594a73be-5a1b-419a-a584-2e0009cbd12c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071427 Jul 19 22:28:34.846977 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 395/821] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:34.863866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fbd292df-6ba3-4ce0-bb6c-96b8c71ee4a9 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-847009-3", "block_migration": "auto"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:34.865720 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fbd292df-6ba3-4ce0-bb6c-96b8c71ee4a9 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:34.894225 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fbd292df-6ba3-4ce0-bb6c-96b8c71ee4a9 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:34.894819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fbd292df-6ba3-4ce0-bb6c-96b8c71ee4a9 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:34.896099 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fbd292df-6ba3-4ce0-bb6c-96b8c71ee4a9 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:34.896778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fbd292df-6ba3-4ce0-bb6c-96b8c71ee4a9 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:34.923159 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7423ad1e-8ff2-4406-b9ce-845ba006c57c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:34.948757 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7423ad1e-8ff2-4406-b9ce-845ba006c57c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1378 microversion: 2.1 time: 0.419777 Jul 19 22:28:34.956693 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-fbd292df-6ba3-4ce0-bb6c-96b8c71ee4a9 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lazy-loading 'flavor' on Instance uuid ef1f3571-2f57-4f5b-b607-16d82d41d8d2 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:28:34.964456 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 427/822] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:34 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1378 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:34.976747 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-020ce03f-b480-4ccb-8832-2b54a446786e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:34.979888 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fbd292df-6ba3-4ce0-bb6c-96b8c71ee4a9 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Going to try to live migrate instance to n-h1-847009-3 {{(pid=119338) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 22:28:34.980043 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-020ce03f-b480-4ccb-8832-2b54a446786e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:34.994329 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-020ce03f-b480-4ccb-8832-2b54a446786e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:34.994872 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-020ce03f-b480-4ccb-8832-2b54a446786e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:34.995777 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-020ce03f-b480-4ccb-8832-2b54a446786e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:35.000191 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-020ce03f-b480-4ccb-8832-2b54a446786e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:35.356130 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-020ce03f-b480-4ccb-8832-2b54a446786e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:35.383615 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-020ce03f-b480-4ccb-8832-2b54a446786e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1360 microversion: 2.1 time: 0.417883 Jul 19 22:28:35.387066 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 428/823] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:34 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1360 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:35.411490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c36d5674-dec9-42e2-b2eb-e00e2f5879ae tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:35.412428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c36d5674-dec9-42e2-b2eb-e00e2f5879ae tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] [instance: 30cffef5-6254-4e63-b322-dcbbb4812bcb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:35.434074 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c36d5674-dec9-42e2-b2eb-e00e2f5879ae tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:35.435346 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c36d5674-dec9-42e2-b2eb-e00e2f5879ae tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:35.446543 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c36d5674-dec9-42e2-b2eb-e00e2f5879ae tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:35.449830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c36d5674-dec9-42e2-b2eb-e00e2f5879ae tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:36.115429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c36d5674-dec9-42e2-b2eb-e00e2f5879ae tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95538027b9ea43dd877a396003416933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad9b6d4ffc446bbe411c040b4aef80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:36.130646 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c36d5674-dec9-42e2-b2eb-e00e2f5879ae tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] 10.222.0.25 "GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb" status: 200 len: 1322 microversion: 2.1 time: 0.731972 Jul 19 22:28:36.132847 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 429/824] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:35 2022] GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb => generated 1322 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:36.146178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9f28ea5e-4e45-44c3-bc41-babbddd3849b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:36.146817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9f28ea5e-4e45-44c3-bc41-babbddd3849b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 7a5c8094-ecd0-4423-bbfd-43d136f1f443] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:36.163972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9f28ea5e-4e45-44c3-bc41-babbddd3849b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:36.165543 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9f28ea5e-4e45-44c3-bc41-babbddd3849b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:36.169946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9f28ea5e-4e45-44c3-bc41-babbddd3849b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:36.170400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9f28ea5e-4e45-44c3-bc41-babbddd3849b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:36.364926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9f28ea5e-4e45-44c3-bc41-babbddd3849b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:36.374286 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9f28ea5e-4e45-44c3-bc41-babbddd3849b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443" status: 200 len: 1319 microversion: 2.1 time: 0.237886 Jul 19 22:28:36.375172 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 430/825] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:36 2022] GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:36.381886 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-14016fb3-1fbc-48b6-b98d-8ca033c5c1f4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:36.382988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-14016fb3-1fbc-48b6-b98d-8ca033c5c1f4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:36.392583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14016fb3-1fbc-48b6-b98d-8ca033c5c1f4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:36.393281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14016fb3-1fbc-48b6-b98d-8ca033c5c1f4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:36.395226 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14016fb3-1fbc-48b6-b98d-8ca033c5c1f4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:36.396049 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14016fb3-1fbc-48b6-b98d-8ca033c5c1f4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:36.583913 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-14016fb3-1fbc-48b6-b98d-8ca033c5c1f4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:36.597662 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-14016fb3-1fbc-48b6-b98d-8ca033c5c1f4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1308 microversion: 2.1 time: 0.221055 Jul 19 22:28:36.607346 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 431/826] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:36 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1308 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:36.616446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-732abba7-e415-4a42-a54d-76d5a8509a33 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:36.617075 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-732abba7-e415-4a42-a54d-76d5a8509a33 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:36.628639 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-732abba7-e415-4a42-a54d-76d5a8509a33 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:36.629092 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-732abba7-e415-4a42-a54d-76d5a8509a33 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:36.629871 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-732abba7-e415-4a42-a54d-76d5a8509a33 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:36.630311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-732abba7-e415-4a42-a54d-76d5a8509a33 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:36.840853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-732abba7-e415-4a42-a54d-76d5a8509a33 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:36.858641 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-732abba7-e415-4a42-a54d-76d5a8509a33 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1528 microversion: 2.1 time: 0.248889 Jul 19 22:28:36.859379 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 432/827] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:36 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1528 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:36.864070 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8f59f60d-9baa-4b22-b72a-f9037abcbd64 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:36.866124 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8f59f60d-9baa-4b22-b72a-f9037abcbd64 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:36.876681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f59f60d-9baa-4b22-b72a-f9037abcbd64 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:36.878198 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f59f60d-9baa-4b22-b72a-f9037abcbd64 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:36.880040 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f59f60d-9baa-4b22-b72a-f9037abcbd64 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:36.881214 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f59f60d-9baa-4b22-b72a-f9037abcbd64 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:36.954117 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=4 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:36.986379 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=32 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:37.159028 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8f59f60d-9baa-4b22-b72a-f9037abcbd64 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:37.182150 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8f59f60d-9baa-4b22-b72a-f9037abcbd64 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1360 microversion: 2.1 time: 0.321435 Jul 19 22:28:37.183958 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 433/828] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:36 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1360 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:37.203558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-28aa7f16-37a0-4698-8856-95672aca2996 req-4999b123-8c3c-4080-bdb0-afd1a9be8b5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab", "tag": "896237d9-1570-436b-8b3f-65f168fd8555"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:37.230997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-28aa7f16-37a0-4698-8856-95672aca2996 req-4999b123-8c3c-4080-bdb0-afd1a9be8b5e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:37.240296 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-28aa7f16-37a0-4698-8856-95672aca2996 req-4999b123-8c3c-4080-bdb0-afd1a9be8b5e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:37.284888 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-28aa7f16-37a0-4698-8856-95672aca2996 req-4999b123-8c3c-4080-bdb0-afd1a9be8b5e service nova] Creating event network-changed:896237d9-1570-436b-8b3f-65f168fd8555 for instance b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab on n-h2-847009-3 Jul 19 22:28:37.307802 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-28aa7f16-37a0-4698-8856-95672aca2996 req-4999b123-8c3c-4080-bdb0-afd1a9be8b5e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118161 Jul 19 22:28:37.315446 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 434/829] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:37.344997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-218e1239-cb0f-4f20-bcd6-6c8fd608a4a1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:37.346593 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-218e1239-cb0f-4f20-bcd6-6c8fd608a4a1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:37.366772 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-218e1239-cb0f-4f20-bcd6-6c8fd608a4a1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:37.367572 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-218e1239-cb0f-4f20-bcd6-6c8fd608a4a1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:37.368922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-218e1239-cb0f-4f20-bcd6-6c8fd608a4a1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:37.369669 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-218e1239-cb0f-4f20-bcd6-6c8fd608a4a1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:37.684703 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-218e1239-cb0f-4f20-bcd6-6c8fd608a4a1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:37.699853 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-218e1239-cb0f-4f20-bcd6-6c8fd608a4a1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1528 microversion: 2.1 time: 0.381842 Jul 19 22:28:37.701548 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 435/830] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:37 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1528 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:37.708540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7d5f7615-0857-48b3-b4c8-b68b0801d5a0 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:37.709331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7d5f7615-0857-48b3-b4c8-b68b0801d5a0 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] [instance: 30cffef5-6254-4e63-b322-dcbbb4812bcb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:37.716740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d5f7615-0857-48b3-b4c8-b68b0801d5a0 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:37.717406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d5f7615-0857-48b3-b4c8-b68b0801d5a0 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:37.718418 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d5f7615-0857-48b3-b4c8-b68b0801d5a0 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:37.718967 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d5f7615-0857-48b3-b4c8-b68b0801d5a0 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:37.797694 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=5 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:37.965919 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7d5f7615-0857-48b3-b4c8-b68b0801d5a0 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95538027b9ea43dd877a396003416933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad9b6d4ffc446bbe411c040b4aef80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:38.005707 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7d5f7615-0857-48b3-b4c8-b68b0801d5a0 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] 10.222.0.25 "GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb" status: 200 len: 1322 microversion: 2.1 time: 0.302353 Jul 19 22:28:38.018626 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 436/831] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:37 2022] GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:38.026315 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dc7a0e72-7058-43b8-ad27-df92f78fdaf0 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:38.027051 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dc7a0e72-7058-43b8-ad27-df92f78fdaf0 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 7a5c8094-ecd0-4423-bbfd-43d136f1f443] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:38.039420 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dc7a0e72-7058-43b8-ad27-df92f78fdaf0 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:38.040059 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dc7a0e72-7058-43b8-ad27-df92f78fdaf0 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:38.040935 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dc7a0e72-7058-43b8-ad27-df92f78fdaf0 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:38.041504 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dc7a0e72-7058-43b8-ad27-df92f78fdaf0 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:38.259415 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dc7a0e72-7058-43b8-ad27-df92f78fdaf0 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:38.280655 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dc7a0e72-7058-43b8-ad27-df92f78fdaf0 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443" status: 200 len: 1319 microversion: 2.1 time: 0.270329 Jul 19 22:28:38.301521 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 437/832] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:38 2022] GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443 => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:38.478875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-da232982-4e76-4172-8825-5e1aaa731f71 tempest-FlavorMetadataValidation-948911389 tempest-FlavorMetadataValidation-948911389-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1317747840", "id": 1961214136, "os-flavor-access:is_public": "True"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:38.480645 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:28:38.480645 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:28:38.516515 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-da232982-4e76-4172-8825-5e1aaa731f71 tempest-FlavorMetadataValidation-948911389 tempest-FlavorMetadataValidation-948911389-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.219171 Jul 19 22:28:38.525894 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 438/833] 10.222.0.25 () {62 vars in 1187 bytes} [Tue Jul 19 22:28:38 2022] POST /compute/v2.1/flavors => generated 471 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:28:38.539985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-58ad25ba-c139-470e-ad6f-f1860b5fa2ea tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:38.541867 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-58ad25ba-c139-470e-ad6f-f1860b5fa2ea tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:38.555473 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58ad25ba-c139-470e-ad6f-f1860b5fa2ea tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:38.557146 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58ad25ba-c139-470e-ad6f-f1860b5fa2ea tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:38.558540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58ad25ba-c139-470e-ad6f-f1860b5fa2ea tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:38.559408 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58ad25ba-c139-470e-ad6f-f1860b5fa2ea tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:38.898773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-58ad25ba-c139-470e-ad6f-f1860b5fa2ea tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:38.901670 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:38.916574 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-58ad25ba-c139-470e-ad6f-f1860b5fa2ea tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1308 microversion: 2.1 time: 0.387841 Jul 19 22:28:38.917190 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 439/834] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:38 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1308 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:38.928072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5824d46d-a0ad-423e-94a2-d4a6312e5d64 tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:38.928926 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:28:38.928926 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:28:38.953380 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5824d46d-a0ad-423e-94a2-d4a6312e5d64 tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/41955a04-02ae-48d8-a418-8fe76c81baed" status: 202 len: 0 microversion: 2.1 time: 0.031574 Jul 19 22:28:38.954381 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 440/835] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:28:38 2022] DELETE /compute/v2.1/flavors/41955a04-02ae-48d8-a418-8fe76c81baed => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:28:38.962752 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1bc48168-c448-4a65-af7e-a777b8f92828 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:38.963709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1bc48168-c448-4a65-af7e-a777b8f92828 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:38.992960 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1bc48168-c448-4a65-af7e-a777b8f92828 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:38.993582 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1bc48168-c448-4a65-af7e-a777b8f92828 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:38.994961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1bc48168-c448-4a65-af7e-a777b8f92828 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:38.995743 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1bc48168-c448-4a65-af7e-a777b8f92828 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:39.264374 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1bc48168-c448-4a65-af7e-a777b8f92828 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:39.274811 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1bc48168-c448-4a65-af7e-a777b8f92828 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1360 microversion: 2.1 time: 0.318894 Jul 19 22:28:39.277108 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 441/836] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:38 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1360 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:39.285502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-89ab21b7-2e01-4250-8dd9-50f8295ca923 tempest-FlavorMetadataValidation-948911389 tempest-FlavorMetadataValidation-948911389-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:39.287220 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:28:39.287220 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:28:39.480589 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-89ab21b7-2e01-4250-8dd9-50f8295ca923 tempest-FlavorMetadataValidation-948911389 tempest-FlavorMetadataValidation-948911389-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1961214136/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.201793 Jul 19 22:28:39.486589 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 442/837] 10.222.0.25 () {62 vars in 1264 bytes} [Tue Jul 19 22:28:39 2022] POST /compute/v2.1/flavors/1961214136/os-extra_specs => generated 62 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:39.488236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9bfed989-6457-47f5-b4da-8640972f8987 tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:39.510590 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9bfed989-6457-47f5-b4da-8640972f8987 tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5413 microversion: 2.1 time: 0.027113 Jul 19 22:28:39.522261 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 443/838] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:28:39 2022] GET /compute/v2.1/flavors/detail => generated 5413 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:39.522261 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5034c69c-cca0-42fd-afc2-3fdbc1b5e746 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:39.522261 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5034c69c-cca0-42fd-afc2-3fdbc1b5e746 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] [instance: 30cffef5-6254-4e63-b322-dcbbb4812bcb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:39.531094 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5034c69c-cca0-42fd-afc2-3fdbc1b5e746 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:39.531712 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5034c69c-cca0-42fd-afc2-3fdbc1b5e746 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:39.532780 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5034c69c-cca0-42fd-afc2-3fdbc1b5e746 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:39.533516 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5034c69c-cca0-42fd-afc2-3fdbc1b5e746 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:39.723438 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5034c69c-cca0-42fd-afc2-3fdbc1b5e746 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95538027b9ea43dd877a396003416933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad9b6d4ffc446bbe411c040b4aef80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:39.736575 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5034c69c-cca0-42fd-afc2-3fdbc1b5e746 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] 10.222.0.25 "GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb" status: 200 len: 1322 microversion: 2.1 time: 0.222988 Jul 19 22:28:39.745665 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 444/839] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:39 2022] GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:39.753924 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a94329b6-8eb0-4a01-860a-38dc65c446c9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:39.754561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a94329b6-8eb0-4a01-860a-38dc65c446c9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 7a5c8094-ecd0-4423-bbfd-43d136f1f443] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:39.769115 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a94329b6-8eb0-4a01-860a-38dc65c446c9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:39.769578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a94329b6-8eb0-4a01-860a-38dc65c446c9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:39.770383 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a94329b6-8eb0-4a01-860a-38dc65c446c9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:39.771379 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a94329b6-8eb0-4a01-860a-38dc65c446c9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:40.003936 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a94329b6-8eb0-4a01-860a-38dc65c446c9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:40.012872 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a94329b6-8eb0-4a01-860a-38dc65c446c9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443" status: 200 len: 1319 microversion: 2.1 time: 0.273636 Jul 19 22:28:40.023547 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 445/840] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:39 2022] GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443 => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:40.029490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-873e1d00-b56b-4330-95e6-49d793d8604b req-17dcddeb-713d-44d1-b068-b16d6de1400c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30cffef5-6254-4e63-b322-dcbbb4812bcb", "tag": "197dafce-8f4a-48f2-8028-c1e0cabd851f"}, {"name": "network-changed", "server_uuid": "fab0a3d6-8249-4058-9ce5-90d458fff59d", "tag": "7078c457-b7f7-49a3-bb53-e2a5e49cc511"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:40.037202 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9,nova_api:DELETE=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:40.039846 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-873e1d00-b56b-4330-95e6-49d793d8604b req-17dcddeb-713d-44d1-b068-b16d6de1400c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:40.040293 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-873e1d00-b56b-4330-95e6-49d793d8604b req-17dcddeb-713d-44d1-b068-b16d6de1400c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:40.066313 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-873e1d00-b56b-4330-95e6-49d793d8604b req-17dcddeb-713d-44d1-b068-b16d6de1400c service nova] Creating event network-changed:197dafce-8f4a-48f2-8028-c1e0cabd851f for instance 30cffef5-6254-4e63-b322-dcbbb4812bcb on n-h2-847009-3 Jul 19 22:28:40.068311 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-873e1d00-b56b-4330-95e6-49d793d8604b req-17dcddeb-713d-44d1-b068-b16d6de1400c service nova] Creating event network-changed:7078c457-b7f7-49a3-bb53-e2a5e49cc511 for instance fab0a3d6-8249-4058-9ce5-90d458fff59d on n-h2-847009-3 Jul 19 22:28:40.076114 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-873e1d00-b56b-4330-95e6-49d793d8604b req-17dcddeb-713d-44d1-b068-b16d6de1400c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.050383 Jul 19 22:28:40.077092 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 446/841] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:40.082981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7760b538-75f8-4ea9-bcd1-dcfeff44c51a tempest-FlavorMetadataValidation-948911389 tempest-FlavorMetadataValidation-948911389-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:40.084400 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:28:40.084400 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:28:40.133167 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7760b538-75f8-4ea9-bcd1-dcfeff44c51a tempest-FlavorMetadataValidation-948911389 tempest-FlavorMetadataValidation-948911389-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1961214136" status: 202 len: 0 microversion: 2.86 time: 0.054353 Jul 19 22:28:40.133764 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 447/842] 10.222.0.25 () {60 vars in 1201 bytes} [Tue Jul 19 22:28:40 2022] DELETE /compute/v2.1/flavors/1961214136 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:28:40.155053 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4932e51c-43a5-43e0-9995-c3d4cedf1852 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:40.156328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4932e51c-43a5-43e0-9995-c3d4cedf1852 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:40.177551 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4932e51c-43a5-43e0-9995-c3d4cedf1852 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:40.178716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4932e51c-43a5-43e0-9995-c3d4cedf1852 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:40.181271 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4932e51c-43a5-43e0-9995-c3d4cedf1852 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:40.182062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4932e51c-43a5-43e0-9995-c3d4cedf1852 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:40.353852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4932e51c-43a5-43e0-9995-c3d4cedf1852 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:40.361369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4932e51c-43a5-43e0-9995-c3d4cedf1852 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Old instance type tempest-test_resize_flavor_-1374020207, new instance type m1.heat {{(pid=119337) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 22:28:40.378125 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4932e51c-43a5-43e0-9995-c3d4cedf1852 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:28:40.378555 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4932e51c-43a5-43e0-9995-c3d4cedf1852 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:28:40.379037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4932e51c-43a5-43e0-9995-c3d4cedf1852 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:28:40.379488 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4932e51c-43a5-43e0-9995-c3d4cedf1852 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:28:40.379906 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4932e51c-43a5-43e0-9995-c3d4cedf1852 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:28:40.612989 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4932e51c-43a5-43e0-9995-c3d4cedf1852 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "POST /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e/action" status: 202 len: 0 microversion: 2.1 time: 0.471841 Jul 19 22:28:40.613995 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 448/843] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:28:40 2022] POST /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:28:40.622753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-35c91c1b-52b7-4206-bfe3-325540bde5d0 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:40.623922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-35c91c1b-52b7-4206-bfe3-325540bde5d0 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:40.636902 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-35c91c1b-52b7-4206-bfe3-325540bde5d0 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:40.638613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-35c91c1b-52b7-4206-bfe3-325540bde5d0 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:40.640277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-35c91c1b-52b7-4206-bfe3-325540bde5d0 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:40.641205 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-35c91c1b-52b7-4206-bfe3-325540bde5d0 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:40.745391 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fbd292df-6ba3-4ce0-bb6c-96b8c71ee4a9 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2/action" status: 202 len: 0 microversion: 2.25 time: 5.890487 Jul 19 22:28:40.747307 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 396/844] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Jul 19 22:28:34 2022] POST /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2/action => generated 0 bytes in 5893 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:28:40.753714 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5d9d07c1-e5da-4b8d-b0ad-0dd45fee3318 tempest-FlavorMetadataValidation-948911389 tempest-FlavorMetadataValidation-948911389-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:40.802883 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5d9d07c1-e5da-4b8d-b0ad-0dd45fee3318 tempest-FlavorMetadataValidation-948911389 tempest-FlavorMetadataValidation-948911389-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.053756 Jul 19 22:28:40.806081 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 397/845] 10.222.0.25 () {60 vars in 1186 bytes} [Tue Jul 19 22:28:40 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:40.814217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f4fc4296-22a1-4274-928e-d16573171b12 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:40.814842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f4fc4296-22a1-4274-928e-d16573171b12 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:40.864186 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4fc4296-22a1-4274-928e-d16573171b12 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:40.864931 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4fc4296-22a1-4274-928e-d16573171b12 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:40.866273 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4fc4296-22a1-4274-928e-d16573171b12 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:40.871668 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4fc4296-22a1-4274-928e-d16573171b12 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:41.082073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-35c91c1b-52b7-4206-bfe3-325540bde5d0 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:41.101776 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-35c91c1b-52b7-4206-bfe3-325540bde5d0 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1308 microversion: 2.1 time: 0.485244 Jul 19 22:28:41.107820 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 449/846] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:40 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1308 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:41.127138 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eb77c96c-e0c1-4c74-8998-5b94ef3721f0 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:41.129942 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eb77c96c-e0c1-4c74-8998-5b94ef3721f0 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:41.147636 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb77c96c-e0c1-4c74-8998-5b94ef3721f0 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:41.149142 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb77c96c-e0c1-4c74-8998-5b94ef3721f0 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:41.152643 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb77c96c-e0c1-4c74-8998-5b94ef3721f0 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:41.153501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb77c96c-e0c1-4c74-8998-5b94ef3721f0 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:41.392873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f4fc4296-22a1-4274-928e-d16573171b12 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:41.403364 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f4fc4296-22a1-4274-928e-d16573171b12 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1360 microversion: 2.1 time: 0.595838 Jul 19 22:28:41.406570 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 398/847] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:40 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1360 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:41.435367 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-12d51759-0101-4e3d-baf8-921fe30c64f1 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:41.436223 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-12d51759-0101-4e3d-baf8-921fe30c64f1 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] [instance: 30cffef5-6254-4e63-b322-dcbbb4812bcb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:41.441846 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-eb77c96c-e0c1-4c74-8998-5b94ef3721f0 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:41.452196 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eb77c96c-e0c1-4c74-8998-5b94ef3721f0 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1537 microversion: 2.1 time: 0.342508 Jul 19 22:28:41.462839 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-12d51759-0101-4e3d-baf8-921fe30c64f1 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:41.463212 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 450/848] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:41 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1537 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:41.463612 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-12d51759-0101-4e3d-baf8-921fe30c64f1 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:41.469487 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b73a8c17-4934-441a-8b7b-2fe239d3e8f4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:41.470205 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b73a8c17-4934-441a-8b7b-2fe239d3e8f4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:41.474759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-12d51759-0101-4e3d-baf8-921fe30c64f1 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:41.475698 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-12d51759-0101-4e3d-baf8-921fe30c64f1 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:41.483540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b73a8c17-4934-441a-8b7b-2fe239d3e8f4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:41.484501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b73a8c17-4934-441a-8b7b-2fe239d3e8f4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:41.485708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b73a8c17-4934-441a-8b7b-2fe239d3e8f4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:41.486458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b73a8c17-4934-441a-8b7b-2fe239d3e8f4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:41.877145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-12d51759-0101-4e3d-baf8-921fe30c64f1 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95538027b9ea43dd877a396003416933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad9b6d4ffc446bbe411c040b4aef80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:41.880666 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b73a8c17-4934-441a-8b7b-2fe239d3e8f4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:41.890514 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-12d51759-0101-4e3d-baf8-921fe30c64f1 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] 10.222.0.25 "GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb" status: 200 len: 1322 microversion: 2.1 time: 0.463076 Jul 19 22:28:41.892226 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b73a8c17-4934-441a-8b7b-2fe239d3e8f4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:41.901538 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 399/849] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:41 2022] GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb => generated 1322 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:41.901538 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-60792ed9-74f3-4cb2-b243-2b263c59d1a6 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:41.901538 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-60792ed9-74f3-4cb2-b243-2b263c59d1a6 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 7a5c8094-ecd0-4423-bbfd-43d136f1f443] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:41.906608 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b73a8c17-4934-441a-8b7b-2fe239d3e8f4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:41.908068 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b73a8c17-4934-441a-8b7b-2fe239d3e8f4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 200 len: 1568 microversion: 2.25 time: 0.443801 Jul 19 22:28:41.908857 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 451/850] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:41 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 1568 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:41.932127 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-60792ed9-74f3-4cb2-b243-2b263c59d1a6 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:41.932565 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-60792ed9-74f3-4cb2-b243-2b263c59d1a6 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:41.936262 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-60792ed9-74f3-4cb2-b243-2b263c59d1a6 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:41.937025 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-60792ed9-74f3-4cb2-b243-2b263c59d1a6 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:42.130490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-14c11463-42f5-402a-bc59-3054a2aa4661 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:42.132050 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-14c11463-42f5-402a-bc59-3054a2aa4661 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:42.143251 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14c11463-42f5-402a-bc59-3054a2aa4661 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:42.143953 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14c11463-42f5-402a-bc59-3054a2aa4661 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:42.145047 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14c11463-42f5-402a-bc59-3054a2aa4661 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:42.145868 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14c11463-42f5-402a-bc59-3054a2aa4661 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:42.196230 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-60792ed9-74f3-4cb2-b243-2b263c59d1a6 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:42.205376 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-60792ed9-74f3-4cb2-b243-2b263c59d1a6 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443" status: 200 len: 1319 microversion: 2.1 time: 0.310644 Jul 19 22:28:42.215429 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 400/851] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:41 2022] GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443 => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:42.393152 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-14c11463-42f5-402a-bc59-3054a2aa4661 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:42.406401 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-14c11463-42f5-402a-bc59-3054a2aa4661 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1308 microversion: 2.1 time: 0.285585 Jul 19 22:28:42.407830 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 452/852] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:42 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1308 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:42.428013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c4a6f16a-1e95-45c0-b2f6-55191b52af1d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:42.429177 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c4a6f16a-1e95-45c0-b2f6-55191b52af1d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:42.438669 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4a6f16a-1e95-45c0-b2f6-55191b52af1d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:42.439704 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4a6f16a-1e95-45c0-b2f6-55191b52af1d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:42.440894 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4a6f16a-1e95-45c0-b2f6-55191b52af1d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:42.441637 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4a6f16a-1e95-45c0-b2f6-55191b52af1d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:42.483539 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-61dca0ce-78d9-447c-97f9-e83dd4520508 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:42.483985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-61dca0ce-78d9-447c-97f9-e83dd4520508 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:42.502189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61dca0ce-78d9-447c-97f9-e83dd4520508 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:42.502668 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61dca0ce-78d9-447c-97f9-e83dd4520508 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:42.509566 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61dca0ce-78d9-447c-97f9-e83dd4520508 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:42.510189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61dca0ce-78d9-447c-97f9-e83dd4520508 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:42.771679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c4a6f16a-1e95-45c0-b2f6-55191b52af1d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:42.782421 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c4a6f16a-1e95-45c0-b2f6-55191b52af1d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1360 microversion: 2.1 time: 0.359299 Jul 19 22:28:42.799321 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 401/853] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:42 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1360 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:42.819511 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-61dca0ce-78d9-447c-97f9-e83dd4520508 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:42.831461 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-61dca0ce-78d9-447c-97f9-e83dd4520508 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1537 microversion: 2.1 time: 0.359638 Jul 19 22:28:42.832272 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 453/854] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:42 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1537 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:42.911817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ffd44354-0046-40ff-b41b-baf24818082c tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:42.912443 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ffd44354-0046-40ff-b41b-baf24818082c tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] [instance: 30cffef5-6254-4e63-b322-dcbbb4812bcb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:42.920381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ffd44354-0046-40ff-b41b-baf24818082c tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:42.920841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ffd44354-0046-40ff-b41b-baf24818082c tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:42.921636 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ffd44354-0046-40ff-b41b-baf24818082c tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:42.922079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ffd44354-0046-40ff-b41b-baf24818082c tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:42.931296 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-df6a0366-2726-4bfa-a56c-5cde10928e19 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:42.931296 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-df6a0366-2726-4bfa-a56c-5cde10928e19 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:42.939381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-df6a0366-2726-4bfa-a56c-5cde10928e19 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:42.939977 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-df6a0366-2726-4bfa-a56c-5cde10928e19 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:42.940763 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-df6a0366-2726-4bfa-a56c-5cde10928e19 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:42.941357 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-df6a0366-2726-4bfa-a56c-5cde10928e19 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:43.041683 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=10 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:43.245887 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-df6a0366-2726-4bfa-a56c-5cde10928e19 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:43.253705 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ffd44354-0046-40ff-b41b-baf24818082c tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95538027b9ea43dd877a396003416933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad9b6d4ffc446bbe411c040b4aef80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:43.259249 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-df6a0366-2726-4bfa-a56c-5cde10928e19 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:43.261157 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-df6a0366-2726-4bfa-a56c-5cde10928e19 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:43.261646 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ffd44354-0046-40ff-b41b-baf24818082c tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] 10.222.0.25 "GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb" status: 200 len: 1322 microversion: 2.1 time: 0.355022 Jul 19 22:28:43.263477 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 402/855] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:42 2022] GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb => generated 1322 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:43.268925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9c308dfe-fc65-4380-a47a-ca249d0e8a5b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:43.269770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9c308dfe-fc65-4380-a47a-ca249d0e8a5b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 7a5c8094-ecd0-4423-bbfd-43d136f1f443] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:43.275058 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-df6a0366-2726-4bfa-a56c-5cde10928e19 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 200 len: 1568 microversion: 2.25 time: 0.337421 Jul 19 22:28:43.276070 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 454/856] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:42 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 1568 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:43.284256 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9c308dfe-fc65-4380-a47a-ca249d0e8a5b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:43.285022 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9c308dfe-fc65-4380-a47a-ca249d0e8a5b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:43.287240 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9c308dfe-fc65-4380-a47a-ca249d0e8a5b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:43.288120 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9c308dfe-fc65-4380-a47a-ca249d0e8a5b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:43.430319 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-883a3c3d-d91c-4ed6-bff1-a9541161c487 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:43.431058 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-883a3c3d-d91c-4ed6-bff1-a9541161c487 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:43.446368 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-883a3c3d-d91c-4ed6-bff1-a9541161c487 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:43.447567 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-883a3c3d-d91c-4ed6-bff1-a9541161c487 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:43.450011 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-883a3c3d-d91c-4ed6-bff1-a9541161c487 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:43.452263 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-883a3c3d-d91c-4ed6-bff1-a9541161c487 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:43.537978 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9c308dfe-fc65-4380-a47a-ca249d0e8a5b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:43.553562 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9c308dfe-fc65-4380-a47a-ca249d0e8a5b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443" status: 200 len: 1319 microversion: 2.1 time: 0.288409 Jul 19 22:28:43.554156 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 403/857] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:43 2022] GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443 => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:43.770338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-883a3c3d-d91c-4ed6-bff1-a9541161c487 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:43.793580 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-883a3c3d-d91c-4ed6-bff1-a9541161c487 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1308 microversion: 2.1 time: 0.370003 Jul 19 22:28:43.800020 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 455/858] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:43 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1308 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:43.801361 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d0c78a40-f418-4854-b38f-d7e3dfa9ed0e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:43.802143 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d0c78a40-f418-4854-b38f-d7e3dfa9ed0e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:43.810859 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d0c78a40-f418-4854-b38f-d7e3dfa9ed0e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:43.814161 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d0c78a40-f418-4854-b38f-d7e3dfa9ed0e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:43.816443 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d0c78a40-f418-4854-b38f-d7e3dfa9ed0e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:43.816914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d0c78a40-f418-4854-b38f-d7e3dfa9ed0e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:43.849522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5801c160-5c1e-4154-bcff-c1f30d612183 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:43.850850 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5801c160-5c1e-4154-bcff-c1f30d612183 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:43.862251 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5801c160-5c1e-4154-bcff-c1f30d612183 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:43.862716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5801c160-5c1e-4154-bcff-c1f30d612183 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:43.863548 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5801c160-5c1e-4154-bcff-c1f30d612183 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:43.863989 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5801c160-5c1e-4154-bcff-c1f30d612183 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:44.314771 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5801c160-5c1e-4154-bcff-c1f30d612183 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:44.324280 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5801c160-5c1e-4154-bcff-c1f30d612183 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1537 microversion: 2.1 time: 0.478609 Jul 19 22:28:44.328085 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 456/859] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:43 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1537 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:44.339659 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-40bec3d9-2cf7-4788-a3ee-7a7c30875691 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:44.343779 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-40bec3d9-2cf7-4788-a3ee-7a7c30875691 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] [instance: 30cffef5-6254-4e63-b322-dcbbb4812bcb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:44.367609 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-40bec3d9-2cf7-4788-a3ee-7a7c30875691 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:44.368354 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-40bec3d9-2cf7-4788-a3ee-7a7c30875691 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:44.369373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-40bec3d9-2cf7-4788-a3ee-7a7c30875691 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:44.369895 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-40bec3d9-2cf7-4788-a3ee-7a7c30875691 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:44.484095 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d0c78a40-f418-4854-b38f-d7e3dfa9ed0e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:44.495886 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d0c78a40-f418-4854-b38f-d7e3dfa9ed0e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1360 microversion: 2.1 time: 0.699392 Jul 19 22:28:44.497041 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 404/860] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:43 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1360 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:28:44.502633 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fa316b79-ab8b-4e3f-8e24-5fa564ca2b2f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:44.503294 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fa316b79-ab8b-4e3f-8e24-5fa564ca2b2f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:44.526850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa316b79-ab8b-4e3f-8e24-5fa564ca2b2f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:44.534991 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa316b79-ab8b-4e3f-8e24-5fa564ca2b2f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:44.536079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa316b79-ab8b-4e3f-8e24-5fa564ca2b2f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:44.536538 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa316b79-ab8b-4e3f-8e24-5fa564ca2b2f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:44.937917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-40bec3d9-2cf7-4788-a3ee-7a7c30875691 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95538027b9ea43dd877a396003416933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad9b6d4ffc446bbe411c040b4aef80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:44.953433 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-40bec3d9-2cf7-4788-a3ee-7a7c30875691 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] 10.222.0.25 "GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb" status: 200 len: 1322 microversion: 2.1 time: 0.617743 Jul 19 22:28:44.954410 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 457/861] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:44 2022] GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb => generated 1322 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:44.966831 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-8c972e6e-b6f0-470d-ac9d-f90432cb2c05 req-2632c561-abb3-4eeb-8b57-4028b0ee5d58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5c8094-ecd0-4423-bbfd-43d136f1f443", "name": "network-vif-plugged", "status": "completed", "tag": "fdcfb6b1-ce54-4c4c-9b5f-fd0ab666672e"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:44.984444 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-8c972e6e-b6f0-470d-ac9d-f90432cb2c05 req-2632c561-abb3-4eeb-8b57-4028b0ee5d58 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:44.987206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-8c972e6e-b6f0-470d-ac9d-f90432cb2c05 req-2632c561-abb3-4eeb-8b57-4028b0ee5d58 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:45.018560 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-8c972e6e-b6f0-470d-ac9d-f90432cb2c05 req-2632c561-abb3-4eeb-8b57-4028b0ee5d58 service nova] Creating event network-vif-plugged:fdcfb6b1-ce54-4c4c-9b5f-fd0ab666672e for instance 7a5c8094-ecd0-4423-bbfd-43d136f1f443 on n-h1-847009-3 Jul 19 22:28:45.025864 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-8c972e6e-b6f0-470d-ac9d-f90432cb2c05 req-2632c561-abb3-4eeb-8b57-4028b0ee5d58 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070049 Jul 19 22:28:45.027195 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 458/862] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:45.034834 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6c5e310c-c485-4ecf-85fc-cd9043bf90ed tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:45.036950 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6c5e310c-c485-4ecf-85fc-cd9043bf90ed tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 7a5c8094-ecd0-4423-bbfd-43d136f1f443] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:45.048160 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6c5e310c-c485-4ecf-85fc-cd9043bf90ed tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:45.049310 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6c5e310c-c485-4ecf-85fc-cd9043bf90ed tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:45.050565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6c5e310c-c485-4ecf-85fc-cd9043bf90ed tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:45.051281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6c5e310c-c485-4ecf-85fc-cd9043bf90ed tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:45.066505 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fa316b79-ab8b-4e3f-8e24-5fa564ca2b2f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:45.080872 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fa316b79-ab8b-4e3f-8e24-5fa564ca2b2f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:45.082980 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fa316b79-ab8b-4e3f-8e24-5fa564ca2b2f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:45.084712 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fa316b79-ab8b-4e3f-8e24-5fa564ca2b2f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 200 len: 1568 microversion: 2.25 time: 0.586138 Jul 19 22:28:45.088695 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 405/863] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:44 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 1568 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:45.104706 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ebaa019a-34d4-4848-afcc-c157e19667a3 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:45.107283 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ebaa019a-34d4-4848-afcc-c157e19667a3 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:45.126373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ebaa019a-34d4-4848-afcc-c157e19667a3 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:45.127096 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ebaa019a-34d4-4848-afcc-c157e19667a3 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:45.128752 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ebaa019a-34d4-4848-afcc-c157e19667a3 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:45.129513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ebaa019a-34d4-4848-afcc-c157e19667a3 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:45.159031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:45.457967 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6c5e310c-c485-4ecf-85fc-cd9043bf90ed tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:45.473703 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6c5e310c-c485-4ecf-85fc-cd9043bf90ed tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443" status: 200 len: 1319 microversion: 2.1 time: 0.444955 Jul 19 22:28:45.478362 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 459/864] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:45 2022] GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443 => generated 1319 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:45.507707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e02ca62e-0b44-4472-967e-468414af4b15 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:45.510218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e02ca62e-0b44-4472-967e-468414af4b15 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:45.536090 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e02ca62e-0b44-4472-967e-468414af4b15 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:45.536547 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e02ca62e-0b44-4472-967e-468414af4b15 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:45.541629 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e02ca62e-0b44-4472-967e-468414af4b15 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:45.542243 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e02ca62e-0b44-4472-967e-468414af4b15 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:45.591999 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:45.662908 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ebaa019a-34d4-4848-afcc-c157e19667a3 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:45.672746 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ebaa019a-34d4-4848-afcc-c157e19667a3 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1308 microversion: 2.1 time: 0.582487 Jul 19 22:28:45.676989 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 406/865] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:45 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1308 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:45.689860 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d277ab6b-9859-403c-929d-4e11cf23b344 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:45.695021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d277ab6b-9859-403c-929d-4e11cf23b344 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:45.720730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d277ab6b-9859-403c-929d-4e11cf23b344 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:45.721182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d277ab6b-9859-403c-929d-4e11cf23b344 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:45.722247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d277ab6b-9859-403c-929d-4e11cf23b344 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:45.723276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d277ab6b-9859-403c-929d-4e11cf23b344 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:45.921829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e02ca62e-0b44-4472-967e-468414af4b15 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:45.934407 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e02ca62e-0b44-4472-967e-468414af4b15 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1542 microversion: 2.1 time: 0.452403 Jul 19 22:28:45.935937 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 460/866] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:45 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1542 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:45.983771 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eacaaf02-68c5-42d3-9fcb-3fd53ab8550b tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:45.984606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eacaaf02-68c5-42d3-9fcb-3fd53ab8550b tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] [instance: 30cffef5-6254-4e63-b322-dcbbb4812bcb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:45.991193 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d277ab6b-9859-403c-929d-4e11cf23b344 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:45.992244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eacaaf02-68c5-42d3-9fcb-3fd53ab8550b tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:45.992715 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eacaaf02-68c5-42d3-9fcb-3fd53ab8550b tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:45.993701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eacaaf02-68c5-42d3-9fcb-3fd53ab8550b tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:45.994406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eacaaf02-68c5-42d3-9fcb-3fd53ab8550b tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:46.003914 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d277ab6b-9859-403c-929d-4e11cf23b344 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1360 microversion: 2.1 time: 0.324014 Jul 19 22:28:46.013148 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 407/867] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:45 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1360 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:46.220802 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-eacaaf02-68c5-42d3-9fcb-3fd53ab8550b tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95538027b9ea43dd877a396003416933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad9b6d4ffc446bbe411c040b4aef80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:46.237594 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eacaaf02-68c5-42d3-9fcb-3fd53ab8550b tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] 10.222.0.25 "GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb" status: 200 len: 1322 microversion: 2.1 time: 0.266850 Jul 19 22:28:46.238676 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 461/868] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:45 2022] GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:46.242576 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-47317ed6-a9d2-4c3f-b00c-1cf3cce3feb9 tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] Calling method '.version_select at 0x7f7a10a1d5e0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:46.243580 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:28:46.243580 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:28:46.244822 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-47317ed6-a9d2-4c3f-b00c-1cf3cce3feb9 tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:46.245356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-47317ed6-a9d2-4c3f-b00c-1cf3cce3feb9 tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:46.246576 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7fbdf525-fe6f-4277-b18b-8c20a299c1dd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:46.249100 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7fbdf525-fe6f-4277-b18b-8c20a299c1dd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:46.260380 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7fbdf525-fe6f-4277-b18b-8c20a299c1dd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:46.261220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7fbdf525-fe6f-4277-b18b-8c20a299c1dd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:46.262338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7fbdf525-fe6f-4277-b18b-8c20a299c1dd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:46.264353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7fbdf525-fe6f-4277-b18b-8c20a299c1dd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:46.273048 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-47317ed6-a9d2-4c3f-b00c-1cf3cce3feb9 tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:46.273586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-47317ed6-a9d2-4c3f-b00c-1cf3cce3feb9 tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:46.290815 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-47317ed6-a9d2-4c3f-b00c-1cf3cce3feb9 tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:46.291459 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-47317ed6-a9d2-4c3f-b00c-1cf3cce3feb9 tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:46.300386 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-47317ed6-a9d2-4c3f-b00c-1cf3cce3feb9 tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.294068 Jul 19 22:28:46.302069 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 408/869] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:28:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:46.315925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cfd451a0-94f5-42a8-8db2-a5bac8f7a370 tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] Calling method '.version_select at 0x7f7a10828040>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:46.316974 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:28:46.316974 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:28:46.318370 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cfd451a0-94f5-42a8-8db2-a5bac8f7a370 tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:46.318985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cfd451a0-94f5-42a8-8db2-a5bac8f7a370 tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:46.339601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cfd451a0-94f5-42a8-8db2-a5bac8f7a370 tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:46.340056 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cfd451a0-94f5-42a8-8db2-a5bac8f7a370 tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:46.391664 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cfd451a0-94f5-42a8-8db2-a5bac8f7a370 tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:46.393061 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cfd451a0-94f5-42a8-8db2-a5bac8f7a370 tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:46.400729 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cfd451a0-94f5-42a8-8db2-a5bac8f7a370 tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h2-847009-3/servers" status: 200 len: 749 microversion: 2.1 time: 0.089165 Jul 19 22:28:46.401676 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 409/870] 10.222.0.25 () {58 vars in 1211 bytes} [Tue Jul 19 22:28:46 2022] GET /compute/v2.1/os-hypervisors/n-h2-847009-3/servers => generated 749 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:28:46.415654 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6fb5ae23-502e-4a51-8793-b3590e9914f8 tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] Calling method '.version_select at 0x7f7a1073baf0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:46.417349 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:28:46.417349 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:28:46.419949 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6fb5ae23-502e-4a51-8793-b3590e9914f8 tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:46.420807 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6fb5ae23-502e-4a51-8793-b3590e9914f8 tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:46.448239 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6fb5ae23-502e-4a51-8793-b3590e9914f8 tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:46.449347 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6fb5ae23-502e-4a51-8793-b3590e9914f8 tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:46.452634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7fbdf525-fe6f-4277-b18b-8c20a299c1dd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:46.464212 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6fb5ae23-502e-4a51-8793-b3590e9914f8 tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:46.464929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6fb5ae23-502e-4a51-8793-b3590e9914f8 tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:46.473981 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6fb5ae23-502e-4a51-8793-b3590e9914f8 tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.064047 Jul 19 22:28:46.474980 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 410/871] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:28:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:46.475280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7fbdf525-fe6f-4277-b18b-8c20a299c1dd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:46.478669 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7fbdf525-fe6f-4277-b18b-8c20a299c1dd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:46.480648 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7fbdf525-fe6f-4277-b18b-8c20a299c1dd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 200 len: 1568 microversion: 2.25 time: 0.240837 Jul 19 22:28:46.482727 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 462/872] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:46 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:46.491489 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-96ea1c14-dbd0-4e95-812f-3b1a520aa9aa tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] Calling method '.version_select at 0x7f7a10828820>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:46.500316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ba978710-cd59-479c-a3df-24a0dd71cbdc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:46.500653 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:28:46.500653 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:28:46.502162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ba978710-cd59-479c-a3df-24a0dd71cbdc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 7a5c8094-ecd0-4423-bbfd-43d136f1f443] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:46.502353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96ea1c14-dbd0-4e95-812f-3b1a520aa9aa tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:46.502717 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96ea1c14-dbd0-4e95-812f-3b1a520aa9aa tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:46.516562 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba978710-cd59-479c-a3df-24a0dd71cbdc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:46.517265 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba978710-cd59-479c-a3df-24a0dd71cbdc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:46.518241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba978710-cd59-479c-a3df-24a0dd71cbdc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:46.518946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba978710-cd59-479c-a3df-24a0dd71cbdc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:46.529853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96ea1c14-dbd0-4e95-812f-3b1a520aa9aa tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:46.530528 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96ea1c14-dbd0-4e95-812f-3b1a520aa9aa tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:46.543500 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-96ea1c14-dbd0-4e95-812f-3b1a520aa9aa tempest-HypervisorAdminUnderV252Test-1561804334 tempest-HypervisorAdminUnderV252Test-1561804334-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h2-847009-3/search" status: 200 len: 104 microversion: 2.1 time: 0.062472 Jul 19 22:28:46.546149 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 411/873] 10.222.0.25 () {58 vars in 1208 bytes} [Tue Jul 19 22:28:46 2022] GET /compute/v2.1/os-hypervisors/n-h2-847009-3/search => generated 104 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:46.696200 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-85f54659-51a3-4f0c-9060-dd50b8dadeef tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:46.697164 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-85f54659-51a3-4f0c-9060-dd50b8dadeef tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:46.712050 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ba978710-cd59-479c-a3df-24a0dd71cbdc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:46.719010 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85f54659-51a3-4f0c-9060-dd50b8dadeef tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:46.720767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85f54659-51a3-4f0c-9060-dd50b8dadeef tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:46.722786 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85f54659-51a3-4f0c-9060-dd50b8dadeef tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:46.723809 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85f54659-51a3-4f0c-9060-dd50b8dadeef tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:46.725054 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ba978710-cd59-479c-a3df-24a0dd71cbdc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443" status: 200 len: 1319 microversion: 2.1 time: 0.231402 Jul 19 22:28:46.726533 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 463/874] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:46 2022] GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:46.746201 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-27c80b1f-2dc5-439b-86ea-bf76a0e0ee05 req-b476b7c7-62ca-4048-83d2-f855e49b5c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef1f3571-2f57-4f5b-b607-16d82d41d8d2", "name": "network-vif-unplugged", "status": "completed", "tag": "01a778f9-5da2-424c-9cea-9f854afa416c"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:46.761439 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-27c80b1f-2dc5-439b-86ea-bf76a0e0ee05 req-b476b7c7-62ca-4048-83d2-f855e49b5c91 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:46.762233 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-27c80b1f-2dc5-439b-86ea-bf76a0e0ee05 req-b476b7c7-62ca-4048-83d2-f855e49b5c91 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:46.785544 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-27c80b1f-2dc5-439b-86ea-bf76a0e0ee05 req-b476b7c7-62ca-4048-83d2-f855e49b5c91 service nova] Creating event network-vif-unplugged:01a778f9-5da2-424c-9cea-9f854afa416c for instance ef1f3571-2f57-4f5b-b607-16d82d41d8d2 on n-h2-847009-3 Jul 19 22:28:46.794953 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-27c80b1f-2dc5-439b-86ea-bf76a0e0ee05 req-b476b7c7-62ca-4048-83d2-f855e49b5c91 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053563 Jul 19 22:28:46.797382 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 464/875] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:28:46.954421 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a8ad556f-2688-4785-9a41-cb0350d4efad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:46.955172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a8ad556f-2688-4785-9a41-cb0350d4efad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:46.963254 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a8ad556f-2688-4785-9a41-cb0350d4efad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:46.963709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a8ad556f-2688-4785-9a41-cb0350d4efad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:46.964488 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a8ad556f-2688-4785-9a41-cb0350d4efad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:46.964934 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a8ad556f-2688-4785-9a41-cb0350d4efad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:47.051636 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-85f54659-51a3-4f0c-9060-dd50b8dadeef tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:47.063177 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-85f54659-51a3-4f0c-9060-dd50b8dadeef tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1308 microversion: 2.1 time: 0.371898 Jul 19 22:28:47.066797 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 412/876] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:46 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1308 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:47.080828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-451e5d73-6542-4cbe-97bb-43ebb0aad716 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:47.081571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-451e5d73-6542-4cbe-97bb-43ebb0aad716 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:47.089551 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-451e5d73-6542-4cbe-97bb-43ebb0aad716 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:47.090112 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-451e5d73-6542-4cbe-97bb-43ebb0aad716 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:47.091544 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-451e5d73-6542-4cbe-97bb-43ebb0aad716 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:47.092086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-451e5d73-6542-4cbe-97bb-43ebb0aad716 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:47.331018 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a8ad556f-2688-4785-9a41-cb0350d4efad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:47.340437 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a8ad556f-2688-4785-9a41-cb0350d4efad tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1542 microversion: 2.1 time: 0.391381 Jul 19 22:28:47.343728 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 465/877] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:46 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1542 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:47.366515 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-00f77a05-1f50-4ede-8321-a73cacdac8a1 req-b4357e47-1937-4748-851d-608892e6f50f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab", "name": "network-vif-plugged", "status": "completed", "tag": "896237d9-1570-436b-8b3f-65f168fd8555"}, {"server_uuid": "2df991c2-a91f-4de1-96a1-8c36ae7ce9be", "name": "network-vif-plugged", "status": "completed", "tag": "0292746c-2df0-4aad-a561-ebf4daa4f8d7"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:47.394941 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-00f77a05-1f50-4ede-8321-a73cacdac8a1 req-b4357e47-1937-4748-851d-608892e6f50f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:47.396670 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-00f77a05-1f50-4ede-8321-a73cacdac8a1 req-b4357e47-1937-4748-851d-608892e6f50f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:47.430883 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-00f77a05-1f50-4ede-8321-a73cacdac8a1 req-b4357e47-1937-4748-851d-608892e6f50f service nova] Creating event network-vif-plugged:896237d9-1570-436b-8b3f-65f168fd8555 for instance b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab on n-h2-847009-3 Jul 19 22:28:47.433244 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-00f77a05-1f50-4ede-8321-a73cacdac8a1 req-b4357e47-1937-4748-851d-608892e6f50f service nova] Creating event network-vif-plugged:0292746c-2df0-4aad-a561-ebf4daa4f8d7 for instance 2df991c2-a91f-4de1-96a1-8c36ae7ce9be on n-h1-847009-3 Jul 19 22:28:47.457825 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-00f77a05-1f50-4ede-8321-a73cacdac8a1 req-b4357e47-1937-4748-851d-608892e6f50f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.109781 Jul 19 22:28:47.458756 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 466/878] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:47.472475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-517c792d-05a7-447c-ae63-904f1864e924 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:47.473421 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-517c792d-05a7-447c-ae63-904f1864e924 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] [instance: 30cffef5-6254-4e63-b322-dcbbb4812bcb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:47.492415 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-517c792d-05a7-447c-ae63-904f1864e924 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:47.493136 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-517c792d-05a7-447c-ae63-904f1864e924 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:47.494092 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-517c792d-05a7-447c-ae63-904f1864e924 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:47.494675 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-517c792d-05a7-447c-ae63-904f1864e924 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:47.752175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-451e5d73-6542-4cbe-97bb-43ebb0aad716 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:47.796070 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-451e5d73-6542-4cbe-97bb-43ebb0aad716 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1360 microversion: 2.1 time: 0.727034 Jul 19 22:28:47.797267 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 413/879] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:47 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1360 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:47.823511 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-26d50089-554d-459b-b36d-c95a9397e89c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:47.828524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-26d50089-554d-459b-b36d-c95a9397e89c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:47.846307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-26d50089-554d-459b-b36d-c95a9397e89c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:47.847002 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-26d50089-554d-459b-b36d-c95a9397e89c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:47.848066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-26d50089-554d-459b-b36d-c95a9397e89c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:47.850755 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-26d50089-554d-459b-b36d-c95a9397e89c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:48.329175 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-517c792d-05a7-447c-ae63-904f1864e924 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95538027b9ea43dd877a396003416933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad9b6d4ffc446bbe411c040b4aef80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:48.364200 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-517c792d-05a7-447c-ae63-904f1864e924 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] 10.222.0.25 "GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb" status: 200 len: 1322 microversion: 2.1 time: 0.901029 Jul 19 22:28:48.366547 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 467/880] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:47 2022] GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb => generated 1322 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:48.376925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-28921edd-c763-45c5-92fd-755843553451 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:48.378135 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-28921edd-c763-45c5-92fd-755843553451 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 7a5c8094-ecd0-4423-bbfd-43d136f1f443] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:48.385954 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28921edd-c763-45c5-92fd-755843553451 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:48.387165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28921edd-c763-45c5-92fd-755843553451 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:48.388727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28921edd-c763-45c5-92fd-755843553451 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:48.388964 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28921edd-c763-45c5-92fd-755843553451 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:48.601560 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-26d50089-554d-459b-b36d-c95a9397e89c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:48.619602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-26d50089-554d-459b-b36d-c95a9397e89c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:48.629638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-26d50089-554d-459b-b36d-c95a9397e89c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:48.631870 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-26d50089-554d-459b-b36d-c95a9397e89c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 200 len: 1568 microversion: 2.25 time: 0.832489 Jul 19 22:28:48.636626 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 414/881] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:47 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 1568 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:48.652607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-acef1191-528d-407c-b289-89962829832d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:48.654657 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-acef1191-528d-407c-b289-89962829832d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:48.665444 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-acef1191-528d-407c-b289-89962829832d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:48.666174 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-acef1191-528d-407c-b289-89962829832d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:48.667494 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-acef1191-528d-407c-b289-89962829832d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:48.668515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-acef1191-528d-407c-b289-89962829832d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:48.873125 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-28921edd-c763-45c5-92fd-755843553451 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:48.907246 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-28921edd-c763-45c5-92fd-755843553451 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443" status: 200 len: 1469 microversion: 2.1 time: 0.537911 Jul 19 22:28:48.908841 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 468/882] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:48 2022] GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443 => generated 1469 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:48.916610 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d5273a7f-20ee-4e4f-b338-bbbf97bbcf8f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:48.917754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d5273a7f-20ee-4e4f-b338-bbbf97bbcf8f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:48.931561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5273a7f-20ee-4e4f-b338-bbbf97bbcf8f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:48.932571 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5273a7f-20ee-4e4f-b338-bbbf97bbcf8f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:48.934087 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5273a7f-20ee-4e4f-b338-bbbf97bbcf8f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:48.935917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5273a7f-20ee-4e4f-b338-bbbf97bbcf8f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:49.022309 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-acef1191-528d-407c-b289-89962829832d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:49.041042 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-acef1191-528d-407c-b289-89962829832d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1308 microversion: 2.1 time: 0.404660 Jul 19 22:28:49.043421 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 415/883] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:48 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1308 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:49.053741 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f8a1701f-8f5b-4a81-b306-5bba19a3c191 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:49.055824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f8a1701f-8f5b-4a81-b306-5bba19a3c191 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:49.082503 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8a1701f-8f5b-4a81-b306-5bba19a3c191 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:49.083496 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8a1701f-8f5b-4a81-b306-5bba19a3c191 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:49.085052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8a1701f-8f5b-4a81-b306-5bba19a3c191 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:49.085950 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8a1701f-8f5b-4a81-b306-5bba19a3c191 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:49.316876 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d5273a7f-20ee-4e4f-b338-bbbf97bbcf8f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:49.327881 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d5273a7f-20ee-4e4f-b338-bbbf97bbcf8f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1542 microversion: 2.1 time: 0.417378 Jul 19 22:28:49.338485 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 469/884] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:48 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1542 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:49.344913 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-9bfaa0b3-6d83-4b04-9d54-2b0e4d0645bd req-7e0a50d7-5761-432e-a9b9-dc175771bfca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef1f3571-2f57-4f5b-b607-16d82d41d8d2", "tag": "01a778f9-5da2-424c-9cea-9f854afa416c"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:49.354134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-9bfaa0b3-6d83-4b04-9d54-2b0e4d0645bd req-7e0a50d7-5761-432e-a9b9-dc175771bfca service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:49.354679 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-9bfaa0b3-6d83-4b04-9d54-2b0e4d0645bd req-7e0a50d7-5761-432e-a9b9-dc175771bfca service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:49.368721 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-9bfaa0b3-6d83-4b04-9d54-2b0e4d0645bd req-7e0a50d7-5761-432e-a9b9-dc175771bfca service nova] Creating event network-changed:01a778f9-5da2-424c-9cea-9f854afa416c for instance ef1f3571-2f57-4f5b-b607-16d82d41d8d2 on n-h2-847009-3 Jul 19 22:28:49.372515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f8a1701f-8f5b-4a81-b306-5bba19a3c191 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:49.375618 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-9bfaa0b3-6d83-4b04-9d54-2b0e4d0645bd req-7e0a50d7-5761-432e-a9b9-dc175771bfca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035211 Jul 19 22:28:49.376430 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 470/885] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:49.383025 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5680127a-ccad-49a0-83f2-0fa03f6649dc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:49.384011 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5680127a-ccad-49a0-83f2-0fa03f6649dc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 2df991c2-a91f-4de1-96a1-8c36ae7ce9be] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:49.391537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5680127a-ccad-49a0-83f2-0fa03f6649dc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:49.392010 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5680127a-ccad-49a0-83f2-0fa03f6649dc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:49.392902 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5680127a-ccad-49a0-83f2-0fa03f6649dc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:49.393073 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f8a1701f-8f5b-4a81-b306-5bba19a3c191 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1360 microversion: 2.1 time: 0.347111 Jul 19 22:28:49.393247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5680127a-ccad-49a0-83f2-0fa03f6649dc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:49.394177 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 416/886] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:49 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1360 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:49.415309 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2cb1fe8e-218b-480f-a2a4-7f5f47101505 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:49.416819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2cb1fe8e-218b-480f-a2a4-7f5f47101505 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] [instance: 30cffef5-6254-4e63-b322-dcbbb4812bcb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:49.430651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2cb1fe8e-218b-480f-a2a4-7f5f47101505 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:49.431367 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2cb1fe8e-218b-480f-a2a4-7f5f47101505 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:49.432209 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2cb1fe8e-218b-480f-a2a4-7f5f47101505 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:49.433287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2cb1fe8e-218b-480f-a2a4-7f5f47101505 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:49.708648 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2cb1fe8e-218b-480f-a2a4-7f5f47101505 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95538027b9ea43dd877a396003416933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad9b6d4ffc446bbe411c040b4aef80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:49.715332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5680127a-ccad-49a0-83f2-0fa03f6649dc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:49.732050 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5680127a-ccad-49a0-83f2-0fa03f6649dc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/2df991c2-a91f-4de1-96a1-8c36ae7ce9be" status: 200 len: 1319 microversion: 2.1 time: 0.353441 Jul 19 22:28:49.739570 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2cb1fe8e-218b-480f-a2a4-7f5f47101505 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] 10.222.0.25 "GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb" status: 200 len: 1322 microversion: 2.1 time: 0.331833 Jul 19 22:28:49.740181 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 417/887] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:49 2022] GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb => generated 1322 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:49.744704 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 471/888] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:49 2022] GET /compute/v2.1/servers/2df991c2-a91f-4de1-96a1-8c36ae7ce9be => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:49.750038 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-faca9ba8-0c5c-409b-8458-80d00420d729 req-8529bf45-9ed5-414b-b075-42dc5584864d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab0a3d6-8249-4058-9ce5-90d458fff59d", "name": "network-vif-plugged", "status": "completed", "tag": "7078c457-b7f7-49a3-bb53-e2a5e49cc511"}, {"server_uuid": "30cffef5-6254-4e63-b322-dcbbb4812bcb", "name": "network-vif-plugged", "status": "completed", "tag": "197dafce-8f4a-48f2-8028-c1e0cabd851f"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:49.750671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-67db7585-4175-4563-b258-716161248ed0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:49.751387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-67db7585-4175-4563-b258-716161248ed0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:49.758133 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67db7585-4175-4563-b258-716161248ed0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:49.758557 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67db7585-4175-4563-b258-716161248ed0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:49.759621 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67db7585-4175-4563-b258-716161248ed0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:49.760064 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67db7585-4175-4563-b258-716161248ed0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:49.761941 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-faca9ba8-0c5c-409b-8458-80d00420d729 req-8529bf45-9ed5-414b-b075-42dc5584864d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:49.762898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-faca9ba8-0c5c-409b-8458-80d00420d729 req-8529bf45-9ed5-414b-b075-42dc5584864d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:49.777097 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-faca9ba8-0c5c-409b-8458-80d00420d729 req-8529bf45-9ed5-414b-b075-42dc5584864d service nova] Creating event network-vif-plugged:7078c457-b7f7-49a3-bb53-e2a5e49cc511 for instance fab0a3d6-8249-4058-9ce5-90d458fff59d on n-h2-847009-3 Jul 19 22:28:49.777611 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-faca9ba8-0c5c-409b-8458-80d00420d729 req-8529bf45-9ed5-414b-b075-42dc5584864d service nova] Creating event network-vif-plugged:197dafce-8f4a-48f2-8028-c1e0cabd851f for instance 30cffef5-6254-4e63-b322-dcbbb4812bcb on n-h2-847009-3 Jul 19 22:28:49.785909 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-faca9ba8-0c5c-409b-8458-80d00420d729 req-8529bf45-9ed5-414b-b075-42dc5584864d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044132 Jul 19 22:28:49.786904 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 418/889] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:50.016063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-67db7585-4175-4563-b258-716161248ed0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:50.029443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-67db7585-4175-4563-b258-716161248ed0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:50.031019 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-67db7585-4175-4563-b258-716161248ed0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:50.032481 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-67db7585-4175-4563-b258-716161248ed0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 200 len: 1568 microversion: 2.25 time: 0.286380 Jul 19 22:28:50.034631 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 472/890] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:49 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 1568 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:50.071311 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-20f0907d-a043-4662-8ad4-9357ee5e27fe tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:50.072062 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-20f0907d-a043-4662-8ad4-9357ee5e27fe tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:50.084046 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-20f0907d-a043-4662-8ad4-9357ee5e27fe tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:50.084555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-20f0907d-a043-4662-8ad4-9357ee5e27fe tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:50.085602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-20f0907d-a043-4662-8ad4-9357ee5e27fe tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:50.086384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-20f0907d-a043-4662-8ad4-9357ee5e27fe tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:50.250538 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-20f0907d-a043-4662-8ad4-9357ee5e27fe tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:50.258830 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-20f0907d-a043-4662-8ad4-9357ee5e27fe tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1308 microversion: 2.1 time: 0.192602 Jul 19 22:28:50.259807 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 419/891] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:50 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1308 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:50.346541 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6dc7a7be-599e-44ef-9eb9-7462d7065cc2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:50.347212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6dc7a7be-599e-44ef-9eb9-7462d7065cc2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:50.354239 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6dc7a7be-599e-44ef-9eb9-7462d7065cc2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:50.354701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6dc7a7be-599e-44ef-9eb9-7462d7065cc2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:50.355794 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6dc7a7be-599e-44ef-9eb9-7462d7065cc2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:50.356811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6dc7a7be-599e-44ef-9eb9-7462d7065cc2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:50.413401 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b93fa7fb-fb98-4047-bc98-8eb05d2c7cc0 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:50.414553 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b93fa7fb-fb98-4047-bc98-8eb05d2c7cc0 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:50.422514 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b93fa7fb-fb98-4047-bc98-8eb05d2c7cc0 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:50.422927 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b93fa7fb-fb98-4047-bc98-8eb05d2c7cc0 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:50.424087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b93fa7fb-fb98-4047-bc98-8eb05d2c7cc0 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:50.424560 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b93fa7fb-fb98-4047-bc98-8eb05d2c7cc0 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:50.579551 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6dc7a7be-599e-44ef-9eb9-7462d7065cc2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:50.592879 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6dc7a7be-599e-44ef-9eb9-7462d7065cc2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1542 microversion: 2.1 time: 0.251329 Jul 19 22:28:50.594128 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 473/892] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:50 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1542 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:50.623531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b93fa7fb-fb98-4047-bc98-8eb05d2c7cc0 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:50.631162 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b93fa7fb-fb98-4047-bc98-8eb05d2c7cc0 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1360 microversion: 2.1 time: 0.222340 Jul 19 22:28:50.631763 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 420/893] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:50 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1360 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:50.753787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4080833a-6097-4ab3-b2c4-e857decac7e1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:50.754412 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4080833a-6097-4ab3-b2c4-e857decac7e1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 2df991c2-a91f-4de1-96a1-8c36ae7ce9be] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:50.763783 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dec4922d-f9cb-4930-b484-33a30b99c7e8 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:50.764409 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dec4922d-f9cb-4930-b484-33a30b99c7e8 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] [instance: 30cffef5-6254-4e63-b322-dcbbb4812bcb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:50.771332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4080833a-6097-4ab3-b2c4-e857decac7e1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:50.771784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4080833a-6097-4ab3-b2c4-e857decac7e1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:50.772533 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dec4922d-f9cb-4930-b484-33a30b99c7e8 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:50.772745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4080833a-6097-4ab3-b2c4-e857decac7e1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:50.773117 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dec4922d-f9cb-4930-b484-33a30b99c7e8 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:50.773347 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4080833a-6097-4ab3-b2c4-e857decac7e1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:50.774028 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dec4922d-f9cb-4930-b484-33a30b99c7e8 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:50.774794 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dec4922d-f9cb-4930-b484-33a30b99c7e8 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:51.134256 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dec4922d-f9cb-4930-b484-33a30b99c7e8 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95538027b9ea43dd877a396003416933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad9b6d4ffc446bbe411c040b4aef80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:51.143780 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4080833a-6097-4ab3-b2c4-e857decac7e1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:51.144111 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dec4922d-f9cb-4930-b484-33a30b99c7e8 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] 10.222.0.25 "GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb" status: 200 len: 1322 microversion: 2.1 time: 0.385136 Jul 19 22:28:51.144611 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 421/894] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:50 2022] GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb => generated 1322 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:51.150265 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-62f2ac5f-aea4-4356-b9c6-3c3eae363766 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:51.151374 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-62f2ac5f-aea4-4356-b9c6-3c3eae363766 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:51.159304 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4080833a-6097-4ab3-b2c4-e857decac7e1 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/2df991c2-a91f-4de1-96a1-8c36ae7ce9be" status: 200 len: 1469 microversion: 2.1 time: 0.409800 Jul 19 22:28:51.164307 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 474/895] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:50 2022] GET /compute/v2.1/servers/2df991c2-a91f-4de1-96a1-8c36ae7ce9be => generated 1469 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:51.165817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62f2ac5f-aea4-4356-b9c6-3c3eae363766 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:51.166941 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62f2ac5f-aea4-4356-b9c6-3c3eae363766 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:51.167911 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62f2ac5f-aea4-4356-b9c6-3c3eae363766 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:51.168299 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62f2ac5f-aea4-4356-b9c6-3c3eae363766 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:51.187141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-724731cf-d78a-4bde-8314-54a9d08226f9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:51.191774 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-724731cf-d78a-4bde-8314-54a9d08226f9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:51.193219 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-724731cf-d78a-4bde-8314-54a9d08226f9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Searching by: {'reservation_id': 'r-78pb82c0', 'deleted': False, 'project_id': '791e176b6751415ca1472c109b3ce011'} {{(pid=119337) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:28:51.204626 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-724731cf-d78a-4bde-8314-54a9d08226f9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:51.205540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-724731cf-d78a-4bde-8314-54a9d08226f9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:51.206456 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-724731cf-d78a-4bde-8314-54a9d08226f9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:51.207497 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-724731cf-d78a-4bde-8314-54a9d08226f9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:51.397049 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-62f2ac5f-aea4-4356-b9c6-3c3eae363766 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:51.407358 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-62f2ac5f-aea4-4356-b9c6-3c3eae363766 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:51.409785 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-62f2ac5f-aea4-4356-b9c6-3c3eae363766 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:51.411841 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-62f2ac5f-aea4-4356-b9c6-3c3eae363766 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 200 len: 1568 microversion: 2.25 time: 0.265668 Jul 19 22:28:51.412863 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 422/896] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:51 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 1568 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:51.444350 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b3f22731-9007-4938-9860-0e0d947bc4cd tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:51.445627 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b3f22731-9007-4938-9860-0e0d947bc4cd tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:51.459023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b3f22731-9007-4938-9860-0e0d947bc4cd tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:51.460610 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b3f22731-9007-4938-9860-0e0d947bc4cd tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:51.462379 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b3f22731-9007-4938-9860-0e0d947bc4cd tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:51.463308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b3f22731-9007-4938-9860-0e0d947bc4cd tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:51.467584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.multi_cell_list [None req-724731cf-d78a-4bde-8314-54a9d08226f9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119337) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:28:51.738655 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-724731cf-d78a-4bde-8314-54a9d08226f9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:51.756111 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-724731cf-d78a-4bde-8314-54a9d08226f9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:51.756577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-724731cf-d78a-4bde-8314-54a9d08226f9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:51.804734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b3f22731-9007-4938-9860-0e0d947bc4cd tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:51.809282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:51.820245 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b3f22731-9007-4938-9860-0e0d947bc4cd tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1308 microversion: 2.1 time: 0.404643 Jul 19 22:28:51.829949 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 423/897] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:51 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1308 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:51.841191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-738fd663-41ff-4642-afee-684b27f18a1d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:51.852531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-738fd663-41ff-4642-afee-684b27f18a1d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:51.879780 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-738fd663-41ff-4642-afee-684b27f18a1d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:51.880862 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-738fd663-41ff-4642-afee-684b27f18a1d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:51.884537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-738fd663-41ff-4642-afee-684b27f18a1d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:51.887478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-738fd663-41ff-4642-afee-684b27f18a1d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:51.993485 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-724731cf-d78a-4bde-8314-54a9d08226f9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?reservation_id=r-78pb82c0" status: 200 len: 2931 microversion: 2.1 time: 0.810322 Jul 19 22:28:51.994487 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 475/898] 10.222.0.25 () {58 vars in 1196 bytes} [Tue Jul 19 22:28:51 2022] GET /compute/v2.1/servers/detail?reservation_id=r-78pb82c0 => generated 2931 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:28:52.000914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c2bf547f-e2de-42c1-aa31-6fb4af9f6e12 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:52.001594 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c2bf547f-e2de-42c1-aa31-6fb4af9f6e12 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:52.023595 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c2bf547f-e2de-42c1-aa31-6fb4af9f6e12 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:52.024072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c2bf547f-e2de-42c1-aa31-6fb4af9f6e12 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:52.024852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c2bf547f-e2de-42c1-aa31-6fb4af9f6e12 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:52.025295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c2bf547f-e2de-42c1-aa31-6fb4af9f6e12 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:52.262169 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-738fd663-41ff-4642-afee-684b27f18a1d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:52.278521 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-738fd663-41ff-4642-afee-684b27f18a1d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1542 microversion: 2.1 time: 0.445898 Jul 19 22:28:52.299150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c2bf547f-e2de-42c1-aa31-6fb4af9f6e12 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:52.300248 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 424/899] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:51 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1542 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:52.300451 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c2bf547f-e2de-42c1-aa31-6fb4af9f6e12 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1360 microversion: 2.1 time: 0.304237 Jul 19 22:28:52.301194 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 476/900] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:51 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1360 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:52.306361 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-61888233-f008-4b3b-bcde-70e4009a6f27 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:52.369303 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.compute.server_groups [None req-61888233-f008-4b3b-bcde-70e4009a6f27 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Querying cell c9ec50c5-1e53-4d76-a6eb-599548551fc7(cell1) for 2 instances {{(pid=119337) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 19 22:28:52.370123 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61888233-f008-4b3b-bcde-70e4009a6f27 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:52.370568 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61888233-f008-4b3b-bcde-70e4009a6f27 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:52.411329 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-61888233-f008-4b3b-bcde-70e4009a6f27 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/cd67c25a-4da8-4c0b-9e4e-8e7b07cc4a71" status: 200 len: 265 microversion: 2.1 time: 0.108892 Jul 19 22:28:52.412239 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 477/901] 10.222.0.25 () {58 vars in 1262 bytes} [Tue Jul 19 22:28:52 2022] GET /compute/v2.1/os-server-groups/cd67c25a-4da8-4c0b-9e4e-8e7b07cc4a71 => generated 265 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:52.426752 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5a0c8ad7-dbd0-448b-977a-9008da39f904 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:52.427404 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5a0c8ad7-dbd0-448b-977a-9008da39f904 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] [instance: 30cffef5-6254-4e63-b322-dcbbb4812bcb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:52.444480 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a0c8ad7-dbd0-448b-977a-9008da39f904 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:52.444939 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a0c8ad7-dbd0-448b-977a-9008da39f904 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:52.446434 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a0c8ad7-dbd0-448b-977a-9008da39f904 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:52.446875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a0c8ad7-dbd0-448b-977a-9008da39f904 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:52.567319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a0540f99-cd5c-48c7-8f25-5b72bc6e3752 tempest-KeyPairsV210TestJSON-659142807 tempest-KeyPairsV210TestJSON-659142807-project-admin] Action: 'create', calling method: .version_select at 0x7f7a109f0820>, body: {"keypair": {"name": "tempest-keypair-1357153678", "type": "ssh", "user_id": "2dc1961ee5e843f588efcdba55372406", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF65opEtChy0dAUQu7qEGGlMKcfIObuhkalKBznfhgLz8520uh/YRDRJWFadGvglpqUBzxdo6RIOg2S09ZQyR3GHs34qnVIICFxTcfC5YN+g1qbsuL4WhT70aCUL2rTQdA=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:52.586759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-a0540f99-cd5c-48c7-8f25-5b72bc6e3752 tempest-KeyPairsV210TestJSON-659142807 tempest-KeyPairsV210TestJSON-659142807-project-admin] Getting quotas for project 1cb4c27936574c4fa70636d99a6a1ac6. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:28:52.594895 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-a0540f99-cd5c-48c7-8f25-5b72bc6e3752 tempest-KeyPairsV210TestJSON-659142807 tempest-KeyPairsV210TestJSON-659142807-project-admin] Getting quotas for user 6afcbed15f374c0687e7d4b35d75f164 and project 1cb4c27936574c4fa70636d99a6a1ac6. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:28:52.643326 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a0540f99-cd5c-48c7-8f25-5b72bc6e3752 tempest-KeyPairsV210TestJSON-659142807 tempest-KeyPairsV210TestJSON-659142807-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.340199 Jul 19 22:28:52.644403 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 425/902] 10.222.0.25 () {62 vars in 1199 bytes} [Tue Jul 19 22:28:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 343 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 22:28:52.658330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dc9d2b3a-bbcd-403d-bc34-f77678dc0189 tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:52.659560 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dc9d2b3a-bbcd-403d-bc34-f77678dc0189 tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] [instance: 2df991c2-a91f-4de1-96a1-8c36ae7ce9be] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:52.670734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dc9d2b3a-bbcd-403d-bc34-f77678dc0189 tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:52.671434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dc9d2b3a-bbcd-403d-bc34-f77678dc0189 tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:52.672482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dc9d2b3a-bbcd-403d-bc34-f77678dc0189 tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:52.673035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dc9d2b3a-bbcd-403d-bc34-f77678dc0189 tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:52.775376 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5a0c8ad7-dbd0-448b-977a-9008da39f904 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95538027b9ea43dd877a396003416933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad9b6d4ffc446bbe411c040b4aef80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:52.777734 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:52.789848 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5a0c8ad7-dbd0-448b-977a-9008da39f904 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] 10.222.0.25 "GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb" status: 200 len: 1322 microversion: 2.1 time: 0.376255 Jul 19 22:28:52.790278 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 478/903] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:52 2022] GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb => generated 1322 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:52.796265 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-44417422-86d8-4494-92c3-63f13718a838 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:52.797724 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-44417422-86d8-4494-92c3-63f13718a838 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:52.805475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-44417422-86d8-4494-92c3-63f13718a838 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:52.805931 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-44417422-86d8-4494-92c3-63f13718a838 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:52.806729 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-44417422-86d8-4494-92c3-63f13718a838 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:52.807209 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-44417422-86d8-4494-92c3-63f13718a838 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:52.942511 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dc9d2b3a-bbcd-403d-bc34-f77678dc0189 tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/2df991c2-a91f-4de1-96a1-8c36ae7ce9be" status: 200 len: 1620 microversion: 2.1 time: 0.296301 Jul 19 22:28:52.943372 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 426/904] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:52 2022] GET /compute/v2.1/servers/2df991c2-a91f-4de1-96a1-8c36ae7ce9be => generated 1620 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:52.949717 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-114f70c3-8fdc-49c1-8124-0e1c8964d413 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:52.952333 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-114f70c3-8fdc-49c1-8124-0e1c8964d413 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:52.955004 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:52.964558 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-114f70c3-8fdc-49c1-8124-0e1c8964d413 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:52.965945 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-114f70c3-8fdc-49c1-8124-0e1c8964d413 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:52.968421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-114f70c3-8fdc-49c1-8124-0e1c8964d413 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:52.969043 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-114f70c3-8fdc-49c1-8124-0e1c8964d413 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:53.036103 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-114f70c3-8fdc-49c1-8124-0e1c8964d413 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090484 Jul 19 22:28:53.046672 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 427/905] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:28:52 2022] GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:53.049586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a4995cfc-8eb0-4e22-b538-3cdab5767e25 tempest-KeyPairsV210TestJSON-659142807 tempest-KeyPairsV210TestJSON-659142807-project-admin] Action: 'create', calling method: .version_select at 0x7f7a107abd30>, body: {"keypair": {"name": "tempest-keypair-1576159509", "type": "ssh", "user_id": "2dc1961ee5e843f588efcdba55372406", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXeqaQDyVKqjRMLf/flq9UGVWz95cpTtlbYYhVY0SLVJW3+8fBvDskQvlfQJWenANdlU6kFO0QzMR61fKiM1JCx6j1L5l2V/oUC4swVjK7iP1YAJxobXrGAJg+xyia1gw=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:53.083177 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-a4995cfc-8eb0-4e22-b538-3cdab5767e25 tempest-KeyPairsV210TestJSON-659142807 tempest-KeyPairsV210TestJSON-659142807-project-admin] Getting quotas for project 1cb4c27936574c4fa70636d99a6a1ac6. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:28:53.093331 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-a4995cfc-8eb0-4e22-b538-3cdab5767e25 tempest-KeyPairsV210TestJSON-659142807 tempest-KeyPairsV210TestJSON-659142807-project-admin] Getting quotas for user 6afcbed15f374c0687e7d4b35d75f164 and project 1cb4c27936574c4fa70636d99a6a1ac6. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:28:53.140104 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a4995cfc-8eb0-4e22-b538-3cdab5767e25 tempest-KeyPairsV210TestJSON-659142807 tempest-KeyPairsV210TestJSON-659142807-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.098838 Jul 19 22:28:53.148174 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 428/906] 10.222.0.25 () {62 vars in 1199 bytes} [Tue Jul 19 22:28:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 104 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 22:28:53.150666 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-58512012-691b-4f15-8dc3-c4959cb58942 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:53.151843 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-58512012-691b-4f15-8dc3-c4959cb58942 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:53.155092 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-44417422-86d8-4494-92c3-63f13718a838 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:53.165248 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58512012-691b-4f15-8dc3-c4959cb58942 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:53.166009 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58512012-691b-4f15-8dc3-c4959cb58942 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:53.167448 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58512012-691b-4f15-8dc3-c4959cb58942 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:53.168233 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58512012-691b-4f15-8dc3-c4959cb58942 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:53.174618 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-44417422-86d8-4494-92c3-63f13718a838 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:53.178074 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-44417422-86d8-4494-92c3-63f13718a838 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:53.180464 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-44417422-86d8-4494-92c3-63f13718a838 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 200 len: 1568 microversion: 2.25 time: 0.388831 Jul 19 22:28:53.182204 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 479/907] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:52 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 1568 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:53.190079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-c164f893-41d8-446c-9fca-491539139787 req-3ae6b2a1-12f9-4ef4-a384-daafbd7e9467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef1f3571-2f57-4f5b-b607-16d82d41d8d2", "name": "network-vif-unplugged", "status": "completed", "tag": "01a778f9-5da2-424c-9cea-9f854afa416c"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:53.203515 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-c164f893-41d8-446c-9fca-491539139787 req-3ae6b2a1-12f9-4ef4-a384-daafbd7e9467 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:53.204203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-c164f893-41d8-446c-9fca-491539139787 req-3ae6b2a1-12f9-4ef4-a384-daafbd7e9467 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:53.222160 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-c164f893-41d8-446c-9fca-491539139787 req-3ae6b2a1-12f9-4ef4-a384-daafbd7e9467 service nova] Creating event network-vif-unplugged:01a778f9-5da2-424c-9cea-9f854afa416c for instance ef1f3571-2f57-4f5b-b607-16d82d41d8d2 on n-h2-847009-3 Jul 19 22:28:53.233764 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-c164f893-41d8-446c-9fca-491539139787 req-3ae6b2a1-12f9-4ef4-a384-daafbd7e9467 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045672 Jul 19 22:28:53.234783 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 480/908] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:53.239797 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dd1d34be-97ca-4241-89ca-9c4a38e3fd0a tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:53.240612 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dd1d34be-97ca-4241-89ca-9c4a38e3fd0a tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] [instance: 7a5c8094-ecd0-4423-bbfd-43d136f1f443] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:53.248503 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dd1d34be-97ca-4241-89ca-9c4a38e3fd0a tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:53.249076 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dd1d34be-97ca-4241-89ca-9c4a38e3fd0a tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:53.249957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dd1d34be-97ca-4241-89ca-9c4a38e3fd0a tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:53.250454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dd1d34be-97ca-4241-89ca-9c4a38e3fd0a tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:53.678644 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-58512012-691b-4f15-8dc3-c4959cb58942 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:53.693531 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-58512012-691b-4f15-8dc3-c4959cb58942 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1489 microversion: 2.1 time: 0.549588 Jul 19 22:28:53.694648 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 429/909] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:53 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1489 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:53.722975 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dd1d34be-97ca-4241-89ca-9c4a38e3fd0a tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443" status: 200 len: 1620 microversion: 2.1 time: 0.486821 Jul 19 22:28:53.724094 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 481/910] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:53 2022] GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443 => generated 1620 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:53.730884 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-97e410ce-6a94-474d-b10e-0cba7f504d3f tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:53.731804 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-97e410ce-6a94-474d-b10e-0cba7f504d3f tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:53.731980 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d8c4f26d-8443-4d01-834f-c10e58be7f1e tempest-KeyPairsV210TestJSON-659142807 tempest-KeyPairsV210TestJSON-659142807-project-admin] Calling method '.version_select at 0x7f7a10538430>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:53.745231 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-97e410ce-6a94-474d-b10e-0cba7f504d3f tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:53.745231 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-97e410ce-6a94-474d-b10e-0cba7f504d3f tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:53.745231 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-97e410ce-6a94-474d-b10e-0cba7f504d3f tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:53.745756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-97e410ce-6a94-474d-b10e-0cba7f504d3f tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:53.746175 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d8c4f26d-8443-4d01-834f-c10e58be7f1e tempest-KeyPairsV210TestJSON-659142807 tempest-KeyPairsV210TestJSON-659142807-project-admin] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-1357153678?user_id=2dc1961ee5e843f588efcdba55372406" status: 200 len: 512 microversion: 2.10 time: 0.020253 Jul 19 22:28:53.756775 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 482/911] 10.222.0.25 () {60 vars in 1339 bytes} [Tue Jul 19 22:28:53 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1357153678?user_id=2dc1961ee5e843f588efcdba55372406 => generated 512 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:28:53.758373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3d2bc823-7bca-4dd9-88b5-26d3e625ca36 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:53.759459 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3d2bc823-7bca-4dd9-88b5-26d3e625ca36 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:53.774128 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d2bc823-7bca-4dd9-88b5-26d3e625ca36 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:53.775390 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d2bc823-7bca-4dd9-88b5-26d3e625ca36 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:53.777667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d2bc823-7bca-4dd9-88b5-26d3e625ca36 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:53.778951 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d2bc823-7bca-4dd9-88b5-26d3e625ca36 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:53.963193 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3d2bc823-7bca-4dd9-88b5-26d3e625ca36 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:53.972865 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3d2bc823-7bca-4dd9-88b5-26d3e625ca36 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1542 microversion: 2.1 time: 0.221715 Jul 19 22:28:53.973858 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 483/912] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:53 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1542 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:53.979071 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3e697008-68db-49e9-a38c-217a6ca65f71 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:53.979726 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3e697008-68db-49e9-a38c-217a6ca65f71 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:53.989371 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e697008-68db-49e9-a38c-217a6ca65f71 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:53.989371 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e697008-68db-49e9-a38c-217a6ca65f71 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:53.989371 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e697008-68db-49e9-a38c-217a6ca65f71 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:53.989371 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e697008-68db-49e9-a38c-217a6ca65f71 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:53.994229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-97e410ce-6a94-474d-b10e-0cba7f504d3f tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lazy-loading 'services' on Instance uuid 40ce1872-5f47-4acc-ba80-696b87b062b5 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:28:54.155909 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-97e410ce-6a94-474d-b10e-0cba7f504d3f tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5/os-volume_attachments/de9fa399-c5b5-4d78-baca-2f326f3343d2" status: 202 len: 0 microversion: 2.1 time: 0.458495 Jul 19 22:28:54.157004 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 430/913] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 19 22:28:53 2022] DELETE /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5/os-volume_attachments/de9fa399-c5b5-4d78-baca-2f326f3343d2 => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:28:54.167752 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-95815c08-79a7-448c-b3c5-a9d8c930fe43 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:54.181115 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-95815c08-79a7-448c-b3c5-a9d8c930fe43 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:54.181928 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-95815c08-79a7-448c-b3c5-a9d8c930fe43 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:54.206963 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3e697008-68db-49e9-a38c-217a6ca65f71 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:54.221289 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3e697008-68db-49e9-a38c-217a6ca65f71 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1360 microversion: 2.1 time: 0.245449 Jul 19 22:28:54.235720 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 484/914] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:53 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1360 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:54.244814 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3d0da162-1e89-479c-a290-99575b13c71a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Action: 'create', calling method: .version_select at 0x7f7a10543550>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-874266825", "policies": ["anti-affinity"]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:54.324806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-95815c08-79a7-448c-b3c5-a9d8c930fe43 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Going to try to stop instance {{(pid=119338) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 22:28:54.337200 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-3d0da162-1e89-479c-a290-99575b13c71a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for project 791e176b6751415ca1472c109b3ce011. Resources: {'server_groups'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:28:54.348427 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-3d0da162-1e89-479c-a290-99575b13c71a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for user bd5fb561f7bd429e8c6b2cc30ed76f13 and project 791e176b6751415ca1472c109b3ce011. Resources: {'server_groups'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:28:54.366664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:54.429985 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-95815c08-79a7-448c-b3c5-a9d8c930fe43 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "POST /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab/action" status: 202 len: 0 microversion: 2.1 time: 0.270386 Jul 19 22:28:54.431727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-3d0da162-1e89-479c-a290-99575b13c71a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for project 791e176b6751415ca1472c109b3ce011. Resources: {'server_groups'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:28:54.432555 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 431/915] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:28:54 2022] POST /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:28:54.443015 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-17c84934-fb7f-40a2-abc0-1b417ad848e2 tempest-KeyPairsV210TestJSON-659142807 tempest-KeyPairsV210TestJSON-659142807-project-admin] Action: 'create', calling method: .version_select at 0x7f7a106258b0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1441266858", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAEVr6zG5sfI4GBHa2Uc44rboFGF/qf1g5LOz9INl6IfLoaLTa+LjEUiWHaQxQtLaRtgN8AssvJKJ4efS0z/6aZcDjK7yEHCDePapJxlzagFpaC8Lkbt4ylrEn/rzNpiQ=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:54.445477 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-3d0da162-1e89-479c-a290-99575b13c71a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for user bd5fb561f7bd429e8c6b2cc30ed76f13 and project 791e176b6751415ca1472c109b3ce011. Resources: {'server_groups'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:28:54.462035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-17c84934-fb7f-40a2-abc0-1b417ad848e2 tempest-KeyPairsV210TestJSON-659142807 tempest-KeyPairsV210TestJSON-659142807-project-admin] Getting quotas for project 1cb4c27936574c4fa70636d99a6a1ac6. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:28:54.469803 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-17c84934-fb7f-40a2-abc0-1b417ad848e2 tempest-KeyPairsV210TestJSON-659142807 tempest-KeyPairsV210TestJSON-659142807-project-admin] Getting quotas for user 6afcbed15f374c0687e7d4b35d75f164 and project 1cb4c27936574c4fa70636d99a6a1ac6. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:28:54.474493 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3d0da162-1e89-479c-a290-99575b13c71a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.236432 Jul 19 22:28:54.476029 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 485/916] 10.222.0.25 () {60 vars in 1173 bytes} [Tue Jul 19 22:28:54 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:54.486843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ef373b64-88c2-4886-be00-bf899f7697f7 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:54.488404 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ef373b64-88c2-4886-be00-bf899f7697f7 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] [instance: 30cffef5-6254-4e63-b322-dcbbb4812bcb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:54.498308 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ef373b64-88c2-4886-be00-bf899f7697f7 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:54.499818 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ef373b64-88c2-4886-be00-bf899f7697f7 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:54.501470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ef373b64-88c2-4886-be00-bf899f7697f7 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:54.502496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ef373b64-88c2-4886-be00-bf899f7697f7 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:54.540719 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-17c84934-fb7f-40a2-abc0-1b417ad848e2 tempest-KeyPairsV210TestJSON-659142807 tempest-KeyPairsV210TestJSON-659142807-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.106164 Jul 19 22:28:54.547466 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 432/917] 10.222.0.25 () {62 vars in 1199 bytes} [Tue Jul 19 22:28:54 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 109 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 22:28:54.558326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b3f80d28-ebc0-4ca6-9763-39a2f40706ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:54.561334 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b3f80d28-ebc0-4ca6-9763-39a2f40706ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:54.582310 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b3f80d28-ebc0-4ca6-9763-39a2f40706ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:54.583748 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b3f80d28-ebc0-4ca6-9763-39a2f40706ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:54.585796 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b3f80d28-ebc0-4ca6-9763-39a2f40706ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:54.586726 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b3f80d28-ebc0-4ca6-9763-39a2f40706ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:54.900909 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ef373b64-88c2-4886-be00-bf899f7697f7 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95538027b9ea43dd877a396003416933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad9b6d4ffc446bbe411c040b4aef80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:54.912892 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ef373b64-88c2-4886-be00-bf899f7697f7 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] 10.222.0.25 "GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb" status: 200 len: 1472 microversion: 2.1 time: 0.434448 Jul 19 22:28:54.917514 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 486/918] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:54 2022] GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb => generated 1472 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:54.926964 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4cc33b76-6225-4181-bb3f-388316b9ec3a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:54.928736 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4cc33b76-6225-4181-bb3f-388316b9ec3a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:54.938188 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4cc33b76-6225-4181-bb3f-388316b9ec3a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:54.938972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4cc33b76-6225-4181-bb3f-388316b9ec3a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:54.940632 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4cc33b76-6225-4181-bb3f-388316b9ec3a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:54.941394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4cc33b76-6225-4181-bb3f-388316b9ec3a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:54.968541 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b3f80d28-ebc0-4ca6-9763-39a2f40706ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:54.978695 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b3f80d28-ebc0-4ca6-9763-39a2f40706ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:54.980226 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b3f80d28-ebc0-4ca6-9763-39a2f40706ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:54.981919 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b3f80d28-ebc0-4ca6-9763-39a2f40706ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 200 len: 1568 microversion: 2.25 time: 0.438179 Jul 19 22:28:54.982543 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 433/919] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:54 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 1568 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:54.986985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a4e5a06f-f118-44cc-8a2d-6dc00957851d tempest-KeyPairsV210TestJSON-659142807 tempest-KeyPairsV210TestJSON-659142807-project-admin] Calling method '.version_select at 0x7f7a10625430>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:54.989533 n-d-847009-3 devstack@n-api.service[119338]: WARNING oslo_db.sqlalchemy.utils [None req-a4e5a06f-f118-44cc-8a2d-6dc00957851d tempest-KeyPairsV210TestJSON-659142807 tempest-KeyPairsV210TestJSON-659142807-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 19 22:28:54.997591 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a4e5a06f-f118-44cc-8a2d-6dc00957851d tempest-KeyPairsV210TestJSON-659142807 tempest-KeyPairsV210TestJSON-659142807-project-admin] 10.222.0.25 "GET /compute/v2.1/os-keypairs?user_id=2dc1961ee5e843f588efcdba55372406" status: 200 len: 726 microversion: 2.10 time: 0.013931 Jul 19 22:28:54.998141 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 434/920] 10.222.0.25 () {60 vars in 1258 bytes} [Tue Jul 19 22:28:54 2022] GET /compute/v2.1/os-keypairs?user_id=2dc1961ee5e843f588efcdba55372406 => generated 726 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:28:55.002720 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-35808cce-a1e5-40b7-b422-15417b83bb57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1229431658", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "e1b7331f-8339-484a-b401-587687fab655"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:28:55.082018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-35808cce-a1e5-40b7-b422-15417b83bb57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] validate_networks() for None {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:28:55.401485 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4cc33b76-6225-4181-bb3f-388316b9ec3a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:55.416993 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4cc33b76-6225-4181-bb3f-388316b9ec3a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1499 microversion: 2.1 time: 0.497738 Jul 19 22:28:55.417631 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 487/921] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:54 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1499 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:55.425992 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-764814f0-ddff-4fb3-afef-b6e1aff34e43 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:55.426834 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-764814f0-ddff-4fb3-afef-b6e1aff34e43 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] [instance: 30cffef5-6254-4e63-b322-dcbbb4812bcb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:55.439591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-764814f0-ddff-4fb3-afef-b6e1aff34e43 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:55.442882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-764814f0-ddff-4fb3-afef-b6e1aff34e43 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:55.442882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-764814f0-ddff-4fb3-afef-b6e1aff34e43 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:55.442882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-764814f0-ddff-4fb3-afef-b6e1aff34e43 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:55.471999 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-764814f0-ddff-4fb3-afef-b6e1aff34e43 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '95538027b9ea43dd877a396003416933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad9b6d4ffc446bbe411c040b4aef80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:55.479143 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-764814f0-ddff-4fb3-afef-b6e1aff34e43 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Request method failure captured: Jul 19 22:28:55.479143 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb/diagnostics HTTP/1.1 Jul 19 22:28:55.479143 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:28:55.479143 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:28:55.479143 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:28:55.479143 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:28:55.479143 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:28:55.479143 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:28:55.479143 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:28:55.479143 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:28:55.479143 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zAGFJl-BzIETIaR3861xRMjGMU-paY62nDbrmpFAQ_DXrJPyDcsnmKpN0y45eoChzJhvpdtWr3JKmDQqsA1JTrK_2wevxCfIJwVJxgq6OOIBhKenJQS1VyU5t3yAWHedOD8YXMly9BQvS4SCrWXOfxqX94IJ_aJVGjYmpWrMAeKgU4 Jul 19 22:28:55.479143 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:28:55.479143 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:28:55.479143 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:28:55.479143 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:28:55.479143 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:28:55.479143 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:28:55.479143 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: e5ad9b6d4ffc446bbe411c040b4aef80 Jul 19 22:28:55.479143 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1147666485 Jul 19 22:28:55.479143 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:28:55.479143 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:28:55.482823 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e5ad9b6d4ffc446bbe411c040b4aef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5ad9b6d4ffc446bbe411c040b4aef80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e5ad9b6d4ffc446bbe411c040b4aef80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5ad9b6d4ffc446bbe411c040b4aef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:28:55.482823 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1147666485 Jul 19 22:28:55.482823 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: e5ad9b6d4ffc446bbe411c040b4aef80 Jul 19 22:28:55.482823 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1147666485 Jul 19 22:28:55.482823 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerDiagnosticsNegativeTest-1147666485-project Jul 19 22:28:55.482823 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:28:55.482823 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:28:55.482823 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 95538027b9ea43dd877a396003416933 Jul 19 22:28:55.482823 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1147666485-project Jul 19 22:28:55.482823 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:28:55.482823 n-d-847009-3 devstack@n-api.service[119337]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 19 22:28:55.484273 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'server_id': '30cffef5-6254-4e63-b322-dcbbb4812bcb'} Jul 19 22:28:55.484273 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:28:55.484273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:28:55.484273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:28:55.484273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:28:55.484273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:28:55.484273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:28:55.484273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:28:55.484273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:28:55.484273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 19 22:28:55.484273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 19 22:28:55.484273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:28:55.484273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:28:55.484273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:28:55.484273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:28:55.484273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:28:55.484273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:28:55.484273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:28:55.484273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:28:55.484273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:28:55.487143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:28:55.487143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:28:55.487143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:28:55.487143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:28:55.487143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:28:55.487143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 19 22:28:55.487143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:55.487143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:28:55.487143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:55.487143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:28:55.487143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:28:55.487143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:28:55.487143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:28:55.487143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:28:55.487143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 19 22:28:55.487143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:28:55.487143 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-764814f0-ddff-4fb3-afef-b6e1aff34e43 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:28:55.490932 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-764814f0-ddff-4fb3-afef-b6e1aff34e43 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] 10.222.0.25 "GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.062703 Jul 19 22:28:55.490932 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 488/922] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:28:55 2022] GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb/diagnostics => generated 117 bytes in 65 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:28:55.500545 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1194203a-ffcc-4858-9587-fd8e2ad039a7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:55.501512 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1194203a-ffcc-4858-9587-fd8e2ad039a7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:55.508375 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1194203a-ffcc-4858-9587-fd8e2ad039a7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:55.508900 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1194203a-ffcc-4858-9587-fd8e2ad039a7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:55.510014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1194203a-ffcc-4858-9587-fd8e2ad039a7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:55.510538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1194203a-ffcc-4858-9587-fd8e2ad039a7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:55.647843 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-35808cce-a1e5-40b7-b422-15417b83bb57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:28:55.648435 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-35808cce-a1e5-40b7-b422-15417b83bb57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:28:55.649097 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-35808cce-a1e5-40b7-b422-15417b83bb57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:28:55.649644 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-35808cce-a1e5-40b7-b422-15417b83bb57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:28:55.651887 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-35808cce-a1e5-40b7-b422-15417b83bb57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:28:55.675977 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35808cce-a1e5-40b7-b422-15417b83bb57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:55.676742 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35808cce-a1e5-40b7-b422-15417b83bb57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:55.678197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35808cce-a1e5-40b7-b422-15417b83bb57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:55.685704 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35808cce-a1e5-40b7-b422-15417b83bb57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:55.717312 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-35808cce-a1e5-40b7-b422-15417b83bb57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for project 791e176b6751415ca1472c109b3ce011. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:28:55.729238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-35808cce-a1e5-40b7-b422-15417b83bb57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for user bd5fb561f7bd429e8c6b2cc30ed76f13 and project 791e176b6751415ca1472c109b3ce011. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:28:55.753061 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1194203a-ffcc-4858-9587-fd8e2ad039a7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:55.768397 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-35808cce-a1e5-40b7-b422-15417b83bb57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Going to run 2 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:28:55.771077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-35808cce-a1e5-40b7-b422-15417b83bb57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: ca03e7c4-e8c2-43f5-8528-7b2a847ca718] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:28:55.779383 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1194203a-ffcc-4858-9587-fd8e2ad039a7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1542 microversion: 2.1 time: 0.285560 Jul 19 22:28:55.797004 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 489/923] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:55 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1542 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:55.813421 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4d2be4ea-0f53-4851-ab94-be8d33a7a241 tempest-KeyPairsV210TestJSON-659142807 tempest-KeyPairsV210TestJSON-659142807-project-admin] Calling method '.version_select at 0x7f7a104ef5e0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:55.838751 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4d2be4ea-0f53-4851-ab94-be8d33a7a241 tempest-KeyPairsV210TestJSON-659142807 tempest-KeyPairsV210TestJSON-659142807-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1441266858" status: 204 len: 0 microversion: 2.10 time: 0.039304 Jul 19 22:28:55.843461 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 490/924] 10.222.0.25 () {60 vars in 1324 bytes} [Tue Jul 19 22:28:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1441266858 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:28:55.846995 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-35808cce-a1e5-40b7-b422-15417b83bb57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for project 791e176b6751415ca1472c109b3ce011. Resources: {'server_group_members'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:28:55.849232 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-15ec35ec-95fb-4cc7-ad1d-3c4eada8a8ae tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:55.849967 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-15ec35ec-95fb-4cc7-ad1d-3c4eada8a8ae tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:55.855384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-35808cce-a1e5-40b7-b422-15417b83bb57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for user bd5fb561f7bd429e8c6b2cc30ed76f13 and project 791e176b6751415ca1472c109b3ce011. Resources: {'server_group_members'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:28:55.859460 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-15ec35ec-95fb-4cc7-ad1d-3c4eada8a8ae tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:55.859925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-15ec35ec-95fb-4cc7-ad1d-3c4eada8a8ae tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:55.861005 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-15ec35ec-95fb-4cc7-ad1d-3c4eada8a8ae tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:55.861270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-15ec35ec-95fb-4cc7-ad1d-3c4eada8a8ae tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:55.936176 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-35808cce-a1e5-40b7-b422-15417b83bb57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for project 791e176b6751415ca1472c109b3ce011. Resources: {'server_group_members'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:28:55.948406 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-35808cce-a1e5-40b7-b422-15417b83bb57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for user bd5fb561f7bd429e8c6b2cc30ed76f13 and project 791e176b6751415ca1472c109b3ce011. Resources: {'server_group_members'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:28:55.973323 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-35808cce-a1e5-40b7-b422-15417b83bb57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0cc94c67-92c3-491d-974d-1a40bf8757c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=ca03e7c4-e8c2-43f5-8528-7b2a847ca718,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:28:56.059738 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-35808cce-a1e5-40b7-b422-15417b83bb57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for project 791e176b6751415ca1472c109b3ce011. Resources: {'server_group_members'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:28:56.070276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-35808cce-a1e5-40b7-b422-15417b83bb57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for user bd5fb561f7bd429e8c6b2cc30ed76f13 and project 791e176b6751415ca1472c109b3ce011. Resources: {'server_group_members'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:28:56.143168 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-35808cce-a1e5-40b7-b422-15417b83bb57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for project 791e176b6751415ca1472c109b3ce011. Resources: {'server_group_members'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:28:56.147662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:56.157227 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-35808cce-a1e5-40b7-b422-15417b83bb57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for user bd5fb561f7bd429e8c6b2cc30ed76f13 and project 791e176b6751415ca1472c109b3ce011. Resources: {'server_group_members'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:28:56.216472 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-35808cce-a1e5-40b7-b422-15417b83bb57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.215967 Jul 19 22:28:56.217850 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 435/925] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:28:54 2022] POST /compute/v2.1/servers => generated 32 bytes in 1219 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 19 22:28:56.227370 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7963d620-0c7c-40e2-bd32-8888e4f8fb46 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:56.228064 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7963d620-0c7c-40e2-bd32-8888e4f8fb46 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] [instance: 30cffef5-6254-4e63-b322-dcbbb4812bcb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:56.238972 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7963d620-0c7c-40e2-bd32-8888e4f8fb46 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:56.239477 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7963d620-0c7c-40e2-bd32-8888e4f8fb46 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:56.240302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7963d620-0c7c-40e2-bd32-8888e4f8fb46 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:56.240754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7963d620-0c7c-40e2-bd32-8888e4f8fb46 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:56.285856 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7963d620-0c7c-40e2-bd32-8888e4f8fb46 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] [instance: 30cffef5-6254-4e63-b322-dcbbb4812bcb] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:28:56.330111 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-15ec35ec-95fb-4cc7-ad1d-3c4eada8a8ae tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:56.340129 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-15ec35ec-95fb-4cc7-ad1d-3c4eada8a8ae tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1544 microversion: 2.1 time: 0.498368 Jul 19 22:28:56.348438 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 491/926] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:55 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1544 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:56.364753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-319e3cf2-7bd9-400b-b077-b5fada22c3e2 tempest-KeyPairsV210TestJSON-659142807 tempest-KeyPairsV210TestJSON-659142807-project-admin] Calling method '.version_select at 0x7f7a10fa2310>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:56.424147 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-319e3cf2-7bd9-400b-b077-b5fada22c3e2 tempest-KeyPairsV210TestJSON-659142807 tempest-KeyPairsV210TestJSON-659142807-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1576159509?user_id=2dc1961ee5e843f588efcdba55372406" status: 204 len: 0 microversion: 2.10 time: 0.070510 Jul 19 22:28:56.425204 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 492/927] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 19 22:28:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1576159509?user_id=2dc1961ee5e843f588efcdba55372406 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:28:56.446805 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b0667690-1210-4d56-9f39-eee0c46ec55f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:56.456280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b0667690-1210-4d56-9f39-eee0c46ec55f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:56.471891 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b0667690-1210-4d56-9f39-eee0c46ec55f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:56.483766 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b0667690-1210-4d56-9f39-eee0c46ec55f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:56.485368 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b0667690-1210-4d56-9f39-eee0c46ec55f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:56.486694 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b0667690-1210-4d56-9f39-eee0c46ec55f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:56.566165 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7963d620-0c7c-40e2-bd32-8888e4f8fb46 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] 10.222.0.25 "DELETE /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb" status: 204 len: 0 microversion: 2.1 time: 0.343375 Jul 19 22:28:56.570716 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 436/928] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:28:56 2022] DELETE /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:28:56.579217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-34eff4c8-f1d6-442d-a842-417509e3f70c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:56.583253 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-34eff4c8-f1d6-442d-a842-417509e3f70c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:56.584022 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-34eff4c8-f1d6-442d-a842-417509e3f70c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Searching by: {'deleted': False, 'project_id': '791e176b6751415ca1472c109b3ce011'} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:28:56.628982 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-34eff4c8-f1d6-442d-a842-417509e3f70c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:56.631656 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-34eff4c8-f1d6-442d-a842-417509e3f70c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:56.632768 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-34eff4c8-f1d6-442d-a842-417509e3f70c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:56.634562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-34eff4c8-f1d6-442d-a842-417509e3f70c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:56.702936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.multi_cell_list [None req-34eff4c8-f1d6-442d-a842-417509e3f70c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=119338) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:28:56.769497 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-34eff4c8-f1d6-442d-a842-417509e3f70c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1666 microversion: 2.1 time: 0.196879 Jul 19 22:28:56.784451 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 437/929] 10.222.0.25 () {58 vars in 1124 bytes} [Tue Jul 19 22:28:56 2022] GET /compute/v2.1/servers => generated 1666 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:56.790529 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-93e803bc-3d7e-4920-9abb-8ab814ce112d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:56.795933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-93e803bc-3d7e-4920-9abb-8ab814ce112d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:56.805866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93e803bc-3d7e-4920-9abb-8ab814ce112d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:56.806678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93e803bc-3d7e-4920-9abb-8ab814ce112d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:56.808197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93e803bc-3d7e-4920-9abb-8ab814ce112d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:56.808973 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93e803bc-3d7e-4920-9abb-8ab814ce112d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:56.971589 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b0667690-1210-4d56-9f39-eee0c46ec55f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:56.996534 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b0667690-1210-4d56-9f39-eee0c46ec55f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:56.998469 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b0667690-1210-4d56-9f39-eee0c46ec55f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:56.999728 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b0667690-1210-4d56-9f39-eee0c46ec55f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 200 len: 1568 microversion: 2.25 time: 0.567530 Jul 19 22:28:57.005912 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-93e803bc-3d7e-4920-9abb-8ab814ce112d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.219853 Jul 19 22:28:57.018830 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 438/930] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 19 22:28:56 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d/os-interface => generated 285 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:28:57.020164 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 493/931] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:56 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 1568 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:57.021413 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ce7717b8-32b7-44ba-bbd9-b9a6521cacd9 tempest-KeyPairsV210TestJSON-659142807 tempest-KeyPairsV210TestJSON-659142807-project-admin] Calling method '.version_select at 0x7f7a1055b430>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:57.021709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b27a6be6-ac78-42d6-bbc5-3f261b9e7c57 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:57.021709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b27a6be6-ac78-42d6-bbc5-3f261b9e7c57 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:57.029593 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b27a6be6-ac78-42d6-bbc5-3f261b9e7c57 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:57.030037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b27a6be6-ac78-42d6-bbc5-3f261b9e7c57 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:57.031036 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b27a6be6-ac78-42d6-bbc5-3f261b9e7c57 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:57.031666 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b27a6be6-ac78-42d6-bbc5-3f261b9e7c57 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:57.089426 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ce7717b8-32b7-44ba-bbd9-b9a6521cacd9 tempest-KeyPairsV210TestJSON-659142807 tempest-KeyPairsV210TestJSON-659142807-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1357153678?user_id=2dc1961ee5e843f588efcdba55372406" status: 204 len: 0 microversion: 2.10 time: 0.080059 Jul 19 22:28:57.100407 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 439/932] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 19 22:28:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1357153678?user_id=2dc1961ee5e843f588efcdba55372406 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:28:57.117069 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-925acba5-435a-4d08-8570-052d7d723ccf tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:57.117838 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-925acba5-435a-4d08-8570-052d7d723ccf tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] [instance: 30cffef5-6254-4e63-b322-dcbbb4812bcb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:57.156788 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-925acba5-435a-4d08-8570-052d7d723ccf tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:57.157315 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-925acba5-435a-4d08-8570-052d7d723ccf tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:57.158792 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-925acba5-435a-4d08-8570-052d7d723ccf tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:57.160591 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-925acba5-435a-4d08-8570-052d7d723ccf tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:57.745906 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b27a6be6-ac78-42d6-bbc5-3f261b9e7c57 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:57.814851 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-925acba5-435a-4d08-8570-052d7d723ccf tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95538027b9ea43dd877a396003416933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad9b6d4ffc446bbe411c040b4aef80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:57.816418 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b27a6be6-ac78-42d6-bbc5-3f261b9e7c57 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1499 microversion: 2.1 time: 0.798099 Jul 19 22:28:57.820608 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 494/933] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:57 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1499 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:57.829673 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ecfd8032-aa31-4632-8168-ca44a6153aa6 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:57.830308 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ecfd8032-aa31-4632-8168-ca44a6153aa6 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0cc94c67-92c3-491d-974d-1a40bf8757c4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:57.886195 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-925acba5-435a-4d08-8570-052d7d723ccf tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] 10.222.0.25 "GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb" status: 200 len: 1478 microversion: 2.1 time: 0.784020 Jul 19 22:28:57.887497 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 440/934] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:57 2022] GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb => generated 1478 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:57.907151 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-589fa58c-ee1d-40e3-859b-9dd186029dd3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:57.920912 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-589fa58c-ee1d-40e3-859b-9dd186029dd3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:57.941458 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-589fa58c-ee1d-40e3-859b-9dd186029dd3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:57.942237 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-589fa58c-ee1d-40e3-859b-9dd186029dd3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:57.943631 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-589fa58c-ee1d-40e3-859b-9dd186029dd3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:57.944398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-589fa58c-ee1d-40e3-859b-9dd186029dd3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:58.058519 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ecfd8032-aa31-4632-8168-ca44a6153aa6 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:58.073317 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ecfd8032-aa31-4632-8168-ca44a6153aa6 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4" status: 200 len: 1219 microversion: 2.1 time: 0.247957 Jul 19 22:28:58.094554 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 495/935] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:57 2022] GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4 => generated 1219 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:58.103245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2e3162ba-0dc8-48d2-ae77-55e03d5960ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:58.104183 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2e3162ba-0dc8-48d2-ae77-55e03d5960ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:58.116026 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e3162ba-0dc8-48d2-ae77-55e03d5960ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:58.116499 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e3162ba-0dc8-48d2-ae77-55e03d5960ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:58.117353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e3162ba-0dc8-48d2-ae77-55e03d5960ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:58.117916 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e3162ba-0dc8-48d2-ae77-55e03d5960ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:58.393337 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-589fa58c-ee1d-40e3-859b-9dd186029dd3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:58.401908 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-589fa58c-ee1d-40e3-859b-9dd186029dd3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1542 microversion: 2.1 time: 0.501833 Jul 19 22:28:58.412615 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 441/936] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:57 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1542 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:58.554296 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2e3162ba-0dc8-48d2-ae77-55e03d5960ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:58.573486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2e3162ba-0dc8-48d2-ae77-55e03d5960ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:58.581462 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2e3162ba-0dc8-48d2-ae77-55e03d5960ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:58.584567 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2e3162ba-0dc8-48d2-ae77-55e03d5960ec tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 200 len: 1543 microversion: 2.25 time: 0.488226 Jul 19 22:28:58.587265 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 496/937] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:58 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 1543 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:58.629143 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a8cf016d-ddde-49ce-a40e-c21a30f60680 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Calling method '.version_select at 0x7f7a1058aa60>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:58.644260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a8cf016d-ddde-49ce-a40e-c21a30f60680 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:58.644748 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a8cf016d-ddde-49ce-a40e-c21a30f60680 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:58.683093 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a8cf016d-ddde-49ce-a40e-c21a30f60680 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 3206 microversion: 2.25 time: 0.068946 Jul 19 22:28:58.695538 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 442/938] 10.222.0.25 () {60 vars in 1183 bytes} [Tue Jul 19 22:28:58 2022] GET /compute/v2.1/os-migrations => generated 3206 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:58.707264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-011ae7ad-cc14-4e66-be3a-fc87c1f16511 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:58.708573 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-011ae7ad-cc14-4e66-be3a-fc87c1f16511 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:58.720205 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-011ae7ad-cc14-4e66-be3a-fc87c1f16511 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:58.720947 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-011ae7ad-cc14-4e66-be3a-fc87c1f16511 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:58.722538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-011ae7ad-cc14-4e66-be3a-fc87c1f16511 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:58.723558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-011ae7ad-cc14-4e66-be3a-fc87c1f16511 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:58.858201 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-23c2564d-681b-4612-aeed-89f6d2806675 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:58.872436 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-23c2564d-681b-4612-aeed-89f6d2806675 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:58.894416 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-23c2564d-681b-4612-aeed-89f6d2806675 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:58.895341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-23c2564d-681b-4612-aeed-89f6d2806675 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:58.896588 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-23c2564d-681b-4612-aeed-89f6d2806675 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:58.897359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-23c2564d-681b-4612-aeed-89f6d2806675 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:58.968109 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:28:59.537412 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-011ae7ad-cc14-4e66-be3a-fc87c1f16511 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lazy-loading 'services' on Instance uuid ef1f3571-2f57-4f5b-b607-16d82d41d8d2 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:28:59.579266 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-011ae7ad-cc14-4e66-be3a-fc87c1f16511 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 200 len: 2035 microversion: 2.25 time: 0.878938 Jul 19 22:28:59.580075 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 497/939] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:28:58 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 2035 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:28:59.593609 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e786508d-25e5-4ca8-88e4-33caffcbb6b1 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:59.594793 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e786508d-25e5-4ca8-88e4-33caffcbb6b1 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] [instance: 30cffef5-6254-4e63-b322-dcbbb4812bcb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:59.608390 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e786508d-25e5-4ca8-88e4-33caffcbb6b1 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:59.616218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e786508d-25e5-4ca8-88e4-33caffcbb6b1 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:59.617506 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e786508d-25e5-4ca8-88e4-33caffcbb6b1 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:59.617963 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e786508d-25e5-4ca8-88e4-33caffcbb6b1 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:59.737801 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-23c2564d-681b-4612-aeed-89f6d2806675 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:59.752598 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-23c2564d-681b-4612-aeed-89f6d2806675 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1499 microversion: 2.1 time: 0.904414 Jul 19 22:28:59.757665 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 443/940] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:58 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1499 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:59.762977 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5fbd526e-f769-4982-bd81-51a3a47df217 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:59.764040 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5fbd526e-f769-4982-bd81-51a3a47df217 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0cc94c67-92c3-491d-974d-1a40bf8757c4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:28:59.783959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5fbd526e-f769-4982-bd81-51a3a47df217 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:59.784996 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5fbd526e-f769-4982-bd81-51a3a47df217 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:59.786321 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5fbd526e-f769-4982-bd81-51a3a47df217 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:28:59.787185 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5fbd526e-f769-4982-bd81-51a3a47df217 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:28:59.976639 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5fbd526e-f769-4982-bd81-51a3a47df217 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:28:59.992319 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5fbd526e-f769-4982-bd81-51a3a47df217 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4" status: 200 len: 1271 microversion: 2.1 time: 0.233134 Jul 19 22:28:59.993254 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 444/941] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:59 2022] GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4 => generated 1271 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:28:59.999009 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-83fd296d-6a03-461d-bd9f-a137b2a3c352 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:28:59.999973 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-83fd296d-6a03-461d-bd9f-a137b2a3c352 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:00.027999 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-83fd296d-6a03-461d-bd9f-a137b2a3c352 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:00.035879 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-83fd296d-6a03-461d-bd9f-a137b2a3c352 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:00.037415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-83fd296d-6a03-461d-bd9f-a137b2a3c352 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:00.040155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-83fd296d-6a03-461d-bd9f-a137b2a3c352 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:00.394850 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e786508d-25e5-4ca8-88e4-33caffcbb6b1 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95538027b9ea43dd877a396003416933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad9b6d4ffc446bbe411c040b4aef80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:00.408357 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e786508d-25e5-4ca8-88e4-33caffcbb6b1 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] 10.222.0.25 "GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb" status: 200 len: 1478 microversion: 2.1 time: 0.825144 Jul 19 22:29:00.420717 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 498/942] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:59 2022] GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb => generated 1478 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:00.428848 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9a3b032d-74df-44ae-9997-870b4ec95a52 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Action: 'create', calling method: .version_select at 0x7f7a10609af0>, body: {"keypair": {"name": "tempest-keypair-1744052936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzB3DJv/kULMImD5jhBoPTb6ClRvvmTZD80hFvOvcoP/HA9YE/K4pNT35dPV3kJJB01Yk2hXdJ41AWvpfIiPMz/lf508fS0T/7K5qGY7JRqbGsaVjBN6D/quo05zBWnTg=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:00.472783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-9a3b032d-74df-44ae-9997-870b4ec95a52 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Getting quotas for project d0aa317147bd4c878b3c5e4480ae6289. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:29:00.488341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-9a3b032d-74df-44ae-9997-870b4ec95a52 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Getting quotas for user 113e94f3bdbc4a2bb284a82b0b410d68 and project d0aa317147bd4c878b3c5e4480ae6289. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:29:00.555305 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9a3b032d-74df-44ae-9997-870b4ec95a52 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.129536 Jul 19 22:29:00.556909 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 499/943] 10.222.0.25 () {62 vars in 1199 bytes} [Tue Jul 19 22:29:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 135 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 22:29:00.572212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-3bb01d26-7a9e-4aa6-aa79-9278cd639329 req-0c68e92c-c7a8-4d0d-90ea-a54a97c39479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30cffef5-6254-4e63-b322-dcbbb4812bcb", "name": "network-vif-deleted", "tag": "197dafce-8f4a-48f2-8028-c1e0cabd851f"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:00.596008 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-3bb01d26-7a9e-4aa6-aa79-9278cd639329 req-0c68e92c-c7a8-4d0d-90ea-a54a97c39479 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:00.597364 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-3bb01d26-7a9e-4aa6-aa79-9278cd639329 req-0c68e92c-c7a8-4d0d-90ea-a54a97c39479 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:00.624611 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-3bb01d26-7a9e-4aa6-aa79-9278cd639329 req-0c68e92c-c7a8-4d0d-90ea-a54a97c39479 service nova] Creating event network-vif-deleted:197dafce-8f4a-48f2-8028-c1e0cabd851f for instance 30cffef5-6254-4e63-b322-dcbbb4812bcb on n-h2-847009-3 Jul 19 22:29:00.639072 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-3bb01d26-7a9e-4aa6-aa79-9278cd639329 req-0c68e92c-c7a8-4d0d-90ea-a54a97c39479 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076501 Jul 19 22:29:00.639733 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 500/944] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:00.786402 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-41994bf3-3597-49c9-80a1-02f27591b67c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:00.788561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-41994bf3-3597-49c9-80a1-02f27591b67c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:00.814264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41994bf3-3597-49c9-80a1-02f27591b67c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:00.814712 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41994bf3-3597-49c9-80a1-02f27591b67c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:00.815537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41994bf3-3597-49c9-80a1-02f27591b67c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:00.815977 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41994bf3-3597-49c9-80a1-02f27591b67c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:01.227461 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-83fd296d-6a03-461d-bd9f-a137b2a3c352 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:01.242364 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-83fd296d-6a03-461d-bd9f-a137b2a3c352 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1542 microversion: 2.1 time: 1.247160 Jul 19 22:29:01.255453 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 445/945] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:28:59 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1542 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:01.255453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-48ed6cdb-ebfc-4828-b1f6-36abaff0fbcf tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:01.255453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-48ed6cdb-ebfc-4828-b1f6-36abaff0fbcf tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0cc94c67-92c3-491d-974d-1a40bf8757c4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:01.292052 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:29:01.315790 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48ed6cdb-ebfc-4828-b1f6-36abaff0fbcf tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:01.327764 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48ed6cdb-ebfc-4828-b1f6-36abaff0fbcf tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:01.329548 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48ed6cdb-ebfc-4828-b1f6-36abaff0fbcf tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:01.343195 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48ed6cdb-ebfc-4828-b1f6-36abaff0fbcf tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:01.536407 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-48ed6cdb-ebfc-4828-b1f6-36abaff0fbcf tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:01.558927 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-48ed6cdb-ebfc-4828-b1f6-36abaff0fbcf tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4" status: 200 len: 1279 microversion: 2.1 time: 0.313151 Jul 19 22:29:01.573595 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 446/946] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:01 2022] GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4 => generated 1279 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:01.582686 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f0d194e8-4ebe-4e86-9ed4-d7777ba8fe53 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:01.588986 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f0d194e8-4ebe-4e86-9ed4-d7777ba8fe53 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] [instance: 30cffef5-6254-4e63-b322-dcbbb4812bcb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:01.643534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f0d194e8-4ebe-4e86-9ed4-d7777ba8fe53 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:01.645771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f0d194e8-4ebe-4e86-9ed4-d7777ba8fe53 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:01.650577 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f0d194e8-4ebe-4e86-9ed4-d7777ba8fe53 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:01.652797 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f0d194e8-4ebe-4e86-9ed4-d7777ba8fe53 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:01.702181 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-f0d194e8-4ebe-4e86-9ed4-d7777ba8fe53 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] HTTP exception thrown: Instance 30cffef5-6254-4e63-b322-dcbbb4812bcb could not be found. Jul 19 22:29:01.705711 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f0d194e8-4ebe-4e86-9ed4-d7777ba8fe53 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Request method failure captured: Jul 19 22:29:01.705711 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb HTTP/1.1 Jul 19 22:29:01.705711 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:29:01.705711 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:29:01.705711 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:29:01.705711 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:29:01.705711 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:29:01.705711 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:29:01.705711 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:29:01.705711 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:29:01.705711 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zAGFJl-BzIETIaR3861xRMjGMU-paY62nDbrmpFAQ_DXrJPyDcsnmKpN0y45eoChzJhvpdtWr3JKmDQqsA1JTrK_2wevxCfIJwVJxgq6OOIBhKenJQS1VyU5t3yAWHedOD8YXMly9BQvS4SCrWXOfxqX94IJ_aJVGjYmpWrMAeKgU4 Jul 19 22:29:01.705711 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:29:01.705711 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:29:01.705711 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:29:01.705711 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:29:01.705711 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:29:01.705711 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:29:01.705711 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: e5ad9b6d4ffc446bbe411c040b4aef80 Jul 19 22:29:01.705711 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1147666485 Jul 19 22:29:01.705711 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:29:01.705711 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:29:01.708146 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e5ad9b6d4ffc446bbe411c040b4aef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5ad9b6d4ffc446bbe411c040b4aef80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e5ad9b6d4ffc446bbe411c040b4aef80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5ad9b6d4ffc446bbe411c040b4aef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:29:01.708146 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1147666485 Jul 19 22:29:01.708146 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: e5ad9b6d4ffc446bbe411c040b4aef80 Jul 19 22:29:01.708146 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1147666485 Jul 19 22:29:01.708146 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerDiagnosticsNegativeTest-1147666485-project Jul 19 22:29:01.708146 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:29:01.708146 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:29:01.708146 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 95538027b9ea43dd877a396003416933 Jul 19 22:29:01.708146 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1147666485-project Jul 19 22:29:01.708146 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:29:01.708146 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 30cffef5-6254-4e63-b322-dcbbb4812bcb could not be found. Jul 19 22:29:01.708146 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '30cffef5-6254-4e63-b322-dcbbb4812bcb'} Jul 19 22:29:01.709531 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:29:01.709531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:01.709531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:29:01.709531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:29:01.709531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:29:01.709531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:29:01.709531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:29:01.709531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:29:01.709531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:29:01.709531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:29:01.709531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30cffef5-6254-4e63-b322-dcbbb4812bcb could not be found. Jul 19 22:29:01.709531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:29:01.709531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:29:01.709531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:29:01.709531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:01.709531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:29:01.709531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:29:01.709531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:29:01.709531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:29:01.709531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:29:01.712667 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:29:01.712667 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:29:01.712667 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:29:01.712667 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:29:01.712667 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:29:01.712667 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:29:01.712667 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:29:01.712667 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30cffef5-6254-4e63-b322-dcbbb4812bcb could not be found. Jul 19 22:29:01.712667 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:29:01.712667 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:29:01.712667 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:29:01.712667 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:01.712667 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:29:01.712667 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:29:01.712667 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:29:01.712667 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:29:01.712667 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30cffef5-6254-4e63-b322-dcbbb4812bcb could not be found. Jul 19 22:29:01.712667 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:29:01.722075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f0d194e8-4ebe-4e86-9ed4-d7777ba8fe53 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] Returning 404 to user: Instance 30cffef5-6254-4e63-b322-dcbbb4812bcb could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:29:01.724852 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f0d194e8-4ebe-4e86-9ed4-d7777ba8fe53 tempest-ServerDiagnosticsNegativeTest-1147666485 tempest-ServerDiagnosticsNegativeTest-1147666485-project] 10.222.0.25 "GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb" status: 404 len: 111 microversion: 2.1 time: 0.147653 Jul 19 22:29:01.726293 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 447/947] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:01 2022] GET /compute/v2.1/servers/30cffef5-6254-4e63-b322-dcbbb4812bcb => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:29:02.174161 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-41994bf3-3597-49c9-80a1-02f27591b67c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:02.204904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-05f16831-5318-4a88-a518-1840d8a63717 req-0d325718-5364-4c88-878f-60788380f580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fab0a3d6-8249-4058-9ce5-90d458fff59d", "tag": "7078c457-b7f7-49a3-bb53-e2a5e49cc511"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:02.251291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-05f16831-5318-4a88-a518-1840d8a63717 req-0d325718-5364-4c88-878f-60788380f580 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:02.254023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-05f16831-5318-4a88-a518-1840d8a63717 req-0d325718-5364-4c88-878f-60788380f580 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:02.260849 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-41994bf3-3597-49c9-80a1-02f27591b67c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1499 microversion: 2.1 time: 1.483356 Jul 19 22:29:02.283890 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 501/948] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:00 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1499 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:29:02.307812 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-142bb710-ba51-48e4-8c27-f5c06ea3ae11 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:02.308783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-142bb710-ba51-48e4-8c27-f5c06ea3ae11 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:02.321039 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-05f16831-5318-4a88-a518-1840d8a63717 req-0d325718-5364-4c88-878f-60788380f580 service nova] Creating event network-changed:7078c457-b7f7-49a3-bb53-e2a5e49cc511 for instance fab0a3d6-8249-4058-9ce5-90d458fff59d on n-h2-847009-3 Jul 19 22:29:02.332128 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-05f16831-5318-4a88-a518-1840d8a63717 req-0d325718-5364-4c88-878f-60788380f580 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142570 Jul 19 22:29:02.337204 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 448/949] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:29:02.366632 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-142bb710-ba51-48e4-8c27-f5c06ea3ae11 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:02.370108 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-142bb710-ba51-48e4-8c27-f5c06ea3ae11 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:02.375701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-142bb710-ba51-48e4-8c27-f5c06ea3ae11 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:02.382856 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-142bb710-ba51-48e4-8c27-f5c06ea3ae11 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:02.598215 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-72386009-b2b5-4df1-9b2b-e43804d26b14 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:02.598215 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-72386009-b2b5-4df1-9b2b-e43804d26b14 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0cc94c67-92c3-491d-974d-1a40bf8757c4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:02.614936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-72386009-b2b5-4df1-9b2b-e43804d26b14 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:02.615994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-72386009-b2b5-4df1-9b2b-e43804d26b14 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:02.618865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-72386009-b2b5-4df1-9b2b-e43804d26b14 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:02.622374 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-72386009-b2b5-4df1-9b2b-e43804d26b14 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:03.187991 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-72386009-b2b5-4df1-9b2b-e43804d26b14 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:03.203330 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-72386009-b2b5-4df1-9b2b-e43804d26b14 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4" status: 200 len: 1277 microversion: 2.1 time: 0.614207 Jul 19 22:29:03.217823 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 449/950] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:02 2022] GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4 => generated 1277 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:03.304084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-feb1857a-1a7a-4d0a-9618-8998ad2d87d5 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:03.306143 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-feb1857a-1a7a-4d0a-9618-8998ad2d87d5 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:03.324190 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-feb1857a-1a7a-4d0a-9618-8998ad2d87d5 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:03.324706 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-feb1857a-1a7a-4d0a-9618-8998ad2d87d5 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:03.325530 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-feb1857a-1a7a-4d0a-9618-8998ad2d87d5 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:03.325969 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-feb1857a-1a7a-4d0a-9618-8998ad2d87d5 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:03.864731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-142bb710-ba51-48e4-8c27-f5c06ea3ae11 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:03.867691 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:29:03.890341 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-142bb710-ba51-48e4-8c27-f5c06ea3ae11 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1542 microversion: 2.1 time: 1.602014 Jul 19 22:29:03.891389 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 502/951] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:02 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1542 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:03.911891 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-380bd30b-2d43-4a12-aba2-2d054e5de8f9 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:03.918919 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-380bd30b-2d43-4a12-aba2-2d054e5de8f9 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:03.951855 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-380bd30b-2d43-4a12-aba2-2d054e5de8f9 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:03.953230 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-380bd30b-2d43-4a12-aba2-2d054e5de8f9 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:03.957097 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-380bd30b-2d43-4a12-aba2-2d054e5de8f9 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:03.961588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-380bd30b-2d43-4a12-aba2-2d054e5de8f9 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:04.030659 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-380bd30b-2d43-4a12-aba2-2d054e5de8f9 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.134403 Jul 19 22:29:04.032389 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 503/952] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:29:03 2022] GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5/os-volume_attachments => generated 25 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:29:04.214926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ac9086c2-2465-441f-8681-3b2f7670c748 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:04.218259 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ac9086c2-2465-441f-8681-3b2f7670c748 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:04.231611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac9086c2-2465-441f-8681-3b2f7670c748 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:04.233082 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac9086c2-2465-441f-8681-3b2f7670c748 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:04.235226 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac9086c2-2465-441f-8681-3b2f7670c748 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:04.236447 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac9086c2-2465-441f-8681-3b2f7670c748 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:04.358285 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ac9086c2-2465-441f-8681-3b2f7670c748 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.154148 Jul 19 22:29:04.360245 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 504/953] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:29:04 2022] GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5/os-volume_attachments => generated 25 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:29:04.370550 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-03321b2f-97de-4d23-acf9-46b5dd7e8ce4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:04.372502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-03321b2f-97de-4d23-acf9-46b5dd7e8ce4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0cc94c67-92c3-491d-974d-1a40bf8757c4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:04.391967 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-03321b2f-97de-4d23-acf9-46b5dd7e8ce4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:04.392723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-03321b2f-97de-4d23-acf9-46b5dd7e8ce4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:04.396496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-03321b2f-97de-4d23-acf9-46b5dd7e8ce4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:04.397442 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-03321b2f-97de-4d23-acf9-46b5dd7e8ce4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:04.572353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-feb1857a-1a7a-4d0a-9618-8998ad2d87d5 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:04.589337 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-feb1857a-1a7a-4d0a-9618-8998ad2d87d5 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1499 microversion: 2.1 time: 1.289767 Jul 19 22:29:04.591419 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 450/954] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:03 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1499 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:29:04.614882 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c276a917-c4c5-4c18-a97a-c73a7832cbbc tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:04.616281 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c276a917-c4c5-4c18-a97a-c73a7832cbbc tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:04.642186 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c276a917-c4c5-4c18-a97a-c73a7832cbbc tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:04.645884 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c276a917-c4c5-4c18-a97a-c73a7832cbbc tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:04.647706 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c276a917-c4c5-4c18-a97a-c73a7832cbbc tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:04.651705 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c276a917-c4c5-4c18-a97a-c73a7832cbbc tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:04.721614 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c276a917-c4c5-4c18-a97a-c73a7832cbbc tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:29:04.795074 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-03321b2f-97de-4d23-acf9-46b5dd7e8ce4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:04.813739 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-03321b2f-97de-4d23-acf9-46b5dd7e8ce4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4" status: 200 len: 1277 microversion: 2.1 time: 0.451743 Jul 19 22:29:04.818921 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 505/955] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:04 2022] GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4 => generated 1277 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:04.908877 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-31592500-65fa-4c8a-a477-6d3f238c9df7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:04.909500 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-31592500-65fa-4c8a-a477-6d3f238c9df7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:04.920987 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31592500-65fa-4c8a-a477-6d3f238c9df7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:04.925141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31592500-65fa-4c8a-a477-6d3f238c9df7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:04.926716 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c276a917-c4c5-4c18-a97a-c73a7832cbbc tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5" status: 204 len: 0 microversion: 2.1 time: 0.332656 Jul 19 22:29:04.929908 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 451/956] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:29:04 2022] DELETE /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:29:04.931346 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31592500-65fa-4c8a-a477-6d3f238c9df7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:04.933680 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31592500-65fa-4c8a-a477-6d3f238c9df7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:04.970242 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3b670949-2e0a-4bf0-8ab1-0bbd9fedce64 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:04.974004 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3b670949-2e0a-4bf0-8ab1-0bbd9fedce64 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:04.995169 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b670949-2e0a-4bf0-8ab1-0bbd9fedce64 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:04.996044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b670949-2e0a-4bf0-8ab1-0bbd9fedce64 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:04.999604 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b670949-2e0a-4bf0-8ab1-0bbd9fedce64 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:05.000556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b670949-2e0a-4bf0-8ab1-0bbd9fedce64 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:05.584772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3b670949-2e0a-4bf0-8ab1-0bbd9fedce64 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66a794a5a4c41498472dd994128703f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53b71f56584a28b7b82c799fb96673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:05.605496 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3b670949-2e0a-4bf0-8ab1-0bbd9fedce64 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5" status: 200 len: 1683 microversion: 2.1 time: 0.651212 Jul 19 22:29:05.606286 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 452/957] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:04 2022] GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5 => generated 1683 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:05.612005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-814956a2-8c5e-4266-9179-63611c5e8de0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1478540921", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "69dde816-f623-484f-b274-67b5a7bbba5e"}], "security_groups": [{"name": "tempest-securitygroup--361927101"}], "key_name": "tempest-keypair-1744052936", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:05.626613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-31592500-65fa-4c8a-a477-6d3f238c9df7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:05.670473 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-31592500-65fa-4c8a-a477-6d3f238c9df7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1542 microversion: 2.1 time: 0.761822 Jul 19 22:29:05.676894 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 506/958] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:04 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1542 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:05.694311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3f3ebd84-c629-4753-94ac-dc3bfcde14a8 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:05.702210 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3f3ebd84-c629-4753-94ac-dc3bfcde14a8 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:05.718302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f3ebd84-c629-4753-94ac-dc3bfcde14a8 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:05.719646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f3ebd84-c629-4753-94ac-dc3bfcde14a8 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:05.722081 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f3ebd84-c629-4753-94ac-dc3bfcde14a8 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:05.723606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f3ebd84-c629-4753-94ac-dc3bfcde14a8 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:05.990694 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-814956a2-8c5e-4266-9179-63611c5e8de0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] validate_networks() for [('69dde816-f623-484f-b274-67b5a7bbba5e', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:29:06.173921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=34 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:29:06.195997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3f3ebd84-c629-4753-94ac-dc3bfcde14a8 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:06.217245 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3f3ebd84-c629-4753-94ac-dc3bfcde14a8 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1499 microversion: 2.1 time: 0.537824 Jul 19 22:29:06.218317 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 507/959] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:05 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1499 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:06.247337 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1c66198f-314e-43c7-b071-e56c4cf5806d tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:06.248401 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1c66198f-314e-43c7-b071-e56c4cf5806d tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0cc94c67-92c3-491d-974d-1a40bf8757c4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:06.265946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1c66198f-314e-43c7-b071-e56c4cf5806d tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:06.266383 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1c66198f-314e-43c7-b071-e56c4cf5806d tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:06.269208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1c66198f-314e-43c7-b071-e56c4cf5806d tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:06.270114 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1c66198f-314e-43c7-b071-e56c4cf5806d tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:06.622232 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1c66198f-314e-43c7-b071-e56c4cf5806d tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:06.639560 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1c66198f-314e-43c7-b071-e56c4cf5806d tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4" status: 200 len: 1319 microversion: 2.1 time: 0.417009 Jul 19 22:29:06.641451 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 508/960] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:06 2022] GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4 => generated 1319 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:06.650603 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:29:06.952257 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-814956a2-8c5e-4266-9179-63611c5e8de0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:29:06.952828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-814956a2-8c5e-4266-9179-63611c5e8de0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:29:06.953159 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-814956a2-8c5e-4266-9179-63611c5e8de0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:29:06.953580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-814956a2-8c5e-4266-9179-63611c5e8de0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:29:06.954001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-814956a2-8c5e-4266-9179-63611c5e8de0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:29:06.964582 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-814956a2-8c5e-4266-9179-63611c5e8de0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:06.965042 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-814956a2-8c5e-4266-9179-63611c5e8de0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:06.966485 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-814956a2-8c5e-4266-9179-63611c5e8de0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:06.967001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-814956a2-8c5e-4266-9179-63611c5e8de0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:06.998534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-814956a2-8c5e-4266-9179-63611c5e8de0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Getting quotas for project d0aa317147bd4c878b3c5e4480ae6289. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:29:07.005191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-814956a2-8c5e-4266-9179-63611c5e8de0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Getting quotas for user 113e94f3bdbc4a2bb284a82b0b410d68 and project d0aa317147bd4c878b3c5e4480ae6289. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:29:07.020109 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-814956a2-8c5e-4266-9179-63611c5e8de0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:29:07.022790 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-814956a2-8c5e-4266-9179-63611c5e8de0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:29:07.064975 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1b2093e9-9500-4cf9-b988-48a9a6a6993a tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Calling method '.version_select at 0x7f7a10512f70>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:07.126178 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-814956a2-8c5e-4266-9179-63611c5e8de0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.518466 Jul 19 22:29:07.131202 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 453/961] 10.222.0.25 () {62 vars in 1187 bytes} [Tue Jul 19 22:29:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 1521 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 22:29:07.135041 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-3bc2ae95-e305-4e3d-91d9-f13ae42e3fd9 req-6b644354-ddd2-43d8-b686-addbbc1ad16d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca03e7c4-e8c2-43f5-8528-7b2a847ca718", "tag": "bd28cab7-fac1-4695-830b-6be183a87784"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:07.150743 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-3bc2ae95-e305-4e3d-91d9-f13ae42e3fd9 req-6b644354-ddd2-43d8-b686-addbbc1ad16d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:07.151879 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-3bc2ae95-e305-4e3d-91d9-f13ae42e3fd9 req-6b644354-ddd2-43d8-b686-addbbc1ad16d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:07.164199 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1b2093e9-9500-4cf9-b988-48a9a6a6993a tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/a7d6344dff7540a58021e8d5aa9d997a" status: 200 len: 371 microversion: 2.1 time: 0.521182 Jul 19 22:29:07.165198 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 509/962] 10.222.0.25 () {58 vars in 1241 bytes} [Tue Jul 19 22:29:06 2022] GET /compute/v2.1/os-quota-sets/a7d6344dff7540a58021e8d5aa9d997a => generated 371 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:07.170486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-40f76001-5c63-4bc0-bca2-6b0eae6c67dd tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:07.171672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-40f76001-5c63-4bc0-bca2-6b0eae6c67dd tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:07.173159 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-3bc2ae95-e305-4e3d-91d9-f13ae42e3fd9 req-6b644354-ddd2-43d8-b686-addbbc1ad16d service nova] Creating event network-changed:bd28cab7-fac1-4695-830b-6be183a87784 for instance ca03e7c4-e8c2-43f5-8528-7b2a847ca718 on n-h1-847009-3 Jul 19 22:29:07.180313 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-40f76001-5c63-4bc0-bca2-6b0eae6c67dd tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:07.181113 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-40f76001-5c63-4bc0-bca2-6b0eae6c67dd tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:07.182336 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-40f76001-5c63-4bc0-bca2-6b0eae6c67dd tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:07.183070 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-3bc2ae95-e305-4e3d-91d9-f13ae42e3fd9 req-6b644354-ddd2-43d8-b686-addbbc1ad16d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053127 Jul 19 22:29:07.183502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-40f76001-5c63-4bc0-bca2-6b0eae6c67dd tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:07.184949 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 454/963] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:07.192389 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4ff79b30-2dc6-483e-9e72-7029bb598ec5 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:07.194153 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4ff79b30-2dc6-483e-9e72-7029bb598ec5 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:07.204919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ff79b30-2dc6-483e-9e72-7029bb598ec5 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:07.205805 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ff79b30-2dc6-483e-9e72-7029bb598ec5 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:07.206942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ff79b30-2dc6-483e-9e72-7029bb598ec5 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:07.207682 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ff79b30-2dc6-483e-9e72-7029bb598ec5 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:08.366215 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4ff79b30-2dc6-483e-9e72-7029bb598ec5 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:08.385541 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4ff79b30-2dc6-483e-9e72-7029bb598ec5 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1542 microversion: 2.1 time: 1.197287 Jul 19 22:29:08.389314 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 455/964] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:07 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1542 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:08.400191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-00ba36aa-232a-4de7-aee7-280e70ddfd71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:08.401770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-00ba36aa-232a-4de7-aee7-280e70ddfd71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:08.417067 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00ba36aa-232a-4de7-aee7-280e70ddfd71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:08.422535 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00ba36aa-232a-4de7-aee7-280e70ddfd71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:08.424270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00ba36aa-232a-4de7-aee7-280e70ddfd71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:08.424741 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-40f76001-5c63-4bc0-bca2-6b0eae6c67dd tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66a794a5a4c41498472dd994128703f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53b71f56584a28b7b82c799fb96673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:08.427463 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00ba36aa-232a-4de7-aee7-280e70ddfd71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:08.457696 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-40f76001-5c63-4bc0-bca2-6b0eae6c67dd tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5" status: 200 len: 1683 microversion: 2.1 time: 1.291192 Jul 19 22:29:08.458445 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 510/965] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:07 2022] GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5 => generated 1683 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:08.478295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d1cd9231-be4b-42a1-8ebf-6750ff24b88a tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Action: 'update', calling method: .version_select at 0x7f7a105e6c10>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:08.728454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-00ba36aa-232a-4de7-aee7-280e70ddfd71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:08.744264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-00ba36aa-232a-4de7-aee7-280e70ddfd71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:08.750734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-00ba36aa-232a-4de7-aee7-280e70ddfd71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:08.753793 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-00ba36aa-232a-4de7-aee7-280e70ddfd71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1282 microversion: 2.25 time: 0.361874 Jul 19 22:29:08.755612 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 456/966] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:29:08 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1282 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:29:08.775346 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-81c22097-493e-4786-a737-6a9313d448c4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:08.776793 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-81c22097-493e-4786-a737-6a9313d448c4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:08.806404 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81c22097-493e-4786-a737-6a9313d448c4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:08.809715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81c22097-493e-4786-a737-6a9313d448c4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:08.811382 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81c22097-493e-4786-a737-6a9313d448c4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:08.812121 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81c22097-493e-4786-a737-6a9313d448c4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:08.929901 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d1cd9231-be4b-42a1-8ebf-6750ff24b88a tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:08.930531 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d1cd9231-be4b-42a1-8ebf-6750ff24b88a tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:08.931419 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d1cd9231-be4b-42a1-8ebf-6750ff24b88a tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:08.932577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d1cd9231-be4b-42a1-8ebf-6750ff24b88a tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:09.052572 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d1cd9231-be4b-42a1-8ebf-6750ff24b88a tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/a7d6344dff7540a58021e8d5aa9d997a" status: 200 len: 328 microversion: 2.1 time: 0.576090 Jul 19 22:29:09.064147 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 511/967] 10.222.0.25 () {60 vars in 1261 bytes} [Tue Jul 19 22:29:08 2022] PUT /compute/v2.1/os-quota-sets/a7d6344dff7540a58021e8d5aa9d997a => generated 328 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:09.076965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-27b2c960-188e-4a09-8fab-84d2bcb94824 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:09.077915 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-27b2c960-188e-4a09-8fab-84d2bcb94824 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0cc94c67-92c3-491d-974d-1a40bf8757c4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:09.084807 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:29:09.087829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-27b2c960-188e-4a09-8fab-84d2bcb94824 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:09.088707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-27b2c960-188e-4a09-8fab-84d2bcb94824 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:09.090965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-27b2c960-188e-4a09-8fab-84d2bcb94824 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:09.091895 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-27b2c960-188e-4a09-8fab-84d2bcb94824 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:09.782458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-27b2c960-188e-4a09-8fab-84d2bcb94824 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:09.798030 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-27b2c960-188e-4a09-8fab-84d2bcb94824 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4" status: 200 len: 1319 microversion: 2.1 time: 0.732133 Jul 19 22:29:09.828868 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 512/968] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:09 2022] GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4 => generated 1319 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:09.855569 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-81c22097-493e-4786-a737-6a9313d448c4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:09.889487 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-81c22097-493e-4786-a737-6a9313d448c4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1499 microversion: 2.1 time: 1.128314 Jul 19 22:29:09.890879 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 457/969] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:08 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1499 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:09.898557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-4cb818fd-51c6-4ff9-a50a-7c3c1bea03ec req-aa79e1f9-05f7-46bb-a36d-bdd1735869c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cc94c67-92c3-491d-974d-1a40bf8757c4", "tag": "36c690fa-f832-4d8c-967c-46b6df7eda25"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:09.938224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-4cb818fd-51c6-4ff9-a50a-7c3c1bea03ec req-aa79e1f9-05f7-46bb-a36d-bdd1735869c9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:09.938807 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-4cb818fd-51c6-4ff9-a50a-7c3c1bea03ec req-aa79e1f9-05f7-46bb-a36d-bdd1735869c9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:09.989805 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-4cb818fd-51c6-4ff9-a50a-7c3c1bea03ec req-aa79e1f9-05f7-46bb-a36d-bdd1735869c9 service nova] Creating event network-changed:36c690fa-f832-4d8c-967c-46b6df7eda25 for instance 0cc94c67-92c3-491d-974d-1a40bf8757c4 on n-h2-847009-3 Jul 19 22:29:10.002611 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-4cb818fd-51c6-4ff9-a50a-7c3c1bea03ec req-aa79e1f9-05f7-46bb-a36d-bdd1735869c9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109934 Jul 19 22:29:10.004776 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 458/970] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:10.016083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d714df3b-d625-4f49-8cc7-b654c9be6323 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:10.018208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d714df3b-d625-4f49-8cc7-b654c9be6323 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:10.039607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d714df3b-d625-4f49-8cc7-b654c9be6323 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:10.041410 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d714df3b-d625-4f49-8cc7-b654c9be6323 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:10.045750 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d714df3b-d625-4f49-8cc7-b654c9be6323 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:10.047519 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d714df3b-d625-4f49-8cc7-b654c9be6323 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:10.293822 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-778566ad-aaf7-4603-93af-d9d2ff6efdd7 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-223472917", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:10.410371 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-778566ad-aaf7-4603-93af-d9d2ff6efdd7 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] validate_networks() for None {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:29:10.740236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d714df3b-d625-4f49-8cc7-b654c9be6323 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:10.764209 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d714df3b-d625-4f49-8cc7-b654c9be6323 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1541 microversion: 2.1 time: 0.757746 Jul 19 22:29:10.792473 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 459/971] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:10 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1541 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:10.799041 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bbc1d078-2a45-4199-85b9-423e223da869 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:10.800041 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bbc1d078-2a45-4199-85b9-423e223da869 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:10.818337 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bbc1d078-2a45-4199-85b9-423e223da869 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:10.819882 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bbc1d078-2a45-4199-85b9-423e223da869 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:10.821723 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bbc1d078-2a45-4199-85b9-423e223da869 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:10.822785 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bbc1d078-2a45-4199-85b9-423e223da869 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:10.888876 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bbc1d078-2a45-4199-85b9-423e223da869 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:10.890514 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bbc1d078-2a45-4199-85b9-423e223da869 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:10.891007 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-bbc1d078-2a45-4199-85b9-423e223da869 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lazy-loading 'fault' on Instance uuid 40ce1872-5f47-4acc-ba80-696b87b062b5 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:29:11.045229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bbc1d078-2a45-4199-85b9-423e223da869 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66a794a5a4c41498472dd994128703f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53b71f56584a28b7b82c799fb96673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:11.061042 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bbc1d078-2a45-4199-85b9-423e223da869 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5" status: 200 len: 1332 microversion: 2.1 time: 0.266039 Jul 19 22:29:11.062642 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 460/972] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:10 2022] GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5 => generated 1332 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:11.070645 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0d9b6bf9-0265-462d-82ad-6f8a5cacda28 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:11.071582 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0d9b6bf9-0265-462d-82ad-6f8a5cacda28 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:11.086094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d9b6bf9-0265-462d-82ad-6f8a5cacda28 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:11.087053 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d9b6bf9-0265-462d-82ad-6f8a5cacda28 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:11.088654 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d9b6bf9-0265-462d-82ad-6f8a5cacda28 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:11.089767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d9b6bf9-0265-462d-82ad-6f8a5cacda28 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:11.128454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:29:11.285193 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0d9b6bf9-0265-462d-82ad-6f8a5cacda28 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:11.296961 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0d9b6bf9-0265-462d-82ad-6f8a5cacda28 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:11.298751 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0d9b6bf9-0265-462d-82ad-6f8a5cacda28 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:11.300610 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0d9b6bf9-0265-462d-82ad-6f8a5cacda28 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1344 microversion: 2.25 time: 0.236040 Jul 19 22:29:11.301338 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 461/973] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:29:11 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1344 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:29:11.346407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-778566ad-aaf7-4603-93af-d9d2ff6efdd7 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:29:11.348070 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-778566ad-aaf7-4603-93af-d9d2ff6efdd7 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:29:11.349054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-778566ad-aaf7-4603-93af-d9d2ff6efdd7 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:29:11.350946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-778566ad-aaf7-4603-93af-d9d2ff6efdd7 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:29:11.352728 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-778566ad-aaf7-4603-93af-d9d2ff6efdd7 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:29:11.367102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-778566ad-aaf7-4603-93af-d9d2ff6efdd7 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:11.367871 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-778566ad-aaf7-4603-93af-d9d2ff6efdd7 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:11.370014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-778566ad-aaf7-4603-93af-d9d2ff6efdd7 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:11.371092 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-778566ad-aaf7-4603-93af-d9d2ff6efdd7 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:11.399420 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-778566ad-aaf7-4603-93af-d9d2ff6efdd7 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Getting quotas for project a7d6344dff7540a58021e8d5aa9d997a. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:29:11.405897 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-778566ad-aaf7-4603-93af-d9d2ff6efdd7 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Getting quotas for user 045c9ef2aac74819bbe91d09d4644c8f and project a7d6344dff7540a58021e8d5aa9d997a. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:29:11.411282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1a518e8f-2f7e-4942-9f05-1e6216438533 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1787807743", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:11.429377 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.utils [None req-778566ad-aaf7-4603-93af-d9d2ff6efdd7 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] cores quota exceeded for a7d6344dff7540a58021e8d5aa9d997a, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119337) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 19 22:29:11.430645 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-778566ad-aaf7-4603-93af-d9d2ff6efdd7 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 19 22:29:11.458417 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-778566ad-aaf7-4603-93af-d9d2ff6efdd7 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Request method failure captured: Jul 19 22:29:11.458417 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:29:11.458417 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:29:11.458417 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:29:11.458417 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:29:11.458417 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 144 Jul 19 22:29:11.458417 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:29:11.458417 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:29:11.458417 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:29:11.458417 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:29:11.458417 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zAwnjXrXeilHFm4auC3Bn63u_5uUapHZt_r1R7NG-nHApAHz6ALEwEvVWK8xu2S9CZnhK3HBVl7dnvrxBdh4tzmpRnupji6G2NlwbEmHDgy8YtNp_x_HetIaqJlZ3qsrfFbRAMwu2TXhpMkOM1nVY2WtEDLe4EweMbFbc6zSOMnLyw Jul 19 22:29:11.458417 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:29:11.458417 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:29:11.458417 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:29:11.458417 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:29:11.458417 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:29:11.458417 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:29:11.458417 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: a7d6344dff7540a58021e8d5aa9d997a Jul 19 22:29:11.458417 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-QuotasAdminNegativeTest-1150226152 Jul 19 22:29:11.458417 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:29:11.458417 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:29:11.460123 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7d6344dff7540a58021e8d5aa9d997a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7d6344dff7540a58021e8d5aa9d997a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7d6344dff7540a58021e8d5aa9d997a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7d6344dff7540a58021e8d5aa9d997a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:29:11.460123 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-QuotasAdminNegativeTest-1150226152 Jul 19 22:29:11.460123 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: a7d6344dff7540a58021e8d5aa9d997a Jul 19 22:29:11.460123 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1150226152 Jul 19 22:29:11.460123 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-QuotasAdminNegativeTest-1150226152-project Jul 19 22:29:11.460123 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:29:11.460123 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:29:11.460123 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 045c9ef2aac74819bbe91d09d4644c8f Jul 19 22:29:11.460123 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-QuotasAdminNegativeTest-1150226152-project Jul 19 22:29:11.460123 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:29:11.460123 n-d-847009-3 devstack@n-api.service[119337]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-223472917", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}} Jul 19 22:29:11.460123 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:29:11.461063 n-d-847009-3 devstack@n-api.service[119337]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 19 22:29:11.461063 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-223472917', 'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691', 'flavorRef': '452'}}} Jul 19 22:29:11.461063 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:29:11.461063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:11.461063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 19 22:29:11.461063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 19 22:29:11.461063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:29:11.461063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:29:11.461063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 19 22:29:11.461063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc Jul 19 22:29:11.461063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 19 22:29:11.461063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 19 22:29:11.461063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:29:11.461063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:29:11.461063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 19 22:29:11.461063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 19 22:29:11.461063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 19 22:29:11.461063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 19 22:29:11.462370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 19 22:29:11.462370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 19 22:29:11.462370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 19 22:29:11.462370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:29:11.462370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:29:11.462370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:29:11.462370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:11.462370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 19 22:29:11.462370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 19 22:29:11.462370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 19 22:29:11.462370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 19 22:29:11.462370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 19 22:29:11.462370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 19 22:29:11.462370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 19 22:29:11.462370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 19 22:29:11.462370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 19 22:29:11.462370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 19 22:29:11.462370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 19 22:29:11.462370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:29:11.462370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:29:11.462370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:29:11.463978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:11.463978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:29:11.463978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:29:11.463978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:29:11.463978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:29:11.463978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:29:11.463978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:29:11.463978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:29:11.463978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:29:11.463978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:29:11.463978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:29:11.463978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:29:11.463978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:29:11.463978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 22:29:11.463978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 19 22:29:11.463978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 19 22:29:11.463978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 19 22:29:11.463978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:29:11.463978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:29:11.463978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:29:11.463978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:11.465530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:29:11.465530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:29:11.465530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:29:11.465530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:29:11.465530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 19 22:29:11.465530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:29:11.465530 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-778566ad-aaf7-4603-93af-d9d2ff6efdd7 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:29:11.465530 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-778566ad-aaf7-4603-93af-d9d2ff6efdd7 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.646246 Jul 19 22:29:11.465530 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 513/974] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:29:09 2022] POST /compute/v2.1/servers => generated 111 bytes in 1648 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:29:11.475389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b050cd56-c049-44ad-8255-085069e3f092 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:11.476011 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b050cd56-c049-44ad-8255-085069e3f092 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0cc94c67-92c3-491d-974d-1a40bf8757c4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:11.487841 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b050cd56-c049-44ad-8255-085069e3f092 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:11.489343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b050cd56-c049-44ad-8255-085069e3f092 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:11.490312 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b050cd56-c049-44ad-8255-085069e3f092 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:11.491929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b050cd56-c049-44ad-8255-085069e3f092 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:11.509441 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-1a518e8f-2f7e-4942-9f05-1e6216438533 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] validate_networks() for None {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:29:11.937391 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b050cd56-c049-44ad-8255-085069e3f092 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:11.948305 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b050cd56-c049-44ad-8255-085069e3f092 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4" status: 200 len: 1319 microversion: 2.1 time: 0.479888 Jul 19 22:29:11.958913 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 514/975] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:11 2022] GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4 => generated 1319 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:11.964106 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dad78963-bb1c-4509-a2cd-c3538983f149 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:11.964732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dad78963-bb1c-4509-a2cd-c3538983f149 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:11.972522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dad78963-bb1c-4509-a2cd-c3538983f149 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:11.973004 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dad78963-bb1c-4509-a2cd-c3538983f149 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:11.973763 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dad78963-bb1c-4509-a2cd-c3538983f149 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:11.974195 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dad78963-bb1c-4509-a2cd-c3538983f149 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:12.032886 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-1a518e8f-2f7e-4942-9f05-1e6216438533 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:29:12.034440 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-1a518e8f-2f7e-4942-9f05-1e6216438533 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:29:12.035522 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-1a518e8f-2f7e-4942-9f05-1e6216438533 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:29:12.035987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-1a518e8f-2f7e-4942-9f05-1e6216438533 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:29:12.036779 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-1a518e8f-2f7e-4942-9f05-1e6216438533 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:29:12.048821 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a518e8f-2f7e-4942-9f05-1e6216438533 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:12.049843 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a518e8f-2f7e-4942-9f05-1e6216438533 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:12.051370 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a518e8f-2f7e-4942-9f05-1e6216438533 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:12.052496 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a518e8f-2f7e-4942-9f05-1e6216438533 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:12.086513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-1a518e8f-2f7e-4942-9f05-1e6216438533 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Getting quotas for project 512cc31b5f6546eeb04486cd5213e441. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:29:12.095657 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-1a518e8f-2f7e-4942-9f05-1e6216438533 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Getting quotas for user 4781dbc875d24dc490e598b41905a542 and project 512cc31b5f6546eeb04486cd5213e441. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:29:12.125363 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1a518e8f-2f7e-4942-9f05-1e6216438533 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:29:12.130380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1a518e8f-2f7e-4942-9f05-1e6216438533 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:29:12.164711 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:29:12.247726 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1a518e8f-2f7e-4942-9f05-1e6216438533 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.944109 Jul 19 22:29:12.252016 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 462/976] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:29:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:29:12.258632 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e7e2d5b2-a600-4a4f-911c-61a0c7e6adc3 tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Action: 'update', calling method: .version_select at 0x7f7a10625b80>, body: {"quota_set": {"cores": 20}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:12.400038 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dad78963-bb1c-4509-a2cd-c3538983f149 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:12.412077 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dad78963-bb1c-4509-a2cd-c3538983f149 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1499 microversion: 2.1 time: 0.451664 Jul 19 22:29:12.427641 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 515/977] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:11 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1499 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:12.433022 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e6b340c6-996d-4fd9-8c67-7fb2f6c05078 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:12.448058 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e6b340c6-996d-4fd9-8c67-7fb2f6c05078 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:12.468194 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6b340c6-996d-4fd9-8c67-7fb2f6c05078 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:12.469070 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6b340c6-996d-4fd9-8c67-7fb2f6c05078 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:12.470123 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6b340c6-996d-4fd9-8c67-7fb2f6c05078 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:12.471163 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6b340c6-996d-4fd9-8c67-7fb2f6c05078 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:12.532002 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e7e2d5b2-a600-4a4f-911c-61a0c7e6adc3 tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:12.532567 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e7e2d5b2-a600-4a4f-911c-61a0c7e6adc3 tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:12.533919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e7e2d5b2-a600-4a4f-911c-61a0c7e6adc3 tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:12.536171 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e7e2d5b2-a600-4a4f-911c-61a0c7e6adc3 tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:12.666118 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e7e2d5b2-a600-4a4f-911c-61a0c7e6adc3 tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/a7d6344dff7540a58021e8d5aa9d997a" status: 200 len: 329 microversion: 2.1 time: 0.412255 Jul 19 22:29:12.667020 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 463/978] 10.222.0.25 () {60 vars in 1261 bytes} [Tue Jul 19 22:29:12 2022] PUT /compute/v2.1/os-quota-sets/a7d6344dff7540a58021e8d5aa9d997a => generated 329 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:12.675366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-dfb93832-64dc-4b3b-a504-a7d9d2ed3a89 req-c17cb6d4-340c-46f1-8e74-96b7e76ca963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ce1872-5f47-4acc-ba80-696b87b062b5", "name": "network-vif-deleted", "tag": "ea7d48d9-65be-47a1-9821-5c0e56f6eed7"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:12.688902 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-dfb93832-64dc-4b3b-a504-a7d9d2ed3a89 req-c17cb6d4-340c-46f1-8e74-96b7e76ca963 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:12.689657 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-dfb93832-64dc-4b3b-a504-a7d9d2ed3a89 req-c17cb6d4-340c-46f1-8e74-96b7e76ca963 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:12.709622 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-dfb93832-64dc-4b3b-a504-a7d9d2ed3a89 req-c17cb6d4-340c-46f1-8e74-96b7e76ca963 service nova] Creating event network-vif-deleted:ea7d48d9-65be-47a1-9821-5c0e56f6eed7 for instance 40ce1872-5f47-4acc-ba80-696b87b062b5 on n-h2-847009-3 Jul 19 22:29:12.719339 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-dfb93832-64dc-4b3b-a504-a7d9d2ed3a89 req-c17cb6d4-340c-46f1-8e74-96b7e76ca963 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049165 Jul 19 22:29:12.720289 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 464/979] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:12.728063 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5d042982-ce1e-414e-af69-1732dba03629 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:12.729246 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5d042982-ce1e-414e-af69-1732dba03629 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:12.737015 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d042982-ce1e-414e-af69-1732dba03629 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:12.737876 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d042982-ce1e-414e-af69-1732dba03629 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:12.739082 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d042982-ce1e-414e-af69-1732dba03629 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:12.739713 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d042982-ce1e-414e-af69-1732dba03629 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:12.751727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e6b340c6-996d-4fd9-8c67-7fb2f6c05078 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:12.775057 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e6b340c6-996d-4fd9-8c67-7fb2f6c05078 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1541 microversion: 2.1 time: 0.346112 Jul 19 22:29:12.777000 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 516/980] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:12 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1541 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:12.787253 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-64ba3e1d-76ff-4e24-8593-c403d028c778 req-69e65141-ecce-4fb0-b6ef-ee4d738bdcdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d191bac-6976-461e-9def-4f839a59331e", "name": "network-vif-unplugged", "status": "completed", "tag": "c456a7c4-6281-40e9-846b-1f8734a09c76"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:12.808103 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d042982-ce1e-414e-af69-1732dba03629 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:12.808543 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-64ba3e1d-76ff-4e24-8593-c403d028c778 req-69e65141-ecce-4fb0-b6ef-ee4d738bdcdf service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:12.808743 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d042982-ce1e-414e-af69-1732dba03629 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:12.810030 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-5d042982-ce1e-414e-af69-1732dba03629 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lazy-loading 'fault' on Instance uuid 40ce1872-5f47-4acc-ba80-696b87b062b5 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:29:12.810754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-64ba3e1d-76ff-4e24-8593-c403d028c778 req-69e65141-ecce-4fb0-b6ef-ee4d738bdcdf service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:12.848104 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-64ba3e1d-76ff-4e24-8593-c403d028c778 req-69e65141-ecce-4fb0-b6ef-ee4d738bdcdf service nova] Creating event network-vif-unplugged:c456a7c4-6281-40e9-846b-1f8734a09c76 for instance 3d191bac-6976-461e-9def-4f839a59331e on n-h1-847009-3 Jul 19 22:29:12.858256 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [req-64ba3e1d-76ff-4e24-8593-c403d028c778 req-69e65141-ecce-4fb0-b6ef-ee4d738bdcdf service nova] Instance 3d191bac-6976-461e-9def-4f839a59331e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3'} {{(pid=119337) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 22:29:12.874205 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-64ba3e1d-76ff-4e24-8593-c403d028c778 req-69e65141-ecce-4fb0-b6ef-ee4d738bdcdf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094212 Jul 19 22:29:12.875200 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 517/981] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:12.880569 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5d042982-ce1e-414e-af69-1732dba03629 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66a794a5a4c41498472dd994128703f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53b71f56584a28b7b82c799fb96673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:12.889306 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c6cde766-6e65-4998-a17d-a5882d0625d5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:12.891237 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c6cde766-6e65-4998-a17d-a5882d0625d5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:12.892147 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5d042982-ce1e-414e-af69-1732dba03629 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5" status: 200 len: 1332 microversion: 2.1 time: 0.169816 Jul 19 22:29:12.905841 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 465/982] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:12 2022] GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5 => generated 1332 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:12.917155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c6cde766-6e65-4998-a17d-a5882d0625d5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:12.918525 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c6cde766-6e65-4998-a17d-a5882d0625d5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:12.920348 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c6cde766-6e65-4998-a17d-a5882d0625d5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:12.921387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c6cde766-6e65-4998-a17d-a5882d0625d5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:12.931693 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0c99a849-b6f6-4baf-8658-33ecb1cdcfa0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-420933260", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:13.051234 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-0c99a849-b6f6-4baf-8658-33ecb1cdcfa0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] validate_networks() for None {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:29:13.718633 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c6cde766-6e65-4998-a17d-a5882d0625d5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:13.728602 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c6cde766-6e65-4998-a17d-a5882d0625d5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:13.730226 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c6cde766-6e65-4998-a17d-a5882d0625d5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:13.732452 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c6cde766-6e65-4998-a17d-a5882d0625d5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1411 microversion: 2.25 time: 0.853791 Jul 19 22:29:13.733039 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 518/983] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:29:12 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1411 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:29:13.749214 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d81aad6f-6554-47f5-93bf-47723d164cfa tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Calling method '.version_select at 0x7f7a104b9700>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:13.834687 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d81aad6f-6554-47f5-93bf-47723d164cfa tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/a7d6344dff7540a58021e8d5aa9d997a" status: 200 len: 371 microversion: 2.1 time: 0.089310 Jul 19 22:29:13.839698 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 519/984] 10.222.0.25 () {58 vars in 1241 bytes} [Tue Jul 19 22:29:13 2022] GET /compute/v2.1/os-quota-sets/a7d6344dff7540a58021e8d5aa9d997a => generated 371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:13.847485 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-20bb54fb-2400-4beb-8136-18fc2efb1059 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:13.848403 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-20bb54fb-2400-4beb-8136-18fc2efb1059 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0cc94c67-92c3-491d-974d-1a40bf8757c4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:13.867876 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-20bb54fb-2400-4beb-8136-18fc2efb1059 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:13.869106 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-20bb54fb-2400-4beb-8136-18fc2efb1059 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:13.870480 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-20bb54fb-2400-4beb-8136-18fc2efb1059 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:13.874873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-20bb54fb-2400-4beb-8136-18fc2efb1059 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:13.905390 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-0c99a849-b6f6-4baf-8658-33ecb1cdcfa0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:29:13.905993 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-0c99a849-b6f6-4baf-8658-33ecb1cdcfa0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:29:13.906717 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-0c99a849-b6f6-4baf-8658-33ecb1cdcfa0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:29:13.907375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-0c99a849-b6f6-4baf-8658-33ecb1cdcfa0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:29:13.908460 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-0c99a849-b6f6-4baf-8658-33ecb1cdcfa0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:29:13.941746 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c99a849-b6f6-4baf-8658-33ecb1cdcfa0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:13.942398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c99a849-b6f6-4baf-8658-33ecb1cdcfa0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:13.943652 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c99a849-b6f6-4baf-8658-33ecb1cdcfa0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:13.944290 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c99a849-b6f6-4baf-8658-33ecb1cdcfa0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:14.015209 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-0c99a849-b6f6-4baf-8658-33ecb1cdcfa0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Getting quotas for project 512cc31b5f6546eeb04486cd5213e441. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:29:14.032071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-0c99a849-b6f6-4baf-8658-33ecb1cdcfa0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Getting quotas for user 4781dbc875d24dc490e598b41905a542 and project 512cc31b5f6546eeb04486cd5213e441. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:29:14.060658 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0c99a849-b6f6-4baf-8658-33ecb1cdcfa0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:29:14.065565 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0c99a849-b6f6-4baf-8658-33ecb1cdcfa0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 03987102-e808-4669-a48a-d9cee489c71e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:29:14.163300 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-20bb54fb-2400-4beb-8136-18fc2efb1059 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:14.196245 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-20bb54fb-2400-4beb-8136-18fc2efb1059 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4" status: 200 len: 1319 microversion: 2.1 time: 0.347716 Jul 19 22:29:14.197773 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 520/985] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:13 2022] GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4 => generated 1319 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:14.205702 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0c99a849-b6f6-4baf-8658-33ecb1cdcfa0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.308166 Jul 19 22:29:14.211992 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 466/986] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:29:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:29:14.221485 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-74ca44ca-8f8a-49c6-862d-26b86d42ae57 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:14.222121 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-74ca44ca-8f8a-49c6-862d-26b86d42ae57 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:14.224248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5c45b8f4-b660-4dbd-8e6f-7adabbf2c38a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:14.225814 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5c45b8f4-b660-4dbd-8e6f-7adabbf2c38a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:14.243925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-74ca44ca-8f8a-49c6-862d-26b86d42ae57 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:14.244385 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c45b8f4-b660-4dbd-8e6f-7adabbf2c38a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:14.244608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-74ca44ca-8f8a-49c6-862d-26b86d42ae57 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:14.244907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c45b8f4-b660-4dbd-8e6f-7adabbf2c38a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:14.245202 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-74ca44ca-8f8a-49c6-862d-26b86d42ae57 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:14.245627 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-74ca44ca-8f8a-49c6-862d-26b86d42ae57 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:14.251498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c45b8f4-b660-4dbd-8e6f-7adabbf2c38a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:14.253132 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c45b8f4-b660-4dbd-8e6f-7adabbf2c38a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:14.658456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-74ca44ca-8f8a-49c6-862d-26b86d42ae57 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:14.681446 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-74ca44ca-8f8a-49c6-862d-26b86d42ae57 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1473 microversion: 2.1 time: 0.468417 Jul 19 22:29:14.704097 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 467/987] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:14 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1473 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:14.743773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3a02865e-667b-47a6-88ef-1d039b1605a8 tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Action: 'update', calling method: .version_select at 0x7f7a104b7a60>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:14.983044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a02865e-667b-47a6-88ef-1d039b1605a8 tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:14.983784 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a02865e-667b-47a6-88ef-1d039b1605a8 tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:14.985135 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a02865e-667b-47a6-88ef-1d039b1605a8 tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:14.992036 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a02865e-667b-47a6-88ef-1d039b1605a8 tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:15.051163 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5c45b8f4-b660-4dbd-8e6f-7adabbf2c38a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:15.088643 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5c45b8f4-b660-4dbd-8e6f-7adabbf2c38a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1499 microversion: 2.1 time: 0.869772 Jul 19 22:29:15.089782 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 521/988] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:14 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1499 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:15.112064 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e412db40-cc7d-4736-ac3c-4df080ea719a tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:15.128652 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e412db40-cc7d-4736-ac3c-4df080ea719a tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:15.154120 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e412db40-cc7d-4736-ac3c-4df080ea719a tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:15.160830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e412db40-cc7d-4736-ac3c-4df080ea719a tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:15.162379 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e412db40-cc7d-4736-ac3c-4df080ea719a tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:15.163258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e412db40-cc7d-4736-ac3c-4df080ea719a tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:15.197706 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-e412db40-cc7d-4736-ac3c-4df080ea719a tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] HTTP exception thrown: Instance 40ce1872-5f47-4acc-ba80-696b87b062b5 could not be found. Jul 19 22:29:15.203477 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e412db40-cc7d-4736-ac3c-4df080ea719a tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Request method failure captured: Jul 19 22:29:15.203477 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5 HTTP/1.1 Jul 19 22:29:15.203477 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:29:15.203477 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:29:15.203477 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:29:15.203477 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:29:15.203477 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:29:15.203477 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:29:15.203477 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:29:15.203477 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:29:15.203477 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y9zWxQw0R-nY4SSBETaYsexOHh8R6Yl-zc08BKDRDfpUg3byRbcWtcyxVplJQDXOMfX_qGxcPNbAatffGgOLAaQlpNGilc5TWbJ7ipTqGsVCQ_kQwuRHgSOexhyEr4gmkam8ip26X-DUabNEikv5YaI8sAG9hLTtmWkmpvO2YNZQFg Jul 19 22:29:15.203477 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:29:15.203477 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:29:15.203477 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:29:15.203477 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:29:15.203477 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:29:15.203477 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:29:15.203477 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 3d53b71f56584a28b7b82c799fb96673 Jul 19 22:29:15.203477 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1505670044 Jul 19 22:29:15.203477 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:29:15.203477 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:29:15.205899 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d53b71f56584a28b7b82c799fb96673"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d53b71f56584a28b7b82c799fb96673"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d53b71f56584a28b7b82c799fb96673"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d53b71f56584a28b7b82c799fb96673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:29:15.205899 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1505670044 Jul 19 22:29:15.205899 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 3d53b71f56584a28b7b82c799fb96673 Jul 19 22:29:15.205899 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1505670044 Jul 19 22:29:15.205899 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AttachSCSIVolumeTestJSON-1505670044-project Jul 19 22:29:15.205899 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:29:15.205899 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:29:15.205899 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: e66a794a5a4c41498472dd994128703f Jul 19 22:29:15.205899 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1505670044-project Jul 19 22:29:15.205899 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:29:15.205899 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 40ce1872-5f47-4acc-ba80-696b87b062b5 could not be found. Jul 19 22:29:15.205899 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '40ce1872-5f47-4acc-ba80-696b87b062b5'} Jul 19 22:29:15.207479 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:29:15.207479 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:15.207479 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:29:15.207479 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:29:15.207479 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:29:15.207479 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:29:15.207479 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:29:15.207479 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:29:15.207479 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:29:15.207479 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:29:15.207479 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40ce1872-5f47-4acc-ba80-696b87b062b5 could not be found. Jul 19 22:29:15.207479 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:29:15.207479 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:29:15.207479 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:29:15.207479 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:15.207479 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:29:15.207479 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:29:15.207479 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:29:15.207479 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:29:15.207479 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:29:15.209759 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:29:15.209759 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:29:15.209759 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:29:15.209759 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:29:15.209759 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:29:15.209759 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:29:15.209759 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:29:15.209759 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40ce1872-5f47-4acc-ba80-696b87b062b5 could not be found. Jul 19 22:29:15.209759 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:29:15.209759 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:29:15.209759 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:29:15.209759 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:15.209759 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:29:15.209759 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:29:15.209759 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:29:15.209759 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:29:15.209759 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40ce1872-5f47-4acc-ba80-696b87b062b5 could not be found. Jul 19 22:29:15.209759 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:29:15.218407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e412db40-cc7d-4736-ac3c-4df080ea719a tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Returning 404 to user: Instance 40ce1872-5f47-4acc-ba80-696b87b062b5 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:29:15.220467 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e412db40-cc7d-4736-ac3c-4df080ea719a tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5" status: 404 len: 111 microversion: 2.1 time: 0.117712 Jul 19 22:29:15.227928 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 522/989] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:15 2022] GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:29:15.236974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7812ba03-ba7d-4b31-9456-88308f6bb4d6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:15.239236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7812ba03-ba7d-4b31-9456-88308f6bb4d6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 03987102-e808-4669-a48a-d9cee489c71e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:15.256344 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3a02865e-667b-47a6-88ef-1d039b1605a8 tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/a7d6344dff7540a58021e8d5aa9d997a" status: 200 len: 328 microversion: 2.1 time: 0.549520 Jul 19 22:29:15.263173 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 468/990] 10.222.0.25 () {60 vars in 1261 bytes} [Tue Jul 19 22:29:14 2022] PUT /compute/v2.1/os-quota-sets/a7d6344dff7540a58021e8d5aa9d997a => generated 328 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:15.300253 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2cb085c0-b1b4-489a-8c31-2fd4aa7bded4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:15.306004 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2cb085c0-b1b4-489a-8c31-2fd4aa7bded4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:15.332880 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2cb085c0-b1b4-489a-8c31-2fd4aa7bded4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:15.334232 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2cb085c0-b1b4-489a-8c31-2fd4aa7bded4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:15.336524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2cb085c0-b1b4-489a-8c31-2fd4aa7bded4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:15.341434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2cb085c0-b1b4-489a-8c31-2fd4aa7bded4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:15.587573 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7812ba03-ba7d-4b31-9456-88308f6bb4d6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:15.626552 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7812ba03-ba7d-4b31-9456-88308f6bb4d6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e" status: 200 len: 1213 microversion: 2.1 time: 0.396402 Jul 19 22:29:15.627966 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 523/991] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:15 2022] GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e => generated 1213 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:15.649154 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ebe5af23-97dd-4b33-a6fe-08f2c514d5f8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:15.657433 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ebe5af23-97dd-4b33-a6fe-08f2c514d5f8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0cc94c67-92c3-491d-974d-1a40bf8757c4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:15.672092 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ebe5af23-97dd-4b33-a6fe-08f2c514d5f8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:15.673219 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ebe5af23-97dd-4b33-a6fe-08f2c514d5f8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:15.675764 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ebe5af23-97dd-4b33-a6fe-08f2c514d5f8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:15.676918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ebe5af23-97dd-4b33-a6fe-08f2c514d5f8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:16.140075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2cb085c0-b1b4-489a-8c31-2fd4aa7bded4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:16.156663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2cb085c0-b1b4-489a-8c31-2fd4aa7bded4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:16.159525 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2cb085c0-b1b4-489a-8c31-2fd4aa7bded4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:16.161519 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2cb085c0-b1b4-489a-8c31-2fd4aa7bded4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1411 microversion: 2.25 time: 0.888667 Jul 19 22:29:16.162442 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 469/992] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:29:15 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1411 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:29:16.172473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-40ae839a-8583-4626-b386-7c3d3d4a11d4 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '.version_select at 0x7f7a105648b0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:16.177773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ebe5af23-97dd-4b33-a6fe-08f2c514d5f8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:16.180717 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:29:16.192452 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ebe5af23-97dd-4b33-a6fe-08f2c514d5f8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4" status: 200 len: 1319 microversion: 2.1 time: 0.562652 Jul 19 22:29:16.193282 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 524/993] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:15 2022] GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4 => generated 1319 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:16.199311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-33e7549a-426a-4aa3-8d8c-fdc63a6e1d5b tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-243487750", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:16.216033 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-40ae839a-8583-4626-b386-7c3d3d4a11d4 tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1655168498" status: 202 len: 0 microversion: 2.1 time: 0.050450 Jul 19 22:29:16.220567 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 470/994] 10.222.0.25 () {58 vars in 1220 bytes} [Tue Jul 19 22:29:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1655168498 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:29:16.228559 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-0cdc5509-b5c7-4db4-8846-8fa9197bfb9d req-bc1f179d-bce5-4d6a-be03-681c4d59d137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d871dc5-0189-41e2-8650-8f753bf98c67", "tag": "76972dec-38be-463e-8f2e-775f0e49be0a"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:16.239064 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0cdc5509-b5c7-4db4-8846-8fa9197bfb9d req-bc1f179d-bce5-4d6a-be03-681c4d59d137 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:16.239906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0cdc5509-b5c7-4db4-8846-8fa9197bfb9d req-bc1f179d-bce5-4d6a-be03-681c4d59d137 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:16.259516 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-0cdc5509-b5c7-4db4-8846-8fa9197bfb9d req-bc1f179d-bce5-4d6a-be03-681c4d59d137 service nova] Creating event network-changed:76972dec-38be-463e-8f2e-775f0e49be0a for instance 5d871dc5-0189-41e2-8650-8f753bf98c67 on n-h2-847009-3 Jul 19 22:29:16.269291 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-0cdc5509-b5c7-4db4-8846-8fa9197bfb9d req-bc1f179d-bce5-4d6a-be03-681c4d59d137 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046510 Jul 19 22:29:16.270863 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 471/995] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:16.289326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-be270944-b1fc-4df2-899f-9d3e11271142 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:16.290812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-be270944-b1fc-4df2-899f-9d3e11271142 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:16.295761 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-33e7549a-426a-4aa3-8d8c-fdc63a6e1d5b tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] validate_networks() for None {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:29:16.305895 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be270944-b1fc-4df2-899f-9d3e11271142 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:16.306929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be270944-b1fc-4df2-899f-9d3e11271142 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:16.308048 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be270944-b1fc-4df2-899f-9d3e11271142 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:16.309330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be270944-b1fc-4df2-899f-9d3e11271142 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:17.009759 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-33e7549a-426a-4aa3-8d8c-fdc63a6e1d5b tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:29:17.009989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-be270944-b1fc-4df2-899f-9d3e11271142 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:17.024398 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-33e7549a-426a-4aa3-8d8c-fdc63a6e1d5b tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:29:17.026176 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-33e7549a-426a-4aa3-8d8c-fdc63a6e1d5b tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:29:17.026866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-33e7549a-426a-4aa3-8d8c-fdc63a6e1d5b tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:29:17.031312 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-33e7549a-426a-4aa3-8d8c-fdc63a6e1d5b tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:29:17.062620 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=37 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:29:17.070520 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-33e7549a-426a-4aa3-8d8c-fdc63a6e1d5b tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:17.074017 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-be270944-b1fc-4df2-899f-9d3e11271142 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1470 microversion: 2.1 time: 0.795466 Jul 19 22:29:17.077024 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-33e7549a-426a-4aa3-8d8c-fdc63a6e1d5b tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:17.079506 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-33e7549a-426a-4aa3-8d8c-fdc63a6e1d5b tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:17.080131 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 472/996] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:16 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1470 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:17.081369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-33e7549a-426a-4aa3-8d8c-fdc63a6e1d5b tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:17.104495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c382c8c5-579e-4401-a638-8a3d3b4d1d93 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:17.107864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c382c8c5-579e-4401-a638-8a3d3b4d1d93 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:17.143519 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c382c8c5-579e-4401-a638-8a3d3b4d1d93 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:17.144691 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c382c8c5-579e-4401-a638-8a3d3b4d1d93 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:17.146710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c382c8c5-579e-4401-a638-8a3d3b4d1d93 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:17.148303 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c382c8c5-579e-4401-a638-8a3d3b4d1d93 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:17.171356 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-33e7549a-426a-4aa3-8d8c-fdc63a6e1d5b tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Getting quotas for project a7d6344dff7540a58021e8d5aa9d997a. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:29:17.196602 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-33e7549a-426a-4aa3-8d8c-fdc63a6e1d5b tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Getting quotas for user 045c9ef2aac74819bbe91d09d4644c8f and project a7d6344dff7540a58021e8d5aa9d997a. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:29:17.237973 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.utils [None req-33e7549a-426a-4aa3-8d8c-fdc63a6e1d5b tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] instances quota exceeded for a7d6344dff7540a58021e8d5aa9d997a, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119337) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 19 22:29:17.241787 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-33e7549a-426a-4aa3-8d8c-fdc63a6e1d5b tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 19 22:29:17.244436 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-33e7549a-426a-4aa3-8d8c-fdc63a6e1d5b tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Request method failure captured: Jul 19 22:29:17.244436 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:29:17.244436 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:29:17.244436 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:29:17.244436 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:29:17.244436 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 144 Jul 19 22:29:17.244436 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:29:17.244436 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:29:17.244436 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:29:17.244436 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:29:17.244436 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zAwnjXrXeilHFm4auC3Bn63u_5uUapHZt_r1R7NG-nHApAHz6ALEwEvVWK8xu2S9CZnhK3HBVl7dnvrxBdh4tzmpRnupji6G2NlwbEmHDgy8YtNp_x_HetIaqJlZ3qsrfFbRAMwu2TXhpMkOM1nVY2WtEDLe4EweMbFbc6zSOMnLyw Jul 19 22:29:17.244436 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:29:17.244436 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:29:17.244436 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:29:17.244436 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:29:17.244436 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:29:17.244436 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:29:17.244436 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: a7d6344dff7540a58021e8d5aa9d997a Jul 19 22:29:17.244436 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-QuotasAdminNegativeTest-1150226152 Jul 19 22:29:17.244436 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:29:17.244436 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:29:17.245901 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7d6344dff7540a58021e8d5aa9d997a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7d6344dff7540a58021e8d5aa9d997a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7d6344dff7540a58021e8d5aa9d997a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7d6344dff7540a58021e8d5aa9d997a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:29:17.245901 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-QuotasAdminNegativeTest-1150226152 Jul 19 22:29:17.245901 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: a7d6344dff7540a58021e8d5aa9d997a Jul 19 22:29:17.245901 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1150226152 Jul 19 22:29:17.245901 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-QuotasAdminNegativeTest-1150226152-project Jul 19 22:29:17.245901 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:29:17.245901 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:29:17.245901 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 045c9ef2aac74819bbe91d09d4644c8f Jul 19 22:29:17.245901 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-QuotasAdminNegativeTest-1150226152-project Jul 19 22:29:17.245901 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:29:17.245901 n-d-847009-3 devstack@n-api.service[119337]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-243487750", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}} Jul 19 22:29:17.245901 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:29:17.246757 n-d-847009-3 devstack@n-api.service[119337]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 19 22:29:17.246757 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-243487750', 'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691', 'flavorRef': '452'}}} Jul 19 22:29:17.246757 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:29:17.246757 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:17.246757 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 19 22:29:17.246757 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 19 22:29:17.246757 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:29:17.246757 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:29:17.246757 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 19 22:29:17.246757 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc Jul 19 22:29:17.246757 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 19 22:29:17.246757 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 19 22:29:17.246757 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:29:17.246757 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:29:17.246757 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 19 22:29:17.246757 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 19 22:29:17.246757 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 19 22:29:17.246757 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 19 22:29:17.248052 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 19 22:29:17.248052 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 19 22:29:17.248052 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 19 22:29:17.248052 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:29:17.248052 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:29:17.248052 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:29:17.248052 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:17.248052 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 19 22:29:17.248052 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 19 22:29:17.248052 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 19 22:29:17.248052 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 19 22:29:17.248052 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 19 22:29:17.248052 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 19 22:29:17.248052 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 19 22:29:17.248052 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 19 22:29:17.248052 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 19 22:29:17.248052 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 19 22:29:17.248052 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 19 22:29:17.248052 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:29:17.248052 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:29:17.248052 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:29:17.249300 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:17.249300 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:29:17.249300 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:29:17.249300 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:29:17.249300 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:29:17.249300 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:29:17.249300 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:29:17.249300 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:29:17.249300 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:29:17.249300 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:29:17.249300 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:29:17.249300 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:29:17.249300 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:29:17.249300 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 22:29:17.249300 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 19 22:29:17.249300 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 19 22:29:17.249300 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 19 22:29:17.249300 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:29:17.249300 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:29:17.249300 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:29:17.249300 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:17.250614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:29:17.250614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:29:17.250614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:29:17.250614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:29:17.250614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 19 22:29:17.250614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:29:17.254603 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-33e7549a-426a-4aa3-8d8c-fdc63a6e1d5b tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:29:17.256091 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-33e7549a-426a-4aa3-8d8c-fdc63a6e1d5b tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.061867 Jul 19 22:29:17.261050 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 525/997] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:29:16 2022] POST /compute/v2.1/servers => generated 119 bytes in 1067 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:29:17.271149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a5845476-256c-4fa8-b861-86d23f96a6d9 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:17.272525 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a5845476-256c-4fa8-b861-86d23f96a6d9 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 03987102-e808-4669-a48a-d9cee489c71e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:17.281312 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5845476-256c-4fa8-b861-86d23f96a6d9 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:17.282211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5845476-256c-4fa8-b861-86d23f96a6d9 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:17.284138 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5845476-256c-4fa8-b861-86d23f96a6d9 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:17.284895 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5845476-256c-4fa8-b861-86d23f96a6d9 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:17.452810 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a5845476-256c-4fa8-b861-86d23f96a6d9 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:17.475205 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a5845476-256c-4fa8-b861-86d23f96a6d9 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e" status: 200 len: 1271 microversion: 2.1 time: 0.210661 Jul 19 22:29:17.476149 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 526/998] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:17 2022] GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e => generated 1271 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:17.497020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2630b85b-39d7-417d-b07d-f5957cfcbb7b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:17.498383 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2630b85b-39d7-417d-b07d-f5957cfcbb7b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:17.512471 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2630b85b-39d7-417d-b07d-f5957cfcbb7b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:17.515402 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2630b85b-39d7-417d-b07d-f5957cfcbb7b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:17.518905 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2630b85b-39d7-417d-b07d-f5957cfcbb7b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:17.519997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2630b85b-39d7-417d-b07d-f5957cfcbb7b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:17.620838 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2630b85b-39d7-417d-b07d-f5957cfcbb7b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:17.622722 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2630b85b-39d7-417d-b07d-f5957cfcbb7b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:17.624624 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2630b85b-39d7-417d-b07d-f5957cfcbb7b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:17.625754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2630b85b-39d7-417d-b07d-f5957cfcbb7b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:17.704590 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-2630b85b-39d7-417d-b07d-f5957cfcbb7b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Getting quotas for project eed5e83db4ae4156ae9635b84ca7ff4a. Resources: {'cores', 'ram'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:29:17.716773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-2630b85b-39d7-417d-b07d-f5957cfcbb7b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Getting quotas for user e3ef9d4c38d547a1a1532d964195144a and project eed5e83db4ae4156ae9635b84ca7ff4a. Resources: {'cores', 'ram'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:29:17.762797 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c382c8c5-579e-4401-a638-8a3d3b4d1d93 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:17.782336 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c382c8c5-579e-4401-a638-8a3d3b4d1d93 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1499 microversion: 2.1 time: 0.699482 Jul 19 22:29:17.783058 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 473/999] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:17 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1499 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:17.792207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0a3f6d44-860f-40a2-b40b-7334fb04c166 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:17.793879 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0a3f6d44-860f-40a2-b40b-7334fb04c166 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:17.806732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a3f6d44-860f-40a2-b40b-7334fb04c166 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:17.807940 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a3f6d44-860f-40a2-b40b-7334fb04c166 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:17.810429 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a3f6d44-860f-40a2-b40b-7334fb04c166 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:17.811594 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a3f6d44-860f-40a2-b40b-7334fb04c166 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:17.920324 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2630b85b-39d7-417d-b07d-f5957cfcbb7b tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "POST /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e/action" status: 202 len: 0 microversion: 2.1 time: 0.434701 Jul 19 22:29:17.921744 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 527/1000] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:29:17 2022] POST /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e/action => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:29:17.929289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b7668c23-3d42-4cde-9241-cf88617b4142 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:17.930010 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b7668c23-3d42-4cde-9241-cf88617b4142 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0cc94c67-92c3-491d-974d-1a40bf8757c4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:17.941033 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7668c23-3d42-4cde-9241-cf88617b4142 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:17.941779 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7668c23-3d42-4cde-9241-cf88617b4142 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:17.942718 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7668c23-3d42-4cde-9241-cf88617b4142 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:17.943343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7668c23-3d42-4cde-9241-cf88617b4142 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:18.194648 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0a3f6d44-860f-40a2-b40b-7334fb04c166 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:18.209052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0a3f6d44-860f-40a2-b40b-7334fb04c166 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:18.210997 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0a3f6d44-860f-40a2-b40b-7334fb04c166 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:18.212470 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0a3f6d44-860f-40a2-b40b-7334fb04c166 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1411 microversion: 2.25 time: 0.427453 Jul 19 22:29:18.213938 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 474/1001] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:29:17 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1411 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:29:18.223552 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-9dd4f2c9-bca5-4476-bec0-ec236732b6e6 req-72116b0b-1759-48f7-9718-373e04de66f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca03e7c4-e8c2-43f5-8528-7b2a847ca718", "name": "network-vif-plugged", "status": "completed", "tag": "bd28cab7-fac1-4695-830b-6be183a87784"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:18.243457 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-9dd4f2c9-bca5-4476-bec0-ec236732b6e6 req-72116b0b-1759-48f7-9718-373e04de66f9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:18.244057 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-9dd4f2c9-bca5-4476-bec0-ec236732b6e6 req-72116b0b-1759-48f7-9718-373e04de66f9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:18.254967 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b7668c23-3d42-4cde-9241-cf88617b4142 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:18.268897 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b7668c23-3d42-4cde-9241-cf88617b4142 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4" status: 200 len: 1319 microversion: 2.1 time: 0.345707 Jul 19 22:29:18.272314 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-9dd4f2c9-bca5-4476-bec0-ec236732b6e6 req-72116b0b-1759-48f7-9718-373e04de66f9 service nova] Creating event network-vif-plugged:bd28cab7-fac1-4695-830b-6be183a87784 for instance ca03e7c4-e8c2-43f5-8528-7b2a847ca718 on n-h1-847009-3 Jul 19 22:29:18.279891 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 528/1002] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:17 2022] GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4 => generated 1319 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:18.280502 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-9dd4f2c9-bca5-4476-bec0-ec236732b6e6 req-72116b0b-1759-48f7-9718-373e04de66f9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063366 Jul 19 22:29:18.281167 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 475/1003] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:18.287729 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c4d97a52-8a0e-4db9-bc0b-8df604acab7d tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Action: 'update', calling method: .version_select at 0x7f7a104c55e0>, body: {"quota_set": {"instances": 10}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:18.288683 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e11a5e71-f5fd-4288-9af9-c92342994c5d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:18.290560 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e11a5e71-f5fd-4288-9af9-c92342994c5d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:18.298253 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e11a5e71-f5fd-4288-9af9-c92342994c5d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:18.299424 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e11a5e71-f5fd-4288-9af9-c92342994c5d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:18.299667 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e11a5e71-f5fd-4288-9af9-c92342994c5d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:18.300274 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e11a5e71-f5fd-4288-9af9-c92342994c5d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:18.369434 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c4d97a52-8a0e-4db9-bc0b-8df604acab7d tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:18.369887 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c4d97a52-8a0e-4db9-bc0b-8df604acab7d tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:18.370698 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c4d97a52-8a0e-4db9-bc0b-8df604acab7d tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:18.375493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c4d97a52-8a0e-4db9-bc0b-8df604acab7d tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:18.446477 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c4d97a52-8a0e-4db9-bc0b-8df604acab7d tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/a7d6344dff7540a58021e8d5aa9d997a" status: 200 len: 329 microversion: 2.1 time: 0.165336 Jul 19 22:29:18.447188 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 529/1004] 10.222.0.25 () {60 vars in 1261 bytes} [Tue Jul 19 22:29:18 2022] PUT /compute/v2.1/os-quota-sets/a7d6344dff7540a58021e8d5aa9d997a => generated 329 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:18.459094 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e2fa8511-94be-447e-a19e-a9f61eec98aa tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Calling method '.version_select at 0x7f7a104ef280>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:18.576435 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e2fa8511-94be-447e-a19e-a9f61eec98aa tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/a7d6344dff7540a58021e8d5aa9d997a" status: 200 len: 371 microversion: 2.1 time: 0.121051 Jul 19 22:29:18.577474 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 530/1005] 10.222.0.25 () {58 vars in 1241 bytes} [Tue Jul 19 22:29:18 2022] GET /compute/v2.1/os-quota-sets/a7d6344dff7540a58021e8d5aa9d997a => generated 371 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:18.582553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-df591ef4-ff54-4b86-8d60-09cf2c0fcc6c tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:18.583301 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-df591ef4-ff54-4b86-8d60-09cf2c0fcc6c tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 03987102-e808-4669-a48a-d9cee489c71e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:18.598677 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-df591ef4-ff54-4b86-8d60-09cf2c0fcc6c tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:18.600247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-df591ef4-ff54-4b86-8d60-09cf2c0fcc6c tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:18.602433 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-df591ef4-ff54-4b86-8d60-09cf2c0fcc6c tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:18.625958 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-df591ef4-ff54-4b86-8d60-09cf2c0fcc6c tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:18.760598 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e11a5e71-f5fd-4288-9af9-c92342994c5d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:18.770598 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e11a5e71-f5fd-4288-9af9-c92342994c5d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1469 microversion: 2.1 time: 0.486120 Jul 19 22:29:18.774334 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 476/1006] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:18 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1469 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:18.780735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0d6f6aed-2614-4297-876c-d7f51d65ded6 tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Action: 'update', calling method: .version_select at 0x7f7a104b1af0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:18.791719 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-df591ef4-ff54-4b86-8d60-09cf2c0fcc6c tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:18.812524 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-df591ef4-ff54-4b86-8d60-09cf2c0fcc6c tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e" status: 200 len: 1271 microversion: 2.1 time: 0.234082 Jul 19 22:29:18.818399 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 531/1007] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:18 2022] GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e => generated 1271 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:18.839068 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3d4a6320-2b4b-4e29-b5ea-a390f3008ddd tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:18.840130 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3d4a6320-2b4b-4e29-b5ea-a390f3008ddd tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:18.847892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d4a6320-2b4b-4e29-b5ea-a390f3008ddd tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:18.848488 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d4a6320-2b4b-4e29-b5ea-a390f3008ddd tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:18.849340 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d4a6320-2b4b-4e29-b5ea-a390f3008ddd tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:18.849798 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d4a6320-2b4b-4e29-b5ea-a390f3008ddd tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:18.932536 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d6f6aed-2614-4297-876c-d7f51d65ded6 tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:18.933023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d6f6aed-2614-4297-876c-d7f51d65ded6 tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:18.935844 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d6f6aed-2614-4297-876c-d7f51d65ded6 tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:18.936312 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d6f6aed-2614-4297-876c-d7f51d65ded6 tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:19.043630 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0d6f6aed-2614-4297-876c-d7f51d65ded6 tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/a7d6344dff7540a58021e8d5aa9d997a" status: 200 len: 325 microversion: 2.1 time: 0.267162 Jul 19 22:29:19.047208 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 477/1008] 10.222.0.25 () {60 vars in 1261 bytes} [Tue Jul 19 22:29:18 2022] PUT /compute/v2.1/os-quota-sets/a7d6344dff7540a58021e8d5aa9d997a => generated 325 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:19.160529 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c6f793f1-5f02-4299-8c4d-aa2c9b266ff5 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1813671474", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:19.194398 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3d4a6320-2b4b-4e29-b5ea-a390f3008ddd tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:19.207681 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3d4a6320-2b4b-4e29-b5ea-a390f3008ddd tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1499 microversion: 2.1 time: 0.373825 Jul 19 22:29:19.212431 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 532/1009] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:18 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1499 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:19.243398 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7a98fea4-6393-4757-a6db-d849a22119aa tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:19.245836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7a98fea4-6393-4757-a6db-d849a22119aa tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:19.274607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a98fea4-6393-4757-a6db-d849a22119aa tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:19.290494 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a98fea4-6393-4757-a6db-d849a22119aa tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:19.291532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a98fea4-6393-4757-a6db-d849a22119aa tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:19.291986 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a98fea4-6393-4757-a6db-d849a22119aa tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:19.306339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-c6f793f1-5f02-4299-8c4d-aa2c9b266ff5 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] validate_networks() for None {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:29:19.969984 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7a98fea4-6393-4757-a6db-d849a22119aa tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:19.988467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7a98fea4-6393-4757-a6db-d849a22119aa tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:19.990420 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7a98fea4-6393-4757-a6db-d849a22119aa tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:19.991587 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7a98fea4-6393-4757-a6db-d849a22119aa tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1411 microversion: 2.25 time: 0.753611 Jul 19 22:29:19.992502 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 533/1010] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:29:19 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1411 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:29:19.997596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-73cfcbc5-60e0-453c-a87e-f80ac9556641 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:20.004030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-73cfcbc5-60e0-453c-a87e-f80ac9556641 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0cc94c67-92c3-491d-974d-1a40bf8757c4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:20.007710 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:29:20.019692 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-73cfcbc5-60e0-453c-a87e-f80ac9556641 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:20.020394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-73cfcbc5-60e0-453c-a87e-f80ac9556641 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:20.021368 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-73cfcbc5-60e0-453c-a87e-f80ac9556641 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:20.028869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-73cfcbc5-60e0-453c-a87e-f80ac9556641 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:20.448812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-c6f793f1-5f02-4299-8c4d-aa2c9b266ff5 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:29:20.451313 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-c6f793f1-5f02-4299-8c4d-aa2c9b266ff5 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:29:20.452066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-c6f793f1-5f02-4299-8c4d-aa2c9b266ff5 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:29:20.452712 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-c6f793f1-5f02-4299-8c4d-aa2c9b266ff5 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:29:20.453341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-c6f793f1-5f02-4299-8c4d-aa2c9b266ff5 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:29:20.476944 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6f793f1-5f02-4299-8c4d-aa2c9b266ff5 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:20.478024 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6f793f1-5f02-4299-8c4d-aa2c9b266ff5 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:20.479234 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6f793f1-5f02-4299-8c4d-aa2c9b266ff5 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:20.479897 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6f793f1-5f02-4299-8c4d-aa2c9b266ff5 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:20.500408 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-73cfcbc5-60e0-453c-a87e-f80ac9556641 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:20.506116 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-c6f793f1-5f02-4299-8c4d-aa2c9b266ff5 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Getting quotas for project a7d6344dff7540a58021e8d5aa9d997a. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:29:20.515927 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-c6f793f1-5f02-4299-8c4d-aa2c9b266ff5 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Getting quotas for user 045c9ef2aac74819bbe91d09d4644c8f and project a7d6344dff7540a58021e8d5aa9d997a. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:29:20.522694 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-73cfcbc5-60e0-453c-a87e-f80ac9556641 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4" status: 200 len: 1319 microversion: 2.1 time: 0.528989 Jul 19 22:29:20.526713 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 534/1011] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:19 2022] GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4 => generated 1319 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:20.544106 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-5625cb64-5b65-4d42-9756-f29da1c4f50a req-465e3fc7-61c7-4103-9861-f2622dc75c66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613", "tag": "8551ae32-70fe-4a9f-920b-2e4c5b49340d"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:20.551245 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:29:20.553522 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.utils [None req-c6f793f1-5f02-4299-8c4d-aa2c9b266ff5 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] ram quota exceeded for a7d6344dff7540a58021e8d5aa9d997a, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119338) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 19 22:29:20.556604 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-c6f793f1-5f02-4299-8c4d-aa2c9b266ff5 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 19 22:29:20.564401 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c6f793f1-5f02-4299-8c4d-aa2c9b266ff5 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Request method failure captured: Jul 19 22:29:20.564401 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:29:20.564401 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:29:20.564401 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:29:20.564401 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:29:20.564401 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 145 Jul 19 22:29:20.564401 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:29:20.564401 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:29:20.564401 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:29:20.564401 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:29:20.564401 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zAwnjXrXeilHFm4auC3Bn63u_5uUapHZt_r1R7NG-nHApAHz6ALEwEvVWK8xu2S9CZnhK3HBVl7dnvrxBdh4tzmpRnupji6G2NlwbEmHDgy8YtNp_x_HetIaqJlZ3qsrfFbRAMwu2TXhpMkOM1nVY2WtEDLe4EweMbFbc6zSOMnLyw Jul 19 22:29:20.564401 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:29:20.564401 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:29:20.564401 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:29:20.564401 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:29:20.564401 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:29:20.564401 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:29:20.564401 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a7d6344dff7540a58021e8d5aa9d997a Jul 19 22:29:20.564401 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-QuotasAdminNegativeTest-1150226152 Jul 19 22:29:20.564401 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:29:20.564401 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:29:20.565747 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7d6344dff7540a58021e8d5aa9d997a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7d6344dff7540a58021e8d5aa9d997a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7d6344dff7540a58021e8d5aa9d997a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7d6344dff7540a58021e8d5aa9d997a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:29:20.565747 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-QuotasAdminNegativeTest-1150226152 Jul 19 22:29:20.565747 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a7d6344dff7540a58021e8d5aa9d997a Jul 19 22:29:20.565747 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1150226152 Jul 19 22:29:20.565747 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-QuotasAdminNegativeTest-1150226152-project Jul 19 22:29:20.565747 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:29:20.565747 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:29:20.565747 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 045c9ef2aac74819bbe91d09d4644c8f Jul 19 22:29:20.565747 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-QuotasAdminNegativeTest-1150226152-project Jul 19 22:29:20.565747 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:29:20.565747 n-d-847009-3 devstack@n-api.service[119338]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1813671474", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}} Jul 19 22:29:20.565747 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:29:20.566589 n-d-847009-3 devstack@n-api.service[119338]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 19 22:29:20.566589 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1813671474', 'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691', 'flavorRef': '452'}}} Jul 19 22:29:20.566589 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:29:20.566589 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:20.566589 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 19 22:29:20.566589 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 19 22:29:20.566589 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:29:20.566589 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:29:20.566589 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 19 22:29:20.566589 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc Jul 19 22:29:20.566589 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 19 22:29:20.566589 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 19 22:29:20.566589 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:29:20.566589 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:29:20.566589 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 19 22:29:20.566589 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 19 22:29:20.566589 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 19 22:29:20.566589 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 19 22:29:20.567687 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 19 22:29:20.567687 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 19 22:29:20.567687 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 19 22:29:20.567687 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:29:20.567687 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:29:20.567687 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:29:20.567687 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:20.567687 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 19 22:29:20.567687 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 19 22:29:20.567687 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 19 22:29:20.567687 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 19 22:29:20.567687 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 19 22:29:20.567687 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 19 22:29:20.567687 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 19 22:29:20.567687 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 19 22:29:20.567687 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 19 22:29:20.567687 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 19 22:29:20.567687 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 19 22:29:20.567687 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:29:20.567687 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:29:20.567687 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:29:20.568886 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:20.568886 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:29:20.568886 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:29:20.568886 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:29:20.568886 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:29:20.568886 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:29:20.568886 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:29:20.568886 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:29:20.568886 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:29:20.568886 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:29:20.568886 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:29:20.568886 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:29:20.568886 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:29:20.568886 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 22:29:20.568886 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 19 22:29:20.568886 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 19 22:29:20.568886 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 19 22:29:20.568886 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:29:20.568886 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:29:20.568886 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:29:20.568886 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:20.572389 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:29:20.572389 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:29:20.572389 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:29:20.572389 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:29:20.572389 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 19 22:29:20.572389 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:29:20.579433 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-5625cb64-5b65-4d42-9756-f29da1c4f50a req-465e3fc7-61c7-4103-9861-f2622dc75c66 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:20.581148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c6f793f1-5f02-4299-8c4d-aa2c9b266ff5 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:29:20.582282 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c6f793f1-5f02-4299-8c4d-aa2c9b266ff5 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.452437 Jul 19 22:29:20.583702 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-5625cb64-5b65-4d42-9756-f29da1c4f50a req-465e3fc7-61c7-4103-9861-f2622dc75c66 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:20.589084 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 478/1012] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:29:19 2022] POST /compute/v2.1/servers => generated 110 bytes in 1459 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:29:20.609490 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7499df08-78ea-4a8a-84c2-7b16b72cc16f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:20.612039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7499df08-78ea-4a8a-84c2-7b16b72cc16f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:20.653987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7499df08-78ea-4a8a-84c2-7b16b72cc16f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:20.655179 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7499df08-78ea-4a8a-84c2-7b16b72cc16f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:20.657119 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7499df08-78ea-4a8a-84c2-7b16b72cc16f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:20.658241 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-5625cb64-5b65-4d42-9756-f29da1c4f50a req-465e3fc7-61c7-4103-9861-f2622dc75c66 service nova] Creating event network-changed:8551ae32-70fe-4a9f-920b-2e4c5b49340d for instance 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 on n-h2-847009-3 Jul 19 22:29:20.659100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7499df08-78ea-4a8a-84c2-7b16b72cc16f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:20.672843 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-5625cb64-5b65-4d42-9756-f29da1c4f50a req-465e3fc7-61c7-4103-9861-f2622dc75c66 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142458 Jul 19 22:29:20.673114 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 535/1013] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:20.685487 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a42855f2-7812-4297-9236-2eaf194fb4fe tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:20.686400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a42855f2-7812-4297-9236-2eaf194fb4fe tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 03987102-e808-4669-a48a-d9cee489c71e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:20.704502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a42855f2-7812-4297-9236-2eaf194fb4fe tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:20.704994 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a42855f2-7812-4297-9236-2eaf194fb4fe tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:20.708229 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a42855f2-7812-4297-9236-2eaf194fb4fe tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:20.709443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a42855f2-7812-4297-9236-2eaf194fb4fe tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:21.296203 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7499df08-78ea-4a8a-84c2-7b16b72cc16f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:21.304319 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a42855f2-7812-4297-9236-2eaf194fb4fe tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:21.313690 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7499df08-78ea-4a8a-84c2-7b16b72cc16f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1469 microversion: 2.1 time: 0.720179 Jul 19 22:29:21.318602 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a42855f2-7812-4297-9236-2eaf194fb4fe tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e" status: 200 len: 1313 microversion: 2.1 time: 0.644154 Jul 19 22:29:21.319465 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 479/1014] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:20 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1469 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:21.321754 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 536/1015] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:20 2022] GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e => generated 1313 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:21.329768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-ef6b4044-c257-4a65-87e4-43699bf64973 req-c46d8cff-3b45-4ec7-bdcc-6cfba916aa6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc94c67-92c3-491d-974d-1a40bf8757c4", "name": "network-vif-plugged", "status": "completed", "tag": "36c690fa-f832-4d8c-967c-46b6df7eda25"}, {"server_uuid": "3d191bac-6976-461e-9def-4f839a59331e", "name": "network-vif-plugged", "status": "completed", "tag": "c456a7c4-6281-40e9-846b-1f8734a09c76"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:21.332196 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d7f85345-ead8-4b80-bda6-af55c3ddea4f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:21.332978 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d7f85345-ead8-4b80-bda6-af55c3ddea4f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:21.348284 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7f85345-ead8-4b80-bda6-af55c3ddea4f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:21.348739 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7f85345-ead8-4b80-bda6-af55c3ddea4f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:21.349524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7f85345-ead8-4b80-bda6-af55c3ddea4f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:21.352101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-ef6b4044-c257-4a65-87e4-43699bf64973 req-c46d8cff-3b45-4ec7-bdcc-6cfba916aa6e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:21.352639 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7f85345-ead8-4b80-bda6-af55c3ddea4f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:21.357803 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-ef6b4044-c257-4a65-87e4-43699bf64973 req-c46d8cff-3b45-4ec7-bdcc-6cfba916aa6e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:21.396956 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-ef6b4044-c257-4a65-87e4-43699bf64973 req-c46d8cff-3b45-4ec7-bdcc-6cfba916aa6e service nova] Creating event network-vif-plugged:36c690fa-f832-4d8c-967c-46b6df7eda25 for instance 0cc94c67-92c3-491d-974d-1a40bf8757c4 on n-h2-847009-3 Jul 19 22:29:21.397387 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-ef6b4044-c257-4a65-87e4-43699bf64973 req-c46d8cff-3b45-4ec7-bdcc-6cfba916aa6e service nova] Creating event network-vif-plugged:c456a7c4-6281-40e9-846b-1f8734a09c76 for instance 3d191bac-6976-461e-9def-4f839a59331e on n-h1-847009-3 Jul 19 22:29:21.409346 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [req-ef6b4044-c257-4a65-87e4-43699bf64973 req-c46d8cff-3b45-4ec7-bdcc-6cfba916aa6e service nova] Instance 3d191bac-6976-461e-9def-4f839a59331e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3'} {{(pid=119337) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 22:29:21.425428 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-ef6b4044-c257-4a65-87e4-43699bf64973 req-c46d8cff-3b45-4ec7-bdcc-6cfba916aa6e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.102226 Jul 19 22:29:21.426283 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 537/1016] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:21.432243 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9953dfe2-c0ec-40b1-b78c-2652f581dbbd tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Action: 'update', calling method: .version_select at 0x7f7a1050e4c0>, body: {"quota_set": {"ram": 51200}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:21.574476 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9953dfe2-c0ec-40b1-b78c-2652f581dbbd tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:21.575769 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9953dfe2-c0ec-40b1-b78c-2652f581dbbd tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:21.576432 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9953dfe2-c0ec-40b1-b78c-2652f581dbbd tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:21.576991 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9953dfe2-c0ec-40b1-b78c-2652f581dbbd tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:21.660248 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d7f85345-ead8-4b80-bda6-af55c3ddea4f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:21.675706 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d7f85345-ead8-4b80-bda6-af55c3ddea4f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1499 microversion: 2.1 time: 0.354236 Jul 19 22:29:21.676788 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 480/1017] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:21 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1499 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:21.677808 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9953dfe2-c0ec-40b1-b78c-2652f581dbbd tempest-QuotasAdminNegativeTest-60521688 tempest-QuotasAdminNegativeTest-60521688-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/a7d6344dff7540a58021e8d5aa9d997a" status: 200 len: 329 microversion: 2.1 time: 0.249452 Jul 19 22:29:21.689642 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 538/1018] 10.222.0.25 () {60 vars in 1261 bytes} [Tue Jul 19 22:29:21 2022] PUT /compute/v2.1/os-quota-sets/a7d6344dff7540a58021e8d5aa9d997a => generated 329 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:21.690411 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b4d6cf4c-0e3d-4a73-953e-adc7e58617b9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:21.691343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b4d6cf4c-0e3d-4a73-953e-adc7e58617b9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0cc94c67-92c3-491d-974d-1a40bf8757c4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:21.696373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-43270a0f-89db-4d6a-86e6-afaf72ce845a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:21.697316 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-43270a0f-89db-4d6a-86e6-afaf72ce845a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:21.701113 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b4d6cf4c-0e3d-4a73-953e-adc7e58617b9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:21.701736 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b4d6cf4c-0e3d-4a73-953e-adc7e58617b9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:21.704913 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b4d6cf4c-0e3d-4a73-953e-adc7e58617b9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:21.704913 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b4d6cf4c-0e3d-4a73-953e-adc7e58617b9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:21.707750 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43270a0f-89db-4d6a-86e6-afaf72ce845a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:21.708484 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43270a0f-89db-4d6a-86e6-afaf72ce845a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:21.712185 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43270a0f-89db-4d6a-86e6-afaf72ce845a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:21.712894 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43270a0f-89db-4d6a-86e6-afaf72ce845a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:22.002229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-43270a0f-89db-4d6a-86e6-afaf72ce845a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:22.006067 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b4d6cf4c-0e3d-4a73-953e-adc7e58617b9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:22.016700 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-43270a0f-89db-4d6a-86e6-afaf72ce845a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:22.018994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-43270a0f-89db-4d6a-86e6-afaf72ce845a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:22.020218 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-43270a0f-89db-4d6a-86e6-afaf72ce845a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1411 microversion: 2.25 time: 0.341521 Jul 19 22:29:22.021638 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 481/1019] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:29:21 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1411 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:29:22.025181 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b4d6cf4c-0e3d-4a73-953e-adc7e58617b9 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4" status: 200 len: 1319 microversion: 2.1 time: 0.343753 Jul 19 22:29:22.026119 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 539/1020] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:21 2022] GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:22.029764 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7fc08039-0dd2-444a-8042-5a849aab31e3 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Action: 'update', calling method: .version_select at 0x7f7a1042f1f0>, body: {"quota_set": {"ram": 0}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:22.033823 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7fc08039-0dd2-444a-8042-5a849aab31e3 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '045c9ef2aac74819bbe91d09d4644c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d6344dff7540a58021e8d5aa9d997a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:22.050433 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7fc08039-0dd2-444a-8042-5a849aab31e3 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Request method failure captured: Jul 19 22:29:22.050433 n-d-847009-3 devstack@n-api.service[119338]: request: PUT /compute/v2.1/os-quota-sets/a7d6344dff7540a58021e8d5aa9d997a HTTP/1.1 Jul 19 22:29:22.050433 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:29:22.050433 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:29:22.050433 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:29:22.050433 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 25 Jul 19 22:29:22.050433 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:29:22.050433 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:29:22.050433 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:29:22.050433 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:29:22.050433 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zAwnjXrXeilHFm4auC3Bn63u_5uUapHZt_r1R7NG-nHApAHz6ALEwEvVWK8xu2S9CZnhK3HBVl7dnvrxBdh4tzmpRnupji6G2NlwbEmHDgy8YtNp_x_HetIaqJlZ3qsrfFbRAMwu2TXhpMkOM1nVY2WtEDLe4EweMbFbc6zSOMnLyw Jul 19 22:29:22.050433 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:29:22.050433 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:29:22.050433 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:29:22.050433 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:29:22.050433 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:29:22.050433 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:29:22.050433 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a7d6344dff7540a58021e8d5aa9d997a Jul 19 22:29:22.050433 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-QuotasAdminNegativeTest-1150226152 Jul 19 22:29:22.050433 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:29:22.050433 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:29:22.052337 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7d6344dff7540a58021e8d5aa9d997a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7d6344dff7540a58021e8d5aa9d997a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7d6344dff7540a58021e8d5aa9d997a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7d6344dff7540a58021e8d5aa9d997a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:29:22.052337 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-QuotasAdminNegativeTest-1150226152 Jul 19 22:29:22.052337 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a7d6344dff7540a58021e8d5aa9d997a Jul 19 22:29:22.052337 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1150226152 Jul 19 22:29:22.052337 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-QuotasAdminNegativeTest-1150226152-project Jul 19 22:29:22.052337 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:29:22.052337 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:29:22.052337 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 045c9ef2aac74819bbe91d09d4644c8f Jul 19 22:29:22.052337 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-QuotasAdminNegativeTest-1150226152-project Jul 19 22:29:22.052337 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:29:22.052337 n-d-847009-3 devstack@n-api.service[119338]: {"quota_set": {"ram": 0}} Jul 19 22:29:22.052337 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:29:22.052337 n-d-847009-3 devstack@n-api.service[119338]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 19 22:29:22.052337 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'a7d6344dff7540a58021e8d5aa9d997a', 'body': {'quota_set': {'ram': 0}}} Jul 19 22:29:22.053321 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:29:22.053321 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:22.053321 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:29:22.053321 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:29:22.053321 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:29:22.053321 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:29:22.053321 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:29:22.053321 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:29:22.053321 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:29:22.053321 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:29:22.053321 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:29:22.053321 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:29:22.053321 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 19 22:29:22.053321 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 19 22:29:22.053321 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 22:29:22.053321 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:29:22.053321 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 22:29:22.053321 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:29:22.053321 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 19 22:29:22.055795 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 19 22:29:22.055795 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:29:22.055795 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:29:22.055795 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:29:22.055795 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:29:22.055795 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:29:22.055795 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:29:22.055795 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:29:22.055795 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:29:22.055795 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:29:22.055795 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:29:22.055795 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:29:22.055795 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:29:22.055795 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:29:22.055795 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:29:22.055795 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 19 22:29:22.055795 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:29:22.055795 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:29:22.055795 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:29:22.055795 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:22.057765 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:29:22.057765 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:29:22.057765 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:29:22.057765 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:29:22.057765 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 19 22:29:22.057765 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:29:22.057765 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7fc08039-0dd2-444a-8042-5a849aab31e3 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:29:22.057765 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7fc08039-0dd2-444a-8042-5a849aab31e3 tempest-QuotasAdminNegativeTest-1150226152 tempest-QuotasAdminNegativeTest-1150226152-project] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/a7d6344dff7540a58021e8d5aa9d997a" status: 403 len: 116 microversion: 2.1 time: 0.029424 Jul 19 22:29:22.057765 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 482/1021] 10.222.0.25 () {60 vars in 1261 bytes} [Tue Jul 19 22:29:22 2022] PUT /compute/v2.1/os-quota-sets/a7d6344dff7540a58021e8d5aa9d997a => generated 116 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:29:22.342178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-91d981ab-0e01-48fc-b31b-220b4b19b4f6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:22.347756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-402c2d1c-d3a6-4166-b9a8-aad81b3be9db tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:22.348508 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-402c2d1c-d3a6-4166-b9a8-aad81b3be9db tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:22.351048 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-91d981ab-0e01-48fc-b31b-220b4b19b4f6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 03987102-e808-4669-a48a-d9cee489c71e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:22.380715 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-91d981ab-0e01-48fc-b31b-220b4b19b4f6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:22.382306 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-91d981ab-0e01-48fc-b31b-220b4b19b4f6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:22.383356 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-91d981ab-0e01-48fc-b31b-220b4b19b4f6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:22.384744 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-91d981ab-0e01-48fc-b31b-220b4b19b4f6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:22.431568 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-402c2d1c-d3a6-4166-b9a8-aad81b3be9db tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:22.433051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-402c2d1c-d3a6-4166-b9a8-aad81b3be9db tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:22.435605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-402c2d1c-d3a6-4166-b9a8-aad81b3be9db tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:22.436399 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-402c2d1c-d3a6-4166-b9a8-aad81b3be9db tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:22.923714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-91d981ab-0e01-48fc-b31b-220b4b19b4f6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:22.927583 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-402c2d1c-d3a6-4166-b9a8-aad81b3be9db tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:22.937861 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-402c2d1c-d3a6-4166-b9a8-aad81b3be9db tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1469 microversion: 2.1 time: 0.594020 Jul 19 22:29:22.942631 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-91d981ab-0e01-48fc-b31b-220b4b19b4f6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e" status: 200 len: 1313 microversion: 2.1 time: 0.605144 Jul 19 22:29:22.947493 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 483/1022] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:22 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1469 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:22.953126 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d839260e-b68a-4d37-974f-1df12cbd6a40 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:22.953926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d839260e-b68a-4d37-974f-1df12cbd6a40 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:22.959057 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 540/1023] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:22 2022] GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e => generated 1313 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:22.960763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d839260e-b68a-4d37-974f-1df12cbd6a40 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:22.961369 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d839260e-b68a-4d37-974f-1df12cbd6a40 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:22.962561 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d839260e-b68a-4d37-974f-1df12cbd6a40 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:22.963239 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d839260e-b68a-4d37-974f-1df12cbd6a40 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:22.970504 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-0f2cfb89-2c9f-4b6b-b73f-1e66cacc5ecf req-97f76e74-b41e-49ea-8666-e9a2bb412df0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03987102-e808-4669-a48a-d9cee489c71e", "tag": "174e2193-cdeb-4c38-baad-2354f434d257"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:22.987842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-0f2cfb89-2c9f-4b6b-b73f-1e66cacc5ecf req-97f76e74-b41e-49ea-8666-e9a2bb412df0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:22.990169 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-0f2cfb89-2c9f-4b6b-b73f-1e66cacc5ecf req-97f76e74-b41e-49ea-8666-e9a2bb412df0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:23.020447 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-0f2cfb89-2c9f-4b6b-b73f-1e66cacc5ecf req-97f76e74-b41e-49ea-8666-e9a2bb412df0 service nova] Creating event network-changed:174e2193-cdeb-4c38-baad-2354f434d257 for instance 03987102-e808-4669-a48a-d9cee489c71e on n-h2-847009-3 Jul 19 22:29:23.033830 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-0f2cfb89-2c9f-4b6b-b73f-1e66cacc5ecf req-97f76e74-b41e-49ea-8666-e9a2bb412df0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072647 Jul 19 22:29:23.035892 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 541/1024] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:23.052365 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-00ac6863-6489-4077-b1b9-4af5dfb4ebf3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:23.053352 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-00ac6863-6489-4077-b1b9-4af5dfb4ebf3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0cc94c67-92c3-491d-974d-1a40bf8757c4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:23.063040 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-00ac6863-6489-4077-b1b9-4af5dfb4ebf3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:23.063800 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-00ac6863-6489-4077-b1b9-4af5dfb4ebf3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:23.064760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-00ac6863-6489-4077-b1b9-4af5dfb4ebf3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:23.065400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-00ac6863-6489-4077-b1b9-4af5dfb4ebf3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:23.237858 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d839260e-b68a-4d37-974f-1df12cbd6a40 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:23.255450 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d839260e-b68a-4d37-974f-1df12cbd6a40 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1499 microversion: 2.1 time: 0.305832 Jul 19 22:29:23.267763 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 484/1025] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:22 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1499 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:23.291687 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bc9e41ee-5f50-4db0-a3a2-24941f5f5b7a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:23.292545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bc9e41ee-5f50-4db0-a3a2-24941f5f5b7a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:23.301909 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bc9e41ee-5f50-4db0-a3a2-24941f5f5b7a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:23.303229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bc9e41ee-5f50-4db0-a3a2-24941f5f5b7a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:23.304047 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bc9e41ee-5f50-4db0-a3a2-24941f5f5b7a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:23.304822 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bc9e41ee-5f50-4db0-a3a2-24941f5f5b7a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:23.330752 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-00ac6863-6489-4077-b1b9-4af5dfb4ebf3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:23.342057 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-00ac6863-6489-4077-b1b9-4af5dfb4ebf3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4" status: 200 len: 1319 microversion: 2.1 time: 0.296375 Jul 19 22:29:23.343358 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 542/1026] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:23 2022] GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4 => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:29:23.579474 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bc9e41ee-5f50-4db0-a3a2-24941f5f5b7a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:23.606359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:29:23.644588 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bc9e41ee-5f50-4db0-a3a2-24941f5f5b7a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:23.649891 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bc9e41ee-5f50-4db0-a3a2-24941f5f5b7a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:23.651381 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bc9e41ee-5f50-4db0-a3a2-24941f5f5b7a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1411 microversion: 2.25 time: 0.365130 Jul 19 22:29:23.661362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-74c883c2-80c9-4eec-90e8-fc41de5e28f3 req-6da7cc8f-8548-4de7-96c3-2769cd5cae19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d871dc5-0189-41e2-8650-8f753bf98c67", "name": "network-vif-plugged", "status": "completed", "tag": "76972dec-38be-463e-8f2e-775f0e49be0a"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:23.672104 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 485/1027] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:29:23 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1411 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:29:23.684794 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-74c883c2-80c9-4eec-90e8-fc41de5e28f3 req-6da7cc8f-8548-4de7-96c3-2769cd5cae19 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:23.685257 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-74c883c2-80c9-4eec-90e8-fc41de5e28f3 req-6da7cc8f-8548-4de7-96c3-2769cd5cae19 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:23.712078 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:29:23.721270 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-74c883c2-80c9-4eec-90e8-fc41de5e28f3 req-6da7cc8f-8548-4de7-96c3-2769cd5cae19 service nova] Creating event network-vif-plugged:76972dec-38be-463e-8f2e-775f0e49be0a for instance 5d871dc5-0189-41e2-8650-8f753bf98c67 on n-h2-847009-3 Jul 19 22:29:23.731789 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-74c883c2-80c9-4eec-90e8-fc41de5e28f3 req-6da7cc8f-8548-4de7-96c3-2769cd5cae19 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073909 Jul 19 22:29:23.733597 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 543/1028] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:29:23.957526 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-36844080-776b-44c3-9356-7dd8ca45b798 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:23.959400 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-36844080-776b-44c3-9356-7dd8ca45b798 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:23.975860 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-74393d5b-52ae-43d5-bece-389b4bc0e6bb tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:23.978917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-74393d5b-52ae-43d5-bece-389b4bc0e6bb tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 03987102-e808-4669-a48a-d9cee489c71e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:23.990469 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-36844080-776b-44c3-9356-7dd8ca45b798 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:23.992502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74393d5b-52ae-43d5-bece-389b4bc0e6bb tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:23.993341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-36844080-776b-44c3-9356-7dd8ca45b798 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:23.993777 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74393d5b-52ae-43d5-bece-389b4bc0e6bb tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:23.995184 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74393d5b-52ae-43d5-bece-389b4bc0e6bb tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:23.995390 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-36844080-776b-44c3-9356-7dd8ca45b798 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:23.996340 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74393d5b-52ae-43d5-bece-389b4bc0e6bb tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:23.998242 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-36844080-776b-44c3-9356-7dd8ca45b798 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:24.465257 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-74393d5b-52ae-43d5-bece-389b4bc0e6bb tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:24.480112 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-74393d5b-52ae-43d5-bece-389b4bc0e6bb tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e" status: 200 len: 1313 microversion: 2.1 time: 0.511067 Jul 19 22:29:24.482121 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 544/1029] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:23 2022] GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e => generated 1313 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:24.488121 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-36844080-776b-44c3-9356-7dd8ca45b798 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:24.502705 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-36844080-776b-44c3-9356-7dd8ca45b798 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1535 microversion: 2.1 time: 0.550914 Jul 19 22:29:24.506172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-49055bc6-bbfa-4b21-8210-2fe759923aa0 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:24.508885 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 486/1030] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:23 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1535 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:24.512716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-49055bc6-bbfa-4b21-8210-2fe759923aa0 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:24.528279 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-03f9130f-01ca-4360-974b-c540ce8f35c8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:24.530047 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-03f9130f-01ca-4360-974b-c540ce8f35c8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0cc94c67-92c3-491d-974d-1a40bf8757c4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:24.546877 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49055bc6-bbfa-4b21-8210-2fe759923aa0 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:24.549297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49055bc6-bbfa-4b21-8210-2fe759923aa0 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:24.550502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49055bc6-bbfa-4b21-8210-2fe759923aa0 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:24.553292 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49055bc6-bbfa-4b21-8210-2fe759923aa0 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:24.560527 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-03f9130f-01ca-4360-974b-c540ce8f35c8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:24.566202 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-03f9130f-01ca-4360-974b-c540ce8f35c8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:24.567926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-03f9130f-01ca-4360-974b-c540ce8f35c8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:24.571142 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-03f9130f-01ca-4360-974b-c540ce8f35c8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:24.909101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-49055bc6-bbfa-4b21-8210-2fe759923aa0 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:24.919405 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-49055bc6-bbfa-4b21-8210-2fe759923aa0 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1499 microversion: 2.1 time: 0.434717 Jul 19 22:29:24.939171 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 545/1031] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:24 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1499 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:24.945981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4b5ca227-2640-4a9d-b3c0-6f51b342a2e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:24.946940 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4b5ca227-2640-4a9d-b3c0-6f51b342a2e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:24.958734 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4b5ca227-2640-4a9d-b3c0-6f51b342a2e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:24.959384 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4b5ca227-2640-4a9d-b3c0-6f51b342a2e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:24.960347 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4b5ca227-2640-4a9d-b3c0-6f51b342a2e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:24.961224 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4b5ca227-2640-4a9d-b3c0-6f51b342a2e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:25.103294 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-03f9130f-01ca-4360-974b-c540ce8f35c8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:25.134947 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-03f9130f-01ca-4360-974b-c540ce8f35c8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4" status: 200 len: 1319 microversion: 2.1 time: 0.622160 Jul 19 22:29:25.136987 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 487/1032] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:24 2022] GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4 => generated 1319 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:25.147443 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9ba5d023-53fd-4e22-90de-1d6c718ac17c tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:25.148910 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9ba5d023-53fd-4e22-90de-1d6c718ac17c tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:25.159506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ba5d023-53fd-4e22-90de-1d6c718ac17c tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:25.161626 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ba5d023-53fd-4e22-90de-1d6c718ac17c tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:25.163537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ba5d023-53fd-4e22-90de-1d6c718ac17c tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:25.168925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ba5d023-53fd-4e22-90de-1d6c718ac17c tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:25.235582 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-9ba5d023-53fd-4e22-90de-1d6c718ac17c tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] HTTP exception thrown: Instance 40ce1872-5f47-4acc-ba80-696b87b062b5 could not be found. Jul 19 22:29:25.245271 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9ba5d023-53fd-4e22-90de-1d6c718ac17c tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Request method failure captured: Jul 19 22:29:25.245271 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5 HTTP/1.1 Jul 19 22:29:25.245271 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:29:25.245271 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:29:25.245271 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:29:25.245271 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:29:25.245271 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:29:25.245271 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:29:25.245271 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:29:25.245271 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:29:25.245271 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y9zWxQw0R-nY4SSBETaYsexOHh8R6Yl-zc08BKDRDfpUg3byRbcWtcyxVplJQDXOMfX_qGxcPNbAatffGgOLAaQlpNGilc5TWbJ7ipTqGsVCQ_kQwuRHgSOexhyEr4gmkam8ip26X-DUabNEikv5YaI8sAG9hLTtmWkmpvO2YNZQFg Jul 19 22:29:25.245271 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:29:25.245271 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:29:25.245271 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:29:25.245271 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:29:25.245271 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:29:25.245271 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:29:25.245271 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 3d53b71f56584a28b7b82c799fb96673 Jul 19 22:29:25.245271 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1505670044 Jul 19 22:29:25.245271 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:29:25.245271 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:29:25.248778 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d53b71f56584a28b7b82c799fb96673"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d53b71f56584a28b7b82c799fb96673"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d53b71f56584a28b7b82c799fb96673"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d53b71f56584a28b7b82c799fb96673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:29:25.248778 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1505670044 Jul 19 22:29:25.248778 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 3d53b71f56584a28b7b82c799fb96673 Jul 19 22:29:25.248778 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1505670044 Jul 19 22:29:25.248778 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-AttachSCSIVolumeTestJSON-1505670044-project Jul 19 22:29:25.248778 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:29:25.248778 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:29:25.248778 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: e66a794a5a4c41498472dd994128703f Jul 19 22:29:25.248778 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1505670044-project Jul 19 22:29:25.248778 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:29:25.248778 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 40ce1872-5f47-4acc-ba80-696b87b062b5 could not be found. Jul 19 22:29:25.248778 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '40ce1872-5f47-4acc-ba80-696b87b062b5'} Jul 19 22:29:25.250147 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:29:25.250147 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:25.250147 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:29:25.250147 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:29:25.250147 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:29:25.250147 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:29:25.250147 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:29:25.250147 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:29:25.250147 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:29:25.250147 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:29:25.250147 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40ce1872-5f47-4acc-ba80-696b87b062b5 could not be found. Jul 19 22:29:25.250147 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:29:25.250147 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:29:25.250147 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:29:25.250147 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:25.250147 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:29:25.250147 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:29:25.250147 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:29:25.250147 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:29:25.250147 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:29:25.252778 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:29:25.252778 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:29:25.252778 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:29:25.252778 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:29:25.252778 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:29:25.252778 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:29:25.252778 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:29:25.252778 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:29:25.252778 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:29:25.252778 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40ce1872-5f47-4acc-ba80-696b87b062b5 could not be found. Jul 19 22:29:25.252778 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:29:25.252778 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:29:25.252778 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:29:25.252778 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:25.252778 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:29:25.252778 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:29:25.252778 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:29:25.252778 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:29:25.252778 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40ce1872-5f47-4acc-ba80-696b87b062b5 could not be found. Jul 19 22:29:25.252778 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:29:25.262561 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9ba5d023-53fd-4e22-90de-1d6c718ac17c tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Returning 404 to user: Instance 40ce1872-5f47-4acc-ba80-696b87b062b5 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:29:25.262561 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9ba5d023-53fd-4e22-90de-1d6c718ac17c tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5" status: 404 len: 111 microversion: 2.1 time: 0.118054 Jul 19 22:29:25.263364 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 488/1033] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:29:25 2022] DELETE /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:29:25.273109 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-db0f873f-ade1-4b44-8f27-6e6dbaecb10b tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:25.274628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-db0f873f-ade1-4b44-8f27-6e6dbaecb10b tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] [instance: 40ce1872-5f47-4acc-ba80-696b87b062b5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:25.287442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-db0f873f-ade1-4b44-8f27-6e6dbaecb10b tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:25.288309 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-db0f873f-ade1-4b44-8f27-6e6dbaecb10b tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:25.289317 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-db0f873f-ade1-4b44-8f27-6e6dbaecb10b tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:25.289957 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-db0f873f-ade1-4b44-8f27-6e6dbaecb10b tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:25.331858 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-db0f873f-ade1-4b44-8f27-6e6dbaecb10b tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] HTTP exception thrown: Instance 40ce1872-5f47-4acc-ba80-696b87b062b5 could not be found. Jul 19 22:29:25.342276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-db0f873f-ade1-4b44-8f27-6e6dbaecb10b tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Request method failure captured: Jul 19 22:29:25.342276 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5 HTTP/1.1 Jul 19 22:29:25.342276 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:29:25.342276 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:29:25.342276 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:29:25.342276 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:29:25.342276 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:29:25.342276 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:29:25.342276 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:29:25.342276 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:29:25.342276 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y9zWxQw0R-nY4SSBETaYsexOHh8R6Yl-zc08BKDRDfpUg3byRbcWtcyxVplJQDXOMfX_qGxcPNbAatffGgOLAaQlpNGilc5TWbJ7ipTqGsVCQ_kQwuRHgSOexhyEr4gmkam8ip26X-DUabNEikv5YaI8sAG9hLTtmWkmpvO2YNZQFg Jul 19 22:29:25.342276 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:29:25.342276 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:29:25.342276 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:29:25.342276 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:29:25.342276 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:29:25.342276 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:29:25.342276 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 3d53b71f56584a28b7b82c799fb96673 Jul 19 22:29:25.342276 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1505670044 Jul 19 22:29:25.342276 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:29:25.342276 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:29:25.343947 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d53b71f56584a28b7b82c799fb96673"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d53b71f56584a28b7b82c799fb96673"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d53b71f56584a28b7b82c799fb96673"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d53b71f56584a28b7b82c799fb96673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:29:25.343947 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1505670044 Jul 19 22:29:25.343947 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 3d53b71f56584a28b7b82c799fb96673 Jul 19 22:29:25.343947 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1505670044 Jul 19 22:29:25.343947 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-AttachSCSIVolumeTestJSON-1505670044-project Jul 19 22:29:25.343947 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:29:25.343947 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:29:25.343947 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: e66a794a5a4c41498472dd994128703f Jul 19 22:29:25.343947 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1505670044-project Jul 19 22:29:25.343947 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:29:25.343947 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 40ce1872-5f47-4acc-ba80-696b87b062b5 could not be found. Jul 19 22:29:25.343947 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '40ce1872-5f47-4acc-ba80-696b87b062b5'} Jul 19 22:29:25.344847 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:29:25.344847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:25.344847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:29:25.344847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:29:25.344847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:29:25.344847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:29:25.344847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:29:25.344847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:29:25.344847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:29:25.344847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:29:25.344847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40ce1872-5f47-4acc-ba80-696b87b062b5 could not be found. Jul 19 22:29:25.344847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:29:25.344847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:29:25.344847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:29:25.344847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:25.344847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:29:25.344847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:29:25.344847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:29:25.344847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:29:25.344847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:29:25.346257 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:29:25.346257 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:29:25.346257 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:29:25.346257 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:29:25.346257 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:29:25.346257 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:29:25.346257 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:29:25.346257 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40ce1872-5f47-4acc-ba80-696b87b062b5 could not be found. Jul 19 22:29:25.346257 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:29:25.346257 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:29:25.346257 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:29:25.346257 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:25.346257 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:29:25.346257 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:29:25.346257 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:29:25.346257 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:29:25.346257 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40ce1872-5f47-4acc-ba80-696b87b062b5 could not be found. Jul 19 22:29:25.346257 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:29:25.348478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-db0f873f-ade1-4b44-8f27-6e6dbaecb10b tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] Returning 404 to user: Instance 40ce1872-5f47-4acc-ba80-696b87b062b5 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:29:25.355004 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-db0f873f-ade1-4b44-8f27-6e6dbaecb10b tempest-AttachSCSIVolumeTestJSON-1505670044 tempest-AttachSCSIVolumeTestJSON-1505670044-project] 10.222.0.25 "GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5" status: 404 len: 111 microversion: 2.1 time: 0.086170 Jul 19 22:29:25.358838 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 489/1034] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:25 2022] GET /compute/v2.1/servers/40ce1872-5f47-4acc-ba80-696b87b062b5 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:29:25.507709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b97ff58e-9d94-473a-b218-add7ad87fa5a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:25.508353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b97ff58e-9d94-473a-b218-add7ad87fa5a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 03987102-e808-4669-a48a-d9cee489c71e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:25.521943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b97ff58e-9d94-473a-b218-add7ad87fa5a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:25.523637 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b97ff58e-9d94-473a-b218-add7ad87fa5a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:25.525963 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b97ff58e-9d94-473a-b218-add7ad87fa5a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:25.528252 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b97ff58e-9d94-473a-b218-add7ad87fa5a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:25.660832 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4b5ca227-2640-4a9d-b3c0-6f51b342a2e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:25.677307 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4b5ca227-2640-4a9d-b3c0-6f51b342a2e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:25.679275 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4b5ca227-2640-4a9d-b3c0-6f51b342a2e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:25.680804 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4b5ca227-2640-4a9d-b3c0-6f51b342a2e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1411 microversion: 2.25 time: 0.752158 Jul 19 22:29:25.688387 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 546/1035] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:29:24 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1411 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:29:25.693777 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d38bbbdd-0f9e-4324-9cc4-4ace38299264 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:25.694400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d38bbbdd-0f9e-4324-9cc4-4ace38299264 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:25.714536 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d38bbbdd-0f9e-4324-9cc4-4ace38299264 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:25.715390 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d38bbbdd-0f9e-4324-9cc4-4ace38299264 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:25.716203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d38bbbdd-0f9e-4324-9cc4-4ace38299264 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:25.716642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d38bbbdd-0f9e-4324-9cc4-4ace38299264 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:25.996807 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b97ff58e-9d94-473a-b218-add7ad87fa5a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:26.052147 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b97ff58e-9d94-473a-b218-add7ad87fa5a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e" status: 200 len: 1313 microversion: 2.1 time: 0.512260 Jul 19 22:29:26.052147 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 490/1036] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:25 2022] GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e => generated 1313 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:26.052147 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-6334b1c5-742d-482d-9aa1-59594140cb5a req-c3c602fd-f08b-4c42-81c4-86a33020f99d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d191bac-6976-461e-9def-4f839a59331e", "name": "network-vif-unplugged", "status": "completed", "tag": "c456a7c4-6281-40e9-846b-1f8734a09c76"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:26.077391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-6334b1c5-742d-482d-9aa1-59594140cb5a req-c3c602fd-f08b-4c42-81c4-86a33020f99d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:26.078154 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-6334b1c5-742d-482d-9aa1-59594140cb5a req-c3c602fd-f08b-4c42-81c4-86a33020f99d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:26.138590 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-6334b1c5-742d-482d-9aa1-59594140cb5a req-c3c602fd-f08b-4c42-81c4-86a33020f99d service nova] Creating event network-vif-unplugged:c456a7c4-6281-40e9-846b-1f8734a09c76 for instance 3d191bac-6976-461e-9def-4f839a59331e on n-h1-847009-3 Jul 19 22:29:26.162228 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [req-6334b1c5-742d-482d-9aa1-59594140cb5a req-c3c602fd-f08b-4c42-81c4-86a33020f99d service nova] Instance 3d191bac-6976-461e-9def-4f839a59331e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3'} {{(pid=119338) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 22:29:26.187093 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-6334b1c5-742d-482d-9aa1-59594140cb5a req-c3c602fd-f08b-4c42-81c4-86a33020f99d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.164397 Jul 19 22:29:26.193602 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 491/1037] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:26.210751 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2225915a-4d7e-4487-a902-7f85a9ec4e8b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:26.221174 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2225915a-4d7e-4487-a902-7f85a9ec4e8b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:26.251046 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2225915a-4d7e-4487-a902-7f85a9ec4e8b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:26.252100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2225915a-4d7e-4487-a902-7f85a9ec4e8b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:26.253575 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2225915a-4d7e-4487-a902-7f85a9ec4e8b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:26.254426 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2225915a-4d7e-4487-a902-7f85a9ec4e8b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:26.356285 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d38bbbdd-0f9e-4324-9cc4-4ace38299264 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:26.368612 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d38bbbdd-0f9e-4324-9cc4-4ace38299264 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1535 microversion: 2.1 time: 0.679149 Jul 19 22:29:26.369212 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 547/1038] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:25 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1535 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:26.399438 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-53ffe5e9-70e6-436e-97eb-74b86323df9b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:26.400386 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-53ffe5e9-70e6-436e-97eb-74b86323df9b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0cc94c67-92c3-491d-974d-1a40bf8757c4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:26.421780 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-53ffe5e9-70e6-436e-97eb-74b86323df9b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:26.422343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-53ffe5e9-70e6-436e-97eb-74b86323df9b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:26.426544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-53ffe5e9-70e6-436e-97eb-74b86323df9b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:26.427324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-53ffe5e9-70e6-436e-97eb-74b86323df9b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:26.813392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2225915a-4d7e-4487-a902-7f85a9ec4e8b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:26.831965 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2225915a-4d7e-4487-a902-7f85a9ec4e8b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1499 microversion: 2.1 time: 0.636310 Jul 19 22:29:26.855206 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 492/1039] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:26 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1499 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:26.860545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-958840a2-a4c8-44f4-909f-3bacf3857606 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:26.866378 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-958840a2-a4c8-44f4-909f-3bacf3857606 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:26.895327 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-958840a2-a4c8-44f4-909f-3bacf3857606 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:26.897219 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-958840a2-a4c8-44f4-909f-3bacf3857606 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:26.898250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-958840a2-a4c8-44f4-909f-3bacf3857606 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:26.901209 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-958840a2-a4c8-44f4-909f-3bacf3857606 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:26.948289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-53ffe5e9-70e6-436e-97eb-74b86323df9b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:26.960240 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-53ffe5e9-70e6-436e-97eb-74b86323df9b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4" status: 200 len: 1319 microversion: 2.1 time: 0.585198 Jul 19 22:29:26.964447 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 548/1040] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:26 2022] GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4 => generated 1319 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:27.046575 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c951d97c-bedd-4a9e-9743-577cc8988424 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:27.050470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c951d97c-bedd-4a9e-9743-577cc8988424 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 03987102-e808-4669-a48a-d9cee489c71e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:27.057660 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c951d97c-bedd-4a9e-9743-577cc8988424 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:27.058576 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c951d97c-bedd-4a9e-9743-577cc8988424 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:27.060111 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c951d97c-bedd-4a9e-9743-577cc8988424 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:27.060804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c951d97c-bedd-4a9e-9743-577cc8988424 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:27.198565 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-958840a2-a4c8-44f4-909f-3bacf3857606 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:27.220250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-958840a2-a4c8-44f4-909f-3bacf3857606 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:27.226139 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-958840a2-a4c8-44f4-909f-3bacf3857606 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:27.228077 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-958840a2-a4c8-44f4-909f-3bacf3857606 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1411 microversion: 2.25 time: 0.371537 Jul 19 22:29:27.233739 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 493/1041] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:29:26 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1411 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:29:27.324544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c951d97c-bedd-4a9e-9743-577cc8988424 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:27.342543 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c951d97c-bedd-4a9e-9743-577cc8988424 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e" status: 200 len: 1313 microversion: 2.1 time: 0.300241 Jul 19 22:29:27.353935 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 549/1042] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:27 2022] GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:29:27.388427 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a1a74117-aa8f-49b6-8b1f-60c18c46297a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:27.389675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a1a74117-aa8f-49b6-8b1f-60c18c46297a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:27.396371 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1a74117-aa8f-49b6-8b1f-60c18c46297a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:27.397192 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1a74117-aa8f-49b6-8b1f-60c18c46297a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:27.399385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1a74117-aa8f-49b6-8b1f-60c18c46297a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:27.400075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1a74117-aa8f-49b6-8b1f-60c18c46297a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:27.613331 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a1a74117-aa8f-49b6-8b1f-60c18c46297a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:27.622177 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a1a74117-aa8f-49b6-8b1f-60c18c46297a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1535 microversion: 2.1 time: 0.238532 Jul 19 22:29:27.622864 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 494/1043] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:27 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1535 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:27.851825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-be747d2b-fb96-4353-a286-2026760d4c5d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:27.853023 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-be747d2b-fb96-4353-a286-2026760d4c5d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:27.862090 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be747d2b-fb96-4353-a286-2026760d4c5d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:27.862859 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be747d2b-fb96-4353-a286-2026760d4c5d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:27.863861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be747d2b-fb96-4353-a286-2026760d4c5d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:27.864459 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be747d2b-fb96-4353-a286-2026760d4c5d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:27.986531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-da0f2da6-adc0-4939-83ab-410eda5b0b57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:27.988564 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-da0f2da6-adc0-4939-83ab-410eda5b0b57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0cc94c67-92c3-491d-974d-1a40bf8757c4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:28.000385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da0f2da6-adc0-4939-83ab-410eda5b0b57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:28.001402 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da0f2da6-adc0-4939-83ab-410eda5b0b57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:28.003861 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da0f2da6-adc0-4939-83ab-410eda5b0b57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:28.004978 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da0f2da6-adc0-4939-83ab-410eda5b0b57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:28.160153 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-be747d2b-fb96-4353-a286-2026760d4c5d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:28.176652 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-be747d2b-fb96-4353-a286-2026760d4c5d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1499 microversion: 2.1 time: 0.329729 Jul 19 22:29:28.177608 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 550/1044] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:27 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1499 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:28.255006 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-39da634f-0032-4512-8186-33dcdc5585d8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:28.256935 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-39da634f-0032-4512-8186-33dcdc5585d8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:28.268579 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-da0f2da6-adc0-4939-83ab-410eda5b0b57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:28.281237 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39da634f-0032-4512-8186-33dcdc5585d8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:28.281785 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39da634f-0032-4512-8186-33dcdc5585d8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:28.283895 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39da634f-0032-4512-8186-33dcdc5585d8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:28.284333 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39da634f-0032-4512-8186-33dcdc5585d8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:28.288763 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-da0f2da6-adc0-4939-83ab-410eda5b0b57 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4" status: 200 len: 1469 microversion: 2.1 time: 0.312124 Jul 19 22:29:28.289669 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 495/1045] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:27 2022] GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4 => generated 1469 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:29:28.318689 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dc6691b8-a0de-413e-82ee-3f3006ffde6b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:28.319789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dc6691b8-a0de-413e-82ee-3f3006ffde6b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: ca03e7c4-e8c2-43f5-8528-7b2a847ca718] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:28.343241 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dc6691b8-a0de-413e-82ee-3f3006ffde6b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:28.344424 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dc6691b8-a0de-413e-82ee-3f3006ffde6b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:28.346147 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dc6691b8-a0de-413e-82ee-3f3006ffde6b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:28.347250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dc6691b8-a0de-413e-82ee-3f3006ffde6b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:28.961794 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-39da634f-0032-4512-8186-33dcdc5585d8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:28.964300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dc6691b8-a0de-413e-82ee-3f3006ffde6b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:28.982580 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dc6691b8-a0de-413e-82ee-3f3006ffde6b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/ca03e7c4-e8c2-43f5-8528-7b2a847ca718" status: 200 len: 1468 microversion: 2.1 time: 0.664443 Jul 19 22:29:28.983534 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 496/1046] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:28 2022] GET /compute/v2.1/servers/ca03e7c4-e8c2-43f5-8528-7b2a847ca718 => generated 1468 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:29:28.996233 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-39da634f-0032-4512-8186-33dcdc5585d8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:29.000776 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-39da634f-0032-4512-8186-33dcdc5585d8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:29.002468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-93365364-38b7-4a57-9f61-7a8f801d3b8a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:29.004253 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-93365364-38b7-4a57-9f61-7a8f801d3b8a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 03987102-e808-4669-a48a-d9cee489c71e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:29.005780 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-39da634f-0032-4512-8186-33dcdc5585d8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1411 microversion: 2.25 time: 0.754722 Jul 19 22:29:29.006619 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 551/1047] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:29:28 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1411 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:29:29.020036 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93365364-38b7-4a57-9f61-7a8f801d3b8a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:29.020343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-aca064e6-9674-4c27-80ef-19ba07fa8249 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:29.020852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-aca064e6-9674-4c27-80ef-19ba07fa8249 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:29.021598 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93365364-38b7-4a57-9f61-7a8f801d3b8a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:29.023512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93365364-38b7-4a57-9f61-7a8f801d3b8a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:29.024882 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93365364-38b7-4a57-9f61-7a8f801d3b8a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:29.037998 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aca064e6-9674-4c27-80ef-19ba07fa8249 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:29.039597 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aca064e6-9674-4c27-80ef-19ba07fa8249 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:29.041217 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aca064e6-9674-4c27-80ef-19ba07fa8249 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:29.043474 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aca064e6-9674-4c27-80ef-19ba07fa8249 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:29.700929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-93365364-38b7-4a57-9f61-7a8f801d3b8a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:29.702120 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-aca064e6-9674-4c27-80ef-19ba07fa8249 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:29.716763 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-aca064e6-9674-4c27-80ef-19ba07fa8249 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1528 microversion: 2.1 time: 0.708957 Jul 19 22:29:29.717371 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 552/1048] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:29 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1528 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:29.725812 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-93365364-38b7-4a57-9f61-7a8f801d3b8a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e" status: 200 len: 1313 microversion: 2.1 time: 0.740858 Jul 19 22:29:29.727588 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 497/1049] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:28 2022] GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e => generated 1313 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:29.734945 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-0f329f48-b2f5-41d4-b369-e55cd9326150 req-7bf1fd8b-62a7-4ecf-a253-a6c8092285c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613", "name": "network-vif-plugged", "status": "completed", "tag": "8551ae32-70fe-4a9f-920b-2e4c5b49340d"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:29.742082 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b5a38654-070a-43e5-aba0-ffebee1719ca tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:29.750094 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b5a38654-070a-43e5-aba0-ffebee1719ca tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:29.761557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0f329f48-b2f5-41d4-b369-e55cd9326150 req-7bf1fd8b-62a7-4ecf-a253-a6c8092285c2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:29.763054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b5a38654-070a-43e5-aba0-ffebee1719ca tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Searching by: {'reservation_id': 'r-0n1w6c85', 'deleted': False, 'project_id': '791e176b6751415ca1472c109b3ce011'} {{(pid=119337) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:29:29.763324 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0f329f48-b2f5-41d4-b369-e55cd9326150 req-7bf1fd8b-62a7-4ecf-a253-a6c8092285c2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:29.787012 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b5a38654-070a-43e5-aba0-ffebee1719ca tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:29.788169 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b5a38654-070a-43e5-aba0-ffebee1719ca tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:29.790221 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b5a38654-070a-43e5-aba0-ffebee1719ca tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:29.792418 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b5a38654-070a-43e5-aba0-ffebee1719ca tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:29.794774 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-0f329f48-b2f5-41d4-b369-e55cd9326150 req-7bf1fd8b-62a7-4ecf-a253-a6c8092285c2 service nova] Creating event network-vif-plugged:8551ae32-70fe-4a9f-920b-2e4c5b49340d for instance 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 on n-h2-847009-3 Jul 19 22:29:29.804447 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-0f329f48-b2f5-41d4-b369-e55cd9326150 req-7bf1fd8b-62a7-4ecf-a253-a6c8092285c2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073787 Jul 19 22:29:29.805709 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 498/1050] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:29.816982 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b43f06dc-a35f-456a-b0a0-20d4bdc9576d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:29.818716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b43f06dc-a35f-456a-b0a0-20d4bdc9576d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:29.828663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b43f06dc-a35f-456a-b0a0-20d4bdc9576d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:29.829421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b43f06dc-a35f-456a-b0a0-20d4bdc9576d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:29.830445 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b43f06dc-a35f-456a-b0a0-20d4bdc9576d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:29.831058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b43f06dc-a35f-456a-b0a0-20d4bdc9576d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:29.987165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.multi_cell_list [None req-b5a38654-070a-43e5-aba0-ffebee1719ca tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119337) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:29:30.093693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b5a38654-070a-43e5-aba0-ffebee1719ca tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:30.104196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b5a38654-070a-43e5-aba0-ffebee1719ca tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:30.104930 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b5a38654-070a-43e5-aba0-ffebee1719ca tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:30.173027 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b43f06dc-a35f-456a-b0a0-20d4bdc9576d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:30.181482 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b43f06dc-a35f-456a-b0a0-20d4bdc9576d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1499 microversion: 2.1 time: 0.373737 Jul 19 22:29:30.191874 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 499/1051] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:29 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1499 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:30.197277 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-453babe8-6d25-4af9-b913-921189b97fbc tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:30.198146 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-453babe8-6d25-4af9-b913-921189b97fbc tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:30.206127 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-453babe8-6d25-4af9-b913-921189b97fbc tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:30.206930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-453babe8-6d25-4af9-b913-921189b97fbc tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:30.207938 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-453babe8-6d25-4af9-b913-921189b97fbc tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:30.208372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-453babe8-6d25-4af9-b913-921189b97fbc tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:30.486165 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-453babe8-6d25-4af9-b913-921189b97fbc tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:30.493619 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=14 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:29:30.497092 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-453babe8-6d25-4af9-b913-921189b97fbc tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1528 microversion: 2.1 time: 0.303580 Jul 19 22:29:30.497799 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 500/1052] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:30 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1528 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:30.521389 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b5a38654-070a-43e5-aba0-ffebee1719ca tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?reservation_id=r-0n1w6c85" status: 200 len: 2930 microversion: 2.1 time: 0.802535 Jul 19 22:29:30.522476 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 553/1053] 10.222.0.25 () {58 vars in 1196 bytes} [Tue Jul 19 22:29:29 2022] GET /compute/v2.1/servers/detail?reservation_id=r-0n1w6c85 => generated 2930 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:30.524632 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3fe8f6d9-05b1-4472-81f6-e4370fa83654 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:30.528440 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3fe8f6d9-05b1-4472-81f6-e4370fa83654 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:30.535299 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=48 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:29:30.540818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3fe8f6d9-05b1-4472-81f6-e4370fa83654 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:30.541620 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3fe8f6d9-05b1-4472-81f6-e4370fa83654 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:30.542861 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3fe8f6d9-05b1-4472-81f6-e4370fa83654 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:30.545905 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5c602eb6-0db2-43f2-906c-cfb7a28cacae tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:30.548096 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:29:30.548096 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:29:30.553602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3fe8f6d9-05b1-4472-81f6-e4370fa83654 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:30.573376 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-5c602eb6-0db2-43f2-906c-cfb7a28cacae tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] HTTP exception thrown: Flavor 41955a04-02ae-48d8-a418-8fe76c81baed could not be found. Jul 19 22:29:30.582659 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5c602eb6-0db2-43f2-906c-cfb7a28cacae tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Request method failure captured: Jul 19 22:29:30.582659 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/flavors/41955a04-02ae-48d8-a418-8fe76c81baed HTTP/1.1 Jul 19 22:29:30.582659 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:29:30.582659 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:29:30.582659 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:29:30.582659 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:29:30.582659 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:29:30.582659 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:29:30.582659 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:29:30.582659 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:29:30.582659 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y9VNvFjTdItueVbuH59Sh2HWJ87LwAGiUV2Y1X9zU17OiF2w6QVMxHoqN3UbpX7h7ECoSae4RgTEXld8V02survkOHpi_Q9hMBRx8yhhvYnKAa7ClCXDOAtzCf3gEygjZjMUA2jK8e8B4EwvY4wtFGAYAVb2dPCjklTvjwMNoBmZ-s Jul 19 22:29:30.582659 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:29:30.582659 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:29:30.582659 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:29:30.582659 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:29:30.582659 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:29:30.582659 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:29:30.582659 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 85fc2601da774e8392b1ff78a3ffea0b Jul 19 22:29:30.582659 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-MigrationsAdminTest-300891642 Jul 19 22:29:30.582659 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:29:30.582659 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:29:30.584572 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_85fc2601da774e8392b1ff78a3ffea0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/85fc2601da774e8392b1ff78a3ffea0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/85fc2601da774e8392b1ff78a3ffea0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/85fc2601da774e8392b1ff78a3ffea0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:29:30.584572 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-MigrationsAdminTest-300891642 Jul 19 22:29:30.584572 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 85fc2601da774e8392b1ff78a3ffea0b Jul 19 22:29:30.584572 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-MigrationsAdminTest-300891642 Jul 19 22:29:30.584572 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-MigrationsAdminTest-300891642-project-admin Jul 19 22:29:30.584572 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:29:30.584572 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:29:30.584572 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 8c849cd3f1e44096aec522948f87ce7e Jul 19 22:29:30.584572 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-MigrationsAdminTest-300891642-project-admin Jul 19 22:29:30.584572 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:29:30.584572 n-d-847009-3 devstack@n-api.service[119337]: exception: Flavor 41955a04-02ae-48d8-a418-8fe76c81baed could not be found. Jul 19 22:29:30.584572 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '41955a04-02ae-48d8-a418-8fe76c81baed'} Jul 19 22:29:30.585729 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:29:30.585729 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:30.585729 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 19 22:29:30.585729 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 19 22:29:30.585729 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 19 22:29:30.585729 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 19 22:29:30.585729 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 19 22:29:30.585729 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 19 22:29:30.585729 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 19 22:29:30.585729 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 19 22:29:30.585729 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 22:29:30.585729 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 22:29:30.585729 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 19 22:29:30.585729 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 19 22:29:30.585729 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 41955a04-02ae-48d8-a418-8fe76c81baed could not be found. Jul 19 22:29:30.585729 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:29:30.585729 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:29:30.585729 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:29:30.585729 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:30.585729 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:29:30.587370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:29:30.587370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:29:30.587370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:29:30.587370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:29:30.587370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:29:30.587370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 19 22:29:30.587370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:29:30.587370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 41955a04-02ae-48d8-a418-8fe76c81baed could not be found. Jul 19 22:29:30.587370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:29:30.587370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:29:30.587370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:29:30.587370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:29:30.587370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:29:30.587370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:29:30.587370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:29:30.587370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:29:30.587370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 41955a04-02ae-48d8-a418-8fe76c81baed could not be found. Jul 19 22:29:30.587370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:29:30.602839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5c602eb6-0db2-43f2-906c-cfb7a28cacae tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Returning 404 to user: Flavor 41955a04-02ae-48d8-a418-8fe76c81baed could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:29:30.602839 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5c602eb6-0db2-43f2-906c-cfb7a28cacae tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/41955a04-02ae-48d8-a418-8fe76c81baed" status: 404 len: 109 microversion: 2.1 time: 0.058805 Jul 19 22:29:30.602839 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 554/1054] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:29:30 2022] DELETE /compute/v2.1/flavors/41955a04-02ae-48d8-a418-8fe76c81baed => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:29:30.602839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d660ab5c-3d4c-49e8-958b-2472b236f918 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:30.635062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.compute.server_groups [None req-d660ab5c-3d4c-49e8-958b-2472b236f918 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Querying cell c9ec50c5-1e53-4d76-a6eb-599548551fc7(cell1) for 2 instances {{(pid=119337) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 19 22:29:30.636692 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d660ab5c-3d4c-49e8-958b-2472b236f918 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:30.647871 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d660ab5c-3d4c-49e8-958b-2472b236f918 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:30.685981 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d660ab5c-3d4c-49e8-958b-2472b236f918 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/e1b7331f-8339-484a-b401-587687fab655" status: 200 len: 270 microversion: 2.1 time: 0.099336 Jul 19 22:29:30.687942 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 555/1055] 10.222.0.25 () {58 vars in 1262 bytes} [Tue Jul 19 22:29:30 2022] GET /compute/v2.1/os-server-groups/e1b7331f-8339-484a-b401-587687fab655 => generated 270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:30.710221 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7e66719b-40f4-4571-8dee-9173d76f6c0c tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:30.718786 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7e66719b-40f4-4571-8dee-9173d76f6c0c tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] [instance: 0cc94c67-92c3-491d-974d-1a40bf8757c4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:30.744220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e66719b-40f4-4571-8dee-9173d76f6c0c tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:30.745597 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e66719b-40f4-4571-8dee-9173d76f6c0c tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:30.748578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e66719b-40f4-4571-8dee-9173d76f6c0c tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:30.750849 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e66719b-40f4-4571-8dee-9173d76f6c0c tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:31.203396 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3fe8f6d9-05b1-4472-81f6-e4370fa83654 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:31.232558 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3fe8f6d9-05b1-4472-81f6-e4370fa83654 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:31.240386 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3fe8f6d9-05b1-4472-81f6-e4370fa83654 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:31.242113 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3fe8f6d9-05b1-4472-81f6-e4370fa83654 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1608 microversion: 2.25 time: 0.724072 Jul 19 22:29:31.243975 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 501/1056] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:29:30 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1608 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:29:31.253180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3137f2d2-2324-4c13-a2e0-517e0286abd0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:31.257762 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3137f2d2-2324-4c13-a2e0-517e0286abd0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 03987102-e808-4669-a48a-d9cee489c71e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:31.271804 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3137f2d2-2324-4c13-a2e0-517e0286abd0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:31.274366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3137f2d2-2324-4c13-a2e0-517e0286abd0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:31.280525 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3137f2d2-2324-4c13-a2e0-517e0286abd0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:31.281382 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3137f2d2-2324-4c13-a2e0-517e0286abd0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:31.469950 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7e66719b-40f4-4571-8dee-9173d76f6c0c tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4" status: 200 len: 1620 microversion: 2.1 time: 0.770951 Jul 19 22:29:31.472384 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 556/1057] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:30 2022] GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4 => generated 1620 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:31.483532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-612634c8-5239-4c25-b88a-d27190fe3a4d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1667829006", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:31.621211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-612634c8-5239-4c25-b88a-d27190fe3a4d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] validate_networks() for None {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:29:31.692532 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3137f2d2-2324-4c13-a2e0-517e0286abd0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:31.718299 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3137f2d2-2324-4c13-a2e0-517e0286abd0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e" status: 200 len: 1313 microversion: 2.1 time: 0.472643 Jul 19 22:29:31.724873 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 502/1058] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:31 2022] GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e => generated 1313 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:31.746953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-afc916b8-35f0-4f78-b304-529415c28b87 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:31.748370 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-afc916b8-35f0-4f78-b304-529415c28b87 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:31.766617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-afc916b8-35f0-4f78-b304-529415c28b87 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:31.768239 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-afc916b8-35f0-4f78-b304-529415c28b87 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:31.771696 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-afc916b8-35f0-4f78-b304-529415c28b87 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:31.773071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-afc916b8-35f0-4f78-b304-529415c28b87 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:32.658408 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-afc916b8-35f0-4f78-b304-529415c28b87 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:32.669247 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-afc916b8-35f0-4f78-b304-529415c28b87 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1499 microversion: 2.1 time: 0.942338 Jul 19 22:29:32.670019 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 503/1059] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:31 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1499 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:32.675823 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-daa4270d-4684-48d7-b329-5b89d53dfc22 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:32.676464 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-daa4270d-4684-48d7-b329-5b89d53dfc22 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:32.692167 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-daa4270d-4684-48d7-b329-5b89d53dfc22 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:32.692874 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-daa4270d-4684-48d7-b329-5b89d53dfc22 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:32.694234 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-daa4270d-4684-48d7-b329-5b89d53dfc22 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:32.695051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-daa4270d-4684-48d7-b329-5b89d53dfc22 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:32.998396 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-daa4270d-4684-48d7-b329-5b89d53dfc22 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.326702 Jul 19 22:29:33.000254 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 504/1060] 10.222.0.25 () {60 vars in 1315 bytes} [Tue Jul 19 22:29:32 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67/os-interface => generated 285 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:29:33.015942 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-612634c8-5239-4c25-b88a-d27190fe3a4d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:29:33.016737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-612634c8-5239-4c25-b88a-d27190fe3a4d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:29:33.017521 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-612634c8-5239-4c25-b88a-d27190fe3a4d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:29:33.018665 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-612634c8-5239-4c25-b88a-d27190fe3a4d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:29:33.020138 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-612634c8-5239-4c25-b88a-d27190fe3a4d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:29:33.028503 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b3b66a76-f8ce-421c-a84d-ca38e8d18cab tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:33.033844 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b3b66a76-f8ce-421c-a84d-ca38e8d18cab tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] [instance: ca03e7c4-e8c2-43f5-8528-7b2a847ca718] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:33.045615 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-612634c8-5239-4c25-b88a-d27190fe3a4d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:33.051506 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-612634c8-5239-4c25-b88a-d27190fe3a4d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:33.056780 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-612634c8-5239-4c25-b88a-d27190fe3a4d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:33.061452 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b3b66a76-f8ce-421c-a84d-ca38e8d18cab tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:33.061868 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-612634c8-5239-4c25-b88a-d27190fe3a4d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:33.064449 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b3b66a76-f8ce-421c-a84d-ca38e8d18cab tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:33.068528 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b3b66a76-f8ce-421c-a84d-ca38e8d18cab tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:33.069671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b3b66a76-f8ce-421c-a84d-ca38e8d18cab tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:33.100849 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=16 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:29:33.106140 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:29:33.140786 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-612634c8-5239-4c25-b88a-d27190fe3a4d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Getting quotas for project eed5e83db4ae4156ae9635b84ca7ff4a. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:29:33.151783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-612634c8-5239-4c25-b88a-d27190fe3a4d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Getting quotas for user e3ef9d4c38d547a1a1532d964195144a and project eed5e83db4ae4156ae9635b84ca7ff4a. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:29:33.184838 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-612634c8-5239-4c25-b88a-d27190fe3a4d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:29:33.191428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-612634c8-5239-4c25-b88a-d27190fe3a4d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:29:33.353589 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-612634c8-5239-4c25-b88a-d27190fe3a4d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.879602 Jul 19 22:29:33.355028 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 557/1061] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:29:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:29:33.360672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-d8940673-8545-44a2-9c32-32a210a770bb req-6fd5be6a-80a8-475f-bc55-9f5da9d80340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d191bac-6976-461e-9def-4f839a59331e", "name": "network-vif-plugged", "status": "completed", "tag": "c456a7c4-6281-40e9-846b-1f8734a09c76"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:33.370345 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d8940673-8545-44a2-9c32-32a210a770bb req-6fd5be6a-80a8-475f-bc55-9f5da9d80340 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:33.372007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d8940673-8545-44a2-9c32-32a210a770bb req-6fd5be6a-80a8-475f-bc55-9f5da9d80340 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:33.444862 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-d8940673-8545-44a2-9c32-32a210a770bb req-6fd5be6a-80a8-475f-bc55-9f5da9d80340 service nova] Creating event network-vif-plugged:c456a7c4-6281-40e9-846b-1f8734a09c76 for instance 3d191bac-6976-461e-9def-4f839a59331e on n-h1-847009-3 Jul 19 22:29:33.452186 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-d8940673-8545-44a2-9c32-32a210a770bb req-6fd5be6a-80a8-475f-bc55-9f5da9d80340 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095476 Jul 19 22:29:33.452838 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 558/1062] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:33.458120 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-032f5f1a-7b05-4a97-a1ab-92affd77f2de tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:33.458847 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-032f5f1a-7b05-4a97-a1ab-92affd77f2de tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 03987102-e808-4669-a48a-d9cee489c71e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:33.493739 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-032f5f1a-7b05-4a97-a1ab-92affd77f2de tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:33.494208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-032f5f1a-7b05-4a97-a1ab-92affd77f2de tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:33.495018 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-032f5f1a-7b05-4a97-a1ab-92affd77f2de tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:33.500783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-032f5f1a-7b05-4a97-a1ab-92affd77f2de tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:33.582625 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b3b66a76-f8ce-421c-a84d-ca38e8d18cab tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ca03e7c4-e8c2-43f5-8528-7b2a847ca718" status: 200 len: 1619 microversion: 2.1 time: 0.580368 Jul 19 22:29:33.583606 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 505/1063] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:33 2022] GET /compute/v2.1/servers/ca03e7c4-e8c2-43f5-8528-7b2a847ca718 => generated 1619 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:33.613745 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d6b5c21e-8e2c-4e36-b932-530bd271f50d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:33.634664 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d6b5c21e-8e2c-4e36-b932-530bd271f50d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:33.957367 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d6b5c21e-8e2c-4e36-b932-530bd271f50d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:34.001994 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d6b5c21e-8e2c-4e36-b932-530bd271f50d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1213 microversion: 2.1 time: 0.415346 Jul 19 22:29:34.009607 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 506/1064] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:33 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1213 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:34.054839 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-48cb8ee2-886a-4e52-85ed-6dacbb4f53dc tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:34.061534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-48cb8ee2-886a-4e52-85ed-6dacbb4f53dc tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:34.105186 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48cb8ee2-886a-4e52-85ed-6dacbb4f53dc tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:34.106018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48cb8ee2-886a-4e52-85ed-6dacbb4f53dc tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:34.115631 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48cb8ee2-886a-4e52-85ed-6dacbb4f53dc tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:34.118144 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48cb8ee2-886a-4e52-85ed-6dacbb4f53dc tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:34.212469 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-032f5f1a-7b05-4a97-a1ab-92affd77f2de tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:34.241037 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-032f5f1a-7b05-4a97-a1ab-92affd77f2de tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e" status: 200 len: 1313 microversion: 2.1 time: 0.786527 Jul 19 22:29:34.268567 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 559/1065] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:33 2022] GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e => generated 1313 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:34.279803 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eebbcdee-007c-4cda-a216-c6d95b2b7c96 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-210590819", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "9d261177-b837-4836-959b-2b419921e90c"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:34.406757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-eebbcdee-007c-4cda-a216-c6d95b2b7c96 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] validate_networks() for None {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:29:35.010888 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-48cb8ee2-886a-4e52-85ed-6dacbb4f53dc tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:35.046158 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-48cb8ee2-886a-4e52-85ed-6dacbb4f53dc tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1499 microversion: 2.1 time: 1.033226 Jul 19 22:29:35.048030 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 507/1066] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:34 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1499 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:35.057111 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2cae2f57-e2b9-4c75-b1c9-64c0ee08e30f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:35.058867 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2cae2f57-e2b9-4c75-b1c9-64c0ee08e30f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:35.084130 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2cae2f57-e2b9-4c75-b1c9-64c0ee08e30f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:35.085271 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2cae2f57-e2b9-4c75-b1c9-64c0ee08e30f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:35.087235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2cae2f57-e2b9-4c75-b1c9-64c0ee08e30f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:35.088358 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2cae2f57-e2b9-4c75-b1c9-64c0ee08e30f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:35.281622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2cae2f57-e2b9-4c75-b1c9-64c0ee08e30f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:35.296195 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2cae2f57-e2b9-4c75-b1c9-64c0ee08e30f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1265 microversion: 2.1 time: 0.245983 Jul 19 22:29:35.296830 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 508/1067] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:35 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:35.307993 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-91eb4849-eaae-4fc4-be05-f2c88acc2b21 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:35.315496 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-91eb4849-eaae-4fc4-be05-f2c88acc2b21 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 03987102-e808-4669-a48a-d9cee489c71e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:35.332989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91eb4849-eaae-4fc4-be05-f2c88acc2b21 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:35.333450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91eb4849-eaae-4fc4-be05-f2c88acc2b21 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:35.334298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91eb4849-eaae-4fc4-be05-f2c88acc2b21 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:35.334933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91eb4849-eaae-4fc4-be05-f2c88acc2b21 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:35.402599 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-eebbcdee-007c-4cda-a216-c6d95b2b7c96 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:29:35.403541 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-eebbcdee-007c-4cda-a216-c6d95b2b7c96 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:29:35.403541 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-eebbcdee-007c-4cda-a216-c6d95b2b7c96 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:29:35.403988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-eebbcdee-007c-4cda-a216-c6d95b2b7c96 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:29:35.404420 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-eebbcdee-007c-4cda-a216-c6d95b2b7c96 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:29:35.436274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eebbcdee-007c-4cda-a216-c6d95b2b7c96 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:35.437094 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eebbcdee-007c-4cda-a216-c6d95b2b7c96 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:35.438737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eebbcdee-007c-4cda-a216-c6d95b2b7c96 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:35.439664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eebbcdee-007c-4cda-a216-c6d95b2b7c96 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:35.499321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-eebbcdee-007c-4cda-a216-c6d95b2b7c96 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for project 791e176b6751415ca1472c109b3ce011. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:29:35.508975 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-eebbcdee-007c-4cda-a216-c6d95b2b7c96 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for user bd5fb561f7bd429e8c6b2cc30ed76f13 and project 791e176b6751415ca1472c109b3ce011. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:29:35.531234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eebbcdee-007c-4cda-a216-c6d95b2b7c96 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:29:35.534136 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eebbcdee-007c-4cda-a216-c6d95b2b7c96 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:29:35.641858 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eebbcdee-007c-4cda-a216-c6d95b2b7c96 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.371156 Jul 19 22:29:35.645156 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 560/1068] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:29:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:29:35.661048 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-335b7177-0170-4b4b-ac70-fedf7df4a0b0 req-528c94ab-ca21-4253-bf35-3def49959518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d871dc5-0189-41e2-8650-8f753bf98c67", "tag": "76972dec-38be-463e-8f2e-775f0e49be0a"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:35.682213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:29:35.716237 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-335b7177-0170-4b4b-ac70-fedf7df4a0b0 req-528c94ab-ca21-4253-bf35-3def49959518 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:35.717053 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-335b7177-0170-4b4b-ac70-fedf7df4a0b0 req-528c94ab-ca21-4253-bf35-3def49959518 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:35.797017 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-335b7177-0170-4b4b-ac70-fedf7df4a0b0 req-528c94ab-ca21-4253-bf35-3def49959518 service nova] Creating event network-changed:76972dec-38be-463e-8f2e-775f0e49be0a for instance 5d871dc5-0189-41e2-8650-8f753bf98c67 on n-h2-847009-3 Jul 19 22:29:35.814570 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-335b7177-0170-4b4b-ac70-fedf7df4a0b0 req-528c94ab-ca21-4253-bf35-3def49959518 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160998 Jul 19 22:29:35.827678 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 561/1069] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:35.838379 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a9fa693d-8cb3-4690-a7b1-846dfca70e08 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:35.840538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a9fa693d-8cb3-4690-a7b1-846dfca70e08 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:36.128585 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a9fa693d-8cb3-4690-a7b1-846dfca70e08 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:36.137653 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a9fa693d-8cb3-4690-a7b1-846dfca70e08 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1" status: 200 len: 1216 microversion: 2.1 time: 0.306664 Jul 19 22:29:36.137653 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 562/1070] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:35 2022] GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 => generated 1216 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:36.142495 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-7ef6f060-5b4d-422f-9aaf-b81c777a9267 req-19f50ad0-19d9-4214-8831-c1ac1d487abd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03987102-e808-4669-a48a-d9cee489c71e", "name": "network-vif-plugged", "status": "completed", "tag": "174e2193-cdeb-4c38-baad-2354f434d257"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:36.189791 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-7ef6f060-5b4d-422f-9aaf-b81c777a9267 req-19f50ad0-19d9-4214-8831-c1ac1d487abd service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:36.190617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-7ef6f060-5b4d-422f-9aaf-b81c777a9267 req-19f50ad0-19d9-4214-8831-c1ac1d487abd service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:36.240395 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-7ef6f060-5b4d-422f-9aaf-b81c777a9267 req-19f50ad0-19d9-4214-8831-c1ac1d487abd service nova] Creating event network-vif-plugged:174e2193-cdeb-4c38-baad-2354f434d257 for instance 03987102-e808-4669-a48a-d9cee489c71e on n-h2-847009-3 Jul 19 22:29:36.258550 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-7ef6f060-5b4d-422f-9aaf-b81c777a9267 req-19f50ad0-19d9-4214-8831-c1ac1d487abd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118637 Jul 19 22:29:36.262350 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 563/1071] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:36.276115 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3f574337-3a02-4a15-8a66-c4b4b2423d08 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:36.277906 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3f574337-3a02-4a15-8a66-c4b4b2423d08 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:36.288993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f574337-3a02-4a15-8a66-c4b4b2423d08 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:36.289684 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f574337-3a02-4a15-8a66-c4b4b2423d08 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:36.290688 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f574337-3a02-4a15-8a66-c4b4b2423d08 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:36.291455 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f574337-3a02-4a15-8a66-c4b4b2423d08 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:36.330266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-91eb4849-eaae-4fc4-be05-f2c88acc2b21 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:36.346195 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-91eb4849-eaae-4fc4-be05-f2c88acc2b21 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e" status: 200 len: 1313 microversion: 2.1 time: 1.047900 Jul 19 22:29:36.347438 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 509/1072] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:35 2022] GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e => generated 1313 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:36.352868 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1a7c8955-d7a1-4420-925c-73c08b1d6855 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:36.359339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1a7c8955-d7a1-4420-925c-73c08b1d6855 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:36.377194 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a7c8955-d7a1-4420-925c-73c08b1d6855 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:36.378320 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a7c8955-d7a1-4420-925c-73c08b1d6855 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:36.379300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a7c8955-d7a1-4420-925c-73c08b1d6855 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:36.379859 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a7c8955-d7a1-4420-925c-73c08b1d6855 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:36.908690 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1a7c8955-d7a1-4420-925c-73c08b1d6855 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:36.918907 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1a7c8955-d7a1-4420-925c-73c08b1d6855 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1271 microversion: 2.1 time: 0.570121 Jul 19 22:29:36.929571 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 510/1073] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:36 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1271 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:37.155678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bb8af957-340d-41a9-bf5b-f8da2c8a36d0 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:37.159424 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bb8af957-340d-41a9-bf5b-f8da2c8a36d0 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:37.177137 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bb8af957-340d-41a9-bf5b-f8da2c8a36d0 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:37.177929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bb8af957-340d-41a9-bf5b-f8da2c8a36d0 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:37.179304 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bb8af957-340d-41a9-bf5b-f8da2c8a36d0 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:37.180534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bb8af957-340d-41a9-bf5b-f8da2c8a36d0 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:37.523389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3f574337-3a02-4a15-8a66-c4b4b2423d08 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:37.536655 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bb8af957-340d-41a9-bf5b-f8da2c8a36d0 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:37.559927 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3f574337-3a02-4a15-8a66-c4b4b2423d08 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1499 microversion: 2.1 time: 1.294783 Jul 19 22:29:37.564879 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bb8af957-340d-41a9-bf5b-f8da2c8a36d0 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1" status: 200 len: 1268 microversion: 2.1 time: 0.413693 Jul 19 22:29:37.567233 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 511/1074] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:37 2022] GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 => generated 1268 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:29:37.569069 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 564/1075] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:36 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1499 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:37.573154 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1b910e4c-b2a4-444a-b211-30b31b168369 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:37.574157 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1b910e4c-b2a4-444a-b211-30b31b168369 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 03987102-e808-4669-a48a-d9cee489c71e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:37.585647 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b910e4c-b2a4-444a-b211-30b31b168369 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:37.586857 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b910e4c-b2a4-444a-b211-30b31b168369 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:37.588847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b910e4c-b2a4-444a-b211-30b31b168369 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:37.601152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b910e4c-b2a4-444a-b211-30b31b168369 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:37.940950 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8c444786-5c32-443d-b3e1-3f0f3de01cf7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:37.942130 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8c444786-5c32-443d-b3e1-3f0f3de01cf7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:37.970149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c444786-5c32-443d-b3e1-3f0f3de01cf7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:37.970828 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c444786-5c32-443d-b3e1-3f0f3de01cf7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:37.972050 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c444786-5c32-443d-b3e1-3f0f3de01cf7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:37.972713 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c444786-5c32-443d-b3e1-3f0f3de01cf7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:38.009454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:29:38.130613 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1b910e4c-b2a4-444a-b211-30b31b168369 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:38.131939 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8c444786-5c32-443d-b3e1-3f0f3de01cf7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:38.159885 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8c444786-5c32-443d-b3e1-3f0f3de01cf7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1271 microversion: 2.1 time: 0.223462 Jul 19 22:29:38.163283 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1b910e4c-b2a4-444a-b211-30b31b168369 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e" status: 200 len: 1313 microversion: 2.1 time: 0.593977 Jul 19 22:29:38.164023 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 565/1076] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:37 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1271 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:29:38.176718 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 512/1077] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:37 2022] GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e => generated 1313 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:38.593322 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-81fc5aa9-cb94-4076-98b0-adc9afbdddfb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:38.595233 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-81fc5aa9-cb94-4076-98b0-adc9afbdddfb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:38.614040 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6d19b5a1-f587-4326-b516-500039222c3c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:38.618956 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6d19b5a1-f587-4326-b516-500039222c3c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:38.635760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-81fc5aa9-cb94-4076-98b0-adc9afbdddfb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:38.638816 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-81fc5aa9-cb94-4076-98b0-adc9afbdddfb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:38.640134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-81fc5aa9-cb94-4076-98b0-adc9afbdddfb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:38.640964 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-81fc5aa9-cb94-4076-98b0-adc9afbdddfb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:38.642618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6d19b5a1-f587-4326-b516-500039222c3c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:38.645198 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6d19b5a1-f587-4326-b516-500039222c3c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:38.652867 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6d19b5a1-f587-4326-b516-500039222c3c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:38.654263 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6d19b5a1-f587-4326-b516-500039222c3c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:38.875868 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6d19b5a1-f587-4326-b516-500039222c3c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:38.894927 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6d19b5a1-f587-4326-b516-500039222c3c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1" status: 200 len: 1274 microversion: 2.1 time: 0.294669 Jul 19 22:29:38.896828 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 513/1078] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:38 2022] GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 => generated 1274 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:39.195612 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1caf4129-2add-49ca-a151-fa8d2f81f96d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:39.204095 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1caf4129-2add-49ca-a151-fa8d2f81f96d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:39.246299 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1caf4129-2add-49ca-a151-fa8d2f81f96d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:39.251760 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1caf4129-2add-49ca-a151-fa8d2f81f96d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:39.256911 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1caf4129-2add-49ca-a151-fa8d2f81f96d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:39.258279 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1caf4129-2add-49ca-a151-fa8d2f81f96d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:39.411428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-81fc5aa9-cb94-4076-98b0-adc9afbdddfb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:39.425914 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-81fc5aa9-cb94-4076-98b0-adc9afbdddfb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 200 len: 1476 microversion: 2.1 time: 0.844616 Jul 19 22:29:39.426976 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 566/1079] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:38 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 1476 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:39.437211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ebf9cbe8-2d7a-4ee5-9369-00947465038f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:39.439245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ebf9cbe8-2d7a-4ee5-9369-00947465038f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 03987102-e808-4669-a48a-d9cee489c71e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:39.452997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ebf9cbe8-2d7a-4ee5-9369-00947465038f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:39.454332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ebf9cbe8-2d7a-4ee5-9369-00947465038f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:39.456010 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ebf9cbe8-2d7a-4ee5-9369-00947465038f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:39.457009 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ebf9cbe8-2d7a-4ee5-9369-00947465038f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:39.982158 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1caf4129-2add-49ca-a151-fa8d2f81f96d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:40.044277 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1caf4129-2add-49ca-a151-fa8d2f81f96d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1313 microversion: 2.1 time: 0.859704 Jul 19 22:29:40.049701 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 514/1080] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:39 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1313 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:40.064565 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-207f944b-4c24-4777-9249-8ad37beb2aef tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-39250698"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:40.066772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-207f944b-4c24-4777-9249-8ad37beb2aef tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:40.106117 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-207f944b-4c24-4777-9249-8ad37beb2aef tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:40.107659 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-207f944b-4c24-4777-9249-8ad37beb2aef tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:40.110051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-207f944b-4c24-4777-9249-8ad37beb2aef tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:40.112803 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-207f944b-4c24-4777-9249-8ad37beb2aef tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:40.395482 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ebf9cbe8-2d7a-4ee5-9369-00947465038f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:40.415793 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ebf9cbe8-2d7a-4ee5-9369-00947465038f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e" status: 200 len: 1462 microversion: 2.1 time: 0.986458 Jul 19 22:29:40.423405 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 567/1081] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:39 2022] GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e => generated 1462 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:40.430744 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-15aa5c46-8ea8-4a76-97a8-2bb02123dd22 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:40.432376 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-15aa5c46-8ea8-4a76-97a8-2bb02123dd22 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:40.442917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-15aa5c46-8ea8-4a76-97a8-2bb02123dd22 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:40.445371 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-15aa5c46-8ea8-4a76-97a8-2bb02123dd22 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:40.447719 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-15aa5c46-8ea8-4a76-97a8-2bb02123dd22 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:40.448408 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-15aa5c46-8ea8-4a76-97a8-2bb02123dd22 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:40.831799 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-207f944b-4c24-4777-9249-8ad37beb2aef tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "POST /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab/action" status: 202 len: 0 microversion: 2.1 time: 0.776607 Jul 19 22:29:40.842220 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 515/1082] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:29:40 2022] POST /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab/action => generated 0 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 22:29:40.856176 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-02d55961-aacd-4499-8065-b04ad098dbc2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:40.858417 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-02d55961-aacd-4499-8065-b04ad098dbc2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:40.893729 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02d55961-aacd-4499-8065-b04ad098dbc2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:40.895080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02d55961-aacd-4499-8065-b04ad098dbc2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:40.896614 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02d55961-aacd-4499-8065-b04ad098dbc2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:40.897388 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02d55961-aacd-4499-8065-b04ad098dbc2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:41.162798 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-15aa5c46-8ea8-4a76-97a8-2bb02123dd22 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:41.187913 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-15aa5c46-8ea8-4a76-97a8-2bb02123dd22 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1" status: 200 len: 1274 microversion: 2.1 time: 0.757280 Jul 19 22:29:41.189257 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 568/1083] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:40 2022] GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 => generated 1274 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:41.231477 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0629d8bf-df7e-418a-80af-f398dd853454 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a103f71f0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:41.307100 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0629d8bf-df7e-418a-80af-f398dd853454 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006" status: 200 len: 1412 microversion: 2.1 time: 0.098861 Jul 19 22:29:41.308938 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 569/1084] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:29:41 2022] GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006 => generated 1412 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:41.314246 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d280c2bd-3b55-459f-9eb9-f9acb8b3a7f8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:41.315183 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d280c2bd-3b55-459f-9eb9-f9acb8b3a7f8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:41.323611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d280c2bd-3b55-459f-9eb9-f9acb8b3a7f8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:41.324821 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d280c2bd-3b55-459f-9eb9-f9acb8b3a7f8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:41.325796 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d280c2bd-3b55-459f-9eb9-f9acb8b3a7f8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:41.326397 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d280c2bd-3b55-459f-9eb9-f9acb8b3a7f8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:41.952066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-02d55961-aacd-4499-8065-b04ad098dbc2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:42.005492 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-02d55961-aacd-4499-8065-b04ad098dbc2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1464 microversion: 2.1 time: 1.160910 Jul 19 22:29:42.014082 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 516/1085] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:40 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1464 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:42.222626 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3d605ba7-0560-4c65-97c9-be58ba2e4f67 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:42.223320 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3d605ba7-0560-4c65-97c9-be58ba2e4f67 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:42.252854 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d605ba7-0560-4c65-97c9-be58ba2e4f67 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:42.253646 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d605ba7-0560-4c65-97c9-be58ba2e4f67 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:42.255047 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d605ba7-0560-4c65-97c9-be58ba2e4f67 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:42.263737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d605ba7-0560-4c65-97c9-be58ba2e4f67 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:42.532162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d280c2bd-3b55-459f-9eb9-f9acb8b3a7f8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:42.564039 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d280c2bd-3b55-459f-9eb9-f9acb8b3a7f8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1313 microversion: 2.1 time: 1.252913 Jul 19 22:29:42.577020 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 570/1086] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:41 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1313 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:42.585461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f62a65e5-104b-4bc6-a5f9-c7cbec81267e tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1038092757", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:42.734428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-f62a65e5-104b-4bc6-a5f9-c7cbec81267e tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] validate_networks() for None {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:29:43.571294 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3d605ba7-0560-4c65-97c9-be58ba2e4f67 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:43.602233 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3d605ba7-0560-4c65-97c9-be58ba2e4f67 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1" status: 200 len: 1316 microversion: 2.1 time: 1.386799 Jul 19 22:29:43.604733 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 517/1087] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:42 2022] GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 => generated 1316 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:29:43.616332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a72416ac-fad9-42ba-9e2d-e5df2cb0573c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a104b1dc0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:43.720424 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a72416ac-fad9-42ba-9e2d-e5df2cb0573c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006" status: 200 len: 1412 microversion: 2.1 time: 0.112756 Jul 19 22:29:43.722331 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 518/1088] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:29:43 2022] GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006 => generated 1412 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:43.733536 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f9e24ef9-de14-4e94-bddc-c5ac42d4891f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:43.735052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f9e24ef9-de14-4e94-bddc-c5ac42d4891f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:43.755948 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9e24ef9-de14-4e94-bddc-c5ac42d4891f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:43.758993 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9e24ef9-de14-4e94-bddc-c5ac42d4891f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:43.762309 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9e24ef9-de14-4e94-bddc-c5ac42d4891f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:43.763539 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9e24ef9-de14-4e94-bddc-c5ac42d4891f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:44.000477 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:29:44.858971 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-f62a65e5-104b-4bc6-a5f9-c7cbec81267e tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:29:44.860409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-f62a65e5-104b-4bc6-a5f9-c7cbec81267e tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:29:44.861864 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-f62a65e5-104b-4bc6-a5f9-c7cbec81267e tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:29:44.863484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-f62a65e5-104b-4bc6-a5f9-c7cbec81267e tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:29:44.864257 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-f62a65e5-104b-4bc6-a5f9-c7cbec81267e tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:29:44.890979 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f62a65e5-104b-4bc6-a5f9-c7cbec81267e tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:44.891484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f62a65e5-104b-4bc6-a5f9-c7cbec81267e tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:44.892307 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f62a65e5-104b-4bc6-a5f9-c7cbec81267e tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:44.892751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f62a65e5-104b-4bc6-a5f9-c7cbec81267e tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:44.918048 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-f62a65e5-104b-4bc6-a5f9-c7cbec81267e tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Getting quotas for project 512cc31b5f6546eeb04486cd5213e441. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:29:44.926099 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-f62a65e5-104b-4bc6-a5f9-c7cbec81267e tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Getting quotas for user 4781dbc875d24dc490e598b41905a542 and project 512cc31b5f6546eeb04486cd5213e441. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:29:44.953370 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f62a65e5-104b-4bc6-a5f9-c7cbec81267e tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:29:44.956505 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f62a65e5-104b-4bc6-a5f9-c7cbec81267e tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: ab10a036-a8b3-44c0-a0c8-4adc2002adff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:29:45.006723 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f9e24ef9-de14-4e94-bddc-c5ac42d4891f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:45.044289 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f9e24ef9-de14-4e94-bddc-c5ac42d4891f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1313 microversion: 2.1 time: 1.303154 Jul 19 22:29:45.051580 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f62a65e5-104b-4bc6-a5f9-c7cbec81267e tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.472817 Jul 19 22:29:45.059616 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 519/1089] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:43 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1313 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:45.061370 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 571/1090] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:29:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:29:45.069881 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d1329095-4e68-4172-947f-ea3d7dcd859c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a1040f040>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:45.079722 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-990ccdf1-3d96-444d-8042-441a43dd3719 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:45.085640 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-990ccdf1-3d96-444d-8042-441a43dd3719 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:45.099340 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-990ccdf1-3d96-444d-8042-441a43dd3719 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:45.100799 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-990ccdf1-3d96-444d-8042-441a43dd3719 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:45.112313 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-990ccdf1-3d96-444d-8042-441a43dd3719 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:45.113063 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-990ccdf1-3d96-444d-8042-441a43dd3719 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:45.276565 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d1329095-4e68-4172-947f-ea3d7dcd859c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006" status: 200 len: 1412 microversion: 2.1 time: 0.211321 Jul 19 22:29:45.294777 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 572/1091] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:29:45 2022] GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006 => generated 1412 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:45.326908 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b12fb1e7-189a-46b8-92e8-6148a7f54b35 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:45.328690 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b12fb1e7-189a-46b8-92e8-6148a7f54b35 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: ab10a036-a8b3-44c0-a0c8-4adc2002adff] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:45.602245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b12fb1e7-189a-46b8-92e8-6148a7f54b35 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:45.623080 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b12fb1e7-189a-46b8-92e8-6148a7f54b35 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff" status: 200 len: 1214 microversion: 2.1 time: 0.331911 Jul 19 22:29:45.627981 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 573/1092] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:45 2022] GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff => generated 1214 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:45.992126 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-990ccdf1-3d96-444d-8042-441a43dd3719 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:46.028792 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-990ccdf1-3d96-444d-8042-441a43dd3719 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1" status: 200 len: 1316 microversion: 2.1 time: 0.967392 Jul 19 22:29:46.029746 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 520/1093] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:45 2022] GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 => generated 1316 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:46.082062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ad1ef356-00b8-4c4a-aee4-ba74dfcc4a45 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:46.082913 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ad1ef356-00b8-4c4a-aee4-ba74dfcc4a45 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:46.110254 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad1ef356-00b8-4c4a-aee4-ba74dfcc4a45 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:46.110753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad1ef356-00b8-4c4a-aee4-ba74dfcc4a45 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:46.111658 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad1ef356-00b8-4c4a-aee4-ba74dfcc4a45 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:46.112319 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad1ef356-00b8-4c4a-aee4-ba74dfcc4a45 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:46.318775 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d5bee4e2-76f8-4af0-9d88-9c7fbe905be6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a103f4310>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:46.490674 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d5bee4e2-76f8-4af0-9d88-9c7fbe905be6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006" status: 200 len: 1412 microversion: 2.1 time: 0.192599 Jul 19 22:29:46.499576 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 521/1094] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:29:46 2022] GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006 => generated 1412 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:46.530886 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-f92cf41c-425e-43f6-a648-fdfd85538cd3 req-e82cbd8a-7596-4079-8f9c-e2af45c30536 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e6ee0c6-66e1-4877-a7be-b7996a03d158", "tag": "5964d642-fd77-41ab-93fe-df25f0bebc9c"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:46.588195 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f92cf41c-425e-43f6-a648-fdfd85538cd3 req-e82cbd8a-7596-4079-8f9c-e2af45c30536 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:46.588969 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f92cf41c-425e-43f6-a648-fdfd85538cd3 req-e82cbd8a-7596-4079-8f9c-e2af45c30536 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:46.656719 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-f92cf41c-425e-43f6-a648-fdfd85538cd3 req-e82cbd8a-7596-4079-8f9c-e2af45c30536 service nova] Creating event network-changed:5964d642-fd77-41ab-93fe-df25f0bebc9c for instance 1e6ee0c6-66e1-4877-a7be-b7996a03d158 on n-h1-847009-3 Jul 19 22:29:46.703162 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-f92cf41c-425e-43f6-a648-fdfd85538cd3 req-e82cbd8a-7596-4079-8f9c-e2af45c30536 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190042 Jul 19 22:29:46.708943 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 522/1095] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:46.737179 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8f4d3875-3a60-4e35-a8f4-c4532d96183f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:46.745106 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8f4d3875-3a60-4e35-a8f4-c4532d96183f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: ab10a036-a8b3-44c0-a0c8-4adc2002adff] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:46.796823 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8f4d3875-3a60-4e35-a8f4-c4532d96183f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:46.798041 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8f4d3875-3a60-4e35-a8f4-c4532d96183f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:46.808775 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8f4d3875-3a60-4e35-a8f4-c4532d96183f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:46.816524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8f4d3875-3a60-4e35-a8f4-c4532d96183f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:47.320801 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8f4d3875-3a60-4e35-a8f4-c4532d96183f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:47.375430 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8f4d3875-3a60-4e35-a8f4-c4532d96183f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff" status: 200 len: 1210 microversion: 2.1 time: 0.659080 Jul 19 22:29:47.377002 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 523/1096] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:46 2022] GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff => generated 1210 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:47.383682 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-440628df-8a40-4f1f-abf5-43e27ccb4d7d tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:47.384954 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-440628df-8a40-4f1f-abf5-43e27ccb4d7d tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:47.396901 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-440628df-8a40-4f1f-abf5-43e27ccb4d7d tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:47.397621 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-440628df-8a40-4f1f-abf5-43e27ccb4d7d tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:47.398948 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-440628df-8a40-4f1f-abf5-43e27ccb4d7d tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:47.399786 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-440628df-8a40-4f1f-abf5-43e27ccb4d7d tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:47.407092 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:29:48.001160 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ad1ef356-00b8-4c4a-aee4-ba74dfcc4a45 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:48.030633 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ad1ef356-00b8-4c4a-aee4-ba74dfcc4a45 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1313 microversion: 2.1 time: 1.952509 Jul 19 22:29:48.035396 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 574/1097] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:46 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1313 bytes in 1958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:29:48.044959 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2d487654-e8da-4334-91e5-1e4bac6d22b8 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a103fc820>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:48.201721 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2d487654-e8da-4334-91e5-1e4bac6d22b8 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006" status: 200 len: 1412 microversion: 2.1 time: 0.164463 Jul 19 22:29:48.202991 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 575/1098] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:29:48 2022] GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006 => generated 1412 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:48.411160 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-82478709-b264-4a77-a86d-7d9b40a3478f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:48.418550 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-82478709-b264-4a77-a86d-7d9b40a3478f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: ab10a036-a8b3-44c0-a0c8-4adc2002adff] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:48.434843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-82478709-b264-4a77-a86d-7d9b40a3478f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:48.435682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-82478709-b264-4a77-a86d-7d9b40a3478f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:48.437352 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-82478709-b264-4a77-a86d-7d9b40a3478f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:48.439086 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-82478709-b264-4a77-a86d-7d9b40a3478f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:48.781506 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-82478709-b264-4a77-a86d-7d9b40a3478f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:48.814059 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-82478709-b264-4a77-a86d-7d9b40a3478f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff" status: 200 len: 1284 microversion: 2.1 time: 0.413187 Jul 19 22:29:48.818994 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 576/1099] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:48 2022] GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff => generated 1284 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:48.838150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-6750ee6d-ac6b-4c26-a24c-2312b4d17110 req-f5b4fe69-9d00-4f55-986f-98b1bf955bdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab", "name": "network-vif-plugged", "status": "completed", "tag": "896237d9-1570-436b-8b3f-65f168fd8555"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:48.862849 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-6750ee6d-ac6b-4c26-a24c-2312b4d17110 req-f5b4fe69-9d00-4f55-986f-98b1bf955bdb service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:48.864013 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-6750ee6d-ac6b-4c26-a24c-2312b4d17110 req-f5b4fe69-9d00-4f55-986f-98b1bf955bdb service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:48.895035 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-6750ee6d-ac6b-4c26-a24c-2312b4d17110 req-f5b4fe69-9d00-4f55-986f-98b1bf955bdb service nova] Creating event network-vif-plugged:896237d9-1570-436b-8b3f-65f168fd8555 for instance b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab on n-h2-847009-3 Jul 19 22:29:48.905595 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-6750ee6d-ac6b-4c26-a24c-2312b4d17110 req-f5b4fe69-9d00-4f55-986f-98b1bf955bdb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084186 Jul 19 22:29:48.908506 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 577/1100] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:49.061631 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-23a9e741-60b6-4fdb-a1b8-2434815949e6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:49.063995 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-23a9e741-60b6-4fdb-a1b8-2434815949e6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:49.088337 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-23a9e741-60b6-4fdb-a1b8-2434815949e6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:49.090882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-23a9e741-60b6-4fdb-a1b8-2434815949e6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:49.092784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-23a9e741-60b6-4fdb-a1b8-2434815949e6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:49.093974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-23a9e741-60b6-4fdb-a1b8-2434815949e6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:49.195763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-440628df-8a40-4f1f-abf5-43e27ccb4d7d tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:49.248919 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-440628df-8a40-4f1f-abf5-43e27ccb4d7d tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1" status: 200 len: 1316 microversion: 2.1 time: 1.869915 Jul 19 22:29:49.263754 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 524/1101] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:47 2022] GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 => generated 1316 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:49.271868 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9cd70594-94e6-4c58-8d88-da2b271ae6a6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a1044c550>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:49.354795 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9cd70594-94e6-4c58-8d88-da2b271ae6a6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006" status: 200 len: 1412 microversion: 2.1 time: 0.088768 Jul 19 22:29:49.366737 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 525/1102] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:29:49 2022] GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006 => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:49.845767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9a6e3fbf-e2bc-44e0-82fa-96cedc41aa4d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:49.846391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9a6e3fbf-e2bc-44e0-82fa-96cedc41aa4d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: ab10a036-a8b3-44c0-a0c8-4adc2002adff] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:49.854181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a6e3fbf-e2bc-44e0-82fa-96cedc41aa4d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:49.854625 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a6e3fbf-e2bc-44e0-82fa-96cedc41aa4d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:49.856324 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a6e3fbf-e2bc-44e0-82fa-96cedc41aa4d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:49.857098 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a6e3fbf-e2bc-44e0-82fa-96cedc41aa4d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:50.130284 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9a6e3fbf-e2bc-44e0-82fa-96cedc41aa4d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:50.156703 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9a6e3fbf-e2bc-44e0-82fa-96cedc41aa4d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff" status: 200 len: 1272 microversion: 2.1 time: 0.315480 Jul 19 22:29:50.156703 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 526/1103] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:49 2022] GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff => generated 1272 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:29:50.271946 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9241ffa2-3b57-4fc7-83c3-2016a75a02f6 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:50.272801 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9241ffa2-3b57-4fc7-83c3-2016a75a02f6 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:50.289609 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9241ffa2-3b57-4fc7-83c3-2016a75a02f6 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:50.290336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9241ffa2-3b57-4fc7-83c3-2016a75a02f6 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:50.291437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9241ffa2-3b57-4fc7-83c3-2016a75a02f6 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:50.292128 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9241ffa2-3b57-4fc7-83c3-2016a75a02f6 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:50.428682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-23a9e741-60b6-4fdb-a1b8-2434815949e6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:50.447004 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-23a9e741-60b6-4fdb-a1b8-2434815949e6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1313 microversion: 2.1 time: 1.396572 Jul 19 22:29:50.459536 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 578/1104] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:49 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1313 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:29:50.467830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c40cd3b4-4c8d-4b79-ab5a-e541fb66a862 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a10444ee0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:50.608285 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c40cd3b4-4c8d-4b79-ab5a-e541fb66a862 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006" status: 200 len: 1412 microversion: 2.1 time: 0.144702 Jul 19 22:29:50.610106 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 579/1105] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:29:50 2022] GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006 => generated 1412 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:50.631489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-1a4ba4ec-fd0f-44a6-94ff-a0ea24c35b92 req-3dcbb7a0-6f3a-4fdc-a8cc-b528b9e53a15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a55a915-9f3d-4d8b-be8b-b1f7290eccc1", "tag": "8e6d0cbe-d249-4344-a244-71c2ccf15b18"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:50.648431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1a4ba4ec-fd0f-44a6-94ff-a0ea24c35b92 req-3dcbb7a0-6f3a-4fdc-a8cc-b528b9e53a15 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:50.649070 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1a4ba4ec-fd0f-44a6-94ff-a0ea24c35b92 req-3dcbb7a0-6f3a-4fdc-a8cc-b528b9e53a15 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:50.671532 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-1a4ba4ec-fd0f-44a6-94ff-a0ea24c35b92 req-3dcbb7a0-6f3a-4fdc-a8cc-b528b9e53a15 service nova] Creating event network-changed:8e6d0cbe-d249-4344-a244-71c2ccf15b18 for instance 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 on n-h1-847009-3 Jul 19 22:29:50.684696 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-1a4ba4ec-fd0f-44a6-94ff-a0ea24c35b92 req-3dcbb7a0-6f3a-4fdc-a8cc-b528b9e53a15 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069792 Jul 19 22:29:50.686435 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 580/1106] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:51.100065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9241ffa2-3b57-4fc7-83c3-2016a75a02f6 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:51.115089 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9241ffa2-3b57-4fc7-83c3-2016a75a02f6 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1" status: 200 len: 1316 microversion: 2.1 time: 0.847027 Jul 19 22:29:51.119989 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 527/1107] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:50 2022] GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 => generated 1316 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:29:51.188672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5c6d88ba-a7f3-4677-ab6b-dbf63f1d3600 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:51.192260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5c6d88ba-a7f3-4677-ab6b-dbf63f1d3600 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: ab10a036-a8b3-44c0-a0c8-4adc2002adff] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:51.204317 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c6d88ba-a7f3-4677-ab6b-dbf63f1d3600 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:51.207355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c6d88ba-a7f3-4677-ab6b-dbf63f1d3600 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:51.210253 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c6d88ba-a7f3-4677-ab6b-dbf63f1d3600 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:51.214248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c6d88ba-a7f3-4677-ab6b-dbf63f1d3600 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:51.470944 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6377f533-6d43-4930-ad59-9930a63470eb tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:51.485242 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6377f533-6d43-4930-ad59-9930a63470eb tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:51.507933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=94 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:29:51.510272 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6377f533-6d43-4930-ad59-9930a63470eb tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:51.512871 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6377f533-6d43-4930-ad59-9930a63470eb tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:51.513900 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6377f533-6d43-4930-ad59-9930a63470eb tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:51.515389 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6377f533-6d43-4930-ad59-9930a63470eb tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:52.175552 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5c6d88ba-a7f3-4677-ab6b-dbf63f1d3600 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:52.201999 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5c6d88ba-a7f3-4677-ab6b-dbf63f1d3600 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff" status: 200 len: 1314 microversion: 2.1 time: 1.023034 Jul 19 22:29:52.203247 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 581/1108] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:51 2022] GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff => generated 1314 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:52.510450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6377f533-6d43-4930-ad59-9930a63470eb tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:52.530196 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6377f533-6d43-4930-ad59-9930a63470eb tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1313 microversion: 2.1 time: 1.066115 Jul 19 22:29:52.541891 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 528/1109] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:51 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1313 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:52.567400 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8fb25c70-e890-400b-bb95-819ec1838537 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a10415c10>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:52.679435 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-88243b23-c8ce-4950-87ce-f28cf3e976b1 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1595494772", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "7fb227a3-c946-4497-a05d-837fd699bb48"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:52.717014 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8fb25c70-e890-400b-bb95-819ec1838537 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006" status: 200 len: 1412 microversion: 2.1 time: 0.169472 Jul 19 22:29:52.724037 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 529/1110] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:29:52 2022] GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006 => generated 1412 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:52.730546 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-657b6b22-1ec0-4c9c-bfdd-6fb94a63c3e7 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:52.735158 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-657b6b22-1ec0-4c9c-bfdd-6fb94a63c3e7 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:52.753769 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-657b6b22-1ec0-4c9c-bfdd-6fb94a63c3e7 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:52.755571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-657b6b22-1ec0-4c9c-bfdd-6fb94a63c3e7 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:52.759875 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-657b6b22-1ec0-4c9c-bfdd-6fb94a63c3e7 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:52.768644 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-657b6b22-1ec0-4c9c-bfdd-6fb94a63c3e7 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:52.790787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-88243b23-c8ce-4950-87ce-f28cf3e976b1 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] validate_networks() for [('7fb227a3-c946-4497-a05d-837fd699bb48', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:29:53.851079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-657b6b22-1ec0-4c9c-bfdd-6fb94a63c3e7 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:53.878428 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-657b6b22-1ec0-4c9c-bfdd-6fb94a63c3e7 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1" status: 200 len: 1316 microversion: 2.1 time: 1.152764 Jul 19 22:29:53.879737 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 530/1111] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:52 2022] GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 => generated 1316 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:53.885574 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-d5a49516-cc0f-4a4a-876e-4d5b8c036111 req-4d0562c5-4f2a-466f-a173-96f04e9a487e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab10a036-a8b3-44c0-a0c8-4adc2002adff", "tag": "77a3a43b-8e3e-4477-8abe-6e3d58a24309"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:29:53.898741 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d5a49516-cc0f-4a4a-876e-4d5b8c036111 req-4d0562c5-4f2a-466f-a173-96f04e9a487e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:53.899994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d5a49516-cc0f-4a4a-876e-4d5b8c036111 req-4d0562c5-4f2a-466f-a173-96f04e9a487e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:53.932441 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-d5a49516-cc0f-4a4a-876e-4d5b8c036111 req-4d0562c5-4f2a-466f-a173-96f04e9a487e service nova] Creating event network-changed:77a3a43b-8e3e-4477-8abe-6e3d58a24309 for instance ab10a036-a8b3-44c0-a0c8-4adc2002adff on n-h2-847009-3 Jul 19 22:29:53.941865 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-d5a49516-cc0f-4a4a-876e-4d5b8c036111 req-4d0562c5-4f2a-466f-a173-96f04e9a487e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060237 Jul 19 22:29:53.943353 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 531/1112] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:29:53.970233 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-840bd6e8-b048-4200-b3c7-180e4100f220 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:53.971934 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-840bd6e8-b048-4200-b3c7-180e4100f220 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: ab10a036-a8b3-44c0-a0c8-4adc2002adff] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:53.984316 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-840bd6e8-b048-4200-b3c7-180e4100f220 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:53.985433 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-840bd6e8-b048-4200-b3c7-180e4100f220 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:53.986982 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-840bd6e8-b048-4200-b3c7-180e4100f220 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:53.987961 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-840bd6e8-b048-4200-b3c7-180e4100f220 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:54.231974 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-840bd6e8-b048-4200-b3c7-180e4100f220 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:54.245150 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-840bd6e8-b048-4200-b3c7-180e4100f220 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff" status: 200 len: 1314 microversion: 2.1 time: 0.293072 Jul 19 22:29:54.258505 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 532/1113] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:53 2022] GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:54.269381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-79daa74a-4803-41ca-8916-fdb799e1ff3e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:54.270010 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-79daa74a-4803-41ca-8916-fdb799e1ff3e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:54.290455 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79daa74a-4803-41ca-8916-fdb799e1ff3e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:54.292308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79daa74a-4803-41ca-8916-fdb799e1ff3e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:54.293409 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79daa74a-4803-41ca-8916-fdb799e1ff3e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:54.293933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79daa74a-4803-41ca-8916-fdb799e1ff3e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:54.489081 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-88243b23-c8ce-4950-87ce-f28cf3e976b1 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:29:54.490935 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-88243b23-c8ce-4950-87ce-f28cf3e976b1 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:29:54.492049 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-88243b23-c8ce-4950-87ce-f28cf3e976b1 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:29:54.493004 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-88243b23-c8ce-4950-87ce-f28cf3e976b1 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:29:54.493953 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-88243b23-c8ce-4950-87ce-f28cf3e976b1 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:29:54.529275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-79daa74a-4803-41ca-8916-fdb799e1ff3e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:54.534150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=48 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:29:54.543812 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-79daa74a-4803-41ca-8916-fdb799e1ff3e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1313 microversion: 2.1 time: 0.279916 Jul 19 22:29:54.544958 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 533/1114] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:54 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:54.546028 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88243b23-c8ce-4950-87ce-f28cf3e976b1 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:54.546491 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88243b23-c8ce-4950-87ce-f28cf3e976b1 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:54.547335 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88243b23-c8ce-4950-87ce-f28cf3e976b1 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:54.547776 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88243b23-c8ce-4950-87ce-f28cf3e976b1 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:54.560725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-32670f21-1243-4202-9d87-1b69226c0012 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a104153a0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:54.611948 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-88243b23-c8ce-4950-87ce-f28cf3e976b1 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Getting quotas for project 94e68faed5a742fcbd3818f9c0f6569a. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:29:54.653166 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-88243b23-c8ce-4950-87ce-f28cf3e976b1 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Getting quotas for user 0f20e57a90994fbb989c749dc3ea2ec6 and project 94e68faed5a742fcbd3818f9c0f6569a. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:29:54.687165 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-32670f21-1243-4202-9d87-1b69226c0012 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006" status: 200 len: 1412 microversion: 2.1 time: 0.134588 Jul 19 22:29:54.689453 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 534/1115] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:29:54 2022] GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006 => generated 1412 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:54.710364 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-88243b23-c8ce-4950-87ce-f28cf3e976b1 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:29:54.716169 n-d-847009-3 devstack@n-api.service[119337]: WARNING nova.utils [None req-88243b23-c8ce-4950-87ce-f28cf3e976b1 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1595494772 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-159549477 Jul 19 22:29:54.723790 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-88243b23-c8ce-4950-87ce-f28cf3e976b1 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:29:54.804097 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-88243b23-c8ce-4950-87ce-f28cf3e976b1 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.598639 Jul 19 22:29:54.806243 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 582/1116] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:29:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:29:54.819863 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8e89da29-4f38-48d6-876a-cf6291397001 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:54.820657 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8e89da29-4f38-48d6-876a-cf6291397001 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:54.911629 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-172f4e77-62b5-4f1d-a7f8-a09c48cc3efa tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:54.912281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-172f4e77-62b5-4f1d-a7f8-a09c48cc3efa tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:54.927706 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-172f4e77-62b5-4f1d-a7f8-a09c48cc3efa tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:54.928164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-172f4e77-62b5-4f1d-a7f8-a09c48cc3efa tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:54.928960 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-172f4e77-62b5-4f1d-a7f8-a09c48cc3efa tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:54.940560 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-172f4e77-62b5-4f1d-a7f8-a09c48cc3efa tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:55.762884 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8e89da29-4f38-48d6-876a-cf6291397001 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f20e57a90994fbb989c749dc3ea2ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e68faed5a742fcbd3818f9c0f6569a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:55.775797 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8e89da29-4f38-48d6-876a-cf6291397001 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372" status: 200 len: 1232 microversion: 2.1 time: 0.963044 Jul 19 22:29:55.787859 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 535/1117] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:54 2022] GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372 => generated 1232 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:55.796645 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-182672e7-ffb1-44d9-ae9a-9dbd307e9b0d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:55.798759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-182672e7-ffb1-44d9-ae9a-9dbd307e9b0d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: ab10a036-a8b3-44c0-a0c8-4adc2002adff] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:55.817159 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-182672e7-ffb1-44d9-ae9a-9dbd307e9b0d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:55.818353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-182672e7-ffb1-44d9-ae9a-9dbd307e9b0d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:55.820746 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-182672e7-ffb1-44d9-ae9a-9dbd307e9b0d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:55.821483 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-182672e7-ffb1-44d9-ae9a-9dbd307e9b0d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:56.575730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-182672e7-ffb1-44d9-ae9a-9dbd307e9b0d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:56.624757 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-182672e7-ffb1-44d9-ae9a-9dbd307e9b0d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff" status: 200 len: 1314 microversion: 2.1 time: 0.835170 Jul 19 22:29:56.643375 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 536/1118] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:55 2022] GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff => generated 1314 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:56.652545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-005d6c13-9ce2-4bd2-8041-26c440f3f0d4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:56.653501 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-005d6c13-9ce2-4bd2-8041-26c440f3f0d4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:56.663979 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-005d6c13-9ce2-4bd2-8041-26c440f3f0d4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:56.668813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-005d6c13-9ce2-4bd2-8041-26c440f3f0d4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:56.670167 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-005d6c13-9ce2-4bd2-8041-26c440f3f0d4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:56.671565 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-005d6c13-9ce2-4bd2-8041-26c440f3f0d4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:57.054179 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-172f4e77-62b5-4f1d-a7f8-a09c48cc3efa tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:57.087981 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-172f4e77-62b5-4f1d-a7f8-a09c48cc3efa tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1" status: 200 len: 1316 microversion: 2.1 time: 2.180193 Jul 19 22:29:57.093247 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 583/1119] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:54 2022] GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 => generated 1316 bytes in 2188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:57.121261 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cec24a2b-9f98-4f52-9dae-44bad6f9e58a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a10353b80>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:57.271102 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cec24a2b-9f98-4f52-9dae-44bad6f9e58a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006" status: 200 len: 1412 microversion: 2.1 time: 0.176109 Jul 19 22:29:57.272362 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 584/1120] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:29:57 2022] GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006 => generated 1412 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:57.278505 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e9f83234-7f10-4c73-bcb8-898b4891da96 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:57.288543 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e9f83234-7f10-4c73-bcb8-898b4891da96 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:57.315712 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e9f83234-7f10-4c73-bcb8-898b4891da96 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:57.316339 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e9f83234-7f10-4c73-bcb8-898b4891da96 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:57.317641 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e9f83234-7f10-4c73-bcb8-898b4891da96 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:57.318401 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e9f83234-7f10-4c73-bcb8-898b4891da96 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:57.606610 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-005d6c13-9ce2-4bd2-8041-26c440f3f0d4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:57.650271 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-005d6c13-9ce2-4bd2-8041-26c440f3f0d4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1313 microversion: 2.1 time: 1.005219 Jul 19 22:29:57.656122 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 537/1121] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:56 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1313 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:57.678106 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-156c529b-8fab-4bc4-acfa-e85adde85b77 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:57.679590 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-156c529b-8fab-4bc4-acfa-e85adde85b77 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: ab10a036-a8b3-44c0-a0c8-4adc2002adff] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:57.705653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-156c529b-8fab-4bc4-acfa-e85adde85b77 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:57.708850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-156c529b-8fab-4bc4-acfa-e85adde85b77 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:57.712643 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-156c529b-8fab-4bc4-acfa-e85adde85b77 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:57.716414 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-156c529b-8fab-4bc4-acfa-e85adde85b77 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:57.877972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e9f83234-7f10-4c73-bcb8-898b4891da96 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f20e57a90994fbb989c749dc3ea2ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e68faed5a742fcbd3818f9c0f6569a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:57.892462 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e9f83234-7f10-4c73-bcb8-898b4891da96 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372" status: 200 len: 1236 microversion: 2.1 time: 0.618635 Jul 19 22:29:57.894687 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 585/1122] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:57 2022] GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372 => generated 1236 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:58.114601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8d8bc31e-10c6-4114-b09a-62d3e84f7d86 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:58.121046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8d8bc31e-10c6-4114-b09a-62d3e84f7d86 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:58.192099 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8d8bc31e-10c6-4114-b09a-62d3e84f7d86 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:58.192551 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8d8bc31e-10c6-4114-b09a-62d3e84f7d86 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:58.193517 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8d8bc31e-10c6-4114-b09a-62d3e84f7d86 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:58.193891 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8d8bc31e-10c6-4114-b09a-62d3e84f7d86 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:58.838145 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8d8bc31e-10c6-4114-b09a-62d3e84f7d86 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:58.877960 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-156c529b-8fab-4bc4-acfa-e85adde85b77 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:58.882648 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8d8bc31e-10c6-4114-b09a-62d3e84f7d86 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1" status: 200 len: 1316 microversion: 2.1 time: 0.774714 Jul 19 22:29:58.884332 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 586/1123] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:58 2022] GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 => generated 1316 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:29:58.896273 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-156c529b-8fab-4bc4-acfa-e85adde85b77 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff" status: 200 len: 1314 microversion: 2.1 time: 1.228115 Jul 19 22:29:58.897119 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 538/1124] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:57 2022] GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff => generated 1314 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:58.897355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-131b5f9c-b507-4f75-be70-6bb28f3d259e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a104c5e50>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:58.912123 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-67b976fd-997c-4355-9183-42c696ef0f97 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:58.915441 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-67b976fd-997c-4355-9183-42c696ef0f97 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:58.944157 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67b976fd-997c-4355-9183-42c696ef0f97 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:58.946394 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67b976fd-997c-4355-9183-42c696ef0f97 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:58.947336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67b976fd-997c-4355-9183-42c696ef0f97 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:58.947758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67b976fd-997c-4355-9183-42c696ef0f97 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:59.068068 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-131b5f9c-b507-4f75-be70-6bb28f3d259e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006" status: 200 len: 1412 microversion: 2.1 time: 0.173388 Jul 19 22:29:59.069174 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 587/1125] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:29:58 2022] GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006 => generated 1412 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:59.083596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5e5bd610-a6a5-42f8-9b33-b4fcda91cc90 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:59.093074 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5e5bd610-a6a5-42f8-9b33-b4fcda91cc90 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:59.144080 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5e5bd610-a6a5-42f8-9b33-b4fcda91cc90 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:59.145995 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5e5bd610-a6a5-42f8-9b33-b4fcda91cc90 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:59.148093 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5e5bd610-a6a5-42f8-9b33-b4fcda91cc90 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:59.153899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5e5bd610-a6a5-42f8-9b33-b4fcda91cc90 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:59.424124 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5e5bd610-a6a5-42f8-9b33-b4fcda91cc90 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f20e57a90994fbb989c749dc3ea2ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e68faed5a742fcbd3818f9c0f6569a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:59.455409 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5e5bd610-a6a5-42f8-9b33-b4fcda91cc90 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372" status: 200 len: 1284 microversion: 2.1 time: 0.384007 Jul 19 22:29:59.460355 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 588/1126] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:59 2022] GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372 => generated 1284 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:59.663278 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-67b976fd-997c-4355-9183-42c696ef0f97 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:29:59.690627 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-67b976fd-997c-4355-9183-42c696ef0f97 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1313 microversion: 2.1 time: 0.788237 Jul 19 22:29:59.692701 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 539/1127] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:58 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1313 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:29:59.906575 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5ca97749-f4b1-4dec-83c4-0733fa2ebf25 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:59.910587 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5ca97749-f4b1-4dec-83c4-0733fa2ebf25 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:59.934375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fb964b41-7953-48ca-b7bd-698bbf666930 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:29:59.936688 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fb964b41-7953-48ca-b7bd-698bbf666930 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: ab10a036-a8b3-44c0-a0c8-4adc2002adff] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:29:59.961420 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fb964b41-7953-48ca-b7bd-698bbf666930 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:59.962531 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ca97749-f4b1-4dec-83c4-0733fa2ebf25 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:59.963081 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fb964b41-7953-48ca-b7bd-698bbf666930 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:59.963317 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ca97749-f4b1-4dec-83c4-0733fa2ebf25 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:59.964987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fb964b41-7953-48ca-b7bd-698bbf666930 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:59.966238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fb964b41-7953-48ca-b7bd-698bbf666930 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:29:59.969249 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ca97749-f4b1-4dec-83c4-0733fa2ebf25 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:29:59.973483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ca97749-f4b1-4dec-83c4-0733fa2ebf25 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:00.822738 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fb964b41-7953-48ca-b7bd-698bbf666930 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:00.850714 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fb964b41-7953-48ca-b7bd-698bbf666930 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff" status: 200 len: 1314 microversion: 2.1 time: 0.910812 Jul 19 22:30:00.864769 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 540/1128] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:59 2022] GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff => generated 1314 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:30:00.957920 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e775e785-f88d-4074-97ca-dec0db20d237 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a1044c8b0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:01.193053 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e775e785-f88d-4074-97ca-dec0db20d237 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006" status: 200 len: 1412 microversion: 2.1 time: 0.322124 Jul 19 22:30:01.198317 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 541/1129] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:30:00 2022] GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006 => generated 1412 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:01.210281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5ca97749-f4b1-4dec-83c4-0733fa2ebf25 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:01.225359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d3a77fff-18bb-4da3-949a-3d0c65bf6edd tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:01.226266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d3a77fff-18bb-4da3-949a-3d0c65bf6edd tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:01.254447 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3a77fff-18bb-4da3-949a-3d0c65bf6edd tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:01.256220 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3a77fff-18bb-4da3-949a-3d0c65bf6edd tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:01.257290 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3a77fff-18bb-4da3-949a-3d0c65bf6edd tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:01.257908 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3a77fff-18bb-4da3-949a-3d0c65bf6edd tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:01.268581 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5ca97749-f4b1-4dec-83c4-0733fa2ebf25 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1" status: 200 len: 1316 microversion: 2.1 time: 1.369184 Jul 19 22:30:01.270234 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 589/1130] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:29:59 2022] GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 => generated 1316 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:30:01.283831 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-168a86a0-27d7-480a-8f76-96fe53cd3a98 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:01.286864 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-168a86a0-27d7-480a-8f76-96fe53cd3a98 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:01.313311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-168a86a0-27d7-480a-8f76-96fe53cd3a98 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:01.316748 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-168a86a0-27d7-480a-8f76-96fe53cd3a98 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:01.318422 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-168a86a0-27d7-480a-8f76-96fe53cd3a98 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:01.319627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-168a86a0-27d7-480a-8f76-96fe53cd3a98 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:01.579523 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d3a77fff-18bb-4da3-949a-3d0c65bf6edd tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f20e57a90994fbb989c749dc3ea2ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e68faed5a742fcbd3818f9c0f6569a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:01.610195 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d3a77fff-18bb-4da3-949a-3d0c65bf6edd tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372" status: 200 len: 1290 microversion: 2.1 time: 0.404759 Jul 19 22:30:01.631890 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 542/1131] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:01 2022] GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372 => generated 1290 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:01.877504 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-486c96b2-6500-4177-a548-8ab22aaa2b3b tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:01.879608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-486c96b2-6500-4177-a548-8ab22aaa2b3b tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: ab10a036-a8b3-44c0-a0c8-4adc2002adff] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:01.890538 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-486c96b2-6500-4177-a548-8ab22aaa2b3b tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:01.891442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-486c96b2-6500-4177-a548-8ab22aaa2b3b tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:01.899011 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-486c96b2-6500-4177-a548-8ab22aaa2b3b tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:01.899898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-486c96b2-6500-4177-a548-8ab22aaa2b3b tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:02.088663 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-168a86a0-27d7-480a-8f76-96fe53cd3a98 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:02.113424 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-168a86a0-27d7-480a-8f76-96fe53cd3a98 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1313 microversion: 2.1 time: 0.840086 Jul 19 22:30:02.129037 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 590/1132] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:01 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1313 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:02.170431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-038a8b14-9320-4e58-ab1d-904285a65828 req-b62a7e60-0eb9-4e0f-bcaf-79a4e08a092c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6ee0c6-66e1-4877-a7be-b7996a03d158", "name": "network-vif-plugged", "status": "completed", "tag": "5964d642-fd77-41ab-93fe-df25f0bebc9c"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:02.220326 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-038a8b14-9320-4e58-ab1d-904285a65828 req-b62a7e60-0eb9-4e0f-bcaf-79a4e08a092c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:02.223930 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-038a8b14-9320-4e58-ab1d-904285a65828 req-b62a7e60-0eb9-4e0f-bcaf-79a4e08a092c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:02.307956 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-038a8b14-9320-4e58-ab1d-904285a65828 req-b62a7e60-0eb9-4e0f-bcaf-79a4e08a092c service nova] Creating event network-vif-plugged:5964d642-fd77-41ab-93fe-df25f0bebc9c for instance 1e6ee0c6-66e1-4877-a7be-b7996a03d158 on n-h1-847009-3 Jul 19 22:30:02.373259 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-038a8b14-9320-4e58-ab1d-904285a65828 req-b62a7e60-0eb9-4e0f-bcaf-79a4e08a092c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219031 Jul 19 22:30:02.375900 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 591/1133] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:30:02.431624 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-928f8e26-8fdc-4015-bf19-82b4ad25d507 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a103fcee0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:02.628003 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-928f8e26-8fdc-4015-bf19-82b4ad25d507 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006" status: 200 len: 1412 microversion: 2.1 time: 0.223366 Jul 19 22:30:02.630713 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 592/1134] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:30:02 2022] GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006 => generated 1412 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:02.646112 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f011d329-c95c-47e7-aa06-e481b0ee9894 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:02.647939 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f011d329-c95c-47e7-aa06-e481b0ee9894 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:02.669959 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f011d329-c95c-47e7-aa06-e481b0ee9894 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:02.671169 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f011d329-c95c-47e7-aa06-e481b0ee9894 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:02.673416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f011d329-c95c-47e7-aa06-e481b0ee9894 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:02.674493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f011d329-c95c-47e7-aa06-e481b0ee9894 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:02.742579 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:30:03.630244 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-486c96b2-6500-4177-a548-8ab22aaa2b3b tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:03.655098 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-486c96b2-6500-4177-a548-8ab22aaa2b3b tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff" status: 200 len: 1314 microversion: 2.1 time: 1.781230 Jul 19 22:30:03.679424 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 543/1135] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:01 2022] GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff => generated 1314 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:30:03.685327 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-946a28e2-110f-4442-8368-9c7205414445 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:03.699149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-946a28e2-110f-4442-8368-9c7205414445 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:03.717514 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-946a28e2-110f-4442-8368-9c7205414445 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:03.719700 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-946a28e2-110f-4442-8368-9c7205414445 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:03.724346 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-946a28e2-110f-4442-8368-9c7205414445 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:03.731535 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-946a28e2-110f-4442-8368-9c7205414445 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:04.320692 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f011d329-c95c-47e7-aa06-e481b0ee9894 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:04.338278 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f011d329-c95c-47e7-aa06-e481b0ee9894 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1" status: 200 len: 1316 microversion: 2.1 time: 1.704355 Jul 19 22:30:04.346931 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 593/1136] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:02 2022] GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 => generated 1316 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:04.359100 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ed84d51d-d4ab-4c93-b7c2-cab66dd95eae tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:04.372225 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ed84d51d-d4ab-4c93-b7c2-cab66dd95eae tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:04.388345 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ed84d51d-d4ab-4c93-b7c2-cab66dd95eae tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:04.395191 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ed84d51d-d4ab-4c93-b7c2-cab66dd95eae tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:04.396387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ed84d51d-d4ab-4c93-b7c2-cab66dd95eae tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:04.399829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ed84d51d-d4ab-4c93-b7c2-cab66dd95eae tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:04.576572 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=7 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:30:04.696546 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=5 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:30:04.809291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-946a28e2-110f-4442-8368-9c7205414445 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f20e57a90994fbb989c749dc3ea2ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e68faed5a742fcbd3818f9c0f6569a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:04.827571 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-946a28e2-110f-4442-8368-9c7205414445 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372" status: 200 len: 1332 microversion: 2.1 time: 1.146564 Jul 19 22:30:04.838493 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 544/1137] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:03 2022] GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372 => generated 1332 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:04.849738 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fe031fe6-0996-433e-b4c5-f69d8b96be32 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a10461c10>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:04.972467 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fe031fe6-0996-433e-b4c5-f69d8b96be32 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006" status: 200 len: 1412 microversion: 2.1 time: 0.131767 Jul 19 22:30:04.979291 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 545/1138] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:30:04 2022] GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006 => generated 1412 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:05.001152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-81fe7e10-68b6-4267-a328-0081b61c37f6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:05.002347 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-81fe7e10-68b6-4267-a328-0081b61c37f6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: ab10a036-a8b3-44c0-a0c8-4adc2002adff] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:05.016355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81fe7e10-68b6-4267-a328-0081b61c37f6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:05.017086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81fe7e10-68b6-4267-a328-0081b61c37f6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:05.018090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81fe7e10-68b6-4267-a328-0081b61c37f6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:05.018719 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81fe7e10-68b6-4267-a328-0081b61c37f6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:05.491456 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ed84d51d-d4ab-4c93-b7c2-cab66dd95eae tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:05.520468 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ed84d51d-d4ab-4c93-b7c2-cab66dd95eae tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1313 microversion: 2.1 time: 1.171538 Jul 19 22:30:05.524695 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 594/1139] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:04 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1313 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:05.536072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-a27b1f48-c71a-4b74-9eda-622785182a4a req-eeec7458-d528-4e44-a601-9cfdaa63ca62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a55a915-9f3d-4d8b-be8b-b1f7290eccc1", "name": "network-vif-plugged", "status": "completed", "tag": "8e6d0cbe-d249-4344-a244-71c2ccf15b18"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:05.565453 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a27b1f48-c71a-4b74-9eda-622785182a4a req-eeec7458-d528-4e44-a601-9cfdaa63ca62 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:05.566172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a27b1f48-c71a-4b74-9eda-622785182a4a req-eeec7458-d528-4e44-a601-9cfdaa63ca62 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:05.621607 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-a27b1f48-c71a-4b74-9eda-622785182a4a req-eeec7458-d528-4e44-a601-9cfdaa63ca62 service nova] Creating event network-vif-plugged:8e6d0cbe-d249-4344-a244-71c2ccf15b18 for instance 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 on n-h1-847009-3 Jul 19 22:30:05.638198 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-a27b1f48-c71a-4b74-9eda-622785182a4a req-eeec7458-d528-4e44-a601-9cfdaa63ca62 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109168 Jul 19 22:30:05.646333 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 595/1140] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:30:05.674460 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fedeefb1-dec8-4a87-9f7b-2b3bd9010e4f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:05.679192 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fedeefb1-dec8-4a87-9f7b-2b3bd9010e4f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:05.708559 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fedeefb1-dec8-4a87-9f7b-2b3bd9010e4f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:05.711536 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fedeefb1-dec8-4a87-9f7b-2b3bd9010e4f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:05.715885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fedeefb1-dec8-4a87-9f7b-2b3bd9010e4f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:05.718420 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fedeefb1-dec8-4a87-9f7b-2b3bd9010e4f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:05.773528 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:30:06.385260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-81fe7e10-68b6-4267-a328-0081b61c37f6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:06.409893 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-81fe7e10-68b6-4267-a328-0081b61c37f6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff" status: 200 len: 1314 microversion: 2.1 time: 1.427934 Jul 19 22:30:06.411262 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 546/1141] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:04 2022] GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff => generated 1314 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:06.422468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-b6af8132-5b52-4de8-9c27-e0cbdfaf5997 req-cde0294a-08db-4dfb-9187-f9ca1a8fce44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a134613f-f510-43e4-943e-d869b38c4372", "tag": "b5b458c6-907b-4661-bb17-cd57f2eb40a1"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:06.442569 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b6af8132-5b52-4de8-9c27-e0cbdfaf5997 req-cde0294a-08db-4dfb-9187-f9ca1a8fce44 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:06.443879 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b6af8132-5b52-4de8-9c27-e0cbdfaf5997 req-cde0294a-08db-4dfb-9187-f9ca1a8fce44 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:06.491092 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-b6af8132-5b52-4de8-9c27-e0cbdfaf5997 req-cde0294a-08db-4dfb-9187-f9ca1a8fce44 service nova] Creating event network-changed:b5b458c6-907b-4661-bb17-cd57f2eb40a1 for instance a134613f-f510-43e4-943e-d869b38c4372 on n-h2-847009-3 Jul 19 22:30:06.498083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fedeefb1-dec8-4a87-9f7b-2b3bd9010e4f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:06.507878 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fedeefb1-dec8-4a87-9f7b-2b3bd9010e4f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1" status: 200 len: 1316 microversion: 2.1 time: 0.856824 Jul 19 22:30:06.509838 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 596/1142] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:05 2022] GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 => generated 1316 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:06.514467 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-b6af8132-5b52-4de8-9c27-e0cbdfaf5997 req-cde0294a-08db-4dfb-9187-f9ca1a8fce44 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100632 Jul 19 22:30:06.518103 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 547/1143] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:30:06.519087 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-633ca222-85f5-4d3e-9f99-da4d0fcbde42 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:06.524592 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-633ca222-85f5-4d3e-9f99-da4d0fcbde42 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:06.552013 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:30:06.556135 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-633ca222-85f5-4d3e-9f99-da4d0fcbde42 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:06.557722 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-04e32fec-8ece-4ab4-90fb-921ef1c322b2 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a10415790>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:06.561757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-633ca222-85f5-4d3e-9f99-da4d0fcbde42 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:06.562646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-633ca222-85f5-4d3e-9f99-da4d0fcbde42 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:06.563097 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-633ca222-85f5-4d3e-9f99-da4d0fcbde42 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:06.741436 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-04e32fec-8ece-4ab4-90fb-921ef1c322b2 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006" status: 200 len: 1412 microversion: 2.1 time: 0.220241 Jul 19 22:30:06.763731 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 548/1144] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:30:06 2022] GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006 => generated 1412 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:06.782893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-778d630d-3617-4a91-aad5-9d1b61e69a2a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:06.789108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-778d630d-3617-4a91-aad5-9d1b61e69a2a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:06.816174 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-778d630d-3617-4a91-aad5-9d1b61e69a2a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:06.820169 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-778d630d-3617-4a91-aad5-9d1b61e69a2a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:06.821555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-778d630d-3617-4a91-aad5-9d1b61e69a2a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:06.824125 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-778d630d-3617-4a91-aad5-9d1b61e69a2a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:06.925591 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:30:07.700740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-633ca222-85f5-4d3e-9f99-da4d0fcbde42 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f20e57a90994fbb989c749dc3ea2ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e68faed5a742fcbd3818f9c0f6569a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:07.741964 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-633ca222-85f5-4d3e-9f99-da4d0fcbde42 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372" status: 200 len: 1332 microversion: 2.1 time: 1.228309 Jul 19 22:30:07.746910 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 597/1145] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:06 2022] GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372 => generated 1332 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:07.765757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-22719263-ff35-42f5-a9c0-be96ba224bca tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:07.770025 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-22719263-ff35-42f5-a9c0-be96ba224bca tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:07.795586 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22719263-ff35-42f5-a9c0-be96ba224bca tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:07.797328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22719263-ff35-42f5-a9c0-be96ba224bca tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:07.798380 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22719263-ff35-42f5-a9c0-be96ba224bca tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:07.800215 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22719263-ff35-42f5-a9c0-be96ba224bca tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:08.072607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-778d630d-3617-4a91-aad5-9d1b61e69a2a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:08.126103 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-778d630d-3617-4a91-aad5-9d1b61e69a2a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1463 microversion: 2.1 time: 1.359736 Jul 19 22:30:08.191894 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 549/1146] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:06 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1463 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:08.206125 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-62b63594-e202-4b71-b5a5-99f7d3812a98 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:08.209149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-62b63594-e202-4b71-b5a5-99f7d3812a98 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: ab10a036-a8b3-44c0-a0c8-4adc2002adff] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:08.231573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62b63594-e202-4b71-b5a5-99f7d3812a98 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:08.232710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62b63594-e202-4b71-b5a5-99f7d3812a98 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:08.236883 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62b63594-e202-4b71-b5a5-99f7d3812a98 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:08.238096 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62b63594-e202-4b71-b5a5-99f7d3812a98 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:08.330338 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-22719263-ff35-42f5-a9c0-be96ba224bca tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1813 microversion: 2.1 time: 0.580928 Jul 19 22:30:08.347768 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 598/1147] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:07 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1813 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:08.382607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-402b8294-27ac-42d9-ab55-651caa252593 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:08.384150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-402b8294-27ac-42d9-ab55-651caa252593 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:08.394749 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-402b8294-27ac-42d9-ab55-651caa252593 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:08.396200 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-402b8294-27ac-42d9-ab55-651caa252593 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:08.397926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-402b8294-27ac-42d9-ab55-651caa252593 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:08.399072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-402b8294-27ac-42d9-ab55-651caa252593 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:08.559872 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-62b63594-e202-4b71-b5a5-99f7d3812a98 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:08.571854 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-62b63594-e202-4b71-b5a5-99f7d3812a98 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff" status: 200 len: 1314 microversion: 2.1 time: 0.378383 Jul 19 22:30:08.573633 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 550/1148] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:08 2022] GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:08.586991 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-38c5a538-a8a1-48b0-bfc1-5021ede1302b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a1052f280>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:08.724086 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-38c5a538-a8a1-48b0-bfc1-5021ede1302b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006" status: 200 len: 1412 microversion: 2.1 time: 0.148877 Jul 19 22:30:08.733362 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 551/1149] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:30:08 2022] GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006 => generated 1412 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:08.746015 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8ab9a4ea-e188-47ff-9664-2b13f8d070ec tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:08.746994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8ab9a4ea-e188-47ff-9664-2b13f8d070ec tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:08.754479 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ab9a4ea-e188-47ff-9664-2b13f8d070ec tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:08.755289 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ab9a4ea-e188-47ff-9664-2b13f8d070ec tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:08.756319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ab9a4ea-e188-47ff-9664-2b13f8d070ec tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:08.757812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ab9a4ea-e188-47ff-9664-2b13f8d070ec tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:09.031791 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-402b8294-27ac-42d9-ab55-651caa252593 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:09.053703 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-402b8294-27ac-42d9-ab55-651caa252593 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1" status: 200 len: 1466 microversion: 2.1 time: 0.690328 Jul 19 22:30:09.075151 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 599/1150] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:08 2022] GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 => generated 1466 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:09.080252 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-17702476-fae0-49ca-8f36-d2e1853f09a1 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:09.081827 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:30:09.081827 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:30:09.083296 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-17702476-fae0-49ca-8f36-d2e1853f09a1 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:09.083614 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-17702476-fae0-49ca-8f36-d2e1853f09a1 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:09.088284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-17702476-fae0-49ca-8f36-d2e1853f09a1 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:09.089135 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-17702476-fae0-49ca-8f36-d2e1853f09a1 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:09.163407 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-17702476-fae0-49ca-8f36-d2e1853f09a1 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.086554 Jul 19 22:30:09.179343 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 600/1151] 10.222.0.25 () {58 vars in 1175 bytes} [Tue Jul 19 22:30:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:30:09.192100 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b8366e72-5010-48d7-89e7-24072b11cc7c tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:09.192842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b8366e72-5010-48d7-89e7-24072b11cc7c tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:09.217664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8366e72-5010-48d7-89e7-24072b11cc7c tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:09.220044 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8366e72-5010-48d7-89e7-24072b11cc7c tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:09.227416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8366e72-5010-48d7-89e7-24072b11cc7c tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:09.233127 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8366e72-5010-48d7-89e7-24072b11cc7c tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:09.233570 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8ab9a4ea-e188-47ff-9664-2b13f8d070ec tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1614 microversion: 2.1 time: 0.498193 Jul 19 22:30:09.238096 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 552/1152] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:08 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1614 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:09.282806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-d20dc483-e78f-424c-88e3-a40752839ea0 req-ae7ecaa4-0d5b-4029-8557-4d4b20024e5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab10a036-a8b3-44c0-a0c8-4adc2002adff", "name": "network-vif-plugged", "status": "completed", "tag": "77a3a43b-8e3e-4477-8abe-6e3d58a24309"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:09.323994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d20dc483-e78f-424c-88e3-a40752839ea0 req-ae7ecaa4-0d5b-4029-8557-4d4b20024e5d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:09.324694 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d20dc483-e78f-424c-88e3-a40752839ea0 req-ae7ecaa4-0d5b-4029-8557-4d4b20024e5d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:09.354667 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-d20dc483-e78f-424c-88e3-a40752839ea0 req-ae7ecaa4-0d5b-4029-8557-4d4b20024e5d service nova] Creating event network-vif-plugged:77a3a43b-8e3e-4477-8abe-6e3d58a24309 for instance ab10a036-a8b3-44c0-a0c8-4adc2002adff on n-h2-847009-3 Jul 19 22:30:09.376959 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-d20dc483-e78f-424c-88e3-a40752839ea0 req-ae7ecaa4-0d5b-4029-8557-4d4b20024e5d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113803 Jul 19 22:30:09.378617 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 553/1153] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:30:09.399739 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-04d5fcbf-ecef-4b22-b9fe-5017accb70ba tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:09.405043 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-04d5fcbf-ecef-4b22-b9fe-5017accb70ba tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] [instance: 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:09.415373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04d5fcbf-ecef-4b22-b9fe-5017accb70ba tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:09.416639 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04d5fcbf-ecef-4b22-b9fe-5017accb70ba tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:09.418589 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04d5fcbf-ecef-4b22-b9fe-5017accb70ba tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:09.419749 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04d5fcbf-ecef-4b22-b9fe-5017accb70ba tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:09.649526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b8366e72-5010-48d7-89e7-24072b11cc7c tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f20e57a90994fbb989c749dc3ea2ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e68faed5a742fcbd3818f9c0f6569a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:09.694226 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b8366e72-5010-48d7-89e7-24072b11cc7c tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372" status: 200 len: 1332 microversion: 2.1 time: 0.512118 Jul 19 22:30:09.701890 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 601/1154] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:09 2022] GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372 => generated 1332 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:09.713320 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ea6f0034-9f2a-4538-8afd-ce812580d6dd tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:09.717197 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ea6f0034-9f2a-4538-8afd-ce812580d6dd tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:09.732276 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea6f0034-9f2a-4538-8afd-ce812580d6dd tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:09.733139 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea6f0034-9f2a-4538-8afd-ce812580d6dd tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:09.734428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea6f0034-9f2a-4538-8afd-ce812580d6dd tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:09.735041 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea6f0034-9f2a-4538-8afd-ce812580d6dd tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:09.781653 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ea6f0034-9f2a-4538-8afd-ce812580d6dd tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8c849cd3f1e44096aec522948f87ce7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85fc2601da774e8392b1ff78a3ffea0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:09.783419 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ea6f0034-9f2a-4538-8afd-ce812580d6dd tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] flavor_id is None. Assuming migration. {{(pid=119337) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 19 22:30:09.784256 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ea6f0034-9f2a-4538-8afd-ce812580d6dd tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119337) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 22:30:10.180306 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-04d5fcbf-ecef-4b22-b9fe-5017accb70ba tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1" status: 200 len: 1617 microversion: 2.1 time: 0.798233 Jul 19 22:30:10.183238 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 554/1155] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:09 2022] GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 => generated 1617 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:10.197244 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4b23d1fe-e6e6-4977-b393-8ee1c5e8a6e5 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:10.199354 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4b23d1fe-e6e6-4977-b393-8ee1c5e8a6e5 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: ab10a036-a8b3-44c0-a0c8-4adc2002adff] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:10.223344 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ea6f0034-9f2a-4538-8afd-ce812580d6dd tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158/action" status: 202 len: 0 microversion: 2.1 time: 0.508404 Jul 19 22:30:10.228927 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 602/1156] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:30:09 2022] POST /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158/action => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:30:10.244648 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b23d1fe-e6e6-4977-b393-8ee1c5e8a6e5 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:10.246030 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b23d1fe-e6e6-4977-b393-8ee1c5e8a6e5 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:10.247431 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b23d1fe-e6e6-4977-b393-8ee1c5e8a6e5 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:10.247934 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b23d1fe-e6e6-4977-b393-8ee1c5e8a6e5 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:10.265536 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3a0d9927-d8ce-4add-972e-388ad7dcd834 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a1040c940>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:10.427528 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3a0d9927-d8ce-4add-972e-388ad7dcd834 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006" status: 200 len: 1412 microversion: 2.1 time: 0.201271 Jul 19 22:30:10.429314 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 603/1157] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:30:10 2022] GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006 => generated 1412 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:10.437658 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eb8d7720-688b-4c15-8701-822ac38e9e9d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:10.439210 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eb8d7720-688b-4c15-8701-822ac38e9e9d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:10.453573 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb8d7720-688b-4c15-8701-822ac38e9e9d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:10.454750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb8d7720-688b-4c15-8701-822ac38e9e9d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:10.457256 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb8d7720-688b-4c15-8701-822ac38e9e9d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:10.458358 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb8d7720-688b-4c15-8701-822ac38e9e9d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:11.034811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-eb8d7720-688b-4c15-8701-822ac38e9e9d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:11.043354 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eb8d7720-688b-4c15-8701-822ac38e9e9d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1472 microversion: 2.1 time: 0.612593 Jul 19 22:30:11.045671 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 604/1158] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:10 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1472 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:11.058410 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bb4b6333-bc51-4230-b59c-d74f4c07bae3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-479489828", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["9d261177-b837-4836-959b-2b419921e90c"]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:11.201483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-bb4b6333-bc51-4230-b59c-d74f4c07bae3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] validate_networks() for None {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:30:11.329598 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4b23d1fe-e6e6-4977-b393-8ee1c5e8a6e5 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:11.342652 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4b23d1fe-e6e6-4977-b393-8ee1c5e8a6e5 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff" status: 200 len: 1314 microversion: 2.1 time: 1.156374 Jul 19 22:30:11.344092 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 555/1159] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:10 2022] GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff => generated 1314 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:11.351354 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-130d0bc7-cc31-4cf7-bf41-f8433e96d17b tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:11.353565 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-130d0bc7-cc31-4cf7-bf41-f8433e96d17b tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:11.382652 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-130d0bc7-cc31-4cf7-bf41-f8433e96d17b tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:11.383408 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-130d0bc7-cc31-4cf7-bf41-f8433e96d17b tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:11.384371 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-130d0bc7-cc31-4cf7-bf41-f8433e96d17b tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:11.385151 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-130d0bc7-cc31-4cf7-bf41-f8433e96d17b tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:12.236036 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-130d0bc7-cc31-4cf7-bf41-f8433e96d17b tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f20e57a90994fbb989c749dc3ea2ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e68faed5a742fcbd3818f9c0f6569a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:12.281209 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-130d0bc7-cc31-4cf7-bf41-f8433e96d17b tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372" status: 200 len: 1332 microversion: 2.1 time: 0.934839 Jul 19 22:30:12.281995 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 556/1160] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:11 2022] GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372 => generated 1332 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:12.343524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-be47e24d-7a52-45df-bead-ee942e7690be tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a104b1790>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:12.508350 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-be47e24d-7a52-45df-bead-ee942e7690be tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006" status: 200 len: 1412 microversion: 2.1 time: 0.189140 Jul 19 22:30:12.508945 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 557/1161] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:30:12 2022] GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006 => generated 1412 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:12.527022 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ce20b265-db4b-4c90-97f5-dea393c7a8a7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:12.533479 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ce20b265-db4b-4c90-97f5-dea393c7a8a7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:12.569630 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ce20b265-db4b-4c90-97f5-dea393c7a8a7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:12.584530 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ce20b265-db4b-4c90-97f5-dea393c7a8a7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:12.592850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ce20b265-db4b-4c90-97f5-dea393c7a8a7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:12.594574 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ce20b265-db4b-4c90-97f5-dea393c7a8a7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:12.773074 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-bb4b6333-bc51-4230-b59c-d74f4c07bae3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:30:12.774788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-bb4b6333-bc51-4230-b59c-d74f4c07bae3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:30:12.776101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-bb4b6333-bc51-4230-b59c-d74f4c07bae3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:30:12.777148 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-bb4b6333-bc51-4230-b59c-d74f4c07bae3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:30:12.778200 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-bb4b6333-bc51-4230-b59c-d74f4c07bae3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:30:12.869475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb4b6333-bc51-4230-b59c-d74f4c07bae3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:12.871481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb4b6333-bc51-4230-b59c-d74f4c07bae3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:12.893399 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb4b6333-bc51-4230-b59c-d74f4c07bae3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:12.894228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb4b6333-bc51-4230-b59c-d74f4c07bae3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:13.096410 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-bb4b6333-bc51-4230-b59c-d74f4c07bae3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for project 791e176b6751415ca1472c109b3ce011. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:30:13.173203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-bb4b6333-bc51-4230-b59c-d74f4c07bae3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for user bd5fb561f7bd429e8c6b2cc30ed76f13 and project 791e176b6751415ca1472c109b3ce011. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:30:13.297638 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bb4b6333-bc51-4230-b59c-d74f4c07bae3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:30:13.314252 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bb4b6333-bc51-4230-b59c-d74f4c07bae3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 67fd85a5-6cde-4aa6-acf2-99640be2bb44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:30:13.572063 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ce20b265-db4b-4c90-97f5-dea393c7a8a7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:13.625663 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ce20b265-db4b-4c90-97f5-dea393c7a8a7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1472 microversion: 2.1 time: 1.115061 Jul 19 22:30:13.643937 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 558/1162] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:12 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1472 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:13.695420 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4c1246f4-1758-437e-a380-6abf0139e0d2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:13.696664 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4c1246f4-1758-437e-a380-6abf0139e0d2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: ab10a036-a8b3-44c0-a0c8-4adc2002adff] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:13.749755 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bb4b6333-bc51-4230-b59c-d74f4c07bae3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.700091 Jul 19 22:30:13.752997 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4c1246f4-1758-437e-a380-6abf0139e0d2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:13.769255 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 605/1163] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:30:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:30:13.774684 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4c1246f4-1758-437e-a380-6abf0139e0d2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:13.776401 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4c1246f4-1758-437e-a380-6abf0139e0d2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:13.795979 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4c1246f4-1758-437e-a380-6abf0139e0d2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:13.821327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9ec2469c-1318-4029-9db6-5b12317b582f tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:13.831015 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9ec2469c-1318-4029-9db6-5b12317b582f tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:14.025265 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ec2469c-1318-4029-9db6-5b12317b582f tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:14.027961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ec2469c-1318-4029-9db6-5b12317b582f tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:14.029701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ec2469c-1318-4029-9db6-5b12317b582f tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:14.041723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ec2469c-1318-4029-9db6-5b12317b582f tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:14.927627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9ec2469c-1318-4029-9db6-5b12317b582f tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f20e57a90994fbb989c749dc3ea2ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e68faed5a742fcbd3818f9c0f6569a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:14.970489 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9ec2469c-1318-4029-9db6-5b12317b582f tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372" status: 200 len: 1332 microversion: 2.1 time: 1.196260 Jul 19 22:30:14.975062 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 606/1164] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:13 2022] GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372 => generated 1332 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:15.001386 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2c0d4bb0-0540-4057-98d4-c0585e1f6412 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a1040f5e0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:15.062306 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4c1246f4-1758-437e-a380-6abf0139e0d2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:15.078377 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4c1246f4-1758-437e-a380-6abf0139e0d2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff" status: 200 len: 1464 microversion: 2.1 time: 1.428908 Jul 19 22:30:15.079422 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 559/1165] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:13 2022] GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff => generated 1464 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:15.082778 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2c0d4bb0-0540-4057-98d4-c0585e1f6412 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006" status: 200 len: 1412 microversion: 2.1 time: 0.105170 Jul 19 22:30:15.083768 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 607/1166] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:30:14 2022] GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006 => generated 1412 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:15.102076 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d48107e2-26e2-4aae-9369-dac821bc9402 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:15.103284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d48107e2-26e2-4aae-9369-dac821bc9402 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:15.114146 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d48107e2-26e2-4aae-9369-dac821bc9402 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:15.114832 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d48107e2-26e2-4aae-9369-dac821bc9402 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:15.116222 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d48107e2-26e2-4aae-9369-dac821bc9402 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:15.116971 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d48107e2-26e2-4aae-9369-dac821bc9402 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:15.131792 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-04e65f2d-1973-4c64-99bd-d166d3c8168e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:15.134169 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-04e65f2d-1973-4c64-99bd-d166d3c8168e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 67fd85a5-6cde-4aa6-acf2-99640be2bb44] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:15.328708 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-04e65f2d-1973-4c64-99bd-d166d3c8168e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:15.355402 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-04e65f2d-1973-4c64-99bd-d166d3c8168e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44" status: 200 len: 1216 microversion: 2.1 time: 0.262791 Jul 19 22:30:15.356227 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 560/1167] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:15 2022] GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44 => generated 1216 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:15.363471 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f39aa3b5-5850-4061-9c2f-481c2f4fe531 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2b03908-771c-4b90-9eb2-0bc827b3d2ef", "device": "/dev/xvdb"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:15.375636 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f39aa3b5-5850-4061-9c2f-481c2f4fe531 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:15.395034 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f39aa3b5-5850-4061-9c2f-481c2f4fe531 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:15.401941 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f39aa3b5-5850-4061-9c2f-481c2f4fe531 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:15.403173 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f39aa3b5-5850-4061-9c2f-481c2f4fe531 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:15.403765 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f39aa3b5-5850-4061-9c2f-481c2f4fe531 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:15.509965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d48107e2-26e2-4aae-9369-dac821bc9402 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:15.522063 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d48107e2-26e2-4aae-9369-dac821bc9402 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1472 microversion: 2.1 time: 0.436114 Jul 19 22:30:15.528908 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 608/1168] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:15 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1472 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:16.243654 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f324f19b-dba4-48e8-8679-138d6989f72d tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:16.249286 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f324f19b-dba4-48e8-8679-138d6989f72d tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Searching by: {'deleted': False, 'project_id': 'ed40e37ba4b045fca904450a5104b781'} {{(pid=119337) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:30:16.257518 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f324f19b-dba4-48e8-8679-138d6989f72d tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:16.258387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f324f19b-dba4-48e8-8679-138d6989f72d tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:16.259485 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f324f19b-dba4-48e8-8679-138d6989f72d tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:16.260179 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f324f19b-dba4-48e8-8679-138d6989f72d tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:16.290506 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f39aa3b5-5850-4061-9c2f-481c2f4fe531 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "POST /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.926085 Jul 19 22:30:16.292433 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 561/1169] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 19 22:30:15 2022] POST /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d/os-volume_attachments => generated 194 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:30:16.318542 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1cb714f2-98a8-4472-a43a-c6a33f98dfdd tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:16.322492 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1cb714f2-98a8-4472-a43a-c6a33f98dfdd tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:16.369056 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1cb714f2-98a8-4472-a43a-c6a33f98dfdd tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:16.382369 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1cb714f2-98a8-4472-a43a-c6a33f98dfdd tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:16.389293 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1cb714f2-98a8-4472-a43a-c6a33f98dfdd tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:16.390170 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1cb714f2-98a8-4472-a43a-c6a33f98dfdd tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:16.527599 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f324f19b-dba4-48e8-8679-138d6989f72d tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.997246 Jul 19 22:30:16.528491 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 609/1170] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:30:15 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:30:16.567217 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8ccec308-40fd-41e6-9cda-61d41b2f6b29 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a104e29d0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:16.661422 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8ccec308-40fd-41e6-9cda-61d41b2f6b29 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006" status: 200 len: 1412 microversion: 2.1 time: 0.111814 Jul 19 22:30:16.662590 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 610/1171] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:30:16 2022] GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006 => generated 1412 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:16.674877 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-62bb022c-c8fd-4dbc-944b-8f8719078ea3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:16.683101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-62bb022c-c8fd-4dbc-944b-8f8719078ea3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 67fd85a5-6cde-4aa6-acf2-99640be2bb44] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:16.740319 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62bb022c-c8fd-4dbc-944b-8f8719078ea3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:16.740960 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62bb022c-c8fd-4dbc-944b-8f8719078ea3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:16.742341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62bb022c-c8fd-4dbc-944b-8f8719078ea3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:16.743258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62bb022c-c8fd-4dbc-944b-8f8719078ea3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:17.081285 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-62bb022c-c8fd-4dbc-944b-8f8719078ea3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:17.109669 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-62bb022c-c8fd-4dbc-944b-8f8719078ea3 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44" status: 200 len: 1268 microversion: 2.1 time: 0.444653 Jul 19 22:30:17.109669 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 611/1172] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:16 2022] GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44 => generated 1268 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:17.119038 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-652874c6-82b4-45da-bb5f-90591255f022 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:17.128993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-652874c6-82b4-45da-bb5f-90591255f022 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:17.149063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-652874c6-82b4-45da-bb5f-90591255f022 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:17.149977 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-652874c6-82b4-45da-bb5f-90591255f022 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:17.169588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-652874c6-82b4-45da-bb5f-90591255f022 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:17.170145 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-652874c6-82b4-45da-bb5f-90591255f022 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:17.365563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1cb714f2-98a8-4472-a43a-c6a33f98dfdd tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f20e57a90994fbb989c749dc3ea2ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e68faed5a742fcbd3818f9c0f6569a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:17.399146 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1cb714f2-98a8-4472-a43a-c6a33f98dfdd tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372" status: 200 len: 1332 microversion: 2.1 time: 1.102994 Jul 19 22:30:17.424851 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 562/1173] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:16 2022] GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372 => generated 1332 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:17.435146 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b36e5b28-d041-4628-813d-c34415558e2e tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:17.489660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b36e5b28-d041-4628-813d-c34415558e2e tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Searching by: {'deleted': False} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:30:17.525926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b36e5b28-d041-4628-813d-c34415558e2e tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:17.526534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b36e5b28-d041-4628-813d-c34415558e2e tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:17.527817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b36e5b28-d041-4628-813d-c34415558e2e tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:17.528624 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b36e5b28-d041-4628-813d-c34415558e2e tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:18.292720 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.multi_cell_list [None req-b36e5b28-d041-4628-813d-c34415558e2e tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Listed batch of 22 results from cell out of 1000 limit. Returned 22 total so far. {{(pid=119338) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:30:18.508422 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-652874c6-82b4-45da-bb5f-90591255f022 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:18.517069 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-652874c6-82b4-45da-bb5f-90591255f022 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1472 microversion: 2.1 time: 1.406470 Jul 19 22:30:18.527396 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 612/1174] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:17 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1472 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:18.540708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a4e1d849-0172-416a-8679-c01b1be5d543 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a103498b0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:18.669998 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a4e1d849-0172-416a-8679-c01b1be5d543 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006" status: 200 len: 1412 microversion: 2.1 time: 0.133562 Jul 19 22:30:18.671013 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 613/1175] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:30:18 2022] GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006 => generated 1412 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:18.680585 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-072d9ab6-ca23-4590-befb-2afde4d2d069 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:18.693431 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b36e5b28-d041-4628-813d-c34415558e2e tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:18.694341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b36e5b28-d041-4628-813d-c34415558e2e tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:18.699552 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-072d9ab6-ca23-4590-befb-2afde4d2d069 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 67fd85a5-6cde-4aa6-acf2-99640be2bb44] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:18.716755 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-072d9ab6-ca23-4590-befb-2afde4d2d069 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:18.722532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-072d9ab6-ca23-4590-befb-2afde4d2d069 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:18.726273 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-072d9ab6-ca23-4590-befb-2afde4d2d069 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:18.730128 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-072d9ab6-ca23-4590-befb-2afde4d2d069 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:19.264698 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-072d9ab6-ca23-4590-befb-2afde4d2d069 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:19.302104 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-072d9ab6-ca23-4590-befb-2afde4d2d069 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44" status: 200 len: 1274 microversion: 2.1 time: 0.627078 Jul 19 22:30:19.303436 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 614/1176] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:18 2022] GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44 => generated 1274 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:19.325426 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6280d4c7-a76f-4a60-a282-10c8723df9bb tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:19.326885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6280d4c7-a76f-4a60-a282-10c8723df9bb tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:19.354750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6280d4c7-a76f-4a60-a282-10c8723df9bb tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:19.365693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6280d4c7-a76f-4a60-a282-10c8723df9bb tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:19.367568 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6280d4c7-a76f-4a60-a282-10c8723df9bb tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:19.368626 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6280d4c7-a76f-4a60-a282-10c8723df9bb tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:19.452043 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:30:21.016102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6280d4c7-a76f-4a60-a282-10c8723df9bb tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f20e57a90994fbb989c749dc3ea2ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e68faed5a742fcbd3818f9c0f6569a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:21.027261 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6280d4c7-a76f-4a60-a282-10c8723df9bb tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372" status: 200 len: 1332 microversion: 2.1 time: 1.721974 Jul 19 22:30:21.032483 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 615/1177] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:19 2022] GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372 => generated 1332 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:21.059612 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d01f1f84-3f34-4ccc-8f09-f2d6668d5faf tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:21.065967 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d01f1f84-3f34-4ccc-8f09-f2d6668d5faf tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:21.105378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d01f1f84-3f34-4ccc-8f09-f2d6668d5faf tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:21.111355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d01f1f84-3f34-4ccc-8f09-f2d6668d5faf tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:21.112821 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d01f1f84-3f34-4ccc-8f09-f2d6668d5faf tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:21.127902 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d01f1f84-3f34-4ccc-8f09-f2d6668d5faf tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:22.194519 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d01f1f84-3f34-4ccc-8f09-f2d6668d5faf tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:22.220410 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d01f1f84-3f34-4ccc-8f09-f2d6668d5faf tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1472 microversion: 2.1 time: 1.173307 Jul 19 22:30:22.222401 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 616/1178] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:21 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1472 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:22.246122 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-429001e1-1240-49c0-8353-ee8d02a75022 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a106a8d30>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:22.304268 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b36e5b28-d041-4628-813d-c34415558e2e tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 35736 microversion: 2.1 time: 4.875095 Jul 19 22:30:22.311844 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 563/1179] 10.222.0.25 () {58 vars in 1170 bytes} [Tue Jul 19 22:30:17 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 35736 bytes in 4886 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:30:22.328099 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1dd595ff-1276-4d9e-8d9b-4d1f815f4d45 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:22.332658 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1dd595ff-1276-4d9e-8d9b-4d1f815f4d45 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 67fd85a5-6cde-4aa6-acf2-99640be2bb44] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:22.357721 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=64 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:30:22.369369 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1dd595ff-1276-4d9e-8d9b-4d1f815f4d45 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:22.372416 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1dd595ff-1276-4d9e-8d9b-4d1f815f4d45 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:22.374345 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-429001e1-1240-49c0-8353-ee8d02a75022 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006" status: 200 len: 1412 microversion: 2.1 time: 0.139408 Jul 19 22:30:22.379303 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1dd595ff-1276-4d9e-8d9b-4d1f815f4d45 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:22.382023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1dd595ff-1276-4d9e-8d9b-4d1f815f4d45 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:22.395325 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 617/1180] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:30:22 2022] GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006 => generated 1412 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:22.413766 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2a1c2578-48e2-4428-9510-cf58cae86e31 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:22.414895 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2a1c2578-48e2-4428-9510-cf58cae86e31 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:22.445357 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2a1c2578-48e2-4428-9510-cf58cae86e31 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:22.454015 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2a1c2578-48e2-4428-9510-cf58cae86e31 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:22.456148 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2a1c2578-48e2-4428-9510-cf58cae86e31 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:22.456903 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2a1c2578-48e2-4428-9510-cf58cae86e31 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:23.015805 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1dd595ff-1276-4d9e-8d9b-4d1f815f4d45 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:23.044920 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1dd595ff-1276-4d9e-8d9b-4d1f815f4d45 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44" status: 200 len: 1274 microversion: 2.1 time: 0.731551 Jul 19 22:30:23.048665 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 564/1181] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:22 2022] GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44 => generated 1274 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:23.070811 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8e8219af-6187-4ec1-bba8-97a9a7b0f102 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:23.075026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8e8219af-6187-4ec1-bba8-97a9a7b0f102 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Searching by: {'deleted': False, 'project_id': 'ed40e37ba4b045fca904450a5104b781'} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:30:23.095457 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8e8219af-6187-4ec1-bba8-97a9a7b0f102 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:23.095930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8e8219af-6187-4ec1-bba8-97a9a7b0f102 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:23.096804 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8e8219af-6187-4ec1-bba8-97a9a7b0f102 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:23.097247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8e8219af-6187-4ec1-bba8-97a9a7b0f102 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:23.230435 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:30:23.377471 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2a1c2578-48e2-4428-9510-cf58cae86e31 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f20e57a90994fbb989c749dc3ea2ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e68faed5a742fcbd3818f9c0f6569a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:23.393670 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2a1c2578-48e2-4428-9510-cf58cae86e31 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372" status: 200 len: 1332 microversion: 2.1 time: 0.996929 Jul 19 22:30:23.408871 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 618/1182] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:22 2022] GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372 => generated 1332 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:23.522864 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8e8219af-6187-4ec1-bba8-97a9a7b0f102 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?tenant_id=512cc31b5f6546eeb04486cd5213e441" status: 200 len: 15 microversion: 2.1 time: 0.470521 Jul 19 22:30:23.539168 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 565/1183] 10.222.0.25 () {58 vars in 1230 bytes} [Tue Jul 19 22:30:23 2022] GET /compute/v2.1/servers/detail?tenant_id=512cc31b5f6546eeb04486cd5213e441 => generated 15 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:30:23.540597 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-40d3962f-7100-482c-a4ec-079f3685fc0f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:23.541545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-40d3962f-7100-482c-a4ec-079f3685fc0f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:23.558447 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-40d3962f-7100-482c-a4ec-079f3685fc0f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:23.559423 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-40d3962f-7100-482c-a4ec-079f3685fc0f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:23.563259 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-40d3962f-7100-482c-a4ec-079f3685fc0f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:23.563628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-40d3962f-7100-482c-a4ec-079f3685fc0f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:23.564548 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-b8e4f7e6-d618-45b5-a69b-80ca3ad622ef req-160ad112-7c6a-41f6-8a12-cb5c9944fb59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a134613f-f510-43e4-943e-d869b38c4372", "name": "network-vif-plugged", "status": "completed", "tag": "b5b458c6-907b-4661-bb17-cd57f2eb40a1"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:23.583585 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b8e4f7e6-d618-45b5-a69b-80ca3ad622ef req-160ad112-7c6a-41f6-8a12-cb5c9944fb59 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:23.584574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b8e4f7e6-d618-45b5-a69b-80ca3ad622ef req-160ad112-7c6a-41f6-8a12-cb5c9944fb59 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:23.616950 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-b8e4f7e6-d618-45b5-a69b-80ca3ad622ef req-160ad112-7c6a-41f6-8a12-cb5c9944fb59 service nova] Creating event network-vif-plugged:b5b458c6-907b-4661-bb17-cd57f2eb40a1 for instance a134613f-f510-43e4-943e-d869b38c4372 on n-h2-847009-3 Jul 19 22:30:23.629300 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-b8e4f7e6-d618-45b5-a69b-80ca3ad622ef req-160ad112-7c6a-41f6-8a12-cb5c9944fb59 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229014 Jul 19 22:30:23.643306 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 619/1184] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:30:23.670822 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-53fc152a-680e-4837-ae42-855609743869 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a10550e50>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:23.830893 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-53fc152a-680e-4837-ae42-855609743869 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006" status: 200 len: 1421 microversion: 2.1 time: 0.183982 Jul 19 22:30:23.854689 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 620/1185] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:30:23 2022] GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006 => generated 1421 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:23.861078 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6c6b7e72-2371-41e8-a912-1172a91e260c tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:23.894187 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6c6b7e72-2371-41e8-a912-1172a91e260c tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Searching by: {'tenant_id': '512cc31b5f6546eeb04486cd5213e441', 'deleted': False} {{(pid=119337) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:30:23.909526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6c6b7e72-2371-41e8-a912-1172a91e260c tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:23.909984 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6c6b7e72-2371-41e8-a912-1172a91e260c tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:23.910811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6c6b7e72-2371-41e8-a912-1172a91e260c tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:23.911283 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6c6b7e72-2371-41e8-a912-1172a91e260c tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:24.032983 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.multi_cell_list [None req-6c6b7e72-2371-41e8-a912-1172a91e260c tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119337) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:30:24.217162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6c6b7e72-2371-41e8-a912-1172a91e260c tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:24.217610 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6c6b7e72-2371-41e8-a912-1172a91e260c tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:24.774517 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-40d3962f-7100-482c-a4ec-079f3685fc0f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:24.818335 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-40d3962f-7100-482c-a4ec-079f3685fc0f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1477 microversion: 2.1 time: 1.288381 Jul 19 22:30:24.829130 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 566/1186] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:23 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1477 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:24.867365 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b2d99d72-e0b1-474a-802a-40eed13b7187 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a103f4940>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:24.960081 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6c6b7e72-2371-41e8-a912-1172a91e260c tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=512cc31b5f6546eeb04486cd5213e441" status: 200 len: 4826 microversion: 2.1 time: 1.102085 Jul 19 22:30:24.962549 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 621/1187] 10.222.0.25 () {58 vars in 1256 bytes} [Tue Jul 19 22:30:23 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=512cc31b5f6546eeb04486cd5213e441 => generated 4826 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:24.995997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0257c195-50bd-4166-86e9-761b7adfaba8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:25.000583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0257c195-50bd-4166-86e9-761b7adfaba8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 67fd85a5-6cde-4aa6-acf2-99640be2bb44] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:25.036103 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b2d99d72-e0b1-474a-802a-40eed13b7187 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006" status: 200 len: 1421 microversion: 2.1 time: 0.205384 Jul 19 22:30:25.036705 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 567/1188] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:30:24 2022] GET /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006 => generated 1421 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:25.038784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0257c195-50bd-4166-86e9-761b7adfaba8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:25.042866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0257c195-50bd-4166-86e9-761b7adfaba8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:25.060445 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0257c195-50bd-4166-86e9-761b7adfaba8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:25.061158 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0257c195-50bd-4166-86e9-761b7adfaba8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:25.074802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2c9d1be1-31dc-456b-ad6a-01167866e273 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:25.096919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2c9d1be1-31dc-456b-ad6a-01167866e273 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:25.140438 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c9d1be1-31dc-456b-ad6a-01167866e273 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:25.148601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c9d1be1-31dc-456b-ad6a-01167866e273 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:25.149770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c9d1be1-31dc-456b-ad6a-01167866e273 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:25.150197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c9d1be1-31dc-456b-ad6a-01167866e273 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:26.290145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2c9d1be1-31dc-456b-ad6a-01167866e273 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f20e57a90994fbb989c749dc3ea2ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e68faed5a742fcbd3818f9c0f6569a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:26.305760 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2c9d1be1-31dc-456b-ad6a-01167866e273 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372" status: 200 len: 1332 microversion: 2.1 time: 1.260878 Jul 19 22:30:26.306326 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 568/1189] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:25 2022] GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372 => generated 1332 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:26.336630 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ac32df44-3d49-4554-9edf-de7643cadd5a tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:26.377430 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ac32df44-3d49-4554-9edf-de7643cadd5a tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Searching by: {'tenant_id': 'ed40e37ba4b045fca904450a5104b781', 'deleted': False} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:30:26.397358 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0257c195-50bd-4166-86e9-761b7adfaba8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:26.405295 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac32df44-3d49-4554-9edf-de7643cadd5a tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:26.405754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac32df44-3d49-4554-9edf-de7643cadd5a tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:26.427413 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac32df44-3d49-4554-9edf-de7643cadd5a tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:26.429650 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0257c195-50bd-4166-86e9-761b7adfaba8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44" status: 200 len: 1316 microversion: 2.1 time: 1.461800 Jul 19 22:30:26.432826 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac32df44-3d49-4554-9edf-de7643cadd5a tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:26.440538 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 622/1190] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:24 2022] GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44 => generated 1316 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:26.449288 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ea201ef7-06e9-4d9f-92af-f93630e51099 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a1040c670>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:26.469617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:30:26.496203 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ac32df44-3d49-4554-9edf-de7643cadd5a tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ed40e37ba4b045fca904450a5104b781" status: 200 len: 15 microversion: 2.1 time: 0.181631 Jul 19 22:30:26.515146 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 569/1191] 10.222.0.25 () {58 vars in 1256 bytes} [Tue Jul 19 22:30:26 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ed40e37ba4b045fca904450a5104b781 => generated 15 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:30:26.939217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6b774278-889b-408e-b424-cc54e70ced91 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:26.940046 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6b774278-889b-408e-b424-cc54e70ced91 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:26.958930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b774278-889b-408e-b424-cc54e70ced91 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:26.965024 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b774278-889b-408e-b424-cc54e70ced91 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:26.967066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b774278-889b-408e-b424-cc54e70ced91 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:26.968268 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b774278-889b-408e-b424-cc54e70ced91 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:27.968519 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6b774278-889b-408e-b424-cc54e70ced91 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:27.992359 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6b774278-889b-408e-b424-cc54e70ced91 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1477 microversion: 2.1 time: 1.486306 Jul 19 22:30:28.010790 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 570/1192] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:26 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1477 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:28.038142 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9263f74d-1cf5-42f6-bda3-180fd929b72e tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:28.055157 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9263f74d-1cf5-42f6-bda3-180fd929b72e tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.031944 Jul 19 22:30:28.064433 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 571/1193] 10.222.0.25 () {58 vars in 1188 bytes} [Tue Jul 19 22:30:28 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:30:28.574017 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ea201ef7-06e9-4d9f-92af-f93630e51099 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "DELETE /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006" status: 204 len: 0 microversion: 2.1 time: 2.131203 Jul 19 22:30:28.575503 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 623/1194] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:26 2022] DELETE /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006 => generated 0 bytes in 2134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:30:28.603386 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:30:28.608331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-19dfb5aa-d149-46a5-bbe0-e37e08ce6fc8 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:28.621017 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-19dfb5aa-d149-46a5-bbe0-e37e08ce6fc8 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:28.672324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-19dfb5aa-d149-46a5-bbe0-e37e08ce6fc8 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:28.672592 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-19dfb5aa-d149-46a5-bbe0-e37e08ce6fc8 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:28.677713 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-19dfb5aa-d149-46a5-bbe0-e37e08ce6fc8 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:28.691062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-19dfb5aa-d149-46a5-bbe0-e37e08ce6fc8 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:28.693372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2782b29a-73be-4b53-9e86-f2aac4522b11 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Action: 'create', calling method: .version_select at 0x7f7a102305e0>, body: {"keypair": {"name": "tempest-keypair-342114636", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgZMtpeMoOWGaR1HYkma12zgVz+TljZ6y2M99Ix3ZZWNgjGi/sPnSy4HLo+l7uTUsGR4Gx+cvq3Qx2h4tB2yKVgdWow6AZlgjwjx53MO1pBEuNc4+ZIDGOM5KEuvlRNPg=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:28.752302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-2782b29a-73be-4b53-9e86-f2aac4522b11 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Getting quotas for project a353634f70fb4ff58c7190a5c7aa675d. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:30:28.768985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-2782b29a-73be-4b53-9e86-f2aac4522b11 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Getting quotas for user 37267b4c360540489a72d9b0043abd87 and project a353634f70fb4ff58c7190a5c7aa675d. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:30:28.859330 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2782b29a-73be-4b53-9e86-f2aac4522b11 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.793207 Jul 19 22:30:28.865536 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 572/1195] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:30:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:30:28.871131 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fe44fab2-9852-425a-a651-eb9bb2b998bc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:28.875329 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fe44fab2-9852-425a-a651-eb9bb2b998bc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 67fd85a5-6cde-4aa6-acf2-99640be2bb44] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:28.892844 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe44fab2-9852-425a-a651-eb9bb2b998bc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:28.893837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe44fab2-9852-425a-a651-eb9bb2b998bc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:28.904629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe44fab2-9852-425a-a651-eb9bb2b998bc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:28.904629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe44fab2-9852-425a-a651-eb9bb2b998bc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:29.536805 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-19dfb5aa-d149-46a5-bbe0-e37e08ce6fc8 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f20e57a90994fbb989c749dc3ea2ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e68faed5a742fcbd3818f9c0f6569a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:29.561193 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-19dfb5aa-d149-46a5-bbe0-e37e08ce6fc8 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372" status: 200 len: 1536 microversion: 2.1 time: 0.984186 Jul 19 22:30:29.561814 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 624/1196] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:28 2022] GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372 => generated 1536 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:29.574175 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b09a8e65-5c78-4dc7-ac98-06ecf95c0a97 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:29.578824 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b09a8e65-5c78-4dc7-ac98-06ecf95c0a97 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:29.594512 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b09a8e65-5c78-4dc7-ac98-06ecf95c0a97 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:29.599709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b09a8e65-5c78-4dc7-ac98-06ecf95c0a97 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:29.603000 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b09a8e65-5c78-4dc7-ac98-06ecf95c0a97 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:29.603676 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b09a8e65-5c78-4dc7-ac98-06ecf95c0a97 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:29.790539 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b09a8e65-5c78-4dc7-ac98-06ecf95c0a97 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613/action" status: 202 len: 0 microversion: 2.1 time: 0.223542 Jul 19 22:30:29.799464 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 625/1197] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:30:29 2022] POST /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:30:29.810881 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-971e1c9f-c226-4563-b089-b311125382ee tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:29.811620 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-971e1c9f-c226-4563-b089-b311125382ee tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:29.817134 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fe44fab2-9852-425a-a651-eb9bb2b998bc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:29.824932 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-971e1c9f-c226-4563-b089-b311125382ee tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:29.829386 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-971e1c9f-c226-4563-b089-b311125382ee tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:29.830503 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-971e1c9f-c226-4563-b089-b311125382ee tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:29.835920 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-971e1c9f-c226-4563-b089-b311125382ee tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:29.850770 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fe44fab2-9852-425a-a651-eb9bb2b998bc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44" status: 200 len: 1316 microversion: 2.1 time: 0.988740 Jul 19 22:30:29.852483 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 573/1198] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:28 2022] GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44 => generated 1316 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:29.859222 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-bd2605c5-63b0-4401-9d41-da4dac0ac302 req-e1c46e24-049f-4b49-a775-7396c9981bda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab", "name": "network-vif-unplugged", "status": "completed", "tag": "896237d9-1570-436b-8b3f-65f168fd8555"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:29.879037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-bd2605c5-63b0-4401-9d41-da4dac0ac302 req-e1c46e24-049f-4b49-a775-7396c9981bda service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:29.879962 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-bd2605c5-63b0-4401-9d41-da4dac0ac302 req-e1c46e24-049f-4b49-a775-7396c9981bda service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:29.906145 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-bd2605c5-63b0-4401-9d41-da4dac0ac302 req-e1c46e24-049f-4b49-a775-7396c9981bda service nova] Creating event network-vif-unplugged:896237d9-1570-436b-8b3f-65f168fd8555 for instance b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab on n-h2-847009-3 Jul 19 22:30:29.919603 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-bd2605c5-63b0-4401-9d41-da4dac0ac302 req-e1c46e24-049f-4b49-a775-7396c9981bda service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061682 Jul 19 22:30:29.922661 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 574/1199] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:30:29.948492 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8165242f-678e-4300-a445-f5eaa33df8c8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:29.952170 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8165242f-678e-4300-a445-f5eaa33df8c8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:29.991678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8165242f-678e-4300-a445-f5eaa33df8c8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:30.000088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8165242f-678e-4300-a445-f5eaa33df8c8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:30.003595 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8165242f-678e-4300-a445-f5eaa33df8c8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:30.007519 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8165242f-678e-4300-a445-f5eaa33df8c8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:30.366230 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-971e1c9f-c226-4563-b089-b311125382ee tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:30:30.458712 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8165242f-678e-4300-a445-f5eaa33df8c8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:30.475210 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8165242f-678e-4300-a445-f5eaa33df8c8 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1477 microversion: 2.1 time: 0.549449 Jul 19 22:30:30.476937 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 575/1200] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:29 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1477 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:30.494527 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c81afaa6-2d5d-4b01-aa5d-96e95c318975 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Action: 'create', calling method: .version_select at 0x7f7a10410a60>, body: {"pool": "43456dc5-a081-4e58-9850-97923d9b3e3e"} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:30.559283 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-971e1c9f-c226-4563-b089-b311125382ee tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 204 len: 0 microversion: 2.1 time: 0.758172 Jul 19 22:30:30.564347 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 626/1201] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:30:29 2022] DELETE /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 0 bytes in 761 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:30:30.571992 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-aec6d176-9208-484c-8187-9b12c28eaed4 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:30.578807 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-aec6d176-9208-484c-8187-9b12c28eaed4 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:30.580650 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-aec6d176-9208-484c-8187-9b12c28eaed4 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '512cc31b5f6546eeb04486cd5213e441'} {{(pid=119337) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:30:30.590512 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aec6d176-9208-484c-8187-9b12c28eaed4 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:30.591355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aec6d176-9208-484c-8187-9b12c28eaed4 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:30.592569 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aec6d176-9208-484c-8187-9b12c28eaed4 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:30.593261 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aec6d176-9208-484c-8187-9b12c28eaed4 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:30.944155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.multi_cell_list [None req-aec6d176-9208-484c-8187-9b12c28eaed4 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119337) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:30:31.144691 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-aec6d176-9208-484c-8187-9b12c28eaed4 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.577577 Jul 19 22:30:31.146259 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 627/1202] 10.222.0.25 () {58 vars in 1149 bytes} [Tue Jul 19 22:30:30 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:30:31.371475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-ab4feeb9-c4eb-4972-82c2-50843719f2b0 req-001c0673-8d74-4b7f-a756-23784be858a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67fd85a5-6cde-4aa6-acf2-99640be2bb44", "tag": "ee275296-af34-4a61-8a8f-8c33c4fdec74"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:31.413216 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-ab4feeb9-c4eb-4972-82c2-50843719f2b0 req-001c0673-8d74-4b7f-a756-23784be858a6 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:31.413880 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-ab4feeb9-c4eb-4972-82c2-50843719f2b0 req-001c0673-8d74-4b7f-a756-23784be858a6 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:31.440175 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-ab4feeb9-c4eb-4972-82c2-50843719f2b0 req-001c0673-8d74-4b7f-a756-23784be858a6 service nova] Creating event network-changed:ee275296-af34-4a61-8a8f-8c33c4fdec74 for instance 67fd85a5-6cde-4aa6-acf2-99640be2bb44 on n-h1-847009-3 Jul 19 22:30:31.454155 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-ab4feeb9-c4eb-4972-82c2-50843719f2b0 req-001c0673-8d74-4b7f-a756-23784be858a6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.306472 Jul 19 22:30:31.458804 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 628/1203] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:30:31.489722 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f5f430f2-d013-4bc5-b92d-d5fa9c17f716 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:31.491646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f5f430f2-d013-4bc5-b92d-d5fa9c17f716 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 67fd85a5-6cde-4aa6-acf2-99640be2bb44] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:31.521240 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f5f430f2-d013-4bc5-b92d-d5fa9c17f716 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:31.522464 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f5f430f2-d013-4bc5-b92d-d5fa9c17f716 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:31.524043 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f5f430f2-d013-4bc5-b92d-d5fa9c17f716 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:31.525131 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f5f430f2-d013-4bc5-b92d-d5fa9c17f716 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:32.012626 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f5f430f2-d013-4bc5-b92d-d5fa9c17f716 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:32.033119 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f5f430f2-d013-4bc5-b92d-d5fa9c17f716 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44" status: 200 len: 1316 microversion: 2.1 time: 0.572337 Jul 19 22:30:32.046801 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 629/1204] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:31 2022] GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44 => generated 1316 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:32.051827 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6e5bd4c2-c065-4ec9-8e1c-e37f3af5b598 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1669391647", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "5684cb20-bc75-42db-91c0-b2fe6d252169"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:32.175153 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-6e5bd4c2-c065-4ec9-8e1c-e37f3af5b598 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] validate_networks() for [('5684cb20-bc75-42db-91c0-b2fe6d252169', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:30:33.783419 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-6e5bd4c2-c065-4ec9-8e1c-e37f3af5b598 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:30:33.784538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-6e5bd4c2-c065-4ec9-8e1c-e37f3af5b598 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:30:33.785295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-6e5bd4c2-c065-4ec9-8e1c-e37f3af5b598 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:30:33.785927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-6e5bd4c2-c065-4ec9-8e1c-e37f3af5b598 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:30:33.786732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-6e5bd4c2-c065-4ec9-8e1c-e37f3af5b598 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:30:33.810425 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e5bd4c2-c065-4ec9-8e1c-e37f3af5b598 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:33.813513 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e5bd4c2-c065-4ec9-8e1c-e37f3af5b598 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:33.821546 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e5bd4c2-c065-4ec9-8e1c-e37f3af5b598 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:33.823342 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e5bd4c2-c065-4ec9-8e1c-e37f3af5b598 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:33.893429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-6e5bd4c2-c065-4ec9-8e1c-e37f3af5b598 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Getting quotas for project 5e91c72f8cf5406a9662a29ee25780e6. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:30:33.906693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-6e5bd4c2-c065-4ec9-8e1c-e37f3af5b598 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Getting quotas for user 22b46b207cdb40c7b325bdc42baae246 and project 5e91c72f8cf5406a9662a29ee25780e6. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:30:33.941460 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6e5bd4c2-c065-4ec9-8e1c-e37f3af5b598 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:30:33.944061 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6e5bd4c2-c065-4ec9-8e1c-e37f3af5b598 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: f94bf14c-804e-4058-9ed8-037dd0a8ef98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:30:34.021610 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6e5bd4c2-c065-4ec9-8e1c-e37f3af5b598 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.986403 Jul 19 22:30:34.041165 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 630/1205] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:30:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:30:34.049349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ade8406a-31de-481e-ad6b-933677615a35 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:34.052258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ade8406a-31de-481e-ad6b-933677615a35 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:34.083396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ade8406a-31de-481e-ad6b-933677615a35 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:34.084327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ade8406a-31de-481e-ad6b-933677615a35 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:34.085316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ade8406a-31de-481e-ad6b-933677615a35 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:34.085926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ade8406a-31de-481e-ad6b-933677615a35 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:34.172707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:30:34.267906 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ade8406a-31de-481e-ad6b-933677615a35 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613/action" status: 202 len: 0 microversion: 2.1 time: 0.224402 Jul 19 22:30:34.275415 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 631/1206] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:30:34 2022] POST /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:30:34.280855 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d0dfe28a-e27c-46a9-8e5f-18921371c15f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:34.281496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d0dfe28a-e27c-46a9-8e5f-18921371c15f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:34.301130 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0dfe28a-e27c-46a9-8e5f-18921371c15f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:34.301862 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0dfe28a-e27c-46a9-8e5f-18921371c15f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:34.302659 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0dfe28a-e27c-46a9-8e5f-18921371c15f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:34.303091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0dfe28a-e27c-46a9-8e5f-18921371c15f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:35.713674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d0dfe28a-e27c-46a9-8e5f-18921371c15f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:35.738610 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d0dfe28a-e27c-46a9-8e5f-18921371c15f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1477 microversion: 2.1 time: 1.467457 Jul 19 22:30:35.740096 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 632/1207] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:34 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1477 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:35.753898 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4d9781e5-abdf-4569-9fb2-dcd988aadb1a tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-676216387", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "15be07df-5570-4a1c-b54c-7d24b8519012"}], "security_groups": [{"name": "tempest-securitygroup--1459661942"}], "key_name": "tempest-keypair-342114636", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:35.771190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:30:36.116441 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-4d9781e5-abdf-4569-9fb2-dcd988aadb1a tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] validate_networks() for [('15be07df-5570-4a1c-b54c-7d24b8519012', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:30:36.462943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:30:36.607188 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c81afaa6-2d5d-4b01-aa5d-96e95c318975 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 6.124315 Jul 19 22:30:36.607188 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 576/1208] 10.222.0.25 () {60 vars in 1169 bytes} [Tue Jul 19 22:30:30 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 6128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:30:36.617902 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a34bbc82-6202-4171-b0b7-1476dfd97b40 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:36.620268 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a34bbc82-6202-4171-b0b7-1476dfd97b40 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 67fd85a5-6cde-4aa6-acf2-99640be2bb44] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:36.631065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a34bbc82-6202-4171-b0b7-1476dfd97b40 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:36.634262 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a34bbc82-6202-4171-b0b7-1476dfd97b40 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:36.634623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a34bbc82-6202-4171-b0b7-1476dfd97b40 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:36.636109 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a34bbc82-6202-4171-b0b7-1476dfd97b40 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:37.187863 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a34bbc82-6202-4171-b0b7-1476dfd97b40 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:37.209429 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a34bbc82-6202-4171-b0b7-1476dfd97b40 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44" status: 200 len: 1316 microversion: 2.1 time: 0.602100 Jul 19 22:30:37.210748 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 577/1209] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:36 2022] GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44 => generated 1316 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:37.226586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9871fffe-2e19-4f5d-b639-5e201f9ade9d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:37.228046 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9871fffe-2e19-4f5d-b639-5e201f9ade9d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: f94bf14c-804e-4058-9ed8-037dd0a8ef98] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:37.242023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9871fffe-2e19-4f5d-b639-5e201f9ade9d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:37.243818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9871fffe-2e19-4f5d-b639-5e201f9ade9d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:37.246211 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9871fffe-2e19-4f5d-b639-5e201f9ade9d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:37.246892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9871fffe-2e19-4f5d-b639-5e201f9ade9d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:37.461765 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9871fffe-2e19-4f5d-b639-5e201f9ade9d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:37.477290 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9871fffe-2e19-4f5d-b639-5e201f9ade9d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98" status: 200 len: 1266 microversion: 2.1 time: 0.257210 Jul 19 22:30:37.482302 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 578/1210] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:37 2022] GET /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98 => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:37.491705 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4fe8dc73-5e00-455c-8e4d-835f80757ed1 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:37.492988 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4fe8dc73-5e00-455c-8e4d-835f80757ed1 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:37.504105 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4fe8dc73-5e00-455c-8e4d-835f80757ed1 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:37.505953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4fe8dc73-5e00-455c-8e4d-835f80757ed1 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:37.508023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4fe8dc73-5e00-455c-8e4d-835f80757ed1 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:37.509020 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4fe8dc73-5e00-455c-8e4d-835f80757ed1 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:37.890115 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4d9781e5-abdf-4569-9fb2-dcd988aadb1a tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:30:37.891407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4d9781e5-abdf-4569-9fb2-dcd988aadb1a tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:30:37.892081 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4d9781e5-abdf-4569-9fb2-dcd988aadb1a tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:30:37.892702 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4d9781e5-abdf-4569-9fb2-dcd988aadb1a tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:30:37.893311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4d9781e5-abdf-4569-9fb2-dcd988aadb1a tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:30:37.909065 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4d9781e5-abdf-4569-9fb2-dcd988aadb1a tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:37.910163 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4d9781e5-abdf-4569-9fb2-dcd988aadb1a tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:37.911525 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4d9781e5-abdf-4569-9fb2-dcd988aadb1a tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:37.913097 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4d9781e5-abdf-4569-9fb2-dcd988aadb1a tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:37.926695 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=13 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:30:37.943265 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-4d9781e5-abdf-4569-9fb2-dcd988aadb1a tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Getting quotas for project a353634f70fb4ff58c7190a5c7aa675d. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:30:37.950144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-4d9781e5-abdf-4569-9fb2-dcd988aadb1a tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Getting quotas for user 37267b4c360540489a72d9b0043abd87 and project a353634f70fb4ff58c7190a5c7aa675d. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:30:37.976507 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4d9781e5-abdf-4569-9fb2-dcd988aadb1a tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:30:37.976745 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4fe8dc73-5e00-455c-8e4d-835f80757ed1 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1615 microversion: 2.1 time: 0.490341 Jul 19 22:30:37.979181 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4d9781e5-abdf-4569-9fb2-dcd988aadb1a tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:30:37.991877 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 579/1211] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:37 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1615 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:38.122752 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-b024201f-4a51-4f6a-8538-6ffdae532b7b req-dc50f757-7030-4071-9280-f9cc61321a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab", "name": "network-vif-deleted", "tag": "896237d9-1570-436b-8b3f-65f168fd8555"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:38.150179 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4d9781e5-abdf-4569-9fb2-dcd988aadb1a tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.407260 Jul 19 22:30:38.157650 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 633/1212] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:30:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 2417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:30:38.159408 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b024201f-4a51-4f6a-8538-6ffdae532b7b req-dc50f757-7030-4071-9280-f9cc61321a47 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:38.160121 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b024201f-4a51-4f6a-8538-6ffdae532b7b req-dc50f757-7030-4071-9280-f9cc61321a47 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:38.173554 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8de1cf09-8900-4559-9229-d332da076dc8 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Action: 'action', calling method: .version_select at 0x7f7a1310ed30>, body: {"addFloatingIp": {"address": "172.25.7.9"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:38.175328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8de1cf09-8900-4559-9229-d332da076dc8 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:38.190855 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-b024201f-4a51-4f6a-8538-6ffdae532b7b req-dc50f757-7030-4071-9280-f9cc61321a47 service nova] Creating event network-vif-deleted:896237d9-1570-436b-8b3f-65f168fd8555 for instance b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab on n-h2-847009-3 Jul 19 22:30:38.203203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8de1cf09-8900-4559-9229-d332da076dc8 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:38.204188 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-b024201f-4a51-4f6a-8538-6ffdae532b7b req-dc50f757-7030-4071-9280-f9cc61321a47 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209590 Jul 19 22:30:38.205213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8de1cf09-8900-4559-9229-d332da076dc8 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:38.206668 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 580/1213] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:30:38.211451 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8de1cf09-8900-4559-9229-d332da076dc8 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:38.212335 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8de1cf09-8900-4559-9229-d332da076dc8 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:38.220127 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a56d9405-fb5c-427b-927e-c80916a253fe tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:38.221286 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a56d9405-fb5c-427b-927e-c80916a253fe tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:38.238182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a56d9405-fb5c-427b-927e-c80916a253fe tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:38.239332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a56d9405-fb5c-427b-927e-c80916a253fe tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:38.240981 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a56d9405-fb5c-427b-927e-c80916a253fe tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:38.245454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a56d9405-fb5c-427b-927e-c80916a253fe tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:38.410732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8de1cf09-8900-4559-9229-d332da076dc8 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Acquired lock "refresh_cache-a134613f-f510-43e4-943e-d869b38c4372" {{(pid=119337) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 22:30:38.817911 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:30:38.957357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a56d9405-fb5c-427b-927e-c80916a253fe tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:38.979601 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a56d9405-fb5c-427b-927e-c80916a253fe tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1477 microversion: 2.1 time: 0.769760 Jul 19 22:30:38.980886 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 581/1214] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:38 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1477 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:38.990534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2f95d694-8151-4616-ae1a-76ffa4ec9ece tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:38.992103 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2f95d694-8151-4616-ae1a-76ffa4ec9ece tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:39.020344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f95d694-8151-4616-ae1a-76ffa4ec9ece tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:39.021595 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f95d694-8151-4616-ae1a-76ffa4ec9ece tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:39.023449 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f95d694-8151-4616-ae1a-76ffa4ec9ece tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:39.024498 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f95d694-8151-4616-ae1a-76ffa4ec9ece tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:39.679361 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2f95d694-8151-4616-ae1a-76ffa4ec9ece tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1615 microversion: 2.1 time: 0.694917 Jul 19 22:30:39.698170 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 582/1215] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:38 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1615 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:39.721552 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-73eeeabc-a6cf-41d7-b9cc-ab9386ddf644 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:39.724183 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-73eeeabc-a6cf-41d7-b9cc-ab9386ddf644 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:39.760613 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-73eeeabc-a6cf-41d7-b9cc-ab9386ddf644 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:39.763904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-73eeeabc-a6cf-41d7-b9cc-ab9386ddf644 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:39.766427 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-73eeeabc-a6cf-41d7-b9cc-ab9386ddf644 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:39.767573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-73eeeabc-a6cf-41d7-b9cc-ab9386ddf644 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:40.117407 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-73eeeabc-a6cf-41d7-b9cc-ab9386ddf644 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37267b4c360540489a72d9b0043abd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a353634f70fb4ff58c7190a5c7aa675d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:40.138509 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-73eeeabc-a6cf-41d7-b9cc-ab9386ddf644 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e" status: 200 len: 1244 microversion: 2.1 time: 0.437721 Jul 19 22:30:40.140559 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 583/1216] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:39 2022] GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e => generated 1244 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:40.151000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ffcfb056-ce27-4f7b-acad-5c2036b40414 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:40.152730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ffcfb056-ce27-4f7b-acad-5c2036b40414 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 67fd85a5-6cde-4aa6-acf2-99640be2bb44] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:40.167190 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ffcfb056-ce27-4f7b-acad-5c2036b40414 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:40.168412 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ffcfb056-ce27-4f7b-acad-5c2036b40414 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:40.170125 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ffcfb056-ce27-4f7b-acad-5c2036b40414 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:40.170977 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ffcfb056-ce27-4f7b-acad-5c2036b40414 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:40.930352 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ffcfb056-ce27-4f7b-acad-5c2036b40414 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:40.965842 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ffcfb056-ce27-4f7b-acad-5c2036b40414 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44" status: 200 len: 1316 microversion: 2.1 time: 0.823170 Jul 19 22:30:40.976574 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 584/1217] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:40 2022] GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44 => generated 1316 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:40.986509 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d85c757d-5d35-4844-9131-e667e3cd2dfc tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:40.987557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d85c757d-5d35-4844-9131-e667e3cd2dfc tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: f94bf14c-804e-4058-9ed8-037dd0a8ef98] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:41.007393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d85c757d-5d35-4844-9131-e667e3cd2dfc tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:41.008181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d85c757d-5d35-4844-9131-e667e3cd2dfc tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:41.009572 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d85c757d-5d35-4844-9131-e667e3cd2dfc tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:41.010948 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d85c757d-5d35-4844-9131-e667e3cd2dfc tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:41.562497 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d85c757d-5d35-4844-9131-e667e3cd2dfc tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:41.589895 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d85c757d-5d35-4844-9131-e667e3cd2dfc tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98" status: 200 len: 1308 microversion: 2.1 time: 0.610351 Jul 19 22:30:41.615596 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 585/1218] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:40 2022] GET /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98 => generated 1308 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:41.632361 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-542e941a-c27b-44d9-b9d4-ce37659687f6 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:41.673658 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-542e941a-c27b-44d9-b9d4-ce37659687f6 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Searching by: {'host': 'n-h2-847009-3', 'deleted': False} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:30:41.684801 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-542e941a-c27b-44d9-b9d4-ce37659687f6 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:41.686012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-542e941a-c27b-44d9-b9d4-ce37659687f6 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:41.687907 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-542e941a-c27b-44d9-b9d4-ce37659687f6 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:41.689000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-542e941a-c27b-44d9-b9d4-ce37659687f6 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:41.950770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.multi_cell_list [None req-542e941a-c27b-44d9-b9d4-ce37659687f6 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Listed batch of 11 results from cell out of 1000 limit. Returned 11 total so far. {{(pid=119338) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:30:42.172565 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-542e941a-c27b-44d9-b9d4-ce37659687f6 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] 10.222.0.25 "GET /compute/v2.1/servers?host=n-h2-847009-3&all_tenants=1" status: 200 len: 3628 microversion: 2.1 time: 0.553557 Jul 19 22:30:42.174591 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 586/1219] 10.222.0.25 () {58 vars in 1189 bytes} [Tue Jul 19 22:30:41 2022] GET /compute/v2.1/servers?host=n-h2-847009-3&all_tenants=1 => generated 3628 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:42.197871 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-ee6db891-5b2e-4664-8c9b-5f106125687f req-084e49f7-e1d3-4aa9-952f-830fcf298c68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67fd85a5-6cde-4aa6-acf2-99640be2bb44", "name": "network-vif-plugged", "status": "completed", "tag": "ee275296-af34-4a61-8a8f-8c33c4fdec74"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:42.231317 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-ee6db891-5b2e-4664-8c9b-5f106125687f req-084e49f7-e1d3-4aa9-952f-830fcf298c68 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:42.232042 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-ee6db891-5b2e-4664-8c9b-5f106125687f req-084e49f7-e1d3-4aa9-952f-830fcf298c68 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:42.265411 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-ee6db891-5b2e-4664-8c9b-5f106125687f req-084e49f7-e1d3-4aa9-952f-830fcf298c68 service nova] Creating event network-vif-plugged:ee275296-af34-4a61-8a8f-8c33c4fdec74 for instance 67fd85a5-6cde-4aa6-acf2-99640be2bb44 on n-h1-847009-3 Jul 19 22:30:42.281727 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-ee6db891-5b2e-4664-8c9b-5f106125687f req-084e49f7-e1d3-4aa9-952f-830fcf298c68 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104482 Jul 19 22:30:42.283535 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 587/1220] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:30:42.295618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-292ee803-e59a-4d04-8a73-993538756a70 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:42.297197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-292ee803-e59a-4d04-8a73-993538756a70 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:42.317429 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-292ee803-e59a-4d04-8a73-993538756a70 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:42.318626 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-292ee803-e59a-4d04-8a73-993538756a70 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:42.320723 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-292ee803-e59a-4d04-8a73-993538756a70 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:42.322695 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-292ee803-e59a-4d04-8a73-993538756a70 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:42.966437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-292ee803-e59a-4d04-8a73-993538756a70 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:42.978028 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-8de1cf09-8900-4559-9229-d332da076dc8 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Building network info cache for instance {{(pid=119337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 22:30:42.984748 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-292ee803-e59a-4d04-8a73-993538756a70 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1477 microversion: 2.1 time: 0.698645 Jul 19 22:30:42.999168 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 588/1221] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:42 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1477 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:42.999168 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4f2793e4-d0e7-408d-a489-d3f086951d47 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:42.999168 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4f2793e4-d0e7-408d-a489-d3f086951d47 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:43.022513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f2793e4-d0e7-408d-a489-d3f086951d47 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:43.028057 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f2793e4-d0e7-408d-a489-d3f086951d47 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:43.029947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f2793e4-d0e7-408d-a489-d3f086951d47 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:43.034398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f2793e4-d0e7-408d-a489-d3f086951d47 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:43.436237 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4f2793e4-d0e7-408d-a489-d3f086951d47 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1859 microversion: 2.1 time: 0.446042 Jul 19 22:30:43.440801 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 589/1222] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:42 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1859 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:43.452902 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f73aeb28-a56f-4a66-9a39-b4c9016a6215 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:43.455478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f73aeb28-a56f-4a66-9a39-b4c9016a6215 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:43.468073 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f73aeb28-a56f-4a66-9a39-b4c9016a6215 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:43.469462 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f73aeb28-a56f-4a66-9a39-b4c9016a6215 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:43.471170 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f73aeb28-a56f-4a66-9a39-b4c9016a6215 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:43.472049 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f73aeb28-a56f-4a66-9a39-b4c9016a6215 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:44.379777 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f73aeb28-a56f-4a66-9a39-b4c9016a6215 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37267b4c360540489a72d9b0043abd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a353634f70fb4ff58c7190a5c7aa675d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:44.399783 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f73aeb28-a56f-4a66-9a39-b4c9016a6215 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e" status: 200 len: 1366 microversion: 2.1 time: 0.956183 Jul 19 22:30:44.411621 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 590/1223] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:43 2022] GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e => generated 1366 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:44.420551 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-883af347-2188-49ab-bdd7-016bff6d1293 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:44.421655 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-883af347-2188-49ab-bdd7-016bff6d1293 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 67fd85a5-6cde-4aa6-acf2-99640be2bb44] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:44.444855 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-883af347-2188-49ab-bdd7-016bff6d1293 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:44.445519 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-883af347-2188-49ab-bdd7-016bff6d1293 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:44.446575 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-883af347-2188-49ab-bdd7-016bff6d1293 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:44.447683 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-883af347-2188-49ab-bdd7-016bff6d1293 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:44.454518 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:30:44.803950 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-883af347-2188-49ab-bdd7-016bff6d1293 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:44.815072 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-883af347-2188-49ab-bdd7-016bff6d1293 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44" status: 200 len: 1316 microversion: 2.1 time: 0.401797 Jul 19 22:30:44.816346 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 591/1224] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:44 2022] GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44 => generated 1316 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:44.820498 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3751a947-9b8c-4cec-9c75-051730a2103e tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:44.826755 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3751a947-9b8c-4cec-9c75-051730a2103e tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:30:44.832491 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3751a947-9b8c-4cec-9c75-051730a2103e tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:44.832949 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3751a947-9b8c-4cec-9c75-051730a2103e tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:44.834488 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3751a947-9b8c-4cec-9c75-051730a2103e tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:44.834649 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3751a947-9b8c-4cec-9c75-051730a2103e tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:44.839843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-8de1cf09-8900-4559-9229-d332da076dc8 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Updating instance_info_cache with network_info: [{"id": "b5b458c6-907b-4661-bb17-cd57f2eb40a1", "address": "fa:16:3e:b9:6b:9c", "network": {"id": "7fb227a3-c946-4497-a05d-837fd699bb48", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-817212019-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "94e68faed5a742fcbd3818f9c0f6569a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb5b458c6-90", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 22:30:44.866711 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8de1cf09-8900-4559-9229-d332da076dc8 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Releasing lock "refresh_cache-a134613f-f510-43e4-943e-d869b38c4372" {{(pid=119337) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 22:30:44.870881 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8de1cf09-8900-4559-9229-d332da076dc8 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "POST /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372/action" status: 202 len: 0 microversion: 2.1 time: 6.709153 Jul 19 22:30:44.872474 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3751a947-9b8c-4cec-9c75-051730a2103e tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] 10.222.0.25 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.055604 Jul 19 22:30:44.872805 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 634/1225] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:30:38 2022] POST /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372/action => generated 0 bytes in 6714 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 19 22:30:44.875181 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 592/1226] 10.222.0.25 () {58 vars in 1195 bytes} [Tue Jul 19 22:30:44 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:30:44.883463 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-9dd7b6b9-208d-4062-ab47-cf45c5de7c07 req-daac077a-5215-4986-9bdf-46d1c1ec7ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f94bf14c-804e-4058-9ed8-037dd0a8ef98", "tag": "0ebe3908-8f61-4950-8278-87404fd21fa1"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:44.889658 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-505c1d56-3ec7-422d-a715-653ee4d2823e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:44.890332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-505c1d56-3ec7-422d-a715-653ee4d2823e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: f94bf14c-804e-4058-9ed8-037dd0a8ef98] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:44.898357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-505c1d56-3ec7-422d-a715-653ee4d2823e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:44.898803 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-505c1d56-3ec7-422d-a715-653ee4d2823e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:44.899954 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-505c1d56-3ec7-422d-a715-653ee4d2823e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:44.901133 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-505c1d56-3ec7-422d-a715-653ee4d2823e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:44.902891 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-9dd7b6b9-208d-4062-ab47-cf45c5de7c07 req-daac077a-5215-4986-9bdf-46d1c1ec7ad9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:44.903962 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-9dd7b6b9-208d-4062-ab47-cf45c5de7c07 req-daac077a-5215-4986-9bdf-46d1c1ec7ad9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:44.928634 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-9dd7b6b9-208d-4062-ab47-cf45c5de7c07 req-daac077a-5215-4986-9bdf-46d1c1ec7ad9 service nova] Creating event network-changed:0ebe3908-8f61-4950-8278-87404fd21fa1 for instance f94bf14c-804e-4058-9ed8-037dd0a8ef98 on n-h1-847009-3 Jul 19 22:30:44.936081 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-9dd7b6b9-208d-4062-ab47-cf45c5de7c07 req-daac077a-5215-4986-9bdf-46d1c1ec7ad9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058477 Jul 19 22:30:44.937014 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 635/1227] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:30:44.944710 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-96561c80-fe71-4149-b416-ec0147f2c03b tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-847009-3", "block_migration": true, "disk_over_commit": false}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:44.946700 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-96561c80-fe71-4149-b416-ec0147f2c03b tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:44.955454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-96561c80-fe71-4149-b416-ec0147f2c03b tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:44.956217 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-96561c80-fe71-4149-b416-ec0147f2c03b tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:44.957202 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-96561c80-fe71-4149-b416-ec0147f2c03b tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:44.957810 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-96561c80-fe71-4149-b416-ec0147f2c03b tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:45.075193 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-96561c80-fe71-4149-b416-ec0147f2c03b tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lazy-loading 'flavor' on Instance uuid fab0a3d6-8249-4058-9ce5-90d458fff59d {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:30:45.118149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-96561c80-fe71-4149-b416-ec0147f2c03b tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Going to try to live migrate instance to n-h1-847009-3 {{(pid=119337) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 22:30:45.235478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-505c1d56-3ec7-422d-a715-653ee4d2823e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:45.293249 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-505c1d56-3ec7-422d-a715-653ee4d2823e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98" status: 200 len: 1308 microversion: 2.1 time: 0.408726 Jul 19 22:30:45.296473 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 593/1228] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:44 2022] GET /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98 => generated 1308 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:45.325607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2e570588-3600-40e6-a080-6699597fb2fb tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:45.329324 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2e570588-3600-40e6-a080-6699597fb2fb tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:45.350837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2e570588-3600-40e6-a080-6699597fb2fb tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:45.351010 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2e570588-3600-40e6-a080-6699597fb2fb tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:45.351803 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2e570588-3600-40e6-a080-6699597fb2fb tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:45.352242 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2e570588-3600-40e6-a080-6699597fb2fb tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:45.673879 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2e570588-3600-40e6-a080-6699597fb2fb tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:45.690162 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2e570588-3600-40e6-a080-6699597fb2fb tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1476 microversion: 2.1 time: 0.389198 Jul 19 22:30:45.691550 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 594/1229] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:45 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1476 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:45.714642 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-284d0cd2-bcc3-461b-ab61-08769f43a911 req-3b84c099-fa0a-4ad6-b2da-3889f3311eab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317af5ae-9759-4095-b561-ed61e9847c7e", "tag": "f3ab19a8-a957-4cec-a5b1-da04b760b755"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:45.731895 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-284d0cd2-bcc3-461b-ab61-08769f43a911 req-3b84c099-fa0a-4ad6-b2da-3889f3311eab service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:45.732162 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-284d0cd2-bcc3-461b-ab61-08769f43a911 req-3b84c099-fa0a-4ad6-b2da-3889f3311eab service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:45.752643 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-284d0cd2-bcc3-461b-ab61-08769f43a911 req-3b84c099-fa0a-4ad6-b2da-3889f3311eab service nova] Creating event network-changed:f3ab19a8-a957-4cec-a5b1-da04b760b755 for instance 317af5ae-9759-4095-b561-ed61e9847c7e on n-h2-847009-3 Jul 19 22:30:45.761306 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-284d0cd2-bcc3-461b-ab61-08769f43a911 req-3b84c099-fa0a-4ad6-b2da-3889f3311eab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055481 Jul 19 22:30:45.762526 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 595/1230] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:30:45.770302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7fb42af0-c74f-4375-a31c-85b499c06994 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Action: 'create', calling method: .version_select at 0x7f7a1045dd30>, body: {"pool": "43456dc5-a081-4e58-9850-97923d9b3e3e"} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:47.607271 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7fb42af0-c74f-4375-a31c-85b499c06994 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.842994 Jul 19 22:30:47.615089 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 596/1231] 10.222.0.25 () {60 vars in 1169 bytes} [Tue Jul 19 22:30:45 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:30:47.621842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-be73d41d-0e1c-4408-b34b-7fefe3b705de tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:47.623385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-be73d41d-0e1c-4408-b34b-7fefe3b705de tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:47.633308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be73d41d-0e1c-4408-b34b-7fefe3b705de tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:47.634669 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be73d41d-0e1c-4408-b34b-7fefe3b705de tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:47.636788 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be73d41d-0e1c-4408-b34b-7fefe3b705de tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:47.637489 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be73d41d-0e1c-4408-b34b-7fefe3b705de tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:47.746461 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-be73d41d-0e1c-4408-b34b-7fefe3b705de tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613/action" status: 202 len: 0 microversion: 2.1 time: 0.129665 Jul 19 22:30:47.747200 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 597/1232] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:30:47 2022] POST /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:30:47.752221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dc0f4317-10f8-477e-b16d-dd66cc209d48 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:47.753094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dc0f4317-10f8-477e-b16d-dd66cc209d48 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:47.765177 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dc0f4317-10f8-477e-b16d-dd66cc209d48 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:47.765999 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dc0f4317-10f8-477e-b16d-dd66cc209d48 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:47.767307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dc0f4317-10f8-477e-b16d-dd66cc209d48 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:47.768033 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dc0f4317-10f8-477e-b16d-dd66cc209d48 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:47.933988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:30:47.958630 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=14 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:30:47.971527 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dc0f4317-10f8-477e-b16d-dd66cc209d48 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37267b4c360540489a72d9b0043abd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a353634f70fb4ff58c7190a5c7aa675d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:47.980844 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dc0f4317-10f8-477e-b16d-dd66cc209d48 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e" status: 200 len: 1366 microversion: 2.1 time: 0.232034 Jul 19 22:30:47.995392 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 598/1233] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:47 2022] GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:47.995392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-080d2f46-1128-4100-a8a2-0ad234a26a60 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:47.995392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-080d2f46-1128-4100-a8a2-0ad234a26a60 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 67fd85a5-6cde-4aa6-acf2-99640be2bb44] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:48.002521 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-080d2f46-1128-4100-a8a2-0ad234a26a60 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:48.003829 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-080d2f46-1128-4100-a8a2-0ad234a26a60 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:48.005438 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-080d2f46-1128-4100-a8a2-0ad234a26a60 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:48.006077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-080d2f46-1128-4100-a8a2-0ad234a26a60 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:48.683632 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-080d2f46-1128-4100-a8a2-0ad234a26a60 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:48.692158 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-080d2f46-1128-4100-a8a2-0ad234a26a60 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44" status: 200 len: 1466 microversion: 2.1 time: 0.708691 Jul 19 22:30:48.693554 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 599/1234] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:47 2022] GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44 => generated 1466 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:48.699202 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7defc784-00f1-4093-94a6-5e608664120a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:48.700043 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7defc784-00f1-4093-94a6-5e608664120a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: f94bf14c-804e-4058-9ed8-037dd0a8ef98] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:48.708307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7defc784-00f1-4093-94a6-5e608664120a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:48.709002 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7defc784-00f1-4093-94a6-5e608664120a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:48.709946 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7defc784-00f1-4093-94a6-5e608664120a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:48.710596 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7defc784-00f1-4093-94a6-5e608664120a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:48.964999 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7defc784-00f1-4093-94a6-5e608664120a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:48.978956 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7defc784-00f1-4093-94a6-5e608664120a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98" status: 200 len: 1308 microversion: 2.1 time: 0.282854 Jul 19 22:30:48.980068 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 600/1235] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:48 2022] GET /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98 => generated 1308 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:48.989032 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0c504380-d43c-450a-abd6-2844121bdaf3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:48.991611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0c504380-d43c-450a-abd6-2844121bdaf3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:49.003684 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c504380-d43c-450a-abd6-2844121bdaf3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:49.004478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c504380-d43c-450a-abd6-2844121bdaf3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:49.005842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c504380-d43c-450a-abd6-2844121bdaf3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:49.009276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c504380-d43c-450a-abd6-2844121bdaf3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:49.212707 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0c504380-d43c-450a-abd6-2844121bdaf3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:49.222969 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0c504380-d43c-450a-abd6-2844121bdaf3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1476 microversion: 2.1 time: 0.241299 Jul 19 22:30:49.223580 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 601/1236] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:48 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1476 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:49.228891 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-790b3077-6fff-41b2-a274-5b0f1f7f1199 req-ab106a24-90e2-4042-896a-5b185c4f1814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a134613f-f510-43e4-943e-d869b38c4372", "tag": "b5b458c6-907b-4661-bb17-cd57f2eb40a1"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:49.238989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-790b3077-6fff-41b2-a274-5b0f1f7f1199 req-ab106a24-90e2-4042-896a-5b185c4f1814 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:49.239487 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-790b3077-6fff-41b2-a274-5b0f1f7f1199 req-ab106a24-90e2-4042-896a-5b185c4f1814 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:49.256137 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-790b3077-6fff-41b2-a274-5b0f1f7f1199 req-ab106a24-90e2-4042-896a-5b185c4f1814 service nova] Creating event network-changed:b5b458c6-907b-4661-bb17-cd57f2eb40a1 for instance a134613f-f510-43e4-943e-d869b38c4372 on n-h2-847009-3 Jul 19 22:30:49.265499 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-790b3077-6fff-41b2-a274-5b0f1f7f1199 req-ab106a24-90e2-4042-896a-5b185c4f1814 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039809 Jul 19 22:30:49.266807 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 602/1237] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:30:49.276263 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6add7605-983b-44d4-bb6c-36a205fbcaf4 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Action: 'action', calling method: .version_select at 0x7f7a1310fd30>, body: {"addFloatingIp": {"address": "172.25.7.72"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:49.278350 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6add7605-983b-44d4-bb6c-36a205fbcaf4 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:49.288039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6add7605-983b-44d4-bb6c-36a205fbcaf4 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:49.288614 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6add7605-983b-44d4-bb6c-36a205fbcaf4 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:49.290013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6add7605-983b-44d4-bb6c-36a205fbcaf4 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:49.290688 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6add7605-983b-44d4-bb6c-36a205fbcaf4 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:49.395282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6add7605-983b-44d4-bb6c-36a205fbcaf4 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Acquired lock "refresh_cache-a134613f-f510-43e4-943e-d869b38c4372" {{(pid=119338) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 22:30:49.986584 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-96561c80-fe71-4149-b416-ec0147f2c03b tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d/action" status: 202 len: 0 microversion: 2.1 time: 5.045962 Jul 19 22:30:49.989913 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 636/1238] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:30:44 2022] POST /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d/action => generated 0 bytes in 5052 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:30:50.020527 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ee4f8e61-4883-4137-ac99-f593071f9778 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:50.027798 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ee4f8e61-4883-4137-ac99-f593071f9778 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:50.063026 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ee4f8e61-4883-4137-ac99-f593071f9778 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:50.063985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ee4f8e61-4883-4137-ac99-f593071f9778 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:50.067351 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ee4f8e61-4883-4137-ac99-f593071f9778 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:50.071692 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ee4f8e61-4883-4137-ac99-f593071f9778 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:50.268137 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ee4f8e61-4883-4137-ac99-f593071f9778 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:30:50.268923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ee4f8e61-4883-4137-ac99-f593071f9778 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:30:50.269742 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ee4f8e61-4883-4137-ac99-f593071f9778 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:30:50.270337 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ee4f8e61-4883-4137-ac99-f593071f9778 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:30:50.270926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ee4f8e61-4883-4137-ac99-f593071f9778 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:30:50.376988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ee4f8e61-4883-4137-ac99-f593071f9778 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:50.414985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ee4f8e61-4883-4137-ac99-f593071f9778 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:50.419916 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ee4f8e61-4883-4137-ac99-f593071f9778 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:50.422980 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ee4f8e61-4883-4137-ac99-f593071f9778 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:50.425313 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ee4f8e61-4883-4137-ac99-f593071f9778 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:50.512757 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ee4f8e61-4883-4137-ac99-f593071f9778 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "POST /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613/action" status: 202 len: 1068 microversion: 2.1 time: 0.521127 Jul 19 22:30:50.526569 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 637/1239] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:30:49 2022] POST /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613/action => generated 1068 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 19 22:30:50.540323 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-4ad1159b-9e74-476b-82ee-434d4c4eba2b req-513a6dba-e188-4b19-9a95-c7b812ad698e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6ee0c6-66e1-4877-a7be-b7996a03d158", "name": "network-vif-unplugged", "status": "completed", "tag": "5964d642-fd77-41ab-93fe-df25f0bebc9c"}, {"name": "network-changed", "server_uuid": "1e6ee0c6-66e1-4877-a7be-b7996a03d158", "tag": "5964d642-fd77-41ab-93fe-df25f0bebc9c"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:50.568914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-4ad1159b-9e74-476b-82ee-434d4c4eba2b req-513a6dba-e188-4b19-9a95-c7b812ad698e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:50.571170 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-4ad1159b-9e74-476b-82ee-434d4c4eba2b req-513a6dba-e188-4b19-9a95-c7b812ad698e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:50.612573 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-4ad1159b-9e74-476b-82ee-434d4c4eba2b req-513a6dba-e188-4b19-9a95-c7b812ad698e service nova] Creating event network-vif-unplugged:5964d642-fd77-41ab-93fe-df25f0bebc9c for instance 1e6ee0c6-66e1-4877-a7be-b7996a03d158 on n-h2-847009-3 Jul 19 22:30:50.613599 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-4ad1159b-9e74-476b-82ee-434d4c4eba2b req-513a6dba-e188-4b19-9a95-c7b812ad698e service nova] Creating event network-changed:5964d642-fd77-41ab-93fe-df25f0bebc9c for instance 1e6ee0c6-66e1-4877-a7be-b7996a03d158 on n-h2-847009-3 Jul 19 22:30:50.623904 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [req-4ad1159b-9e74-476b-82ee-434d4c4eba2b req-513a6dba-e188-4b19-9a95-c7b812ad698e service nova] Instance 1e6ee0c6-66e1-4877-a7be-b7996a03d158 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119337) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 22:30:50.638031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG neutronclient.v2_0.client [None req-6add7605-983b-44d4-bb6c-36a205fbcaf4 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.7.72 (ae868c5e-59bd-49ee-b651-d3a69d4bf08e) with port b5b458c6-907b-4661-bb17-cd57f2eb40a1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 43456dc5-a081-4e58-9850-97923d9b3e3e.", "detail": ""}} {{(pid=119338) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 22:30:50.640804 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6add7605-983b-44d4-bb6c-36a205fbcaf4 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Releasing lock "refresh_cache-a134613f-f510-43e4-943e-d869b38c4372" {{(pid=119338) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 22:30:50.641607 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-6add7605-983b-44d4-bb6c-36a205fbcaf4 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] HTTP exception thrown: Cannot associate floating IP 172.25.7.72 (ae868c5e-59bd-49ee-b651-d3a69d4bf08e) with port b5b458c6-907b-4661-bb17-cd57f2eb40a1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 43456dc5-a081-4e58-9850-97923d9b3e3e. Jul 19 22:30:50.641607 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-5fb9c3b0-c526-43f0-bd4c-53365e27fead'] Jul 19 22:30:50.642506 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-4ad1159b-9e74-476b-82ee-434d4c4eba2b req-513a6dba-e188-4b19-9a95-c7b812ad698e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.114104 Jul 19 22:30:50.643713 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 638/1240] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:30:50.674750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7e8a2aab-4ded-438e-9963-a362580d4a5e tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:50.676133 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7e8a2aab-4ded-438e-9963-a362580d4a5e tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] [instance: 67fd85a5-6cde-4aa6-acf2-99640be2bb44] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:50.680572 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6add7605-983b-44d4-bb6c-36a205fbcaf4 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Request method failure captured: Jul 19 22:30:50.680572 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372/action HTTP/1.1 Jul 19 22:30:50.680572 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:30:50.680572 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:30:50.680572 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:30:50.680572 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 45 Jul 19 22:30:50.680572 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:30:50.680572 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:30:50.680572 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:30:50.680572 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:30:50.680572 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zBffm25x4xYa7JzDlLJIESGAgCPSFEkA7y6FYg9TrCpiBjNJSxaG9X7U3eQhgYDbIxW8dG5nidohqPDfN5gpCMhbkfW3vs54sTnSucmW5D1dYQ6EHnI3O-x5CeIwYZ4NysXswwCEpPHivIKgqLq-uT1pxQcq_p4cNiAxOMP2qoDlY4 Jul 19 22:30:50.680572 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:30:50.680572 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:30:50.680572 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:30:50.680572 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:30:50.680572 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:30:50.680572 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:30:50.680572 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 94e68faed5a742fcbd3818f9c0f6569a Jul 19 22:30:50.680572 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-231453760 Jul 19 22:30:50.680572 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:30:50.680572 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:30:50.682914 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94e68faed5a742fcbd3818f9c0f6569a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94e68faed5a742fcbd3818f9c0f6569a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94e68faed5a742fcbd3818f9c0f6569a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94e68faed5a742fcbd3818f9c0f6569a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:30:50.682914 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-231453760 Jul 19 22:30:50.682914 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 94e68faed5a742fcbd3818f9c0f6569a Jul 19 22:30:50.682914 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-231453760 Jul 19 22:30:50.682914 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project Jul 19 22:30:50.682914 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:30:50.682914 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:30:50.682914 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 0f20e57a90994fbb989c749dc3ea2ec6 Jul 19 22:30:50.682914 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project Jul 19 22:30:50.682914 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:30:50.682914 n-d-847009-3 devstack@n-api.service[119338]: {"addFloatingIp": {"address": "172.25.7.72"}} Jul 19 22:30:50.682914 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:30:50.683720 n-d-847009-3 devstack@n-api.service[119338]: exception: Cannot associate floating IP 172.25.7.72 (ae868c5e-59bd-49ee-b651-d3a69d4bf08e) with port b5b458c6-907b-4661-bb17-cd57f2eb40a1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 43456dc5-a081-4e58-9850-97923d9b3e3e. Jul 19 22:30:50.683720 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-5fb9c3b0-c526-43f0-bd4c-53365e27fead'] Jul 19 22:30:50.683720 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'a134613f-f510-43e4-943e-d869b38c4372', 'body': {'addFloatingIp': {'address': '172.25.7.72'}}} Jul 19 22:30:50.683720 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:30:50.683720 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:30:50.683720 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 19 22:30:50.683720 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 19 22:30:50.683720 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:30:50.683720 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:30:50.683720 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 19 22:30:50.683720 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 19 22:30:50.683720 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:30:50.683720 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:30:50.683720 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 19 22:30:50.683720 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 19 22:30:50.683720 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:30:50.683720 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:30:50.684897 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 19 22:30:50.684897 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 19 22:30:50.684897 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:30:50.684897 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:30:50.684897 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 22:30:50.684897 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 22:30:50.684897 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:30:50.684897 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:30:50.684897 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 22:30:50.684897 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 22:30:50.684897 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:30:50.684897 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:30:50.684897 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 22:30:50.684897 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 22:30:50.684897 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 22:30:50.684897 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 22:30:50.686610 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.7.72 (ae868c5e-59bd-49ee-b651-d3a69d4bf08e) with port b5b458c6-907b-4661-bb17-cd57f2eb40a1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 43456dc5-a081-4e58-9850-97923d9b3e3e. Jul 19 22:30:50.686610 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5fb9c3b0-c526-43f0-bd4c-53365e27fead'] Jul 19 22:30:50.686610 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:30:50.686610 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:30:50.686610 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:30:50.686610 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:30:50.686610 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 19 22:30:50.686610 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 19 22:30:50.686610 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 19 22:30:50.686610 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 19 22:30:50.686610 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 19 22:30:50.686610 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 19 22:30:50.686610 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.7.72 (ae868c5e-59bd-49ee-b651-d3a69d4bf08e) with port b5b458c6-907b-4661-bb17-cd57f2eb40a1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 43456dc5-a081-4e58-9850-97923d9b3e3e. Jul 19 22:30:50.686610 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5fb9c3b0-c526-43f0-bd4c-53365e27fead'] Jul 19 22:30:50.686610 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:30:50.686610 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:30:50.689484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:30:50.689484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:30:50.689484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:30:50.689484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:30:50.689484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:30:50.689484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:30:50.689484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:30:50.689484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:30:50.689484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:30:50.689484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:30:50.689484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:30:50.689484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:30:50.689484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 19 22:30:50.689484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 22:30:50.689484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.7.72 (ae868c5e-59bd-49ee-b651-d3a69d4bf08e) with port b5b458c6-907b-4661-bb17-cd57f2eb40a1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 43456dc5-a081-4e58-9850-97923d9b3e3e. Jul 19 22:30:50.689484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5fb9c3b0-c526-43f0-bd4c-53365e27fead'] Jul 19 22:30:50.689484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:30:50.689484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:30:50.691949 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:30:50.691949 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:30:50.691949 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:30:50.691949 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:30:50.691949 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:30:50.691949 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:30:50.691949 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.7.72 (ae868c5e-59bd-49ee-b651-d3a69d4bf08e) with port b5b458c6-907b-4661-bb17-cd57f2eb40a1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 43456dc5-a081-4e58-9850-97923d9b3e3e. Jul 19 22:30:50.691949 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5fb9c3b0-c526-43f0-bd4c-53365e27fead'] Jul 19 22:30:50.691949 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:30:50.696237 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6add7605-983b-44d4-bb6c-36a205fbcaf4 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Returning 400 to user: Cannot associate floating IP 172.25.7.72 (ae868c5e-59bd-49ee-b651-d3a69d4bf08e) with port b5b458c6-907b-4661-bb17-cd57f2eb40a1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 43456dc5-a081-4e58-9850-97923d9b3e3e. Jul 19 22:30:50.696237 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-5fb9c3b0-c526-43f0-bd4c-53365e27fead'] {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:30:50.696237 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6add7605-983b-44d4-bb6c-36a205fbcaf4 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "POST /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372/action" status: 400 len: 381 microversion: 2.1 time: 1.426208 Jul 19 22:30:50.696237 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 603/1241] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:30:49 2022] POST /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372/action => generated 381 bytes in 1428 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:30:50.703665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f28ebdab-2f80-4ac9-bdf6-674ebcc1614b tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:50.704656 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f28ebdab-2f80-4ac9-bdf6-674ebcc1614b tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:50.715142 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f28ebdab-2f80-4ac9-bdf6-674ebcc1614b tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:50.715992 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f28ebdab-2f80-4ac9-bdf6-674ebcc1614b tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:50.717013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f28ebdab-2f80-4ac9-bdf6-674ebcc1614b tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:50.717134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e8a2aab-4ded-438e-9963-a362580d4a5e tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:50.717775 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f28ebdab-2f80-4ac9-bdf6-674ebcc1614b tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:50.717995 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e8a2aab-4ded-438e-9963-a362580d4a5e tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:50.718848 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e8a2aab-4ded-438e-9963-a362580d4a5e tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:50.719336 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e8a2aab-4ded-438e-9963-a362580d4a5e tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:51.442872 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f28ebdab-2f80-4ac9-bdf6-674ebcc1614b tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37267b4c360540489a72d9b0043abd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a353634f70fb4ff58c7190a5c7aa675d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:51.466298 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f28ebdab-2f80-4ac9-bdf6-674ebcc1614b tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e" status: 200 len: 1366 microversion: 2.1 time: 0.764467 Jul 19 22:30:51.483947 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 604/1242] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:50 2022] GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e => generated 1366 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:51.492015 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-84b31468-a6d3-4d9e-93ae-b40c36cff1f6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:51.493315 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-84b31468-a6d3-4d9e-93ae-b40c36cff1f6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: f94bf14c-804e-4058-9ed8-037dd0a8ef98] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:51.507406 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-84b31468-a6d3-4d9e-93ae-b40c36cff1f6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:51.508369 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-84b31468-a6d3-4d9e-93ae-b40c36cff1f6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:51.511420 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-84b31468-a6d3-4d9e-93ae-b40c36cff1f6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:51.512396 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-84b31468-a6d3-4d9e-93ae-b40c36cff1f6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:51.551027 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7e8a2aab-4ded-438e-9963-a362580d4a5e tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44" status: 200 len: 1617 microversion: 2.1 time: 0.904787 Jul 19 22:30:51.553068 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 639/1243] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:50 2022] GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44 => generated 1617 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:51.558304 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ba40829e-b223-4e40-81fa-96a30fe5674b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:51.559305 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ba40829e-b223-4e40-81fa-96a30fe5674b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:51.567307 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba40829e-b223-4e40-81fa-96a30fe5674b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:51.568165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba40829e-b223-4e40-81fa-96a30fe5674b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:51.569298 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba40829e-b223-4e40-81fa-96a30fe5674b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:51.569982 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba40829e-b223-4e40-81fa-96a30fe5674b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:51.957582 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-84b31468-a6d3-4d9e-93ae-b40c36cff1f6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:51.978947 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ba40829e-b223-4e40-81fa-96a30fe5674b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:51.983729 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-84b31468-a6d3-4d9e-93ae-b40c36cff1f6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98" status: 200 len: 1308 microversion: 2.1 time: 0.495921 Jul 19 22:30:51.987310 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 605/1244] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:51 2022] GET /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98 => generated 1308 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:52.000487 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bb89d1ae-e3d9-4374-858c-981ab035170f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:52.002084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bb89d1ae-e3d9-4374-858c-981ab035170f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:52.006158 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ba40829e-b223-4e40-81fa-96a30fe5674b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1718 microversion: 2.1 time: 0.451649 Jul 19 22:30:52.015431 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 640/1245] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:51 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1718 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:52.027543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bb89d1ae-e3d9-4374-858c-981ab035170f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:52.028346 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bb89d1ae-e3d9-4374-858c-981ab035170f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:52.028643 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-51dcfcf4-43bc-409b-aa07-7f214cfde04d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:52.029384 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-51dcfcf4-43bc-409b-aa07-7f214cfde04d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:52.029669 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bb89d1ae-e3d9-4374-858c-981ab035170f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:52.031024 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bb89d1ae-e3d9-4374-858c-981ab035170f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:52.038617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51dcfcf4-43bc-409b-aa07-7f214cfde04d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:52.043531 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51dcfcf4-43bc-409b-aa07-7f214cfde04d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:52.044418 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51dcfcf4-43bc-409b-aa07-7f214cfde04d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:52.047140 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51dcfcf4-43bc-409b-aa07-7f214cfde04d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:52.638102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bb89d1ae-e3d9-4374-858c-981ab035170f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:52.657299 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bb89d1ae-e3d9-4374-858c-981ab035170f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1474 microversion: 2.1 time: 0.667897 Jul 19 22:30:52.660479 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 606/1246] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:51 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1474 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:52.661484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-51dcfcf4-43bc-409b-aa07-7f214cfde04d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:52.670876 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f03dff54-da91-404f-90ac-6c684a492478 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Calling method '.version_select at 0x7f7a1003c040>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:52.680512 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-51dcfcf4-43bc-409b-aa07-7f214cfde04d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1472 microversion: 2.1 time: 0.669780 Jul 19 22:30:52.683205 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 641/1247] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:52 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1472 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:52.694213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ad051ee5-626f-46eb-8816-e3ebcea9b06e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1357255553", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "9d261177-b837-4836-959b-2b419921e90c"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:52.796577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-ad051ee5-626f-46eb-8816-e3ebcea9b06e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] validate_networks() for None {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:30:53.699213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ad051ee5-626f-46eb-8816-e3ebcea9b06e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:30:53.700034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ad051ee5-626f-46eb-8816-e3ebcea9b06e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:30:53.700954 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ad051ee5-626f-46eb-8816-e3ebcea9b06e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:30:53.701764 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ad051ee5-626f-46eb-8816-e3ebcea9b06e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:30:53.702576 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ad051ee5-626f-46eb-8816-e3ebcea9b06e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:30:53.717454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad051ee5-626f-46eb-8816-e3ebcea9b06e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:53.718521 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad051ee5-626f-46eb-8816-e3ebcea9b06e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:53.720154 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad051ee5-626f-46eb-8816-e3ebcea9b06e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:53.720935 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad051ee5-626f-46eb-8816-e3ebcea9b06e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:53.743331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-ad051ee5-626f-46eb-8816-e3ebcea9b06e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for project 791e176b6751415ca1472c109b3ce011. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:30:53.750087 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-ad051ee5-626f-46eb-8816-e3ebcea9b06e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Getting quotas for user bd5fb561f7bd429e8c6b2cc30ed76f13 and project 791e176b6751415ca1472c109b3ce011. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:30:53.765781 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ad051ee5-626f-46eb-8816-e3ebcea9b06e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:30:53.768674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ad051ee5-626f-46eb-8816-e3ebcea9b06e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: e5cee0f0-7a6c-4388-8bbb-25781a0e0442] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:30:53.825403 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ad051ee5-626f-46eb-8816-e3ebcea9b06e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.140107 Jul 19 22:30:53.834841 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 642/1248] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:30:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:30:53.834841 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-59b577b0-50a4-476b-89f3-b67bc02a3eea req-21a8a93c-8424-4248-bb31-f30a9992f2d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f94bf14c-804e-4058-9ed8-037dd0a8ef98", "name": "network-vif-plugged", "status": "completed", "tag": "0ebe3908-8f61-4950-8278-87404fd21fa1"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:53.843555 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-59b577b0-50a4-476b-89f3-b67bc02a3eea req-21a8a93c-8424-4248-bb31-f30a9992f2d6 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:53.844155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-59b577b0-50a4-476b-89f3-b67bc02a3eea req-21a8a93c-8424-4248-bb31-f30a9992f2d6 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:53.872439 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-59b577b0-50a4-476b-89f3-b67bc02a3eea req-21a8a93c-8424-4248-bb31-f30a9992f2d6 service nova] Creating event network-vif-plugged:0ebe3908-8f61-4950-8278-87404fd21fa1 for instance f94bf14c-804e-4058-9ed8-037dd0a8ef98 on n-h1-847009-3 Jul 19 22:30:53.879470 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-59b577b0-50a4-476b-89f3-b67bc02a3eea req-21a8a93c-8424-4248-bb31-f30a9992f2d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051126 Jul 19 22:30:53.880566 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 643/1249] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:30:53.890279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cd3edbbe-92de-4dfb-ab50-875297a8868f tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:53.891817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cd3edbbe-92de-4dfb-ab50-875297a8868f tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:53.901134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd3edbbe-92de-4dfb-ab50-875297a8868f tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:53.901859 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd3edbbe-92de-4dfb-ab50-875297a8868f tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:53.903788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd3edbbe-92de-4dfb-ab50-875297a8868f tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:53.904472 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd3edbbe-92de-4dfb-ab50-875297a8868f tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:54.355536 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cd3edbbe-92de-4dfb-ab50-875297a8868f tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37267b4c360540489a72d9b0043abd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a353634f70fb4ff58c7190a5c7aa675d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:54.387266 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cd3edbbe-92de-4dfb-ab50-875297a8868f tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e" status: 200 len: 1366 microversion: 2.1 time: 0.504132 Jul 19 22:30:54.389899 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 644/1250] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:53 2022] GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e => generated 1366 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:54.399870 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-644e8e01-f045-4780-b048-ded41c5ced10 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:54.401098 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-644e8e01-f045-4780-b048-ded41c5ced10 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: f94bf14c-804e-4058-9ed8-037dd0a8ef98] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:54.420322 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-644e8e01-f045-4780-b048-ded41c5ced10 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:54.422734 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-644e8e01-f045-4780-b048-ded41c5ced10 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:54.426193 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-644e8e01-f045-4780-b048-ded41c5ced10 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:54.427534 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-644e8e01-f045-4780-b048-ded41c5ced10 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:54.845340 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-644e8e01-f045-4780-b048-ded41c5ced10 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:54.852463 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:UPDATE=6,nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:30:54.854370 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:30:54.865230 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-644e8e01-f045-4780-b048-ded41c5ced10 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98" status: 200 len: 1308 microversion: 2.1 time: 0.473497 Jul 19 22:30:54.867249 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 645/1251] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:54 2022] GET /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98 => generated 1308 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:54.876088 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f03dff54-da91-404f-90ac-6c684a492478 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/ae868c5e-59bd-49ee-b651-d3a69d4bf08e" status: 202 len: 0 microversion: 2.1 time: 2.211836 Jul 19 22:30:54.877255 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 607/1252] 10.222.0.25 () {58 vars in 1262 bytes} [Tue Jul 19 22:30:52 2022] DELETE /compute/v2.1/os-floating-ips/ae868c5e-59bd-49ee-b651-d3a69d4bf08e => generated 0 bytes in 2216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:30:54.878384 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8d2d7ed6-e57d-4694-ad31-0423e30fc138 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:54.879723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8d2d7ed6-e57d-4694-ad31-0423e30fc138 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:54.886340 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-91613aad-a623-410c-be0c-aa5161a605d1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:54.886990 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-91613aad-a623-410c-be0c-aa5161a605d1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:54.892822 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:30:54.893578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8d2d7ed6-e57d-4694-ad31-0423e30fc138 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:54.894591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8d2d7ed6-e57d-4694-ad31-0423e30fc138 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:54.894757 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91613aad-a623-410c-be0c-aa5161a605d1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:54.895231 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91613aad-a623-410c-be0c-aa5161a605d1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:54.896021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91613aad-a623-410c-be0c-aa5161a605d1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:54.896520 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91613aad-a623-410c-be0c-aa5161a605d1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:54.897157 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8d2d7ed6-e57d-4694-ad31-0423e30fc138 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:54.898212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8d2d7ed6-e57d-4694-ad31-0423e30fc138 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:55.298253 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-91613aad-a623-410c-be0c-aa5161a605d1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:55.325185 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-91613aad-a623-410c-be0c-aa5161a605d1 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1474 microversion: 2.1 time: 0.445698 Jul 19 22:30:55.329925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8d2d7ed6-e57d-4694-ad31-0423e30fc138 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:55.330679 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 608/1253] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:54 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1474 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:55.343825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-adc908e7-95e7-449f-bf5f-7642ffc29e42 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:55.345149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-adc908e7-95e7-449f-bf5f-7642ffc29e42 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:55.350244 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8d2d7ed6-e57d-4694-ad31-0423e30fc138 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1718 microversion: 2.1 time: 0.480145 Jul 19 22:30:55.363143 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 646/1254] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:54 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1718 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:55.363143 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7ee934a2-c74e-4a90-8cf0-cba430239873 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:55.363143 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7ee934a2-c74e-4a90-8cf0-cba430239873 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: e5cee0f0-7a6c-4388-8bbb-25781a0e0442] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:55.376121 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-adc908e7-95e7-449f-bf5f-7642ffc29e42 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:55.376628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-adc908e7-95e7-449f-bf5f-7642ffc29e42 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:55.378161 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-adc908e7-95e7-449f-bf5f-7642ffc29e42 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:55.378161 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-adc908e7-95e7-449f-bf5f-7642ffc29e42 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:55.386486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7ee934a2-c74e-4a90-8cf0-cba430239873 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:55.387033 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7ee934a2-c74e-4a90-8cf0-cba430239873 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:55.388521 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7ee934a2-c74e-4a90-8cf0-cba430239873 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:55.389299 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7ee934a2-c74e-4a90-8cf0-cba430239873 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:55.563836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7ee934a2-c74e-4a90-8cf0-cba430239873 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:55.581154 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7ee934a2-c74e-4a90-8cf0-cba430239873 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442" status: 200 len: 1269 microversion: 2.1 time: 0.226716 Jul 19 22:30:55.585264 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 647/1255] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:55 2022] GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442 => generated 1269 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:55.592191 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-535b511b-57e8-44a6-80e3-383da64b3a53 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Action: 'action', calling method: .version_select at 0x7f7a1310edc0>, body: {"removeFloatingIp": {"address": "172.25.7.9"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:55.860335 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-adc908e7-95e7-449f-bf5f-7642ffc29e42 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:55.874953 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-adc908e7-95e7-449f-bf5f-7642ffc29e42 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1472 microversion: 2.1 time: 0.542107 Jul 19 22:30:55.883219 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 609/1256] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:55 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1472 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:55.883652 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-535b511b-57e8-44a6-80e3-383da64b3a53 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:55.893097 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5b6814d2-3ca8-4972-abf7-645b86b7e723 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:55.893680 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-535b511b-57e8-44a6-80e3-383da64b3a53 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:55.894532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-535b511b-57e8-44a6-80e3-383da64b3a53 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:55.896078 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-535b511b-57e8-44a6-80e3-383da64b3a53 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:55.897132 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5b6814d2-3ca8-4972-abf7-645b86b7e723 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:55.897457 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-535b511b-57e8-44a6-80e3-383da64b3a53 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:55.910292 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b6814d2-3ca8-4972-abf7-645b86b7e723 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:55.911823 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b6814d2-3ca8-4972-abf7-645b86b7e723 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:55.913477 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b6814d2-3ca8-4972-abf7-645b86b7e723 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:55.915517 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b6814d2-3ca8-4972-abf7-645b86b7e723 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:56.297479 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5b6814d2-3ca8-4972-abf7-645b86b7e723 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37267b4c360540489a72d9b0043abd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a353634f70fb4ff58c7190a5c7aa675d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:56.303903 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:30:56.331556 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5b6814d2-3ca8-4972-abf7-645b86b7e723 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e" status: 200 len: 1366 microversion: 2.1 time: 0.453565 Jul 19 22:30:56.341290 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 610/1257] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:55 2022] GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e => generated 1366 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:56.355499 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-747c56da-0c5e-40c0-9f52-5b8b8855194a req-1903002c-c1ee-43f7-864d-68ef748c037f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317af5ae-9759-4095-b561-ed61e9847c7e", "name": "network-vif-plugged", "status": "completed", "tag": "f3ab19a8-a957-4cec-a5b1-da04b760b755"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:56.374364 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-747c56da-0c5e-40c0-9f52-5b8b8855194a req-1903002c-c1ee-43f7-864d-68ef748c037f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:56.375874 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-747c56da-0c5e-40c0-9f52-5b8b8855194a req-1903002c-c1ee-43f7-864d-68ef748c037f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:56.390304 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-535b511b-57e8-44a6-80e3-383da64b3a53 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Acquired lock "refresh_cache-a134613f-f510-43e4-943e-d869b38c4372" {{(pid=119337) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 22:30:56.411441 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-747c56da-0c5e-40c0-9f52-5b8b8855194a req-1903002c-c1ee-43f7-864d-68ef748c037f service nova] Creating event network-vif-plugged:f3ab19a8-a957-4cec-a5b1-da04b760b755 for instance 317af5ae-9759-4095-b561-ed61e9847c7e on n-h2-847009-3 Jul 19 22:30:56.421071 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-747c56da-0c5e-40c0-9f52-5b8b8855194a req-1903002c-c1ee-43f7-864d-68ef748c037f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078155 Jul 19 22:30:56.422240 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 611/1258] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:30:56.427967 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5a04cb76-0ac8-4906-9fb5-8f4b57f5420f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:56.429458 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5a04cb76-0ac8-4906-9fb5-8f4b57f5420f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: f94bf14c-804e-4058-9ed8-037dd0a8ef98] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:56.440932 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5a04cb76-0ac8-4906-9fb5-8f4b57f5420f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:56.441644 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5a04cb76-0ac8-4906-9fb5-8f4b57f5420f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:56.442733 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5a04cb76-0ac8-4906-9fb5-8f4b57f5420f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:56.443779 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5a04cb76-0ac8-4906-9fb5-8f4b57f5420f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:56.901559 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5a04cb76-0ac8-4906-9fb5-8f4b57f5420f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:56.929201 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5a04cb76-0ac8-4906-9fb5-8f4b57f5420f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98" status: 200 len: 1488 microversion: 2.1 time: 0.503219 Jul 19 22:30:56.931102 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 612/1259] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:56 2022] GET /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98 => generated 1488 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:56.943796 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d26f7041-2979-4834-bbe1-ac94aea2fabd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:56.945325 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d26f7041-2979-4834-bbe1-ac94aea2fabd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:56.966046 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d26f7041-2979-4834-bbe1-ac94aea2fabd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:56.967204 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d26f7041-2979-4834-bbe1-ac94aea2fabd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:56.969050 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d26f7041-2979-4834-bbe1-ac94aea2fabd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:56.970394 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d26f7041-2979-4834-bbe1-ac94aea2fabd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:57.350687 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d26f7041-2979-4834-bbe1-ac94aea2fabd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:57.377630 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d26f7041-2979-4834-bbe1-ac94aea2fabd tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1471 microversion: 2.1 time: 0.441967 Jul 19 22:30:57.377630 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 613/1260] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:56 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1471 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:57.389889 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dfb883eb-c08a-461b-b86c-69ce6a996773 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:57.391311 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dfb883eb-c08a-461b-b86c-69ce6a996773 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:57.422958 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfb883eb-c08a-461b-b86c-69ce6a996773 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:57.424167 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfb883eb-c08a-461b-b86c-69ce6a996773 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:57.436059 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfb883eb-c08a-461b-b86c-69ce6a996773 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:57.436447 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfb883eb-c08a-461b-b86c-69ce6a996773 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:57.807965 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dfb883eb-c08a-461b-b86c-69ce6a996773 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:57.831892 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dfb883eb-c08a-461b-b86c-69ce6a996773 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1718 microversion: 2.1 time: 0.453253 Jul 19 22:30:57.832860 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 614/1261] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:57 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1718 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:57.850711 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dfea0d6d-6c2d-455c-8b18-5d9245694baf tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:57.855033 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dfea0d6d-6c2d-455c-8b18-5d9245694baf tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: e5cee0f0-7a6c-4388-8bbb-25781a0e0442] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:57.879746 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfea0d6d-6c2d-455c-8b18-5d9245694baf tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:57.886234 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfea0d6d-6c2d-455c-8b18-5d9245694baf tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:57.889381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfea0d6d-6c2d-455c-8b18-5d9245694baf tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:57.889838 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfea0d6d-6c2d-455c-8b18-5d9245694baf tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:58.351497 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-535b511b-57e8-44a6-80e3-383da64b3a53 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Building network info cache for instance {{(pid=119337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 22:30:58.437934 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dfea0d6d-6c2d-455c-8b18-5d9245694baf tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:58.446698 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dfea0d6d-6c2d-455c-8b18-5d9245694baf tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442" status: 200 len: 1317 microversion: 2.1 time: 0.612381 Jul 19 22:30:58.451478 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 615/1262] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:57 2022] GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442 => generated 1317 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:58.469199 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aa87b043-2885-44f7-9bce-dc8dc9fecdb4 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:58.470268 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-aa87b043-2885-44f7-9bce-dc8dc9fecdb4 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:58.487206 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa87b043-2885-44f7-9bce-dc8dc9fecdb4 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:58.488049 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa87b043-2885-44f7-9bce-dc8dc9fecdb4 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:58.492281 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa87b043-2885-44f7-9bce-dc8dc9fecdb4 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:58.492843 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa87b043-2885-44f7-9bce-dc8dc9fecdb4 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:58.955868 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-aa87b043-2885-44f7-9bce-dc8dc9fecdb4 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:30:58.971010 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-aa87b043-2885-44f7-9bce-dc8dc9fecdb4 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1472 microversion: 2.1 time: 0.508610 Jul 19 22:30:58.977612 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 616/1263] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:30:58 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1472 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:30:59.006226 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d9e0142a-5b4b-4221-ac34-2647f6a1d870 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:30:59.006787 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d9e0142a-5b4b-4221-ac34-2647f6a1d870 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: f94bf14c-804e-4058-9ed8-037dd0a8ef98] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:59.027129 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d9e0142a-5b4b-4221-ac34-2647f6a1d870 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:59.027913 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d9e0142a-5b4b-4221-ac34-2647f6a1d870 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:59.030058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d9e0142a-5b4b-4221-ac34-2647f6a1d870 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:59.030856 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d9e0142a-5b4b-4221-ac34-2647f6a1d870 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:59.136521 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-d9e0142a-5b4b-4221-ac34-2647f6a1d870 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lazy-loading 'flavor' on Instance uuid f94bf14c-804e-4058-9ed8-037dd0a8ef98 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:30:59.468326 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d9e0142a-5b4b-4221-ac34-2647f6a1d870 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "POST /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98/action" status: 202 len: 0 microversion: 2.1 time: 0.487182 Jul 19 22:30:59.476701 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 617/1264] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:30:58 2022] POST /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:30:59.489447 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c4b1b07a-2b39-42d8-8c15-1d09778ab9d8 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:30:59.490713 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c4b1b07a-2b39-42d8-8c15-1d09778ab9d8 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:30:59.524169 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4b1b07a-2b39-42d8-8c15-1d09778ab9d8 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:59.525327 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4b1b07a-2b39-42d8-8c15-1d09778ab9d8 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:30:59.528391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4b1b07a-2b39-42d8-8c15-1d09778ab9d8 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:30:59.531091 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4b1b07a-2b39-42d8-8c15-1d09778ab9d8 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:00.099703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-c4b1b07a-2b39-42d8-8c15-1d09778ab9d8 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lazy-loading 'services' on Instance uuid 5d871dc5-0189-41e2-8650-8f753bf98c67 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:31:00.174545 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c4b1b07a-2b39-42d8-8c15-1d09778ab9d8 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 2345 microversion: 2.25 time: 0.692983 Jul 19 22:31:00.179816 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 618/1265] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:30:59 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 2345 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:31:00.191558 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fc665e50-a757-4710-a9b1-b49f1e8e2678 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:00.205295 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fc665e50-a757-4710-a9b1-b49f1e8e2678 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:00.229898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc665e50-a757-4710-a9b1-b49f1e8e2678 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:00.231376 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc665e50-a757-4710-a9b1-b49f1e8e2678 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:00.232307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc665e50-a757-4710-a9b1-b49f1e8e2678 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:00.234416 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc665e50-a757-4710-a9b1-b49f1e8e2678 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:00.338444 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-535b511b-57e8-44a6-80e3-383da64b3a53 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Updating instance_info_cache with network_info: [{"id": "b5b458c6-907b-4661-bb17-cd57f2eb40a1", "address": "fa:16:3e:b9:6b:9c", "network": {"id": "7fb227a3-c946-4497-a05d-837fd699bb48", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-817212019-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "94e68faed5a742fcbd3818f9c0f6569a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb5b458c6-90", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 22:31:00.353285 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-535b511b-57e8-44a6-80e3-383da64b3a53 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Releasing lock "refresh_cache-a134613f-f510-43e4-943e-d869b38c4372" {{(pid=119337) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 22:31:00.354466 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-535b511b-57e8-44a6-80e3-383da64b3a53 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "POST /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372/action" status: 202 len: 0 microversion: 2.1 time: 4.766720 Jul 19 22:31:00.358681 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 648/1266] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:30:55 2022] POST /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372/action => generated 0 bytes in 4772 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 19 22:31:00.372783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4fa2faf0-149b-422d-9cb4-28a4358c99aa tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:00.373485 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4fa2faf0-149b-422d-9cb4-28a4358c99aa tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:00.391306 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4fa2faf0-149b-422d-9cb4-28a4358c99aa tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:00.393014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4fa2faf0-149b-422d-9cb4-28a4358c99aa tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:00.394436 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4fa2faf0-149b-422d-9cb4-28a4358c99aa tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:00.395492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4fa2faf0-149b-422d-9cb4-28a4358c99aa tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:00.577933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fc665e50-a757-4710-a9b1-b49f1e8e2678 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37267b4c360540489a72d9b0043abd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a353634f70fb4ff58c7190a5c7aa675d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:00.593559 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fc665e50-a757-4710-a9b1-b49f1e8e2678 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e" status: 200 len: 1556 microversion: 2.1 time: 0.411508 Jul 19 22:31:00.597104 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 619/1267] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:00 2022] GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e => generated 1556 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:00.609025 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-d1d874cf-6d00-48e4-b986-0f1a6a779bfe req-fd405c1a-2700-48ca-8d7c-e183063f94c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a134613f-f510-43e4-943e-d869b38c4372", "tag": "b5b458c6-907b-4661-bb17-cd57f2eb40a1"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:00.627734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d1d874cf-6d00-48e4-b986-0f1a6a779bfe req-fd405c1a-2700-48ca-8d7c-e183063f94c5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:00.629599 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d1d874cf-6d00-48e4-b986-0f1a6a779bfe req-fd405c1a-2700-48ca-8d7c-e183063f94c5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:00.673211 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4fa2faf0-149b-422d-9cb4-28a4358c99aa tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "POST /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158/action" status: 202 len: 0 microversion: 2.1 time: 0.312392 Jul 19 22:31:00.675407 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 649/1268] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:31:00 2022] POST /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:31:00.686475 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-d1d874cf-6d00-48e4-b986-0f1a6a779bfe req-fd405c1a-2700-48ca-8d7c-e183063f94c5 service nova] Creating event network-changed:b5b458c6-907b-4661-bb17-cd57f2eb40a1 for instance a134613f-f510-43e4-943e-d869b38c4372 on n-h2-847009-3 Jul 19 22:31:00.688247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c088b732-b9c9-4f12-a0a2-c09e8567d2f6 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:00.689902 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c088b732-b9c9-4f12-a0a2-c09e8567d2f6 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:00.698952 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-d1d874cf-6d00-48e4-b986-0f1a6a779bfe req-fd405c1a-2700-48ca-8d7c-e183063f94c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098764 Jul 19 22:31:00.700383 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 620/1269] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:00.704970 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c088b732-b9c9-4f12-a0a2-c09e8567d2f6 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:00.706089 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c088b732-b9c9-4f12-a0a2-c09e8567d2f6 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:00.708288 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c088b732-b9c9-4f12-a0a2-c09e8567d2f6 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:00.709452 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c088b732-b9c9-4f12-a0a2-c09e8567d2f6 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:00.760890 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-6f58f2c6-8565-4920-a7e6-a8078a21ed0e req-40e21c51-212a-437d-9381-96faf346b9c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5cee0f0-7a6c-4388-8bbb-25781a0e0442", "tag": "18a87ef7-665a-4eed-ab86-8f47c80dbf71"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:00.783229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-6f58f2c6-8565-4920-a7e6-a8078a21ed0e req-40e21c51-212a-437d-9381-96faf346b9c3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:00.784112 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-6f58f2c6-8565-4920-a7e6-a8078a21ed0e req-40e21c51-212a-437d-9381-96faf346b9c3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:00.834744 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-6f58f2c6-8565-4920-a7e6-a8078a21ed0e req-40e21c51-212a-437d-9381-96faf346b9c3 service nova] Creating event network-changed:18a87ef7-665a-4eed-ab86-8f47c80dbf71 for instance e5cee0f0-7a6c-4388-8bbb-25781a0e0442 on n-h2-847009-3 Jul 19 22:31:00.846140 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-6f58f2c6-8565-4920-a7e6-a8078a21ed0e req-40e21c51-212a-437d-9381-96faf346b9c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120071 Jul 19 22:31:00.848626 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 621/1270] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:00.862733 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-665ee174-c703-46a2-aaa9-7379c94ac039 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:00.864608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-665ee174-c703-46a2-aaa9-7379c94ac039 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: e5cee0f0-7a6c-4388-8bbb-25781a0e0442] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:00.879946 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-665ee174-c703-46a2-aaa9-7379c94ac039 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:00.880883 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-665ee174-c703-46a2-aaa9-7379c94ac039 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:00.882450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-665ee174-c703-46a2-aaa9-7379c94ac039 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:00.883376 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-665ee174-c703-46a2-aaa9-7379c94ac039 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:01.380052 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c088b732-b9c9-4f12-a0a2-c09e8567d2f6 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:01.392725 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c088b732-b9c9-4f12-a0a2-c09e8567d2f6 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1718 microversion: 2.1 time: 0.714366 Jul 19 22:31:01.393507 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 650/1271] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:00 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1718 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:01.401292 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e5f4f443-59cd-467e-8b38-7a9e2397dfd4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:01.403877 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e5f4f443-59cd-467e-8b38-7a9e2397dfd4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: f94bf14c-804e-4058-9ed8-037dd0a8ef98] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:01.416371 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5f4f443-59cd-467e-8b38-7a9e2397dfd4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:01.417288 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5f4f443-59cd-467e-8b38-7a9e2397dfd4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:01.418642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5f4f443-59cd-467e-8b38-7a9e2397dfd4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:01.420111 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5f4f443-59cd-467e-8b38-7a9e2397dfd4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:01.423545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-665ee174-c703-46a2-aaa9-7379c94ac039 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:01.436086 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-665ee174-c703-46a2-aaa9-7379c94ac039 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442" status: 200 len: 1317 microversion: 2.1 time: 0.584574 Jul 19 22:31:01.436793 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 622/1272] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:00 2022] GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442 => generated 1317 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:01.445073 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-b886afb3-f601-462c-bc62-cb4d7e50d9a0 req-7b6cbae3-eb2d-414e-aef6-f12fd783507b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6ee0c6-66e1-4877-a7be-b7996a03d158", "name": "network-vif-plugged", "status": "completed", "tag": "5964d642-fd77-41ab-93fe-df25f0bebc9c"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:01.461478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b886afb3-f601-462c-bc62-cb4d7e50d9a0 req-7b6cbae3-eb2d-414e-aef6-f12fd783507b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:01.462353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b886afb3-f601-462c-bc62-cb4d7e50d9a0 req-7b6cbae3-eb2d-414e-aef6-f12fd783507b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:01.486216 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-b886afb3-f601-462c-bc62-cb4d7e50d9a0 req-7b6cbae3-eb2d-414e-aef6-f12fd783507b service nova] Creating event network-vif-plugged:5964d642-fd77-41ab-93fe-df25f0bebc9c for instance 1e6ee0c6-66e1-4877-a7be-b7996a03d158 on n-h2-847009-3 Jul 19 22:31:01.494167 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [req-b886afb3-f601-462c-bc62-cb4d7e50d9a0 req-7b6cbae3-eb2d-414e-aef6-f12fd783507b service nova] Instance 1e6ee0c6-66e1-4877-a7be-b7996a03d158 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119338) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 22:31:01.510716 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-b886afb3-f601-462c-bc62-cb4d7e50d9a0 req-7b6cbae3-eb2d-414e-aef6-f12fd783507b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072436 Jul 19 22:31:01.511779 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 623/1273] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:01.521215 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b8526eb7-3763-452d-86f8-3063dff92bc0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:01.522187 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b8526eb7-3763-452d-86f8-3063dff92bc0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:01.531222 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b8526eb7-3763-452d-86f8-3063dff92bc0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:01.531699 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b8526eb7-3763-452d-86f8-3063dff92bc0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:01.532900 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b8526eb7-3763-452d-86f8-3063dff92bc0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:01.533143 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b8526eb7-3763-452d-86f8-3063dff92bc0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:01.630542 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e5f4f443-59cd-467e-8b38-7a9e2397dfd4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:01.641008 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e5f4f443-59cd-467e-8b38-7a9e2397dfd4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98" status: 200 len: 1479 microversion: 2.1 time: 0.246221 Jul 19 22:31:01.641838 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 651/1274] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:01 2022] GET /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98 => generated 1479 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:01.647869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-44e1127f-06cf-4e9b-8648-e0f677006348 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:01.650917 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:31:01.650917 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:31:01.652588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-44e1127f-06cf-4e9b-8648-e0f677006348 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:01.653316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-44e1127f-06cf-4e9b-8648-e0f677006348 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:01.654327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-44e1127f-06cf-4e9b-8648-e0f677006348 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:01.654935 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-44e1127f-06cf-4e9b-8648-e0f677006348 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:01.689080 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-44e1127f-06cf-4e9b-8648-e0f677006348 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.043673 Jul 19 22:31:01.689080 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 652/1275] 10.222.0.25 () {60 vars in 1216 bytes} [Tue Jul 19 22:31:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:31:01.692638 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e41f7f77-7496-4fbc-85c2-5d1d6f0a2d84 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Calling method '.version_select at 0x7f7a106baee0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:01.782303 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b8526eb7-3763-452d-86f8-3063dff92bc0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:01.801146 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b8526eb7-3763-452d-86f8-3063dff92bc0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1472 microversion: 2.1 time: 0.286583 Jul 19 22:31:01.801970 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 624/1276] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:01 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1472 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:01.812026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d0eef521-0319-4d3a-9bba-7b86d77efe23 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:01.813321 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d0eef521-0319-4d3a-9bba-7b86d77efe23 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:01.824301 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d0eef521-0319-4d3a-9bba-7b86d77efe23 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:01.824863 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d0eef521-0319-4d3a-9bba-7b86d77efe23 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:01.825742 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d0eef521-0319-4d3a-9bba-7b86d77efe23 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:01.826421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d0eef521-0319-4d3a-9bba-7b86d77efe23 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:02.261804 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d0eef521-0319-4d3a-9bba-7b86d77efe23 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.457853 Jul 19 22:31:02.262416 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 625/1277] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 19 22:31:01 2022] GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-interface => generated 284 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:02.272495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a0de4b74-8842-4f9d-b7fe-14403343e569 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:02.272495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a0de4b74-8842-4f9d-b7fe-14403343e569 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:02.274155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0de4b74-8842-4f9d-b7fe-14403343e569 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:02.274611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0de4b74-8842-4f9d-b7fe-14403343e569 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:02.275862 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0de4b74-8842-4f9d-b7fe-14403343e569 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:02.276247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0de4b74-8842-4f9d-b7fe-14403343e569 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:02.704103 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a0de4b74-8842-4f9d-b7fe-14403343e569 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:02.716766 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a0de4b74-8842-4f9d-b7fe-14403343e569 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1470 microversion: 2.1 time: 0.452985 Jul 19 22:31:02.718591 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 626/1278] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:02 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1470 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:02.727545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7a0c01a6-97f0-4d07-81f3-7c49519838cf tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1248509656"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:02.730025 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7a0c01a6-97f0-4d07-81f3-7c49519838cf tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: f94bf14c-804e-4058-9ed8-037dd0a8ef98] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:02.738093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a0c01a6-97f0-4d07-81f3-7c49519838cf tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:02.738876 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a0c01a6-97f0-4d07-81f3-7c49519838cf tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:02.742034 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a0c01a6-97f0-4d07-81f3-7c49519838cf tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:02.742793 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a0c01a6-97f0-4d07-81f3-7c49519838cf tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:03.203569 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:31:03.316535 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e41f7f77-7496-4fbc-85c2-5d1d6f0a2d84 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/696d4fdc-e931-45a1-ad7c-107f42976eb5" status: 202 len: 0 microversion: 2.1 time: 1.627002 Jul 19 22:31:03.318352 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 653/1279] 10.222.0.25 () {58 vars in 1262 bytes} [Tue Jul 19 22:31:01 2022] DELETE /compute/v2.1/os-floating-ips/696d4fdc-e931-45a1-ad7c-107f42976eb5 => generated 0 bytes in 1630 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:31:03.325057 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e48c4a1c-5aff-4d91-93aa-8a662f12dfcc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:03.325992 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e48c4a1c-5aff-4d91-93aa-8a662f12dfcc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:03.341893 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7a0c01a6-97f0-4d07-81f3-7c49519838cf tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "POST /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98/action" status: 202 len: 0 microversion: 2.1 time: 0.621415 Jul 19 22:31:03.343161 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 627/1280] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:31:02 2022] POST /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98/action => generated 0 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 22:31:03.343327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e48c4a1c-5aff-4d91-93aa-8a662f12dfcc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:03.343766 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e48c4a1c-5aff-4d91-93aa-8a662f12dfcc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:03.344567 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e48c4a1c-5aff-4d91-93aa-8a662f12dfcc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:03.345008 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e48c4a1c-5aff-4d91-93aa-8a662f12dfcc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:03.356414 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1a035c20-81ba-44e5-9bee-6e655d4b6ed5 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:03.357122 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1a035c20-81ba-44e5-9bee-6e655d4b6ed5 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: e5cee0f0-7a6c-4388-8bbb-25781a0e0442] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:03.365403 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a035c20-81ba-44e5-9bee-6e655d4b6ed5 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:03.365720 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a035c20-81ba-44e5-9bee-6e655d4b6ed5 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:03.366698 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a035c20-81ba-44e5-9bee-6e655d4b6ed5 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:03.367325 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a035c20-81ba-44e5-9bee-6e655d4b6ed5 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:03.733846 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e48c4a1c-5aff-4d91-93aa-8a662f12dfcc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:03.751895 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1a035c20-81ba-44e5-9bee-6e655d4b6ed5 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:03.752895 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e48c4a1c-5aff-4d91-93aa-8a662f12dfcc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1718 microversion: 2.1 time: 0.432595 Jul 19 22:31:03.764182 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1a035c20-81ba-44e5-9bee-6e655d4b6ed5 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442" status: 200 len: 1317 microversion: 2.1 time: 0.415792 Jul 19 22:31:03.768243 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 654/1281] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:03 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1718 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:03.780722 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 628/1282] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:03 2022] GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442 => generated 1317 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:03.783531 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3391e1fe-5010-41ad-a66d-d64691b2fa3a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:03.784894 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3391e1fe-5010-41ad-a66d-d64691b2fa3a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:03.789337 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3341d449-6cb0-49a0-b433-4ed1c24c3c83 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:03.789606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:31:03.798268 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3341d449-6cb0-49a0-b433-4ed1c24c3c83 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Request method failure captured: Jul 19 22:31:03.798268 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372/action HTTP/1.1 Jul 19 22:31:03.798268 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:31:03.798268 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:31:03.798268 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:31:03.798268 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 34 Jul 19 22:31:03.798268 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:31:03.798268 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:31:03.798268 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:31:03.798268 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:31:03.798268 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zBffm25x4xYa7JzDlLJIESGAgCPSFEkA7y6FYg9TrCpiBjNJSxaG9X7U3eQhgYDbIxW8dG5nidohqPDfN5gpCMhbkfW3vs54sTnSucmW5D1dYQ6EHnI3O-x5CeIwYZ4NysXswwCEpPHivIKgqLq-uT1pxQcq_p4cNiAxOMP2qoDlY4 Jul 19 22:31:03.798268 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:31:03.798268 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:31:03.798268 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:31:03.798268 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:31:03.798268 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:31:03.798268 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:31:03.798268 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 94e68faed5a742fcbd3818f9c0f6569a Jul 19 22:31:03.798268 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-231453760 Jul 19 22:31:03.798268 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:31:03.798268 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:31:03.801253 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94e68faed5a742fcbd3818f9c0f6569a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94e68faed5a742fcbd3818f9c0f6569a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94e68faed5a742fcbd3818f9c0f6569a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94e68faed5a742fcbd3818f9c0f6569a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:31:03.801253 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-231453760 Jul 19 22:31:03.801253 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 94e68faed5a742fcbd3818f9c0f6569a Jul 19 22:31:03.801253 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-231453760 Jul 19 22:31:03.801253 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project Jul 19 22:31:03.801253 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:31:03.801253 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:31:03.801253 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 0f20e57a90994fbb989c749dc3ea2ec6 Jul 19 22:31:03.801253 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project Jul 19 22:31:03.801253 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:31:03.801253 n-d-847009-3 devstack@n-api.service[119338]: {"addFloatingIp": {"address": ""}} Jul 19 22:31:03.801253 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:31:03.801253 n-d-847009-3 devstack@n-api.service[119338]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 19 22:31:03.802901 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'a134613f-f510-43e4-943e-d869b38c4372', 'body': {'addFloatingIp': {'address': ''}}} Jul 19 22:31:03.802901 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:31:03.802901 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:03.802901 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:31:03.802901 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:31:03.802901 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:31:03.802901 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:31:03.802901 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 19 22:31:03.802901 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:03.802901 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 19 22:31:03.802901 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 19 22:31:03.802901 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:03.802901 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 19 22:31:03.802901 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi '' Jul 19 22:31:03.802901 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:03.802901 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:03.802901 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:03.802901 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:03.802901 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:03.802901 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:03.802901 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:31:03.802901 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:31:03.819179 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:31:03.819179 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:31:03.819179 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:31:03.819179 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:31:03.819179 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:31:03.819179 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:31:03.819179 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:31:03.819179 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:31:03.819179 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:31:03.819179 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:31:03.819179 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 19 22:31:03.819179 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:03.819179 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:03.819179 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:03.819179 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:03.819179 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:03.819179 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:03.819179 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:31:03.819179 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:31:03.825271 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 19 22:31:03.825271 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:03.825808 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3391e1fe-5010-41ad-a66d-d64691b2fa3a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:03.825808 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3391e1fe-5010-41ad-a66d-d64691b2fa3a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:03.825808 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3391e1fe-5010-41ad-a66d-d64691b2fa3a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:03.825808 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3391e1fe-5010-41ad-a66d-d64691b2fa3a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:03.826841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3341d449-6cb0-49a0-b433-4ed1c24c3c83 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:31:03.826841 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3341d449-6cb0-49a0-b433-4ed1c24c3c83 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "POST /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372/action" status: 400 len: 142 microversion: 2.1 time: 0.034333 Jul 19 22:31:03.826841 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 629/1283] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:31:03 2022] POST /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372/action => generated 142 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:31:03.843198 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b9f886b5-23cc-424d-b344-8e990fd766d3 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a104153a0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:03.924877 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b9f886b5-23cc-424d-b344-8e990fd766d3 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17" status: 200 len: 1440 microversion: 2.1 time: 0.093547 Jul 19 22:31:03.926761 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 630/1284] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:31:03 2022] GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17 => generated 1440 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:03.936687 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6ead7cf6-7e32-4238-9928-8a53fa07ede6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:03.937691 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6ead7cf6-7e32-4238-9928-8a53fa07ede6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:03.946023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ead7cf6-7e32-4238-9928-8a53fa07ede6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:03.946308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ead7cf6-7e32-4238-9928-8a53fa07ede6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:03.947097 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ead7cf6-7e32-4238-9928-8a53fa07ede6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:03.947582 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ead7cf6-7e32-4238-9928-8a53fa07ede6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:04.247292 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3391e1fe-5010-41ad-a66d-d64691b2fa3a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:04.269950 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3391e1fe-5010-41ad-a66d-d64691b2fa3a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1472 microversion: 2.1 time: 0.498309 Jul 19 22:31:04.271734 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 655/1285] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:03 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1472 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:04.281981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ff677ab2-fbfc-48d0-80f9-3435b15b5852 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:04.284067 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ff677ab2-fbfc-48d0-80f9-3435b15b5852 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:04.292130 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ff677ab2-fbfc-48d0-80f9-3435b15b5852 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:04.292967 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ff677ab2-fbfc-48d0-80f9-3435b15b5852 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:04.294427 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ff677ab2-fbfc-48d0-80f9-3435b15b5852 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:04.295283 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ff677ab2-fbfc-48d0-80f9-3435b15b5852 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:04.347589 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ff677ab2-fbfc-48d0-80f9-3435b15b5852 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Acquired lock "refresh_cache-a134613f-f510-43e4-943e-d869b38c4372" {{(pid=119337) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 22:31:04.425253 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6ead7cf6-7e32-4238-9928-8a53fa07ede6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:04.437362 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6ead7cf6-7e32-4238-9928-8a53fa07ede6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1470 microversion: 2.1 time: 0.508709 Jul 19 22:31:04.438069 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 631/1286] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:03 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1470 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:04.459849 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e9083688-5cad-44b0-ab5e-f762065640e5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8fd55885-642b-4104-96ae-2d4bf4a5f500", "device": "/dev/xvdb"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:04.461805 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e9083688-5cad-44b0-ab5e-f762065640e5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:04.469896 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9083688-5cad-44b0-ab5e-f762065640e5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:04.470346 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9083688-5cad-44b0-ab5e-f762065640e5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:04.471149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9083688-5cad-44b0-ab5e-f762065640e5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:04.471606 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9083688-5cad-44b0-ab5e-f762065640e5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:04.673930 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ff677ab2-fbfc-48d0-80f9-3435b15b5852 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Releasing lock "refresh_cache-a134613f-f510-43e4-943e-d869b38c4372" {{(pid=119337) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 22:31:04.675530 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-ff677ab2-fbfc-48d0-80f9-3435b15b5852 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] HTTP exception thrown: floating IP not found Jul 19 22:31:04.682385 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ff677ab2-fbfc-48d0-80f9-3435b15b5852 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Request method failure captured: Jul 19 22:31:04.682385 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372/action HTTP/1.1 Jul 19 22:31:04.682385 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:31:04.682385 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:31:04.682385 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:31:04.682385 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 41 Jul 19 22:31:04.682385 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:31:04.682385 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:31:04.682385 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:31:04.682385 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:31:04.682385 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zBffm25x4xYa7JzDlLJIESGAgCPSFEkA7y6FYg9TrCpiBjNJSxaG9X7U3eQhgYDbIxW8dG5nidohqPDfN5gpCMhbkfW3vs54sTnSucmW5D1dYQ6EHnI3O-x5CeIwYZ4NysXswwCEpPHivIKgqLq-uT1pxQcq_p4cNiAxOMP2qoDlY4 Jul 19 22:31:04.682385 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:31:04.682385 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:31:04.682385 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:31:04.682385 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:31:04.682385 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:31:04.682385 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:31:04.682385 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 94e68faed5a742fcbd3818f9c0f6569a Jul 19 22:31:04.682385 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-231453760 Jul 19 22:31:04.682385 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:31:04.682385 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:31:04.685100 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94e68faed5a742fcbd3818f9c0f6569a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94e68faed5a742fcbd3818f9c0f6569a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94e68faed5a742fcbd3818f9c0f6569a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94e68faed5a742fcbd3818f9c0f6569a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:31:04.685100 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-231453760 Jul 19 22:31:04.685100 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 94e68faed5a742fcbd3818f9c0f6569a Jul 19 22:31:04.685100 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-231453760 Jul 19 22:31:04.685100 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project Jul 19 22:31:04.685100 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:31:04.685100 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:31:04.685100 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 0f20e57a90994fbb989c749dc3ea2ec6 Jul 19 22:31:04.685100 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project Jul 19 22:31:04.685100 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:31:04.685100 n-d-847009-3 devstack@n-api.service[119337]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 19 22:31:04.685100 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:31:04.685100 n-d-847009-3 devstack@n-api.service[119337]: exception: floating IP not found Jul 19 22:31:04.685100 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'a134613f-f510-43e4-943e-d869b38c4372', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 19 22:31:04.686672 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:31:04.686672 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:04.686672 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 19 22:31:04.686672 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 19 22:31:04.686672 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 19 22:31:04.686672 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 19 22:31:04.686672 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 19 22:31:04.686672 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 19 22:31:04.686672 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 19 22:31:04.686672 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 19 22:31:04.686672 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 19 22:31:04.686672 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:04.686672 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:04.686672 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:04.686672 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:04.686672 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:04.686672 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:04.686672 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:31:04.686672 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:31:04.690089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:31:04.690089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:31:04.690089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:31:04.690089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:31:04.690089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:31:04.690089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:31:04.690089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 19 22:31:04.690089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 22:31:04.690089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 19 22:31:04.690089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:04.690089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:04.690089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:04.690089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:04.690089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:04.690089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:04.690089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:31:04.690089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:31:04.690089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 19 22:31:04.690089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:04.694107 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ff677ab2-fbfc-48d0-80f9-3435b15b5852 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Returning 404 to user: floating IP not found {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:31:04.694107 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ff677ab2-fbfc-48d0-80f9-3435b15b5852 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "POST /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372/action" status: 404 len: 67 microversion: 2.1 time: 0.413344 Jul 19 22:31:04.697735 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 656/1287] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:31:04 2022] POST /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372/action => generated 67 bytes in 423 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:31:04.701804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e8d0ff32-8b33-4e98-9d55-ff3fe6e5bc65 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:04.880408 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-e8d0ff32-8b33-4e98-9d55-ff3fe6e5bc65 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 19 22:31:04.882196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e8d0ff32-8b33-4e98-9d55-ff3fe6e5bc65 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Request method failure captured: Jul 19 22:31:04.882196 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372/action HTTP/1.1 Jul 19 22:31:04.882196 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:31:04.882196 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:31:04.882196 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:31:04.882196 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 44 Jul 19 22:31:04.882196 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:31:04.882196 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:31:04.882196 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:31:04.882196 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:31:04.882196 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zBffm25x4xYa7JzDlLJIESGAgCPSFEkA7y6FYg9TrCpiBjNJSxaG9X7U3eQhgYDbIxW8dG5nidohqPDfN5gpCMhbkfW3vs54sTnSucmW5D1dYQ6EHnI3O-x5CeIwYZ4NysXswwCEpPHivIKgqLq-uT1pxQcq_p4cNiAxOMP2qoDlY4 Jul 19 22:31:04.882196 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:31:04.882196 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:31:04.882196 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:31:04.882196 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:31:04.882196 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:31:04.882196 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:31:04.882196 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 94e68faed5a742fcbd3818f9c0f6569a Jul 19 22:31:04.882196 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-231453760 Jul 19 22:31:04.882196 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:31:04.882196 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:31:04.883561 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94e68faed5a742fcbd3818f9c0f6569a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94e68faed5a742fcbd3818f9c0f6569a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94e68faed5a742fcbd3818f9c0f6569a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94e68faed5a742fcbd3818f9c0f6569a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:31:04.883561 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-231453760 Jul 19 22:31:04.883561 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 94e68faed5a742fcbd3818f9c0f6569a Jul 19 22:31:04.883561 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-231453760 Jul 19 22:31:04.883561 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project Jul 19 22:31:04.883561 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:31:04.883561 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:31:04.883561 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 0f20e57a90994fbb989c749dc3ea2ec6 Jul 19 22:31:04.883561 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project Jul 19 22:31:04.883561 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:31:04.883561 n-d-847009-3 devstack@n-api.service[119337]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 19 22:31:04.883561 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:31:04.883561 n-d-847009-3 devstack@n-api.service[119337]: exception: Floating IP not found for address 0.0.0.0. Jul 19 22:31:04.885085 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'a134613f-f510-43e4-943e-d869b38c4372', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 19 22:31:04.885085 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:31:04.885085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:04.885085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 19 22:31:04.885085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 19 22:31:04.885085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 19 22:31:04.885085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 19 22:31:04.885085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 19 22:31:04.885085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 19 22:31:04.885085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 19 22:31:04.885085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:04.885085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:04.885085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:04.885085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:04.885085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:04.885085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:04.885085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:31:04.885085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:31:04.885085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:31:04.886385 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:31:04.886385 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:31:04.886385 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:31:04.886385 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:31:04.886385 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:31:04.886385 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 19 22:31:04.886385 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 19 22:31:04.886385 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 19 22:31:04.886385 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 19 22:31:04.886385 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 19 22:31:04.886385 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:04.886385 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:04.886385 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:04.886385 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:04.886385 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:04.886385 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:04.886385 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:31:04.886385 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:31:04.886385 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 19 22:31:04.886385 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:04.889424 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e8d0ff32-8b33-4e98-9d55-ff3fe6e5bc65 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:31:04.890517 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e8d0ff32-8b33-4e98-9d55-ff3fe6e5bc65 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "POST /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372/action" status: 404 len: 88 microversion: 2.1 time: 0.193698 Jul 19 22:31:04.891349 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 657/1288] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:31:04 2022] POST /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372/action => generated 88 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:31:04.900893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6cc2b5ff-cefa-4206-beec-1fec10c2763d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:04.901578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6cc2b5ff-cefa-4206-beec-1fec10c2763d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:04.925850 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6cc2b5ff-cefa-4206-beec-1fec10c2763d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:04.926732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6cc2b5ff-cefa-4206-beec-1fec10c2763d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:04.928209 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6cc2b5ff-cefa-4206-beec-1fec10c2763d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:04.929037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6cc2b5ff-cefa-4206-beec-1fec10c2763d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:05.013157 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e9083688-5cad-44b0-ab5e-f762065640e5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "POST /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.573458 Jul 19 22:31:05.014423 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 632/1289] 10.222.0.25 () {62 vars in 1363 bytes} [Tue Jul 19 22:31:04 2022] POST /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67/os-volume_attachments => generated 194 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:31:05.021323 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cc0e3d47-650b-48ab-9395-23de1652fa28 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:05.022343 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cc0e3d47-650b-48ab-9395-23de1652fa28 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: e5cee0f0-7a6c-4388-8bbb-25781a0e0442] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:05.032077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc0e3d47-650b-48ab-9395-23de1652fa28 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:05.033049 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc0e3d47-650b-48ab-9395-23de1652fa28 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:05.034316 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc0e3d47-650b-48ab-9395-23de1652fa28 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:05.035140 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc0e3d47-650b-48ab-9395-23de1652fa28 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:05.530655 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6cc2b5ff-cefa-4206-beec-1fec10c2763d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:05.557741 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6cc2b5ff-cefa-4206-beec-1fec10c2763d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1718 microversion: 2.1 time: 0.662127 Jul 19 22:31:05.559755 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 658/1290] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:04 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1718 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:05.569649 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-7253a49f-3f2f-4611-9e78-9ef080485296 req-277303f6-8989-467b-be02-be61d51a89ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317af5ae-9759-4095-b561-ed61e9847c7e", "tag": "f3ab19a8-a957-4cec-a5b1-da04b760b755"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:05.597380 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-7253a49f-3f2f-4611-9e78-9ef080485296 req-277303f6-8989-467b-be02-be61d51a89ab service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:05.606453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cc0e3d47-650b-48ab-9395-23de1652fa28 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:05.610499 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-7253a49f-3f2f-4611-9e78-9ef080485296 req-277303f6-8989-467b-be02-be61d51a89ab service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:05.658305 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cc0e3d47-650b-48ab-9395-23de1652fa28 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442" status: 200 len: 1317 microversion: 2.1 time: 0.638419 Jul 19 22:31:05.678729 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 633/1291] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:05 2022] GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442 => generated 1317 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:05.703359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6816efb7-a725-4407-9c5e-cde03c4a8c63 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:05.709636 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6816efb7-a725-4407-9c5e-cde03c4a8c63 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:05.715949 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-7253a49f-3f2f-4611-9e78-9ef080485296 req-277303f6-8989-467b-be02-be61d51a89ab service nova] Creating event network-changed:f3ab19a8-a957-4cec-a5b1-da04b760b755 for instance 317af5ae-9759-4095-b561-ed61e9847c7e on n-h2-847009-3 Jul 19 22:31:05.734301 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-7253a49f-3f2f-4611-9e78-9ef080485296 req-277303f6-8989-467b-be02-be61d51a89ab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171684 Jul 19 22:31:05.741881 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 659/1292] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:05.745412 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6816efb7-a725-4407-9c5e-cde03c4a8c63 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:05.746763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6816efb7-a725-4407-9c5e-cde03c4a8c63 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:05.756132 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6816efb7-a725-4407-9c5e-cde03c4a8c63 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:05.758147 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6816efb7-a725-4407-9c5e-cde03c4a8c63 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:05.779480 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9a29bd36-48ec-4a09-83ca-f2715f88ba28 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a104b9430>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:05.859555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6816efb7-a725-4407-9c5e-cde03c4a8c63 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:31:05.915795 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9a29bd36-48ec-4a09-83ca-f2715f88ba28 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17" status: 200 len: 1440 microversion: 2.1 time: 0.170655 Jul 19 22:31:05.928472 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 660/1293] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:31:05 2022] GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17 => generated 1440 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:05.943941 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f536fd4b-84f7-4de7-b3b6-856af8a35a2e tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:05.951655 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f536fd4b-84f7-4de7-b3b6-856af8a35a2e tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:05.972956 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:31:05.982317 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f536fd4b-84f7-4de7-b3b6-856af8a35a2e tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:05.986093 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f536fd4b-84f7-4de7-b3b6-856af8a35a2e tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:05.987442 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f536fd4b-84f7-4de7-b3b6-856af8a35a2e tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:05.988472 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f536fd4b-84f7-4de7-b3b6-856af8a35a2e tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:06.111265 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6816efb7-a725-4407-9c5e-cde03c4a8c63 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372" status: 204 len: 0 microversion: 2.1 time: 0.430192 Jul 19 22:31:06.114458 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 634/1294] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:31:05 2022] DELETE /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:31:06.131626 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-063c9401-4751-4d5e-8614-26aa0764a8b2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:06.132709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-063c9401-4751-4d5e-8614-26aa0764a8b2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:06.149019 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-063c9401-4751-4d5e-8614-26aa0764a8b2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:06.149857 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-063c9401-4751-4d5e-8614-26aa0764a8b2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:06.151700 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-063c9401-4751-4d5e-8614-26aa0764a8b2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:06.152313 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-063c9401-4751-4d5e-8614-26aa0764a8b2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:06.496502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f536fd4b-84f7-4de7-b3b6-856af8a35a2e tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:06.512876 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f536fd4b-84f7-4de7-b3b6-856af8a35a2e tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1472 microversion: 2.1 time: 0.582840 Jul 19 22:31:06.514090 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 661/1295] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:05 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1472 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:06.515457 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-063c9401-4751-4d5e-8614-26aa0764a8b2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:06.522603 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3b69c387-e7a2-43f7-847f-fbcf51d3146e tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:06.523374 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3b69c387-e7a2-43f7-847f-fbcf51d3146e tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:06.529340 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-063c9401-4751-4d5e-8614-26aa0764a8b2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1470 microversion: 2.1 time: 0.413045 Jul 19 22:31:06.539340 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b69c387-e7a2-43f7-847f-fbcf51d3146e tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:06.539340 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b69c387-e7a2-43f7-847f-fbcf51d3146e tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:06.539340 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b69c387-e7a2-43f7-847f-fbcf51d3146e tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:06.539935 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b69c387-e7a2-43f7-847f-fbcf51d3146e tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:06.541672 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 635/1296] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:06 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1470 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:06.751343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3b69c387-e7a2-43f7-847f-fbcf51d3146e tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f20e57a90994fbb989c749dc3ea2ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e68faed5a742fcbd3818f9c0f6569a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:06.765509 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3b69c387-e7a2-43f7-847f-fbcf51d3146e tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372" status: 200 len: 1542 microversion: 2.1 time: 0.248203 Jul 19 22:31:06.766198 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 662/1297] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:06 2022] GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372 => generated 1542 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:06.795585 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9d08e4f8-cd6d-41aa-b2da-214d88e411ee tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:06.796551 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9d08e4f8-cd6d-41aa-b2da-214d88e411ee tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: e5cee0f0-7a6c-4388-8bbb-25781a0e0442] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:06.809599 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d08e4f8-cd6d-41aa-b2da-214d88e411ee tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:06.811509 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d08e4f8-cd6d-41aa-b2da-214d88e411ee tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:06.812456 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d08e4f8-cd6d-41aa-b2da-214d88e411ee tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:06.814327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d08e4f8-cd6d-41aa-b2da-214d88e411ee tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:06.859174 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-14c4b19a-e734-4dd5-8a31-bec7386c7f90 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:06.860747 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-14c4b19a-e734-4dd5-8a31-bec7386c7f90 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:06.874478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-14c4b19a-e734-4dd5-8a31-bec7386c7f90 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:06.874957 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-14c4b19a-e734-4dd5-8a31-bec7386c7f90 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:06.875799 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-14c4b19a-e734-4dd5-8a31-bec7386c7f90 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:06.876245 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-14c4b19a-e734-4dd5-8a31-bec7386c7f90 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:07.173611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9d08e4f8-cd6d-41aa-b2da-214d88e411ee tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:07.196159 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9d08e4f8-cd6d-41aa-b2da-214d88e411ee tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442" status: 200 len: 1317 microversion: 2.1 time: 0.418182 Jul 19 22:31:07.201887 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 663/1298] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:06 2022] GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442 => generated 1317 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:07.219734 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-15be95bb-53ca-4604-b2de-e59c14750d53 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a107b94c0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:07.324399 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-14c4b19a-e734-4dd5-8a31-bec7386c7f90 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:07.344547 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-15be95bb-53ca-4604-b2de-e59c14750d53 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17" status: 200 len: 1440 microversion: 2.1 time: 0.140767 Jul 19 22:31:07.345818 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 664/1299] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:31:07 2022] GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17 => generated 1440 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:07.364898 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-14c4b19a-e734-4dd5-8a31-bec7386c7f90 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1718 microversion: 2.1 time: 0.781004 Jul 19 22:31:07.369756 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 636/1300] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:06 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1718 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:07.552587 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7b148fc7-4ae3-4f57-90a5-9c2b11a441f3 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:07.553615 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7b148fc7-4ae3-4f57-90a5-9c2b11a441f3 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:07.557309 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-56e9f6f7-5019-4821-9d8f-862ee9da19e2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:07.558447 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-56e9f6f7-5019-4821-9d8f-862ee9da19e2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:07.601108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56e9f6f7-5019-4821-9d8f-862ee9da19e2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:07.602067 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7b148fc7-4ae3-4f57-90a5-9c2b11a441f3 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:07.606455 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56e9f6f7-5019-4821-9d8f-862ee9da19e2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:07.607151 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7b148fc7-4ae3-4f57-90a5-9c2b11a441f3 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:07.609189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7b148fc7-4ae3-4f57-90a5-9c2b11a441f3 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:07.611721 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56e9f6f7-5019-4821-9d8f-862ee9da19e2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:07.616837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56e9f6f7-5019-4821-9d8f-862ee9da19e2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:07.617517 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7b148fc7-4ae3-4f57-90a5-9c2b11a441f3 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:07.732272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:31:08.122759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-56e9f6f7-5019-4821-9d8f-862ee9da19e2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:08.131917 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-56e9f6f7-5019-4821-9d8f-862ee9da19e2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1470 microversion: 2.1 time: 0.588424 Jul 19 22:31:08.135896 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 637/1301] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:07 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1470 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:08.142027 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-14c729d2-5bb9-45a2-ada1-7c179d71b92b tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:08.158318 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-14c729d2-5bb9-45a2-ada1-7c179d71b92b tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:08.172556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-14c729d2-5bb9-45a2-ada1-7c179d71b92b tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:08.173317 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-14c729d2-5bb9-45a2-ada1-7c179d71b92b tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:08.174665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-14c729d2-5bb9-45a2-ada1-7c179d71b92b tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:08.175496 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-14c729d2-5bb9-45a2-ada1-7c179d71b92b tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:08.212926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7b148fc7-4ae3-4f57-90a5-9c2b11a441f3 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:08.232349 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7b148fc7-4ae3-4f57-90a5-9c2b11a441f3 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1472 microversion: 2.1 time: 0.697542 Jul 19 22:31:08.233939 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 665/1302] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:07 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1472 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:08.263644 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-9f1f8fd0-7e2a-4e96-b497-fe1e974b17c2 req-f2202e40-eb70-417b-b7ee-e4fc56687db1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f94bf14c-804e-4058-9ed8-037dd0a8ef98", "name": "network-vif-plugged", "status": "completed", "tag": "0ebe3908-8f61-4950-8278-87404fd21fa1"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:08.295090 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-9f1f8fd0-7e2a-4e96-b497-fe1e974b17c2 req-f2202e40-eb70-417b-b7ee-e4fc56687db1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:08.295606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-9f1f8fd0-7e2a-4e96-b497-fe1e974b17c2 req-f2202e40-eb70-417b-b7ee-e4fc56687db1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:08.309587 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-9f1f8fd0-7e2a-4e96-b497-fe1e974b17c2 req-f2202e40-eb70-417b-b7ee-e4fc56687db1 service nova] Creating event network-vif-plugged:0ebe3908-8f61-4950-8278-87404fd21fa1 for instance f94bf14c-804e-4058-9ed8-037dd0a8ef98 on n-h1-847009-3 Jul 19 22:31:08.315275 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-9f1f8fd0-7e2a-4e96-b497-fe1e974b17c2 req-f2202e40-eb70-417b-b7ee-e4fc56687db1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079419 Jul 19 22:31:08.319055 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 666/1303] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:08.326516 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2c9e8ac7-2fa5-4cf2-907c-fe584d0f4f2c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:08.327289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2c9e8ac7-2fa5-4cf2-907c-fe584d0f4f2c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: e5cee0f0-7a6c-4388-8bbb-25781a0e0442] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:08.339006 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2c9e8ac7-2fa5-4cf2-907c-fe584d0f4f2c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:08.339577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2c9e8ac7-2fa5-4cf2-907c-fe584d0f4f2c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:08.340452 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2c9e8ac7-2fa5-4cf2-907c-fe584d0f4f2c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:08.340911 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2c9e8ac7-2fa5-4cf2-907c-fe584d0f4f2c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:08.635925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-14c729d2-5bb9-45a2-ada1-7c179d71b92b tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f20e57a90994fbb989c749dc3ea2ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e68faed5a742fcbd3818f9c0f6569a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:08.666815 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-14c729d2-5bb9-45a2-ada1-7c179d71b92b tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372" status: 200 len: 1542 microversion: 2.1 time: 0.525158 Jul 19 22:31:08.683906 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 638/1304] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:08 2022] GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372 => generated 1542 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:08.695847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-27b3665d-1aea-45d5-9c21-93d6fd725ad6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a103b33a0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:08.731634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2c9e8ac7-2fa5-4cf2-907c-fe584d0f4f2c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:08.748897 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2c9e8ac7-2fa5-4cf2-907c-fe584d0f4f2c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442" status: 200 len: 1317 microversion: 2.1 time: 0.428097 Jul 19 22:31:08.751198 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 667/1305] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:08 2022] GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442 => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:08.771513 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eba1194e-86a1-414e-9a40-451417f8f7e2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:08.773004 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eba1194e-86a1-414e-9a40-451417f8f7e2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:08.784804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eba1194e-86a1-414e-9a40-451417f8f7e2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:08.796318 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eba1194e-86a1-414e-9a40-451417f8f7e2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:08.801555 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eba1194e-86a1-414e-9a40-451417f8f7e2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:08.802443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eba1194e-86a1-414e-9a40-451417f8f7e2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:08.808813 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-27b3665d-1aea-45d5-9c21-93d6fd725ad6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17" status: 200 len: 1440 microversion: 2.1 time: 0.117675 Jul 19 22:31:08.810713 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 639/1306] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:31:08 2022] GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17 => generated 1440 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:09.156083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-eba1194e-86a1-414e-9a40-451417f8f7e2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:09.168030 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-477191d6-7d7a-47c8-8000-5264dfb2d438 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:09.174168 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-477191d6-7d7a-47c8-8000-5264dfb2d438 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:09.181375 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eba1194e-86a1-414e-9a40-451417f8f7e2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1718 microversion: 2.1 time: 0.426727 Jul 19 22:31:09.184455 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 668/1307] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:08 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1718 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:09.200114 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-477191d6-7d7a-47c8-8000-5264dfb2d438 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:09.204247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-477191d6-7d7a-47c8-8000-5264dfb2d438 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:09.205302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-477191d6-7d7a-47c8-8000-5264dfb2d438 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:09.205934 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-477191d6-7d7a-47c8-8000-5264dfb2d438 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:09.258899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-17da9659-127c-4fd0-a2ba-14f38d249245 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:09.259827 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-17da9659-127c-4fd0-a2ba-14f38d249245 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:09.273602 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-17da9659-127c-4fd0-a2ba-14f38d249245 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:09.273884 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-17da9659-127c-4fd0-a2ba-14f38d249245 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:09.275077 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-17da9659-127c-4fd0-a2ba-14f38d249245 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:09.275924 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-17da9659-127c-4fd0-a2ba-14f38d249245 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:09.864806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-477191d6-7d7a-47c8-8000-5264dfb2d438 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:09.891973 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-477191d6-7d7a-47c8-8000-5264dfb2d438 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1470 microversion: 2.1 time: 0.731771 Jul 19 22:31:09.906166 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 640/1308] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:09 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1470 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:31:09.913694 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e600c89a-2956-454b-a6fa-e4693ba34d6e tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:09.915274 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e600c89a-2956-454b-a6fa-e4693ba34d6e tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:09.939904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e600c89a-2956-454b-a6fa-e4693ba34d6e tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:09.941094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e600c89a-2956-454b-a6fa-e4693ba34d6e tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:09.942820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e600c89a-2956-454b-a6fa-e4693ba34d6e tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:09.943952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e600c89a-2956-454b-a6fa-e4693ba34d6e tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:10.114093 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-17da9659-127c-4fd0-a2ba-14f38d249245 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:10.130365 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-17da9659-127c-4fd0-a2ba-14f38d249245 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1472 microversion: 2.1 time: 0.875676 Jul 19 22:31:10.153185 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 669/1309] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:09 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1472 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:10.162319 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1ff1d71c-2286-4437-b48b-b61aefe9a534 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:10.163918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1ff1d71c-2286-4437-b48b-b61aefe9a534 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: e5cee0f0-7a6c-4388-8bbb-25781a0e0442] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:10.176599 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1ff1d71c-2286-4437-b48b-b61aefe9a534 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:10.178360 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1ff1d71c-2286-4437-b48b-b61aefe9a534 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:10.181031 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1ff1d71c-2286-4437-b48b-b61aefe9a534 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:10.183068 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1ff1d71c-2286-4437-b48b-b61aefe9a534 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:10.443750 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e600c89a-2956-454b-a6fa-e4693ba34d6e tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f20e57a90994fbb989c749dc3ea2ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e68faed5a742fcbd3818f9c0f6569a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:10.465537 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e600c89a-2956-454b-a6fa-e4693ba34d6e tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372" status: 200 len: 1542 microversion: 2.1 time: 0.567909 Jul 19 22:31:10.482615 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 641/1310] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:09 2022] GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372 => generated 1542 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:10.489191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ccdbb54e-7da4-48dc-b9a3-40ae9a199e98 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a03fe55e0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:10.569443 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ccdbb54e-7da4-48dc-b9a3-40ae9a199e98 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17" status: 200 len: 1440 microversion: 2.1 time: 0.085247 Jul 19 22:31:10.588595 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 642/1311] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:31:10 2022] GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17 => generated 1440 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:10.601327 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2dafee07-4db4-41f6-b0e6-f07996465b0d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:10.614267 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2dafee07-4db4-41f6-b0e6-f07996465b0d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:10.629414 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2dafee07-4db4-41f6-b0e6-f07996465b0d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:10.635828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2dafee07-4db4-41f6-b0e6-f07996465b0d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:10.637716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2dafee07-4db4-41f6-b0e6-f07996465b0d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:10.641414 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2dafee07-4db4-41f6-b0e6-f07996465b0d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:11.218553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1ff1d71c-2286-4437-b48b-b61aefe9a534 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:11.235363 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1ff1d71c-2286-4437-b48b-b61aefe9a534 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442" status: 200 len: 1317 microversion: 2.1 time: 1.079950 Jul 19 22:31:11.239799 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 670/1312] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:10 2022] GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442 => generated 1317 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:11.246577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-5d2675a0-2850-4ff4-bd97-d46a465bfdaa req-a239afea-caea-4c15-ad28-73c7f5281db2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab0a3d6-8249-4058-9ce5-90d458fff59d", "name": "network-vif-unplugged", "status": "completed", "tag": "7078c457-b7f7-49a3-bb53-e2a5e49cc511"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:11.299854 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-5d2675a0-2850-4ff4-bd97-d46a465bfdaa req-a239afea-caea-4c15-ad28-73c7f5281db2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:11.300871 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-5d2675a0-2850-4ff4-bd97-d46a465bfdaa req-a239afea-caea-4c15-ad28-73c7f5281db2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:11.328165 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2dafee07-4db4-41f6-b0e6-f07996465b0d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:11.344104 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-5d2675a0-2850-4ff4-bd97-d46a465bfdaa req-a239afea-caea-4c15-ad28-73c7f5281db2 service nova] Creating event network-vif-unplugged:7078c457-b7f7-49a3-bb53-e2a5e49cc511 for instance fab0a3d6-8249-4058-9ce5-90d458fff59d on n-h2-847009-3 Jul 19 22:31:11.357317 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2dafee07-4db4-41f6-b0e6-f07996465b0d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1718 microversion: 2.1 time: 0.765988 Jul 19 22:31:11.366322 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 643/1313] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:10 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1718 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:11.368281 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-5d2675a0-2850-4ff4-bd97-d46a465bfdaa req-a239afea-caea-4c15-ad28-73c7f5281db2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126827 Jul 19 22:31:11.373877 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 671/1314] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:11.394076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-0922e48f-76ef-4ea3-8fb0-a81ff1136963 req-6524b31d-8363-4d4a-8489-41c3144b9ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5cee0f0-7a6c-4388-8bbb-25781a0e0442", "name": "network-vif-plugged", "status": "completed", "tag": "18a87ef7-665a-4eed-ab86-8f47c80dbf71"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:11.411478 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-61badfde-ad7b-49a3-93fa-49961de6cb6d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:11.412188 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-61badfde-ad7b-49a3-93fa-49961de6cb6d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:11.436439 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0922e48f-76ef-4ea3-8fb0-a81ff1136963 req-6524b31d-8363-4d4a-8489-41c3144b9ab2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:11.438894 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61badfde-ad7b-49a3-93fa-49961de6cb6d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:11.439732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0922e48f-76ef-4ea3-8fb0-a81ff1136963 req-6524b31d-8363-4d4a-8489-41c3144b9ab2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:11.449608 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61badfde-ad7b-49a3-93fa-49961de6cb6d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:11.450948 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61badfde-ad7b-49a3-93fa-49961de6cb6d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:11.451586 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61badfde-ad7b-49a3-93fa-49961de6cb6d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:11.505808 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-0922e48f-76ef-4ea3-8fb0-a81ff1136963 req-6524b31d-8363-4d4a-8489-41c3144b9ab2 service nova] Creating event network-vif-plugged:18a87ef7-665a-4eed-ab86-8f47c80dbf71 for instance e5cee0f0-7a6c-4388-8bbb-25781a0e0442 on n-h2-847009-3 Jul 19 22:31:11.533060 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-0922e48f-76ef-4ea3-8fb0-a81ff1136963 req-6524b31d-8363-4d4a-8489-41c3144b9ab2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160099 Jul 19 22:31:11.535951 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 644/1315] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:11.542853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e8868cf9-80af-45c6-be95-a37f8fc2d295 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:11.560304 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e8868cf9-80af-45c6-be95-a37f8fc2d295 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:11.600978 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8868cf9-80af-45c6-be95-a37f8fc2d295 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:11.607909 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8868cf9-80af-45c6-be95-a37f8fc2d295 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:11.614947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8868cf9-80af-45c6-be95-a37f8fc2d295 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:11.615893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8868cf9-80af-45c6-be95-a37f8fc2d295 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:11.622472 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:31:11.663683 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=4 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:31:11.992733 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e8868cf9-80af-45c6-be95-a37f8fc2d295 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:12.005857 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e8868cf9-80af-45c6-be95-a37f8fc2d295 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1472 microversion: 2.1 time: 0.468244 Jul 19 22:31:12.007224 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 645/1316] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:11 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1472 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:12.016053 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f8173301-c775-4880-9640-50868bb8b052 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:12.026588 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f8173301-c775-4880-9640-50868bb8b052 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:12.045097 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8173301-c775-4880-9640-50868bb8b052 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:12.045665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8173301-c775-4880-9640-50868bb8b052 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:12.046948 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8173301-c775-4880-9640-50868bb8b052 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:12.047690 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8173301-c775-4880-9640-50868bb8b052 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:12.053300 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-61badfde-ad7b-49a3-93fa-49961de6cb6d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:12.078149 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-61badfde-ad7b-49a3-93fa-49961de6cb6d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1470 microversion: 2.1 time: 0.693690 Jul 19 22:31:12.081037 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 672/1317] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:11 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1470 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:12.111443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9805bb81-d9f5-4b27-b610-1a81a99e59e7 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a10cbd040>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:12.346214 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9805bb81-d9f5-4b27-b610-1a81a99e59e7 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17" status: 200 len: 1440 microversion: 2.1 time: 0.262963 Jul 19 22:31:12.348196 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 673/1318] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:31:12 2022] GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17 => generated 1440 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:12.355334 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3e99b1fb-d8d0-4586-a212-74b8c366e364 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:12.356429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3e99b1fb-d8d0-4586-a212-74b8c366e364 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: e5cee0f0-7a6c-4388-8bbb-25781a0e0442] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:12.367296 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e99b1fb-d8d0-4586-a212-74b8c366e364 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:12.367988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e99b1fb-d8d0-4586-a212-74b8c366e364 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:12.369664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e99b1fb-d8d0-4586-a212-74b8c366e364 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:12.371210 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e99b1fb-d8d0-4586-a212-74b8c366e364 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:12.498312 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f8173301-c775-4880-9640-50868bb8b052 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f20e57a90994fbb989c749dc3ea2ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e68faed5a742fcbd3818f9c0f6569a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:12.554985 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f8173301-c775-4880-9640-50868bb8b052 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372" status: 200 len: 1542 microversion: 2.1 time: 0.542586 Jul 19 22:31:12.588662 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 646/1319] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:12 2022] GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372 => generated 1542 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:12.627466 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f4c80402-3316-4f9e-aebb-775b95ef9f23 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:12.628557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f4c80402-3316-4f9e-aebb-775b95ef9f23 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:12.669853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4c80402-3316-4f9e-aebb-775b95ef9f23 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:12.670623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4c80402-3316-4f9e-aebb-775b95ef9f23 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:12.672026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4c80402-3316-4f9e-aebb-775b95ef9f23 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:12.672793 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4c80402-3316-4f9e-aebb-775b95ef9f23 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:12.788783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3e99b1fb-d8d0-4586-a212-74b8c366e364 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:12.818975 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3e99b1fb-d8d0-4586-a212-74b8c366e364 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442" status: 200 len: 1317 microversion: 2.1 time: 0.466013 Jul 19 22:31:12.822623 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 674/1320] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:12 2022] GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442 => generated 1317 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:13.048816 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-17e1db6a-2492-49e7-9d1d-c918754d5fe1 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:13.049237 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-17e1db6a-2492-49e7-9d1d-c918754d5fe1 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:13.089992 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-17e1db6a-2492-49e7-9d1d-c918754d5fe1 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:13.090761 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-17e1db6a-2492-49e7-9d1d-c918754d5fe1 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:13.091782 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-17e1db6a-2492-49e7-9d1d-c918754d5fe1 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:13.092450 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-17e1db6a-2492-49e7-9d1d-c918754d5fe1 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:13.466721 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f4c80402-3316-4f9e-aebb-775b95ef9f23 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:13.490887 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f4c80402-3316-4f9e-aebb-775b95ef9f23 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1718 microversion: 2.1 time: 0.893432 Jul 19 22:31:13.495224 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 647/1321] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:12 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1718 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:13.513522 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1f58c648-e4e5-4c76-a9ba-52ad1c43da33 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:13.516986 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-17e1db6a-2492-49e7-9d1d-c918754d5fe1 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:13.518740 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1f58c648-e4e5-4c76-a9ba-52ad1c43da33 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:13.529963 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-17e1db6a-2492-49e7-9d1d-c918754d5fe1 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1490 microversion: 2.1 time: 0.486494 Jul 19 22:31:13.531249 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 675/1322] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:13 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1490 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:13.550344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1f58c648-e4e5-4c76-a9ba-52ad1c43da33 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:13.551059 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1f58c648-e4e5-4c76-a9ba-52ad1c43da33 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:13.552586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1f58c648-e4e5-4c76-a9ba-52ad1c43da33 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:13.553554 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1f58c648-e4e5-4c76-a9ba-52ad1c43da33 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:13.570496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2ddea86b-09fb-466d-b5c7-e589a56069f4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a10444af0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:13.651150 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2ddea86b-09fb-466d-b5c7-e589a56069f4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17" status: 200 len: 1440 microversion: 2.1 time: 0.108397 Jul 19 22:31:13.665589 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 676/1323] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:31:13 2022] GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17 => generated 1440 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:13.675344 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-ac069fdd-fac0-4daf-ad24-be510f542180 req-e1d62b69-22fb-495c-86f7-72cc08944b76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fab0a3d6-8249-4058-9ce5-90d458fff59d", "tag": "7078c457-b7f7-49a3-bb53-e2a5e49cc511"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:13.693064 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-ac069fdd-fac0-4daf-ad24-be510f542180 req-e1d62b69-22fb-495c-86f7-72cc08944b76 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:13.693544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-ac069fdd-fac0-4daf-ad24-be510f542180 req-e1d62b69-22fb-495c-86f7-72cc08944b76 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:13.724624 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-ac069fdd-fac0-4daf-ad24-be510f542180 req-e1d62b69-22fb-495c-86f7-72cc08944b76 service nova] Creating event network-changed:7078c457-b7f7-49a3-bb53-e2a5e49cc511 for instance fab0a3d6-8249-4058-9ce5-90d458fff59d on n-h2-847009-3 Jul 19 22:31:13.730890 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-ac069fdd-fac0-4daf-ad24-be510f542180 req-e1d62b69-22fb-495c-86f7-72cc08944b76 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063828 Jul 19 22:31:13.731880 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 677/1324] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:13.737470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8ec42a30-628e-4c0d-9a10-e85088ce23a5 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:13.738221 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8ec42a30-628e-4c0d-9a10-e85088ce23a5 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:13.746252 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8ec42a30-628e-4c0d-9a10-e85088ce23a5 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:13.746741 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8ec42a30-628e-4c0d-9a10-e85088ce23a5 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:13.747662 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8ec42a30-628e-4c0d-9a10-e85088ce23a5 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:13.748164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8ec42a30-628e-4c0d-9a10-e85088ce23a5 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:14.013159 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1f58c648-e4e5-4c76-a9ba-52ad1c43da33 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:14.043478 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1f58c648-e4e5-4c76-a9ba-52ad1c43da33 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1470 microversion: 2.1 time: 0.533692 Jul 19 22:31:14.052168 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 648/1325] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:13 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1470 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:14.076394 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a30f327e-2137-4db2-938e-273559be5d66 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:14.079668 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a30f327e-2137-4db2-938e-273559be5d66 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: e5cee0f0-7a6c-4388-8bbb-25781a0e0442] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:14.123086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a30f327e-2137-4db2-938e-273559be5d66 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:14.124712 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a30f327e-2137-4db2-938e-273559be5d66 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:14.129439 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a30f327e-2137-4db2-938e-273559be5d66 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:14.130401 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a30f327e-2137-4db2-938e-273559be5d66 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:14.682938 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8ec42a30-628e-4c0d-9a10-e85088ce23a5 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f20e57a90994fbb989c749dc3ea2ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e68faed5a742fcbd3818f9c0f6569a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:14.720040 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8ec42a30-628e-4c0d-9a10-e85088ce23a5 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372" status: 200 len: 1542 microversion: 2.1 time: 0.979195 Jul 19 22:31:14.722327 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 678/1326] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:13 2022] GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372 => generated 1542 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:14.739019 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-aef2b305-2a23-4c50-8faf-de2982b9bc8e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:14.740155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-aef2b305-2a23-4c50-8faf-de2982b9bc8e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:14.760580 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aef2b305-2a23-4c50-8faf-de2982b9bc8e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:14.761323 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aef2b305-2a23-4c50-8faf-de2982b9bc8e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:14.762303 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aef2b305-2a23-4c50-8faf-de2982b9bc8e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:14.762898 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aef2b305-2a23-4c50-8faf-de2982b9bc8e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:14.870671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a30f327e-2137-4db2-938e-273559be5d66 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:14.883937 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a30f327e-2137-4db2-938e-273559be5d66 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442" status: 200 len: 1317 microversion: 2.1 time: 0.830020 Jul 19 22:31:14.887264 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 649/1327] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:14 2022] GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442 => generated 1317 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:14.910764 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5ea2c760-9b61-450c-bd7e-31c0c3adeaea tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:14.912235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5ea2c760-9b61-450c-bd7e-31c0c3adeaea tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:14.927242 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ea2c760-9b61-450c-bd7e-31c0c3adeaea tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:14.927865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ea2c760-9b61-450c-bd7e-31c0c3adeaea tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:14.931276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ea2c760-9b61-450c-bd7e-31c0c3adeaea tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:14.934178 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ea2c760-9b61-450c-bd7e-31c0c3adeaea tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:15.590109 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5ea2c760-9b61-450c-bd7e-31c0c3adeaea tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:15.604972 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5ea2c760-9b61-450c-bd7e-31c0c3adeaea tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1478 microversion: 2.1 time: 0.704266 Jul 19 22:31:15.617157 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-aef2b305-2a23-4c50-8faf-de2982b9bc8e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:15.621484 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 650/1328] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:14 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1478 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:15.626574 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bc3aba96-4b60-417a-889d-88251030219e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a102a7040>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:15.668708 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-aef2b305-2a23-4c50-8faf-de2982b9bc8e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1718 microversion: 2.1 time: 0.937209 Jul 19 22:31:15.670811 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 679/1329] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:14 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1718 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:15.694501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-10bf7696-f3c7-412f-b87a-0a955ae72c16 req-d083bf0e-4f8d-4938-9d5b-18e221d91f65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a134613f-f510-43e4-943e-d869b38c4372", "name": "network-vif-unplugged", "status": "completed", "tag": "b5b458c6-907b-4661-bb17-cd57f2eb40a1"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:15.695746 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bc3aba96-4b60-417a-889d-88251030219e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17" status: 200 len: 1440 microversion: 2.1 time: 0.072607 Jul 19 22:31:15.697542 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 651/1330] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:31:15 2022] GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17 => generated 1440 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:15.704235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-56b9aaeb-6e32-46db-a520-884fe772a4a3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:15.705384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-56b9aaeb-6e32-46db-a520-884fe772a4a3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:15.713049 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56b9aaeb-6e32-46db-a520-884fe772a4a3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:15.713920 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56b9aaeb-6e32-46db-a520-884fe772a4a3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:15.714364 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-10bf7696-f3c7-412f-b87a-0a955ae72c16 req-d083bf0e-4f8d-4938-9d5b-18e221d91f65 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:15.714832 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-10bf7696-f3c7-412f-b87a-0a955ae72c16 req-d083bf0e-4f8d-4938-9d5b-18e221d91f65 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:15.715553 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56b9aaeb-6e32-46db-a520-884fe772a4a3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:15.716257 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56b9aaeb-6e32-46db-a520-884fe772a4a3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:15.738372 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-10bf7696-f3c7-412f-b87a-0a955ae72c16 req-d083bf0e-4f8d-4938-9d5b-18e221d91f65 service nova] Creating event network-vif-unplugged:b5b458c6-907b-4661-bb17-cd57f2eb40a1 for instance a134613f-f510-43e4-943e-d869b38c4372 on n-h2-847009-3 Jul 19 22:31:15.749579 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-10bf7696-f3c7-412f-b87a-0a955ae72c16 req-d083bf0e-4f8d-4938-9d5b-18e221d91f65 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076281 Jul 19 22:31:15.751744 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 680/1331] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:15.759757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-8c6d5650-4822-4d56-a959-93868513c179 req-6dc2b02d-990a-498a-b9d0-c4219530a177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a134613f-f510-43e4-943e-d869b38c4372", "name": "network-vif-deleted", "tag": "b5b458c6-907b-4661-bb17-cd57f2eb40a1"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:15.778466 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-8c6d5650-4822-4d56-a959-93868513c179 req-6dc2b02d-990a-498a-b9d0-c4219530a177 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:15.778466 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-8c6d5650-4822-4d56-a959-93868513c179 req-6dc2b02d-990a-498a-b9d0-c4219530a177 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:15.805050 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-8c6d5650-4822-4d56-a959-93868513c179 req-6dc2b02d-990a-498a-b9d0-c4219530a177 service nova] Creating event network-vif-deleted:b5b458c6-907b-4661-bb17-cd57f2eb40a1 for instance a134613f-f510-43e4-943e-d869b38c4372 on n-h2-847009-3 Jul 19 22:31:15.819730 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-8c6d5650-4822-4d56-a959-93868513c179 req-6dc2b02d-990a-498a-b9d0-c4219530a177 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066029 Jul 19 22:31:15.821288 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 681/1332] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:15.841208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ccc32ebc-a7e3-4abc-aca0-41f09dbec042 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:15.843230 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ccc32ebc-a7e3-4abc-aca0-41f09dbec042 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:15.861013 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ccc32ebc-a7e3-4abc-aca0-41f09dbec042 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:15.861517 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ccc32ebc-a7e3-4abc-aca0-41f09dbec042 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:15.862414 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ccc32ebc-a7e3-4abc-aca0-41f09dbec042 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:15.862961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ccc32ebc-a7e3-4abc-aca0-41f09dbec042 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:16.287576 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ccc32ebc-a7e3-4abc-aca0-41f09dbec042 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f20e57a90994fbb989c749dc3ea2ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e68faed5a742fcbd3818f9c0f6569a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:16.307753 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ccc32ebc-a7e3-4abc-aca0-41f09dbec042 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372" status: 200 len: 1500 microversion: 2.1 time: 0.482951 Jul 19 22:31:16.310351 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 682/1333] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:15 2022] GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372 => generated 1500 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:16.326062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e8584ad6-d8ff-4138-a30c-f7022bb5d89f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:16.326772 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e8584ad6-d8ff-4138-a30c-f7022bb5d89f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: e5cee0f0-7a6c-4388-8bbb-25781a0e0442] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:16.335940 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e8584ad6-d8ff-4138-a30c-f7022bb5d89f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:16.336521 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e8584ad6-d8ff-4138-a30c-f7022bb5d89f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:16.338276 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e8584ad6-d8ff-4138-a30c-f7022bb5d89f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:16.339071 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e8584ad6-d8ff-4138-a30c-f7022bb5d89f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:17.428834 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-56b9aaeb-6e32-46db-a520-884fe772a4a3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:17.459939 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-56b9aaeb-6e32-46db-a520-884fe772a4a3 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1470 microversion: 2.1 time: 1.760115 Jul 19 22:31:17.473406 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 652/1334] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:15 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1470 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:17.496716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-301bdb25-b4fe-43ce-815b-ce0355076594 req-ef1de753-f3f6-4165-84e8-fa3378fca975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6ee0c6-66e1-4877-a7be-b7996a03d158", "name": "network-vif-unplugged", "status": "completed", "tag": "5964d642-fd77-41ab-93fe-df25f0bebc9c"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:17.558622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-301bdb25-b4fe-43ce-815b-ce0355076594 req-ef1de753-f3f6-4165-84e8-fa3378fca975 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:17.559324 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-301bdb25-b4fe-43ce-815b-ce0355076594 req-ef1de753-f3f6-4165-84e8-fa3378fca975 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:17.609159 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-301bdb25-b4fe-43ce-815b-ce0355076594 req-ef1de753-f3f6-4165-84e8-fa3378fca975 service nova] Creating event network-vif-unplugged:5964d642-fd77-41ab-93fe-df25f0bebc9c for instance 1e6ee0c6-66e1-4877-a7be-b7996a03d158 on n-h1-847009-3 Jul 19 22:31:17.630199 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [req-301bdb25-b4fe-43ce-815b-ce0355076594 req-ef1de753-f3f6-4165-84e8-fa3378fca975 service nova] Instance 1e6ee0c6-66e1-4877-a7be-b7996a03d158 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119338) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 22:31:17.662080 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-301bdb25-b4fe-43ce-815b-ce0355076594 req-ef1de753-f3f6-4165-84e8-fa3378fca975 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.182700 Jul 19 22:31:17.662080 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 653/1335] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:17.666802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5d762b59-332b-4f1a-b3bb-d6b7932f1e1d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:17.667545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5d762b59-332b-4f1a-b3bb-d6b7932f1e1d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:17.693613 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d762b59-332b-4f1a-b3bb-d6b7932f1e1d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:17.694074 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d762b59-332b-4f1a-b3bb-d6b7932f1e1d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:17.694888 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d762b59-332b-4f1a-b3bb-d6b7932f1e1d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:17.695363 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d762b59-332b-4f1a-b3bb-d6b7932f1e1d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:17.789175 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e8584ad6-d8ff-4138-a30c-f7022bb5d89f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:17.826711 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e8584ad6-d8ff-4138-a30c-f7022bb5d89f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442" status: 200 len: 1317 microversion: 2.1 time: 1.511894 Jul 19 22:31:17.837479 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 683/1336] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:16 2022] GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442 => generated 1317 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:17.857569 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4163fc28-082a-4318-a3b2-0534ab1f1b53 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:17.858186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4163fc28-082a-4318-a3b2-0534ab1f1b53 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:17.876152 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4163fc28-082a-4318-a3b2-0534ab1f1b53 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:17.878473 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4163fc28-082a-4318-a3b2-0534ab1f1b53 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:17.879545 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4163fc28-082a-4318-a3b2-0534ab1f1b53 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:17.880651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4163fc28-082a-4318-a3b2-0534ab1f1b53 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:18.146839 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5d762b59-332b-4f1a-b3bb-d6b7932f1e1d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:18.158636 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5d762b59-332b-4f1a-b3bb-d6b7932f1e1d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1478 microversion: 2.1 time: 0.496625 Jul 19 22:31:18.181323 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 654/1337] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:17 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1478 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:18.204781 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-09e33964-c9c4-4063-b9b8-cae6f251b8d5 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a1014a670>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:18.292560 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-09e33964-c9c4-4063-b9b8-cae6f251b8d5 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17" status: 200 len: 1440 microversion: 2.1 time: 0.108612 Jul 19 22:31:18.301906 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 655/1338] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:31:18 2022] GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17 => generated 1440 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:18.301906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8da138c8-099e-4694-a0aa-c085dae2ed55 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:18.301906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8da138c8-099e-4694-a0aa-c085dae2ed55 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] [instance: a134613f-f510-43e4-943e-d869b38c4372] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:18.322438 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4163fc28-082a-4318-a3b2-0534ab1f1b53 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:18.336383 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4163fc28-082a-4318-a3b2-0534ab1f1b53 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1718 microversion: 2.1 time: 0.496195 Jul 19 22:31:18.338009 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 684/1339] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:17 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1718 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:18.365242 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8da138c8-099e-4694-a0aa-c085dae2ed55 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:18.365710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8da138c8-099e-4694-a0aa-c085dae2ed55 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:18.366524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8da138c8-099e-4694-a0aa-c085dae2ed55 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:18.369005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8da138c8-099e-4694-a0aa-c085dae2ed55 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:18.401255 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-8da138c8-099e-4694-a0aa-c085dae2ed55 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] HTTP exception thrown: Instance a134613f-f510-43e4-943e-d869b38c4372 could not be found. Jul 19 22:31:18.406493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8da138c8-099e-4694-a0aa-c085dae2ed55 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Request method failure captured: Jul 19 22:31:18.406493 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372 HTTP/1.1 Jul 19 22:31:18.406493 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:31:18.406493 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:31:18.406493 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:31:18.406493 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:31:18.406493 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:31:18.406493 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:31:18.406493 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:31:18.406493 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:31:18.406493 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zBffm25x4xYa7JzDlLJIESGAgCPSFEkA7y6FYg9TrCpiBjNJSxaG9X7U3eQhgYDbIxW8dG5nidohqPDfN5gpCMhbkfW3vs54sTnSucmW5D1dYQ6EHnI3O-x5CeIwYZ4NysXswwCEpPHivIKgqLq-uT1pxQcq_p4cNiAxOMP2qoDlY4 Jul 19 22:31:18.406493 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:31:18.406493 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:31:18.406493 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:31:18.406493 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:31:18.406493 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:31:18.406493 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:31:18.406493 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 94e68faed5a742fcbd3818f9c0f6569a Jul 19 22:31:18.406493 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-231453760 Jul 19 22:31:18.406493 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:31:18.406493 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:31:18.408920 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94e68faed5a742fcbd3818f9c0f6569a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94e68faed5a742fcbd3818f9c0f6569a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94e68faed5a742fcbd3818f9c0f6569a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94e68faed5a742fcbd3818f9c0f6569a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:31:18.408920 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-231453760 Jul 19 22:31:18.408920 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 94e68faed5a742fcbd3818f9c0f6569a Jul 19 22:31:18.408920 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-231453760 Jul 19 22:31:18.408920 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project Jul 19 22:31:18.408920 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:31:18.408920 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:31:18.408920 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 0f20e57a90994fbb989c749dc3ea2ec6 Jul 19 22:31:18.408920 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project Jul 19 22:31:18.408920 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:31:18.408920 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance a134613f-f510-43e4-943e-d869b38c4372 could not be found. Jul 19 22:31:18.408920 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'a134613f-f510-43e4-943e-d869b38c4372'} Jul 19 22:31:18.411226 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:31:18.411226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:18.411226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:31:18.411226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:31:18.411226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:31:18.411226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:31:18.411226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:31:18.411226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:31:18.411226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:31:18.411226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:31:18.411226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a134613f-f510-43e4-943e-d869b38c4372 could not be found. Jul 19 22:31:18.411226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:18.411226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:18.411226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:18.411226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:18.411226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:18.411226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:18.411226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:31:18.411226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:31:18.411226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:31:18.412501 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:31:18.412501 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:31:18.412501 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:31:18.412501 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:31:18.412501 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:31:18.412501 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:31:18.412501 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:31:18.412501 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a134613f-f510-43e4-943e-d869b38c4372 could not be found. Jul 19 22:31:18.412501 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:18.412501 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:18.412501 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:18.412501 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:18.412501 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:18.412501 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:18.412501 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:31:18.412501 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:31:18.412501 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a134613f-f510-43e4-943e-d869b38c4372 could not be found. Jul 19 22:31:18.412501 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:18.413637 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8da138c8-099e-4694-a0aa-c085dae2ed55 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] Returning 404 to user: Instance a134613f-f510-43e4-943e-d869b38c4372 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:31:18.413637 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8da138c8-099e-4694-a0aa-c085dae2ed55 tempest-FloatingIPsAssociationNegativeTestJSON-231453760 tempest-FloatingIPsAssociationNegativeTestJSON-231453760-project] 10.222.0.25 "GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372" status: 404 len: 111 microversion: 2.1 time: 0.113651 Jul 19 22:31:18.413637 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 656/1340] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:18 2022] GET /compute/v2.1/servers/a134613f-f510-43e4-943e-d869b38c4372 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:31:18.513135 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6dc2a759-87eb-4235-9acf-de03e2fa8097 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:18.515907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6dc2a759-87eb-4235-9acf-de03e2fa8097 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:18.531967 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6dc2a759-87eb-4235-9acf-de03e2fa8097 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:18.532998 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6dc2a759-87eb-4235-9acf-de03e2fa8097 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:18.534477 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6dc2a759-87eb-4235-9acf-de03e2fa8097 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:18.536461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6dc2a759-87eb-4235-9acf-de03e2fa8097 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:18.845175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6ff9ef67-a3a9-4459-8976-c5cb3fc0f247 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:18.847775 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6ff9ef67-a3a9-4459-8976-c5cb3fc0f247 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: e5cee0f0-7a6c-4388-8bbb-25781a0e0442] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:18.865951 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ff9ef67-a3a9-4459-8976-c5cb3fc0f247 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:18.867032 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ff9ef67-a3a9-4459-8976-c5cb3fc0f247 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:18.869605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ff9ef67-a3a9-4459-8976-c5cb3fc0f247 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:18.871488 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ff9ef67-a3a9-4459-8976-c5cb3fc0f247 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:19.335738 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6dc2a759-87eb-4235-9acf-de03e2fa8097 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:19.346540 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6dc2a759-87eb-4235-9acf-de03e2fa8097 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1470 microversion: 2.1 time: 0.841501 Jul 19 22:31:19.358238 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 685/1341] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:18 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1470 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:19.363868 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9bb4d0da-97cd-49d5-ba8f-e65eebf7b6b2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:19.364835 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9bb4d0da-97cd-49d5-ba8f-e65eebf7b6b2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:19.384937 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9bb4d0da-97cd-49d5-ba8f-e65eebf7b6b2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:19.385799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9bb4d0da-97cd-49d5-ba8f-e65eebf7b6b2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:19.387448 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9bb4d0da-97cd-49d5-ba8f-e65eebf7b6b2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:19.388407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9bb4d0da-97cd-49d5-ba8f-e65eebf7b6b2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:19.735286 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6ff9ef67-a3a9-4459-8976-c5cb3fc0f247 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:19.757602 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6ff9ef67-a3a9-4459-8976-c5cb3fc0f247 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442" status: 200 len: 1317 microversion: 2.1 time: 0.917318 Jul 19 22:31:19.808619 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9bb4d0da-97cd-49d5-ba8f-e65eebf7b6b2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:19.816434 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 657/1342] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:18 2022] GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442 => generated 1317 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:19.833317 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-24b4d9c7-9153-4e51-941c-ca05b0025849 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a103b3160>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:19.835727 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9bb4d0da-97cd-49d5-ba8f-e65eebf7b6b2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1478 microversion: 2.1 time: 0.475180 Jul 19 22:31:19.839590 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 686/1343] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:19 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1478 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:19.864985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5d28eafe-aa94-45d3-ad6e-871ec9834647 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:19.866579 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5d28eafe-aa94-45d3-ad6e-871ec9834647 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:19.882768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5d28eafe-aa94-45d3-ad6e-871ec9834647 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:19.884702 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5d28eafe-aa94-45d3-ad6e-871ec9834647 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:19.886449 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5d28eafe-aa94-45d3-ad6e-871ec9834647 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:19.887653 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5d28eafe-aa94-45d3-ad6e-871ec9834647 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:19.927256 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-24b4d9c7-9153-4e51-941c-ca05b0025849 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17" status: 200 len: 1440 microversion: 2.1 time: 0.107340 Jul 19 22:31:19.930003 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 658/1344] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:31:19 2022] GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17 => generated 1440 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:19.938134 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-336022aa-dc95-4e3c-bbcf-a682dbffb84b req-2de438a8-6e18-4264-9ed9-085fa95d9521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e6ee0c6-66e1-4877-a7be-b7996a03d158", "tag": "5964d642-fd77-41ab-93fe-df25f0bebc9c"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:19.952445 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-336022aa-dc95-4e3c-bbcf-a682dbffb84b req-2de438a8-6e18-4264-9ed9-085fa95d9521 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:19.953722 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-336022aa-dc95-4e3c-bbcf-a682dbffb84b req-2de438a8-6e18-4264-9ed9-085fa95d9521 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:19.980965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:31:19.987258 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-336022aa-dc95-4e3c-bbcf-a682dbffb84b req-2de438a8-6e18-4264-9ed9-085fa95d9521 service nova] Creating event network-changed:5964d642-fd77-41ab-93fe-df25f0bebc9c for instance 1e6ee0c6-66e1-4877-a7be-b7996a03d158 on n-h1-847009-3 Jul 19 22:31:20.000590 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [req-336022aa-dc95-4e3c-bbcf-a682dbffb84b req-2de438a8-6e18-4264-9ed9-085fa95d9521 service nova] Instance 1e6ee0c6-66e1-4877-a7be-b7996a03d158 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119338) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 22:31:20.035021 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-336022aa-dc95-4e3c-bbcf-a682dbffb84b req-2de438a8-6e18-4264-9ed9-085fa95d9521 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102669 Jul 19 22:31:20.036241 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 659/1345] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:20.307219 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5d28eafe-aa94-45d3-ad6e-871ec9834647 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:20.324944 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5d28eafe-aa94-45d3-ad6e-871ec9834647 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1718 microversion: 2.1 time: 0.478335 Jul 19 22:31:20.348881 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 687/1346] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:19 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1718 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:20.388907 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-57f4736b-af73-490d-a8bc-57dc4d45d727 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:20.389639 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-57f4736b-af73-490d-a8bc-57dc4d45d727 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:20.397971 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-57f4736b-af73-490d-a8bc-57dc4d45d727 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:20.398563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-57f4736b-af73-490d-a8bc-57dc4d45d727 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:20.400739 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-57f4736b-af73-490d-a8bc-57dc4d45d727 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:20.401289 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-57f4736b-af73-490d-a8bc-57dc4d45d727 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:20.495827 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-e3dbb08c-0197-49be-8d01-f6add06e0e2f req-d1c23ecf-f096-4aa7-86ea-60780f308aff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613", "name": "network-vif-plugged", "status": "completed", "tag": "8551ae32-70fe-4a9f-920b-2e4c5b49340d"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:20.535314 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e3dbb08c-0197-49be-8d01-f6add06e0e2f req-d1c23ecf-f096-4aa7-86ea-60780f308aff service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:20.536416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e3dbb08c-0197-49be-8d01-f6add06e0e2f req-d1c23ecf-f096-4aa7-86ea-60780f308aff service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:20.563435 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-e3dbb08c-0197-49be-8d01-f6add06e0e2f req-d1c23ecf-f096-4aa7-86ea-60780f308aff service nova] Creating event network-vif-plugged:8551ae32-70fe-4a9f-920b-2e4c5b49340d for instance 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 on n-h2-847009-3 Jul 19 22:31:20.593539 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-e3dbb08c-0197-49be-8d01-f6add06e0e2f req-d1c23ecf-f096-4aa7-86ea-60780f308aff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100919 Jul 19 22:31:20.606754 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 688/1347] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:20.773047 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-57f4736b-af73-490d-a8bc-57dc4d45d727 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:20.798369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c661944a-a724-47af-bcef-5b2050d8a413 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:20.816194 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c661944a-a724-47af-bcef-5b2050d8a413 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: e5cee0f0-7a6c-4388-8bbb-25781a0e0442] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:20.830180 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-57f4736b-af73-490d-a8bc-57dc4d45d727 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1470 microversion: 2.1 time: 0.446131 Jul 19 22:31:20.832219 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 660/1348] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:20 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1470 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:20.849337 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c661944a-a724-47af-bcef-5b2050d8a413 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:20.850315 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c661944a-a724-47af-bcef-5b2050d8a413 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:20.851977 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c661944a-a724-47af-bcef-5b2050d8a413 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:20.853253 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c661944a-a724-47af-bcef-5b2050d8a413 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:20.870449 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-88738f6c-eef8-4251-a355-71c423f3e51d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:20.871080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-88738f6c-eef8-4251-a355-71c423f3e51d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:20.889890 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-88738f6c-eef8-4251-a355-71c423f3e51d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:20.890634 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-88738f6c-eef8-4251-a355-71c423f3e51d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:20.891480 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-88738f6c-eef8-4251-a355-71c423f3e51d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:20.891928 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-88738f6c-eef8-4251-a355-71c423f3e51d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:21.502330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-88738f6c-eef8-4251-a355-71c423f3e51d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:21.526749 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c661944a-a724-47af-bcef-5b2050d8a413 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:21.528198 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-88738f6c-eef8-4251-a355-71c423f3e51d tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1478 microversion: 2.1 time: 0.662297 Jul 19 22:31:21.529967 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 661/1349] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:20 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1478 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:31:21.537638 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c661944a-a724-47af-bcef-5b2050d8a413 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442" status: 200 len: 1467 microversion: 2.1 time: 0.757071 Jul 19 22:31:21.542766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a78c7d6b-b77a-427e-931e-9ca0a71c3c8f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a1012ee50>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:21.555783 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 689/1350] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:20 2022] GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442 => generated 1467 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:21.568684 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-611b5277-2d21-4d18-9802-029eec314070 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:21.569387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-611b5277-2d21-4d18-9802-029eec314070 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:21.581998 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-611b5277-2d21-4d18-9802-029eec314070 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:21.582458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-611b5277-2d21-4d18-9802-029eec314070 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:21.585078 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-611b5277-2d21-4d18-9802-029eec314070 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:21.585414 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-611b5277-2d21-4d18-9802-029eec314070 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:21.620756 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a78c7d6b-b77a-427e-931e-9ca0a71c3c8f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17" status: 200 len: 1440 microversion: 2.1 time: 0.088258 Jul 19 22:31:21.622637 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 662/1351] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:31:21 2022] GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17 => generated 1440 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:21.631084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6201fc48-52ce-4203-a733-7dbdeab05984 tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:21.632259 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6201fc48-52ce-4203-a733-7dbdeab05984 tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] [instance: e5cee0f0-7a6c-4388-8bbb-25781a0e0442] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:21.642480 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:31:21.646784 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6201fc48-52ce-4203-a733-7dbdeab05984 tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:21.647970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6201fc48-52ce-4203-a733-7dbdeab05984 tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:21.652155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6201fc48-52ce-4203-a733-7dbdeab05984 tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:21.653687 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6201fc48-52ce-4203-a733-7dbdeab05984 tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:21.999645 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-611b5277-2d21-4d18-9802-029eec314070 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:22.037079 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-611b5277-2d21-4d18-9802-029eec314070 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1718 microversion: 2.1 time: 0.479395 Jul 19 22:31:22.043175 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6201fc48-52ce-4203-a733-7dbdeab05984 tempest-ServersOnMultiNodesTest-591171130 tempest-ServersOnMultiNodesTest-591171130-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442" status: 200 len: 1618 microversion: 2.1 time: 0.418755 Jul 19 22:31:22.044279 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 690/1352] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:21 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1718 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:22.063949 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 663/1353] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:21 2022] GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442 => generated 1618 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:22.067434 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fd6a8996-cdf2-4bff-ba5a-8392c83657ee tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:22.068908 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fd6a8996-cdf2-4bff-ba5a-8392c83657ee tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:22.084635 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7a615f08-5f07-4a05-86ad-a5f63eb471dd tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:22.085197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7a615f08-5f07-4a05-86ad-a5f63eb471dd tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: e5cee0f0-7a6c-4388-8bbb-25781a0e0442] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:22.086455 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd6a8996-cdf2-4bff-ba5a-8392c83657ee tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:22.088174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd6a8996-cdf2-4bff-ba5a-8392c83657ee tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:22.089903 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd6a8996-cdf2-4bff-ba5a-8392c83657ee tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:22.091395 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd6a8996-cdf2-4bff-ba5a-8392c83657ee tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:22.093902 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a615f08-5f07-4a05-86ad-a5f63eb471dd tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:22.097174 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a615f08-5f07-4a05-86ad-a5f63eb471dd tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:22.098370 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a615f08-5f07-4a05-86ad-a5f63eb471dd tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:22.098838 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a615f08-5f07-4a05-86ad-a5f63eb471dd tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:22.181410 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7a615f08-5f07-4a05-86ad-a5f63eb471dd tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: e5cee0f0-7a6c-4388-8bbb-25781a0e0442] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:31:22.327093 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7a615f08-5f07-4a05-86ad-a5f63eb471dd tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442" status: 204 len: 0 microversion: 2.1 time: 0.246118 Jul 19 22:31:22.331414 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 664/1354] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:31:22 2022] DELETE /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 22:31:22.340756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-53f90b13-f499-417e-bbfc-f24d2cc43cf0 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:22.341947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-53f90b13-f499-417e-bbfc-f24d2cc43cf0 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: e5cee0f0-7a6c-4388-8bbb-25781a0e0442] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:22.370247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53f90b13-f499-417e-bbfc-f24d2cc43cf0 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:22.371180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53f90b13-f499-417e-bbfc-f24d2cc43cf0 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:22.372790 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53f90b13-f499-417e-bbfc-f24d2cc43cf0 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:22.373654 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53f90b13-f499-417e-bbfc-f24d2cc43cf0 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:22.452947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:31:22.537853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fd6a8996-cdf2-4bff-ba5a-8392c83657ee tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:22.558480 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fd6a8996-cdf2-4bff-ba5a-8392c83657ee tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1470 microversion: 2.1 time: 0.512145 Jul 19 22:31:22.560148 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 691/1355] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:22 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1470 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:22.570113 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-564e2b9e-39ab-468d-8c1b-df6e0377efef tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:22.571966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-564e2b9e-39ab-468d-8c1b-df6e0377efef tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:22.585965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-564e2b9e-39ab-468d-8c1b-df6e0377efef tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:22.588278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-564e2b9e-39ab-468d-8c1b-df6e0377efef tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:22.589876 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-564e2b9e-39ab-468d-8c1b-df6e0377efef tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:22.590772 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-564e2b9e-39ab-468d-8c1b-df6e0377efef tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:22.932368 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-53f90b13-f499-417e-bbfc-f24d2cc43cf0 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:22.960485 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-53f90b13-f499-417e-bbfc-f24d2cc43cf0 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442" status: 200 len: 1473 microversion: 2.1 time: 0.625323 Jul 19 22:31:22.971970 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 665/1356] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:22 2022] GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442 => generated 1473 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:22.985526 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e47a6b9c-d487-401c-b75e-79981c8ee6e0 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a103cd790>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:23.012166 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-564e2b9e-39ab-468d-8c1b-df6e0377efef tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:23.029486 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-564e2b9e-39ab-468d-8c1b-df6e0377efef tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1478 microversion: 2.1 time: 0.467784 Jul 19 22:31:23.030674 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 692/1357] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:22 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1478 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:23.070147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c3fe8742-345c-4999-9a59-a08973aed541 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:23.070983 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c3fe8742-345c-4999-9a59-a08973aed541 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:23.078966 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e47a6b9c-d487-401c-b75e-79981c8ee6e0 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17" status: 200 len: 1440 microversion: 2.1 time: 0.108361 Jul 19 22:31:23.080493 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 666/1358] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:31:22 2022] GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17 => generated 1440 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:23.097876 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c3fe8742-345c-4999-9a59-a08973aed541 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:23.100694 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c3fe8742-345c-4999-9a59-a08973aed541 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:23.107758 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c3fe8742-345c-4999-9a59-a08973aed541 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:23.109615 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c3fe8742-345c-4999-9a59-a08973aed541 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:23.332921 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c3fe8742-345c-4999-9a59-a08973aed541 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:23.344488 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c3fe8742-345c-4999-9a59-a08973aed541 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1718 microversion: 2.1 time: 0.280456 Jul 19 22:31:23.357499 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 693/1359] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:23 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1718 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:31:23.588646 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-91209e70-3a87-4005-87c7-76cd0eb66fc6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:23.593365 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-91209e70-3a87-4005-87c7-76cd0eb66fc6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:23.616172 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91209e70-3a87-4005-87c7-76cd0eb66fc6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:23.617448 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91209e70-3a87-4005-87c7-76cd0eb66fc6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:23.620534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91209e70-3a87-4005-87c7-76cd0eb66fc6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:23.621598 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91209e70-3a87-4005-87c7-76cd0eb66fc6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:23.863578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3d0f552d-af4e-44eb-b5ff-af277da7e651 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:23.866042 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3d0f552d-af4e-44eb-b5ff-af277da7e651 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:23.879224 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d0f552d-af4e-44eb-b5ff-af277da7e651 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:23.880398 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d0f552d-af4e-44eb-b5ff-af277da7e651 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:23.882731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d0f552d-af4e-44eb-b5ff-af277da7e651 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:23.885177 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d0f552d-af4e-44eb-b5ff-af277da7e651 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:23.917630 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-91209e70-3a87-4005-87c7-76cd0eb66fc6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:23.971839 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-91209e70-3a87-4005-87c7-76cd0eb66fc6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1470 microversion: 2.1 time: 0.380064 Jul 19 22:31:23.986683 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 667/1360] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:23 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1470 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:24.002733 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-236baaf1-8b32-461c-99b4-2750464f7bc4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:24.003893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-236baaf1-8b32-461c-99b4-2750464f7bc4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: e5cee0f0-7a6c-4388-8bbb-25781a0e0442] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:24.049425 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-236baaf1-8b32-461c-99b4-2750464f7bc4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:24.053575 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-236baaf1-8b32-461c-99b4-2750464f7bc4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:24.057025 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-236baaf1-8b32-461c-99b4-2750464f7bc4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:24.059064 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-236baaf1-8b32-461c-99b4-2750464f7bc4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:24.280517 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-3d0f552d-af4e-44eb-b5ff-af277da7e651 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lazy-loading 'services' on Instance uuid 5d871dc5-0189-41e2-8650-8f753bf98c67 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:31:24.341404 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3d0f552d-af4e-44eb-b5ff-af277da7e651 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 2423 microversion: 2.25 time: 0.478797 Jul 19 22:31:24.367633 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 694/1361] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:31:23 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 2423 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:31:24.415201 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6bad845f-d8d2-43cb-aa83-0376bf82ba4f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:24.423141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6bad845f-d8d2-43cb-aa83-0376bf82ba4f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:24.467053 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6bad845f-d8d2-43cb-aa83-0376bf82ba4f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:24.467848 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6bad845f-d8d2-43cb-aa83-0376bf82ba4f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:24.469306 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6bad845f-d8d2-43cb-aa83-0376bf82ba4f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:24.470074 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6bad845f-d8d2-43cb-aa83-0376bf82ba4f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:24.614616 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-236baaf1-8b32-461c-99b4-2750464f7bc4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:24.627048 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-236baaf1-8b32-461c-99b4-2750464f7bc4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442" status: 200 len: 1473 microversion: 2.1 time: 0.645063 Jul 19 22:31:24.639015 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 668/1362] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:23 2022] GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442 => generated 1473 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:24.651334 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-94142991-a17b-4a6c-b018-0ebb608371be tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a102a7040>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:24.803194 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-94142991-a17b-4a6c-b018-0ebb608371be tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17" status: 200 len: 1440 microversion: 2.1 time: 0.161738 Jul 19 22:31:24.804327 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 669/1363] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:31:24 2022] GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17 => generated 1440 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:24.827830 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6a792c33-5090-4001-9523-df49c708f288 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:24.829070 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6a792c33-5090-4001-9523-df49c708f288 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:24.850229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a792c33-5090-4001-9523-df49c708f288 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:24.850692 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a792c33-5090-4001-9523-df49c708f288 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:24.851880 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a792c33-5090-4001-9523-df49c708f288 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:24.853482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a792c33-5090-4001-9523-df49c708f288 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:24.913634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6bad845f-d8d2-43cb-aa83-0376bf82ba4f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:24.929357 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6bad845f-d8d2-43cb-aa83-0376bf82ba4f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1478 microversion: 2.1 time: 0.555541 Jul 19 22:31:24.931737 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 695/1364] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:24 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1478 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:24.941036 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a2eb33f5-734c-491b-89a7-3e378f66a5a0 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-847009-3", "block_migration": "auto"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:24.953413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a2eb33f5-734c-491b-89a7-3e378f66a5a0 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:24.980552 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a2eb33f5-734c-491b-89a7-3e378f66a5a0 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:24.980926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a2eb33f5-734c-491b-89a7-3e378f66a5a0 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:25.009022 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a2eb33f5-734c-491b-89a7-3e378f66a5a0 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:25.010314 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a2eb33f5-734c-491b-89a7-3e378f66a5a0 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:25.074681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-a2eb33f5-734c-491b-89a7-3e378f66a5a0 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lazy-loading 'flavor' on Instance uuid 5d871dc5-0189-41e2-8650-8f753bf98c67 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:31:25.124677 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a2eb33f5-734c-491b-89a7-3e378f66a5a0 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Going to try to live migrate instance to n-h1-847009-3 {{(pid=119337) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 22:31:25.289694 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6a792c33-5090-4001-9523-df49c708f288 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:25.332378 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6a792c33-5090-4001-9523-df49c708f288 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1718 microversion: 2.1 time: 0.527130 Jul 19 22:31:25.343919 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 670/1365] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:24 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1718 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:25.365745 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-a097aa4e-36b6-48cd-9714-200857d6bed5 req-b185db9a-1bf8-49d4-bfe4-c1d2123fd850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab0a3d6-8249-4058-9ce5-90d458fff59d", "name": "network-vif-unplugged", "status": "completed", "tag": "7078c457-b7f7-49a3-bb53-e2a5e49cc511"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:25.399157 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-a097aa4e-36b6-48cd-9714-200857d6bed5 req-b185db9a-1bf8-49d4-bfe4-c1d2123fd850 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:25.406816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-a097aa4e-36b6-48cd-9714-200857d6bed5 req-b185db9a-1bf8-49d4-bfe4-c1d2123fd850 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:25.469853 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-a097aa4e-36b6-48cd-9714-200857d6bed5 req-b185db9a-1bf8-49d4-bfe4-c1d2123fd850 service nova] Creating event network-vif-unplugged:7078c457-b7f7-49a3-bb53-e2a5e49cc511 for instance fab0a3d6-8249-4058-9ce5-90d458fff59d on n-h2-847009-3 Jul 19 22:31:25.486060 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-a097aa4e-36b6-48cd-9714-200857d6bed5 req-b185db9a-1bf8-49d4-bfe4-c1d2123fd850 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.139955 Jul 19 22:31:25.492641 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 671/1366] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:25.544725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3834fa8d-cb21-4e9f-9815-65f7c53e47fa tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:25.546351 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3834fa8d-cb21-4e9f-9815-65f7c53e47fa tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:25.606221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3834fa8d-cb21-4e9f-9815-65f7c53e47fa tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:25.608624 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3834fa8d-cb21-4e9f-9815-65f7c53e47fa tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:25.612397 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3834fa8d-cb21-4e9f-9815-65f7c53e47fa tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:25.613182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3834fa8d-cb21-4e9f-9815-65f7c53e47fa tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:27.067337 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3834fa8d-cb21-4e9f-9815-65f7c53e47fa tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:27.080952 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3834fa8d-cb21-4e9f-9815-65f7c53e47fa tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1470 microversion: 2.1 time: 1.583328 Jul 19 22:31:27.092666 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 672/1367] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:25 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1470 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:27.110192 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fa84eeb9-cf5e-49b4-99d5-be485083d118 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:27.116606 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fa84eeb9-cf5e-49b4-99d5-be485083d118 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: e5cee0f0-7a6c-4388-8bbb-25781a0e0442] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:27.147268 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa84eeb9-cf5e-49b4-99d5-be485083d118 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:27.148116 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa84eeb9-cf5e-49b4-99d5-be485083d118 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:27.150372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa84eeb9-cf5e-49b4-99d5-be485083d118 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:27.156054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa84eeb9-cf5e-49b4-99d5-be485083d118 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:27.598448 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fa84eeb9-cf5e-49b4-99d5-be485083d118 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:27.609406 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fa84eeb9-cf5e-49b4-99d5-be485083d118 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442" status: 200 len: 1431 microversion: 2.1 time: 0.515493 Jul 19 22:31:27.612656 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 673/1368] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:27 2022] GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442 => generated 1431 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:27.624802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3419a7ec-f5be-4d3d-820e-217ae6687e3f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a10410790>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:27.810372 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3419a7ec-f5be-4d3d-820e-217ae6687e3f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17" status: 200 len: 1440 microversion: 2.1 time: 0.196562 Jul 19 22:31:27.810972 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 674/1369] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:31:27 2022] GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17 => generated 1440 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:27.825690 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8cf4e18e-f898-4444-bdda-1cf05b81f88b tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:27.826685 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8cf4e18e-f898-4444-bdda-1cf05b81f88b tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:27.862741 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8cf4e18e-f898-4444-bdda-1cf05b81f88b tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:27.867260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8cf4e18e-f898-4444-bdda-1cf05b81f88b tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:27.872077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8cf4e18e-f898-4444-bdda-1cf05b81f88b tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:27.879906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8cf4e18e-f898-4444-bdda-1cf05b81f88b tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:29.157662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8cf4e18e-f898-4444-bdda-1cf05b81f88b tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:29.186442 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8cf4e18e-f898-4444-bdda-1cf05b81f88b tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1464 microversion: 2.1 time: 1.364603 Jul 19 22:31:29.187851 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 675/1370] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:27 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1464 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:29.203554 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-49d07132-3a5e-414d-badf-c10b5f92f761 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:29.206716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-49d07132-3a5e-414d-badf-c10b5f92f761 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:29.219548 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49d07132-3a5e-414d-badf-c10b5f92f761 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:29.220992 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49d07132-3a5e-414d-badf-c10b5f92f761 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:29.222622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49d07132-3a5e-414d-badf-c10b5f92f761 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:29.224168 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49d07132-3a5e-414d-badf-c10b5f92f761 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:30.445641 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-49d07132-3a5e-414d-badf-c10b5f92f761 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:30.468961 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-49d07132-3a5e-414d-badf-c10b5f92f761 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1718 microversion: 2.1 time: 1.277109 Jul 19 22:31:30.470322 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 676/1371] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:29 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1718 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:30.476758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-596963ab-43ce-4d70-9305-83bd6f323626 req-b980fa3a-eede-4d8c-963f-ee9be031c402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6ee0c6-66e1-4877-a7be-b7996a03d158", "name": "network-vif-plugged", "status": "completed", "tag": "5964d642-fd77-41ab-93fe-df25f0bebc9c"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:30.489545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-596963ab-43ce-4d70-9305-83bd6f323626 req-b980fa3a-eede-4d8c-963f-ee9be031c402 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:30.490195 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-596963ab-43ce-4d70-9305-83bd6f323626 req-b980fa3a-eede-4d8c-963f-ee9be031c402 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:30.516923 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-596963ab-43ce-4d70-9305-83bd6f323626 req-b980fa3a-eede-4d8c-963f-ee9be031c402 service nova] Creating event network-vif-plugged:5964d642-fd77-41ab-93fe-df25f0bebc9c for instance 1e6ee0c6-66e1-4877-a7be-b7996a03d158 on n-h1-847009-3 Jul 19 22:31:30.529936 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-596963ab-43ce-4d70-9305-83bd6f323626 req-b980fa3a-eede-4d8c-963f-ee9be031c402 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056596 Jul 19 22:31:30.535550 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 677/1372] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:30.547995 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-044a2a8e-c738-4fd5-9456-bb10bef9fe9f req-1223d496-6176-4b93-a65e-3b6f08e9d796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5cee0f0-7a6c-4388-8bbb-25781a0e0442", "name": "network-vif-deleted", "tag": "18a87ef7-665a-4eed-ab86-8f47c80dbf71"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:30.578712 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-044a2a8e-c738-4fd5-9456-bb10bef9fe9f req-1223d496-6176-4b93-a65e-3b6f08e9d796 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:30.579177 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-044a2a8e-c738-4fd5-9456-bb10bef9fe9f req-1223d496-6176-4b93-a65e-3b6f08e9d796 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:30.596711 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-044a2a8e-c738-4fd5-9456-bb10bef9fe9f req-1223d496-6176-4b93-a65e-3b6f08e9d796 service nova] Creating event network-vif-deleted:18a87ef7-665a-4eed-ab86-8f47c80dbf71 for instance e5cee0f0-7a6c-4388-8bbb-25781a0e0442 on n-h2-847009-3 Jul 19 22:31:30.602749 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-044a2a8e-c738-4fd5-9456-bb10bef9fe9f req-1223d496-6176-4b93-a65e-3b6f08e9d796 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064600 Jul 19 22:31:30.604599 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 678/1373] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:30.610119 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-63e91a34-af14-4f00-b4c9-0dff3a4a21ac tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:30.610817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-63e91a34-af14-4f00-b4c9-0dff3a4a21ac tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:30.618845 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-63e91a34-af14-4f00-b4c9-0dff3a4a21ac tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:30.619573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-63e91a34-af14-4f00-b4c9-0dff3a4a21ac tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:30.620546 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-63e91a34-af14-4f00-b4c9-0dff3a4a21ac tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:30.621199 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-63e91a34-af14-4f00-b4c9-0dff3a4a21ac tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:31.020155 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a2eb33f5-734c-491b-89a7-3e378f66a5a0 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67/action" status: 202 len: 0 microversion: 2.25 time: 6.086659 Jul 19 22:31:31.025862 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 696/1374] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Jul 19 22:31:24 2022] POST /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67/action => generated 0 bytes in 6093 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:31:31.032574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a5181de9-7e42-4698-8a58-ce972114b835 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:31.033748 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a5181de9-7e42-4698-8a58-ce972114b835 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: e5cee0f0-7a6c-4388-8bbb-25781a0e0442] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:31.053362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5181de9-7e42-4698-8a58-ce972114b835 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:31.054150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5181de9-7e42-4698-8a58-ce972114b835 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:31.054851 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5181de9-7e42-4698-8a58-ce972114b835 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:31.059974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5181de9-7e42-4698-8a58-ce972114b835 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:31.071991 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-a5181de9-7e42-4698-8a58-ce972114b835 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] HTTP exception thrown: Instance e5cee0f0-7a6c-4388-8bbb-25781a0e0442 could not be found. Jul 19 22:31:31.073790 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a5181de9-7e42-4698-8a58-ce972114b835 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Request method failure captured: Jul 19 22:31:31.073790 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442 HTTP/1.1 Jul 19 22:31:31.073790 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:31:31.073790 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:31:31.073790 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:31:31.073790 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:31:31.073790 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:31:31.073790 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:31:31.073790 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:31:31.073790 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:31:31.073790 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y_lSToTGm6PgX7y4oIs7m5rgLyqg2BjZd8UIRxYbJb2m9EeYEMUBVSO6DHIQ83QGW3D2BNOgioifqv3NuMCiblu_B1iW2SpP-MN-RDBJYPyNbMjv8oGahIddMDTYqMxE8B_kTRHiqGPN6emfEZQBLQO7qtQOHZEh90KLuTSeNhouus Jul 19 22:31:31.073790 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:31:31.073790 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:31:31.073790 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:31:31.073790 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:31:31.073790 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:31:31.073790 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:31:31.073790 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 791e176b6751415ca1472c109b3ce011 Jul 19 22:31:31.073790 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersOnMultiNodesTest-1303510158 Jul 19 22:31:31.073790 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:31:31.073790 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:31:31.076483 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_791e176b6751415ca1472c109b3ce011"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/791e176b6751415ca1472c109b3ce011"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/791e176b6751415ca1472c109b3ce011"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/791e176b6751415ca1472c109b3ce011"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:31:31.076483 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersOnMultiNodesTest-1303510158 Jul 19 22:31:31.076483 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 791e176b6751415ca1472c109b3ce011 Jul 19 22:31:31.076483 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1303510158 Jul 19 22:31:31.076483 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersOnMultiNodesTest-1303510158-project Jul 19 22:31:31.076483 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:31:31.076483 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:31:31.076483 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: bd5fb561f7bd429e8c6b2cc30ed76f13 Jul 19 22:31:31.076483 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersOnMultiNodesTest-1303510158-project Jul 19 22:31:31.076483 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:31:31.076483 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance e5cee0f0-7a6c-4388-8bbb-25781a0e0442 could not be found. Jul 19 22:31:31.076483 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'e5cee0f0-7a6c-4388-8bbb-25781a0e0442'} Jul 19 22:31:31.078415 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:31:31.078415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:31.078415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:31:31.078415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:31:31.078415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:31:31.078415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:31:31.078415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:31:31.078415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:31:31.078415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:31:31.078415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:31:31.078415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5cee0f0-7a6c-4388-8bbb-25781a0e0442 could not be found. Jul 19 22:31:31.078415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:31.078415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:31.078415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:31.078415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:31.078415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:31.078415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:31.078415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:31:31.078415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:31:31.078415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:31:31.081789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:31:31.081789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:31:31.081789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:31:31.081789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:31:31.081789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:31:31.081789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:31:31.081789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:31:31.081789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5cee0f0-7a6c-4388-8bbb-25781a0e0442 could not be found. Jul 19 22:31:31.081789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:31.081789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:31.081789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:31.081789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:31.081789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:31.081789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:31.081789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:31:31.081789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:31:31.081789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5cee0f0-7a6c-4388-8bbb-25781a0e0442 could not be found. Jul 19 22:31:31.081789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:31.084293 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a5181de9-7e42-4698-8a58-ce972114b835 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Returning 404 to user: Instance e5cee0f0-7a6c-4388-8bbb-25781a0e0442 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:31:31.084293 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a5181de9-7e42-4698-8a58-ce972114b835 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442" status: 404 len: 111 microversion: 2.1 time: 0.047699 Jul 19 22:31:31.084293 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 697/1375] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:31 2022] GET /compute/v2.1/servers/e5cee0f0-7a6c-4388-8bbb-25781a0e0442 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:31:31.086280 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-63e91a34-af14-4f00-b4c9-0dff3a4a21ac tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:31.087618 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1b52f363-9c2c-4b78-a64e-2ee4df341a3a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a10609550>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:31.109819 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-63e91a34-af14-4f00-b4c9-0dff3a4a21ac tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1463 microversion: 2.1 time: 0.503574 Jul 19 22:31:31.110864 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 679/1376] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:30 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1463 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:31.119604 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a166af33-798a-4645-8e12-109c0b35119f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:31.121272 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a166af33-798a-4645-8e12-109c0b35119f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:31.132448 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a166af33-798a-4645-8e12-109c0b35119f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:31.133033 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a166af33-798a-4645-8e12-109c0b35119f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:31.135137 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a166af33-798a-4645-8e12-109c0b35119f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:31.135832 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a166af33-798a-4645-8e12-109c0b35119f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:31.156492 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1b52f363-9c2c-4b78-a64e-2ee4df341a3a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17" status: 200 len: 1449 microversion: 2.1 time: 0.075382 Jul 19 22:31:31.157438 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 698/1377] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:31:31 2022] GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17 => generated 1449 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:31.167936 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e901e8c5-3bb4-4a8d-9349-c38ffc7b1105 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:31.169421 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e901e8c5-3bb4-4a8d-9349-c38ffc7b1105 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:31.177785 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e901e8c5-3bb4-4a8d-9349-c38ffc7b1105 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:31.178554 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e901e8c5-3bb4-4a8d-9349-c38ffc7b1105 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:31.179976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e901e8c5-3bb4-4a8d-9349-c38ffc7b1105 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:31.182424 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e901e8c5-3bb4-4a8d-9349-c38ffc7b1105 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:31.576729 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a166af33-798a-4645-8e12-109c0b35119f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:31.580512 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e901e8c5-3bb4-4a8d-9349-c38ffc7b1105 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:31.604476 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a166af33-798a-4645-8e12-109c0b35119f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1464 microversion: 2.1 time: 0.491450 Jul 19 22:31:31.605528 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 680/1378] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:31 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1464 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:31.615311 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7575d5ff-412f-4d15-8179-fa212e8dfa14 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:31.617064 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e901e8c5-3bb4-4a8d-9349-c38ffc7b1105 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:31.619957 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7575d5ff-412f-4d15-8179-fa212e8dfa14 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 67fd85a5-6cde-4aa6-acf2-99640be2bb44] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:31.620975 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e901e8c5-3bb4-4a8d-9349-c38ffc7b1105 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:31.625205 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e901e8c5-3bb4-4a8d-9349-c38ffc7b1105 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 0.465354 Jul 19 22:31:31.625768 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 699/1379] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:31:31 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:31:31.638210 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7575d5ff-412f-4d15-8179-fa212e8dfa14 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:31.638894 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7575d5ff-412f-4d15-8179-fa212e8dfa14 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:31.640534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7575d5ff-412f-4d15-8179-fa212e8dfa14 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:31.641093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7575d5ff-412f-4d15-8179-fa212e8dfa14 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:31.676044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7575d5ff-412f-4d15-8179-fa212e8dfa14 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 67fd85a5-6cde-4aa6-acf2-99640be2bb44] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:31:31.780020 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7575d5ff-412f-4d15-8179-fa212e8dfa14 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "DELETE /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44" status: 204 len: 0 microversion: 2.1 time: 0.172138 Jul 19 22:31:31.785753 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 681/1380] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:31:31 2022] DELETE /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:31:31.797538 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b9adf550-f542-4b9d-91c4-1f87ba970058 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a10043430>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:31.870829 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b9adf550-f542-4b9d-91c4-1f87ba970058 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17" status: 200 len: 1449 microversion: 2.1 time: 0.082557 Jul 19 22:31:31.871622 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 682/1381] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:31:31 2022] GET /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17 => generated 1449 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:31.876849 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d9b37473-01b7-403b-b6b9-968a11bfe741 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:31.877577 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d9b37473-01b7-403b-b6b9-968a11bfe741 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:31.885838 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d9b37473-01b7-403b-b6b9-968a11bfe741 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:31.886216 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d9b37473-01b7-403b-b6b9-968a11bfe741 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:31.887140 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d9b37473-01b7-403b-b6b9-968a11bfe741 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:31.887947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d9b37473-01b7-403b-b6b9-968a11bfe741 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:31.936956 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-844dfe89-ea1b-4b06-8244-2d6aa83e7438 tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:31.937746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-844dfe89-ea1b-4b06-8244-2d6aa83e7438 tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:31.944766 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-844dfe89-ea1b-4b06-8244-2d6aa83e7438 tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:31.945220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-844dfe89-ea1b-4b06-8244-2d6aa83e7438 tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:31.946087 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-844dfe89-ea1b-4b06-8244-2d6aa83e7438 tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:31.946526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-844dfe89-ea1b-4b06-8244-2d6aa83e7438 tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:32.203722 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d9b37473-01b7-403b-b6b9-968a11bfe741 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:32.207913 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-844dfe89-ea1b-4b06-8244-2d6aa83e7438 tempest-MigrationsAdminTest-300891642 tempest-MigrationsAdminTest-300891642-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1614 microversion: 2.1 time: 0.580909 Jul 19 22:31:32.208576 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 700/1382] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:31 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1614 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:32.213379 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d9b37473-01b7-403b-b6b9-968a11bfe741 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1718 microversion: 2.1 time: 0.340291 Jul 19 22:31:32.213957 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 683/1383] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:31 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1718 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:32.218648 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dd453e89-0503-4d74-a837-29abeaa9ae2a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:32.219490 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dd453e89-0503-4d74-a837-29abeaa9ae2a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 67fd85a5-6cde-4aa6-acf2-99640be2bb44] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:32.225773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd453e89-0503-4d74-a837-29abeaa9ae2a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:32.226461 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd453e89-0503-4d74-a837-29abeaa9ae2a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:32.228020 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd453e89-0503-4d74-a837-29abeaa9ae2a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:32.228878 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd453e89-0503-4d74-a837-29abeaa9ae2a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:32.236375 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e04c90f0-5a55-40f6-b574-ed91f189d5ca tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:32.240241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e04c90f0-5a55-40f6-b574-ed91f189d5ca tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:32.252604 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e04c90f0-5a55-40f6-b574-ed91f189d5ca tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:32.253450 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e04c90f0-5a55-40f6-b574-ed91f189d5ca tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:32.254749 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e04c90f0-5a55-40f6-b574-ed91f189d5ca tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:32.255598 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e04c90f0-5a55-40f6-b574-ed91f189d5ca tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:32.377342 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-e04c90f0-5a55-40f6-b574-ed91f189d5ca tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:31:32.378105 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-e04c90f0-5a55-40f6-b574-ed91f189d5ca tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:31:32.378947 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-e04c90f0-5a55-40f6-b574-ed91f189d5ca tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:31:32.379717 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-e04c90f0-5a55-40f6-b574-ed91f189d5ca tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:31:32.380419 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-e04c90f0-5a55-40f6-b574-ed91f189d5ca tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:31:32.418888 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dd453e89-0503-4d74-a837-29abeaa9ae2a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:32.428803 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dd453e89-0503-4d74-a837-29abeaa9ae2a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44" status: 200 len: 1472 microversion: 2.1 time: 0.213645 Jul 19 22:31:32.429389 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 684/1384] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:32 2022] GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44 => generated 1472 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:32.440274 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ef8d290d-6ef3-4f44-ba19-046bbb219c3d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a103f4700>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:32.458336 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e04c90f0-5a55-40f6-b574-ed91f189d5ca tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:32.468053 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e04c90f0-5a55-40f6-b574-ed91f189d5ca tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:32.468825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e04c90f0-5a55-40f6-b574-ed91f189d5ca tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:32.470164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e04c90f0-5a55-40f6-b574-ed91f189d5ca tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:32.470928 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e04c90f0-5a55-40f6-b574-ed91f189d5ca tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:32.530043 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e04c90f0-5a55-40f6-b574-ed91f189d5ca tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "POST /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613/action" status: 202 len: 1068 microversion: 2.1 time: 0.309067 Jul 19 22:31:32.530884 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 701/1385] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:31:32 2022] POST /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613/action => generated 1068 bytes in 322 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 19 22:31:32.547831 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b4f4a946-2d68-45bf-938e-08872888475e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:32.548882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b4f4a946-2d68-45bf-938e-08872888475e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:32.560861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b4f4a946-2d68-45bf-938e-08872888475e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:32.561731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b4f4a946-2d68-45bf-938e-08872888475e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:32.563093 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b4f4a946-2d68-45bf-938e-08872888475e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:32.563867 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b4f4a946-2d68-45bf-938e-08872888475e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:32.572970 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:31:32.604382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b4f4a946-2d68-45bf-938e-08872888475e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:31:32.713853 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b4f4a946-2d68-45bf-938e-08872888475e tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 204 len: 0 microversion: 2.1 time: 0.175457 Jul 19 22:31:32.714219 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 702/1386] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:31:32 2022] DELETE /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:31:32.721721 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b4d59956-2b59-44eb-9531-b65fe59463e5 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:32.722872 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b4d59956-2b59-44eb-9531-b65fe59463e5 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:32.730974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b4d59956-2b59-44eb-9531-b65fe59463e5 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:32.732036 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b4d59956-2b59-44eb-9531-b65fe59463e5 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:32.733037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b4d59956-2b59-44eb-9531-b65fe59463e5 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:32.733820 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b4d59956-2b59-44eb-9531-b65fe59463e5 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:32.928318 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b4d59956-2b59-44eb-9531-b65fe59463e5 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:32.938258 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b4d59956-2b59-44eb-9531-b65fe59463e5 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1473 microversion: 2.1 time: 0.222534 Jul 19 22:31:32.939064 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 703/1387] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:32 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1473 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:32.944462 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f8caebf2-454d-4af7-a9a8-bbdfa2faa954 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:32.945596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f8caebf2-454d-4af7-a9a8-bbdfa2faa954 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:32.955754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f8caebf2-454d-4af7-a9a8-bbdfa2faa954 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:32.956619 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f8caebf2-454d-4af7-a9a8-bbdfa2faa954 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:32.957906 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f8caebf2-454d-4af7-a9a8-bbdfa2faa954 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:32.958501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f8caebf2-454d-4af7-a9a8-bbdfa2faa954 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:33.151968 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f8caebf2-454d-4af7-a9a8-bbdfa2faa954 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:33.166144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f8caebf2-454d-4af7-a9a8-bbdfa2faa954 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:33.168011 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f8caebf2-454d-4af7-a9a8-bbdfa2faa954 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:33.169044 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f8caebf2-454d-4af7-a9a8-bbdfa2faa954 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 0.228669 Jul 19 22:31:33.169655 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 704/1388] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:31:32 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:31:33.174282 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dca859fe-cb7b-4428-b7d2-95488be4c5be tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:33.174902 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dca859fe-cb7b-4428-b7d2-95488be4c5be tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:33.181461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dca859fe-cb7b-4428-b7d2-95488be4c5be tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:33.181896 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dca859fe-cb7b-4428-b7d2-95488be4c5be tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:33.182649 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dca859fe-cb7b-4428-b7d2-95488be4c5be tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:33.183098 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dca859fe-cb7b-4428-b7d2-95488be4c5be tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:33.333343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dca859fe-cb7b-4428-b7d2-95488be4c5be tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:33.342264 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dca859fe-cb7b-4428-b7d2-95488be4c5be tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1469 microversion: 2.1 time: 0.171609 Jul 19 22:31:33.342860 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 705/1389] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:33 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1469 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:33.488472 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ef8d290d-6ef3-4f44-ba19-046bbb219c3d tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "DELETE /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17" status: 204 len: 0 microversion: 2.1 time: 1.057797 Jul 19 22:31:33.490219 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 685/1390] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:32 2022] DELETE /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17 => generated 0 bytes in 1060 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:31:33.496357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8a4e2cd9-b08c-4930-8f40-65813943f095 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:33.496976 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8a4e2cd9-b08c-4930-8f40-65813943f095 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:33.503802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8a4e2cd9-b08c-4930-8f40-65813943f095 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:33.504299 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8a4e2cd9-b08c-4930-8f40-65813943f095 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:33.505122 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8a4e2cd9-b08c-4930-8f40-65813943f095 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:33.505582 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8a4e2cd9-b08c-4930-8f40-65813943f095 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:33.575081 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6b3b50c0-dd73-4e83-ba5b-093bd9ac9216 tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] Calling method '.version_select at 0x7f7a1080f160>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:33.599949 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-6b3b50c0-dd73-4e83-ba5b-093bd9ac9216 tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] HTTP exception thrown: Image not found. Jul 19 22:31:33.626447 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6b3b50c0-dd73-4e83-ba5b-093bd9ac9216 tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] Request method failure captured: Jul 19 22:31:33.626447 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/images/9f4c7bbb-de53-4b55-92b4-d6f115d69bdb/metadata/os_distro HTTP/1.1 Jul 19 22:31:33.626447 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:31:33.626447 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:31:33.626447 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:31:33.626447 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:31:33.626447 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:31:33.626447 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:31:33.626447 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:31:33.626447 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:31:33.626447 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zDF1BJLjdNc4lrE1W3UmYLOroBgK9TeXODdLQUG7JAkXZQj16NqnjZRgD9Dym1fORR_SBZoH7FRwFb2VQjsO-XaFp4Y-dD5710g789TZrUa-WlrRkqRC0R7-Zqi2gLe9PbQLgttULxxaAk1etNeKKIgtk7yT929eRau-zUi4JAMACc Jul 19 22:31:33.626447 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:31:33.626447 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:31:33.626447 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:31:33.626447 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:31:33.626447 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:31:33.626447 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:31:33.626447 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 67880865d6c54df797d5fc3e8f9d7c6d Jul 19 22:31:33.626447 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1279034598 Jul 19 22:31:33.626447 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:31:33.626447 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:31:33.628242 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_67880865d6c54df797d5fc3e8f9d7c6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67880865d6c54df797d5fc3e8f9d7c6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/67880865d6c54df797d5fc3e8f9d7c6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67880865d6c54df797d5fc3e8f9d7c6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:31:33.628242 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1279034598 Jul 19 22:31:33.628242 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 67880865d6c54df797d5fc3e8f9d7c6d Jul 19 22:31:33.628242 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1279034598 Jul 19 22:31:33.628242 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ImagesMetadataNegativeTestJSON-1279034598-project Jul 19 22:31:33.628242 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:31:33.628242 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:31:33.628242 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 12b054f19ba34445b278fdc5f2c7a78a Jul 19 22:31:33.628242 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1279034598-project Jul 19 22:31:33.628242 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:31:33.628242 n-d-847009-3 devstack@n-api.service[119337]: exception: Image not found. Jul 19 22:31:33.628242 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'image_id': '9f4c7bbb-de53-4b55-92b4-d6f115d69bdb', 'id': 'os_distro'} Jul 19 22:31:33.628242 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:31:33.629544 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:33.629544 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 22:31:33.629544 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 22:31:33.629544 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:31:33.629544 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:31:33.629544 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 22:31:33.629544 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 22:31:33.629544 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:31:33.629544 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:31:33.629544 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 22:31:33.629544 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 22:31:33.629544 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 22:31:33.629544 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 22:31:33.629544 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:31:33.629544 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:31:33.629544 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:31:33.629544 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:31:33.629544 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9f4c7bbb-de53-4b55-92b4-d6f115d69bdb Jul 19 22:31:33.631280 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.631280 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:33.631280 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.631280 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:33.631280 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 19 22:31:33.631280 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 19 22:31:33.631280 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 22:31:33.631280 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 22:31:33.631280 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 22:31:33.631280 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 22:31:33.631280 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 22:31:33.631280 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 22:31:33.631280 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 22:31:33.631280 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 22:31:33.631280 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:31:33.631280 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:31:33.631280 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 22:31:33.631280 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 22:31:33.631280 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:31:33.631280 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:31:33.634165 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 22:31:33.634165 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 22:31:33.634165 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 22:31:33.634165 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 22:31:33.634165 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:31:33.634165 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:31:33.634165 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:31:33.634165 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:31:33.634165 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9f4c7bbb-de53-4b55-92b4-d6f115d69bdb could not be found. Jul 19 22:31:33.634165 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.634165 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:33.634165 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.634165 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:33.634165 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:33.634165 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:33.634165 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:31:33.634165 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:31:33.634165 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:31:33.634165 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:31:33.635874 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:31:33.635874 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:31:33.635874 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 19 22:31:33.635874 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 19 22:31:33.635874 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 19 22:31:33.635874 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 22:31:33.635874 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 22:31:33.635874 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.635874 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:33.635874 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.635874 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:33.635874 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:33.635874 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:33.635874 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:31:33.635874 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:31:33.635874 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 22:31:33.635874 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.635874 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6b3b50c0-dd73-4e83-ba5b-093bd9ac9216 tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] Returning 404 to user: Image not found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:31:33.639551 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6b3b50c0-dd73-4e83-ba5b-093bd9ac9216 tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] 10.222.0.25 "DELETE /compute/v2.1/images/9f4c7bbb-de53-4b55-92b4-d6f115d69bdb/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.284527 Jul 19 22:31:33.639551 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 706/1391] 10.222.0.25 () {58 vars in 1292 bytes} [Tue Jul 19 22:31:33 2022] DELETE /compute/v2.1/images/9f4c7bbb-de53-4b55-92b4-d6f115d69bdb/metadata/os_distro => generated 62 bytes in 286 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:31:33.639551 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d0c43802-1eff-4c69-89e8-76705fde4611 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:33.639551 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d0c43802-1eff-4c69-89e8-76705fde4611 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 67fd85a5-6cde-4aa6-acf2-99640be2bb44] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:33.646259 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0c43802-1eff-4c69-89e8-76705fde4611 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:33.646706 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0c43802-1eff-4c69-89e8-76705fde4611 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:33.647575 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0c43802-1eff-4c69-89e8-76705fde4611 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:33.648170 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0c43802-1eff-4c69-89e8-76705fde4611 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:33.663142 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8a4e2cd9-b08c-4930-8f40-65813943f095 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:33.672340 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8a4e2cd9-b08c-4930-8f40-65813943f095 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1718 microversion: 2.1 time: 0.180850 Jul 19 22:31:33.672929 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 686/1392] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:33 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1718 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:33.677572 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-da730dc0-0054-48b0-98fd-d3ea6a30a4df tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:33.678066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-da730dc0-0054-48b0-98fd-d3ea6a30a4df tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: f94bf14c-804e-4058-9ed8-037dd0a8ef98] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:33.685453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da730dc0-0054-48b0-98fd-d3ea6a30a4df tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:33.685893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da730dc0-0054-48b0-98fd-d3ea6a30a4df tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:33.686679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da730dc0-0054-48b0-98fd-d3ea6a30a4df tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:33.687132 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da730dc0-0054-48b0-98fd-d3ea6a30a4df tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:33.705908 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:31:33.720323 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-da730dc0-0054-48b0-98fd-d3ea6a30a4df tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: f94bf14c-804e-4058-9ed8-037dd0a8ef98] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:31:33.805089 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-da730dc0-0054-48b0-98fd-d3ea6a30a4df tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98" status: 204 len: 0 microversion: 2.1 time: 0.130667 Jul 19 22:31:33.805922 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 687/1393] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:31:33 2022] DELETE /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:31:33.811764 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d0c43802-1eff-4c69-89e8-76705fde4611 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:33.813904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fc371799-5ec4-4451-955e-8efae961b295 tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] Calling method '.version_select at 0x7f7a10076f70>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:33.825463 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d0c43802-1eff-4c69-89e8-76705fde4611 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44" status: 200 len: 1472 microversion: 2.1 time: 0.194856 Jul 19 22:31:33.826564 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 707/1394] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:33 2022] GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44 => generated 1472 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:33.846274 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-fc371799-5ec4-4451-955e-8efae961b295 tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] HTTP exception thrown: Image not found. Jul 19 22:31:33.850526 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fc371799-5ec4-4451-955e-8efae961b295 tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] Request method failure captured: Jul 19 22:31:33.850526 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/images/b13bad05-dd32-4a4e-94c4-77d7d0f9a1de/metadata/os_version HTTP/1.1 Jul 19 22:31:33.850526 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:31:33.850526 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:31:33.850526 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:31:33.850526 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:31:33.850526 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:31:33.850526 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:31:33.850526 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:31:33.850526 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:31:33.850526 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zDF1BJLjdNc4lrE1W3UmYLOroBgK9TeXODdLQUG7JAkXZQj16NqnjZRgD9Dym1fORR_SBZoH7FRwFb2VQjsO-XaFp4Y-dD5710g789TZrUa-WlrRkqRC0R7-Zqi2gLe9PbQLgttULxxaAk1etNeKKIgtk7yT929eRau-zUi4JAMACc Jul 19 22:31:33.850526 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:31:33.850526 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:31:33.850526 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:31:33.850526 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:31:33.850526 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:31:33.850526 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:31:33.850526 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 67880865d6c54df797d5fc3e8f9d7c6d Jul 19 22:31:33.850526 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1279034598 Jul 19 22:31:33.850526 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:31:33.850526 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:31:33.853734 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_67880865d6c54df797d5fc3e8f9d7c6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67880865d6c54df797d5fc3e8f9d7c6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/67880865d6c54df797d5fc3e8f9d7c6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67880865d6c54df797d5fc3e8f9d7c6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:31:33.853734 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1279034598 Jul 19 22:31:33.853734 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 67880865d6c54df797d5fc3e8f9d7c6d Jul 19 22:31:33.853734 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1279034598 Jul 19 22:31:33.853734 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesMetadataNegativeTestJSON-1279034598-project Jul 19 22:31:33.853734 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:31:33.853734 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:31:33.853734 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 12b054f19ba34445b278fdc5f2c7a78a Jul 19 22:31:33.853734 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1279034598-project Jul 19 22:31:33.853734 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:31:33.853734 n-d-847009-3 devstack@n-api.service[119338]: exception: Image not found. Jul 19 22:31:33.853734 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'image_id': 'b13bad05-dd32-4a4e-94c4-77d7d0f9a1de', 'id': 'os_version'} Jul 19 22:31:33.853734 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:31:33.854840 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:33.854840 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 22:31:33.854840 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 22:31:33.854840 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:31:33.854840 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:31:33.854840 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 22:31:33.854840 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 22:31:33.854840 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:31:33.854840 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:31:33.854840 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 22:31:33.854840 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 22:31:33.854840 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 22:31:33.854840 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 22:31:33.854840 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:31:33.854840 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:31:33.854840 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:31:33.854840 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:31:33.854840 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b13bad05-dd32-4a4e-94c4-77d7d0f9a1de Jul 19 22:31:33.856413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.856413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:33.856413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.856413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:33.856413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 19 22:31:33.856413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 19 22:31:33.856413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 22:31:33.856413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 22:31:33.856413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 22:31:33.856413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 22:31:33.856413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 22:31:33.856413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 22:31:33.856413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 22:31:33.856413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 22:31:33.856413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:31:33.856413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:31:33.856413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 22:31:33.856413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 22:31:33.856413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:31:33.856413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:31:33.857804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 22:31:33.857804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 22:31:33.857804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 22:31:33.857804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 22:31:33.857804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:31:33.857804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:31:33.857804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:31:33.857804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:31:33.857804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b13bad05-dd32-4a4e-94c4-77d7d0f9a1de could not be found. Jul 19 22:31:33.857804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.857804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:33.857804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.857804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:33.857804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:33.857804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:33.857804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:31:33.857804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:31:33.857804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:31:33.857804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:31:33.859279 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:31:33.859279 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:31:33.859279 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 19 22:31:33.859279 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 19 22:31:33.859279 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 19 22:31:33.859279 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 22:31:33.859279 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 22:31:33.859279 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.859279 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:33.859279 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.859279 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:33.859279 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:33.859279 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:33.859279 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:31:33.859279 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:31:33.859279 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 22:31:33.859279 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.859279 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fc371799-5ec4-4451-955e-8efae961b295 tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] Returning 404 to user: Image not found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:31:33.860710 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fc371799-5ec4-4451-955e-8efae961b295 tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] 10.222.0.25 "GET /compute/v2.1/images/b13bad05-dd32-4a4e-94c4-77d7d0f9a1de/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.044228 Jul 19 22:31:33.860710 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 688/1395] 10.222.0.25 () {58 vars in 1292 bytes} [Tue Jul 19 22:31:33 2022] GET /compute/v2.1/images/b13bad05-dd32-4a4e-94c4-77d7d0f9a1de/metadata/os_version => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:31:33.864110 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1647ba3d-0506-4ea0-823d-16ce43e51444 tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] Calling method '.version_select at 0x7f7a1040f8b0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:33.889017 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-1647ba3d-0506-4ea0-823d-16ce43e51444 tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] HTTP exception thrown: Image not found. Jul 19 22:31:33.891736 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1647ba3d-0506-4ea0-823d-16ce43e51444 tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] Request method failure captured: Jul 19 22:31:33.891736 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/images/8e6817da-de54-496a-a9df-56960b656f6c/metadata HTTP/1.1 Jul 19 22:31:33.891736 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:31:33.891736 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:31:33.891736 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:31:33.891736 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:31:33.891736 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:31:33.891736 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:31:33.891736 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:31:33.891736 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:31:33.891736 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zDF1BJLjdNc4lrE1W3UmYLOroBgK9TeXODdLQUG7JAkXZQj16NqnjZRgD9Dym1fORR_SBZoH7FRwFb2VQjsO-XaFp4Y-dD5710g789TZrUa-WlrRkqRC0R7-Zqi2gLe9PbQLgttULxxaAk1etNeKKIgtk7yT929eRau-zUi4JAMACc Jul 19 22:31:33.891736 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:31:33.891736 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:31:33.891736 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:31:33.891736 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:31:33.891736 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:31:33.891736 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:31:33.891736 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 67880865d6c54df797d5fc3e8f9d7c6d Jul 19 22:31:33.891736 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1279034598 Jul 19 22:31:33.891736 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:31:33.891736 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:31:33.893291 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_67880865d6c54df797d5fc3e8f9d7c6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67880865d6c54df797d5fc3e8f9d7c6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/67880865d6c54df797d5fc3e8f9d7c6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67880865d6c54df797d5fc3e8f9d7c6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:31:33.893291 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1279034598 Jul 19 22:31:33.893291 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 67880865d6c54df797d5fc3e8f9d7c6d Jul 19 22:31:33.893291 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1279034598 Jul 19 22:31:33.893291 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ImagesMetadataNegativeTestJSON-1279034598-project Jul 19 22:31:33.893291 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:31:33.893291 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:31:33.893291 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 12b054f19ba34445b278fdc5f2c7a78a Jul 19 22:31:33.893291 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1279034598-project Jul 19 22:31:33.893291 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:31:33.893291 n-d-847009-3 devstack@n-api.service[119337]: exception: Image not found. Jul 19 22:31:33.893291 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'image_id': '8e6817da-de54-496a-a9df-56960b656f6c'} Jul 19 22:31:33.893291 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:31:33.894513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:33.894513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 22:31:33.894513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 22:31:33.894513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:31:33.894513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:31:33.894513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 22:31:33.894513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 22:31:33.894513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:31:33.894513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:31:33.894513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 22:31:33.894513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 22:31:33.894513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 22:31:33.894513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 22:31:33.894513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:31:33.894513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:31:33.894513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:31:33.894513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:31:33.894513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8e6817da-de54-496a-a9df-56960b656f6c Jul 19 22:31:33.896109 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.896109 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:33.896109 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.896109 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:33.896109 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 19 22:31:33.896109 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 19 22:31:33.896109 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 22:31:33.896109 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 22:31:33.896109 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 22:31:33.896109 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 22:31:33.896109 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 22:31:33.896109 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 22:31:33.896109 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 22:31:33.896109 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 22:31:33.896109 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:31:33.896109 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:31:33.896109 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 22:31:33.896109 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 22:31:33.896109 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:31:33.896109 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:31:33.897561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 22:31:33.897561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 22:31:33.897561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 22:31:33.897561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 22:31:33.897561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:31:33.897561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:31:33.897561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:31:33.897561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:31:33.897561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8e6817da-de54-496a-a9df-56960b656f6c could not be found. Jul 19 22:31:33.897561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.897561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:33.897561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.897561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:33.897561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:33.897561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:33.897561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:31:33.897561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:31:33.897561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:31:33.897561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:31:33.898936 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:31:33.898936 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:31:33.898936 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 19 22:31:33.898936 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 19 22:31:33.898936 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 19 22:31:33.898936 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 22:31:33.898936 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 22:31:33.898936 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.898936 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:33.898936 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.898936 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:33.898936 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:33.898936 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:33.898936 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:31:33.898936 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:31:33.898936 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 22:31:33.898936 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.898936 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1647ba3d-0506-4ea0-823d-16ce43e51444 tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] Returning 404 to user: Image not found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:31:33.900704 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1647ba3d-0506-4ea0-823d-16ce43e51444 tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] 10.222.0.25 "GET /compute/v2.1/images/8e6817da-de54-496a-a9df-56960b656f6c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.033518 Jul 19 22:31:33.900704 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 708/1396] 10.222.0.25 () {58 vars in 1259 bytes} [Tue Jul 19 22:31:33 2022] GET /compute/v2.1/images/8e6817da-de54-496a-a9df-56960b656f6c/metadata => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:31:33.906829 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a3d1226d-e1ce-4a7c-837a-7b58fe2b8be9 tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] Action: 'update_all', calling method: .version_select at 0x7f7a103c4820>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:33.933244 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-a3d1226d-e1ce-4a7c-837a-7b58fe2b8be9 tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] HTTP exception thrown: Image not found. Jul 19 22:31:33.935483 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a3d1226d-e1ce-4a7c-837a-7b58fe2b8be9 tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] Request method failure captured: Jul 19 22:31:33.935483 n-d-847009-3 devstack@n-api.service[119338]: request: PUT /compute/v2.1/images/b2b45046-38b2-4f20-ae49-29ae83603c28/metadata HTTP/1.1 Jul 19 22:31:33.935483 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:31:33.935483 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:31:33.935483 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:31:33.935483 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 57 Jul 19 22:31:33.935483 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:31:33.935483 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:31:33.935483 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:31:33.935483 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:31:33.935483 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zDF1BJLjdNc4lrE1W3UmYLOroBgK9TeXODdLQUG7JAkXZQj16NqnjZRgD9Dym1fORR_SBZoH7FRwFb2VQjsO-XaFp4Y-dD5710g789TZrUa-WlrRkqRC0R7-Zqi2gLe9PbQLgttULxxaAk1etNeKKIgtk7yT929eRau-zUi4JAMACc Jul 19 22:31:33.935483 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:31:33.935483 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:31:33.935483 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:31:33.935483 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:31:33.935483 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:31:33.935483 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:31:33.935483 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 67880865d6c54df797d5fc3e8f9d7c6d Jul 19 22:31:33.935483 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1279034598 Jul 19 22:31:33.935483 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:31:33.935483 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:31:33.936915 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_67880865d6c54df797d5fc3e8f9d7c6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67880865d6c54df797d5fc3e8f9d7c6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/67880865d6c54df797d5fc3e8f9d7c6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67880865d6c54df797d5fc3e8f9d7c6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:31:33.936915 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1279034598 Jul 19 22:31:33.936915 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 67880865d6c54df797d5fc3e8f9d7c6d Jul 19 22:31:33.936915 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1279034598 Jul 19 22:31:33.936915 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesMetadataNegativeTestJSON-1279034598-project Jul 19 22:31:33.936915 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:31:33.936915 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:31:33.936915 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 12b054f19ba34445b278fdc5f2c7a78a Jul 19 22:31:33.936915 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1279034598-project Jul 19 22:31:33.936915 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:31:33.936915 n-d-847009-3 devstack@n-api.service[119338]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 19 22:31:33.936915 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:31:33.936915 n-d-847009-3 devstack@n-api.service[119338]: exception: Image not found. Jul 19 22:31:33.936915 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'image_id': 'b2b45046-38b2-4f20-ae49-29ae83603c28', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 19 22:31:33.942660 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:31:33.942660 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:33.942660 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 22:31:33.942660 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 22:31:33.942660 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:31:33.942660 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:31:33.942660 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 22:31:33.942660 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 22:31:33.942660 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:31:33.942660 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:31:33.942660 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 22:31:33.942660 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 22:31:33.942660 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 22:31:33.942660 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 22:31:33.942660 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:31:33.942660 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:31:33.942660 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:31:33.942660 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:31:33.944143 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b2b45046-38b2-4f20-ae49-29ae83603c28 Jul 19 22:31:33.944143 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.944143 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:33.944143 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.944143 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:33.944143 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 19 22:31:33.944143 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 19 22:31:33.944143 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 22:31:33.944143 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 22:31:33.944143 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 22:31:33.944143 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 22:31:33.944143 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 22:31:33.944143 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 22:31:33.944143 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 22:31:33.944143 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 22:31:33.944143 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:31:33.944143 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:31:33.944143 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 22:31:33.944143 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 22:31:33.945630 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:31:33.945630 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:31:33.945630 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 22:31:33.945630 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 22:31:33.945630 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 22:31:33.945630 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 22:31:33.945630 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:31:33.945630 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:31:33.945630 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:31:33.945630 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:31:33.945630 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b2b45046-38b2-4f20-ae49-29ae83603c28 could not be found. Jul 19 22:31:33.945630 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.945630 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:33.945630 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.945630 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:33.945630 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:33.945630 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:33.945630 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:31:33.945630 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:31:33.947760 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:31:33.947760 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:31:33.947760 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:31:33.947760 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:31:33.947760 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:31:33.947760 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:31:33.947760 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 19 22:31:33.947760 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 19 22:31:33.947760 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 19 22:31:33.947760 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 22:31:33.947760 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 22:31:33.947760 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.947760 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:33.947760 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.947760 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:33.947760 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:33.947760 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:33.947760 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:31:33.947760 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:31:33.947760 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 22:31:33.947760 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.949392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a3d1226d-e1ce-4a7c-837a-7b58fe2b8be9 tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] Returning 404 to user: Image not found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:31:33.949392 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a3d1226d-e1ce-4a7c-837a-7b58fe2b8be9 tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] 10.222.0.25 "PUT /compute/v2.1/images/b2b45046-38b2-4f20-ae49-29ae83603c28/metadata" status: 404 len: 62 microversion: 2.1 time: 0.036029 Jul 19 22:31:33.949392 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 689/1397] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 22:31:33 2022] PUT /compute/v2.1/images/b2b45046-38b2-4f20-ae49-29ae83603c28/metadata => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:31:33.950484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ddea6ac8-e7b5-4560-873b-93d6e3d0f83a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1807815555", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "5684cb20-bc75-42db-91c0-b2fe6d252169"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:33.951655 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fab5bd57-c5fc-403f-a756-d2255fa36044 tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] Action: 'update', calling method: .version_select at 0x7f7a1044c280>, body: {"meta": {"os_distro": "alt"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:33.980761 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-fab5bd57-c5fc-403f-a756-d2255fa36044 tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] HTTP exception thrown: Image not found. Jul 19 22:31:33.984452 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fab5bd57-c5fc-403f-a756-d2255fa36044 tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] Request method failure captured: Jul 19 22:31:33.984452 n-d-847009-3 devstack@n-api.service[119338]: request: PUT /compute/v2.1/images/85f38659-0523-4148-ae92-9e339c488c69/metadata/os_distro HTTP/1.1 Jul 19 22:31:33.984452 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:31:33.984452 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:31:33.984452 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:31:33.984452 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 30 Jul 19 22:31:33.984452 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:31:33.984452 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:31:33.984452 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:31:33.984452 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:31:33.984452 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zDF1BJLjdNc4lrE1W3UmYLOroBgK9TeXODdLQUG7JAkXZQj16NqnjZRgD9Dym1fORR_SBZoH7FRwFb2VQjsO-XaFp4Y-dD5710g789TZrUa-WlrRkqRC0R7-Zqi2gLe9PbQLgttULxxaAk1etNeKKIgtk7yT929eRau-zUi4JAMACc Jul 19 22:31:33.984452 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:31:33.984452 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:31:33.984452 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:31:33.984452 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:31:33.984452 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:31:33.984452 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:31:33.984452 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 67880865d6c54df797d5fc3e8f9d7c6d Jul 19 22:31:33.984452 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1279034598 Jul 19 22:31:33.984452 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:31:33.984452 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:31:33.985970 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_67880865d6c54df797d5fc3e8f9d7c6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67880865d6c54df797d5fc3e8f9d7c6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/67880865d6c54df797d5fc3e8f9d7c6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67880865d6c54df797d5fc3e8f9d7c6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:31:33.985970 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1279034598 Jul 19 22:31:33.985970 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 67880865d6c54df797d5fc3e8f9d7c6d Jul 19 22:31:33.985970 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1279034598 Jul 19 22:31:33.985970 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesMetadataNegativeTestJSON-1279034598-project Jul 19 22:31:33.985970 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:31:33.985970 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:31:33.985970 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 12b054f19ba34445b278fdc5f2c7a78a Jul 19 22:31:33.985970 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1279034598-project Jul 19 22:31:33.985970 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:31:33.985970 n-d-847009-3 devstack@n-api.service[119338]: {"meta": {"os_distro": "alt"}} Jul 19 22:31:33.985970 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:31:33.985970 n-d-847009-3 devstack@n-api.service[119338]: exception: Image not found. Jul 19 22:31:33.985970 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'image_id': '85f38659-0523-4148-ae92-9e339c488c69', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 19 22:31:33.986990 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:31:33.986990 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:33.986990 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 22:31:33.986990 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 22:31:33.986990 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:31:33.986990 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:31:33.986990 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 22:31:33.986990 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 22:31:33.986990 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:31:33.986990 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:31:33.986990 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 22:31:33.986990 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 22:31:33.986990 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 22:31:33.986990 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 22:31:33.986990 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:31:33.986990 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:31:33.986990 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:31:33.986990 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:31:33.988182 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 85f38659-0523-4148-ae92-9e339c488c69 Jul 19 22:31:33.988182 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.988182 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:33.988182 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.988182 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:33.988182 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 19 22:31:33.988182 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 19 22:31:33.988182 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 22:31:33.988182 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 22:31:33.988182 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 22:31:33.988182 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 22:31:33.988182 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 22:31:33.988182 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 22:31:33.988182 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 22:31:33.988182 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 22:31:33.988182 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:31:33.988182 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:31:33.988182 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 22:31:33.988182 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 22:31:33.989405 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:31:33.989405 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:31:33.989405 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 22:31:33.989405 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 22:31:33.989405 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 22:31:33.989405 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 22:31:33.989405 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:31:33.989405 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:31:33.989405 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:31:33.989405 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:31:33.989405 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 85f38659-0523-4148-ae92-9e339c488c69 could not be found. Jul 19 22:31:33.989405 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.989405 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:33.989405 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.989405 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:33.989405 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:33.989405 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:33.989405 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:31:33.989405 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:31:33.990541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:31:33.990541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:31:33.990541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:31:33.990541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:31:33.990541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:31:33.990541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:31:33.990541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 19 22:31:33.990541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 19 22:31:33.990541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 19 22:31:33.990541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 22:31:33.990541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 22:31:33.990541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.990541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:33.990541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.990541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:33.990541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:33.990541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:33.990541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:31:33.990541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:31:33.990541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 22:31:33.990541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:33.991874 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fab5bd57-c5fc-403f-a756-d2255fa36044 tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] Returning 404 to user: Image not found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:31:33.991874 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fab5bd57-c5fc-403f-a756-d2255fa36044 tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] 10.222.0.25 "PUT /compute/v2.1/images/85f38659-0523-4148-ae92-9e339c488c69/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.041344 Jul 19 22:31:33.991874 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 690/1398] 10.222.0.25 () {60 vars in 1309 bytes} [Tue Jul 19 22:31:33 2022] PUT /compute/v2.1/images/85f38659-0523-4148-ae92-9e339c488c69/metadata/os_distro => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:31:33.993113 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-30b57bb3-cbee-4b02-bc15-46f9948447dc tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:33.994638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-30b57bb3-cbee-4b02-bc15-46f9948447dc tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:34.003785 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-30b57bb3-cbee-4b02-bc15-46f9948447dc tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:34.004324 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-30b57bb3-cbee-4b02-bc15-46f9948447dc tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:34.005445 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-30b57bb3-cbee-4b02-bc15-46f9948447dc tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:34.005847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-30b57bb3-cbee-4b02-bc15-46f9948447dc tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:34.014991 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-ddea6ac8-e7b5-4560-873b-93d6e3d0f83a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] validate_networks() for [('5684cb20-bc75-42db-91c0-b2fe6d252169', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:31:34.237497 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-30b57bb3-cbee-4b02-bc15-46f9948447dc tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:34.246891 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-30b57bb3-cbee-4b02-bc15-46f9948447dc tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1473 microversion: 2.1 time: 0.258200 Jul 19 22:31:34.247640 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 691/1399] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:33 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1473 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:34.254128 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8f537159-0c43-412d-b094-7bd730f6daea tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] Action: 'create', calling method: .version_select at 0x7f7a1045dca0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:34.276907 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-8f537159-0c43-412d-b094-7bd730f6daea tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] HTTP exception thrown: Image not found. Jul 19 22:31:34.279152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8f537159-0c43-412d-b094-7bd730f6daea tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] Request method failure captured: Jul 19 22:31:34.279152 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/images/5c3c8207-7c37-4ec4-bce2-e36a1da0b3fa/metadata HTTP/1.1 Jul 19 22:31:34.279152 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:31:34.279152 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:31:34.279152 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:31:34.279152 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 57 Jul 19 22:31:34.279152 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:31:34.279152 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:31:34.279152 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:31:34.279152 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:31:34.279152 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zDF1BJLjdNc4lrE1W3UmYLOroBgK9TeXODdLQUG7JAkXZQj16NqnjZRgD9Dym1fORR_SBZoH7FRwFb2VQjsO-XaFp4Y-dD5710g789TZrUa-WlrRkqRC0R7-Zqi2gLe9PbQLgttULxxaAk1etNeKKIgtk7yT929eRau-zUi4JAMACc Jul 19 22:31:34.279152 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:31:34.279152 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:31:34.279152 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:31:34.279152 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:31:34.279152 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:31:34.279152 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:31:34.279152 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 67880865d6c54df797d5fc3e8f9d7c6d Jul 19 22:31:34.279152 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1279034598 Jul 19 22:31:34.279152 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:31:34.279152 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:31:34.280645 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_67880865d6c54df797d5fc3e8f9d7c6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67880865d6c54df797d5fc3e8f9d7c6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/67880865d6c54df797d5fc3e8f9d7c6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67880865d6c54df797d5fc3e8f9d7c6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:31:34.280645 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1279034598 Jul 19 22:31:34.280645 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 67880865d6c54df797d5fc3e8f9d7c6d Jul 19 22:31:34.280645 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1279034598 Jul 19 22:31:34.280645 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesMetadataNegativeTestJSON-1279034598-project Jul 19 22:31:34.280645 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:31:34.280645 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:31:34.280645 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 12b054f19ba34445b278fdc5f2c7a78a Jul 19 22:31:34.280645 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1279034598-project Jul 19 22:31:34.280645 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:31:34.280645 n-d-847009-3 devstack@n-api.service[119338]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 19 22:31:34.280645 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:31:34.280645 n-d-847009-3 devstack@n-api.service[119338]: exception: Image not found. Jul 19 22:31:34.280645 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'image_id': '5c3c8207-7c37-4ec4-bce2-e36a1da0b3fa', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 19 22:31:34.281710 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:31:34.281710 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:34.281710 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 22:31:34.281710 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 22:31:34.281710 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:31:34.281710 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:31:34.281710 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 22:31:34.281710 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 22:31:34.281710 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:31:34.281710 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:31:34.281710 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 22:31:34.281710 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 22:31:34.281710 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 22:31:34.281710 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 22:31:34.281710 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:31:34.281710 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:31:34.281710 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:31:34.281710 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:31:34.283271 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5c3c8207-7c37-4ec4-bce2-e36a1da0b3fa Jul 19 22:31:34.283271 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:34.283271 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:34.283271 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:34.283271 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:34.283271 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 19 22:31:34.283271 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 19 22:31:34.283271 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 22:31:34.283271 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 22:31:34.283271 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 22:31:34.283271 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 22:31:34.283271 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 22:31:34.283271 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 22:31:34.283271 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 22:31:34.283271 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 22:31:34.283271 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:31:34.283271 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:31:34.283271 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 22:31:34.283271 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 22:31:34.286314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:31:34.286314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:31:34.286314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 22:31:34.286314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 22:31:34.286314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 22:31:34.286314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 22:31:34.286314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:31:34.286314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:31:34.286314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:31:34.286314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:31:34.286314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5c3c8207-7c37-4ec4-bce2-e36a1da0b3fa could not be found. Jul 19 22:31:34.286314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:34.286314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:34.286314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:34.286314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:34.286314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:34.286314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:34.286314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:31:34.286314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:31:34.289165 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:31:34.289165 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:31:34.289165 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:31:34.289165 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:31:34.289165 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:31:34.289165 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:31:34.289165 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 19 22:31:34.289165 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 19 22:31:34.289165 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 19 22:31:34.289165 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 22:31:34.289165 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 22:31:34.289165 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:34.289165 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:34.289165 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:34.289165 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:34.289165 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:34.289165 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:34.289165 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:31:34.289165 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:31:34.289165 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 22:31:34.289165 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:34.293889 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8f537159-0c43-412d-b094-7bd730f6daea tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] Returning 404 to user: Image not found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:31:34.293889 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8f537159-0c43-412d-b094-7bd730f6daea tempest-ImagesMetadataNegativeTestJSON-1279034598 tempest-ImagesMetadataNegativeTestJSON-1279034598-project] 10.222.0.25 "POST /compute/v2.1/images/5c3c8207-7c37-4ec4-bce2-e36a1da0b3fa/metadata" status: 404 len: 62 microversion: 2.1 time: 0.031975 Jul 19 22:31:34.293889 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 692/1400] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Jul 19 22:31:34 2022] POST /compute/v2.1/images/5c3c8207-7c37-4ec4-bce2-e36a1da0b3fa/metadata => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:31:34.293889 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-17d641dd-5828-4562-ad73-646b6f706b2f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:34.293889 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-17d641dd-5828-4562-ad73-646b6f706b2f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:34.304025 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-17d641dd-5828-4562-ad73-646b6f706b2f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:34.304488 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-17d641dd-5828-4562-ad73-646b6f706b2f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:34.305510 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-17d641dd-5828-4562-ad73-646b6f706b2f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:34.306583 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-17d641dd-5828-4562-ad73-646b6f706b2f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:34.593198 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-17d641dd-5828-4562-ad73-646b6f706b2f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:34.608602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-17d641dd-5828-4562-ad73-646b6f706b2f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:34.620223 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-17d641dd-5828-4562-ad73-646b6f706b2f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:34.622211 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-17d641dd-5828-4562-ad73-646b6f706b2f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 0.338203 Jul 19 22:31:34.624616 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 693/1401] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:31:34 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:31:34.645629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8999ad64-4176-45d6-94c2-429cd9727ff7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:34.647154 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8999ad64-4176-45d6-94c2-429cd9727ff7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:34.655862 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8999ad64-4176-45d6-94c2-429cd9727ff7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:34.656759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8999ad64-4176-45d6-94c2-429cd9727ff7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:34.657885 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8999ad64-4176-45d6-94c2-429cd9727ff7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:34.658528 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8999ad64-4176-45d6-94c2-429cd9727ff7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:34.700684 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ddea6ac8-e7b5-4560-873b-93d6e3d0f83a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:31:34.701458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ddea6ac8-e7b5-4560-873b-93d6e3d0f83a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:31:34.701810 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ddea6ac8-e7b5-4560-873b-93d6e3d0f83a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:31:34.702431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ddea6ac8-e7b5-4560-873b-93d6e3d0f83a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:31:34.703028 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ddea6ac8-e7b5-4560-873b-93d6e3d0f83a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:31:34.712808 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ddea6ac8-e7b5-4560-873b-93d6e3d0f83a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:34.713803 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ddea6ac8-e7b5-4560-873b-93d6e3d0f83a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:34.714977 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ddea6ac8-e7b5-4560-873b-93d6e3d0f83a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:34.715665 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ddea6ac8-e7b5-4560-873b-93d6e3d0f83a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:34.731048 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:31:34.738063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-ddea6ac8-e7b5-4560-873b-93d6e3d0f83a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Getting quotas for project 5e91c72f8cf5406a9662a29ee25780e6. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:31:34.744918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-ddea6ac8-e7b5-4560-873b-93d6e3d0f83a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Getting quotas for user 22b46b207cdb40c7b325bdc42baae246 and project 5e91c72f8cf5406a9662a29ee25780e6. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:31:34.763077 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ddea6ac8-e7b5-4560-873b-93d6e3d0f83a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:31:34.765546 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ddea6ac8-e7b5-4560-873b-93d6e3d0f83a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:31:34.834563 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ddea6ac8-e7b5-4560-873b-93d6e3d0f83a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.891134 Jul 19 22:31:34.838795 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 709/1402] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:31:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:31:34.849542 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e0f33408-bd81-4251-abe0-73e49e67ba09 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:34.850475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e0f33408-bd81-4251-abe0-73e49e67ba09 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:34.867266 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0f33408-bd81-4251-abe0-73e49e67ba09 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:34.868851 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0f33408-bd81-4251-abe0-73e49e67ba09 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:34.870071 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0f33408-bd81-4251-abe0-73e49e67ba09 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:34.871736 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0f33408-bd81-4251-abe0-73e49e67ba09 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:34.879662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8999ad64-4176-45d6-94c2-429cd9727ff7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:34.894103 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8999ad64-4176-45d6-94c2-429cd9727ff7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1469 microversion: 2.1 time: 0.257034 Jul 19 22:31:34.895063 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 694/1403] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:34 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1469 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:34.904330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-04aee059-53ad-42c3-83cd-1e2ac30ffe5e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:34.905866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-04aee059-53ad-42c3-83cd-1e2ac30ffe5e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 67fd85a5-6cde-4aa6-acf2-99640be2bb44] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:34.917169 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04aee059-53ad-42c3-83cd-1e2ac30ffe5e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:34.918167 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04aee059-53ad-42c3-83cd-1e2ac30ffe5e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:34.919727 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04aee059-53ad-42c3-83cd-1e2ac30ffe5e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:34.921402 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04aee059-53ad-42c3-83cd-1e2ac30ffe5e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:35.129933 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e0f33408-bd81-4251-abe0-73e49e67ba09 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:35.142501 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e0f33408-bd81-4251-abe0-73e49e67ba09 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1708 microversion: 2.1 time: 0.302175 Jul 19 22:31:35.144024 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 710/1404] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:34 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1708 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:35.149074 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4166fa1c-69a3-4ebc-8c49-5730c5e59008 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:35.150054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4166fa1c-69a3-4ebc-8c49-5730c5e59008 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:35.186452 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-04aee059-53ad-42c3-83cd-1e2ac30ffe5e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:35.199807 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-04aee059-53ad-42c3-83cd-1e2ac30ffe5e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44" status: 200 len: 1472 microversion: 2.1 time: 0.302337 Jul 19 22:31:35.200806 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 695/1405] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:34 2022] GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44 => generated 1472 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:35.235032 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4166fa1c-69a3-4ebc-8c49-5730c5e59008 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:35.246290 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4166fa1c-69a3-4ebc-8c49-5730c5e59008 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f" status: 200 len: 1208 microversion: 2.1 time: 0.100925 Jul 19 22:31:35.252552 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 711/1406] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:35 2022] GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f => generated 1208 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:35.270453 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8c09d9f3-9ba9-471a-99fd-defafa6d1a90 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:35.271537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8c09d9f3-9ba9-471a-99fd-defafa6d1a90 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:35.281844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c09d9f3-9ba9-471a-99fd-defafa6d1a90 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:35.282686 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c09d9f3-9ba9-471a-99fd-defafa6d1a90 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:35.283669 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c09d9f3-9ba9-471a-99fd-defafa6d1a90 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:35.284269 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c09d9f3-9ba9-471a-99fd-defafa6d1a90 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:35.460558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8c09d9f3-9ba9-471a-99fd-defafa6d1a90 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:35.470565 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8c09d9f3-9ba9-471a-99fd-defafa6d1a90 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1473 microversion: 2.1 time: 0.209621 Jul 19 22:31:35.471420 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 712/1407] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:35 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1473 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:31:35.596817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c2f3d23a-a791-4254-96aa-315bf7bc8774 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Calling method '.version_select at 0x7f7a109a89d0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:35.599286 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c2f3d23a-a791-4254-96aa-315bf7bc8774 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:35.599738 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c2f3d23a-a791-4254-96aa-315bf7bc8774 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:35.614994 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c2f3d23a-a791-4254-96aa-315bf7bc8774 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 3886 microversion: 2.1 time: 0.412875 Jul 19 22:31:35.615673 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 696/1408] 10.222.0.25 () {58 vars in 1142 bytes} [Tue Jul 19 22:31:35 2022] GET /compute/v2.1/os-migrations => generated 3886 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:35.631844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4f2ff12b-68d4-434f-a665-a37932fcc20d tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:35.632736 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4f2ff12b-68d4-434f-a665-a37932fcc20d tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:35.642587 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f2ff12b-68d4-434f-a665-a37932fcc20d tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:35.644715 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f2ff12b-68d4-434f-a665-a37932fcc20d tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:35.645888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f2ff12b-68d4-434f-a665-a37932fcc20d tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:35.646716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f2ff12b-68d4-434f-a665-a37932fcc20d tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:35.648254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b80b7891-d0fa-4e5d-8464-df1f19d663ce tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:35.649866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b80b7891-d0fa-4e5d-8464-df1f19d663ce tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:35.663978 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b80b7891-d0fa-4e5d-8464-df1f19d663ce tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:35.664817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b80b7891-d0fa-4e5d-8464-df1f19d663ce tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:35.666335 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b80b7891-d0fa-4e5d-8464-df1f19d663ce tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:35.667300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b80b7891-d0fa-4e5d-8464-df1f19d663ce tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:35.886225 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4f2ff12b-68d4-434f-a665-a37932fcc20d tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1859 microversion: 2.1 time: 0.258881 Jul 19 22:31:35.888298 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 713/1409] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:35 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1859 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:35.898130 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b80b7891-d0fa-4e5d-8464-df1f19d663ce tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:35.915000 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e6d61035-319a-4ea3-88cf-d8a80af65335 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:35.916124 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e6d61035-319a-4ea3-88cf-d8a80af65335 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:35.925561 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b80b7891-d0fa-4e5d-8464-df1f19d663ce tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:35.926030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6d61035-319a-4ea3-88cf-d8a80af65335 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:35.926840 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6d61035-319a-4ea3-88cf-d8a80af65335 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:35.927468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b80b7891-d0fa-4e5d-8464-df1f19d663ce tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:35.928186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6d61035-319a-4ea3-88cf-d8a80af65335 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:35.928752 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b80b7891-d0fa-4e5d-8464-df1f19d663ce tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 0.288864 Jul 19 22:31:35.928963 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6d61035-319a-4ea3-88cf-d8a80af65335 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:35.929318 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 697/1410] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:31:35 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:31:35.934678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f7bc2a68-e91a-4d6c-9c8a-0c6a2ceb968e tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:35.935209 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f7bc2a68-e91a-4d6c-9c8a-0c6a2ceb968e tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:35.941760 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f7bc2a68-e91a-4d6c-9c8a-0c6a2ceb968e tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:35.942219 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f7bc2a68-e91a-4d6c-9c8a-0c6a2ceb968e tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:35.943016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f7bc2a68-e91a-4d6c-9c8a-0c6a2ceb968e tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:35.943515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f7bc2a68-e91a-4d6c-9c8a-0c6a2ceb968e tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:36.275638 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e6d61035-319a-4ea3-88cf-d8a80af65335 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:36.290988 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e6d61035-319a-4ea3-88cf-d8a80af65335 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 200 len: 1469 microversion: 2.1 time: 0.382736 Jul 19 22:31:36.292889 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 714/1411] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:35 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 1469 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:36.318267 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-edb3b1f0-f901-4592-b8d4-9b44e3e5536e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:36.318982 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-edb3b1f0-f901-4592-b8d4-9b44e3e5536e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 67fd85a5-6cde-4aa6-acf2-99640be2bb44] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:36.325492 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f7bc2a68-e91a-4d6c-9c8a-0c6a2ceb968e tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1859 microversion: 2.1 time: 0.387957 Jul 19 22:31:36.326338 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 698/1412] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:35 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1859 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:36.343656 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-edb3b1f0-f901-4592-b8d4-9b44e3e5536e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:36.344377 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-edb3b1f0-f901-4592-b8d4-9b44e3e5536e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:36.345336 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-edb3b1f0-f901-4592-b8d4-9b44e3e5536e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:36.345773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-edb3b1f0-f901-4592-b8d4-9b44e3e5536e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:36.355940 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0c97f55a-fc98-40ac-87bb-842350c8aead tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:36.359586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0c97f55a-fc98-40ac-87bb-842350c8aead tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:36.374701 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c97f55a-fc98-40ac-87bb-842350c8aead tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:36.375504 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c97f55a-fc98-40ac-87bb-842350c8aead tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:36.376509 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c97f55a-fc98-40ac-87bb-842350c8aead tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:36.392367 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c97f55a-fc98-40ac-87bb-842350c8aead tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:36.601061 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0c97f55a-fc98-40ac-87bb-842350c8aead tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:36.611499 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0c97f55a-fc98-40ac-87bb-842350c8aead tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f" status: 200 len: 1278 microversion: 2.1 time: 0.280966 Jul 19 22:31:36.621783 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 699/1413] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:36 2022] GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f => generated 1278 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:36.627771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-c029195f-aa2c-4aba-aa2a-7bfb05e27596 req-b00b2674-9093-4e95-a44f-60f224f1d806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f94bf14c-804e-4058-9ed8-037dd0a8ef98", "name": "network-vif-unplugged", "status": "completed", "tag": "0ebe3908-8f61-4950-8278-87404fd21fa1"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:36.640278 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c029195f-aa2c-4aba-aa2a-7bfb05e27596 req-b00b2674-9093-4e95-a44f-60f224f1d806 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:36.640985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c029195f-aa2c-4aba-aa2a-7bfb05e27596 req-b00b2674-9093-4e95-a44f-60f224f1d806 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:36.660129 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-c029195f-aa2c-4aba-aa2a-7bfb05e27596 req-b00b2674-9093-4e95-a44f-60f224f1d806 service nova] Creating event network-vif-unplugged:0ebe3908-8f61-4950-8278-87404fd21fa1 for instance f94bf14c-804e-4058-9ed8-037dd0a8ef98 on n-h1-847009-3 Jul 19 22:31:36.669411 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-c029195f-aa2c-4aba-aa2a-7bfb05e27596 req-b00b2674-9093-4e95-a44f-60f224f1d806 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045474 Jul 19 22:31:36.670921 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 700/1414] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:36.680316 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-26b4c1e1-56a8-4b48-997e-29121ddfe129 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:36.681363 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-26b4c1e1-56a8-4b48-997e-29121ddfe129 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:36.689387 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-26b4c1e1-56a8-4b48-997e-29121ddfe129 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:36.689839 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-26b4c1e1-56a8-4b48-997e-29121ddfe129 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:36.690647 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-26b4c1e1-56a8-4b48-997e-29121ddfe129 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:36.691087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-26b4c1e1-56a8-4b48-997e-29121ddfe129 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:37.294787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-edb3b1f0-f901-4592-b8d4-9b44e3e5536e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:37.306402 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-edb3b1f0-f901-4592-b8d4-9b44e3e5536e tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44" status: 200 len: 1472 microversion: 2.1 time: 1.003647 Jul 19 22:31:37.307000 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 715/1415] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:36 2022] GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44 => generated 1472 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:37.332978 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a4a23835-08fb-47b2-b09c-4b6617d5617e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:37.334024 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a4a23835-08fb-47b2-b09c-4b6617d5617e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:37.342610 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a4a23835-08fb-47b2-b09c-4b6617d5617e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:37.343407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a4a23835-08fb-47b2-b09c-4b6617d5617e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:37.344396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a4a23835-08fb-47b2-b09c-4b6617d5617e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:37.345063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a4a23835-08fb-47b2-b09c-4b6617d5617e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:37.653169 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-a4a23835-08fb-47b2-b09c-4b6617d5617e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lazy-loading 'services' on Instance uuid fab0a3d6-8249-4058-9ce5-90d458fff59d {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:31:37.814807 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-26b4c1e1-56a8-4b48-997e-29121ddfe129 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:37.825818 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-26b4c1e1-56a8-4b48-997e-29121ddfe129 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1473 microversion: 2.1 time: 1.153416 Jul 19 22:31:37.826426 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 701/1416] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:36 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1473 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:37.939597 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a4a23835-08fb-47b2-b09c-4b6617d5617e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d/os-volume_attachments/e2b03908-771c-4b90-9eb2-0bc827b3d2ef" status: 202 len: 0 microversion: 2.1 time: 0.624544 Jul 19 22:31:37.940550 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 716/1417] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 19 22:31:37 2022] DELETE /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d/os-volume_attachments/e2b03908-771c-4b90-9eb2-0bc827b3d2ef => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:31:37.954324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1968b909-aee4-479a-ac23-29bd95d45d07 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:37.955562 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1968b909-aee4-479a-ac23-29bd95d45d07 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:37.990323 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1968b909-aee4-479a-ac23-29bd95d45d07 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:37.994784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1968b909-aee4-479a-ac23-29bd95d45d07 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:37.996033 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1968b909-aee4-479a-ac23-29bd95d45d07 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:37.997335 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1968b909-aee4-479a-ac23-29bd95d45d07 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:38.111940 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e16593f7-4883-458e-b794-6e84dd829b33 tempest-ListImageFiltersNegativeTestJSON-107790422 tempest-ListImageFiltersNegativeTestJSON-107790422-project] Calling method '.version_select at 0x7f7a10426dc0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:38.175737 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-e16593f7-4883-458e-b794-6e84dd829b33 tempest-ListImageFiltersNegativeTestJSON-107790422 tempest-ListImageFiltersNegativeTestJSON-107790422-project] HTTP exception thrown: Image not found. Jul 19 22:31:38.182878 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e16593f7-4883-458e-b794-6e84dd829b33 tempest-ListImageFiltersNegativeTestJSON-107790422 tempest-ListImageFiltersNegativeTestJSON-107790422-project] Request method failure captured: Jul 19 22:31:38.182878 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/images/a35aec10-8852-4a21-a456-8a54a018e834 HTTP/1.1 Jul 19 22:31:38.182878 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:31:38.182878 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:31:38.182878 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:31:38.182878 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:31:38.182878 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:31:38.182878 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:31:38.182878 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:31:38.182878 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:31:38.182878 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zDIeXj6s4XDvP4ii1A7b0n44JEsXxk3KEzWRza1_CoulSr2sf4B9-KOeDW1a7x-VZUV-8mumRWfjVAMACmmPMMu7qgsaZ9urNzgNiU5fhOHMIZtIvyIoolQEAEu55JXnQiLn5GU1LKDChjjnACpID5Fbz57wBfNjBlH9mPw2Dfkig4 Jul 19 22:31:38.182878 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:31:38.182878 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:31:38.182878 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:31:38.182878 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:31:38.182878 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:31:38.182878 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:31:38.182878 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: af2844a4ee4a48c78213d6eea35eb885 Jul 19 22:31:38.182878 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-107790422 Jul 19 22:31:38.182878 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:31:38.182878 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:31:38.184352 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af2844a4ee4a48c78213d6eea35eb885"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af2844a4ee4a48c78213d6eea35eb885"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af2844a4ee4a48c78213d6eea35eb885"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af2844a4ee4a48c78213d6eea35eb885"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:31:38.184352 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-107790422 Jul 19 22:31:38.184352 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: af2844a4ee4a48c78213d6eea35eb885 Jul 19 22:31:38.184352 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-107790422 Jul 19 22:31:38.184352 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ListImageFiltersNegativeTestJSON-107790422-project Jul 19 22:31:38.184352 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:31:38.184352 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:31:38.184352 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: cbffa075ee9145b4ae7adaa0dd57a013 Jul 19 22:31:38.184352 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-107790422-project Jul 19 22:31:38.184352 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:31:38.184352 n-d-847009-3 devstack@n-api.service[119338]: exception: Image not found. Jul 19 22:31:38.184352 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'a35aec10-8852-4a21-a456-8a54a018e834'} Jul 19 22:31:38.184352 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:31:38.185456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:38.185456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 22:31:38.185456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 22:31:38.185456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:31:38.185456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:31:38.185456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 22:31:38.185456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 22:31:38.185456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:31:38.185456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:31:38.185456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 22:31:38.185456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 22:31:38.185456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 22:31:38.185456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 22:31:38.185456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:31:38.185456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:31:38.185456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:31:38.185456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:31:38.185456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a35aec10-8852-4a21-a456-8a54a018e834 Jul 19 22:31:38.186540 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:38.186540 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:38.186540 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:38.186540 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:38.186540 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 19 22:31:38.186540 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 19 22:31:38.186540 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 22:31:38.186540 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 22:31:38.186540 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 22:31:38.186540 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 22:31:38.186540 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 22:31:38.186540 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 22:31:38.186540 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 22:31:38.186540 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 22:31:38.186540 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:31:38.186540 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:31:38.186540 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 22:31:38.186540 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 22:31:38.186540 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:31:38.186540 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:31:38.187786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 22:31:38.187786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 22:31:38.187786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 22:31:38.187786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 22:31:38.187786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:31:38.187786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:31:38.187786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:31:38.187786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:31:38.187786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a35aec10-8852-4a21-a456-8a54a018e834 could not be found. Jul 19 22:31:38.187786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:38.187786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:38.187786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:38.187786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:38.187786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:38.187786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:38.187786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:31:38.187786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:31:38.187786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:31:38.187786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:31:38.190249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:31:38.190249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:31:38.190249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 19 22:31:38.190249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 22:31:38.190249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 22:31:38.190249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:38.190249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:38.190249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:38.190249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:38.190249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:38.190249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:38.190249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:31:38.190249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:31:38.190249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 22:31:38.190249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:38.201001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e16593f7-4883-458e-b794-6e84dd829b33 tempest-ListImageFiltersNegativeTestJSON-107790422 tempest-ListImageFiltersNegativeTestJSON-107790422-project] Returning 404 to user: Image not found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:31:38.202364 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e16593f7-4883-458e-b794-6e84dd829b33 tempest-ListImageFiltersNegativeTestJSON-107790422 tempest-ListImageFiltersNegativeTestJSON-107790422-project] 10.222.0.25 "GET /compute/v2.1/images/a35aec10-8852-4a21-a456-8a54a018e834" status: 404 len: 62 microversion: 2.1 time: 0.369905 Jul 19 22:31:38.204492 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 702/1418] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:31:37 2022] GET /compute/v2.1/images/a35aec10-8852-4a21-a456-8a54a018e834 => generated 62 bytes in 373 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:31:38.273764 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1f210fcc-aedc-4daa-aed3-9c16a1821262 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:38.274816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1f210fcc-aedc-4daa-aed3-9c16a1821262 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 1e6ee0c6-66e1-4877-a7be-b7996a03d158] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:38.284490 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1f210fcc-aedc-4daa-aed3-9c16a1821262 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:38.284958 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1f210fcc-aedc-4daa-aed3-9c16a1821262 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:38.286037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1f210fcc-aedc-4daa-aed3-9c16a1821262 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:38.286487 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1f210fcc-aedc-4daa-aed3-9c16a1821262 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:38.304446 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-1f210fcc-aedc-4daa-aed3-9c16a1821262 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] HTTP exception thrown: Instance 1e6ee0c6-66e1-4877-a7be-b7996a03d158 could not be found. Jul 19 22:31:38.307005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1f210fcc-aedc-4daa-aed3-9c16a1821262 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Request method failure captured: Jul 19 22:31:38.307005 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 HTTP/1.1 Jul 19 22:31:38.307005 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:31:38.307005 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:31:38.307005 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:31:38.307005 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:31:38.307005 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:31:38.307005 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:31:38.307005 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:31:38.307005 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:31:38.307005 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y9SKRTUgCp_a51-hxNmwpKIKbKego58wzUVpV8NH1wkVEqNRcwiabhpu6-ejJO6NeuhCRw_tHsx7Bw-epZD_t9D4FWivKhoitt_DdR_Js8cp-eQMzZoy9heKP13Txs6oLIr0IwjxnF47WFqAJ4Whduy7jC5bTCDC8m-V9GrXtVoG9c Jul 19 22:31:38.307005 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:31:38.307005 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:31:38.307005 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:31:38.307005 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:31:38.307005 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:31:38.307005 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:31:38.307005 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: eed5e83db4ae4156ae9635b84ca7ff4a Jul 19 22:31:38.307005 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-MigrationsAdminTest-1358192571 Jul 19 22:31:38.307005 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:31:38.307005 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:31:38.308366 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eed5e83db4ae4156ae9635b84ca7ff4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eed5e83db4ae4156ae9635b84ca7ff4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eed5e83db4ae4156ae9635b84ca7ff4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eed5e83db4ae4156ae9635b84ca7ff4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:31:38.308366 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-MigrationsAdminTest-1358192571 Jul 19 22:31:38.308366 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: eed5e83db4ae4156ae9635b84ca7ff4a Jul 19 22:31:38.308366 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-MigrationsAdminTest-1358192571 Jul 19 22:31:38.308366 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-MigrationsAdminTest-1358192571-project Jul 19 22:31:38.308366 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:31:38.308366 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:31:38.308366 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: e3ef9d4c38d547a1a1532d964195144a Jul 19 22:31:38.308366 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-MigrationsAdminTest-1358192571-project Jul 19 22:31:38.308366 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:31:38.308366 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 1e6ee0c6-66e1-4877-a7be-b7996a03d158 could not be found. Jul 19 22:31:38.308366 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '1e6ee0c6-66e1-4877-a7be-b7996a03d158'} Jul 19 22:31:38.309193 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:31:38.309193 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:38.309193 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:31:38.309193 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:31:38.309193 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:31:38.309193 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:31:38.309193 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:31:38.309193 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:31:38.309193 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:31:38.309193 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:31:38.309193 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e6ee0c6-66e1-4877-a7be-b7996a03d158 could not be found. Jul 19 22:31:38.309193 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:38.309193 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:38.309193 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:38.309193 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:38.309193 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:38.309193 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:38.309193 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:31:38.309193 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:31:38.309193 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:31:38.310933 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:31:38.310933 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:31:38.310933 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:31:38.310933 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:31:38.310933 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:31:38.310933 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:31:38.310933 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:31:38.310933 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e6ee0c6-66e1-4877-a7be-b7996a03d158 could not be found. Jul 19 22:31:38.310933 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:38.310933 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:38.310933 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:38.310933 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:38.310933 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:38.310933 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:38.310933 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:31:38.310933 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:31:38.310933 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e6ee0c6-66e1-4877-a7be-b7996a03d158 could not be found. Jul 19 22:31:38.310933 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:38.313581 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1f210fcc-aedc-4daa-aed3-9c16a1821262 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Returning 404 to user: Instance 1e6ee0c6-66e1-4877-a7be-b7996a03d158 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:31:38.313581 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1f210fcc-aedc-4daa-aed3-9c16a1821262 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158" status: 404 len: 111 microversion: 2.1 time: 0.102694 Jul 19 22:31:38.313581 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 703/1419] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:38 2022] GET /compute/v2.1/servers/1e6ee0c6-66e1-4877-a7be-b7996a03d158 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:31:38.319662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f20ff8d3-aeb4-44e9-9a26-211a5bf80333 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:38.320478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f20ff8d3-aeb4-44e9-9a26-211a5bf80333 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:38.334666 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f20ff8d3-aeb4-44e9-9a26-211a5bf80333 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:38.339321 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f20ff8d3-aeb4-44e9-9a26-211a5bf80333 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:38.340630 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f20ff8d3-aeb4-44e9-9a26-211a5bf80333 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:38.341321 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f20ff8d3-aeb4-44e9-9a26-211a5bf80333 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:38.435087 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1968b909-aee4-479a-ac23-29bd95d45d07 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:38.450538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1968b909-aee4-479a-ac23-29bd95d45d07 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:38.454031 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1968b909-aee4-479a-ac23-29bd95d45d07 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:38.457148 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1968b909-aee4-479a-ac23-29bd95d45d07 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 0.515060 Jul 19 22:31:38.474410 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 717/1420] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:31:37 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:31:38.483825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-aa8f6d64-44d1-4beb-aac1-2aa51a193beb req-2a96b710-0d77-4ef7-ae4d-3211222a210b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6ee0c6-66e1-4877-a7be-b7996a03d158", "name": "network-vif-deleted", "tag": "5964d642-fd77-41ab-93fe-df25f0bebc9c"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:38.500584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-aa8f6d64-44d1-4beb-aac1-2aa51a193beb req-2a96b710-0d77-4ef7-ae4d-3211222a210b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:38.501436 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-aa8f6d64-44d1-4beb-aac1-2aa51a193beb req-2a96b710-0d77-4ef7-ae4d-3211222a210b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:38.549057 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-aa8f6d64-44d1-4beb-aac1-2aa51a193beb req-2a96b710-0d77-4ef7-ae4d-3211222a210b service nova] Creating event network-vif-deleted:5964d642-fd77-41ab-93fe-df25f0bebc9c for instance 1e6ee0c6-66e1-4877-a7be-b7996a03d158 on n-h1-847009-3 Jul 19 22:31:38.555392 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-aa8f6d64-44d1-4beb-aac1-2aa51a193beb req-2a96b710-0d77-4ef7-ae4d-3211222a210b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079179 Jul 19 22:31:38.558233 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 718/1421] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:38.571534 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5a4fbbb1-8901-4494-89b1-1f811681c9d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:38.575468 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5a4fbbb1-8901-4494-89b1-1f811681c9d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:38.590817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a4fbbb1-8901-4494-89b1-1f811681c9d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:38.593118 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a4fbbb1-8901-4494-89b1-1f811681c9d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:38.600145 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a4fbbb1-8901-4494-89b1-1f811681c9d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:38.606317 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a4fbbb1-8901-4494-89b1-1f811681c9d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:38.681153 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5a4fbbb1-8901-4494-89b1-1f811681c9d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120476 Jul 19 22:31:38.682171 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 719/1422] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:31:38 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:38.688631 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-611f783b-265d-4efb-a292-15388490bab8 req-636b0643-0648-46c7-a3de-3079288a7b71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f94bf14c-804e-4058-9ed8-037dd0a8ef98", "name": "network-vif-deleted", "tag": "0ebe3908-8f61-4950-8278-87404fd21fa1"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:38.715526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-611f783b-265d-4efb-a292-15388490bab8 req-636b0643-0648-46c7-a3de-3079288a7b71 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:38.718037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-611f783b-265d-4efb-a292-15388490bab8 req-636b0643-0648-46c7-a3de-3079288a7b71 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:38.733201 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-611f783b-265d-4efb-a292-15388490bab8 req-636b0643-0648-46c7-a3de-3079288a7b71 service nova] Creating event network-vif-deleted:0ebe3908-8f61-4950-8278-87404fd21fa1 for instance f94bf14c-804e-4058-9ed8-037dd0a8ef98 on n-h1-847009-3 Jul 19 22:31:38.738626 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-611f783b-265d-4efb-a292-15388490bab8 req-636b0643-0648-46c7-a3de-3079288a7b71 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054702 Jul 19 22:31:38.740188 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 720/1423] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:38.747262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-40369974-ffa9-41fe-a9f0-4d71e097f2d9 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:38.748116 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-40369974-ffa9-41fe-a9f0-4d71e097f2d9 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:38.757614 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-40369974-ffa9-41fe-a9f0-4d71e097f2d9 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:38.758616 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-40369974-ffa9-41fe-a9f0-4d71e097f2d9 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:38.760103 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-40369974-ffa9-41fe-a9f0-4d71e097f2d9 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:38.761129 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-40369974-ffa9-41fe-a9f0-4d71e097f2d9 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:38.821946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:31:38.847932 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-40369974-ffa9-41fe-a9f0-4d71e097f2d9 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:31:38.874904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f20ff8d3-aeb4-44e9-9a26-211a5bf80333 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:38.890627 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f20ff8d3-aeb4-44e9-9a26-211a5bf80333 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f" status: 200 len: 1308 microversion: 2.1 time: 0.576018 Jul 19 22:31:38.908363 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 704/1424] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:38 2022] GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f => generated 1308 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:38.927933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3b06c381-65fb-4fab-ad08-823df5e1e570 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:38.931874 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3b06c381-65fb-4fab-ad08-823df5e1e570 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 67fd85a5-6cde-4aa6-acf2-99640be2bb44] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:38.956877 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b06c381-65fb-4fab-ad08-823df5e1e570 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:38.959628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b06c381-65fb-4fab-ad08-823df5e1e570 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:38.960581 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b06c381-65fb-4fab-ad08-823df5e1e570 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:38.961224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b06c381-65fb-4fab-ad08-823df5e1e570 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:39.099496 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-40369974-ffa9-41fe-a9f0-4d71e097f2d9 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 204 len: 0 microversion: 2.1 time: 0.357312 Jul 19 22:31:39.104539 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 721/1425] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:31:38 2022] DELETE /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:31:39.110344 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dc428bb4-20a0-4876-9c0b-007fdd65d795 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:39.111549 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dc428bb4-20a0-4876-9c0b-007fdd65d795 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:39.118936 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dc428bb4-20a0-4876-9c0b-007fdd65d795 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:39.119836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dc428bb4-20a0-4876-9c0b-007fdd65d795 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:39.120837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dc428bb4-20a0-4876-9c0b-007fdd65d795 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:39.121515 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dc428bb4-20a0-4876-9c0b-007fdd65d795 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:39.202764 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3b06c381-65fb-4fab-ad08-823df5e1e570 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:39.213221 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3b06c381-65fb-4fab-ad08-823df5e1e570 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44" status: 200 len: 1301 microversion: 2.1 time: 0.300405 Jul 19 22:31:39.222246 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 705/1426] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:38 2022] GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44 => generated 1301 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:39.242741 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d529f92a-ff1a-4cdd-bccb-1e41140664a4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:39.245068 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d529f92a-ff1a-4cdd-bccb-1e41140664a4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:39.285144 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d529f92a-ff1a-4cdd-bccb-1e41140664a4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:39.286061 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d529f92a-ff1a-4cdd-bccb-1e41140664a4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:39.287440 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d529f92a-ff1a-4cdd-bccb-1e41140664a4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:39.290450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d529f92a-ff1a-4cdd-bccb-1e41140664a4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:39.807440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dc428bb4-20a0-4876-9c0b-007fdd65d795 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:39.825583 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dc428bb4-20a0-4876-9c0b-007fdd65d795 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1473 microversion: 2.1 time: 0.719321 Jul 19 22:31:39.835941 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 722/1427] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:39 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1473 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:39.841481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-47816586-d65a-43f7-8d20-0d6353d138b8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:39.842100 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-47816586-d65a-43f7-8d20-0d6353d138b8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:39.860196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-47816586-d65a-43f7-8d20-0d6353d138b8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:39.860398 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-47816586-d65a-43f7-8d20-0d6353d138b8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:39.861190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-47816586-d65a-43f7-8d20-0d6353d138b8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:39.861627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-47816586-d65a-43f7-8d20-0d6353d138b8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:40.016330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d529f92a-ff1a-4cdd-bccb-1e41140664a4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:40.044523 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d529f92a-ff1a-4cdd-bccb-1e41140664a4 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1534 microversion: 2.1 time: 0.818861 Jul 19 22:31:40.053675 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 706/1428] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:39 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1534 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:40.069956 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6f22bbb7-9978-43ba-b426-288c5199e624 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:40.072825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6f22bbb7-9978-43ba-b426-288c5199e624 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:40.093796 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f22bbb7-9978-43ba-b426-288c5199e624 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:40.094604 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f22bbb7-9978-43ba-b426-288c5199e624 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:40.096058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f22bbb7-9978-43ba-b426-288c5199e624 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:40.096878 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f22bbb7-9978-43ba-b426-288c5199e624 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:40.208335 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6f22bbb7-9978-43ba-b426-288c5199e624 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160956 Jul 19 22:31:40.210241 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 707/1429] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:31:40 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:40.220706 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-768e5453-4ca5-4cbc-b626-2f3f92b52dcb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:40.222095 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-768e5453-4ca5-4cbc-b626-2f3f92b52dcb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:40.236105 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-768e5453-4ca5-4cbc-b626-2f3f92b52dcb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:40.237164 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-768e5453-4ca5-4cbc-b626-2f3f92b52dcb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:40.238739 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-768e5453-4ca5-4cbc-b626-2f3f92b52dcb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:40.240264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-768e5453-4ca5-4cbc-b626-2f3f92b52dcb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:40.247789 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-47816586-d65a-43f7-8d20-0d6353d138b8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:40.258748 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-47816586-d65a-43f7-8d20-0d6353d138b8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:40.271696 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-47816586-d65a-43f7-8d20-0d6353d138b8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:40.273345 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-47816586-d65a-43f7-8d20-0d6353d138b8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 0.436238 Jul 19 22:31:40.275006 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 723/1430] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:31:39 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:31:40.288260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b3764125-e059-436f-ae02-7668cdcc96d5 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:40.289362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b3764125-e059-436f-ae02-7668cdcc96d5 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 67fd85a5-6cde-4aa6-acf2-99640be2bb44] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:40.304271 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b3764125-e059-436f-ae02-7668cdcc96d5 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:40.305217 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b3764125-e059-436f-ae02-7668cdcc96d5 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:40.306423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b3764125-e059-436f-ae02-7668cdcc96d5 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:40.307050 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b3764125-e059-436f-ae02-7668cdcc96d5 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:40.348079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b3764125-e059-436f-ae02-7668cdcc96d5 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:40.348788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b3764125-e059-436f-ae02-7668cdcc96d5 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:40.350073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-b3764125-e059-436f-ae02-7668cdcc96d5 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lazy-loading 'fault' on Instance uuid 67fd85a5-6cde-4aa6-acf2-99640be2bb44 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:31:40.453492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b3764125-e059-436f-ae02-7668cdcc96d5 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:40.466648 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b3764125-e059-436f-ae02-7668cdcc96d5 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44" status: 200 len: 1306 microversion: 2.1 time: 0.190289 Jul 19 22:31:40.467994 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 724/1431] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:40 2022] GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44 => generated 1306 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:40.574188 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-768e5453-4ca5-4cbc-b626-2f3f92b52dcb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:40.591699 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-768e5453-4ca5-4cbc-b626-2f3f92b52dcb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f" status: 200 len: 1308 microversion: 2.1 time: 0.378742 Jul 19 22:31:40.592713 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 708/1432] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:40 2022] GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f => generated 1308 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:40.604457 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-4cbd13e9-c261-43be-a065-124cb1e4a276 req-e0013c25-b338-4345-9f1e-21ed4954b021 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2c3a620-1bea-42df-b1b5-fda7ad4de42f", "tag": "e6bc4adb-2eb2-4855-b7e4-a430ffaeae9c"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:40.617288 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-4cbd13e9-c261-43be-a065-124cb1e4a276 req-e0013c25-b338-4345-9f1e-21ed4954b021 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:40.622465 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-4cbd13e9-c261-43be-a065-124cb1e4a276 req-e0013c25-b338-4345-9f1e-21ed4954b021 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:40.652558 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-4cbd13e9-c261-43be-a065-124cb1e4a276 req-e0013c25-b338-4345-9f1e-21ed4954b021 service nova] Creating event network-changed:e6bc4adb-2eb2-4855-b7e4-a430ffaeae9c for instance d2c3a620-1bea-42df-b1b5-fda7ad4de42f on n-h2-847009-3 Jul 19 22:31:40.660797 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-4cbd13e9-c261-43be-a065-124cb1e4a276 req-e0013c25-b338-4345-9f1e-21ed4954b021 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061201 Jul 19 22:31:40.661965 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 725/1433] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:31:40.765325 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-b9324638-2774-4a39-9b57-fe65aae93b08 req-247f9b89-12b0-4611-87be-529c5c3151d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67fd85a5-6cde-4aa6-acf2-99640be2bb44", "name": "network-vif-deleted", "tag": "ee275296-af34-4a61-8a8f-8c33c4fdec74"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:40.777032 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b9324638-2774-4a39-9b57-fe65aae93b08 req-247f9b89-12b0-4611-87be-529c5c3151d7 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:40.777826 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b9324638-2774-4a39-9b57-fe65aae93b08 req-247f9b89-12b0-4611-87be-529c5c3151d7 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:40.793731 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-b9324638-2774-4a39-9b57-fe65aae93b08 req-247f9b89-12b0-4611-87be-529c5c3151d7 service nova] Creating event network-vif-deleted:ee275296-af34-4a61-8a8f-8c33c4fdec74 for instance 67fd85a5-6cde-4aa6-acf2-99640be2bb44 on n-h1-847009-3 Jul 19 22:31:40.816318 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-b9324638-2774-4a39-9b57-fe65aae93b08 req-247f9b89-12b0-4611-87be-529c5c3151d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054977 Jul 19 22:31:40.818917 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 709/1434] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:40.844428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dd252e28-93ea-4c7f-a155-685ef13fcc2f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:40.845162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dd252e28-93ea-4c7f-a155-685ef13fcc2f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:40.852451 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dd252e28-93ea-4c7f-a155-685ef13fcc2f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:40.852905 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dd252e28-93ea-4c7f-a155-685ef13fcc2f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:40.854135 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dd252e28-93ea-4c7f-a155-685ef13fcc2f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:40.854737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dd252e28-93ea-4c7f-a155-685ef13fcc2f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:41.065012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b203613e-0f01-42a8-b03b-effc7bc0cca2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:41.065821 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b203613e-0f01-42a8-b03b-effc7bc0cca2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:41.073031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b203613e-0f01-42a8-b03b-effc7bc0cca2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:41.073487 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b203613e-0f01-42a8-b03b-effc7bc0cca2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:41.074638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b203613e-0f01-42a8-b03b-effc7bc0cca2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:41.075295 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b203613e-0f01-42a8-b03b-effc7bc0cca2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:41.101193 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:31:41.382125 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dd252e28-93ea-4c7f-a155-685ef13fcc2f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:41.394661 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dd252e28-93ea-4c7f-a155-685ef13fcc2f tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1473 microversion: 2.1 time: 0.554660 Jul 19 22:31:41.396056 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 726/1435] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:40 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1473 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:41.401625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-abc1425b-a7fa-4f34-a35f-81994c31a86f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:41.411019 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-abc1425b-a7fa-4f34-a35f-81994c31a86f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:41.421788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-abc1425b-a7fa-4f34-a35f-81994c31a86f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:41.422495 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-abc1425b-a7fa-4f34-a35f-81994c31a86f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:41.424102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-abc1425b-a7fa-4f34-a35f-81994c31a86f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:41.424782 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-abc1425b-a7fa-4f34-a35f-81994c31a86f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:41.467193 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-abc1425b-a7fa-4f34-a35f-81994c31a86f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069083 Jul 19 22:31:41.467438 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 727/1436] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:31:41 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:41.472486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bfdbb180-12de-4c95-aa5e-8c9cc9d01e24 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:41.473165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bfdbb180-12de-4c95-aa5e-8c9cc9d01e24 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:41.481445 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bfdbb180-12de-4c95-aa5e-8c9cc9d01e24 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:41.481895 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bfdbb180-12de-4c95-aa5e-8c9cc9d01e24 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:41.482680 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bfdbb180-12de-4c95-aa5e-8c9cc9d01e24 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:41.483136 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bfdbb180-12de-4c95-aa5e-8c9cc9d01e24 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:41.625476 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b203613e-0f01-42a8-b03b-effc7bc0cca2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:41.641648 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b203613e-0f01-42a8-b03b-effc7bc0cca2 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1534 microversion: 2.1 time: 0.583362 Jul 19 22:31:41.649024 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 710/1437] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:41 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1534 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:31:41.664498 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-34ee4c26-93c6-4cea-a966-76b089b50572 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:41.667615 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-34ee4c26-93c6-4cea-a966-76b089b50572 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 67fd85a5-6cde-4aa6-acf2-99640be2bb44] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:41.682415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-34ee4c26-93c6-4cea-a966-76b089b50572 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:41.684221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-34ee4c26-93c6-4cea-a966-76b089b50572 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:41.685896 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-34ee4c26-93c6-4cea-a966-76b089b50572 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:41.686873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-34ee4c26-93c6-4cea-a966-76b089b50572 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:41.718272 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-34ee4c26-93c6-4cea-a966-76b089b50572 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] HTTP exception thrown: Instance 67fd85a5-6cde-4aa6-acf2-99640be2bb44 could not be found. Jul 19 22:31:41.721821 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-34ee4c26-93c6-4cea-a966-76b089b50572 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Request method failure captured: Jul 19 22:31:41.721821 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44 HTTP/1.1 Jul 19 22:31:41.721821 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:31:41.721821 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:31:41.721821 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:31:41.721821 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:31:41.721821 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:31:41.721821 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:31:41.721821 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:31:41.721821 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:31:41.721821 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y_lSToTGm6PgX7y4oIs7m5rgLyqg2BjZd8UIRxYbJb2m9EeYEMUBVSO6DHIQ83QGW3D2BNOgioifqv3NuMCiblu_B1iW2SpP-MN-RDBJYPyNbMjv8oGahIddMDTYqMxE8B_kTRHiqGPN6emfEZQBLQO7qtQOHZEh90KLuTSeNhouus Jul 19 22:31:41.721821 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:31:41.721821 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:31:41.721821 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:31:41.721821 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:31:41.721821 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:31:41.721821 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:31:41.721821 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 791e176b6751415ca1472c109b3ce011 Jul 19 22:31:41.721821 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersOnMultiNodesTest-1303510158 Jul 19 22:31:41.721821 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:31:41.721821 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:31:41.723866 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_791e176b6751415ca1472c109b3ce011"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/791e176b6751415ca1472c109b3ce011"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/791e176b6751415ca1472c109b3ce011"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/791e176b6751415ca1472c109b3ce011"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:31:41.723866 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersOnMultiNodesTest-1303510158 Jul 19 22:31:41.723866 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 791e176b6751415ca1472c109b3ce011 Jul 19 22:31:41.723866 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1303510158 Jul 19 22:31:41.723866 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersOnMultiNodesTest-1303510158-project Jul 19 22:31:41.723866 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:31:41.723866 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:31:41.723866 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: bd5fb561f7bd429e8c6b2cc30ed76f13 Jul 19 22:31:41.723866 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersOnMultiNodesTest-1303510158-project Jul 19 22:31:41.723866 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:31:41.723866 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 67fd85a5-6cde-4aa6-acf2-99640be2bb44 could not be found. Jul 19 22:31:41.723866 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '67fd85a5-6cde-4aa6-acf2-99640be2bb44'} Jul 19 22:31:41.724773 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:31:41.724773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:41.724773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:31:41.724773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:31:41.724773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:31:41.724773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:31:41.724773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:31:41.724773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:31:41.724773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:31:41.724773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:31:41.724773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67fd85a5-6cde-4aa6-acf2-99640be2bb44 could not be found. Jul 19 22:31:41.724773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:41.724773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:41.724773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:41.724773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:41.724773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:41.724773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:41.724773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:31:41.724773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:31:41.724773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:31:41.726240 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:31:41.726240 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:31:41.726240 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:31:41.726240 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:31:41.726240 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:31:41.726240 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:31:41.726240 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:31:41.726240 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67fd85a5-6cde-4aa6-acf2-99640be2bb44 could not be found. Jul 19 22:31:41.726240 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:41.726240 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:41.726240 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:41.726240 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:41.726240 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:41.726240 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:41.726240 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:31:41.726240 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:31:41.726240 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67fd85a5-6cde-4aa6-acf2-99640be2bb44 could not be found. Jul 19 22:31:41.726240 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:41.727960 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-34ee4c26-93c6-4cea-a966-76b089b50572 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Returning 404 to user: Instance 67fd85a5-6cde-4aa6-acf2-99640be2bb44 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:31:41.727960 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-34ee4c26-93c6-4cea-a966-76b089b50572 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44" status: 404 len: 111 microversion: 2.1 time: 0.075339 Jul 19 22:31:41.731320 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 711/1438] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:41 2022] GET /compute/v2.1/servers/67fd85a5-6cde-4aa6-acf2-99640be2bb44 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:31:41.749350 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5042829d-0094-4d3c-bba7-98794ec00a4e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:41.749350 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5042829d-0094-4d3c-bba7-98794ec00a4e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:41.755366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5042829d-0094-4d3c-bba7-98794ec00a4e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:41.756125 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5042829d-0094-4d3c-bba7-98794ec00a4e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:41.756841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5042829d-0094-4d3c-bba7-98794ec00a4e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:41.757393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5042829d-0094-4d3c-bba7-98794ec00a4e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:41.898155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bfdbb180-12de-4c95-aa5e-8c9cc9d01e24 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:41.907923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bfdbb180-12de-4c95-aa5e-8c9cc9d01e24 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:41.909999 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bfdbb180-12de-4c95-aa5e-8c9cc9d01e24 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:41.911579 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bfdbb180-12de-4c95-aa5e-8c9cc9d01e24 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 0.443145 Jul 19 22:31:41.912519 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 728/1439] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:31:41 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:31:41.929502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a994b859-ebfb-4af0-9f6e-a81516a5c168 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:41.930925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a994b859-ebfb-4af0-9f6e-a81516a5c168 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:41.937946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a994b859-ebfb-4af0-9f6e-a81516a5c168 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:41.938399 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a994b859-ebfb-4af0-9f6e-a81516a5c168 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:41.939236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a994b859-ebfb-4af0-9f6e-a81516a5c168 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:41.939681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a994b859-ebfb-4af0-9f6e-a81516a5c168 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:41.981524 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a994b859-ebfb-4af0-9f6e-a81516a5c168 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:31:42.119540 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a994b859-ebfb-4af0-9f6e-a81516a5c168 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1" status: 204 len: 0 microversion: 2.1 time: 0.191374 Jul 19 22:31:42.120263 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 729/1440] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:31:41 2022] DELETE /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:31:42.139340 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5042829d-0094-4d3c-bba7-98794ec00a4e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:42.148753 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5042829d-0094-4d3c-bba7-98794ec00a4e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f" status: 200 len: 1308 microversion: 2.1 time: 0.415261 Jul 19 22:31:42.155208 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 712/1441] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:41 2022] GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f => generated 1308 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:42.169063 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8d0f89c3-0198-46a4-8085-69111016bd06 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:42.170216 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8d0f89c3-0198-46a4-8085-69111016bd06 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:42.184756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d0f89c3-0198-46a4-8085-69111016bd06 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:42.185549 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d0f89c3-0198-46a4-8085-69111016bd06 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:42.186384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d0f89c3-0198-46a4-8085-69111016bd06 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:42.186858 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d0f89c3-0198-46a4-8085-69111016bd06 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:42.281787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d0d9b748-50d2-4605-b25a-5e62fd653735 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Action: 'create', calling method: .version_select at 0x7f7a108b5af0>, body: {"keypair": {"name": "tempest-keypair-409472525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQY4Oybd+Nk2M3xt42mBk4mv9z7V1e+Ia0swjYghq9w1YdPsngZPNRRhEwfka27k7J8qdntumRBq7BiI3bd4HneKNPnuCPkVMg7l/SS8EFMIrtdFSGNRxkxSESnUpdtFg=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:42.300543 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-d0d9b748-50d2-4605-b25a-5e62fd653735 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Getting quotas for project 0c1390e1d2f1462e922ef2a226ea0626. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:31:42.307374 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-d0d9b748-50d2-4605-b25a-5e62fd653735 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Getting quotas for user 15f0bebffdc44572908491e8d832022f and project 0c1390e1d2f1462e922ef2a226ea0626. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:31:42.339790 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d0d9b748-50d2-4605-b25a-5e62fd653735 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.217538 Jul 19 22:31:42.342419 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 730/1442] 10.222.0.25 () {62 vars in 1198 bytes} [Tue Jul 19 22:31:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 221 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 19 22:31:42.358369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a5673ffb-a5a8-41d6-bbd0-5f3735d4c16d tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Calling method '.version_select at 0x7f7a102f1ca0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:42.372556 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a5673ffb-a5a8-41d6-bbd0-5f3735d4c16d tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-409472525" status: 200 len: 512 microversion: 2.2 time: 0.022067 Jul 19 22:31:42.374426 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 731/1443] 10.222.0.25 () {60 vars in 1254 bytes} [Tue Jul 19 22:31:42 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-409472525 => generated 512 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:31:42.389309 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-22f824fd-b7f9-4bb1-8702-5eaa934a25e2 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Calling method '.version_select at 0x7f7a108059d0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:42.428701 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-22f824fd-b7f9-4bb1-8702-5eaa934a25e2 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-409472525" status: 204 len: 0 microversion: 2.2 time: 0.044345 Jul 19 22:31:42.429304 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 732/1444] 10.222.0.25 () {60 vars in 1257 bytes} [Tue Jul 19 22:31:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-409472525 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 22:31:42.465915 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-233efcb5-4b5a-465c-bc27-cfbd5bdd2de0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:42.466704 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-233efcb5-4b5a-465c-bc27-cfbd5bdd2de0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:42.485981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-233efcb5-4b5a-465c-bc27-cfbd5bdd2de0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:42.486454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-233efcb5-4b5a-465c-bc27-cfbd5bdd2de0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:42.487351 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-233efcb5-4b5a-465c-bc27-cfbd5bdd2de0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:42.487801 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-233efcb5-4b5a-465c-bc27-cfbd5bdd2de0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:42.562503 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8d0f89c3-0198-46a4-8085-69111016bd06 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:42.590696 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8d0f89c3-0198-46a4-8085-69111016bd06 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1" status: 200 len: 1472 microversion: 2.1 time: 0.434095 Jul 19 22:31:42.591321 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 713/1445] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:42 2022] GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 => generated 1472 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:42.605578 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-38d40d07-6d03-4f10-9760-0f19c995a033 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Action: 'create', calling method: .version_select at 0x7f7a1058a940>, body: {"keypair": {"name": "tempest-keypair-2083097313", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbHjfVYavY7msBV7btSsuozGUZivFjeR0CTbBisnMjO4KrEURcYQN3R3U4T+OY9IBWmbpcJ/NrUK3DwJAJI7cAwKOyDs/0OfYaOisxoGHL2JCURvDovDPkFFuC11+fCOA=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:42.631173 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:31:42.652612 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-38d40d07-6d03-4f10-9760-0f19c995a033 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Getting quotas for project 0c1390e1d2f1462e922ef2a226ea0626. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:31:42.670746 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-38d40d07-6d03-4f10-9760-0f19c995a033 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Getting quotas for user 15f0bebffdc44572908491e8d832022f and project 0c1390e1d2f1462e922ef2a226ea0626. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:31:42.708653 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-38d40d07-6d03-4f10-9760-0f19c995a033 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.112945 Jul 19 22:31:42.709287 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 714/1446] 10.222.0.25 () {62 vars in 1198 bytes} [Tue Jul 19 22:31:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 19 22:31:42.720356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-084d6ebe-d2b0-495d-8981-f227324649cc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:42.721568 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-084d6ebe-d2b0-495d-8981-f227324649cc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:42.736086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-084d6ebe-d2b0-495d-8981-f227324649cc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:42.736636 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-084d6ebe-d2b0-495d-8981-f227324649cc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:42.737647 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-084d6ebe-d2b0-495d-8981-f227324649cc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:42.738228 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-084d6ebe-d2b0-495d-8981-f227324649cc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:42.796806 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-084d6ebe-d2b0-495d-8981-f227324649cc tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086001 Jul 19 22:31:42.798151 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 715/1447] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:31:42 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:42.807807 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-50c9bb5d-4edf-48b3-b583-a8b108c20fe6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:42.808746 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-50c9bb5d-4edf-48b3-b583-a8b108c20fe6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:42.818243 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50c9bb5d-4edf-48b3-b583-a8b108c20fe6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:42.818945 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50c9bb5d-4edf-48b3-b583-a8b108c20fe6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:42.819928 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50c9bb5d-4edf-48b3-b583-a8b108c20fe6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:42.820528 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50c9bb5d-4edf-48b3-b583-a8b108c20fe6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:42.937109 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-233efcb5-4b5a-465c-bc27-cfbd5bdd2de0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:42.952412 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-50c9bb5d-4edf-48b3-b583-a8b108c20fe6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:42.955031 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-233efcb5-4b5a-465c-bc27-cfbd5bdd2de0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1473 microversion: 2.1 time: 0.523699 Jul 19 22:31:42.967612 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 733/1448] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:42 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1473 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:42.973591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-332b9422-63bd-4c06-876e-cc17ed9873db tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Calling method '.version_select at 0x7f7a10273c10>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:42.979743 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-50c9bb5d-4edf-48b3-b583-a8b108c20fe6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1492 microversion: 2.1 time: 0.178324 Jul 19 22:31:42.981108 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 716/1449] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:42 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1492 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:42.986980 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-5ec50cc4-c309-40ac-81ee-3ebcfb0a1ca8 req-afb75ffe-93db-481b-9549-20963e54b575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d191bac-6976-461e-9def-4f839a59331e", "name": "network-vif-deleted", "tag": "c456a7c4-6281-40e9-846b-1f8734a09c76"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:43.004492 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5ec50cc4-c309-40ac-81ee-3ebcfb0a1ca8 req-afb75ffe-93db-481b-9549-20963e54b575 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:43.005667 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5ec50cc4-c309-40ac-81ee-3ebcfb0a1ca8 req-afb75ffe-93db-481b-9549-20963e54b575 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:43.017883 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-332b9422-63bd-4c06-876e-cc17ed9873db tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2083097313" status: 204 len: 0 microversion: 2.2 time: 0.048731 Jul 19 22:31:43.019386 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 734/1450] 10.222.0.25 () {60 vars in 1260 bytes} [Tue Jul 19 22:31:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2083097313 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:31:43.027948 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-5ec50cc4-c309-40ac-81ee-3ebcfb0a1ca8 req-afb75ffe-93db-481b-9549-20963e54b575 service nova] Creating event network-vif-deleted:c456a7c4-6281-40e9-846b-1f8734a09c76 for instance 3d191bac-6976-461e-9def-4f839a59331e on n-h1-847009-3 Jul 19 22:31:43.031292 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-435b7922-03d5-4a19-b23f-54bf8abb0e8b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:43.032431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-435b7922-03d5-4a19-b23f-54bf8abb0e8b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:43.038296 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-5ec50cc4-c309-40ac-81ee-3ebcfb0a1ca8 req-afb75ffe-93db-481b-9549-20963e54b575 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055696 Jul 19 22:31:43.040751 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 717/1451] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:43.046573 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-435b7922-03d5-4a19-b23f-54bf8abb0e8b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:43.047485 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-435b7922-03d5-4a19-b23f-54bf8abb0e8b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:43.047731 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-30bc4b30-123c-4b5a-bb83-8a92d931a561 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Action: 'create', calling method: .version_select at 0x7f7a10625700>, body: {"keypair": {"name": "tempest-keypair-796568285", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:43.048767 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-435b7922-03d5-4a19-b23f-54bf8abb0e8b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:43.049719 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-435b7922-03d5-4a19-b23f-54bf8abb0e8b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:43.101621 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-30bc4b30-123c-4b5a-bb83-8a92d931a561 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Getting quotas for project 0c1390e1d2f1462e922ef2a226ea0626. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:31:43.110929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-30bc4b30-123c-4b5a-bb83-8a92d931a561 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Getting quotas for user 15f0bebffdc44572908491e8d832022f and project 0c1390e1d2f1462e922ef2a226ea0626. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:31:43.156259 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-30bc4b30-123c-4b5a-bb83-8a92d931a561 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.114129 Jul 19 22:31:43.156984 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 718/1452] 10.222.0.25 () {62 vars in 1198 bytes} [Tue Jul 19 22:31:43 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 116 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 19 22:31:43.174873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b1d0c070-7232-4686-98c7-ecf43bfcca21 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Calling method '.version_select at 0x7f7a105514c0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:43.204514 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b1d0c070-7232-4686-98c7-ecf43bfcca21 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-796568285" status: 204 len: 0 microversion: 2.2 time: 0.037027 Jul 19 22:31:43.214916 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 719/1453] 10.222.0.25 () {60 vars in 1257 bytes} [Tue Jul 19 22:31:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-796568285 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:31:43.220812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-436faa59-b3a6-4f19-a9e1-7abda7766842 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:43.221815 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-436faa59-b3a6-4f19-a9e1-7abda7766842 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:43.231336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-436faa59-b3a6-4f19-a9e1-7abda7766842 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:43.231838 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-436faa59-b3a6-4f19-a9e1-7abda7766842 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:43.232770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-436faa59-b3a6-4f19-a9e1-7abda7766842 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:43.233205 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-436faa59-b3a6-4f19-a9e1-7abda7766842 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:43.258069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-435b7922-03d5-4a19-b23f-54bf8abb0e8b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:43.299606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-435b7922-03d5-4a19-b23f-54bf8abb0e8b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:43.301356 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-435b7922-03d5-4a19-b23f-54bf8abb0e8b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:43.303054 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-435b7922-03d5-4a19-b23f-54bf8abb0e8b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 0.282271 Jul 19 22:31:43.304137 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 735/1454] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:31:43 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:31:43.313612 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-efa0ab24-fd2f-497e-9284-0188d5b76d08 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Action: 'create', calling method: .version_select at 0x7f7a10273550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2001756485", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMkZOa/XgTkqJdBJbZZrYqgwYDdUYYT6PRRuCduqYsQDN7LcSGv9eLDEa2sxHjJ+toNgyQzRDC1bhkL36yYluB3f+M/WOSAirdjH169djmD7Y+I0fpR3VJH3XxgO0BN8w=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:43.340069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-efa0ab24-fd2f-497e-9284-0188d5b76d08 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Getting quotas for project 0c1390e1d2f1462e922ef2a226ea0626. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:31:43.350739 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-efa0ab24-fd2f-497e-9284-0188d5b76d08 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Getting quotas for user 15f0bebffdc44572908491e8d832022f and project 0c1390e1d2f1462e922ef2a226ea0626. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:31:43.356294 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:31:43.393716 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-efa0ab24-fd2f-497e-9284-0188d5b76d08 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.086909 Jul 19 22:31:43.402679 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 736/1455] 10.222.0.25 () {62 vars in 1198 bytes} [Tue Jul 19 22:31:43 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 90 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 19 22:31:43.412227 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-db621298-7bfb-48b9-bfee-a221e2233370 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Action: 'create', calling method: .version_select at 0x7f7a104efd30>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-716715998", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKoQAGO5QE5YSartbbZ6B9FNlu6cZgsn7op1iPBdmxWTBQQne00ta12XovW/wsTg4wMrbmIzREmOHegnH21j7egueAdazB0ITDW4iV8bM4CmmhYJphLZCuuDNtZI6Duzg=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:43.449391 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-db621298-7bfb-48b9-bfee-a221e2233370 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Getting quotas for project 0c1390e1d2f1462e922ef2a226ea0626. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:31:43.456896 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-db621298-7bfb-48b9-bfee-a221e2233370 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Getting quotas for user 15f0bebffdc44572908491e8d832022f and project 0c1390e1d2f1462e922ef2a226ea0626. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:31:43.499362 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-db621298-7bfb-48b9-bfee-a221e2233370 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.094054 Jul 19 22:31:43.501603 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 737/1456] 10.222.0.25 () {62 vars in 1198 bytes} [Tue Jul 19 22:31:43 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 97 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jul 19 22:31:43.522698 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6876ec68-c81f-4da8-94b8-3d9dfc1e8751 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Action: 'create', calling method: .version_select at 0x7f7a103054c0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-276626051", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5iThVv7O7n0QZCTHrpx0rn0TxrmgFZIGFJXDMioDc3zbIuraFDFgFIfjRP3UBudPCdMQGgwV/IQ1zj6MJgG0MHBzafWgoSJXcnUE1NMJzmHvbZ7Y9qeOgy+7v22DyxlQ=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:43.549041 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-6876ec68-c81f-4da8-94b8-3d9dfc1e8751 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Getting quotas for project 0c1390e1d2f1462e922ef2a226ea0626. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:31:43.559629 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-6876ec68-c81f-4da8-94b8-3d9dfc1e8751 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Getting quotas for user 15f0bebffdc44572908491e8d832022f and project 0c1390e1d2f1462e922ef2a226ea0626. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:31:43.563784 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-436faa59-b3a6-4f19-a9e1-7abda7766842 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:43.596363 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-436faa59-b3a6-4f19-a9e1-7abda7766842 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f" status: 200 len: 1308 microversion: 2.1 time: 0.389232 Jul 19 22:31:43.598259 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 720/1457] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:43 2022] GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f => generated 1308 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:43.629687 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6876ec68-c81f-4da8-94b8-3d9dfc1e8751 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.114671 Jul 19 22:31:43.635173 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 738/1458] 10.222.0.25 () {62 vars in 1198 bytes} [Tue Jul 19 22:31:43 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 123 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 19 22:31:43.637119 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-994dbc99-0ade-437e-84a8-92d6450688bb tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:43.637788 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-994dbc99-0ade-437e-84a8-92d6450688bb tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:43.654922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c95e3b82-ea6d-47da-a107-d5270672c711 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Calling method '.version_select at 0x7f7a10273310>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:43.671404 n-d-847009-3 devstack@n-api.service[119337]: WARNING oslo_db.sqlalchemy.utils [None req-c95e3b82-ea6d-47da-a107-d5270672c711 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 19 22:31:43.671820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-994dbc99-0ade-437e-84a8-92d6450688bb tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:43.671820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-994dbc99-0ade-437e-84a8-92d6450688bb tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:43.672411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-994dbc99-0ade-437e-84a8-92d6450688bb tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:43.680942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-994dbc99-0ade-437e-84a8-92d6450688bb tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:43.691419 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c95e3b82-ea6d-47da-a107-d5270672c711 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.048723 Jul 19 22:31:43.697811 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 739/1459] 10.222.0.25 () {60 vars in 1176 bytes} [Tue Jul 19 22:31:43 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:43.709280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-39c14c59-bca8-4afa-b604-48039fbcf5bb tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Calling method '.version_select at 0x7f7a10609550>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:43.737297 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-39c14c59-bca8-4afa-b604-48039fbcf5bb tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-276626051" status: 204 len: 0 microversion: 2.2 time: 0.032648 Jul 19 22:31:43.738305 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 740/1460] 10.222.0.25 () {60 vars in 1317 bytes} [Tue Jul 19 22:31:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-276626051 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:31:43.748676 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-654c2fdf-0223-4a2d-9c4b-a8c2efeb0b34 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Calling method '.version_select at 0x7f7a103f78b0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:43.779161 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-654c2fdf-0223-4a2d-9c4b-a8c2efeb0b34 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-716715998" status: 204 len: 0 microversion: 2.2 time: 0.034826 Jul 19 22:31:43.781313 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 741/1461] 10.222.0.25 () {60 vars in 1317 bytes} [Tue Jul 19 22:31:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-716715998 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:31:43.796404 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f14210e4-3641-4543-9e8d-a18b9d3c95ff tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Calling method '.version_select at 0x7f7a10273040>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:43.822262 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f14210e4-3641-4543-9e8d-a18b9d3c95ff tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2001756485" status: 204 len: 0 microversion: 2.2 time: 0.034361 Jul 19 22:31:43.829783 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 742/1462] 10.222.0.25 () {60 vars in 1320 bytes} [Tue Jul 19 22:31:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2001756485 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:31:43.834839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1e3d8661-7c31-412d-a5e8-2f045284a90b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:43.835371 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1e3d8661-7c31-412d-a5e8-2f045284a90b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:43.844411 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e3d8661-7c31-412d-a5e8-2f045284a90b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:43.845114 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e3d8661-7c31-412d-a5e8-2f045284a90b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:43.846069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e3d8661-7c31-412d-a5e8-2f045284a90b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:43.846069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e3d8661-7c31-412d-a5e8-2f045284a90b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:43.887870 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1e3d8661-7c31-412d-a5e8-2f045284a90b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063516 Jul 19 22:31:43.891618 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 743/1463] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:31:43 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:43.896069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d02ef9e2-3e00-4218-b246-8380aa1115b5 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Action: 'create', calling method: .version_select at 0x7f7a1040fca0>, body: {"keypair": {"name": "tempest-keypair-1057333512", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIah1MoOU5ZcDb/ArY3UrJFTLDLefT5QOyY5bbIJCHkadZPRtlHF9hojE7nUPI0qMkktAZ5xxCDk2YYyRpu5V1twyrC6pUfrLp8iXRa8g3c7Q4Iwq6org55pFDpuIE7Uw=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:43.913513 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-d02ef9e2-3e00-4218-b246-8380aa1115b5 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Getting quotas for project 0c1390e1d2f1462e922ef2a226ea0626. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:31:43.921878 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-d02ef9e2-3e00-4218-b246-8380aa1115b5 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Getting quotas for user 15f0bebffdc44572908491e8d832022f and project 0c1390e1d2f1462e922ef2a226ea0626. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:31:43.922255 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-994dbc99-0ade-437e-84a8-92d6450688bb tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:43.933421 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-994dbc99-0ade-437e-84a8-92d6450688bb tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1" status: 200 len: 1472 microversion: 2.1 time: 0.315266 Jul 19 22:31:43.944308 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 721/1464] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:43 2022] GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 => generated 1472 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:43.975766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-87380843-0740-4030-b2a8-01badab5f632 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:43.976602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-87380843-0740-4030-b2a8-01badab5f632 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:43.984131 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d02ef9e2-3e00-4218-b246-8380aa1115b5 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.094270 Jul 19 22:31:43.990447 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 744/1465] 10.222.0.25 () {62 vars in 1198 bytes} [Tue Jul 19 22:31:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 98 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 19 22:31:43.990640 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87380843-0740-4030-b2a8-01badab5f632 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:43.996736 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87380843-0740-4030-b2a8-01badab5f632 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:43.998457 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87380843-0740-4030-b2a8-01badab5f632 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:44.000753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ef88466a-5258-4071-8f7f-5246de062279 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Calling method '.version_select at 0x7f7a10273e50>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:44.001391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87380843-0740-4030-b2a8-01badab5f632 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:44.022705 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ef88466a-5258-4071-8f7f-5246de062279 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-1057333512" status: 200 len: 513 microversion: 2.2 time: 0.030676 Jul 19 22:31:44.032168 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 745/1466] 10.222.0.25 () {60 vars in 1257 bytes} [Tue Jul 19 22:31:43 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1057333512 => generated 513 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:44.041574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fd51804f-5c66-47af-8c72-b600e5b6ec9a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:44.042550 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fd51804f-5c66-47af-8c72-b600e5b6ec9a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:44.091321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd51804f-5c66-47af-8c72-b600e5b6ec9a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:44.092146 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd51804f-5c66-47af-8c72-b600e5b6ec9a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:44.095854 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd51804f-5c66-47af-8c72-b600e5b6ec9a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:44.096630 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd51804f-5c66-47af-8c72-b600e5b6ec9a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:44.154367 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd51804f-5c66-47af-8c72-b600e5b6ec9a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:44.154996 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd51804f-5c66-47af-8c72-b600e5b6ec9a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:44.155747 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-fd51804f-5c66-47af-8c72-b600e5b6ec9a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lazy-loading 'fault' on Instance uuid 3d191bac-6976-461e-9def-4f839a59331e {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:31:44.239203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fd51804f-5c66-47af-8c72-b600e5b6ec9a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:44.250414 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fd51804f-5c66-47af-8c72-b600e5b6ec9a tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 200 len: 1368 microversion: 2.1 time: 0.221650 Jul 19 22:31:44.251025 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 746/1467] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:44 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:44.261536 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-923d88d4-6e2b-4975-b8d5-c0df87c7fd10 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Calling method '.version_select at 0x7f7a102733a0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:44.262588 n-d-847009-3 devstack@n-api.service[119337]: WARNING oslo_db.sqlalchemy.utils [None req-923d88d4-6e2b-4975-b8d5-c0df87c7fd10 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 19 22:31:44.280361 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-923d88d4-6e2b-4975-b8d5-c0df87c7fd10 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.027312 Jul 19 22:31:44.280970 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 747/1468] 10.222.0.25 () {60 vars in 1176 bytes} [Tue Jul 19 22:31:44 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:44.296363 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1b4a8b8d-f253-4027-953f-b451acdbcd11 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Calling method '.version_select at 0x7f7a104ef5e0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:44.328633 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1b4a8b8d-f253-4027-953f-b451acdbcd11 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057333512" status: 204 len: 0 microversion: 2.2 time: 0.035140 Jul 19 22:31:44.331290 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 748/1469] 10.222.0.25 () {60 vars in 1260 bytes} [Tue Jul 19 22:31:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057333512 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:31:44.343049 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0c7a1044-2e60-4113-9142-4e26a0e6ced1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:44.343857 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0c7a1044-2e60-4113-9142-4e26a0e6ced1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:44.353976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c7a1044-2e60-4113-9142-4e26a0e6ced1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:44.354602 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c7a1044-2e60-4113-9142-4e26a0e6ced1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:44.355556 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c7a1044-2e60-4113-9142-4e26a0e6ced1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:44.356094 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c7a1044-2e60-4113-9142-4e26a0e6ced1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:44.463344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-87380843-0740-4030-b2a8-01badab5f632 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:44.473981 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-87380843-0740-4030-b2a8-01badab5f632 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1473 microversion: 2.1 time: 0.503704 Jul 19 22:31:44.475567 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 722/1470] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:43 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1473 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:44.492291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b9b1ea88-32e6-443c-a5ed-a20a6730605b tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Action: 'create', calling method: .version_select at 0x7f7a10625d30>, body: {"keypair": {"name": "tempest-keypair-1778358801", "type": "x509"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:44.510776 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-b9b1ea88-32e6-443c-a5ed-a20a6730605b tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Getting quotas for project 0c1390e1d2f1462e922ef2a226ea0626. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:31:44.518362 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-b9b1ea88-32e6-443c-a5ed-a20a6730605b tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Getting quotas for user 15f0bebffdc44572908491e8d832022f and project 0c1390e1d2f1462e922ef2a226ea0626. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:31:44.552322 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.processutils [None req-b9b1ea88-32e6-443c-a5ed-a20a6730605b tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpck9otm3_/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpck9otm3_/temp.key -subj /CN=15f0bebffdc44572908491e8d832022f -extensions v3_req_client {{(pid=119338) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 19 22:31:44.718128 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0c7a1044-2e60-4113-9142-4e26a0e6ced1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:44.722052 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:31:44.725121 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:31:44.730921 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0c7a1044-2e60-4113-9142-4e26a0e6ced1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:44.733271 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0c7a1044-2e60-4113-9142-4e26a0e6ced1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:44.735963 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0c7a1044-2e60-4113-9142-4e26a0e6ced1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 0.399023 Jul 19 22:31:44.737026 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 749/1471] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:31:44 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:31:44.742161 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1d799e34-4891-48c0-b156-3918e34e5400 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:44.744120 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1d799e34-4891-48c0-b156-3918e34e5400 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:44.760181 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d799e34-4891-48c0-b156-3918e34e5400 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:44.760966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d799e34-4891-48c0-b156-3918e34e5400 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:44.761855 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d799e34-4891-48c0-b156-3918e34e5400 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:44.762563 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d799e34-4891-48c0-b156-3918e34e5400 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:44.872072 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.processutils [None req-b9b1ea88-32e6-443c-a5ed-a20a6730605b tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpck9otm3_/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpck9otm3_/temp.key -subj /CN=15f0bebffdc44572908491e8d832022f -extensions v3_req_client" returned: 0 in 0.319s {{(pid=119338) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 19 22:31:44.875744 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.processutils [None req-b9b1ea88-32e6-443c-a5ed-a20a6730605b tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpck9otm3_/temp.key -password pass: {{(pid=119338) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 19 22:31:44.941611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.processutils [None req-b9b1ea88-32e6-443c-a5ed-a20a6730605b tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpck9otm3_/temp.key -password pass:" returned: 0 in 0.066s {{(pid=119338) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 19 22:31:45.009680 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-b9b1ea88-32e6-443c-a5ed-a20a6730605b tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Getting quotas for project 0c1390e1d2f1462e922ef2a226ea0626. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:31:45.022441 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-b9b1ea88-32e6-443c-a5ed-a20a6730605b tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Getting quotas for user 15f0bebffdc44572908491e8d832022f and project 0c1390e1d2f1462e922ef2a226ea0626. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:31:45.050514 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b9b1ea88-32e6-443c-a5ed-a20a6730605b tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.571820 Jul 19 22:31:45.053647 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 723/1472] 10.222.0.25 () {62 vars in 1197 bytes} [Tue Jul 19 22:31:44 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 577 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:31:45.061869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3e20eb7d-a404-435b-8d7a-d1b344652205 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:45.063444 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3e20eb7d-a404-435b-8d7a-d1b344652205 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:45.072949 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e20eb7d-a404-435b-8d7a-d1b344652205 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:45.073679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e20eb7d-a404-435b-8d7a-d1b344652205 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:45.075300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e20eb7d-a404-435b-8d7a-d1b344652205 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:45.076168 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e20eb7d-a404-435b-8d7a-d1b344652205 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:45.127297 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3e20eb7d-a404-435b-8d7a-d1b344652205 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070755 Jul 19 22:31:45.134102 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 724/1473] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:31:45 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:45.134102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-748b8255-b1ba-4a22-b2da-c56c69b9ccff tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:45.135088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-748b8255-b1ba-4a22-b2da-c56c69b9ccff tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:45.144949 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-748b8255-b1ba-4a22-b2da-c56c69b9ccff tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:45.145598 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-748b8255-b1ba-4a22-b2da-c56c69b9ccff tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:45.147771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-748b8255-b1ba-4a22-b2da-c56c69b9ccff tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:45.149196 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-748b8255-b1ba-4a22-b2da-c56c69b9ccff tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:45.164150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1d799e34-4891-48c0-b156-3918e34e5400 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:45.176023 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1d799e34-4891-48c0-b156-3918e34e5400 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f" status: 200 len: 1308 microversion: 2.1 time: 0.437606 Jul 19 22:31:45.177513 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 750/1474] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:44 2022] GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f => generated 1308 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:45.184158 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e395293a-db67-4bc6-a5ac-275ba7461bdb tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Calling method '.version_select at 0x7f7a1040fca0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:45.201990 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e395293a-db67-4bc6-a5ac-275ba7461bdb tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-1778358801" status: 200 len: 1534 microversion: 2.2 time: 0.022738 Jul 19 22:31:45.211444 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 751/1475] 10.222.0.25 () {60 vars in 1257 bytes} [Tue Jul 19 22:31:45 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1778358801 => generated 1534 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:45.220821 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-f0ccdec9-4aea-451e-bf59-6bb89acbe527 req-7545a143-0d0c-473b-aea4-e14f0c0c7d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a55a915-9f3d-4d8b-be8b-b1f7290eccc1", "name": "network-vif-deleted", "tag": "8e6d0cbe-d249-4344-a244-71c2ccf15b18"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:45.240229 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-f0ccdec9-4aea-451e-bf59-6bb89acbe527 req-7545a143-0d0c-473b-aea4-e14f0c0c7d03 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:45.240943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-f0ccdec9-4aea-451e-bf59-6bb89acbe527 req-7545a143-0d0c-473b-aea4-e14f0c0c7d03 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:45.285613 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-748b8255-b1ba-4a22-b2da-c56c69b9ccff tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:45.292046 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-f0ccdec9-4aea-451e-bf59-6bb89acbe527 req-7545a143-0d0c-473b-aea4-e14f0c0c7d03 service nova] Creating event network-vif-deleted:8e6d0cbe-d249-4344-a244-71c2ccf15b18 for instance 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 on n-h1-847009-3 Jul 19 22:31:45.302338 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-748b8255-b1ba-4a22-b2da-c56c69b9ccff tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1" status: 200 len: 1301 microversion: 2.1 time: 0.172703 Jul 19 22:31:45.303598 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 725/1476] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:45 2022] GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 => generated 1301 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:45.310893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4272d935-d538-4fbb-8a4f-3ab727213d0a tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Calling method '.version_select at 0x7f7a10426550>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:45.313429 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-f0ccdec9-4aea-451e-bf59-6bb89acbe527 req-7545a143-0d0c-473b-aea4-e14f0c0c7d03 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099404 Jul 19 22:31:45.314374 n-d-847009-3 devstack@n-api.service[119338]: WARNING oslo_db.sqlalchemy.utils [None req-4272d935-d538-4fbb-8a4f-3ab727213d0a tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 19 22:31:45.314532 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 752/1477] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:45.328559 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4272d935-d538-4fbb-8a4f-3ab727213d0a tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.023764 Jul 19 22:31:45.328897 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8b8937e9-db89-442c-a269-340a3ac5f796 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:45.337335 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 726/1478] 10.222.0.25 () {60 vars in 1176 bytes} [Tue Jul 19 22:31:45 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:45.346713 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8b8937e9-db89-442c-a269-340a3ac5f796 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 3d191bac-6976-461e-9def-4f839a59331e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:45.348793 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3ef52f0e-cbca-4738-abd9-c5c2e81a8ed3 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] Calling method '.version_select at 0x7f7a1045d040>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:45.366710 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b8937e9-db89-442c-a269-340a3ac5f796 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:45.367355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b8937e9-db89-442c-a269-340a3ac5f796 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:45.369446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b8937e9-db89-442c-a269-340a3ac5f796 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:45.370049 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b8937e9-db89-442c-a269-340a3ac5f796 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:45.381789 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3ef52f0e-cbca-4738-abd9-c5c2e81a8ed3 tempest-KeyPairsV22TestJSON-216331808 tempest-KeyPairsV22TestJSON-216331808-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778358801" status: 204 len: 0 microversion: 2.2 time: 0.039992 Jul 19 22:31:45.382591 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 727/1479] 10.222.0.25 () {60 vars in 1260 bytes} [Tue Jul 19 22:31:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778358801 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:31:45.416894 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-8b8937e9-db89-442c-a269-340a3ac5f796 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] HTTP exception thrown: Instance 3d191bac-6976-461e-9def-4f839a59331e could not be found. Jul 19 22:31:45.420217 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8b8937e9-db89-442c-a269-340a3ac5f796 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Request method failure captured: Jul 19 22:31:45.420217 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e HTTP/1.1 Jul 19 22:31:45.420217 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:31:45.420217 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:31:45.420217 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:31:45.420217 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:31:45.420217 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:31:45.420217 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:31:45.420217 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:31:45.420217 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:31:45.420217 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y9SKRTUgCp_a51-hxNmwpKIKbKego58wzUVpV8NH1wkVEqNRcwiabhpu6-ejJO6NeuhCRw_tHsx7Bw-epZD_t9D4FWivKhoitt_DdR_Js8cp-eQMzZoy9heKP13Txs6oLIr0IwjxnF47WFqAJ4Whduy7jC5bTCDC8m-V9GrXtVoG9c Jul 19 22:31:45.420217 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:31:45.420217 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:31:45.420217 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:31:45.420217 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:31:45.420217 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:31:45.420217 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:31:45.420217 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: eed5e83db4ae4156ae9635b84ca7ff4a Jul 19 22:31:45.420217 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-MigrationsAdminTest-1358192571 Jul 19 22:31:45.420217 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:31:45.420217 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:31:45.421822 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eed5e83db4ae4156ae9635b84ca7ff4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eed5e83db4ae4156ae9635b84ca7ff4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eed5e83db4ae4156ae9635b84ca7ff4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eed5e83db4ae4156ae9635b84ca7ff4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:31:45.421822 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-MigrationsAdminTest-1358192571 Jul 19 22:31:45.421822 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: eed5e83db4ae4156ae9635b84ca7ff4a Jul 19 22:31:45.421822 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-MigrationsAdminTest-1358192571 Jul 19 22:31:45.421822 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-MigrationsAdminTest-1358192571-project Jul 19 22:31:45.421822 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:31:45.421822 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:31:45.421822 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: e3ef9d4c38d547a1a1532d964195144a Jul 19 22:31:45.421822 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-MigrationsAdminTest-1358192571-project Jul 19 22:31:45.421822 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:31:45.421822 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 3d191bac-6976-461e-9def-4f839a59331e could not be found. Jul 19 22:31:45.421822 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '3d191bac-6976-461e-9def-4f839a59331e'} Jul 19 22:31:45.422745 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:31:45.422745 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:45.422745 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:31:45.422745 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:31:45.422745 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:31:45.422745 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:31:45.422745 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:31:45.422745 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:31:45.422745 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:31:45.422745 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:31:45.422745 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d191bac-6976-461e-9def-4f839a59331e could not be found. Jul 19 22:31:45.422745 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:45.422745 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:45.422745 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:45.422745 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:45.422745 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:45.422745 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:45.422745 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:31:45.422745 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:31:45.422745 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:31:45.424256 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:31:45.424256 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:31:45.424256 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:31:45.424256 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:31:45.424256 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:31:45.424256 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:31:45.424256 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:31:45.424256 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d191bac-6976-461e-9def-4f839a59331e could not be found. Jul 19 22:31:45.424256 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:45.424256 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:45.424256 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:45.424256 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:45.424256 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:45.424256 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:45.424256 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:31:45.424256 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:31:45.424256 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d191bac-6976-461e-9def-4f839a59331e could not be found. Jul 19 22:31:45.424256 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:45.429600 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8b8937e9-db89-442c-a269-340a3ac5f796 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Returning 404 to user: Instance 3d191bac-6976-461e-9def-4f839a59331e could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:31:45.437340 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8b8937e9-db89-442c-a269-340a3ac5f796 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e" status: 404 len: 111 microversion: 2.1 time: 0.120728 Jul 19 22:31:45.447532 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 753/1480] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:45 2022] GET /compute/v2.1/servers/3d191bac-6976-461e-9def-4f839a59331e => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:31:45.451519 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-06731afe-6ed7-4475-9b83-9fe01928f17f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '.version_select at 0x7f7a10625820>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:45.475853 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-06731afe-6ed7-4475-9b83-9fe01928f17f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-628086489" status: 202 len: 0 microversion: 2.1 time: 0.029789 Jul 19 22:31:45.480246 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 728/1481] 10.222.0.25 () {58 vars in 1217 bytes} [Tue Jul 19 22:31:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-628086489 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 22:31:45.501630 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-db4b8d84-1613-4c42-9292-82d6cf707858 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:45.503150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-db4b8d84-1613-4c42-9292-82d6cf707858 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:45.525717 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db4b8d84-1613-4c42-9292-82d6cf707858 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:45.531465 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db4b8d84-1613-4c42-9292-82d6cf707858 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:45.545496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db4b8d84-1613-4c42-9292-82d6cf707858 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:45.547193 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db4b8d84-1613-4c42-9292-82d6cf707858 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:45.760400 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-eeaa5993-7d45-4142-a303-eba8143fb55f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:45.761480 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-eeaa5993-7d45-4142-a303-eba8143fb55f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:45.790891 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eeaa5993-7d45-4142-a303-eba8143fb55f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:45.797476 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eeaa5993-7d45-4142-a303-eba8143fb55f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:45.806081 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eeaa5993-7d45-4142-a303-eba8143fb55f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:45.810497 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eeaa5993-7d45-4142-a303-eba8143fb55f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:46.140757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-db4b8d84-1613-4c42-9292-82d6cf707858 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:46.185228 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-db4b8d84-1613-4c42-9292-82d6cf707858 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1473 microversion: 2.1 time: 0.689498 Jul 19 22:31:46.193650 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 754/1482] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:45 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1473 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:46.213270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-97a5210e-41e6-42da-ab8e-d88e839cd3f7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:46.225130 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-97a5210e-41e6-42da-ab8e-d88e839cd3f7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:46.259751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-97a5210e-41e6-42da-ab8e-d88e839cd3f7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:46.259751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-97a5210e-41e6-42da-ab8e-d88e839cd3f7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:46.261059 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-97a5210e-41e6-42da-ab8e-d88e839cd3f7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:46.261785 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-97a5210e-41e6-42da-ab8e-d88e839cd3f7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:46.323032 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-97a5210e-41e6-42da-ab8e-d88e839cd3f7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126667 Jul 19 22:31:46.333495 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 755/1483] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:31:46 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:46.345001 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-584f4981-fa9e-49b2-bb56-896320eb744e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:46.346100 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-584f4981-fa9e-49b2-bb56-896320eb744e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:46.366074 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-584f4981-fa9e-49b2-bb56-896320eb744e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:46.366820 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-584f4981-fa9e-49b2-bb56-896320eb744e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:46.369083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-584f4981-fa9e-49b2-bb56-896320eb744e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:46.369642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-584f4981-fa9e-49b2-bb56-896320eb744e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:46.699563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-eeaa5993-7d45-4142-a303-eba8143fb55f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:46.716008 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-eeaa5993-7d45-4142-a303-eba8143fb55f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:46.717711 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-eeaa5993-7d45-4142-a303-eba8143fb55f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:46.718953 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-eeaa5993-7d45-4142-a303-eba8143fb55f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 0.963652 Jul 19 22:31:46.723071 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 729/1484] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:31:45 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:31:46.735816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c6c17fcf-230b-402e-933e-3d00696be220 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:46.736462 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c6c17fcf-230b-402e-933e-3d00696be220 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:46.744111 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6c17fcf-230b-402e-933e-3d00696be220 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:46.745326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6c17fcf-230b-402e-933e-3d00696be220 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:46.745507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6c17fcf-230b-402e-933e-3d00696be220 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:46.745829 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6c17fcf-230b-402e-933e-3d00696be220 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:46.754087 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-584f4981-fa9e-49b2-bb56-896320eb744e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:46.764187 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-584f4981-fa9e-49b2-bb56-896320eb744e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f" status: 200 len: 1308 microversion: 2.1 time: 0.428981 Jul 19 22:31:46.778551 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 756/1485] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:46 2022] GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f => generated 1308 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:46.789151 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-2cfdc704-7e89-487f-b7f3-e57a6fe44bfa req-16447477-1abb-4070-9907-efd5fa2d2256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c3a620-1bea-42df-b1b5-fda7ad4de42f", "name": "network-vif-plugged", "status": "completed", "tag": "e6bc4adb-2eb2-4855-b7e4-a430ffaeae9c"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:46.796776 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-c6c17fcf-230b-402e-933e-3d00696be220 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] HTTP exception thrown: Instance 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 could not be found. Jul 19 22:31:46.798983 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c6c17fcf-230b-402e-933e-3d00696be220 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Request method failure captured: Jul 19 22:31:46.798983 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 HTTP/1.1 Jul 19 22:31:46.798983 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:31:46.798983 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:31:46.798983 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:31:46.798983 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:31:46.798983 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:31:46.798983 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:31:46.798983 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:31:46.798983 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:31:46.798983 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y_lSToTGm6PgX7y4oIs7m5rgLyqg2BjZd8UIRxYbJb2m9EeYEMUBVSO6DHIQ83QGW3D2BNOgioifqv3NuMCiblu_B1iW2SpP-MN-RDBJYPyNbMjv8oGahIddMDTYqMxE8B_kTRHiqGPN6emfEZQBLQO7qtQOHZEh90KLuTSeNhouus Jul 19 22:31:46.798983 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:31:46.798983 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:31:46.798983 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:31:46.798983 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:31:46.798983 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:31:46.798983 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:31:46.798983 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 791e176b6751415ca1472c109b3ce011 Jul 19 22:31:46.798983 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersOnMultiNodesTest-1303510158 Jul 19 22:31:46.798983 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:31:46.798983 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:31:46.800313 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_791e176b6751415ca1472c109b3ce011"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/791e176b6751415ca1472c109b3ce011"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/791e176b6751415ca1472c109b3ce011"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/791e176b6751415ca1472c109b3ce011"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:31:46.800313 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersOnMultiNodesTest-1303510158 Jul 19 22:31:46.800313 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 791e176b6751415ca1472c109b3ce011 Jul 19 22:31:46.800313 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1303510158 Jul 19 22:31:46.800313 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersOnMultiNodesTest-1303510158-project Jul 19 22:31:46.800313 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:31:46.800313 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:31:46.800313 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: bd5fb561f7bd429e8c6b2cc30ed76f13 Jul 19 22:31:46.800313 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersOnMultiNodesTest-1303510158-project Jul 19 22:31:46.800313 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:31:46.800313 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 could not be found. Jul 19 22:31:46.800313 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '0a55a915-9f3d-4d8b-be8b-b1f7290eccc1'} Jul 19 22:31:46.801075 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:31:46.801075 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:46.801075 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:31:46.801075 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:31:46.801075 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:31:46.801075 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:31:46.801075 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:31:46.801075 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:31:46.801075 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:31:46.801075 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:31:46.801075 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 could not be found. Jul 19 22:31:46.801075 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:46.801075 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:46.801075 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:46.801075 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:46.801075 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:46.801075 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:46.801075 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:31:46.801075 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:31:46.801075 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:31:46.802830 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:31:46.802830 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:31:46.802830 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:31:46.802830 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:31:46.802830 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:31:46.802830 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:31:46.802830 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:31:46.802830 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 could not be found. Jul 19 22:31:46.802830 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:46.802830 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:46.802830 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:46.802830 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:46.802830 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:46.802830 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:46.802830 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:31:46.802830 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:31:46.802830 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 could not be found. Jul 19 22:31:46.802830 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:46.803957 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c6c17fcf-230b-402e-933e-3d00696be220 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Returning 404 to user: Instance 0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:31:46.803957 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c6c17fcf-230b-402e-933e-3d00696be220 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1" status: 404 len: 111 microversion: 2.1 time: 0.076382 Jul 19 22:31:46.806778 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 730/1486] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:46 2022] GET /compute/v2.1/servers/0a55a915-9f3d-4d8b-be8b-b1f7290eccc1 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:31:46.812851 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-963416b5-5f6a-4948-b2ac-b3b746639aaf tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:46.813372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-963416b5-5f6a-4948-b2ac-b3b746639aaf tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: ca03e7c4-e8c2-43f5-8528-7b2a847ca718] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:46.817923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-2cfdc704-7e89-487f-b7f3-e57a6fe44bfa req-16447477-1abb-4070-9907-efd5fa2d2256 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:46.818377 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-2cfdc704-7e89-487f-b7f3-e57a6fe44bfa req-16447477-1abb-4070-9907-efd5fa2d2256 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:46.832512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-963416b5-5f6a-4948-b2ac-b3b746639aaf tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:46.832975 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-963416b5-5f6a-4948-b2ac-b3b746639aaf tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:46.833775 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-963416b5-5f6a-4948-b2ac-b3b746639aaf tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:46.834228 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-963416b5-5f6a-4948-b2ac-b3b746639aaf tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:46.843589 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-2cfdc704-7e89-487f-b7f3-e57a6fe44bfa req-16447477-1abb-4070-9907-efd5fa2d2256 service nova] Creating event network-vif-plugged:e6bc4adb-2eb2-4855-b7e4-a430ffaeae9c for instance d2c3a620-1bea-42df-b1b5-fda7ad4de42f on n-h2-847009-3 Jul 19 22:31:46.858190 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-2cfdc704-7e89-487f-b7f3-e57a6fe44bfa req-16447477-1abb-4070-9907-efd5fa2d2256 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078174 Jul 19 22:31:46.858823 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 757/1487] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:46.908874 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-963416b5-5f6a-4948-b2ac-b3b746639aaf tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: ca03e7c4-e8c2-43f5-8528-7b2a847ca718] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:31:47.075580 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e41172a5-0214-4dad-8be1-63a892a0ab41 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:47.079217 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e41172a5-0214-4dad-8be1-63a892a0ab41 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:47.091007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e41172a5-0214-4dad-8be1-63a892a0ab41 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:47.091829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e41172a5-0214-4dad-8be1-63a892a0ab41 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:47.092885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e41172a5-0214-4dad-8be1-63a892a0ab41 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:47.093502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e41172a5-0214-4dad-8be1-63a892a0ab41 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:47.093906 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-963416b5-5f6a-4948-b2ac-b3b746639aaf tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ca03e7c4-e8c2-43f5-8528-7b2a847ca718" status: 204 len: 0 microversion: 2.1 time: 0.282959 Jul 19 22:31:47.097011 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 731/1488] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:31:46 2022] DELETE /compute/v2.1/servers/ca03e7c4-e8c2-43f5-8528-7b2a847ca718 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:31:47.106362 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3968b75c-eabc-4dac-a79f-443b0838e27f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:47.107258 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3968b75c-eabc-4dac-a79f-443b0838e27f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0cc94c67-92c3-491d-974d-1a40bf8757c4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:47.120592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3968b75c-eabc-4dac-a79f-443b0838e27f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:47.121051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3968b75c-eabc-4dac-a79f-443b0838e27f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:47.121859 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3968b75c-eabc-4dac-a79f-443b0838e27f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:47.122300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3968b75c-eabc-4dac-a79f-443b0838e27f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:47.140324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e41172a5-0214-4dad-8be1-63a892a0ab41 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:31:47.170309 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3968b75c-eabc-4dac-a79f-443b0838e27f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0cc94c67-92c3-491d-974d-1a40bf8757c4] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:31:47.260741 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e41172a5-0214-4dad-8be1-63a892a0ab41 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "DELETE /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 204 len: 0 microversion: 2.1 time: 0.200767 Jul 19 22:31:47.265839 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 758/1489] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:31:47 2022] DELETE /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 22:31:47.272164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-240d7ebd-4be9-4dcb-8555-a864f78d2989 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:47.273330 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-240d7ebd-4be9-4dcb-8555-a864f78d2989 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:47.275845 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:31:47.281243 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-240d7ebd-4be9-4dcb-8555-a864f78d2989 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:47.281942 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-240d7ebd-4be9-4dcb-8555-a864f78d2989 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:47.283029 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-240d7ebd-4be9-4dcb-8555-a864f78d2989 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:47.283715 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-240d7ebd-4be9-4dcb-8555-a864f78d2989 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:47.424334 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3968b75c-eabc-4dac-a79f-443b0838e27f tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4" status: 204 len: 0 microversion: 2.1 time: 0.320251 Jul 19 22:31:47.426531 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 732/1490] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:31:47 2022] DELETE /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:31:47.446477 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b7b70f70-68ae-4570-81b5-473eefb21865 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:47.448542 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b7b70f70-68ae-4570-81b5-473eefb21865 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:47.468768 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b7b70f70-68ae-4570-81b5-473eefb21865 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:47.469588 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b7b70f70-68ae-4570-81b5-473eefb21865 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:47.471011 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b7b70f70-68ae-4570-81b5-473eefb21865 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:47.471838 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b7b70f70-68ae-4570-81b5-473eefb21865 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:47.503187 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-240d7ebd-4be9-4dcb-8555-a864f78d2989 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:47.513185 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-240d7ebd-4be9-4dcb-8555-a864f78d2989 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1473 microversion: 2.1 time: 0.245477 Jul 19 22:31:47.524033 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 759/1491] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:47 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1473 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:47.537562 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8b69b98f-091e-49e4-bcf1-810e3edffd17 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:47.538547 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8b69b98f-091e-49e4-bcf1-810e3edffd17 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:47.579703 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b69b98f-091e-49e4-bcf1-810e3edffd17 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:47.580162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b69b98f-091e-49e4-bcf1-810e3edffd17 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:47.581158 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b69b98f-091e-49e4-bcf1-810e3edffd17 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:47.581782 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b69b98f-091e-49e4-bcf1-810e3edffd17 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:47.633445 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8b69b98f-091e-49e4-bcf1-810e3edffd17 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.107213 Jul 19 22:31:47.639479 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 760/1492] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:31:47 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:31:47.639756 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6eee1aeb-8f10-4244-80e6-92678ba3837b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:47.640276 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6eee1aeb-8f10-4244-80e6-92678ba3837b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: ca03e7c4-e8c2-43f5-8528-7b2a847ca718] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:47.642336 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:31:47.648133 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6eee1aeb-8f10-4244-80e6-92678ba3837b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:47.648581 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6eee1aeb-8f10-4244-80e6-92678ba3837b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:47.650085 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6eee1aeb-8f10-4244-80e6-92678ba3837b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:47.650524 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6eee1aeb-8f10-4244-80e6-92678ba3837b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:47.774392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b7b70f70-68ae-4570-81b5-473eefb21865 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:47.784969 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b7b70f70-68ae-4570-81b5-473eefb21865 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1467 microversion: 2.1 time: 0.354959 Jul 19 22:31:47.795174 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 733/1493] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:47 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1467 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:47.795174 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5dfb6620-3703-431b-88c1-331fbd570aa4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:47.795174 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5dfb6620-3703-431b-88c1-331fbd570aa4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:47.803360 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5dfb6620-3703-431b-88c1-331fbd570aa4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:47.803360 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5dfb6620-3703-431b-88c1-331fbd570aa4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:47.803643 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5dfb6620-3703-431b-88c1-331fbd570aa4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:47.804561 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5dfb6620-3703-431b-88c1-331fbd570aa4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:47.921599 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6eee1aeb-8f10-4244-80e6-92678ba3837b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:47.931347 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6eee1aeb-8f10-4244-80e6-92678ba3837b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/ca03e7c4-e8c2-43f5-8528-7b2a847ca718" status: 200 len: 1474 microversion: 2.1 time: 0.294839 Jul 19 22:31:47.931605 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 761/1494] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:47 2022] GET /compute/v2.1/servers/ca03e7c4-e8c2-43f5-8528-7b2a847ca718 => generated 1474 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:47.946001 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f6125844-310f-46ac-b399-9bfbd5f353ad tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:47.946757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f6125844-310f-46ac-b399-9bfbd5f353ad tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:47.955273 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f6125844-310f-46ac-b399-9bfbd5f353ad tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:47.955730 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f6125844-310f-46ac-b399-9bfbd5f353ad tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:47.956925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f6125844-310f-46ac-b399-9bfbd5f353ad tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:47.961149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f6125844-310f-46ac-b399-9bfbd5f353ad tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:48.091628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5dfb6620-3703-431b-88c1-331fbd570aa4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:48.119867 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5dfb6620-3703-431b-88c1-331fbd570aa4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:48.123709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5dfb6620-3703-431b-88c1-331fbd570aa4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:48.128253 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5dfb6620-3703-431b-88c1-331fbd570aa4 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 0.340545 Jul 19 22:31:48.143740 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 734/1495] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:31:47 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:31:48.172780 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f6125844-310f-46ac-b399-9bfbd5f353ad tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:48.181171 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f6125844-310f-46ac-b399-9bfbd5f353ad tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f" status: 200 len: 1308 microversion: 2.1 time: 0.239254 Jul 19 22:31:48.190922 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 762/1496] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:47 2022] GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f => generated 1308 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:48.533135 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3133d530-bf31-4ee0-8820-2ee35b526f95 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:48.533798 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3133d530-bf31-4ee0-8820-2ee35b526f95 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:48.544963 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3133d530-bf31-4ee0-8820-2ee35b526f95 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:48.545833 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3133d530-bf31-4ee0-8820-2ee35b526f95 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:48.546869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3133d530-bf31-4ee0-8820-2ee35b526f95 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:48.547619 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3133d530-bf31-4ee0-8820-2ee35b526f95 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:48.828646 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3133d530-bf31-4ee0-8820-2ee35b526f95 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:48.851300 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3133d530-bf31-4ee0-8820-2ee35b526f95 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1473 microversion: 2.1 time: 0.322686 Jul 19 22:31:48.852965 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 735/1497] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:48 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1473 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:48.865508 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-38d85e3a-96d2-4f4d-85d4-1e32bd308cd6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:48.868577 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-38d85e3a-96d2-4f4d-85d4-1e32bd308cd6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:48.873153 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:31:48.887918 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-38d85e3a-96d2-4f4d-85d4-1e32bd308cd6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:48.888437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-38d85e3a-96d2-4f4d-85d4-1e32bd308cd6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:48.889245 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-38d85e3a-96d2-4f4d-85d4-1e32bd308cd6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:48.889928 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-38d85e3a-96d2-4f4d-85d4-1e32bd308cd6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:48.957703 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ad22c855-a8f6-4489-b138-bfc2dd050cae tempest-AbsoluteLimitsTestJSON-198584732 tempest-AbsoluteLimitsTestJSON-198584732-project] Calling method '.version_select at 0x7f7a10273a60>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:48.993340 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad22c855-a8f6-4489-b138-bfc2dd050cae tempest-AbsoluteLimitsTestJSON-198584732 tempest-AbsoluteLimitsTestJSON-198584732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:49.001752 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad22c855-a8f6-4489-b138-bfc2dd050cae tempest-AbsoluteLimitsTestJSON-198584732 tempest-AbsoluteLimitsTestJSON-198584732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:49.001752 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad22c855-a8f6-4489-b138-bfc2dd050cae tempest-AbsoluteLimitsTestJSON-198584732 tempest-AbsoluteLimitsTestJSON-198584732-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:49.002072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad22c855-a8f6-4489-b138-bfc2dd050cae tempest-AbsoluteLimitsTestJSON-198584732 tempest-AbsoluteLimitsTestJSON-198584732-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:49.048556 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ad22c855-a8f6-4489-b138-bfc2dd050cae tempest-AbsoluteLimitsTestJSON-198584732 tempest-AbsoluteLimitsTestJSON-198584732-project] 10.222.0.25 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.346461 Jul 19 22:31:49.052542 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 763/1498] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 22:31:48 2022] GET /compute/v2.1/limits => generated 511 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:49.063206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fc3492e3-92fc-49b3-818d-8791f18f59b8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:49.065031 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fc3492e3-92fc-49b3-818d-8791f18f59b8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: ca03e7c4-e8c2-43f5-8528-7b2a847ca718] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:49.081989 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc3492e3-92fc-49b3-818d-8791f18f59b8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:49.096069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc3492e3-92fc-49b3-818d-8791f18f59b8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:49.097799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc3492e3-92fc-49b3-818d-8791f18f59b8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:49.098567 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc3492e3-92fc-49b3-818d-8791f18f59b8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:49.304076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-38d85e3a-96d2-4f4d-85d4-1e32bd308cd6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:49.321692 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-38d85e3a-96d2-4f4d-85d4-1e32bd308cd6 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1467 microversion: 2.1 time: 0.466687 Jul 19 22:31:49.323289 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 736/1499] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:48 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1467 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:49.333678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9ede2cef-37e7-463a-9095-0ec402bd7068 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:49.334761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9ede2cef-37e7-463a-9095-0ec402bd7068 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:49.343246 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ede2cef-37e7-463a-9095-0ec402bd7068 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:49.344144 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ede2cef-37e7-463a-9095-0ec402bd7068 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:49.345264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ede2cef-37e7-463a-9095-0ec402bd7068 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:49.345894 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ede2cef-37e7-463a-9095-0ec402bd7068 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:49.690386 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fc3492e3-92fc-49b3-818d-8791f18f59b8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:49.706813 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fc3492e3-92fc-49b3-818d-8791f18f59b8 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/ca03e7c4-e8c2-43f5-8528-7b2a847ca718" status: 200 len: 1474 microversion: 2.1 time: 0.651485 Jul 19 22:31:49.708021 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 764/1500] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:49 2022] GET /compute/v2.1/servers/ca03e7c4-e8c2-43f5-8528-7b2a847ca718 => generated 1474 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:49.716397 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6d453c5d-e49a-4e32-b470-afcfc032550b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:49.717276 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6d453c5d-e49a-4e32-b470-afcfc032550b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:49.735075 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d453c5d-e49a-4e32-b470-afcfc032550b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:49.735816 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d453c5d-e49a-4e32-b470-afcfc032550b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:49.736772 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d453c5d-e49a-4e32-b470-afcfc032550b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:49.737364 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d453c5d-e49a-4e32-b470-afcfc032550b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:50.572919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9ede2cef-37e7-463a-9095-0ec402bd7068 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:50.594446 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9ede2cef-37e7-463a-9095-0ec402bd7068 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:50.604964 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9ede2cef-37e7-463a-9095-0ec402bd7068 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:50.606628 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9ede2cef-37e7-463a-9095-0ec402bd7068 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 1.281835 Jul 19 22:31:50.608237 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 737/1501] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:31:49 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:31:50.613781 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-60a91635-c29d-4fee-981d-5b00bbc7295a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:50.615658 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-60a91635-c29d-4fee-981d-5b00bbc7295a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:50.635190 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-60a91635-c29d-4fee-981d-5b00bbc7295a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:50.636312 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-60a91635-c29d-4fee-981d-5b00bbc7295a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:50.638819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-60a91635-c29d-4fee-981d-5b00bbc7295a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:50.640876 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-60a91635-c29d-4fee-981d-5b00bbc7295a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:51.047739 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6d453c5d-e49a-4e32-b470-afcfc032550b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:51.061849 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6d453c5d-e49a-4e32-b470-afcfc032550b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f" status: 200 len: 1308 microversion: 2.1 time: 1.352553 Jul 19 22:31:51.063037 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 765/1502] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:49 2022] GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f => generated 1308 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:51.068070 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-97e1e2cb-efa8-4f83-82ec-f73729b1c54d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:51.068986 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-97e1e2cb-efa8-4f83-82ec-f73729b1c54d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:51.090030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-97e1e2cb-efa8-4f83-82ec-f73729b1c54d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:51.090830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-97e1e2cb-efa8-4f83-82ec-f73729b1c54d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:51.091993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-97e1e2cb-efa8-4f83-82ec-f73729b1c54d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:51.092696 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-97e1e2cb-efa8-4f83-82ec-f73729b1c54d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:51.469534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-60a91635-c29d-4fee-981d-5b00bbc7295a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:51.484553 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-60a91635-c29d-4fee-981d-5b00bbc7295a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1473 microversion: 2.1 time: 0.874805 Jul 19 22:31:51.505807 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 738/1503] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:50 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1473 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:51.524110 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-1ff38c18-2819-4f34-88cb-a89f852dce3d req-fd4338d7-f551-4a99-b8ff-0243395efe8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc94c67-92c3-491d-974d-1a40bf8757c4", "name": "network-vif-deleted", "tag": "36c690fa-f832-4d8c-967c-46b6df7eda25"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:51.549527 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-1ff38c18-2819-4f34-88cb-a89f852dce3d req-fd4338d7-f551-4a99-b8ff-0243395efe8e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:51.557239 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-1ff38c18-2819-4f34-88cb-a89f852dce3d req-fd4338d7-f551-4a99-b8ff-0243395efe8e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:51.601407 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-1ff38c18-2819-4f34-88cb-a89f852dce3d req-fd4338d7-f551-4a99-b8ff-0243395efe8e service nova] Creating event network-vif-deleted:36c690fa-f832-4d8c-967c-46b6df7eda25 for instance 0cc94c67-92c3-491d-974d-1a40bf8757c4 on n-h2-847009-3 Jul 19 22:31:51.612739 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-1ff38c18-2819-4f34-88cb-a89f852dce3d req-fd4338d7-f551-4a99-b8ff-0243395efe8e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104818 Jul 19 22:31:51.613966 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 739/1504] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:51.641648 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-36f1c5b0-8cfc-4675-a496-70ceb0269fa4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:51.642542 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-36f1c5b0-8cfc-4675-a496-70ceb0269fa4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: ca03e7c4-e8c2-43f5-8528-7b2a847ca718] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:51.656389 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-36f1c5b0-8cfc-4675-a496-70ceb0269fa4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:51.657115 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-36f1c5b0-8cfc-4675-a496-70ceb0269fa4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:51.658081 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-36f1c5b0-8cfc-4675-a496-70ceb0269fa4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:51.660103 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-36f1c5b0-8cfc-4675-a496-70ceb0269fa4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:51.852777 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-97e1e2cb-efa8-4f83-82ec-f73729b1c54d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:51.874158 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-97e1e2cb-efa8-4f83-82ec-f73729b1c54d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1467 microversion: 2.1 time: 0.802479 Jul 19 22:31:51.876609 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 766/1505] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:51 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1467 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:51.885059 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-26e1599a-be00-4284-9328-7ad4885f1a1f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:51.886490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-26e1599a-be00-4284-9328-7ad4885f1a1f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:51.897093 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-26e1599a-be00-4284-9328-7ad4885f1a1f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:51.898208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-26e1599a-be00-4284-9328-7ad4885f1a1f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:51.902042 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-26e1599a-be00-4284-9328-7ad4885f1a1f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:51.902783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-26e1599a-be00-4284-9328-7ad4885f1a1f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:52.334554 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-36f1c5b0-8cfc-4675-a496-70ceb0269fa4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:52.352471 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-36f1c5b0-8cfc-4675-a496-70ceb0269fa4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/ca03e7c4-e8c2-43f5-8528-7b2a847ca718" status: 200 len: 1474 microversion: 2.1 time: 0.731829 Jul 19 22:31:52.357589 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 740/1506] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:51 2022] GET /compute/v2.1/servers/ca03e7c4-e8c2-43f5-8528-7b2a847ca718 => generated 1474 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:52.362580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aab0a8d3-5017-4351-94af-48bd1f0cc6e4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:52.363439 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-aab0a8d3-5017-4351-94af-48bd1f0cc6e4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:52.376426 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aab0a8d3-5017-4351-94af-48bd1f0cc6e4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:52.377254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aab0a8d3-5017-4351-94af-48bd1f0cc6e4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:52.385298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aab0a8d3-5017-4351-94af-48bd1f0cc6e4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:52.385298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aab0a8d3-5017-4351-94af-48bd1f0cc6e4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:52.444213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-26e1599a-be00-4284-9328-7ad4885f1a1f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:52.457909 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-26e1599a-be00-4284-9328-7ad4885f1a1f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:52.462486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-26e1599a-be00-4284-9328-7ad4885f1a1f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:52.465701 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-26e1599a-be00-4284-9328-7ad4885f1a1f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 0.587598 Jul 19 22:31:52.470293 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 767/1507] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:31:51 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:31:52.514700 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7417284a-e5cb-4a1e-b2e4-0be239ba6e54 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:52.515919 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7417284a-e5cb-4a1e-b2e4-0be239ba6e54 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:52.533789 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7417284a-e5cb-4a1e-b2e4-0be239ba6e54 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:52.535149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7417284a-e5cb-4a1e-b2e4-0be239ba6e54 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:52.536313 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7417284a-e5cb-4a1e-b2e4-0be239ba6e54 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:52.537549 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7417284a-e5cb-4a1e-b2e4-0be239ba6e54 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:52.586914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:31:53.030466 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-aab0a8d3-5017-4351-94af-48bd1f0cc6e4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:53.053780 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-aab0a8d3-5017-4351-94af-48bd1f0cc6e4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f" status: 200 len: 1488 microversion: 2.1 time: 0.694813 Jul 19 22:31:53.054397 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 741/1508] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:52 2022] GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f => generated 1488 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:53.093325 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9a3af20c-b2c0-4a2d-a7ad-f587ec838e36 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:53.094487 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9a3af20c-b2c0-4a2d-a7ad-f587ec838e36 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:53.123976 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a3af20c-b2c0-4a2d-a7ad-f587ec838e36 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:53.125269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a3af20c-b2c0-4a2d-a7ad-f587ec838e36 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:53.132191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a3af20c-b2c0-4a2d-a7ad-f587ec838e36 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:53.132990 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a3af20c-b2c0-4a2d-a7ad-f587ec838e36 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:53.286390 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7417284a-e5cb-4a1e-b2e4-0be239ba6e54 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:53.297298 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7417284a-e5cb-4a1e-b2e4-0be239ba6e54 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1473 microversion: 2.1 time: 0.790104 Jul 19 22:31:53.311528 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 768/1509] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:52 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1473 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:53.332795 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3ef5d250-e259-4b27-9f87-71b5e0870ca6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1286403951"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:53.340742 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3ef5d250-e259-4b27-9f87-71b5e0870ca6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:53.364424 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ef5d250-e259-4b27-9f87-71b5e0870ca6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:53.365469 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ef5d250-e259-4b27-9f87-71b5e0870ca6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:53.366455 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ef5d250-e259-4b27-9f87-71b5e0870ca6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:53.367060 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ef5d250-e259-4b27-9f87-71b5e0870ca6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:53.538542 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9a3af20c-b2c0-4a2d-a7ad-f587ec838e36 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:53.554538 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9a3af20c-b2c0-4a2d-a7ad-f587ec838e36 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 200 len: 1425 microversion: 2.1 time: 0.482825 Jul 19 22:31:53.562670 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 742/1510] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:53 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 1425 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:53.575621 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4402a880-9a5d-438e-9611-5c46c336e68c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:53.576309 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4402a880-9a5d-438e-9611-5c46c336e68c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: ca03e7c4-e8c2-43f5-8528-7b2a847ca718] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:53.589264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4402a880-9a5d-438e-9611-5c46c336e68c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:53.589726 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4402a880-9a5d-438e-9611-5c46c336e68c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:53.590533 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4402a880-9a5d-438e-9611-5c46c336e68c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:53.590982 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4402a880-9a5d-438e-9611-5c46c336e68c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:53.815515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4402a880-9a5d-438e-9611-5c46c336e68c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:53.825768 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4402a880-9a5d-438e-9611-5c46c336e68c tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/ca03e7c4-e8c2-43f5-8528-7b2a847ca718" status: 200 len: 1432 microversion: 2.1 time: 0.261664 Jul 19 22:31:53.831538 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 743/1511] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:53 2022] GET /compute/v2.1/servers/ca03e7c4-e8c2-43f5-8528-7b2a847ca718 => generated 1432 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:53.859466 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a3ba9381-6243-4a19-bdd0-3e847fd2ec24 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:53.860287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a3ba9381-6243-4a19-bdd0-3e847fd2ec24 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:53.880597 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3ba9381-6243-4a19-bdd0-3e847fd2ec24 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:53.881271 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3ba9381-6243-4a19-bdd0-3e847fd2ec24 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:53.882287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3ba9381-6243-4a19-bdd0-3e847fd2ec24 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:53.882942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3ba9381-6243-4a19-bdd0-3e847fd2ec24 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:54.185884 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3ef5d250-e259-4b27-9f87-71b5e0870ca6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "POST /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f/action" status: 202 len: 0 microversion: 2.1 time: 0.860758 Jul 19 22:31:54.186854 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 769/1512] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:31:53 2022] POST /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f/action => generated 0 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 22:31:54.214636 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-1481f78f-d1a6-4d13-b11b-d87a6383a0fa req-83467256-a995-469e-9c31-fe3483c61231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca03e7c4-e8c2-43f5-8528-7b2a847ca718", "name": "network-vif-deleted", "tag": "bd28cab7-fac1-4695-830b-6be183a87784"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:54.251253 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1481f78f-d1a6-4d13-b11b-d87a6383a0fa req-83467256-a995-469e-9c31-fe3483c61231 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:54.252527 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1481f78f-d1a6-4d13-b11b-d87a6383a0fa req-83467256-a995-469e-9c31-fe3483c61231 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:54.286847 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-1481f78f-d1a6-4d13-b11b-d87a6383a0fa req-83467256-a995-469e-9c31-fe3483c61231 service nova] Creating event network-vif-deleted:bd28cab7-fac1-4695-830b-6be183a87784 for instance ca03e7c4-e8c2-43f5-8528-7b2a847ca718 on n-h1-847009-3 Jul 19 22:31:54.297889 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-1481f78f-d1a6-4d13-b11b-d87a6383a0fa req-83467256-a995-469e-9c31-fe3483c61231 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096591 Jul 19 22:31:54.298904 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 770/1513] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:54.329114 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8497a8cd-bdfe-4c6d-8187-ee5ae1f5a194 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a10273820>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:54.455318 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8497a8cd-bdfe-4c6d-8187-ee5ae1f5a194 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/a3aa43e8-276d-40dc-b24d-d5ff9e10d70e" status: 200 len: 1414 microversion: 2.1 time: 0.154731 Jul 19 22:31:54.456199 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 771/1514] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:31:54 2022] GET /compute/v2.1/images/a3aa43e8-276d-40dc-b24d-d5ff9e10d70e => generated 1414 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:54.482311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f9ebaa13-262a-4b14-a1af-41fe95d94100 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:54.483385 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f9ebaa13-262a-4b14-a1af-41fe95d94100 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:54.514865 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f9ebaa13-262a-4b14-a1af-41fe95d94100 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:54.514865 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f9ebaa13-262a-4b14-a1af-41fe95d94100 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:54.514865 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f9ebaa13-262a-4b14-a1af-41fe95d94100 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:54.514865 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f9ebaa13-262a-4b14-a1af-41fe95d94100 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:54.611870 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a3ba9381-6243-4a19-bdd0-3e847fd2ec24 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:54.659621 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a3ba9381-6243-4a19-bdd0-3e847fd2ec24 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:54.667126 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a3ba9381-6243-4a19-bdd0-3e847fd2ec24 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:54.673957 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a3ba9381-6243-4a19-bdd0-3e847fd2ec24 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 0.826123 Jul 19 22:31:54.676303 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 744/1515] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:31:53 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:31:54.687524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-49a8d7fb-ba07-456a-b3d6-5babf0168754 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a10553670>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:54.809834 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-49a8d7fb-ba07-456a-b3d6-5babf0168754 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/a3aa43e8-276d-40dc-b24d-d5ff9e10d70e" status: 200 len: 1414 microversion: 2.1 time: 0.131444 Jul 19 22:31:54.811089 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 745/1516] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:31:54 2022] GET /compute/v2.1/images/a3aa43e8-276d-40dc-b24d-d5ff9e10d70e => generated 1414 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:54.822169 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-694744f5-4f8a-4a77-ba8d-08733bc3c14f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:54.824374 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-694744f5-4f8a-4a77-ba8d-08733bc3c14f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:54.834269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-694744f5-4f8a-4a77-ba8d-08733bc3c14f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:54.835187 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-694744f5-4f8a-4a77-ba8d-08733bc3c14f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:54.838112 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-694744f5-4f8a-4a77-ba8d-08733bc3c14f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:54.841937 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-694744f5-4f8a-4a77-ba8d-08733bc3c14f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:54.867177 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-694744f5-4f8a-4a77-ba8d-08733bc3c14f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] HTTP exception thrown: Instance 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 could not be found. Jul 19 22:31:54.871170 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-694744f5-4f8a-4a77-ba8d-08733bc3c14f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Request method failure captured: Jul 19 22:31:54.871170 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 HTTP/1.1 Jul 19 22:31:54.871170 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:31:54.871170 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:31:54.871170 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:31:54.871170 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:31:54.871170 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:31:54.871170 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:31:54.871170 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:31:54.871170 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:31:54.871170 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y9SKRTUgCp_a51-hxNmwpKIKbKego58wzUVpV8NH1wkVEqNRcwiabhpu6-ejJO6NeuhCRw_tHsx7Bw-epZD_t9D4FWivKhoitt_DdR_Js8cp-eQMzZoy9heKP13Txs6oLIr0IwjxnF47WFqAJ4Whduy7jC5bTCDC8m-V9GrXtVoG9c Jul 19 22:31:54.871170 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:31:54.871170 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:31:54.871170 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:31:54.871170 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:31:54.871170 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:31:54.871170 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:31:54.871170 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: eed5e83db4ae4156ae9635b84ca7ff4a Jul 19 22:31:54.871170 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-MigrationsAdminTest-1358192571 Jul 19 22:31:54.871170 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:31:54.871170 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:31:54.873634 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eed5e83db4ae4156ae9635b84ca7ff4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eed5e83db4ae4156ae9635b84ca7ff4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eed5e83db4ae4156ae9635b84ca7ff4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eed5e83db4ae4156ae9635b84ca7ff4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:31:54.873634 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-MigrationsAdminTest-1358192571 Jul 19 22:31:54.873634 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: eed5e83db4ae4156ae9635b84ca7ff4a Jul 19 22:31:54.873634 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-MigrationsAdminTest-1358192571 Jul 19 22:31:54.873634 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-MigrationsAdminTest-1358192571-project Jul 19 22:31:54.873634 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:31:54.873634 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:31:54.873634 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: e3ef9d4c38d547a1a1532d964195144a Jul 19 22:31:54.873634 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-MigrationsAdminTest-1358192571-project Jul 19 22:31:54.873634 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:31:54.873634 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 could not be found. Jul 19 22:31:54.873634 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '40f7dcd8-59a5-4e02-8774-9d5e8b4616f5'} Jul 19 22:31:54.874880 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:31:54.874880 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:54.874880 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:31:54.874880 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:31:54.874880 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:31:54.874880 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:31:54.874880 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:31:54.874880 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:31:54.874880 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:31:54.874880 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:31:54.874880 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 could not be found. Jul 19 22:31:54.874880 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:54.874880 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:54.874880 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:54.874880 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:54.874880 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:54.874880 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:54.874880 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:31:54.874880 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:31:54.874880 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:31:54.878651 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:31:54.878651 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:31:54.878651 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:31:54.878651 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:31:54.878651 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:31:54.878651 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:31:54.878651 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:31:54.878651 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 could not be found. Jul 19 22:31:54.878651 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:54.878651 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:54.878651 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:54.878651 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:54.878651 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:54.878651 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:54.878651 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:31:54.878651 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:31:54.878651 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 could not be found. Jul 19 22:31:54.878651 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:54.880893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-694744f5-4f8a-4a77-ba8d-08733bc3c14f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Returning 404 to user: Instance 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:31:54.880893 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-694744f5-4f8a-4a77-ba8d-08733bc3c14f tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5" status: 404 len: 111 microversion: 2.1 time: 0.059411 Jul 19 22:31:54.880893 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 746/1517] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:54 2022] GET /compute/v2.1/servers/40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:31:54.885417 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c212585d-46e8-4b3d-b80b-fed369376ffb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a10625ee0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:54.915977 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f9ebaa13-262a-4b14-a1af-41fe95d94100 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:54.927278 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f9ebaa13-262a-4b14-a1af-41fe95d94100 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1473 microversion: 2.1 time: 0.470233 Jul 19 22:31:54.944324 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 772/1518] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:54 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1473 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:54.944324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fedd3014-ed4b-458b-8fc3-920d46dee925 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:54.944786 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fedd3014-ed4b-458b-8fc3-920d46dee925 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: ca03e7c4-e8c2-43f5-8528-7b2a847ca718] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:54.953395 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fedd3014-ed4b-458b-8fc3-920d46dee925 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:54.953882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fedd3014-ed4b-458b-8fc3-920d46dee925 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:54.956935 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fedd3014-ed4b-458b-8fc3-920d46dee925 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:54.957464 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fedd3014-ed4b-458b-8fc3-920d46dee925 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:54.982936 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-fedd3014-ed4b-458b-8fc3-920d46dee925 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] HTTP exception thrown: Instance ca03e7c4-e8c2-43f5-8528-7b2a847ca718 could not be found. Jul 19 22:31:54.986828 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fedd3014-ed4b-458b-8fc3-920d46dee925 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Request method failure captured: Jul 19 22:31:54.986828 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/ca03e7c4-e8c2-43f5-8528-7b2a847ca718 HTTP/1.1 Jul 19 22:31:54.986828 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:31:54.986828 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:31:54.986828 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:31:54.986828 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:31:54.986828 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:31:54.986828 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:31:54.986828 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:31:54.986828 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:31:54.986828 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y_lSToTGm6PgX7y4oIs7m5rgLyqg2BjZd8UIRxYbJb2m9EeYEMUBVSO6DHIQ83QGW3D2BNOgioifqv3NuMCiblu_B1iW2SpP-MN-RDBJYPyNbMjv8oGahIddMDTYqMxE8B_kTRHiqGPN6emfEZQBLQO7qtQOHZEh90KLuTSeNhouus Jul 19 22:31:54.986828 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:31:54.986828 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:31:54.986828 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:31:54.986828 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:31:54.986828 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:31:54.986828 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:31:54.986828 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 791e176b6751415ca1472c109b3ce011 Jul 19 22:31:54.986828 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersOnMultiNodesTest-1303510158 Jul 19 22:31:54.986828 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:31:54.986828 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:31:54.988996 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_791e176b6751415ca1472c109b3ce011"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/791e176b6751415ca1472c109b3ce011"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/791e176b6751415ca1472c109b3ce011"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/791e176b6751415ca1472c109b3ce011"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:31:54.988996 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersOnMultiNodesTest-1303510158 Jul 19 22:31:54.988996 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 791e176b6751415ca1472c109b3ce011 Jul 19 22:31:54.988996 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1303510158 Jul 19 22:31:54.988996 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersOnMultiNodesTest-1303510158-project Jul 19 22:31:54.988996 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:31:54.988996 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:31:54.988996 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: bd5fb561f7bd429e8c6b2cc30ed76f13 Jul 19 22:31:54.988996 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersOnMultiNodesTest-1303510158-project Jul 19 22:31:54.988996 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:31:54.988996 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance ca03e7c4-e8c2-43f5-8528-7b2a847ca718 could not be found. Jul 19 22:31:54.988996 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'ca03e7c4-e8c2-43f5-8528-7b2a847ca718'} Jul 19 22:31:54.989882 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:31:54.989882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:54.989882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:31:54.989882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:31:54.989882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:31:54.989882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:31:54.989882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:31:54.989882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:31:54.989882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:31:54.989882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:31:54.989882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca03e7c4-e8c2-43f5-8528-7b2a847ca718 could not be found. Jul 19 22:31:54.989882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:54.989882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:54.989882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:54.989882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:54.989882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:54.989882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:54.989882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:31:54.989882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:31:54.989882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:31:54.991090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:31:54.991090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:31:54.991090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:31:54.991090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:31:54.991090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:31:54.991090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:31:54.991090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:31:54.991090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca03e7c4-e8c2-43f5-8528-7b2a847ca718 could not be found. Jul 19 22:31:54.991090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:54.991090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:54.991090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:54.991090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:54.991090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:54.991090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:54.991090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:31:54.991090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:31:54.991090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca03e7c4-e8c2-43f5-8528-7b2a847ca718 could not be found. Jul 19 22:31:54.991090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:31:54.992234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fedd3014-ed4b-458b-8fc3-920d46dee925 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Returning 404 to user: Instance ca03e7c4-e8c2-43f5-8528-7b2a847ca718 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:31:54.992234 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fedd3014-ed4b-458b-8fc3-920d46dee925 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/ca03e7c4-e8c2-43f5-8528-7b2a847ca718" status: 404 len: 111 microversion: 2.1 time: 0.050747 Jul 19 22:31:54.997536 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 773/1519] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:54 2022] GET /compute/v2.1/servers/ca03e7c4-e8c2-43f5-8528-7b2a847ca718 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:31:55.002636 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-287d0d3d-7861-4ec4-aaca-f4dcfd6f5296 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:55.003211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-287d0d3d-7861-4ec4-aaca-f4dcfd6f5296 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:55.013111 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-287d0d3d-7861-4ec4-aaca-f4dcfd6f5296 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:55.014049 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-287d0d3d-7861-4ec4-aaca-f4dcfd6f5296 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:55.015983 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-287d0d3d-7861-4ec4-aaca-f4dcfd6f5296 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:55.016839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-287d0d3d-7861-4ec4-aaca-f4dcfd6f5296 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:55.036831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=16 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:31:55.071887 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-287d0d3d-7861-4ec4-aaca-f4dcfd6f5296 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:31:55.149315 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c212585d-46e8-4b3d-b80b-fed369376ffb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "DELETE /compute/v2.1/images/a3aa43e8-276d-40dc-b24d-d5ff9e10d70e" status: 204 len: 0 microversion: 2.1 time: 0.269009 Jul 19 22:31:55.150931 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 747/1520] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:54 2022] DELETE /compute/v2.1/images/a3aa43e8-276d-40dc-b24d-d5ff9e10d70e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:31:55.161170 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9d40b0e0-4f34-42b1-8f59-4e2712db6c4a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:55.163466 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9d40b0e0-4f34-42b1-8f59-4e2712db6c4a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 0cc94c67-92c3-491d-974d-1a40bf8757c4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:55.174336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d40b0e0-4f34-42b1-8f59-4e2712db6c4a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:55.175945 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d40b0e0-4f34-42b1-8f59-4e2712db6c4a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:55.178877 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d40b0e0-4f34-42b1-8f59-4e2712db6c4a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:55.181342 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d40b0e0-4f34-42b1-8f59-4e2712db6c4a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:55.214968 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-9d40b0e0-4f34-42b1-8f59-4e2712db6c4a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] HTTP exception thrown: Instance 0cc94c67-92c3-491d-974d-1a40bf8757c4 could not be found. Jul 19 22:31:55.217606 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9d40b0e0-4f34-42b1-8f59-4e2712db6c4a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Request method failure captured: Jul 19 22:31:55.217606 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4 HTTP/1.1 Jul 19 22:31:55.217606 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:31:55.217606 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:31:55.217606 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:31:55.217606 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:31:55.217606 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:31:55.217606 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:31:55.217606 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:31:55.217606 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:31:55.217606 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y_lSToTGm6PgX7y4oIs7m5rgLyqg2BjZd8UIRxYbJb2m9EeYEMUBVSO6DHIQ83QGW3D2BNOgioifqv3NuMCiblu_B1iW2SpP-MN-RDBJYPyNbMjv8oGahIddMDTYqMxE8B_kTRHiqGPN6emfEZQBLQO7qtQOHZEh90KLuTSeNhouus Jul 19 22:31:55.217606 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:31:55.217606 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:31:55.217606 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:31:55.217606 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:31:55.217606 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:31:55.217606 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:31:55.217606 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 791e176b6751415ca1472c109b3ce011 Jul 19 22:31:55.217606 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersOnMultiNodesTest-1303510158 Jul 19 22:31:55.217606 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:31:55.217606 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:31:55.219140 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_791e176b6751415ca1472c109b3ce011"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/791e176b6751415ca1472c109b3ce011"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/791e176b6751415ca1472c109b3ce011"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/791e176b6751415ca1472c109b3ce011"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:31:55.219140 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersOnMultiNodesTest-1303510158 Jul 19 22:31:55.219140 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 791e176b6751415ca1472c109b3ce011 Jul 19 22:31:55.219140 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1303510158 Jul 19 22:31:55.219140 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersOnMultiNodesTest-1303510158-project Jul 19 22:31:55.219140 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:31:55.219140 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:31:55.219140 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: bd5fb561f7bd429e8c6b2cc30ed76f13 Jul 19 22:31:55.219140 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersOnMultiNodesTest-1303510158-project Jul 19 22:31:55.219140 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:31:55.219140 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 0cc94c67-92c3-491d-974d-1a40bf8757c4 could not be found. Jul 19 22:31:55.219140 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '0cc94c67-92c3-491d-974d-1a40bf8757c4'} Jul 19 22:31:55.220043 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:31:55.220043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:55.220043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:31:55.220043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:31:55.220043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:31:55.220043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:31:55.220043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:31:55.220043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:31:55.220043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:31:55.220043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:31:55.220043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cc94c67-92c3-491d-974d-1a40bf8757c4 could not be found. Jul 19 22:31:55.220043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:55.220043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:55.220043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:55.220043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:55.220043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:55.220043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:55.220043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:31:55.220043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:31:55.220043 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:31:55.221538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:31:55.221538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:31:55.221538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:31:55.221538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:31:55.221538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:31:55.221538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:31:55.221538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:31:55.221538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cc94c67-92c3-491d-974d-1a40bf8757c4 could not be found. Jul 19 22:31:55.221538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:55.221538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:55.221538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:55.221538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:55.221538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:55.221538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:55.221538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:31:55.221538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:31:55.221538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cc94c67-92c3-491d-974d-1a40bf8757c4 could not be found. Jul 19 22:31:55.221538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:55.224734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9d40b0e0-4f34-42b1-8f59-4e2712db6c4a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Returning 404 to user: Instance 0cc94c67-92c3-491d-974d-1a40bf8757c4 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:31:55.225515 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9d40b0e0-4f34-42b1-8f59-4e2712db6c4a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4" status: 404 len: 111 microversion: 2.1 time: 0.072114 Jul 19 22:31:55.231720 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 748/1521] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:55 2022] GET /compute/v2.1/servers/0cc94c67-92c3-491d-974d-1a40bf8757c4 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:31:55.249841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-42b3c8d1-6c30-4afb-b8bb-7ec268ce127a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a10525820>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:55.250847 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-287d0d3d-7861-4ec4-aaca-f4dcfd6f5296 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "DELETE /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 204 len: 0 microversion: 2.1 time: 0.252708 Jul 19 22:31:55.252874 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 774/1522] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:31:54 2022] DELETE /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:31:55.267394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7c8655a9-d830-41cd-874a-1542aea0ad82 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:55.318069 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7c8655a9-d830-41cd-874a-1542aea0ad82 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/e1b7331f-8339-484a-b401-587687fab655" status: 204 len: 0 microversion: 2.1 time: 0.059211 Jul 19 22:31:55.318069 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 775/1523] 10.222.0.25 () {58 vars in 1265 bytes} [Tue Jul 19 22:31:55 2022] DELETE /compute/v2.1/os-server-groups/e1b7331f-8339-484a-b401-587687fab655 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:31:55.318612 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-42b3c8d1-6c30-4afb-b8bb-7ec268ce127a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] HTTP exception thrown: Image not found. Jul 19 22:31:55.322038 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-42b3c8d1-6c30-4afb-b8bb-7ec268ce127a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Request method failure captured: Jul 19 22:31:55.322038 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/images/a3aa43e8-276d-40dc-b24d-d5ff9e10d70e HTTP/1.1 Jul 19 22:31:55.322038 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:31:55.322038 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:31:55.322038 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:31:55.322038 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:31:55.322038 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:31:55.322038 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:31:55.322038 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:31:55.322038 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:31:55.322038 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y_T-rV9vdmYQMM8LoQwWPhS5cDjBwvgUgmSjEmbZ_ttnUU-jQvotVgKddbEooltkOokiE6SwLo3Z-kacOPZhg9AscTkUHDvjvam8aXJrhX9z_4RA-iJlI6NKQ4vgYyMS4_6SOYRmQQRsSyk4EfpgJ3-yKW12si84M6_1FVqSwNQW1g Jul 19 22:31:55.322038 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:31:55.322038 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:31:55.322038 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:31:55.322038 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:31:55.322038 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:31:55.322038 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:31:55.322038 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 5e91c72f8cf5406a9662a29ee25780e6 Jul 19 22:31:55.322038 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesTestJSON-1973838127 Jul 19 22:31:55.322038 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:31:55.322038 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:31:55.325294 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:31:55.325294 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesTestJSON-1973838127 Jul 19 22:31:55.325294 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 5e91c72f8cf5406a9662a29ee25780e6 Jul 19 22:31:55.325294 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesTestJSON-1973838127 Jul 19 22:31:55.325294 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesTestJSON-1973838127-project Jul 19 22:31:55.325294 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:31:55.325294 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:31:55.325294 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 22b46b207cdb40c7b325bdc42baae246 Jul 19 22:31:55.325294 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesTestJSON-1973838127-project Jul 19 22:31:55.325294 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:31:55.325294 n-d-847009-3 devstack@n-api.service[119338]: exception: Image not found. Jul 19 22:31:55.325294 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'a3aa43e8-276d-40dc-b24d-d5ff9e10d70e'} Jul 19 22:31:55.325294 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:31:55.325294 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:55.327494 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 22:31:55.327494 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 22:31:55.327494 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:31:55.327494 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:31:55.327494 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 22:31:55.327494 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 22:31:55.327494 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:31:55.327494 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:31:55.327494 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 22:31:55.327494 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 22:31:55.327494 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 22:31:55.327494 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 22:31:55.327494 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:31:55.327494 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:31:55.327494 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:31:55.327494 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:31:55.327494 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a3aa43e8-276d-40dc-b24d-d5ff9e10d70e Jul 19 22:31:55.327494 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:55.329640 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:55.329640 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:55.329640 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:55.329640 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 19 22:31:55.329640 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 19 22:31:55.329640 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 22:31:55.329640 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 22:31:55.329640 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 22:31:55.329640 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 22:31:55.329640 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 22:31:55.329640 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 22:31:55.329640 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 22:31:55.329640 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 22:31:55.329640 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:31:55.329640 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:31:55.329640 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 22:31:55.329640 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 22:31:55.329640 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:31:55.329640 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:31:55.339813 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 22:31:55.339813 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 22:31:55.339813 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 22:31:55.339813 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 22:31:55.339813 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:31:55.339813 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:31:55.339813 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:31:55.339813 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:31:55.339813 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a3aa43e8-276d-40dc-b24d-d5ff9e10d70e could not be found. Jul 19 22:31:55.339813 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:55.339813 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:55.339813 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:55.339813 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:55.339813 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:55.339813 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:55.339813 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:31:55.339813 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:31:55.339813 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:31:55.339813 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:31:55.342403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:31:55.342403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:31:55.342403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 19 22:31:55.342403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 22:31:55.342403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 22:31:55.342403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:55.342403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:31:55.342403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:55.342403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:31:55.342403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:31:55.342403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:31:55.342403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:31:55.342403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:31:55.342403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 22:31:55.342403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:31:55.344639 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-455fad3a-ddd4-48cc-8a81-2205888fcf42 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:55.344808 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-42b3c8d1-6c30-4afb-b8bb-7ec268ce127a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Returning 404 to user: Image not found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:31:55.344972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-455fad3a-ddd4-48cc-8a81-2205888fcf42 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:55.345144 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-42b3c8d1-6c30-4afb-b8bb-7ec268ce127a tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/images/a3aa43e8-276d-40dc-b24d-d5ff9e10d70e" status: 404 len: 62 microversion: 2.1 time: 0.102367 Jul 19 22:31:55.345144 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 749/1524] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:31:55 2022] GET /compute/v2.1/images/a3aa43e8-276d-40dc-b24d-d5ff9e10d70e => generated 62 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:31:55.349370 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-455fad3a-ddd4-48cc-8a81-2205888fcf42 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:55.351205 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-455fad3a-ddd4-48cc-8a81-2205888fcf42 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:55.351442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dd84e16a-cd26-4c6c-bf29-681c7638423a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:55.352777 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dd84e16a-cd26-4c6c-bf29-681c7638423a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 2df991c2-a91f-4de1-96a1-8c36ae7ce9be] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:55.353852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-455fad3a-ddd4-48cc-8a81-2205888fcf42 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:55.354828 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-455fad3a-ddd4-48cc-8a81-2205888fcf42 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:55.363096 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd84e16a-cd26-4c6c-bf29-681c7638423a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:55.363975 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd84e16a-cd26-4c6c-bf29-681c7638423a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:55.365166 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd84e16a-cd26-4c6c-bf29-681c7638423a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:55.366323 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd84e16a-cd26-4c6c-bf29-681c7638423a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:55.426587 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dd84e16a-cd26-4c6c-bf29-681c7638423a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 2df991c2-a91f-4de1-96a1-8c36ae7ce9be] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:31:55.583726 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dd84e16a-cd26-4c6c-bf29-681c7638423a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2df991c2-a91f-4de1-96a1-8c36ae7ce9be" status: 204 len: 0 microversion: 2.1 time: 0.235898 Jul 19 22:31:55.584619 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 750/1525] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:31:55 2022] DELETE /compute/v2.1/servers/2df991c2-a91f-4de1-96a1-8c36ae7ce9be => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:31:55.596942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d2035331-4b07-4a6f-85fc-9f5a2c306ea5 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:55.598215 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d2035331-4b07-4a6f-85fc-9f5a2c306ea5 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:55.610143 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2035331-4b07-4a6f-85fc-9f5a2c306ea5 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:55.610780 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2035331-4b07-4a6f-85fc-9f5a2c306ea5 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:55.613110 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2035331-4b07-4a6f-85fc-9f5a2c306ea5 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:55.616327 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2035331-4b07-4a6f-85fc-9f5a2c306ea5 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:55.803359 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-455fad3a-ddd4-48cc-8a81-2205888fcf42 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:55.824059 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-455fad3a-ddd4-48cc-8a81-2205888fcf42 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1469 microversion: 2.1 time: 0.504905 Jul 19 22:31:55.828488 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 776/1526] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:55 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1469 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:55.834693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-61752337-aff3-4ad2-bb7d-6c6a64816658 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:55.836127 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-61752337-aff3-4ad2-bb7d-6c6a64816658 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 7a5c8094-ecd0-4423-bbfd-43d136f1f443] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:55.854825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61752337-aff3-4ad2-bb7d-6c6a64816658 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:55.855819 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61752337-aff3-4ad2-bb7d-6c6a64816658 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:55.857879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61752337-aff3-4ad2-bb7d-6c6a64816658 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:55.858964 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61752337-aff3-4ad2-bb7d-6c6a64816658 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:55.963330 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-61752337-aff3-4ad2-bb7d-6c6a64816658 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 7a5c8094-ecd0-4423-bbfd-43d136f1f443] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:31:56.012674 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d2035331-4b07-4a6f-85fc-9f5a2c306ea5 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:56.040398 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d2035331-4b07-4a6f-85fc-9f5a2c306ea5 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f" status: 200 len: 1500 microversion: 2.1 time: 0.451967 Jul 19 22:31:56.041553 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 751/1527] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:55 2022] GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f => generated 1500 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:56.063757 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e9d2cc41-0588-4834-9a31-5910a1be6105 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:56.070265 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e9d2cc41-0588-4834-9a31-5910a1be6105 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:56.085526 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9d2cc41-0588-4834-9a31-5910a1be6105 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:56.087127 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9d2cc41-0588-4834-9a31-5910a1be6105 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:56.088783 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9d2cc41-0588-4834-9a31-5910a1be6105 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:56.089621 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9d2cc41-0588-4834-9a31-5910a1be6105 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:56.125854 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:31:56.210418 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-61752337-aff3-4ad2-bb7d-6c6a64816658 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443" status: 204 len: 0 microversion: 2.1 time: 0.380179 Jul 19 22:31:56.211942 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 777/1528] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:31:55 2022] DELETE /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:31:56.229884 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-34f55552-b720-464e-a5b1-075706bbe407 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:56.233006 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-34f55552-b720-464e-a5b1-075706bbe407 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:56.247033 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-34f55552-b720-464e-a5b1-075706bbe407 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:56.248419 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-34f55552-b720-464e-a5b1-075706bbe407 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:56.249806 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-34f55552-b720-464e-a5b1-075706bbe407 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:56.250601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-34f55552-b720-464e-a5b1-075706bbe407 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:56.435873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e9d2cc41-0588-4834-9a31-5910a1be6105 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:56.458921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e9d2cc41-0588-4834-9a31-5910a1be6105 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:56.465921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e9d2cc41-0588-4834-9a31-5910a1be6105 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:56.469401 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e9d2cc41-0588-4834-9a31-5910a1be6105 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 0.426340 Jul 19 22:31:56.473159 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 752/1529] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:31:56 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:31:56.482273 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9e6ab10f-7d70-43c9-9660-3cc4b5a7b86a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:56.483603 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9e6ab10f-7d70-43c9-9660-3cc4b5a7b86a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 2df991c2-a91f-4de1-96a1-8c36ae7ce9be] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:56.505544 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e6ab10f-7d70-43c9-9660-3cc4b5a7b86a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:56.506358 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e6ab10f-7d70-43c9-9660-3cc4b5a7b86a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:56.507569 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e6ab10f-7d70-43c9-9660-3cc4b5a7b86a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:56.510011 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e6ab10f-7d70-43c9-9660-3cc4b5a7b86a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:56.620159 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-34f55552-b720-464e-a5b1-075706bbe407 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:56.642456 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-34f55552-b720-464e-a5b1-075706bbe407 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1473 microversion: 2.1 time: 0.428135 Jul 19 22:31:56.643498 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 778/1530] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:56 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1473 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:56.657996 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-da13d789-b5bf-41a7-9841-30fa77b508fe req-6c79a4e5-403b-4a15-a5ec-d3f71e21638a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f7dcd8-59a5-4e02-8774-9d5e8b4616f5", "name": "network-vif-deleted", "tag": "ecd96882-feb4-4205-a4ed-b44495364c7d"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:56.669456 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-da13d789-b5bf-41a7-9841-30fa77b508fe req-6c79a4e5-403b-4a15-a5ec-d3f71e21638a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:56.669930 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-da13d789-b5bf-41a7-9841-30fa77b508fe req-6c79a4e5-403b-4a15-a5ec-d3f71e21638a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:56.696391 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-da13d789-b5bf-41a7-9841-30fa77b508fe req-6c79a4e5-403b-4a15-a5ec-d3f71e21638a service nova] Creating event network-vif-deleted:ecd96882-feb4-4205-a4ed-b44495364c7d for instance 40f7dcd8-59a5-4e02-8774-9d5e8b4616f5 on n-h1-847009-3 Jul 19 22:31:56.709097 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-da13d789-b5bf-41a7-9841-30fa77b508fe req-6c79a4e5-403b-4a15-a5ec-d3f71e21638a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064019 Jul 19 22:31:56.710109 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 779/1531] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:56.806292 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9e6ab10f-7d70-43c9-9660-3cc4b5a7b86a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:56.821893 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9e6ab10f-7d70-43c9-9660-3cc4b5a7b86a tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/2df991c2-a91f-4de1-96a1-8c36ae7ce9be" status: 200 len: 1475 microversion: 2.1 time: 0.345634 Jul 19 22:31:56.822997 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 753/1532] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:56 2022] GET /compute/v2.1/servers/2df991c2-a91f-4de1-96a1-8c36ae7ce9be => generated 1475 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:56.858526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-535d7b05-03d3-4cb2-a679-dafb6b291e9d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:56.859273 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-535d7b05-03d3-4cb2-a679-dafb6b291e9d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:56.873753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-535d7b05-03d3-4cb2-a679-dafb6b291e9d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:56.874900 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-535d7b05-03d3-4cb2-a679-dafb6b291e9d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:56.877079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-535d7b05-03d3-4cb2-a679-dafb6b291e9d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:56.878014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-535d7b05-03d3-4cb2-a679-dafb6b291e9d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:57.064235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b671cd17-25d0-4a6e-92f1-84b58b2e7f7b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:57.068535 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b671cd17-25d0-4a6e-92f1-84b58b2e7f7b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:57.091588 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b671cd17-25d0-4a6e-92f1-84b58b2e7f7b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:57.101008 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b671cd17-25d0-4a6e-92f1-84b58b2e7f7b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:57.103782 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b671cd17-25d0-4a6e-92f1-84b58b2e7f7b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:57.107474 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b671cd17-25d0-4a6e-92f1-84b58b2e7f7b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:57.197087 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-535d7b05-03d3-4cb2-a679-dafb6b291e9d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:57.209660 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-535d7b05-03d3-4cb2-a679-dafb6b291e9d tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1469 microversion: 2.1 time: 0.356337 Jul 19 22:31:57.221798 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 780/1533] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:56 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1469 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:31:57.378285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b671cd17-25d0-4a6e-92f1-84b58b2e7f7b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:57.401308 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b671cd17-25d0-4a6e-92f1-84b58b2e7f7b tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f" status: 200 len: 1506 microversion: 2.1 time: 0.341534 Jul 19 22:31:57.446767 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 754/1534] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:57 2022] GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f => generated 1506 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:57.508442 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c5e486b0-4de0-4efd-89ca-9e0e2dcf436d tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:57.509288 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c5e486b0-4de0-4efd-89ca-9e0e2dcf436d tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:57.530236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5e486b0-4de0-4efd-89ca-9e0e2dcf436d tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:57.531181 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5e486b0-4de0-4efd-89ca-9e0e2dcf436d tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:57.533514 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5e486b0-4de0-4efd-89ca-9e0e2dcf436d tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:57.534332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5e486b0-4de0-4efd-89ca-9e0e2dcf436d tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:57.586703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-f34c20ac-9f97-4641-8791-a5d584266ee4 req-3d9499ed-f003-4715-a44c-fb4cb61ece13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18dfb53a-18ce-4ad5-a226-dff0410f00eb", "name": "network-vif-deleted", "tag": "c7157193-94b5-4be3-a477-21afd3984d48"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:31:57.607981 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f34c20ac-9f97-4641-8791-a5d584266ee4 req-3d9499ed-f003-4715-a44c-fb4cb61ece13 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:57.610272 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f34c20ac-9f97-4641-8791-a5d584266ee4 req-3d9499ed-f003-4715-a44c-fb4cb61ece13 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:57.634132 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-f34c20ac-9f97-4641-8791-a5d584266ee4 req-3d9499ed-f003-4715-a44c-fb4cb61ece13 service nova] Creating event network-vif-deleted:c7157193-94b5-4be3-a477-21afd3984d48 for instance 18dfb53a-18ce-4ad5-a226-dff0410f00eb on n-h2-847009-3 Jul 19 22:31:57.651675 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-f34c20ac-9f97-4641-8791-a5d584266ee4 req-3d9499ed-f003-4715-a44c-fb4cb61ece13 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068228 Jul 19 22:31:57.657096 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 755/1535] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:31:57.686780 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3eb835d5-c06f-4085-b05f-065f09a93f19 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:57.689598 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3eb835d5-c06f-4085-b05f-065f09a93f19 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:57.719056 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3eb835d5-c06f-4085-b05f-065f09a93f19 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:57.722608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3eb835d5-c06f-4085-b05f-065f09a93f19 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:57.725035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3eb835d5-c06f-4085-b05f-065f09a93f19 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:57.727421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3eb835d5-c06f-4085-b05f-065f09a93f19 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:58.020877 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c5e486b0-4de0-4efd-89ca-9e0e2dcf436d tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:58.050299 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c5e486b0-4de0-4efd-89ca-9e0e2dcf436d tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:58.057096 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c5e486b0-4de0-4efd-89ca-9e0e2dcf436d tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:58.063329 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c5e486b0-4de0-4efd-89ca-9e0e2dcf436d tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 0.563039 Jul 19 22:31:58.064766 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 781/1536] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:31:57 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:31:58.071790 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cb405182-3806-405f-bdb4-89d99115b4ea tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:58.072578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cb405182-3806-405f-bdb4-89d99115b4ea tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 2df991c2-a91f-4de1-96a1-8c36ae7ce9be] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:58.080236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cb405182-3806-405f-bdb4-89d99115b4ea tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:58.080236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cb405182-3806-405f-bdb4-89d99115b4ea tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:58.080965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cb405182-3806-405f-bdb4-89d99115b4ea tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:58.080965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cb405182-3806-405f-bdb4-89d99115b4ea tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:58.179205 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3eb835d5-c06f-4085-b05f-065f09a93f19 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:58.245430 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3eb835d5-c06f-4085-b05f-065f09a93f19 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1473 microversion: 2.1 time: 0.560889 Jul 19 22:31:58.246539 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 756/1537] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:57 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1473 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:58.274521 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5e042e71-f44e-4206-8dba-963b6e8955b7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:58.275441 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5e042e71-f44e-4206-8dba-963b6e8955b7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:58.283277 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e042e71-f44e-4206-8dba-963b6e8955b7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:58.284047 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e042e71-f44e-4206-8dba-963b6e8955b7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:58.285145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e042e71-f44e-4206-8dba-963b6e8955b7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:58.287460 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e042e71-f44e-4206-8dba-963b6e8955b7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:58.432658 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e042e71-f44e-4206-8dba-963b6e8955b7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:58.434961 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e042e71-f44e-4206-8dba-963b6e8955b7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:58.437317 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-5e042e71-f44e-4206-8dba-963b6e8955b7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lazy-loading 'fault' on Instance uuid 18dfb53a-18ce-4ad5-a226-dff0410f00eb {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:31:58.576797 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5e042e71-f44e-4206-8dba-963b6e8955b7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef9d4c38d547a1a1532d964195144a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed5e83db4ae4156ae9635b84ca7ff4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:58.596092 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5e042e71-f44e-4206-8dba-963b6e8955b7 tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 200 len: 1303 microversion: 2.1 time: 0.342783 Jul 19 22:31:58.603736 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 757/1538] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:58 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 1303 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:58.630512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9b34f1c2-d5d2-45fa-8930-f33487a560f8 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:58.631322 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9b34f1c2-d5d2-45fa-8930-f33487a560f8 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:58.669530 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b34f1c2-d5d2-45fa-8930-f33487a560f8 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:58.680756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b34f1c2-d5d2-45fa-8930-f33487a560f8 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:58.693798 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b34f1c2-d5d2-45fa-8930-f33487a560f8 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:58.696224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b34f1c2-d5d2-45fa-8930-f33487a560f8 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:58.991773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=30 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:31:59.020837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:31:59.028265 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cb405182-3806-405f-bdb4-89d99115b4ea tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:59.042763 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cb405182-3806-405f-bdb4-89d99115b4ea tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/2df991c2-a91f-4de1-96a1-8c36ae7ce9be" status: 200 len: 1475 microversion: 2.1 time: 0.976266 Jul 19 22:31:59.048221 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 782/1539] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:58 2022] GET /compute/v2.1/servers/2df991c2-a91f-4de1-96a1-8c36ae7ce9be => generated 1475 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:59.105170 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2f840092-c12b-4d18-9d2b-b7cf29042dcd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:31:59.106241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2f840092-c12b-4d18-9d2b-b7cf29042dcd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:31:59.130113 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2f840092-c12b-4d18-9d2b-b7cf29042dcd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:59.130875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2f840092-c12b-4d18-9d2b-b7cf29042dcd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:59.136281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2f840092-c12b-4d18-9d2b-b7cf29042dcd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:31:59.137455 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2f840092-c12b-4d18-9d2b-b7cf29042dcd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:31:59.948784 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9b34f1c2-d5d2-45fa-8930-f33487a560f8 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:31:59.973806 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9b34f1c2-d5d2-45fa-8930-f33487a560f8 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f" status: 200 len: 1501 microversion: 2.1 time: 1.367544 Jul 19 22:31:59.988474 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 758/1540] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:58 2022] GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f => generated 1501 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:31:59.999027 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9cf3b748-59e7-43e9-80e9-789ece548278 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:00.000544 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9cf3b748-59e7-43e9-80e9-789ece548278 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:00.033356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9cf3b748-59e7-43e9-80e9-789ece548278 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:00.034560 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9cf3b748-59e7-43e9-80e9-789ece548278 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:00.037384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9cf3b748-59e7-43e9-80e9-789ece548278 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:00.040088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9cf3b748-59e7-43e9-80e9-789ece548278 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:00.454655 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2f840092-c12b-4d18-9d2b-b7cf29042dcd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:00.486378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2f840092-c12b-4d18-9d2b-b7cf29042dcd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:00.489320 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2f840092-c12b-4d18-9d2b-b7cf29042dcd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:00.491231 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2f840092-c12b-4d18-9d2b-b7cf29042dcd tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 1.399212 Jul 19 22:32:00.497422 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 783/1541] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:31:59 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:00.513859 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b236d6d6-1912-4035-b6f5-fc67a660834c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:00.518446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b236d6d6-1912-4035-b6f5-fc67a660834c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] [instance: 18dfb53a-18ce-4ad5-a226-dff0410f00eb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:00.553232 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b236d6d6-1912-4035-b6f5-fc67a660834c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:00.557756 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b236d6d6-1912-4035-b6f5-fc67a660834c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:00.562621 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b236d6d6-1912-4035-b6f5-fc67a660834c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:00.564324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b236d6d6-1912-4035-b6f5-fc67a660834c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:00.603018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9cf3b748-59e7-43e9-80e9-789ece548278 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:00.614451 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-b236d6d6-1912-4035-b6f5-fc67a660834c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] HTTP exception thrown: Instance 18dfb53a-18ce-4ad5-a226-dff0410f00eb could not be found. Jul 19 22:32:00.616208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b236d6d6-1912-4035-b6f5-fc67a660834c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Request method failure captured: Jul 19 22:32:00.616208 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb HTTP/1.1 Jul 19 22:32:00.616208 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:32:00.616208 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:32:00.616208 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:32:00.616208 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:32:00.616208 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:32:00.616208 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:32:00.616208 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:32:00.616208 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:00.616208 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y9SKRTUgCp_a51-hxNmwpKIKbKego58wzUVpV8NH1wkVEqNRcwiabhpu6-ejJO6NeuhCRw_tHsx7Bw-epZD_t9D4FWivKhoitt_DdR_Js8cp-eQMzZoy9heKP13Txs6oLIr0IwjxnF47WFqAJ4Whduy7jC5bTCDC8m-V9GrXtVoG9c Jul 19 22:32:00.616208 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:32:00.616208 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:32:00.616208 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:32:00.616208 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:32:00.616208 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:32:00.616208 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:32:00.616208 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: eed5e83db4ae4156ae9635b84ca7ff4a Jul 19 22:32:00.616208 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-MigrationsAdminTest-1358192571 Jul 19 22:32:00.616208 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:32:00.616208 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:32:00.619666 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eed5e83db4ae4156ae9635b84ca7ff4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eed5e83db4ae4156ae9635b84ca7ff4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eed5e83db4ae4156ae9635b84ca7ff4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eed5e83db4ae4156ae9635b84ca7ff4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:00.619666 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-MigrationsAdminTest-1358192571 Jul 19 22:32:00.619666 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: eed5e83db4ae4156ae9635b84ca7ff4a Jul 19 22:32:00.619666 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-MigrationsAdminTest-1358192571 Jul 19 22:32:00.619666 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-MigrationsAdminTest-1358192571-project Jul 19 22:32:00.619666 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:32:00.619666 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:32:00.619666 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: e3ef9d4c38d547a1a1532d964195144a Jul 19 22:32:00.619666 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-MigrationsAdminTest-1358192571-project Jul 19 22:32:00.619666 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:32:00.619666 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 18dfb53a-18ce-4ad5-a226-dff0410f00eb could not be found. Jul 19 22:32:00.619666 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '18dfb53a-18ce-4ad5-a226-dff0410f00eb'} Jul 19 22:32:00.621309 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:00.621309 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:00.621309 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:32:00.621309 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:32:00.621309 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:32:00.621309 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:32:00.621309 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:32:00.621309 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:32:00.621309 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:32:00.621309 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:32:00.621309 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18dfb53a-18ce-4ad5-a226-dff0410f00eb could not be found. Jul 19 22:32:00.621309 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:00.621309 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:00.621309 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:00.621309 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:00.621309 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:00.621309 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:00.621309 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:00.621309 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:00.621309 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:00.624013 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:00.624013 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:32:00.624013 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:32:00.624013 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:32:00.624013 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:32:00.624013 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:32:00.624013 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:32:00.624013 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18dfb53a-18ce-4ad5-a226-dff0410f00eb could not be found. Jul 19 22:32:00.624013 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:00.624013 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:00.624013 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:00.624013 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:00.624013 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:00.624013 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:00.624013 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:00.624013 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:00.624013 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18dfb53a-18ce-4ad5-a226-dff0410f00eb could not be found. Jul 19 22:32:00.624013 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:00.626481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b236d6d6-1912-4035-b6f5-fc67a660834c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] Returning 404 to user: Instance 18dfb53a-18ce-4ad5-a226-dff0410f00eb could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:00.626481 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b236d6d6-1912-4035-b6f5-fc67a660834c tempest-MigrationsAdminTest-1358192571 tempest-MigrationsAdminTest-1358192571-project] 10.222.0.25 "GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb" status: 404 len: 111 microversion: 2.1 time: 0.119782 Jul 19 22:32:00.626481 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 784/1542] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:00 2022] GET /compute/v2.1/servers/18dfb53a-18ce-4ad5-a226-dff0410f00eb => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:32:00.636180 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9cf3b748-59e7-43e9-80e9-789ece548278 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1473 microversion: 2.1 time: 0.645382 Jul 19 22:32:00.643054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c6b33471-7768-4f0a-9a6d-7165bac961ea tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:00.644799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c6b33471-7768-4f0a-9a6d-7165bac961ea tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 2df991c2-a91f-4de1-96a1-8c36ae7ce9be] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:00.648368 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 759/1543] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:31:59 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1473 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:00.664858 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-09e930b8-ab8e-4074-a7c7-27980ea94e15 req-40b9635d-0f97-4e9f-a2fd-db1dcbe73f10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5c8094-ecd0-4423-bbfd-43d136f1f443", "name": "network-vif-deleted", "tag": "fdcfb6b1-ce54-4c4c-9b5f-fd0ab666672e"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:00.676822 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-09e930b8-ab8e-4074-a7c7-27980ea94e15 req-40b9635d-0f97-4e9f-a2fd-db1dcbe73f10 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:00.677440 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-09e930b8-ab8e-4074-a7c7-27980ea94e15 req-40b9635d-0f97-4e9f-a2fd-db1dcbe73f10 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:00.703191 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c6b33471-7768-4f0a-9a6d-7165bac961ea tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:00.706872 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c6b33471-7768-4f0a-9a6d-7165bac961ea tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:00.710348 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-09e930b8-ab8e-4074-a7c7-27980ea94e15 req-40b9635d-0f97-4e9f-a2fd-db1dcbe73f10 service nova] Creating event network-vif-deleted:fdcfb6b1-ce54-4c4c-9b5f-fd0ab666672e for instance 7a5c8094-ecd0-4423-bbfd-43d136f1f443 on n-h1-847009-3 Jul 19 22:32:00.720478 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c6b33471-7768-4f0a-9a6d-7165bac961ea tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:00.723066 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c6b33471-7768-4f0a-9a6d-7165bac961ea tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:00.737709 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-09e930b8-ab8e-4074-a7c7-27980ea94e15 req-40b9635d-0f97-4e9f-a2fd-db1dcbe73f10 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086353 Jul 19 22:32:00.746059 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 760/1544] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:00.747885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:32:00.895490 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-fdca13ec-33a0-4ebd-a2ba-4dc665130484 req-39ff1090-7a59-4ba5-b73f-c23e5b2f9289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c3a620-1bea-42df-b1b5-fda7ad4de42f", "name": "network-vif-plugged", "status": "completed", "tag": "e6bc4adb-2eb2-4855-b7e4-a430ffaeae9c"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:00.938484 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-fdca13ec-33a0-4ebd-a2ba-4dc665130484 req-39ff1090-7a59-4ba5-b73f-c23e5b2f9289 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:00.940005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-fdca13ec-33a0-4ebd-a2ba-4dc665130484 req-39ff1090-7a59-4ba5-b73f-c23e5b2f9289 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:00.970912 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-fdca13ec-33a0-4ebd-a2ba-4dc665130484 req-39ff1090-7a59-4ba5-b73f-c23e5b2f9289 service nova] Creating event network-vif-plugged:e6bc4adb-2eb2-4855-b7e4-a430ffaeae9c for instance d2c3a620-1bea-42df-b1b5-fda7ad4de42f on n-h2-847009-3 Jul 19 22:32:00.983604 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-fdca13ec-33a0-4ebd-a2ba-4dc665130484 req-39ff1090-7a59-4ba5-b73f-c23e5b2f9289 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103243 Jul 19 22:32:00.985939 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 761/1545] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:32:01.007811 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ac2329cd-8c96-4e11-b59e-85f8f09dbafb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:01.009954 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ac2329cd-8c96-4e11-b59e-85f8f09dbafb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:01.031945 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac2329cd-8c96-4e11-b59e-85f8f09dbafb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:01.032976 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac2329cd-8c96-4e11-b59e-85f8f09dbafb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:01.040386 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac2329cd-8c96-4e11-b59e-85f8f09dbafb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:01.041993 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac2329cd-8c96-4e11-b59e-85f8f09dbafb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:01.115529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c6b33471-7768-4f0a-9a6d-7165bac961ea tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:01.133096 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c6b33471-7768-4f0a-9a6d-7165bac961ea tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/2df991c2-a91f-4de1-96a1-8c36ae7ce9be" status: 200 len: 1433 microversion: 2.1 time: 0.506998 Jul 19 22:32:01.150626 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 785/1546] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:00 2022] GET /compute/v2.1/servers/2df991c2-a91f-4de1-96a1-8c36ae7ce9be => generated 1433 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:01.527977 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-65fa9688-66ab-4316-b1a4-c379d00d5925 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:01.529120 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-65fa9688-66ab-4316-b1a4-c379d00d5925 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:01.560653 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65fa9688-66ab-4316-b1a4-c379d00d5925 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:01.561111 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65fa9688-66ab-4316-b1a4-c379d00d5925 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:01.568316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65fa9688-66ab-4316-b1a4-c379d00d5925 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:01.568876 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65fa9688-66ab-4316-b1a4-c379d00d5925 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:02.114898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ac2329cd-8c96-4e11-b59e-85f8f09dbafb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:02.138565 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ac2329cd-8c96-4e11-b59e-85f8f09dbafb tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f" status: 200 len: 1488 microversion: 2.1 time: 1.135520 Jul 19 22:32:02.143345 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 762/1547] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:01 2022] GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f => generated 1488 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:32:02.177084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-082f9280-673e-4c93-9428-273e50b50503 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:02.180560 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-082f9280-673e-4c93-9428-273e50b50503 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:02.202782 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-082f9280-673e-4c93-9428-273e50b50503 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:02.203282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-082f9280-673e-4c93-9428-273e50b50503 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:02.210804 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-082f9280-673e-4c93-9428-273e50b50503 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:02.211748 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-082f9280-673e-4c93-9428-273e50b50503 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:02.338408 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-65fa9688-66ab-4316-b1a4-c379d00d5925 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:02.373421 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-65fa9688-66ab-4316-b1a4-c379d00d5925 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:02.375537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-65fa9688-66ab-4316-b1a4-c379d00d5925 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:02.376946 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-65fa9688-66ab-4316-b1a4-c379d00d5925 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 0.861962 Jul 19 22:32:02.394451 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 786/1548] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:01 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:02.400820 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-14d6b4d8-bdfd-43a7-a26d-33b37bca61ed tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:02.401582 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-14d6b4d8-bdfd-43a7-a26d-33b37bca61ed tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 2df991c2-a91f-4de1-96a1-8c36ae7ce9be] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:02.427382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14d6b4d8-bdfd-43a7-a26d-33b37bca61ed tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:02.429384 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14d6b4d8-bdfd-43a7-a26d-33b37bca61ed tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:02.430859 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14d6b4d8-bdfd-43a7-a26d-33b37bca61ed tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:02.431464 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14d6b4d8-bdfd-43a7-a26d-33b37bca61ed tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:02.586483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14d6b4d8-bdfd-43a7-a26d-33b37bca61ed tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:02.590163 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14d6b4d8-bdfd-43a7-a26d-33b37bca61ed tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:02.592002 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-14d6b4d8-bdfd-43a7-a26d-33b37bca61ed tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lazy-loading 'fault' on Instance uuid 2df991c2-a91f-4de1-96a1-8c36ae7ce9be {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:32:02.746584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-14d6b4d8-bdfd-43a7-a26d-33b37bca61ed tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:02.780356 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-14d6b4d8-bdfd-43a7-a26d-33b37bca61ed tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/2df991c2-a91f-4de1-96a1-8c36ae7ce9be" status: 200 len: 1309 microversion: 2.1 time: 0.384181 Jul 19 22:32:02.781196 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 787/1549] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:02 2022] GET /compute/v2.1/servers/2df991c2-a91f-4de1-96a1-8c36ae7ce9be => generated 1309 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:02.819063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-39875263-b311-4aef-96b7-4dfdde3c2c86 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:02.822107 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-39875263-b311-4aef-96b7-4dfdde3c2c86 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:02.832980 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39875263-b311-4aef-96b7-4dfdde3c2c86 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:02.833730 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39875263-b311-4aef-96b7-4dfdde3c2c86 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:02.834730 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39875263-b311-4aef-96b7-4dfdde3c2c86 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:02.835405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39875263-b311-4aef-96b7-4dfdde3c2c86 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:02.897182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-082f9280-673e-4c93-9428-273e50b50503 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:02.922932 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-39875263-b311-4aef-96b7-4dfdde3c2c86 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:32:02.939890 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-082f9280-673e-4c93-9428-273e50b50503 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1473 microversion: 2.1 time: 0.795078 Jul 19 22:32:02.940505 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 763/1550] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:02 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1473 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:02.996180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-9e1bfb29-4a92-4867-bf16-eba8670ea67a req-09c62eda-67ff-46b0-af44-267bd1672ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2df991c2-a91f-4de1-96a1-8c36ae7ce9be", "name": "network-vif-deleted", "tag": "0292746c-2df0-4aad-a561-ebf4daa4f8d7"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:03.019315 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-9e1bfb29-4a92-4867-bf16-eba8670ea67a req-09c62eda-67ff-46b0-af44-267bd1672ca2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:03.020723 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-9e1bfb29-4a92-4867-bf16-eba8670ea67a req-09c62eda-67ff-46b0-af44-267bd1672ca2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:03.054640 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-9e1bfb29-4a92-4867-bf16-eba8670ea67a req-09c62eda-67ff-46b0-af44-267bd1672ca2 service nova] Creating event network-vif-deleted:0292746c-2df0-4aad-a561-ebf4daa4f8d7 for instance 2df991c2-a91f-4de1-96a1-8c36ae7ce9be on n-h1-847009-3 Jul 19 22:32:03.065266 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-9e1bfb29-4a92-4867-bf16-eba8670ea67a req-09c62eda-67ff-46b0-af44-267bd1672ca2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103099 Jul 19 22:32:03.072572 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 764/1551] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:03.223315 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-39875263-b311-4aef-96b7-4dfdde3c2c86 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f" status: 204 len: 0 microversion: 2.1 time: 0.438601 Jul 19 22:32:03.226934 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 788/1552] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:32:02 2022] DELETE /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:32:03.245582 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ac764d6e-cb9e-4a94-a095-cfeaf72dcde4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a106259d0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:03.370457 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-ac764d6e-cb9e-4a94-a095-cfeaf72dcde4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] HTTP exception thrown: Image not found. Jul 19 22:32:03.372630 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ac764d6e-cb9e-4a94-a095-cfeaf72dcde4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Request method failure captured: Jul 19 22:32:03.372630 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/images/a3aa43e8-276d-40dc-b24d-d5ff9e10d70e HTTP/1.1 Jul 19 22:32:03.372630 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:32:03.372630 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:32:03.372630 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:32:03.372630 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:32:03.372630 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:32:03.372630 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:32:03.372630 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:32:03.372630 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:03.372630 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y_T-rV9vdmYQMM8LoQwWPhS5cDjBwvgUgmSjEmbZ_ttnUU-jQvotVgKddbEooltkOokiE6SwLo3Z-kacOPZhg9AscTkUHDvjvam8aXJrhX9z_4RA-iJlI6NKQ4vgYyMS4_6SOYRmQQRsSyk4EfpgJ3-yKW12si84M6_1FVqSwNQW1g Jul 19 22:32:03.372630 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:32:03.372630 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:32:03.372630 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:32:03.372630 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:32:03.372630 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:32:03.372630 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:32:03.372630 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 5e91c72f8cf5406a9662a29ee25780e6 Jul 19 22:32:03.372630 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:03.372630 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:32:03.372630 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:32:03.374342 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:03.374342 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:03.374342 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 5e91c72f8cf5406a9662a29ee25780e6 Jul 19 22:32:03.374342 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:03.374342 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesTestJSON-1973838127-project Jul 19 22:32:03.374342 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:32:03.374342 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:32:03.374342 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 22b46b207cdb40c7b325bdc42baae246 Jul 19 22:32:03.374342 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesTestJSON-1973838127-project Jul 19 22:32:03.374342 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:32:03.374342 n-d-847009-3 devstack@n-api.service[119338]: exception: Image not found. Jul 19 22:32:03.374342 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'a3aa43e8-276d-40dc-b24d-d5ff9e10d70e'} Jul 19 22:32:03.374342 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:03.374342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:03.375408 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 22:32:03.375408 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 22:32:03.375408 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:32:03.375408 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:32:03.375408 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:32:03.375408 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:32:03.375408 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 22:32:03.375408 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 22:32:03.375408 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 22:32:03.375408 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 22:32:03.375408 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:32:03.375408 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:32:03.375408 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:32:03.375408 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:32:03.375408 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a3aa43e8-276d-40dc-b24d-d5ff9e10d70e to delete Jul 19 22:32:03.375408 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:03.375408 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:03.375408 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:03.375408 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:03.376863 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 22:32:03.376863 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 22:32:03.376863 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 22:32:03.376863 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 22:32:03.376863 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 22:32:03.376863 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 22:32:03.376863 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a3aa43e8-276d-40dc-b24d-d5ff9e10d70e could not be found. Jul 19 22:32:03.376863 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:03.376863 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:03.376863 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:03.376863 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:03.376863 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:03.376863 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:03.376863 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:03.376863 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:03.376863 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:32:03.376863 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:32:03.376863 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:03.376863 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:03.376863 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 22:32:03.378196 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 22:32:03.378196 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 22:32:03.378196 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:03.378196 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:03.378196 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:03.378196 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:03.378196 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:03.378196 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:03.378196 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:03.378196 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:03.378196 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 22:32:03.378196 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:03.378196 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ac764d6e-cb9e-4a94-a095-cfeaf72dcde4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Returning 404 to user: Image not found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:03.378196 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ac764d6e-cb9e-4a94-a095-cfeaf72dcde4 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "DELETE /compute/v2.1/images/a3aa43e8-276d-40dc-b24d-d5ff9e10d70e" status: 404 len: 62 microversion: 2.1 time: 0.138637 Jul 19 22:32:03.385278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-970946dc-90e4-4a61-a7ae-1a5293bed971 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:03.385877 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-970946dc-90e4-4a61-a7ae-1a5293bed971 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:03.388480 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 765/1553] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:03 2022] DELETE /compute/v2.1/images/a3aa43e8-276d-40dc-b24d-d5ff9e10d70e => generated 62 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:32:03.440783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-970946dc-90e4-4a61-a7ae-1a5293bed971 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:03.441621 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-970946dc-90e4-4a61-a7ae-1a5293bed971 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:03.448203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-970946dc-90e4-4a61-a7ae-1a5293bed971 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:03.451229 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-970946dc-90e4-4a61-a7ae-1a5293bed971 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:03.588093 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-970946dc-90e4-4a61-a7ae-1a5293bed971 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:32:03.722251 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.compute.api [None req-970946dc-90e4-4a61-a7ae-1a5293bed971 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] Instance is already in deleting state, ignoring this request Jul 19 22:32:03.728719 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-970946dc-90e4-4a61-a7ae-1a5293bed971 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f" status: 204 len: 0 microversion: 2.1 time: 0.346682 Jul 19 22:32:03.729730 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 789/1554] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:32:03 2022] DELETE /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:32:03.739978 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ce3b6cfb-5e05-41e2-85cb-4f017223f141 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:03.743531 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ce3b6cfb-5e05-41e2-85cb-4f017223f141 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:03.795212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ce3b6cfb-5e05-41e2-85cb-4f017223f141 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:03.802131 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ce3b6cfb-5e05-41e2-85cb-4f017223f141 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:03.803416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ce3b6cfb-5e05-41e2-85cb-4f017223f141 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:03.804113 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ce3b6cfb-5e05-41e2-85cb-4f017223f141 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:04.376846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ec6f8e6e-874a-424c-97a0-1472926ef3fc tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:04.378960 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ec6f8e6e-874a-424c-97a0-1472926ef3fc tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:04.422460 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec6f8e6e-874a-424c-97a0-1472926ef3fc tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:04.422994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec6f8e6e-874a-424c-97a0-1472926ef3fc tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:04.426467 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec6f8e6e-874a-424c-97a0-1472926ef3fc tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:04.427695 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec6f8e6e-874a-424c-97a0-1472926ef3fc tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:04.573002 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ce3b6cfb-5e05-41e2-85cb-4f017223f141 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:04.614018 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ce3b6cfb-5e05-41e2-85cb-4f017223f141 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f" status: 200 len: 1494 microversion: 2.1 time: 0.877005 Jul 19 22:32:04.619769 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 790/1555] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:03 2022] GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f => generated 1494 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:32:04.665603 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-28b10af1-93ec-4cfc-b182-abe64b0534fc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:04.666866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-28b10af1-93ec-4cfc-b182-abe64b0534fc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 2df991c2-a91f-4de1-96a1-8c36ae7ce9be] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:04.713717 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28b10af1-93ec-4cfc-b182-abe64b0534fc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:04.721908 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28b10af1-93ec-4cfc-b182-abe64b0534fc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:04.724006 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28b10af1-93ec-4cfc-b182-abe64b0534fc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:04.728701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28b10af1-93ec-4cfc-b182-abe64b0534fc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:04.797711 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-28b10af1-93ec-4cfc-b182-abe64b0534fc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] HTTP exception thrown: Instance 2df991c2-a91f-4de1-96a1-8c36ae7ce9be could not be found. Jul 19 22:32:04.804091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-28b10af1-93ec-4cfc-b182-abe64b0534fc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Request method failure captured: Jul 19 22:32:04.804091 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/2df991c2-a91f-4de1-96a1-8c36ae7ce9be HTTP/1.1 Jul 19 22:32:04.804091 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:32:04.804091 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:32:04.804091 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:32:04.804091 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:32:04.804091 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:32:04.804091 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:32:04.804091 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:32:04.804091 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:04.804091 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y_lSToTGm6PgX7y4oIs7m5rgLyqg2BjZd8UIRxYbJb2m9EeYEMUBVSO6DHIQ83QGW3D2BNOgioifqv3NuMCiblu_B1iW2SpP-MN-RDBJYPyNbMjv8oGahIddMDTYqMxE8B_kTRHiqGPN6emfEZQBLQO7qtQOHZEh90KLuTSeNhouus Jul 19 22:32:04.804091 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:32:04.804091 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:32:04.804091 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:32:04.804091 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:32:04.804091 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:32:04.804091 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:32:04.804091 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 791e176b6751415ca1472c109b3ce011 Jul 19 22:32:04.804091 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersOnMultiNodesTest-1303510158 Jul 19 22:32:04.804091 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:32:04.804091 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:32:04.807037 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_791e176b6751415ca1472c109b3ce011"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/791e176b6751415ca1472c109b3ce011"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/791e176b6751415ca1472c109b3ce011"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/791e176b6751415ca1472c109b3ce011"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:04.807037 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersOnMultiNodesTest-1303510158 Jul 19 22:32:04.807037 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 791e176b6751415ca1472c109b3ce011 Jul 19 22:32:04.807037 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1303510158 Jul 19 22:32:04.807037 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersOnMultiNodesTest-1303510158-project Jul 19 22:32:04.807037 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:32:04.807037 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:32:04.807037 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: bd5fb561f7bd429e8c6b2cc30ed76f13 Jul 19 22:32:04.807037 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersOnMultiNodesTest-1303510158-project Jul 19 22:32:04.807037 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:32:04.807037 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 2df991c2-a91f-4de1-96a1-8c36ae7ce9be could not be found. Jul 19 22:32:04.807037 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '2df991c2-a91f-4de1-96a1-8c36ae7ce9be'} Jul 19 22:32:04.808446 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:04.808446 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:04.808446 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:32:04.808446 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:32:04.808446 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:32:04.808446 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:32:04.808446 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:32:04.808446 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:32:04.808446 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:32:04.808446 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:32:04.808446 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2df991c2-a91f-4de1-96a1-8c36ae7ce9be could not be found. Jul 19 22:32:04.808446 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:04.808446 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:04.808446 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:04.808446 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:04.808446 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:04.808446 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:04.808446 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:04.808446 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:04.808446 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:04.810993 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:04.810993 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:32:04.810993 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:32:04.810993 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:32:04.810993 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:32:04.810993 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:32:04.810993 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:32:04.810993 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2df991c2-a91f-4de1-96a1-8c36ae7ce9be could not be found. Jul 19 22:32:04.810993 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:04.810993 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:04.810993 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:04.810993 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:04.810993 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:04.810993 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:04.810993 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:04.810993 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:04.810993 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2df991c2-a91f-4de1-96a1-8c36ae7ce9be could not be found. Jul 19 22:32:04.810993 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:04.824001 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-28b10af1-93ec-4cfc-b182-abe64b0534fc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Returning 404 to user: Instance 2df991c2-a91f-4de1-96a1-8c36ae7ce9be could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:04.825774 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-28b10af1-93ec-4cfc-b182-abe64b0534fc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/2df991c2-a91f-4de1-96a1-8c36ae7ce9be" status: 404 len: 111 microversion: 2.1 time: 0.204077 Jul 19 22:32:04.831767 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 791/1556] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:04 2022] GET /compute/v2.1/servers/2df991c2-a91f-4de1-96a1-8c36ae7ce9be => generated 111 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:32:04.847645 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-caeae790-9d95-4599-981f-26ecbff43631 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:04.848621 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-caeae790-9d95-4599-981f-26ecbff43631 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:04.863319 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-caeae790-9d95-4599-981f-26ecbff43631 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:04.865957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-caeae790-9d95-4599-981f-26ecbff43631 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:04.873901 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-caeae790-9d95-4599-981f-26ecbff43631 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:04.874988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-caeae790-9d95-4599-981f-26ecbff43631 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:04.875824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ec6f8e6e-874a-424c-97a0-1472926ef3fc tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:04.909264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ec6f8e6e-874a-424c-97a0-1472926ef3fc tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:04.912894 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ec6f8e6e-874a-424c-97a0-1472926ef3fc tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:04.916595 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ec6f8e6e-874a-424c-97a0-1472926ef3fc tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 1.509152 Jul 19 22:32:04.924041 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 766/1557] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:03 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:04.932889 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-1bc3b91c-b20b-45c0-b10c-abe72753190e req-066b6b9f-23ab-4f25-a40b-9faddfd5ed3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c3a620-1bea-42df-b1b5-fda7ad4de42f", "name": "network-vif-unplugged", "status": "completed", "tag": "e6bc4adb-2eb2-4855-b7e4-a430ffaeae9c"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:04.969098 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-1bc3b91c-b20b-45c0-b10c-abe72753190e req-066b6b9f-23ab-4f25-a40b-9faddfd5ed3a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:04.972501 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-1bc3b91c-b20b-45c0-b10c-abe72753190e req-066b6b9f-23ab-4f25-a40b-9faddfd5ed3a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:05.030607 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-1bc3b91c-b20b-45c0-b10c-abe72753190e req-066b6b9f-23ab-4f25-a40b-9faddfd5ed3a service nova] Creating event network-vif-unplugged:e6bc4adb-2eb2-4855-b7e4-a430ffaeae9c for instance d2c3a620-1bea-42df-b1b5-fda7ad4de42f on n-h2-847009-3 Jul 19 22:32:05.057995 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-1bc3b91c-b20b-45c0-b10c-abe72753190e req-066b6b9f-23ab-4f25-a40b-9faddfd5ed3a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131167 Jul 19 22:32:05.063613 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 767/1558] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:05.078089 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-738eb932-6231-4c69-936f-555dca4aafcd tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:05.089160 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-738eb932-6231-4c69-936f-555dca4aafcd tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 7a5c8094-ecd0-4423-bbfd-43d136f1f443] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:05.113982 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-738eb932-6231-4c69-936f-555dca4aafcd tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:05.114697 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-738eb932-6231-4c69-936f-555dca4aafcd tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:05.125248 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-738eb932-6231-4c69-936f-555dca4aafcd tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:05.126104 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-738eb932-6231-4c69-936f-555dca4aafcd tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:05.178051 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-738eb932-6231-4c69-936f-555dca4aafcd tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] HTTP exception thrown: Instance 7a5c8094-ecd0-4423-bbfd-43d136f1f443 could not be found. Jul 19 22:32:05.183752 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-738eb932-6231-4c69-936f-555dca4aafcd tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Request method failure captured: Jul 19 22:32:05.183752 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443 HTTP/1.1 Jul 19 22:32:05.183752 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:32:05.183752 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:32:05.183752 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:32:05.183752 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:32:05.183752 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:32:05.183752 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:32:05.183752 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:32:05.183752 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:05.183752 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y_lSToTGm6PgX7y4oIs7m5rgLyqg2BjZd8UIRxYbJb2m9EeYEMUBVSO6DHIQ83QGW3D2BNOgioifqv3NuMCiblu_B1iW2SpP-MN-RDBJYPyNbMjv8oGahIddMDTYqMxE8B_kTRHiqGPN6emfEZQBLQO7qtQOHZEh90KLuTSeNhouus Jul 19 22:32:05.183752 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:32:05.183752 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:32:05.183752 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:32:05.183752 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:32:05.183752 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:32:05.183752 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:32:05.183752 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 791e176b6751415ca1472c109b3ce011 Jul 19 22:32:05.183752 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersOnMultiNodesTest-1303510158 Jul 19 22:32:05.183752 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:32:05.183752 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:32:05.185800 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_791e176b6751415ca1472c109b3ce011"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/791e176b6751415ca1472c109b3ce011"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/791e176b6751415ca1472c109b3ce011"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/791e176b6751415ca1472c109b3ce011"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:05.185800 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersOnMultiNodesTest-1303510158 Jul 19 22:32:05.185800 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 791e176b6751415ca1472c109b3ce011 Jul 19 22:32:05.185800 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1303510158 Jul 19 22:32:05.185800 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersOnMultiNodesTest-1303510158-project Jul 19 22:32:05.185800 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:32:05.185800 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:32:05.185800 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: bd5fb561f7bd429e8c6b2cc30ed76f13 Jul 19 22:32:05.185800 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersOnMultiNodesTest-1303510158-project Jul 19 22:32:05.185800 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:32:05.185800 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 7a5c8094-ecd0-4423-bbfd-43d136f1f443 could not be found. Jul 19 22:32:05.185800 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '7a5c8094-ecd0-4423-bbfd-43d136f1f443'} Jul 19 22:32:05.187129 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:05.187129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:05.187129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:32:05.187129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:32:05.187129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:32:05.187129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:32:05.187129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:32:05.187129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:32:05.187129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:32:05.187129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:32:05.187129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a5c8094-ecd0-4423-bbfd-43d136f1f443 could not be found. Jul 19 22:32:05.187129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:05.187129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:05.187129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:05.187129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:05.187129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:05.187129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:05.187129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:05.187129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:05.187129 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:05.189978 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:05.189978 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:32:05.189978 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:32:05.189978 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:32:05.189978 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:32:05.189978 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:32:05.189978 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:32:05.189978 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a5c8094-ecd0-4423-bbfd-43d136f1f443 could not be found. Jul 19 22:32:05.189978 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:05.189978 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:05.189978 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:05.189978 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:05.189978 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:05.189978 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:05.189978 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:05.189978 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:05.189978 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a5c8094-ecd0-4423-bbfd-43d136f1f443 could not be found. Jul 19 22:32:05.189978 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:05.194918 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-738eb932-6231-4c69-936f-555dca4aafcd tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Returning 404 to user: Instance 7a5c8094-ecd0-4423-bbfd-43d136f1f443 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:05.196697 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-738eb932-6231-4c69-936f-555dca4aafcd tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443" status: 404 len: 111 microversion: 2.1 time: 0.131263 Jul 19 22:32:05.201457 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 768/1559] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:05 2022] GET /compute/v2.1/servers/7a5c8094-ecd0-4423-bbfd-43d136f1f443 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:32:05.208753 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f8458301-5102-4690-a72e-bc1c3e1ae499 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:05.259522 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f8458301-5102-4690-a72e-bc1c3e1ae499 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/cd67c25a-4da8-4c0b-9e4e-8e7b07cc4a71" status: 204 len: 0 microversion: 2.1 time: 0.055960 Jul 19 22:32:05.261071 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 769/1560] 10.222.0.25 () {58 vars in 1265 bytes} [Tue Jul 19 22:32:05 2022] DELETE /compute/v2.1/os-server-groups/cd67c25a-4da8-4c0b-9e4e-8e7b07cc4a71 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:32:05.273745 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-9e5f039d-9e80-46d5-8aa4-f3a37a729f33 req-96012cba-f596-4648-a079-7cff712bf138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d871dc5-0189-41e2-8650-8f753bf98c67", "name": "network-vif-unplugged", "status": "completed", "tag": "76972dec-38be-463e-8f2e-775f0e49be0a"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:05.284829 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-9e5f039d-9e80-46d5-8aa4-f3a37a729f33 req-96012cba-f596-4648-a079-7cff712bf138 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:05.285559 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-9e5f039d-9e80-46d5-8aa4-f3a37a729f33 req-96012cba-f596-4648-a079-7cff712bf138 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:05.303354 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-9e5f039d-9e80-46d5-8aa4-f3a37a729f33 req-96012cba-f596-4648-a079-7cff712bf138 service nova] Creating event network-vif-unplugged:76972dec-38be-463e-8f2e-775f0e49be0a for instance 5d871dc5-0189-41e2-8650-8f753bf98c67 on n-h2-847009-3 Jul 19 22:32:05.311682 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-9e5f039d-9e80-46d5-8aa4-f3a37a729f33 req-96012cba-f596-4648-a079-7cff712bf138 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042335 Jul 19 22:32:05.314826 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 770/1561] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:05.328037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d08cdb8f-e444-4604-8fb0-07a0045eb4c4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:05.329041 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d08cdb8f-e444-4604-8fb0-07a0045eb4c4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 9d261177-b837-4836-959b-2b419921e90c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:05.345804 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d08cdb8f-e444-4604-8fb0-07a0045eb4c4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:05.347491 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d08cdb8f-e444-4604-8fb0-07a0045eb4c4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:05.348883 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d08cdb8f-e444-4604-8fb0-07a0045eb4c4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:05.349501 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d08cdb8f-e444-4604-8fb0-07a0045eb4c4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:05.412384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d08cdb8f-e444-4604-8fb0-07a0045eb4c4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 9d261177-b837-4836-959b-2b419921e90c] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:32:05.564365 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-caeae790-9d95-4599-981f-26ecbff43631 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:05.578102 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-caeae790-9d95-4599-981f-26ecbff43631 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1473 microversion: 2.1 time: 0.745092 Jul 19 22:32:05.592337 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 792/1562] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:04 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1473 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:05.626705 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6915c282-0005-425c-8305-5e63d49c8530 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "250e070c-0eb5-4823-813b-4bf060f2f27f"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:05.640782 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6915c282-0005-425c-8305-5e63d49c8530 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:05.663725 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d08cdb8f-e444-4604-8fb0-07a0045eb4c4 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c" status: 204 len: 0 microversion: 2.1 time: 0.344318 Jul 19 22:32:05.669629 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 771/1563] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:32:05 2022] DELETE /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:32:05.692103 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6915c282-0005-425c-8305-5e63d49c8530 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:05.692103 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6915c282-0005-425c-8305-5e63d49c8530 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:05.696037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6915c282-0005-425c-8305-5e63d49c8530 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:05.697980 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6915c282-0005-425c-8305-5e63d49c8530 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:05.699229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cb6dc821-ad0e-4fc0-a54a-7a16e6b06e4e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:05.701936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cb6dc821-ad0e-4fc0-a54a-7a16e6b06e4e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:05.741575 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cb6dc821-ad0e-4fc0-a54a-7a16e6b06e4e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:05.745434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cb6dc821-ad0e-4fc0-a54a-7a16e6b06e4e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:05.750120 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cb6dc821-ad0e-4fc0-a54a-7a16e6b06e4e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:05.751331 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cb6dc821-ad0e-4fc0-a54a-7a16e6b06e4e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:06.111674 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cb6dc821-ad0e-4fc0-a54a-7a16e6b06e4e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:06.124875 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cb6dc821-ad0e-4fc0-a54a-7a16e6b06e4e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f" status: 200 len: 1494 microversion: 2.1 time: 0.446254 Jul 19 22:32:06.125780 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 772/1564] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:05 2022] GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f => generated 1494 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:06.145078 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5a6b847b-016d-44a4-ba5e-d950553f1561 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:06.146108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5a6b847b-016d-44a4-ba5e-d950553f1561 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 9d261177-b837-4836-959b-2b419921e90c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:06.156330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5a6b847b-016d-44a4-ba5e-d950553f1561 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:06.156798 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5a6b847b-016d-44a4-ba5e-d950553f1561 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:06.157602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5a6b847b-016d-44a4-ba5e-d950553f1561 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:06.158124 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5a6b847b-016d-44a4-ba5e-d950553f1561 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:06.438137 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5a6b847b-016d-44a4-ba5e-d950553f1561 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:06.446822 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:32:06.449647 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5a6b847b-016d-44a4-ba5e-d950553f1561 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c" status: 200 len: 1472 microversion: 2.1 time: 0.321274 Jul 19 22:32:06.450345 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 773/1565] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:06 2022] GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c => generated 1472 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:07.032798 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b51e708e-a2eb-4828-9dc9-0ef4265571ec tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Action: 'create', calling method: .version_select at 0x7f7a10510430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-232322488", "description": "tempest-description-155157788"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:07.312872 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b51e708e-a2eb-4828-9dc9-0ef4265571ec tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.850302 Jul 19 22:32:07.313897 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 774/1566] 10.222.0.25 () {60 vars in 1179 bytes} [Tue Jul 19 22:32:06 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:07.319149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0f908da6-8abc-4f22-b9f7-e3c1c8e6fb56 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:07.319852 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0f908da6-8abc-4f22-b9f7-e3c1c8e6fb56 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:07.336865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0f908da6-8abc-4f22-b9f7-e3c1c8e6fb56 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:07.337748 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0f908da6-8abc-4f22-b9f7-e3c1c8e6fb56 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:07.343063 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0f908da6-8abc-4f22-b9f7-e3c1c8e6fb56 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:07.344106 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0f908da6-8abc-4f22-b9f7-e3c1c8e6fb56 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:07.561924 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0f908da6-8abc-4f22-b9f7-e3c1c8e6fb56 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:07.577135 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0f908da6-8abc-4f22-b9f7-e3c1c8e6fb56 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:07.580047 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0f908da6-8abc-4f22-b9f7-e3c1c8e6fb56 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:07.581664 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0f908da6-8abc-4f22-b9f7-e3c1c8e6fb56 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 0.266578 Jul 19 22:32:07.583386 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 775/1567] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:07 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:07.588395 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6e44129e-2b82-49d6-acfb-97637c05d476 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:07.589386 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6e44129e-2b82-49d6-acfb-97637c05d476 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:07.616623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e44129e-2b82-49d6-acfb-97637c05d476 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:07.618810 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e44129e-2b82-49d6-acfb-97637c05d476 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:07.620172 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e44129e-2b82-49d6-acfb-97637c05d476 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:07.621223 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e44129e-2b82-49d6-acfb-97637c05d476 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:07.830297 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6e44129e-2b82-49d6-acfb-97637c05d476 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:07.858171 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6e44129e-2b82-49d6-acfb-97637c05d476 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1491 microversion: 2.1 time: 0.273113 Jul 19 22:32:07.860744 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 776/1568] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:07 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1491 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:07.873826 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1c626571-b566-49ae-9481-3d8f96613e70 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:07.876234 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1c626571-b566-49ae-9481-3d8f96613e70 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:07.889505 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1c626571-b566-49ae-9481-3d8f96613e70 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:07.890500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1c626571-b566-49ae-9481-3d8f96613e70 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:07.891925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1c626571-b566-49ae-9481-3d8f96613e70 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:07.892753 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1c626571-b566-49ae-9481-3d8f96613e70 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:08.106508 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1c626571-b566-49ae-9481-3d8f96613e70 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:08.116822 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1c626571-b566-49ae-9481-3d8f96613e70 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f" status: 200 len: 1494 microversion: 2.1 time: 0.253308 Jul 19 22:32:08.120626 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 777/1569] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:07 2022] GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f => generated 1494 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:08.126392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-73cc286c-d15d-41c2-b15f-e06cb592c5ee tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Action: 'create', calling method: .version_select at 0x7f7a105105e0>, body: {"security_group_rule": {"parent_group_id": "aedfec83-1301-4d0a-a43e-ba25f9e8109e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:08.422475 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-73cc286c-d15d-41c2-b15f-e06cb592c5ee tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.300729 Jul 19 22:32:08.423736 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 778/1570] 10.222.0.25 () {60 vars in 1194 bytes} [Tue Jul 19 22:32:08 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:08.431226 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-3741bfc0-75ab-44f2-9e8b-e30078ecfcec req-2b7c2147-ad1a-489a-b054-6b7de6ca0369 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d871dc5-0189-41e2-8650-8f753bf98c67", "tag": "76972dec-38be-463e-8f2e-775f0e49be0a"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:08.451933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-3741bfc0-75ab-44f2-9e8b-e30078ecfcec req-2b7c2147-ad1a-489a-b054-6b7de6ca0369 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:08.453021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-3741bfc0-75ab-44f2-9e8b-e30078ecfcec req-2b7c2147-ad1a-489a-b054-6b7de6ca0369 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:08.467379 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-3741bfc0-75ab-44f2-9e8b-e30078ecfcec req-2b7c2147-ad1a-489a-b054-6b7de6ca0369 service nova] Creating event network-changed:76972dec-38be-463e-8f2e-775f0e49be0a for instance 5d871dc5-0189-41e2-8650-8f753bf98c67 on n-h2-847009-3 Jul 19 22:32:08.473126 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-3741bfc0-75ab-44f2-9e8b-e30078ecfcec req-2b7c2147-ad1a-489a-b054-6b7de6ca0369 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047214 Jul 19 22:32:08.480812 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 779/1571] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:08.489460 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-31ec90f7-4433-4157-8a29-4f9265994582 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:08.495581 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-31ec90f7-4433-4157-8a29-4f9265994582 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 9d261177-b837-4836-959b-2b419921e90c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:08.506086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31ec90f7-4433-4157-8a29-4f9265994582 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:08.513331 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31ec90f7-4433-4157-8a29-4f9265994582 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:08.514260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31ec90f7-4433-4157-8a29-4f9265994582 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:08.514709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31ec90f7-4433-4157-8a29-4f9265994582 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:08.721124 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-31ec90f7-4433-4157-8a29-4f9265994582 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:08.733363 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-31ec90f7-4433-4157-8a29-4f9265994582 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c" status: 200 len: 1472 microversion: 2.1 time: 0.250290 Jul 19 22:32:08.734572 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 780/1572] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:08 2022] GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c => generated 1472 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:08.742539 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8c1c799a-cd97-42d3-aa7f-2f3b91ee52ce tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Action: 'create', calling method: .version_select at 0x7f7a1052f670>, body: {"security_group_rule": {"parent_group_id": "aedfec83-1301-4d0a-a43e-ba25f9e8109e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:08.815601 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-8c1c799a-cd97-42d3-aa7f-2f3b91ee52ce tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] HTTP exception thrown: This rule already exists in group aedfec83-1301-4d0a-a43e-ba25f9e8109e Jul 19 22:32:08.829784 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8c1c799a-cd97-42d3-aa7f-2f3b91ee52ce tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Request method failure captured: Jul 19 22:32:08.829784 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 19 22:32:08.829784 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:32:08.829784 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:32:08.829784 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:32:08.829784 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 138 Jul 19 22:32:08.829784 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:32:08.829784 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:32:08.829784 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:32:08.829784 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:08.829784 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zDlVM0R8-woxzFBDbF9TpdOo_RgnOhGYonCZhqe4mPdOqTy-rIsIG0BAUPDqmnIXW5U5_lTDmNnsdHImz-YpnAz9uJIvUtfoZi3fxfjEhvF-cvPHqKEGqiwbeMTCOv6tCExmaVYGAvJmoYG3l672Gk05RXcSu35OmESbWBbwFyRAr0 Jul 19 22:32:08.829784 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:32:08.829784 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:32:08.829784 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:32:08.829784 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:32:08.829784 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:32:08.829784 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:32:08.829784 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 0bc3ae517d3249d093279dd6af357d8f Jul 19 22:32:08.829784 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-151170730 Jul 19 22:32:08.829784 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:32:08.829784 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:32:08.831359 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:08.831359 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-151170730 Jul 19 22:32:08.831359 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 0bc3ae517d3249d093279dd6af357d8f Jul 19 22:32:08.831359 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-151170730 Jul 19 22:32:08.831359 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-151170730-project Jul 19 22:32:08.831359 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:32:08.831359 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:32:08.831359 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 6d7253958c7146349baf25c59a46060d Jul 19 22:32:08.831359 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-151170730-project Jul 19 22:32:08.831359 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:32:08.831359 n-d-847009-3 devstack@n-api.service[119338]: {"security_group_rule": {"parent_group_id": "aedfec83-1301-4d0a-a43e-ba25f9e8109e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 19 22:32:08.831359 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:32:08.832206 n-d-847009-3 devstack@n-api.service[119338]: exception: This rule already exists in group aedfec83-1301-4d0a-a43e-ba25f9e8109e Jul 19 22:32:08.832206 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'aedfec83-1301-4d0a-a43e-ba25f9e8109e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 19 22:32:08.832206 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:08.832206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:08.832206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 19 22:32:08.832206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 19 22:32:08.832206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 19 22:32:08.832206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 19 22:32:08.832206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group aedfec83-1301-4d0a-a43e-ba25f9e8109e Jul 19 22:32:08.832206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:08.832206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:08.832206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:08.832206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:08.832206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:08.832206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:08.832206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:08.832206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:08.832206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:32:08.832206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:32:08.832206 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:08.833921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:08.833921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 19 22:32:08.833921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 19 22:32:08.833921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group aedfec83-1301-4d0a-a43e-ba25f9e8109e Jul 19 22:32:08.833921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:08.833921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:08.833921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:08.833921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:08.833921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:08.833921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:08.833921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:08.833921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:08.833921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group aedfec83-1301-4d0a-a43e-ba25f9e8109e Jul 19 22:32:08.833921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:08.833921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8c1c799a-cd97-42d3-aa7f-2f3b91ee52ce tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Returning 400 to user: This rule already exists in group aedfec83-1301-4d0a-a43e-ba25f9e8109e {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:08.835597 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8c1c799a-cd97-42d3-aa7f-2f3b91ee52ce tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.095646 Jul 19 22:32:08.836749 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 781/1573] 10.222.0.25 () {60 vars in 1194 bytes} [Tue Jul 19 22:32:08 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:32:08.985481 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-00485c49-d3e2-49ec-aa0d-45e9d3bc61bc tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1936565231", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": "none"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:09.063925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-00485c49-d3e2-49ec-aa0d-45e9d3bc61bc tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:32:09.064525 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-00485c49-d3e2-49ec-aa0d-45e9d3bc61bc tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:32:09.065252 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-00485c49-d3e2-49ec-aa0d-45e9d3bc61bc tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:32:09.065689 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-00485c49-d3e2-49ec-aa0d-45e9d3bc61bc tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:32:09.066068 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-00485c49-d3e2-49ec-aa0d-45e9d3bc61bc tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:32:09.068715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:32:09.092090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00485c49-d3e2-49ec-aa0d-45e9d3bc61bc tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:09.092555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00485c49-d3e2-49ec-aa0d-45e9d3bc61bc tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:09.093380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00485c49-d3e2-49ec-aa0d-45e9d3bc61bc tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:09.093827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00485c49-d3e2-49ec-aa0d-45e9d3bc61bc tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:09.122691 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-00485c49-d3e2-49ec-aa0d-45e9d3bc61bc tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Getting quotas for project ad1c67c61d2e480b89e35ec82316c80b. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:32:09.129381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-00485c49-d3e2-49ec-aa0d-45e9d3bc61bc tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Getting quotas for user 968e8fd97cea4daea5640e033d010394 and project ad1c67c61d2e480b89e35ec82316c80b. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:32:09.170746 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-00485c49-d3e2-49ec-aa0d-45e9d3bc61bc tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:32:09.173491 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-00485c49-d3e2-49ec-aa0d-45e9d3bc61bc tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:32:09.228172 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-00485c49-d3e2-49ec-aa0d-45e9d3bc61bc tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.389539 Jul 19 22:32:09.231195 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 782/1574] 10.222.0.25 () {62 vars in 1187 bytes} [Tue Jul 19 22:32:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 394 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 22:32:09.236328 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-679402e9-786e-4a9f-a232-5f4cb6e8371c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:09.236964 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-679402e9-786e-4a9f-a232-5f4cb6e8371c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:09.245632 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-679402e9-786e-4a9f-a232-5f4cb6e8371c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:09.246094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-679402e9-786e-4a9f-a232-5f4cb6e8371c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:09.246887 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-679402e9-786e-4a9f-a232-5f4cb6e8371c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:09.247495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-679402e9-786e-4a9f-a232-5f4cb6e8371c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:09.381379 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6915c282-0005-425c-8305-5e63d49c8530 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "POST /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.775888 Jul 19 22:32:09.388123 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 793/1575] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 19 22:32:05 2022] POST /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments => generated 194 bytes in 3784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:32:09.394459 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4317170d-6f3d-4161-b495-55b51a10e910 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Calling method '.version_select at 0x7f7a03f6e8b0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:09.538006 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-679402e9-786e-4a9f-a232-5f4cb6e8371c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:09.550328 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-679402e9-786e-4a9f-a232-5f4cb6e8371c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:09.552365 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-679402e9-786e-4a9f-a232-5f4cb6e8371c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:09.553753 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-679402e9-786e-4a9f-a232-5f4cb6e8371c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 0.321379 Jul 19 22:32:09.567714 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 783/1576] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:09 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:09.583608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1bb6a00d-538d-4a7d-9eb1-392f34b70471 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:09.589334 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1bb6a00d-538d-4a7d-9eb1-392f34b70471 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:09.606416 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1bb6a00d-538d-4a7d-9eb1-392f34b70471 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:09.608029 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1bb6a00d-538d-4a7d-9eb1-392f34b70471 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:09.613687 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1bb6a00d-538d-4a7d-9eb1-392f34b70471 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:09.616120 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1bb6a00d-538d-4a7d-9eb1-392f34b70471 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:09.907067 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4317170d-6f3d-4161-b495-55b51a10e910 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/749d0903-36c7-4c57-9ff3-ba52aa1140b1" status: 202 len: 0 microversion: 2.1 time: 0.517183 Jul 19 22:32:09.908171 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 794/1577] 10.222.0.25 () {58 vars in 1286 bytes} [Tue Jul 19 22:32:09 2022] DELETE /compute/v2.1/os-security-group-rules/749d0903-36c7-4c57-9ff3-ba52aa1140b1 => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:32:09.922509 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6f313996-f603-4a80-815e-b9b77ff232f9 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:09.924093 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6f313996-f603-4a80-815e-b9b77ff232f9 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:09.946481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6f313996-f603-4a80-815e-b9b77ff232f9 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:09.947208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6f313996-f603-4a80-815e-b9b77ff232f9 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:09.948983 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6f313996-f603-4a80-815e-b9b77ff232f9 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:09.952922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6f313996-f603-4a80-815e-b9b77ff232f9 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:09.954705 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1bb6a00d-538d-4a7d-9eb1-392f34b70471 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:09.963888 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1bb6a00d-538d-4a7d-9eb1-392f34b70471 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1479 microversion: 2.1 time: 0.394380 Jul 19 22:32:09.973898 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 784/1578] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:09 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1479 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:09.973898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3308ea48-a2df-4d8f-8d27-b1bb672ec76d tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:09.973898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3308ea48-a2df-4d8f-8d27-b1bb672ec76d tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:10.050094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3308ea48-a2df-4d8f-8d27-b1bb672ec76d tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:10.050571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3308ea48-a2df-4d8f-8d27-b1bb672ec76d tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:10.225595 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3308ea48-a2df-4d8f-8d27-b1bb672ec76d tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:10.226786 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6f313996-f603-4a80-815e-b9b77ff232f9 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:10.235138 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3308ea48-a2df-4d8f-8d27-b1bb672ec76d tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:10.236759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3308ea48-a2df-4d8f-8d27-b1bb672ec76d tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:10.237475 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-3308ea48-a2df-4d8f-8d27-b1bb672ec76d tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lazy-loading 'trusted_certs' on Instance uuid 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:32:10.240799 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6f313996-f603-4a80-815e-b9b77ff232f9 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f" status: 200 len: 1494 microversion: 2.1 time: 0.331341 Jul 19 22:32:10.249859 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 795/1579] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:09 2022] GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f => generated 1494 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:10.259876 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3308ea48-a2df-4d8f-8d27-b1bb672ec76d tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "PUT /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1363 microversion: 2.75 time: 0.287892 Jul 19 22:32:10.259876 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 785/1580] 10.222.0.25 () {62 vars in 1296 bytes} [Tue Jul 19 22:32:09 2022] PUT /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1363 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:10.260580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ce665039-8153-4352-b94b-9365870777be tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Action: 'create', calling method: .version_select at 0x7f7a1098a040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-62146301", "description": "tempest-description-164783610"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:10.268206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9db03914-8836-4713-b69e-eb8ce904c3fc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:10.271388 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9db03914-8836-4713-b69e-eb8ce904c3fc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 9d261177-b837-4836-959b-2b419921e90c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:10.314613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9db03914-8836-4713-b69e-eb8ce904c3fc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:10.319475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9db03914-8836-4713-b69e-eb8ce904c3fc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:10.320663 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9db03914-8836-4713-b69e-eb8ce904c3fc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:10.322242 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9db03914-8836-4713-b69e-eb8ce904c3fc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:10.787704 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ce665039-8153-4352-b94b-9365870777be tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 0.531677 Jul 19 22:32:10.789641 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 786/1581] 10.222.0.25 () {60 vars in 1179 bytes} [Tue Jul 19 22:32:10 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:10.811485 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-666d6561-117f-442f-a5be-a9427aa0393e tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:10.812812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-666d6561-117f-442f-a5be-a9427aa0393e tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:10.850148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-666d6561-117f-442f-a5be-a9427aa0393e tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:10.851537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-666d6561-117f-442f-a5be-a9427aa0393e tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:10.853787 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-666d6561-117f-442f-a5be-a9427aa0393e tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:10.854365 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-666d6561-117f-442f-a5be-a9427aa0393e tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:10.889084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9db03914-8836-4713-b69e-eb8ce904c3fc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:10.897675 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9db03914-8836-4713-b69e-eb8ce904c3fc tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c" status: 200 len: 1472 microversion: 2.1 time: 0.643235 Jul 19 22:32:10.911565 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 796/1582] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:10 2022] GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c => generated 1472 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:10.923708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-623e0edd-f84f-45f7-89af-f43fb8af0830 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:10.924601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-623e0edd-f84f-45f7-89af-f43fb8af0830 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:10.935307 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-623e0edd-f84f-45f7-89af-f43fb8af0830 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:10.941070 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-623e0edd-f84f-45f7-89af-f43fb8af0830 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:10.944936 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-623e0edd-f84f-45f7-89af-f43fb8af0830 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:10.947065 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-623e0edd-f84f-45f7-89af-f43fb8af0830 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:11.148658 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-666d6561-117f-442f-a5be-a9427aa0393e tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:11.162983 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-666d6561-117f-442f-a5be-a9427aa0393e tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:11.167709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-666d6561-117f-442f-a5be-a9427aa0393e tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:11.182580 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-666d6561-117f-442f-a5be-a9427aa0393e tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1419 microversion: 2.75 time: 0.391493 Jul 19 22:32:11.197912 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 787/1583] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:10 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1419 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:11.208354 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-d76b2cdd-ae58-4911-bafe-8c0f68497c8b req-42eef832-5e6c-4283-82bd-0aef2059fc7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c3a620-1bea-42df-b1b5-fda7ad4de42f", "name": "network-vif-deleted", "tag": "e6bc4adb-2eb2-4855-b7e4-a430ffaeae9c"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:11.235983 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d76b2cdd-ae58-4911-bafe-8c0f68497c8b req-42eef832-5e6c-4283-82bd-0aef2059fc7f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:11.236733 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d76b2cdd-ae58-4911-bafe-8c0f68497c8b req-42eef832-5e6c-4283-82bd-0aef2059fc7f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:11.255537 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-d76b2cdd-ae58-4911-bafe-8c0f68497c8b req-42eef832-5e6c-4283-82bd-0aef2059fc7f service nova] Creating event network-vif-deleted:e6bc4adb-2eb2-4855-b7e4-a430ffaeae9c for instance d2c3a620-1bea-42df-b1b5-fda7ad4de42f on n-h2-847009-3 Jul 19 22:32:11.273279 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-d76b2cdd-ae58-4911-bafe-8c0f68497c8b req-42eef832-5e6c-4283-82bd-0aef2059fc7f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072829 Jul 19 22:32:11.274558 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 788/1584] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:11.280784 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bc46b0fd-c193-49aa-a6f3-43b69323e67f tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Action: 'create', calling method: .version_select at 0x7f7a10525700>, body: {"security_group_rule": {"parent_group_id": "bde998fc-7b9f-4f1a-8aaf-20a3018cc6f5", "ip_protocol": "tcp", "from_port": 2095805945, "to_port": 22}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:11.494180 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-623e0edd-f84f-45f7-89af-f43fb8af0830 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:11.506686 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-623e0edd-f84f-45f7-89af-f43fb8af0830 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:11.511023 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-623e0edd-f84f-45f7-89af-f43fb8af0830 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:11.514554 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-623e0edd-f84f-45f7-89af-f43fb8af0830 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 0.601407 Jul 19 22:32:11.516026 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 797/1585] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:10 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:11.525923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e3e87945-a8c7-41f9-99de-36dd9f7d386a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:11.526895 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e3e87945-a8c7-41f9-99de-36dd9f7d386a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:11.536779 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:32:11.539677 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3e87945-a8c7-41f9-99de-36dd9f7d386a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:11.540511 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3e87945-a8c7-41f9-99de-36dd9f7d386a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:11.541829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3e87945-a8c7-41f9-99de-36dd9f7d386a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:11.542809 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3e87945-a8c7-41f9-99de-36dd9f7d386a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:11.548394 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-bc46b0fd-c193-49aa-a6f3-43b69323e67f tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] HTTP exception thrown: Invalid port range 2095805945:22. Former value cannot be greater than the later Jul 19 22:32:11.550376 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bc46b0fd-c193-49aa-a6f3-43b69323e67f tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Request method failure captured: Jul 19 22:32:11.550376 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 19 22:32:11.550376 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:32:11.550376 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:32:11.550376 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:32:11.550376 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 146 Jul 19 22:32:11.550376 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:32:11.550376 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:32:11.550376 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:32:11.550376 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:11.550376 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zDlVM0R8-woxzFBDbF9TpdOo_RgnOhGYonCZhqe4mPdOqTy-rIsIG0BAUPDqmnIXW5U5_lTDmNnsdHImz-YpnAz9uJIvUtfoZi3fxfjEhvF-cvPHqKEGqiwbeMTCOv6tCExmaVYGAvJmoYG3l672Gk05RXcSu35OmESbWBbwFyRAr0 Jul 19 22:32:11.550376 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:32:11.550376 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:32:11.550376 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:32:11.550376 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:32:11.550376 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:32:11.550376 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:32:11.550376 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 0bc3ae517d3249d093279dd6af357d8f Jul 19 22:32:11.550376 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-151170730 Jul 19 22:32:11.550376 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:32:11.550376 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:32:11.552617 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:11.552617 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-151170730 Jul 19 22:32:11.552617 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 0bc3ae517d3249d093279dd6af357d8f Jul 19 22:32:11.552617 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-151170730 Jul 19 22:32:11.552617 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-151170730-project Jul 19 22:32:11.552617 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:32:11.552617 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:32:11.552617 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 6d7253958c7146349baf25c59a46060d Jul 19 22:32:11.552617 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-151170730-project Jul 19 22:32:11.552617 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:32:11.552617 n-d-847009-3 devstack@n-api.service[119338]: {"security_group_rule": {"parent_group_id": "bde998fc-7b9f-4f1a-8aaf-20a3018cc6f5", "ip_protocol": "tcp", "from_port": 2095805945, "to_port": 22}} Jul 19 22:32:11.552617 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:32:11.554563 n-d-847009-3 devstack@n-api.service[119338]: exception: Invalid port range 2095805945:22. Former value cannot be greater than the later Jul 19 22:32:11.554563 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'bde998fc-7b9f-4f1a-8aaf-20a3018cc6f5', 'ip_protocol': 'tcp', 'from_port': 2095805945, 'to_port': 22}}} Jul 19 22:32:11.554563 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:11.554563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:11.554563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 19 22:32:11.554563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 19 22:32:11.554563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 19 22:32:11.554563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 19 22:32:11.554563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 19 22:32:11.554563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 19 22:32:11.554563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 19 22:32:11.554563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 19 22:32:11.554563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 2095805945:22. Former value cannot be greater than the later Jul 19 22:32:11.554563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:11.554563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:11.554563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:11.554563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:11.554563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:11.554563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:11.556604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:11.556604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:11.556604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:32:11.556604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:32:11.556604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:11.556604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:11.556604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 19 22:32:11.556604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 19 22:32:11.556604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 2095805945:22. Former value cannot be greater than the later Jul 19 22:32:11.556604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:11.556604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:11.556604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:11.556604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:11.556604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:11.556604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:11.556604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:11.556604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:11.556604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 2095805945:22. Former value cannot be greater than the later Jul 19 22:32:11.556604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:11.561037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bc46b0fd-c193-49aa-a6f3-43b69323e67f tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Returning 400 to user: Invalid port range 2095805945:22. Former value cannot be greater than the later {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:11.561037 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bc46b0fd-c193-49aa-a6f3-43b69323e67f tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.283911 Jul 19 22:32:11.561596 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 789/1586] 10.222.0.25 () {60 vars in 1194 bytes} [Tue Jul 19 22:32:11 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 286 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:32:11.574411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0432beec-5d8a-4836-8d7c-c8eac9c16362 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:11.578929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0432beec-5d8a-4836-8d7c-c8eac9c16362 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:11.629179 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0432beec-5d8a-4836-8d7c-c8eac9c16362 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:11.630049 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0432beec-5d8a-4836-8d7c-c8eac9c16362 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:11.643784 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0432beec-5d8a-4836-8d7c-c8eac9c16362 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:11.644449 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0432beec-5d8a-4836-8d7c-c8eac9c16362 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:11.806994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0432beec-5d8a-4836-8d7c-c8eac9c16362 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:11.807607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0432beec-5d8a-4836-8d7c-c8eac9c16362 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:11.808136 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-0432beec-5d8a-4836-8d7c-c8eac9c16362 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lazy-loading 'fault' on Instance uuid d2c3a620-1bea-42df-b1b5-fda7ad4de42f {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:32:11.998012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0432beec-5d8a-4836-8d7c-c8eac9c16362 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b46b207cdb40c7b325bdc42baae246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e91c72f8cf5406a9662a29ee25780e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:12.019028 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0432beec-5d8a-4836-8d7c-c8eac9c16362 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f" status: 200 len: 1298 microversion: 2.1 time: 0.455909 Jul 19 22:32:12.022670 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 790/1587] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:11 2022] GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f => generated 1298 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:12.052761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bbdbfb39-44d9-4858-81a7-4c24b2de0713 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Action: 'create', calling method: .version_select at 0x7f7a1095a310>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-511497554", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:12.074041 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-bbdbfb39-44d9-4858-81a7-4c24b2de0713 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] HTTP exception thrown: Security group id should be uuid Jul 19 22:32:12.099168 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bbdbfb39-44d9-4858-81a7-4c24b2de0713 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Request method failure captured: Jul 19 22:32:12.099168 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 19 22:32:12.099168 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:32:12.099168 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:32:12.099168 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:32:12.099168 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 130 Jul 19 22:32:12.099168 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:32:12.099168 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:32:12.099168 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:32:12.099168 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:12.099168 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zDlVM0R8-woxzFBDbF9TpdOo_RgnOhGYonCZhqe4mPdOqTy-rIsIG0BAUPDqmnIXW5U5_lTDmNnsdHImz-YpnAz9uJIvUtfoZi3fxfjEhvF-cvPHqKEGqiwbeMTCOv6tCExmaVYGAvJmoYG3l672Gk05RXcSu35OmESbWBbwFyRAr0 Jul 19 22:32:12.099168 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:32:12.099168 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:32:12.099168 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:32:12.099168 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:32:12.099168 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:32:12.099168 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:32:12.099168 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 0bc3ae517d3249d093279dd6af357d8f Jul 19 22:32:12.099168 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-151170730 Jul 19 22:32:12.099168 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:32:12.099168 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:32:12.103681 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:12.103681 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-151170730 Jul 19 22:32:12.103681 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 0bc3ae517d3249d093279dd6af357d8f Jul 19 22:32:12.103681 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-151170730 Jul 19 22:32:12.103681 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-151170730-project Jul 19 22:32:12.103681 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:32:12.103681 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:32:12.103681 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 6d7253958c7146349baf25c59a46060d Jul 19 22:32:12.103681 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-151170730-project Jul 19 22:32:12.103681 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:32:12.103681 n-d-847009-3 devstack@n-api.service[119338]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-511497554", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 19 22:32:12.103681 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:32:12.103681 n-d-847009-3 devstack@n-api.service[119338]: exception: Security group id should be uuid Jul 19 22:32:12.106550 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-511497554', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 19 22:32:12.106550 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:12.106550 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:12.106550 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 19 22:32:12.106550 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 19 22:32:12.106550 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 19 22:32:12.106550 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 19 22:32:12.106550 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 19 22:32:12.106550 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:12.106550 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:12.106550 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:12.106550 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:12.106550 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:12.106550 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:12.106550 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:12.106550 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:12.106550 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:32:12.106550 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:32:12.106550 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:12.106550 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:12.110636 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 19 22:32:12.110636 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 19 22:32:12.110636 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 19 22:32:12.110636 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:12.110636 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:12.110636 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:12.110636 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:12.110636 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:12.110636 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:12.110636 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:12.110636 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:12.110636 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 19 22:32:12.110636 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:12.110636 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bbdbfb39-44d9-4858-81a7-4c24b2de0713 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Returning 400 to user: Security group id should be uuid {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:12.110636 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bbdbfb39-44d9-4858-81a7-4c24b2de0713 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.082361 Jul 19 22:32:12.115568 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 791/1588] 10.222.0.25 () {60 vars in 1194 bytes} [Tue Jul 19 22:32:12 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 86 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 22:32:12.125295 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-06fa7d13-6923-4760-bcf1-f5fa54a72187 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:12.127493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-06fa7d13-6923-4760-bcf1-f5fa54a72187 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 9d261177-b837-4836-959b-2b419921e90c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:12.145675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-06fa7d13-6923-4760-bcf1-f5fa54a72187 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:12.147081 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-06fa7d13-6923-4760-bcf1-f5fa54a72187 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:12.150229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-06fa7d13-6923-4760-bcf1-f5fa54a72187 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:12.152351 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-06fa7d13-6923-4760-bcf1-f5fa54a72187 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:12.271526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e3e87945-a8c7-41f9-99de-36dd9f7d386a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:12.277661 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:32:12.299631 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e3e87945-a8c7-41f9-99de-36dd9f7d386a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1479 microversion: 2.1 time: 0.782038 Jul 19 22:32:12.305749 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 798/1589] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:11 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1479 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:12.330273 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e838e70c-2680-42aa-8b54-ec9fd321ad9a tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Action: 'create', calling method: .version_select at 0x7f7a03f78c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1476171594", "description": "tempest-description-1164866814"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:12.624725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-06fa7d13-6923-4760-bcf1-f5fa54a72187 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5fb561f7bd429e8c6b2cc30ed76f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791e176b6751415ca1472c109b3ce011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:12.659657 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-06fa7d13-6923-4760-bcf1-f5fa54a72187 tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c" status: 200 len: 1302 microversion: 2.1 time: 0.548225 Jul 19 22:32:12.662491 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 792/1590] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:12 2022] GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c => generated 1302 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:12.690391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b4b9ab02-5cc8-4e5f-b5be-69eaa6faf40e tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:12.698073 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b4b9ab02-5cc8-4e5f-b5be-69eaa6faf40e tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:12.724257 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b4b9ab02-5cc8-4e5f-b5be-69eaa6faf40e tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:12.733735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b4b9ab02-5cc8-4e5f-b5be-69eaa6faf40e tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:12.736339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b4b9ab02-5cc8-4e5f-b5be-69eaa6faf40e tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:12.740695 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b4b9ab02-5cc8-4e5f-b5be-69eaa6faf40e tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:13.054515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b4b9ab02-5cc8-4e5f-b5be-69eaa6faf40e tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:13.072069 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b4b9ab02-5cc8-4e5f-b5be-69eaa6faf40e tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:13.076184 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b4b9ab02-5cc8-4e5f-b5be-69eaa6faf40e tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:13.085434 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b4b9ab02-5cc8-4e5f-b5be-69eaa6faf40e tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1417 microversion: 2.75 time: 0.409934 Jul 19 22:32:13.087800 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 793/1591] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:12 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1417 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:13.100829 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-3955d37f-199d-4f38-9e63-f2f6360e113c req-805ad09f-0043-4694-bb44-1a02cfbfabd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613", "name": "network-vif-unplugged", "status": "completed", "tag": "8551ae32-70fe-4a9f-920b-2e4c5b49340d"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:13.118137 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-3955d37f-199d-4f38-9e63-f2f6360e113c req-805ad09f-0043-4694-bb44-1a02cfbfabd9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:13.119561 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-3955d37f-199d-4f38-9e63-f2f6360e113c req-805ad09f-0043-4694-bb44-1a02cfbfabd9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:13.149066 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-3955d37f-199d-4f38-9e63-f2f6360e113c req-805ad09f-0043-4694-bb44-1a02cfbfabd9 service nova] Creating event network-vif-unplugged:8551ae32-70fe-4a9f-920b-2e4c5b49340d for instance 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 on n-h2-847009-3 Jul 19 22:32:13.161097 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-3955d37f-199d-4f38-9e63-f2f6360e113c req-805ad09f-0043-4694-bb44-1a02cfbfabd9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064593 Jul 19 22:32:13.165022 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 794/1592] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:13.173776 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c1474cc5-8d0f-4dca-a837-111898e841e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:13.174985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c1474cc5-8d0f-4dca-a837-111898e841e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:13.190103 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c1474cc5-8d0f-4dca-a837-111898e841e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:13.191343 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c1474cc5-8d0f-4dca-a837-111898e841e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:13.193162 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c1474cc5-8d0f-4dca-a837-111898e841e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:13.194025 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c1474cc5-8d0f-4dca-a837-111898e841e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:13.608512 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e838e70c-2680-42aa-8b54-ec9fd321ad9a tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.300027 Jul 19 22:32:13.610243 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 799/1593] 10.222.0.25 () {60 vars in 1179 bytes} [Tue Jul 19 22:32:12 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:13.620911 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d3124572-dd31-43bd-9f40-6019241f929c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:13.622008 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d3124572-dd31-43bd-9f40-6019241f929c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: d2c3a620-1bea-42df-b1b5-fda7ad4de42f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:13.632056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d3124572-dd31-43bd-9f40-6019241f929c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:13.633913 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d3124572-dd31-43bd-9f40-6019241f929c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:13.635295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d3124572-dd31-43bd-9f40-6019241f929c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:13.635922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d3124572-dd31-43bd-9f40-6019241f929c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:13.656731 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c1474cc5-8d0f-4dca-a837-111898e841e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:13.657018 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-d3124572-dd31-43bd-9f40-6019241f929c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] HTTP exception thrown: Instance d2c3a620-1bea-42df-b1b5-fda7ad4de42f could not be found. Jul 19 22:32:13.661209 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d3124572-dd31-43bd-9f40-6019241f929c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Request method failure captured: Jul 19 22:32:13.661209 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f HTTP/1.1 Jul 19 22:32:13.661209 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:32:13.661209 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:32:13.661209 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:32:13.661209 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:32:13.661209 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:32:13.661209 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:32:13.661209 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:32:13.661209 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:13.661209 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y_T-rV9vdmYQMM8LoQwWPhS5cDjBwvgUgmSjEmbZ_ttnUU-jQvotVgKddbEooltkOokiE6SwLo3Z-kacOPZhg9AscTkUHDvjvam8aXJrhX9z_4RA-iJlI6NKQ4vgYyMS4_6SOYRmQQRsSyk4EfpgJ3-yKW12si84M6_1FVqSwNQW1g Jul 19 22:32:13.661209 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:32:13.661209 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:32:13.661209 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:32:13.661209 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:32:13.661209 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:32:13.661209 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:32:13.661209 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 5e91c72f8cf5406a9662a29ee25780e6 Jul 19 22:32:13.661209 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:13.661209 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:32:13.661209 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:32:13.662797 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:13.662797 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:13.662797 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 5e91c72f8cf5406a9662a29ee25780e6 Jul 19 22:32:13.662797 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:13.662797 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ImagesTestJSON-1973838127-project Jul 19 22:32:13.662797 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:32:13.662797 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:32:13.662797 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 22b46b207cdb40c7b325bdc42baae246 Jul 19 22:32:13.662797 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ImagesTestJSON-1973838127-project Jul 19 22:32:13.662797 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:32:13.662797 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance d2c3a620-1bea-42df-b1b5-fda7ad4de42f could not be found. Jul 19 22:32:13.662797 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'd2c3a620-1bea-42df-b1b5-fda7ad4de42f'} Jul 19 22:32:13.662797 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:13.664321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:13.664321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:32:13.664321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:32:13.664321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:32:13.664321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:32:13.664321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:32:13.664321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:32:13.664321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:32:13.664321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:32:13.664321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2c3a620-1bea-42df-b1b5-fda7ad4de42f could not be found. Jul 19 22:32:13.664321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:13.664321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:13.664321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:13.664321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:13.664321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:13.664321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:13.664321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:13.664321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:13.664321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:13.664321 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:13.666037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:32:13.666037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:32:13.666037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:32:13.666037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:32:13.666037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:32:13.666037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:32:13.666037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2c3a620-1bea-42df-b1b5-fda7ad4de42f could not be found. Jul 19 22:32:13.666037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:13.666037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:13.666037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:13.666037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:13.666037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:13.666037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:13.666037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:13.666037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:13.666037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2c3a620-1bea-42df-b1b5-fda7ad4de42f could not be found. Jul 19 22:32:13.666037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:13.670569 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d3124572-dd31-43bd-9f40-6019241f929c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Returning 404 to user: Instance d2c3a620-1bea-42df-b1b5-fda7ad4de42f could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:13.670569 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d3124572-dd31-43bd-9f40-6019241f929c tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f" status: 404 len: 111 microversion: 2.1 time: 0.054606 Jul 19 22:32:13.670569 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 800/1594] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:13 2022] GET /compute/v2.1/servers/d2c3a620-1bea-42df-b1b5-fda7ad4de42f => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:32:13.673764 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c1474cc5-8d0f-4dca-a837-111898e841e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:13.677506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c1474cc5-8d0f-4dca-a837-111898e841e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:13.680757 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c1474cc5-8d0f-4dca-a837-111898e841e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 0.513174 Jul 19 22:32:13.682142 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 795/1595] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:13 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:13.683394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fba6968b-ccd9-476c-95bb-1cc634d02d11 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:13.684114 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fba6968b-ccd9-476c-95bb-1cc634d02d11 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:13.688245 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-2875aa0f-7270-49aa-98f3-7adf9194e427 req-174db301-656b-4c54-b1b5-76811c4a73f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d261177-b837-4836-959b-2b419921e90c", "name": "network-vif-deleted", "tag": "6fdf2740-fff6-48fb-b225-03f5d4b86d01"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:13.690501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fba6968b-ccd9-476c-95bb-1cc634d02d11 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:13.690955 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fba6968b-ccd9-476c-95bb-1cc634d02d11 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:13.691788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fba6968b-ccd9-476c-95bb-1cc634d02d11 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:13.692227 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fba6968b-ccd9-476c-95bb-1cc634d02d11 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:13.700173 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-2875aa0f-7270-49aa-98f3-7adf9194e427 req-174db301-656b-4c54-b1b5-76811c4a73f5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:13.700919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-2875aa0f-7270-49aa-98f3-7adf9194e427 req-174db301-656b-4c54-b1b5-76811c4a73f5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:13.717397 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-2875aa0f-7270-49aa-98f3-7adf9194e427 req-174db301-656b-4c54-b1b5-76811c4a73f5 service nova] Creating event network-vif-deleted:6fdf2740-fff6-48fb-b225-03f5d4b86d01 for instance 9d261177-b837-4836-959b-2b419921e90c on n-h2-847009-3 Jul 19 22:32:13.731644 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-2875aa0f-7270-49aa-98f3-7adf9194e427 req-174db301-656b-4c54-b1b5-76811c4a73f5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043068 Jul 19 22:32:13.733708 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 796/1596] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:13.745260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a22d0353-cc93-483d-b3a6-58cc112e4d39 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Action: 'create', calling method: .version_select at 0x7f7a10840820>, body: {"security_group_rule": {"parent_group_id": "f436d83e-068b-4e3c-a456-27b3ef67f110", "ip_protocol": "tempest-999-1951018062", "from_port": 22, "to_port": 22}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:13.883556 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-a22d0353-cc93-483d-b3a6-58cc112e4d39 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] HTTP exception thrown: Invalid IP protocol tempest-999-1951018062. Jul 19 22:32:13.886531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a22d0353-cc93-483d-b3a6-58cc112e4d39 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Request method failure captured: Jul 19 22:32:13.886531 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 19 22:32:13.886531 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:32:13.886531 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:32:13.886531 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:32:13.886531 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 157 Jul 19 22:32:13.886531 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:32:13.886531 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:32:13.886531 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:32:13.886531 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:13.886531 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zDlVM0R8-woxzFBDbF9TpdOo_RgnOhGYonCZhqe4mPdOqTy-rIsIG0BAUPDqmnIXW5U5_lTDmNnsdHImz-YpnAz9uJIvUtfoZi3fxfjEhvF-cvPHqKEGqiwbeMTCOv6tCExmaVYGAvJmoYG3l672Gk05RXcSu35OmESbWBbwFyRAr0 Jul 19 22:32:13.886531 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:32:13.886531 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:32:13.886531 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:32:13.886531 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:32:13.886531 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:32:13.886531 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:32:13.886531 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 0bc3ae517d3249d093279dd6af357d8f Jul 19 22:32:13.886531 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-151170730 Jul 19 22:32:13.886531 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:32:13.886531 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:32:13.888809 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:13.888809 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-151170730 Jul 19 22:32:13.888809 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 0bc3ae517d3249d093279dd6af357d8f Jul 19 22:32:13.888809 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-151170730 Jul 19 22:32:13.888809 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-151170730-project Jul 19 22:32:13.888809 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:32:13.888809 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:32:13.888809 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 6d7253958c7146349baf25c59a46060d Jul 19 22:32:13.888809 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-151170730-project Jul 19 22:32:13.888809 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:32:13.888809 n-d-847009-3 devstack@n-api.service[119338]: {"security_group_rule": {"parent_group_id": "f436d83e-068b-4e3c-a456-27b3ef67f110", "ip_protocol": "tempest-999-1951018062", "from_port": 22, "to_port": 22}} Jul 19 22:32:13.888809 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:32:13.888809 n-d-847009-3 devstack@n-api.service[119338]: exception: Invalid IP protocol tempest-999-1951018062. Jul 19 22:32:13.890064 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f436d83e-068b-4e3c-a456-27b3ef67f110', 'ip_protocol': 'tempest-999-1951018062', 'from_port': 22, 'to_port': 22}}} Jul 19 22:32:13.890064 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:13.890064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:13.890064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 19 22:32:13.890064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 19 22:32:13.890064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 19 22:32:13.890064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 19 22:32:13.890064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 19 22:32:13.890064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 19 22:32:13.890064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 19 22:32:13.890064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 19 22:32:13.890064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1951018062. Jul 19 22:32:13.890064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:13.890064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:13.890064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:13.890064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:13.890064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:13.890064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:13.890064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:13.894972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:13.894972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:32:13.894972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:32:13.894972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:13.894972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:13.894972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 19 22:32:13.894972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 19 22:32:13.894972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1951018062. Jul 19 22:32:13.894972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:13.894972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:13.894972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:13.894972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:13.894972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:13.894972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:13.894972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:13.894972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:13.894972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1951018062. Jul 19 22:32:13.894972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:13.899483 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a22d0353-cc93-483d-b3a6-58cc112e4d39 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Returning 400 to user: Invalid IP protocol tempest-999-1951018062. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:13.901271 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a22d0353-cc93-483d-b3a6-58cc112e4d39 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.165528 Jul 19 22:32:13.909292 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 797/1597] 10.222.0.25 () {60 vars in 1194 bytes} [Tue Jul 19 22:32:13 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 22:32:13.918274 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-69d9b99f-485a-454c-a7e6-e4dc5979fcc1 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a10774a60>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:13.949070 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-69d9b99f-485a-454c-a7e6-e4dc5979fcc1 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] HTTP exception thrown: Image not found. Jul 19 22:32:13.951682 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-69d9b99f-485a-454c-a7e6-e4dc5979fcc1 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Request method failure captured: Jul 19 22:32:13.951682 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17 HTTP/1.1 Jul 19 22:32:13.951682 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:32:13.951682 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:32:13.951682 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:32:13.951682 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:32:13.951682 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:32:13.951682 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:32:13.951682 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:32:13.951682 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:13.951682 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y_T-rV9vdmYQMM8LoQwWPhS5cDjBwvgUgmSjEmbZ_ttnUU-jQvotVgKddbEooltkOokiE6SwLo3Z-kacOPZhg9AscTkUHDvjvam8aXJrhX9z_4RA-iJlI6NKQ4vgYyMS4_6SOYRmQQRsSyk4EfpgJ3-yKW12si84M6_1FVqSwNQW1g Jul 19 22:32:13.951682 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:32:13.951682 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:32:13.951682 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:32:13.951682 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:32:13.951682 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:32:13.951682 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:32:13.951682 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 5e91c72f8cf5406a9662a29ee25780e6 Jul 19 22:32:13.951682 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:13.951682 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:32:13.951682 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:32:13.953081 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:13.953081 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:13.953081 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 5e91c72f8cf5406a9662a29ee25780e6 Jul 19 22:32:13.953081 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:13.953081 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesTestJSON-1973838127-project Jul 19 22:32:13.953081 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:32:13.953081 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:32:13.953081 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 22b46b207cdb40c7b325bdc42baae246 Jul 19 22:32:13.953081 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesTestJSON-1973838127-project Jul 19 22:32:13.953081 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:32:13.953081 n-d-847009-3 devstack@n-api.service[119338]: exception: Image not found. Jul 19 22:32:13.953081 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'bf48eeef-e115-4453-9a77-47ec30010b17'} Jul 19 22:32:13.953081 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:13.953081 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:13.953943 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 22:32:13.953943 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 22:32:13.953943 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:32:13.953943 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:32:13.953943 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:32:13.953943 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:32:13.953943 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 22:32:13.953943 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 22:32:13.953943 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 22:32:13.953943 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 22:32:13.953943 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:32:13.953943 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:32:13.953943 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:32:13.953943 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:32:13.953943 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image bf48eeef-e115-4453-9a77-47ec30010b17 to delete Jul 19 22:32:13.953943 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:13.953943 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:13.953943 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:13.953943 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:13.955379 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 22:32:13.955379 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 22:32:13.955379 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 22:32:13.955379 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 22:32:13.955379 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 22:32:13.955379 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 22:32:13.955379 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bf48eeef-e115-4453-9a77-47ec30010b17 could not be found. Jul 19 22:32:13.955379 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:13.955379 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:13.955379 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:13.955379 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:13.955379 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:13.955379 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:13.955379 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:13.955379 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:13.955379 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:32:13.955379 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:32:13.955379 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:13.955379 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:13.955379 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 22:32:13.962412 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 22:32:13.962412 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 22:32:13.962412 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:13.962412 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:13.962412 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:13.962412 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:13.962412 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:13.962412 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:13.962412 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:13.962412 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:13.962412 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 22:32:13.962412 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:13.968803 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-69d9b99f-485a-454c-a7e6-e4dc5979fcc1 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Returning 404 to user: Image not found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:13.970462 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-69d9b99f-485a-454c-a7e6-e4dc5979fcc1 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "DELETE /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17" status: 404 len: 62 microversion: 2.1 time: 0.059539 Jul 19 22:32:13.972476 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 798/1598] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:13 2022] DELETE /compute/v2.1/images/bf48eeef-e115-4453-9a77-47ec30010b17 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:32:13.988047 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0a63d13b-a2d8-4e9e-9cff-26fda4b1821b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:13.989812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0a63d13b-a2d8-4e9e-9cff-26fda4b1821b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] [instance: 9d261177-b837-4836-959b-2b419921e90c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:14.010823 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a63d13b-a2d8-4e9e-9cff-26fda4b1821b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:14.011711 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a63d13b-a2d8-4e9e-9cff-26fda4b1821b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:14.013035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a63d13b-a2d8-4e9e-9cff-26fda4b1821b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:14.013747 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a63d13b-a2d8-4e9e-9cff-26fda4b1821b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:14.033868 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fba6968b-ccd9-476c-95bb-1cc634d02d11 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:14.042117 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fba6968b-ccd9-476c-95bb-1cc634d02d11 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1479 microversion: 2.1 time: 0.370681 Jul 19 22:32:14.046204 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-0a63d13b-a2d8-4e9e-9cff-26fda4b1821b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] HTTP exception thrown: Instance 9d261177-b837-4836-959b-2b419921e90c could not be found. Jul 19 22:32:14.048693 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0a63d13b-a2d8-4e9e-9cff-26fda4b1821b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Request method failure captured: Jul 19 22:32:14.048693 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c HTTP/1.1 Jul 19 22:32:14.048693 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:32:14.048693 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:32:14.048693 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:32:14.048693 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:32:14.048693 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:32:14.048693 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:32:14.048693 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:32:14.048693 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:14.048693 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y_lSToTGm6PgX7y4oIs7m5rgLyqg2BjZd8UIRxYbJb2m9EeYEMUBVSO6DHIQ83QGW3D2BNOgioifqv3NuMCiblu_B1iW2SpP-MN-RDBJYPyNbMjv8oGahIddMDTYqMxE8B_kTRHiqGPN6emfEZQBLQO7qtQOHZEh90KLuTSeNhouus Jul 19 22:32:14.048693 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:32:14.048693 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:32:14.048693 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:32:14.048693 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:32:14.048693 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:32:14.048693 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:32:14.048693 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 791e176b6751415ca1472c109b3ce011 Jul 19 22:32:14.048693 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersOnMultiNodesTest-1303510158 Jul 19 22:32:14.048693 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:32:14.048693 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:32:14.050221 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_791e176b6751415ca1472c109b3ce011"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/791e176b6751415ca1472c109b3ce011"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/791e176b6751415ca1472c109b3ce011"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/791e176b6751415ca1472c109b3ce011"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:14.050221 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersOnMultiNodesTest-1303510158 Jul 19 22:32:14.050221 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 791e176b6751415ca1472c109b3ce011 Jul 19 22:32:14.050221 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1303510158 Jul 19 22:32:14.050221 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersOnMultiNodesTest-1303510158-project Jul 19 22:32:14.050221 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:32:14.050221 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:32:14.050221 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: bd5fb561f7bd429e8c6b2cc30ed76f13 Jul 19 22:32:14.050221 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersOnMultiNodesTest-1303510158-project Jul 19 22:32:14.050221 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:32:14.050221 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 9d261177-b837-4836-959b-2b419921e90c could not be found. Jul 19 22:32:14.050221 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '9d261177-b837-4836-959b-2b419921e90c'} Jul 19 22:32:14.051269 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:14.051269 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:14.051269 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:32:14.051269 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:32:14.051269 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:32:14.051269 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:32:14.051269 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:32:14.051269 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:32:14.051269 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:32:14.051269 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:32:14.051269 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d261177-b837-4836-959b-2b419921e90c could not be found. Jul 19 22:32:14.051269 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:14.051269 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:14.051269 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:14.051269 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:14.051269 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:14.051269 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:14.051269 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:14.051269 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:14.051269 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:14.052774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:14.052774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:32:14.052774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:32:14.052774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:32:14.052774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:32:14.052774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:32:14.052774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:32:14.052774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d261177-b837-4836-959b-2b419921e90c could not be found. Jul 19 22:32:14.052774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:14.052774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:14.052774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:14.052774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:14.052774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:14.052774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:14.052774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:14.052774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:14.052774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d261177-b837-4836-959b-2b419921e90c could not be found. Jul 19 22:32:14.052774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:14.059172 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0a63d13b-a2d8-4e9e-9cff-26fda4b1821b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] Returning 404 to user: Instance 9d261177-b837-4836-959b-2b419921e90c could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:14.060809 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0a63d13b-a2d8-4e9e-9cff-26fda4b1821b tempest-ServersOnMultiNodesTest-1303510158 tempest-ServersOnMultiNodesTest-1303510158-project] 10.222.0.25 "GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c" status: 404 len: 111 microversion: 2.1 time: 0.086814 Jul 19 22:32:14.061522 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 801/1599] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:13 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1479 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:14.064991 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 799/1600] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:13 2022] GET /compute/v2.1/servers/9d261177-b837-4836-959b-2b419921e90c => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:32:14.070858 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-70e03581-0735-4d56-ab87-c64f2d30c4d6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:14.071630 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-265bb977-b08f-4b6e-8d9b-50574b050299 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Action: 'create', calling method: .version_select at 0x7f7a03f42ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1907560961", "description": "tempest-description-1089356385"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:14.072002 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-70e03581-0735-4d56-ab87-c64f2d30c4d6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: f94bf14c-804e-4058-9ed8-037dd0a8ef98] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:14.079590 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-70e03581-0735-4d56-ab87-c64f2d30c4d6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:14.080201 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-70e03581-0735-4d56-ab87-c64f2d30c4d6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:14.081243 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-70e03581-0735-4d56-ab87-c64f2d30c4d6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:14.081866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-70e03581-0735-4d56-ab87-c64f2d30c4d6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:14.100056 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-70e03581-0735-4d56-ab87-c64f2d30c4d6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] HTTP exception thrown: Instance f94bf14c-804e-4058-9ed8-037dd0a8ef98 could not be found. Jul 19 22:32:14.108224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-70e03581-0735-4d56-ab87-c64f2d30c4d6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Request method failure captured: Jul 19 22:32:14.108224 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98 HTTP/1.1 Jul 19 22:32:14.108224 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:32:14.108224 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:32:14.108224 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:32:14.108224 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:32:14.108224 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:32:14.108224 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:32:14.108224 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:32:14.108224 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:14.108224 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y_T-rV9vdmYQMM8LoQwWPhS5cDjBwvgUgmSjEmbZ_ttnUU-jQvotVgKddbEooltkOokiE6SwLo3Z-kacOPZhg9AscTkUHDvjvam8aXJrhX9z_4RA-iJlI6NKQ4vgYyMS4_6SOYRmQQRsSyk4EfpgJ3-yKW12si84M6_1FVqSwNQW1g Jul 19 22:32:14.108224 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:32:14.108224 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:32:14.108224 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:32:14.108224 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:32:14.108224 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:32:14.108224 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:32:14.108224 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 5e91c72f8cf5406a9662a29ee25780e6 Jul 19 22:32:14.108224 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:14.108224 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:32:14.108224 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:32:14.109658 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:14.109658 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:14.109658 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 5e91c72f8cf5406a9662a29ee25780e6 Jul 19 22:32:14.109658 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:14.109658 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesTestJSON-1973838127-project Jul 19 22:32:14.109658 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:32:14.109658 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:32:14.109658 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 22b46b207cdb40c7b325bdc42baae246 Jul 19 22:32:14.109658 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesTestJSON-1973838127-project Jul 19 22:32:14.109658 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:32:14.109658 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance f94bf14c-804e-4058-9ed8-037dd0a8ef98 could not be found. Jul 19 22:32:14.109658 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'f94bf14c-804e-4058-9ed8-037dd0a8ef98'} Jul 19 22:32:14.110399 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:14.110399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:14.110399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:32:14.110399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:32:14.110399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:32:14.110399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:32:14.110399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:32:14.110399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:32:14.110399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:32:14.110399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:32:14.110399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f94bf14c-804e-4058-9ed8-037dd0a8ef98 could not be found. Jul 19 22:32:14.110399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:14.110399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:14.110399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:14.110399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:14.110399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:14.110399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:14.110399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:14.110399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:14.110399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:14.111634 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:14.111634 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:32:14.111634 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:32:14.111634 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:32:14.111634 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:32:14.111634 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:32:14.111634 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:32:14.111634 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:32:14.111634 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:32:14.111634 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f94bf14c-804e-4058-9ed8-037dd0a8ef98 could not be found. Jul 19 22:32:14.111634 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:14.111634 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:14.111634 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:14.111634 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:14.111634 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:14.111634 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:14.111634 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:14.111634 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:14.111634 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f94bf14c-804e-4058-9ed8-037dd0a8ef98 could not be found. Jul 19 22:32:14.111634 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:14.115921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-70e03581-0735-4d56-ab87-c64f2d30c4d6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Returning 404 to user: Instance f94bf14c-804e-4058-9ed8-037dd0a8ef98 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:14.122323 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-70e03581-0735-4d56-ab87-c64f2d30c4d6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98" status: 404 len: 111 microversion: 2.1 time: 0.056970 Jul 19 22:32:14.123701 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 800/1601] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:32:14 2022] DELETE /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:32:14.139356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e94c41fc-f619-469a-bd3c-43266aebb298 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:14.141635 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e94c41fc-f619-469a-bd3c-43266aebb298 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:14.171814 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e94c41fc-f619-469a-bd3c-43266aebb298 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:14.173668 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e94c41fc-f619-469a-bd3c-43266aebb298 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:14.176594 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e94c41fc-f619-469a-bd3c-43266aebb298 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:14.179519 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e94c41fc-f619-469a-bd3c-43266aebb298 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:14.508830 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e94c41fc-f619-469a-bd3c-43266aebb298 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:14.531440 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e94c41fc-f619-469a-bd3c-43266aebb298 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:14.533673 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e94c41fc-f619-469a-bd3c-43266aebb298 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:14.553274 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e94c41fc-f619-469a-bd3c-43266aebb298 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1417 microversion: 2.75 time: 0.425518 Jul 19 22:32:14.563150 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 801/1602] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:14 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1417 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:14.571956 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c7c036f5-119d-4ec5-b803-a0ab30b09de6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:14.572851 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c7c036f5-119d-4ec5-b803-a0ab30b09de6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: f94bf14c-804e-4058-9ed8-037dd0a8ef98] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:14.583275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7c036f5-119d-4ec5-b803-a0ab30b09de6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:14.583718 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7c036f5-119d-4ec5-b803-a0ab30b09de6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:14.599639 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7c036f5-119d-4ec5-b803-a0ab30b09de6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:14.599639 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7c036f5-119d-4ec5-b803-a0ab30b09de6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:14.628461 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-c7c036f5-119d-4ec5-b803-a0ab30b09de6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] HTTP exception thrown: Instance f94bf14c-804e-4058-9ed8-037dd0a8ef98 could not be found. Jul 19 22:32:14.630295 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c7c036f5-119d-4ec5-b803-a0ab30b09de6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Request method failure captured: Jul 19 22:32:14.630295 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98 HTTP/1.1 Jul 19 22:32:14.630295 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:32:14.630295 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:32:14.630295 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:32:14.630295 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:32:14.630295 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:32:14.630295 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:32:14.630295 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:32:14.630295 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:14.630295 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y_T-rV9vdmYQMM8LoQwWPhS5cDjBwvgUgmSjEmbZ_ttnUU-jQvotVgKddbEooltkOokiE6SwLo3Z-kacOPZhg9AscTkUHDvjvam8aXJrhX9z_4RA-iJlI6NKQ4vgYyMS4_6SOYRmQQRsSyk4EfpgJ3-yKW12si84M6_1FVqSwNQW1g Jul 19 22:32:14.630295 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:32:14.630295 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:32:14.630295 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:32:14.630295 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:32:14.630295 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:32:14.630295 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:32:14.630295 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 5e91c72f8cf5406a9662a29ee25780e6 Jul 19 22:32:14.630295 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:14.630295 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:32:14.630295 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:32:14.634339 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:14.634339 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:14.634339 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 5e91c72f8cf5406a9662a29ee25780e6 Jul 19 22:32:14.634339 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:14.634339 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesTestJSON-1973838127-project Jul 19 22:32:14.634339 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:32:14.634339 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:32:14.634339 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 22b46b207cdb40c7b325bdc42baae246 Jul 19 22:32:14.634339 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesTestJSON-1973838127-project Jul 19 22:32:14.634339 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:32:14.634339 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance f94bf14c-804e-4058-9ed8-037dd0a8ef98 could not be found. Jul 19 22:32:14.634339 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'f94bf14c-804e-4058-9ed8-037dd0a8ef98'} Jul 19 22:32:14.634339 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:14.638728 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:14.638728 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:32:14.638728 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:32:14.638728 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:32:14.638728 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:32:14.638728 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:32:14.638728 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:32:14.638728 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:32:14.638728 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:32:14.638728 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f94bf14c-804e-4058-9ed8-037dd0a8ef98 could not be found. Jul 19 22:32:14.638728 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:14.638728 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:14.638728 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:14.638728 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:14.638728 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:14.638728 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:14.638728 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:14.638728 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:14.638728 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:14.638728 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:14.643941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:32:14.643941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:32:14.643941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:32:14.643941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:32:14.643941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:32:14.643941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:32:14.643941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f94bf14c-804e-4058-9ed8-037dd0a8ef98 could not be found. Jul 19 22:32:14.643941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:14.643941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:14.643941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:14.643941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:14.643941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:14.643941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:14.643941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:14.643941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:14.643941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f94bf14c-804e-4058-9ed8-037dd0a8ef98 could not be found. Jul 19 22:32:14.643941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:14.650530 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c7c036f5-119d-4ec5-b803-a0ab30b09de6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Returning 404 to user: Instance f94bf14c-804e-4058-9ed8-037dd0a8ef98 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:14.650530 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c7c036f5-119d-4ec5-b803-a0ab30b09de6 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98" status: 404 len: 111 microversion: 2.1 time: 0.076445 Jul 19 22:32:14.650530 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 802/1603] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:14 2022] GET /compute/v2.1/servers/f94bf14c-804e-4058-9ed8-037dd0a8ef98 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:32:14.650530 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b7f8545e-dcf9-4678-89b6-b39e6791391e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a107c2ca0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:14.701650 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-b7f8545e-dcf9-4678-89b6-b39e6791391e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] HTTP exception thrown: Image not found. Jul 19 22:32:14.703520 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b7f8545e-dcf9-4678-89b6-b39e6791391e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Request method failure captured: Jul 19 22:32:14.703520 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006 HTTP/1.1 Jul 19 22:32:14.703520 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:32:14.703520 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:32:14.703520 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:32:14.703520 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:32:14.703520 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:32:14.703520 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:32:14.703520 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:32:14.703520 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:14.703520 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y_T-rV9vdmYQMM8LoQwWPhS5cDjBwvgUgmSjEmbZ_ttnUU-jQvotVgKddbEooltkOokiE6SwLo3Z-kacOPZhg9AscTkUHDvjvam8aXJrhX9z_4RA-iJlI6NKQ4vgYyMS4_6SOYRmQQRsSyk4EfpgJ3-yKW12si84M6_1FVqSwNQW1g Jul 19 22:32:14.703520 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:32:14.703520 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:32:14.703520 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:32:14.703520 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:32:14.703520 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:32:14.703520 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:32:14.703520 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 5e91c72f8cf5406a9662a29ee25780e6 Jul 19 22:32:14.703520 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:14.703520 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:32:14.703520 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:32:14.705035 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:14.705035 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:14.705035 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 5e91c72f8cf5406a9662a29ee25780e6 Jul 19 22:32:14.705035 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:14.705035 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesTestJSON-1973838127-project Jul 19 22:32:14.705035 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:32:14.705035 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:32:14.705035 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 22b46b207cdb40c7b325bdc42baae246 Jul 19 22:32:14.705035 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesTestJSON-1973838127-project Jul 19 22:32:14.705035 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:32:14.705035 n-d-847009-3 devstack@n-api.service[119338]: exception: Image not found. Jul 19 22:32:14.705035 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '2332022c-eefe-4b60-bd89-897fd898b006'} Jul 19 22:32:14.705035 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:14.705035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:14.705984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 22:32:14.705984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 22:32:14.705984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:32:14.705984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:32:14.705984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:32:14.705984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:32:14.705984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 22:32:14.705984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 22:32:14.705984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 22:32:14.705984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 22:32:14.705984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:32:14.705984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:32:14.705984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:32:14.705984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:32:14.705984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2332022c-eefe-4b60-bd89-897fd898b006 to delete Jul 19 22:32:14.705984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:14.705984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:14.705984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:14.705984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:14.707931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 22:32:14.707931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 22:32:14.707931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 22:32:14.707931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 22:32:14.707931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 22:32:14.707931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 22:32:14.707931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2332022c-eefe-4b60-bd89-897fd898b006 could not be found. Jul 19 22:32:14.707931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:14.707931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:14.707931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:14.707931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:14.707931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:14.707931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:14.707931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:14.707931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:14.707931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:32:14.707931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:32:14.707931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:14.707931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:14.707931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 22:32:14.710380 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 22:32:14.710380 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 22:32:14.710380 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:14.710380 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:14.710380 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:14.710380 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:14.710380 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:14.710380 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:14.710380 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:14.710380 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:14.710380 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 22:32:14.710380 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:14.713814 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b7f8545e-dcf9-4678-89b6-b39e6791391e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Returning 404 to user: Image not found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:14.714960 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b7f8545e-dcf9-4678-89b6-b39e6791391e tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "DELETE /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006" status: 404 len: 62 microversion: 2.1 time: 0.076355 Jul 19 22:32:14.716075 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 803/1604] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:14 2022] DELETE /compute/v2.1/images/2332022c-eefe-4b60-bd89-897fd898b006 => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:32:14.721946 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a46f02be-2396-413f-ae08-a28a45bfbca3 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:14.722874 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a46f02be-2396-413f-ae08-a28a45bfbca3 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:14.736183 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a46f02be-2396-413f-ae08-a28a45bfbca3 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:14.737581 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a46f02be-2396-413f-ae08-a28a45bfbca3 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:14.739061 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a46f02be-2396-413f-ae08-a28a45bfbca3 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:14.739818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a46f02be-2396-413f-ae08-a28a45bfbca3 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:14.762467 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:32:14.902599 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-265bb977-b08f-4b6e-8d9b-50574b050299 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.836292 Jul 19 22:32:14.904866 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 802/1605] 10.222.0.25 () {60 vars in 1179 bytes} [Tue Jul 19 22:32:14 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:14.913107 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8626094f-a2ed-4f2f-b21d-db81e761460f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:14.913628 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8626094f-a2ed-4f2f-b21d-db81e761460f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:14.934830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8626094f-a2ed-4f2f-b21d-db81e761460f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:14.942072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8626094f-a2ed-4f2f-b21d-db81e761460f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:14.943511 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8626094f-a2ed-4f2f-b21d-db81e761460f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:14.943839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8626094f-a2ed-4f2f-b21d-db81e761460f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:14.970064 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-8626094f-a2ed-4f2f-b21d-db81e761460f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] HTTP exception thrown: Instance b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab could not be found. Jul 19 22:32:14.971678 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8626094f-a2ed-4f2f-b21d-db81e761460f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Request method failure captured: Jul 19 22:32:14.971678 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab HTTP/1.1 Jul 19 22:32:14.971678 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:32:14.971678 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:32:14.971678 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:32:14.971678 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:32:14.971678 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:32:14.971678 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:32:14.971678 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:32:14.971678 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:14.971678 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y_T-rV9vdmYQMM8LoQwWPhS5cDjBwvgUgmSjEmbZ_ttnUU-jQvotVgKddbEooltkOokiE6SwLo3Z-kacOPZhg9AscTkUHDvjvam8aXJrhX9z_4RA-iJlI6NKQ4vgYyMS4_6SOYRmQQRsSyk4EfpgJ3-yKW12si84M6_1FVqSwNQW1g Jul 19 22:32:14.971678 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:32:14.971678 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:32:14.971678 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:32:14.971678 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:32:14.971678 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:32:14.971678 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:32:14.971678 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 5e91c72f8cf5406a9662a29ee25780e6 Jul 19 22:32:14.971678 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:14.971678 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:32:14.971678 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:32:14.973485 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:14.973485 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:14.973485 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 5e91c72f8cf5406a9662a29ee25780e6 Jul 19 22:32:14.973485 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:14.973485 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ImagesTestJSON-1973838127-project Jul 19 22:32:14.973485 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:32:14.973485 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:32:14.973485 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 22b46b207cdb40c7b325bdc42baae246 Jul 19 22:32:14.973485 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ImagesTestJSON-1973838127-project Jul 19 22:32:14.973485 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:32:14.973485 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab could not be found. Jul 19 22:32:14.973485 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab'} Jul 19 22:32:14.974308 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:14.974308 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:14.974308 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:32:14.974308 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:32:14.974308 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:32:14.974308 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:32:14.974308 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:32:14.974308 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:32:14.974308 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:32:14.974308 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:32:14.974308 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab could not be found. Jul 19 22:32:14.974308 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:14.974308 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:14.974308 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:14.974308 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:14.974308 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:14.974308 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:14.974308 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:14.974308 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:14.974308 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:14.977882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:14.977882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:32:14.977882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:32:14.977882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:32:14.977882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:32:14.977882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:32:14.977882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:32:14.977882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:32:14.977882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:32:14.977882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab could not be found. Jul 19 22:32:14.977882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:14.977882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:14.977882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:14.977882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:14.977882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:14.977882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:14.977882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:14.977882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:14.977882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab could not be found. Jul 19 22:32:14.977882 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:14.980234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8626094f-a2ed-4f2f-b21d-db81e761460f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Returning 404 to user: Instance b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:14.980234 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8626094f-a2ed-4f2f-b21d-db81e761460f tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 404 len: 111 microversion: 2.1 time: 0.066758 Jul 19 22:32:14.980234 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 803/1606] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:32:14 2022] DELETE /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:32:14.980845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7de3810f-f7d1-4dad-a577-5f3cab5c19b6 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Action: 'create', calling method: .version_select at 0x7f7a03f420d0>, body: {"security_group_rule": {"parent_group_id": "f74badc3-e9af-4def-8d7d-689c0199b6d7", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:15.075046 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-7de3810f-f7d1-4dad-a577-5f3cab5c19b6 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 19 22:32:15.079921 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7de3810f-f7d1-4dad-a577-5f3cab5c19b6 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Request method failure captured: Jul 19 22:32:15.079921 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 19 22:32:15.079921 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:32:15.079921 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:32:15.079921 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:32:15.079921 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 138 Jul 19 22:32:15.079921 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:32:15.079921 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:32:15.079921 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:32:15.079921 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:15.079921 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zDlVM0R8-woxzFBDbF9TpdOo_RgnOhGYonCZhqe4mPdOqTy-rIsIG0BAUPDqmnIXW5U5_lTDmNnsdHImz-YpnAz9uJIvUtfoZi3fxfjEhvF-cvPHqKEGqiwbeMTCOv6tCExmaVYGAvJmoYG3l672Gk05RXcSu35OmESbWBbwFyRAr0 Jul 19 22:32:15.079921 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:32:15.079921 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:32:15.079921 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:32:15.079921 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:32:15.079921 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:32:15.079921 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:32:15.079921 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 0bc3ae517d3249d093279dd6af357d8f Jul 19 22:32:15.079921 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-151170730 Jul 19 22:32:15.079921 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:32:15.079921 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:32:15.082421 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:15.082421 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-151170730 Jul 19 22:32:15.082421 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 0bc3ae517d3249d093279dd6af357d8f Jul 19 22:32:15.082421 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-151170730 Jul 19 22:32:15.082421 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-151170730-project Jul 19 22:32:15.082421 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:32:15.082421 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:32:15.082421 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 6d7253958c7146349baf25c59a46060d Jul 19 22:32:15.082421 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-151170730-project Jul 19 22:32:15.082421 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:32:15.082421 n-d-847009-3 devstack@n-api.service[119337]: {"security_group_rule": {"parent_group_id": "f74badc3-e9af-4def-8d7d-689c0199b6d7", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 19 22:32:15.082421 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:32:15.084651 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 19 22:32:15.084651 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f74badc3-e9af-4def-8d7d-689c0199b6d7', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 19 22:32:15.084651 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:15.084651 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:15.084651 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 19 22:32:15.084651 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 19 22:32:15.084651 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 19 22:32:15.084651 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 19 22:32:15.084651 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 19 22:32:15.084651 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 19 22:32:15.084651 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 19 22:32:15.084651 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 19 22:32:15.084651 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 19 22:32:15.084651 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.084651 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:15.084651 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.084651 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:15.084651 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:15.084651 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:15.088094 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:15.088094 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:15.088094 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:32:15.088094 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:32:15.088094 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:15.088094 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:15.088094 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 19 22:32:15.088094 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 19 22:32:15.088094 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 19 22:32:15.088094 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.088094 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:15.088094 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.088094 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:15.088094 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:15.088094 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:15.088094 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:15.088094 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:15.088094 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 19 22:32:15.088094 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.090667 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a46f02be-2396-413f-ae08-a28a45bfbca3 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:15.091240 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7de3810f-f7d1-4dad-a577-5f3cab5c19b6 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:15.091240 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7de3810f-f7d1-4dad-a577-5f3cab5c19b6 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.111084 Jul 19 22:32:15.093790 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 804/1607] 10.222.0.25 () {60 vars in 1194 bytes} [Tue Jul 19 22:32:14 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:32:15.097196 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a46f02be-2396-413f-ae08-a28a45bfbca3 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:15.098746 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a46f02be-2396-413f-ae08-a28a45bfbca3 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:15.099353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a35f28f2-ddbc-40b6-9fd7-6dffbb2f19e7 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:15.099968 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a46f02be-2396-413f-ae08-a28a45bfbca3 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 0.382748 Jul 19 22:32:15.100349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a35f28f2-ddbc-40b6-9fd7-6dffbb2f19e7 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:15.106344 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 804/1608] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:14 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:15.111602 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a35f28f2-ddbc-40b6-9fd7-6dffbb2f19e7 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:15.112915 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a35f28f2-ddbc-40b6-9fd7-6dffbb2f19e7 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:15.114783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a35f28f2-ddbc-40b6-9fd7-6dffbb2f19e7 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:15.115936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d3d4bb8b-b6ed-4052-8629-3a10478cdcc2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:15.116258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a35f28f2-ddbc-40b6-9fd7-6dffbb2f19e7 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:15.117053 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d3d4bb8b-b6ed-4052-8629-3a10478cdcc2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:15.127487 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3d4bb8b-b6ed-4052-8629-3a10478cdcc2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:15.128065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3d4bb8b-b6ed-4052-8629-3a10478cdcc2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:15.128998 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3d4bb8b-b6ed-4052-8629-3a10478cdcc2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:15.131282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3d4bb8b-b6ed-4052-8629-3a10478cdcc2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:15.150400 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-a35f28f2-ddbc-40b6-9fd7-6dffbb2f19e7 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] HTTP exception thrown: Instance b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab could not be found. Jul 19 22:32:15.152501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a35f28f2-ddbc-40b6-9fd7-6dffbb2f19e7 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Request method failure captured: Jul 19 22:32:15.152501 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab HTTP/1.1 Jul 19 22:32:15.152501 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:32:15.152501 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:32:15.152501 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:32:15.152501 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:32:15.152501 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:32:15.152501 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:32:15.152501 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:32:15.152501 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:15.152501 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y_T-rV9vdmYQMM8LoQwWPhS5cDjBwvgUgmSjEmbZ_ttnUU-jQvotVgKddbEooltkOokiE6SwLo3Z-kacOPZhg9AscTkUHDvjvam8aXJrhX9z_4RA-iJlI6NKQ4vgYyMS4_6SOYRmQQRsSyk4EfpgJ3-yKW12si84M6_1FVqSwNQW1g Jul 19 22:32:15.152501 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:32:15.152501 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:32:15.152501 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:32:15.152501 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:32:15.152501 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:32:15.152501 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:32:15.152501 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 5e91c72f8cf5406a9662a29ee25780e6 Jul 19 22:32:15.152501 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:15.152501 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:32:15.152501 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:32:15.153891 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:15.153891 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:15.153891 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 5e91c72f8cf5406a9662a29ee25780e6 Jul 19 22:32:15.153891 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:15.153891 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ImagesTestJSON-1973838127-project Jul 19 22:32:15.153891 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:32:15.153891 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:32:15.153891 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 22b46b207cdb40c7b325bdc42baae246 Jul 19 22:32:15.153891 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ImagesTestJSON-1973838127-project Jul 19 22:32:15.153891 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:32:15.153891 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab could not be found. Jul 19 22:32:15.153891 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab'} Jul 19 22:32:15.153891 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:15.154767 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:15.154767 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:32:15.154767 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:32:15.154767 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:32:15.154767 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:32:15.154767 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:32:15.154767 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:32:15.154767 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:32:15.154767 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:32:15.154767 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab could not be found. Jul 19 22:32:15.154767 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.154767 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:15.154767 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.154767 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:15.154767 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:15.154767 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:15.154767 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:15.154767 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:15.154767 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:15.154767 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:15.156035 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:32:15.156035 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:32:15.156035 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:32:15.156035 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:32:15.156035 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:32:15.156035 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:32:15.156035 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab could not be found. Jul 19 22:32:15.156035 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.156035 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:15.156035 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.156035 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:15.156035 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:15.156035 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:15.156035 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:15.156035 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:15.156035 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab could not be found. Jul 19 22:32:15.156035 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.166651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a35f28f2-ddbc-40b6-9fd7-6dffbb2f19e7 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Returning 404 to user: Instance b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:15.168518 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a35f28f2-ddbc-40b6-9fd7-6dffbb2f19e7 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab" status: 404 len: 111 microversion: 2.1 time: 0.072954 Jul 19 22:32:15.173007 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 805/1609] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:15 2022] GET /compute/v2.1/servers/b0dbb92d-b9ec-40dd-822a-0c8f6b24a4ab => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:32:15.181573 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c5f4849d-cf7b-4ab1-a9f0-018b3168bdf9 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Action: 'create', calling method: .version_select at 0x7f7a03f42700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1277469518", "description": "tempest-description-2039513807"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:15.435057 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d3d4bb8b-b6ed-4052-8629-3a10478cdcc2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:15.452528 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d3d4bb8b-b6ed-4052-8629-3a10478cdcc2 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1479 microversion: 2.1 time: 0.341805 Jul 19 22:32:15.456759 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 805/1610] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:15 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1479 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:15.471757 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-53bc535f-5c43-46ba-bec1-2f16dced3612 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '.version_select at 0x7f7a107749d0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:15.500158 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-53bc535f-5c43-46ba-bec1-2f16dced3612 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] HTTP exception thrown: Image not found. Jul 19 22:32:15.502348 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-53bc535f-5c43-46ba-bec1-2f16dced3612 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Request method failure captured: Jul 19 22:32:15.502348 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5 HTTP/1.1 Jul 19 22:32:15.502348 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:32:15.502348 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:32:15.502348 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:32:15.502348 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:32:15.502348 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:32:15.502348 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:32:15.502348 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:32:15.502348 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:15.502348 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y_T-rV9vdmYQMM8LoQwWPhS5cDjBwvgUgmSjEmbZ_ttnUU-jQvotVgKddbEooltkOokiE6SwLo3Z-kacOPZhg9AscTkUHDvjvam8aXJrhX9z_4RA-iJlI6NKQ4vgYyMS4_6SOYRmQQRsSyk4EfpgJ3-yKW12si84M6_1FVqSwNQW1g Jul 19 22:32:15.502348 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:32:15.502348 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:32:15.502348 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:32:15.502348 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:32:15.502348 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:32:15.502348 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:32:15.502348 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 5e91c72f8cf5406a9662a29ee25780e6 Jul 19 22:32:15.502348 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:15.502348 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:32:15.502348 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:32:15.503932 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:15.503932 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:15.503932 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 5e91c72f8cf5406a9662a29ee25780e6 Jul 19 22:32:15.503932 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:15.503932 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesTestJSON-1973838127-project Jul 19 22:32:15.503932 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:32:15.503932 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:32:15.503932 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 22b46b207cdb40c7b325bdc42baae246 Jul 19 22:32:15.503932 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesTestJSON-1973838127-project Jul 19 22:32:15.503932 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:32:15.503932 n-d-847009-3 devstack@n-api.service[119338]: exception: Image not found. Jul 19 22:32:15.503932 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '536b4d43-251b-4211-87c6-64c0ac3b6cd5'} Jul 19 22:32:15.503932 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:15.503932 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:15.504919 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 22:32:15.504919 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 22:32:15.504919 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:32:15.504919 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:32:15.504919 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:32:15.504919 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:32:15.504919 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 22:32:15.504919 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 22:32:15.504919 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 22:32:15.504919 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 22:32:15.504919 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:32:15.504919 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:32:15.504919 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:32:15.504919 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:32:15.504919 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 536b4d43-251b-4211-87c6-64c0ac3b6cd5 to delete Jul 19 22:32:15.504919 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.504919 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:15.504919 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.504919 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:15.506057 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 22:32:15.506057 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 22:32:15.506057 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 22:32:15.506057 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 22:32:15.506057 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 22:32:15.506057 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 22:32:15.506057 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 536b4d43-251b-4211-87c6-64c0ac3b6cd5 could not be found. Jul 19 22:32:15.506057 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.506057 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:15.506057 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.506057 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:15.506057 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:15.506057 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:15.506057 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:15.506057 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:15.506057 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:32:15.506057 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:32:15.506057 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:15.506057 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:15.506057 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 22:32:15.507258 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 22:32:15.507258 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 22:32:15.507258 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.507258 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:15.507258 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.507258 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:15.507258 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:15.507258 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:15.507258 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:15.507258 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:15.507258 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 22:32:15.507258 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.510500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-53bc535f-5c43-46ba-bec1-2f16dced3612 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Returning 404 to user: Image not found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:15.511742 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-53bc535f-5c43-46ba-bec1-2f16dced3612 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "DELETE /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5" status: 404 len: 62 microversion: 2.1 time: 0.053004 Jul 19 22:32:15.512827 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 806/1611] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:15 2022] DELETE /compute/v2.1/images/536b4d43-251b-4211-87c6-64c0ac3b6cd5 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:32:15.535992 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b163274b-4eb7-4c66-b0c7-bd62a2eea0ec tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:15.536862 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b163274b-4eb7-4c66-b0c7-bd62a2eea0ec tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: c63853a7-f403-42e3-9a4b-fb322a8decd6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:15.564128 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b163274b-4eb7-4c66-b0c7-bd62a2eea0ec tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:15.564964 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b163274b-4eb7-4c66-b0c7-bd62a2eea0ec tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:15.566669 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b163274b-4eb7-4c66-b0c7-bd62a2eea0ec tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:15.572371 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b163274b-4eb7-4c66-b0c7-bd62a2eea0ec tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:15.604126 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-b163274b-4eb7-4c66-b0c7-bd62a2eea0ec tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] HTTP exception thrown: Instance c63853a7-f403-42e3-9a4b-fb322a8decd6 could not be found. Jul 19 22:32:15.607330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b163274b-4eb7-4c66-b0c7-bd62a2eea0ec tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Request method failure captured: Jul 19 22:32:15.607330 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6 HTTP/1.1 Jul 19 22:32:15.607330 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:32:15.607330 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:32:15.607330 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:32:15.607330 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:32:15.607330 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:32:15.607330 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:32:15.607330 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:32:15.607330 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:15.607330 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y_T-rV9vdmYQMM8LoQwWPhS5cDjBwvgUgmSjEmbZ_ttnUU-jQvotVgKddbEooltkOokiE6SwLo3Z-kacOPZhg9AscTkUHDvjvam8aXJrhX9z_4RA-iJlI6NKQ4vgYyMS4_6SOYRmQQRsSyk4EfpgJ3-yKW12si84M6_1FVqSwNQW1g Jul 19 22:32:15.607330 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:32:15.607330 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:32:15.607330 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:32:15.607330 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:32:15.607330 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:32:15.607330 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:32:15.607330 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 5e91c72f8cf5406a9662a29ee25780e6 Jul 19 22:32:15.607330 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:15.607330 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:32:15.607330 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:32:15.610264 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:15.610264 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:15.610264 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 5e91c72f8cf5406a9662a29ee25780e6 Jul 19 22:32:15.610264 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:15.610264 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesTestJSON-1973838127-project Jul 19 22:32:15.610264 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:32:15.610264 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:32:15.610264 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 22b46b207cdb40c7b325bdc42baae246 Jul 19 22:32:15.610264 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesTestJSON-1973838127-project Jul 19 22:32:15.610264 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:32:15.610264 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance c63853a7-f403-42e3-9a4b-fb322a8decd6 could not be found. Jul 19 22:32:15.610264 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'c63853a7-f403-42e3-9a4b-fb322a8decd6'} Jul 19 22:32:15.613171 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:15.613171 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:15.613171 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:32:15.613171 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:32:15.613171 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:32:15.613171 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:32:15.613171 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:32:15.613171 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:32:15.613171 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:32:15.613171 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:32:15.613171 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c63853a7-f403-42e3-9a4b-fb322a8decd6 could not be found. Jul 19 22:32:15.613171 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.613171 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:15.613171 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.613171 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:15.613171 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:15.613171 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:15.613171 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:15.613171 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:15.613171 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:15.618460 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:15.618460 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:32:15.618460 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:32:15.618460 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:32:15.618460 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:32:15.618460 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:32:15.618460 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:32:15.618460 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:32:15.618460 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:32:15.618460 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c63853a7-f403-42e3-9a4b-fb322a8decd6 could not be found. Jul 19 22:32:15.618460 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.618460 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:15.618460 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.618460 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:15.618460 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:15.618460 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:15.618460 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:15.618460 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:15.618460 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c63853a7-f403-42e3-9a4b-fb322a8decd6 could not be found. Jul 19 22:32:15.618460 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.632870 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c5f4849d-cf7b-4ab1-a9f0-018b3168bdf9 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.460604 Jul 19 22:32:15.640708 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 806/1612] 10.222.0.25 () {60 vars in 1179 bytes} [Tue Jul 19 22:32:15 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:15.640708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-256be3c6-c3c3-4849-94d1-be3afeb1b13d tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:15.640708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-256be3c6-c3c3-4849-94d1-be3afeb1b13d tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:15.644095 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b163274b-4eb7-4c66-b0c7-bd62a2eea0ec tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Returning 404 to user: Instance c63853a7-f403-42e3-9a4b-fb322a8decd6 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:15.646510 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b163274b-4eb7-4c66-b0c7-bd62a2eea0ec tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6" status: 404 len: 111 microversion: 2.1 time: 0.126389 Jul 19 22:32:15.649272 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 807/1613] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:32:15 2022] DELETE /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:32:15.657167 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b9fb9ca9-d941-4eb5-92b6-2cb8e89703e4 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Action: 'create', calling method: .version_select at 0x7f7a1058a700>, body: {"security_group_rule": {"parent_group_id": "38bcd3f4-53b3-48c7-89aa-0da27be04f45", "ip_protocol": "tcp", "from_port": 22, "to_port": 1246669187}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:15.657961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-256be3c6-c3c3-4849-94d1-be3afeb1b13d tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:15.658423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-256be3c6-c3c3-4849-94d1-be3afeb1b13d tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:15.659233 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-256be3c6-c3c3-4849-94d1-be3afeb1b13d tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:15.659671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-256be3c6-c3c3-4849-94d1-be3afeb1b13d tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:15.727933 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-b9fb9ca9-d941-4eb5-92b6-2cb8e89703e4 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] HTTP exception thrown: Invalid port range 22:1246669187. Valid TCP ports should be between 1-65535 Jul 19 22:32:15.729716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b9fb9ca9-d941-4eb5-92b6-2cb8e89703e4 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Request method failure captured: Jul 19 22:32:15.729716 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 19 22:32:15.729716 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:32:15.729716 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:32:15.729716 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:32:15.729716 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 146 Jul 19 22:32:15.729716 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:32:15.729716 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:32:15.729716 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:32:15.729716 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:15.729716 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zDlVM0R8-woxzFBDbF9TpdOo_RgnOhGYonCZhqe4mPdOqTy-rIsIG0BAUPDqmnIXW5U5_lTDmNnsdHImz-YpnAz9uJIvUtfoZi3fxfjEhvF-cvPHqKEGqiwbeMTCOv6tCExmaVYGAvJmoYG3l672Gk05RXcSu35OmESbWBbwFyRAr0 Jul 19 22:32:15.729716 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:32:15.729716 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:32:15.729716 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:32:15.729716 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:32:15.729716 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:32:15.729716 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:32:15.729716 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 0bc3ae517d3249d093279dd6af357d8f Jul 19 22:32:15.729716 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-151170730 Jul 19 22:32:15.729716 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:32:15.729716 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:32:15.731038 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:15.731038 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-151170730 Jul 19 22:32:15.731038 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 0bc3ae517d3249d093279dd6af357d8f Jul 19 22:32:15.731038 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-151170730 Jul 19 22:32:15.731038 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-151170730-project Jul 19 22:32:15.731038 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:32:15.731038 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:32:15.731038 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 6d7253958c7146349baf25c59a46060d Jul 19 22:32:15.731038 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-151170730-project Jul 19 22:32:15.731038 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:32:15.731038 n-d-847009-3 devstack@n-api.service[119338]: {"security_group_rule": {"parent_group_id": "38bcd3f4-53b3-48c7-89aa-0da27be04f45", "ip_protocol": "tcp", "from_port": 22, "to_port": 1246669187}} Jul 19 22:32:15.731038 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:32:15.731833 n-d-847009-3 devstack@n-api.service[119338]: exception: Invalid port range 22:1246669187. Valid TCP ports should be between 1-65535 Jul 19 22:32:15.731833 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'body': {'security_group_rule': {'parent_group_id': '38bcd3f4-53b3-48c7-89aa-0da27be04f45', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1246669187}}} Jul 19 22:32:15.731833 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:15.731833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:15.731833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 19 22:32:15.731833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 19 22:32:15.731833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 19 22:32:15.731833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 19 22:32:15.731833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 19 22:32:15.731833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 19 22:32:15.731833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 19 22:32:15.731833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 19 22:32:15.731833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1246669187. Valid TCP ports should be between 1-65535 Jul 19 22:32:15.731833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.731833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:15.731833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.731833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:15.731833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:15.731833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:15.733006 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:15.733006 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:15.733006 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:32:15.733006 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:32:15.733006 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:15.733006 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:15.733006 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 19 22:32:15.733006 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 19 22:32:15.733006 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1246669187. Valid TCP ports should be between 1-65535 Jul 19 22:32:15.733006 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.733006 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:15.733006 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.733006 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:15.733006 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:15.733006 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:15.733006 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:15.733006 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:15.733006 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1246669187. Valid TCP ports should be between 1-65535 Jul 19 22:32:15.733006 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.734153 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b9fb9ca9-d941-4eb5-92b6-2cb8e89703e4 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Returning 400 to user: Invalid port range 22:1246669187. Valid TCP ports should be between 1-65535 {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:15.734153 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b9fb9ca9-d941-4eb5-92b6-2cb8e89703e4 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.079604 Jul 19 22:32:15.737940 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 808/1614] 10.222.0.25 () {60 vars in 1194 bytes} [Tue Jul 19 22:32:15 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 87 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:32:15.743393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-84d20c1f-6764-40a7-bf10-09a03db26dd2 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:15.744006 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-84d20c1f-6764-40a7-bf10-09a03db26dd2 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] [instance: c63853a7-f403-42e3-9a4b-fb322a8decd6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:15.757107 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-84d20c1f-6764-40a7-bf10-09a03db26dd2 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:15.759654 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-84d20c1f-6764-40a7-bf10-09a03db26dd2 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:15.762761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-84d20c1f-6764-40a7-bf10-09a03db26dd2 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:15.763490 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-84d20c1f-6764-40a7-bf10-09a03db26dd2 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:15.782580 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-84d20c1f-6764-40a7-bf10-09a03db26dd2 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] HTTP exception thrown: Instance c63853a7-f403-42e3-9a4b-fb322a8decd6 could not be found. Jul 19 22:32:15.784470 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-84d20c1f-6764-40a7-bf10-09a03db26dd2 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Request method failure captured: Jul 19 22:32:15.784470 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6 HTTP/1.1 Jul 19 22:32:15.784470 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:32:15.784470 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:32:15.784470 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:32:15.784470 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:32:15.784470 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:32:15.784470 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:32:15.784470 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:32:15.784470 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:15.784470 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y_T-rV9vdmYQMM8LoQwWPhS5cDjBwvgUgmSjEmbZ_ttnUU-jQvotVgKddbEooltkOokiE6SwLo3Z-kacOPZhg9AscTkUHDvjvam8aXJrhX9z_4RA-iJlI6NKQ4vgYyMS4_6SOYRmQQRsSyk4EfpgJ3-yKW12si84M6_1FVqSwNQW1g Jul 19 22:32:15.784470 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:32:15.784470 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:32:15.784470 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:32:15.784470 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:32:15.784470 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:32:15.784470 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:32:15.784470 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 5e91c72f8cf5406a9662a29ee25780e6 Jul 19 22:32:15.784470 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:15.784470 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:32:15.784470 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:32:15.785821 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e91c72f8cf5406a9662a29ee25780e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:15.785821 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:15.785821 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 5e91c72f8cf5406a9662a29ee25780e6 Jul 19 22:32:15.785821 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesTestJSON-1973838127 Jul 19 22:32:15.785821 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesTestJSON-1973838127-project Jul 19 22:32:15.785821 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:32:15.785821 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:32:15.785821 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 22b46b207cdb40c7b325bdc42baae246 Jul 19 22:32:15.785821 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesTestJSON-1973838127-project Jul 19 22:32:15.785821 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:32:15.785821 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance c63853a7-f403-42e3-9a4b-fb322a8decd6 could not be found. Jul 19 22:32:15.785821 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'c63853a7-f403-42e3-9a4b-fb322a8decd6'} Jul 19 22:32:15.785821 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:15.786733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:15.786733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:32:15.786733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:32:15.786733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:32:15.786733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:32:15.786733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:32:15.786733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:32:15.786733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:32:15.786733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:32:15.786733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c63853a7-f403-42e3-9a4b-fb322a8decd6 could not be found. Jul 19 22:32:15.786733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.786733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:15.786733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.786733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:15.786733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:15.786733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:15.786733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:15.786733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:15.786733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:15.786733 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:15.787982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:32:15.787982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:32:15.787982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:32:15.787982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:32:15.787982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:32:15.787982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:32:15.787982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c63853a7-f403-42e3-9a4b-fb322a8decd6 could not be found. Jul 19 22:32:15.787982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.787982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:15.787982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.787982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:15.787982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:15.787982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:15.787982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:15.787982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:15.787982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c63853a7-f403-42e3-9a4b-fb322a8decd6 could not be found. Jul 19 22:32:15.787982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.792158 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-84d20c1f-6764-40a7-bf10-09a03db26dd2 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] Returning 404 to user: Instance c63853a7-f403-42e3-9a4b-fb322a8decd6 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:15.793286 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-84d20c1f-6764-40a7-bf10-09a03db26dd2 tempest-ImagesTestJSON-1973838127 tempest-ImagesTestJSON-1973838127-project] 10.222.0.25 "GET /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6" status: 404 len: 111 microversion: 2.1 time: 0.054311 Jul 19 22:32:15.793863 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 809/1615] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:15 2022] GET /compute/v2.1/servers/c63853a7-f403-42e3-9a4b-fb322a8decd6 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:32:15.803044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-037bdfee-7f79-4d69-811e-3fe20d8f7019 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Action: 'create', calling method: .version_select at 0x7f7a107745e0>, body: {"security_group_rule": {"parent_group_id": "28334e8c-12ba-4fac-acab-6a5df7339a65", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:15.831349 n-d-847009-3 devstack@n-api.service[119338]: DEBUG neutronclient.v2_0.client [None req-037bdfee-7f79-4d69-811e-3fe20d8f7019 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 28334e8c-12ba-4fac-acab-6a5df7339a65 does not exist", "detail": ""}} {{(pid=119338) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 22:32:15.832305 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.security_group_api [None req-037bdfee-7f79-4d69-811e-3fe20d8f7019 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Neutron security group 28334e8c-12ba-4fac-acab-6a5df7339a65 not found {{(pid=119338) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 22:32:15.833085 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-037bdfee-7f79-4d69-811e-3fe20d8f7019 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] HTTP exception thrown: Security group 28334e8c-12ba-4fac-acab-6a5df7339a65 does not exist Jul 19 22:32:15.833085 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-72f04638-c0bd-4417-929e-e46625e63397'] Jul 19 22:32:15.835333 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-037bdfee-7f79-4d69-811e-3fe20d8f7019 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Request method failure captured: Jul 19 22:32:15.835333 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 19 22:32:15.835333 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:32:15.835333 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:32:15.835333 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:32:15.835333 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 138 Jul 19 22:32:15.835333 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:32:15.835333 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:32:15.835333 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:32:15.835333 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:15.835333 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zDlVM0R8-woxzFBDbF9TpdOo_RgnOhGYonCZhqe4mPdOqTy-rIsIG0BAUPDqmnIXW5U5_lTDmNnsdHImz-YpnAz9uJIvUtfoZi3fxfjEhvF-cvPHqKEGqiwbeMTCOv6tCExmaVYGAvJmoYG3l672Gk05RXcSu35OmESbWBbwFyRAr0 Jul 19 22:32:15.835333 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:32:15.835333 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:32:15.835333 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:32:15.835333 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:32:15.835333 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:32:15.835333 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:32:15.835333 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 0bc3ae517d3249d093279dd6af357d8f Jul 19 22:32:15.835333 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-151170730 Jul 19 22:32:15.835333 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:32:15.835333 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:32:15.837396 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:15.837396 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-151170730 Jul 19 22:32:15.837396 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 0bc3ae517d3249d093279dd6af357d8f Jul 19 22:32:15.837396 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-151170730 Jul 19 22:32:15.837396 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-151170730-project Jul 19 22:32:15.837396 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:32:15.837396 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:32:15.837396 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 6d7253958c7146349baf25c59a46060d Jul 19 22:32:15.837396 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-151170730-project Jul 19 22:32:15.837396 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:32:15.837396 n-d-847009-3 devstack@n-api.service[119338]: {"security_group_rule": {"parent_group_id": "28334e8c-12ba-4fac-acab-6a5df7339a65", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 19 22:32:15.837396 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:32:15.838134 n-d-847009-3 devstack@n-api.service[119338]: exception: Security group 28334e8c-12ba-4fac-acab-6a5df7339a65 does not exist Jul 19 22:32:15.838134 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-72f04638-c0bd-4417-929e-e46625e63397'] Jul 19 22:32:15.838134 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'body': {'security_group_rule': {'parent_group_id': '28334e8c-12ba-4fac-acab-6a5df7339a65', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 19 22:32:15.838134 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:15.838134 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:15.838134 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 22:32:15.838134 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 22:32:15.838134 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:32:15.838134 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:32:15.838134 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 22:32:15.838134 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 22:32:15.838134 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:32:15.838134 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:32:15.838134 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 22:32:15.838134 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 22:32:15.838134 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:32:15.838134 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:32:15.838134 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 22:32:15.838134 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 22:32:15.839348 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:32:15.839348 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:32:15.839348 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 22:32:15.839348 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 22:32:15.839348 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:32:15.839348 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:32:15.839348 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 22:32:15.839348 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 22:32:15.839348 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 22:32:15.839348 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 22:32:15.839348 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 28334e8c-12ba-4fac-acab-6a5df7339a65 does not exist Jul 19 22:32:15.839348 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72f04638-c0bd-4417-929e-e46625e63397'] Jul 19 22:32:15.839348 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.839348 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:15.839348 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.839348 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:15.839348 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 19 22:32:15.839348 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 19 22:32:15.839348 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 22:32:15.842316 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 22:32:15.842316 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 28334e8c-12ba-4fac-acab-6a5df7339a65 does not exist Jul 19 22:32:15.842316 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72f04638-c0bd-4417-929e-e46625e63397'] Jul 19 22:32:15.842316 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.842316 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:15.842316 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.842316 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:15.842316 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:15.842316 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:15.842316 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:15.842316 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:15.842316 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:32:15.842316 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:32:15.842316 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:15.842316 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:15.842316 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 19 22:32:15.842316 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 22:32:15.842316 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 28334e8c-12ba-4fac-acab-6a5df7339a65 does not exist Jul 19 22:32:15.842316 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72f04638-c0bd-4417-929e-e46625e63397'] Jul 19 22:32:15.842316 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.845020 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:15.845020 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.845020 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:15.845020 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:15.845020 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:15.845020 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:15.845020 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:15.845020 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 28334e8c-12ba-4fac-acab-6a5df7339a65 does not exist Jul 19 22:32:15.845020 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72f04638-c0bd-4417-929e-e46625e63397'] Jul 19 22:32:15.845020 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.845020 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-037bdfee-7f79-4d69-811e-3fe20d8f7019 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Returning 404 to user: Security group 28334e8c-12ba-4fac-acab-6a5df7339a65 does not exist Jul 19 22:32:15.845020 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-72f04638-c0bd-4417-929e-e46625e63397'] {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:15.850348 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-037bdfee-7f79-4d69-811e-3fe20d8f7019 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.045823 Jul 19 22:32:15.858107 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 810/1616] 10.222.0.25 () {60 vars in 1194 bytes} [Tue Jul 19 22:32:15 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:32:15.871299 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-53977332-a12a-431d-9c6b-e52693a7b0b4 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Calling method '.version_select at 0x7f7a10941d30>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:15.977342 n-d-847009-3 devstack@n-api.service[119338]: DEBUG neutronclient.v2_0.client [None req-53977332-a12a-431d-9c6b-e52693a7b0b4 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 23f91258-0254-4d3c-acc9-b399008c9f22 does not exist", "detail": ""}} {{(pid=119338) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 22:32:15.978055 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.security_group_api [None req-53977332-a12a-431d-9c6b-e52693a7b0b4 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Neutron security group rule 23f91258-0254-4d3c-acc9-b399008c9f22 not found {{(pid=119338) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 19 22:32:15.978950 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-53977332-a12a-431d-9c6b-e52693a7b0b4 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] HTTP exception thrown: Security group rule 23f91258-0254-4d3c-acc9-b399008c9f22 does not exist Jul 19 22:32:15.978950 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-a99e8bb1-ac6f-462b-b9bd-2e986e9c7f65'] Jul 19 22:32:15.984920 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-256be3c6-c3c3-4849-94d1-be3afeb1b13d tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:15.988685 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-53977332-a12a-431d-9c6b-e52693a7b0b4 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Request method failure captured: Jul 19 22:32:15.988685 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/os-security-group-rules/23f91258-0254-4d3c-acc9-b399008c9f22 HTTP/1.1 Jul 19 22:32:15.988685 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:32:15.988685 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:32:15.988685 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:32:15.988685 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:32:15.988685 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:32:15.988685 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:32:15.988685 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:32:15.988685 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:15.988685 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zDlVM0R8-woxzFBDbF9TpdOo_RgnOhGYonCZhqe4mPdOqTy-rIsIG0BAUPDqmnIXW5U5_lTDmNnsdHImz-YpnAz9uJIvUtfoZi3fxfjEhvF-cvPHqKEGqiwbeMTCOv6tCExmaVYGAvJmoYG3l672Gk05RXcSu35OmESbWBbwFyRAr0 Jul 19 22:32:15.988685 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:32:15.988685 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:32:15.988685 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:32:15.988685 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:32:15.988685 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:32:15.988685 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:32:15.988685 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 0bc3ae517d3249d093279dd6af357d8f Jul 19 22:32:15.988685 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-151170730 Jul 19 22:32:15.988685 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:32:15.988685 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:32:15.990048 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bc3ae517d3249d093279dd6af357d8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:15.990048 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-151170730 Jul 19 22:32:15.990048 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 0bc3ae517d3249d093279dd6af357d8f Jul 19 22:32:15.990048 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-151170730 Jul 19 22:32:15.990048 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-151170730-project Jul 19 22:32:15.990048 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:32:15.990048 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:32:15.990048 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 6d7253958c7146349baf25c59a46060d Jul 19 22:32:15.990048 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-151170730-project Jul 19 22:32:15.990048 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:32:15.990048 n-d-847009-3 devstack@n-api.service[119338]: exception: Security group rule 23f91258-0254-4d3c-acc9-b399008c9f22 does not exist Jul 19 22:32:15.990048 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-a99e8bb1-ac6f-462b-b9bd-2e986e9c7f65'] Jul 19 22:32:15.990980 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '23f91258-0254-4d3c-acc9-b399008c9f22'} Jul 19 22:32:15.990980 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:15.990980 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:15.990980 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 19 22:32:15.990980 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 19 22:32:15.990980 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:32:15.990980 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:32:15.990980 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 19 22:32:15.990980 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 19 22:32:15.990980 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:32:15.990980 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:32:15.990980 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 22:32:15.990980 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 22:32:15.990980 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:32:15.990980 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:32:15.990980 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 22:32:15.990980 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 22:32:15.990980 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:32:15.990980 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:32:15.992503 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 22:32:15.992503 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 22:32:15.992503 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:32:15.992503 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:32:15.992503 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 22:32:15.992503 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 22:32:15.992503 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 22:32:15.992503 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 22:32:15.992503 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 23f91258-0254-4d3c-acc9-b399008c9f22 does not exist Jul 19 22:32:15.992503 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a99e8bb1-ac6f-462b-b9bd-2e986e9c7f65'] Jul 19 22:32:15.992503 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.992503 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:15.992503 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.992503 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:15.992503 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 19 22:32:15.992503 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 19 22:32:15.992503 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 19 22:32:15.992503 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 22:32:15.993658 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 23f91258-0254-4d3c-acc9-b399008c9f22 does not exist Jul 19 22:32:15.993658 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a99e8bb1-ac6f-462b-b9bd-2e986e9c7f65'] Jul 19 22:32:15.993658 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.993658 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:15.993658 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.993658 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:15.993658 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:15.993658 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:15.993658 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:15.993658 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:15.993658 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:32:15.993658 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:32:15.993658 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:15.993658 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:15.993658 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 19 22:32:15.993658 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 22:32:15.993658 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 23f91258-0254-4d3c-acc9-b399008c9f22 does not exist Jul 19 22:32:15.993658 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a99e8bb1-ac6f-462b-b9bd-2e986e9c7f65'] Jul 19 22:32:15.993658 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.993658 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:15.994993 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.994993 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:15.994993 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:15.994993 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:15.994993 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:15.994993 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:15.994993 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 23f91258-0254-4d3c-acc9-b399008c9f22 does not exist Jul 19 22:32:15.994993 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a99e8bb1-ac6f-462b-b9bd-2e986e9c7f65'] Jul 19 22:32:15.994993 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:15.994993 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-53977332-a12a-431d-9c6b-e52693a7b0b4 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Returning 404 to user: Security group rule 23f91258-0254-4d3c-acc9-b399008c9f22 does not exist Jul 19 22:32:15.994993 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-a99e8bb1-ac6f-462b-b9bd-2e986e9c7f65'] {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:15.996360 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-53977332-a12a-431d-9c6b-e52693a7b0b4 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/23f91258-0254-4d3c-acc9-b399008c9f22" status: 404 len: 199 microversion: 2.1 time: 0.131203 Jul 19 22:32:16.001367 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 811/1617] 10.222.0.25 () {58 vars in 1286 bytes} [Tue Jul 19 22:32:15 2022] DELETE /compute/v2.1/os-security-group-rules/23f91258-0254-4d3c-acc9-b399008c9f22 => generated 199 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:32:16.006732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-256be3c6-c3c3-4849-94d1-be3afeb1b13d tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:16.011096 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-256be3c6-c3c3-4849-94d1-be3afeb1b13d tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:16.014407 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8929a8ee-cc98-4485-afe2-2c63766dca2f tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Calling method '.version_select at 0x7f7a10774c10>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:16.026771 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-256be3c6-c3c3-4849-94d1-be3afeb1b13d tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1438 microversion: 2.75 time: 0.391647 Jul 19 22:32:16.030743 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 807/1618] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:15 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1438 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:16.046517 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-705b9d4c-d8b5-43c7-8de8-11342a1af562 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:16.049043 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-705b9d4c-d8b5-43c7-8de8-11342a1af562 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:16.061168 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-705b9d4c-d8b5-43c7-8de8-11342a1af562 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:16.063023 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-705b9d4c-d8b5-43c7-8de8-11342a1af562 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:16.064037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-705b9d4c-d8b5-43c7-8de8-11342a1af562 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:16.065825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-705b9d4c-d8b5-43c7-8de8-11342a1af562 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:16.236441 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-705b9d4c-d8b5-43c7-8de8-11342a1af562 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:32:16.237078 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-705b9d4c-d8b5-43c7-8de8-11342a1af562 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:32:16.237744 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-705b9d4c-d8b5-43c7-8de8-11342a1af562 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:32:16.238315 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-705b9d4c-d8b5-43c7-8de8-11342a1af562 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:32:16.238894 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-705b9d4c-d8b5-43c7-8de8-11342a1af562 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:32:16.375151 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-705b9d4c-d8b5-43c7-8de8-11342a1af562 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:16.387092 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-705b9d4c-d8b5-43c7-8de8-11342a1af562 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:16.390837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-705b9d4c-d8b5-43c7-8de8-11342a1af562 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:16.392005 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-705b9d4c-d8b5-43c7-8de8-11342a1af562 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:16.392650 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-705b9d4c-d8b5-43c7-8de8-11342a1af562 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:16.566641 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-705b9d4c-d8b5-43c7-8de8-11342a1af562 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:16.581231 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-705b9d4c-d8b5-43c7-8de8-11342a1af562 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:16.582815 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-705b9d4c-d8b5-43c7-8de8-11342a1af562 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:16.593245 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-705b9d4c-d8b5-43c7-8de8-11342a1af562 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "POST /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d/action" status: 202 len: 1495 microversion: 2.75 time: 0.550739 Jul 19 22:32:16.593757 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 808/1619] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Jul 19 22:32:16 2022] POST /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d/action => generated 1495 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Jul 19 22:32:16.606885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3dc11aee-4695-459b-b91d-079b7f866b46 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:16.611916 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3dc11aee-4695-459b-b91d-079b7f866b46 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:16.620466 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3dc11aee-4695-459b-b91d-079b7f866b46 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:16.621403 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3dc11aee-4695-459b-b91d-079b7f866b46 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:16.622498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3dc11aee-4695-459b-b91d-079b7f866b46 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:16.623198 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3dc11aee-4695-459b-b91d-079b7f866b46 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:16.641642 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8929a8ee-cc98-4485-afe2-2c63766dca2f tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/38bcd3f4-53b3-48c7-89aa-0da27be04f45" status: 202 len: 0 microversion: 2.1 time: 0.635558 Jul 19 22:32:16.645445 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 812/1620] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:32:16 2022] DELETE /compute/v2.1/os-security-groups/38bcd3f4-53b3-48c7-89aa-0da27be04f45 => generated 0 bytes in 640 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:32:16.651720 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-4f84aa13-c22b-496f-9d4b-e709b04b4914 req-4c584a03-c7d7-4e3f-9f49-6eeca1c80400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613", "name": "network-vif-plugged", "status": "completed", "tag": "8551ae32-70fe-4a9f-920b-2e4c5b49340d"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:16.674336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-4f84aa13-c22b-496f-9d4b-e709b04b4914 req-4c584a03-c7d7-4e3f-9f49-6eeca1c80400 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:16.674846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-4f84aa13-c22b-496f-9d4b-e709b04b4914 req-4c584a03-c7d7-4e3f-9f49-6eeca1c80400 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:16.702664 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-4f84aa13-c22b-496f-9d4b-e709b04b4914 req-4c584a03-c7d7-4e3f-9f49-6eeca1c80400 service nova] Creating event network-vif-plugged:8551ae32-70fe-4a9f-920b-2e4c5b49340d for instance 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 on n-h2-847009-3 Jul 19 22:32:16.713006 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-4f84aa13-c22b-496f-9d4b-e709b04b4914 req-4c584a03-c7d7-4e3f-9f49-6eeca1c80400 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066165 Jul 19 22:32:16.716694 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 813/1621] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:16.724120 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0c591465-e073-426d-95a7-3e9dad8af665 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:16.732947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0c591465-e073-426d-95a7-3e9dad8af665 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:16.746699 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c591465-e073-426d-95a7-3e9dad8af665 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:16.749454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c591465-e073-426d-95a7-3e9dad8af665 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:16.750381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c591465-e073-426d-95a7-3e9dad8af665 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:16.750902 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c591465-e073-426d-95a7-3e9dad8af665 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:17.269152 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3dc11aee-4695-459b-b91d-079b7f866b46 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:17.282820 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3dc11aee-4695-459b-b91d-079b7f866b46 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:17.285709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3dc11aee-4695-459b-b91d-079b7f866b46 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:17.288492 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3dc11aee-4695-459b-b91d-079b7f866b46 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 0.690117 Jul 19 22:32:17.289938 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 809/1622] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:16 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:17.297482 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e3c898eb-13c6-4f25-998a-d9bf14a6cacb tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:17.298845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e3c898eb-13c6-4f25-998a-d9bf14a6cacb tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:17.308721 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3c898eb-13c6-4f25-998a-d9bf14a6cacb tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:17.309806 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3c898eb-13c6-4f25-998a-d9bf14a6cacb tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:17.312307 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3c898eb-13c6-4f25-998a-d9bf14a6cacb tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:17.313008 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3c898eb-13c6-4f25-998a-d9bf14a6cacb tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:17.358440 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0c591465-e073-426d-95a7-3e9dad8af665 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:17.372163 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0c591465-e073-426d-95a7-3e9dad8af665 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1479 microversion: 2.1 time: 0.653951 Jul 19 22:32:17.383318 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 814/1623] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:16 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1479 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:17.401908 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4db08d86-d461-4e6e-9330-240fb88ca129 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Calling method '.version_select at 0x7f7a103f4040>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:17.448373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e3c898eb-13c6-4f25-998a-d9bf14a6cacb tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:17.459857 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e3c898eb-13c6-4f25-998a-d9bf14a6cacb tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:17.463134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e3c898eb-13c6-4f25-998a-d9bf14a6cacb tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:17.471748 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e3c898eb-13c6-4f25-998a-d9bf14a6cacb tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1447 microversion: 2.75 time: 0.180277 Jul 19 22:32:17.473515 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 810/1624] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:17 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1447 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:18.310473 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-377b465c-a7c1-436b-95e0-5c07325447da tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:18.311271 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-377b465c-a7c1-436b-95e0-5c07325447da tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:18.332981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-377b465c-a7c1-436b-95e0-5c07325447da tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:18.333443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-377b465c-a7c1-436b-95e0-5c07325447da tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:18.341880 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-377b465c-a7c1-436b-95e0-5c07325447da tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:18.347882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-377b465c-a7c1-436b-95e0-5c07325447da tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:18.477041 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4db08d86-d461-4e6e-9330-240fb88ca129 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/f74badc3-e9af-4def-8d7d-689c0199b6d7" status: 202 len: 0 microversion: 2.1 time: 1.091861 Jul 19 22:32:18.477824 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 815/1625] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:32:17 2022] DELETE /compute/v2.1/os-security-groups/f74badc3-e9af-4def-8d7d-689c0199b6d7 => generated 0 bytes in 1094 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:32:18.486889 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f067b8c1-7195-4ec8-8573-d8ee3b17cc0a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:18.487675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f067b8c1-7195-4ec8-8573-d8ee3b17cc0a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:18.504730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f067b8c1-7195-4ec8-8573-d8ee3b17cc0a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:18.505225 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f067b8c1-7195-4ec8-8573-d8ee3b17cc0a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:18.507289 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f067b8c1-7195-4ec8-8573-d8ee3b17cc0a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:18.508952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f067b8c1-7195-4ec8-8573-d8ee3b17cc0a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:19.075877 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-377b465c-a7c1-436b-95e0-5c07325447da tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:19.094739 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-377b465c-a7c1-436b-95e0-5c07325447da tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:19.096237 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-377b465c-a7c1-436b-95e0-5c07325447da tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:19.108106 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-377b465c-a7c1-436b-95e0-5c07325447da tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 0.801721 Jul 19 22:32:19.111193 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:32:19.118259 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 811/1626] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:18 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:32:19.131642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ee5b7826-f1ec-40b3-a3cf-8b65b2f8364c tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Calling method '.version_select at 0x7f7a03efb160>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:19.193757 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f067b8c1-7195-4ec8-8573-d8ee3b17cc0a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:19.209926 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f067b8c1-7195-4ec8-8573-d8ee3b17cc0a tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1479 microversion: 2.1 time: 0.729330 Jul 19 22:32:19.220396 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 816/1627] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:18 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1479 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:19.226596 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-75aa9476-f34d-404a-a1d4-32777de954ed tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:19.242499 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-75aa9476-f34d-404a-a1d4-32777de954ed tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:19.259805 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75aa9476-f34d-404a-a1d4-32777de954ed tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:19.260924 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75aa9476-f34d-404a-a1d4-32777de954ed tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:19.264454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75aa9476-f34d-404a-a1d4-32777de954ed tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:19.267031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75aa9476-f34d-404a-a1d4-32777de954ed tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:19.411080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-75aa9476-f34d-404a-a1d4-32777de954ed tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:19.429092 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-75aa9476-f34d-404a-a1d4-32777de954ed tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:19.431686 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-75aa9476-f34d-404a-a1d4-32777de954ed tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:19.447399 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-75aa9476-f34d-404a-a1d4-32777de954ed tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1447 microversion: 2.75 time: 0.225772 Jul 19 22:32:19.448438 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 817/1628] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:19 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1447 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:19.463490 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-d35ad003-dc81-4715-ba99-fb66abd6fe1f req-6a062a25-4724-4d15-a41f-720dc1319cfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d871dc5-0189-41e2-8650-8f753bf98c67", "name": "network-vif-unplugged", "status": "completed", "tag": "76972dec-38be-463e-8f2e-775f0e49be0a"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:19.486557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d35ad003-dc81-4715-ba99-fb66abd6fe1f req-6a062a25-4724-4d15-a41f-720dc1319cfa service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:19.487280 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d35ad003-dc81-4715-ba99-fb66abd6fe1f req-6a062a25-4724-4d15-a41f-720dc1319cfa service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:19.506524 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-d35ad003-dc81-4715-ba99-fb66abd6fe1f req-6a062a25-4724-4d15-a41f-720dc1319cfa service nova] Creating event network-vif-unplugged:76972dec-38be-463e-8f2e-775f0e49be0a for instance 5d871dc5-0189-41e2-8650-8f753bf98c67 on n-h2-847009-3 Jul 19 22:32:19.518770 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-d35ad003-dc81-4715-ba99-fb66abd6fe1f req-6a062a25-4724-4d15-a41f-720dc1319cfa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068830 Jul 19 22:32:19.520764 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 818/1629] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:19.864615 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ee5b7826-f1ec-40b3-a3cf-8b65b2f8364c tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/f436d83e-068b-4e3c-a456-27b3ef67f110" status: 202 len: 0 microversion: 2.1 time: 0.745087 Jul 19 22:32:19.869022 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 812/1630] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:32:19 2022] DELETE /compute/v2.1/os-security-groups/f436d83e-068b-4e3c-a456-27b3ef67f110 => generated 0 bytes in 747 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:32:19.876288 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-51e71d8c-58c4-4bf6-b104-a726bf478c80 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Calling method '.version_select at 0x7f7a109419d0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:20.126085 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-337bec8d-1dac-4055-ab73-6c7c71362c16 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:20.127018 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-337bec8d-1dac-4055-ab73-6c7c71362c16 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:20.138232 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-337bec8d-1dac-4055-ab73-6c7c71362c16 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:20.141457 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-337bec8d-1dac-4055-ab73-6c7c71362c16 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:20.142573 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-337bec8d-1dac-4055-ab73-6c7c71362c16 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:20.144599 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-337bec8d-1dac-4055-ab73-6c7c71362c16 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:20.232116 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=8 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:32:20.376552 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-51e71d8c-58c4-4bf6-b104-a726bf478c80 tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/bde998fc-7b9f-4f1a-8aaf-20a3018cc6f5" status: 202 len: 0 microversion: 2.1 time: 0.504611 Jul 19 22:32:20.377219 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 819/1631] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:32:19 2022] DELETE /compute/v2.1/os-security-groups/bde998fc-7b9f-4f1a-8aaf-20a3018cc6f5 => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:32:20.381849 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7652468c-9d3e-4d72-a4eb-40434e773599 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:20.383339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7652468c-9d3e-4d72-a4eb-40434e773599 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:20.413108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7652468c-9d3e-4d72-a4eb-40434e773599 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:20.424513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7652468c-9d3e-4d72-a4eb-40434e773599 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:20.425728 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7652468c-9d3e-4d72-a4eb-40434e773599 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:20.428865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7652468c-9d3e-4d72-a4eb-40434e773599 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:20.486705 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-337bec8d-1dac-4055-ab73-6c7c71362c16 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:20.500664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-337bec8d-1dac-4055-ab73-6c7c71362c16 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:20.502909 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-337bec8d-1dac-4055-ab73-6c7c71362c16 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:20.504516 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-337bec8d-1dac-4055-ab73-6c7c71362c16 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 0.382580 Jul 19 22:32:20.517195 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 813/1632] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:20 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:32:20.522557 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dc3d0d8d-f6cd-477c-bb26-f5eee0da9c2e tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] Calling method '.version_select at 0x7f7a03e883a0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:20.705651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7652468c-9d3e-4d72-a4eb-40434e773599 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:20.719564 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7652468c-9d3e-4d72-a4eb-40434e773599 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1464 microversion: 2.1 time: 0.341021 Jul 19 22:32:20.731712 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 820/1633] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:20 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1464 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:20.735675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-58bdc18e-4dfd-4acf-b1e5-b01bfa833671 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:20.736450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-58bdc18e-4dfd-4acf-b1e5-b01bfa833671 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:20.748389 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58bdc18e-4dfd-4acf-b1e5-b01bfa833671 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:20.759932 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58bdc18e-4dfd-4acf-b1e5-b01bfa833671 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:20.763892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58bdc18e-4dfd-4acf-b1e5-b01bfa833671 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:20.764405 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58bdc18e-4dfd-4acf-b1e5-b01bfa833671 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:20.898722 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-58bdc18e-4dfd-4acf-b1e5-b01bfa833671 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:20.917535 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-58bdc18e-4dfd-4acf-b1e5-b01bfa833671 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:20.925162 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dc3d0d8d-f6cd-477c-bb26-f5eee0da9c2e tempest-SecurityGroupRulesNegativeTestJSON-151170730 tempest-SecurityGroupRulesNegativeTestJSON-151170730-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/aedfec83-1301-4d0a-a43e-ba25f9e8109e" status: 202 len: 0 microversion: 2.1 time: 0.406375 Jul 19 22:32:20.927224 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 814/1634] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:32:20 2022] DELETE /compute/v2.1/os-security-groups/aedfec83-1301-4d0a-a43e-ba25f9e8109e => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:32:20.934499 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-90a40324-762a-4ed2-9e68-8063bfeb7042 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:20.936315 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-58bdc18e-4dfd-4acf-b1e5-b01bfa833671 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:20.939093 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-90a40324-762a-4ed2-9e68-8063bfeb7042 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:20.954186 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-58bdc18e-4dfd-4acf-b1e5-b01bfa833671 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1447 microversion: 2.75 time: 0.225288 Jul 19 22:32:20.957032 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 821/1635] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:20 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1447 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:20.958077 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-90a40324-762a-4ed2-9e68-8063bfeb7042 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:20.959124 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-90a40324-762a-4ed2-9e68-8063bfeb7042 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:20.960638 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-90a40324-762a-4ed2-9e68-8063bfeb7042 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:20.961407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-90a40324-762a-4ed2-9e68-8063bfeb7042 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:21.136733 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-90a40324-762a-4ed2-9e68-8063bfeb7042 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613/action" status: 202 len: 0 microversion: 2.1 time: 0.207534 Jul 19 22:32:21.148397 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-73bbb7ec-5911-400b-808c-25e0c3a5fe16 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:21.149407 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-73bbb7ec-5911-400b-808c-25e0c3a5fe16 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:21.162232 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 815/1636] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:32:20 2022] POST /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:32:21.167769 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-73bbb7ec-5911-400b-808c-25e0c3a5fe16 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:21.171820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-73bbb7ec-5911-400b-808c-25e0c3a5fe16 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:21.172687 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-73bbb7ec-5911-400b-808c-25e0c3a5fe16 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:21.173138 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-73bbb7ec-5911-400b-808c-25e0c3a5fe16 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:21.247537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-73bbb7ec-5911-400b-808c-25e0c3a5fe16 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:21.248019 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-73bbb7ec-5911-400b-808c-25e0c3a5fe16 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:21.248690 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-73bbb7ec-5911-400b-808c-25e0c3a5fe16 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lazy-loading 'fault' on Instance uuid 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:32:21.523834 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-27c8a9e1-e0ea-4a40-927b-0072e47b48b6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:21.524842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-27c8a9e1-e0ea-4a40-927b-0072e47b48b6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:21.536988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-27c8a9e1-e0ea-4a40-927b-0072e47b48b6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:21.542748 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-27c8a9e1-e0ea-4a40-927b-0072e47b48b6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:21.543844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-27c8a9e1-e0ea-4a40-927b-0072e47b48b6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:21.544487 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-27c8a9e1-e0ea-4a40-927b-0072e47b48b6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:21.832912 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-73bbb7ec-5911-400b-808c-25e0c3a5fe16 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1598 microversion: 2.1 time: 0.690889 Jul 19 22:32:21.837123 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 822/1637] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:21 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1598 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:21.855210 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5da925e4-8342-46bb-b49d-4d16c8cbe324 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:21.856513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5da925e4-8342-46bb-b49d-4d16c8cbe324 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:21.866584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5da925e4-8342-46bb-b49d-4d16c8cbe324 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:21.868380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5da925e4-8342-46bb-b49d-4d16c8cbe324 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:21.869197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5da925e4-8342-46bb-b49d-4d16c8cbe324 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:21.869641 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5da925e4-8342-46bb-b49d-4d16c8cbe324 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:22.045151 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5da925e4-8342-46bb-b49d-4d16c8cbe324 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613/action" status: 202 len: 0 microversion: 2.1 time: 0.195315 Jul 19 22:32:22.046747 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 823/1638] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:32:21 2022] POST /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:32:22.054318 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cc5204c2-cd0b-4a45-be95-ba3caa3f5caa tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:22.055832 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cc5204c2-cd0b-4a45-be95-ba3caa3f5caa tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:22.065586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc5204c2-cd0b-4a45-be95-ba3caa3f5caa tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:22.066376 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc5204c2-cd0b-4a45-be95-ba3caa3f5caa tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:22.067541 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc5204c2-cd0b-4a45-be95-ba3caa3f5caa tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:22.068209 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc5204c2-cd0b-4a45-be95-ba3caa3f5caa tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:22.417670 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cc5204c2-cd0b-4a45-be95-ba3caa3f5caa tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:22.461942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cc5204c2-cd0b-4a45-be95-ba3caa3f5caa tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:22.464425 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cc5204c2-cd0b-4a45-be95-ba3caa3f5caa tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:22.485276 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cc5204c2-cd0b-4a45-be95-ba3caa3f5caa tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1447 microversion: 2.75 time: 0.436738 Jul 19 22:32:22.490415 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 824/1639] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:22 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1447 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:22.498691 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ad2de4fe-e564-44b0-ad48-ca8dca095c77 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:22.508811 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ad2de4fe-e564-44b0-ad48-ca8dca095c77 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:22.546325 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad2de4fe-e564-44b0-ad48-ca8dca095c77 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:22.547936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad2de4fe-e564-44b0-ad48-ca8dca095c77 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:22.549638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad2de4fe-e564-44b0-ad48-ca8dca095c77 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:22.550326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad2de4fe-e564-44b0-ad48-ca8dca095c77 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:22.836924 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-27c8a9e1-e0ea-4a40-927b-0072e47b48b6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:22.855687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-27c8a9e1-e0ea-4a40-927b-0072e47b48b6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:22.857775 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-27c8a9e1-e0ea-4a40-927b-0072e47b48b6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:22.871423 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-27c8a9e1-e0ea-4a40-927b-0072e47b48b6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 1.340075 Jul 19 22:32:22.872980 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 816/1640] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:21 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:23.213892 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ad2de4fe-e564-44b0-ad48-ca8dca095c77 tempest-ServersAdminTestJSON-1739703331 tempest-ServersAdminTestJSON-1739703331-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1615 microversion: 2.1 time: 0.720385 Jul 19 22:32:23.215125 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 825/1641] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:22 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1615 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:23.242238 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e92db297-7d6c-41df-8b53-e2ed591f70af tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:23.248436 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e92db297-7d6c-41df-8b53-e2ed591f70af tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: ab10a036-a8b3-44c0-a0c8-4adc2002adff] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:23.265015 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e92db297-7d6c-41df-8b53-e2ed591f70af tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:23.265479 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e92db297-7d6c-41df-8b53-e2ed591f70af tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:23.270745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e92db297-7d6c-41df-8b53-e2ed591f70af tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:23.273467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e92db297-7d6c-41df-8b53-e2ed591f70af tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:23.349600 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e92db297-7d6c-41df-8b53-e2ed591f70af tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: ab10a036-a8b3-44c0-a0c8-4adc2002adff] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:32:23.513018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f9a19030-9ed3-4b27-b243-a3c403772cf2 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:23.513534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f9a19030-9ed3-4b27-b243-a3c403772cf2 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:23.515520 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:32:23.523224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9a19030-9ed3-4b27-b243-a3c403772cf2 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:23.523685 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9a19030-9ed3-4b27-b243-a3c403772cf2 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:23.534438 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9a19030-9ed3-4b27-b243-a3c403772cf2 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:23.536368 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9a19030-9ed3-4b27-b243-a3c403772cf2 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:23.563732 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e92db297-7d6c-41df-8b53-e2ed591f70af tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff" status: 204 len: 0 microversion: 2.1 time: 0.334711 Jul 19 22:32:23.572334 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 817/1642] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:32:23 2022] DELETE /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:32:23.580700 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5a33e2f6-c566-43ff-b03c-6edda6de07aa tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:23.581975 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5a33e2f6-c566-43ff-b03c-6edda6de07aa tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: ab10a036-a8b3-44c0-a0c8-4adc2002adff] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:23.599825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a33e2f6-c566-43ff-b03c-6edda6de07aa tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:23.600289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a33e2f6-c566-43ff-b03c-6edda6de07aa tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:23.601130 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a33e2f6-c566-43ff-b03c-6edda6de07aa tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:23.601580 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a33e2f6-c566-43ff-b03c-6edda6de07aa tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:23.624962 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:32:23.766770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f9a19030-9ed3-4b27-b243-a3c403772cf2 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:23.783719 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f9a19030-9ed3-4b27-b243-a3c403772cf2 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:23.792090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f9a19030-9ed3-4b27-b243-a3c403772cf2 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:23.893458 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f9a19030-9ed3-4b27-b243-a3c403772cf2 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1447 microversion: 2.75 time: 0.384316 Jul 19 22:32:23.911040 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 826/1643] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:23 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1447 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:32:23.922090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-927c06f3-fdef-4c67-b755-53585f935ed6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:23.926080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-927c06f3-fdef-4c67-b755-53585f935ed6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:23.952296 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-927c06f3-fdef-4c67-b755-53585f935ed6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:23.953877 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-927c06f3-fdef-4c67-b755-53585f935ed6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:23.954939 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-927c06f3-fdef-4c67-b755-53585f935ed6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:23.955641 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-927c06f3-fdef-4c67-b755-53585f935ed6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:25.672339 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5a33e2f6-c566-43ff-b03c-6edda6de07aa tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:25.684638 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5a33e2f6-c566-43ff-b03c-6edda6de07aa tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff" status: 200 len: 1470 microversion: 2.1 time: 2.107981 Jul 19 22:32:25.688313 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 818/1644] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:23 2022] GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff => generated 1470 bytes in 2113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:32:25.696707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-faed48a2-51f3-47a0-9654-896ca925b01f tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:25.715129 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-faed48a2-51f3-47a0-9654-896ca925b01f tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:25.722027 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-faed48a2-51f3-47a0-9654-896ca925b01f tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:25.723250 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-faed48a2-51f3-47a0-9654-896ca925b01f tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:25.733655 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-faed48a2-51f3-47a0-9654-896ca925b01f tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:25.734511 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-faed48a2-51f3-47a0-9654-896ca925b01f tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:25.752166 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-927c06f3-fdef-4c67-b755-53585f935ed6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:25.777915 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-927c06f3-fdef-4c67-b755-53585f935ed6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:25.791779 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-927c06f3-fdef-4c67-b755-53585f935ed6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:25.793250 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-927c06f3-fdef-4c67-b755-53585f935ed6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 1.880711 Jul 19 22:32:25.794183 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 827/1645] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:23 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 1882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:25.813035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e604599a-a5ec-4203-a7cc-41498ca9171f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-789046876", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "f8e64135-274c-4e94-95ba-a2d0adec94fe"}], "block_device_mapping_v2": [{"uuid": "d8f9d5bd-1749-4b00-a35d-de42e5f7cfdb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:25.911485 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-faed48a2-51f3-47a0-9654-896ca925b01f tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:25.920924 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-e604599a-a5ec-4203-a7cc-41498ca9171f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] validate_networks() for [('f8e64135-274c-4e94-95ba-a2d0adec94fe', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:32:25.935895 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-faed48a2-51f3-47a0-9654-896ca925b01f tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:25.944892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-faed48a2-51f3-47a0-9654-896ca925b01f tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:25.957804 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-faed48a2-51f3-47a0-9654-896ca925b01f tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1447 microversion: 2.75 time: 0.266930 Jul 19 22:32:25.968271 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 819/1646] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:25 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1447 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:26.559233 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-70a80a24-bd34-49c3-92d0-4e4586108425 req-14afda43-4206-41be-a2a6-f0bf84eef9ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab10a036-a8b3-44c0-a0c8-4adc2002adff", "name": "network-vif-deleted", "tag": "77a3a43b-8e3e-4477-8abe-6e3d58a24309"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:26.585605 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-70a80a24-bd34-49c3-92d0-4e4586108425 req-14afda43-4206-41be-a2a6-f0bf84eef9ab service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:26.586490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-70a80a24-bd34-49c3-92d0-4e4586108425 req-14afda43-4206-41be-a2a6-f0bf84eef9ab service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:26.603239 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-70a80a24-bd34-49c3-92d0-4e4586108425 req-14afda43-4206-41be-a2a6-f0bf84eef9ab service nova] Creating event network-vif-deleted:77a3a43b-8e3e-4477-8abe-6e3d58a24309 for instance ab10a036-a8b3-44c0-a0c8-4adc2002adff on n-h2-847009-3 Jul 19 22:32:26.612241 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-70a80a24-bd34-49c3-92d0-4e4586108425 req-14afda43-4206-41be-a2a6-f0bf84eef9ab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055079 Jul 19 22:32:26.619179 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 820/1647] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:26.710866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f16c0ffc-f65f-410a-bf94-7083765e62c6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:26.712424 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f16c0ffc-f65f-410a-bf94-7083765e62c6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: ab10a036-a8b3-44c0-a0c8-4adc2002adff] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:26.721225 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f16c0ffc-f65f-410a-bf94-7083765e62c6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:26.721950 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f16c0ffc-f65f-410a-bf94-7083765e62c6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:26.722915 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f16c0ffc-f65f-410a-bf94-7083765e62c6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:26.723781 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f16c0ffc-f65f-410a-bf94-7083765e62c6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:26.763082 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f16c0ffc-f65f-410a-bf94-7083765e62c6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:26.763673 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f16c0ffc-f65f-410a-bf94-7083765e62c6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:26.764202 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-f16c0ffc-f65f-410a-bf94-7083765e62c6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lazy-loading 'fault' on Instance uuid ab10a036-a8b3-44c0-a0c8-4adc2002adff {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:32:26.852844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f16c0ffc-f65f-410a-bf94-7083765e62c6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:26.864949 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f16c0ffc-f65f-410a-bf94-7083765e62c6 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff" status: 200 len: 1304 microversion: 2.1 time: 0.158879 Jul 19 22:32:26.867528 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 821/1648] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:26 2022] GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff => generated 1304 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:32:26.874463 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c0788326-67b0-4096-a520-1750a0d90762 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:26.875646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c0788326-67b0-4096-a520-1750a0d90762 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:26.888924 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c0788326-67b0-4096-a520-1750a0d90762 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:26.889675 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c0788326-67b0-4096-a520-1750a0d90762 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:26.890882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c0788326-67b0-4096-a520-1750a0d90762 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:26.891553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c0788326-67b0-4096-a520-1750a0d90762 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:27.643395 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c0788326-67b0-4096-a520-1750a0d90762 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:27.653906 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c0788326-67b0-4096-a520-1750a0d90762 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:27.655703 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c0788326-67b0-4096-a520-1750a0d90762 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:27.657142 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c0788326-67b0-4096-a520-1750a0d90762 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 0.788278 Jul 19 22:32:27.657859 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 822/1649] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:26 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:27.665803 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f500ca18-17a7-46c2-96d4-8e48ae8ce5d4 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:27.666829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f500ca18-17a7-46c2-96d4-8e48ae8ce5d4 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:27.681847 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f500ca18-17a7-46c2-96d4-8e48ae8ce5d4 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:27.682317 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f500ca18-17a7-46c2-96d4-8e48ae8ce5d4 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:27.683148 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f500ca18-17a7-46c2-96d4-8e48ae8ce5d4 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:27.683573 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f500ca18-17a7-46c2-96d4-8e48ae8ce5d4 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:28.156715 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f500ca18-17a7-46c2-96d4-8e48ae8ce5d4 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:28.165984 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f500ca18-17a7-46c2-96d4-8e48ae8ce5d4 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:28.167879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f500ca18-17a7-46c2-96d4-8e48ae8ce5d4 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:28.173163 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f500ca18-17a7-46c2-96d4-8e48ae8ce5d4 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1447 microversion: 2.75 time: 0.514043 Jul 19 22:32:28.173954 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 823/1650] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:27 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1447 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:28.184406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e79162f9-89be-480d-9bd4-26918ce4b8fd tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:28.185122 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e79162f9-89be-480d-9bd4-26918ce4b8fd tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: ab10a036-a8b3-44c0-a0c8-4adc2002adff] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:28.191522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e79162f9-89be-480d-9bd4-26918ce4b8fd tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:28.192057 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e79162f9-89be-480d-9bd4-26918ce4b8fd tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:28.192911 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e79162f9-89be-480d-9bd4-26918ce4b8fd tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:28.193355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e79162f9-89be-480d-9bd4-26918ce4b8fd tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:28.207761 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-e79162f9-89be-480d-9bd4-26918ce4b8fd tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] HTTP exception thrown: Instance ab10a036-a8b3-44c0-a0c8-4adc2002adff could not be found. Jul 19 22:32:28.209704 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e79162f9-89be-480d-9bd4-26918ce4b8fd tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Request method failure captured: Jul 19 22:32:28.209704 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff HTTP/1.1 Jul 19 22:32:28.209704 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:32:28.209704 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:32:28.209704 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:32:28.209704 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:32:28.209704 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:32:28.209704 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:32:28.209704 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:32:28.209704 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:28.209704 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zA0OsaGoXD87AIzz7SPn5-GNHM9nnQghSoW5_zo3uFFDyb_j_cqk5ifZn6i8oyiPJZN0Sk2EHnF7aFC_Y22MNDdGdHkuy2umKxpdI1ldpSvlcxS2q2m1Ssx8LSeRCsVfnbMGeWxaUFtey34vrS1764XeVlUB7EvtNQWoBhy7RiKfzk Jul 19 22:32:28.209704 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:32:28.209704 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:32:28.209704 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:32:28.209704 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:32:28.209704 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:32:28.209704 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:32:28.209704 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 512cc31b5f6546eeb04486cd5213e441 Jul 19 22:32:28.209704 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersAdminTestJSON-1016439079 Jul 19 22:32:28.209704 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:32:28.209704 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:32:28.213312 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_512cc31b5f6546eeb04486cd5213e441"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/512cc31b5f6546eeb04486cd5213e441"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/512cc31b5f6546eeb04486cd5213e441"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/512cc31b5f6546eeb04486cd5213e441"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:28.213312 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersAdminTestJSON-1016439079 Jul 19 22:32:28.213312 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 512cc31b5f6546eeb04486cd5213e441 Jul 19 22:32:28.213312 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersAdminTestJSON-1016439079 Jul 19 22:32:28.213312 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersAdminTestJSON-1016439079-project Jul 19 22:32:28.213312 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:32:28.213312 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:32:28.213312 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 4781dbc875d24dc490e598b41905a542 Jul 19 22:32:28.213312 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersAdminTestJSON-1016439079-project Jul 19 22:32:28.213312 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:32:28.213312 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance ab10a036-a8b3-44c0-a0c8-4adc2002adff could not be found. Jul 19 22:32:28.213312 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'ab10a036-a8b3-44c0-a0c8-4adc2002adff'} Jul 19 22:32:28.214519 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:28.214519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:28.214519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:32:28.214519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:32:28.214519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:32:28.214519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:32:28.214519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:32:28.214519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:32:28.214519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:32:28.214519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:32:28.214519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab10a036-a8b3-44c0-a0c8-4adc2002adff could not be found. Jul 19 22:32:28.214519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:28.214519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:28.214519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:28.214519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:28.214519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:28.214519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:28.214519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:28.214519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:28.214519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:28.217016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:28.217016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:32:28.217016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:32:28.217016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:32:28.217016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:32:28.217016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:32:28.217016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:32:28.217016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab10a036-a8b3-44c0-a0c8-4adc2002adff could not be found. Jul 19 22:32:28.217016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:28.217016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:28.217016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:28.217016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:28.217016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:28.217016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:28.217016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:28.217016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:28.217016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab10a036-a8b3-44c0-a0c8-4adc2002adff could not be found. Jul 19 22:32:28.217016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:28.218363 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e79162f9-89be-480d-9bd4-26918ce4b8fd tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Returning 404 to user: Instance ab10a036-a8b3-44c0-a0c8-4adc2002adff could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:28.218363 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e79162f9-89be-480d-9bd4-26918ce4b8fd tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff" status: 404 len: 111 microversion: 2.1 time: 0.037764 Jul 19 22:32:28.218363 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 824/1651] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:28 2022] GET /compute/v2.1/servers/ab10a036-a8b3-44c0-a0c8-4adc2002adff => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:32:28.223540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-10a5a676-916b-4f67-95c1-4c3954fbd7f7 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:28.224479 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-10a5a676-916b-4f67-95c1-4c3954fbd7f7 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 03987102-e808-4669-a48a-d9cee489c71e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:28.231927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-10a5a676-916b-4f67-95c1-4c3954fbd7f7 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:28.232378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-10a5a676-916b-4f67-95c1-4c3954fbd7f7 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:28.233158 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-10a5a676-916b-4f67-95c1-4c3954fbd7f7 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:28.233596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-10a5a676-916b-4f67-95c1-4c3954fbd7f7 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:28.280819 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-10a5a676-916b-4f67-95c1-4c3954fbd7f7 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 03987102-e808-4669-a48a-d9cee489c71e] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:32:28.395448 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-10a5a676-916b-4f67-95c1-4c3954fbd7f7 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "DELETE /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e" status: 204 len: 0 microversion: 2.1 time: 0.175890 Jul 19 22:32:28.396668 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 825/1652] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:32:28 2022] DELETE /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:32:28.418648 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e759ac1f-e47c-4aa8-ac66-c17fa10d0529 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:28.419623 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e759ac1f-e47c-4aa8-ac66-c17fa10d0529 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 03987102-e808-4669-a48a-d9cee489c71e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:28.433146 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e759ac1f-e47c-4aa8-ac66-c17fa10d0529 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:28.433974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e759ac1f-e47c-4aa8-ac66-c17fa10d0529 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:28.438678 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e759ac1f-e47c-4aa8-ac66-c17fa10d0529 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:28.440148 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e759ac1f-e47c-4aa8-ac66-c17fa10d0529 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:28.508511 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-e604599a-a5ec-4203-a7cc-41498ca9171f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:32:28.509028 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-e604599a-a5ec-4203-a7cc-41498ca9171f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:32:28.509415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-e604599a-a5ec-4203-a7cc-41498ca9171f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:32:28.509836 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-e604599a-a5ec-4203-a7cc-41498ca9171f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:32:28.510258 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-e604599a-a5ec-4203-a7cc-41498ca9171f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:32:28.524493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e604599a-a5ec-4203-a7cc-41498ca9171f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:28.525229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e604599a-a5ec-4203-a7cc-41498ca9171f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:28.526273 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e604599a-a5ec-4203-a7cc-41498ca9171f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:28.527019 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e604599a-a5ec-4203-a7cc-41498ca9171f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:28.549892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-e604599a-a5ec-4203-a7cc-41498ca9171f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Getting quotas for project 2619b807c1ee4dca858dae47c4686ba2. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:32:28.558224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-e604599a-a5ec-4203-a7cc-41498ca9171f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Getting quotas for user 55a214cbc1ec4cdb80ccf736f4251964 and project 2619b807c1ee4dca858dae47c4686ba2. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:32:28.639961 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e604599a-a5ec-4203-a7cc-41498ca9171f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:32:28.641596 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e604599a-a5ec-4203-a7cc-41498ca9171f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d8f9d5bd-1749-4b00-a35d-de42e5f7cfdb',volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:32:28.838690 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e604599a-a5ec-4203-a7cc-41498ca9171f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.043725 Jul 19 22:32:28.839999 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 828/1653] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:32:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:32:28.845475 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f42f0a03-ebe6-43fc-93ae-448df4450cc1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:28.846533 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f42f0a03-ebe6-43fc-93ae-448df4450cc1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:28.853857 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f42f0a03-ebe6-43fc-93ae-448df4450cc1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:28.854584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f42f0a03-ebe6-43fc-93ae-448df4450cc1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:28.855624 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f42f0a03-ebe6-43fc-93ae-448df4450cc1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:28.856394 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f42f0a03-ebe6-43fc-93ae-448df4450cc1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:28.887669 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:32:29.185484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e759ac1f-e47c-4aa8-ac66-c17fa10d0529 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:29.211253 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e759ac1f-e47c-4aa8-ac66-c17fa10d0529 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e" status: 200 len: 1468 microversion: 2.1 time: 0.806984 Jul 19 22:32:29.212627 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 826/1654] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:28 2022] GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e => generated 1468 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:29.220289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4c1d46a0-5070-480f-8681-644b4628bc48 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:29.222833 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4c1d46a0-5070-480f-8681-644b4628bc48 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:29.352906 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4c1d46a0-5070-480f-8681-644b4628bc48 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:29.365505 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4c1d46a0-5070-480f-8681-644b4628bc48 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1052 microversion: 2.1 time: 0.148549 Jul 19 22:32:29.376781 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 827/1655] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:29 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1052 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:29.382401 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-be675bd2-08ff-4049-af6a-08a7e3531934 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:29.383725 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-be675bd2-08ff-4049-af6a-08a7e3531934 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:29.397793 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be675bd2-08ff-4049-af6a-08a7e3531934 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:29.398626 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be675bd2-08ff-4049-af6a-08a7e3531934 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:29.401537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be675bd2-08ff-4049-af6a-08a7e3531934 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:29.402198 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be675bd2-08ff-4049-af6a-08a7e3531934 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:29.403774 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f42f0a03-ebe6-43fc-93ae-448df4450cc1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:29.430039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f42f0a03-ebe6-43fc-93ae-448df4450cc1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:29.434840 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f42f0a03-ebe6-43fc-93ae-448df4450cc1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:29.437362 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f42f0a03-ebe6-43fc-93ae-448df4450cc1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1814 microversion: 2.25 time: 0.595851 Jul 19 22:32:29.438584 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 829/1656] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:28 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1814 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:29.587717 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-be675bd2-08ff-4049-af6a-08a7e3531934 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:29.596526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-be675bd2-08ff-4049-af6a-08a7e3531934 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:29.598205 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-be675bd2-08ff-4049-af6a-08a7e3531934 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:29.603877 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-be675bd2-08ff-4049-af6a-08a7e3531934 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1447 microversion: 2.75 time: 0.225625 Jul 19 22:32:29.604453 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 828/1657] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:29 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1447 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:30.233083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d4e02fde-f316-4372-aba8-ea808106b9da tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:30.234635 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d4e02fde-f316-4372-aba8-ea808106b9da tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 03987102-e808-4669-a48a-d9cee489c71e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:30.276966 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d4e02fde-f316-4372-aba8-ea808106b9da tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:30.277838 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d4e02fde-f316-4372-aba8-ea808106b9da tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:30.279991 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d4e02fde-f316-4372-aba8-ea808106b9da tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:30.281734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d4e02fde-f316-4372-aba8-ea808106b9da tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:30.385322 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fd534fad-06ee-4e64-b994-2e5d89226475 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:30.385939 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fd534fad-06ee-4e64-b994-2e5d89226475 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:30.402794 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd534fad-06ee-4e64-b994-2e5d89226475 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:30.404446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd534fad-06ee-4e64-b994-2e5d89226475 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:30.408388 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd534fad-06ee-4e64-b994-2e5d89226475 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:30.410202 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd534fad-06ee-4e64-b994-2e5d89226475 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:31.086918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fd534fad-06ee-4e64-b994-2e5d89226475 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:31.108099 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fd534fad-06ee-4e64-b994-2e5d89226475 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1150 microversion: 2.1 time: 0.727828 Jul 19 22:32:31.108736 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 829/1658] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:30 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1150 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:32:31.114223 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-68983e92-5c2a-47bd-b2ba-ccc9eb804b6b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:31.115146 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-68983e92-5c2a-47bd-b2ba-ccc9eb804b6b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:31.136103 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-68983e92-5c2a-47bd-b2ba-ccc9eb804b6b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:31.137237 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-68983e92-5c2a-47bd-b2ba-ccc9eb804b6b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:31.138602 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-68983e92-5c2a-47bd-b2ba-ccc9eb804b6b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:31.148873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-68983e92-5c2a-47bd-b2ba-ccc9eb804b6b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:31.277886 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d4e02fde-f316-4372-aba8-ea808106b9da tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:31.299168 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d4e02fde-f316-4372-aba8-ea808106b9da tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e" status: 200 len: 1468 microversion: 2.1 time: 1.070918 Jul 19 22:32:31.311935 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 830/1659] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:30 2022] GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e => generated 1468 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:31.319280 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-91983905-f639-4ba0-92cc-0321639037ad tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:31.323422 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-91983905-f639-4ba0-92cc-0321639037ad tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:31.338094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91983905-f639-4ba0-92cc-0321639037ad tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:31.339436 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91983905-f639-4ba0-92cc-0321639037ad tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:31.340810 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91983905-f639-4ba0-92cc-0321639037ad tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:31.343239 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91983905-f639-4ba0-92cc-0321639037ad tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:31.652808 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-91983905-f639-4ba0-92cc-0321639037ad tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:31.670165 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-91983905-f639-4ba0-92cc-0321639037ad tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:31.671965 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-91983905-f639-4ba0-92cc-0321639037ad tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:31.685872 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-91983905-f639-4ba0-92cc-0321639037ad tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1447 microversion: 2.75 time: 0.372604 Jul 19 22:32:31.696229 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 831/1660] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:31 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1447 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:31.805698 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-68983e92-5c2a-47bd-b2ba-ccc9eb804b6b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:31.822777 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-68983e92-5c2a-47bd-b2ba-ccc9eb804b6b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:31.825373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-68983e92-5c2a-47bd-b2ba-ccc9eb804b6b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:31.826915 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-68983e92-5c2a-47bd-b2ba-ccc9eb804b6b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1804 microversion: 2.25 time: 0.717036 Jul 19 22:32:31.828146 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 830/1661] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:31 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1804 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:31.844924 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3c1b14ec-1e5f-456e-8fa2-d0a05bff1a05 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Calling method '.version_select at 0x7f7a10853040>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:31.847851 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3c1b14ec-1e5f-456e-8fa2-d0a05bff1a05 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:31.848750 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3c1b14ec-1e5f-456e-8fa2-d0a05bff1a05 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:31.862183 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3c1b14ec-1e5f-456e-8fa2-d0a05bff1a05 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 2783 microversion: 2.25 time: 0.020913 Jul 19 22:32:31.873998 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 832/1662] 10.222.0.25 () {60 vars in 1183 bytes} [Tue Jul 19 22:32:31 2022] GET /compute/v2.1/os-migrations => generated 2783 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:32:31.880803 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5d1147c7-da49-4b10-a046-2198c3e830ec tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:31.887685 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5d1147c7-da49-4b10-a046-2198c3e830ec tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:31.906954 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5d1147c7-da49-4b10-a046-2198c3e830ec tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:31.908260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5d1147c7-da49-4b10-a046-2198c3e830ec tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:31.910712 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5d1147c7-da49-4b10-a046-2198c3e830ec tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:31.913052 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5d1147c7-da49-4b10-a046-2198c3e830ec tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:32.131239 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6c9e3966-3abe-4847-988c-f6f32d718409 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:32.138969 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6c9e3966-3abe-4847-988c-f6f32d718409 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:32.228857 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c9e3966-3abe-4847-988c-f6f32d718409 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:32.229674 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c9e3966-3abe-4847-988c-f6f32d718409 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:32.244421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c9e3966-3abe-4847-988c-f6f32d718409 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:32.251091 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c9e3966-3abe-4847-988c-f6f32d718409 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:32.502601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6c9e3966-3abe-4847-988c-f6f32d718409 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:32.514860 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6c9e3966-3abe-4847-988c-f6f32d718409 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1168 microversion: 2.1 time: 0.392202 Jul 19 22:32:32.517194 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 833/1663] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:32 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1168 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:32:32.529509 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-84aca38e-4c0f-4730-a262-5c0a95c6e219 req-f87799ea-9c21-4a37-b69d-f3e2eac20595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03987102-e808-4669-a48a-d9cee489c71e", "name": "network-vif-deleted", "tag": "174e2193-cdeb-4c38-baad-2354f434d257"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:32.552472 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-84aca38e-4c0f-4730-a262-5c0a95c6e219 req-f87799ea-9c21-4a37-b69d-f3e2eac20595 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:32.555010 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-84aca38e-4c0f-4730-a262-5c0a95c6e219 req-f87799ea-9c21-4a37-b69d-f3e2eac20595 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:32.585849 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-84aca38e-4c0f-4730-a262-5c0a95c6e219 req-f87799ea-9c21-4a37-b69d-f3e2eac20595 service nova] Creating event network-vif-deleted:174e2193-cdeb-4c38-baad-2354f434d257 for instance 03987102-e808-4669-a48a-d9cee489c71e on n-h2-847009-3 Jul 19 22:32:32.608297 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-84aca38e-4c0f-4730-a262-5c0a95c6e219 req-f87799ea-9c21-4a37-b69d-f3e2eac20595 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087345 Jul 19 22:32:32.611272 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 834/1664] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:32.620302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-064537cf-8329-4314-966e-e866976b1873 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:32.621720 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-064537cf-8329-4314-966e-e866976b1873 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 03987102-e808-4669-a48a-d9cee489c71e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:32.637780 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-064537cf-8329-4314-966e-e866976b1873 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:32.638392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-064537cf-8329-4314-966e-e866976b1873 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:32.639349 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-064537cf-8329-4314-966e-e866976b1873 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:32.641248 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-064537cf-8329-4314-966e-e866976b1873 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:32.748370 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-064537cf-8329-4314-966e-e866976b1873 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:32.749199 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-064537cf-8329-4314-966e-e866976b1873 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:32.749878 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-064537cf-8329-4314-966e-e866976b1873 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lazy-loading 'fault' on Instance uuid 03987102-e808-4669-a48a-d9cee489c71e {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:32:32.753095 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-5d1147c7-da49-4b10-a046-2198c3e830ec tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lazy-loading 'services' on Instance uuid 5d871dc5-0189-41e2-8650-8f753bf98c67 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:32:32.795783 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5d1147c7-da49-4b10-a046-2198c3e830ec tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 2423 microversion: 2.25 time: 0.919221 Jul 19 22:32:32.798464 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 831/1665] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:31 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 2423 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:32.809355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9d3c55e5-12a1-42a8-9202-1abdf881e073 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:32.816137 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9d3c55e5-12a1-42a8-9202-1abdf881e073 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:32.834759 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d3c55e5-12a1-42a8-9202-1abdf881e073 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:32.841465 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d3c55e5-12a1-42a8-9202-1abdf881e073 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:32.845649 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d3c55e5-12a1-42a8-9202-1abdf881e073 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:32.846310 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d3c55e5-12a1-42a8-9202-1abdf881e073 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:32.874020 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-064537cf-8329-4314-966e-e866976b1873 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:32.889469 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-064537cf-8329-4314-966e-e866976b1873 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e" status: 200 len: 1303 microversion: 2.1 time: 0.272430 Jul 19 22:32:32.901552 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 835/1666] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:32 2022] GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e => generated 1303 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:33.110695 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9d3c55e5-12a1-42a8-9202-1abdf881e073 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:33.127252 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9d3c55e5-12a1-42a8-9202-1abdf881e073 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:33.129607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9d3c55e5-12a1-42a8-9202-1abdf881e073 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:33.146097 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9d3c55e5-12a1-42a8-9202-1abdf881e073 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1447 microversion: 2.75 time: 0.346237 Jul 19 22:32:33.147283 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 832/1667] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:32 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1447 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:33.162563 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3af5db25-b83c-465c-820f-e880d33b81c3 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:33.163494 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3af5db25-b83c-465c-820f-e880d33b81c3 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:33.177907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3af5db25-b83c-465c-820f-e880d33b81c3 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:33.178389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3af5db25-b83c-465c-820f-e880d33b81c3 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:33.179312 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3af5db25-b83c-465c-820f-e880d33b81c3 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:33.179993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3af5db25-b83c-465c-820f-e880d33b81c3 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:33.297238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1faaab39-595c-48b7-8750-b2ba5721bffe tempest-VolumesAdminNegativeTest-1447173879 tempest-VolumesAdminNegativeTest-1447173879-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "c7ff3e88-1e6c-4d92-911a-95771561eb2c"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:33.298595 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1faaab39-595c-48b7-8750-b2ba5721bffe tempest-VolumesAdminNegativeTest-1447173879 tempest-VolumesAdminNegativeTest-1447173879-project-admin] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:33.311093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1faaab39-595c-48b7-8750-b2ba5721bffe tempest-VolumesAdminNegativeTest-1447173879 tempest-VolumesAdminNegativeTest-1447173879-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:33.311882 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1faaab39-595c-48b7-8750-b2ba5721bffe tempest-VolumesAdminNegativeTest-1447173879 tempest-VolumesAdminNegativeTest-1447173879-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:33.312978 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1faaab39-595c-48b7-8750-b2ba5721bffe tempest-VolumesAdminNegativeTest-1447173879 tempest-VolumesAdminNegativeTest-1447173879-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:33.314023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1faaab39-595c-48b7-8750-b2ba5721bffe tempest-VolumesAdminNegativeTest-1447173879 tempest-VolumesAdminNegativeTest-1447173879-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:33.524040 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-1faaab39-595c-48b7-8750-b2ba5721bffe tempest-VolumesAdminNegativeTest-1447173879 tempest-VolumesAdminNegativeTest-1447173879-project-admin] HTTP exception thrown: Volume c7ff3e88-1e6c-4d92-911a-95771561eb2c could not be found. Jul 19 22:32:33.562306 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1faaab39-595c-48b7-8750-b2ba5721bffe tempest-VolumesAdminNegativeTest-1447173879 tempest-VolumesAdminNegativeTest-1447173879-project-admin] Request method failure captured: Jul 19 22:32:33.562306 n-d-847009-3 devstack@n-api.service[119338]: request: PUT /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments/250e070c-0eb5-4823-813b-4bf060f2f27f HTTP/1.1 Jul 19 22:32:33.562306 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:32:33.562306 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:32:33.562306 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:32:33.562306 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 74 Jul 19 22:32:33.562306 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:32:33.562306 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:32:33.562306 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:32:33.562306 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:33.562306 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zCCcLykTW23nVGexflcU3EBiDjxEBh0s2wM34MLi69ggPaGg4IH-cp1HsQKl2Sg9dH9bYM2Fdh1SVj6cCmVbQ4EU0RHO1fPm1Hb2-yZ6YCxD0rAXIc2mX33Z-Xo6pAIueIIBf9Z3-hAWL3oVAR_sEKp6KyxJ-wzPBIcEuYau9NExRI Jul 19 22:32:33.562306 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:32:33.562306 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:32:33.562306 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:32:33.562306 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:32:33.562306 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:32:33.562306 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:32:33.562306 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 53f5362a2fb44d68baca204db799343c Jul 19 22:32:33.562306 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-VolumesAdminNegativeTest-1447173879 Jul 19 22:32:33.562306 n-d-847009-3 devstack@n-api.service[119338]: X-Role: admin,member,reader Jul 19 22:32:33.562306 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: admin,member,reader Jul 19 22:32:33.564180 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_53f5362a2fb44d68baca204db799343c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/53f5362a2fb44d68baca204db799343c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/53f5362a2fb44d68baca204db799343c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/53f5362a2fb44d68baca204db799343c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:33.564180 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-VolumesAdminNegativeTest-1447173879 Jul 19 22:32:33.564180 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 53f5362a2fb44d68baca204db799343c Jul 19 22:32:33.564180 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1447173879 Jul 19 22:32:33.564180 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-VolumesAdminNegativeTest-1447173879-project-admin Jul 19 22:32:33.564180 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:32:33.564180 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:32:33.564180 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: b6cf133be025460891a641f2dedb54e9 Jul 19 22:32:33.564180 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-VolumesAdminNegativeTest-1447173879-project-admin Jul 19 22:32:33.564180 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:32:33.564180 n-d-847009-3 devstack@n-api.service[119338]: {"volumeAttachment": {"volumeId": "c7ff3e88-1e6c-4d92-911a-95771561eb2c"}} Jul 19 22:32:33.564180 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:32:33.564180 n-d-847009-3 devstack@n-api.service[119338]: exception: Volume c7ff3e88-1e6c-4d92-911a-95771561eb2c could not be found. Jul 19 22:32:33.565173 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'server_id': '317af5ae-9759-4095-b561-ed61e9847c7e', 'id': '250e070c-0eb5-4823-813b-4bf060f2f27f', 'body': {'volumeAttachment': {'volumeId': 'c7ff3e88-1e6c-4d92-911a-95771561eb2c'}}} Jul 19 22:32:33.565173 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:33.565173 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:33.565173 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 22:32:33.565173 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 22:32:33.565173 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 22:32:33.565173 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 22:32:33.565173 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 22:32:33.565173 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 22:32:33.565173 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 22:32:33.565173 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 22:32:33.565173 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 22:32:33.565173 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 22:32:33.565173 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 22:32:33.565173 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 22:32:33.565173 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 22:32:33.565173 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 22:32:33.566291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c7ff3e88-1e6c-4d92-911a-95771561eb2c could not be found. (HTTP 404) (Request-ID: req-ad819fee-2174-40fe-8642-42ce301564dc) Jul 19 22:32:33.566291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:33.566291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:33.566291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:33.566291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:33.566291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 19 22:32:33.566291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 19 22:32:33.566291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 22:32:33.566291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 22:32:33.566291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 22:32:33.566291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 22:32:33.566291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 22:32:33.566291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 22:32:33.566291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 22:32:33.566291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 22:32:33.566291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 22:32:33.566291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 22:32:33.566291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 22:32:33.566291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 22:32:33.567568 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 22:32:33.567568 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 22:32:33.567568 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 22:32:33.567568 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 22:32:33.567568 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 22:32:33.567568 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 22:32:33.567568 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 22:32:33.567568 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 22:32:33.567568 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c7ff3e88-1e6c-4d92-911a-95771561eb2c could not be found. Jul 19 22:32:33.567568 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:33.567568 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:33.567568 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:33.567568 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:33.567568 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:33.567568 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:33.567568 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:33.567568 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:33.567568 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:33.567568 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:33.568782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:32:33.568782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:32:33.568782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:32:33.568782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:32:33.568782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 19 22:32:33.568782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 19 22:32:33.568782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 19 22:32:33.568782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 22:32:33.568782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume c7ff3e88-1e6c-4d92-911a-95771561eb2c could not be found. Jul 19 22:32:33.568782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:33.568782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:33.568782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:33.568782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:33.568782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:33.568782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:33.568782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:33.568782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:33.568782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c7ff3e88-1e6c-4d92-911a-95771561eb2c could not be found. Jul 19 22:32:33.568782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:33.572851 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1faaab39-595c-48b7-8750-b2ba5721bffe tempest-VolumesAdminNegativeTest-1447173879 tempest-VolumesAdminNegativeTest-1447173879-project-admin] Returning 400 to user: Volume c7ff3e88-1e6c-4d92-911a-95771561eb2c could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:33.574145 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1faaab39-595c-48b7-8750-b2ba5721bffe tempest-VolumesAdminNegativeTest-1447173879 tempest-VolumesAdminNegativeTest-1447173879-project-admin] 10.222.0.25 "PUT /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments/250e070c-0eb5-4823-813b-4bf060f2f27f" status: 400 len: 107 microversion: 2.1 time: 0.671309 Jul 19 22:32:33.575345 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 836/1668] 10.222.0.25 () {60 vars in 1432 bytes} [Tue Jul 19 22:32:32 2022] PUT /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments/250e070c-0eb5-4823-813b-4bf060f2f27f => generated 107 bytes in 673 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:32:33.581254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6a0dc103-cadf-4b0a-9ae5-a2001ee310d7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:33.582408 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6a0dc103-cadf-4b0a-9ae5-a2001ee310d7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:33.611760 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a0dc103-cadf-4b0a-9ae5-a2001ee310d7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:33.613665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a0dc103-cadf-4b0a-9ae5-a2001ee310d7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:33.615762 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a0dc103-cadf-4b0a-9ae5-a2001ee310d7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:33.617036 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a0dc103-cadf-4b0a-9ae5-a2001ee310d7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:33.870880 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-3af5db25-b83c-465c-820f-e880d33b81c3 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lazy-loading 'services' on Instance uuid 5d871dc5-0189-41e2-8650-8f753bf98c67 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:32:33.899424 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3af5db25-b83c-465c-820f-e880d33b81c3 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 2423 microversion: 2.25 time: 0.748911 Jul 19 22:32:33.900420 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 833/1669] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:33 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 2423 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:33.919842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-51be560b-62ba-4579-943d-83480be66f43 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:33.920586 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-51be560b-62ba-4579-943d-83480be66f43 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:33.936063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51be560b-62ba-4579-943d-83480be66f43 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:33.940309 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51be560b-62ba-4579-943d-83480be66f43 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:33.941429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51be560b-62ba-4579-943d-83480be66f43 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:33.941955 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51be560b-62ba-4579-943d-83480be66f43 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:33.964860 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6a0dc103-cadf-4b0a-9ae5-a2001ee310d7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:33.983668 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6a0dc103-cadf-4b0a-9ae5-a2001ee310d7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1168 microversion: 2.1 time: 0.406627 Jul 19 22:32:33.986260 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 837/1670] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:33 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1168 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:34.005271 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9b38241f-c91c-4e9e-86f2-5612dd9775bd tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:34.006339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9b38241f-c91c-4e9e-86f2-5612dd9775bd tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 03987102-e808-4669-a48a-d9cee489c71e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:34.017454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:32:34.024336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b38241f-c91c-4e9e-86f2-5612dd9775bd tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:34.028215 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b38241f-c91c-4e9e-86f2-5612dd9775bd tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:34.031285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b38241f-c91c-4e9e-86f2-5612dd9775bd tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:34.032080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b38241f-c91c-4e9e-86f2-5612dd9775bd tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:34.056620 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-9b38241f-c91c-4e9e-86f2-5612dd9775bd tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] HTTP exception thrown: Instance 03987102-e808-4669-a48a-d9cee489c71e could not be found. Jul 19 22:32:34.070515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9b38241f-c91c-4e9e-86f2-5612dd9775bd tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Request method failure captured: Jul 19 22:32:34.070515 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e HTTP/1.1 Jul 19 22:32:34.070515 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:32:34.070515 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:32:34.070515 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:32:34.070515 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:32:34.070515 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:32:34.070515 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:32:34.070515 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:32:34.070515 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:34.070515 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zA0OsaGoXD87AIzz7SPn5-GNHM9nnQghSoW5_zo3uFFDyb_j_cqk5ifZn6i8oyiPJZN0Sk2EHnF7aFC_Y22MNDdGdHkuy2umKxpdI1ldpSvlcxS2q2m1Ssx8LSeRCsVfnbMGeWxaUFtey34vrS1764XeVlUB7EvtNQWoBhy7RiKfzk Jul 19 22:32:34.070515 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:32:34.070515 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:32:34.070515 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:32:34.070515 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:32:34.070515 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:32:34.070515 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:32:34.070515 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 512cc31b5f6546eeb04486cd5213e441 Jul 19 22:32:34.070515 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersAdminTestJSON-1016439079 Jul 19 22:32:34.070515 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:32:34.070515 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:32:34.072076 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_512cc31b5f6546eeb04486cd5213e441"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/512cc31b5f6546eeb04486cd5213e441"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/512cc31b5f6546eeb04486cd5213e441"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/512cc31b5f6546eeb04486cd5213e441"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:34.072076 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersAdminTestJSON-1016439079 Jul 19 22:32:34.072076 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 512cc31b5f6546eeb04486cd5213e441 Jul 19 22:32:34.072076 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersAdminTestJSON-1016439079 Jul 19 22:32:34.072076 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersAdminTestJSON-1016439079-project Jul 19 22:32:34.072076 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:32:34.072076 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:32:34.072076 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 4781dbc875d24dc490e598b41905a542 Jul 19 22:32:34.072076 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersAdminTestJSON-1016439079-project Jul 19 22:32:34.072076 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:32:34.072076 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 03987102-e808-4669-a48a-d9cee489c71e could not be found. Jul 19 22:32:34.072076 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '03987102-e808-4669-a48a-d9cee489c71e'} Jul 19 22:32:34.072899 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:34.072899 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:34.072899 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:32:34.072899 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:32:34.072899 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:32:34.072899 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:32:34.072899 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:32:34.072899 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:32:34.072899 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:32:34.072899 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:32:34.072899 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03987102-e808-4669-a48a-d9cee489c71e could not be found. Jul 19 22:32:34.072899 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:34.072899 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:34.072899 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:34.072899 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:34.072899 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:34.072899 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:34.072899 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:34.072899 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:34.072899 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:34.074231 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:34.074231 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:32:34.074231 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:32:34.074231 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:32:34.074231 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:32:34.074231 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:32:34.074231 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:32:34.074231 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03987102-e808-4669-a48a-d9cee489c71e could not be found. Jul 19 22:32:34.074231 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:34.074231 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:34.074231 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:34.074231 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:34.074231 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:34.074231 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:34.074231 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:34.074231 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:34.074231 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03987102-e808-4669-a48a-d9cee489c71e could not be found. Jul 19 22:32:34.074231 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:32:34.076898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9b38241f-c91c-4e9e-86f2-5612dd9775bd tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Returning 404 to user: Instance 03987102-e808-4669-a48a-d9cee489c71e could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:34.076898 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9b38241f-c91c-4e9e-86f2-5612dd9775bd tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e" status: 404 len: 111 microversion: 2.1 time: 0.076959 Jul 19 22:32:34.076898 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 838/1671] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:33 2022] GET /compute/v2.1/servers/03987102-e808-4669-a48a-d9cee489c71e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:32:34.088281 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e4f2dec9-91a7-4bf6-a38e-4ee5148eb385 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:34.088801 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e4f2dec9-91a7-4bf6-a38e-4ee5148eb385 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:34.106778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e4f2dec9-91a7-4bf6-a38e-4ee5148eb385 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:34.111520 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e4f2dec9-91a7-4bf6-a38e-4ee5148eb385 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:34.113564 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e4f2dec9-91a7-4bf6-a38e-4ee5148eb385 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:34.115604 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e4f2dec9-91a7-4bf6-a38e-4ee5148eb385 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:34.168781 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e4f2dec9-91a7-4bf6-a38e-4ee5148eb385 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:32:34.176493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-51be560b-62ba-4579-943d-83480be66f43 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lazy-loading 'services' on Instance uuid 317af5ae-9759-4095-b561-ed61e9847c7e {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:32:34.331447 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e4f2dec9-91a7-4bf6-a38e-4ee5148eb385 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 204 len: 0 microversion: 2.1 time: 0.257822 Jul 19 22:32:34.333512 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 839/1672] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:32:34 2022] DELETE /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:32:34.343431 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e2e91eae-9249-43fd-b3ca-a2e35b43518b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:34.345168 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e2e91eae-9249-43fd-b3ca-a2e35b43518b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:34.375210 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2e91eae-9249-43fd-b3ca-a2e35b43518b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:34.379491 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2e91eae-9249-43fd-b3ca-a2e35b43518b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:34.381177 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2e91eae-9249-43fd-b3ca-a2e35b43518b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:34.382853 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-51be560b-62ba-4579-943d-83480be66f43 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "DELETE /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments/250e070c-0eb5-4823-813b-4bf060f2f27f" status: 202 len: 0 microversion: 2.1 time: 0.475820 Jul 19 22:32:34.384634 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2e91eae-9249-43fd-b3ca-a2e35b43518b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:34.386780 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 834/1673] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 19 22:32:33 2022] DELETE /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments/250e070c-0eb5-4823-813b-4bf060f2f27f => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:32:34.408705 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f205aebe-2d40-4429-b20b-4baf536989bb tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:34.411816 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f205aebe-2d40-4429-b20b-4baf536989bb tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:34.438494 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f205aebe-2d40-4429-b20b-4baf536989bb tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:34.439275 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f205aebe-2d40-4429-b20b-4baf536989bb tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:34.440260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f205aebe-2d40-4429-b20b-4baf536989bb tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:34.440856 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f205aebe-2d40-4429-b20b-4baf536989bb tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:34.568560 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-e2e91eae-9249-43fd-b3ca-a2e35b43518b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lazy-loading 'services' on Instance uuid 5d871dc5-0189-41e2-8650-8f753bf98c67 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:32:34.734226 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e2e91eae-9249-43fd-b3ca-a2e35b43518b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67/os-volume_attachments/8fd55885-642b-4104-96ae-2d4bf4a5f500" status: 202 len: 0 microversion: 2.25 time: 0.396975 Jul 19 22:32:34.734718 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 840/1674] 10.222.0.25 () {60 vars in 1456 bytes} [Tue Jul 19 22:32:34 2022] DELETE /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67/os-volume_attachments/8fd55885-642b-4104-96ae-2d4bf4a5f500 => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:32:34.744590 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fd674f97-c2f2-4717-865b-a34ef734b6b0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:34.749229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fd674f97-c2f2-4717-865b-a34ef734b6b0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:34.758179 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd674f97-c2f2-4717-865b-a34ef734b6b0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:34.759080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd674f97-c2f2-4717-865b-a34ef734b6b0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:34.760320 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd674f97-c2f2-4717-865b-a34ef734b6b0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:34.761048 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd674f97-c2f2-4717-865b-a34ef734b6b0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:34.872228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f205aebe-2d40-4429-b20b-4baf536989bb tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:34.888271 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f205aebe-2d40-4429-b20b-4baf536989bb tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:34.892577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f205aebe-2d40-4429-b20b-4baf536989bb tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:34.903691 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f205aebe-2d40-4429-b20b-4baf536989bb tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1447 microversion: 2.75 time: 0.509468 Jul 19 22:32:34.906444 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 835/1675] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:34 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1447 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:34.915937 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7a48c62e-5f29-48b1-bc47-54d4ac00b6d1 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:34.918957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7a48c62e-5f29-48b1-bc47-54d4ac00b6d1 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:34.932461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:32:34.938063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a48c62e-5f29-48b1-bc47-54d4ac00b6d1 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:34.939900 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a48c62e-5f29-48b1-bc47-54d4ac00b6d1 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:34.940786 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a48c62e-5f29-48b1-bc47-54d4ac00b6d1 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:34.942474 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a48c62e-5f29-48b1-bc47-54d4ac00b6d1 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:35.077630 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7a48c62e-5f29-48b1-bc47-54d4ac00b6d1 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169050 Jul 19 22:32:35.089637 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 836/1676] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:32:34 2022] GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:35.096140 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-014f67c4-ea62-45fd-ba07-a9bde28b74a3 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:35.097403 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-014f67c4-ea62-45fd-ba07-a9bde28b74a3 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:35.112637 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-014f67c4-ea62-45fd-ba07-a9bde28b74a3 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:35.113442 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-014f67c4-ea62-45fd-ba07-a9bde28b74a3 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:35.114475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-014f67c4-ea62-45fd-ba07-a9bde28b74a3 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:35.120436 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-014f67c4-ea62-45fd-ba07-a9bde28b74a3 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:35.218399 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-014f67c4-ea62-45fd-ba07-a9bde28b74a3 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.127163 Jul 19 22:32:35.219403 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 837/1677] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 19 22:32:35 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:32:35.224204 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-34d9f4b5-522f-47f9-896f-2b76fd7d96d2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:35.224835 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-34d9f4b5-522f-47f9-896f-2b76fd7d96d2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:35.234605 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-34d9f4b5-522f-47f9-896f-2b76fd7d96d2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:35.235626 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-34d9f4b5-522f-47f9-896f-2b76fd7d96d2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:35.236441 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-34d9f4b5-522f-47f9-896f-2b76fd7d96d2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:35.236886 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-34d9f4b5-522f-47f9-896f-2b76fd7d96d2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:35.673878 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-34d9f4b5-522f-47f9-896f-2b76fd7d96d2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:35.692392 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-34d9f4b5-522f-47f9-896f-2b76fd7d96d2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1168 microversion: 2.1 time: 0.470999 Jul 19 22:32:35.699963 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 838/1678] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:35 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1168 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:35.849638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fd674f97-c2f2-4717-865b-a34ef734b6b0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:35.864218 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fd674f97-c2f2-4717-865b-a34ef734b6b0 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1470 microversion: 2.1 time: 1.127728 Jul 19 22:32:35.869074 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 841/1679] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:34 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1470 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:35.927391 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ea040e25-7162-4613-851d-82411644f932 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:35.928025 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ea040e25-7162-4613-851d-82411644f932 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:35.939596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea040e25-7162-4613-851d-82411644f932 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:35.940261 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea040e25-7162-4613-851d-82411644f932 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:35.947875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea040e25-7162-4613-851d-82411644f932 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:35.948742 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea040e25-7162-4613-851d-82411644f932 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:36.099900 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-412ff8bc-b70b-4e40-8f98-46259a8c475d tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:36.101457 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-412ff8bc-b70b-4e40-8f98-46259a8c475d tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:36.113507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-412ff8bc-b70b-4e40-8f98-46259a8c475d tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:36.116171 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-412ff8bc-b70b-4e40-8f98-46259a8c475d tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:36.119148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-412ff8bc-b70b-4e40-8f98-46259a8c475d tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:36.120029 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-412ff8bc-b70b-4e40-8f98-46259a8c475d tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:36.164403 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ea040e25-7162-4613-851d-82411644f932 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:36.180328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ea040e25-7162-4613-851d-82411644f932 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:36.183289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ea040e25-7162-4613-851d-82411644f932 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:36.198871 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ea040e25-7162-4613-851d-82411644f932 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1447 microversion: 2.75 time: 0.276710 Jul 19 22:32:36.203926 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 839/1680] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:35 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1447 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:36.207488 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-412ff8bc-b70b-4e40-8f98-46259a8c475d tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111967 Jul 19 22:32:36.208074 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 842/1681] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:32:36 2022] GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:36.232627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a887c10c-4a6a-4075-a6d3-8fafd565c5c7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:36.233726 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a887c10c-4a6a-4075-a6d3-8fafd565c5c7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:36.272870 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a887c10c-4a6a-4075-a6d3-8fafd565c5c7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:36.273488 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a887c10c-4a6a-4075-a6d3-8fafd565c5c7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:36.275770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a887c10c-4a6a-4075-a6d3-8fafd565c5c7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:36.291780 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a887c10c-4a6a-4075-a6d3-8fafd565c5c7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:36.408681 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a887c10c-4a6a-4075-a6d3-8fafd565c5c7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.178120 Jul 19 22:32:36.409545 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 840/1682] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 19 22:32:36 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:32:36.719012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-deeb7098-e969-4ee5-af1e-8a1f0278c511 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:36.720021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-deeb7098-e969-4ee5-af1e-8a1f0278c511 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:36.734034 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-deeb7098-e969-4ee5-af1e-8a1f0278c511 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:36.738133 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-deeb7098-e969-4ee5-af1e-8a1f0278c511 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:36.740012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-deeb7098-e969-4ee5-af1e-8a1f0278c511 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:36.748509 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-deeb7098-e969-4ee5-af1e-8a1f0278c511 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:36.886557 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-49c0e7c1-0967-42a3-b0b6-499f7d2a1c10 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:36.887208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-49c0e7c1-0967-42a3-b0b6-499f7d2a1c10 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:36.901614 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49c0e7c1-0967-42a3-b0b6-499f7d2a1c10 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:36.902453 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49c0e7c1-0967-42a3-b0b6-499f7d2a1c10 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:36.903437 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49c0e7c1-0967-42a3-b0b6-499f7d2a1c10 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:36.905179 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49c0e7c1-0967-42a3-b0b6-499f7d2a1c10 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:37.355520 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-49c0e7c1-0967-42a3-b0b6-499f7d2a1c10 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:37.364009 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-49c0e7c1-0967-42a3-b0b6-499f7d2a1c10 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1470 microversion: 2.1 time: 0.482430 Jul 19 22:32:37.364497 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 841/1683] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:36 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1470 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:37.384252 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-40197a91-185d-472f-a510-e983d2018c21 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:37.385405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-40197a91-185d-472f-a510-e983d2018c21 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:37.394807 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-40197a91-185d-472f-a510-e983d2018c21 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:37.395206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-40197a91-185d-472f-a510-e983d2018c21 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:37.395983 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-40197a91-185d-472f-a510-e983d2018c21 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:37.400272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-40197a91-185d-472f-a510-e983d2018c21 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:37.464670 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-40197a91-185d-472f-a510-e983d2018c21 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094101 Jul 19 22:32:37.477255 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 842/1684] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:32:37 2022] GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:37.486451 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6e4f97c7-e398-4be4-8e92-c779856b7835 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:37.487091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6e4f97c7-e398-4be4-8e92-c779856b7835 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:37.504072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e4f97c7-e398-4be4-8e92-c779856b7835 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:37.504558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e4f97c7-e398-4be4-8e92-c779856b7835 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:37.505344 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e4f97c7-e398-4be4-8e92-c779856b7835 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:37.505782 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e4f97c7-e398-4be4-8e92-c779856b7835 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:37.614758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-deeb7098-e969-4ee5-af1e-8a1f0278c511 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:37.627077 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-deeb7098-e969-4ee5-af1e-8a1f0278c511 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1210 microversion: 2.1 time: 0.910821 Jul 19 22:32:37.627702 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 843/1685] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:36 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1210 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:37.641999 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4861addc-903f-41c4-a2b5-232b8c8c1eda tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:37.643048 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4861addc-903f-41c4-a2b5-232b8c8c1eda tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:37.653049 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4861addc-903f-41c4-a2b5-232b8c8c1eda tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:37.659133 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4861addc-903f-41c4-a2b5-232b8c8c1eda tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:37.659975 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4861addc-903f-41c4-a2b5-232b8c8c1eda tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:37.660416 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4861addc-903f-41c4-a2b5-232b8c8c1eda tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:37.739902 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4861addc-903f-41c4-a2b5-232b8c8c1eda tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.111085 Jul 19 22:32:37.747740 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 844/1686] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 19 22:32:37 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:32:37.774738 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6e4f97c7-e398-4be4-8e92-c779856b7835 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:37.789031 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6e4f97c7-e398-4be4-8e92-c779856b7835 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:37.795146 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6e4f97c7-e398-4be4-8e92-c779856b7835 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:37.812042 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6e4f97c7-e398-4be4-8e92-c779856b7835 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1447 microversion: 2.75 time: 0.332717 Jul 19 22:32:37.814515 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 843/1687] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:37 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1447 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:38.084531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-f7b2c45d-19e2-4e67-8d07-1f17859287ec req-40df1174-8782-4f35-8a86-66d47cb049a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613", "name": "network-vif-deleted", "tag": "8551ae32-70fe-4a9f-920b-2e4c5b49340d"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:38.110006 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f7b2c45d-19e2-4e67-8d07-1f17859287ec req-40df1174-8782-4f35-8a86-66d47cb049a2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:38.113645 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f7b2c45d-19e2-4e67-8d07-1f17859287ec req-40df1174-8782-4f35-8a86-66d47cb049a2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:38.167986 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-a97265be-c28f-4ca8-af36-67283f2ad1b9 req-16fb9b1a-b3bd-4ca6-8c47-9882abf7fe0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7", "tag": "982bb92a-f3e0-4d49-82fa-8c659b4cf2a9"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:38.171097 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-f7b2c45d-19e2-4e67-8d07-1f17859287ec req-40df1174-8782-4f35-8a86-66d47cb049a2 service nova] Creating event network-vif-deleted:8551ae32-70fe-4a9f-920b-2e4c5b49340d for instance 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 on n-h2-847009-3 Jul 19 22:32:38.185209 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-f7b2c45d-19e2-4e67-8d07-1f17859287ec req-40df1174-8782-4f35-8a86-66d47cb049a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105582 Jul 19 22:32:38.191613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a97265be-c28f-4ca8-af36-67283f2ad1b9 req-16fb9b1a-b3bd-4ca6-8c47-9882abf7fe0e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:38.192829 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 845/1688] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:32:38.193327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a97265be-c28f-4ca8-af36-67283f2ad1b9 req-16fb9b1a-b3bd-4ca6-8c47-9882abf7fe0e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:38.228265 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-a97265be-c28f-4ca8-af36-67283f2ad1b9 req-16fb9b1a-b3bd-4ca6-8c47-9882abf7fe0e service nova] Creating event network-changed:982bb92a-f3e0-4d49-82fa-8c659b4cf2a9 for instance b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 on n-h2-847009-3 Jul 19 22:32:38.238268 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-a97265be-c28f-4ca8-af36-67283f2ad1b9 req-16fb9b1a-b3bd-4ca6-8c47-9882abf7fe0e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073903 Jul 19 22:32:38.264574 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 844/1689] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:32:38.381957 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6b85d20b-721e-4b75-900b-c18b26619698 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:38.382730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6b85d20b-721e-4b75-900b-c18b26619698 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:38.394953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b85d20b-721e-4b75-900b-c18b26619698 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:38.395434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b85d20b-721e-4b75-900b-c18b26619698 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:38.402758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b85d20b-721e-4b75-900b-c18b26619698 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:38.403507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b85d20b-721e-4b75-900b-c18b26619698 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:38.447741 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:32:38.498161 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-57574d31-0761-46c0-97e5-747cfcca1985 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:38.504571 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-57574d31-0761-46c0-97e5-747cfcca1985 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:38.510098 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b85d20b-721e-4b75-900b-c18b26619698 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:38.510562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b85d20b-721e-4b75-900b-c18b26619698 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:38.511031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-6b85d20b-721e-4b75-900b-c18b26619698 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lazy-loading 'fault' on Instance uuid 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:32:38.521584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57574d31-0761-46c0-97e5-747cfcca1985 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:38.522489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57574d31-0761-46c0-97e5-747cfcca1985 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:38.524472 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57574d31-0761-46c0-97e5-747cfcca1985 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:38.525695 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57574d31-0761-46c0-97e5-747cfcca1985 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:38.548906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:32:38.567864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:32:38.570926 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-57574d31-0761-46c0-97e5-747cfcca1985 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096227 Jul 19 22:32:38.572149 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 845/1690] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:32:38 2022] GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:32:38.645264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ea159242-6e23-41c4-9459-abd74a263ed7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:38.646280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ea159242-6e23-41c4-9459-abd74a263ed7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:38.656157 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea159242-6e23-41c4-9459-abd74a263ed7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:38.656978 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea159242-6e23-41c4-9459-abd74a263ed7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:38.658063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea159242-6e23-41c4-9459-abd74a263ed7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:38.659162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea159242-6e23-41c4-9459-abd74a263ed7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:38.712099 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6b85d20b-721e-4b75-900b-c18b26619698 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4781dbc875d24dc490e598b41905a542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512cc31b5f6546eeb04486cd5213e441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:38.724207 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6b85d20b-721e-4b75-900b-c18b26619698 tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 200 len: 1304 microversion: 2.1 time: 0.346512 Jul 19 22:32:38.736748 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 846/1691] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:38 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 1304 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:38.759507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e9f704db-04d3-46c1-adfa-456937f59700 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:38.764475 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e9f704db-04d3-46c1-adfa-456937f59700 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:38.776772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9f704db-04d3-46c1-adfa-456937f59700 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:38.777524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9f704db-04d3-46c1-adfa-456937f59700 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:38.780585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9f704db-04d3-46c1-adfa-456937f59700 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:38.781477 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9f704db-04d3-46c1-adfa-456937f59700 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:38.865469 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e9f704db-04d3-46c1-adfa-456937f59700 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.116267 Jul 19 22:32:38.868186 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 847/1692] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 19 22:32:38 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:32:38.880234 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f64b11b3-66ab-4630-858a-f0330a40a274 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:38.881451 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f64b11b3-66ab-4630-858a-f0330a40a274 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:38.909116 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f64b11b3-66ab-4630-858a-f0330a40a274 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:38.911298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f64b11b3-66ab-4630-858a-f0330a40a274 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:38.912719 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f64b11b3-66ab-4630-858a-f0330a40a274 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:38.914082 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f64b11b3-66ab-4630-858a-f0330a40a274 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:39.187692 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f64b11b3-66ab-4630-858a-f0330a40a274 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:39.205737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f64b11b3-66ab-4630-858a-f0330a40a274 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:39.211676 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f64b11b3-66ab-4630-858a-f0330a40a274 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:39.227542 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f64b11b3-66ab-4630-858a-f0330a40a274 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1447 microversion: 2.75 time: 0.357893 Jul 19 22:32:39.241281 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 848/1693] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:38 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1447 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:39.358353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:32:39.406204 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ea159242-6e23-41c4-9459-abd74a263ed7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:39.415825 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ea159242-6e23-41c4-9459-abd74a263ed7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1210 microversion: 2.1 time: 0.775015 Jul 19 22:32:39.433022 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 846/1694] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:38 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1210 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:39.582097 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9c9b9eab-cc42-4837-8d5c-8070f60c9283 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:39.583124 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9c9b9eab-cc42-4837-8d5c-8070f60c9283 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:39.606495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9c9b9eab-cc42-4837-8d5c-8070f60c9283 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:39.606782 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9c9b9eab-cc42-4837-8d5c-8070f60c9283 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:39.615026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9c9b9eab-cc42-4837-8d5c-8070f60c9283 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:39.615978 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9c9b9eab-cc42-4837-8d5c-8070f60c9283 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:39.705154 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9c9b9eab-cc42-4837-8d5c-8070f60c9283 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127038 Jul 19 22:32:39.707240 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 849/1695] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:32:39 2022] GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:39.742809 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5c1b85a8-a771-48a7-b21d-8aa1577c27dc tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:39.743458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5c1b85a8-a771-48a7-b21d-8aa1577c27dc tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] [instance: 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:39.754296 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c1b85a8-a771-48a7-b21d-8aa1577c27dc tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:39.754764 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c1b85a8-a771-48a7-b21d-8aa1577c27dc tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:39.755588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c1b85a8-a771-48a7-b21d-8aa1577c27dc tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:39.756426 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c1b85a8-a771-48a7-b21d-8aa1577c27dc tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:39.788804 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-5c1b85a8-a771-48a7-b21d-8aa1577c27dc tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] HTTP exception thrown: Instance 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 could not be found. Jul 19 22:32:39.792046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5c1b85a8-a771-48a7-b21d-8aa1577c27dc tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Request method failure captured: Jul 19 22:32:39.792046 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 HTTP/1.1 Jul 19 22:32:39.792046 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:32:39.792046 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:32:39.792046 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:32:39.792046 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:32:39.792046 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:32:39.792046 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:32:39.792046 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:32:39.792046 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:39.792046 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zA0OsaGoXD87AIzz7SPn5-GNHM9nnQghSoW5_zo3uFFDyb_j_cqk5ifZn6i8oyiPJZN0Sk2EHnF7aFC_Y22MNDdGdHkuy2umKxpdI1ldpSvlcxS2q2m1Ssx8LSeRCsVfnbMGeWxaUFtey34vrS1764XeVlUB7EvtNQWoBhy7RiKfzk Jul 19 22:32:39.792046 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:32:39.792046 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:32:39.792046 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:32:39.792046 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:32:39.792046 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:32:39.792046 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:32:39.792046 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 512cc31b5f6546eeb04486cd5213e441 Jul 19 22:32:39.792046 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersAdminTestJSON-1016439079 Jul 19 22:32:39.792046 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:32:39.792046 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:32:39.793805 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_512cc31b5f6546eeb04486cd5213e441"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/512cc31b5f6546eeb04486cd5213e441"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/512cc31b5f6546eeb04486cd5213e441"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/512cc31b5f6546eeb04486cd5213e441"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:39.793805 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersAdminTestJSON-1016439079 Jul 19 22:32:39.793805 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 512cc31b5f6546eeb04486cd5213e441 Jul 19 22:32:39.793805 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersAdminTestJSON-1016439079 Jul 19 22:32:39.793805 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersAdminTestJSON-1016439079-project Jul 19 22:32:39.793805 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:32:39.793805 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:32:39.793805 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 4781dbc875d24dc490e598b41905a542 Jul 19 22:32:39.793805 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersAdminTestJSON-1016439079-project Jul 19 22:32:39.793805 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:32:39.793805 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 could not be found. Jul 19 22:32:39.793805 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613'} Jul 19 22:32:39.794858 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:39.794858 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:39.794858 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:32:39.794858 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:32:39.794858 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:32:39.794858 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:32:39.794858 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:32:39.794858 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:32:39.794858 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:32:39.794858 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:32:39.794858 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 could not be found. Jul 19 22:32:39.794858 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:39.794858 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:39.794858 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:39.794858 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:39.794858 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:39.794858 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:39.794858 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:39.794858 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:39.794858 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:39.796440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:39.796440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:32:39.796440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:32:39.796440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:32:39.796440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:32:39.796440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:32:39.796440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:32:39.796440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 could not be found. Jul 19 22:32:39.796440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:39.796440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:39.796440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:39.796440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:39.796440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:39.796440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:39.796440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:39.796440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:39.796440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 could not be found. Jul 19 22:32:39.796440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:39.797997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5c1b85a8-a771-48a7-b21d-8aa1577c27dc tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] Returning 404 to user: Instance 2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:39.797997 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5c1b85a8-a771-48a7-b21d-8aa1577c27dc tempest-ServersAdminTestJSON-1016439079 tempest-ServersAdminTestJSON-1016439079-project] 10.222.0.25 "GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613" status: 404 len: 111 microversion: 2.1 time: 0.058332 Jul 19 22:32:39.797997 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 847/1696] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:39 2022] GET /compute/v2.1/servers/2ce23397-1dfa-4ae1-89c4-f2b0bd1ca613 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:32:39.879522 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c48b42c5-3fe1-45c6-89c1-3c6e4c436a92 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:39.880167 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c48b42c5-3fe1-45c6-89c1-3c6e4c436a92 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:39.889123 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c48b42c5-3fe1-45c6-89c1-3c6e4c436a92 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:39.890220 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c48b42c5-3fe1-45c6-89c1-3c6e4c436a92 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:39.891584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c48b42c5-3fe1-45c6-89c1-3c6e4c436a92 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:39.892034 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c48b42c5-3fe1-45c6-89c1-3c6e4c436a92 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:39.933548 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c48b42c5-3fe1-45c6-89c1-3c6e4c436a92 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.058628 Jul 19 22:32:39.934422 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 850/1697] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 19 22:32:39 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:32:40.251831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-19e0f19d-26c3-4ddf-90aa-21ccca59877b tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:40.252609 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-19e0f19d-26c3-4ddf-90aa-21ccca59877b tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:40.264350 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-19e0f19d-26c3-4ddf-90aa-21ccca59877b tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:40.264820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-19e0f19d-26c3-4ddf-90aa-21ccca59877b tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:40.265629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-19e0f19d-26c3-4ddf-90aa-21ccca59877b tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:40.266081 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-19e0f19d-26c3-4ddf-90aa-21ccca59877b tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:40.630114 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-19e0f19d-26c3-4ddf-90aa-21ccca59877b tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:40.648546 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-19e0f19d-26c3-4ddf-90aa-21ccca59877b tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:40.664943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-19e0f19d-26c3-4ddf-90aa-21ccca59877b tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:40.683280 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-19e0f19d-26c3-4ddf-90aa-21ccca59877b tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1447 microversion: 2.75 time: 0.435448 Jul 19 22:32:40.684582 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 851/1698] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:40 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1447 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:32:40.689900 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a17fb2d7-2971-454b-b526-262ca4fadd41 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:40.706379 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a17fb2d7-2971-454b-b526-262ca4fadd41 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:40.730421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a17fb2d7-2971-454b-b526-262ca4fadd41 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:40.730886 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a17fb2d7-2971-454b-b526-262ca4fadd41 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:40.732360 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a17fb2d7-2971-454b-b526-262ca4fadd41 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:40.732812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a17fb2d7-2971-454b-b526-262ca4fadd41 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:40.809185 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-81702ecd-9c71-46b1-821e-f70f9b6223ac tempest-FloatingIPDetailsTestJSON-1529178395 tempest-FloatingIPDetailsTestJSON-1529178395-project] Action: 'create', calling method: .version_select at 0x7f7a03ea90d0>, body: {"pool": null} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:41.560521 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a17fb2d7-2971-454b-b526-262ca4fadd41 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:41.588907 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a17fb2d7-2971-454b-b526-262ca4fadd41 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1210 microversion: 2.1 time: 0.902549 Jul 19 22:32:41.598004 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 852/1699] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:40 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1210 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:41.625585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-92fe604c-1a83-4359-a486-aa120811aa6f tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:41.640236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-92fe604c-1a83-4359-a486-aa120811aa6f tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:41.651653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-92fe604c-1a83-4359-a486-aa120811aa6f tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:41.652795 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-92fe604c-1a83-4359-a486-aa120811aa6f tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:41.664952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-92fe604c-1a83-4359-a486-aa120811aa6f tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:41.666094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-92fe604c-1a83-4359-a486-aa120811aa6f tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:41.743839 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-92fe604c-1a83-4359-a486-aa120811aa6f tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133573 Jul 19 22:32:41.744405 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 853/1700] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:32:41 2022] GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:41.756320 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-97d1f0e8-7f87-4f6d-80f3-92ce99a49311 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:41.758558 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-97d1f0e8-7f87-4f6d-80f3-92ce99a49311 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:41.778422 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-97d1f0e8-7f87-4f6d-80f3-92ce99a49311 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:41.779136 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-97d1f0e8-7f87-4f6d-80f3-92ce99a49311 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:41.781823 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-97d1f0e8-7f87-4f6d-80f3-92ce99a49311 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:41.783640 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-97d1f0e8-7f87-4f6d-80f3-92ce99a49311 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:41.870477 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-97d1f0e8-7f87-4f6d-80f3-92ce99a49311 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.124754 Jul 19 22:32:41.871073 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 854/1701] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 19 22:32:41 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:32:41.980431 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-413089b5-404e-44f9-bcda-f41b2f52461a tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1706822106", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "26dc913c-0134-4622-8a19-0b2cdc75bf02"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:42.088261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-413089b5-404e-44f9-bcda-f41b2f52461a tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] validate_networks() for [('26dc913c-0134-4622-8a19-0b2cdc75bf02', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:32:44.230585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-413089b5-404e-44f9-bcda-f41b2f52461a tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:32:44.231307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-413089b5-404e-44f9-bcda-f41b2f52461a tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:32:44.231516 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-413089b5-404e-44f9-bcda-f41b2f52461a tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:32:44.231932 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-413089b5-404e-44f9-bcda-f41b2f52461a tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:32:44.232351 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-413089b5-404e-44f9-bcda-f41b2f52461a tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:32:44.275647 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-413089b5-404e-44f9-bcda-f41b2f52461a tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:44.278734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-413089b5-404e-44f9-bcda-f41b2f52461a tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:44.280343 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-413089b5-404e-44f9-bcda-f41b2f52461a tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:44.285330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-413089b5-404e-44f9-bcda-f41b2f52461a tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:44.358809 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-413089b5-404e-44f9-bcda-f41b2f52461a tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Getting quotas for project d240e28831304ae890a9bf83a9383111. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:32:44.398891 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-413089b5-404e-44f9-bcda-f41b2f52461a tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Getting quotas for user 4020bca56fb34848b4f6c8d7d1b7b10a and project d240e28831304ae890a9bf83a9383111. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:32:44.442556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-413089b5-404e-44f9-bcda-f41b2f52461a tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:32:44.452694 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-413089b5-404e-44f9-bcda-f41b2f52461a tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] [instance: 6fded340-0a2a-4b49-8988-53d61dcd8021] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:32:44.586541 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:32:44.618641 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-413089b5-404e-44f9-bcda-f41b2f52461a tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.743319 Jul 19 22:32:44.628587 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 855/1702] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:32:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:32:44.645424 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-98915ed6-de78-4bbe-8a52-21ee2e79c5ea tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:44.652418 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-98915ed6-de78-4bbe-8a52-21ee2e79c5ea tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:44.691252 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-98915ed6-de78-4bbe-8a52-21ee2e79c5ea tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:44.692531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-98915ed6-de78-4bbe-8a52-21ee2e79c5ea tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:44.692531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-98915ed6-de78-4bbe-8a52-21ee2e79c5ea tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:44.692930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-98915ed6-de78-4bbe-8a52-21ee2e79c5ea tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:45.056304 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-98915ed6-de78-4bbe-8a52-21ee2e79c5ea tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:45.079846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-98915ed6-de78-4bbe-8a52-21ee2e79c5ea tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:45.084510 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-98915ed6-de78-4bbe-8a52-21ee2e79c5ea tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:45.110188 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-98915ed6-de78-4bbe-8a52-21ee2e79c5ea tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1453 microversion: 2.75 time: 0.477784 Jul 19 22:32:45.116151 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 856/1703] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:44 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1453 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:45.124315 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0ebda935-75ff-480e-94dc-9b0d4bc7c6d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:45.126933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0ebda935-75ff-480e-94dc-9b0d4bc7c6d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:45.152391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ebda935-75ff-480e-94dc-9b0d4bc7c6d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:45.153199 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ebda935-75ff-480e-94dc-9b0d4bc7c6d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:45.154430 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ebda935-75ff-480e-94dc-9b0d4bc7c6d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:45.155162 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ebda935-75ff-480e-94dc-9b0d4bc7c6d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:46.505610 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0ebda935-75ff-480e-94dc-9b0d4bc7c6d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:46.524634 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0ebda935-75ff-480e-94dc-9b0d4bc7c6d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1210 microversion: 2.1 time: 1.406575 Jul 19 22:32:46.542044 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 857/1704] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:45 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1210 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:46.562037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0b8ca746-a396-44df-82d1-5bbdd0314acb tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:46.576921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0b8ca746-a396-44df-82d1-5bbdd0314acb tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:46.611806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b8ca746-a396-44df-82d1-5bbdd0314acb tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:46.612268 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b8ca746-a396-44df-82d1-5bbdd0314acb tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:46.619602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b8ca746-a396-44df-82d1-5bbdd0314acb tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:46.620172 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b8ca746-a396-44df-82d1-5bbdd0314acb tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:46.754086 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0b8ca746-a396-44df-82d1-5bbdd0314acb tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.209364 Jul 19 22:32:46.759432 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 858/1705] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:32:46 2022] GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments => generated 197 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:46.776172 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-75061e3e-6326-4041-b904-93bde4140758 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:46.777147 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-75061e3e-6326-4041-b904-93bde4140758 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:46.817052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75061e3e-6326-4041-b904-93bde4140758 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:46.817501 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75061e3e-6326-4041-b904-93bde4140758 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:46.818475 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75061e3e-6326-4041-b904-93bde4140758 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:46.824068 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75061e3e-6326-4041-b904-93bde4140758 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:46.904534 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-75061e3e-6326-4041-b904-93bde4140758 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.140977 Jul 19 22:32:46.906489 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 859/1706] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 19 22:32:46 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:32:46.917381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ead01144-6cee-4711-ba0c-ca9d0dc0eb3d tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:46.918147 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ead01144-6cee-4711-ba0c-ca9d0dc0eb3d tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] [instance: 6fded340-0a2a-4b49-8988-53d61dcd8021] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:46.938750 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ead01144-6cee-4711-ba0c-ca9d0dc0eb3d tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:46.965841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ead01144-6cee-4711-ba0c-ca9d0dc0eb3d tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:46.971714 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ead01144-6cee-4711-ba0c-ca9d0dc0eb3d tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:46.973162 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ead01144-6cee-4711-ba0c-ca9d0dc0eb3d tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:47.218831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ead01144-6cee-4711-ba0c-ca9d0dc0eb3d tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4020bca56fb34848b4f6c8d7d1b7b10a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd240e28831304ae890a9bf83a9383111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:47.247741 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ead01144-6cee-4711-ba0c-ca9d0dc0eb3d tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] 10.222.0.25 "GET /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021" status: 200 len: 1268 microversion: 2.1 time: 0.336121 Jul 19 22:32:47.251334 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 860/1707] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:46 2022] GET /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021 => generated 1268 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:47.269841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e802232e-a43d-4a18-9506-8a419a02c6ce tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:47.271457 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e802232e-a43d-4a18-9506-8a419a02c6ce tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:47.280363 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e802232e-a43d-4a18-9506-8a419a02c6ce tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:47.281929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e802232e-a43d-4a18-9506-8a419a02c6ce tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:47.283083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e802232e-a43d-4a18-9506-8a419a02c6ce tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:47.283914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e802232e-a43d-4a18-9506-8a419a02c6ce tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:47.443868 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e802232e-a43d-4a18-9506-8a419a02c6ce tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:47.465080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e802232e-a43d-4a18-9506-8a419a02c6ce tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:47.466597 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e802232e-a43d-4a18-9506-8a419a02c6ce tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:47.484861 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e802232e-a43d-4a18-9506-8a419a02c6ce tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1438 microversion: 2.75 time: 0.231894 Jul 19 22:32:47.495984 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 861/1708] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:47 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1438 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:48.061766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ab700d3d-3c06-49ad-b9df-040480410814 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:48.063361 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ab700d3d-3c06-49ad-b9df-040480410814 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:48.084512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab700d3d-3c06-49ad-b9df-040480410814 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:48.085999 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab700d3d-3c06-49ad-b9df-040480410814 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:48.088511 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab700d3d-3c06-49ad-b9df-040480410814 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:48.090402 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab700d3d-3c06-49ad-b9df-040480410814 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:48.292406 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-ab700d3d-3c06-49ad-b9df-040480410814 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:32:48.295430 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-ab700d3d-3c06-49ad-b9df-040480410814 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:32:48.296355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-ab700d3d-3c06-49ad-b9df-040480410814 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:32:48.297019 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-ab700d3d-3c06-49ad-b9df-040480410814 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:32:48.298464 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-ab700d3d-3c06-49ad-b9df-040480410814 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:32:48.343725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:32:48.416189 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ab700d3d-3c06-49ad-b9df-040480410814 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:48.424735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab700d3d-3c06-49ad-b9df-040480410814 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:48.425541 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab700d3d-3c06-49ad-b9df-040480410814 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:48.427046 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab700d3d-3c06-49ad-b9df-040480410814 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:48.428132 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab700d3d-3c06-49ad-b9df-040480410814 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:48.815471 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-ab700d3d-3c06-49ad-b9df-040480410814 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lazy-loading 'services' on Instance uuid 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:32:48.860167 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ab700d3d-3c06-49ad-b9df-040480410814 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d/action" status: 202 len: 1942 microversion: 2.75 time: 1.352748 Jul 19 22:32:48.861181 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 862/1709] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Jul 19 22:32:47 2022] POST /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d/action => generated 1942 bytes in 1356 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 19 22:32:48.875983 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3904a75b-03a7-4ab8-ae6a-602f7f22233e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:48.877721 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3904a75b-03a7-4ab8-ae6a-602f7f22233e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:48.886855 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3904a75b-03a7-4ab8-ae6a-602f7f22233e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:48.887556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3904a75b-03a7-4ab8-ae6a-602f7f22233e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:48.888513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3904a75b-03a7-4ab8-ae6a-602f7f22233e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:48.888958 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3904a75b-03a7-4ab8-ae6a-602f7f22233e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:49.011048 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-81702ecd-9c71-46b1-821e-f70f9b6223ac tempest-FloatingIPDetailsTestJSON-1529178395 tempest-FloatingIPDetailsTestJSON-1529178395-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 8.868529 Jul 19 22:32:49.011910 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 848/1710] 10.222.0.25 () {60 vars in 1169 bytes} [Tue Jul 19 22:32:40 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 8870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:49.135821 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1a6e0476-a09a-4b3f-9ae1-e53d03e8fb07 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Action: 'update', calling method: .version_select at 0x7f7a103054c0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:49.148923 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:32:49.148923 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:32:49.154517 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a6e0476-a09a-4b3f-9ae1-e53d03e8fb07 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:49.157997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a6e0476-a09a-4b3f-9ae1-e53d03e8fb07 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:49.178275 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a6e0476-a09a-4b3f-9ae1-e53d03e8fb07 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:49.179831 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a6e0476-a09a-4b3f-9ae1-e53d03e8fb07 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:49.188449 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-1a6e0476-a09a-4b3f-9ae1-e53d03e8fb07 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] HTTP exception thrown: Service d55f4339-497f-45ff-94fe-dcb3bed47ca9 could not be found. Jul 19 22:32:49.202201 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1a6e0476-a09a-4b3f-9ae1-e53d03e8fb07 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Request method failure captured: Jul 19 22:32:49.202201 n-d-847009-3 devstack@n-api.service[119337]: request: PUT /compute/v2.1/os-services/d55f4339-497f-45ff-94fe-dcb3bed47ca9 HTTP/1.1 Jul 19 22:32:49.202201 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:32:49.202201 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:32:49.202201 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:32:49.202201 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 56 Jul 19 22:32:49.202201 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:32:49.202201 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:32:49.202201 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:32:49.202201 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:49.202201 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zEP9ri9AygQt-n1w9ZkRKpXue0Y-Bi1EDITUAoOigl9nvfbqcCcduZSp2tSXEmD65dhWjYyT4XNPQ0uOQHjyLLuZZNInBlxvtCfU-zko2OsMwcMFpinuYzl4AZhEjG4u4xMMbqTsVS_UxtyuU29JsPo9HParFu3pBQT1GPzCYyN7K4 Jul 19 22:32:49.202201 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:32:49.202201 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:32:49.202201 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:32:49.202201 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:32:49.202201 n-d-847009-3 devstack@n-api.service[119337]: X-Openstack-Nova-Api-Version: 2.53 Jul 19 22:32:49.202201 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:32:49.202201 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:32:49.202201 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08c7939457484ff7a5795fcc4318a77a Jul 19 22:32:49.202201 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1137449555 Jul 19 22:32:49.202201 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:32:49.202201 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:32:49.204265 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08c7939457484ff7a5795fcc4318a77a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08c7939457484ff7a5795fcc4318a77a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08c7939457484ff7a5795fcc4318a77a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08c7939457484ff7a5795fcc4318a77a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:49.204265 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1137449555 Jul 19 22:32:49.204265 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08c7939457484ff7a5795fcc4318a77a Jul 19 22:32:49.204265 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1137449555 Jul 19 22:32:49.204265 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin Jul 19 22:32:49.204265 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:32:49.204265 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:32:49.204265 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 6b93c4ce93c94511997204bdc13a25c3 Jul 19 22:32:49.204265 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin Jul 19 22:32:49.204265 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:32:49.204265 n-d-847009-3 devstack@n-api.service[119337]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 19 22:32:49.204265 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:32:49.204265 n-d-847009-3 devstack@n-api.service[119337]: exception: Service d55f4339-497f-45ff-94fe-dcb3bed47ca9 could not be found. Jul 19 22:32:49.205363 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'd55f4339-497f-45ff-94fe-dcb3bed47ca9', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 19 22:32:49.205363 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:49.205363 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:49.205363 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 19 22:32:49.205363 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 19 22:32:49.205363 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 19 22:32:49.205363 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 19 22:32:49.205363 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 19 22:32:49.205363 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:49.205363 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:49.205363 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:49.205363 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:49.205363 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 19 22:32:49.205363 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 19 22:32:49.205363 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 19 22:32:49.205363 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 19 22:32:49.205363 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service d55f4339-497f-45ff-94fe-dcb3bed47ca9 could not be found. Jul 19 22:32:49.205363 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:49.205363 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:49.205363 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:49.205363 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:49.207156 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:49.207156 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:49.207156 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:49.207156 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:49.207156 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:32:49.207156 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:32:49.207156 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:49.207156 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:49.207156 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:32:49.207156 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:32:49.207156 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 19 22:32:49.207156 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:32:49.207156 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service d55f4339-497f-45ff-94fe-dcb3bed47ca9 could not be found. Jul 19 22:32:49.207156 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:49.207156 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:49.207156 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:49.207156 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:49.207156 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:49.207156 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:49.207156 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:49.208800 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:49.208800 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service d55f4339-497f-45ff-94fe-dcb3bed47ca9 could not be found. Jul 19 22:32:49.208800 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:49.212834 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1a6e0476-a09a-4b3f-9ae1-e53d03e8fb07 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Returning 404 to user: Service d55f4339-497f-45ff-94fe-dcb3bed47ca9 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:49.213945 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1a6e0476-a09a-4b3f-9ae1-e53d03e8fb07 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/d55f4339-497f-45ff-94fe-dcb3bed47ca9" status: 404 len: 110 microversion: 2.53 time: 0.181434 Jul 19 22:32:49.220616 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 849/1711] 10.222.0.25 () {62 vars in 1308 bytes} [Tue Jul 19 22:32:49 2022] PUT /compute/v2.1/os-services/d55f4339-497f-45ff-94fe-dcb3bed47ca9 => generated 110 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:32:49.229264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cb08307e-d3c9-4246-afca-0921d26b333b tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:49.230737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cb08307e-d3c9-4246-afca-0921d26b333b tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:49.244676 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cb08307e-d3c9-4246-afca-0921d26b333b tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:49.245452 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cb08307e-d3c9-4246-afca-0921d26b333b tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:49.246892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cb08307e-d3c9-4246-afca-0921d26b333b tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:49.247708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cb08307e-d3c9-4246-afca-0921d26b333b tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:49.291276 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cb08307e-d3c9-4246-afca-0921d26b333b tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068211 Jul 19 22:32:49.296110 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 850/1712] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:32:49 2022] GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:49.302600 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3038290c-f435-4e04-bdb5-f33a58ca313e tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:49.304488 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3038290c-f435-4e04-bdb5-f33a58ca313e tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:49.323927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3038290c-f435-4e04-bdb5-f33a58ca313e tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:49.325764 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3038290c-f435-4e04-bdb5-f33a58ca313e tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:49.326638 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3038290c-f435-4e04-bdb5-f33a58ca313e tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:49.327075 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3038290c-f435-4e04-bdb5-f33a58ca313e tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:49.395995 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3038290c-f435-4e04-bdb5-f33a58ca313e tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.097699 Jul 19 22:32:49.396585 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 851/1713] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 19 22:32:49 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:49.412230 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2321acf1-54b7-48a8-af8c-69c146819c46 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:49.420056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2321acf1-54b7-48a8-af8c-69c146819c46 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] [instance: 6fded340-0a2a-4b49-8988-53d61dcd8021] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:49.434300 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2321acf1-54b7-48a8-af8c-69c146819c46 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:49.438769 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2321acf1-54b7-48a8-af8c-69c146819c46 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:49.440472 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2321acf1-54b7-48a8-af8c-69c146819c46 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:49.441094 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2321acf1-54b7-48a8-af8c-69c146819c46 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:49.775607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3904a75b-03a7-4ab8-ae6a-602f7f22233e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:49.789478 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3904a75b-03a7-4ab8-ae6a-602f7f22233e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1210 microversion: 2.1 time: 0.927125 Jul 19 22:32:49.793440 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 863/1714] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:48 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1210 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:49.801792 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4a069cfd-79cd-4d3c-8c34-1aec0c55993f tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:49.804474 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4a069cfd-79cd-4d3c-8c34-1aec0c55993f tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:49.821412 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4a069cfd-79cd-4d3c-8c34-1aec0c55993f tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:49.822153 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4a069cfd-79cd-4d3c-8c34-1aec0c55993f tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:49.823150 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4a069cfd-79cd-4d3c-8c34-1aec0c55993f tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:49.823758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4a069cfd-79cd-4d3c-8c34-1aec0c55993f tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:50.433480 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-4a069cfd-79cd-4d3c-8c34-1aec0c55993f tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lazy-loading 'services' on Instance uuid 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:32:50.480771 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4a069cfd-79cd-4d3c-8c34-1aec0c55993f tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1929 microversion: 2.75 time: 0.685976 Jul 19 22:32:50.482992 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 864/1715] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:49 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1929 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:50.490308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b877d63c-7a73-4072-9375-645cb860cb13 tempest-FloatingIPDetailsTestJSON-1529178395 tempest-FloatingIPDetailsTestJSON-1529178395-project] Action: 'create', calling method: .version_select at 0x7f7a1561ac10>, body: {"pool": null} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:50.694992 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2321acf1-54b7-48a8-af8c-69c146819c46 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4020bca56fb34848b4f6c8d7d1b7b10a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd240e28831304ae890a9bf83a9383111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:50.705751 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2321acf1-54b7-48a8-af8c-69c146819c46 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] 10.222.0.25 "GET /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021" status: 200 len: 1316 microversion: 2.1 time: 1.303128 Jul 19 22:32:50.709976 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 852/1716] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:49 2022] GET /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021 => generated 1316 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:50.714962 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3d7fb2f8-28f1-4d69-a66c-3c6ae87bc9b3 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Action: 'update', calling method: .version_select at 0x7f7a03f420d0>, body: {"status": "disabled"} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:50.721658 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:32:50.721658 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:32:50.727368 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d7fb2f8-28f1-4d69-a66c-3c6ae87bc9b3 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:50.727825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d7fb2f8-28f1-4d69-a66c-3c6ae87bc9b3 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:50.745289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d7fb2f8-28f1-4d69-a66c-3c6ae87bc9b3 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:50.745738 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d7fb2f8-28f1-4d69-a66c-3c6ae87bc9b3 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:50.765872 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-3d7fb2f8-28f1-4d69-a66c-3c6ae87bc9b3 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] HTTP exception thrown: Service d55f4339-497f-45ff-94fe-dcb3bed47ca9 could not be found. Jul 19 22:32:50.768710 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3d7fb2f8-28f1-4d69-a66c-3c6ae87bc9b3 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Request method failure captured: Jul 19 22:32:50.768710 n-d-847009-3 devstack@n-api.service[119337]: request: PUT /compute/v2.1/os-services/d55f4339-497f-45ff-94fe-dcb3bed47ca9 HTTP/1.1 Jul 19 22:32:50.768710 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:32:50.768710 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:32:50.768710 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:32:50.768710 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 22 Jul 19 22:32:50.768710 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:32:50.768710 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:32:50.768710 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:32:50.768710 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:50.768710 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zEP9ri9AygQt-n1w9ZkRKpXue0Y-Bi1EDITUAoOigl9nvfbqcCcduZSp2tSXEmD65dhWjYyT4XNPQ0uOQHjyLLuZZNInBlxvtCfU-zko2OsMwcMFpinuYzl4AZhEjG4u4xMMbqTsVS_UxtyuU29JsPo9HParFu3pBQT1GPzCYyN7K4 Jul 19 22:32:50.768710 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:32:50.768710 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:32:50.768710 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:32:50.768710 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:32:50.768710 n-d-847009-3 devstack@n-api.service[119337]: X-Openstack-Nova-Api-Version: 2.53 Jul 19 22:32:50.768710 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:32:50.768710 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:32:50.768710 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08c7939457484ff7a5795fcc4318a77a Jul 19 22:32:50.768710 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1137449555 Jul 19 22:32:50.768710 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:32:50.768710 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:32:50.770738 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08c7939457484ff7a5795fcc4318a77a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08c7939457484ff7a5795fcc4318a77a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08c7939457484ff7a5795fcc4318a77a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08c7939457484ff7a5795fcc4318a77a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:50.770738 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1137449555 Jul 19 22:32:50.770738 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08c7939457484ff7a5795fcc4318a77a Jul 19 22:32:50.770738 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1137449555 Jul 19 22:32:50.770738 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin Jul 19 22:32:50.770738 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:32:50.770738 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:32:50.770738 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 6b93c4ce93c94511997204bdc13a25c3 Jul 19 22:32:50.770738 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin Jul 19 22:32:50.770738 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:32:50.770738 n-d-847009-3 devstack@n-api.service[119337]: {"status": "disabled"} Jul 19 22:32:50.770738 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:32:50.770738 n-d-847009-3 devstack@n-api.service[119337]: exception: Service d55f4339-497f-45ff-94fe-dcb3bed47ca9 could not be found. Jul 19 22:32:50.770738 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'd55f4339-497f-45ff-94fe-dcb3bed47ca9', 'body': {'status': 'disabled'}} Jul 19 22:32:50.775489 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:50.775489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:50.775489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 19 22:32:50.775489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 19 22:32:50.775489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 19 22:32:50.775489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 19 22:32:50.775489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 19 22:32:50.775489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:50.775489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:50.775489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:50.775489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:50.775489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 19 22:32:50.775489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 19 22:32:50.775489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 19 22:32:50.775489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 19 22:32:50.775489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service d55f4339-497f-45ff-94fe-dcb3bed47ca9 could not be found. Jul 19 22:32:50.775489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:50.775489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:50.775489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:50.775489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:50.775489 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:50.777255 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:50.777255 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:50.777255 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:50.777255 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:32:50.777255 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:32:50.777255 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:50.777255 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:50.777255 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:32:50.777255 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:32:50.777255 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 19 22:32:50.777255 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:32:50.777255 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service d55f4339-497f-45ff-94fe-dcb3bed47ca9 could not be found. Jul 19 22:32:50.777255 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:50.777255 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:50.777255 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:50.777255 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:50.777255 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:50.777255 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:50.777255 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:50.777255 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:50.778894 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service d55f4339-497f-45ff-94fe-dcb3bed47ca9 could not be found. Jul 19 22:32:50.778894 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:50.798879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3d7fb2f8-28f1-4d69-a66c-3c6ae87bc9b3 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Returning 404 to user: Service d55f4339-497f-45ff-94fe-dcb3bed47ca9 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:50.801106 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3d7fb2f8-28f1-4d69-a66c-3c6ae87bc9b3 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/d55f4339-497f-45ff-94fe-dcb3bed47ca9" status: 404 len: 110 microversion: 2.53 time: 0.089895 Jul 19 22:32:50.807279 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 853/1717] 10.222.0.25 () {62 vars in 1308 bytes} [Tue Jul 19 22:32:50 2022] PUT /compute/v2.1/os-services/d55f4339-497f-45ff-94fe-dcb3bed47ca9 => generated 110 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:32:50.824416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-50d7c97c-66cc-484e-b395-6ee89c0ca05c tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:50.826189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-50d7c97c-66cc-484e-b395-6ee89c0ca05c tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:50.852326 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-50d7c97c-66cc-484e-b395-6ee89c0ca05c tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:50.852781 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-50d7c97c-66cc-484e-b395-6ee89c0ca05c tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:50.862971 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-50d7c97c-66cc-484e-b395-6ee89c0ca05c tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:50.863641 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-50d7c97c-66cc-484e-b395-6ee89c0ca05c tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:50.869981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:32:51.014500 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-50d7c97c-66cc-484e-b395-6ee89c0ca05c tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.205756 Jul 19 22:32:51.032202 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 854/1718] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:32:50 2022] GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments => generated 197 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:51.042599 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8cba7ad3-a8e4-441c-a377-04492ebc79fe tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:51.047255 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8cba7ad3-a8e4-441c-a377-04492ebc79fe tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:51.065504 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8cba7ad3-a8e4-441c-a377-04492ebc79fe tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:51.066122 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8cba7ad3-a8e4-441c-a377-04492ebc79fe tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:51.070484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8cba7ad3-a8e4-441c-a377-04492ebc79fe tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:51.070960 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8cba7ad3-a8e4-441c-a377-04492ebc79fe tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:51.715725 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8cba7ad3-a8e4-441c-a377-04492ebc79fe tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:51.729482 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8cba7ad3-a8e4-441c-a377-04492ebc79fe tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1210 microversion: 2.1 time: 0.695678 Jul 19 22:32:51.740590 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 855/1719] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:51 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1210 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:51.746975 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8f813815-73a9-4aca-9402-c5b831fcc764 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Action: 'update', calling method: .version_select at 0x7f7a03e04ee0>, body: {"status": "enabled"} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:51.748556 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:32:51.748556 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:32:51.750076 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f813815-73a9-4aca-9402-c5b831fcc764 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:51.750763 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f813815-73a9-4aca-9402-c5b831fcc764 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:51.757468 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f813815-73a9-4aca-9402-c5b831fcc764 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:51.758958 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f813815-73a9-4aca-9402-c5b831fcc764 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:51.767218 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-8f813815-73a9-4aca-9402-c5b831fcc764 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] HTTP exception thrown: Service d55f4339-497f-45ff-94fe-dcb3bed47ca9 could not be found. Jul 19 22:32:51.769153 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8f813815-73a9-4aca-9402-c5b831fcc764 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Request method failure captured: Jul 19 22:32:51.769153 n-d-847009-3 devstack@n-api.service[119337]: request: PUT /compute/v2.1/os-services/d55f4339-497f-45ff-94fe-dcb3bed47ca9 HTTP/1.1 Jul 19 22:32:51.769153 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:32:51.769153 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:32:51.769153 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:32:51.769153 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 21 Jul 19 22:32:51.769153 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:32:51.769153 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:32:51.769153 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:32:51.769153 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:51.769153 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zEP9ri9AygQt-n1w9ZkRKpXue0Y-Bi1EDITUAoOigl9nvfbqcCcduZSp2tSXEmD65dhWjYyT4XNPQ0uOQHjyLLuZZNInBlxvtCfU-zko2OsMwcMFpinuYzl4AZhEjG4u4xMMbqTsVS_UxtyuU29JsPo9HParFu3pBQT1GPzCYyN7K4 Jul 19 22:32:51.769153 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:32:51.769153 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:32:51.769153 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:32:51.769153 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:32:51.769153 n-d-847009-3 devstack@n-api.service[119337]: X-Openstack-Nova-Api-Version: 2.53 Jul 19 22:32:51.769153 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:32:51.769153 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:32:51.769153 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08c7939457484ff7a5795fcc4318a77a Jul 19 22:32:51.769153 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1137449555 Jul 19 22:32:51.769153 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:32:51.769153 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:32:51.770665 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08c7939457484ff7a5795fcc4318a77a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08c7939457484ff7a5795fcc4318a77a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08c7939457484ff7a5795fcc4318a77a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08c7939457484ff7a5795fcc4318a77a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:51.770665 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1137449555 Jul 19 22:32:51.770665 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08c7939457484ff7a5795fcc4318a77a Jul 19 22:32:51.770665 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1137449555 Jul 19 22:32:51.770665 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin Jul 19 22:32:51.770665 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:32:51.770665 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:32:51.770665 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 6b93c4ce93c94511997204bdc13a25c3 Jul 19 22:32:51.770665 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin Jul 19 22:32:51.770665 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:32:51.770665 n-d-847009-3 devstack@n-api.service[119337]: {"status": "enabled"} Jul 19 22:32:51.770665 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:32:51.770665 n-d-847009-3 devstack@n-api.service[119337]: exception: Service d55f4339-497f-45ff-94fe-dcb3bed47ca9 could not be found. Jul 19 22:32:51.770665 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'd55f4339-497f-45ff-94fe-dcb3bed47ca9', 'body': {'status': 'enabled'}} Jul 19 22:32:51.771630 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:51.771630 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:51.771630 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 19 22:32:51.771630 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 19 22:32:51.771630 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 19 22:32:51.771630 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 19 22:32:51.771630 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 19 22:32:51.771630 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:51.771630 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:51.771630 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:51.771630 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:51.771630 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 19 22:32:51.771630 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 19 22:32:51.771630 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 19 22:32:51.771630 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 19 22:32:51.771630 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service d55f4339-497f-45ff-94fe-dcb3bed47ca9 could not be found. Jul 19 22:32:51.771630 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:51.771630 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:51.771630 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:51.771630 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:51.771630 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:51.773054 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:51.773054 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:51.773054 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:51.773054 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:32:51.773054 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:32:51.773054 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:51.773054 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:51.773054 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:32:51.773054 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:32:51.773054 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 19 22:32:51.773054 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:32:51.773054 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service d55f4339-497f-45ff-94fe-dcb3bed47ca9 could not be found. Jul 19 22:32:51.773054 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:51.773054 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:51.773054 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:51.773054 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:51.773054 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:51.773054 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:51.773054 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:51.773054 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:51.774325 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service d55f4339-497f-45ff-94fe-dcb3bed47ca9 could not be found. Jul 19 22:32:51.774325 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:51.794756 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8f813815-73a9-4aca-9402-c5b831fcc764 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Returning 404 to user: Service d55f4339-497f-45ff-94fe-dcb3bed47ca9 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:51.796611 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8f813815-73a9-4aca-9402-c5b831fcc764 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/d55f4339-497f-45ff-94fe-dcb3bed47ca9" status: 404 len: 110 microversion: 2.53 time: 0.054632 Jul 19 22:32:51.799413 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 856/1720] 10.222.0.25 () {62 vars in 1308 bytes} [Tue Jul 19 22:32:51 2022] PUT /compute/v2.1/os-services/d55f4339-497f-45ff-94fe-dcb3bed47ca9 => generated 110 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:32:51.811551 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-0322db3c-74b2-4090-9f03-bfde800563a7 req-b172aed7-ef38-41d5-968c-1ee15783750d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fded340-0a2a-4b49-8988-53d61dcd8021", "tag": "cb6cd53b-ccaa-46d2-be9c-ba3c44c8d66e"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:51.843824 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-0322db3c-74b2-4090-9f03-bfde800563a7 req-b172aed7-ef38-41d5-968c-1ee15783750d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:51.844580 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-0322db3c-74b2-4090-9f03-bfde800563a7 req-b172aed7-ef38-41d5-968c-1ee15783750d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:51.873663 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-0322db3c-74b2-4090-9f03-bfde800563a7 req-b172aed7-ef38-41d5-968c-1ee15783750d service nova] Creating event network-changed:cb6cd53b-ccaa-46d2-be9c-ba3c44c8d66e for instance 6fded340-0a2a-4b49-8988-53d61dcd8021 on n-h2-847009-3 Jul 19 22:32:51.885395 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-0322db3c-74b2-4090-9f03-bfde800563a7 req-b172aed7-ef38-41d5-968c-1ee15783750d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083866 Jul 19 22:32:51.886214 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 857/1721] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:51.902297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e02f646d-643e-49c5-ae0d-7e56571b04c2 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:51.904281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e02f646d-643e-49c5-ae0d-7e56571b04c2 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:51.916490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e02f646d-643e-49c5-ae0d-7e56571b04c2 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:51.917355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e02f646d-643e-49c5-ae0d-7e56571b04c2 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:51.919213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e02f646d-643e-49c5-ae0d-7e56571b04c2 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:51.922129 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e02f646d-643e-49c5-ae0d-7e56571b04c2 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:52.304437 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-e02f646d-643e-49c5-ae0d-7e56571b04c2 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lazy-loading 'services' on Instance uuid 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:32:52.338976 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e02f646d-643e-49c5-ae0d-7e56571b04c2 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1929 microversion: 2.75 time: 0.450481 Jul 19 22:32:52.339854 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 858/1722] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:51 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1929 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:52.357994 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-51656e0f-fb96-4b4a-a0cd-b1b33f0dc3c0 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:52.359079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-51656e0f-fb96-4b4a-a0cd-b1b33f0dc3c0 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] [instance: 6fded340-0a2a-4b49-8988-53d61dcd8021] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:52.371894 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51656e0f-fb96-4b4a-a0cd-b1b33f0dc3c0 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:52.372641 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51656e0f-fb96-4b4a-a0cd-b1b33f0dc3c0 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:52.373623 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51656e0f-fb96-4b4a-a0cd-b1b33f0dc3c0 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:52.374558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51656e0f-fb96-4b4a-a0cd-b1b33f0dc3c0 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:53.193846 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-51656e0f-fb96-4b4a-a0cd-b1b33f0dc3c0 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4020bca56fb34848b4f6c8d7d1b7b10a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd240e28831304ae890a9bf83a9383111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:53.203441 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-51656e0f-fb96-4b4a-a0cd-b1b33f0dc3c0 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] 10.222.0.25 "GET /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021" status: 200 len: 1316 microversion: 2.1 time: 0.850131 Jul 19 22:32:53.204183 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 859/1723] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:52 2022] GET /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021 => generated 1316 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:53.209028 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a417a0b8-f182-42f1-ba47-acbd1c350181 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:53.213140 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:32:53.213140 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:32:53.214896 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a417a0b8-f182-42f1-ba47-acbd1c350181 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:53.219737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a417a0b8-f182-42f1-ba47-acbd1c350181 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:53.221126 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a417a0b8-f182-42f1-ba47-acbd1c350181 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:53.221969 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a417a0b8-f182-42f1-ba47-acbd1c350181 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:53.258437 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a417a0b8-f182-42f1-ba47-acbd1c350181 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.053015 Jul 19 22:32:53.259711 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 860/1724] 10.222.0.25 () {60 vars in 1177 bytes} [Tue Jul 19 22:32:53 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:53.265090 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7f938a7b-a649-4d28-b1a8-f2005da0f227 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:53.266354 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7f938a7b-a649-4d28-b1a8-f2005da0f227 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:53.277987 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7f938a7b-a649-4d28-b1a8-f2005da0f227 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:53.278929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7f938a7b-a649-4d28-b1a8-f2005da0f227 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:53.279830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7f938a7b-a649-4d28-b1a8-f2005da0f227 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:53.280571 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7f938a7b-a649-4d28-b1a8-f2005da0f227 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:53.320905 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7f938a7b-a649-4d28-b1a8-f2005da0f227 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059463 Jul 19 22:32:53.322254 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 861/1725] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:32:53 2022] GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:53.327503 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-23fb9ca1-43d1-4974-a4cf-68fd538fc25f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:53.328328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-23fb9ca1-43d1-4974-a4cf-68fd538fc25f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:53.339277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-23fb9ca1-43d1-4974-a4cf-68fd538fc25f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:53.339734 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-23fb9ca1-43d1-4974-a4cf-68fd538fc25f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:53.340591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-23fb9ca1-43d1-4974-a4cf-68fd538fc25f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:53.341031 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-23fb9ca1-43d1-4974-a4cf-68fd538fc25f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:53.685236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-23fb9ca1-43d1-4974-a4cf-68fd538fc25f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:53.694543 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-23fb9ca1-43d1-4974-a4cf-68fd538fc25f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1198 microversion: 2.1 time: 0.370589 Jul 19 22:32:53.695979 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 862/1726] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:53 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1198 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:53.708817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2a0f5e9f-3204-4e25-9945-3e7c95820c43 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:53.711395 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:32:53.711395 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:32:53.717087 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2a0f5e9f-3204-4e25-9945-3e7c95820c43 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:53.717788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2a0f5e9f-3204-4e25-9945-3e7c95820c43 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:53.718867 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2a0f5e9f-3204-4e25-9945-3e7c95820c43 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:53.723915 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2a0f5e9f-3204-4e25-9945-3e7c95820c43 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:53.790344 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2a0f5e9f-3204-4e25-9945-3e7c95820c43 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.093020 Jul 19 22:32:53.790977 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 863/1727] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Jul 19 22:32:53 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:53.795468 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-849ad0c2-f2d8-4a8e-9f85-bd8dff19f913 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:53.796083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-849ad0c2-f2d8-4a8e-9f85-bd8dff19f913 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:53.810421 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-849ad0c2-f2d8-4a8e-9f85-bd8dff19f913 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:53.810878 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-849ad0c2-f2d8-4a8e-9f85-bd8dff19f913 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:53.811714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-849ad0c2-f2d8-4a8e-9f85-bd8dff19f913 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:53.812148 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-849ad0c2-f2d8-4a8e-9f85-bd8dff19f913 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:53.984892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-849ad0c2-f2d8-4a8e-9f85-bd8dff19f913 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lazy-loading 'services' on Instance uuid 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:32:54.057962 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-849ad0c2-f2d8-4a8e-9f85-bd8dff19f913 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1929 microversion: 2.75 time: 0.259171 Jul 19 22:32:54.061391 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 864/1728] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:53 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1929 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:54.079211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-60f31c51-f88a-4cdd-b4a1-525de9c5b9e9 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:54.081871 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:32:54.081871 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:32:54.098550 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60f31c51-f88a-4cdd-b4a1-525de9c5b9e9 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:54.100301 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60f31c51-f88a-4cdd-b4a1-525de9c5b9e9 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:54.104546 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60f31c51-f88a-4cdd-b4a1-525de9c5b9e9 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:54.106355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60f31c51-f88a-4cdd-b4a1-525de9c5b9e9 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:54.150584 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-60f31c51-f88a-4cdd-b4a1-525de9c5b9e9 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.086686 Jul 19 22:32:54.158850 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 865/1729] 10.222.0.25 () {60 vars in 1177 bytes} [Tue Jul 19 22:32:54 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:54.165164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0372be19-564a-441b-ad90-cfa74fdc6153 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:54.168133 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:32:54.168133 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:32:54.170581 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0372be19-564a-441b-ad90-cfa74fdc6153 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:54.171462 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0372be19-564a-441b-ad90-cfa74fdc6153 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:54.172907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0372be19-564a-441b-ad90-cfa74fdc6153 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:54.173615 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0372be19-564a-441b-ad90-cfa74fdc6153 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:54.213095 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0372be19-564a-441b-ad90-cfa74fdc6153 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-847009-3&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.052085 Jul 19 22:32:54.220759 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 866/1730] 10.222.0.25 () {60 vars in 1234 bytes} [Tue Jul 19 22:32:54 2022] GET /compute/v2.1/os-services?host=n-d-847009-3&binary=xxx => generated 16 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:54.229978 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a162b882-c1df-4e91-8773-643e21580163 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:54.231493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a162b882-c1df-4e91-8773-643e21580163 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] [instance: 6fded340-0a2a-4b49-8988-53d61dcd8021] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:54.243624 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a162b882-c1df-4e91-8773-643e21580163 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:54.244338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a162b882-c1df-4e91-8773-643e21580163 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:54.245480 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a162b882-c1df-4e91-8773-643e21580163 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:54.246120 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a162b882-c1df-4e91-8773-643e21580163 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:54.303622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:32:54.436869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:32:54.704483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a162b882-c1df-4e91-8773-643e21580163 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4020bca56fb34848b4f6c8d7d1b7b10a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd240e28831304ae890a9bf83a9383111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:54.718811 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a162b882-c1df-4e91-8773-643e21580163 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] 10.222.0.25 "GET /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021" status: 200 len: 1316 microversion: 2.1 time: 0.496436 Jul 19 22:32:54.721751 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 867/1731] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:54 2022] GET /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021 => generated 1316 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:54.731002 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6b7b207b-e3fe-4149-8bfb-bae30b230735 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:54.737632 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:32:54.737632 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:32:54.739438 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b7b207b-e3fe-4149-8bfb-bae30b230735 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:54.742700 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b7b207b-e3fe-4149-8bfb-bae30b230735 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:54.743871 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b7b207b-e3fe-4149-8bfb-bae30b230735 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:54.747844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b7b207b-e3fe-4149-8bfb-bae30b230735 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:54.847317 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6b7b207b-e3fe-4149-8bfb-bae30b230735 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.119721 Jul 19 22:32:54.848433 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 868/1732] 10.222.0.25 () {60 vars in 1177 bytes} [Tue Jul 19 22:32:54 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:54.854900 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-39de704c-e810-4eec-b50b-1b21916739e2 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:54.856960 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-39de704c-e810-4eec-b50b-1b21916739e2 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:54.864595 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39de704c-e810-4eec-b50b-1b21916739e2 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:54.865165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39de704c-e810-4eec-b50b-1b21916739e2 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:54.866432 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39de704c-e810-4eec-b50b-1b21916739e2 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:54.867204 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39de704c-e810-4eec-b50b-1b21916739e2 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:54.904208 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-39de704c-e810-4eec-b50b-1b21916739e2 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054435 Jul 19 22:32:54.905225 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 869/1733] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:32:54 2022] GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:54.911525 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a3dd9395-acbf-4438-9ab7-aa9910aec935 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:54.912558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a3dd9395-acbf-4438-9ab7-aa9910aec935 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:54.920376 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a3dd9395-acbf-4438-9ab7-aa9910aec935 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:54.921835 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a3dd9395-acbf-4438-9ab7-aa9910aec935 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:54.922798 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a3dd9395-acbf-4438-9ab7-aa9910aec935 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:54.923439 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a3dd9395-acbf-4438-9ab7-aa9910aec935 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:55.673253 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a3dd9395-acbf-4438-9ab7-aa9910aec935 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:55.681119 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b877d63c-7a73-4072-9375-645cb860cb13 tempest-FloatingIPDetailsTestJSON-1529178395 tempest-FloatingIPDetailsTestJSON-1529178395-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.196479 Jul 19 22:32:55.682747 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 865/1734] 10.222.0.25 () {60 vars in 1169 bytes} [Tue Jul 19 22:32:50 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:55.692416 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-18a92758-a73d-4a85-94ca-f78e3fb28a98 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:55.694056 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:32:55.694056 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:32:55.694390 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a3dd9395-acbf-4438-9ab7-aa9910aec935 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1198 microversion: 2.1 time: 0.787327 Jul 19 22:32:55.695012 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 870/1735] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:54 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1198 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:55.699735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-258579c3-65ad-4fe9-9318-6ab4f6908e54 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:55.700774 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-258579c3-65ad-4fe9-9318-6ab4f6908e54 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:55.705356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-18a92758-a73d-4a85-94ca-f78e3fb28a98 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:55.705825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-18a92758-a73d-4a85-94ca-f78e3fb28a98 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:55.706674 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-18a92758-a73d-4a85-94ca-f78e3fb28a98 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:55.707133 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-18a92758-a73d-4a85-94ca-f78e3fb28a98 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:55.711851 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-258579c3-65ad-4fe9-9318-6ab4f6908e54 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:55.712741 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-258579c3-65ad-4fe9-9318-6ab4f6908e54 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:55.713932 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-258579c3-65ad-4fe9-9318-6ab4f6908e54 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:55.714374 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-258579c3-65ad-4fe9-9318-6ab4f6908e54 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:55.754039 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-18a92758-a73d-4a85-94ca-f78e3fb28a98 tempest-ServicesAdminNegativeV253TestJSON-1137449555 tempest-ServicesAdminNegativeV253TestJSON-1137449555-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.069943 Jul 19 22:32:55.758263 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 866/1736] 10.222.0.25 () {60 vars in 1238 bytes} [Tue Jul 19 22:32:55 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:55.768998 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-120edfef-845f-4f3a-9eb3-c66a3567a40e tempest-FloatingIPDetailsTestJSON-1529178395 tempest-FloatingIPDetailsTestJSON-1529178395-project] Action: 'create', calling method: .version_select at 0x7f7a15694670>, body: {"pool": null} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:55.862952 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-258579c3-65ad-4fe9-9318-6ab4f6908e54 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lazy-loading 'services' on Instance uuid 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:32:55.910659 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-258579c3-65ad-4fe9-9318-6ab4f6908e54 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1929 microversion: 2.75 time: 0.214108 Jul 19 22:32:55.911229 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 871/1737] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:55 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1929 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:55.925145 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d9dc39fe-b523-4c54-adb9-5c8eec376984 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:55.926223 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d9dc39fe-b523-4c54-adb9-5c8eec376984 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] [instance: 6fded340-0a2a-4b49-8988-53d61dcd8021] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:55.940218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d9dc39fe-b523-4c54-adb9-5c8eec376984 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:55.940680 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d9dc39fe-b523-4c54-adb9-5c8eec376984 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:55.943765 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d9dc39fe-b523-4c54-adb9-5c8eec376984 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:55.944481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d9dc39fe-b523-4c54-adb9-5c8eec376984 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:56.306936 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d9dc39fe-b523-4c54-adb9-5c8eec376984 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4020bca56fb34848b4f6c8d7d1b7b10a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd240e28831304ae890a9bf83a9383111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:56.315580 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d9dc39fe-b523-4c54-adb9-5c8eec376984 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] 10.222.0.25 "GET /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021" status: 200 len: 1316 microversion: 2.1 time: 0.402310 Jul 19 22:32:56.320291 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 872/1738] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:55 2022] GET /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021 => generated 1316 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:56.572910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-140eb7de-ac9d-4232-ac1c-9c92ed0b8256 tempest-ServicesAdminNegativeV253TestJSON-1821763350 tempest-ServicesAdminNegativeV253TestJSON-1821763350-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:56.575469 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:32:56.575469 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:32:56.577189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-140eb7de-ac9d-4232-ac1c-9c92ed0b8256 tempest-ServicesAdminNegativeV253TestJSON-1821763350 tempest-ServicesAdminNegativeV253TestJSON-1821763350-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '864fbfc989004cebb9acfc2498c3d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c54d8e88fbe42fb80efee478f8e4f80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:56.578950 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-140eb7de-ac9d-4232-ac1c-9c92ed0b8256 tempest-ServicesAdminNegativeV253TestJSON-1821763350 tempest-ServicesAdminNegativeV253TestJSON-1821763350-project] Request method failure captured: Jul 19 22:32:56.578950 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 19 22:32:56.578950 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:32:56.578950 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:32:56.578950 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:32:56.578950 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:32:56.578950 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:32:56.578950 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:32:56.578950 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:32:56.578950 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:56.578950 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zENQvqbjOqw0uVOx62CWVKR8Wdkuy1qd0AgveX_NahemSnTqzj-7gQ58tdZF3pVdayXn7UoxQM1F99cxfUzlX_FwBNpgmFBpasEFgzyswB6KO6EN_uMBn3x4hlnc7e6KLh_4DCi4pTi7Gxw2_917wveBks4eHKekqfI9yikUfUWuOU Jul 19 22:32:56.578950 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:32:56.578950 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:32:56.578950 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:32:56.578950 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:32:56.578950 n-d-847009-3 devstack@n-api.service[119337]: X-Openstack-Nova-Api-Version: 2.53 Jul 19 22:32:56.578950 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:32:56.578950 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:32:56.578950 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 4c54d8e88fbe42fb80efee478f8e4f80 Jul 19 22:32:56.578950 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1821763350 Jul 19 22:32:56.578950 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:32:56.578950 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:32:56.580532 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4c54d8e88fbe42fb80efee478f8e4f80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c54d8e88fbe42fb80efee478f8e4f80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4c54d8e88fbe42fb80efee478f8e4f80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c54d8e88fbe42fb80efee478f8e4f80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:56.580532 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1821763350 Jul 19 22:32:56.580532 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 4c54d8e88fbe42fb80efee478f8e4f80 Jul 19 22:32:56.580532 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1821763350 Jul 19 22:32:56.580532 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1821763350-project Jul 19 22:32:56.580532 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:32:56.580532 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:32:56.580532 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 864fbfc989004cebb9acfc2498c3d1c1 Jul 19 22:32:56.580532 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1821763350-project Jul 19 22:32:56.580532 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:32:56.580532 n-d-847009-3 devstack@n-api.service[119337]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 19 22:32:56.580532 n-d-847009-3 devstack@n-api.service[119337]: action_args: {} Jul 19 22:32:56.581365 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:56.581365 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:56.581365 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:56.581365 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:56.581365 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:56.581365 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:56.581365 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 22:32:56.581365 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:32:56.581365 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 22:32:56.581365 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:32:56.581365 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:56.581365 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:56.581365 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 19 22:32:56.581365 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 19 22:32:56.581365 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:32:56.581365 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:32:56.581365 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:32:56.581365 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:32:56.581365 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:32:56.582604 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:32:56.582604 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:32:56.582604 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:32:56.582604 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:32:56.582604 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:32:56.582604 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:32:56.582604 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:32:56.582604 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:32:56.582604 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:32:56.582604 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 19 22:32:56.582604 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:56.582604 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:56.582604 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:56.582604 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:56.582604 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:56.582604 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:56.582604 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:32:56.582604 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:32:56.582604 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 19 22:32:56.582604 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:56.584073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-140eb7de-ac9d-4232-ac1c-9c92ed0b8256 tempest-ServicesAdminNegativeV253TestJSON-1821763350 tempest-ServicesAdminNegativeV253TestJSON-1821763350-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:56.584073 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-140eb7de-ac9d-4232-ac1c-9c92ed0b8256 tempest-ServicesAdminNegativeV253TestJSON-1821763350 tempest-ServicesAdminNegativeV253TestJSON-1821763350-project] 10.222.0.25 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.259148 Jul 19 22:32:56.593273 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 873/1739] 10.222.0.25 () {60 vars in 1177 bytes} [Tue Jul 19 22:32:56 2022] GET /compute/v2.1/os-services => generated 112 bytes in 272 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:32:56.601617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e33b9609-3d92-4871-9ceb-74999355e768 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:56.607827 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e33b9609-3d92-4871-9ceb-74999355e768 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:56.625249 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e33b9609-3d92-4871-9ceb-74999355e768 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:56.625700 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e33b9609-3d92-4871-9ceb-74999355e768 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:56.626504 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e33b9609-3d92-4871-9ceb-74999355e768 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:56.633994 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e33b9609-3d92-4871-9ceb-74999355e768 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:56.706670 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e33b9609-3d92-4871-9ceb-74999355e768 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105921 Jul 19 22:32:56.708523 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 874/1740] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:32:56 2022] GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:56.886672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-619b9af1-4d1e-43c3-83cc-ee4d6640923c tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] Calling method '.version_select at 0x7f7a03e041f0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:56.948877 n-d-847009-3 devstack@n-api.service[119337]: DEBUG neutronclient.v2_0.client [None req-619b9af1-4d1e-43c3-83cc-ee4d6640923c tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9a3d84fe-75bc-414b-9516-3e72a146a8a8 does not exist", "detail": ""}} {{(pid=119337) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 22:32:56.950510 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.security_group_api [None req-619b9af1-4d1e-43c3-83cc-ee4d6640923c tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] Neutron security group 9a3d84fe-75bc-414b-9516-3e72a146a8a8 not found {{(pid=119337) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 22:32:56.951248 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-619b9af1-4d1e-43c3-83cc-ee4d6640923c tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] HTTP exception thrown: Security group 9a3d84fe-75bc-414b-9516-3e72a146a8a8 does not exist Jul 19 22:32:56.951248 n-d-847009-3 devstack@n-api.service[119337]: Neutron server returns request_ids: ['req-94d1aa1f-901f-4dee-9bd0-af0f0cc0916f'] Jul 19 22:32:56.955487 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-619b9af1-4d1e-43c3-83cc-ee4d6640923c tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] Request method failure captured: Jul 19 22:32:56.955487 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/os-security-groups/9a3d84fe-75bc-414b-9516-3e72a146a8a8 HTTP/1.1 Jul 19 22:32:56.955487 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:32:56.955487 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:32:56.955487 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:32:56.955487 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:32:56.955487 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:32:56.955487 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:32:56.955487 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:32:56.955487 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:32:56.955487 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zEX9Of-lEgRTOpTZ4zydUMS2mvrmL2mPtVkQ2yun1ZNIQkluk4osGdydaSUWJ_HNQEdcOajdnof_LASlINmTCTjAFqqcLgS7sP6NvaW6Wcn73Ea15VR9WRLY_Lp-QgOgZdippiXIxu-ZoB9aQ3udHrjeDBhZgX1vD6693ppkunX9rk Jul 19 22:32:56.955487 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:32:56.955487 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:32:56.955487 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:32:56.955487 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:32:56.955487 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:32:56.955487 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:32:56.955487 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: f1e17cbd723942609c5be6a0b055806b Jul 19 22:32:56.955487 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1887358563 Jul 19 22:32:56.955487 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:32:56.955487 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:32:56.957229 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1e17cbd723942609c5be6a0b055806b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1e17cbd723942609c5be6a0b055806b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1e17cbd723942609c5be6a0b055806b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1e17cbd723942609c5be6a0b055806b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:32:56.957229 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1887358563 Jul 19 22:32:56.957229 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: f1e17cbd723942609c5be6a0b055806b Jul 19 22:32:56.957229 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1887358563 Jul 19 22:32:56.957229 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-SecurityGroupsNegativeTestJSON-1887358563-project Jul 19 22:32:56.957229 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:32:56.957229 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:32:56.957229 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 02618b10dc0f4ad7b90feabaa6a80fb7 Jul 19 22:32:56.957229 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1887358563-project Jul 19 22:32:56.957229 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:32:56.957229 n-d-847009-3 devstack@n-api.service[119337]: exception: Security group 9a3d84fe-75bc-414b-9516-3e72a146a8a8 does not exist Jul 19 22:32:56.957229 n-d-847009-3 devstack@n-api.service[119337]: Neutron server returns request_ids: ['req-94d1aa1f-901f-4dee-9bd0-af0f0cc0916f'] Jul 19 22:32:56.957229 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '9a3d84fe-75bc-414b-9516-3e72a146a8a8'} Jul 19 22:32:56.958159 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:32:56.958159 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:56.958159 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 22:32:56.958159 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 22:32:56.958159 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:32:56.958159 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:32:56.958159 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 22:32:56.958159 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 22:32:56.958159 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:32:56.958159 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:32:56.958159 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 22:32:56.958159 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 22:32:56.958159 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:32:56.958159 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:32:56.958159 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 22:32:56.958159 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 22:32:56.958159 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:32:56.958159 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:32:56.958159 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 22:32:56.960126 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 22:32:56.960126 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:32:56.960126 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:32:56.960126 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 22:32:56.960126 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 22:32:56.960126 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 22:32:56.960126 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 22:32:56.960126 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9a3d84fe-75bc-414b-9516-3e72a146a8a8 does not exist Jul 19 22:32:56.960126 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-94d1aa1f-901f-4dee-9bd0-af0f0cc0916f'] Jul 19 22:32:56.960126 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:56.960126 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:56.960126 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:56.960126 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:56.960126 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 19 22:32:56.960126 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 22:32:56.960126 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 22:32:56.960126 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 22:32:56.960126 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9a3d84fe-75bc-414b-9516-3e72a146a8a8 does not exist Jul 19 22:32:56.961641 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-94d1aa1f-901f-4dee-9bd0-af0f0cc0916f'] Jul 19 22:32:56.961641 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:56.961641 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:56.961641 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:56.961641 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:56.961641 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:56.961641 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:56.961641 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:32:56.961641 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:32:56.961641 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:32:56.961641 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:32:56.961641 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:32:56.961641 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:32:56.961641 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 19 22:32:56.961641 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 22:32:56.961641 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9a3d84fe-75bc-414b-9516-3e72a146a8a8 does not exist Jul 19 22:32:56.961641 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-94d1aa1f-901f-4dee-9bd0-af0f0cc0916f'] Jul 19 22:32:56.961641 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:56.961641 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:32:56.961641 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:56.961641 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:32:56.962993 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:32:56.962993 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:32:56.962993 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:32:56.962993 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:32:56.962993 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9a3d84fe-75bc-414b-9516-3e72a146a8a8 does not exist Jul 19 22:32:56.962993 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-94d1aa1f-901f-4dee-9bd0-af0f0cc0916f'] Jul 19 22:32:56.962993 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:32:56.962993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-619b9af1-4d1e-43c3-83cc-ee4d6640923c tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] Returning 404 to user: Security group 9a3d84fe-75bc-414b-9516-3e72a146a8a8 does not exist Jul 19 22:32:56.962993 n-d-847009-3 devstack@n-api.service[119337]: Neutron server returns request_ids: ['req-94d1aa1f-901f-4dee-9bd0-af0f0cc0916f'] {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:32:56.962993 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-619b9af1-4d1e-43c3-83cc-ee4d6640923c tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/9a3d84fe-75bc-414b-9516-3e72a146a8a8" status: 404 len: 194 microversion: 2.1 time: 0.247793 Jul 19 22:32:56.964505 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 875/1741] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:32:56 2022] DELETE /compute/v2.1/os-security-groups/9a3d84fe-75bc-414b-9516-3e72a146a8a8 => generated 194 bytes in 255 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:32:56.969603 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-556e43b2-88e2-4568-b0ba-39c77f83346d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:56.970233 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-556e43b2-88e2-4568-b0ba-39c77f83346d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:56.996421 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-556e43b2-88e2-4568-b0ba-39c77f83346d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:56.996823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-556e43b2-88e2-4568-b0ba-39c77f83346d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:56.997655 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-556e43b2-88e2-4568-b0ba-39c77f83346d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:56.998422 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-556e43b2-88e2-4568-b0ba-39c77f83346d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:57.046362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:32:57.465674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-556e43b2-88e2-4568-b0ba-39c77f83346d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:57.482943 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-556e43b2-88e2-4568-b0ba-39c77f83346d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1198 microversion: 2.1 time: 0.516952 Jul 19 22:32:57.484426 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 876/1742] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:56 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1198 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:57.494922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eccb501c-034d-40d5-a07a-39e1385e0a37 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:57.495282 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eccb501c-034d-40d5-a07a-39e1385e0a37 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:57.505500 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eccb501c-034d-40d5-a07a-39e1385e0a37 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:57.507093 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eccb501c-034d-40d5-a07a-39e1385e0a37 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:57.509230 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eccb501c-034d-40d5-a07a-39e1385e0a37 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:57.509928 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eccb501c-034d-40d5-a07a-39e1385e0a37 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:57.692533 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-eccb501c-034d-40d5-a07a-39e1385e0a37 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lazy-loading 'services' on Instance uuid 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:32:57.790559 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eccb501c-034d-40d5-a07a-39e1385e0a37 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1929 microversion: 2.75 time: 0.302371 Jul 19 22:32:57.804175 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 877/1743] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:32:57 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1929 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:32:57.817134 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f7b35de0-d557-4c6a-afc7-433e4a57b1a3 tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.011657 Jul 19 22:32:57.822525 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 878/1744] 10.222.0.25 () {58 vars in 1163 bytes} [Tue Jul 19 22:32:57 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 19 22:32:57.852529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-89af835f-2bf9-4b86-9a29-d88f1b59ce9d tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:57.854634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-89af835f-2bf9-4b86-9a29-d88f1b59ce9d tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] [instance: 6fded340-0a2a-4b49-8988-53d61dcd8021] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:57.875164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-89af835f-2bf9-4b86-9a29-d88f1b59ce9d tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:57.875625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-89af835f-2bf9-4b86-9a29-d88f1b59ce9d tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:57.876501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-89af835f-2bf9-4b86-9a29-d88f1b59ce9d tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:57.877898 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-89af835f-2bf9-4b86-9a29-d88f1b59ce9d tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:58.338241 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-120edfef-845f-4f3a-9eb3-c66a3567a40e tempest-FloatingIPDetailsTestJSON-1529178395 tempest-FloatingIPDetailsTestJSON-1529178395-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.578677 Jul 19 22:32:58.339611 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 867/1745] 10.222.0.25 () {60 vars in 1169 bytes} [Tue Jul 19 22:32:55 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:58.345091 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f4203254-0ef9-4181-a534-480f96a37554 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:58.347011 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f4203254-0ef9-4181-a534-480f96a37554 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:58.363536 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4203254-0ef9-4181-a534-480f96a37554 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:58.368426 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4203254-0ef9-4181-a534-480f96a37554 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:58.372279 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4203254-0ef9-4181-a534-480f96a37554 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:58.373026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4203254-0ef9-4181-a534-480f96a37554 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:58.418625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-89af835f-2bf9-4b86-9a29-d88f1b59ce9d tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4020bca56fb34848b4f6c8d7d1b7b10a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd240e28831304ae890a9bf83a9383111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:58.427998 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-89af835f-2bf9-4b86-9a29-d88f1b59ce9d tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] 10.222.0.25 "GET /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021" status: 200 len: 1316 microversion: 2.1 time: 0.608501 Jul 19 22:32:58.429423 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 879/1746] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:57 2022] GET /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021 => generated 1316 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:58.444245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b565017c-2b52-4666-9dd4-9d5eebe34adc tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] Calling method '.version_select at 0x7f7a03e7d8b0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:58.482707 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f4203254-0ef9-4181-a534-480f96a37554 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.141778 Jul 19 22:32:58.492588 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 868/1747] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:32:58 2022] GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e/os-volume_attachments => generated 25 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:32:58.529583 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-13d07d41-9d4d-4be6-a554-17a6eea7dbf7 tempest-FloatingIPDetailsTestJSON-1529178395 tempest-FloatingIPDetailsTestJSON-1529178395-project] Action: 'create', calling method: .version_select at 0x7f7a1562c700>, body: {"pool": null} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:59.079309 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b565017c-2b52-4666-9dd4-9d5eebe34adc tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.646436 Jul 19 22:32:59.081888 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 880/1748] 10.222.0.25 () {58 vars in 1157 bytes} [Tue Jul 19 22:32:58 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:59.091321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-52927561-6c4c-4028-bf04-150127b2eb48 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:32:59.093195 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-52927561-6c4c-4028-bf04-150127b2eb48 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:32:59.108411 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52927561-6c4c-4028-bf04-150127b2eb48 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:59.110816 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52927561-6c4c-4028-bf04-150127b2eb48 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:59.113850 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52927561-6c4c-4028-bf04-150127b2eb48 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:59.115272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52927561-6c4c-4028-bf04-150127b2eb48 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:59.400895 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-52927561-6c4c-4028-bf04-150127b2eb48 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:32:59.410067 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-52927561-6c4c-4028-bf04-150127b2eb48 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1198 microversion: 2.1 time: 0.326736 Jul 19 22:32:59.410787 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 881/1749] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:32:59 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1198 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:32:59.417475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-de2801ed-b895-4cf1-a7b5-173dad214b8f req-b1eef326-f358-4556-b92d-83a2bda78cba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fded340-0a2a-4b49-8988-53d61dcd8021", "name": "network-vif-plugged", "status": "completed", "tag": "cb6cd53b-ccaa-46d2-be9c-ba3c44c8d66e"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:59.427414 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-de2801ed-b895-4cf1-a7b5-173dad214b8f req-b1eef326-f358-4556-b92d-83a2bda78cba service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:32:59.428348 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-de2801ed-b895-4cf1-a7b5-173dad214b8f req-b1eef326-f358-4556-b92d-83a2bda78cba service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:32:59.442257 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-de2801ed-b895-4cf1-a7b5-173dad214b8f req-b1eef326-f358-4556-b92d-83a2bda78cba service nova] Creating event network-vif-plugged:cb6cd53b-ccaa-46d2-be9c-ba3c44c8d66e for instance 6fded340-0a2a-4b49-8988-53d61dcd8021 on n-h2-847009-3 Jul 19 22:32:59.450397 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-de2801ed-b895-4cf1-a7b5-173dad214b8f req-b1eef326-f358-4556-b92d-83a2bda78cba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037649 Jul 19 22:32:59.452315 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 882/1750] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:32:59.462654 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8027a4fb-bdd4-4ba0-a626-54aa4e7eba2e tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-360286525", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "15be07df-5570-4a1c-b54c-7d24b8519012"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:32:59.479331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:32:59.579646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-8027a4fb-bdd4-4ba0-a626-54aa4e7eba2e tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] validate_networks() for [('15be07df-5570-4a1c-b54c-7d24b8519012', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:33:00.372843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-8027a4fb-bdd4-4ba0-a626-54aa4e7eba2e tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:33:00.373467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-8027a4fb-bdd4-4ba0-a626-54aa4e7eba2e tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:33:00.373745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-8027a4fb-bdd4-4ba0-a626-54aa4e7eba2e tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:33:00.374164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-8027a4fb-bdd4-4ba0-a626-54aa4e7eba2e tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:33:00.374581 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-8027a4fb-bdd4-4ba0-a626-54aa4e7eba2e tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:33:00.399299 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8027a4fb-bdd4-4ba0-a626-54aa4e7eba2e tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:00.399788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8027a4fb-bdd4-4ba0-a626-54aa4e7eba2e tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:00.400706 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8027a4fb-bdd4-4ba0-a626-54aa4e7eba2e tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:00.401103 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8027a4fb-bdd4-4ba0-a626-54aa4e7eba2e tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:00.467752 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-8027a4fb-bdd4-4ba0-a626-54aa4e7eba2e tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Getting quotas for project a353634f70fb4ff58c7190a5c7aa675d. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:33:00.485741 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-8027a4fb-bdd4-4ba0-a626-54aa4e7eba2e tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Getting quotas for user 37267b4c360540489a72d9b0043abd87 and project a353634f70fb4ff58c7190a5c7aa675d. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:33:00.522719 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8027a4fb-bdd4-4ba0-a626-54aa4e7eba2e tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:33:00.526757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8027a4fb-bdd4-4ba0-a626-54aa4e7eba2e tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 3b832d3f-6d05-4494-be32-1250a88c787c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:33:00.606621 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8027a4fb-bdd4-4ba0-a626-54aa4e7eba2e tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.152389 Jul 19 22:33:00.607642 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 883/1751] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:32:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:33:00.620838 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2bc120c2-a780-417d-81af-3bee4bcc7a67 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:00.622133 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2bc120c2-a780-417d-81af-3bee4bcc7a67 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:00.630331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bc120c2-a780-417d-81af-3bee4bcc7a67 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:00.631319 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bc120c2-a780-417d-81af-3bee4bcc7a67 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:00.632601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bc120c2-a780-417d-81af-3bee4bcc7a67 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:00.633373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bc120c2-a780-417d-81af-3bee4bcc7a67 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:00.769130 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-2bc120c2-a780-417d-81af-3bee4bcc7a67 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lazy-loading 'services' on Instance uuid 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:33:00.811089 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2bc120c2-a780-417d-81af-3bee4bcc7a67 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1929 microversion: 2.75 time: 0.200831 Jul 19 22:33:00.813359 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 884/1752] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:00 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1929 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:33:00.840408 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d17173c9-3e09-44de-a39c-08a4ff235401 tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] Calling method '.version_select at 0x7f7a03ea99d0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:01.120738 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-13d07d41-9d4d-4be6-a554-17a6eea7dbf7 tempest-FloatingIPDetailsTestJSON-1529178395 tempest-FloatingIPDetailsTestJSON-1529178395-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.626694 Jul 19 22:33:01.122634 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 869/1753] 10.222.0.25 () {60 vars in 1169 bytes} [Tue Jul 19 22:32:58 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:33:01.130607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2d112b8b-56bc-47f9-a967-314f6708f99e tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:01.131667 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2d112b8b-56bc-47f9-a967-314f6708f99e tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] [instance: 6fded340-0a2a-4b49-8988-53d61dcd8021] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:01.145197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d112b8b-56bc-47f9-a967-314f6708f99e tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:01.146461 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d112b8b-56bc-47f9-a967-314f6708f99e tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:01.147557 n-d-847009-3 devstack@n-api.service[119337]: DEBUG neutronclient.v2_0.client [None req-d17173c9-3e09-44de-a39c-08a4ff235401 tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=119337) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 22:33:01.148279 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-d17173c9-3e09-44de-a39c-08a4ff235401 tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 19 22:33:01.148279 n-d-847009-3 devstack@n-api.service[119337]: Neutron server returns request_ids: ['req-2f64ad8c-09d1-4c0a-87da-76e121023eeb'] Jul 19 22:33:01.148985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d112b8b-56bc-47f9-a967-314f6708f99e tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:01.149758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d112b8b-56bc-47f9-a967-314f6708f99e tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:01.150517 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d17173c9-3e09-44de-a39c-08a4ff235401 tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] Request method failure captured: Jul 19 22:33:01.150517 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/os-security-groups/da883f31-fdef-418d-9e07-dc22f24b1d68 HTTP/1.1 Jul 19 22:33:01.150517 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:33:01.150517 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:33:01.150517 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:33:01.150517 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:33:01.150517 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:33:01.150517 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:33:01.150517 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:33:01.150517 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:33:01.150517 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zEX9Of-lEgRTOpTZ4zydUMS2mvrmL2mPtVkQ2yun1ZNIQkluk4osGdydaSUWJ_HNQEdcOajdnof_LASlINmTCTjAFqqcLgS7sP6NvaW6Wcn73Ea15VR9WRLY_Lp-QgOgZdippiXIxu-ZoB9aQ3udHrjeDBhZgX1vD6693ppkunX9rk Jul 19 22:33:01.150517 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:33:01.150517 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:33:01.150517 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:33:01.150517 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:33:01.150517 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:33:01.150517 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:33:01.150517 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: f1e17cbd723942609c5be6a0b055806b Jul 19 22:33:01.150517 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1887358563 Jul 19 22:33:01.150517 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:33:01.150517 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:33:01.152026 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1e17cbd723942609c5be6a0b055806b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1e17cbd723942609c5be6a0b055806b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1e17cbd723942609c5be6a0b055806b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1e17cbd723942609c5be6a0b055806b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:33:01.152026 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1887358563 Jul 19 22:33:01.152026 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: f1e17cbd723942609c5be6a0b055806b Jul 19 22:33:01.152026 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1887358563 Jul 19 22:33:01.152026 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-SecurityGroupsNegativeTestJSON-1887358563-project Jul 19 22:33:01.152026 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:33:01.152026 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:33:01.152026 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 02618b10dc0f4ad7b90feabaa6a80fb7 Jul 19 22:33:01.152026 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1887358563-project Jul 19 22:33:01.152026 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:33:01.152026 n-d-847009-3 devstack@n-api.service[119337]: exception: Insufficient rights for removing default security group. Jul 19 22:33:01.152026 n-d-847009-3 devstack@n-api.service[119337]: Neutron server returns request_ids: ['req-2f64ad8c-09d1-4c0a-87da-76e121023eeb'] Jul 19 22:33:01.152026 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'da883f31-fdef-418d-9e07-dc22f24b1d68'} Jul 19 22:33:01.153104 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:33:01.153104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:01.153104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 19 22:33:01.153104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 19 22:33:01.153104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:33:01.153104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:33:01.153104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 19 22:33:01.153104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 19 22:33:01.153104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:33:01.153104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:33:01.153104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 19 22:33:01.153104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 19 22:33:01.153104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:33:01.153104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:33:01.153104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 22:33:01.153104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 22:33:01.153104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:33:01.153104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:33:01.153104 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 22:33:01.154566 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 22:33:01.154566 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:33:01.154566 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:33:01.154566 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 22:33:01.154566 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 22:33:01.154566 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 22:33:01.154566 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 22:33:01.154566 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 19 22:33:01.154566 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f64ad8c-09d1-4c0a-87da-76e121023eeb'] Jul 19 22:33:01.154566 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:01.154566 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:01.154566 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:01.154566 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:01.154566 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 19 22:33:01.154566 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 19 22:33:01.154566 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 19 22:33:01.154566 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 19 22:33:01.154566 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 19 22:33:01.154566 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f64ad8c-09d1-4c0a-87da-76e121023eeb'] Jul 19 22:33:01.156007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:01.156007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:01.156007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:01.156007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:01.156007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:01.156007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:01.156007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:33:01.156007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:33:01.156007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:33:01.156007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:33:01.156007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:33:01.156007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:33:01.156007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 19 22:33:01.156007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 19 22:33:01.156007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 19 22:33:01.156007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f64ad8c-09d1-4c0a-87da-76e121023eeb'] Jul 19 22:33:01.156007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:01.156007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:01.156007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:01.156007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:01.156007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:01.157373 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:01.157373 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:33:01.157373 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:33:01.157373 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 19 22:33:01.157373 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f64ad8c-09d1-4c0a-87da-76e121023eeb'] Jul 19 22:33:01.157373 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:01.157373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d17173c9-3e09-44de-a39c-08a4ff235401 tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 19 22:33:01.157373 n-d-847009-3 devstack@n-api.service[119337]: Neutron server returns request_ids: ['req-2f64ad8c-09d1-4c0a-87da-76e121023eeb'] {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:33:01.157373 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d17173c9-3e09-44de-a39c-08a4ff235401 tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/da883f31-fdef-418d-9e07-dc22f24b1d68" status: 400 len: 182 microversion: 2.1 time: 0.335113 Jul 19 22:33:01.157373 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 885/1754] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:33:00 2022] DELETE /compute/v2.1/os-security-groups/da883f31-fdef-418d-9e07-dc22f24b1d68 => generated 182 bytes in 340 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:33:01.164581 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6ae8749e-34a5-4b69-8d4d-1e76066747d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:01.164581 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6ae8749e-34a5-4b69-8d4d-1e76066747d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:01.183102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6ae8749e-34a5-4b69-8d4d-1e76066747d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:01.184125 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6ae8749e-34a5-4b69-8d4d-1e76066747d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:01.185447 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6ae8749e-34a5-4b69-8d4d-1e76066747d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:01.186260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6ae8749e-34a5-4b69-8d4d-1e76066747d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:01.369291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2d112b8b-56bc-47f9-a967-314f6708f99e tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4020bca56fb34848b4f6c8d7d1b7b10a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd240e28831304ae890a9bf83a9383111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:01.380497 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2d112b8b-56bc-47f9-a967-314f6708f99e tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] 10.222.0.25 "GET /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021" status: 200 len: 1504 microversion: 2.1 time: 0.256096 Jul 19 22:33:01.382212 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 870/1755] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:01 2022] GET /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021 => generated 1504 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:01.388077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f142a682-18a1-487d-928d-93bf49fadba6 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:01.389020 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f142a682-18a1-487d-928d-93bf49fadba6 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 3b832d3f-6d05-4494-be32-1250a88c787c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:01.396825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f142a682-18a1-487d-928d-93bf49fadba6 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:01.398645 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f142a682-18a1-487d-928d-93bf49fadba6 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:01.399720 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f142a682-18a1-487d-928d-93bf49fadba6 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:01.400267 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f142a682-18a1-487d-928d-93bf49fadba6 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:01.471553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6ae8749e-34a5-4b69-8d4d-1e76066747d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:01.484018 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6ae8749e-34a5-4b69-8d4d-1e76066747d3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1198 microversion: 2.1 time: 0.330362 Jul 19 22:33:01.484620 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 886/1756] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:01 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1198 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:01.490493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f142a682-18a1-487d-928d-93bf49fadba6 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37267b4c360540489a72d9b0043abd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a353634f70fb4ff58c7190a5c7aa675d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:01.508007 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f142a682-18a1-487d-928d-93bf49fadba6 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c" status: 200 len: 1221 microversion: 2.1 time: 0.124049 Jul 19 22:33:01.509064 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 871/1757] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:01 2022] GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c => generated 1221 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:01.515845 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3ac1f500-3110-4051-bd62-ddfd5103a2ec tempest-FloatingIPDetailsTestJSON-1529178395 tempest-FloatingIPDetailsTestJSON-1529178395-project] Calling method '.version_select at 0x7f7a155fe0d0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:01.751467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-30293997-155b-4909-924d-15b9924106f2 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:01.792278 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-30293997-155b-4909-924d-15b9924106f2 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.296852 Jul 19 22:33:01.800672 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 887/1758] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:33:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:33:01.806133 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ac81f1fa-931f-4ff3-bfc3-678c8e91f03b tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] Calling method '.version_select at 0x7f7a03dc4f70>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:01.852442 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3ac1f500-3110-4051-bd62-ddfd5103a2ec tempest-FloatingIPDetailsTestJSON-1529178395 tempest-FloatingIPDetailsTestJSON-1529178395-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/cf2d97cb-0ba2-4ced-9639-63e78e090c63" status: 200 len: 141 microversion: 2.1 time: 0.342441 Jul 19 22:33:01.853184 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 872/1759] 10.222.0.25 () {58 vars in 1259 bytes} [Tue Jul 19 22:33:01 2022] GET /compute/v2.1/os-floating-ips/cf2d97cb-0ba2-4ced-9639-63e78e090c63 => generated 141 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:33:01.860041 n-d-847009-3 devstack@n-api.service[119337]: DEBUG neutronclient.v2_0.client [None req-ac81f1fa-931f-4ff3-bfc3-678c8e91f03b tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group db6affb5-aec4-462f-9393-160af01cef90 does not exist", "detail": ""}} {{(pid=119337) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 22:33:01.860304 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9a71f488-5205-4b5f-ad50-ff5f93e1f610 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:01.860744 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.security_group_api [None req-ac81f1fa-931f-4ff3-bfc3-678c8e91f03b tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] Neutron security group db6affb5-aec4-462f-9393-160af01cef90 not found {{(pid=119337) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 22:33:01.861328 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-ac81f1fa-931f-4ff3-bfc3-678c8e91f03b tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] HTTP exception thrown: Security group db6affb5-aec4-462f-9393-160af01cef90 does not exist Jul 19 22:33:01.861328 n-d-847009-3 devstack@n-api.service[119337]: Neutron server returns request_ids: ['req-004625b1-a010-411c-8e9a-67faf7ecb410'] Jul 19 22:33:01.862168 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9a71f488-5205-4b5f-ad50-ff5f93e1f610 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] [instance: 6fded340-0a2a-4b49-8988-53d61dcd8021] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:01.863472 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ac81f1fa-931f-4ff3-bfc3-678c8e91f03b tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] Request method failure captured: Jul 19 22:33:01.863472 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/os-security-groups/db6affb5-aec4-462f-9393-160af01cef90 HTTP/1.1 Jul 19 22:33:01.863472 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:33:01.863472 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:33:01.863472 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:33:01.863472 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:33:01.863472 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:33:01.863472 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:33:01.863472 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:33:01.863472 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:33:01.863472 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zEX9Of-lEgRTOpTZ4zydUMS2mvrmL2mPtVkQ2yun1ZNIQkluk4osGdydaSUWJ_HNQEdcOajdnof_LASlINmTCTjAFqqcLgS7sP6NvaW6Wcn73Ea15VR9WRLY_Lp-QgOgZdippiXIxu-ZoB9aQ3udHrjeDBhZgX1vD6693ppkunX9rk Jul 19 22:33:01.863472 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:33:01.863472 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:33:01.863472 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:33:01.863472 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:33:01.863472 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:33:01.863472 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:33:01.863472 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: f1e17cbd723942609c5be6a0b055806b Jul 19 22:33:01.863472 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1887358563 Jul 19 22:33:01.863472 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:33:01.863472 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:33:01.864922 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1e17cbd723942609c5be6a0b055806b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1e17cbd723942609c5be6a0b055806b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1e17cbd723942609c5be6a0b055806b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1e17cbd723942609c5be6a0b055806b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:33:01.864922 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1887358563 Jul 19 22:33:01.864922 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: f1e17cbd723942609c5be6a0b055806b Jul 19 22:33:01.864922 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1887358563 Jul 19 22:33:01.864922 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-SecurityGroupsNegativeTestJSON-1887358563-project Jul 19 22:33:01.864922 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:33:01.864922 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:33:01.864922 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 02618b10dc0f4ad7b90feabaa6a80fb7 Jul 19 22:33:01.864922 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1887358563-project Jul 19 22:33:01.864922 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:33:01.864922 n-d-847009-3 devstack@n-api.service[119337]: exception: Security group db6affb5-aec4-462f-9393-160af01cef90 does not exist Jul 19 22:33:01.864922 n-d-847009-3 devstack@n-api.service[119337]: Neutron server returns request_ids: ['req-004625b1-a010-411c-8e9a-67faf7ecb410'] Jul 19 22:33:01.864922 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'db6affb5-aec4-462f-9393-160af01cef90'} Jul 19 22:33:01.866488 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:33:01.866488 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:01.866488 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 22:33:01.866488 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 22:33:01.866488 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:33:01.866488 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:33:01.866488 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 22:33:01.866488 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 22:33:01.866488 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:33:01.866488 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:33:01.866488 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 22:33:01.866488 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 22:33:01.866488 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:33:01.866488 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:33:01.866488 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 22:33:01.866488 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 22:33:01.866488 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:33:01.866488 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:33:01.866488 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 22:33:01.867947 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 22:33:01.867947 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:33:01.867947 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:33:01.867947 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 22:33:01.867947 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 22:33:01.867947 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 22:33:01.867947 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 22:33:01.867947 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group db6affb5-aec4-462f-9393-160af01cef90 does not exist Jul 19 22:33:01.867947 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-004625b1-a010-411c-8e9a-67faf7ecb410'] Jul 19 22:33:01.867947 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:01.867947 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:01.867947 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:01.867947 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:01.867947 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 19 22:33:01.867947 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 22:33:01.867947 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 22:33:01.867947 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 22:33:01.867947 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group db6affb5-aec4-462f-9393-160af01cef90 does not exist Jul 19 22:33:01.869164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-004625b1-a010-411c-8e9a-67faf7ecb410'] Jul 19 22:33:01.869164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:01.869164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:01.869164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:01.869164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:01.869164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:01.869164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:01.869164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:33:01.869164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:33:01.869164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:33:01.869164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:33:01.869164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:33:01.869164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:33:01.869164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 19 22:33:01.869164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 22:33:01.869164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group db6affb5-aec4-462f-9393-160af01cef90 does not exist Jul 19 22:33:01.869164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-004625b1-a010-411c-8e9a-67faf7ecb410'] Jul 19 22:33:01.869164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:01.869164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:01.869164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:01.869164 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:01.870526 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:01.870526 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:01.870526 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:33:01.870526 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:33:01.870526 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group db6affb5-aec4-462f-9393-160af01cef90 does not exist Jul 19 22:33:01.870526 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-004625b1-a010-411c-8e9a-67faf7ecb410'] Jul 19 22:33:01.870526 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:01.870526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ac81f1fa-931f-4ff3-bfc3-678c8e91f03b tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] Returning 404 to user: Security group db6affb5-aec4-462f-9393-160af01cef90 does not exist Jul 19 22:33:01.870526 n-d-847009-3 devstack@n-api.service[119337]: Neutron server returns request_ids: ['req-004625b1-a010-411c-8e9a-67faf7ecb410'] {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:33:01.870526 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ac81f1fa-931f-4ff3-bfc3-678c8e91f03b tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/db6affb5-aec4-462f-9393-160af01cef90" status: 404 len: 194 microversion: 2.1 time: 0.063574 Jul 19 22:33:01.870526 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 888/1760] 10.222.0.25 () {58 vars in 1268 bytes} [Tue Jul 19 22:33:01 2022] GET /compute/v2.1/os-security-groups/db6affb5-aec4-462f-9393-160af01cef90 => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:33:01.879948 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2d02af4c-c33b-4bc2-adfd-5e03c1a519c3 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:01.884918 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a71f488-5205-4b5f-ad50-ff5f93e1f610 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:01.885532 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a71f488-5205-4b5f-ad50-ff5f93e1f610 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:01.886648 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a71f488-5205-4b5f-ad50-ff5f93e1f610 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:01.887250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a71f488-5205-4b5f-ad50-ff5f93e1f610 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:01.905167 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2d02af4c-c33b-4bc2-adfd-5e03c1a519c3 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.035892 Jul 19 22:33:01.906188 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 889/1761] 10.222.0.25 () {58 vars in 1124 bytes} [Tue Jul 19 22:33:01 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:01.914547 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-32f68b46-b9a0-45d0-bf25-1ed13fbe08a3 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:01.915229 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-32f68b46-b9a0-45d0-bf25-1ed13fbe08a3 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:01.921529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32f68b46-b9a0-45d0-bf25-1ed13fbe08a3 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:01.921965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32f68b46-b9a0-45d0-bf25-1ed13fbe08a3 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:01.922740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32f68b46-b9a0-45d0-bf25-1ed13fbe08a3 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:01.923227 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32f68b46-b9a0-45d0-bf25-1ed13fbe08a3 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:01.924135 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9a71f488-5205-4b5f-ad50-ff5f93e1f610 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] [instance: 6fded340-0a2a-4b49-8988-53d61dcd8021] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:33:02.020244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-32f68b46-b9a0-45d0-bf25-1ed13fbe08a3 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lazy-loading 'services' on Instance uuid 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:33:02.029175 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9a71f488-5205-4b5f-ad50-ff5f93e1f610 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021" status: 204 len: 0 microversion: 2.1 time: 0.173761 Jul 19 22:33:02.032923 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 873/1762] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:33:01 2022] DELETE /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:33:02.043656 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-32f68b46-b9a0-45d0-bf25-1ed13fbe08a3 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1929 microversion: 2.75 time: 0.136357 Jul 19 22:33:02.044262 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 890/1763] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:01 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1929 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:33:02.045041 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1a44d2a9-3b46-4254-ac50-a13bc64d4590 tempest-FloatingIPDetailsTestJSON-1529178395 tempest-FloatingIPDetailsTestJSON-1529178395-project] Calling method '.version_select at 0x7f7a107ab430>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:02.052253 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-abca8ca8-e72e-4816-9380-06198dff1785 tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] Action: 'update', calling method: .version_select at 0x7f7a03e88160>, body: {"security_group": {"name": "tempest-sg-704208813", "description": "tempest-description-664953946"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:33:02.116264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG neutronclient.v2_0.client [None req-abca8ca8-e72e-4816-9380-06198dff1785 tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 84a6c8b2-6740-4bb1-9ad4-3b3361c9f94d does not exist", "detail": ""}} {{(pid=119337) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 22:33:02.116904 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.security_group_api [None req-abca8ca8-e72e-4816-9380-06198dff1785 tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] Neutron security group 84a6c8b2-6740-4bb1-9ad4-3b3361c9f94d not found {{(pid=119337) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 22:33:02.117559 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-abca8ca8-e72e-4816-9380-06198dff1785 tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] HTTP exception thrown: Security group 84a6c8b2-6740-4bb1-9ad4-3b3361c9f94d does not exist Jul 19 22:33:02.117559 n-d-847009-3 devstack@n-api.service[119337]: Neutron server returns request_ids: ['req-fdcc75cb-db97-448c-8baf-1bf5a5e12252'] Jul 19 22:33:02.119467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-abca8ca8-e72e-4816-9380-06198dff1785 tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] Request method failure captured: Jul 19 22:33:02.119467 n-d-847009-3 devstack@n-api.service[119337]: request: PUT /compute/v2.1/os-security-groups/84a6c8b2-6740-4bb1-9ad4-3b3361c9f94d HTTP/1.1 Jul 19 22:33:02.119467 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:33:02.119467 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:33:02.119467 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:33:02.119467 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 100 Jul 19 22:33:02.119467 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:33:02.119467 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:33:02.119467 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:33:02.119467 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:33:02.119467 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zEX9Of-lEgRTOpTZ4zydUMS2mvrmL2mPtVkQ2yun1ZNIQkluk4osGdydaSUWJ_HNQEdcOajdnof_LASlINmTCTjAFqqcLgS7sP6NvaW6Wcn73Ea15VR9WRLY_Lp-QgOgZdippiXIxu-ZoB9aQ3udHrjeDBhZgX1vD6693ppkunX9rk Jul 19 22:33:02.119467 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:33:02.119467 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:33:02.119467 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:33:02.119467 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:33:02.119467 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:33:02.119467 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:33:02.119467 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: f1e17cbd723942609c5be6a0b055806b Jul 19 22:33:02.119467 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1887358563 Jul 19 22:33:02.119467 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:33:02.119467 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:33:02.120919 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1e17cbd723942609c5be6a0b055806b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1e17cbd723942609c5be6a0b055806b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1e17cbd723942609c5be6a0b055806b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1e17cbd723942609c5be6a0b055806b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:33:02.120919 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1887358563 Jul 19 22:33:02.120919 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: f1e17cbd723942609c5be6a0b055806b Jul 19 22:33:02.120919 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1887358563 Jul 19 22:33:02.120919 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-SecurityGroupsNegativeTestJSON-1887358563-project Jul 19 22:33:02.120919 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:33:02.120919 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:33:02.120919 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 02618b10dc0f4ad7b90feabaa6a80fb7 Jul 19 22:33:02.120919 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1887358563-project Jul 19 22:33:02.120919 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:33:02.120919 n-d-847009-3 devstack@n-api.service[119337]: {"security_group": {"name": "tempest-sg-704208813", "description": "tempest-description-664953946"}} Jul 19 22:33:02.120919 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:33:02.120919 n-d-847009-3 devstack@n-api.service[119337]: exception: Security group 84a6c8b2-6740-4bb1-9ad4-3b3361c9f94d does not exist Jul 19 22:33:02.122333 n-d-847009-3 devstack@n-api.service[119337]: Neutron server returns request_ids: ['req-fdcc75cb-db97-448c-8baf-1bf5a5e12252'] Jul 19 22:33:02.122333 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '84a6c8b2-6740-4bb1-9ad4-3b3361c9f94d', 'body': {'security_group': {'name': 'tempest-sg-704208813', 'description': 'tempest-description-664953946'}}} Jul 19 22:33:02.122333 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:33:02.122333 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:02.122333 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 22:33:02.122333 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 22:33:02.122333 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:33:02.122333 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:33:02.122333 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 22:33:02.122333 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 22:33:02.122333 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:33:02.122333 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:33:02.122333 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 22:33:02.122333 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 22:33:02.122333 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:33:02.122333 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:33:02.122333 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 22:33:02.122333 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 22:33:02.123547 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:33:02.123547 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:33:02.123547 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 22:33:02.123547 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 22:33:02.123547 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:33:02.123547 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:33:02.123547 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 22:33:02.123547 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 22:33:02.123547 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 22:33:02.123547 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 22:33:02.123547 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 84a6c8b2-6740-4bb1-9ad4-3b3361c9f94d does not exist Jul 19 22:33:02.123547 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdcc75cb-db97-448c-8baf-1bf5a5e12252'] Jul 19 22:33:02.123547 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:02.123547 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:02.123547 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:02.123547 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:02.123547 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 19 22:33:02.123547 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 22:33:02.123547 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 22:33:02.124803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 22:33:02.124803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 84a6c8b2-6740-4bb1-9ad4-3b3361c9f94d does not exist Jul 19 22:33:02.124803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdcc75cb-db97-448c-8baf-1bf5a5e12252'] Jul 19 22:33:02.124803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:02.124803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:02.124803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:02.124803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:02.124803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:02.124803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:02.124803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:33:02.124803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:33:02.124803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:33:02.124803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:33:02.124803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:33:02.124803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:33:02.124803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 19 22:33:02.124803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 22:33:02.124803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 84a6c8b2-6740-4bb1-9ad4-3b3361c9f94d does not exist Jul 19 22:33:02.124803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdcc75cb-db97-448c-8baf-1bf5a5e12252'] Jul 19 22:33:02.124803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:02.126105 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:02.126105 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:02.126105 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:02.126105 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:02.126105 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:02.126105 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:33:02.126105 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:33:02.126105 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 84a6c8b2-6740-4bb1-9ad4-3b3361c9f94d does not exist Jul 19 22:33:02.126105 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdcc75cb-db97-448c-8baf-1bf5a5e12252'] Jul 19 22:33:02.126105 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:02.128661 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-abca8ca8-e72e-4816-9380-06198dff1785 tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] Returning 404 to user: Security group 84a6c8b2-6740-4bb1-9ad4-3b3361c9f94d does not exist Jul 19 22:33:02.128661 n-d-847009-3 devstack@n-api.service[119337]: Neutron server returns request_ids: ['req-fdcc75cb-db97-448c-8baf-1bf5a5e12252'] {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:33:02.129535 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-abca8ca8-e72e-4816-9380-06198dff1785 tempest-SecurityGroupsNegativeTestJSON-1887358563 tempest-SecurityGroupsNegativeTestJSON-1887358563-project] 10.222.0.25 "PUT /compute/v2.1/os-security-groups/84a6c8b2-6740-4bb1-9ad4-3b3361c9f94d" status: 404 len: 194 microversion: 2.1 time: 0.084345 Jul 19 22:33:02.130437 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 891/1764] 10.222.0.25 () {60 vars in 1289 bytes} [Tue Jul 19 22:33:02 2022] PUT /compute/v2.1/os-security-groups/84a6c8b2-6740-4bb1-9ad4-3b3361c9f94d => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:33:02.135880 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bb262f1a-1765-4c88-9e97-becd8faf40f8 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:02.145880 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bb262f1a-1765-4c88-9e97-becd8faf40f8 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013812 Jul 19 22:33:02.154045 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 892/1765] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:33:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:33:02.159340 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6250a3e1-e9a7-4046-aebc-f05ca21b8f2f tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:02.160051 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6250a3e1-e9a7-4046-aebc-f05ca21b8f2f tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] [instance: 6fded340-0a2a-4b49-8988-53d61dcd8021] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:02.167472 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6250a3e1-e9a7-4046-aebc-f05ca21b8f2f tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:02.168035 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6250a3e1-e9a7-4046-aebc-f05ca21b8f2f tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:02.168874 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6250a3e1-e9a7-4046-aebc-f05ca21b8f2f tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:02.169552 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6250a3e1-e9a7-4046-aebc-f05ca21b8f2f tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:02.390985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6250a3e1-e9a7-4046-aebc-f05ca21b8f2f tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4020bca56fb34848b4f6c8d7d1b7b10a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd240e28831304ae890a9bf83a9383111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:02.407212 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6250a3e1-e9a7-4046-aebc-f05ca21b8f2f tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] 10.222.0.25 "GET /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021" status: 200 len: 1510 microversion: 2.1 time: 0.251824 Jul 19 22:33:02.407801 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 893/1766] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:02 2022] GET /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021 => generated 1510 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:02.415426 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-624316ac-6737-4f34-9dad-81776c85fde7 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:02.435276 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-624316ac-6737-4f34-9dad-81776c85fde7 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025959 Jul 19 22:33:02.436155 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 894/1767] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:33:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:33:02.441038 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-bfab9f0d-9230-46e8-a0d7-b5fd784245d4 req-4d03c69b-0416-4ddb-a638-5ace790a33d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7", "name": "network-vif-plugged", "status": "completed", "tag": "982bb92a-f3e0-4d49-82fa-8c659b4cf2a9"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:33:02.458099 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-bfab9f0d-9230-46e8-a0d7-b5fd784245d4 req-4d03c69b-0416-4ddb-a638-5ace790a33d1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:02.461274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-bfab9f0d-9230-46e8-a0d7-b5fd784245d4 req-4d03c69b-0416-4ddb-a638-5ace790a33d1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:02.494708 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-bfab9f0d-9230-46e8-a0d7-b5fd784245d4 req-4d03c69b-0416-4ddb-a638-5ace790a33d1 service nova] Creating event network-vif-plugged:982bb92a-f3e0-4d49-82fa-8c659b4cf2a9 for instance b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 on n-h2-847009-3 Jul 19 22:33:02.512499 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-bfab9f0d-9230-46e8-a0d7-b5fd784245d4 req-4d03c69b-0416-4ddb-a638-5ace790a33d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073858 Jul 19 22:33:02.513140 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 895/1768] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:33:02.535687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5022c448-c4dd-4c01-875b-66b17c542046 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:02.620549 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5022c448-c4dd-4c01-875b-66b17c542046 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.104420 Jul 19 22:33:02.621162 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 896/1769] 10.222.0.25 () {58 vars in 1164 bytes} [Tue Jul 19 22:33:02 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:02.639534 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-10fdfacf-95a3-459e-8693-c52aabbe1a93 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:02.641103 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-10fdfacf-95a3-459e-8693-c52aabbe1a93 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:02.659832 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-10fdfacf-95a3-459e-8693-c52aabbe1a93 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:02.662616 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-10fdfacf-95a3-459e-8693-c52aabbe1a93 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:02.665106 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-10fdfacf-95a3-459e-8693-c52aabbe1a93 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:02.667536 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-10fdfacf-95a3-459e-8693-c52aabbe1a93 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:03.360795 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-10fdfacf-95a3-459e-8693-c52aabbe1a93 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:03.376328 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-10fdfacf-95a3-459e-8693-c52aabbe1a93 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1198 microversion: 2.1 time: 0.745707 Jul 19 22:33:03.376937 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 897/1770] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:02 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1198 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:03.386698 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d73d0182-e1b4-493a-8724-3f428178940e tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:03.388970 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d73d0182-e1b4-493a-8724-3f428178940e tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 3b832d3f-6d05-4494-be32-1250a88c787c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:03.452217 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d73d0182-e1b4-493a-8724-3f428178940e tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:03.453427 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d73d0182-e1b4-493a-8724-3f428178940e tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:03.454437 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d73d0182-e1b4-493a-8724-3f428178940e tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:03.455690 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d73d0182-e1b4-493a-8724-3f428178940e tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:03.590945 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d73d0182-e1b4-493a-8724-3f428178940e tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37267b4c360540489a72d9b0043abd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a353634f70fb4ff58c7190a5c7aa675d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:03.610166 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d73d0182-e1b4-493a-8724-3f428178940e tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c" status: 200 len: 1275 microversion: 2.1 time: 0.229219 Jul 19 22:33:03.610771 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 898/1771] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:03 2022] GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c => generated 1275 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:03.621476 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7a0ae4ea-195c-423d-ba8b-31d619bf2a56 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:03.644233 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7a0ae4ea-195c-423d-ba8b-31d619bf2a56 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032329 Jul 19 22:33:03.649461 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 899/1772] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:33:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:33:03.654341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4fff36d7-b8f4-4099-a6e2-4d7512eecad2 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:03.656061 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4fff36d7-b8f4-4099-a6e2-4d7512eecad2 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:03.692506 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4fff36d7-b8f4-4099-a6e2-4d7512eecad2 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:03.695533 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4fff36d7-b8f4-4099-a6e2-4d7512eecad2 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:03.697936 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4fff36d7-b8f4-4099-a6e2-4d7512eecad2 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:03.699210 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4fff36d7-b8f4-4099-a6e2-4d7512eecad2 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:03.871675 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-4fff36d7-b8f4-4099-a6e2-4d7512eecad2 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lazy-loading 'services' on Instance uuid 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:33:03.896564 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4fff36d7-b8f4-4099-a6e2-4d7512eecad2 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1929 microversion: 2.75 time: 0.245257 Jul 19 22:33:03.896987 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 900/1773] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:03 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1929 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:33:03.906245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ffc18b1c-024f-4398-a6ea-9b01bb930b45 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:03.906922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ffc18b1c-024f-4398-a6ea-9b01bb930b45 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] [instance: 6fded340-0a2a-4b49-8988-53d61dcd8021] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:03.914899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ffc18b1c-024f-4398-a6ea-9b01bb930b45 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:03.915384 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ffc18b1c-024f-4398-a6ea-9b01bb930b45 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:03.916180 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ffc18b1c-024f-4398-a6ea-9b01bb930b45 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:03.916760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ffc18b1c-024f-4398-a6ea-9b01bb930b45 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:04.528476 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ffc18b1c-024f-4398-a6ea-9b01bb930b45 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4020bca56fb34848b4f6c8d7d1b7b10a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd240e28831304ae890a9bf83a9383111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:04.545406 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ffc18b1c-024f-4398-a6ea-9b01bb930b45 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] 10.222.0.25 "GET /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021" status: 200 len: 1510 microversion: 2.1 time: 0.646461 Jul 19 22:33:04.548990 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 901/1774] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:03 2022] GET /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021 => generated 1510 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:04.560446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ca3ea2a4-29fb-4954-ae07-41dc2afb5c61 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:04.628220 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ca3ea2a4-29fb-4954-ae07-41dc2afb5c61 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.077713 Jul 19 22:33:04.629794 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 902/1775] 10.222.0.25 () {58 vars in 1168 bytes} [Tue Jul 19 22:33:04 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:04.640282 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d32129ee-4ed9-43ad-99a6-b5e3f70e24a5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:04.641193 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d32129ee-4ed9-43ad-99a6-b5e3f70e24a5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:04.653396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d32129ee-4ed9-43ad-99a6-b5e3f70e24a5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:04.654272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d32129ee-4ed9-43ad-99a6-b5e3f70e24a5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:04.655652 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d32129ee-4ed9-43ad-99a6-b5e3f70e24a5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:04.658610 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d32129ee-4ed9-43ad-99a6-b5e3f70e24a5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:04.675049 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1a44d2a9-3b46-4254-ac50-a13bc64d4590 tempest-FloatingIPDetailsTestJSON-1529178395 tempest-FloatingIPDetailsTestJSON-1529178395-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/cf2d97cb-0ba2-4ced-9639-63e78e090c63" status: 202 len: 0 microversion: 2.1 time: 2.642889 Jul 19 22:33:04.681154 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 874/1776] 10.222.0.25 () {58 vars in 1262 bytes} [Tue Jul 19 22:33:02 2022] DELETE /compute/v2.1/os-floating-ips/cf2d97cb-0ba2-4ced-9639-63e78e090c63 => generated 0 bytes in 2650 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:33:04.687140 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d536e00c-f3ad-495e-9f9e-2c4a7d8635dd tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:04.689775 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d536e00c-f3ad-495e-9f9e-2c4a7d8635dd tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 3b832d3f-6d05-4494-be32-1250a88c787c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:04.705772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d536e00c-f3ad-495e-9f9e-2c4a7d8635dd tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:04.707035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d536e00c-f3ad-495e-9f9e-2c4a7d8635dd tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:04.709652 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d536e00c-f3ad-495e-9f9e-2c4a7d8635dd tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:04.711095 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d536e00c-f3ad-495e-9f9e-2c4a7d8635dd tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:05.310457 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d32129ee-4ed9-43ad-99a6-b5e3f70e24a5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:05.324154 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d32129ee-4ed9-43ad-99a6-b5e3f70e24a5 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1198 microversion: 2.1 time: 0.691539 Jul 19 22:33:05.325008 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 903/1777] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:04 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1198 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:05.335063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4669ae68-cff2-4dd8-8566-6d9effd3e933 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:05.371556 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4669ae68-cff2-4dd8-8566-6d9effd3e933 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.033355 Jul 19 22:33:05.380658 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 904/1778] 10.222.0.25 () {58 vars in 1160 bytes} [Tue Jul 19 22:33:05 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:33:05.386111 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5d9df8d7-f24f-47da-9b4d-7d2bd9a6ff29 tempest-FloatingIPDetailsTestJSON-1529178395 tempest-FloatingIPDetailsTestJSON-1529178395-project] Calling method '.version_select at 0x7f7a03d43550>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:05.509888 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d536e00c-f3ad-495e-9f9e-2c4a7d8635dd tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37267b4c360540489a72d9b0043abd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a353634f70fb4ff58c7190a5c7aa675d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:05.528910 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d536e00c-f3ad-495e-9f9e-2c4a7d8635dd tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c" status: 200 len: 1317 microversion: 2.1 time: 0.846407 Jul 19 22:33:05.540826 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 875/1779] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:04 2022] GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c => generated 1317 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:05.559208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bca9ec9e-48a4-4bc7-9505-87fda5f1caad tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:05.560220 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bca9ec9e-48a4-4bc7-9505-87fda5f1caad tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:05.575743 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bca9ec9e-48a4-4bc7-9505-87fda5f1caad tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:05.576608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bca9ec9e-48a4-4bc7-9505-87fda5f1caad tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:05.578503 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bca9ec9e-48a4-4bc7-9505-87fda5f1caad tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:05.579230 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bca9ec9e-48a4-4bc7-9505-87fda5f1caad tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:05.730341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:33:05.829453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-bca9ec9e-48a4-4bc7-9505-87fda5f1caad tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lazy-loading 'services' on Instance uuid 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:33:05.875838 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bca9ec9e-48a4-4bc7-9505-87fda5f1caad tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1929 microversion: 2.75 time: 0.330419 Jul 19 22:33:05.877507 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 876/1780] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:05 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1929 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:33:05.883258 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9d52027b-1cf6-47d5-baa1-5eba250377e3 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:05.900989 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9d52027b-1cf6-47d5-baa1-5eba250377e3 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021473 Jul 19 22:33:05.907445 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 877/1781] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:33:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:33:05.913216 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5b8022de-238d-400b-985d-73cf7e4b610c tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:05.913840 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5b8022de-238d-400b-985d-73cf7e4b610c tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] [instance: 6fded340-0a2a-4b49-8988-53d61dcd8021] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:05.921287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b8022de-238d-400b-985d-73cf7e4b610c tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:05.921748 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b8022de-238d-400b-985d-73cf7e4b610c tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:05.922938 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b8022de-238d-400b-985d-73cf7e4b610c tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:05.923581 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b8022de-238d-400b-985d-73cf7e4b610c tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:05.927594 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5d9df8d7-f24f-47da-9b4d-7d2bd9a6ff29 tempest-FloatingIPDetailsTestJSON-1529178395 tempest-FloatingIPDetailsTestJSON-1529178395-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.545053 Jul 19 22:33:05.929549 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 905/1782] 10.222.0.25 () {58 vars in 1163 bytes} [Tue Jul 19 22:33:05 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:33:05.940601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-3be58331-aa58-4ec4-92cb-f1f3ef45576d req-7965fbb7-6b1a-4058-9ac9-757a43b51b06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fded340-0a2a-4b49-8988-53d61dcd8021", "name": "network-vif-deleted", "tag": "cb6cd53b-ccaa-46d2-be9c-ba3c44c8d66e"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:33:05.965165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-3be58331-aa58-4ec4-92cb-f1f3ef45576d req-7965fbb7-6b1a-4058-9ac9-757a43b51b06 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:05.969174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-3be58331-aa58-4ec4-92cb-f1f3ef45576d req-7965fbb7-6b1a-4058-9ac9-757a43b51b06 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:05.974653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b8022de-238d-400b-985d-73cf7e4b610c tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:05.976296 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b8022de-238d-400b-985d-73cf7e4b610c tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:05.976954 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-5b8022de-238d-400b-985d-73cf7e4b610c tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lazy-loading 'fault' on Instance uuid 6fded340-0a2a-4b49-8988-53d61dcd8021 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:33:05.994870 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-3be58331-aa58-4ec4-92cb-f1f3ef45576d req-7965fbb7-6b1a-4058-9ac9-757a43b51b06 service nova] Creating event network-vif-deleted:cb6cd53b-ccaa-46d2-be9c-ba3c44c8d66e for instance 6fded340-0a2a-4b49-8988-53d61dcd8021 on n-h2-847009-3 Jul 19 22:33:06.007994 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-3be58331-aa58-4ec4-92cb-f1f3ef45576d req-7965fbb7-6b1a-4058-9ac9-757a43b51b06 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075062 Jul 19 22:33:06.009447 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 906/1783] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:33:06.016380 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-98b23f7a-dfb6-45f6-8a52-fa02bb11bff5 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:06.087136 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5b8022de-238d-400b-985d-73cf7e4b610c tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4020bca56fb34848b4f6c8d7d1b7b10a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd240e28831304ae890a9bf83a9383111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:06.100957 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-98b23f7a-dfb6-45f6-8a52-fa02bb11bff5 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.088981 Jul 19 22:33:06.102450 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 907/1784] 10.222.0.25 () {58 vars in 1166 bytes} [Tue Jul 19 22:33:06 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:06.115306 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4da44492-92b8-4318-a793-6640c4a538ed tempest-FloatingIPDetailsTestJSON-1529178395 tempest-FloatingIPDetailsTestJSON-1529178395-project] Calling method '.version_select at 0x7f7a03d43550>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:06.122773 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5b8022de-238d-400b-985d-73cf7e4b610c tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] 10.222.0.25 "GET /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021" status: 200 len: 1306 microversion: 2.1 time: 0.214000 Jul 19 22:33:06.123741 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 878/1785] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:05 2022] GET /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021 => generated 1306 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:06.128710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-586fb4c3-8d52-4c22-bc65-31c683fa3033 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:06.141833 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-586fb4c3-8d52-4c22-bc65-31c683fa3033 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016734 Jul 19 22:33:06.150753 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 879/1786] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:33:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:33:06.157346 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-45136a96-018b-40ec-9c3f-2527675cc029 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:06.191361 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-45136a96-018b-40ec-9c3f-2527675cc029 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] 10.222.0.25 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.038573 Jul 19 22:33:06.197130 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 880/1787] 10.222.0.25 () {58 vars in 1143 bytes} [Tue Jul 19 22:33:06 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:06.205280 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e81ff1a9-0ad6-47e2-ace8-ad5e456ef428 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:06.219347 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e81ff1a9-0ad6-47e2-ace8-ad5e456ef428 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017707 Jul 19 22:33:06.225534 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 881/1788] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:33:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:33:06.230934 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b1e625bd-ff2a-490e-9b50-55d9a24c7123 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:06.259822 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b1e625bd-ff2a-490e-9b50-55d9a24c7123 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] 10.222.0.25 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.032823 Jul 19 22:33:06.267808 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 882/1789] 10.222.0.25 () {58 vars in 1147 bytes} [Tue Jul 19 22:33:06 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:06.292019 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-314d5827-b81f-4ea0-91e7-71c16a74aae9 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:06.316735 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-314d5827-b81f-4ea0-91e7-71c16a74aae9 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] 10.222.0.25 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.046930 Jul 19 22:33:06.318819 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 883/1790] 10.222.0.25 () {58 vars in 1139 bytes} [Tue Jul 19 22:33:06 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:33:06.331097 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b8d1fdc1-a5be-494d-b611-8b0b14f63da7 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:06.341844 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b8d1fdc1-a5be-494d-b611-8b0b14f63da7 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015503 Jul 19 22:33:06.342432 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 884/1791] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:33:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:33:06.347185 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-66affbd1-8b26-456d-8fc6-3e2718839920 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:06.348092 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-66affbd1-8b26-456d-8fc6-3e2718839920 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:06.357584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66affbd1-8b26-456d-8fc6-3e2718839920 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:06.358648 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66affbd1-8b26-456d-8fc6-3e2718839920 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:06.359773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66affbd1-8b26-456d-8fc6-3e2718839920 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:06.360285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66affbd1-8b26-456d-8fc6-3e2718839920 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:06.819877 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4da44492-92b8-4318-a793-6640c4a538ed tempest-FloatingIPDetailsTestJSON-1529178395 tempest-FloatingIPDetailsTestJSON-1529178395-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.716309 Jul 19 22:33:06.827016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-66affbd1-8b26-456d-8fc6-3e2718839920 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:06.828224 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 908/1792] 10.222.0.25 () {58 vars in 1148 bytes} [Tue Jul 19 22:33:06 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:33:06.833490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bc633334-06b4-4b11-a77f-594ef22d6da1 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:06.838257 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-66affbd1-8b26-456d-8fc6-3e2718839920 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1381 microversion: 2.1 time: 0.494392 Jul 19 22:33:06.841490 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 885/1793] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:06 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1381 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:06.851948 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c17b782c-3a49-4930-83c0-f1284dbc244d tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:06.853241 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c17b782c-3a49-4930-83c0-f1284dbc244d tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 3b832d3f-6d05-4494-be32-1250a88c787c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:06.863032 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c17b782c-3a49-4930-83c0-f1284dbc244d tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:06.864100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c17b782c-3a49-4930-83c0-f1284dbc244d tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:06.868309 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bc633334-06b4-4b11-a77f-594ef22d6da1 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] 10.222.0.25 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.038132 Jul 19 22:33:06.869009 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 909/1794] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:33:06 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:06.876694 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5c124f17-368b-48f9-9831-81e1f693a138 tempest-FloatingIPDetailsTestJSON-1529178395 tempest-FloatingIPDetailsTestJSON-1529178395-project] Calling method '.version_select at 0x7f7a03d43b80>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:06.890269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c17b782c-3a49-4930-83c0-f1284dbc244d tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:06.890929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c17b782c-3a49-4930-83c0-f1284dbc244d tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:07.602099 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c17b782c-3a49-4930-83c0-f1284dbc244d tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37267b4c360540489a72d9b0043abd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a353634f70fb4ff58c7190a5c7aa675d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:07.612365 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c17b782c-3a49-4930-83c0-f1284dbc244d tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c" status: 200 len: 1317 microversion: 2.1 time: 0.769295 Jul 19 22:33:07.614111 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 886/1795] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:06 2022] GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c => generated 1317 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:07.621872 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-81dd8895-5e4f-40ed-9684-715115ad3f2d tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:07.623086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-81dd8895-5e4f-40ed-9684-715115ad3f2d tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:07.639867 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81dd8895-5e4f-40ed-9684-715115ad3f2d tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:07.640334 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81dd8895-5e4f-40ed-9684-715115ad3f2d tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:07.641141 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81dd8895-5e4f-40ed-9684-715115ad3f2d tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:07.641587 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81dd8895-5e4f-40ed-9684-715115ad3f2d tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:07.680175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:33:08.350653 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-81dd8895-5e4f-40ed-9684-715115ad3f2d tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1532 microversion: 2.1 time: 0.734942 Jul 19 22:33:08.352777 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 887/1796] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:07 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1532 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:08.362201 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-86db67ff-963a-49ba-80dd-98fabb1205a7 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:08.405442 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-86db67ff-963a-49ba-80dd-98fabb1205a7 tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051314 Jul 19 22:33:08.406196 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 888/1797] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:33:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:08.412999 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ac1e1034-c500-4074-9e13-a6b0423c5d8b tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:08.414430 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ac1e1034-c500-4074-9e13-a6b0423c5d8b tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:08.423757 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac1e1034-c500-4074-9e13-a6b0423c5d8b tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:08.424236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac1e1034-c500-4074-9e13-a6b0423c5d8b tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:08.425273 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac1e1034-c500-4074-9e13-a6b0423c5d8b tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:08.425884 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac1e1034-c500-4074-9e13-a6b0423c5d8b tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:08.659183 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-ac1e1034-c500-4074-9e13-a6b0423c5d8b tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lazy-loading 'services' on Instance uuid 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:33:08.689654 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ac1e1034-c500-4074-9e13-a6b0423c5d8b tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1929 microversion: 2.75 time: 0.281316 Jul 19 22:33:08.691017 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 889/1798] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:08 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1929 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:33:08.702263 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-839ee5dd-d185-4b9c-802a-5a784880c649 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:08.703717 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-839ee5dd-d185-4b9c-802a-5a784880c649 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] [instance: 6fded340-0a2a-4b49-8988-53d61dcd8021] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:08.713578 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-839ee5dd-d185-4b9c-802a-5a784880c649 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:08.714749 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-839ee5dd-d185-4b9c-802a-5a784880c649 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:08.716406 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-839ee5dd-d185-4b9c-802a-5a784880c649 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:08.716660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-839ee5dd-d185-4b9c-802a-5a784880c649 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:08.738631 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-839ee5dd-d185-4b9c-802a-5a784880c649 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] HTTP exception thrown: Instance 6fded340-0a2a-4b49-8988-53d61dcd8021 could not be found. Jul 19 22:33:08.742029 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-839ee5dd-d185-4b9c-802a-5a784880c649 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Request method failure captured: Jul 19 22:33:08.742029 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021 HTTP/1.1 Jul 19 22:33:08.742029 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:33:08.742029 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:33:08.742029 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:33:08.742029 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:33:08.742029 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:33:08.742029 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:33:08.742029 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:33:08.742029 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:33:08.742029 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zEJ6Ey2o-KXMk0r_LIzG00khK8rSOxcjkCuYr80XCUwqkSDhKljp3k-zHcbGzRKNcIR5rHqqS4NIbRcX_qIVdVRwpxsCLfTINv-Z_orB4_BQ3ILNsuIbUZdQBjrIJBIwX6ji22QmyF84Oi0hj9TZPqoimHnbsjml-Sp8j58cEtQy4I Jul 19 22:33:08.742029 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:33:08.742029 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:33:08.742029 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:33:08.742029 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:33:08.742029 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:33:08.742029 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:33:08.742029 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: d240e28831304ae890a9bf83a9383111 Jul 19 22:33:08.742029 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesNegativeTestJSON-498308189 Jul 19 22:33:08.742029 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:33:08.742029 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:33:08.743884 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d240e28831304ae890a9bf83a9383111"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d240e28831304ae890a9bf83a9383111"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d240e28831304ae890a9bf83a9383111"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d240e28831304ae890a9bf83a9383111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:33:08.743884 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesNegativeTestJSON-498308189 Jul 19 22:33:08.743884 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: d240e28831304ae890a9bf83a9383111 Jul 19 22:33:08.743884 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-498308189 Jul 19 22:33:08.743884 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesNegativeTestJSON-498308189-project Jul 19 22:33:08.743884 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:33:08.743884 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:33:08.743884 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 4020bca56fb34848b4f6c8d7d1b7b10a Jul 19 22:33:08.743884 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesNegativeTestJSON-498308189-project Jul 19 22:33:08.743884 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:33:08.743884 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 6fded340-0a2a-4b49-8988-53d61dcd8021 could not be found. Jul 19 22:33:08.743884 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '6fded340-0a2a-4b49-8988-53d61dcd8021'} Jul 19 22:33:08.744924 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:33:08.744924 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:08.744924 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:33:08.744924 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:33:08.744924 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:33:08.744924 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:33:08.744924 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:33:08.744924 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:33:08.744924 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:33:08.744924 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:33:08.744924 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fded340-0a2a-4b49-8988-53d61dcd8021 could not be found. Jul 19 22:33:08.744924 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:33:08.744924 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:08.744924 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:33:08.744924 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:08.744924 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:08.744924 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:08.744924 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:33:08.744924 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:33:08.744924 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:33:08.746342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:33:08.746342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:33:08.746342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:33:08.746342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:33:08.746342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:33:08.746342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:33:08.746342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:33:08.746342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fded340-0a2a-4b49-8988-53d61dcd8021 could not be found. Jul 19 22:33:08.746342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:33:08.746342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:08.746342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:33:08.746342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:08.746342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:08.746342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:08.746342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:33:08.746342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:33:08.746342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fded340-0a2a-4b49-8988-53d61dcd8021 could not be found. Jul 19 22:33:08.746342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:33:08.747724 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-839ee5dd-d185-4b9c-802a-5a784880c649 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Returning 404 to user: Instance 6fded340-0a2a-4b49-8988-53d61dcd8021 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:33:08.747724 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-839ee5dd-d185-4b9c-802a-5a784880c649 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] 10.222.0.25 "GET /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021" status: 404 len: 111 microversion: 2.1 time: 0.051253 Jul 19 22:33:08.747724 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 890/1799] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:08 2022] GET /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:33:08.756777 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-44ff0a70-e9d6-49bc-8f46-72c440937266 req-f5ca95b8-643f-4f18-bf61-7b4d22221b5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b832d3f-6d05-4494-be32-1250a88c787c", "tag": "1d4992a2-d0b2-44e7-9f1d-113c2e3cb558"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:33:08.766968 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-44ff0a70-e9d6-49bc-8f46-72c440937266 req-f5ca95b8-643f-4f18-bf61-7b4d22221b5b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:08.768224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-44ff0a70-e9d6-49bc-8f46-72c440937266 req-f5ca95b8-643f-4f18-bf61-7b4d22221b5b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:08.785898 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-44ff0a70-e9d6-49bc-8f46-72c440937266 req-f5ca95b8-643f-4f18-bf61-7b4d22221b5b service nova] Creating event network-changed:1d4992a2-d0b2-44e7-9f1d-113c2e3cb558 for instance 3b832d3f-6d05-4494-be32-1250a88c787c on n-h1-847009-3 Jul 19 22:33:08.792732 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-44ff0a70-e9d6-49bc-8f46-72c440937266 req-f5ca95b8-643f-4f18-bf61-7b4d22221b5b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043232 Jul 19 22:33:08.794140 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 891/1800] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:33:08.805063 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e9f14740-af5d-4421-ab5c-eb9ee0f0f037 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:08.806277 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e9f14740-af5d-4421-ab5c-eb9ee0f0f037 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:08.814464 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9f14740-af5d-4421-ab5c-eb9ee0f0f037 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:08.815221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9f14740-af5d-4421-ab5c-eb9ee0f0f037 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:08.816224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9f14740-af5d-4421-ab5c-eb9ee0f0f037 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:08.816860 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9f14740-af5d-4421-ab5c-eb9ee0f0f037 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:09.095349 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e9f14740-af5d-4421-ab5c-eb9ee0f0f037 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1532 microversion: 2.1 time: 0.298444 Jul 19 22:33:09.096017 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 892/1801] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:08 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1532 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:09.104271 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5a8efd47-fb83-44f5-832c-93a7a3d1c30d tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:09.118780 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5a8efd47-fb83-44f5-832c-93a7a3d1c30d tempest-FlavorsV2TestJSON-1075870072 tempest-FlavorsV2TestJSON-1075870072-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020799 Jul 19 22:33:09.120098 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 893/1802] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:33:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:33:09.149865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a544eb6a-8f24-4f94-ae07-c9a7664da631 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:09.151870 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a544eb6a-8f24-4f94-ae07-c9a7664da631 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 3b832d3f-6d05-4494-be32-1250a88c787c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:09.165820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a544eb6a-8f24-4f94-ae07-c9a7664da631 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:09.170744 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a544eb6a-8f24-4f94-ae07-c9a7664da631 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:09.171778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a544eb6a-8f24-4f94-ae07-c9a7664da631 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:09.172337 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a544eb6a-8f24-4f94-ae07-c9a7664da631 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:09.445146 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5c124f17-368b-48f9-9831-81e1f693a138 tempest-FloatingIPDetailsTestJSON-1529178395 tempest-FloatingIPDetailsTestJSON-1529178395-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/5293b236-b821-453e-a881-aec85a2ef214" status: 202 len: 0 microversion: 2.1 time: 2.574687 Jul 19 22:33:09.446518 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 910/1803] 10.222.0.25 () {58 vars in 1262 bytes} [Tue Jul 19 22:33:06 2022] DELETE /compute/v2.1/os-floating-ips/5293b236-b821-453e-a881-aec85a2ef214 => generated 0 bytes in 2576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:33:09.453380 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e2596619-6164-4d57-998e-bed3a3504652 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-220445435", "metadata": {"image_type": "test"}}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:33:09.461803 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e2596619-6164-4d57-998e-bed3a3504652 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] [instance: 6fded340-0a2a-4b49-8988-53d61dcd8021] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:09.464741 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a544eb6a-8f24-4f94-ae07-c9a7664da631 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37267b4c360540489a72d9b0043abd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a353634f70fb4ff58c7190a5c7aa675d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:09.479461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e2596619-6164-4d57-998e-bed3a3504652 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:09.480464 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e2596619-6164-4d57-998e-bed3a3504652 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:09.481564 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e2596619-6164-4d57-998e-bed3a3504652 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:09.482183 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e2596619-6164-4d57-998e-bed3a3504652 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:09.488935 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a544eb6a-8f24-4f94-ae07-c9a7664da631 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c" status: 200 len: 1317 microversion: 2.1 time: 0.365354 Jul 19 22:33:09.489986 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 894/1804] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:09 2022] GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:09.501674 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b309ab9d-2c17-48af-a5b1-59dc4ecec122 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:09.503867 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-e2596619-6164-4d57-998e-bed3a3504652 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] HTTP exception thrown: Instance 6fded340-0a2a-4b49-8988-53d61dcd8021 could not be found. Jul 19 22:33:09.511216 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:33:09.511216 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:33:09.511216 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b309ab9d-2c17-48af-a5b1-59dc4ecec122 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:09.511216 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b309ab9d-2c17-48af-a5b1-59dc4ecec122 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:09.511216 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b309ab9d-2c17-48af-a5b1-59dc4ecec122 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:09.512184 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b309ab9d-2c17-48af-a5b1-59dc4ecec122 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:09.512277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e2596619-6164-4d57-998e-bed3a3504652 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Request method failure captured: Jul 19 22:33:09.512277 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021/action HTTP/1.1 Jul 19 22:33:09.512277 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:33:09.512277 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:33:09.512277 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:33:09.512277 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 111 Jul 19 22:33:09.512277 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:33:09.512277 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:33:09.512277 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:33:09.512277 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:33:09.512277 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zEJ6Ey2o-KXMk0r_LIzG00khK8rSOxcjkCuYr80XCUwqkSDhKljp3k-zHcbGzRKNcIR5rHqqS4NIbRcX_qIVdVRwpxsCLfTINv-Z_orB4_BQ3ILNsuIbUZdQBjrIJBIwX6ji22QmyF84Oi0hj9TZPqoimHnbsjml-Sp8j58cEtQy4I Jul 19 22:33:09.512277 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:33:09.512277 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:33:09.512277 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:33:09.512277 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:33:09.512277 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:33:09.512277 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:33:09.512277 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: d240e28831304ae890a9bf83a9383111 Jul 19 22:33:09.512277 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ImagesNegativeTestJSON-498308189 Jul 19 22:33:09.512277 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:33:09.512277 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:33:09.513758 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d240e28831304ae890a9bf83a9383111"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d240e28831304ae890a9bf83a9383111"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d240e28831304ae890a9bf83a9383111"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d240e28831304ae890a9bf83a9383111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:33:09.513758 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ImagesNegativeTestJSON-498308189 Jul 19 22:33:09.513758 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: d240e28831304ae890a9bf83a9383111 Jul 19 22:33:09.513758 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-498308189 Jul 19 22:33:09.513758 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ImagesNegativeTestJSON-498308189-project Jul 19 22:33:09.513758 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:33:09.513758 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:33:09.513758 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 4020bca56fb34848b4f6c8d7d1b7b10a Jul 19 22:33:09.513758 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ImagesNegativeTestJSON-498308189-project Jul 19 22:33:09.513758 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:33:09.513758 n-d-847009-3 devstack@n-api.service[119337]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-220445435", "metadata": {"image_type": "test"}}} Jul 19 22:33:09.513758 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:33:09.513758 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 6fded340-0a2a-4b49-8988-53d61dcd8021 could not be found. Jul 19 22:33:09.514917 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '6fded340-0a2a-4b49-8988-53d61dcd8021', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-220445435', 'metadata': {'image_type': 'test'}}}} Jul 19 22:33:09.514917 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:33:09.514917 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:09.514917 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:33:09.514917 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:33:09.514917 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:33:09.514917 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:33:09.514917 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:33:09.514917 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:33:09.514917 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:33:09.514917 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:33:09.514917 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fded340-0a2a-4b49-8988-53d61dcd8021 could not be found. Jul 19 22:33:09.514917 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:09.514917 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:09.514917 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:09.514917 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:09.514917 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:09.514917 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:09.514917 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:33:09.518153 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:33:09.518153 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:33:09.518153 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:33:09.518153 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:33:09.518153 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:33:09.518153 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:33:09.518153 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:33:09.518153 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 19 22:33:09.518153 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 19 22:33:09.518153 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:33:09.518153 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:33:09.518153 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:33:09.518153 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:33:09.518153 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fded340-0a2a-4b49-8988-53d61dcd8021 could not be found. Jul 19 22:33:09.518153 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:09.518153 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:09.518153 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:09.518153 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:09.518153 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:09.518153 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:09.521449 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:33:09.521449 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:33:09.521449 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fded340-0a2a-4b49-8988-53d61dcd8021 could not be found. Jul 19 22:33:09.521449 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:09.521449 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e2596619-6164-4d57-998e-bed3a3504652 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Returning 404 to user: Instance 6fded340-0a2a-4b49-8988-53d61dcd8021 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:33:09.521449 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e2596619-6164-4d57-998e-bed3a3504652 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] 10.222.0.25 "POST /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021/action" status: 404 len: 111 microversion: 2.1 time: 0.063900 Jul 19 22:33:09.521449 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 911/1805] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Jul 19 22:33:09 2022] POST /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:33:09.521449 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2e5489f3-9cc0-4f29-a442-21038ea6af6c tempest-FloatingIPDetailsTestJSON-1529178395 tempest-FloatingIPDetailsTestJSON-1529178395-project] Calling method '.version_select at 0x7f7a03d63ca0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:09.558375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:33:09.564433 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b309ab9d-2c17-48af-a5b1-59dc4ecec122 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.072254 Jul 19 22:33:09.571751 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 895/1806] 10.222.0.25 () {58 vars in 1175 bytes} [Tue Jul 19 22:33:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:33:09.576699 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6fc09b68-6b2d-499e-b2de-f689c51b9a7d tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1753195549", "metadata": {"image_type": "test"}}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:33:09.577817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6fc09b68-6b2d-499e-b2de-f689c51b9a7d tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Failed to fetch instance by id tempest-invalid-579921221 {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 19 22:33:09.578394 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-6fc09b68-6b2d-499e-b2de-f689c51b9a7d tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] HTTP exception thrown: Instance tempest-invalid-579921221 could not be found. Jul 19 22:33:09.580131 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6fc09b68-6b2d-499e-b2de-f689c51b9a7d tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Request method failure captured: Jul 19 22:33:09.580131 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers/tempest-invalid-579921221/action HTTP/1.1 Jul 19 22:33:09.580131 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:33:09.580131 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:33:09.580131 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:33:09.580131 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 112 Jul 19 22:33:09.580131 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:33:09.580131 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:33:09.580131 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:33:09.580131 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:33:09.580131 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zEJ6Ey2o-KXMk0r_LIzG00khK8rSOxcjkCuYr80XCUwqkSDhKljp3k-zHcbGzRKNcIR5rHqqS4NIbRcX_qIVdVRwpxsCLfTINv-Z_orB4_BQ3ILNsuIbUZdQBjrIJBIwX6ji22QmyF84Oi0hj9TZPqoimHnbsjml-Sp8j58cEtQy4I Jul 19 22:33:09.580131 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:33:09.580131 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:33:09.580131 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:33:09.580131 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:33:09.580131 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:33:09.580131 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:33:09.580131 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: d240e28831304ae890a9bf83a9383111 Jul 19 22:33:09.580131 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesNegativeTestJSON-498308189 Jul 19 22:33:09.580131 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:33:09.580131 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:33:09.581723 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d240e28831304ae890a9bf83a9383111"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d240e28831304ae890a9bf83a9383111"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d240e28831304ae890a9bf83a9383111"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d240e28831304ae890a9bf83a9383111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:33:09.581723 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesNegativeTestJSON-498308189 Jul 19 22:33:09.581723 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: d240e28831304ae890a9bf83a9383111 Jul 19 22:33:09.581723 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-498308189 Jul 19 22:33:09.581723 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesNegativeTestJSON-498308189-project Jul 19 22:33:09.581723 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:33:09.581723 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:33:09.581723 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 4020bca56fb34848b4f6c8d7d1b7b10a Jul 19 22:33:09.581723 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesNegativeTestJSON-498308189-project Jul 19 22:33:09.581723 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:33:09.581723 n-d-847009-3 devstack@n-api.service[119338]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1753195549", "metadata": {"image_type": "test"}}} Jul 19 22:33:09.581723 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:33:09.581723 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance tempest-invalid-579921221 could not be found. Jul 19 22:33:09.583593 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'tempest-invalid-579921221', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1753195549', 'metadata': {'image_type': 'test'}}}} Jul 19 22:33:09.583593 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:33:09.583593 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:09.583593 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:33:09.583593 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:33:09.583593 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 19 22:33:09.583593 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 19 22:33:09.583593 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-579921221 could not be found. Jul 19 22:33:09.583593 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:33:09.583593 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:09.583593 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:33:09.583593 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:09.583593 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:09.583593 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:09.583593 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:33:09.583593 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:33:09.583593 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:33:09.583593 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:33:09.583593 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:33:09.583593 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:33:09.585878 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:33:09.585878 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:33:09.585878 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 19 22:33:09.585878 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 19 22:33:09.585878 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:33:09.585878 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:33:09.585878 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:33:09.585878 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:33:09.585878 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-579921221 could not be found. Jul 19 22:33:09.585878 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:33:09.585878 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:09.585878 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:33:09.585878 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:09.585878 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:09.585878 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:09.585878 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:33:09.585878 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:33:09.585878 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-579921221 could not be found. Jul 19 22:33:09.585878 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:33:09.587178 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6fc09b68-6b2d-499e-b2de-f689c51b9a7d tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Returning 404 to user: Instance tempest-invalid-579921221 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:33:09.587178 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6fc09b68-6b2d-499e-b2de-f689c51b9a7d tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] 10.222.0.25 "POST /compute/v2.1/servers/tempest-invalid-579921221/action" status: 404 len: 100 microversion: 2.1 time: 0.008684 Jul 19 22:33:09.588392 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 896/1807] 10.222.0.25 () {60 vars in 1245 bytes} [Tue Jul 19 22:33:09 2022] POST /compute/v2.1/servers/tempest-invalid-579921221/action => generated 100 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:33:09.593302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9956eb0e-d906-4267-9b45-85c7ab90aebf tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-847009-3", "block_migration": false, "disk_over_commit": false}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:33:09.594467 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9956eb0e-d906-4267-9b45-85c7ab90aebf tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:09.602740 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9956eb0e-d906-4267-9b45-85c7ab90aebf tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:09.603217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9956eb0e-d906-4267-9b45-85c7ab90aebf tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:09.604355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9956eb0e-d906-4267-9b45-85c7ab90aebf tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:09.604796 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9956eb0e-d906-4267-9b45-85c7ab90aebf tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:09.634956 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-9956eb0e-d906-4267-9b45-85c7ab90aebf tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lazy-loading 'flavor' on Instance uuid b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:33:09.663322 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9956eb0e-d906-4267-9b45-85c7ab90aebf tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Going to try to live migrate instance to n-h1-847009-3 {{(pid=119338) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 22:33:10.420259 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=18 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:33:10.515437 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:33:11.130995 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2e5489f3-9cc0-4f29-a442-21038ea6af6c tempest-FloatingIPDetailsTestJSON-1529178395 tempest-FloatingIPDetailsTestJSON-1529178395-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/b0f0d64a-6ce6-4d23-932b-03d3fc8b0bc9" status: 202 len: 0 microversion: 2.1 time: 1.618340 Jul 19 22:33:11.134008 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 912/1808] 10.222.0.25 () {58 vars in 1262 bytes} [Tue Jul 19 22:33:09 2022] DELETE /compute/v2.1/os-floating-ips/b0f0d64a-6ce6-4d23-932b-03d3fc8b0bc9 => generated 0 bytes in 1622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:33:11.161197 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ff8dd7fc-3540-4052-8914-f834872a89f4 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-960823585"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:33:11.164622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ff8dd7fc-3540-4052-8914-f834872a89f4 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 19 22:33:11.165840 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-ff8dd7fc-3540-4052-8914-f834872a89f4 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 22:33:11.175134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ff8dd7fc-3540-4052-8914-f834872a89f4 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Request method failure captured: Jul 19 22:33:11.175134 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 19 22:33:11.175134 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:33:11.175134 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:33:11.175134 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:33:11.175134 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 56 Jul 19 22:33:11.175134 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:33:11.175134 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:33:11.175134 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:33:11.175134 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:33:11.175134 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zEJ6Ey2o-KXMk0r_LIzG00khK8rSOxcjkCuYr80XCUwqkSDhKljp3k-zHcbGzRKNcIR5rHqqS4NIbRcX_qIVdVRwpxsCLfTINv-Z_orB4_BQ3ILNsuIbUZdQBjrIJBIwX6ji22QmyF84Oi0hj9TZPqoimHnbsjml-Sp8j58cEtQy4I Jul 19 22:33:11.175134 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:33:11.175134 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:33:11.175134 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:33:11.175134 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:33:11.175134 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:33:11.175134 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:33:11.175134 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: d240e28831304ae890a9bf83a9383111 Jul 19 22:33:11.175134 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ImagesNegativeTestJSON-498308189 Jul 19 22:33:11.175134 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:33:11.175134 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:33:11.178782 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d240e28831304ae890a9bf83a9383111"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d240e28831304ae890a9bf83a9383111"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d240e28831304ae890a9bf83a9383111"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d240e28831304ae890a9bf83a9383111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:33:11.178782 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ImagesNegativeTestJSON-498308189 Jul 19 22:33:11.178782 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: d240e28831304ae890a9bf83a9383111 Jul 19 22:33:11.178782 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-498308189 Jul 19 22:33:11.178782 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ImagesNegativeTestJSON-498308189-project Jul 19 22:33:11.178782 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:33:11.178782 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:33:11.178782 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 4020bca56fb34848b4f6c8d7d1b7b10a Jul 19 22:33:11.178782 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ImagesNegativeTestJSON-498308189-project Jul 19 22:33:11.178782 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:33:11.178782 n-d-847009-3 devstack@n-api.service[119337]: {"createImage": {"name": "tempest-test-snap-960823585"}} Jul 19 22:33:11.178782 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:33:11.178782 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 22:33:11.181704 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-960823585'}}} Jul 19 22:33:11.181704 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:33:11.181704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:11.181704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:33:11.181704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:33:11.181704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 19 22:33:11.181704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 19 22:33:11.181704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 22:33:11.181704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:11.181704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:11.181704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:11.181704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:11.181704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:11.181704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:11.181704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:33:11.181704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:33:11.181704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:33:11.181704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:33:11.181704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:33:11.181704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:33:11.184625 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:33:11.184625 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:33:11.184625 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 19 22:33:11.184625 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 19 22:33:11.184625 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:33:11.184625 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:33:11.184625 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:33:11.184625 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:33:11.184625 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 22:33:11.184625 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:11.184625 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:11.184625 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:11.184625 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:11.184625 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:11.184625 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:11.184625 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:33:11.184625 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:33:11.184625 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 22:33:11.184625 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:11.187361 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ff8dd7fc-3540-4052-8914-f834872a89f4 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:33:11.190836 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ff8dd7fc-3540-4052-8914-f834872a89f4 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] 10.222.0.25 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.054276 Jul 19 22:33:11.203134 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 913/1809] 10.222.0.25 () {60 vars in 1274 bytes} [Tue Jul 19 22:33:11 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:33:11.217444 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b7a53ff3-8679-49d6-b3d6-8bf01865e260 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:11.221745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b7a53ff3-8679-49d6-b3d6-8bf01865e260 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:11.255444 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7a53ff3-8679-49d6-b3d6-8bf01865e260 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:11.256835 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7a53ff3-8679-49d6-b3d6-8bf01865e260 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:11.257910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7a53ff3-8679-49d6-b3d6-8bf01865e260 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:11.259083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7a53ff3-8679-49d6-b3d6-8bf01865e260 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:11.434073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-b7a53ff3-8679-49d6-b3d6-8bf01865e260 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lazy-loading 'services' on Instance uuid 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:33:11.438405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:33:11.484384 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b7a53ff3-8679-49d6-b3d6-8bf01865e260 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1929 microversion: 2.75 time: 0.287468 Jul 19 22:33:11.485578 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 914/1810] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:11 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1929 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:33:11.490747 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-68297449-8b02-4660-908f-f25513d1ce75 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:11.491918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-68297449-8b02-4660-908f-f25513d1ce75 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 3b832d3f-6d05-4494-be32-1250a88c787c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:11.499279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-68297449-8b02-4660-908f-f25513d1ce75 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:11.500534 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-68297449-8b02-4660-908f-f25513d1ce75 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:11.501977 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-68297449-8b02-4660-908f-f25513d1ce75 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:11.502641 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-68297449-8b02-4660-908f-f25513d1ce75 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:11.691877 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-68297449-8b02-4660-908f-f25513d1ce75 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37267b4c360540489a72d9b0043abd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a353634f70fb4ff58c7190a5c7aa675d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:11.702997 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-68297449-8b02-4660-908f-f25513d1ce75 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c" status: 200 len: 1317 microversion: 2.1 time: 0.214806 Jul 19 22:33:11.704585 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 915/1811] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:11 2022] GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:11.725759 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-186f9c4f-fa3e-4996-bdde-30952ad6fc72 tempest-FloatingIPDetailsTestJSON-1529178395 tempest-FloatingIPDetailsTestJSON-1529178395-project] Calling method '.version_select at 0x7f7a03d63f70>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:12.680993 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-186f9c4f-fa3e-4996-bdde-30952ad6fc72 tempest-FloatingIPDetailsTestJSON-1529178395 tempest-FloatingIPDetailsTestJSON-1529178395-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/69256f7b-239d-48e4-8660-6139d504ca65" status: 202 len: 0 microversion: 2.1 time: 0.974927 Jul 19 22:33:12.684042 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 916/1812] 10.222.0.25 () {58 vars in 1262 bytes} [Tue Jul 19 22:33:11 2022] DELETE /compute/v2.1/os-floating-ips/69256f7b-239d-48e4-8660-6139d504ca65 => generated 0 bytes in 978 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:33:12.703381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-605e98ec-029d-4a44-93a6-3f582b9c648c tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-760484481"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:33:12.704518 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-605e98ec-029d-4a44-93a6-3f582b9c648c tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 19 22:33:12.705055 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-605e98ec-029d-4a44-93a6-3f582b9c648c tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 22:33:12.716945 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-605e98ec-029d-4a44-93a6-3f582b9c648c tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Request method failure captured: Jul 19 22:33:12.716945 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 19 22:33:12.716945 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:33:12.716945 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:33:12.716945 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:33:12.716945 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 56 Jul 19 22:33:12.716945 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:33:12.716945 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:33:12.716945 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:33:12.716945 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:33:12.716945 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zEJ6Ey2o-KXMk0r_LIzG00khK8rSOxcjkCuYr80XCUwqkSDhKljp3k-zHcbGzRKNcIR5rHqqS4NIbRcX_qIVdVRwpxsCLfTINv-Z_orB4_BQ3ILNsuIbUZdQBjrIJBIwX6ji22QmyF84Oi0hj9TZPqoimHnbsjml-Sp8j58cEtQy4I Jul 19 22:33:12.716945 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:33:12.716945 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:33:12.716945 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:33:12.716945 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:33:12.716945 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:33:12.716945 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:33:12.716945 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: d240e28831304ae890a9bf83a9383111 Jul 19 22:33:12.716945 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ImagesNegativeTestJSON-498308189 Jul 19 22:33:12.716945 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:33:12.716945 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:33:12.718514 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d240e28831304ae890a9bf83a9383111"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d240e28831304ae890a9bf83a9383111"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d240e28831304ae890a9bf83a9383111"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d240e28831304ae890a9bf83a9383111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:33:12.718514 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ImagesNegativeTestJSON-498308189 Jul 19 22:33:12.718514 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: d240e28831304ae890a9bf83a9383111 Jul 19 22:33:12.718514 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-498308189 Jul 19 22:33:12.718514 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ImagesNegativeTestJSON-498308189-project Jul 19 22:33:12.718514 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:33:12.718514 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:33:12.718514 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 4020bca56fb34848b4f6c8d7d1b7b10a Jul 19 22:33:12.718514 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ImagesNegativeTestJSON-498308189-project Jul 19 22:33:12.718514 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:33:12.718514 n-d-847009-3 devstack@n-api.service[119337]: {"createImage": {"name": "tempest-test-snap-760484481"}} Jul 19 22:33:12.718514 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:33:12.718514 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 22:33:12.719506 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-760484481'}}} Jul 19 22:33:12.719506 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:33:12.719506 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:12.719506 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:33:12.719506 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:33:12.719506 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 19 22:33:12.719506 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 19 22:33:12.719506 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 22:33:12.719506 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:12.719506 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:12.719506 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:12.719506 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:12.719506 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:12.719506 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:12.719506 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:33:12.719506 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:33:12.719506 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:33:12.719506 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:33:12.719506 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:33:12.719506 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:33:12.721187 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:33:12.721187 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:33:12.721187 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 19 22:33:12.721187 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 19 22:33:12.721187 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:33:12.721187 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:33:12.721187 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:33:12.721187 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:33:12.721187 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 22:33:12.721187 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:12.721187 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:12.721187 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:12.721187 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:12.721187 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:12.721187 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:12.721187 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:33:12.721187 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:33:12.721187 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 19 22:33:12.721187 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:12.722704 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-605e98ec-029d-4a44-93a6-3f582b9c648c tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:33:12.722704 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-605e98ec-029d-4a44-93a6-3f582b9c648c tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] 10.222.0.25 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.033477 Jul 19 22:33:12.723530 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 917/1813] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Jul 19 22:33:12 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:33:12.748186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2913856c-c5e7-4b15-b78b-0c915eda0d25 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:12.748817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2913856c-c5e7-4b15-b78b-0c915eda0d25 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:12.793613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2913856c-c5e7-4b15-b78b-0c915eda0d25 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:12.794428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2913856c-c5e7-4b15-b78b-0c915eda0d25 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:12.799865 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2913856c-c5e7-4b15-b78b-0c915eda0d25 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:12.800619 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2913856c-c5e7-4b15-b78b-0c915eda0d25 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:12.830821 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9956eb0e-d906-4267-9b45-85c7ab90aebf tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7/action" status: 202 len: 0 microversion: 2.1 time: 3.241148 Jul 19 22:33:12.831619 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 897/1814] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:33:09 2022] POST /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7/action => generated 0 bytes in 3243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:33:12.838168 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-29d26bd2-379e-414d-abe6-784abb4b780c tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:12.839409 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-29d26bd2-379e-414d-abe6-784abb4b780c tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 3b832d3f-6d05-4494-be32-1250a88c787c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:12.887359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29d26bd2-379e-414d-abe6-784abb4b780c tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:12.895503 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29d26bd2-379e-414d-abe6-784abb4b780c tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:12.898817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29d26bd2-379e-414d-abe6-784abb4b780c tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:12.901923 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29d26bd2-379e-414d-abe6-784abb4b780c tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:13.016598 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-2913856c-c5e7-4b15-b78b-0c915eda0d25 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lazy-loading 'services' on Instance uuid 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:33:13.089438 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2913856c-c5e7-4b15-b78b-0c915eda0d25 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1929 microversion: 2.75 time: 0.361345 Jul 19 22:33:13.090915 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 918/1815] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:12 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1929 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:33:13.107078 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b397e70c-3b94-4ecb-b701-49de14165a48 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:13.107941 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b397e70c-3b94-4ecb-b701-49de14165a48 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] [instance: 6fded340-0a2a-4b49-8988-53d61dcd8021] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:13.121316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b397e70c-3b94-4ecb-b701-49de14165a48 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:13.122143 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b397e70c-3b94-4ecb-b701-49de14165a48 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:13.123812 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b397e70c-3b94-4ecb-b701-49de14165a48 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:13.124570 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b397e70c-3b94-4ecb-b701-49de14165a48 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:13.152008 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-b397e70c-3b94-4ecb-b701-49de14165a48 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] HTTP exception thrown: Instance 6fded340-0a2a-4b49-8988-53d61dcd8021 could not be found. Jul 19 22:33:13.153909 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b397e70c-3b94-4ecb-b701-49de14165a48 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Request method failure captured: Jul 19 22:33:13.153909 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021 HTTP/1.1 Jul 19 22:33:13.153909 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:33:13.153909 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:33:13.153909 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:33:13.153909 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:33:13.153909 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:33:13.153909 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:33:13.153909 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:33:13.153909 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:33:13.153909 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zEJ6Ey2o-KXMk0r_LIzG00khK8rSOxcjkCuYr80XCUwqkSDhKljp3k-zHcbGzRKNcIR5rHqqS4NIbRcX_qIVdVRwpxsCLfTINv-Z_orB4_BQ3ILNsuIbUZdQBjrIJBIwX6ji22QmyF84Oi0hj9TZPqoimHnbsjml-Sp8j58cEtQy4I Jul 19 22:33:13.153909 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:33:13.153909 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:33:13.153909 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:33:13.153909 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:33:13.153909 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:33:13.153909 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:33:13.153909 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: d240e28831304ae890a9bf83a9383111 Jul 19 22:33:13.153909 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ImagesNegativeTestJSON-498308189 Jul 19 22:33:13.153909 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:33:13.153909 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:33:13.155796 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d240e28831304ae890a9bf83a9383111"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d240e28831304ae890a9bf83a9383111"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d240e28831304ae890a9bf83a9383111"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d240e28831304ae890a9bf83a9383111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:33:13.155796 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ImagesNegativeTestJSON-498308189 Jul 19 22:33:13.155796 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: d240e28831304ae890a9bf83a9383111 Jul 19 22:33:13.155796 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-498308189 Jul 19 22:33:13.155796 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ImagesNegativeTestJSON-498308189-project Jul 19 22:33:13.155796 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:33:13.155796 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:33:13.155796 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 4020bca56fb34848b4f6c8d7d1b7b10a Jul 19 22:33:13.155796 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ImagesNegativeTestJSON-498308189-project Jul 19 22:33:13.155796 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:33:13.155796 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 6fded340-0a2a-4b49-8988-53d61dcd8021 could not be found. Jul 19 22:33:13.155796 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '6fded340-0a2a-4b49-8988-53d61dcd8021'} Jul 19 22:33:13.156823 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:33:13.156823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:13.156823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:33:13.156823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:33:13.156823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:33:13.156823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:33:13.156823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:33:13.156823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:33:13.156823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:33:13.156823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:33:13.156823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fded340-0a2a-4b49-8988-53d61dcd8021 could not be found. Jul 19 22:33:13.156823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:13.156823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:13.156823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:13.156823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:13.156823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:13.156823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:13.156823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:33:13.156823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:33:13.156823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:33:13.158511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:33:13.158511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:33:13.158511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:33:13.158511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:33:13.158511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:33:13.158511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:33:13.158511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:33:13.158511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:33:13.158511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:33:13.158511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fded340-0a2a-4b49-8988-53d61dcd8021 could not be found. Jul 19 22:33:13.158511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:13.158511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:13.158511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:13.158511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:13.158511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:13.158511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:13.158511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:33:13.158511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:33:13.158511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fded340-0a2a-4b49-8988-53d61dcd8021 could not be found. Jul 19 22:33:13.158511 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:13.160892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b397e70c-3b94-4ecb-b701-49de14165a48 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Returning 404 to user: Instance 6fded340-0a2a-4b49-8988-53d61dcd8021 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:33:13.162622 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b397e70c-3b94-4ecb-b701-49de14165a48 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021" status: 404 len: 111 microversion: 2.1 time: 0.068796 Jul 19 22:33:13.163549 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 919/1816] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:33:13 2022] DELETE /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:33:13.169617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-66850534-74db-4d4f-8e96-66024e4cf2ac tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:13.170576 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-66850534-74db-4d4f-8e96-66024e4cf2ac tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:13.180655 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-66850534-74db-4d4f-8e96-66024e4cf2ac tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:13.181424 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-66850534-74db-4d4f-8e96-66024e4cf2ac tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:13.183353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-66850534-74db-4d4f-8e96-66024e4cf2ac tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:13.184048 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-66850534-74db-4d4f-8e96-66024e4cf2ac tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:13.985874 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-29d26bd2-379e-414d-abe6-784abb4b780c tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37267b4c360540489a72d9b0043abd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a353634f70fb4ff58c7190a5c7aa675d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:13.996378 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-29d26bd2-379e-414d-abe6-784abb4b780c tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c" status: 200 len: 1317 microversion: 2.1 time: 1.163552 Jul 19 22:33:13.997593 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 898/1817] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:12 2022] GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c => generated 1317 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:14.003630 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-94312126-e56e-4708-8e37-5fe15e401447 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:14.004549 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-94312126-e56e-4708-8e37-5fe15e401447 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] [instance: 6fded340-0a2a-4b49-8988-53d61dcd8021] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:14.014538 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-94312126-e56e-4708-8e37-5fe15e401447 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:14.015228 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-94312126-e56e-4708-8e37-5fe15e401447 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:14.016115 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-94312126-e56e-4708-8e37-5fe15e401447 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:14.016566 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-94312126-e56e-4708-8e37-5fe15e401447 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:14.035559 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-94312126-e56e-4708-8e37-5fe15e401447 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] HTTP exception thrown: Instance 6fded340-0a2a-4b49-8988-53d61dcd8021 could not be found. Jul 19 22:33:14.037584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-94312126-e56e-4708-8e37-5fe15e401447 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Request method failure captured: Jul 19 22:33:14.037584 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021 HTTP/1.1 Jul 19 22:33:14.037584 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:33:14.037584 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:33:14.037584 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:33:14.037584 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:33:14.037584 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:33:14.037584 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:33:14.037584 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:33:14.037584 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:33:14.037584 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zEJ6Ey2o-KXMk0r_LIzG00khK8rSOxcjkCuYr80XCUwqkSDhKljp3k-zHcbGzRKNcIR5rHqqS4NIbRcX_qIVdVRwpxsCLfTINv-Z_orB4_BQ3ILNsuIbUZdQBjrIJBIwX6ji22QmyF84Oi0hj9TZPqoimHnbsjml-Sp8j58cEtQy4I Jul 19 22:33:14.037584 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:33:14.037584 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:33:14.037584 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:33:14.037584 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:33:14.037584 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:33:14.037584 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:33:14.037584 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: d240e28831304ae890a9bf83a9383111 Jul 19 22:33:14.037584 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesNegativeTestJSON-498308189 Jul 19 22:33:14.037584 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:33:14.037584 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:33:14.039764 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d240e28831304ae890a9bf83a9383111"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d240e28831304ae890a9bf83a9383111"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d240e28831304ae890a9bf83a9383111"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d240e28831304ae890a9bf83a9383111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:33:14.039764 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesNegativeTestJSON-498308189 Jul 19 22:33:14.039764 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: d240e28831304ae890a9bf83a9383111 Jul 19 22:33:14.039764 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-498308189 Jul 19 22:33:14.039764 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesNegativeTestJSON-498308189-project Jul 19 22:33:14.039764 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:33:14.039764 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:33:14.039764 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 4020bca56fb34848b4f6c8d7d1b7b10a Jul 19 22:33:14.039764 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesNegativeTestJSON-498308189-project Jul 19 22:33:14.039764 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:33:14.039764 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 6fded340-0a2a-4b49-8988-53d61dcd8021 could not be found. Jul 19 22:33:14.039764 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '6fded340-0a2a-4b49-8988-53d61dcd8021'} Jul 19 22:33:14.040774 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:33:14.040774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:14.040774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:33:14.040774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:33:14.040774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:33:14.040774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:33:14.040774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:33:14.040774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:33:14.040774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:33:14.040774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:33:14.040774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fded340-0a2a-4b49-8988-53d61dcd8021 could not be found. Jul 19 22:33:14.040774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:33:14.040774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:14.040774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:33:14.040774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:14.040774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:14.040774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:14.040774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:33:14.040774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:33:14.040774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:33:14.042335 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:33:14.042335 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:33:14.042335 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:33:14.042335 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:33:14.042335 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:33:14.042335 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:33:14.042335 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:33:14.042335 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fded340-0a2a-4b49-8988-53d61dcd8021 could not be found. Jul 19 22:33:14.042335 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:33:14.042335 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:14.042335 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:33:14.042335 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:14.042335 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:14.042335 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:14.042335 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:33:14.042335 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:33:14.042335 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fded340-0a2a-4b49-8988-53d61dcd8021 could not be found. Jul 19 22:33:14.042335 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:33:14.045587 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-94312126-e56e-4708-8e37-5fe15e401447 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] Returning 404 to user: Instance 6fded340-0a2a-4b49-8988-53d61dcd8021 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:33:14.046743 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-94312126-e56e-4708-8e37-5fe15e401447 tempest-ImagesNegativeTestJSON-498308189 tempest-ImagesNegativeTestJSON-498308189-project] 10.222.0.25 "GET /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021" status: 404 len: 111 microversion: 2.1 time: 0.047959 Jul 19 22:33:14.047898 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 899/1818] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:13 2022] GET /compute/v2.1/servers/6fded340-0a2a-4b49-8988-53d61dcd8021 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:33:14.110916 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-69b633d3-392f-41cc-afb4-0e109f651190 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:14.112675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-69b633d3-392f-41cc-afb4-0e109f651190 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:14.122232 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-66850534-74db-4d4f-8e96-66024e4cf2ac tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:14.124577 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-69b633d3-392f-41cc-afb4-0e109f651190 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:14.128395 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-69b633d3-392f-41cc-afb4-0e109f651190 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:14.129409 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-69b633d3-392f-41cc-afb4-0e109f651190 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:14.133236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-69b633d3-392f-41cc-afb4-0e109f651190 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:14.163613 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-66850534-74db-4d4f-8e96-66024e4cf2ac tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1391 microversion: 2.1 time: 0.993851 Jul 19 22:33:14.164381 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 920/1819] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:13 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1391 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:14.381401 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-69b633d3-392f-41cc-afb4-0e109f651190 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lazy-loading 'services' on Instance uuid 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:33:14.404924 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-69b633d3-392f-41cc-afb4-0e109f651190 tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1929 microversion: 2.75 time: 0.297294 Jul 19 22:33:14.406873 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 900/1820] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:14 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1929 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:33:15.014557 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-57b0198a-c1dc-4f39-a7a5-8d59d3993a87 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:15.015926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-57b0198a-c1dc-4f39-a7a5-8d59d3993a87 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 3b832d3f-6d05-4494-be32-1250a88c787c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:15.047639 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57b0198a-c1dc-4f39-a7a5-8d59d3993a87 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:15.047639 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57b0198a-c1dc-4f39-a7a5-8d59d3993a87 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:15.048311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57b0198a-c1dc-4f39-a7a5-8d59d3993a87 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:15.054083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57b0198a-c1dc-4f39-a7a5-8d59d3993a87 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:15.181865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7b91d41c-b895-4fce-b17e-4513981fd655 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:15.182625 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7b91d41c-b895-4fce-b17e-4513981fd655 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:15.212515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b91d41c-b895-4fce-b17e-4513981fd655 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:15.215487 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b91d41c-b895-4fce-b17e-4513981fd655 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:15.217679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b91d41c-b895-4fce-b17e-4513981fd655 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:15.220492 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b91d41c-b895-4fce-b17e-4513981fd655 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:16.329679 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-57b0198a-c1dc-4f39-a7a5-8d59d3993a87 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37267b4c360540489a72d9b0043abd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a353634f70fb4ff58c7190a5c7aa675d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:16.356114 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-57b0198a-c1dc-4f39-a7a5-8d59d3993a87 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c" status: 200 len: 1317 microversion: 2.1 time: 1.345323 Jul 19 22:33:16.361840 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 921/1821] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:15 2022] GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c => generated 1317 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:16.384667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-71ae8677-7f61-4841-b45c-911b0fc84fad tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:16.385306 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-71ae8677-7f61-4841-b45c-911b0fc84fad tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:16.410606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-71ae8677-7f61-4841-b45c-911b0fc84fad tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:16.414576 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-71ae8677-7f61-4841-b45c-911b0fc84fad tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:16.419006 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-71ae8677-7f61-4841-b45c-911b0fc84fad tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:16.420953 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-71ae8677-7f61-4841-b45c-911b0fc84fad tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:16.541721 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7b91d41c-b895-4fce-b17e-4513981fd655 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:16.564248 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7b91d41c-b895-4fce-b17e-4513981fd655 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1391 microversion: 2.1 time: 1.380004 Jul 19 22:33:16.566524 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 901/1822] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:15 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1391 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:16.629930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-d7412963-0353-49b8-8642-3d9f6b2b1dfa req-6d64530a-bb4b-4a8f-8f7a-5105e3413ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b832d3f-6d05-4494-be32-1250a88c787c", "name": "network-vif-plugged", "status": "completed", "tag": "1d4992a2-d0b2-44e7-9f1d-113c2e3cb558"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:33:16.656774 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d7412963-0353-49b8-8642-3d9f6b2b1dfa req-6d64530a-bb4b-4a8f-8f7a-5105e3413ffe service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:16.657594 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d7412963-0353-49b8-8642-3d9f6b2b1dfa req-6d64530a-bb4b-4a8f-8f7a-5105e3413ffe service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:16.695428 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-d7412963-0353-49b8-8642-3d9f6b2b1dfa req-6d64530a-bb4b-4a8f-8f7a-5105e3413ffe service nova] Creating event network-vif-plugged:1d4992a2-d0b2-44e7-9f1d-113c2e3cb558 for instance 3b832d3f-6d05-4494-be32-1250a88c787c on n-h1-847009-3 Jul 19 22:33:16.712066 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-d7412963-0353-49b8-8642-3d9f6b2b1dfa req-6d64530a-bb4b-4a8f-8f7a-5105e3413ffe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143956 Jul 19 22:33:16.713024 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 902/1823] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:33:17.383579 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8acbf838-38f0-446d-915e-73fb7d9edd74 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:17.385773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8acbf838-38f0-446d-915e-73fb7d9edd74 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 3b832d3f-6d05-4494-be32-1250a88c787c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:17.421127 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8acbf838-38f0-446d-915e-73fb7d9edd74 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:17.431458 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8acbf838-38f0-446d-915e-73fb7d9edd74 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:17.434001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8acbf838-38f0-446d-915e-73fb7d9edd74 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:17.434778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8acbf838-38f0-446d-915e-73fb7d9edd74 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:17.676354 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-71ae8677-7f61-4841-b45c-911b0fc84fad tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lazy-loading 'services' on Instance uuid 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:33:17.753891 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-71ae8677-7f61-4841-b45c-911b0fc84fad tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1929 microversion: 2.75 time: 1.390456 Jul 19 22:33:17.755992 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 922/1824] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:16 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1929 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:33:17.840318 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-10ce8a69-45f9-4b60-b283-88b214e098c7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:17.850785 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-10ce8a69-45f9-4b60-b283-88b214e098c7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:17.878247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-10ce8a69-45f9-4b60-b283-88b214e098c7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:17.883601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-10ce8a69-45f9-4b60-b283-88b214e098c7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:17.885996 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-10ce8a69-45f9-4b60-b283-88b214e098c7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:17.886663 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-10ce8a69-45f9-4b60-b283-88b214e098c7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:18.668959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8acbf838-38f0-446d-915e-73fb7d9edd74 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37267b4c360540489a72d9b0043abd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a353634f70fb4ff58c7190a5c7aa675d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:18.701693 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8acbf838-38f0-446d-915e-73fb7d9edd74 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c" status: 200 len: 1317 microversion: 2.1 time: 1.328112 Jul 19 22:33:18.702995 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 903/1825] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:17 2022] GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c => generated 1317 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:18.777880 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7d58ae4f-8b67-40c3-87b0-a13c5b7c4b7e tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:18.778986 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7d58ae4f-8b67-40c3-87b0-a13c5b7c4b7e tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:18.797951 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7d58ae4f-8b67-40c3-87b0-a13c5b7c4b7e tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:18.799150 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7d58ae4f-8b67-40c3-87b0-a13c5b7c4b7e tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:18.800280 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7d58ae4f-8b67-40c3-87b0-a13c5b7c4b7e tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:18.801007 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7d58ae4f-8b67-40c3-87b0-a13c5b7c4b7e tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:19.535885 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:33:19.748144 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-7d58ae4f-8b67-40c3-87b0-a13c5b7c4b7e tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lazy-loading 'services' on Instance uuid 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:33:19.826171 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7d58ae4f-8b67-40c3-87b0-a13c5b7c4b7e tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1935 microversion: 2.75 time: 1.053333 Jul 19 22:33:19.827331 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 904/1826] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:18 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1935 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:33:19.838486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-618988c7-12a3-4a7d-8df0-afde23af63d4 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:19.839462 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-618988c7-12a3-4a7d-8df0-afde23af63d4 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 3b832d3f-6d05-4494-be32-1250a88c787c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:19.852950 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-618988c7-12a3-4a7d-8df0-afde23af63d4 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:19.855569 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-618988c7-12a3-4a7d-8df0-afde23af63d4 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:19.862827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-618988c7-12a3-4a7d-8df0-afde23af63d4 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:19.863801 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-618988c7-12a3-4a7d-8df0-afde23af63d4 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:20.058670 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-10ce8a69-45f9-4b60-b283-88b214e098c7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:20.079266 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-10ce8a69-45f9-4b60-b283-88b214e098c7 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1391 microversion: 2.1 time: 2.243217 Jul 19 22:33:20.080673 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 923/1827] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:17 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1391 bytes in 2320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:20.333551 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b729fb39-2f0b-4d4a-a6cf-3b735604408e tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-148594704", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "b4641b99-bd60-4a37-a86f-eb90810f05bc"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:33:20.407008 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-b729fb39-2f0b-4d4a-a6cf-3b735604408e tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] validate_networks() for [('b4641b99-bd60-4a37-a86f-eb90810f05bc', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:33:20.795722 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-618988c7-12a3-4a7d-8df0-afde23af63d4 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37267b4c360540489a72d9b0043abd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a353634f70fb4ff58c7190a5c7aa675d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:20.813347 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-618988c7-12a3-4a7d-8df0-afde23af63d4 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c" status: 200 len: 1317 microversion: 2.1 time: 0.984448 Jul 19 22:33:20.814481 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 905/1828] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:19 2022] GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c => generated 1317 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:20.837584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f68cb8ec-1f24-4a8b-bfb7-c1e397d9bd69 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1212884394", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "69dde816-f623-484f-b274-67b5a7bbba5e"}], "block_device_mapping_v2": [{"uuid": "0633ca38-0950-4a26-895a-562ac0360a24", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:33:20.930222 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-f68cb8ec-1f24-4a8b-bfb7-c1e397d9bd69 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] validate_networks() for [('69dde816-f623-484f-b274-67b5a7bbba5e', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:33:22.792817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-b729fb39-2f0b-4d4a-a6cf-3b735604408e tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:33:22.793251 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-b729fb39-2f0b-4d4a-a6cf-3b735604408e tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:33:22.793712 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-b729fb39-2f0b-4d4a-a6cf-3b735604408e tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:33:22.794314 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-b729fb39-2f0b-4d4a-a6cf-3b735604408e tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:33:22.794743 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-b729fb39-2f0b-4d4a-a6cf-3b735604408e tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:33:22.814383 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b729fb39-2f0b-4d4a-a6cf-3b735604408e tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:22.814841 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b729fb39-2f0b-4d4a-a6cf-3b735604408e tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:22.820311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b729fb39-2f0b-4d4a-a6cf-3b735604408e tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:22.820923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b729fb39-2f0b-4d4a-a6cf-3b735604408e tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:22.891070 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-b729fb39-2f0b-4d4a-a6cf-3b735604408e tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Getting quotas for project a3c1b5a8abc7401b9513023803dd1f15. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:33:22.907564 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-b729fb39-2f0b-4d4a-a6cf-3b735604408e tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Getting quotas for user 89cd4a1e9d0f4f328e7f4046ad9fa711 and project a3c1b5a8abc7401b9513023803dd1f15. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:33:22.945904 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:33:22.950822 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b729fb39-2f0b-4d4a-a6cf-3b735604408e tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:33:22.957295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b729fb39-2f0b-4d4a-a6cf-3b735604408e tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] [instance: 43943c92-c6e2-456e-b295-ca4ed3e6c5f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:33:23.038873 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b729fb39-2f0b-4d4a-a6cf-3b735604408e tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.956190 Jul 19 22:33:23.042836 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 924/1829] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:33:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:33:23.053480 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-50e970fe-64bb-46dc-a4f6-1bd67fad054e tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:23.054435 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-50e970fe-64bb-46dc-a4f6-1bd67fad054e tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:23.088537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-50e970fe-64bb-46dc-a4f6-1bd67fad054e tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:23.088951 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-50e970fe-64bb-46dc-a4f6-1bd67fad054e tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:23.095591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-50e970fe-64bb-46dc-a4f6-1bd67fad054e tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:23.096063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-50e970fe-64bb-46dc-a4f6-1bd67fad054e tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:23.515687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-50e970fe-64bb-46dc-a4f6-1bd67fad054e tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] Lazy-loading 'services' on Instance uuid 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:33:23.578660 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-50e970fe-64bb-46dc-a4f6-1bd67fad054e tempest-ServersAdmin275Test-1185450220 tempest-ServersAdmin275Test-1185450220-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1920 microversion: 2.75 time: 0.534531 Jul 19 22:33:23.579177 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 925/1830] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:23 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1920 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:33:23.580455 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-f68cb8ec-1f24-4a8b-bfb7-c1e397d9bd69 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:33:23.581537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-f68cb8ec-1f24-4a8b-bfb7-c1e397d9bd69 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:33:23.582200 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-f68cb8ec-1f24-4a8b-bfb7-c1e397d9bd69 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:33:23.582771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-f68cb8ec-1f24-4a8b-bfb7-c1e397d9bd69 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:33:23.583477 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-f68cb8ec-1f24-4a8b-bfb7-c1e397d9bd69 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:33:23.602755 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f68cb8ec-1f24-4a8b-bfb7-c1e397d9bd69 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:23.603516 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f68cb8ec-1f24-4a8b-bfb7-c1e397d9bd69 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:23.604777 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f68cb8ec-1f24-4a8b-bfb7-c1e397d9bd69 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:23.606578 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f68cb8ec-1f24-4a8b-bfb7-c1e397d9bd69 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:23.625390 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b7eb1d43-36ab-4473-bf76-b3d555f2b75b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:23.626535 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b7eb1d43-36ab-4473-bf76-b3d555f2b75b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:23.654196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7eb1d43-36ab-4473-bf76-b3d555f2b75b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:23.662034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7eb1d43-36ab-4473-bf76-b3d555f2b75b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:23.663068 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7eb1d43-36ab-4473-bf76-b3d555f2b75b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:23.663567 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7eb1d43-36ab-4473-bf76-b3d555f2b75b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:23.691960 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-f68cb8ec-1f24-4a8b-bfb7-c1e397d9bd69 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Getting quotas for project d0aa317147bd4c878b3c5e4480ae6289. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:33:23.712112 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-f68cb8ec-1f24-4a8b-bfb7-c1e397d9bd69 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Getting quotas for user 113e94f3bdbc4a2bb284a82b0b410d68 and project d0aa317147bd4c878b3c5e4480ae6289. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:33:23.949229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f68cb8ec-1f24-4a8b-bfb7-c1e397d9bd69 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:33:23.952359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f68cb8ec-1f24-4a8b-bfb7-c1e397d9bd69 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0633ca38-0950-4a26-895a-562ac0360a24',volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:33:24.251177 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f68cb8ec-1f24-4a8b-bfb7-c1e397d9bd69 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.424387 Jul 19 22:33:24.254698 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 906/1831] 10.222.0.25 () {62 vars in 1187 bytes} [Tue Jul 19 22:33:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3430 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 19 22:33:24.268014 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f81e7a13-be3c-41d4-8d7b-c59bb6eaae10 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:24.269042 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f81e7a13-be3c-41d4-8d7b-c59bb6eaae10 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 3b832d3f-6d05-4494-be32-1250a88c787c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:24.283813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f81e7a13-be3c-41d4-8d7b-c59bb6eaae10 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:24.284282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f81e7a13-be3c-41d4-8d7b-c59bb6eaae10 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:24.287514 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f81e7a13-be3c-41d4-8d7b-c59bb6eaae10 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:24.290375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f81e7a13-be3c-41d4-8d7b-c59bb6eaae10 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:25.288944 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b7eb1d43-36ab-4473-bf76-b3d555f2b75b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:25.321022 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b7eb1d43-36ab-4473-bf76-b3d555f2b75b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1391 microversion: 2.1 time: 1.735919 Jul 19 22:33:25.351047 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 926/1832] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:23 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1391 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:25.378104 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-217d64c2-2808-42fc-9415-28b71740a727 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:25.381280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-217d64c2-2808-42fc-9415-28b71740a727 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] [instance: 43943c92-c6e2-456e-b295-ca4ed3e6c5f1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:25.390937 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f81e7a13-be3c-41d4-8d7b-c59bb6eaae10 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37267b4c360540489a72d9b0043abd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a353634f70fb4ff58c7190a5c7aa675d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:25.395643 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-217d64c2-2808-42fc-9415-28b71740a727 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:25.405686 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f81e7a13-be3c-41d4-8d7b-c59bb6eaae10 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c" status: 200 len: 1508 microversion: 2.1 time: 1.148540 Jul 19 22:33:25.410159 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-217d64c2-2808-42fc-9415-28b71740a727 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:25.419288 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 907/1833] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:24 2022] GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c => generated 1508 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:25.420672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-217d64c2-2808-42fc-9415-28b71740a727 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:25.420672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-217d64c2-2808-42fc-9415-28b71740a727 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:25.430842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-761cb51a-53d5-48fb-a4aa-3c15abc0a3b4 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:25.431402 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-761cb51a-53d5-48fb-a4aa-3c15abc0a3b4 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:25.466151 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-761cb51a-53d5-48fb-a4aa-3c15abc0a3b4 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:25.466608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-761cb51a-53d5-48fb-a4aa-3c15abc0a3b4 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:25.471092 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-761cb51a-53d5-48fb-a4aa-3c15abc0a3b4 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:25.471571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-761cb51a-53d5-48fb-a4aa-3c15abc0a3b4 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:25.505191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:33:25.600726 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-761cb51a-53d5-48fb-a4aa-3c15abc0a3b4 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:33:25.905125 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-761cb51a-53d5-48fb-a4aa-3c15abc0a3b4 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "DELETE /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 204 len: 0 microversion: 2.75 time: 0.489909 Jul 19 22:33:25.914288 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 908/1834] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 22:33:25 2022] DELETE /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:33:25.939587 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-04a680aa-a0fc-48f9-ab34-1f9c04243dac tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:25.940696 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-04a680aa-a0fc-48f9-ab34-1f9c04243dac tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:25.975899 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04a680aa-a0fc-48f9-ab34-1f9c04243dac tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:25.976234 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04a680aa-a0fc-48f9-ab34-1f9c04243dac tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:25.976967 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04a680aa-a0fc-48f9-ab34-1f9c04243dac tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:25.977423 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04a680aa-a0fc-48f9-ab34-1f9c04243dac tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:26.298472 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-04a680aa-a0fc-48f9-ab34-1f9c04243dac tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:26.346819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-04a680aa-a0fc-48f9-ab34-1f9c04243dac tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:26.358443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-217d64c2-2808-42fc-9415-28b71740a727 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cd4a1e9d0f4f328e7f4046ad9fa711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c1b5a8abc7401b9513023803dd1f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:26.366877 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-04a680aa-a0fc-48f9-ab34-1f9c04243dac tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:26.382892 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-04a680aa-a0fc-48f9-ab34-1f9c04243dac tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1233 microversion: 2.25 time: 0.466286 Jul 19 22:33:26.404588 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-217d64c2-2808-42fc-9415-28b71740a727 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] 10.222.0.25 "GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1" status: 200 len: 1274 microversion: 2.1 time: 1.051060 Jul 19 22:33:26.413096 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 927/1836] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:25 2022] GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1 => generated 1274 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:26.417222 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 909/1836] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:25 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1233 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:33:26.431375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ddbf3029-cee3-4638-a52c-6f359e763e87 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:26.432018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ddbf3029-cee3-4638-a52c-6f359e763e87 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:26.450120 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ddbf3029-cee3-4638-a52c-6f359e763e87 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:26.450622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ddbf3029-cee3-4638-a52c-6f359e763e87 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:26.451472 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ddbf3029-cee3-4638-a52c-6f359e763e87 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:26.451921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ddbf3029-cee3-4638-a52c-6f359e763e87 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:26.460210 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d5fe06c0-31ee-47b2-a155-ceeb5c581f09 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:26.464528 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d5fe06c0-31ee-47b2-a155-ceeb5c581f09 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:26.488531 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5fe06c0-31ee-47b2-a155-ceeb5c581f09 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:26.505085 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5fe06c0-31ee-47b2-a155-ceeb5c581f09 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:26.512247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5fe06c0-31ee-47b2-a155-ceeb5c581f09 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:26.519313 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5fe06c0-31ee-47b2-a155-ceeb5c581f09 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:28.296758 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d5fe06c0-31ee-47b2-a155-ceeb5c581f09 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:28.316034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d5fe06c0-31ee-47b2-a155-ceeb5c581f09 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:28.318704 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d5fe06c0-31ee-47b2-a155-ceeb5c581f09 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:28.330802 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d5fe06c0-31ee-47b2-a155-ceeb5c581f09 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1444 microversion: 2.75 time: 1.910561 Jul 19 22:33:28.332163 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 928/1837] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:26 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1444 bytes in 1914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:33:28.341367 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e5a9e6da-c481-4888-aae5-eb3c3a88881a tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:28.342250 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e5a9e6da-c481-4888-aae5-eb3c3a88881a tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] [instance: 43943c92-c6e2-456e-b295-ca4ed3e6c5f1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:28.355036 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5a9e6da-c481-4888-aae5-eb3c3a88881a tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:28.355738 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5a9e6da-c481-4888-aae5-eb3c3a88881a tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:28.358410 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5a9e6da-c481-4888-aae5-eb3c3a88881a tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:28.359546 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5a9e6da-c481-4888-aae5-eb3c3a88881a tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:28.613025 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e5a9e6da-c481-4888-aae5-eb3c3a88881a tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cd4a1e9d0f4f328e7f4046ad9fa711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c1b5a8abc7401b9513023803dd1f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:28.629955 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e5a9e6da-c481-4888-aae5-eb3c3a88881a tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] 10.222.0.25 "GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1" status: 200 len: 1274 microversion: 2.1 time: 0.296354 Jul 19 22:33:28.633289 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 929/1838] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:28 2022] GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1 => generated 1274 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:28.660538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4f6ed4d3-3818-46f3-a4a9-fa72445516e1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:28.666038 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4f6ed4d3-3818-46f3-a4a9-fa72445516e1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:28.682984 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f6ed4d3-3818-46f3-a4a9-fa72445516e1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:28.691700 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f6ed4d3-3818-46f3-a4a9-fa72445516e1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:28.692890 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f6ed4d3-3818-46f3-a4a9-fa72445516e1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:28.694866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f6ed4d3-3818-46f3-a4a9-fa72445516e1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:29.319228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4f6ed4d3-3818-46f3-a4a9-fa72445516e1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:29.333069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4f6ed4d3-3818-46f3-a4a9-fa72445516e1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:29.339529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4f6ed4d3-3818-46f3-a4a9-fa72445516e1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:29.340937 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4f6ed4d3-3818-46f3-a4a9-fa72445516e1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1251 microversion: 2.25 time: 0.693187 Jul 19 22:33:29.343632 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 930/1839] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:28 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1251 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:33:29.357034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-593aaa75-dcb2-40ab-a334-98f82922f857 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:29.358103 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-593aaa75-dcb2-40ab-a334-98f82922f857 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:29.370549 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-593aaa75-dcb2-40ab-a334-98f82922f857 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:29.376917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-593aaa75-dcb2-40ab-a334-98f82922f857 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:29.380780 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-593aaa75-dcb2-40ab-a334-98f82922f857 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:29.385689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-593aaa75-dcb2-40ab-a334-98f82922f857 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:29.504772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ddbf3029-cee3-4638-a52c-6f359e763e87 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:29.518961 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ddbf3029-cee3-4638-a52c-6f359e763e87 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1391 microversion: 2.1 time: 3.099057 Jul 19 22:33:29.520091 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 910/1840] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:26 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1391 bytes in 3102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:29.591128 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3f83de0b-cc1e-48f4-afa2-3dd968584fb7 tempest-VolumesAdminNegativeTest-1447173879 tempest-VolumesAdminNegativeTest-1447173879-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "aa9c81a5-bbf0-43ff-aebb-e91d436acd61"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:33:29.594106 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3f83de0b-cc1e-48f4-afa2-3dd968584fb7 tempest-VolumesAdminNegativeTest-1447173879 tempest-VolumesAdminNegativeTest-1447173879-project-admin] [instance: 3b832d3f-6d05-4494-be32-1250a88c787c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:29.604699 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3f83de0b-cc1e-48f4-afa2-3dd968584fb7 tempest-VolumesAdminNegativeTest-1447173879 tempest-VolumesAdminNegativeTest-1447173879-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:29.605539 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3f83de0b-cc1e-48f4-afa2-3dd968584fb7 tempest-VolumesAdminNegativeTest-1447173879 tempest-VolumesAdminNegativeTest-1447173879-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:29.606552 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3f83de0b-cc1e-48f4-afa2-3dd968584fb7 tempest-VolumesAdminNegativeTest-1447173879 tempest-VolumesAdminNegativeTest-1447173879-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:29.607598 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3f83de0b-cc1e-48f4-afa2-3dd968584fb7 tempest-VolumesAdminNegativeTest-1447173879 tempest-VolumesAdminNegativeTest-1447173879-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:29.761580 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-3f83de0b-cc1e-48f4-afa2-3dd968584fb7 tempest-VolumesAdminNegativeTest-1447173879 tempest-VolumesAdminNegativeTest-1447173879-project-admin] HTTP exception thrown: Volume c7765630-87f1-4c30-92bf-e8985b14bd4d could not be found. Jul 19 22:33:29.764455 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3f83de0b-cc1e-48f4-afa2-3dd968584fb7 tempest-VolumesAdminNegativeTest-1447173879 tempest-VolumesAdminNegativeTest-1447173879-project-admin] Request method failure captured: Jul 19 22:33:29.764455 n-d-847009-3 devstack@n-api.service[119338]: request: PUT /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c/os-volume_attachments/c7765630-87f1-4c30-92bf-e8985b14bd4d HTTP/1.1 Jul 19 22:33:29.764455 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:33:29.764455 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:33:29.764455 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:33:29.764455 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 74 Jul 19 22:33:29.764455 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:33:29.764455 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:33:29.764455 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:33:29.764455 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:33:29.764455 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zCCcLykTW23nVGexflcU3EBiDjxEBh0s2wM34MLi69ggPaGg4IH-cp1HsQKl2Sg9dH9bYM2Fdh1SVj6cCmVbQ4EU0RHO1fPm1Hb2-yZ6YCxD0rAXIc2mX33Z-Xo6pAIueIIBf9Z3-hAWL3oVAR_sEKp6KyxJ-wzPBIcEuYau9NExRI Jul 19 22:33:29.764455 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:33:29.764455 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:33:29.764455 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:33:29.764455 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:33:29.764455 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:33:29.764455 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:33:29.764455 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 53f5362a2fb44d68baca204db799343c Jul 19 22:33:29.764455 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-VolumesAdminNegativeTest-1447173879 Jul 19 22:33:29.764455 n-d-847009-3 devstack@n-api.service[119338]: X-Role: admin,member,reader Jul 19 22:33:29.764455 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: admin,member,reader Jul 19 22:33:29.766160 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_53f5362a2fb44d68baca204db799343c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/53f5362a2fb44d68baca204db799343c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/53f5362a2fb44d68baca204db799343c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/53f5362a2fb44d68baca204db799343c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:33:29.766160 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-VolumesAdminNegativeTest-1447173879 Jul 19 22:33:29.766160 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 53f5362a2fb44d68baca204db799343c Jul 19 22:33:29.766160 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1447173879 Jul 19 22:33:29.766160 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-VolumesAdminNegativeTest-1447173879-project-admin Jul 19 22:33:29.766160 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:33:29.766160 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:33:29.766160 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: b6cf133be025460891a641f2dedb54e9 Jul 19 22:33:29.766160 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-VolumesAdminNegativeTest-1447173879-project-admin Jul 19 22:33:29.766160 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:33:29.766160 n-d-847009-3 devstack@n-api.service[119338]: {"volumeAttachment": {"volumeId": "aa9c81a5-bbf0-43ff-aebb-e91d436acd61"}} Jul 19 22:33:29.766160 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:33:29.766160 n-d-847009-3 devstack@n-api.service[119338]: exception: Volume c7765630-87f1-4c30-92bf-e8985b14bd4d could not be found. Jul 19 22:33:29.767260 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'server_id': '3b832d3f-6d05-4494-be32-1250a88c787c', 'id': 'c7765630-87f1-4c30-92bf-e8985b14bd4d', 'body': {'volumeAttachment': {'volumeId': 'aa9c81a5-bbf0-43ff-aebb-e91d436acd61'}}} Jul 19 22:33:29.767260 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:33:29.767260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:29.767260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 22:33:29.767260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 22:33:29.767260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 22:33:29.767260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 22:33:29.767260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 22:33:29.767260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 22:33:29.767260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 22:33:29.767260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 22:33:29.767260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 22:33:29.767260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 22:33:29.767260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 22:33:29.767260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 22:33:29.767260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 22:33:29.767260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 22:33:29.768643 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c7765630-87f1-4c30-92bf-e8985b14bd4d could not be found. (HTTP 404) (Request-ID: req-6d11e8b3-4247-4a9d-b07a-03d366d95c4a) Jul 19 22:33:29.768643 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:33:29.768643 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:29.768643 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:33:29.768643 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:29.768643 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 19 22:33:29.768643 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 19 22:33:29.768643 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 22:33:29.768643 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 22:33:29.768643 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 22:33:29.768643 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 22:33:29.768643 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 22:33:29.768643 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 22:33:29.768643 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 22:33:29.768643 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 22:33:29.768643 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 22:33:29.768643 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 22:33:29.768643 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 22:33:29.768643 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 22:33:29.770736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 22:33:29.770736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 22:33:29.770736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 22:33:29.770736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 22:33:29.770736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 22:33:29.770736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 22:33:29.770736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 22:33:29.770736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 22:33:29.770736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c7765630-87f1-4c30-92bf-e8985b14bd4d could not be found. Jul 19 22:33:29.770736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:33:29.770736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:29.770736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:33:29.770736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:29.770736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:29.770736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:29.770736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:33:29.770736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:33:29.770736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:33:29.770736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:33:29.773246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:33:29.773246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:33:29.773246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:33:29.773246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:33:29.773246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 19 22:33:29.773246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 19 22:33:29.773246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 19 22:33:29.773246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:33:29.773246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c7765630-87f1-4c30-92bf-e8985b14bd4d could not be found. Jul 19 22:33:29.773246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:33:29.773246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:29.773246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:33:29.773246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:29.773246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:29.773246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:29.773246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:33:29.773246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:33:29.773246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c7765630-87f1-4c30-92bf-e8985b14bd4d could not be found. Jul 19 22:33:29.773246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:33:29.776712 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3f83de0b-cc1e-48f4-afa2-3dd968584fb7 tempest-VolumesAdminNegativeTest-1447173879 tempest-VolumesAdminNegativeTest-1447173879-project-admin] Returning 404 to user: Volume c7765630-87f1-4c30-92bf-e8985b14bd4d could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:33:29.777746 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3f83de0b-cc1e-48f4-afa2-3dd968584fb7 tempest-VolumesAdminNegativeTest-1447173879 tempest-VolumesAdminNegativeTest-1447173879-project-admin] 10.222.0.25 "PUT /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c/os-volume_attachments/c7765630-87f1-4c30-92bf-e8985b14bd4d" status: 404 len: 109 microversion: 2.1 time: 0.189968 Jul 19 22:33:29.778665 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 911/1841] 10.222.0.25 () {60 vars in 1432 bytes} [Tue Jul 19 22:33:29 2022] PUT /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c/os-volume_attachments/c7765630-87f1-4c30-92bf-e8985b14bd4d => generated 109 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:33:29.810737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-02cd2bd6-7525-4dbb-8520-8678a527dc73 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:29.816291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-02cd2bd6-7525-4dbb-8520-8678a527dc73 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] [instance: 43943c92-c6e2-456e-b295-ca4ed3e6c5f1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:29.844652 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02cd2bd6-7525-4dbb-8520-8678a527dc73 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:29.850828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02cd2bd6-7525-4dbb-8520-8678a527dc73 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:29.859080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02cd2bd6-7525-4dbb-8520-8678a527dc73 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:29.859654 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02cd2bd6-7525-4dbb-8520-8678a527dc73 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:30.218915 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-593aaa75-dcb2-40ab-a334-98f82922f857 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:30.234567 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-593aaa75-dcb2-40ab-a334-98f82922f857 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:30.236236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-593aaa75-dcb2-40ab-a334-98f82922f857 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:30.254381 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-593aaa75-dcb2-40ab-a334-98f82922f857 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1444 microversion: 2.75 time: 0.901758 Jul 19 22:33:30.268602 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 931/1842] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:29 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1444 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:33:30.364710 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f0d10e5f-142f-4701-ab7b-f7a4e7e0b016 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:30.366857 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f0d10e5f-142f-4701-ab7b-f7a4e7e0b016 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:30.378873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f0d10e5f-142f-4701-ab7b-f7a4e7e0b016 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:30.387845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f0d10e5f-142f-4701-ab7b-f7a4e7e0b016 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:30.388957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f0d10e5f-142f-4701-ab7b-f7a4e7e0b016 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:30.390182 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f0d10e5f-142f-4701-ab7b-f7a4e7e0b016 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:31.267435 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-02cd2bd6-7525-4dbb-8520-8678a527dc73 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cd4a1e9d0f4f328e7f4046ad9fa711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c1b5a8abc7401b9513023803dd1f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:31.281484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f0d10e5f-142f-4701-ab7b-f7a4e7e0b016 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:31.285122 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-02cd2bd6-7525-4dbb-8520-8678a527dc73 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] 10.222.0.25 "GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1" status: 200 len: 1316 microversion: 2.1 time: 1.503366 Jul 19 22:33:31.289195 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 912/1843] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:29 2022] GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1 => generated 1316 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:31.294457 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f0d10e5f-142f-4701-ab7b-f7a4e7e0b016 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:31.301160 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f0d10e5f-142f-4701-ab7b-f7a4e7e0b016 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:31.301932 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-616378c8-cf43-4572-b13e-bf498d5e00c1 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:31.303590 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f0d10e5f-142f-4701-ab7b-f7a4e7e0b016 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1251 microversion: 2.25 time: 0.943605 Jul 19 22:33:31.305116 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-616378c8-cf43-4572-b13e-bf498d5e00c1 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:31.305918 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 932/1844] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:30 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1251 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:33:31.325906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-616378c8-cf43-4572-b13e-bf498d5e00c1 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:31.326678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-616378c8-cf43-4572-b13e-bf498d5e00c1 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:31.327683 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-616378c8-cf43-4572-b13e-bf498d5e00c1 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:31.329020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1a6bb998-af4b-45e7-b352-b1d0f0e10063 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:31.329889 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-616378c8-cf43-4572-b13e-bf498d5e00c1 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:31.330031 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1a6bb998-af4b-45e7-b352-b1d0f0e10063 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:31.357369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a6bb998-af4b-45e7-b352-b1d0f0e10063 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:31.357839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a6bb998-af4b-45e7-b352-b1d0f0e10063 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:31.358646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a6bb998-af4b-45e7-b352-b1d0f0e10063 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:31.359077 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a6bb998-af4b-45e7-b352-b1d0f0e10063 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:31.651182 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1a6bb998-af4b-45e7-b352-b1d0f0e10063 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:31.666594 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:33:31.671631 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1a6bb998-af4b-45e7-b352-b1d0f0e10063 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:31.673872 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1a6bb998-af4b-45e7-b352-b1d0f0e10063 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e8fd97cea4daea5640e033d010394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c67c61d2e480b89e35ec82316c80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:31.688512 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1a6bb998-af4b-45e7-b352-b1d0f0e10063 tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 200 len: 1444 microversion: 2.75 time: 0.380448 Jul 19 22:33:31.692661 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 933/1845] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:31 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 1444 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:33:32.126085 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-616378c8-cf43-4572-b13e-bf498d5e00c1 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:32.147141 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-616378c8-cf43-4572-b13e-bf498d5e00c1 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1391 microversion: 2.1 time: 0.846413 Jul 19 22:33:32.162567 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 913/1846] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:31 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1391 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:32.307220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-661c3e1b-dfda-44e8-a00c-8d5d79d7121d tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:32.308402 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-661c3e1b-dfda-44e8-a00c-8d5d79d7121d tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] [instance: 43943c92-c6e2-456e-b295-ca4ed3e6c5f1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:32.334628 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-661c3e1b-dfda-44e8-a00c-8d5d79d7121d tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:32.334864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-919b13b6-26d4-4bd8-8de3-51ceefa28216 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:32.335523 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-919b13b6-26d4-4bd8-8de3-51ceefa28216 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:32.339878 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-661c3e1b-dfda-44e8-a00c-8d5d79d7121d tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:32.341019 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-661c3e1b-dfda-44e8-a00c-8d5d79d7121d tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:32.343699 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-661c3e1b-dfda-44e8-a00c-8d5d79d7121d tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:32.352373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-919b13b6-26d4-4bd8-8de3-51ceefa28216 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:32.355663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-919b13b6-26d4-4bd8-8de3-51ceefa28216 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:32.356512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-919b13b6-26d4-4bd8-8de3-51ceefa28216 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:32.356960 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-919b13b6-26d4-4bd8-8de3-51ceefa28216 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:32.783263 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-919b13b6-26d4-4bd8-8de3-51ceefa28216 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:32.823102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-919b13b6-26d4-4bd8-8de3-51ceefa28216 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:32.828508 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-919b13b6-26d4-4bd8-8de3-51ceefa28216 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:32.829711 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-919b13b6-26d4-4bd8-8de3-51ceefa28216 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1251 microversion: 2.25 time: 0.509283 Jul 19 22:33:32.833033 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 914/1847] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:32 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1251 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:33:32.838639 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-43f38600-b861-4a21-b1bc-ca0037a402cf tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:32.841907 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-43f38600-b861-4a21-b1bc-ca0037a402cf tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] [instance: 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:32.857848 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:33:32.858443 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43f38600-b861-4a21-b1bc-ca0037a402cf tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:32.858580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43f38600-b861-4a21-b1bc-ca0037a402cf tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:32.859381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43f38600-b861-4a21-b1bc-ca0037a402cf tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:32.859832 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43f38600-b861-4a21-b1bc-ca0037a402cf tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:32.901515 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-43f38600-b861-4a21-b1bc-ca0037a402cf tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] HTTP exception thrown: Instance 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d could not be found. Jul 19 22:33:32.903211 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-43f38600-b861-4a21-b1bc-ca0037a402cf tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Request method failure captured: Jul 19 22:33:32.903211 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d HTTP/1.1 Jul 19 22:33:32.903211 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:33:32.903211 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:33:32.903211 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:33:32.903211 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:33:32.903211 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:33:32.903211 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:33:32.903211 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:33:32.903211 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:33:32.903211 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zDn_zWOLMRcwRWmXDXz17IeayDsBigFbU07m-KKRBCnknvZ1mI9RpOu13lDnUUwKRhZNlUL80GKqfl-TuiTP0XGaqxNUm-NU3MeWQHzKGBVCNqLvh830dGWNjS_7782LATcN2FqmnM6zI2LOIXKikqA6SiMJOo5EJWY-FV3DuhmQuI Jul 19 22:33:32.903211 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:33:32.903211 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:33:32.903211 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:33:32.903211 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:33:32.903211 n-d-847009-3 devstack@n-api.service[119338]: X-Openstack-Nova-Api-Version: 2.75 Jul 19 22:33:32.903211 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:33:32.903211 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:33:32.903211 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: ad1c67c61d2e480b89e35ec82316c80b Jul 19 22:33:32.903211 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersAdmin275Test-638016616 Jul 19 22:33:32.903211 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:33:32.903211 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:33:32.905184 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ad1c67c61d2e480b89e35ec82316c80b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ad1c67c61d2e480b89e35ec82316c80b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ad1c67c61d2e480b89e35ec82316c80b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ad1c67c61d2e480b89e35ec82316c80b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:33:32.905184 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersAdmin275Test-638016616 Jul 19 22:33:32.905184 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: ad1c67c61d2e480b89e35ec82316c80b Jul 19 22:33:32.905184 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersAdmin275Test-638016616 Jul 19 22:33:32.905184 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersAdmin275Test-638016616-project Jul 19 22:33:32.905184 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:33:32.905184 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:33:32.905184 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 968e8fd97cea4daea5640e033d010394 Jul 19 22:33:32.905184 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersAdmin275Test-638016616-project Jul 19 22:33:32.905184 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:33:32.905184 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d could not be found. Jul 19 22:33:32.905184 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '93ace1ac-b0fb-4bf1-8c01-6b391e7d245d'} Jul 19 22:33:32.906023 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:33:32.906023 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:32.906023 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:33:32.906023 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:33:32.906023 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:33:32.906023 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:33:32.906023 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:33:32.906023 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:33:32.906023 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:33:32.906023 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:33:32.906023 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d could not be found. Jul 19 22:33:32.906023 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:33:32.906023 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:32.906023 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:33:32.906023 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:32.906023 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:32.906023 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:32.906023 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:33:32.906023 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:33:32.906023 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:33:32.908299 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:33:32.908299 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:33:32.908299 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:33:32.908299 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:33:32.908299 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:33:32.908299 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:33:32.908299 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:33:32.908299 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d could not be found. Jul 19 22:33:32.908299 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:33:32.908299 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:32.908299 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:33:32.908299 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:32.908299 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:32.908299 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:32.908299 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:33:32.908299 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:33:32.908299 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d could not be found. Jul 19 22:33:32.908299 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:33:32.911524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-43f38600-b861-4a21-b1bc-ca0037a402cf tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] Returning 404 to user: Instance 93ace1ac-b0fb-4bf1-8c01-6b391e7d245d could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:33:32.911524 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-43f38600-b861-4a21-b1bc-ca0037a402cf tempest-ServersAdmin275Test-638016616 tempest-ServersAdmin275Test-638016616-project] 10.222.0.25 "GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d" status: 404 len: 111 microversion: 2.75 time: 0.070805 Jul 19 22:33:32.920469 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 915/1848] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:32 2022] GET /compute/v2.1/servers/93ace1ac-b0fb-4bf1-8c01-6b391e7d245d => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:33:32.932624 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:33:33.166907 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fbd8c2ec-a27b-4081-be7d-96f74626215e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:33.168251 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fbd8c2ec-a27b-4081-be7d-96f74626215e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:33.184810 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fbd8c2ec-a27b-4081-be7d-96f74626215e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:33.186124 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fbd8c2ec-a27b-4081-be7d-96f74626215e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:33.188026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fbd8c2ec-a27b-4081-be7d-96f74626215e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:33.191908 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fbd8c2ec-a27b-4081-be7d-96f74626215e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:33.630434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:33:33.775889 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-661c3e1b-dfda-44e8-a00c-8d5d79d7121d tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cd4a1e9d0f4f328e7f4046ad9fa711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c1b5a8abc7401b9513023803dd1f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:33.776101 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:33:33.805582 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-661c3e1b-dfda-44e8-a00c-8d5d79d7121d tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] 10.222.0.25 "GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1" status: 200 len: 1316 microversion: 2.1 time: 1.498192 Jul 19 22:33:33.806609 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 934/1849] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:32 2022] GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1 => generated 1316 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:33.819211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-5b07ccb0-36f4-42df-8692-5160419f818e req-c60009f5-51a0-4d24-8daa-38e4d04f676a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43943c92-c6e2-456e-b295-ca4ed3e6c5f1", "tag": "4b69539f-f6cc-4693-b4db-a2a0720bb8bf"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:33:33.841466 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-5b07ccb0-36f4-42df-8692-5160419f818e req-c60009f5-51a0-4d24-8daa-38e4d04f676a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:33.844875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-5b07ccb0-36f4-42df-8692-5160419f818e req-c60009f5-51a0-4d24-8daa-38e4d04f676a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:33.887004 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-5b07ccb0-36f4-42df-8692-5160419f818e req-c60009f5-51a0-4d24-8daa-38e4d04f676a service nova] Creating event network-changed:4b69539f-f6cc-4693-b4db-a2a0720bb8bf for instance 43943c92-c6e2-456e-b295-ca4ed3e6c5f1 on n-h2-847009-3 Jul 19 22:33:33.915140 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-5b07ccb0-36f4-42df-8692-5160419f818e req-c60009f5-51a0-4d24-8daa-38e4d04f676a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106138 Jul 19 22:33:33.916166 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 935/1850] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:33:33.928834 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-75a3c97e-4fff-4434-97b0-0bcfdebc0349 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:33.930247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-75a3c97e-4fff-4434-97b0-0bcfdebc0349 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:33.963478 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-75a3c97e-4fff-4434-97b0-0bcfdebc0349 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:33.964202 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-75a3c97e-4fff-4434-97b0-0bcfdebc0349 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:33.965971 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-75a3c97e-4fff-4434-97b0-0bcfdebc0349 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:33.972921 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-75a3c97e-4fff-4434-97b0-0bcfdebc0349 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:34.238538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-75a3c97e-4fff-4434-97b0-0bcfdebc0349 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:34.251210 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-75a3c97e-4fff-4434-97b0-0bcfdebc0349 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:34.257092 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-75a3c97e-4fff-4434-97b0-0bcfdebc0349 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:34.258609 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-75a3c97e-4fff-4434-97b0-0bcfdebc0349 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1251 microversion: 2.25 time: 0.341054 Jul 19 22:33:34.259855 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 936/1851] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:33 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1251 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:33:34.379793 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fbd8c2ec-a27b-4081-be7d-96f74626215e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:34.392100 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fbd8c2ec-a27b-4081-be7d-96f74626215e tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1391 microversion: 2.1 time: 1.231152 Jul 19 22:33:34.398176 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 916/1852] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:33 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1391 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:33:34.828160 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f5d836c1-f9b1-48d1-85d6-b657d41716d3 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:34.829430 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f5d836c1-f9b1-48d1-85d6-b657d41716d3 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] [instance: 43943c92-c6e2-456e-b295-ca4ed3e6c5f1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:34.857372 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f5d836c1-f9b1-48d1-85d6-b657d41716d3 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:34.857843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f5d836c1-f9b1-48d1-85d6-b657d41716d3 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:34.862262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f5d836c1-f9b1-48d1-85d6-b657d41716d3 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:34.863349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f5d836c1-f9b1-48d1-85d6-b657d41716d3 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:35.276914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ddd84caa-dcab-42ef-9bf3-81bdd78000b7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:35.277751 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ddd84caa-dcab-42ef-9bf3-81bdd78000b7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:35.296135 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ddd84caa-dcab-42ef-9bf3-81bdd78000b7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:35.315681 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ddd84caa-dcab-42ef-9bf3-81bdd78000b7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:35.318737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ddd84caa-dcab-42ef-9bf3-81bdd78000b7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:35.326938 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ddd84caa-dcab-42ef-9bf3-81bdd78000b7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:36.475995 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f5d836c1-f9b1-48d1-85d6-b657d41716d3 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cd4a1e9d0f4f328e7f4046ad9fa711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c1b5a8abc7401b9513023803dd1f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:36.487846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ddd84caa-dcab-42ef-9bf3-81bdd78000b7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:36.525708 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f5d836c1-f9b1-48d1-85d6-b657d41716d3 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] 10.222.0.25 "GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1" status: 200 len: 1316 microversion: 2.1 time: 1.705282 Jul 19 22:33:36.541192 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 937/1853] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:34 2022] GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1 => generated 1316 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:36.553186 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ddd84caa-dcab-42ef-9bf3-81bdd78000b7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:36.557111 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ddd84caa-dcab-42ef-9bf3-81bdd78000b7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:36.560014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a100817e-8ce3-4cc7-ac6a-5e7f32c55b85 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:36.566119 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ddd84caa-dcab-42ef-9bf3-81bdd78000b7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1293 microversion: 2.25 time: 1.285618 Jul 19 22:33:36.566883 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 917/1854] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:35 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1293 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:33:36.567787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a100817e-8ce3-4cc7-ac6a-5e7f32c55b85 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:36.587672 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6a38189b-a6cf-49f3-813c-fb332e5a1fce tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:36.588386 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6a38189b-a6cf-49f3-813c-fb332e5a1fce tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 3b832d3f-6d05-4494-be32-1250a88c787c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:36.590171 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a100817e-8ce3-4cc7-ac6a-5e7f32c55b85 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:36.595743 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a100817e-8ce3-4cc7-ac6a-5e7f32c55b85 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:36.599578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a100817e-8ce3-4cc7-ac6a-5e7f32c55b85 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:36.600302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a100817e-8ce3-4cc7-ac6a-5e7f32c55b85 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:36.623254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a38189b-a6cf-49f3-813c-fb332e5a1fce tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:36.624814 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a38189b-a6cf-49f3-813c-fb332e5a1fce tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:36.630694 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a38189b-a6cf-49f3-813c-fb332e5a1fce tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:36.634589 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a38189b-a6cf-49f3-813c-fb332e5a1fce tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:36.760517 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6a38189b-a6cf-49f3-813c-fb332e5a1fce tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 3b832d3f-6d05-4494-be32-1250a88c787c] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:33:37.031214 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6a38189b-a6cf-49f3-813c-fb332e5a1fce tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c" status: 204 len: 0 microversion: 2.1 time: 0.451398 Jul 19 22:33:37.040018 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 918/1855] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:33:36 2022] DELETE /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:33:37.074532 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-c2e5c81e-be44-4b32-8d2f-2ff7c0210ece req-c9e238d5-c5d9-41d2-a355-36befa237d82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7", "name": "network-vif-unplugged", "status": "completed", "tag": "982bb92a-f3e0-4d49-82fa-8c659b4cf2a9"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:33:37.122999 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c2e5c81e-be44-4b32-8d2f-2ff7c0210ece req-c9e238d5-c5d9-41d2-a355-36befa237d82 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:37.125588 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c2e5c81e-be44-4b32-8d2f-2ff7c0210ece req-c9e238d5-c5d9-41d2-a355-36befa237d82 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:37.189353 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-c2e5c81e-be44-4b32-8d2f-2ff7c0210ece req-c9e238d5-c5d9-41d2-a355-36befa237d82 service nova] Creating event network-vif-unplugged:982bb92a-f3e0-4d49-82fa-8c659b4cf2a9 for instance b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 on n-h2-847009-3 Jul 19 22:33:37.206170 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-c2e5c81e-be44-4b32-8d2f-2ff7c0210ece req-c9e238d5-c5d9-41d2-a355-36befa237d82 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.161583 Jul 19 22:33:37.212334 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 919/1856] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:33:37.221815 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e7b1ae10-0c04-4deb-9fe3-8bc524d80751 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:37.227487 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e7b1ae10-0c04-4deb-9fe3-8bc524d80751 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 3b832d3f-6d05-4494-be32-1250a88c787c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:37.246313 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e7b1ae10-0c04-4deb-9fe3-8bc524d80751 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:37.251858 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e7b1ae10-0c04-4deb-9fe3-8bc524d80751 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:37.257122 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e7b1ae10-0c04-4deb-9fe3-8bc524d80751 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:37.258317 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e7b1ae10-0c04-4deb-9fe3-8bc524d80751 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:37.414716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a100817e-8ce3-4cc7-ac6a-5e7f32c55b85 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:37.442138 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a100817e-8ce3-4cc7-ac6a-5e7f32c55b85 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1391 microversion: 2.1 time: 0.899614 Jul 19 22:33:37.449105 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 938/1857] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:36 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1391 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:37.550508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eb22e3a9-1ed5-4640-b0c9-c681e518a207 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:37.554727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eb22e3a9-1ed5-4640-b0c9-c681e518a207 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] [instance: 43943c92-c6e2-456e-b295-ca4ed3e6c5f1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:37.573969 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb22e3a9-1ed5-4640-b0c9-c681e518a207 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:37.574872 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb22e3a9-1ed5-4640-b0c9-c681e518a207 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:37.577007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb22e3a9-1ed5-4640-b0c9-c681e518a207 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:37.578264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb22e3a9-1ed5-4640-b0c9-c681e518a207 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:38.007709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e7b1ae10-0c04-4deb-9fe3-8bc524d80751 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37267b4c360540489a72d9b0043abd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a353634f70fb4ff58c7190a5c7aa675d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:38.036225 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e7b1ae10-0c04-4deb-9fe3-8bc524d80751 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c" status: 200 len: 1514 microversion: 2.1 time: 0.820423 Jul 19 22:33:38.044259 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 920/1858] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:37 2022] GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c => generated 1514 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:38.071610 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-422ee701-1a86-47f3-a551-4cb953a3a460 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:38.072808 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-422ee701-1a86-47f3-a551-4cb953a3a460 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:38.098890 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-422ee701-1a86-47f3-a551-4cb953a3a460 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:38.103187 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-422ee701-1a86-47f3-a551-4cb953a3a460 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:38.104791 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-422ee701-1a86-47f3-a551-4cb953a3a460 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:38.110284 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-422ee701-1a86-47f3-a551-4cb953a3a460 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:38.809129 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-eb22e3a9-1ed5-4640-b0c9-c681e518a207 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cd4a1e9d0f4f328e7f4046ad9fa711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c1b5a8abc7401b9513023803dd1f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:38.823952 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eb22e3a9-1ed5-4640-b0c9-c681e518a207 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] 10.222.0.25 "GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1" status: 200 len: 1316 microversion: 2.1 time: 1.279678 Jul 19 22:33:38.840001 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 939/1859] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:37 2022] GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1 => generated 1316 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:33:39.034037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-422ee701-1a86-47f3-a551-4cb953a3a460 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:39.049650 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-422ee701-1a86-47f3-a551-4cb953a3a460 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:39.060701 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-422ee701-1a86-47f3-a551-4cb953a3a460 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:39.061937 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-422ee701-1a86-47f3-a551-4cb953a3a460 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1293 microversion: 2.25 time: 1.015894 Jul 19 22:33:39.062867 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 921/1860] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:38 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1293 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:33:39.068601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1746db55-92e3-472b-9054-83a421ec7c4b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:39.069270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1746db55-92e3-472b-9054-83a421ec7c4b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:39.105845 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1746db55-92e3-472b-9054-83a421ec7c4b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:39.106306 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1746db55-92e3-472b-9054-83a421ec7c4b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:39.107152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1746db55-92e3-472b-9054-83a421ec7c4b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:39.107726 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1746db55-92e3-472b-9054-83a421ec7c4b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:39.261159 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-616351ee-422d-4356-8f26-8612a4c176cf tempest-FloatingIPDetailsNegativeTestJSON-418958598 tempest-FloatingIPDetailsNegativeTestJSON-418958598-project] Calling method '.version_select at 0x7f7a03e643a0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:39.665279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG neutronclient.v2_0.client [None req-616351ee-422d-4356-8f26-8612a4c176cf tempest-FloatingIPDetailsNegativeTestJSON-418958598 tempest-FloatingIPDetailsNegativeTestJSON-418958598-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP dd1985fb-1252-4440-bc0b-bf72e7131edb could not be found", "detail": ""}} {{(pid=119337) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 22:33:39.666404 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-616351ee-422d-4356-8f26-8612a4c176cf tempest-FloatingIPDetailsNegativeTestJSON-418958598 tempest-FloatingIPDetailsNegativeTestJSON-418958598-project] HTTP exception thrown: Floating IP not found for ID dd1985fb-1252-4440-bc0b-bf72e7131edb Jul 19 22:33:39.669662 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-616351ee-422d-4356-8f26-8612a4c176cf tempest-FloatingIPDetailsNegativeTestJSON-418958598 tempest-FloatingIPDetailsNegativeTestJSON-418958598-project] Request method failure captured: Jul 19 22:33:39.669662 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/os-floating-ips/dd1985fb-1252-4440-bc0b-bf72e7131edb HTTP/1.1 Jul 19 22:33:39.669662 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:33:39.669662 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:33:39.669662 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:33:39.669662 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:33:39.669662 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:33:39.669662 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:33:39.669662 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:33:39.669662 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:33:39.669662 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zFBNogNP693twz4kNllqS_a8OUdlU9bQVUVfqGdBZBT7AgXpsuWSyl2zpOdIsOORZrC5p1pIYCturKpPoutpSd63kqoW32_CQgxmZOqUpOtznVisWGcMZz3TyURTRi1HCWWelmM__uEkLPJ3JDn4h4x3uUQqnC1EjIeECESAbKg-nY Jul 19 22:33:39.669662 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:33:39.669662 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:33:39.669662 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:33:39.669662 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:33:39.669662 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:33:39.669662 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:33:39.669662 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: cf44a95ab65d4fd5a9ef70d63a748d37 Jul 19 22:33:39.669662 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-418958598 Jul 19 22:33:39.669662 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:33:39.669662 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:33:39.671427 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cf44a95ab65d4fd5a9ef70d63a748d37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cf44a95ab65d4fd5a9ef70d63a748d37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cf44a95ab65d4fd5a9ef70d63a748d37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cf44a95ab65d4fd5a9ef70d63a748d37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:33:39.671427 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-418958598 Jul 19 22:33:39.671427 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: cf44a95ab65d4fd5a9ef70d63a748d37 Jul 19 22:33:39.671427 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-418958598 Jul 19 22:33:39.671427 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-418958598-project Jul 19 22:33:39.671427 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:33:39.671427 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:33:39.671427 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 4b30424de60e45ff8419cab48d4c5b9d Jul 19 22:33:39.671427 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-418958598-project Jul 19 22:33:39.671427 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:33:39.671427 n-d-847009-3 devstack@n-api.service[119337]: exception: Floating IP not found for ID dd1985fb-1252-4440-bc0b-bf72e7131edb Jul 19 22:33:39.671427 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'dd1985fb-1252-4440-bc0b-bf72e7131edb'} Jul 19 22:33:39.672382 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:33:39.672382 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:39.672382 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 19 22:33:39.672382 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 19 22:33:39.672382 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:33:39.672382 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:33:39.672382 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 19 22:33:39.672382 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 19 22:33:39.672382 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:33:39.672382 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:33:39.672382 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 22:33:39.672382 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 22:33:39.672382 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:33:39.672382 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:33:39.672382 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 22:33:39.672382 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 22:33:39.672382 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:33:39.672382 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:33:39.672382 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 22:33:39.673702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 22:33:39.673702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:33:39.673702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:33:39.673702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 22:33:39.673702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 22:33:39.673702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 22:33:39.673702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 22:33:39.673702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP dd1985fb-1252-4440-bc0b-bf72e7131edb could not be found Jul 19 22:33:39.673702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95c07ed7-2143-4b34-8e3f-bfa764fbafb6'] Jul 19 22:33:39.673702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:39.673702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:39.673702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:39.673702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:39.673702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 19 22:33:39.673702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 19 22:33:39.673702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 19 22:33:39.673702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 19 22:33:39.673702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID dd1985fb-1252-4440-bc0b-bf72e7131edb. Jul 19 22:33:39.673702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:39.675275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:39.675275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:39.675275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:39.675275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:39.675275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:39.675275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:33:39.675275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:33:39.675275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:33:39.675275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:33:39.675275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:33:39.675275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:33:39.675275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 19 22:33:39.675275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 22:33:39.675275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID dd1985fb-1252-4440-bc0b-bf72e7131edb Jul 19 22:33:39.675275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:39.675275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:39.675275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:39.675275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:39.675275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:39.675275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:39.675275 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:33:39.678472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:33:39.678472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID dd1985fb-1252-4440-bc0b-bf72e7131edb Jul 19 22:33:39.678472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:39.684015 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-616351ee-422d-4356-8f26-8612a4c176cf tempest-FloatingIPDetailsNegativeTestJSON-418958598 tempest-FloatingIPDetailsNegativeTestJSON-418958598-project] Returning 404 to user: Floating IP not found for ID dd1985fb-1252-4440-bc0b-bf72e7131edb {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:33:39.686747 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-616351ee-422d-4356-8f26-8612a4c176cf tempest-FloatingIPDetailsNegativeTestJSON-418958598 tempest-FloatingIPDetailsNegativeTestJSON-418958598-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/dd1985fb-1252-4440-bc0b-bf72e7131edb" status: 404 len: 111 microversion: 2.1 time: 0.844522 Jul 19 22:33:39.702365 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 940/1861] 10.222.0.25 () {58 vars in 1259 bytes} [Tue Jul 19 22:33:38 2022] GET /compute/v2.1/os-floating-ips/dd1985fb-1252-4440-bc0b-bf72e7131edb => generated 111 bytes in 853 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:33:39.712839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3140f690-9285-4677-8d35-61bfec6b3d09 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:39.715277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3140f690-9285-4677-8d35-61bfec6b3d09 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 3b832d3f-6d05-4494-be32-1250a88c787c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:39.731560 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3140f690-9285-4677-8d35-61bfec6b3d09 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:39.733597 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3140f690-9285-4677-8d35-61bfec6b3d09 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:39.735406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3140f690-9285-4677-8d35-61bfec6b3d09 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:39.737087 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3140f690-9285-4677-8d35-61bfec6b3d09 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:40.738510 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1746db55-92e3-472b-9054-83a421ec7c4b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:40.760464 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1746db55-92e3-472b-9054-83a421ec7c4b tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1391 microversion: 2.1 time: 1.695567 Jul 19 22:33:40.772455 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 922/1862] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:39 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1391 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:40.783604 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-d89807e5-266f-4e3b-8d19-280a436fd48a req-b9182ffb-e042-44c9-9966-515c987be77e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7", "tag": "982bb92a-f3e0-4d49-82fa-8c659b4cf2a9"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:33:40.805030 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:33:40.814631 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d89807e5-266f-4e3b-8d19-280a436fd48a req-b9182ffb-e042-44c9-9966-515c987be77e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:40.821542 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d89807e5-266f-4e3b-8d19-280a436fd48a req-b9182ffb-e042-44c9-9966-515c987be77e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:40.832003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:33:40.852933 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-d89807e5-266f-4e3b-8d19-280a436fd48a req-b9182ffb-e042-44c9-9966-515c987be77e service nova] Creating event network-changed:982bb92a-f3e0-4d49-82fa-8c659b4cf2a9 for instance b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 on n-h2-847009-3 Jul 19 22:33:40.868901 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-d89807e5-266f-4e3b-8d19-280a436fd48a req-b9182ffb-e042-44c9-9966-515c987be77e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095313 Jul 19 22:33:40.874976 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 923/1863] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:33:40.886478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6a6ac68c-0cc2-427b-98a9-2f110169853f tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:40.888872 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6a6ac68c-0cc2-427b-98a9-2f110169853f tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] [instance: 43943c92-c6e2-456e-b295-ca4ed3e6c5f1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:40.909718 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a6ac68c-0cc2-427b-98a9-2f110169853f tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:40.911237 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a6ac68c-0cc2-427b-98a9-2f110169853f tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:40.912342 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a6ac68c-0cc2-427b-98a9-2f110169853f tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:40.914925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a6ac68c-0cc2-427b-98a9-2f110169853f tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:41.502838 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3140f690-9285-4677-8d35-61bfec6b3d09 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37267b4c360540489a72d9b0043abd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a353634f70fb4ff58c7190a5c7aa675d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:41.522378 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3140f690-9285-4677-8d35-61bfec6b3d09 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c" status: 200 len: 1514 microversion: 2.1 time: 1.815323 Jul 19 22:33:41.526121 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 941/1864] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:39 2022] GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c => generated 1514 bytes in 1821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:41.540484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-67fa19bd-e8ee-425f-a63e-916c6d314a45 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:41.541116 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-67fa19bd-e8ee-425f-a63e-916c6d314a45 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:41.571132 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67fa19bd-e8ee-425f-a63e-916c6d314a45 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:41.571874 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67fa19bd-e8ee-425f-a63e-916c6d314a45 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:41.574820 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67fa19bd-e8ee-425f-a63e-916c6d314a45 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:41.576596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67fa19bd-e8ee-425f-a63e-916c6d314a45 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:41.986135 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6a6ac68c-0cc2-427b-98a9-2f110169853f tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cd4a1e9d0f4f328e7f4046ad9fa711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c1b5a8abc7401b9513023803dd1f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:42.001640 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6a6ac68c-0cc2-427b-98a9-2f110169853f tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] 10.222.0.25 "GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1" status: 200 len: 1316 microversion: 2.1 time: 1.125159 Jul 19 22:33:42.004371 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 924/1865] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:40 2022] GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1 => generated 1316 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:42.298567 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-57b5fefc-2f92-44f2-848b-a0d779d9af5b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-62455189", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:33:42.423371 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-67fa19bd-e8ee-425f-a63e-916c6d314a45 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:42.480407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-67fa19bd-e8ee-425f-a63e-916c6d314a45 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:42.482736 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-67fa19bd-e8ee-425f-a63e-916c6d314a45 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:42.486772 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-67fa19bd-e8ee-425f-a63e-916c6d314a45 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1281 microversion: 2.25 time: 0.959431 Jul 19 22:33:42.492937 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 942/1866] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:41 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1281 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:33:42.508796 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2552b192-2444-4e71-8c2a-5dd561e8515a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:42.510859 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2552b192-2444-4e71-8c2a-5dd561e8515a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:42.533848 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-57b5fefc-2f92-44f2-848b-a0d779d9af5b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] validate_networks() for None {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:33:42.544639 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2552b192-2444-4e71-8c2a-5dd561e8515a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:42.546836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2552b192-2444-4e71-8c2a-5dd561e8515a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:42.550473 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2552b192-2444-4e71-8c2a-5dd561e8515a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:42.553649 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2552b192-2444-4e71-8c2a-5dd561e8515a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:43.559389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2552b192-2444-4e71-8c2a-5dd561e8515a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:43.576415 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2552b192-2444-4e71-8c2a-5dd561e8515a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1391 microversion: 2.1 time: 1.081977 Jul 19 22:33:43.578093 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 943/1867] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:42 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1391 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:43.600388 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fe850c4e-b6bb-48a6-acb5-7fdc9d4a7668 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:43.602511 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fe850c4e-b6bb-48a6-acb5-7fdc9d4a7668 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 3b832d3f-6d05-4494-be32-1250a88c787c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:43.619591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fe850c4e-b6bb-48a6-acb5-7fdc9d4a7668 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:43.621350 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fe850c4e-b6bb-48a6-acb5-7fdc9d4a7668 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:43.623247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fe850c4e-b6bb-48a6-acb5-7fdc9d4a7668 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:43.623712 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fe850c4e-b6bb-48a6-acb5-7fdc9d4a7668 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:43.667553 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-fe850c4e-b6bb-48a6-acb5-7fdc9d4a7668 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] HTTP exception thrown: Instance 3b832d3f-6d05-4494-be32-1250a88c787c could not be found. Jul 19 22:33:43.672265 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fe850c4e-b6bb-48a6-acb5-7fdc9d4a7668 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Request method failure captured: Jul 19 22:33:43.672265 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c HTTP/1.1 Jul 19 22:33:43.672265 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:33:43.672265 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:33:43.672265 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:33:43.672265 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:33:43.672265 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:33:43.672265 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:33:43.672265 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:33:43.672265 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:33:43.672265 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zBwSSNo71LcCjfYAYmhsByQl_SWhHPkrWp19RS9IQ6uEy2gAWW21j1aqw2ewBqM-_j_dZv06wTRIwH-7utNDuAYSh5IE5sHqP5NdUyc7XSBZEeYoD_X1ZEjXH04ISbbNV5ni4Nu0gUUCw5W-zOWfkwzg3vhWltzHW5sqX30z1snYvM Jul 19 22:33:43.672265 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:33:43.672265 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:33:43.672265 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:33:43.672265 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:33:43.672265 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:33:43.672265 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:33:43.672265 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: a353634f70fb4ff58c7190a5c7aa675d Jul 19 22:33:43.672265 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-VolumesAdminNegativeTest-1228918780 Jul 19 22:33:43.672265 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:33:43.672265 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:33:43.673896 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a353634f70fb4ff58c7190a5c7aa675d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a353634f70fb4ff58c7190a5c7aa675d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a353634f70fb4ff58c7190a5c7aa675d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a353634f70fb4ff58c7190a5c7aa675d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:33:43.673896 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-VolumesAdminNegativeTest-1228918780 Jul 19 22:33:43.673896 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: a353634f70fb4ff58c7190a5c7aa675d Jul 19 22:33:43.673896 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1228918780 Jul 19 22:33:43.673896 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-VolumesAdminNegativeTest-1228918780-project Jul 19 22:33:43.673896 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:33:43.673896 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:33:43.673896 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 37267b4c360540489a72d9b0043abd87 Jul 19 22:33:43.673896 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-VolumesAdminNegativeTest-1228918780-project Jul 19 22:33:43.673896 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:33:43.673896 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 3b832d3f-6d05-4494-be32-1250a88c787c could not be found. Jul 19 22:33:43.673896 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '3b832d3f-6d05-4494-be32-1250a88c787c'} Jul 19 22:33:43.676469 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:33:43.676469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:43.676469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:33:43.676469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:33:43.676469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:33:43.676469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:33:43.676469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:33:43.676469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:33:43.676469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:33:43.676469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:33:43.676469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b832d3f-6d05-4494-be32-1250a88c787c could not be found. Jul 19 22:33:43.676469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:43.676469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:43.676469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:43.676469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:43.676469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:43.676469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:43.676469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:33:43.676469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:33:43.676469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:33:43.680452 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:33:43.680452 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:33:43.680452 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:33:43.680452 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:33:43.680452 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:33:43.680452 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:33:43.680452 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:33:43.680452 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b832d3f-6d05-4494-be32-1250a88c787c could not be found. Jul 19 22:33:43.680452 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:43.680452 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:33:43.680452 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:43.680452 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:33:43.680452 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:33:43.680452 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:33:43.680452 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:33:43.680452 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:33:43.680452 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b832d3f-6d05-4494-be32-1250a88c787c could not be found. Jul 19 22:33:43.680452 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:33:43.681684 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fe850c4e-b6bb-48a6-acb5-7fdc9d4a7668 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Returning 404 to user: Instance 3b832d3f-6d05-4494-be32-1250a88c787c could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:33:43.681684 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fe850c4e-b6bb-48a6-acb5-7fdc9d4a7668 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c" status: 404 len: 111 microversion: 2.1 time: 0.085423 Jul 19 22:33:43.681684 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 944/1868] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:43 2022] GET /compute/v2.1/servers/3b832d3f-6d05-4494-be32-1250a88c787c => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:33:43.690476 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-9638287a-1e61-41b7-a589-9dcaabee99fb req-ec8cf085-1785-49ad-b414-05463014f88b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b832d3f-6d05-4494-be32-1250a88c787c", "name": "network-vif-deleted", "tag": "1d4992a2-d0b2-44e7-9f1d-113c2e3cb558"}, {"name": "network-changed", "server_uuid": "9f2b8c66-5ac4-42bd-afe7-e283eba41078", "tag": "7697d6fa-c774-468b-a275-a40743f7894f"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:33:43.720092 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-9638287a-1e61-41b7-a589-9dcaabee99fb req-ec8cf085-1785-49ad-b414-05463014f88b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:43.722219 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-9638287a-1e61-41b7-a589-9dcaabee99fb req-ec8cf085-1785-49ad-b414-05463014f88b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:43.740910 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-9638287a-1e61-41b7-a589-9dcaabee99fb req-ec8cf085-1785-49ad-b414-05463014f88b service nova] Creating event network-vif-deleted:1d4992a2-d0b2-44e7-9f1d-113c2e3cb558 for instance 3b832d3f-6d05-4494-be32-1250a88c787c on n-h1-847009-3 Jul 19 22:33:43.741759 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-9638287a-1e61-41b7-a589-9dcaabee99fb req-ec8cf085-1785-49ad-b414-05463014f88b service nova] Creating event network-changed:7697d6fa-c774-468b-a275-a40743f7894f for instance 9f2b8c66-5ac4-42bd-afe7-e283eba41078 on n-h1-847009-3 Jul 19 22:33:43.751344 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-9638287a-1e61-41b7-a589-9dcaabee99fb req-ec8cf085-1785-49ad-b414-05463014f88b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.069102 Jul 19 22:33:43.754517 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 945/1869] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:33:43.771480 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3c7e4afe-5b11-4519-bd27-b34045cbafb7 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:43.773144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3c7e4afe-5b11-4519-bd27-b34045cbafb7 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] [instance: 43943c92-c6e2-456e-b295-ca4ed3e6c5f1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:43.798176 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c7e4afe-5b11-4519-bd27-b34045cbafb7 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:43.799521 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c7e4afe-5b11-4519-bd27-b34045cbafb7 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:43.800940 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c7e4afe-5b11-4519-bd27-b34045cbafb7 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:43.805077 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c7e4afe-5b11-4519-bd27-b34045cbafb7 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:44.763953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-57b5fefc-2f92-44f2-848b-a0d779d9af5b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:33:44.764542 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-57b5fefc-2f92-44f2-848b-a0d779d9af5b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:33:44.764841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-57b5fefc-2f92-44f2-848b-a0d779d9af5b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:33:44.765460 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-57b5fefc-2f92-44f2-848b-a0d779d9af5b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:33:44.766061 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-57b5fefc-2f92-44f2-848b-a0d779d9af5b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:33:44.793696 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-57b5fefc-2f92-44f2-848b-a0d779d9af5b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:44.794456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-57b5fefc-2f92-44f2-848b-a0d779d9af5b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:44.795986 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-57b5fefc-2f92-44f2-848b-a0d779d9af5b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:44.800353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-57b5fefc-2f92-44f2-848b-a0d779d9af5b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:44.853281 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-57b5fefc-2f92-44f2-848b-a0d779d9af5b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Getting quotas for project 5f5702d8328442d5b5473e6bfe086537. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:33:44.866111 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-57b5fefc-2f92-44f2-848b-a0d779d9af5b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Getting quotas for user cb361b1d3c724290b20f96d89be4ccf1 and project 5f5702d8328442d5b5473e6bfe086537. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:33:44.907902 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-57b5fefc-2f92-44f2-848b-a0d779d9af5b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:33:44.920445 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-57b5fefc-2f92-44f2-848b-a0d779d9af5b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] [instance: f4b57123-4fc4-45eb-8d88-4a5eed851fb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:33:45.038142 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-57b5fefc-2f92-44f2-848b-a0d779d9af5b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.031897 Jul 19 22:33:45.038791 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 925/1870] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:33:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:33:45.049586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b38bcfd3-c135-4c99-8812-2571bc915e88 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:45.050468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b38bcfd3-c135-4c99-8812-2571bc915e88 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:45.070284 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b38bcfd3-c135-4c99-8812-2571bc915e88 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:45.071050 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b38bcfd3-c135-4c99-8812-2571bc915e88 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:45.072047 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b38bcfd3-c135-4c99-8812-2571bc915e88 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:45.072691 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b38bcfd3-c135-4c99-8812-2571bc915e88 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:45.582413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3c7e4afe-5b11-4519-bd27-b34045cbafb7 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cd4a1e9d0f4f328e7f4046ad9fa711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c1b5a8abc7401b9513023803dd1f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:45.604416 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3c7e4afe-5b11-4519-bd27-b34045cbafb7 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] 10.222.0.25 "GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1" status: 200 len: 1316 microversion: 2.1 time: 1.844916 Jul 19 22:33:45.607247 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 946/1871] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:43 2022] GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1 => generated 1316 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:45.635356 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-cf7ec3e7-a264-49ef-8a58-7e0d58d6ef1d req-8f7d350f-8ed7-47b1-bba4-39a30ec3ea90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43943c92-c6e2-456e-b295-ca4ed3e6c5f1", "name": "network-vif-plugged", "status": "completed", "tag": "4b69539f-f6cc-4693-b4db-a2a0720bb8bf"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:33:45.674667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-cf7ec3e7-a264-49ef-8a58-7e0d58d6ef1d req-8f7d350f-8ed7-47b1-bba4-39a30ec3ea90 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:45.675452 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-cf7ec3e7-a264-49ef-8a58-7e0d58d6ef1d req-8f7d350f-8ed7-47b1-bba4-39a30ec3ea90 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:45.724803 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-cf7ec3e7-a264-49ef-8a58-7e0d58d6ef1d req-8f7d350f-8ed7-47b1-bba4-39a30ec3ea90 service nova] Creating event network-vif-plugged:4b69539f-f6cc-4693-b4db-a2a0720bb8bf for instance 43943c92-c6e2-456e-b295-ca4ed3e6c5f1 on n-h2-847009-3 Jul 19 22:33:45.751505 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-cf7ec3e7-a264-49ef-8a58-7e0d58d6ef1d req-8f7d350f-8ed7-47b1-bba4-39a30ec3ea90 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142863 Jul 19 22:33:45.758966 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 947/1872] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:33:45.806278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-566bf024-71bd-4c71-91a1-0288bd210efb tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:45.819007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-566bf024-71bd-4c71-91a1-0288bd210efb tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:45.861384 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-566bf024-71bd-4c71-91a1-0288bd210efb tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:45.861917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-566bf024-71bd-4c71-91a1-0288bd210efb tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:45.874436 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-566bf024-71bd-4c71-91a1-0288bd210efb tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:45.876646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-566bf024-71bd-4c71-91a1-0288bd210efb tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:46.932622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-566bf024-71bd-4c71-91a1-0288bd210efb tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:46.953291 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-566bf024-71bd-4c71-91a1-0288bd210efb tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1391 microversion: 2.1 time: 1.190730 Jul 19 22:33:46.956998 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 948/1873] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:45 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1391 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:46.984143 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bec53270-dfc9-4733-872b-a7002ad30995 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:46.984943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bec53270-dfc9-4733-872b-a7002ad30995 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] [instance: f4b57123-4fc4-45eb-8d88-4a5eed851fb0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:47.005217 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bec53270-dfc9-4733-872b-a7002ad30995 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:47.010203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bec53270-dfc9-4733-872b-a7002ad30995 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:47.013999 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bec53270-dfc9-4733-872b-a7002ad30995 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:47.014663 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bec53270-dfc9-4733-872b-a7002ad30995 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:47.209559 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b38bcfd3-c135-4c99-8812-2571bc915e88 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:47.241778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b38bcfd3-c135-4c99-8812-2571bc915e88 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:47.259850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b38bcfd3-c135-4c99-8812-2571bc915e88 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:47.268202 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b38bcfd3-c135-4c99-8812-2571bc915e88 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1281 microversion: 2.25 time: 2.227762 Jul 19 22:33:47.278955 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 926/1874] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:45 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1281 bytes in 2230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:33:47.285023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0cf09dbc-cbd5-41cc-98cf-125bc731f9b1 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:47.285733 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0cf09dbc-cbd5-41cc-98cf-125bc731f9b1 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] [instance: 43943c92-c6e2-456e-b295-ca4ed3e6c5f1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:47.296508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bec53270-dfc9-4733-872b-a7002ad30995 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb361b1d3c724290b20f96d89be4ccf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5702d8328442d5b5473e6bfe086537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:47.308013 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bec53270-dfc9-4733-872b-a7002ad30995 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0" status: 200 len: 1264 microversion: 2.1 time: 0.348232 Jul 19 22:33:47.308734 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 949/1875] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:46 2022] GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0 => generated 1264 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:47.310079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cf09dbc-cbd5-41cc-98cf-125bc731f9b1 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:47.310550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cf09dbc-cbd5-41cc-98cf-125bc731f9b1 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:47.311395 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cf09dbc-cbd5-41cc-98cf-125bc731f9b1 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:47.311845 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cf09dbc-cbd5-41cc-98cf-125bc731f9b1 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:47.788987 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-519b7dcd-87a8-4c54-8d1d-fea6e2482eb0 req-791bf3fb-3f4c-4a82-847e-d7a97932572f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7", "name": "network-vif-unplugged", "status": "completed", "tag": "982bb92a-f3e0-4d49-82fa-8c659b4cf2a9"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:33:47.821566 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-519b7dcd-87a8-4c54-8d1d-fea6e2482eb0 req-791bf3fb-3f4c-4a82-847e-d7a97932572f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:47.823436 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-519b7dcd-87a8-4c54-8d1d-fea6e2482eb0 req-791bf3fb-3f4c-4a82-847e-d7a97932572f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:47.863868 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-519b7dcd-87a8-4c54-8d1d-fea6e2482eb0 req-791bf3fb-3f4c-4a82-847e-d7a97932572f service nova] Creating event network-vif-unplugged:982bb92a-f3e0-4d49-82fa-8c659b4cf2a9 for instance b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 on n-h2-847009-3 Jul 19 22:33:47.879096 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-519b7dcd-87a8-4c54-8d1d-fea6e2482eb0 req-791bf3fb-3f4c-4a82-847e-d7a97932572f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094394 Jul 19 22:33:47.902949 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 950/1876] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:33:47.981528 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-653d840f-af1c-4e6e-99ad-5e7b4e8aee82 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:47.982284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-653d840f-af1c-4e6e-99ad-5e7b4e8aee82 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:48.019432 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-653d840f-af1c-4e6e-99ad-5e7b4e8aee82 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:48.020261 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-653d840f-af1c-4e6e-99ad-5e7b4e8aee82 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:48.039864 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-653d840f-af1c-4e6e-99ad-5e7b4e8aee82 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:48.045497 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-653d840f-af1c-4e6e-99ad-5e7b4e8aee82 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:48.166457 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0cf09dbc-cbd5-41cc-98cf-125bc731f9b1 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cd4a1e9d0f4f328e7f4046ad9fa711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c1b5a8abc7401b9513023803dd1f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:48.183982 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0cf09dbc-cbd5-41cc-98cf-125bc731f9b1 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] 10.222.0.25 "GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1" status: 200 len: 1316 microversion: 2.1 time: 0.913479 Jul 19 22:33:48.185205 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 927/1877] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:47 2022] GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1 => generated 1316 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:48.286519 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-67bd8045-fe07-420a-ab30-d68434e2f3f0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:48.287787 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-67bd8045-fe07-420a-ab30-d68434e2f3f0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:48.306806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67bd8045-fe07-420a-ab30-d68434e2f3f0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:48.307352 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67bd8045-fe07-420a-ab30-d68434e2f3f0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:48.308597 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67bd8045-fe07-420a-ab30-d68434e2f3f0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:48.311800 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67bd8045-fe07-420a-ab30-d68434e2f3f0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:49.227745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-653d840f-af1c-4e6e-99ad-5e7b4e8aee82 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:49.237671 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-653d840f-af1c-4e6e-99ad-5e7b4e8aee82 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1391 microversion: 2.1 time: 1.267281 Jul 19 22:33:49.247980 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 951/1878] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:47 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1391 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:49.253517 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b63648ad-250f-4e0e-bf13-5fa1aa8092a4 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:49.254212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b63648ad-250f-4e0e-bf13-5fa1aa8092a4 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] [instance: f4b57123-4fc4-45eb-8d88-4a5eed851fb0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:49.269079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b63648ad-250f-4e0e-bf13-5fa1aa8092a4 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:49.269945 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b63648ad-250f-4e0e-bf13-5fa1aa8092a4 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:49.276485 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b63648ad-250f-4e0e-bf13-5fa1aa8092a4 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:49.277414 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b63648ad-250f-4e0e-bf13-5fa1aa8092a4 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:49.330574 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-67bd8045-fe07-420a-ab30-d68434e2f3f0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:49.340771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-67bd8045-fe07-420a-ab30-d68434e2f3f0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:49.352566 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-67bd8045-fe07-420a-ab30-d68434e2f3f0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:49.354412 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-67bd8045-fe07-420a-ab30-d68434e2f3f0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1281 microversion: 2.25 time: 1.072062 Jul 19 22:33:49.356510 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 928/1879] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:48 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1281 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:33:49.367153 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-af1ebe6b-4f94-4723-bfcb-2019fe385bfa tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:49.372023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-af1ebe6b-4f94-4723-bfcb-2019fe385bfa tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] [instance: 43943c92-c6e2-456e-b295-ca4ed3e6c5f1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:49.388489 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-af1ebe6b-4f94-4723-bfcb-2019fe385bfa tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:49.389139 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-af1ebe6b-4f94-4723-bfcb-2019fe385bfa tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:49.389947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-af1ebe6b-4f94-4723-bfcb-2019fe385bfa tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:49.390395 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-af1ebe6b-4f94-4723-bfcb-2019fe385bfa tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:49.574211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b63648ad-250f-4e0e-bf13-5fa1aa8092a4 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb361b1d3c724290b20f96d89be4ccf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5702d8328442d5b5473e6bfe086537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:49.590368 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b63648ad-250f-4e0e-bf13-5fa1aa8092a4 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0" status: 200 len: 1270 microversion: 2.1 time: 0.340671 Jul 19 22:33:49.595608 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 952/1880] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:49 2022] GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0 => generated 1270 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:49.777681 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-af1ebe6b-4f94-4723-bfcb-2019fe385bfa tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cd4a1e9d0f4f328e7f4046ad9fa711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c1b5a8abc7401b9513023803dd1f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:49.807659 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-af1ebe6b-4f94-4723-bfcb-2019fe385bfa tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] 10.222.0.25 "GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1" status: 200 len: 1504 microversion: 2.1 time: 0.438978 Jul 19 22:33:49.823779 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 929/1881] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:49 2022] GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1 => generated 1504 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:49.835263 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c66ebbb8-eb15-4099-82e9-66d9a5ecf284 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:49.835818 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c66ebbb8-eb15-4099-82e9-66d9a5ecf284 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] [instance: 43943c92-c6e2-456e-b295-ca4ed3e6c5f1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:49.861162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c66ebbb8-eb15-4099-82e9-66d9a5ecf284 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:49.861627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c66ebbb8-eb15-4099-82e9-66d9a5ecf284 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:49.862427 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c66ebbb8-eb15-4099-82e9-66d9a5ecf284 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:49.868836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c66ebbb8-eb15-4099-82e9-66d9a5ecf284 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:49.981045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c66ebbb8-eb15-4099-82e9-66d9a5ecf284 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '89cd4a1e9d0f4f328e7f4046ad9fa711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c1b5a8abc7401b9513023803dd1f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:49.982068 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c66ebbb8-eb15-4099-82e9-66d9a5ecf284 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] 10.222.0.25 "GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1/os-instance-actions/req-b729fb39-2f0b-4d4a-a6cf-3b735604408e" status: 200 len: 313 microversion: 2.1 time: 0.159481 Jul 19 22:33:49.991509 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 953/1882] 10.222.0.25 () {58 vars in 1418 bytes} [Tue Jul 19 22:33:49 2022] GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1/os-instance-actions/req-b729fb39-2f0b-4d4a-a6cf-3b735604408e => generated 313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:33:49.997687 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b30b2f81-3da4-4023-9235-4386705d12a7 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:33:49.998786 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b30b2f81-3da4-4023-9235-4386705d12a7 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] [instance: 43943c92-c6e2-456e-b295-ca4ed3e6c5f1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:50.015222 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b30b2f81-3da4-4023-9235-4386705d12a7 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:50.015806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b30b2f81-3da4-4023-9235-4386705d12a7 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:50.016652 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b30b2f81-3da4-4023-9235-4386705d12a7 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:50.017096 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b30b2f81-3da4-4023-9235-4386705d12a7 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:50.217586 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b30b2f81-3da4-4023-9235-4386705d12a7 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] 10.222.0.25 "POST /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1/action" status: 202 len: 0 microversion: 2.1 time: 0.223989 Jul 19 22:33:50.223065 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 930/1883] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:33:49 2022] POST /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:33:50.237454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-992bae8e-984a-4df5-9f05-50411cbaf15c tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:50.244057 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-992bae8e-984a-4df5-9f05-50411cbaf15c tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] [instance: 43943c92-c6e2-456e-b295-ca4ed3e6c5f1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:50.273231 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-75ecbdad-f4dd-4adc-b162-d028c7d66441 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:50.277059 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-75ecbdad-f4dd-4adc-b162-d028c7d66441 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:50.285496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-992bae8e-984a-4df5-9f05-50411cbaf15c tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:50.286256 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-992bae8e-984a-4df5-9f05-50411cbaf15c tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:50.287543 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-992bae8e-984a-4df5-9f05-50411cbaf15c tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:50.289486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-992bae8e-984a-4df5-9f05-50411cbaf15c tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:50.294712 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75ecbdad-f4dd-4adc-b162-d028c7d66441 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:50.295806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75ecbdad-f4dd-4adc-b162-d028c7d66441 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:50.298519 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75ecbdad-f4dd-4adc-b162-d028c7d66441 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:50.299345 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75ecbdad-f4dd-4adc-b162-d028c7d66441 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:50.881894 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-992bae8e-984a-4df5-9f05-50411cbaf15c tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cd4a1e9d0f4f328e7f4046ad9fa711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c1b5a8abc7401b9513023803dd1f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:50.884320 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:33:50.894012 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-992bae8e-984a-4df5-9f05-50411cbaf15c tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] 10.222.0.25 "GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1" status: 200 len: 1506 microversion: 2.1 time: 0.670212 Jul 19 22:33:50.905971 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 954/1884] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:50 2022] GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1 => generated 1506 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:50.912734 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5cc63fa1-7294-4de9-9877-3d4e4fd19054 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:50.913937 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5cc63fa1-7294-4de9-9877-3d4e4fd19054 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:50.920681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5cc63fa1-7294-4de9-9877-3d4e4fd19054 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:50.921704 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5cc63fa1-7294-4de9-9877-3d4e4fd19054 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:50.922672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5cc63fa1-7294-4de9-9877-3d4e4fd19054 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:50.924799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5cc63fa1-7294-4de9-9877-3d4e4fd19054 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:50.944213 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-75ecbdad-f4dd-4adc-b162-d028c7d66441 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:50.970558 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-75ecbdad-f4dd-4adc-b162-d028c7d66441 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1391 microversion: 2.1 time: 0.707222 Jul 19 22:33:50.973444 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 931/1885] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:50 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1391 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:50.988958 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-367cba56-72cd-403e-a4be-da1c94765c51 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:50.991125 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-367cba56-72cd-403e-a4be-da1c94765c51 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] [instance: f4b57123-4fc4-45eb-8d88-4a5eed851fb0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:51.000626 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-367cba56-72cd-403e-a4be-da1c94765c51 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:51.002446 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-367cba56-72cd-403e-a4be-da1c94765c51 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:51.003550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-367cba56-72cd-403e-a4be-da1c94765c51 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:51.004208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-367cba56-72cd-403e-a4be-da1c94765c51 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:51.317421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-367cba56-72cd-403e-a4be-da1c94765c51 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb361b1d3c724290b20f96d89be4ccf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5702d8328442d5b5473e6bfe086537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:51.337286 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-367cba56-72cd-403e-a4be-da1c94765c51 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0" status: 200 len: 1270 microversion: 2.1 time: 0.360497 Jul 19 22:33:51.347913 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 932/1886] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:50 2022] GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0 => generated 1270 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:51.395867 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5cc63fa1-7294-4de9-9877-3d4e4fd19054 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:51.415552 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5cc63fa1-7294-4de9-9877-3d4e4fd19054 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:51.427728 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5cc63fa1-7294-4de9-9877-3d4e4fd19054 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:51.429979 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5cc63fa1-7294-4de9-9877-3d4e4fd19054 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1281 microversion: 2.25 time: 0.522336 Jul 19 22:33:51.447772 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 955/1887] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:50 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1281 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:33:51.916287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9e61f36f-60c2-46fb-9940-cbcc734b698c tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:51.916841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9e61f36f-60c2-46fb-9940-cbcc734b698c tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] [instance: 43943c92-c6e2-456e-b295-ca4ed3e6c5f1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:51.954531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e61f36f-60c2-46fb-9940-cbcc734b698c tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:51.955722 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e61f36f-60c2-46fb-9940-cbcc734b698c tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:51.957703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e61f36f-60c2-46fb-9940-cbcc734b698c tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:51.958041 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e61f36f-60c2-46fb-9940-cbcc734b698c tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:51.995682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4e7398e8-99b2-4e2c-93d2-79068d5b031f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:51.996724 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4e7398e8-99b2-4e2c-93d2-79068d5b031f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:52.011372 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4e7398e8-99b2-4e2c-93d2-79068d5b031f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:52.012520 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4e7398e8-99b2-4e2c-93d2-79068d5b031f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:52.015583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4e7398e8-99b2-4e2c-93d2-79068d5b031f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:52.019745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4e7398e8-99b2-4e2c-93d2-79068d5b031f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:53.212289 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9e61f36f-60c2-46fb-9940-cbcc734b698c tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cd4a1e9d0f4f328e7f4046ad9fa711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c1b5a8abc7401b9513023803dd1f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:53.216883 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4e7398e8-99b2-4e2c-93d2-79068d5b031f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:53.228764 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4e7398e8-99b2-4e2c-93d2-79068d5b031f tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1391 microversion: 2.1 time: 1.237824 Jul 19 22:33:53.229570 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9e61f36f-60c2-46fb-9940-cbcc734b698c tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] 10.222.0.25 "GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1" status: 200 len: 1506 microversion: 2.1 time: 1.316837 Jul 19 22:33:53.230490 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 933/1888] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:51 2022] GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1 => generated 1506 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:53.239447 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 956/1889] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:51 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1391 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:33:53.244935 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c1f6872f-95a2-4a8c-818d-e905cc840a5a tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:53.246097 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ed56f712-f6e1-490d-afc4-219b184c27a6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:53.247045 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c1f6872f-95a2-4a8c-818d-e905cc840a5a tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] [instance: f4b57123-4fc4-45eb-8d88-4a5eed851fb0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:53.247274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ed56f712-f6e1-490d-afc4-219b184c27a6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:53.256789 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:33:53.260747 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ed56f712-f6e1-490d-afc4-219b184c27a6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:53.261860 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ed56f712-f6e1-490d-afc4-219b184c27a6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:53.263098 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ed56f712-f6e1-490d-afc4-219b184c27a6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:53.263949 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ed56f712-f6e1-490d-afc4-219b184c27a6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:53.269299 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c1f6872f-95a2-4a8c-818d-e905cc840a5a tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:53.270019 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c1f6872f-95a2-4a8c-818d-e905cc840a5a tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:53.273193 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c1f6872f-95a2-4a8c-818d-e905cc840a5a tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:53.273813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c1f6872f-95a2-4a8c-818d-e905cc840a5a tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:53.876847 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ed56f712-f6e1-490d-afc4-219b184c27a6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:53.899152 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ed56f712-f6e1-490d-afc4-219b184c27a6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:53.902716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ed56f712-f6e1-490d-afc4-219b184c27a6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:53.907793 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ed56f712-f6e1-490d-afc4-219b184c27a6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1281 microversion: 2.25 time: 0.666727 Jul 19 22:33:53.908402 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 957/1890] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:53 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1281 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:33:53.933467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-69e2d49f-3b2c-4fed-9eee-9b8365ddab50 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:53.941464 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-69e2d49f-3b2c-4fed-9eee-9b8365ddab50 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:53.952975 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69e2d49f-3b2c-4fed-9eee-9b8365ddab50 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:53.955248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69e2d49f-3b2c-4fed-9eee-9b8365ddab50 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:53.958807 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69e2d49f-3b2c-4fed-9eee-9b8365ddab50 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:53.961171 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69e2d49f-3b2c-4fed-9eee-9b8365ddab50 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:54.034332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-69e2d49f-3b2c-4fed-9eee-9b8365ddab50 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:33:54.157053 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-69e2d49f-3b2c-4fed-9eee-9b8365ddab50 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "DELETE /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e" status: 204 len: 0 microversion: 2.1 time: 0.233104 Jul 19 22:33:54.159142 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 958/1891] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:33:53 2022] DELETE /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:33:54.172325 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-796d06f7-b4f3-43bd-bb4f-56ce758cd92b tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:54.173764 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-796d06f7-b4f3-43bd-bb4f-56ce758cd92b tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:54.185919 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-796d06f7-b4f3-43bd-bb4f-56ce758cd92b tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:54.186602 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-796d06f7-b4f3-43bd-bb4f-56ce758cd92b tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:54.187644 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-796d06f7-b4f3-43bd-bb4f-56ce758cd92b tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:54.188210 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-796d06f7-b4f3-43bd-bb4f-56ce758cd92b tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:54.576482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c1f6872f-95a2-4a8c-818d-e905cc840a5a tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb361b1d3c724290b20f96d89be4ccf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5702d8328442d5b5473e6bfe086537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:54.590773 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c1f6872f-95a2-4a8c-818d-e905cc840a5a tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0" status: 200 len: 1312 microversion: 2.1 time: 1.355366 Jul 19 22:33:54.591990 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 934/1892] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:53 2022] GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0 => generated 1312 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:54.597891 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-27023be2-f02a-4f35-b6f5-21a0c81cb369 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:54.599545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-27023be2-f02a-4f35-b6f5-21a0c81cb369 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:54.608582 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-27023be2-f02a-4f35-b6f5-21a0c81cb369 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:54.609321 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-27023be2-f02a-4f35-b6f5-21a0c81cb369 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:54.610357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-27023be2-f02a-4f35-b6f5-21a0c81cb369 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:54.611644 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-27023be2-f02a-4f35-b6f5-21a0c81cb369 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:54.818332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:33:54.892120 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:33:54.919523 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-796d06f7-b4f3-43bd-bb4f-56ce758cd92b tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37267b4c360540489a72d9b0043abd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a353634f70fb4ff58c7190a5c7aa675d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:54.928790 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-796d06f7-b4f3-43bd-bb4f-56ce758cd92b tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e" status: 200 len: 1681 microversion: 2.1 time: 0.762197 Jul 19 22:33:54.933399 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 959/1893] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:54 2022] GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e => generated 1681 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:54.944990 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d0a8420b-319a-4095-9730-949f2c13c312 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:54.947634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d0a8420b-319a-4095-9730-949f2c13c312 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] [instance: 43943c92-c6e2-456e-b295-ca4ed3e6c5f1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:54.964195 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0a8420b-319a-4095-9730-949f2c13c312 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:54.964763 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0a8420b-319a-4095-9730-949f2c13c312 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:54.965620 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0a8420b-319a-4095-9730-949f2c13c312 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:54.966066 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0a8420b-319a-4095-9730-949f2c13c312 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:55.302651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-27023be2-f02a-4f35-b6f5-21a0c81cb369 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:55.314820 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-27023be2-f02a-4f35-b6f5-21a0c81cb369 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1391 microversion: 2.1 time: 0.721232 Jul 19 22:33:55.315430 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 935/1894] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:54 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1391 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:55.324025 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b48af487-82bc-428f-8d07-d128d72bf190 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:55.330770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b48af487-82bc-428f-8d07-d128d72bf190 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:55.362503 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b48af487-82bc-428f-8d07-d128d72bf190 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:55.363867 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b48af487-82bc-428f-8d07-d128d72bf190 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:55.365639 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b48af487-82bc-428f-8d07-d128d72bf190 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:55.375698 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b48af487-82bc-428f-8d07-d128d72bf190 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:56.154542 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d0a8420b-319a-4095-9730-949f2c13c312 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cd4a1e9d0f4f328e7f4046ad9fa711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c1b5a8abc7401b9513023803dd1f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:56.172432 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d0a8420b-319a-4095-9730-949f2c13c312 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] 10.222.0.25 "GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1" status: 200 len: 1504 microversion: 2.1 time: 1.237741 Jul 19 22:33:56.173506 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 960/1895] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:54 2022] GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1 => generated 1504 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:56.310417 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3b1ae0be-7354-4475-bff1-939cfb9ed000 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-15456401", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "6d053fb3-7842-42eb-ace2-41e8e82ce28b"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:33:56.443435 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-3b1ae0be-7354-4475-bff1-939cfb9ed000 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] validate_networks() for [('6d053fb3-7842-42eb-ace2-41e8e82ce28b', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:33:56.655126 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b48af487-82bc-428f-8d07-d128d72bf190 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:56.682722 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b48af487-82bc-428f-8d07-d128d72bf190 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:56.688084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b48af487-82bc-428f-8d07-d128d72bf190 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:56.695589 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b48af487-82bc-428f-8d07-d128d72bf190 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1281 microversion: 2.25 time: 1.375041 Jul 19 22:33:56.697789 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 936/1896] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:33:55 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1281 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:33:56.719405 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f91e2dc8-7a9b-46c2-bcfc-d57f1c3b39fb tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:56.720976 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f91e2dc8-7a9b-46c2-bcfc-d57f1c3b39fb tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] [instance: f4b57123-4fc4-45eb-8d88-4a5eed851fb0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:56.747724 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f91e2dc8-7a9b-46c2-bcfc-d57f1c3b39fb tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:56.749766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f91e2dc8-7a9b-46c2-bcfc-d57f1c3b39fb tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:56.757970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f91e2dc8-7a9b-46c2-bcfc-d57f1c3b39fb tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:56.758754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f91e2dc8-7a9b-46c2-bcfc-d57f1c3b39fb tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:57.563283 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f91e2dc8-7a9b-46c2-bcfc-d57f1c3b39fb tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb361b1d3c724290b20f96d89be4ccf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5702d8328442d5b5473e6bfe086537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:57.587327 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f91e2dc8-7a9b-46c2-bcfc-d57f1c3b39fb tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0" status: 200 len: 1312 microversion: 2.1 time: 0.886894 Jul 19 22:33:57.597318 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 937/1897] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:56 2022] GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0 => generated 1312 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:57.602952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dd8db934-9967-45ee-8791-c0721336b068 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:57.603602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dd8db934-9967-45ee-8791-c0721336b068 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:57.626908 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd8db934-9967-45ee-8791-c0721336b068 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:57.628970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd8db934-9967-45ee-8791-c0721336b068 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:57.631015 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd8db934-9967-45ee-8791-c0721336b068 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:57.633132 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd8db934-9967-45ee-8791-c0721336b068 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:58.264741 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dd8db934-9967-45ee-8791-c0721336b068 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37267b4c360540489a72d9b0043abd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a353634f70fb4ff58c7190a5c7aa675d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:33:58.279244 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dd8db934-9967-45ee-8791-c0721336b068 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e" status: 200 len: 1681 microversion: 2.1 time: 0.680713 Jul 19 22:33:58.288680 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 938/1898] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:57 2022] GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e => generated 1681 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:33:58.312233 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-35ee5ee2-f3df-46cd-a5e9-b816e8a04ebc tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Calling method '.version_select at 0x7f7a15694e50>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:58.318834 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-35ee5ee2-f3df-46cd-a5e9-b816e8a04ebc tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] [instance: 43943c92-c6e2-456e-b295-ca4ed3e6c5f1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:58.331880 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35ee5ee2-f3df-46cd-a5e9-b816e8a04ebc tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:58.332595 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35ee5ee2-f3df-46cd-a5e9-b816e8a04ebc tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:58.335761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35ee5ee2-f3df-46cd-a5e9-b816e8a04ebc tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:58.339379 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35ee5ee2-f3df-46cd-a5e9-b816e8a04ebc tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:58.420020 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-35ee5ee2-f3df-46cd-a5e9-b816e8a04ebc tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] 10.222.0.25 "GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.129723 Jul 19 22:33:58.428836 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 939/1899] 10.222.0.25 () {58 vars in 1295 bytes} [Tue Jul 19 22:33:58 2022] GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1/os-instance-actions => generated 611 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:33:58.442507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1fb5ec88-cb48-473d-8317-3cd4f5e52bae tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:33:58.443940 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1fb5ec88-cb48-473d-8317-3cd4f5e52bae tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:33:58.479757 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1fb5ec88-cb48-473d-8317-3cd4f5e52bae tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:58.480426 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1fb5ec88-cb48-473d-8317-3cd4f5e52bae tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:58.481780 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1fb5ec88-cb48-473d-8317-3cd4f5e52bae tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:58.487244 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1fb5ec88-cb48-473d-8317-3cd4f5e52bae tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:58.506932 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:33:59.581568 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-3b1ae0be-7354-4475-bff1-939cfb9ed000 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:33:59.582696 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-3b1ae0be-7354-4475-bff1-939cfb9ed000 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:33:59.583472 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-3b1ae0be-7354-4475-bff1-939cfb9ed000 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:33:59.584831 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-3b1ae0be-7354-4475-bff1-939cfb9ed000 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:33:59.585588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-3b1ae0be-7354-4475-bff1-939cfb9ed000 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:33:59.620150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b1ae0be-7354-4475-bff1-939cfb9ed000 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:59.632412 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b1ae0be-7354-4475-bff1-939cfb9ed000 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:59.647206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b1ae0be-7354-4475-bff1-939cfb9ed000 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:33:59.653659 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b1ae0be-7354-4475-bff1-939cfb9ed000 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:33:59.770286 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-3b1ae0be-7354-4475-bff1-939cfb9ed000 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Getting quotas for project 3eca98474bca4a64af425dffb9ecb5b3. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:33:59.783093 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-3b1ae0be-7354-4475-bff1-939cfb9ed000 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Getting quotas for user ecca13a073e7447591944e6604d67e4c and project 3eca98474bca4a64af425dffb9ecb5b3. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:33:59.824016 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3b1ae0be-7354-4475-bff1-939cfb9ed000 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:33:59.831868 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3b1ae0be-7354-4475-bff1-939cfb9ed000 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:33:59.996719 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3b1ae0be-7354-4475-bff1-939cfb9ed000 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.806120 Jul 19 22:34:00.006566 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 961/1900] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:33:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:34:00.020750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-75118006-e68a-49d8-8bab-374fda84e441 req-7ed2a42e-d571-41fa-bf2b-4ba4bbc32686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4b57123-4fc4-45eb-8d88-4a5eed851fb0", "tag": "6cad745a-f8d4-40f4-aafb-c8e35144f99b"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:34:00.062556 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-75118006-e68a-49d8-8bab-374fda84e441 req-7ed2a42e-d571-41fa-bf2b-4ba4bbc32686 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:00.071343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-75118006-e68a-49d8-8bab-374fda84e441 req-7ed2a42e-d571-41fa-bf2b-4ba4bbc32686 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:00.106162 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-75118006-e68a-49d8-8bab-374fda84e441 req-7ed2a42e-d571-41fa-bf2b-4ba4bbc32686 service nova] Creating event network-changed:6cad745a-f8d4-40f4-aafb-c8e35144f99b for instance f4b57123-4fc4-45eb-8d88-4a5eed851fb0 on n-h1-847009-3 Jul 19 22:34:00.116820 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-75118006-e68a-49d8-8bab-374fda84e441 req-7ed2a42e-d571-41fa-bf2b-4ba4bbc32686 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106781 Jul 19 22:34:00.123001 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 962/1901] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:34:00.146863 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5c45cf98-8d3b-425e-9d2b-b00a6c4101c0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:00.148879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5c45cf98-8d3b-425e-9d2b-b00a6c4101c0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:00.163016 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c45cf98-8d3b-425e-9d2b-b00a6c4101c0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:00.163979 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c45cf98-8d3b-425e-9d2b-b00a6c4101c0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:00.165079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c45cf98-8d3b-425e-9d2b-b00a6c4101c0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:00.166001 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c45cf98-8d3b-425e-9d2b-b00a6c4101c0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:00.263833 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1fb5ec88-cb48-473d-8317-3cd4f5e52bae tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:00.299911 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1fb5ec88-cb48-473d-8317-3cd4f5e52bae tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1381 microversion: 2.1 time: 1.869050 Jul 19 22:34:00.308613 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 940/1902] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:33:58 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1381 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:00.344672 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e11d24b7-19d6-406c-8869-d8cd165029fa tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:00.347487 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e11d24b7-19d6-406c-8869-d8cd165029fa tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] [instance: 43943c92-c6e2-456e-b295-ca4ed3e6c5f1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:00.368444 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e11d24b7-19d6-406c-8869-d8cd165029fa tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:00.371813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e11d24b7-19d6-406c-8869-d8cd165029fa tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:00.373057 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e11d24b7-19d6-406c-8869-d8cd165029fa tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:00.373661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e11d24b7-19d6-406c-8869-d8cd165029fa tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:00.448079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e11d24b7-19d6-406c-8869-d8cd165029fa tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] [instance: 43943c92-c6e2-456e-b295-ca4ed3e6c5f1] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:34:00.789934 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e11d24b7-19d6-406c-8869-d8cd165029fa tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] 10.222.0.25 "DELETE /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1" status: 204 len: 0 microversion: 2.1 time: 0.453103 Jul 19 22:34:00.790658 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 941/1903] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:34:00 2022] DELETE /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:34:00.813069 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d0f4257e-97f1-448a-8b61-14c20bcb9c5b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:00.827923 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d0f4257e-97f1-448a-8b61-14c20bcb9c5b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] [instance: f4b57123-4fc4-45eb-8d88-4a5eed851fb0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:00.847656 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d0f4257e-97f1-448a-8b61-14c20bcb9c5b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:00.848546 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d0f4257e-97f1-448a-8b61-14c20bcb9c5b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:00.853161 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d0f4257e-97f1-448a-8b61-14c20bcb9c5b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:00.854038 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d0f4257e-97f1-448a-8b61-14c20bcb9c5b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:01.501921 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5c45cf98-8d3b-425e-9d2b-b00a6c4101c0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:01.528220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5c45cf98-8d3b-425e-9d2b-b00a6c4101c0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:01.530216 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5c45cf98-8d3b-425e-9d2b-b00a6c4101c0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:01.534540 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5c45cf98-8d3b-425e-9d2b-b00a6c4101c0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1281 microversion: 2.25 time: 1.409557 Jul 19 22:34:01.553727 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 963/1904] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:34:00 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1281 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:34:01.568071 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1c88e57f-e675-4f31-a2a1-40bd2fc7d9dc tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:01.569475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1c88e57f-e675-4f31-a2a1-40bd2fc7d9dc tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:01.590159 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1c88e57f-e675-4f31-a2a1-40bd2fc7d9dc tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:01.592877 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1c88e57f-e675-4f31-a2a1-40bd2fc7d9dc tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:01.597448 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1c88e57f-e675-4f31-a2a1-40bd2fc7d9dc tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:01.602341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1c88e57f-e675-4f31-a2a1-40bd2fc7d9dc tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:01.605272 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d0f4257e-97f1-448a-8b61-14c20bcb9c5b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb361b1d3c724290b20f96d89be4ccf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5702d8328442d5b5473e6bfe086537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:01.623806 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d0f4257e-97f1-448a-8b61-14c20bcb9c5b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0" status: 200 len: 1312 microversion: 2.1 time: 0.828993 Jul 19 22:34:01.627186 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 942/1905] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:00 2022] GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0 => generated 1312 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:01.648937 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-18aabd97-a9fa-438b-810d-5d8b23d6e1f6 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:01.655254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-18aabd97-a9fa-438b-810d-5d8b23d6e1f6 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:01.687780 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-18aabd97-a9fa-438b-810d-5d8b23d6e1f6 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:01.690363 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-18aabd97-a9fa-438b-810d-5d8b23d6e1f6 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:01.692203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1c88e57f-e675-4f31-a2a1-40bd2fc7d9dc tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37267b4c360540489a72d9b0043abd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a353634f70fb4ff58c7190a5c7aa675d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:01.698377 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-18aabd97-a9fa-438b-810d-5d8b23d6e1f6 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:01.700094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-18aabd97-a9fa-438b-810d-5d8b23d6e1f6 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:01.711470 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1c88e57f-e675-4f31-a2a1-40bd2fc7d9dc tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e" status: 200 len: 1613 microversion: 2.1 time: 0.154979 Jul 19 22:34:01.721902 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 964/1906] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:01 2022] GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e => generated 1613 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:01.728755 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a309ae58-0e16-41e1-aadc-be16d48cad09 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Calling method '.version_select at 0x7f7a03e7d430>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:01.732538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a309ae58-0e16-41e1-aadc-be16d48cad09 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:01.733225 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a309ae58-0e16-41e1-aadc-be16d48cad09 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:01.761703 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a309ae58-0e16-41e1-aadc-be16d48cad09 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 2706 microversion: 2.1 time: 0.038599 Jul 19 22:34:01.762913 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 965/1907] 10.222.0.25 () {58 vars in 1142 bytes} [Tue Jul 19 22:34:01 2022] GET /compute/v2.1/os-migrations => generated 2706 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:01.789013 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a68abb2e-8822-483a-92bf-2990ba83f652 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:01.817931 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a68abb2e-8822-483a-92bf-2990ba83f652 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] [instance: 43943c92-c6e2-456e-b295-ca4ed3e6c5f1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:01.837603 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a68abb2e-8822-483a-92bf-2990ba83f652 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:01.838060 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a68abb2e-8822-483a-92bf-2990ba83f652 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:01.838866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a68abb2e-8822-483a-92bf-2990ba83f652 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:01.839342 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a68abb2e-8822-483a-92bf-2990ba83f652 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:01.900241 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-18aabd97-a9fa-438b-810d-5d8b23d6e1f6 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:01.910267 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-18aabd97-a9fa-438b-810d-5d8b23d6e1f6 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 200 len: 1227 microversion: 2.1 time: 0.277215 Jul 19 22:34:01.919327 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 943/1908] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:01 2022] GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 1227 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:01.925368 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-178d6780-a1b6-4d07-aaa0-7e1c78d33c58 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:01.930546 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-178d6780-a1b6-4d07-aaa0-7e1c78d33c58 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:01.956149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-178d6780-a1b6-4d07-aaa0-7e1c78d33c58 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:01.956713 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-178d6780-a1b6-4d07-aaa0-7e1c78d33c58 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:01.957676 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-178d6780-a1b6-4d07-aaa0-7e1c78d33c58 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:01.958895 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-178d6780-a1b6-4d07-aaa0-7e1c78d33c58 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:02.316556 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a68abb2e-8822-483a-92bf-2990ba83f652 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cd4a1e9d0f4f328e7f4046ad9fa711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c1b5a8abc7401b9513023803dd1f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:02.328301 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a68abb2e-8822-483a-92bf-2990ba83f652 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] 10.222.0.25 "GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1" status: 200 len: 1510 microversion: 2.1 time: 0.563823 Jul 19 22:34:02.329624 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 966/1909] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:01 2022] GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1 => generated 1510 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:02.335701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-05f9f140-2f7e-49a7-bbab-06343a72eb68 req-3643066c-3bc6-49f6-9bdd-50b2bcce9ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f2b8c66-5ac4-42bd-afe7-e283eba41078", "name": "network-vif-plugged", "status": "completed", "tag": "7697d6fa-c774-468b-a275-a40743f7894f"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:34:02.349841 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-05f9f140-2f7e-49a7-bbab-06343a72eb68 req-3643066c-3bc6-49f6-9bdd-50b2bcce9ac3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:02.350866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-05f9f140-2f7e-49a7-bbab-06343a72eb68 req-3643066c-3bc6-49f6-9bdd-50b2bcce9ac3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:02.378941 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-05f9f140-2f7e-49a7-bbab-06343a72eb68 req-3643066c-3bc6-49f6-9bdd-50b2bcce9ac3 service nova] Creating event network-vif-plugged:7697d6fa-c774-468b-a275-a40743f7894f for instance 9f2b8c66-5ac4-42bd-afe7-e283eba41078 on n-h1-847009-3 Jul 19 22:34:02.391816 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-05f9f140-2f7e-49a7-bbab-06343a72eb68 req-3643066c-3bc6-49f6-9bdd-50b2bcce9ac3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059846 Jul 19 22:34:02.397314 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 967/1910] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:34:02.410458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-f4522273-9306-4bb2-a6b2-975645553e87 req-0272b518-ae0a-41c5-acf0-0a130527da24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317af5ae-9759-4095-b561-ed61e9847c7e", "name": "network-vif-deleted", "tag": "f3ab19a8-a957-4cec-a5b1-da04b760b755"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:34:02.429367 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-f4522273-9306-4bb2-a6b2-975645553e87 req-0272b518-ae0a-41c5-acf0-0a130527da24 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:02.430166 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-178d6780-a1b6-4d07-aaa0-7e1c78d33c58 tempest-LiveMigrationTest-676456532 tempest-LiveMigrationTest-676456532-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1532 microversion: 2.1 time: 0.509384 Jul 19 22:34:02.430497 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-f4522273-9306-4bb2-a6b2-975645553e87 req-0272b518-ae0a-41c5-acf0-0a130527da24 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:02.446351 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 944/1911] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:01 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1532 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:02.450198 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-f4522273-9306-4bb2-a6b2-975645553e87 req-0272b518-ae0a-41c5-acf0-0a130527da24 service nova] Creating event network-vif-deleted:f3ab19a8-a957-4cec-a5b1-da04b760b755 for instance 317af5ae-9759-4095-b561-ed61e9847c7e on n-h2-847009-3 Jul 19 22:34:02.459426 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-f4522273-9306-4bb2-a6b2-975645553e87 req-0272b518-ae0a-41c5-acf0-0a130527da24 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059145 Jul 19 22:34:02.461035 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 968/1912] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:34:02.467772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b391aa38-745d-4f4a-a6d2-13cd45d057c2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:02.468522 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b391aa38-745d-4f4a-a6d2-13cd45d057c2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:02.479709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b391aa38-745d-4f4a-a6d2-13cd45d057c2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:02.480649 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b391aa38-745d-4f4a-a6d2-13cd45d057c2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:02.481703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b391aa38-745d-4f4a-a6d2-13cd45d057c2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:02.482481 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b391aa38-745d-4f4a-a6d2-13cd45d057c2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:02.518216 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b391aa38-745d-4f4a-a6d2-13cd45d057c2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:34:02.564013 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9439b3ae-019f-41c8-bb54-00d7fea4b0fc tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:02.564837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9439b3ae-019f-41c8-bb54-00d7fea4b0fc tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:02.580965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9439b3ae-019f-41c8-bb54-00d7fea4b0fc tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:02.583284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9439b3ae-019f-41c8-bb54-00d7fea4b0fc tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:02.585147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9439b3ae-019f-41c8-bb54-00d7fea4b0fc tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:02.591666 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9439b3ae-019f-41c8-bb54-00d7fea4b0fc tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:02.648747 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b391aa38-745d-4f4a-a6d2-13cd45d057c2 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 204 len: 0 microversion: 2.1 time: 0.187584 Jul 19 22:34:02.654289 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 945/1913] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:34:02 2022] DELETE /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:34:02.662289 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-138d6b9e-cc2a-40c6-b373-c32327107120 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:02.663427 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-138d6b9e-cc2a-40c6-b373-c32327107120 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] [instance: f4b57123-4fc4-45eb-8d88-4a5eed851fb0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:02.671077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-138d6b9e-cc2a-40c6-b373-c32327107120 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:02.671917 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-138d6b9e-cc2a-40c6-b373-c32327107120 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:02.673488 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-138d6b9e-cc2a-40c6-b373-c32327107120 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:02.674184 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-138d6b9e-cc2a-40c6-b373-c32327107120 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:04.017765 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-138d6b9e-cc2a-40c6-b373-c32327107120 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb361b1d3c724290b20f96d89be4ccf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5702d8328442d5b5473e6bfe086537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:04.019298 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9439b3ae-019f-41c8-bb54-00d7fea4b0fc tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:04.046132 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-138d6b9e-cc2a-40c6-b373-c32327107120 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0" status: 200 len: 1312 microversion: 2.1 time: 1.389574 Jul 19 22:34:04.053000 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 946/1914] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:02 2022] GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0 => generated 1312 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:04.053814 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9439b3ae-019f-41c8-bb54-00d7fea4b0fc tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:04.064228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9439b3ae-019f-41c8-bb54-00d7fea4b0fc tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:04.072455 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9439b3ae-019f-41c8-bb54-00d7fea4b0fc tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1281 microversion: 2.25 time: 1.511768 Jul 19 22:34:04.083744 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d412785f-3d30-4306-bd56-1921d7f155d4 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:04.085408 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d412785f-3d30-4306-bd56-1921d7f155d4 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:04.089375 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 969/1915] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:34:02 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1281 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:34:04.101074 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f7c3165d-6824-4fbc-9661-cccff98caf3d tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:04.104605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d412785f-3d30-4306-bd56-1921d7f155d4 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:04.105719 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d412785f-3d30-4306-bd56-1921d7f155d4 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:04.106427 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f7c3165d-6824-4fbc-9661-cccff98caf3d tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] [instance: 317af5ae-9759-4095-b561-ed61e9847c7e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:04.107053 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d412785f-3d30-4306-bd56-1921d7f155d4 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:04.107741 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d412785f-3d30-4306-bd56-1921d7f155d4 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:04.122474 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f7c3165d-6824-4fbc-9661-cccff98caf3d tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:04.122953 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f7c3165d-6824-4fbc-9661-cccff98caf3d tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:04.129196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f7c3165d-6824-4fbc-9661-cccff98caf3d tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:04.129664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f7c3165d-6824-4fbc-9661-cccff98caf3d tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:04.195511 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-f7c3165d-6824-4fbc-9661-cccff98caf3d tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] HTTP exception thrown: Instance 317af5ae-9759-4095-b561-ed61e9847c7e could not be found. Jul 19 22:34:04.200475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f7c3165d-6824-4fbc-9661-cccff98caf3d tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Request method failure captured: Jul 19 22:34:04.200475 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e HTTP/1.1 Jul 19 22:34:04.200475 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:34:04.200475 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:34:04.200475 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:34:04.200475 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:34:04.200475 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:34:04.200475 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:34:04.200475 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:34:04.200475 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:34:04.200475 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zBwSSNo71LcCjfYAYmhsByQl_SWhHPkrWp19RS9IQ6uEy2gAWW21j1aqw2ewBqM-_j_dZv06wTRIwH-7utNDuAYSh5IE5sHqP5NdUyc7XSBZEeYoD_X1ZEjXH04ISbbNV5ni4Nu0gUUCw5W-zOWfkwzg3vhWltzHW5sqX30z1snYvM Jul 19 22:34:04.200475 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:34:04.200475 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:34:04.200475 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:34:04.200475 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:34:04.200475 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:34:04.200475 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:34:04.200475 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: a353634f70fb4ff58c7190a5c7aa675d Jul 19 22:34:04.200475 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-VolumesAdminNegativeTest-1228918780 Jul 19 22:34:04.200475 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:34:04.200475 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:34:04.202197 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a353634f70fb4ff58c7190a5c7aa675d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a353634f70fb4ff58c7190a5c7aa675d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a353634f70fb4ff58c7190a5c7aa675d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a353634f70fb4ff58c7190a5c7aa675d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:34:04.202197 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-VolumesAdminNegativeTest-1228918780 Jul 19 22:34:04.202197 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: a353634f70fb4ff58c7190a5c7aa675d Jul 19 22:34:04.202197 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1228918780 Jul 19 22:34:04.202197 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-VolumesAdminNegativeTest-1228918780-project Jul 19 22:34:04.202197 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:34:04.202197 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:34:04.202197 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 37267b4c360540489a72d9b0043abd87 Jul 19 22:34:04.202197 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-VolumesAdminNegativeTest-1228918780-project Jul 19 22:34:04.202197 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:34:04.202197 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 317af5ae-9759-4095-b561-ed61e9847c7e could not be found. Jul 19 22:34:04.202197 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '317af5ae-9759-4095-b561-ed61e9847c7e'} Jul 19 22:34:04.203131 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:34:04.203131 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:04.203131 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:34:04.203131 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:34:04.203131 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:34:04.203131 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:34:04.203131 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:34:04.203131 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:34:04.203131 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:34:04.203131 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:34:04.203131 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 317af5ae-9759-4095-b561-ed61e9847c7e could not be found. Jul 19 22:34:04.203131 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:04.203131 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:34:04.203131 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:04.203131 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:04.203131 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:34:04.203131 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:34:04.203131 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:34:04.203131 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:34:04.203131 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:34:04.205323 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:34:04.205323 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:34:04.205323 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:34:04.205323 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:34:04.205323 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:34:04.205323 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:34:04.205323 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:34:04.205323 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317af5ae-9759-4095-b561-ed61e9847c7e could not be found. Jul 19 22:34:04.205323 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:04.205323 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:34:04.205323 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:04.205323 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:04.205323 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:34:04.205323 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:34:04.205323 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:34:04.205323 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:34:04.205323 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317af5ae-9759-4095-b561-ed61e9847c7e could not be found. Jul 19 22:34:04.205323 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:04.207727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f7c3165d-6824-4fbc-9661-cccff98caf3d tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Returning 404 to user: Instance 317af5ae-9759-4095-b561-ed61e9847c7e could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:34:04.212136 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f7c3165d-6824-4fbc-9661-cccff98caf3d tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e" status: 404 len: 111 microversion: 2.1 time: 0.121478 Jul 19 22:34:04.216864 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 970/1916] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:04 2022] GET /compute/v2.1/servers/317af5ae-9759-4095-b561-ed61e9847c7e => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:34:04.237367 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d9d644b0-6e67-4917-9a51-38b98d1ffcdb tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:04.237996 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d9d644b0-6e67-4917-9a51-38b98d1ffcdb tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:04.246012 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d9d644b0-6e67-4917-9a51-38b98d1ffcdb tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:04.246571 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d9d644b0-6e67-4917-9a51-38b98d1ffcdb tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:04.247545 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d9d644b0-6e67-4917-9a51-38b98d1ffcdb tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:04.248092 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d9d644b0-6e67-4917-9a51-38b98d1ffcdb tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:04.415617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d9d644b0-6e67-4917-9a51-38b98d1ffcdb tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:04.424219 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d9d644b0-6e67-4917-9a51-38b98d1ffcdb tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 200 len: 1281 microversion: 2.1 time: 0.205912 Jul 19 22:34:04.425316 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 971/1917] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:04 2022] GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 1281 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:04.430810 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ffdb8f94-6d8b-4661-852c-6845b021e55f tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:04.431757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ffdb8f94-6d8b-4661-852c-6845b021e55f tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] [instance: 43943c92-c6e2-456e-b295-ca4ed3e6c5f1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:04.448597 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ffdb8f94-6d8b-4661-852c-6845b021e55f tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:04.449173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ffdb8f94-6d8b-4661-852c-6845b021e55f tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:04.450019 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ffdb8f94-6d8b-4661-852c-6845b021e55f tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:04.450654 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ffdb8f94-6d8b-4661-852c-6845b021e55f tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:05.295350 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d412785f-3d30-4306-bd56-1921d7f155d4 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:05.314013 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d412785f-3d30-4306-bd56-1921d7f155d4 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1387 microversion: 2.1 time: 1.255860 Jul 19 22:34:05.318369 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 947/1918] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:04 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1387 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:05.333936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2f3bca82-9a8b-4622-87f7-739a80578428 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] Calling method '.version_select at 0x7f7a15571790>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:05.387198 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2f3bca82-9a8b-4622-87f7-739a80578428 tempest-VolumesAdminNegativeTest-1228918780 tempest-VolumesAdminNegativeTest-1228918780-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-342114636" status: 202 len: 0 microversion: 2.1 time: 0.067302 Jul 19 22:34:05.388651 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 948/1919] 10.222.0.25 () {58 vars in 1217 bytes} [Tue Jul 19 22:34:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-342114636 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:34:05.394597 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4d8cd4a7-a8ee-46f7-a8d8-615d2cceb4ec tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:05.395653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4d8cd4a7-a8ee-46f7-a8d8-615d2cceb4ec tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] [instance: f4b57123-4fc4-45eb-8d88-4a5eed851fb0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:05.404161 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d8cd4a7-a8ee-46f7-a8d8-615d2cceb4ec tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:05.406592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d8cd4a7-a8ee-46f7-a8d8-615d2cceb4ec tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:05.408219 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d8cd4a7-a8ee-46f7-a8d8-615d2cceb4ec tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:05.408847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d8cd4a7-a8ee-46f7-a8d8-615d2cceb4ec tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:05.523599 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ffdb8f94-6d8b-4661-852c-6845b021e55f tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cd4a1e9d0f4f328e7f4046ad9fa711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c1b5a8abc7401b9513023803dd1f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:05.547181 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ffdb8f94-6d8b-4661-852c-6845b021e55f tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] 10.222.0.25 "GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1" status: 200 len: 1510 microversion: 2.1 time: 1.113684 Jul 19 22:34:05.569464 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 972/1920] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:04 2022] GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1 => generated 1510 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:05.580376 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-38ca0ce3-27f2-42f6-830d-b094feb7c457 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:05.589669 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-38ca0ce3-27f2-42f6-830d-b094feb7c457 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:05.604748 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-38ca0ce3-27f2-42f6-830d-b094feb7c457 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:05.605216 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-38ca0ce3-27f2-42f6-830d-b094feb7c457 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:05.606020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-38ca0ce3-27f2-42f6-830d-b094feb7c457 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:05.606465 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-38ca0ce3-27f2-42f6-830d-b094feb7c457 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:06.888363 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4d8cd4a7-a8ee-46f7-a8d8-615d2cceb4ec tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb361b1d3c724290b20f96d89be4ccf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5702d8328442d5b5473e6bfe086537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:06.918990 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4d8cd4a7-a8ee-46f7-a8d8-615d2cceb4ec tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0" status: 200 len: 1312 microversion: 2.1 time: 1.528651 Jul 19 22:34:06.927749 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 949/1921] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:05 2022] GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0 => generated 1312 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:06.950418 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4567b49d-afa1-47aa-9c52-b7da1c3e5812 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:06.959768 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4567b49d-afa1-47aa-9c52-b7da1c3e5812 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:06.962213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-38ca0ce3-27f2-42f6-830d-b094feb7c457 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:06.972683 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:34:06.985379 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-38ca0ce3-27f2-42f6-830d-b094feb7c457 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:06.992787 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4567b49d-afa1-47aa-9c52-b7da1c3e5812 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:06.993545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4567b49d-afa1-47aa-9c52-b7da1c3e5812 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:06.996884 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-38ca0ce3-27f2-42f6-830d-b094feb7c457 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:06.997878 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-38ca0ce3-27f2-42f6-830d-b094feb7c457 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1477 microversion: 2.25 time: 1.427286 Jul 19 22:34:07.002713 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4567b49d-afa1-47aa-9c52-b7da1c3e5812 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:07.007025 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4567b49d-afa1-47aa-9c52-b7da1c3e5812 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:07.011867 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 973/1922] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:34:05 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1477 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:34:07.018362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f693f5ba-359d-4c95-98f4-7dec95653720 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:07.032966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f693f5ba-359d-4c95-98f4-7dec95653720 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:07.058564 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f693f5ba-359d-4c95-98f4-7dec95653720 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:07.060281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f693f5ba-359d-4c95-98f4-7dec95653720 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:07.063924 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f693f5ba-359d-4c95-98f4-7dec95653720 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:07.068498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f693f5ba-359d-4c95-98f4-7dec95653720 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:07.377632 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f693f5ba-359d-4c95-98f4-7dec95653720 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:07.415431 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f693f5ba-359d-4c95-98f4-7dec95653720 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1183 microversion: 2.1 time: 0.393853 Jul 19 22:34:07.431253 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 974/1923] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:07 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1183 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:07.449496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bbec6e0f-156a-4e2f-9be9-1d6733127b5b tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:07.451085 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bbec6e0f-156a-4e2f-9be9-1d6733127b5b tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] [instance: 43943c92-c6e2-456e-b295-ca4ed3e6c5f1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:07.478800 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bbec6e0f-156a-4e2f-9be9-1d6733127b5b tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:07.492754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bbec6e0f-156a-4e2f-9be9-1d6733127b5b tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:07.494449 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bbec6e0f-156a-4e2f-9be9-1d6733127b5b tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:07.497392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bbec6e0f-156a-4e2f-9be9-1d6733127b5b tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:07.696649 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bbec6e0f-156a-4e2f-9be9-1d6733127b5b tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:07.699705 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bbec6e0f-156a-4e2f-9be9-1d6733127b5b tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:07.700721 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-bbec6e0f-156a-4e2f-9be9-1d6733127b5b tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lazy-loading 'fault' on Instance uuid 43943c92-c6e2-456e-b295-ca4ed3e6c5f1 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:34:07.977360 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bbec6e0f-156a-4e2f-9be9-1d6733127b5b tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cd4a1e9d0f4f328e7f4046ad9fa711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c1b5a8abc7401b9513023803dd1f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:08.027240 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bbec6e0f-156a-4e2f-9be9-1d6733127b5b tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] 10.222.0.25 "GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1" status: 200 len: 1306 microversion: 2.1 time: 0.595768 Jul 19 22:34:08.039444 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 975/1924] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:07 2022] GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1 => generated 1306 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:08.065721 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-7334f23f-785a-4b39-9569-3a7a50f0925d req-755aaf07-6e21-476d-8e75-b58bfd80dfac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7", "name": "network-vif-deleted", "tag": "982bb92a-f3e0-4d49-82fa-8c659b4cf2a9"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:34:08.115818 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-7334f23f-785a-4b39-9569-3a7a50f0925d req-755aaf07-6e21-476d-8e75-b58bfd80dfac service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:08.119283 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-7334f23f-785a-4b39-9569-3a7a50f0925d req-755aaf07-6e21-476d-8e75-b58bfd80dfac service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:08.160486 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-7334f23f-785a-4b39-9569-3a7a50f0925d req-755aaf07-6e21-476d-8e75-b58bfd80dfac service nova] Creating event network-vif-deleted:982bb92a-f3e0-4d49-82fa-8c659b4cf2a9 for instance b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 on n-h1-847009-3 Jul 19 22:34:08.172781 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-7334f23f-785a-4b39-9569-3a7a50f0925d req-755aaf07-6e21-476d-8e75-b58bfd80dfac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130703 Jul 19 22:34:08.173794 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 976/1925] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:34:08.457819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4567b49d-afa1-47aa-9c52-b7da1c3e5812 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:08.477116 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4567b49d-afa1-47aa-9c52-b7da1c3e5812 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 200 len: 1323 microversion: 2.1 time: 1.545353 Jul 19 22:34:08.478539 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 950/1926] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:06 2022] GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 1323 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:08.501065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cae784fe-ad53-4e7b-8f4e-fac23b0a3929 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:08.503142 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cae784fe-ad53-4e7b-8f4e-fac23b0a3929 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] [instance: f4b57123-4fc4-45eb-8d88-4a5eed851fb0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:08.540991 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cae784fe-ad53-4e7b-8f4e-fac23b0a3929 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:08.544618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cae784fe-ad53-4e7b-8f4e-fac23b0a3929 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:08.546868 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cae784fe-ad53-4e7b-8f4e-fac23b0a3929 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:08.555408 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cae784fe-ad53-4e7b-8f4e-fac23b0a3929 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:08.756470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-140736a2-b517-4aea-a92d-5d84b182d313 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:08.757290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-140736a2-b517-4aea-a92d-5d84b182d313 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:08.769179 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-140736a2-b517-4aea-a92d-5d84b182d313 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:08.769633 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-140736a2-b517-4aea-a92d-5d84b182d313 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:08.775307 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-140736a2-b517-4aea-a92d-5d84b182d313 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:08.775861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-140736a2-b517-4aea-a92d-5d84b182d313 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:09.369787 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cae784fe-ad53-4e7b-8f4e-fac23b0a3929 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb361b1d3c724290b20f96d89be4ccf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5702d8328442d5b5473e6bfe086537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:09.382255 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cae784fe-ad53-4e7b-8f4e-fac23b0a3929 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0" status: 200 len: 1312 microversion: 2.1 time: 0.896385 Jul 19 22:34:09.385783 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 951/1927] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:08 2022] GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0 => generated 1312 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:09.392479 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7c91bfde-6dd7-4ee7-9dd9-00185f8d068d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:09.393323 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7c91bfde-6dd7-4ee7-9dd9-00185f8d068d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:09.405181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7c91bfde-6dd7-4ee7-9dd9-00185f8d068d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:09.405892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7c91bfde-6dd7-4ee7-9dd9-00185f8d068d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:09.406871 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7c91bfde-6dd7-4ee7-9dd9-00185f8d068d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:09.407494 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7c91bfde-6dd7-4ee7-9dd9-00185f8d068d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:09.574687 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7c91bfde-6dd7-4ee7-9dd9-00185f8d068d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:09.596274 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7c91bfde-6dd7-4ee7-9dd9-00185f8d068d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1183 microversion: 2.1 time: 0.205139 Jul 19 22:34:09.597986 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 952/1928] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:09 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:09.598114 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-140736a2-b517-4aea-a92d-5d84b182d313 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lazy-loading 'services' on Instance uuid 9f2b8c66-5ac4-42bd-afe7-e283eba41078 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:34:09.614711 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9b4e6c1f-647b-4432-a1d1-29dd0553d713 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:09.615772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9b4e6c1f-647b-4432-a1d1-29dd0553d713 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] [instance: 43943c92-c6e2-456e-b295-ca4ed3e6c5f1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:09.625090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b4e6c1f-647b-4432-a1d1-29dd0553d713 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:09.626321 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b4e6c1f-647b-4432-a1d1-29dd0553d713 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:09.627844 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b4e6c1f-647b-4432-a1d1-29dd0553d713 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:09.630125 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-140736a2-b517-4aea-a92d-5d84b182d313 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1970 microversion: 2.25 time: 1.454482 Jul 19 22:34:09.632710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b4e6c1f-647b-4432-a1d1-29dd0553d713 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:09.650294 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 977/1929] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:34:08 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1970 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:34:09.654163 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-9b4e6c1f-647b-4432-a1d1-29dd0553d713 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] HTTP exception thrown: Instance 43943c92-c6e2-456e-b295-ca4ed3e6c5f1 could not be found. Jul 19 22:34:09.657547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9b4e6c1f-647b-4432-a1d1-29dd0553d713 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Request method failure captured: Jul 19 22:34:09.657547 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1 HTTP/1.1 Jul 19 22:34:09.657547 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:34:09.657547 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:34:09.657547 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:34:09.657547 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:34:09.657547 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:34:09.657547 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:34:09.657547 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:34:09.657547 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:34:09.657547 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zEvmh31A1uB_DfWDmbKYzI_ujvOK_IkOFnWgxyrRG35Vv1fA9zmXdxjO2ghTyfc2rtrz1Ua8Rcxw02Fk_Jr87sMK5CrsP_xCHtCCoC6ZUT-Q1Z0uh6kwW5At5S7iWyaU5m2LfTcvpYt2OEzmGipdG_2RmXFUa1JhPZmqSz7yb2OqJI Jul 19 22:34:09.657547 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:34:09.657547 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:34:09.657547 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:34:09.657547 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:34:09.657547 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:34:09.657547 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:34:09.657547 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a3c1b5a8abc7401b9513023803dd1f15 Jul 19 22:34:09.657547 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-InstanceActionsTestJSON-1035465709 Jul 19 22:34:09.657547 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:34:09.657547 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:34:09.659370 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a3c1b5a8abc7401b9513023803dd1f15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3c1b5a8abc7401b9513023803dd1f15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a3c1b5a8abc7401b9513023803dd1f15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3c1b5a8abc7401b9513023803dd1f15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:34:09.659370 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-InstanceActionsTestJSON-1035465709 Jul 19 22:34:09.659370 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a3c1b5a8abc7401b9513023803dd1f15 Jul 19 22:34:09.659370 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1035465709 Jul 19 22:34:09.659370 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-InstanceActionsTestJSON-1035465709-project Jul 19 22:34:09.659370 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:34:09.659370 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:34:09.659370 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 89cd4a1e9d0f4f328e7f4046ad9fa711 Jul 19 22:34:09.659370 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-InstanceActionsTestJSON-1035465709-project Jul 19 22:34:09.659370 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:34:09.659370 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 43943c92-c6e2-456e-b295-ca4ed3e6c5f1 could not be found. Jul 19 22:34:09.659370 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '43943c92-c6e2-456e-b295-ca4ed3e6c5f1'} Jul 19 22:34:09.660423 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:34:09.660423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:09.660423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:34:09.660423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:34:09.660423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:34:09.660423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:34:09.660423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:34:09.660423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:34:09.660423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:34:09.660423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:34:09.660423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43943c92-c6e2-456e-b295-ca4ed3e6c5f1 could not be found. Jul 19 22:34:09.660423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:34:09.660423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:34:09.660423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:34:09.660423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:09.660423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:34:09.660423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:34:09.660423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:34:09.660423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:34:09.660423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:34:09.662317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:34:09.662317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:34:09.662317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:34:09.662317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:34:09.662317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:34:09.662317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:34:09.662317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:34:09.662317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43943c92-c6e2-456e-b295-ca4ed3e6c5f1 could not be found. Jul 19 22:34:09.662317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:34:09.662317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:34:09.662317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:34:09.662317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:09.662317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:34:09.662317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:34:09.662317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:34:09.662317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:34:09.662317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43943c92-c6e2-456e-b295-ca4ed3e6c5f1 could not be found. Jul 19 22:34:09.662317 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:34:09.667173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-00567979-8421-4be1-9621-7d8de08edb73 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:09.667173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-00567979-8421-4be1-9621-7d8de08edb73 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:09.670276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9b4e6c1f-647b-4432-a1d1-29dd0553d713 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] Returning 404 to user: Instance 43943c92-c6e2-456e-b295-ca4ed3e6c5f1 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:34:09.671594 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9b4e6c1f-647b-4432-a1d1-29dd0553d713 tempest-InstanceActionsTestJSON-1035465709 tempest-InstanceActionsTestJSON-1035465709-project] 10.222.0.25 "GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1" status: 404 len: 111 microversion: 2.1 time: 0.071655 Jul 19 22:34:09.672965 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 953/1930] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:09 2022] GET /compute/v2.1/servers/43943c92-c6e2-456e-b295-ca4ed3e6c5f1 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:34:09.678155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-00567979-8421-4be1-9621-7d8de08edb73 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:09.678651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-00567979-8421-4be1-9621-7d8de08edb73 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:09.679484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-00567979-8421-4be1-9621-7d8de08edb73 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:09.680074 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-00567979-8421-4be1-9621-7d8de08edb73 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:09.681077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2a9c5d1f-cda6-4a32-a06d-206a93d16019 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:09.682031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2a9c5d1f-cda6-4a32-a06d-206a93d16019 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:09.691206 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2a9c5d1f-cda6-4a32-a06d-206a93d16019 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:09.691950 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2a9c5d1f-cda6-4a32-a06d-206a93d16019 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:09.693142 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2a9c5d1f-cda6-4a32-a06d-206a93d16019 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:09.693886 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2a9c5d1f-cda6-4a32-a06d-206a93d16019 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:09.718246 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:34:09.810149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:34:10.682792 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-00567979-8421-4be1-9621-7d8de08edb73 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:10.696633 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-00567979-8421-4be1-9621-7d8de08edb73 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 200 len: 1323 microversion: 2.1 time: 1.044672 Jul 19 22:34:10.701195 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 978/1931] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:09 2022] GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 1323 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:10.712578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fd2a6d92-fda0-4303-8384-7e241c5fc719 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:10.715357 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fd2a6d92-fda0-4303-8384-7e241c5fc719 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] [instance: f4b57123-4fc4-45eb-8d88-4a5eed851fb0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:10.729985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd2a6d92-fda0-4303-8384-7e241c5fc719 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:10.730691 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd2a6d92-fda0-4303-8384-7e241c5fc719 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:10.731806 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd2a6d92-fda0-4303-8384-7e241c5fc719 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:10.733274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd2a6d92-fda0-4303-8384-7e241c5fc719 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:11.197381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-2a9c5d1f-cda6-4a32-a06d-206a93d16019 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lazy-loading 'services' on Instance uuid 9f2b8c66-5ac4-42bd-afe7-e283eba41078 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:34:11.212900 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:34:11.242975 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fd2a6d92-fda0-4303-8384-7e241c5fc719 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb361b1d3c724290b20f96d89be4ccf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5702d8328442d5b5473e6bfe086537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:11.256037 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fd2a6d92-fda0-4303-8384-7e241c5fc719 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0" status: 200 len: 1312 microversion: 2.1 time: 0.552295 Jul 19 22:34:11.258125 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 979/1932] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:10 2022] GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0 => generated 1312 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:11.261409 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2a9c5d1f-cda6-4a32-a06d-206a93d16019 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1970 microversion: 2.25 time: 1.587124 Jul 19 22:34:11.262073 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 954/1933] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:34:09 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1970 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:34:11.278678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3a480ada-fb1e-443d-9e1e-03e223d9c559 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:11.283259 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3a480ada-fb1e-443d-9e1e-03e223d9c559 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:11.283442 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-18541283-99be-4f56-9f91-5b1367f98843 req-1c4b9ed3-3b27-4601-b388-0958fd7efded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43943c92-c6e2-456e-b295-ca4ed3e6c5f1", "name": "network-vif-deleted", "tag": "4b69539f-f6cc-4693-b4db-a2a0720bb8bf"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:34:11.285661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:34:11.298331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-18541283-99be-4f56-9f91-5b1367f98843 req-1c4b9ed3-3b27-4601-b388-0958fd7efded service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:11.308303 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-18541283-99be-4f56-9f91-5b1367f98843 req-1c4b9ed3-3b27-4601-b388-0958fd7efded service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:11.321774 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a480ada-fb1e-443d-9e1e-03e223d9c559 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:11.324828 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-18541283-99be-4f56-9f91-5b1367f98843 req-1c4b9ed3-3b27-4601-b388-0958fd7efded service nova] Creating event network-vif-deleted:4b69539f-f6cc-4693-b4db-a2a0720bb8bf for instance 43943c92-c6e2-456e-b295-ca4ed3e6c5f1 on n-h2-847009-3 Jul 19 22:34:11.331604 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a480ada-fb1e-443d-9e1e-03e223d9c559 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:11.333230 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-18541283-99be-4f56-9f91-5b1367f98843 req-1c4b9ed3-3b27-4601-b388-0958fd7efded service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071050 Jul 19 22:34:11.334640 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a480ada-fb1e-443d-9e1e-03e223d9c559 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:11.335039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a480ada-fb1e-443d-9e1e-03e223d9c559 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:11.336016 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 980/1934] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:34:11.345579 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-d3170cd2-65de-498a-9eae-23829e4600f6 req-2e5a7104-e492-4b81-8aa0-6514530f3194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4b57123-4fc4-45eb-8d88-4a5eed851fb0", "name": "network-vif-plugged", "status": "completed", "tag": "6cad745a-f8d4-40f4-aafb-c8e35144f99b"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:34:11.357065 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d3170cd2-65de-498a-9eae-23829e4600f6 req-2e5a7104-e492-4b81-8aa0-6514530f3194 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:11.357807 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d3170cd2-65de-498a-9eae-23829e4600f6 req-2e5a7104-e492-4b81-8aa0-6514530f3194 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:11.374374 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-d3170cd2-65de-498a-9eae-23829e4600f6 req-2e5a7104-e492-4b81-8aa0-6514530f3194 service nova] Creating event network-vif-plugged:6cad745a-f8d4-40f4-aafb-c8e35144f99b for instance f4b57123-4fc4-45eb-8d88-4a5eed851fb0 on n-h1-847009-3 Jul 19 22:34:11.387968 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-d3170cd2-65de-498a-9eae-23829e4600f6 req-2e5a7104-e492-4b81-8aa0-6514530f3194 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049321 Jul 19 22:34:11.389411 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 981/1935] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:34:11.410311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-e4f40c09-778b-4688-a6b8-d17fc55add1f req-1f0a63e1-5d1c-4542-9e1f-15df1fd24a83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44b7e41a-9a4f-469b-9561-5f798bebeb47", "tag": "bdefef3a-0ad4-4933-8e01-30907c25ee76"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:34:11.468732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e4f40c09-778b-4688-a6b8-d17fc55add1f req-1f0a63e1-5d1c-4542-9e1f-15df1fd24a83 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:11.469803 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e4f40c09-778b-4688-a6b8-d17fc55add1f req-1f0a63e1-5d1c-4542-9e1f-15df1fd24a83 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:11.496717 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-e4f40c09-778b-4688-a6b8-d17fc55add1f req-1f0a63e1-5d1c-4542-9e1f-15df1fd24a83 service nova] Creating event network-changed:bdefef3a-0ad4-4933-8e01-30907c25ee76 for instance 44b7e41a-9a4f-469b-9561-5f798bebeb47 on n-h2-847009-3 Jul 19 22:34:11.503179 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-e4f40c09-778b-4688-a6b8-d17fc55add1f req-1f0a63e1-5d1c-4542-9e1f-15df1fd24a83 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112184 Jul 19 22:34:11.504430 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 982/1936] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:34:11.511387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d6d8397f-2a0c-4863-954c-31737cf3f9e5 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:11.513704 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:34:11.513704 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:34:11.515578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d6d8397f-2a0c-4863-954c-31737cf3f9e5 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:11.516384 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d6d8397f-2a0c-4863-954c-31737cf3f9e5 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:11.517512 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d6d8397f-2a0c-4863-954c-31737cf3f9e5 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:11.518208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d6d8397f-2a0c-4863-954c-31737cf3f9e5 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:11.555911 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d6d8397f-2a0c-4863-954c-31737cf3f9e5 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.049684 Jul 19 22:34:11.556534 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 983/1937] 10.222.0.25 () {60 vars in 1216 bytes} [Tue Jul 19 22:34:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:34:11.574001 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-11185cab-d365-48d1-bb0a-e23d2e3a0266 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-847009-3", "block_migration": "auto"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:34:11.577552 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-11185cab-d365-48d1-bb0a-e23d2e3a0266 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:11.601390 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-11185cab-d365-48d1-bb0a-e23d2e3a0266 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:11.601857 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-11185cab-d365-48d1-bb0a-e23d2e3a0266 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:11.602664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-11185cab-d365-48d1-bb0a-e23d2e3a0266 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:11.603125 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-11185cab-d365-48d1-bb0a-e23d2e3a0266 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:11.684689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-11185cab-d365-48d1-bb0a-e23d2e3a0266 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lazy-loading 'flavor' on Instance uuid 9f2b8c66-5ac4-42bd-afe7-e283eba41078 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:34:11.713116 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-11185cab-d365-48d1-bb0a-e23d2e3a0266 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Going to try to live migrate instance to n-h2-847009-3 {{(pid=119337) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 22:34:11.752943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3a480ada-fb1e-443d-9e1e-03e223d9c559 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:11.766733 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3a480ada-fb1e-443d-9e1e-03e223d9c559 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1183 microversion: 2.1 time: 0.501733 Jul 19 22:34:11.778064 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 955/1938] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:11 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1183 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:11.804935 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d73c777b-c40a-4a31-84fb-19ce68334091 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:11.805573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d73c777b-c40a-4a31-84fb-19ce68334091 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:11.814282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d73c777b-c40a-4a31-84fb-19ce68334091 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:11.814737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d73c777b-c40a-4a31-84fb-19ce68334091 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:11.815577 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d73c777b-c40a-4a31-84fb-19ce68334091 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:11.816013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d73c777b-c40a-4a31-84fb-19ce68334091 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:13.119526 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d73c777b-c40a-4a31-84fb-19ce68334091 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:13.128000 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d73c777b-c40a-4a31-84fb-19ce68334091 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 200 len: 1323 microversion: 2.1 time: 1.354888 Jul 19 22:34:13.133374 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 956/1939] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:11 2022] GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 1323 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:13.142667 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5b9d7dc7-c166-4127-a918-7d464616399b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:13.146204 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5b9d7dc7-c166-4127-a918-7d464616399b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] [instance: f4b57123-4fc4-45eb-8d88-4a5eed851fb0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:13.164600 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b9d7dc7-c166-4127-a918-7d464616399b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:13.166879 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b9d7dc7-c166-4127-a918-7d464616399b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:13.169003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b9d7dc7-c166-4127-a918-7d464616399b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:13.171232 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b9d7dc7-c166-4127-a918-7d464616399b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:14.415991 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5b9d7dc7-c166-4127-a918-7d464616399b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb361b1d3c724290b20f96d89be4ccf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5702d8328442d5b5473e6bfe086537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:14.432946 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5b9d7dc7-c166-4127-a918-7d464616399b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0" status: 200 len: 1312 microversion: 2.1 time: 1.298144 Jul 19 22:34:14.447803 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 957/1940] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:13 2022] GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0 => generated 1312 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:14.465472 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aa9740d2-5b58-4f7b-88a8-1b8978dc317d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:14.466154 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-aa9740d2-5b58-4f7b-88a8-1b8978dc317d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:14.530172 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa9740d2-5b58-4f7b-88a8-1b8978dc317d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:14.530689 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa9740d2-5b58-4f7b-88a8-1b8978dc317d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:14.531549 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa9740d2-5b58-4f7b-88a8-1b8978dc317d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:14.531996 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa9740d2-5b58-4f7b-88a8-1b8978dc317d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:15.107766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-aa9740d2-5b58-4f7b-88a8-1b8978dc317d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:15.128418 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-aa9740d2-5b58-4f7b-88a8-1b8978dc317d tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1183 microversion: 2.1 time: 0.682850 Jul 19 22:34:15.135758 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 958/1941] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:14 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1183 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:15.145135 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1cf7b9a4-66c5-4f7c-b300-b547355d35bd tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:15.145758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1cf7b9a4-66c5-4f7c-b300-b547355d35bd tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:15.162931 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1cf7b9a4-66c5-4f7c-b300-b547355d35bd tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:15.163695 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1cf7b9a4-66c5-4f7c-b300-b547355d35bd tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:15.165829 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1cf7b9a4-66c5-4f7c-b300-b547355d35bd tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:15.166564 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1cf7b9a4-66c5-4f7c-b300-b547355d35bd tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:16.089551 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1cf7b9a4-66c5-4f7c-b300-b547355d35bd tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:16.165011 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1cf7b9a4-66c5-4f7c-b300-b547355d35bd tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 200 len: 1323 microversion: 2.1 time: 0.997466 Jul 19 22:34:16.182932 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 959/1942] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:15 2022] GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 1323 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:16.196887 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6cbe510f-dea2-4f1a-9d02-a229cd1da4e4 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:16.199181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6cbe510f-dea2-4f1a-9d02-a229cd1da4e4 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] [instance: f4b57123-4fc4-45eb-8d88-4a5eed851fb0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:16.217938 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6cbe510f-dea2-4f1a-9d02-a229cd1da4e4 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:16.220307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6cbe510f-dea2-4f1a-9d02-a229cd1da4e4 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:16.223853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6cbe510f-dea2-4f1a-9d02-a229cd1da4e4 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:16.225483 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6cbe510f-dea2-4f1a-9d02-a229cd1da4e4 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:16.642239 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-11185cab-d365-48d1-bb0a-e23d2e3a0266 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078/action" status: 202 len: 0 microversion: 2.25 time: 5.077981 Jul 19 22:34:16.649937 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 984/1943] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Jul 19 22:34:11 2022] POST /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078/action => generated 0 bytes in 5086 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:34:16.656201 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-01d1a733-dcf5-4b08-839d-26b2039afc99 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:16.657248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-01d1a733-dcf5-4b08-839d-26b2039afc99 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:16.680397 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01d1a733-dcf5-4b08-839d-26b2039afc99 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:16.681795 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01d1a733-dcf5-4b08-839d-26b2039afc99 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:16.683290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01d1a733-dcf5-4b08-839d-26b2039afc99 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:16.685308 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01d1a733-dcf5-4b08-839d-26b2039afc99 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:17.121349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-01d1a733-dcf5-4b08-839d-26b2039afc99 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:17.141877 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-01d1a733-dcf5-4b08-839d-26b2039afc99 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1183 microversion: 2.1 time: 0.489968 Jul 19 22:34:17.153442 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 985/1944] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:16 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1183 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:17.156065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6cbe510f-dea2-4f1a-9d02-a229cd1da4e4 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb361b1d3c724290b20f96d89be4ccf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5702d8328442d5b5473e6bfe086537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:17.160305 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-560b566e-88eb-4c98-a967-3f6e0c7489c8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:17.165652 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-560b566e-88eb-4c98-a967-3f6e0c7489c8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:17.172449 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6cbe510f-dea2-4f1a-9d02-a229cd1da4e4 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0" status: 200 len: 1461 microversion: 2.1 time: 0.986877 Jul 19 22:34:17.180264 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 960/1945] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:16 2022] GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0 => generated 1461 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:17.185117 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-560b566e-88eb-4c98-a967-3f6e0c7489c8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:17.189838 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-560b566e-88eb-4c98-a967-3f6e0c7489c8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:17.191198 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-560b566e-88eb-4c98-a967-3f6e0c7489c8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:17.193770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-560b566e-88eb-4c98-a967-3f6e0c7489c8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:17.201423 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3b063a01-5653-4014-9258-5ad95f9e3aff tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:17.204482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3b063a01-5653-4014-9258-5ad95f9e3aff tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:17.233011 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b063a01-5653-4014-9258-5ad95f9e3aff tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:17.239882 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b063a01-5653-4014-9258-5ad95f9e3aff tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:17.241138 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b063a01-5653-4014-9258-5ad95f9e3aff tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:17.241834 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b063a01-5653-4014-9258-5ad95f9e3aff tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:17.826507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3b063a01-5653-4014-9258-5ad95f9e3aff tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:17.837145 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3b063a01-5653-4014-9258-5ad95f9e3aff tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 200 len: 1323 microversion: 2.1 time: 0.655386 Jul 19 22:34:17.843259 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 961/1946] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:17 2022] GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 1323 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:17.877951 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-560b566e-88eb-4c98-a967-3f6e0c7489c8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:17.894189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-560b566e-88eb-4c98-a967-3f6e0c7489c8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:17.898202 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-560b566e-88eb-4c98-a967-3f6e0c7489c8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:17.899980 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-560b566e-88eb-4c98-a967-3f6e0c7489c8 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1487 microversion: 2.25 time: 0.744695 Jul 19 22:34:17.903587 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 986/1947] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:34:17 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1487 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:34:18.160159 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6b09eeb5-a54a-41fc-acb9-b77bbbb35c35 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:18.161689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6b09eeb5-a54a-41fc-acb9-b77bbbb35c35 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:18.173843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b09eeb5-a54a-41fc-acb9-b77bbbb35c35 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:18.179138 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b09eeb5-a54a-41fc-acb9-b77bbbb35c35 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:18.181206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b09eeb5-a54a-41fc-acb9-b77bbbb35c35 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:18.185551 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b09eeb5-a54a-41fc-acb9-b77bbbb35c35 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:18.205676 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f08b765e-21d5-459d-a8a8-0a8d9a630929 tempest-TenantUsagesTestJSON-690065980 tempest-TenantUsagesTestJSON-690065980-project-admin] Calling method '.version_select at 0x7f7a03a4a940>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:18.234134 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f08b765e-21d5-459d-a8a8-0a8d9a630929 tempest-TenantUsagesTestJSON-690065980 tempest-TenantUsagesTestJSON-690065980-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:18.234613 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f08b765e-21d5-459d-a8a8-0a8d9a630929 tempest-TenantUsagesTestJSON-690065980 tempest-TenantUsagesTestJSON-690065980-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:18.254020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b09eeb5-a54a-41fc-acb9-b77bbbb35c35 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:18.255101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b09eeb5-a54a-41fc-acb9-b77bbbb35c35 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:18.255932 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-6b09eeb5-a54a-41fc-acb9-b77bbbb35c35 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lazy-loading 'fault' on Instance uuid b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:34:18.351214 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f08b765e-21d5-459d-a8a8-0a8d9a630929 tempest-TenantUsagesTestJSON-690065980 tempest-TenantUsagesTestJSON-690065980-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:18.351800 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f08b765e-21d5-459d-a8a8-0a8d9a630929 tempest-TenantUsagesTestJSON-690065980 tempest-TenantUsagesTestJSON-690065980-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:18.432780 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f08b765e-21d5-459d-a8a8-0a8d9a630929 tempest-TenantUsagesTestJSON-690065980 tempest-TenantUsagesTestJSON-690065980-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/5f5702d8328442d5b5473e6bfe086537?start=2022-07-18T22%3A34%3A17.189335&end=2022-07-20T22%3A34%3A17.189335" status: 200 len: 693 microversion: 2.1 time: 0.588058 Jul 19 22:34:18.433381 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 962/1948] 10.222.0.25 () {58 vars in 1411 bytes} [Tue Jul 19 22:34:17 2022] GET /compute/v2.1/os-simple-tenant-usage/5f5702d8328442d5b5473e6bfe086537?start=2022-07-18T22%3A34%3A17.189335&end=2022-07-20T22%3A34%3A17.189335 => generated 693 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:34:18.448108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-220426ba-8ef4-4da3-8017-6041f24c3c70 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Calling method '.version_select at 0x7f7a03a159d0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:18.461316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6b09eeb5-a54a-41fc-acb9-b77bbbb35c35 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:18.470613 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6b09eeb5-a54a-41fc-acb9-b77bbbb35c35 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 200 len: 1188 microversion: 2.1 time: 0.314288 Jul 19 22:34:18.472429 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-220426ba-8ef4-4da3-8017-6041f24c3c70 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:18.473089 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-220426ba-8ef4-4da3-8017-6041f24c3c70 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:18.490287 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 987/1949] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:18 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 1188 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:18.493583 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-220426ba-8ef4-4da3-8017-6041f24c3c70 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:18.496251 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-220426ba-8ef4-4da3-8017-6041f24c3c70 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:18.510643 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-220426ba-8ef4-4da3-8017-6041f24c3c70 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/5f5702d8328442d5b5473e6bfe086537?start=2022-07-18T22%3A34%3A17.189335&end=2022-07-20T22%3A34%3A17.189335" status: 200 len: 693 microversion: 2.1 time: 0.066360 Jul 19 22:34:18.524373 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 963/1950] 10.222.0.25 () {58 vars in 1411 bytes} [Tue Jul 19 22:34:18 2022] GET /compute/v2.1/os-simple-tenant-usage/5f5702d8328442d5b5473e6bfe086537?start=2022-07-18T22%3A34%3A17.189335&end=2022-07-20T22%3A34%3A17.189335 => generated 693 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:34:18.539038 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b7507e52-36d2-4e05-998a-b673df416149 tempest-TenantUsagesTestJSON-690065980 tempest-TenantUsagesTestJSON-690065980-project-admin] Calling method '.version_select at 0x7f7a03d43430>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:18.609454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7507e52-36d2-4e05-998a-b673df416149 tempest-TenantUsagesTestJSON-690065980 tempest-TenantUsagesTestJSON-690065980-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:18.609910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7507e52-36d2-4e05-998a-b673df416149 tempest-TenantUsagesTestJSON-690065980 tempest-TenantUsagesTestJSON-690065980-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:18.701012 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7507e52-36d2-4e05-998a-b673df416149 tempest-TenantUsagesTestJSON-690065980 tempest-TenantUsagesTestJSON-690065980-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:18.703897 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7507e52-36d2-4e05-998a-b673df416149 tempest-TenantUsagesTestJSON-690065980 tempest-TenantUsagesTestJSON-690065980-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:18.706087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7f115422-4f53-42d9-957e-61f56820a4f8 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Action: 'create', calling method: .version_select at 0x7f7a1556e9d0>, body: {"keypair": {"name": "tempest-keypair-463013240", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvtDcg6MG3tmsQFb8gljovUMnczOfATGrs4MtAzEoE/dccy63IIG4tbSFUV+pQMl+eLI8y1IkJJAz4uvng62WE6gsrHnTeXV5Gylk+L5IGZtZUjBvtwgFF1In1jn0VkUw=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:34:18.746408 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-7f115422-4f53-42d9-957e-61f56820a4f8 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Getting quotas for project 3173e6bfa06f4118842ec55c92b253de. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:34:18.763274 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-7f115422-4f53-42d9-957e-61f56820a4f8 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Getting quotas for user 5a52bb4626ba4c00abdcbc0bed7811b0 and project 3173e6bfa06f4118842ec55c92b253de. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:34:18.825567 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7f115422-4f53-42d9-957e-61f56820a4f8 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.274268 Jul 19 22:34:18.831907 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 964/1951] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:34:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:34:18.860196 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-27e9deb0-dd4e-4439-a771-32f35d61b9bd tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:18.861089 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-27e9deb0-dd4e-4439-a771-32f35d61b9bd tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:18.883678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-27e9deb0-dd4e-4439-a771-32f35d61b9bd tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:18.884138 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-27e9deb0-dd4e-4439-a771-32f35d61b9bd tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:18.884938 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-27e9deb0-dd4e-4439-a771-32f35d61b9bd tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:18.885378 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-27e9deb0-dd4e-4439-a771-32f35d61b9bd tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:19.028580 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b7507e52-36d2-4e05-998a-b673df416149 tempest-TenantUsagesTestJSON-690065980 tempest-TenantUsagesTestJSON-690065980-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-18T22%3A34%3A17.189335&end=2022-07-20T22%3A34%3A17.189335&detailed=1" status: 200 len: 22205 microversion: 2.1 time: 0.491482 Jul 19 22:34:19.041940 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 988/1952] 10.222.0.25 () {58 vars in 1334 bytes} [Tue Jul 19 22:34:18 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-18T22%3A34%3A17.189335&end=2022-07-20T22%3A34%3A17.189335&detailed=1 => generated 22205 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:34:19.064028 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-88fe81f0-dbc5-4f47-b77b-b23bdca3448a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:19.073215 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-88fe81f0-dbc5-4f47-b77b-b23bdca3448a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:19.104590 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88fe81f0-dbc5-4f47-b77b-b23bdca3448a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:19.105052 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88fe81f0-dbc5-4f47-b77b-b23bdca3448a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:19.105869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88fe81f0-dbc5-4f47-b77b-b23bdca3448a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:19.106314 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88fe81f0-dbc5-4f47-b77b-b23bdca3448a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:20.276847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-27e9deb0-dd4e-4439-a771-32f35d61b9bd tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:20.288618 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-27e9deb0-dd4e-4439-a771-32f35d61b9bd tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 200 len: 1323 microversion: 2.1 time: 1.432550 Jul 19 22:34:20.301348 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 965/1953] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:18 2022] GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 1323 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:34:20.306359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-78c5958b-6f45-4268-8c80-237c56395385 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:20.314294 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-78c5958b-6f45-4268-8c80-237c56395385 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] [instance: f4b57123-4fc4-45eb-8d88-4a5eed851fb0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:20.328999 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78c5958b-6f45-4268-8c80-237c56395385 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:20.329451 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78c5958b-6f45-4268-8c80-237c56395385 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:20.330436 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78c5958b-6f45-4268-8c80-237c56395385 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:20.331043 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78c5958b-6f45-4268-8c80-237c56395385 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:20.388549 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-78c5958b-6f45-4268-8c80-237c56395385 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] [instance: f4b57123-4fc4-45eb-8d88-4a5eed851fb0] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:34:20.527774 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-78c5958b-6f45-4268-8c80-237c56395385 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0" status: 204 len: 0 microversion: 2.1 time: 0.225025 Jul 19 22:34:20.531862 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 966/1954] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:34:20 2022] DELETE /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:34:20.538914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-86fd5ab8-0af9-4729-a75c-9c235b14becb req-a12e557d-a6af-4e04-9691-d33917f02759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b7e41a-9a4f-469b-9561-5f798bebeb47", "name": "network-vif-plugged", "status": "completed", "tag": "bdefef3a-0ad4-4933-8e01-30907c25ee76"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:34:20.555611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-88fe81f0-dbc5-4f47-b77b-b23bdca3448a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:20.566650 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-86fd5ab8-0af9-4729-a75c-9c235b14becb req-a12e557d-a6af-4e04-9691-d33917f02759 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:20.567444 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-86fd5ab8-0af9-4729-a75c-9c235b14becb req-a12e557d-a6af-4e04-9691-d33917f02759 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:20.578127 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-88fe81f0-dbc5-4f47-b77b-b23bdca3448a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:20.579883 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-88fe81f0-dbc5-4f47-b77b-b23bdca3448a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:20.581121 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-88fe81f0-dbc5-4f47-b77b-b23bdca3448a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1487 microversion: 2.25 time: 1.522310 Jul 19 22:34:20.592414 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 989/1955] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:34:19 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1487 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:34:20.595299 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-86fd5ab8-0af9-4729-a75c-9c235b14becb req-a12e557d-a6af-4e04-9691-d33917f02759 service nova] Creating event network-vif-plugged:bdefef3a-0ad4-4933-8e01-30907c25ee76 for instance 44b7e41a-9a4f-469b-9561-5f798bebeb47 on n-h2-847009-3 Jul 19 22:34:20.597305 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3f7532ee-64ce-4361-b338-a7bba0637adf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:20.601625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3f7532ee-64ce-4361-b338-a7bba0637adf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:20.614444 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f7532ee-64ce-4361-b338-a7bba0637adf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:20.615236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f7532ee-64ce-4361-b338-a7bba0637adf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:20.616196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f7532ee-64ce-4361-b338-a7bba0637adf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:20.616804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f7532ee-64ce-4361-b338-a7bba0637adf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:20.624973 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-86fd5ab8-0af9-4729-a75c-9c235b14becb req-a12e557d-a6af-4e04-9691-d33917f02759 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091540 Jul 19 22:34:20.632665 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 967/1956] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:34:20.638131 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7b1fee35-fe6b-4b28-aabf-eb20b9b3fa4d tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:20.638841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7b1fee35-fe6b-4b28-aabf-eb20b9b3fa4d tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] [instance: f4b57123-4fc4-45eb-8d88-4a5eed851fb0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:20.639863 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-3f7532ee-64ce-4361-b338-a7bba0637adf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] HTTP exception thrown: Instance b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 could not be found. Jul 19 22:34:20.641959 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3f7532ee-64ce-4361-b338-a7bba0637adf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Request method failure captured: Jul 19 22:34:20.641959 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 HTTP/1.1 Jul 19 22:34:20.641959 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:34:20.641959 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:34:20.641959 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:34:20.641959 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:34:20.641959 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:34:20.641959 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:34:20.641959 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:34:20.641959 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:34:20.641959 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y9tGEg_0UM-7e0R_jLZscl6npd6EBaoASmTirv5jPYL9hGXCfnXWRTk1mNbU38hxkmKLGBF_JsMgnSxj3iicL-lkJn2EDnv_FsqbzFmmoHtrZKC8Hc58JLWQbASWlyM45z3q-kz-L0ioJwenPhwXIpyJ2_LBJo2kw0RVOmMp1OTHDI Jul 19 22:34:20.641959 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:34:20.641959 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:34:20.641959 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:34:20.641959 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:34:20.641959 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:34:20.641959 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:34:20.641959 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 2619b807c1ee4dca858dae47c4686ba2 Jul 19 22:34:20.641959 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-LiveMigrationTest-203877293 Jul 19 22:34:20.641959 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:34:20.641959 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:34:20.644175 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2619b807c1ee4dca858dae47c4686ba2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2619b807c1ee4dca858dae47c4686ba2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2619b807c1ee4dca858dae47c4686ba2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2619b807c1ee4dca858dae47c4686ba2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:34:20.644175 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-LiveMigrationTest-203877293 Jul 19 22:34:20.644175 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 2619b807c1ee4dca858dae47c4686ba2 Jul 19 22:34:20.644175 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-LiveMigrationTest-203877293 Jul 19 22:34:20.644175 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-LiveMigrationTest-203877293-project Jul 19 22:34:20.644175 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:34:20.644175 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:34:20.644175 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 55a214cbc1ec4cdb80ccf736f4251964 Jul 19 22:34:20.644175 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-LiveMigrationTest-203877293-project Jul 19 22:34:20.644175 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:34:20.644175 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 could not be found. Jul 19 22:34:20.644175 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7'} Jul 19 22:34:20.645631 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:34:20.645631 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:20.645631 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:34:20.645631 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:34:20.645631 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:34:20.645631 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:34:20.645631 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:34:20.645631 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:34:20.645631 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:34:20.645631 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:34:20.645631 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 could not be found. Jul 19 22:34:20.645631 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:20.645631 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:34:20.645631 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:20.645631 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:20.645631 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:34:20.645631 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:34:20.645631 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:34:20.645631 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:34:20.645631 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:34:20.647070 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:34:20.647070 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:34:20.647070 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:34:20.647070 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:34:20.647070 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:34:20.647070 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:34:20.647070 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:34:20.647070 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 could not be found. Jul 19 22:34:20.647070 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:20.647070 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:34:20.647070 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:20.647070 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:20.647070 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:34:20.647070 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:34:20.647070 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:34:20.647070 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:34:20.647070 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 could not be found. Jul 19 22:34:20.647070 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:20.651773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3f7532ee-64ce-4361-b338-a7bba0637adf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Returning 404 to user: Instance b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:34:20.653209 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3f7532ee-64ce-4361-b338-a7bba0637adf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7" status: 404 len: 111 microversion: 2.1 time: 0.059783 Jul 19 22:34:20.654394 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 990/1957] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:20 2022] GET /compute/v2.1/servers/b8d89c5e-7e87-4440-8a6c-ecb7cdd0b2f7 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:34:20.682196 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b1fee35-fe6b-4b28-aabf-eb20b9b3fa4d tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:20.682725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b1fee35-fe6b-4b28-aabf-eb20b9b3fa4d tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:20.688819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b1fee35-fe6b-4b28-aabf-eb20b9b3fa4d tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:20.689279 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b1fee35-fe6b-4b28-aabf-eb20b9b3fa4d tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:21.307920 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5edf006f-0174-4688-bee4-1c97d721bb53 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:21.309480 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5edf006f-0174-4688-bee4-1c97d721bb53 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:21.337931 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5edf006f-0174-4688-bee4-1c97d721bb53 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:21.339740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5edf006f-0174-4688-bee4-1c97d721bb53 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:21.341539 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5edf006f-0174-4688-bee4-1c97d721bb53 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:21.342242 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5edf006f-0174-4688-bee4-1c97d721bb53 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:21.656279 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7b1fee35-fe6b-4b28-aabf-eb20b9b3fa4d tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb361b1d3c724290b20f96d89be4ccf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5702d8328442d5b5473e6bfe086537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:21.675487 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7b1fee35-fe6b-4b28-aabf-eb20b9b3fa4d tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0" status: 200 len: 1467 microversion: 2.1 time: 1.040607 Jul 19 22:34:21.682230 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 968/1958] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:20 2022] GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0 => generated 1467 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:21.692519 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-897a46d5-cbd8-4607-b2d2-88afee64f9a6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:21.693400 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-897a46d5-cbd8-4607-b2d2-88afee64f9a6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:21.713326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-897a46d5-cbd8-4607-b2d2-88afee64f9a6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:21.714113 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-897a46d5-cbd8-4607-b2d2-88afee64f9a6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:21.716437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-897a46d5-cbd8-4607-b2d2-88afee64f9a6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:21.718438 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-897a46d5-cbd8-4607-b2d2-88afee64f9a6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:22.023359 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5edf006f-0174-4688-bee4-1c97d721bb53 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:22.044600 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5edf006f-0174-4688-bee4-1c97d721bb53 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 200 len: 1323 microversion: 2.1 time: 0.740467 Jul 19 22:34:22.051358 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 991/1959] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:21 2022] GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 1323 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:34:22.703346 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-aff7492b-c2c5-4e8a-9db6-9b67ad52de27 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:22.704542 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-aff7492b-c2c5-4e8a-9db6-9b67ad52de27 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] [instance: f4b57123-4fc4-45eb-8d88-4a5eed851fb0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:22.732871 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aff7492b-c2c5-4e8a-9db6-9b67ad52de27 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:22.733836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aff7492b-c2c5-4e8a-9db6-9b67ad52de27 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:22.736130 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aff7492b-c2c5-4e8a-9db6-9b67ad52de27 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:22.737718 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aff7492b-c2c5-4e8a-9db6-9b67ad52de27 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:22.751459 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:34:23.203216 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-897a46d5-cbd8-4607-b2d2-88afee64f9a6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:23.211719 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-897a46d5-cbd8-4607-b2d2-88afee64f9a6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:23.225222 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-897a46d5-cbd8-4607-b2d2-88afee64f9a6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:23.226467 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-897a46d5-cbd8-4607-b2d2-88afee64f9a6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1487 microversion: 2.25 time: 1.543154 Jul 19 22:34:23.227378 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 969/1960] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:34:21 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1487 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:34:23.232407 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ca30da04-b767-40c9-9a82-3a4a98444408 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:23.244991 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ca30da04-b767-40c9-9a82-3a4a98444408 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:23.266619 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca30da04-b767-40c9-9a82-3a4a98444408 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:23.267382 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca30da04-b767-40c9-9a82-3a4a98444408 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:23.268351 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca30da04-b767-40c9-9a82-3a4a98444408 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:23.268958 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca30da04-b767-40c9-9a82-3a4a98444408 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:23.389511 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-aff7492b-c2c5-4e8a-9db6-9b67ad52de27 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb361b1d3c724290b20f96d89be4ccf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5702d8328442d5b5473e6bfe086537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:23.416958 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-aff7492b-c2c5-4e8a-9db6-9b67ad52de27 tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0" status: 200 len: 1467 microversion: 2.1 time: 0.716317 Jul 19 22:34:23.421828 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 992/1961] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:22 2022] GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0 => generated 1467 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:34:23.435502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e97d1f86-2ebe-408b-81d1-6687a2391c08 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2080007311", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "ca774d83-3ed5-407e-8b85-7fdd0269ea1e"}], "security_groups": [{"name": "tempest-securitygroup--1158289501"}], "key_name": "tempest-keypair-463013240", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:34:23.464382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:34:23.853117 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ca30da04-b767-40c9-9a82-3a4a98444408 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:23.872105 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ca30da04-b767-40c9-9a82-3a4a98444408 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 200 len: 1521 microversion: 2.1 time: 0.635017 Jul 19 22:34:23.874090 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 970/1962] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:23 2022] GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 1521 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:23.896110 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-e97d1f86-2ebe-408b-81d1-6687a2391c08 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] validate_networks() for [('ca774d83-3ed5-407e-8b85-7fdd0269ea1e', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:34:23.908233 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bbb83786-5f48-40ad-b746-0612d9a5f8b2 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:23.909038 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bbb83786-5f48-40ad-b746-0612d9a5f8b2 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:23.925137 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bbb83786-5f48-40ad-b746-0612d9a5f8b2 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:23.926766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bbb83786-5f48-40ad-b746-0612d9a5f8b2 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:23.928272 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bbb83786-5f48-40ad-b746-0612d9a5f8b2 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:23.928899 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bbb83786-5f48-40ad-b746-0612d9a5f8b2 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:25.145154 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bbb83786-5f48-40ad-b746-0612d9a5f8b2 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:25.158746 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bbb83786-5f48-40ad-b746-0612d9a5f8b2 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 200 len: 1521 microversion: 2.1 time: 1.270335 Jul 19 22:34:25.172409 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 971/1963] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:23 2022] GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 1521 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:25.195249 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ff2eb3f1-4c12-4cfd-830b-872d5deea09f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:25.195878 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ff2eb3f1-4c12-4cfd-830b-872d5deea09f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:25.221944 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ff2eb3f1-4c12-4cfd-830b-872d5deea09f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:25.222402 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ff2eb3f1-4c12-4cfd-830b-872d5deea09f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:25.235131 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ff2eb3f1-4c12-4cfd-830b-872d5deea09f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:25.240761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ff2eb3f1-4c12-4cfd-830b-872d5deea09f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:26.325691 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ff2eb3f1-4c12-4cfd-830b-872d5deea09f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:26.347834 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:34:26.355743 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ff2eb3f1-4c12-4cfd-830b-872d5deea09f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:26.392728 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ff2eb3f1-4c12-4cfd-830b-872d5deea09f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:26.400558 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ff2eb3f1-4c12-4cfd-830b-872d5deea09f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1487 microversion: 2.25 time: 1.235573 Jul 19 22:34:26.405668 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 972/1964] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:34:25 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1487 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:34:26.471418 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9074a6ae-a169-4b91-9fb3-2bf37cadba9b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:26.472419 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9074a6ae-a169-4b91-9fb3-2bf37cadba9b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] [instance: f4b57123-4fc4-45eb-8d88-4a5eed851fb0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:26.492102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-e97d1f86-2ebe-408b-81d1-6687a2391c08 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Getting quotas for project 3173e6bfa06f4118842ec55c92b253de. Resources: dict_keys(['metadata_items']) {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:34:26.509279 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9074a6ae-a169-4b91-9fb3-2bf37cadba9b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:26.511457 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9074a6ae-a169-4b91-9fb3-2bf37cadba9b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:26.514607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9074a6ae-a169-4b91-9fb3-2bf37cadba9b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:26.517825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9074a6ae-a169-4b91-9fb3-2bf37cadba9b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:26.533017 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-e97d1f86-2ebe-408b-81d1-6687a2391c08 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Getting quotas for user 5a52bb4626ba4c00abdcbc0bed7811b0 and project 3173e6bfa06f4118842ec55c92b253de. Resources: dict_keys(['metadata_items']) {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:34:26.608443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-e97d1f86-2ebe-408b-81d1-6687a2391c08 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:34:26.609271 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-e97d1f86-2ebe-408b-81d1-6687a2391c08 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:34:26.609946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-e97d1f86-2ebe-408b-81d1-6687a2391c08 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:34:26.611905 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-e97d1f86-2ebe-408b-81d1-6687a2391c08 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:34:26.617594 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-e97d1f86-2ebe-408b-81d1-6687a2391c08 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:34:26.627791 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9074a6ae-a169-4b91-9fb3-2bf37cadba9b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:26.633010 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9074a6ae-a169-4b91-9fb3-2bf37cadba9b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:26.635272 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-9074a6ae-a169-4b91-9fb3-2bf37cadba9b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lazy-loading 'fault' on Instance uuid f4b57123-4fc4-45eb-8d88-4a5eed851fb0 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:34:26.656407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e97d1f86-2ebe-408b-81d1-6687a2391c08 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:26.656860 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e97d1f86-2ebe-408b-81d1-6687a2391c08 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:26.665110 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e97d1f86-2ebe-408b-81d1-6687a2391c08 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:26.665705 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e97d1f86-2ebe-408b-81d1-6687a2391c08 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:26.726765 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-e97d1f86-2ebe-408b-81d1-6687a2391c08 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Getting quotas for project 3173e6bfa06f4118842ec55c92b253de. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:34:26.745697 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-e97d1f86-2ebe-408b-81d1-6687a2391c08 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Getting quotas for user 5a52bb4626ba4c00abdcbc0bed7811b0 and project 3173e6bfa06f4118842ec55c92b253de. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:34:26.820501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e97d1f86-2ebe-408b-81d1-6687a2391c08 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:34:26.831540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e97d1f86-2ebe-408b-81d1-6687a2391c08 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] [instance: b33a2a96-d4d2-4835-824d-739d006bf056] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:34:26.934317 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9074a6ae-a169-4b91-9fb3-2bf37cadba9b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb361b1d3c724290b20f96d89be4ccf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5702d8328442d5b5473e6bfe086537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:26.960548 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9074a6ae-a169-4b91-9fb3-2bf37cadba9b tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0" status: 200 len: 1302 microversion: 2.1 time: 0.553447 Jul 19 22:34:26.963869 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 973/1965] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:26 2022] GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0 => generated 1302 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:26.991507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-944e479b-cedf-4953-964b-14d16cc108d7 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1963857413", "metadata": {"": ""}}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:34:27.001768 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-944e479b-cedf-4953-964b-14d16cc108d7 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Request method failure captured: Jul 19 22:34:27.001768 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47/action HTTP/1.1 Jul 19 22:34:27.001768 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:34:27.001768 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:34:27.001768 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:34:27.001768 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 107 Jul 19 22:34:27.001768 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:34:27.001768 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:34:27.001768 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:34:27.001768 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:34:27.001768 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zFSA7GyoHNV6r8lt0QaILXtfyjU87DAOplAZjQU_9SUIJAdMw3TfBxiMnSQsWy218lpl-le3iOg2K6ZI4fs9ORwE8JiU3d4qrQtSVE6mLVRBodkQTjds8wHcIk6jUHzr1JjH374IFd8C1hu4WJXkMpF_7JvVJQyRRP5WIIvershcNo Jul 19 22:34:27.001768 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:34:27.001768 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:34:27.001768 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:34:27.001768 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:34:27.001768 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:34:27.001768 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:34:27.001768 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:34:27.001768 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:34:27.001768 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:34:27.001768 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:34:27.004974 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:34:27.004974 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:34:27.004974 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:34:27.004974 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:34:27.004974 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:34:27.004974 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:34:27.004974 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:34:27.004974 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: ecca13a073e7447591944e6604d67e4c Jul 19 22:34:27.004974 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:34:27.004974 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:34:27.004974 n-d-847009-3 devstack@n-api.service[119338]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1963857413", "metadata": {"": ""}}} Jul 19 22:34:27.004974 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:34:27.006141 n-d-847009-3 devstack@n-api.service[119338]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:34:27.006141 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '44b7e41a-9a4f-469b-9561-5f798bebeb47', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1963857413', 'metadata': {'': ''}}}} Jul 19 22:34:27.006141 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:34:27.006141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:27.006141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:34:27.006141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:34:27.006141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:34:27.006141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:34:27.006141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:34:27.006141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:34:27.006141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 19 22:34:27.006141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 19 22:34:27.006141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 19 22:34:27.006141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 19 22:34:27.006141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 19 22:34:27.006141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:34:27.006141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 19 22:34:27.006141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi {'': ''} Jul 19 22:34:27.006141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:34:27.006141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:34:27.006141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:34:27.008028 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:27.008028 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:34:27.008028 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:34:27.008028 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:34:27.008028 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:34:27.008028 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:34:27.008028 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:34:27.008028 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:34:27.008028 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:34:27.008028 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:34:27.008028 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:34:27.008028 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:34:27.008028 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:34:27.008028 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:34:27.008028 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:34:27.008028 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:34:27.008028 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:34:27.008028 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:34:27.008028 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:34:27.008028 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:27.011229 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:34:27.011229 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:34:27.011229 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:34:27.011229 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:34:27.011229 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:34:27.011229 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:34:27.016759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-944e479b-cedf-4953-964b-14d16cc108d7 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:34:27.023287 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-944e479b-cedf-4953-964b-14d16cc108d7 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "POST /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47/action" status: 400 len: 170 microversion: 2.1 time: 0.052536 Jul 19 22:34:27.031329 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 974/1966] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Jul 19 22:34:26 2022] POST /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47/action => generated 170 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:34:27.052275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-5e1c404b-dc09-4411-88ef-947f498641c8 req-d2d656c0-9d79-4379-bb6e-3380170636b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4b57123-4fc4-45eb-8d88-4a5eed851fb0", "name": "network-vif-deleted", "tag": "6cad745a-f8d4-40f4-aafb-c8e35144f99b"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:34:27.096266 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e97d1f86-2ebe-408b-81d1-6687a2391c08 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.671907 Jul 19 22:34:27.097054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5e1c404b-dc09-4411-88ef-947f498641c8 req-d2d656c0-9d79-4379-bb6e-3380170636b6 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:27.098710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5e1c404b-dc09-4411-88ef-947f498641c8 req-d2d656c0-9d79-4379-bb6e-3380170636b6 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:27.100203 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 993/1967] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:34:23 2022] POST /compute/v2.1/servers => generated 407 bytes in 3678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:34:27.120912 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2e381d08-ce70-485e-942f-46456e6a80c3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:27.127695 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2e381d08-ce70-485e-942f-46456e6a80c3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:27.159869 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-5e1c404b-dc09-4411-88ef-947f498641c8 req-d2d656c0-9d79-4379-bb6e-3380170636b6 service nova] Creating event network-vif-deleted:6cad745a-f8d4-40f4-aafb-c8e35144f99b for instance f4b57123-4fc4-45eb-8d88-4a5eed851fb0 on n-h1-847009-3 Jul 19 22:34:27.162721 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e381d08-ce70-485e-942f-46456e6a80c3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:27.171339 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e381d08-ce70-485e-942f-46456e6a80c3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:27.179601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e381d08-ce70-485e-942f-46456e6a80c3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:27.181216 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e381d08-ce70-485e-942f-46456e6a80c3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:27.186646 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-5e1c404b-dc09-4411-88ef-947f498641c8 req-d2d656c0-9d79-4379-bb6e-3380170636b6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145113 Jul 19 22:34:27.188559 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 975/1968] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:34:27.213636 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c1304195-6f08-422d-af36-42e12405f511 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:27.216336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c1304195-6f08-422d-af36-42e12405f511 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] [instance: b33a2a96-d4d2-4835-824d-739d006bf056] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:27.666283 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c1304195-6f08-422d-af36-42e12405f511 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52bb4626ba4c00abdcbc0bed7811b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3173e6bfa06f4118842ec55c92b253de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:27.702922 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c1304195-6f08-422d-af36-42e12405f511 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] 10.222.0.25 "GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056" status: 200 len: 1269 microversion: 2.1 time: 0.496149 Jul 19 22:34:27.703614 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 976/1969] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:27 2022] GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056 => generated 1269 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:27.726356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0889e8ef-0dbd-4c09-961b-320377ce40ca tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:27.727075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0889e8ef-0dbd-4c09-961b-320377ce40ca tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:27.738468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0889e8ef-0dbd-4c09-961b-320377ce40ca tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:27.739820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0889e8ef-0dbd-4c09-961b-320377ce40ca tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:27.741114 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0889e8ef-0dbd-4c09-961b-320377ce40ca tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:27.741737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0889e8ef-0dbd-4c09-961b-320377ce40ca tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:27.993450 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2e381d08-ce70-485e-942f-46456e6a80c3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:28.014502 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2e381d08-ce70-485e-942f-46456e6a80c3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 200 len: 1521 microversion: 2.1 time: 0.912986 Jul 19 22:34:28.014973 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 994/1970] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:27 2022] GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 1521 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:28.032003 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1a4875d2-75f4-4f9d-a6d9-43dd3cbed4de tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:28.032827 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1a4875d2-75f4-4f9d-a6d9-43dd3cbed4de tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] [instance: f4b57123-4fc4-45eb-8d88-4a5eed851fb0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:28.058292 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a4875d2-75f4-4f9d-a6d9-43dd3cbed4de tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:28.058745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a4875d2-75f4-4f9d-a6d9-43dd3cbed4de tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:28.059690 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a4875d2-75f4-4f9d-a6d9-43dd3cbed4de tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:28.060138 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a4875d2-75f4-4f9d-a6d9-43dd3cbed4de tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:28.113500 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-1a4875d2-75f4-4f9d-a6d9-43dd3cbed4de tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] HTTP exception thrown: Instance f4b57123-4fc4-45eb-8d88-4a5eed851fb0 could not be found. Jul 19 22:34:28.117515 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1a4875d2-75f4-4f9d-a6d9-43dd3cbed4de tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Request method failure captured: Jul 19 22:34:28.117515 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0 HTTP/1.1 Jul 19 22:34:28.117515 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:34:28.117515 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:34:28.117515 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:34:28.117515 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:34:28.117515 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:34:28.117515 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:34:28.117515 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:34:28.117515 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:34:28.117515 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zFDqteM6SEYWpMmj3IGZqLr8CeKi3--Lra7aKF1scU8oGfZOWCNIuNItg41qs_9yqrb_9yc30ET7HCQdh9tiG3ISn2YUn58fYHXoFv-ZpbeWzG9JCc0ZcMRpSlNoCfsOts_9uCo0u1FRcmfesjLnDOkFOQaKx6j5uC7HxAnDR8PwPY Jul 19 22:34:28.117515 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:34:28.117515 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:34:28.117515 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:34:28.117515 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:34:28.117515 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:34:28.117515 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:34:28.117515 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 5f5702d8328442d5b5473e6bfe086537 Jul 19 22:34:28.117515 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-TenantUsagesTestJSON-1948413337 Jul 19 22:34:28.117515 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:34:28.117515 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:34:28.119083 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5f5702d8328442d5b5473e6bfe086537"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f5702d8328442d5b5473e6bfe086537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5f5702d8328442d5b5473e6bfe086537"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f5702d8328442d5b5473e6bfe086537"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:34:28.119083 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-TenantUsagesTestJSON-1948413337 Jul 19 22:34:28.119083 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 5f5702d8328442d5b5473e6bfe086537 Jul 19 22:34:28.119083 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1948413337 Jul 19 22:34:28.119083 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-TenantUsagesTestJSON-1948413337-project Jul 19 22:34:28.119083 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:34:28.119083 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:34:28.119083 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: cb361b1d3c724290b20f96d89be4ccf1 Jul 19 22:34:28.119083 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-TenantUsagesTestJSON-1948413337-project Jul 19 22:34:28.119083 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:34:28.119083 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance f4b57123-4fc4-45eb-8d88-4a5eed851fb0 could not be found. Jul 19 22:34:28.119083 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'f4b57123-4fc4-45eb-8d88-4a5eed851fb0'} Jul 19 22:34:28.120026 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:34:28.120026 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:28.120026 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:34:28.120026 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:34:28.120026 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:34:28.120026 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:34:28.120026 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:34:28.120026 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:34:28.120026 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:34:28.120026 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:34:28.120026 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4b57123-4fc4-45eb-8d88-4a5eed851fb0 could not be found. Jul 19 22:34:28.120026 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:28.120026 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:34:28.120026 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:28.120026 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:28.120026 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:34:28.120026 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:34:28.120026 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:34:28.120026 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:34:28.120026 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:34:28.121433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:34:28.121433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:34:28.121433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:34:28.121433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:34:28.121433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:34:28.121433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:34:28.121433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:34:28.121433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4b57123-4fc4-45eb-8d88-4a5eed851fb0 could not be found. Jul 19 22:34:28.121433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:28.121433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:34:28.121433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:28.121433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:28.121433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:34:28.121433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:34:28.121433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:34:28.121433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:34:28.121433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4b57123-4fc4-45eb-8d88-4a5eed851fb0 could not be found. Jul 19 22:34:28.121433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:28.122706 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1a4875d2-75f4-4f9d-a6d9-43dd3cbed4de tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] Returning 404 to user: Instance f4b57123-4fc4-45eb-8d88-4a5eed851fb0 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:34:28.122706 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1a4875d2-75f4-4f9d-a6d9-43dd3cbed4de tempest-TenantUsagesTestJSON-1948413337 tempest-TenantUsagesTestJSON-1948413337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0" status: 404 len: 111 microversion: 2.1 time: 0.094514 Jul 19 22:34:28.122706 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 995/1971] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:28 2022] GET /compute/v2.1/servers/f4b57123-4fc4-45eb-8d88-4a5eed851fb0 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:34:28.139455 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-01613a97-fc86-4e7c-b052-8438bfa152df tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:28.140152 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-01613a97-fc86-4e7c-b052-8438bfa152df tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:28.181999 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01613a97-fc86-4e7c-b052-8438bfa152df tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:28.185926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01613a97-fc86-4e7c-b052-8438bfa152df tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:28.190597 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01613a97-fc86-4e7c-b052-8438bfa152df tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:28.192214 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01613a97-fc86-4e7c-b052-8438bfa152df tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:28.493306 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:34:28.660884 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-01613a97-fc86-4e7c-b052-8438bfa152df tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:28.680788 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-01613a97-fc86-4e7c-b052-8438bfa152df tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 200 len: 1521 microversion: 2.1 time: 0.558149 Jul 19 22:34:28.688128 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 996/1972] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:28 2022] GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 1521 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:28.739292 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5a758f00-2f45-4b7e-8b5d-dadb0459f974 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1484628104", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:34:28.745558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5a758f00-2f45-4b7e-8b5d-dadb0459f974 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Request method failure captured: Jul 19 22:34:28.745558 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47/action HTTP/1.1 Jul 19 22:34:28.745558 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:34:28.745558 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:34:28.745558 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:34:28.745558 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 619 Jul 19 22:34:28.745558 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:34:28.745558 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:34:28.745558 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:34:28.745558 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:34:28.745558 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zFSA7GyoHNV6r8lt0QaILXtfyjU87DAOplAZjQU_9SUIJAdMw3TfBxiMnSQsWy218lpl-le3iOg2K6ZI4fs9ORwE8JiU3d4qrQtSVE6mLVRBodkQTjds8wHcIk6jUHzr1JjH374IFd8C1hu4WJXkMpF_7JvVJQyRRP5WIIvershcNo Jul 19 22:34:28.745558 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:34:28.745558 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:34:28.745558 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:34:28.745558 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:34:28.745558 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:34:28.745558 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:34:28.745558 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:34:28.745558 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:34:28.745558 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:34:28.745558 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:34:28.747434 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:34:28.747434 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:34:28.747434 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:34:28.747434 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:34:28.747434 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:34:28.747434 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:34:28.747434 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:34:28.747434 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: ecca13a073e7447591944e6604d67e4c Jul 19 22:34:28.747434 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:34:28.747434 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:34:28.748274 n-d-847009-3 devstack@n-api.service[119337]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1484628104", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 19 22:34:28.748274 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:34:28.748274 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:34:28.748599 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '44b7e41a-9a4f-469b-9561-5f798bebeb47', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1484628104', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 19 22:34:28.748599 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:34:28.748599 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:28.748599 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:34:28.748599 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:34:28.748599 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:34:28.748599 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:34:28.748599 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:34:28.748599 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:28.748599 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 19 22:34:28.748599 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 19 22:34:28.749541 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 19 22:34:28.749541 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 19 22:34:28.749541 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 19 22:34:28.749541 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:28.749541 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 19 22:34:28.749541 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 19 22:34:28.749541 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:28.749541 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:34:28.749541 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:28.749541 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:28.749541 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:34:28.749541 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:34:28.749541 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:34:28.749541 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:34:28.749541 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:34:28.749541 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:34:28.749541 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:34:28.750768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:34:28.750768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:34:28.750768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:34:28.750768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:34:28.750768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:34:28.750768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:34:28.750768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:34:28.750768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:34:28.750768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:28.750768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:34:28.750768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:28.750768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:28.751751 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:34:28.751751 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:34:28.751751 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:34:28.751751 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:34:28.751751 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:34:28.751751 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:28.753258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5a758f00-2f45-4b7e-8b5d-dadb0459f974 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:34:28.756724 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5a758f00-2f45-4b7e-8b5d-dadb0459f974 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "POST /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47/action" status: 400 len: 938 microversion: 2.1 time: 0.050600 Jul 19 22:34:28.760644 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 997/1973] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Jul 19 22:34:28 2022] POST /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47/action => generated 938 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:34:28.799941 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c413a7ba-6212-4e51-abb6-dd02143eb203 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:28.802905 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c413a7ba-6212-4e51-abb6-dd02143eb203 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] [instance: b33a2a96-d4d2-4835-824d-739d006bf056] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:28.826419 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c413a7ba-6212-4e51-abb6-dd02143eb203 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:28.827902 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c413a7ba-6212-4e51-abb6-dd02143eb203 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:28.834400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c413a7ba-6212-4e51-abb6-dd02143eb203 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:28.835247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c413a7ba-6212-4e51-abb6-dd02143eb203 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:28.953995 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0889e8ef-0dbd-4c09-961b-320377ce40ca tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:28.967147 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0889e8ef-0dbd-4c09-961b-320377ce40ca tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:28.970842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0889e8ef-0dbd-4c09-961b-320377ce40ca tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:28.978742 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0889e8ef-0dbd-4c09-961b-320377ce40ca tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1487 microversion: 2.25 time: 1.272627 Jul 19 22:34:28.984011 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 977/1974] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:34:27 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1487 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:34:28.991725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-caaa9449-16cb-4c4a-80ab-9ed4622a819f tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:28.994873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-caaa9449-16cb-4c4a-80ab-9ed4622a819f tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:29.009547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-caaa9449-16cb-4c4a-80ab-9ed4622a819f tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:29.010573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-caaa9449-16cb-4c4a-80ab-9ed4622a819f tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:29.012252 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-caaa9449-16cb-4c4a-80ab-9ed4622a819f tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:29.015816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-caaa9449-16cb-4c4a-80ab-9ed4622a819f tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:29.211036 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c413a7ba-6212-4e51-abb6-dd02143eb203 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52bb4626ba4c00abdcbc0bed7811b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3173e6bfa06f4118842ec55c92b253de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:29.224462 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c413a7ba-6212-4e51-abb6-dd02143eb203 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] 10.222.0.25 "GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056" status: 200 len: 1321 microversion: 2.1 time: 0.461435 Jul 19 22:34:29.230059 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 998/1975] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:28 2022] GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056 => generated 1321 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:30.012861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-670e1cb5-7fbc-4ed8-abd1-870870f707e0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:30.013499 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-670e1cb5-7fbc-4ed8-abd1-870870f707e0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:30.028753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-670e1cb5-7fbc-4ed8-abd1-870870f707e0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:30.038931 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-670e1cb5-7fbc-4ed8-abd1-870870f707e0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:30.043679 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-670e1cb5-7fbc-4ed8-abd1-870870f707e0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:30.044439 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-670e1cb5-7fbc-4ed8-abd1-870870f707e0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:30.560647 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-caaa9449-16cb-4c4a-80ab-9ed4622a819f tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:30.574346 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-caaa9449-16cb-4c4a-80ab-9ed4622a819f tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 200 len: 1521 microversion: 2.1 time: 1.587439 Jul 19 22:34:30.575037 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 978/1976] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:28 2022] GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 1521 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:30.594239 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b6ba4dd5-b0ee-4809-a6a9-b6a66bf4b218 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:30.594936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b6ba4dd5-b0ee-4809-a6a9-b6a66bf4b218 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] [instance: b33a2a96-d4d2-4835-824d-739d006bf056] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:30.620643 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b6ba4dd5-b0ee-4809-a6a9-b6a66bf4b218 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:30.623087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b6ba4dd5-b0ee-4809-a6a9-b6a66bf4b218 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:30.624563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b6ba4dd5-b0ee-4809-a6a9-b6a66bf4b218 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:30.627578 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b6ba4dd5-b0ee-4809-a6a9-b6a66bf4b218 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:30.861947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b6ba4dd5-b0ee-4809-a6a9-b6a66bf4b218 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52bb4626ba4c00abdcbc0bed7811b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3173e6bfa06f4118842ec55c92b253de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:30.874130 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b6ba4dd5-b0ee-4809-a6a9-b6a66bf4b218 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] 10.222.0.25 "GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056" status: 200 len: 1327 microversion: 2.1 time: 0.297798 Jul 19 22:34:30.887525 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 979/1977] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:30 2022] GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056 => generated 1327 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:30.903628 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-670e1cb5-7fbc-4ed8-abd1-870870f707e0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:30.916314 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-670e1cb5-7fbc-4ed8-abd1-870870f707e0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:30.919961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-670e1cb5-7fbc-4ed8-abd1-870870f707e0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:30.921417 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-670e1cb5-7fbc-4ed8-abd1-870870f707e0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1487 microversion: 2.25 time: 0.913519 Jul 19 22:34:30.921992 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6b89eff6-db38-4b48-be9a-5b216a80e4b9 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:30.923990 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6b89eff6-db38-4b48-be9a-5b216a80e4b9 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:30.924794 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 999/1978] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:34:30 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1487 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:34:30.943412 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b89eff6-db38-4b48-be9a-5b216a80e4b9 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:30.944133 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b89eff6-db38-4b48-be9a-5b216a80e4b9 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:30.945121 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b89eff6-db38-4b48-be9a-5b216a80e4b9 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:30.945758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b89eff6-db38-4b48-be9a-5b216a80e4b9 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:31.753329 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6b89eff6-db38-4b48-be9a-5b216a80e4b9 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:31.788233 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6b89eff6-db38-4b48-be9a-5b216a80e4b9 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 200 len: 1521 microversion: 2.1 time: 0.899159 Jul 19 22:34:31.794511 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 980/1979] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:30 2022] GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 1521 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:31.814369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-47e9866d-edb9-4f17-a27c-2ebd7ddaefb1 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:34:31.817623 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-47e9866d-edb9-4f17-a27c-2ebd7ddaefb1 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Request method failure captured: Jul 19 22:34:31.817623 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47/action HTTP/1.1 Jul 19 22:34:31.817623 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:34:31.817623 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:34:31.817623 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:34:31.817623 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 285 Jul 19 22:34:31.817623 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:34:31.817623 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:34:31.817623 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:34:31.817623 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:34:31.817623 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zFSA7GyoHNV6r8lt0QaILXtfyjU87DAOplAZjQU_9SUIJAdMw3TfBxiMnSQsWy218lpl-le3iOg2K6ZI4fs9ORwE8JiU3d4qrQtSVE6mLVRBodkQTjds8wHcIk6jUHzr1JjH374IFd8C1hu4WJXkMpF_7JvVJQyRRP5WIIvershcNo Jul 19 22:34:31.817623 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:34:31.817623 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:34:31.817623 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:34:31.817623 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:34:31.817623 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:34:31.817623 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:34:31.817623 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:34:31.817623 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:34:31.817623 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:34:31.817623 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:34:31.819827 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:34:31.819827 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:34:31.819827 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:34:31.819827 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:34:31.819827 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:34:31.819827 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:34:31.819827 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:34:31.819827 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: ecca13a073e7447591944e6604d67e4c Jul 19 22:34:31.819827 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:34:31.819827 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:34:31.819827 n-d-847009-3 devstack@n-api.service[119337]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 19 22:34:31.821152 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:34:31.821152 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 22:34:31.821152 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '44b7e41a-9a4f-469b-9561-5f798bebeb47', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 19 22:34:31.821152 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:34:31.821152 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:31.821152 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:34:31.821152 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:34:31.821152 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:34:31.821152 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:34:31.821152 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 22:34:31.821985 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:31.821985 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 19 22:34:31.821985 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 22:34:31.821985 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:31.821985 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 19 22:34:31.821985 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 19 22:34:31.821985 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:31.821985 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:34:31.821985 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:31.821985 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:31.821985 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:34:31.821985 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:34:31.821985 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:34:31.821985 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:34:31.821985 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:34:31.821985 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:34:31.821985 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:34:31.821985 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:34:31.821985 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:34:31.821985 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:34:31.824247 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:34:31.824247 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:34:31.824247 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:34:31.824247 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:34:31.824247 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 22:34:31.824247 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:31.824247 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:34:31.824247 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:31.824247 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:31.824247 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:34:31.824247 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:34:31.824247 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:34:31.824247 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:34:31.825594 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 22:34:31.825594 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:31.825594 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-47e9866d-edb9-4f17-a27c-2ebd7ddaefb1 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:34:31.827580 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-47e9866d-edb9-4f17-a27c-2ebd7ddaefb1 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "POST /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47/action" status: 400 len: 619 microversion: 2.1 time: 0.010634 Jul 19 22:34:31.828219 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1000/1980] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Jul 19 22:34:31 2022] POST /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47/action => generated 619 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:34:31.838067 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bbdeba62-d130-45c8-a157-969fa7637c32 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:31.839356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bbdeba62-d130-45c8-a157-969fa7637c32 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:31.852293 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bbdeba62-d130-45c8-a157-969fa7637c32 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:31.858328 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bbdeba62-d130-45c8-a157-969fa7637c32 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:31.859479 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bbdeba62-d130-45c8-a157-969fa7637c32 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:31.860707 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bbdeba62-d130-45c8-a157-969fa7637c32 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:31.893849 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-63805b61-c7e8-4914-86a1-47a116356f42 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:31.895351 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-63805b61-c7e8-4914-86a1-47a116356f42 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] [instance: b33a2a96-d4d2-4835-824d-739d006bf056] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:31.920913 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63805b61-c7e8-4914-86a1-47a116356f42 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:31.927174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63805b61-c7e8-4914-86a1-47a116356f42 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:31.928700 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63805b61-c7e8-4914-86a1-47a116356f42 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:31.930857 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63805b61-c7e8-4914-86a1-47a116356f42 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:32.578512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bbdeba62-d130-45c8-a157-969fa7637c32 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:32.593336 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bbdeba62-d130-45c8-a157-969fa7637c32 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 200 len: 1521 microversion: 2.1 time: 0.759433 Jul 19 22:34:32.599187 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 981/1981] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:31 2022] GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 1521 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:32.608668 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-55d000ed-35fd-416b-9b64-875a15cc97e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:32.609283 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-55d000ed-35fd-416b-9b64-875a15cc97e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:32.645584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55d000ed-35fd-416b-9b64-875a15cc97e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:32.647472 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55d000ed-35fd-416b-9b64-875a15cc97e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:32.664855 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55d000ed-35fd-416b-9b64-875a15cc97e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:32.669124 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55d000ed-35fd-416b-9b64-875a15cc97e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:32.824284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-63805b61-c7e8-4914-86a1-47a116356f42 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52bb4626ba4c00abdcbc0bed7811b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3173e6bfa06f4118842ec55c92b253de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:32.838106 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-63805b61-c7e8-4914-86a1-47a116356f42 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] 10.222.0.25 "GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056" status: 200 len: 1395 microversion: 2.1 time: 0.948141 Jul 19 22:34:32.843439 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1001/1982] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:31 2022] GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056 => generated 1395 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:34:32.861848 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ea4ecb96-d165-4ea3-9925-0df115018ae7 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:32.862494 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ea4ecb96-d165-4ea3-9925-0df115018ae7 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:32.883246 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea4ecb96-d165-4ea3-9925-0df115018ae7 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:32.883714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea4ecb96-d165-4ea3-9925-0df115018ae7 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:32.889754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea4ecb96-d165-4ea3-9925-0df115018ae7 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:32.890229 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea4ecb96-d165-4ea3-9925-0df115018ae7 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:33.128994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-55d000ed-35fd-416b-9b64-875a15cc97e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:33.142475 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-55d000ed-35fd-416b-9b64-875a15cc97e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:33.144241 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-55d000ed-35fd-416b-9b64-875a15cc97e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:33.146585 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-55d000ed-35fd-416b-9b64-875a15cc97e6 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1487 microversion: 2.25 time: 0.546344 Jul 19 22:34:33.152976 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 982/1983] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:34:32 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1487 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:34:33.773507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-ccefacce-d9db-4ef4-ae19-a74968233705 req-284d155f-63a5-408d-bd84-c5c9d2b95dfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b33a2a96-d4d2-4835-824d-739d006bf056", "tag": "f02a3722-57d9-4b04-bd6c-cae51d4d500c"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:34:33.807355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-ccefacce-d9db-4ef4-ae19-a74968233705 req-284d155f-63a5-408d-bd84-c5c9d2b95dfb service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:33.808233 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-ccefacce-d9db-4ef4-ae19-a74968233705 req-284d155f-63a5-408d-bd84-c5c9d2b95dfb service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:33.850954 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-ccefacce-d9db-4ef4-ae19-a74968233705 req-284d155f-63a5-408d-bd84-c5c9d2b95dfb service nova] Creating event network-changed:f02a3722-57d9-4b04-bd6c-cae51d4d500c for instance b33a2a96-d4d2-4835-824d-739d006bf056 on n-h2-847009-3 Jul 19 22:34:33.876195 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-ccefacce-d9db-4ef4-ae19-a74968233705 req-284d155f-63a5-408d-bd84-c5c9d2b95dfb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105873 Jul 19 22:34:33.878385 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 983/1984] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:34:33.892145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-00131b5a-e02e-4efc-8b5c-fa0d3b890914 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:33.895512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-00131b5a-e02e-4efc-8b5c-fa0d3b890914 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] [instance: b33a2a96-d4d2-4835-824d-739d006bf056] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:33.916638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00131b5a-e02e-4efc-8b5c-fa0d3b890914 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:33.917685 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00131b5a-e02e-4efc-8b5c-fa0d3b890914 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:33.922312 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00131b5a-e02e-4efc-8b5c-fa0d3b890914 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:33.923012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00131b5a-e02e-4efc-8b5c-fa0d3b890914 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:33.940879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ea4ecb96-d165-4ea3-9925-0df115018ae7 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:33.950980 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ea4ecb96-d165-4ea3-9925-0df115018ae7 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 200 len: 1521 microversion: 2.1 time: 1.104021 Jul 19 22:34:33.965437 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1002/1985] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:32 2022] GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 1521 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:33.990691 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f1212d48-4736-489a-a9ac-cd6da1d0461b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1718830401"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:34:33.993056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f1212d48-4736-489a-a9ac-cd6da1d0461b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:34.001348 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f1212d48-4736-489a-a9ac-cd6da1d0461b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:34.002296 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f1212d48-4736-489a-a9ac-cd6da1d0461b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:34.003332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f1212d48-4736-489a-a9ac-cd6da1d0461b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:34.003987 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f1212d48-4736-489a-a9ac-cd6da1d0461b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:34.616704 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-00131b5a-e02e-4efc-8b5c-fa0d3b890914 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52bb4626ba4c00abdcbc0bed7811b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3173e6bfa06f4118842ec55c92b253de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:34.632579 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-00131b5a-e02e-4efc-8b5c-fa0d3b890914 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] 10.222.0.25 "GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056" status: 200 len: 1395 microversion: 2.1 time: 0.752015 Jul 19 22:34:34.634001 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 984/1986] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:33 2022] GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056 => generated 1395 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:34.640419 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ac52bf09-4cf8-42ff-8c58-cf2b1ae68bc7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:34.643469 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ac52bf09-4cf8-42ff-8c58-cf2b1ae68bc7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:34.651401 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac52bf09-4cf8-42ff-8c58-cf2b1ae68bc7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:34.652188 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac52bf09-4cf8-42ff-8c58-cf2b1ae68bc7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:34.653332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac52bf09-4cf8-42ff-8c58-cf2b1ae68bc7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:34.653978 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac52bf09-4cf8-42ff-8c58-cf2b1ae68bc7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:34.944340 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f1212d48-4736-489a-a9ac-cd6da1d0461b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "POST /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47/action" status: 202 len: 0 microversion: 2.1 time: 0.955595 Jul 19 22:34:34.961811 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1003/1987] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:34:33 2022] POST /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47/action => generated 0 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 19 22:34:34.983592 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d903df57-c122-49b0-8ca5-7b9bc7fca22b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-410728879"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:34:34.984762 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d903df57-c122-49b0-8ca5-7b9bc7fca22b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:34.998817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d903df57-c122-49b0-8ca5-7b9bc7fca22b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:34.999311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d903df57-c122-49b0-8ca5-7b9bc7fca22b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:35.000107 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d903df57-c122-49b0-8ca5-7b9bc7fca22b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:35.000549 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d903df57-c122-49b0-8ca5-7b9bc7fca22b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:35.109994 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-d903df57-c122-49b0-8ca5-7b9bc7fca22b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] HTTP exception thrown: Cannot 'createImage' instance 44b7e41a-9a4f-469b-9561-5f798bebeb47 while it is in task_state image_snapshot_pending Jul 19 22:34:35.114874 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d903df57-c122-49b0-8ca5-7b9bc7fca22b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Request method failure captured: Jul 19 22:34:35.114874 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47/action HTTP/1.1 Jul 19 22:34:35.114874 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:34:35.114874 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:34:35.114874 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:34:35.114874 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 84 Jul 19 22:34:35.114874 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:34:35.114874 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:34:35.114874 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:34:35.114874 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:34:35.114874 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zFSA7GyoHNV6r8lt0QaILXtfyjU87DAOplAZjQU_9SUIJAdMw3TfBxiMnSQsWy218lpl-le3iOg2K6ZI4fs9ORwE8JiU3d4qrQtSVE6mLVRBodkQTjds8wHcIk6jUHzr1JjH374IFd8C1hu4WJXkMpF_7JvVJQyRRP5WIIvershcNo Jul 19 22:34:35.114874 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:34:35.114874 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:34:35.114874 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:34:35.114874 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:34:35.114874 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:34:35.114874 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:34:35.114874 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:34:35.114874 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:34:35.114874 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:34:35.114874 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:34:35.117584 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:34:35.117584 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:34:35.117584 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:34:35.117584 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:34:35.117584 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:34:35.117584 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:34:35.117584 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:34:35.117584 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: ecca13a073e7447591944e6604d67e4c Jul 19 22:34:35.117584 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:34:35.117584 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:34:35.117584 n-d-847009-3 devstack@n-api.service[119337]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-410728879"}} Jul 19 22:34:35.117584 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:34:35.118772 n-d-847009-3 devstack@n-api.service[119337]: exception: Cannot 'createImage' instance 44b7e41a-9a4f-469b-9561-5f798bebeb47 while it is in task_state image_snapshot_pending Jul 19 22:34:35.118772 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '44b7e41a-9a4f-469b-9561-5f798bebeb47', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-410728879'}}} Jul 19 22:34:35.118772 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:34:35.118772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:35.118772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jul 19 22:34:35.118772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 19 22:34:35.118772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jul 19 22:34:35.118772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 22:34:35.118772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 44b7e41a-9a4f-469b-9561-5f798bebeb47 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Jul 19 22:34:35.118772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:35.118772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:34:35.118772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:35.118772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:35.118772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:34:35.118772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:34:35.118772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:34:35.118772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:34:35.118772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:34:35.118772 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:34:35.120594 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:34:35.120594 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:34:35.120594 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:34:35.120594 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:34:35.120594 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jul 19 22:34:35.120594 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 22:34:35.120594 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 22:34:35.120594 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 22:34:35.120594 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 44b7e41a-9a4f-469b-9561-5f798bebeb47 while it is in task_state image_snapshot_pending Jul 19 22:34:35.120594 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:35.120594 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:34:35.120594 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:35.120594 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:35.120594 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:34:35.120594 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:34:35.120594 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:34:35.120594 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:34:35.120594 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 44b7e41a-9a4f-469b-9561-5f798bebeb47 while it is in task_state image_snapshot_pending Jul 19 22:34:35.120594 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:35.126013 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d903df57-c122-49b0-8ca5-7b9bc7fca22b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Returning 409 to user: Cannot 'createImage' instance 44b7e41a-9a4f-469b-9561-5f798bebeb47 while it is in task_state image_snapshot_pending {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:34:35.128301 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d903df57-c122-49b0-8ca5-7b9bc7fca22b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "POST /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47/action" status: 409 len: 167 microversion: 2.1 time: 0.157538 Jul 19 22:34:35.139911 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1004/1988] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:34:34 2022] POST /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47/action => generated 167 bytes in 172 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:34:35.149489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dd341048-b6aa-4c49-af46-6d8d400e74f0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '.version_select at 0x7f7a03efb820>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:35.151918 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ac52bf09-4cf8-42ff-8c58-cf2b1ae68bc7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:35.184445 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ac52bf09-4cf8-42ff-8c58-cf2b1ae68bc7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:35.186359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ac52bf09-4cf8-42ff-8c58-cf2b1ae68bc7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:35.187749 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ac52bf09-4cf8-42ff-8c58-cf2b1ae68bc7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1487 microversion: 2.25 time: 0.552512 Jul 19 22:34:35.188478 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 985/1989] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:34:34 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1487 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:34:35.514444 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dd341048-b6aa-4c49-af46-6d8d400e74f0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "DELETE /compute/v2.1/images/ab95208e-f3f9-4eb7-8809-25bde63b8c0b" status: 204 len: 0 microversion: 2.1 time: 0.372689 Jul 19 22:34:35.515606 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1005/1990] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:35 2022] DELETE /compute/v2.1/images/ab95208e-f3f9-4eb7-8809-25bde63b8c0b => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:34:35.525477 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c6d14fca-164e-49f0-ad4f-b12843a924f7 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:35.526156 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c6d14fca-164e-49f0-ad4f-b12843a924f7 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:35.539393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6d14fca-164e-49f0-ad4f-b12843a924f7 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:35.541771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6d14fca-164e-49f0-ad4f-b12843a924f7 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:35.544862 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6d14fca-164e-49f0-ad4f-b12843a924f7 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:35.547557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6d14fca-164e-49f0-ad4f-b12843a924f7 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:35.655272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d43cbfae-b22c-4e5a-800b-6e02b46e89e1 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:35.661434 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d43cbfae-b22c-4e5a-800b-6e02b46e89e1 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] [instance: b33a2a96-d4d2-4835-824d-739d006bf056] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:35.699333 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d43cbfae-b22c-4e5a-800b-6e02b46e89e1 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:35.703929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d43cbfae-b22c-4e5a-800b-6e02b46e89e1 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:35.708538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d43cbfae-b22c-4e5a-800b-6e02b46e89e1 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:35.710679 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d43cbfae-b22c-4e5a-800b-6e02b46e89e1 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:36.476758 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d43cbfae-b22c-4e5a-800b-6e02b46e89e1 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52bb4626ba4c00abdcbc0bed7811b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3173e6bfa06f4118842ec55c92b253de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:36.499482 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d43cbfae-b22c-4e5a-800b-6e02b46e89e1 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] 10.222.0.25 "GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056" status: 200 len: 1395 microversion: 2.1 time: 0.851218 Jul 19 22:34:36.503174 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1006/1991] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:35 2022] GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056 => generated 1395 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:34:36.521981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a3c4bbcd-61d4-4b1c-8505-cdef6f963d50 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:36.525276 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a3c4bbcd-61d4-4b1c-8505-cdef6f963d50 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:36.537328 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c6d14fca-164e-49f0-ad4f-b12843a924f7 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:36.546022 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a3c4bbcd-61d4-4b1c-8505-cdef6f963d50 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:36.547506 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a3c4bbcd-61d4-4b1c-8505-cdef6f963d50 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:36.551424 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a3c4bbcd-61d4-4b1c-8505-cdef6f963d50 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:36.552257 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a3c4bbcd-61d4-4b1c-8505-cdef6f963d50 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:36.560806 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c6d14fca-164e-49f0-ad4f-b12843a924f7 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 200 len: 1533 microversion: 2.1 time: 1.038601 Jul 19 22:34:36.562263 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 986/1992] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:35 2022] GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 1533 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:36.578026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-744bc99e-e2ae-4276-9909-e6fd315607a1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:36.580031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-744bc99e-e2ae-4276-9909-e6fd315607a1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:36.608049 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-744bc99e-e2ae-4276-9909-e6fd315607a1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:36.613705 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-744bc99e-e2ae-4276-9909-e6fd315607a1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:36.618504 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-744bc99e-e2ae-4276-9909-e6fd315607a1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:36.619558 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-744bc99e-e2ae-4276-9909-e6fd315607a1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:36.633270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a3c4bbcd-61d4-4b1c-8505-cdef6f963d50 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:34:36.689771 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:34:36.797208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=10 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:34:36.857249 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a3c4bbcd-61d4-4b1c-8505-cdef6f963d50 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 204 len: 0 microversion: 2.1 time: 0.351594 Jul 19 22:34:36.863989 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1007/1993] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:34:36 2022] DELETE /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:34:36.893934 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-62073052-6cdd-43f7-82a0-273bfc6d43cf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:36.898990 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-62073052-6cdd-43f7-82a0-273bfc6d43cf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:36.912201 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62073052-6cdd-43f7-82a0-273bfc6d43cf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:36.922989 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62073052-6cdd-43f7-82a0-273bfc6d43cf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:36.924582 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62073052-6cdd-43f7-82a0-273bfc6d43cf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:36.925544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62073052-6cdd-43f7-82a0-273bfc6d43cf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:37.675509 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:34:37.722839 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-744bc99e-e2ae-4276-9909-e6fd315607a1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:37.742690 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-744bc99e-e2ae-4276-9909-e6fd315607a1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:37.750305 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-744bc99e-e2ae-4276-9909-e6fd315607a1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:37.751987 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-744bc99e-e2ae-4276-9909-e6fd315607a1 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1487 microversion: 2.25 time: 1.186510 Jul 19 22:34:37.761399 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 987/1994] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:34:36 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1487 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:34:37.767544 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5e4c5dc5-9f92-4755-8eea-ccf197e30e8e tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:37.768469 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5e4c5dc5-9f92-4755-8eea-ccf197e30e8e tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] [instance: b33a2a96-d4d2-4835-824d-739d006bf056] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:37.781243 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e4c5dc5-9f92-4755-8eea-ccf197e30e8e tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:37.789645 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e4c5dc5-9f92-4755-8eea-ccf197e30e8e tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:37.790826 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e4c5dc5-9f92-4755-8eea-ccf197e30e8e tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:37.791319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e4c5dc5-9f92-4755-8eea-ccf197e30e8e tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:37.826125 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-62073052-6cdd-43f7-82a0-273bfc6d43cf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:37.839566 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-62073052-6cdd-43f7-82a0-273bfc6d43cf tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1668 microversion: 2.1 time: 0.969475 Jul 19 22:34:37.854665 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1008/1995] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:36 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1668 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:37.862796 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c5e76032-bc5a-4b8b-9bad-af54ec6dfdf6 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:37.865539 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c5e76032-bc5a-4b8b-9bad-af54ec6dfdf6 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:37.884965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5e76032-bc5a-4b8b-9bad-af54ec6dfdf6 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:37.886341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5e76032-bc5a-4b8b-9bad-af54ec6dfdf6 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:37.887708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5e76032-bc5a-4b8b-9bad-af54ec6dfdf6 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:37.888424 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5e76032-bc5a-4b8b-9bad-af54ec6dfdf6 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:38.616214 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5e4c5dc5-9f92-4755-8eea-ccf197e30e8e tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52bb4626ba4c00abdcbc0bed7811b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3173e6bfa06f4118842ec55c92b253de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:38.630771 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5e4c5dc5-9f92-4755-8eea-ccf197e30e8e tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] 10.222.0.25 "GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056" status: 200 len: 1395 microversion: 2.1 time: 0.867869 Jul 19 22:34:38.631407 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 988/1996] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:37 2022] GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056 => generated 1395 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:38.764946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c5e76032-bc5a-4b8b-9bad-af54ec6dfdf6 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:38.786883 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c5e76032-bc5a-4b8b-9bad-af54ec6dfdf6 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 200 len: 1539 microversion: 2.1 time: 0.925093 Jul 19 22:34:38.788496 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c11cdada-81de-4ac7-829f-8314e8caa123 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:38.789463 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1009/1997] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:37 2022] GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 1539 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:38.792186 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c11cdada-81de-4ac7-829f-8314e8caa123 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:38.809779 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c11cdada-81de-4ac7-829f-8314e8caa123 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:38.810486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c11cdada-81de-4ac7-829f-8314e8caa123 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:38.811505 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c11cdada-81de-4ac7-829f-8314e8caa123 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:38.812111 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c11cdada-81de-4ac7-829f-8314e8caa123 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:38.860359 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dae0f765-4afa-4db7-9e21-3b76d60e24e3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:38.861288 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dae0f765-4afa-4db7-9e21-3b76d60e24e3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:38.893295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dae0f765-4afa-4db7-9e21-3b76d60e24e3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:38.897812 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dae0f765-4afa-4db7-9e21-3b76d60e24e3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:38.902675 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dae0f765-4afa-4db7-9e21-3b76d60e24e3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:38.907008 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dae0f765-4afa-4db7-9e21-3b76d60e24e3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:38.929482 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:34:40.416741 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dae0f765-4afa-4db7-9e21-3b76d60e24e3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:40.432373 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dae0f765-4afa-4db7-9e21-3b76d60e24e3 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1668 microversion: 2.1 time: 1.570807 Jul 19 22:34:40.433750 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1010/1998] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:38 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1668 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:40.448441 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3f1293be-b0c4-4d6c-b999-bfd6e09bde5b tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:40.449455 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3f1293be-b0c4-4d6c-b999-bfd6e09bde5b tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] [instance: b33a2a96-d4d2-4835-824d-739d006bf056] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:40.466239 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f1293be-b0c4-4d6c-b999-bfd6e09bde5b tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:40.466921 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f1293be-b0c4-4d6c-b999-bfd6e09bde5b tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:40.467964 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f1293be-b0c4-4d6c-b999-bfd6e09bde5b tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:40.470162 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c11cdada-81de-4ac7-829f-8314e8caa123 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:40.471559 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f1293be-b0c4-4d6c-b999-bfd6e09bde5b tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:40.492000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c11cdada-81de-4ac7-829f-8314e8caa123 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:40.497274 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c11cdada-81de-4ac7-829f-8314e8caa123 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:40.502639 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c11cdada-81de-4ac7-829f-8314e8caa123 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1487 microversion: 2.25 time: 1.716828 Jul 19 22:34:40.504971 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 989/1999] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:34:38 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1487 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:34:40.516319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ba626056-03e8-4e53-9736-58853b11118d tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:40.519998 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ba626056-03e8-4e53-9736-58853b11118d tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:40.534825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba626056-03e8-4e53-9736-58853b11118d tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:40.539211 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba626056-03e8-4e53-9736-58853b11118d tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:40.548724 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba626056-03e8-4e53-9736-58853b11118d tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:40.549712 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba626056-03e8-4e53-9736-58853b11118d tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:41.421736 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ba626056-03e8-4e53-9736-58853b11118d tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:41.441868 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ba626056-03e8-4e53-9736-58853b11118d tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 200 len: 1521 microversion: 2.1 time: 0.935519 Jul 19 22:34:41.442994 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 990/2000] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:40 2022] GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 1521 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:41.451056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3f1293be-b0c4-4d6c-b999-bfd6e09bde5b tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52bb4626ba4c00abdcbc0bed7811b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3173e6bfa06f4118842ec55c92b253de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:41.462045 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-22680c93-ce0d-41c6-a1e7-900aa27e6734 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:41.463012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-22680c93-ce0d-41c6-a1e7-900aa27e6734 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:41.464560 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3f1293be-b0c4-4d6c-b999-bfd6e09bde5b tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] 10.222.0.25 "GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056" status: 200 len: 1395 microversion: 2.1 time: 1.029448 Jul 19 22:34:41.465574 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1011/2001] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:40 2022] GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056 => generated 1395 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:41.469625 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:34:41.476218 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-22680c93-ce0d-41c6-a1e7-900aa27e6734 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:41.477369 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-22680c93-ce0d-41c6-a1e7-900aa27e6734 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:41.478197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-22680c93-ce0d-41c6-a1e7-900aa27e6734 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:41.478645 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-22680c93-ce0d-41c6-a1e7-900aa27e6734 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:41.479735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bd60be6c-263f-487e-bac2-31ac5937770d tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:41.480367 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bd60be6c-263f-487e-bac2-31ac5937770d tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:41.490456 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bd60be6c-263f-487e-bac2-31ac5937770d tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:41.501436 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bd60be6c-263f-487e-bac2-31ac5937770d tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:41.511560 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bd60be6c-263f-487e-bac2-31ac5937770d tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:41.512899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bd60be6c-263f-487e-bac2-31ac5937770d tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:41.606667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bd60be6c-263f-487e-bac2-31ac5937770d tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:34:41.728525 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-22680c93-ce0d-41c6-a1e7-900aa27e6734 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:41.745633 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-22680c93-ce0d-41c6-a1e7-900aa27e6734 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1600 microversion: 2.1 time: 0.295462 Jul 19 22:34:41.746977 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 991/2002] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:41 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1600 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:34:41.761387 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-28490d86-6fd4-49d7-8c89-ecc4dde49f71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:41.763989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-28490d86-6fd4-49d7-8c89-ecc4dde49f71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:41.806795 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-28490d86-6fd4-49d7-8c89-ecc4dde49f71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:41.808136 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-28490d86-6fd4-49d7-8c89-ecc4dde49f71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:41.809465 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bd60be6c-263f-487e-bac2-31ac5937770d tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "DELETE /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 204 len: 0 microversion: 2.1 time: 0.342360 Jul 19 22:34:41.810768 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1012/2003] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:34:41 2022] DELETE /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:34:41.811653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-28490d86-6fd4-49d7-8c89-ecc4dde49f71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:41.812118 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-28490d86-6fd4-49d7-8c89-ecc4dde49f71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:41.824769 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a77ce6df-68a7-4519-a5b6-2b0ac60ddb64 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:41.830201 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a77ce6df-68a7-4519-a5b6-2b0ac60ddb64 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:41.847066 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a77ce6df-68a7-4519-a5b6-2b0ac60ddb64 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:41.859440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a77ce6df-68a7-4519-a5b6-2b0ac60ddb64 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:41.866125 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a77ce6df-68a7-4519-a5b6-2b0ac60ddb64 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:41.867238 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a77ce6df-68a7-4519-a5b6-2b0ac60ddb64 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:41.882979 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:34:42.812880 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-28490d86-6fd4-49d7-8c89-ecc4dde49f71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:42.829058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-28490d86-6fd4-49d7-8c89-ecc4dde49f71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:42.830891 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-28490d86-6fd4-49d7-8c89-ecc4dde49f71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:42.833921 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-28490d86-6fd4-49d7-8c89-ecc4dde49f71 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1487 microversion: 2.25 time: 1.084235 Jul 19 22:34:42.836955 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 992/2004] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:34:41 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1487 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:34:42.855385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9de29dc7-5d51-4069-bc52-9eee3bc94c6d tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:42.859049 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9de29dc7-5d51-4069-bc52-9eee3bc94c6d tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] [instance: b33a2a96-d4d2-4835-824d-739d006bf056] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:42.875227 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9de29dc7-5d51-4069-bc52-9eee3bc94c6d tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:42.876231 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9de29dc7-5d51-4069-bc52-9eee3bc94c6d tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:42.877296 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9de29dc7-5d51-4069-bc52-9eee3bc94c6d tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:42.882566 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9de29dc7-5d51-4069-bc52-9eee3bc94c6d tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:42.966887 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a77ce6df-68a7-4519-a5b6-2b0ac60ddb64 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:42.977543 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a77ce6df-68a7-4519-a5b6-2b0ac60ddb64 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 200 len: 1527 microversion: 2.1 time: 1.161332 Jul 19 22:34:42.978147 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1013/2005] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:41 2022] GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 1527 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:42.995718 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-64a1cadc-5328-4430-b11a-eac2b3aaee3f req-a5cb2238-f200-490b-ab4b-3f9a24ee557a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab0a3d6-8249-4058-9ce5-90d458fff59d", "name": "network-vif-deleted", "tag": "7078c457-b7f7-49a3-bb53-e2a5e49cc511"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:34:43.020817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-64a1cadc-5328-4430-b11a-eac2b3aaee3f req-a5cb2238-f200-490b-ab4b-3f9a24ee557a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:43.021269 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-64a1cadc-5328-4430-b11a-eac2b3aaee3f req-a5cb2238-f200-490b-ab4b-3f9a24ee557a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:43.062775 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-64a1cadc-5328-4430-b11a-eac2b3aaee3f req-a5cb2238-f200-490b-ab4b-3f9a24ee557a service nova] Creating event network-vif-deleted:7078c457-b7f7-49a3-bb53-e2a5e49cc511 for instance fab0a3d6-8249-4058-9ce5-90d458fff59d on n-h1-847009-3 Jul 19 22:34:43.069548 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-64a1cadc-5328-4430-b11a-eac2b3aaee3f req-a5cb2238-f200-490b-ab4b-3f9a24ee557a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090178 Jul 19 22:34:43.079406 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1014/2006] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:34:43.085267 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3d831db0-fcaf-4054-905a-c9e78408cdde tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:43.086423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3d831db0-fcaf-4054-905a-c9e78408cdde tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:43.104335 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d831db0-fcaf-4054-905a-c9e78408cdde tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:43.105170 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d831db0-fcaf-4054-905a-c9e78408cdde tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:43.111510 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d831db0-fcaf-4054-905a-c9e78408cdde tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:43.112100 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d831db0-fcaf-4054-905a-c9e78408cdde tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:43.249475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d831db0-fcaf-4054-905a-c9e78408cdde tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:43.249851 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d831db0-fcaf-4054-905a-c9e78408cdde tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:43.250320 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-3d831db0-fcaf-4054-905a-c9e78408cdde tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lazy-loading 'fault' on Instance uuid fab0a3d6-8249-4058-9ce5-90d458fff59d {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:34:43.416502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3d831db0-fcaf-4054-905a-c9e78408cdde tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:43.452824 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3d831db0-fcaf-4054-905a-c9e78408cdde tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 200 len: 1324 microversion: 2.1 time: 0.369385 Jul 19 22:34:43.454565 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1015/2007] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:43 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 1324 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:43.563955 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9de29dc7-5d51-4069-bc52-9eee3bc94c6d tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52bb4626ba4c00abdcbc0bed7811b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3173e6bfa06f4118842ec55c92b253de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:43.581650 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9de29dc7-5d51-4069-bc52-9eee3bc94c6d tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] 10.222.0.25 "GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056" status: 200 len: 1395 microversion: 2.1 time: 0.742558 Jul 19 22:34:43.590128 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 993/2008] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:42 2022] GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056 => generated 1395 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:43.855631 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-977faaf8-9a30-48dc-ad8e-cba07d719a3a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:43.856435 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-977faaf8-9a30-48dc-ad8e-cba07d719a3a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:43.871941 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-977faaf8-9a30-48dc-ad8e-cba07d719a3a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:43.873124 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-977faaf8-9a30-48dc-ad8e-cba07d719a3a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:43.874230 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-977faaf8-9a30-48dc-ad8e-cba07d719a3a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:43.875561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-977faaf8-9a30-48dc-ad8e-cba07d719a3a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:44.006147 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-408ce48f-1303-42cd-807d-abaee9835ee5 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:44.006774 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-408ce48f-1303-42cd-807d-abaee9835ee5 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:44.023618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-408ce48f-1303-42cd-807d-abaee9835ee5 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:44.032638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-408ce48f-1303-42cd-807d-abaee9835ee5 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:44.037895 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-408ce48f-1303-42cd-807d-abaee9835ee5 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:44.038508 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-408ce48f-1303-42cd-807d-abaee9835ee5 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:45.688400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-977faaf8-9a30-48dc-ad8e-cba07d719a3a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:45.707926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-977faaf8-9a30-48dc-ad8e-cba07d719a3a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:45.710030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-977faaf8-9a30-48dc-ad8e-cba07d719a3a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:45.714751 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-977faaf8-9a30-48dc-ad8e-cba07d719a3a tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1487 microversion: 2.25 time: 1.862875 Jul 19 22:34:45.718647 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1016/2009] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:34:43 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1487 bytes in 1869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:34:45.952800 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-408ce48f-1303-42cd-807d-abaee9835ee5 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:45.964191 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-408ce48f-1303-42cd-807d-abaee9835ee5 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 200 len: 1527 microversion: 2.1 time: 1.962337 Jul 19 22:34:45.965372 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 994/2010] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:44 2022] GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 1527 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:45.974099 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-afb33f7f-f8d3-40b2-90f0-fe353e78c367 req-c3ad41b1-656d-47a9-9df6-37de1c0dfba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f2b8c66-5ac4-42bd-afe7-e283eba41078", "name": "network-vif-unplugged", "status": "completed", "tag": "7697d6fa-c774-468b-a275-a40743f7894f"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:34:45.986715 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-94eed6a0-c661-4103-a939-d0de9ff2204b tempest-ListImagesTestJSON-39807159 tempest-ListImagesTestJSON-39807159-project] Calling method '.version_select at 0x7f7a03f78b80>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:46.005478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-afb33f7f-f8d3-40b2-90f0-fe353e78c367 req-c3ad41b1-656d-47a9-9df6-37de1c0dfba0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:46.007149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-afb33f7f-f8d3-40b2-90f0-fe353e78c367 req-c3ad41b1-656d-47a9-9df6-37de1c0dfba0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:46.029118 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-afb33f7f-f8d3-40b2-90f0-fe353e78c367 req-c3ad41b1-656d-47a9-9df6-37de1c0dfba0 service nova] Creating event network-vif-unplugged:7697d6fa-c774-468b-a275-a40743f7894f for instance 9f2b8c66-5ac4-42bd-afe7-e283eba41078 on n-h1-847009-3 Jul 19 22:34:46.038504 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-afb33f7f-f8d3-40b2-90f0-fe353e78c367 req-c3ad41b1-656d-47a9-9df6-37de1c0dfba0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071517 Jul 19 22:34:46.039463 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 995/2011] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:34:46.062747 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-33cef28e-d1c7-44f7-91f8-9e09db621e50 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:46.065997 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-33cef28e-d1c7-44f7-91f8-9e09db621e50 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: fab0a3d6-8249-4058-9ce5-90d458fff59d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:46.080833 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-94eed6a0-c661-4103-a939-d0de9ff2204b tempest-ListImagesTestJSON-39807159 tempest-ListImagesTestJSON-39807159-project] 10.222.0.25 "GET /compute/v2.1/images/3a7659a5-b1a8-4e19-8bfc-eda9874ee691" status: 200 len: 784 microversion: 2.1 time: 0.360257 Jul 19 22:34:46.081709 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1017/2012] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:34:45 2022] GET /compute/v2.1/images/3a7659a5-b1a8-4e19-8bfc-eda9874ee691 => generated 784 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:34:46.085217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-33cef28e-d1c7-44f7-91f8-9e09db621e50 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:46.085924 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-33cef28e-d1c7-44f7-91f8-9e09db621e50 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:46.087238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-33cef28e-d1c7-44f7-91f8-9e09db621e50 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:46.087566 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-33cef28e-d1c7-44f7-91f8-9e09db621e50 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:46.099802 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a0967c30-a275-4260-a91a-02ecd841c645 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:46.101571 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a0967c30-a275-4260-a91a-02ecd841c645 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] [instance: b33a2a96-d4d2-4835-824d-739d006bf056] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:46.110225 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0967c30-a275-4260-a91a-02ecd841c645 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:46.114680 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0967c30-a275-4260-a91a-02ecd841c645 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:46.116390 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0967c30-a275-4260-a91a-02ecd841c645 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:46.117274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0967c30-a275-4260-a91a-02ecd841c645 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:46.126971 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-33cef28e-d1c7-44f7-91f8-9e09db621e50 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] HTTP exception thrown: Instance fab0a3d6-8249-4058-9ce5-90d458fff59d could not be found. Jul 19 22:34:46.129586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-33cef28e-d1c7-44f7-91f8-9e09db621e50 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Request method failure captured: Jul 19 22:34:46.129586 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d HTTP/1.1 Jul 19 22:34:46.129586 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:34:46.129586 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:34:46.129586 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:34:46.129586 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:34:46.129586 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:34:46.129586 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:34:46.129586 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:34:46.129586 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:34:46.129586 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y9tGEg_0UM-7e0R_jLZscl6npd6EBaoASmTirv5jPYL9hGXCfnXWRTk1mNbU38hxkmKLGBF_JsMgnSxj3iicL-lkJn2EDnv_FsqbzFmmoHtrZKC8Hc58JLWQbASWlyM45z3q-kz-L0ioJwenPhwXIpyJ2_LBJo2kw0RVOmMp1OTHDI Jul 19 22:34:46.129586 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:34:46.129586 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:34:46.129586 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:34:46.129586 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:34:46.129586 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:34:46.129586 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:34:46.129586 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 2619b807c1ee4dca858dae47c4686ba2 Jul 19 22:34:46.129586 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-LiveMigrationTest-203877293 Jul 19 22:34:46.129586 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:34:46.129586 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:34:46.131910 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2619b807c1ee4dca858dae47c4686ba2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2619b807c1ee4dca858dae47c4686ba2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2619b807c1ee4dca858dae47c4686ba2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2619b807c1ee4dca858dae47c4686ba2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:34:46.131910 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-LiveMigrationTest-203877293 Jul 19 22:34:46.131910 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 2619b807c1ee4dca858dae47c4686ba2 Jul 19 22:34:46.131910 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-LiveMigrationTest-203877293 Jul 19 22:34:46.131910 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-LiveMigrationTest-203877293-project Jul 19 22:34:46.131910 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:34:46.131910 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:34:46.131910 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 55a214cbc1ec4cdb80ccf736f4251964 Jul 19 22:34:46.131910 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-LiveMigrationTest-203877293-project Jul 19 22:34:46.131910 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:34:46.131910 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance fab0a3d6-8249-4058-9ce5-90d458fff59d could not be found. Jul 19 22:34:46.131910 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'fab0a3d6-8249-4058-9ce5-90d458fff59d'} Jul 19 22:34:46.133038 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:34:46.133038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:46.133038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:34:46.133038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:34:46.133038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:34:46.133038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:34:46.133038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:34:46.133038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:34:46.133038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:34:46.133038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:34:46.133038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fab0a3d6-8249-4058-9ce5-90d458fff59d could not be found. Jul 19 22:34:46.133038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:34:46.133038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:34:46.133038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:34:46.133038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:46.133038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:34:46.133038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:34:46.133038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:34:46.133038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:34:46.133038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:34:46.134768 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:34:46.134768 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:34:46.134768 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:34:46.134768 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:34:46.134768 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:34:46.134768 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:34:46.134768 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:34:46.134768 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fab0a3d6-8249-4058-9ce5-90d458fff59d could not be found. Jul 19 22:34:46.134768 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:34:46.134768 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:34:46.134768 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:34:46.134768 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:46.134768 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:34:46.134768 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:34:46.134768 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:34:46.134768 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:34:46.134768 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fab0a3d6-8249-4058-9ce5-90d458fff59d could not be found. Jul 19 22:34:46.134768 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:34:46.136401 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-33cef28e-d1c7-44f7-91f8-9e09db621e50 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Returning 404 to user: Instance fab0a3d6-8249-4058-9ce5-90d458fff59d could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:34:46.136401 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-33cef28e-d1c7-44f7-91f8-9e09db621e50 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d" status: 404 len: 111 microversion: 2.1 time: 0.082381 Jul 19 22:34:46.141197 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 996/2013] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:46 2022] GET /compute/v2.1/servers/fab0a3d6-8249-4058-9ce5-90d458fff59d => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:34:46.146319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-19330d9b-92a6-46d3-a438-f4c31321ca4d tempest-ListImagesTestJSON-39807159 tempest-ListImagesTestJSON-39807159-project] Calling method '.version_select at 0x7f7a15588940>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:46.313047 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-19330d9b-92a6-46d3-a438-f4c31321ca4d tempest-ListImagesTestJSON-39807159 tempest-ListImagesTestJSON-39807159-project] 10.222.0.25 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.170763 Jul 19 22:34:46.313981 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 997/2014] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 22:34:46 2022] GET /compute/v2.1/images => generated 445 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:34:46.328287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a4149a74-a6e6-4859-9c7c-2f9ea40a9043 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '.version_select at 0x7f7a1554ee50>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:46.364095 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a4149a74-a6e6-4859-9c7c-2f9ea40a9043 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1745561648" status: 202 len: 0 microversion: 2.1 time: 0.048346 Jul 19 22:34:46.366842 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 998/2015] 10.222.0.25 () {58 vars in 1220 bytes} [Tue Jul 19 22:34:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1745561648 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:34:46.377217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-76d268ab-4d44-480d-893f-0f6f16e6d146 req-5f64e02f-a686-46d2-a86e-76e44c8d871f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b33a2a96-d4d2-4835-824d-739d006bf056", "name": "network-vif-plugged", "status": "completed", "tag": "f02a3722-57d9-4b04-bd6c-cae51d4d500c"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:34:46.402903 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-76d268ab-4d44-480d-893f-0f6f16e6d146 req-5f64e02f-a686-46d2-a86e-76e44c8d871f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:46.403419 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-76d268ab-4d44-480d-893f-0f6f16e6d146 req-5f64e02f-a686-46d2-a86e-76e44c8d871f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:46.435773 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-76d268ab-4d44-480d-893f-0f6f16e6d146 req-5f64e02f-a686-46d2-a86e-76e44c8d871f service nova] Creating event network-vif-plugged:f02a3722-57d9-4b04-bd6c-cae51d4d500c for instance b33a2a96-d4d2-4835-824d-739d006bf056 on n-h2-847009-3 Jul 19 22:34:46.450519 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-76d268ab-4d44-480d-893f-0f6f16e6d146 req-5f64e02f-a686-46d2-a86e-76e44c8d871f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081007 Jul 19 22:34:46.457629 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 999/2016] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:34:46.471517 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4357b861-54b8-4a52-9a08-5ccc129fae2f tempest-ListImagesTestJSON-39807159 tempest-ListImagesTestJSON-39807159-project] Calling method '.version_select at 0x7f7a15588430>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:46.584570 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4357b861-54b8-4a52-9a08-5ccc129fae2f tempest-ListImagesTestJSON-39807159 tempest-ListImagesTestJSON-39807159-project] 10.222.0.25 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.123747 Jul 19 22:34:46.585581 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1000/2017] 10.222.0.25 () {58 vars in 1142 bytes} [Tue Jul 19 22:34:46 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:34:46.756670 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0dd5b73e-bb83-4b69-a615-37cedd9789f2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:46.764023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0dd5b73e-bb83-4b69-a615-37cedd9789f2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:46.792545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0dd5b73e-bb83-4b69-a615-37cedd9789f2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:46.793560 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0dd5b73e-bb83-4b69-a615-37cedd9789f2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:46.795320 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0dd5b73e-bb83-4b69-a615-37cedd9789f2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:46.797091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a0967c30-a275-4260-a91a-02ecd841c645 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52bb4626ba4c00abdcbc0bed7811b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3173e6bfa06f4118842ec55c92b253de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:46.798454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0dd5b73e-bb83-4b69-a615-37cedd9789f2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:46.808461 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a0967c30-a275-4260-a91a-02ecd841c645 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] 10.222.0.25 "GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056" status: 200 len: 1395 microversion: 2.1 time: 0.724773 Jul 19 22:34:46.809092 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1018/2018] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:46 2022] GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056 => generated 1395 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:46.989811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fcca3ff6-0749-4665-86e4-a936b21a68a0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:46.991639 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fcca3ff6-0749-4665-86e4-a936b21a68a0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:47.002218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fcca3ff6-0749-4665-86e4-a936b21a68a0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:47.003492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fcca3ff6-0749-4665-86e4-a936b21a68a0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:47.005467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fcca3ff6-0749-4665-86e4-a936b21a68a0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:47.007080 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fcca3ff6-0749-4665-86e4-a936b21a68a0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:47.534383 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fcca3ff6-0749-4665-86e4-a936b21a68a0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:47.616228 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fcca3ff6-0749-4665-86e4-a936b21a68a0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 200 len: 1485 microversion: 2.1 time: 0.631296 Jul 19 22:34:47.628908 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1019/2019] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:46 2022] GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 1485 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:47.726629 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-55c78834-73e0-4bfe-bcf6-04536c5034c8 req-699c2f2e-f5c5-44c7-ada9-99cae5ec2bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b7e41a-9a4f-469b-9561-5f798bebeb47", "name": "network-vif-deleted", "tag": "bdefef3a-0ad4-4933-8e01-30907c25ee76"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:34:47.754927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-55c78834-73e0-4bfe-bcf6-04536c5034c8 req-699c2f2e-f5c5-44c7-ada9-99cae5ec2bf8 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:47.761735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-55c78834-73e0-4bfe-bcf6-04536c5034c8 req-699c2f2e-f5c5-44c7-ada9-99cae5ec2bf8 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:47.838535 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-55c78834-73e0-4bfe-bcf6-04536c5034c8 req-699c2f2e-f5c5-44c7-ada9-99cae5ec2bf8 service nova] Creating event network-vif-deleted:bdefef3a-0ad4-4933-8e01-30907c25ee76 for instance 44b7e41a-9a4f-469b-9561-5f798bebeb47 on n-h2-847009-3 Jul 19 22:34:47.863797 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-55c78834-73e0-4bfe-bcf6-04536c5034c8 req-699c2f2e-f5c5-44c7-ada9-99cae5ec2bf8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139368 Jul 19 22:34:47.868157 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1020/2020] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:34:47.886598 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b2cd0797-d09e-4f29-b09f-d00e9d5d8591 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:47.915542 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b2cd0797-d09e-4f29-b09f-d00e9d5d8591 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] [instance: b33a2a96-d4d2-4835-824d-739d006bf056] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:47.950406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b2cd0797-d09e-4f29-b09f-d00e9d5d8591 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:47.951446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b2cd0797-d09e-4f29-b09f-d00e9d5d8591 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:47.952522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b2cd0797-d09e-4f29-b09f-d00e9d5d8591 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:47.953937 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b2cd0797-d09e-4f29-b09f-d00e9d5d8591 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:48.292615 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0dd5b73e-bb83-4b69-a615-37cedd9789f2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:48.314829 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0dd5b73e-bb83-4b69-a615-37cedd9789f2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:48.321616 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0dd5b73e-bb83-4b69-a615-37cedd9789f2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:48.325648 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0dd5b73e-bb83-4b69-a615-37cedd9789f2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1487 microversion: 2.25 time: 1.582274 Jul 19 22:34:48.342103 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1001/2021] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:34:46 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1487 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:34:48.350621 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-b321448a-9b09-48f3-aa4a-e4b33c15ba70 req-cd9ecbc9-cc6d-40c2-a51d-ec4143736a8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f2b8c66-5ac4-42bd-afe7-e283eba41078", "tag": "7697d6fa-c774-468b-a275-a40743f7894f"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:34:48.367006 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b321448a-9b09-48f3-aa4a-e4b33c15ba70 req-cd9ecbc9-cc6d-40c2-a51d-ec4143736a8d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:48.367957 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b321448a-9b09-48f3-aa4a-e4b33c15ba70 req-cd9ecbc9-cc6d-40c2-a51d-ec4143736a8d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:48.412940 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-b321448a-9b09-48f3-aa4a-e4b33c15ba70 req-cd9ecbc9-cc6d-40c2-a51d-ec4143736a8d service nova] Creating event network-changed:7697d6fa-c774-468b-a275-a40743f7894f for instance 9f2b8c66-5ac4-42bd-afe7-e283eba41078 on n-h1-847009-3 Jul 19 22:34:48.437039 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-b321448a-9b09-48f3-aa4a-e4b33c15ba70 req-cd9ecbc9-cc6d-40c2-a51d-ec4143736a8d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091424 Jul 19 22:34:48.438551 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1002/2022] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:34:48.702182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0233885e-95cf-4103-83b0-610939a6d0c0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:48.728449 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0233885e-95cf-4103-83b0-610939a6d0c0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:48.820726 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0233885e-95cf-4103-83b0-610939a6d0c0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:48.827860 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0233885e-95cf-4103-83b0-610939a6d0c0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:48.843090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0233885e-95cf-4103-83b0-610939a6d0c0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:48.845024 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0233885e-95cf-4103-83b0-610939a6d0c0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:48.974027 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b2cd0797-d09e-4f29-b09f-d00e9d5d8591 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52bb4626ba4c00abdcbc0bed7811b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3173e6bfa06f4118842ec55c92b253de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:49.026580 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b2cd0797-d09e-4f29-b09f-d00e9d5d8591 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] 10.222.0.25 "GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056" status: 200 len: 1395 microversion: 2.1 time: 1.154658 Jul 19 22:34:49.028934 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1021/2023] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:47 2022] GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056 => generated 1395 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:49.051966 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0233885e-95cf-4103-83b0-610939a6d0c0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:49.054833 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0233885e-95cf-4103-83b0-610939a6d0c0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:49.062448 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-0233885e-95cf-4103-83b0-610939a6d0c0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lazy-loading 'fault' on Instance uuid 44b7e41a-9a4f-469b-9561-5f798bebeb47 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:34:49.372492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6fbc98a2-206f-4f4b-bfdb-1314ebcf4d0b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:49.374986 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6fbc98a2-206f-4f4b-bfdb-1314ebcf4d0b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:49.422360 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6fbc98a2-206f-4f4b-bfdb-1314ebcf4d0b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:49.425002 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6fbc98a2-206f-4f4b-bfdb-1314ebcf4d0b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:49.429373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6fbc98a2-206f-4f4b-bfdb-1314ebcf4d0b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:49.432908 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6fbc98a2-206f-4f4b-bfdb-1314ebcf4d0b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:49.438200 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0233885e-95cf-4103-83b0-610939a6d0c0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:49.474609 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0233885e-95cf-4103-83b0-610939a6d0c0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 200 len: 1313 microversion: 2.1 time: 0.829423 Jul 19 22:34:49.477589 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1003/2024] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:48 2022] GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 1313 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:34:50.068507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fc669cd8-bf7d-4a09-bea7-19615987c0eb tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:50.069668 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fc669cd8-bf7d-4a09-bea7-19615987c0eb tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] [instance: b33a2a96-d4d2-4835-824d-739d006bf056] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:50.095818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc669cd8-bf7d-4a09-bea7-19615987c0eb tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:50.097034 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc669cd8-bf7d-4a09-bea7-19615987c0eb tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:50.101014 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc669cd8-bf7d-4a09-bea7-19615987c0eb tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:50.103241 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc669cd8-bf7d-4a09-bea7-19615987c0eb tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:50.413602 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6fbc98a2-206f-4f4b-bfdb-1314ebcf4d0b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:50.443821 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6fbc98a2-206f-4f4b-bfdb-1314ebcf4d0b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:50.450401 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6fbc98a2-206f-4f4b-bfdb-1314ebcf4d0b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:50.461705 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6fbc98a2-206f-4f4b-bfdb-1314ebcf4d0b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1487 microversion: 2.25 time: 1.106066 Jul 19 22:34:50.484666 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1022/2025] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:34:49 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1487 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:34:50.510324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a9bffa79-1bb0-4a11-8974-817d5279e506 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:50.512541 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a9bffa79-1bb0-4a11-8974-817d5279e506 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:50.528280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9bffa79-1bb0-4a11-8974-817d5279e506 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:50.529309 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9bffa79-1bb0-4a11-8974-817d5279e506 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:50.531412 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9bffa79-1bb0-4a11-8974-817d5279e506 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:50.532443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9bffa79-1bb0-4a11-8974-817d5279e506 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:50.599455 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a9bffa79-1bb0-4a11-8974-817d5279e506 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:34:50.809769 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a9bffa79-1bb0-4a11-8974-817d5279e506 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 204 len: 0 microversion: 2.1 time: 0.322820 Jul 19 22:34:50.811583 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1023/2026] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:34:50 2022] DELETE /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:34:50.823129 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3c156bfc-f667-422e-90bb-67007d0a1e72 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:50.824772 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3c156bfc-f667-422e-90bb-67007d0a1e72 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:50.836762 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c156bfc-f667-422e-90bb-67007d0a1e72 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:50.838921 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c156bfc-f667-422e-90bb-67007d0a1e72 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:50.840630 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c156bfc-f667-422e-90bb-67007d0a1e72 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:50.841598 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c156bfc-f667-422e-90bb-67007d0a1e72 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:50.867152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fc669cd8-bf7d-4a09-bea7-19615987c0eb tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52bb4626ba4c00abdcbc0bed7811b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3173e6bfa06f4118842ec55c92b253de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:50.894477 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fc669cd8-bf7d-4a09-bea7-19615987c0eb tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] 10.222.0.25 "GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056" status: 200 len: 1575 microversion: 2.1 time: 0.838624 Jul 19 22:34:50.897403 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-3c156bfc-f667-422e-90bb-67007d0a1e72 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] HTTP exception thrown: Instance 44b7e41a-9a4f-469b-9561-5f798bebeb47 could not be found. Jul 19 22:34:50.903610 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1004/2027] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:50 2022] GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056 => generated 1575 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:50.907490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3c156bfc-f667-422e-90bb-67007d0a1e72 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Request method failure captured: Jul 19 22:34:50.907490 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 HTTP/1.1 Jul 19 22:34:50.907490 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:34:50.907490 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:34:50.907490 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:34:50.907490 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:34:50.907490 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:34:50.907490 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:34:50.907490 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:34:50.907490 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:34:50.907490 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zFSA7GyoHNV6r8lt0QaILXtfyjU87DAOplAZjQU_9SUIJAdMw3TfBxiMnSQsWy218lpl-le3iOg2K6ZI4fs9ORwE8JiU3d4qrQtSVE6mLVRBodkQTjds8wHcIk6jUHzr1JjH374IFd8C1hu4WJXkMpF_7JvVJQyRRP5WIIvershcNo Jul 19 22:34:50.907490 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:34:50.907490 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:34:50.907490 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:34:50.907490 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:34:50.907490 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:34:50.907490 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:34:50.907490 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:34:50.907490 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:34:50.907490 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:34:50.907490 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:34:50.911101 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:34:50.911101 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:34:50.911101 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:34:50.911101 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:34:50.911101 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:34:50.911101 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:34:50.911101 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:34:50.911101 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: ecca13a073e7447591944e6604d67e4c Jul 19 22:34:50.911101 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:34:50.911101 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:34:50.911101 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 44b7e41a-9a4f-469b-9561-5f798bebeb47 could not be found. Jul 19 22:34:50.911101 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '44b7e41a-9a4f-469b-9561-5f798bebeb47'} Jul 19 22:34:50.913069 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:34:50.913069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:50.913069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:34:50.913069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:34:50.913069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:34:50.913069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:34:50.913069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:34:50.913069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:34:50.913069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:34:50.913069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:34:50.913069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44b7e41a-9a4f-469b-9561-5f798bebeb47 could not be found. Jul 19 22:34:50.913069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:50.913069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:34:50.913069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:50.913069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:50.913069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:34:50.913069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:34:50.913069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:34:50.913069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:34:50.913069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:34:50.916143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:34:50.916143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:34:50.916143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:34:50.916143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:34:50.916143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:34:50.916143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:34:50.916143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:34:50.916143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44b7e41a-9a4f-469b-9561-5f798bebeb47 could not be found. Jul 19 22:34:50.916143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:50.916143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:34:50.916143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:50.916143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:50.916143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:34:50.916143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:34:50.916143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:34:50.916143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:34:50.916143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44b7e41a-9a4f-469b-9561-5f798bebeb47 could not be found. Jul 19 22:34:50.916143 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:50.923221 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3c156bfc-f667-422e-90bb-67007d0a1e72 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Returning 404 to user: Instance 44b7e41a-9a4f-469b-9561-5f798bebeb47 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:34:50.925125 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3c156bfc-f667-422e-90bb-67007d0a1e72 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 404 len: 111 microversion: 2.1 time: 0.111100 Jul 19 22:34:50.929847 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1024/2028] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:50 2022] GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:34:50.936997 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7bf73d17-06a7-43ed-9555-c13cbe85d97a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:50.939646 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7bf73d17-06a7-43ed-9555-c13cbe85d97a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:50.954691 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a7bd6f03-476c-434a-bacf-d53081ec906f tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:50.956107 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a7bd6f03-476c-434a-bacf-d53081ec906f tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] [instance: b33a2a96-d4d2-4835-824d-739d006bf056] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:50.967668 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bf73d17-06a7-43ed-9555-c13cbe85d97a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:50.969821 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bf73d17-06a7-43ed-9555-c13cbe85d97a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:50.972323 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bf73d17-06a7-43ed-9555-c13cbe85d97a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:50.976729 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bf73d17-06a7-43ed-9555-c13cbe85d97a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:50.980945 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:34:50.986841 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a7bd6f03-476c-434a-bacf-d53081ec906f tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:50.988122 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a7bd6f03-476c-434a-bacf-d53081ec906f tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:50.990397 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a7bd6f03-476c-434a-bacf-d53081ec906f tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:50.991612 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a7bd6f03-476c-434a-bacf-d53081ec906f tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:51.152337 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a7bd6f03-476c-434a-bacf-d53081ec906f tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] 10.222.0.25 "GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.220637 Jul 19 22:34:51.153124 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1025/2029] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 19 22:34:50 2022] GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056/os-interface => generated 284 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:34:51.158223 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-094b2fbf-f495-4ad9-a2cf-9fb48f806379 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Action: 'create', calling method: .version_select at 0x7f7a03f6eee0>, body: {"keypair": {"name": "tempest-keypair-725684013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnu20+HGCOEhhWxvw2OfprdaqS6k1NUZ+JYUn4ilWVH1kwJ/R3O1rVOtHB5wyFYvSKXIGjKuKU2rfAVyKk9FwhiRWCdFPvdcahDoGiqZDKYlyhy2Qzp9wJ3/7dUZw4GaQ=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:34:51.216558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-094b2fbf-f495-4ad9-a2cf-9fb48f806379 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Getting quotas for project 3eca98474bca4a64af425dffb9ecb5b3. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:34:51.231324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-094b2fbf-f495-4ad9-a2cf-9fb48f806379 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Getting quotas for user ecca13a073e7447591944e6604d67e4c and project 3eca98474bca4a64af425dffb9ecb5b3. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:34:51.282614 n-d-847009-3 devstack@n-api.service[119337]: ERROR oslo.messaging._drivers.impl_rabbit [None req-094b2fbf-f495-4ad9-a2cf-9fb48f806379 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [5306ea33-f0bc-4078-9200-2b5cfa51f96d] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 22:34:52.293301 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [None req-094b2fbf-f495-4ad9-a2cf-9fb48f806379 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [5306ea33-f0bc-4078-9200-2b5cfa51f96d] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39646. Jul 19 22:34:52.321140 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-094b2fbf-f495-4ad9-a2cf-9fb48f806379 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.163354 Jul 19 22:34:52.324454 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1026/2030] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:34:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:34:52.346849 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c0279452-1214-4164-9d22-3015aa8b0cd2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:52.348279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c0279452-1214-4164-9d22-3015aa8b0cd2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:52.373837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c0279452-1214-4164-9d22-3015aa8b0cd2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:52.374716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c0279452-1214-4164-9d22-3015aa8b0cd2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:52.375707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c0279452-1214-4164-9d22-3015aa8b0cd2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:52.376315 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c0279452-1214-4164-9d22-3015aa8b0cd2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:52.418522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:34:53.640952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7bf73d17-06a7-43ed-9555-c13cbe85d97a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:53.659055 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7bf73d17-06a7-43ed-9555-c13cbe85d97a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 200 len: 1485 microversion: 2.1 time: 2.753458 Jul 19 22:34:53.662662 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1005/2031] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:50 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 1485 bytes in 2758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:53.679534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-3fd486e2-e60e-47bb-8056-6fefff848e21 req-f1b8a1cd-3d2d-4705-b001-a041fbe12b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f2b8c66-5ac4-42bd-afe7-e283eba41078", "name": "network-vif-unplugged", "status": "completed", "tag": "7697d6fa-c774-468b-a275-a40743f7894f"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:34:53.708446 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-3fd486e2-e60e-47bb-8056-6fefff848e21 req-f1b8a1cd-3d2d-4705-b001-a041fbe12b1e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:53.716747 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-3fd486e2-e60e-47bb-8056-6fefff848e21 req-f1b8a1cd-3d2d-4705-b001-a041fbe12b1e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:53.775146 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-3fd486e2-e60e-47bb-8056-6fefff848e21 req-f1b8a1cd-3d2d-4705-b001-a041fbe12b1e service nova] Creating event network-vif-unplugged:7697d6fa-c774-468b-a275-a40743f7894f for instance 9f2b8c66-5ac4-42bd-afe7-e283eba41078 on n-h1-847009-3 Jul 19 22:34:53.803073 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-3fd486e2-e60e-47bb-8056-6fefff848e21 req-f1b8a1cd-3d2d-4705-b001-a041fbe12b1e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138349 Jul 19 22:34:53.806264 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1006/2032] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:34:53.826458 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-5ed2215f-2799-4233-a9b2-4bcaa891b05e req-7c0c2f7b-89ef-4f78-b139-c1f5809cca08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f752d932-1177-43ae-89b0-86a439bb446a", "name": "network-vif-deleted", "tag": "9795f500-4e5c-483d-95e2-204859a4140a"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:34:53.916149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c0279452-1214-4164-9d22-3015aa8b0cd2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:53.932541 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5ed2215f-2799-4233-a9b2-4bcaa891b05e req-7c0c2f7b-89ef-4f78-b139-c1f5809cca08 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:53.953790 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5ed2215f-2799-4233-a9b2-4bcaa891b05e req-7c0c2f7b-89ef-4f78-b139-c1f5809cca08 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:53.981936 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c0279452-1214-4164-9d22-3015aa8b0cd2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:53.997914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c0279452-1214-4164-9d22-3015aa8b0cd2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:54.012761 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c0279452-1214-4164-9d22-3015aa8b0cd2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1487 microversion: 2.25 time: 1.681338 Jul 19 22:34:54.015764 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1027/2033] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:34:52 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1487 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:34:54.026615 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-5ed2215f-2799-4233-a9b2-4bcaa891b05e req-7c0c2f7b-89ef-4f78-b139-c1f5809cca08 service nova] Creating event network-vif-deleted:9795f500-4e5c-483d-95e2-204859a4140a for instance f752d932-1177-43ae-89b0-86a439bb446a on n-h2-847009-3 Jul 19 22:34:54.055571 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-5ed2215f-2799-4233-a9b2-4bcaa891b05e req-7c0c2f7b-89ef-4f78-b139-c1f5809cca08 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.241187 Jul 19 22:34:54.059511 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1007/2034] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:34:54.682051 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fa9e3a01-02a8-4fe1-8b1b-2a965b911a6a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:54.683165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fa9e3a01-02a8-4fe1-8b1b-2a965b911a6a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: f752d932-1177-43ae-89b0-86a439bb446a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:54.706333 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa9e3a01-02a8-4fe1-8b1b-2a965b911a6a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:54.708265 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa9e3a01-02a8-4fe1-8b1b-2a965b911a6a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:54.713926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa9e3a01-02a8-4fe1-8b1b-2a965b911a6a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:54.714601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa9e3a01-02a8-4fe1-8b1b-2a965b911a6a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:54.748531 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-fa9e3a01-02a8-4fe1-8b1b-2a965b911a6a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] HTTP exception thrown: Instance f752d932-1177-43ae-89b0-86a439bb446a could not be found. Jul 19 22:34:54.750186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fa9e3a01-02a8-4fe1-8b1b-2a965b911a6a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Request method failure captured: Jul 19 22:34:54.750186 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a HTTP/1.1 Jul 19 22:34:54.750186 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:34:54.750186 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:34:54.750186 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:34:54.750186 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:34:54.750186 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:34:54.750186 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:34:54.750186 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:34:54.750186 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:34:54.750186 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y9tGEg_0UM-7e0R_jLZscl6npd6EBaoASmTirv5jPYL9hGXCfnXWRTk1mNbU38hxkmKLGBF_JsMgnSxj3iicL-lkJn2EDnv_FsqbzFmmoHtrZKC8Hc58JLWQbASWlyM45z3q-kz-L0ioJwenPhwXIpyJ2_LBJo2kw0RVOmMp1OTHDI Jul 19 22:34:54.750186 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:34:54.750186 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:34:54.750186 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:34:54.750186 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:34:54.750186 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:34:54.750186 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:34:54.750186 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 2619b807c1ee4dca858dae47c4686ba2 Jul 19 22:34:54.750186 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-LiveMigrationTest-203877293 Jul 19 22:34:54.750186 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:34:54.750186 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:34:54.751791 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2619b807c1ee4dca858dae47c4686ba2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2619b807c1ee4dca858dae47c4686ba2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2619b807c1ee4dca858dae47c4686ba2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2619b807c1ee4dca858dae47c4686ba2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:34:54.751791 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-LiveMigrationTest-203877293 Jul 19 22:34:54.751791 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 2619b807c1ee4dca858dae47c4686ba2 Jul 19 22:34:54.751791 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-LiveMigrationTest-203877293 Jul 19 22:34:54.751791 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-LiveMigrationTest-203877293-project Jul 19 22:34:54.751791 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:34:54.751791 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:34:54.751791 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 55a214cbc1ec4cdb80ccf736f4251964 Jul 19 22:34:54.751791 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-LiveMigrationTest-203877293-project Jul 19 22:34:54.751791 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:34:54.751791 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance f752d932-1177-43ae-89b0-86a439bb446a could not be found. Jul 19 22:34:54.751791 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'f752d932-1177-43ae-89b0-86a439bb446a'} Jul 19 22:34:54.752622 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:34:54.752622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:54.752622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:34:54.752622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:34:54.752622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:34:54.752622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:34:54.752622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:34:54.752622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:34:54.752622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:34:54.752622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:34:54.752622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f752d932-1177-43ae-89b0-86a439bb446a could not be found. Jul 19 22:34:54.752622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:54.752622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:34:54.752622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:54.752622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:54.752622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:34:54.752622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:34:54.752622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:34:54.752622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:34:54.752622 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:34:54.754713 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:34:54.754713 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:34:54.754713 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:34:54.754713 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:34:54.754713 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:34:54.754713 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:34:54.754713 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:34:54.754713 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f752d932-1177-43ae-89b0-86a439bb446a could not be found. Jul 19 22:34:54.754713 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:54.754713 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:34:54.754713 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:54.754713 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:34:54.754713 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:34:54.754713 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:34:54.754713 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:34:54.754713 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:34:54.754713 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f752d932-1177-43ae-89b0-86a439bb446a could not be found. Jul 19 22:34:54.754713 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:34:54.761278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fa9e3a01-02a8-4fe1-8b1b-2a965b911a6a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Returning 404 to user: Instance f752d932-1177-43ae-89b0-86a439bb446a could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:34:54.761278 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fa9e3a01-02a8-4fe1-8b1b-2a965b911a6a tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a" status: 404 len: 111 microversion: 2.1 time: 0.080928 Jul 19 22:34:54.761278 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1028/2035] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:54 2022] GET /compute/v2.1/servers/f752d932-1177-43ae-89b0-86a439bb446a => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:34:54.766727 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5338a6ee-e938-45e9-9c8d-24f0385f5af9 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:54.767380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5338a6ee-e938-45e9-9c8d-24f0385f5af9 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:54.791216 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5338a6ee-e938-45e9-9c8d-24f0385f5af9 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:54.791683 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5338a6ee-e938-45e9-9c8d-24f0385f5af9 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:54.792497 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5338a6ee-e938-45e9-9c8d-24f0385f5af9 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:54.792943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5338a6ee-e938-45e9-9c8d-24f0385f5af9 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:54.891850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5338a6ee-e938-45e9-9c8d-24f0385f5af9 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:34:55.046374 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2839d686-43aa-485c-849c-ae410ac69c1d tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:55.047768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2839d686-43aa-485c-849c-ae410ac69c1d tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:55.060186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2839d686-43aa-485c-849c-ae410ac69c1d tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:55.062656 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2839d686-43aa-485c-849c-ae410ac69c1d tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:55.065817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2839d686-43aa-485c-849c-ae410ac69c1d tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:55.067237 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2839d686-43aa-485c-849c-ae410ac69c1d tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:55.076652 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5338a6ee-e938-45e9-9c8d-24f0385f5af9 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 204 len: 0 microversion: 2.1 time: 0.314643 Jul 19 22:34:55.081468 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1008/2036] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:34:54 2022] DELETE /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:34:55.094711 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-092a4ca1-61b3-4c58-b620-4aba283fb946 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:55.098755 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-092a4ca1-61b3-4c58-b620-4aba283fb946 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:55.110146 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-092a4ca1-61b3-4c58-b620-4aba283fb946 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:55.113606 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-092a4ca1-61b3-4c58-b620-4aba283fb946 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:55.114702 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-092a4ca1-61b3-4c58-b620-4aba283fb946 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:55.115387 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-092a4ca1-61b3-4c58-b620-4aba283fb946 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:57.241417 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-092a4ca1-61b3-4c58-b620-4aba283fb946 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:57.254522 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-092a4ca1-61b3-4c58-b620-4aba283fb946 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 200 len: 1500 microversion: 2.1 time: 2.169824 Jul 19 22:34:57.255162 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1009/2037] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:55 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 1500 bytes in 2173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:57.396944 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7962e79e-c498-4b3e-8453-53325f50e664 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-555012839", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "e6e615b9-ea1e-442a-be42-579fb635f15f"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:34:57.542982 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-7962e79e-c498-4b3e-8453-53325f50e664 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] validate_networks() for [('e6e615b9-ea1e-442a-be42-579fb635f15f', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:34:58.566481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2839d686-43aa-485c-849c-ae410ac69c1d tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:58.598492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2839d686-43aa-485c-849c-ae410ac69c1d tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:58.602456 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2839d686-43aa-485c-849c-ae410ac69c1d tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:58.605815 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2839d686-43aa-485c-849c-ae410ac69c1d tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1487 microversion: 2.25 time: 3.563398 Jul 19 22:34:58.620304 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1029/2038] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:34:55 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1487 bytes in 3578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:34:58.636267 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8f1d6e62-093a-465b-97ca-bcad08dcdc4c tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:58.637193 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8f1d6e62-093a-465b-97ca-bcad08dcdc4c tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:58.652227 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f1d6e62-093a-465b-97ca-bcad08dcdc4c tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:58.652965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f1d6e62-093a-465b-97ca-bcad08dcdc4c tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:58.653989 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f1d6e62-093a-465b-97ca-bcad08dcdc4c tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:58.654627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f1d6e62-093a-465b-97ca-bcad08dcdc4c tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:59.807119 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8f1d6e62-093a-465b-97ca-bcad08dcdc4c tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a214cbc1ec4cdb80ccf736f4251964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2619b807c1ee4dca858dae47c4686ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:34:59.828025 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8f1d6e62-093a-465b-97ca-bcad08dcdc4c tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 200 len: 1500 microversion: 2.1 time: 1.205974 Jul 19 22:34:59.828641 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1030/2039] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:34:58 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 1500 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:34:59.855394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dce7df38-909f-4be6-8a63-b609b8cf18ff tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:34:59.856275 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dce7df38-909f-4be6-8a63-b609b8cf18ff tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:34:59.891500 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dce7df38-909f-4be6-8a63-b609b8cf18ff tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:59.892483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dce7df38-909f-4be6-8a63-b609b8cf18ff tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:34:59.893539 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dce7df38-909f-4be6-8a63-b609b8cf18ff tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:34:59.894698 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dce7df38-909f-4be6-8a63-b609b8cf18ff tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:01.186196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dce7df38-909f-4be6-8a63-b609b8cf18ff tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:01.214773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dce7df38-909f-4be6-8a63-b609b8cf18ff tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:01.221047 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dce7df38-909f-4be6-8a63-b609b8cf18ff tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:01.226234 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dce7df38-909f-4be6-8a63-b609b8cf18ff tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1487 microversion: 2.25 time: 1.383145 Jul 19 22:35:01.230733 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1031/2040] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:34:59 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1487 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:01.246444 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-38938b10-2719-4717-9119-e93a65ebd911 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:01.247547 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-38938b10-2719-4717-9119-e93a65ebd911 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] [instance: b33a2a96-d4d2-4835-824d-739d006bf056] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:01.261576 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=4 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:35:01.268366 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-38938b10-2719-4717-9119-e93a65ebd911 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:01.269916 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-38938b10-2719-4717-9119-e93a65ebd911 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:01.272016 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-38938b10-2719-4717-9119-e93a65ebd911 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:01.273189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-38938b10-2719-4717-9119-e93a65ebd911 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:02.403203 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-7962e79e-c498-4b3e-8453-53325f50e664 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:35:02.403203 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-7962e79e-c498-4b3e-8453-53325f50e664 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:35:02.403664 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-7962e79e-c498-4b3e-8453-53325f50e664 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:35:02.403979 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-7962e79e-c498-4b3e-8453-53325f50e664 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:35:02.404822 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-7962e79e-c498-4b3e-8453-53325f50e664 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:35:02.422220 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7962e79e-c498-4b3e-8453-53325f50e664 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:02.422675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7962e79e-c498-4b3e-8453-53325f50e664 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:02.423523 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7962e79e-c498-4b3e-8453-53325f50e664 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:02.436575 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7962e79e-c498-4b3e-8453-53325f50e664 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:02.502804 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-7962e79e-c498-4b3e-8453-53325f50e664 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Getting quotas for project 52bcd0bd2cd24c5d86494a3af2d25d59. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:35:02.520211 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-7962e79e-c498-4b3e-8453-53325f50e664 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Getting quotas for user 7a8abba155f841cea0212bbaad5462ac and project 52bcd0bd2cd24c5d86494a3af2d25d59. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:35:02.544581 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7962e79e-c498-4b3e-8453-53325f50e664 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Going to run 2 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:35:02.548453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7962e79e-c498-4b3e-8453-53325f50e664 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: df9fcf88-5d46-4ed8-b799-faf22cc244f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:35:02.609401 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7962e79e-c498-4b3e-8453-53325f50e664 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: eef47923-4943-4736-acb5-5faa2775329e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=df9fcf88-5d46-4ed8-b799-faf22cc244f1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:35:02.730364 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-38938b10-2719-4717-9119-e93a65ebd911 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52bb4626ba4c00abdcbc0bed7811b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3173e6bfa06f4118842ec55c92b253de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:02.739046 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7962e79e-c498-4b3e-8453-53325f50e664 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.481460 Jul 19 22:35:02.746969 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1010/2041] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:34:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 5487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:35:02.749738 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-38938b10-2719-4717-9119-e93a65ebd911 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] 10.222.0.25 "GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056" status: 200 len: 1575 microversion: 2.1 time: 1.512252 Jul 19 22:35:02.750365 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1032/2042] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:01 2022] GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056 => generated 1575 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:02.767378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ad1caa21-e023-4d5f-ad79-f36cad22ce69 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:02.768033 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ad1caa21-e023-4d5f-ad79-f36cad22ce69 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] [instance: 6dc2efca-6346-4a22-999b-5a1fa57dcee9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:02.779810 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-45e8d9de-fb0f-47c2-808c-ca989d65f970 req-f3435279-d689-4245-b9d4-81a6141bfab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b33a2a96-d4d2-4835-824d-739d006bf056", "tag": "f02a3722-57d9-4b04-bd6c-cae51d4d500c"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:02.787481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad1caa21-e023-4d5f-ad79-f36cad22ce69 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:02.787934 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad1caa21-e023-4d5f-ad79-f36cad22ce69 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:02.788735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad1caa21-e023-4d5f-ad79-f36cad22ce69 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:02.789173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad1caa21-e023-4d5f-ad79-f36cad22ce69 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:02.801861 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-45e8d9de-fb0f-47c2-808c-ca989d65f970 req-f3435279-d689-4245-b9d4-81a6141bfab3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:02.802953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-45e8d9de-fb0f-47c2-808c-ca989d65f970 req-f3435279-d689-4245-b9d4-81a6141bfab3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:02.829776 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-ad1caa21-e023-4d5f-ad79-f36cad22ce69 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] HTTP exception thrown: Instance 6dc2efca-6346-4a22-999b-5a1fa57dcee9 could not be found. Jul 19 22:35:02.836386 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-45e8d9de-fb0f-47c2-808c-ca989d65f970 req-f3435279-d689-4245-b9d4-81a6141bfab3 service nova] Creating event network-changed:f02a3722-57d9-4b04-bd6c-cae51d4d500c for instance b33a2a96-d4d2-4835-824d-739d006bf056 on n-h2-847009-3 Jul 19 22:35:02.838160 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ad1caa21-e023-4d5f-ad79-f36cad22ce69 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Request method failure captured: Jul 19 22:35:02.838160 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 HTTP/1.1 Jul 19 22:35:02.838160 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:35:02.838160 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:35:02.838160 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:35:02.838160 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:35:02.838160 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:35:02.838160 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:35:02.838160 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:35:02.838160 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:35:02.838160 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y9tGEg_0UM-7e0R_jLZscl6npd6EBaoASmTirv5jPYL9hGXCfnXWRTk1mNbU38hxkmKLGBF_JsMgnSxj3iicL-lkJn2EDnv_FsqbzFmmoHtrZKC8Hc58JLWQbASWlyM45z3q-kz-L0ioJwenPhwXIpyJ2_LBJo2kw0RVOmMp1OTHDI Jul 19 22:35:02.838160 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:35:02.838160 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:35:02.838160 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:35:02.838160 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:35:02.838160 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:35:02.838160 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:35:02.838160 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 2619b807c1ee4dca858dae47c4686ba2 Jul 19 22:35:02.838160 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-LiveMigrationTest-203877293 Jul 19 22:35:02.838160 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:35:02.838160 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:35:02.839772 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2619b807c1ee4dca858dae47c4686ba2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2619b807c1ee4dca858dae47c4686ba2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2619b807c1ee4dca858dae47c4686ba2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2619b807c1ee4dca858dae47c4686ba2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:35:02.839772 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-LiveMigrationTest-203877293 Jul 19 22:35:02.839772 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 2619b807c1ee4dca858dae47c4686ba2 Jul 19 22:35:02.839772 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-LiveMigrationTest-203877293 Jul 19 22:35:02.839772 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-LiveMigrationTest-203877293-project Jul 19 22:35:02.839772 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:35:02.839772 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:35:02.839772 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 55a214cbc1ec4cdb80ccf736f4251964 Jul 19 22:35:02.839772 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-LiveMigrationTest-203877293-project Jul 19 22:35:02.839772 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:35:02.839772 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 6dc2efca-6346-4a22-999b-5a1fa57dcee9 could not be found. Jul 19 22:35:02.839772 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '6dc2efca-6346-4a22-999b-5a1fa57dcee9'} Jul 19 22:35:02.840657 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:35:02.840657 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:02.840657 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:35:02.840657 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:35:02.840657 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:35:02.840657 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:35:02.840657 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:35:02.840657 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:35:02.840657 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:35:02.840657 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:35:02.840657 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dc2efca-6346-4a22-999b-5a1fa57dcee9 could not be found. Jul 19 22:35:02.840657 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:02.840657 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:35:02.840657 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:02.840657 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:02.840657 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:35:02.840657 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:35:02.840657 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:35:02.840657 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:35:02.840657 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:35:02.842037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:35:02.842037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:35:02.842037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:35:02.842037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:35:02.842037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:35:02.842037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:35:02.842037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:35:02.842037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dc2efca-6346-4a22-999b-5a1fa57dcee9 could not be found. Jul 19 22:35:02.842037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:02.842037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:35:02.842037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:02.842037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:02.842037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:35:02.842037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:35:02.842037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:35:02.842037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:35:02.842037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dc2efca-6346-4a22-999b-5a1fa57dcee9 could not be found. Jul 19 22:35:02.842037 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:02.845527 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ad1caa21-e023-4d5f-ad79-f36cad22ce69 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] Returning 404 to user: Instance 6dc2efca-6346-4a22-999b-5a1fa57dcee9 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:35:02.845527 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ad1caa21-e023-4d5f-ad79-f36cad22ce69 tempest-LiveMigrationTest-203877293 tempest-LiveMigrationTest-203877293-project] 10.222.0.25 "GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9" status: 404 len: 111 microversion: 2.1 time: 0.088474 Jul 19 22:35:02.845527 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1033/2043] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:02 2022] GET /compute/v2.1/servers/6dc2efca-6346-4a22-999b-5a1fa57dcee9 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:35:02.847683 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-45e8d9de-fb0f-47c2-808c-ca989d65f970 req-f3435279-d689-4245-b9d4-81a6141bfab3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103041 Jul 19 22:35:02.851893 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1011/2044] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:02.856137 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-784b97a2-c9db-4abf-bd41-0e06a06100d5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:02.863740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-784b97a2-c9db-4abf-bd41-0e06a06100d5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:02.877535 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-784b97a2-c9db-4abf-bd41-0e06a06100d5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:02.878640 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-784b97a2-c9db-4abf-bd41-0e06a06100d5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:02.879934 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-784b97a2-c9db-4abf-bd41-0e06a06100d5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:02.883918 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-280512d9-7d98-4d2b-9920-9c2150e0d039 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:02.894568 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-784b97a2-c9db-4abf-bd41-0e06a06100d5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:02.897860 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-280512d9-7d98-4d2b-9920-9c2150e0d039 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7a8abba155f841cea0212bbaad5462ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:02.898694 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-280512d9-7d98-4d2b-9920-9c2150e0d039 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Searching by: {'deleted': False, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59'} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:35:02.943212 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-280512d9-7d98-4d2b-9920-9c2150e0d039 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:02.944311 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-280512d9-7d98-4d2b-9920-9c2150e0d039 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:02.946030 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-280512d9-7d98-4d2b-9920-9c2150e0d039 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:02.946498 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-280512d9-7d98-4d2b-9920-9c2150e0d039 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:02.977858 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-280512d9-7d98-4d2b-9920-9c2150e0d039 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.122948 Jul 19 22:35:02.979120 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1012/2045] 10.222.0.25 () {58 vars in 1124 bytes} [Tue Jul 19 22:35:02 2022] GET /compute/v2.1/servers => generated 675 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:02.995635 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f5ee9e85-6d40-4f15-bbcd-df0438049b70 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:02.996614 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f5ee9e85-6d40-4f15-bbcd-df0438049b70 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: eef47923-4943-4736-acb5-5faa2775329e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:03.409967 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f5ee9e85-6d40-4f15-bbcd-df0438049b70 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8abba155f841cea0212bbaad5462ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:03.419201 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f5ee9e85-6d40-4f15-bbcd-df0438049b70 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers/eef47923-4943-4736-acb5-5faa2775329e" status: 200 len: 1219 microversion: 2.1 time: 0.431194 Jul 19 22:35:03.423846 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1013/2046] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:02 2022] GET /compute/v2.1/servers/eef47923-4943-4736-acb5-5faa2775329e => generated 1219 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:03.532269 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-784b97a2-c9db-4abf-bd41-0e06a06100d5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:03.547583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-784b97a2-c9db-4abf-bd41-0e06a06100d5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:03.554493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-784b97a2-c9db-4abf-bd41-0e06a06100d5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:03.557575 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-784b97a2-c9db-4abf-bd41-0e06a06100d5 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1477 microversion: 2.25 time: 0.708330 Jul 19 22:35:03.559916 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1034/2047] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:02 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1477 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:03.575699 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dbb86377-9e06-42cc-b4f1-01fa42407cc5 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Calling method '.version_select at 0x7f7a1554e0d0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:03.578205 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dbb86377-9e06-42cc-b4f1-01fa42407cc5 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:03.578592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dbb86377-9e06-42cc-b4f1-01fa42407cc5 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:03.593904 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dbb86377-9e06-42cc-b4f1-01fa42407cc5 tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1698 microversion: 2.25 time: 0.022038 Jul 19 22:35:03.595010 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1014/2048] 10.222.0.25 () {60 vars in 1183 bytes} [Tue Jul 19 22:35:03 2022] GET /compute/v2.1/os-migrations => generated 1698 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:03.608270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c42ec11c-b921-443b-bead-abf356280bcc tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:03.608871 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c42ec11c-b921-443b-bead-abf356280bcc tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:03.619651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c42ec11c-b921-443b-bead-abf356280bcc tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:03.620433 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c42ec11c-b921-443b-bead-abf356280bcc tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:03.621838 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c42ec11c-b921-443b-bead-abf356280bcc tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:03.622462 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c42ec11c-b921-443b-bead-abf356280bcc tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:04.009493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-c42ec11c-b921-443b-bead-abf356280bcc tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] Lazy-loading 'services' on Instance uuid 9f2b8c66-5ac4-42bd-afe7-e283eba41078 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:35:04.041275 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c42ec11c-b921-443b-bead-abf356280bcc tempest-LiveAutoBlockMigrationV225Test-1515602716 tempest-LiveAutoBlockMigrationV225Test-1515602716-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1970 microversion: 2.25 time: 0.437845 Jul 19 22:35:04.054079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8aba09bd-daec-4a57-b42a-73928aa0e442 tempest-FloatingIPsTestJSON-1136553558 tempest-FloatingIPsTestJSON-1136553558-project] Action: 'create', calling method: .version_select at 0x7f7a15569b80>, body: {"pool": null} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:04.055875 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1035/2049] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:03 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1970 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:04.073497 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fa63c4bc-1ed1-46f3-88cc-c3f93998da01 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:04.074022 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fa63c4bc-1ed1-46f3-88cc-c3f93998da01 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:04.081433 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa63c4bc-1ed1-46f3-88cc-c3f93998da01 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:04.082318 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa63c4bc-1ed1-46f3-88cc-c3f93998da01 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:04.083405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa63c4bc-1ed1-46f3-88cc-c3f93998da01 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:04.083946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa63c4bc-1ed1-46f3-88cc-c3f93998da01 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:04.194689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fa63c4bc-1ed1-46f3-88cc-c3f93998da01 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:35:04.393697 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fa63c4bc-1ed1-46f3-88cc-c3f93998da01 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 204 len: 0 microversion: 2.25 time: 0.324142 Jul 19 22:35:04.401684 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1036/2050] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 22:35:04 2022] DELETE /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 19 22:35:04.412160 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5310306f-cf5f-47bd-b4e4-75089a19430f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:04.412873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5310306f-cf5f-47bd-b4e4-75089a19430f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:04.431797 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5310306f-cf5f-47bd-b4e4-75089a19430f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:04.433210 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5310306f-cf5f-47bd-b4e4-75089a19430f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:04.434064 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5310306f-cf5f-47bd-b4e4-75089a19430f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:04.435731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5310306f-cf5f-47bd-b4e4-75089a19430f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:05.339424 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5310306f-cf5f-47bd-b4e4-75089a19430f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:05.355554 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5310306f-cf5f-47bd-b4e4-75089a19430f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:05.357108 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5310306f-cf5f-47bd-b4e4-75089a19430f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:05.371949 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5310306f-cf5f-47bd-b4e4-75089a19430f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1483 microversion: 2.25 time: 0.952063 Jul 19 22:35:05.376140 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1037/2051] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:04 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1483 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:05.393115 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9658e6ce-1cf5-414e-ab74-77ab9573a24c tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:05.393803 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9658e6ce-1cf5-414e-ab74-77ab9573a24c tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: eef47923-4943-4736-acb5-5faa2775329e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:05.418489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9658e6ce-1cf5-414e-ab74-77ab9573a24c tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:05.418947 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9658e6ce-1cf5-414e-ab74-77ab9573a24c tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:05.423283 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9658e6ce-1cf5-414e-ab74-77ab9573a24c tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:05.423755 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9658e6ce-1cf5-414e-ab74-77ab9573a24c tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:06.021303 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9658e6ce-1cf5-414e-ab74-77ab9573a24c tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8abba155f841cea0212bbaad5462ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:06.041408 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9658e6ce-1cf5-414e-ab74-77ab9573a24c tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers/eef47923-4943-4736-acb5-5faa2775329e" status: 200 len: 1279 microversion: 2.1 time: 0.659737 Jul 19 22:35:06.042214 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1038/2052] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:05 2022] GET /compute/v2.1/servers/eef47923-4943-4736-acb5-5faa2775329e => generated 1279 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:06.064590 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-a3953349-20d8-4745-9d5b-21863e293f9a req-e08fb146-51c8-470a-baee-ac5d1568e5af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc2efca-6346-4a22-999b-5a1fa57dcee9", "name": "network-vif-deleted", "tag": "b2782aff-48f6-4b84-8432-a744c2cd70bd"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:06.089680 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a3953349-20d8-4745-9d5b-21863e293f9a req-e08fb146-51c8-470a-baee-ac5d1568e5af service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:06.090143 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a3953349-20d8-4745-9d5b-21863e293f9a req-e08fb146-51c8-470a-baee-ac5d1568e5af service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:06.138221 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-a3953349-20d8-4745-9d5b-21863e293f9a req-e08fb146-51c8-470a-baee-ac5d1568e5af service nova] Creating event network-vif-deleted:b2782aff-48f6-4b84-8432-a744c2cd70bd for instance 6dc2efca-6346-4a22-999b-5a1fa57dcee9 on n-h1-847009-3 Jul 19 22:35:06.149158 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-a3953349-20d8-4745-9d5b-21863e293f9a req-e08fb146-51c8-470a-baee-ac5d1568e5af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094783 Jul 19 22:35:06.154342 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1039/2053] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:06.176950 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-581e209b-5c42-4936-9409-cb2b6b0b1927 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-525035517", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:06.295223 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-581e209b-5c42-4936-9409-cb2b6b0b1927 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] validate_networks() for [('6d053fb3-7842-42eb-ace2-41e8e82ce28b', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:35:08.453113 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-581e209b-5c42-4936-9409-cb2b6b0b1927 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:35:08.453768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-581e209b-5c42-4936-9409-cb2b6b0b1927 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:35:08.454665 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-581e209b-5c42-4936-9409-cb2b6b0b1927 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:35:08.455376 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-581e209b-5c42-4936-9409-cb2b6b0b1927 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:35:08.457871 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-581e209b-5c42-4936-9409-cb2b6b0b1927 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:35:08.490522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-581e209b-5c42-4936-9409-cb2b6b0b1927 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:08.491184 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-581e209b-5c42-4936-9409-cb2b6b0b1927 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:08.494282 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-581e209b-5c42-4936-9409-cb2b6b0b1927 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:08.495418 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-581e209b-5c42-4936-9409-cb2b6b0b1927 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:08.555167 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-581e209b-5c42-4936-9409-cb2b6b0b1927 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Getting quotas for project 3eca98474bca4a64af425dffb9ecb5b3. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:35:08.571079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-581e209b-5c42-4936-9409-cb2b6b0b1927 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Getting quotas for user ecca13a073e7447591944e6604d67e4c and project 3eca98474bca4a64af425dffb9ecb5b3. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:35:08.607407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-581e209b-5c42-4936-9409-cb2b6b0b1927 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:35:08.611893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-581e209b-5c42-4936-9409-cb2b6b0b1927 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: c2560d4c-c905-4dbc-9eb8-40410ec01473] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:35:08.676736 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-581e209b-5c42-4936-9409-cb2b6b0b1927 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.520852 Jul 19 22:35:08.683515 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1040/2054] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:35:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 2528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:35:08.689462 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a6cd5328-9cd2-4c4d-876e-e414f423ac09 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:08.690454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a6cd5328-9cd2-4c4d-876e-e414f423ac09 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:08.698484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6cd5328-9cd2-4c4d-876e-e414f423ac09 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:08.699431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6cd5328-9cd2-4c4d-876e-e414f423ac09 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:08.700471 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6cd5328-9cd2-4c4d-876e-e414f423ac09 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:08.701142 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6cd5328-9cd2-4c4d-876e-e414f423ac09 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:09.246290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a6cd5328-9cd2-4c4d-876e-e414f423ac09 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:09.273351 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a6cd5328-9cd2-4c4d-876e-e414f423ac09 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:09.274906 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a6cd5328-9cd2-4c4d-876e-e414f423ac09 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:09.309540 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a6cd5328-9cd2-4c4d-876e-e414f423ac09 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1441 microversion: 2.25 time: 0.603986 Jul 19 22:35:09.310219 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1041/2055] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:08 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1441 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:09.334508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a34f85c2-d244-42c8-9f09-ee86c0f29d1e tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:09.335221 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a34f85c2-d244-42c8-9f09-ee86c0f29d1e tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: eef47923-4943-4736-acb5-5faa2775329e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:09.367258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a34f85c2-d244-42c8-9f09-ee86c0f29d1e tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:09.367729 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a34f85c2-d244-42c8-9f09-ee86c0f29d1e tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:09.377781 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a34f85c2-d244-42c8-9f09-ee86c0f29d1e tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:09.378633 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a34f85c2-d244-42c8-9f09-ee86c0f29d1e tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:09.665974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a34f85c2-d244-42c8-9f09-ee86c0f29d1e tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8abba155f841cea0212bbaad5462ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:09.696834 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a34f85c2-d244-42c8-9f09-ee86c0f29d1e tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers/eef47923-4943-4736-acb5-5faa2775329e" status: 200 len: 1277 microversion: 2.1 time: 0.381018 Jul 19 22:35:09.701799 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1042/2056] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:09 2022] GET /compute/v2.1/servers/eef47923-4943-4736-acb5-5faa2775329e => generated 1277 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:09.858960 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-89d35bd6-20ab-455c-b75c-46b856bb1f55 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Action: 'create', calling method: .version_select at 0x7f7a03f78670>, body: {"keypair": {"name": "tempest-keypair-680148385", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMU2Ox3XtEHrZvh4tUCmm3cZPoUMQpIh4Kulu0z0qPe7s+xzY5frjfNdIuqvJvdx9Ri7L9nh+UPmh456/h5zvWT/i8/R3hzQR54uF9kL8dDyycfGAf55S+mJAfbUou2qXQ=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:09.892017 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-89d35bd6-20ab-455c-b75c-46b856bb1f55 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Getting quotas for project c566f4290e1b41dcbab2b7cbb866e023. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:35:09.911279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-89d35bd6-20ab-455c-b75c-46b856bb1f55 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Getting quotas for user df68a9a9195744b386966b5c574b7878 and project c566f4290e1b41dcbab2b7cbb866e023. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:35:09.961606 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-89d35bd6-20ab-455c-b75c-46b856bb1f55 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.258054 Jul 19 22:35:09.971508 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1043/2057] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:35:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:09.981101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-61422982-ec73-4fa4-b044-b8b0c3feda27 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:09.981938 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-61422982-ec73-4fa4-b044-b8b0c3feda27 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: c2560d4c-c905-4dbc-9eb8-40410ec01473] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:09.989026 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61422982-ec73-4fa4-b044-b8b0c3feda27 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:09.989962 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61422982-ec73-4fa4-b044-b8b0c3feda27 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:09.990937 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61422982-ec73-4fa4-b044-b8b0c3feda27 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:09.991559 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61422982-ec73-4fa4-b044-b8b0c3feda27 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:10.164188 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-61422982-ec73-4fa4-b044-b8b0c3feda27 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:10.185642 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-61422982-ec73-4fa4-b044-b8b0c3feda27 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473" status: 200 len: 1228 microversion: 2.1 time: 0.211776 Jul 19 22:35:10.186437 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1044/2058] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:09 2022] GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473 => generated 1228 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:10.193344 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-401f72c5-3bf2-41ce-b8dd-49230442afd1 req-03a15dd8-7103-43f8-8064-061b0d014915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f2b8c66-5ac4-42bd-afe7-e283eba41078", "name": "network-vif-deleted", "tag": "7697d6fa-c774-468b-a275-a40743f7894f"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:10.205285 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-401f72c5-3bf2-41ce-b8dd-49230442afd1 req-03a15dd8-7103-43f8-8064-061b0d014915 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:10.205961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-401f72c5-3bf2-41ce-b8dd-49230442afd1 req-03a15dd8-7103-43f8-8064-061b0d014915 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:10.232336 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-401f72c5-3bf2-41ce-b8dd-49230442afd1 req-03a15dd8-7103-43f8-8064-061b0d014915 service nova] Creating event network-vif-deleted:7697d6fa-c774-468b-a275-a40743f7894f for instance 9f2b8c66-5ac4-42bd-afe7-e283eba41078 on n-h2-847009-3 Jul 19 22:35:10.251545 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-401f72c5-3bf2-41ce-b8dd-49230442afd1 req-03a15dd8-7103-43f8-8064-061b0d014915 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062743 Jul 19 22:35:10.254546 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1045/2059] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:10.329220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-db7fe708-5655-44f8-89e7-9de85acef8e9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:10.335752 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-db7fe708-5655-44f8-89e7-9de85acef8e9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:10.358293 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db7fe708-5655-44f8-89e7-9de85acef8e9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:10.358885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db7fe708-5655-44f8-89e7-9de85acef8e9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:10.360028 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db7fe708-5655-44f8-89e7-9de85acef8e9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:10.360479 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db7fe708-5655-44f8-89e7-9de85acef8e9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:10.392692 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:35:10.559329 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-db7fe708-5655-44f8-89e7-9de85acef8e9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:10.581182 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-db7fe708-5655-44f8-89e7-9de85acef8e9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:10.591461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-db7fe708-5655-44f8-89e7-9de85acef8e9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:10.595613 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-db7fe708-5655-44f8-89e7-9de85acef8e9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1266 microversion: 2.25 time: 0.269743 Jul 19 22:35:10.600380 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1046/2060] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:10 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:10.718570 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6e63ce16-36eb-4e57-b568-66dfc4a7fc25 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:10.719495 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6e63ce16-36eb-4e57-b568-66dfc4a7fc25 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: eef47923-4943-4736-acb5-5faa2775329e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:10.735508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e63ce16-36eb-4e57-b568-66dfc4a7fc25 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:10.736099 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e63ce16-36eb-4e57-b568-66dfc4a7fc25 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:10.742378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e63ce16-36eb-4e57-b568-66dfc4a7fc25 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:10.743025 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e63ce16-36eb-4e57-b568-66dfc4a7fc25 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:10.789430 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8aba09bd-daec-4a57-b42a-73928aa0e442 tempest-FloatingIPsTestJSON-1136553558 tempest-FloatingIPsTestJSON-1136553558-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.856331 Jul 19 22:35:10.791900 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1015/2061] 10.222.0.25 () {60 vars in 1169 bytes} [Tue Jul 19 22:35:03 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:35:10.823588 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b190f9bf-20c5-485e-8447-72496dcaa1c7 tempest-FloatingIPsTestJSON-1136553558 tempest-FloatingIPsTestJSON-1136553558-project] Calling method '.version_select at 0x7f7a156abb80>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:11.353639 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b190f9bf-20c5-485e-8447-72496dcaa1c7 tempest-FloatingIPsTestJSON-1136553558 tempest-FloatingIPsTestJSON-1136553558-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/60970821-8ab4-45ff-8695-ceb15f772ce4" status: 200 len: 141 microversion: 2.1 time: 0.551089 Jul 19 22:35:11.355350 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1016/2062] 10.222.0.25 () {58 vars in 1259 bytes} [Tue Jul 19 22:35:10 2022] GET /compute/v2.1/os-floating-ips/60970821-8ab4-45ff-8695-ceb15f772ce4 => generated 141 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:11.362625 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ba8d2244-9f01-4007-b82b-854d2e0d022b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:11.363742 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ba8d2244-9f01-4007-b82b-854d2e0d022b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: c2560d4c-c905-4dbc-9eb8-40410ec01473] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:11.380031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba8d2244-9f01-4007-b82b-854d2e0d022b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:11.380685 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba8d2244-9f01-4007-b82b-854d2e0d022b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:11.386937 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba8d2244-9f01-4007-b82b-854d2e0d022b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:11.387579 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba8d2244-9f01-4007-b82b-854d2e0d022b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:11.822908 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ba8d2244-9f01-4007-b82b-854d2e0d022b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:11.841734 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ba8d2244-9f01-4007-b82b-854d2e0d022b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473" status: 200 len: 1282 microversion: 2.1 time: 0.484713 Jul 19 22:35:11.844340 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1017/2063] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:11 2022] GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473 => generated 1282 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:11.872263 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a7e1f7da-5a74-4732-bab5-67c9dddd91bd tempest-FloatingIPsTestJSON-1136553558 tempest-FloatingIPsTestJSON-1136553558-project] Calling method '.version_select at 0x7f7a1554eee0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:12.137821 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6e63ce16-36eb-4e57-b568-66dfc4a7fc25 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8abba155f841cea0212bbaad5462ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:12.151752 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6e63ce16-36eb-4e57-b568-66dfc4a7fc25 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers/eef47923-4943-4736-acb5-5faa2775329e" status: 200 len: 1319 microversion: 2.1 time: 1.434711 Jul 19 22:35:12.154957 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1047/2064] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:10 2022] GET /compute/v2.1/servers/eef47923-4943-4736-acb5-5faa2775329e => generated 1319 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:12.170287 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-70784b95-0c37-447f-a906-0957769d2ff2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:12.171024 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-70784b95-0c37-447f-a906-0957769d2ff2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:12.205373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-70784b95-0c37-447f-a906-0957769d2ff2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:12.206017 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-70784b95-0c37-447f-a906-0957769d2ff2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:12.209711 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-70784b95-0c37-447f-a906-0957769d2ff2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:12.210923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-70784b95-0c37-447f-a906-0957769d2ff2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:12.416545 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-70784b95-0c37-447f-a906-0957769d2ff2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:12.430944 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-70784b95-0c37-447f-a906-0957769d2ff2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:12.432857 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-70784b95-0c37-447f-a906-0957769d2ff2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:12.438132 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-70784b95-0c37-447f-a906-0957769d2ff2 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1266 microversion: 2.25 time: 0.280447 Jul 19 22:35:12.444168 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1048/2065] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:12 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:12.863539 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5761ecb1-43b7-49db-9983-c4d3e2ae34fa tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:12.864217 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5761ecb1-43b7-49db-9983-c4d3e2ae34fa tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: c2560d4c-c905-4dbc-9eb8-40410ec01473] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:12.882463 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5761ecb1-43b7-49db-9983-c4d3e2ae34fa tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:12.882942 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5761ecb1-43b7-49db-9983-c4d3e2ae34fa tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:12.883808 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5761ecb1-43b7-49db-9983-c4d3e2ae34fa tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:12.884781 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5761ecb1-43b7-49db-9983-c4d3e2ae34fa tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:12.963824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:35:13.417981 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=8 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:35:13.948988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5761ecb1-43b7-49db-9983-c4d3e2ae34fa tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:13.961660 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5761ecb1-43b7-49db-9983-c4d3e2ae34fa tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473" status: 200 len: 1282 microversion: 2.1 time: 1.103882 Jul 19 22:35:13.966441 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1049/2066] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:12 2022] GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473 => generated 1282 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:13.976910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f7a6668f-88df-44ae-a2d1-61579663c856 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:13.980723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f7a6668f-88df-44ae-a2d1-61579663c856 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: eef47923-4943-4736-acb5-5faa2775329e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:14.000939 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f7a6668f-88df-44ae-a2d1-61579663c856 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:14.002581 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f7a6668f-88df-44ae-a2d1-61579663c856 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:14.006805 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f7a6668f-88df-44ae-a2d1-61579663c856 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:14.007611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f7a6668f-88df-44ae-a2d1-61579663c856 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:14.134077 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a7e1f7da-5a74-4732-bab5-67c9dddd91bd tempest-FloatingIPsTestJSON-1136553558 tempest-FloatingIPsTestJSON-1136553558-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 2.286563 Jul 19 22:35:14.136844 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1018/2067] 10.222.0.25 () {58 vars in 1148 bytes} [Tue Jul 19 22:35:11 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 2291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:14.165021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-23a15181-7447-42ea-b492-013551f215c9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:14.172181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-23a15181-7447-42ea-b492-013551f215c9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:14.199757 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:35:14.206176 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-23a15181-7447-42ea-b492-013551f215c9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:14.207131 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-23a15181-7447-42ea-b492-013551f215c9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:14.208831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-23a15181-7447-42ea-b492-013551f215c9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:14.209861 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-23a15181-7447-42ea-b492-013551f215c9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:14.217472 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:35:14.765365 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-23a15181-7447-42ea-b492-013551f215c9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:14.790346 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-23a15181-7447-42ea-b492-013551f215c9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:14.804666 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-23a15181-7447-42ea-b492-013551f215c9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:14.805922 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-23a15181-7447-42ea-b492-013551f215c9 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1266 microversion: 2.25 time: 0.667364 Jul 19 22:35:14.813354 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1019/2068] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:14 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1266 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:14.847363 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-51ad96d6-8a99-4b38-8ffd-e556cbb999ee tempest-FloatingIPsTestJSON-1136553558 tempest-FloatingIPsTestJSON-1136553558-project] Calling method '.version_select at 0x7f7a03993e50>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:15.211224 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f7a6668f-88df-44ae-a2d1-61579663c856 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8abba155f841cea0212bbaad5462ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:15.224952 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f7a6668f-88df-44ae-a2d1-61579663c856 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers/eef47923-4943-4736-acb5-5faa2775329e" status: 200 len: 1319 microversion: 2.1 time: 1.256764 Jul 19 22:35:15.237491 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1050/2069] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:13 2022] GET /compute/v2.1/servers/eef47923-4943-4736-acb5-5faa2775329e => generated 1319 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:15.244694 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-754f88f0-17aa-4264-b8e9-36da26fc8d45 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:15.245349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-754f88f0-17aa-4264-b8e9-36da26fc8d45 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: c2560d4c-c905-4dbc-9eb8-40410ec01473] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:15.256286 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-754f88f0-17aa-4264-b8e9-36da26fc8d45 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:15.257344 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-754f88f0-17aa-4264-b8e9-36da26fc8d45 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:15.258193 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-754f88f0-17aa-4264-b8e9-36da26fc8d45 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:15.258648 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-754f88f0-17aa-4264-b8e9-36da26fc8d45 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:15.717746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-754f88f0-17aa-4264-b8e9-36da26fc8d45 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:15.731838 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-754f88f0-17aa-4264-b8e9-36da26fc8d45 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473" status: 200 len: 1324 microversion: 2.1 time: 0.491364 Jul 19 22:35:15.736077 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1051/2070] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:15 2022] GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473 => generated 1324 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:15.832015 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f34240aa-ad96-4d2e-ad40-e63228685658 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:15.832586 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f34240aa-ad96-4d2e-ad40-e63228685658 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:15.850110 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f34240aa-ad96-4d2e-ad40-e63228685658 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:15.850825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f34240aa-ad96-4d2e-ad40-e63228685658 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:15.853580 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f34240aa-ad96-4d2e-ad40-e63228685658 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:15.854211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f34240aa-ad96-4d2e-ad40-e63228685658 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:16.156154 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f34240aa-ad96-4d2e-ad40-e63228685658 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:16.172257 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f34240aa-ad96-4d2e-ad40-e63228685658 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:16.174300 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f34240aa-ad96-4d2e-ad40-e63228685658 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:16.177137 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f34240aa-ad96-4d2e-ad40-e63228685658 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1266 microversion: 2.25 time: 0.351018 Jul 19 22:35:16.183198 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1052/2071] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:15 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1266 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:16.188392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-53c0b632-7966-4a70-ab53-c8c6cb79e25b req-f229f5a9-161c-4fbf-9894-a4a4ae965b4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eef47923-4943-4736-acb5-5faa2775329e", "tag": "592405c4-3868-4a35-8878-0c942e38f6c7"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:16.213649 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-53c0b632-7966-4a70-ab53-c8c6cb79e25b req-f229f5a9-161c-4fbf-9894-a4a4ae965b4f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:16.214196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-53c0b632-7966-4a70-ab53-c8c6cb79e25b req-f229f5a9-161c-4fbf-9894-a4a4ae965b4f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:16.271431 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-53c0b632-7966-4a70-ab53-c8c6cb79e25b req-f229f5a9-161c-4fbf-9894-a4a4ae965b4f service nova] Creating event network-changed:592405c4-3868-4a35-8878-0c942e38f6c7 for instance eef47923-4943-4736-acb5-5faa2775329e on n-h1-847009-3 Jul 19 22:35:16.307603 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-53c0b632-7966-4a70-ab53-c8c6cb79e25b req-f229f5a9-161c-4fbf-9894-a4a4ae965b4f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122679 Jul 19 22:35:16.311960 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1053/2072] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:16.329703 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9e79df26-1a73-44d5-8fb9-152c9364cefc tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:16.335537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9e79df26-1a73-44d5-8fb9-152c9364cefc tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: eef47923-4943-4736-acb5-5faa2775329e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:16.352932 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9e79df26-1a73-44d5-8fb9-152c9364cefc tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:16.355971 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9e79df26-1a73-44d5-8fb9-152c9364cefc tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:16.359784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9e79df26-1a73-44d5-8fb9-152c9364cefc tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:16.364796 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9e79df26-1a73-44d5-8fb9-152c9364cefc tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:17.586334 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9e79df26-1a73-44d5-8fb9-152c9364cefc tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8abba155f841cea0212bbaad5462ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:17.599702 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9e79df26-1a73-44d5-8fb9-152c9364cefc tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers/eef47923-4943-4736-acb5-5faa2775329e" status: 200 len: 1319 microversion: 2.1 time: 1.277327 Jul 19 22:35:17.600372 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1054/2073] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:16 2022] GET /compute/v2.1/servers/eef47923-4943-4736-acb5-5faa2775329e => generated 1319 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:17.609399 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dbac1b99-70ed-44da-a473-870a059793c5 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:17.610030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dbac1b99-70ed-44da-a473-870a059793c5 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: c2560d4c-c905-4dbc-9eb8-40410ec01473] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:17.622751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:35:17.629574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dbac1b99-70ed-44da-a473-870a059793c5 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:17.631017 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dbac1b99-70ed-44da-a473-870a059793c5 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:17.632097 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dbac1b99-70ed-44da-a473-870a059793c5 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:17.632689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dbac1b99-70ed-44da-a473-870a059793c5 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:18.522015 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:35:18.877592 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dbac1b99-70ed-44da-a473-870a059793c5 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:18.894581 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dbac1b99-70ed-44da-a473-870a059793c5 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473" status: 200 len: 1324 microversion: 2.1 time: 1.292432 Jul 19 22:35:18.897571 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1055/2074] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:17 2022] GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473 => generated 1324 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:18.914483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e347c2e0-1c33-4d32-bc6a-e022487b115c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:18.915560 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e347c2e0-1c33-4d32-bc6a-e022487b115c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:18.928979 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e347c2e0-1c33-4d32-bc6a-e022487b115c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:18.930041 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e347c2e0-1c33-4d32-bc6a-e022487b115c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:18.931896 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e347c2e0-1c33-4d32-bc6a-e022487b115c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:18.933041 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e347c2e0-1c33-4d32-bc6a-e022487b115c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:19.050032 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e347c2e0-1c33-4d32-bc6a-e022487b115c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:19.050597 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e347c2e0-1c33-4d32-bc6a-e022487b115c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:19.051098 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-e347c2e0-1c33-4d32-bc6a-e022487b115c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lazy-loading 'fault' on Instance uuid 9f2b8c66-5ac4-42bd-afe7-e283eba41078 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:35:19.195943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e347c2e0-1c33-4d32-bc6a-e022487b115c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:19.205255 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e347c2e0-1c33-4d32-bc6a-e022487b115c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:19.207563 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e347c2e0-1c33-4d32-bc6a-e022487b115c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:19.208944 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e347c2e0-1c33-4d32-bc6a-e022487b115c tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 200 len: 1194 microversion: 2.25 time: 0.299699 Jul 19 22:35:19.210024 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1056/2075] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:18 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 1194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:19.215823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b794e9d1-4e4b-442a-bf58-66ca9a6872b8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Action: 'create', calling method: .version_select at 0x7f7a03f9f280>, body: {"keypair": {"name": "tempest-keypair-1975000311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcayQG82UJnS3iNCP31jVbWWpfXopZnaCJfqKF6duBfg8bg2LKGnwdS//XEjm0W+nNpqRWi/JCsPw+IVfLBFqUP/0S+MaHNPpJCqXJp3Q9xaS6Be9kZRhG4u+9vYSZ6VA=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:19.234975 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-b794e9d1-4e4b-442a-bf58-66ca9a6872b8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Getting quotas for project 29ab27ce610d4b02a14a4fa7ff565555. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:35:19.241992 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-b794e9d1-4e4b-442a-bf58-66ca9a6872b8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Getting quotas for user 56b9fae8a5b14153a3715a6514ae84ff and project 29ab27ce610d4b02a14a4fa7ff565555. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:35:19.275165 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b794e9d1-4e4b-442a-bf58-66ca9a6872b8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.063677 Jul 19 22:35:19.276200 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1057/2076] 10.222.0.25 () {62 vars in 1199 bytes} [Tue Jul 19 22:35:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 22:35:19.285506 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-211d8eef-82a3-48ee-a2c6-c0bca98030b4 req-675d1e85-d1d4-4182-8fa2-0f60c77c728c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df9fcf88-5d46-4ed8-b799-faf22cc244f1", "tag": "2e6eb698-2fcc-4f59-8d7d-10b5d9238fbf"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:19.309423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-211d8eef-82a3-48ee-a2c6-c0bca98030b4 req-675d1e85-d1d4-4182-8fa2-0f60c77c728c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:19.311873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-211d8eef-82a3-48ee-a2c6-c0bca98030b4 req-675d1e85-d1d4-4182-8fa2-0f60c77c728c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:19.339129 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-211d8eef-82a3-48ee-a2c6-c0bca98030b4 req-675d1e85-d1d4-4182-8fa2-0f60c77c728c service nova] Creating event network-changed:2e6eb698-2fcc-4f59-8d7d-10b5d9238fbf for instance df9fcf88-5d46-4ed8-b799-faf22cc244f1 on n-h2-847009-3 Jul 19 22:35:19.350577 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-211d8eef-82a3-48ee-a2c6-c0bca98030b4 req-675d1e85-d1d4-4182-8fa2-0f60c77c728c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069462 Jul 19 22:35:19.352428 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1058/2077] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:19.363865 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cde03fda-2e43-4d02-b55c-a444c6559e12 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:19.365168 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cde03fda-2e43-4d02-b55c-a444c6559e12 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: eef47923-4943-4736-acb5-5faa2775329e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:19.379847 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cde03fda-2e43-4d02-b55c-a444c6559e12 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:19.381685 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cde03fda-2e43-4d02-b55c-a444c6559e12 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:19.386310 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cde03fda-2e43-4d02-b55c-a444c6559e12 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:19.387772 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cde03fda-2e43-4d02-b55c-a444c6559e12 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:19.565365 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-51ad96d6-8a99-4b38-8ffd-e556cbb999ee tempest-FloatingIPsTestJSON-1136553558 tempest-FloatingIPsTestJSON-1136553558-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/60970821-8ab4-45ff-8695-ceb15f772ce4" status: 202 len: 0 microversion: 2.1 time: 4.735459 Jul 19 22:35:19.571924 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1020/2078] 10.222.0.25 () {58 vars in 1262 bytes} [Tue Jul 19 22:35:14 2022] DELETE /compute/v2.1/os-floating-ips/60970821-8ab4-45ff-8695-ceb15f772ce4 => generated 0 bytes in 4754 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:35:19.573830 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e630d2ea-05e0-42a2-867b-ce226e656c0c tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "3b0ce618-0b9c-41ac-ad0d-af7a0034f315"}], "security_groups": [{"name": "tempest-securitygroup--475034027"}], "key_name": "tempest-keypair-680148385", "user_data": "}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:19.746337 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cde03fda-2e43-4d02-b55c-a444c6559e12 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8abba155f841cea0212bbaad5462ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:19.770464 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cde03fda-2e43-4d02-b55c-a444c6559e12 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers/eef47923-4943-4736-acb5-5faa2775329e" status: 200 len: 1319 microversion: 2.1 time: 0.415915 Jul 19 22:35:19.770975 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1059/2079] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:19 2022] GET /compute/v2.1/servers/eef47923-4943-4736-acb5-5faa2775329e => generated 1319 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:19.794863 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-6922b889-f244-4b2b-be1a-876a827e0edb req-db9f0bf8-659f-437d-889d-1265ae3948a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2560d4c-c905-4dbc-9eb8-40410ec01473", "tag": "c0c2894d-78f3-43fb-9c7e-679991ba2b43"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:19.805644 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-6922b889-f244-4b2b-be1a-876a827e0edb req-db9f0bf8-659f-437d-889d-1265ae3948a4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:19.806946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-6922b889-f244-4b2b-be1a-876a827e0edb req-db9f0bf8-659f-437d-889d-1265ae3948a4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:19.829006 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-6922b889-f244-4b2b-be1a-876a827e0edb req-db9f0bf8-659f-437d-889d-1265ae3948a4 service nova] Creating event network-changed:c0c2894d-78f3-43fb-9c7e-679991ba2b43 for instance c2560d4c-c905-4dbc-9eb8-40410ec01473 on n-h2-847009-3 Jul 19 22:35:19.835063 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-6922b889-f244-4b2b-be1a-876a827e0edb req-db9f0bf8-659f-437d-889d-1265ae3948a4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055545 Jul 19 22:35:19.835854 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1060/2080] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:19.845244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-123a6801-7a1b-482f-aaab-68f9c6faaee0 tempest-FloatingIPsTestJSON-1136553558 tempest-FloatingIPsTestJSON-1136553558-project] Action: 'create', calling method: .version_select at 0x7f7a03f9f700>, body: {"pool": null} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:19.936247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-e630d2ea-05e0-42a2-867b-ce226e656c0c tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] validate_networks() for [('3b0ce618-0b9c-41ac-ad0d-af7a0034f315', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:35:22.158646 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-e630d2ea-05e0-42a2-867b-ce226e656c0c tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:35:22.160135 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-e630d2ea-05e0-42a2-867b-ce226e656c0c tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:35:22.161161 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-e630d2ea-05e0-42a2-867b-ce226e656c0c tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:35:22.161927 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-e630d2ea-05e0-42a2-867b-ce226e656c0c tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:35:22.162030 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-e630d2ea-05e0-42a2-867b-ce226e656c0c tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:35:22.175849 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e630d2ea-05e0-42a2-867b-ce226e656c0c tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:22.176628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e630d2ea-05e0-42a2-867b-ce226e656c0c tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:22.177599 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e630d2ea-05e0-42a2-867b-ce226e656c0c tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:22.178204 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e630d2ea-05e0-42a2-867b-ce226e656c0c tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:22.199264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-e630d2ea-05e0-42a2-867b-ce226e656c0c tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Getting quotas for project c566f4290e1b41dcbab2b7cbb866e023. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:35:22.206904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-e630d2ea-05e0-42a2-867b-ce226e656c0c tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Getting quotas for user df68a9a9195744b386966b5c574b7878 and project c566f4290e1b41dcbab2b7cbb866e023. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:35:22.228642 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e630d2ea-05e0-42a2-867b-ce226e656c0c tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:35:22.240492 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e630d2ea-05e0-42a2-867b-ce226e656c0c tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] [instance: 84f67219-22f4-491d-9f4c-afb31f356e65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:35:22.378313 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e630d2ea-05e0-42a2-867b-ce226e656c0c tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.808876 Jul 19 22:35:22.387022 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1021/2081] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:35:19 2022] POST /compute/v2.1/servers => generated 408 bytes in 2818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:35:22.407264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c8f1124c-1a4f-49ce-bd73-51994ca9e36a tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:22.410438 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c8f1124c-1a4f-49ce-bd73-51994ca9e36a tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: c2560d4c-c905-4dbc-9eb8-40410ec01473] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:22.424350 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8f1124c-1a4f-49ce-bd73-51994ca9e36a tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:22.425194 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8f1124c-1a4f-49ce-bd73-51994ca9e36a tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:22.426028 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8f1124c-1a4f-49ce-bd73-51994ca9e36a tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:22.426476 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8f1124c-1a4f-49ce-bd73-51994ca9e36a tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:23.367786 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c8f1124c-1a4f-49ce-bd73-51994ca9e36a tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:23.381574 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c8f1124c-1a4f-49ce-bd73-51994ca9e36a tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473" status: 200 len: 1324 microversion: 2.1 time: 0.990669 Jul 19 22:35:23.387000 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1022/2082] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:22 2022] GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473 => generated 1324 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:23.403528 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a8227c6c-36d2-4c4b-8c2e-d2b2183a5cff tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:23.405955 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a8227c6c-36d2-4c4b-8c2e-d2b2183a5cff tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 9f2b8c66-5ac4-42bd-afe7-e283eba41078] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:23.425450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a8227c6c-36d2-4c4b-8c2e-d2b2183a5cff tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:23.425981 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a8227c6c-36d2-4c4b-8c2e-d2b2183a5cff tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:23.428964 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a8227c6c-36d2-4c4b-8c2e-d2b2183a5cff tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:23.431256 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a8227c6c-36d2-4c4b-8c2e-d2b2183a5cff tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:23.469722 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-a8227c6c-36d2-4c4b-8c2e-d2b2183a5cff tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] HTTP exception thrown: Instance 9f2b8c66-5ac4-42bd-afe7-e283eba41078 could not be found. Jul 19 22:35:23.479537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a8227c6c-36d2-4c4b-8c2e-d2b2183a5cff tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Request method failure captured: Jul 19 22:35:23.479537 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 HTTP/1.1 Jul 19 22:35:23.479537 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:35:23.479537 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:35:23.479537 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:35:23.479537 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:35:23.479537 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:35:23.479537 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:35:23.479537 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:35:23.479537 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:35:23.479537 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y-gMMAL5f-xIa7kLu9Egge9ZO_ON0HtwvTyOQ0vs_KbP81_Ma6I2vS-aJF3g39OOCfkCZVdSW4CwqRDmVd8Z35Lx7J2FjWcbc6k_zQor1YeE1MMav0cs0I3iAVJa3gjzEquenecjaME--BluFbvkmQNy63LHmGP4SPyhypKI186Qqg Jul 19 22:35:23.479537 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:35:23.479537 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:35:23.479537 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:35:23.479537 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:35:23.479537 n-d-847009-3 devstack@n-api.service[119338]: X-Openstack-Nova-Api-Version: 2.25 Jul 19 22:35:23.479537 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:35:23.479537 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:35:23.479537 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: d0aa317147bd4c878b3c5e4480ae6289 Jul 19 22:35:23.479537 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-971932489 Jul 19 22:35:23.479537 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:35:23.479537 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:35:23.480937 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d0aa317147bd4c878b3c5e4480ae6289"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d0aa317147bd4c878b3c5e4480ae6289"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d0aa317147bd4c878b3c5e4480ae6289"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d0aa317147bd4c878b3c5e4480ae6289"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:35:23.480937 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-971932489 Jul 19 22:35:23.480937 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: d0aa317147bd4c878b3c5e4480ae6289 Jul 19 22:35:23.480937 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-971932489 Jul 19 22:35:23.480937 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-LiveAutoBlockMigrationV225Test-971932489-project Jul 19 22:35:23.480937 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:35:23.480937 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:35:23.480937 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 113e94f3bdbc4a2bb284a82b0b410d68 Jul 19 22:35:23.480937 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-971932489-project Jul 19 22:35:23.480937 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:35:23.480937 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 9f2b8c66-5ac4-42bd-afe7-e283eba41078 could not be found. Jul 19 22:35:23.480937 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '9f2b8c66-5ac4-42bd-afe7-e283eba41078'} Jul 19 22:35:23.481518 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:35:23.481518 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:23.481518 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:35:23.481518 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:35:23.481518 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:35:23.481518 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:35:23.481518 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:35:23.481518 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:35:23.481518 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:35:23.481518 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:35:23.481518 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f2b8c66-5ac4-42bd-afe7-e283eba41078 could not be found. Jul 19 22:35:23.481518 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:35:23.481518 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:35:23.481518 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:35:23.481518 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:23.481518 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:35:23.481518 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:35:23.481518 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:35:23.481518 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:35:23.481518 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:35:23.482603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:35:23.482603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:35:23.482603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:35:23.482603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:35:23.482603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:35:23.482603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:35:23.482603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:35:23.482603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f2b8c66-5ac4-42bd-afe7-e283eba41078 could not be found. Jul 19 22:35:23.482603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:35:23.482603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:35:23.482603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:35:23.482603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:23.482603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:35:23.482603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:35:23.482603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:35:23.482603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:35:23.482603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f2b8c66-5ac4-42bd-afe7-e283eba41078 could not be found. Jul 19 22:35:23.482603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:35:23.486287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a8227c6c-36d2-4c4b-8c2e-d2b2183a5cff tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Returning 404 to user: Instance 9f2b8c66-5ac4-42bd-afe7-e283eba41078 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:35:23.488396 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a8227c6c-36d2-4c4b-8c2e-d2b2183a5cff tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078" status: 404 len: 111 microversion: 2.25 time: 0.098931 Jul 19 22:35:23.493275 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1023/2083] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:23 2022] GET /compute/v2.1/servers/9f2b8c66-5ac4-42bd-afe7-e283eba41078 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:35:23.498942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fe6206d7-0272-4b8c-996e-ab67ca06b7bc tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:23.506150 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fe6206d7-0272-4b8c-996e-ab67ca06b7bc tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: eef47923-4943-4736-acb5-5faa2775329e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:23.521424 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe6206d7-0272-4b8c-996e-ab67ca06b7bc tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:23.522051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe6206d7-0272-4b8c-996e-ab67ca06b7bc tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:23.522954 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe6206d7-0272-4b8c-996e-ab67ca06b7bc tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:23.527755 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe6206d7-0272-4b8c-996e-ab67ca06b7bc tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:24.090972 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fe6206d7-0272-4b8c-996e-ab67ca06b7bc tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8abba155f841cea0212bbaad5462ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:24.103034 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fe6206d7-0272-4b8c-996e-ab67ca06b7bc tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers/eef47923-4943-4736-acb5-5faa2775329e" status: 200 len: 1319 microversion: 2.1 time: 0.608179 Jul 19 22:35:24.117603 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1024/2084] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:23 2022] GET /compute/v2.1/servers/eef47923-4943-4736-acb5-5faa2775329e => generated 1319 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:24.128414 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-380efbb4-af28-438c-a5c8-3907198dd9a3 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:24.129389 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-380efbb4-af28-438c-a5c8-3907198dd9a3 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] [instance: 84f67219-22f4-491d-9f4c-afb31f356e65] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:24.153825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-380efbb4-af28-438c-a5c8-3907198dd9a3 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:24.154300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-380efbb4-af28-438c-a5c8-3907198dd9a3 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:24.155696 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-380efbb4-af28-438c-a5c8-3907198dd9a3 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:24.157304 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-380efbb4-af28-438c-a5c8-3907198dd9a3 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:24.989616 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-380efbb4-af28-438c-a5c8-3907198dd9a3 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df68a9a9195744b386966b5c574b7878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c566f4290e1b41dcbab2b7cbb866e023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:25.002157 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-380efbb4-af28-438c-a5c8-3907198dd9a3 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] 10.222.0.25 "GET /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65" status: 200 len: 1277 microversion: 2.1 time: 0.883286 Jul 19 22:35:25.014029 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1025/2085] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:24 2022] GET /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65 => generated 1277 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:25.034644 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9b62bee8-f1e4-4e81-b4ce-aeeb5c3e79e8 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:25.036909 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9b62bee8-f1e4-4e81-b4ce-aeeb5c3e79e8 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: c2560d4c-c905-4dbc-9eb8-40410ec01473] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:25.061869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b62bee8-f1e4-4e81-b4ce-aeeb5c3e79e8 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:25.067915 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b62bee8-f1e4-4e81-b4ce-aeeb5c3e79e8 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:25.074532 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b62bee8-f1e4-4e81-b4ce-aeeb5c3e79e8 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:25.075766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b62bee8-f1e4-4e81-b4ce-aeeb5c3e79e8 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:25.654814 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9b62bee8-f1e4-4e81-b4ce-aeeb5c3e79e8 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:25.665265 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9b62bee8-f1e4-4e81-b4ce-aeeb5c3e79e8 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473" status: 200 len: 1324 microversion: 2.1 time: 0.649115 Jul 19 22:35:25.666058 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1026/2086] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:25 2022] GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473 => generated 1324 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:25.684078 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e76ad3a1-c1c9-474d-9e68-b93cecdd330d tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:25.684774 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e76ad3a1-c1c9-474d-9e68-b93cecdd330d tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: eef47923-4943-4736-acb5-5faa2775329e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:25.701014 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e76ad3a1-c1c9-474d-9e68-b93cecdd330d tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:25.704466 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e76ad3a1-c1c9-474d-9e68-b93cecdd330d tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:25.705462 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e76ad3a1-c1c9-474d-9e68-b93cecdd330d tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:25.706665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e76ad3a1-c1c9-474d-9e68-b93cecdd330d tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:25.761902 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-123a6801-7a1b-482f-aaab-68f9c6faaee0 tempest-FloatingIPsTestJSON-1136553558 tempest-FloatingIPsTestJSON-1136553558-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.924288 Jul 19 22:35:25.763545 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1061/2087] 10.222.0.25 () {60 vars in 1169 bytes} [Tue Jul 19 22:35:19 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:25.771861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-94ebb112-d60a-445c-8666-d9b1da525907 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1537993326", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ddbf7746-c7dc-40a9-96a5-a207231af69a"}, {"port": "5b0e7351-eaff-4dcf-814a-86252ed1286b", "tag": "port-1"}, {"port": "4b814275-8b47-43f3-88da-1bc97c3e05e3", "tag": "port-2"}, {"uuid": "579e3d3e-1b38-4208-bea6-59953af82602", "tag": "net-1"}, {"uuid": "579e3d3e-1b38-4208-bea6-59953af82602"}, {"uuid": "a8160b5a-7b08-4365-b92c-6165c0bc8efb", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "a8160b5a-7b08-4365-b92c-6165c0bc8efb", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "fa92190e-bdcc-42f4-b9a7-38a1cb1a4700", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a673dabb-4cd1-4913-963a-a6d3878505d1", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "ebfb1f96-0b99-4b7e-9603-5a3ce61d0fbc", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--696396595"}], "key_name": "tempest-keypair-1975000311", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:26.478359 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-94ebb112-d60a-445c-8666-d9b1da525907 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] validate_networks() for [('ddbf7746-c7dc-40a9-96a5-a207231af69a', None, None, None, None, None), (None, None, '5b0e7351-eaff-4dcf-814a-86252ed1286b', None, None, None), (None, None, '4b814275-8b47-43f3-88da-1bc97c3e05e3', None, None, None), ('579e3d3e-1b38-4208-bea6-59953af82602', None, None, None, None, None), ('579e3d3e-1b38-4208-bea6-59953af82602', None, None, None, None, None), ('a8160b5a-7b08-4365-b92c-6165c0bc8efb', '10.2.2.100', None, None, None, None), ('a8160b5a-7b08-4365-b92c-6165c0bc8efb', '10.2.2.200', None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:35:26.648370 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e76ad3a1-c1c9-474d-9e68-b93cecdd330d tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8abba155f841cea0212bbaad5462ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:26.668482 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e76ad3a1-c1c9-474d-9e68-b93cecdd330d tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers/eef47923-4943-4736-acb5-5faa2775329e" status: 200 len: 1319 microversion: 2.1 time: 0.995338 Jul 19 22:35:26.670157 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1027/2088] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:25 2022] GET /compute/v2.1/servers/eef47923-4943-4736-acb5-5faa2775329e => generated 1319 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:26.818501 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-20964229-9054-428b-b429-bd3a5a991955 req-2c0b1fc4-8f10-4f5a-bed1-3a5fe9b1e515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eef47923-4943-4736-acb5-5faa2775329e", "name": "network-vif-plugged", "status": "completed", "tag": "592405c4-3868-4a35-8878-0c942e38f6c7"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:26.834380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-20964229-9054-428b-b429-bd3a5a991955 req-2c0b1fc4-8f10-4f5a-bed1-3a5fe9b1e515 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:26.836504 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-20964229-9054-428b-b429-bd3a5a991955 req-2c0b1fc4-8f10-4f5a-bed1-3a5fe9b1e515 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:26.855492 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-20964229-9054-428b-b429-bd3a5a991955 req-2c0b1fc4-8f10-4f5a-bed1-3a5fe9b1e515 service nova] Creating event network-vif-plugged:592405c4-3868-4a35-8878-0c942e38f6c7 for instance eef47923-4943-4736-acb5-5faa2775329e on n-h1-847009-3 Jul 19 22:35:26.864305 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-20964229-9054-428b-b429-bd3a5a991955 req-2c0b1fc4-8f10-4f5a-bed1-3a5fe9b1e515 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192645 Jul 19 22:35:26.865484 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1028/2089] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:26.871938 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e6ff4671-7c01-48b3-b402-28ed780ae954 tempest-FloatingIPsTestJSON-1136553558 tempest-FloatingIPsTestJSON-1136553558-project] Calling method '.version_select at 0x7f7a1562c550>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:29.252600 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=14 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:35:29.814397 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=71 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:35:30.012701 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e6ff4671-7c01-48b3-b402-28ed780ae954 tempest-FloatingIPsTestJSON-1136553558 tempest-FloatingIPsTestJSON-1136553558-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/4ebb3ab9-4a4d-44f1-9ae5-ce60695b8dd4" status: 202 len: 0 microversion: 2.1 time: 3.146047 Jul 19 22:35:30.013531 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1029/2090] 10.222.0.25 () {58 vars in 1262 bytes} [Tue Jul 19 22:35:26 2022] DELETE /compute/v2.1/os-floating-ips/4ebb3ab9-4a4d-44f1-9ae5-ce60695b8dd4 => generated 0 bytes in 3148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:35:30.019886 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-080530e7-d188-4168-999d-825aea66d16d tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:30.020753 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-080530e7-d188-4168-999d-825aea66d16d tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] [instance: 84f67219-22f4-491d-9f4c-afb31f356e65] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:30.039318 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-080530e7-d188-4168-999d-825aea66d16d tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:30.039989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-080530e7-d188-4168-999d-825aea66d16d tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:30.041117 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-080530e7-d188-4168-999d-825aea66d16d tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:30.041770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-080530e7-d188-4168-999d-825aea66d16d tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:30.444812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-080530e7-d188-4168-999d-825aea66d16d tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df68a9a9195744b386966b5c574b7878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c566f4290e1b41dcbab2b7cbb866e023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:30.453403 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-080530e7-d188-4168-999d-825aea66d16d tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] 10.222.0.25 "GET /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65" status: 200 len: 1350 microversion: 2.1 time: 0.437850 Jul 19 22:35:30.453991 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1030/2091] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:30 2022] GET /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65 => generated 1350 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:30.459448 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e22e58fd-f575-4a30-a6fa-52736bc82d94 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:30.460147 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e22e58fd-f575-4a30-a6fa-52736bc82d94 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: c2560d4c-c905-4dbc-9eb8-40410ec01473] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:30.466673 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e22e58fd-f575-4a30-a6fa-52736bc82d94 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:30.467400 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e22e58fd-f575-4a30-a6fa-52736bc82d94 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:30.468397 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e22e58fd-f575-4a30-a6fa-52736bc82d94 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:30.469119 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e22e58fd-f575-4a30-a6fa-52736bc82d94 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:31.062609 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e22e58fd-f575-4a30-a6fa-52736bc82d94 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:31.070872 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e22e58fd-f575-4a30-a6fa-52736bc82d94 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473" status: 200 len: 1324 microversion: 2.1 time: 0.615594 Jul 19 22:35:31.071527 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1031/2092] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:30 2022] GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473 => generated 1324 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:31.076236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-605c4898-f269-4d9f-b165-c439f7e5980b tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:31.076860 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-605c4898-f269-4d9f-b165-c439f7e5980b tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: eef47923-4943-4736-acb5-5faa2775329e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:31.083672 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-605c4898-f269-4d9f-b165-c439f7e5980b tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:31.084134 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-605c4898-f269-4d9f-b165-c439f7e5980b tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:31.084925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-605c4898-f269-4d9f-b165-c439f7e5980b tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:31.085375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-605c4898-f269-4d9f-b165-c439f7e5980b tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:31.309892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-605c4898-f269-4d9f-b165-c439f7e5980b tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8abba155f841cea0212bbaad5462ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:31.318405 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-605c4898-f269-4d9f-b165-c439f7e5980b tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers/eef47923-4943-4736-acb5-5faa2775329e" status: 200 len: 1507 microversion: 2.1 time: 0.245744 Jul 19 22:35:31.318907 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1032/2093] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:31 2022] GET /compute/v2.1/servers/eef47923-4943-4736-acb5-5faa2775329e => generated 1507 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:31.323393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-cdd4477d-21b3-4563-bf8c-5ac7ef978ad7 req-56140236-3866-42e5-abf7-4003d0745d15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df9fcf88-5d46-4ed8-b799-faf22cc244f1", "name": "network-vif-plugged", "status": "completed", "tag": "2e6eb698-2fcc-4f59-8d7d-10b5d9238fbf"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:31.331991 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-cdd4477d-21b3-4563-bf8c-5ac7ef978ad7 req-56140236-3866-42e5-abf7-4003d0745d15 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:31.332441 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-cdd4477d-21b3-4563-bf8c-5ac7ef978ad7 req-56140236-3866-42e5-abf7-4003d0745d15 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:31.343949 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-cdd4477d-21b3-4563-bf8c-5ac7ef978ad7 req-56140236-3866-42e5-abf7-4003d0745d15 service nova] Creating event network-vif-plugged:2e6eb698-2fcc-4f59-8d7d-10b5d9238fbf for instance df9fcf88-5d46-4ed8-b799-faf22cc244f1 on n-h2-847009-3 Jul 19 22:35:31.349295 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-cdd4477d-21b3-4563-bf8c-5ac7ef978ad7 req-56140236-3866-42e5-abf7-4003d0745d15 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029213 Jul 19 22:35:31.349935 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1033/2094] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:31.355627 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-37a604af-2818-458a-b506-9d73dc56a374 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:31.356215 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-37a604af-2818-458a-b506-9d73dc56a374 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:31.364403 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-37a604af-2818-458a-b506-9d73dc56a374 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:31.364856 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-37a604af-2818-458a-b506-9d73dc56a374 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:31.365646 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-37a604af-2818-458a-b506-9d73dc56a374 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:31.366102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-37a604af-2818-458a-b506-9d73dc56a374 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:31.398028 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-37a604af-2818-458a-b506-9d73dc56a374 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:35:31.495332 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-37a604af-2818-458a-b506-9d73dc56a374 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 204 len: 0 microversion: 2.25 time: 0.143886 Jul 19 22:35:31.495926 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1034/2095] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 22:35:31 2022] DELETE /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:35:31.641342 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-267d4b82-5f15-44eb-954d-0c3875123858 req-94b98aba-3c2f-4061-8046-c29338eb565d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84f67219-22f4-491d-9f4c-afb31f356e65", "tag": "b51a40ab-5c58-4b37-9085-4a6d031b5972"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:31.651831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-267d4b82-5f15-44eb-954d-0c3875123858 req-94b98aba-3c2f-4061-8046-c29338eb565d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:31.652384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-267d4b82-5f15-44eb-954d-0c3875123858 req-94b98aba-3c2f-4061-8046-c29338eb565d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:31.664404 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-267d4b82-5f15-44eb-954d-0c3875123858 req-94b98aba-3c2f-4061-8046-c29338eb565d service nova] Creating event network-changed:b51a40ab-5c58-4b37-9085-4a6d031b5972 for instance 84f67219-22f4-491d-9f4c-afb31f356e65 on n-h1-847009-3 Jul 19 22:35:31.669989 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-267d4b82-5f15-44eb-954d-0c3875123858 req-94b98aba-3c2f-4061-8046-c29338eb565d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172450 Jul 19 22:35:31.670831 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1035/2096] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:31.678201 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d3cad0aa-0bfb-48da-af43-d31c75f2c0ff tempest-FloatingIPsTestJSON-1136553558 tempest-FloatingIPsTestJSON-1136553558-project] Calling method '.version_select at 0x7f7a156ab160>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:31.734869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG neutronclient.v2_0.client [None req-d3cad0aa-0bfb-48da-af43-d31c75f2c0ff tempest-FloatingIPsTestJSON-1136553558 tempest-FloatingIPsTestJSON-1136553558-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 4ebb3ab9-4a4d-44f1-9ae5-ce60695b8dd4 could not be found", "detail": ""}} {{(pid=119338) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 22:35:31.735624 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-d3cad0aa-0bfb-48da-af43-d31c75f2c0ff tempest-FloatingIPsTestJSON-1136553558 tempest-FloatingIPsTestJSON-1136553558-project] HTTP exception thrown: Floating IP not found for ID 4ebb3ab9-4a4d-44f1-9ae5-ce60695b8dd4 Jul 19 22:35:31.738156 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d3cad0aa-0bfb-48da-af43-d31c75f2c0ff tempest-FloatingIPsTestJSON-1136553558 tempest-FloatingIPsTestJSON-1136553558-project] Request method failure captured: Jul 19 22:35:31.738156 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/os-floating-ips/4ebb3ab9-4a4d-44f1-9ae5-ce60695b8dd4 HTTP/1.1 Jul 19 22:35:31.738156 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:35:31.738156 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:35:31.738156 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:35:31.738156 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:35:31.738156 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:35:31.738156 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:35:31.738156 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:35:31.738156 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:35:31.738156 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zGXqJWtgPVk2sw9k6-_NY6Co7XtQMgl8dXsMtjXX6oP3etLERbBYNxvU0yq3nuqOGipV1wDVNYUGtCBEJnFGDl0nPDk-Ru7uJTEs2X3g8QekBDXmyyJ94YMfvUmofrpqjISK1juIpdCFQSfewWF51vckwVcGwnpiHvbEdvlso0_odo Jul 19 22:35:31.738156 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:35:31.738156 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:35:31.738156 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:35:31.738156 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:35:31.738156 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:35:31.738156 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:35:31.738156 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 087ee41b7ecc4c8388c92e6037e363a5 Jul 19 22:35:31.738156 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-FloatingIPsTestJSON-1136553558 Jul 19 22:35:31.738156 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:35:31.738156 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:35:31.739285 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_087ee41b7ecc4c8388c92e6037e363a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/087ee41b7ecc4c8388c92e6037e363a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/087ee41b7ecc4c8388c92e6037e363a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/087ee41b7ecc4c8388c92e6037e363a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:35:31.739285 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-FloatingIPsTestJSON-1136553558 Jul 19 22:35:31.739285 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 087ee41b7ecc4c8388c92e6037e363a5 Jul 19 22:35:31.739285 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1136553558 Jul 19 22:35:31.739285 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-FloatingIPsTestJSON-1136553558-project Jul 19 22:35:31.739285 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:35:31.739285 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:35:31.739285 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: da824ffa26844aabbd192a0997f67593 Jul 19 22:35:31.739285 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-FloatingIPsTestJSON-1136553558-project Jul 19 22:35:31.739285 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:35:31.739285 n-d-847009-3 devstack@n-api.service[119338]: exception: Floating IP not found for ID 4ebb3ab9-4a4d-44f1-9ae5-ce60695b8dd4 Jul 19 22:35:31.739285 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '4ebb3ab9-4a4d-44f1-9ae5-ce60695b8dd4'} Jul 19 22:35:31.739285 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:35:31.739929 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:31.739929 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 19 22:35:31.739929 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 19 22:35:31.739929 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:35:31.739929 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:35:31.739929 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 19 22:35:31.739929 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 19 22:35:31.739929 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:35:31.739929 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:35:31.739929 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 22:35:31.739929 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 22:35:31.739929 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:35:31.739929 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:35:31.739929 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 22:35:31.739929 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 22:35:31.739929 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:35:31.739929 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:35:31.739929 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 22:35:31.739929 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 22:35:31.740803 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:35:31.740803 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:35:31.740803 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 22:35:31.740803 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 22:35:31.740803 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 22:35:31.740803 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 22:35:31.740803 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 4ebb3ab9-4a4d-44f1-9ae5-ce60695b8dd4 could not be found Jul 19 22:35:31.740803 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-465fd463-1369-484f-b6d8-e3ed1fbd8bf8'] Jul 19 22:35:31.740803 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:35:31.740803 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:35:31.740803 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:35:31.740803 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:31.740803 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 19 22:35:31.740803 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 19 22:35:31.740803 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 19 22:35:31.740803 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 19 22:35:31.740803 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 4ebb3ab9-4a4d-44f1-9ae5-ce60695b8dd4. Jul 19 22:35:31.740803 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:35:31.740803 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:35:31.740803 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:35:31.741718 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:31.741718 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:35:31.741718 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:35:31.741718 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:35:31.741718 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:35:31.741718 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:35:31.741718 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:35:31.741718 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:35:31.741718 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:35:31.741718 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 19 22:35:31.741718 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 22:35:31.741718 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 4ebb3ab9-4a4d-44f1-9ae5-ce60695b8dd4 Jul 19 22:35:31.741718 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:35:31.741718 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:35:31.741718 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:35:31.741718 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:31.741718 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:35:31.741718 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:35:31.741718 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:35:31.741718 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:35:31.742638 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 4ebb3ab9-4a4d-44f1-9ae5-ce60695b8dd4 Jul 19 22:35:31.742638 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:35:31.742638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d3cad0aa-0bfb-48da-af43-d31c75f2c0ff tempest-FloatingIPsTestJSON-1136553558 tempest-FloatingIPsTestJSON-1136553558-project] Returning 404 to user: Floating IP not found for ID 4ebb3ab9-4a4d-44f1-9ae5-ce60695b8dd4 {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:35:31.742638 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d3cad0aa-0bfb-48da-af43-d31c75f2c0ff tempest-FloatingIPsTestJSON-1136553558 tempest-FloatingIPsTestJSON-1136553558-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/4ebb3ab9-4a4d-44f1-9ae5-ce60695b8dd4" status: 404 len: 111 microversion: 2.1 time: 0.067314 Jul 19 22:35:31.742638 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1036/2097] 10.222.0.25 () {58 vars in 1259 bytes} [Tue Jul 19 22:35:31 2022] GET /compute/v2.1/os-floating-ips/4ebb3ab9-4a4d-44f1-9ae5-ce60695b8dd4 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:35:31.748642 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f28e9faf-a37d-4975-99fa-8a59ce0a7c55 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:31.752159 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f28e9faf-a37d-4975-99fa-8a59ce0a7c55 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a52bb4626ba4c00abdcbc0bed7811b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3173e6bfa06f4118842ec55c92b253de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:31.752980 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f28e9faf-a37d-4975-99fa-8a59ce0a7c55 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Searching by: {'deleted': False, 'project_id': '3173e6bfa06f4118842ec55c92b253de'} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:35:31.759638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f28e9faf-a37d-4975-99fa-8a59ce0a7c55 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:31.760087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f28e9faf-a37d-4975-99fa-8a59ce0a7c55 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:31.760896 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f28e9faf-a37d-4975-99fa-8a59ce0a7c55 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:31.761337 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f28e9faf-a37d-4975-99fa-8a59ce0a7c55 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:31.793557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.multi_cell_list [None req-f28e9faf-a37d-4975-99fa-8a59ce0a7c55 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119338) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:35:31.824895 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f28e9faf-a37d-4975-99fa-8a59ce0a7c55 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.083244 Jul 19 22:35:31.825490 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1037/2098] 10.222.0.25 () {58 vars in 1124 bytes} [Tue Jul 19 22:35:31 2022] GET /compute/v2.1/servers => generated 334 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:31.884118 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-51c55962-2dfa-4272-810a-b3e9ed6fa5ed tempest-QuotasAdminTestV236-1321544035 tempest-QuotasAdminTestV236-1321544035-project-admin] Action: 'update', calling method: .version_select at 0x7f7a100f5040>, body: {"quota_set": {"ram": "5120"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:31.953456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51c55962-2dfa-4272-810a-b3e9ed6fa5ed tempest-QuotasAdminTestV236-1321544035 tempest-QuotasAdminTestV236-1321544035-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:31.953918 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51c55962-2dfa-4272-810a-b3e9ed6fa5ed tempest-QuotasAdminTestV236-1321544035 tempest-QuotasAdminTestV236-1321544035-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:31.954769 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51c55962-2dfa-4272-810a-b3e9ed6fa5ed tempest-QuotasAdminTestV236-1321544035 tempest-QuotasAdminTestV236-1321544035-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:31.955237 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51c55962-2dfa-4272-810a-b3e9ed6fa5ed tempest-QuotasAdminTestV236-1321544035 tempest-QuotasAdminTestV236-1321544035-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:32.016591 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-51c55962-2dfa-4272-810a-b3e9ed6fa5ed tempest-QuotasAdminTestV236-1321544035 tempest-QuotasAdminTestV236-1321544035-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/5589a412568c49fb8571a864859a0e86" status: 200 len: 240 microversion: 2.36 time: 0.189634 Jul 19 22:35:32.017596 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1038/2099] 10.222.0.25 () {62 vars in 1302 bytes} [Tue Jul 19 22:35:31 2022] PUT /compute/v2.1/os-quota-sets/5589a412568c49fb8571a864859a0e86 => generated 240 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:35:32.024263 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-be0d1ecc-e8c2-4312-b315-f3bb09f99bfe tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:32.025029 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-be0d1ecc-e8c2-4312-b315-f3bb09f99bfe tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: df9fcf88-5d46-4ed8-b799-faf22cc244f1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:32.034699 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be0d1ecc-e8c2-4312-b315-f3bb09f99bfe tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:32.035207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be0d1ecc-e8c2-4312-b315-f3bb09f99bfe tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:32.036147 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be0d1ecc-e8c2-4312-b315-f3bb09f99bfe tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:32.036599 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be0d1ecc-e8c2-4312-b315-f3bb09f99bfe tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:32.311825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-be0d1ecc-e8c2-4312-b315-f3bb09f99bfe tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8abba155f841cea0212bbaad5462ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:32.321405 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-be0d1ecc-e8c2-4312-b315-f3bb09f99bfe tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers/df9fcf88-5d46-4ed8-b799-faf22cc244f1" status: 200 len: 1319 microversion: 2.1 time: 0.301862 Jul 19 22:35:32.322007 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1039/2100] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:32 2022] GET /compute/v2.1/servers/df9fcf88-5d46-4ed8-b799-faf22cc244f1 => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:32.326830 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0d592683-b9fc-4aad-b9da-01eeb24dd1e4 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:32.327546 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0d592683-b9fc-4aad-b9da-01eeb24dd1e4 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] [instance: 84f67219-22f4-491d-9f4c-afb31f356e65] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:32.334121 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d592683-b9fc-4aad-b9da-01eeb24dd1e4 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:32.335049 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d592683-b9fc-4aad-b9da-01eeb24dd1e4 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:32.335988 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d592683-b9fc-4aad-b9da-01eeb24dd1e4 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:32.336447 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d592683-b9fc-4aad-b9da-01eeb24dd1e4 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:32.341727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-94ebb112-d60a-445c-8666-d9b1da525907 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:35:32.342367 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-94ebb112-d60a-445c-8666-d9b1da525907 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:35:32.343178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-94ebb112-d60a-445c-8666-d9b1da525907 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:35:32.344152 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-94ebb112-d60a-445c-8666-d9b1da525907 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:35:32.345001 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-94ebb112-d60a-445c-8666-d9b1da525907 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:35:32.359101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-94ebb112-d60a-445c-8666-d9b1da525907 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:32.360036 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-94ebb112-d60a-445c-8666-d9b1da525907 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:32.361184 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-94ebb112-d60a-445c-8666-d9b1da525907 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:32.361640 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-94ebb112-d60a-445c-8666-d9b1da525907 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:32.386835 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-94ebb112-d60a-445c-8666-d9b1da525907 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Getting quotas for project 29ab27ce610d4b02a14a4fa7ff565555. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:35:32.392305 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-94ebb112-d60a-445c-8666-d9b1da525907 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Getting quotas for user 56b9fae8a5b14153a3715a6514ae84ff and project 29ab27ce610d4b02a14a4fa7ff565555. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:35:32.591731 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0d592683-b9fc-4aad-b9da-01eeb24dd1e4 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df68a9a9195744b386966b5c574b7878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c566f4290e1b41dcbab2b7cbb866e023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:32.595541 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-94ebb112-d60a-445c-8666-d9b1da525907 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:35:32.602817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-94ebb112-d60a-445c-8666-d9b1da525907 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='fa92190e-bdcc-42f4-b9a7-38a1cb1a4700',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a673dabb-4cd1-4913-963a-a6d3878505d1',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ebfb1f96-0b99-4b7e-9603-5a3ce61d0fbc',volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:35:32.604229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:35:32.623848 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0d592683-b9fc-4aad-b9da-01eeb24dd1e4 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] 10.222.0.25 "GET /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65" status: 200 len: 1350 microversion: 2.1 time: 0.300741 Jul 19 22:35:32.624448 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1040/2101] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:32 2022] GET /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65 => generated 1350 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:32.631944 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fd854f05-603a-457a-8495-22d1f32bdf60 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:32.633005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fd854f05-603a-457a-8495-22d1f32bdf60 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:32.641253 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd854f05-603a-457a-8495-22d1f32bdf60 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:32.642148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd854f05-603a-457a-8495-22d1f32bdf60 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:32.644033 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd854f05-603a-457a-8495-22d1f32bdf60 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:32.644839 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd854f05-603a-457a-8495-22d1f32bdf60 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:33.074541 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-94ebb112-d60a-445c-8666-d9b1da525907 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 7.309274 Jul 19 22:35:33.075803 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1062/2102] 10.222.0.25 () {62 vars in 1188 bytes} [Tue Jul 19 22:35:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 7311 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 22:35:33.080867 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-896e00d1-55c8-46a5-92ad-78d4f6caa459 tempest-FloatingIPsTestJSON-1136553558 tempest-FloatingIPsTestJSON-1136553558-project] Calling method '.version_select at 0x7f7a1040f0d0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:33.173693 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fd854f05-603a-457a-8495-22d1f32bdf60 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:33.185822 n-d-847009-3 devstack@n-api.service[119337]: DEBUG neutronclient.v2_0.client [None req-896e00d1-55c8-46a5-92ad-78d4f6caa459 tempest-FloatingIPsTestJSON-1136553558 tempest-FloatingIPsTestJSON-1136553558-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 4ebb3ab9-4a4d-44f1-9ae5-ce60695b8dd4 could not be found", "detail": ""}} {{(pid=119337) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 22:35:33.186922 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-896e00d1-55c8-46a5-92ad-78d4f6caa459 tempest-FloatingIPsTestJSON-1136553558 tempest-FloatingIPsTestJSON-1136553558-project] HTTP exception thrown: Floating IP not found for ID 4ebb3ab9-4a4d-44f1-9ae5-ce60695b8dd4 Jul 19 22:35:33.192922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-896e00d1-55c8-46a5-92ad-78d4f6caa459 tempest-FloatingIPsTestJSON-1136553558 tempest-FloatingIPsTestJSON-1136553558-project] Request method failure captured: Jul 19 22:35:33.192922 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/os-floating-ips/4ebb3ab9-4a4d-44f1-9ae5-ce60695b8dd4 HTTP/1.1 Jul 19 22:35:33.192922 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:35:33.192922 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:35:33.192922 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:35:33.192922 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:35:33.192922 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:35:33.192922 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:35:33.192922 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:35:33.192922 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:35:33.192922 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zGXqJWtgPVk2sw9k6-_NY6Co7XtQMgl8dXsMtjXX6oP3etLERbBYNxvU0yq3nuqOGipV1wDVNYUGtCBEJnFGDl0nPDk-Ru7uJTEs2X3g8QekBDXmyyJ94YMfvUmofrpqjISK1juIpdCFQSfewWF51vckwVcGwnpiHvbEdvlso0_odo Jul 19 22:35:33.192922 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:35:33.192922 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:35:33.192922 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:35:33.192922 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:35:33.192922 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:35:33.192922 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:35:33.192922 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 087ee41b7ecc4c8388c92e6037e363a5 Jul 19 22:35:33.192922 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-FloatingIPsTestJSON-1136553558 Jul 19 22:35:33.192922 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:35:33.192922 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:35:33.194092 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_087ee41b7ecc4c8388c92e6037e363a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/087ee41b7ecc4c8388c92e6037e363a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/087ee41b7ecc4c8388c92e6037e363a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/087ee41b7ecc4c8388c92e6037e363a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:35:33.194092 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-FloatingIPsTestJSON-1136553558 Jul 19 22:35:33.194092 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 087ee41b7ecc4c8388c92e6037e363a5 Jul 19 22:35:33.194092 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1136553558 Jul 19 22:35:33.194092 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-FloatingIPsTestJSON-1136553558-project Jul 19 22:35:33.194092 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:35:33.194092 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:35:33.194092 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: da824ffa26844aabbd192a0997f67593 Jul 19 22:35:33.194092 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-FloatingIPsTestJSON-1136553558-project Jul 19 22:35:33.194092 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:35:33.194092 n-d-847009-3 devstack@n-api.service[119337]: exception: Floating IP not found for ID 4ebb3ab9-4a4d-44f1-9ae5-ce60695b8dd4 Jul 19 22:35:33.194092 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '4ebb3ab9-4a4d-44f1-9ae5-ce60695b8dd4'} Jul 19 22:35:33.194092 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:35:33.194811 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:33.194811 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 19 22:35:33.194811 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 19 22:35:33.194811 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:35:33.194811 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:35:33.194811 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 19 22:35:33.194811 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 19 22:35:33.194811 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:35:33.194811 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:35:33.194811 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 22:35:33.194811 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 22:35:33.194811 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:35:33.194811 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:35:33.194811 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 22:35:33.194811 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 22:35:33.194811 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:35:33.194811 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:35:33.194811 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 22:35:33.194811 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 22:35:33.195821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:35:33.195821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:35:33.195821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 22:35:33.195821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 22:35:33.195821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 22:35:33.195821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 22:35:33.195821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 4ebb3ab9-4a4d-44f1-9ae5-ce60695b8dd4 could not be found Jul 19 22:35:33.195821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d482ee37-42f0-484f-8b58-9448aea686be'] Jul 19 22:35:33.195821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:33.195821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:35:33.195821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:33.195821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:33.195821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 19 22:35:33.195821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 19 22:35:33.195821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 19 22:35:33.195821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 19 22:35:33.195821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 4ebb3ab9-4a4d-44f1-9ae5-ce60695b8dd4. Jul 19 22:35:33.195821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:33.195821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:35:33.195821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:33.196923 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:33.196923 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:35:33.196923 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:35:33.196923 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:35:33.196923 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:35:33.196923 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:35:33.196923 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:35:33.196923 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:35:33.196923 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:35:33.196923 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 19 22:35:33.196923 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 22:35:33.196923 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 4ebb3ab9-4a4d-44f1-9ae5-ce60695b8dd4 Jul 19 22:35:33.196923 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:33.196923 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:35:33.196923 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:33.196923 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:33.196923 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:35:33.196923 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:35:33.196923 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:35:33.196923 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:35:33.197910 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 4ebb3ab9-4a4d-44f1-9ae5-ce60695b8dd4 Jul 19 22:35:33.197910 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:33.198042 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fd854f05-603a-457a-8495-22d1f32bdf60 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:33.199316 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fd854f05-603a-457a-8495-22d1f32bdf60 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:33.200313 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fd854f05-603a-457a-8495-22d1f32bdf60 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1732 microversion: 2.25 time: 0.572760 Jul 19 22:35:33.200831 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1041/2103] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:32 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1732 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:33.213795 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-896e00d1-55c8-46a5-92ad-78d4f6caa459 tempest-FloatingIPsTestJSON-1136553558 tempest-FloatingIPsTestJSON-1136553558-project] Returning 404 to user: Floating IP not found for ID 4ebb3ab9-4a4d-44f1-9ae5-ce60695b8dd4 {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:35:33.216254 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-896e00d1-55c8-46a5-92ad-78d4f6caa459 tempest-FloatingIPsTestJSON-1136553558 tempest-FloatingIPsTestJSON-1136553558-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/4ebb3ab9-4a4d-44f1-9ae5-ce60695b8dd4" status: 404 len: 111 microversion: 2.1 time: 0.139114 Jul 19 22:35:33.217119 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1063/2104] 10.222.0.25 () {58 vars in 1262 bytes} [Tue Jul 19 22:35:33 2022] DELETE /compute/v2.1/os-floating-ips/4ebb3ab9-4a4d-44f1-9ae5-ce60695b8dd4 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:35:33.223659 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-02acc70d-ae80-459e-9812-25da7e8e423d tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:33.229673 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-02acc70d-ae80-459e-9812-25da7e8e423d tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a52bb4626ba4c00abdcbc0bed7811b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3173e6bfa06f4118842ec55c92b253de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:33.230727 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-02acc70d-ae80-459e-9812-25da7e8e423d tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Searching by: {'deleted': False, 'project_id': '3173e6bfa06f4118842ec55c92b253de'} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:35:33.242675 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-60e97f92-4913-4251-a991-ed56fcd9eed7 tempest-QuotasAdminTestV236-1321544035 tempest-QuotasAdminTestV236-1321544035-project-admin] Calling method '.version_select at 0x7f7a1094a820>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:33.249827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02acc70d-ae80-459e-9812-25da7e8e423d tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:33.250295 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02acc70d-ae80-459e-9812-25da7e8e423d tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:33.252580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02acc70d-ae80-459e-9812-25da7e8e423d tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:33.255514 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02acc70d-ae80-459e-9812-25da7e8e423d tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:33.319892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.multi_cell_list [None req-02acc70d-ae80-459e-9812-25da7e8e423d tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119338) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:35:33.374187 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60e97f92-4913-4251-a991-ed56fcd9eed7 tempest-QuotasAdminTestV236-1321544035 tempest-QuotasAdminTestV236-1321544035-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:33.375311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60e97f92-4913-4251-a991-ed56fcd9eed7 tempest-QuotasAdminTestV236-1321544035 tempest-QuotasAdminTestV236-1321544035-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:33.376318 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60e97f92-4913-4251-a991-ed56fcd9eed7 tempest-QuotasAdminTestV236-1321544035 tempest-QuotasAdminTestV236-1321544035-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:33.376928 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60e97f92-4913-4251-a991-ed56fcd9eed7 tempest-QuotasAdminTestV236-1321544035 tempest-QuotasAdminTestV236-1321544035-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:33.404781 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-60e97f92-4913-4251-a991-ed56fcd9eed7 tempest-QuotasAdminTestV236-1321544035 tempest-QuotasAdminTestV236-1321544035-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/5589a412568c49fb8571a864859a0e86/detail" status: 200 len: 672 microversion: 2.36 time: 0.165718 Jul 19 22:35:33.405916 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1064/2105] 10.222.0.25 () {60 vars in 1303 bytes} [Tue Jul 19 22:35:33 2022] GET /compute/v2.1/os-quota-sets/5589a412568c49fb8571a864859a0e86/detail => generated 672 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:35:33.423354 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1cd175b2-7a03-48fc-884c-57b93112f798 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:33.424333 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1cd175b2-7a03-48fc-884c-57b93112f798 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: c2560d4c-c905-4dbc-9eb8-40410ec01473] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:33.428669 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-02acc70d-ae80-459e-9812-25da7e8e423d tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52bb4626ba4c00abdcbc0bed7811b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3173e6bfa06f4118842ec55c92b253de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:33.433454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1cd175b2-7a03-48fc-884c-57b93112f798 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:33.434243 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1cd175b2-7a03-48fc-884c-57b93112f798 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:33.436402 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1cd175b2-7a03-48fc-884c-57b93112f798 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:33.437300 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1cd175b2-7a03-48fc-884c-57b93112f798 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:33.439322 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02acc70d-ae80-459e-9812-25da7e8e423d tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:33.439761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02acc70d-ae80-459e-9812-25da7e8e423d tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:33.770985 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-02acc70d-ae80-459e-9812-25da7e8e423d tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 0.569074 Jul 19 22:35:33.771957 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1042/2106] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:35:33 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:33.777010 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e5278c14-d918-4ccc-a85d-6c6045d86edf tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:33.778258 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e5278c14-d918-4ccc-a85d-6c6045d86edf tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:33.863816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e5278c14-d918-4ccc-a85d-6c6045d86edf tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:33.871433 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e5278c14-d918-4ccc-a85d-6c6045d86edf tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:33.872961 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e5278c14-d918-4ccc-a85d-6c6045d86edf tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:33.874290 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e5278c14-d918-4ccc-a85d-6c6045d86edf tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1286 microversion: 2.32 time: 0.101189 Jul 19 22:35:33.875012 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1043/2107] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:33 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:33.880084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a0c7c972-cc4c-474c-8fd0-c6ae3985f250 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:33.880944 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a0c7c972-cc4c-474c-8fd0-c6ae3985f250 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: df9fcf88-5d46-4ed8-b799-faf22cc244f1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:33.889295 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0c7c972-cc4c-474c-8fd0-c6ae3985f250 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:33.890123 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0c7c972-cc4c-474c-8fd0-c6ae3985f250 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:33.891189 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0c7c972-cc4c-474c-8fd0-c6ae3985f250 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:33.891878 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0c7c972-cc4c-474c-8fd0-c6ae3985f250 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:33.902302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1cd175b2-7a03-48fc-884c-57b93112f798 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:33.915149 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1cd175b2-7a03-48fc-884c-57b93112f798 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473" status: 200 len: 1324 microversion: 2.1 time: 0.497640 Jul 19 22:35:33.925191 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1065/2108] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:33 2022] GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473 => generated 1324 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:33.925191 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-fc177b37-e332-4be2-b32e-1b6252b5a8c6 req-888e9dc1-5bf5-4e13-ad10-0ab52a266835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2560d4c-c905-4dbc-9eb8-40410ec01473", "name": "network-vif-plugged", "status": "completed", "tag": "c0c2894d-78f3-43fb-9c7e-679991ba2b43"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:33.934627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-fc177b37-e332-4be2-b32e-1b6252b5a8c6 req-888e9dc1-5bf5-4e13-ad10-0ab52a266835 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:33.935177 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-fc177b37-e332-4be2-b32e-1b6252b5a8c6 req-888e9dc1-5bf5-4e13-ad10-0ab52a266835 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:33.962520 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-fc177b37-e332-4be2-b32e-1b6252b5a8c6 req-888e9dc1-5bf5-4e13-ad10-0ab52a266835 service nova] Creating event network-vif-plugged:c0c2894d-78f3-43fb-9c7e-679991ba2b43 for instance c2560d4c-c905-4dbc-9eb8-40410ec01473 on n-h2-847009-3 Jul 19 22:35:33.977127 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-fc177b37-e332-4be2-b32e-1b6252b5a8c6 req-888e9dc1-5bf5-4e13-ad10-0ab52a266835 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059296 Jul 19 22:35:33.978280 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1066/2109] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:33.983964 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7180ddf0-6733-4399-8a80-13e07ee4d667 tempest-QuotasAdminTestV236-1321544035 tempest-QuotasAdminTestV236-1321544035-project-admin] Action: 'update', calling method: .version_select at 0x7f7a03d24ca0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:34.084100 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7180ddf0-6733-4399-8a80-13e07ee4d667 tempest-QuotasAdminTestV236-1321544035 tempest-QuotasAdminTestV236-1321544035-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:34.085175 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7180ddf0-6733-4399-8a80-13e07ee4d667 tempest-QuotasAdminTestV236-1321544035 tempest-QuotasAdminTestV236-1321544035-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:34.086019 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7180ddf0-6733-4399-8a80-13e07ee4d667 tempest-QuotasAdminTestV236-1321544035 tempest-QuotasAdminTestV236-1321544035-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:34.086634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7180ddf0-6733-4399-8a80-13e07ee4d667 tempest-QuotasAdminTestV236-1321544035 tempest-QuotasAdminTestV236-1321544035-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:34.131795 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7180ddf0-6733-4399-8a80-13e07ee4d667 tempest-QuotasAdminTestV236-1321544035 tempest-QuotasAdminTestV236-1321544035-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:34.132580 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7180ddf0-6733-4399-8a80-13e07ee4d667 tempest-QuotasAdminTestV236-1321544035 tempest-QuotasAdminTestV236-1321544035-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:34.133594 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7180ddf0-6733-4399-8a80-13e07ee4d667 tempest-QuotasAdminTestV236-1321544035 tempest-QuotasAdminTestV236-1321544035-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:34.134220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7180ddf0-6733-4399-8a80-13e07ee4d667 tempest-QuotasAdminTestV236-1321544035 tempest-QuotasAdminTestV236-1321544035-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:34.210769 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7180ddf0-6733-4399-8a80-13e07ee4d667 tempest-QuotasAdminTestV236-1321544035 tempest-QuotasAdminTestV236-1321544035-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/5589a412568c49fb8571a864859a0e86?user_id=a8072179766644769cc62e7c8adf5389" status: 200 len: 240 microversion: 2.36 time: 0.231202 Jul 19 22:35:34.212118 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1067/2110] 10.222.0.25 () {62 vars in 1383 bytes} [Tue Jul 19 22:35:33 2022] PUT /compute/v2.1/os-quota-sets/5589a412568c49fb8571a864859a0e86?user_id=a8072179766644769cc62e7c8adf5389 => generated 240 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:35:34.218589 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bfc9b515-b51b-4fca-9d1d-1e2f58cd3983 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:34.219650 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bfc9b515-b51b-4fca-9d1d-1e2f58cd3983 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] [instance: 84f67219-22f4-491d-9f4c-afb31f356e65] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:34.230017 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bfc9b515-b51b-4fca-9d1d-1e2f58cd3983 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:34.230809 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bfc9b515-b51b-4fca-9d1d-1e2f58cd3983 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:34.231818 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bfc9b515-b51b-4fca-9d1d-1e2f58cd3983 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:34.232495 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bfc9b515-b51b-4fca-9d1d-1e2f58cd3983 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:34.292322 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a0c7c972-cc4c-474c-8fd0-c6ae3985f250 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8abba155f841cea0212bbaad5462ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:34.307849 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a0c7c972-cc4c-474c-8fd0-c6ae3985f250 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers/df9fcf88-5d46-4ed8-b799-faf22cc244f1" status: 200 len: 1506 microversion: 2.1 time: 0.431585 Jul 19 22:35:34.309226 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1044/2111] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:33 2022] GET /compute/v2.1/servers/df9fcf88-5d46-4ed8-b799-faf22cc244f1 => generated 1506 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:34.313677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8b831a57-e3f3-430e-b720-9e9e24f18ca5 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:34.331995 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8b831a57-e3f3-430e-b720-9e9e24f18ca5 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021792 Jul 19 22:35:34.332619 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1045/2112] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:35:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:34.343511 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ba20fab4-1af5-400a-bdfa-41519af5331e tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:34.344251 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ba20fab4-1af5-400a-bdfa-41519af5331e tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:34.351697 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba20fab4-1af5-400a-bdfa-41519af5331e tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:34.352266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba20fab4-1af5-400a-bdfa-41519af5331e tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:34.353161 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba20fab4-1af5-400a-bdfa-41519af5331e tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:34.353682 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba20fab4-1af5-400a-bdfa-41519af5331e tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:34.779071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ba20fab4-1af5-400a-bdfa-41519af5331e tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:34.800711 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ba20fab4-1af5-400a-bdfa-41519af5331e tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:34.809144 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ba20fab4-1af5-400a-bdfa-41519af5331e tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:34.818756 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ba20fab4-1af5-400a-bdfa-41519af5331e tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1665 microversion: 2.25 time: 0.483233 Jul 19 22:35:34.819455 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1046/2113] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:34 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1665 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:34.833011 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ccbc99c1-0a29-40ba-bda7-1edd5d5532e9 tempest-QuotasAdminTestV236-1321544035 tempest-QuotasAdminTestV236-1321544035-project-admin] Calling method '.version_select at 0x7f7a1562c4c0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:34.949198 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ccbc99c1-0a29-40ba-bda7-1edd5d5532e9 tempest-QuotasAdminTestV236-1321544035 tempest-QuotasAdminTestV236-1321544035-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/5589a412568c49fb8571a864859a0e86?user_id=a8072179766644769cc62e7c8adf5389" status: 200 len: 282 microversion: 2.36 time: 0.122051 Jul 19 22:35:34.949698 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1047/2114] 10.222.0.25 () {60 vars in 1363 bytes} [Tue Jul 19 22:35:34 2022] GET /compute/v2.1/os-quota-sets/5589a412568c49fb8571a864859a0e86?user_id=a8072179766644769cc62e7c8adf5389 => generated 282 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:35:34.955505 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a1411fdd-9e2a-440f-aa71-491f1feb7630 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:34.956845 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a1411fdd-9e2a-440f-aa71-491f1feb7630 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: df9fcf88-5d46-4ed8-b799-faf22cc244f1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:34.964707 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1411fdd-9e2a-440f-aa71-491f1feb7630 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:34.965490 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1411fdd-9e2a-440f-aa71-491f1feb7630 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:34.966521 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1411fdd-9e2a-440f-aa71-491f1feb7630 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:34.967346 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1411fdd-9e2a-440f-aa71-491f1feb7630 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:34.993945 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bfc9b515-b51b-4fca-9d1d-1e2f58cd3983 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df68a9a9195744b386966b5c574b7878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c566f4290e1b41dcbab2b7cbb866e023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:35.003674 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a1411fdd-9e2a-440f-aa71-491f1feb7630 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: df9fcf88-5d46-4ed8-b799-faf22cc244f1] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:35:35.006455 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bfc9b515-b51b-4fca-9d1d-1e2f58cd3983 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] 10.222.0.25 "GET /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65" status: 200 len: 1350 microversion: 2.1 time: 0.792875 Jul 19 22:35:35.006998 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1068/2115] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:34 2022] GET /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65 => generated 1350 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:35.022029 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-17becee7-ed3f-49cf-8072-d6dd4f630eb2 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:35.022548 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-17becee7-ed3f-49cf-8072-d6dd4f630eb2 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] [instance: b33a2a96-d4d2-4835-824d-739d006bf056] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:35.036482 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-17becee7-ed3f-49cf-8072-d6dd4f630eb2 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:35.037268 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-17becee7-ed3f-49cf-8072-d6dd4f630eb2 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:35.038631 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-17becee7-ed3f-49cf-8072-d6dd4f630eb2 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:35.039451 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-17becee7-ed3f-49cf-8072-d6dd4f630eb2 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:35.107936 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-17becee7-ed3f-49cf-8072-d6dd4f630eb2 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] [instance: b33a2a96-d4d2-4835-824d-739d006bf056] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:35:35.133874 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:35:35.140628 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a1411fdd-9e2a-440f-aa71-491f1feb7630 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "DELETE /compute/v2.1/servers/df9fcf88-5d46-4ed8-b799-faf22cc244f1" status: 204 len: 0 microversion: 2.1 time: 0.189140 Jul 19 22:35:35.141541 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1048/2116] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:35:34 2022] DELETE /compute/v2.1/servers/df9fcf88-5d46-4ed8-b799-faf22cc244f1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:35:35.158850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4d4af5f0-1d00-45aa-a597-dd194bf5aa83 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:35.159333 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4d4af5f0-1d00-45aa-a597-dd194bf5aa83 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:35.171500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d4af5f0-1d00-45aa-a597-dd194bf5aa83 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:35.171976 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d4af5f0-1d00-45aa-a597-dd194bf5aa83 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:35.172788 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d4af5f0-1d00-45aa-a597-dd194bf5aa83 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:35.173251 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d4af5f0-1d00-45aa-a597-dd194bf5aa83 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:35.381889 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-17becee7-ed3f-49cf-8072-d6dd4f630eb2 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056" status: 204 len: 0 microversion: 2.1 time: 0.364621 Jul 19 22:35:35.384200 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1069/2117] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:35:35 2022] DELETE /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:35:35.395100 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-683c4f9b-7788-4de2-b53b-efea913e9f30 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:35.396531 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-683c4f9b-7788-4de2-b53b-efea913e9f30 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: c2560d4c-c905-4dbc-9eb8-40410ec01473] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:35.409684 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-683c4f9b-7788-4de2-b53b-efea913e9f30 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:35.411054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-683c4f9b-7788-4de2-b53b-efea913e9f30 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:35.413748 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-683c4f9b-7788-4de2-b53b-efea913e9f30 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:35.415033 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-683c4f9b-7788-4de2-b53b-efea913e9f30 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:35.419907 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4d4af5f0-1d00-45aa-a597-dd194bf5aa83 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:35.434178 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4d4af5f0-1d00-45aa-a597-dd194bf5aa83 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:35.443243 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4d4af5f0-1d00-45aa-a597-dd194bf5aa83 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:35.444901 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4d4af5f0-1d00-45aa-a597-dd194bf5aa83 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1576 microversion: 2.32 time: 0.302125 Jul 19 22:35:35.447873 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1049/2118] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:35 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1576 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:35.458375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a95177cf-bd98-4869-99e2-665cc139e9fa tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:35.459097 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a95177cf-bd98-4869-99e2-665cc139e9fa tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: eef47923-4943-4736-acb5-5faa2775329e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:35.477102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a95177cf-bd98-4869-99e2-665cc139e9fa tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:35.477822 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a95177cf-bd98-4869-99e2-665cc139e9fa tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:35.479084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a95177cf-bd98-4869-99e2-665cc139e9fa tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:35.489596 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a95177cf-bd98-4869-99e2-665cc139e9fa tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:35.621170 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a95177cf-bd98-4869-99e2-665cc139e9fa tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: eef47923-4943-4736-acb5-5faa2775329e] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:35:35.708766 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-683c4f9b-7788-4de2-b53b-efea913e9f30 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:35.724427 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-683c4f9b-7788-4de2-b53b-efea913e9f30 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473" status: 200 len: 1324 microversion: 2.1 time: 0.337219 Jul 19 22:35:35.725713 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1070/2119] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:35 2022] GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473 => generated 1324 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:35.732000 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-30ec5532-106e-4cb4-976a-8d39f50fb52b req-2bdf5322-9ea2-459c-9a61-01f60e248d94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d871dc5-0189-41e2-8650-8f753bf98c67", "name": "network-vif-deleted", "tag": "76972dec-38be-463e-8f2e-775f0e49be0a"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:35.745150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-30ec5532-106e-4cb4-976a-8d39f50fb52b req-2bdf5322-9ea2-459c-9a61-01f60e248d94 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:35.746030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-30ec5532-106e-4cb4-976a-8d39f50fb52b req-2bdf5322-9ea2-459c-9a61-01f60e248d94 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:35.762113 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-30ec5532-106e-4cb4-976a-8d39f50fb52b req-2bdf5322-9ea2-459c-9a61-01f60e248d94 service nova] Creating event network-vif-deleted:76972dec-38be-463e-8f2e-775f0e49be0a for instance 5d871dc5-0189-41e2-8650-8f753bf98c67 on n-h1-847009-3 Jul 19 22:35:35.769418 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-30ec5532-106e-4cb4-976a-8d39f50fb52b req-2bdf5322-9ea2-459c-9a61-01f60e248d94 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041111 Jul 19 22:35:35.776095 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1071/2120] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:35.788225 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e4f10bd7-e7ab-4b3e-8f0b-cf43a6e57202 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:35.791597 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e4f10bd7-e7ab-4b3e-8f0b-cf43a6e57202 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] [instance: b33a2a96-d4d2-4835-824d-739d006bf056] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:35.814772 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e4f10bd7-e7ab-4b3e-8f0b-cf43a6e57202 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:35.817595 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e4f10bd7-e7ab-4b3e-8f0b-cf43a6e57202 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:35.819470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e4f10bd7-e7ab-4b3e-8f0b-cf43a6e57202 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:35.820784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e4f10bd7-e7ab-4b3e-8f0b-cf43a6e57202 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:35.867317 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a95177cf-bd98-4869-99e2-665cc139e9fa tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "DELETE /compute/v2.1/servers/eef47923-4943-4736-acb5-5faa2775329e" status: 204 len: 0 microversion: 2.1 time: 0.417399 Jul 19 22:35:35.869159 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1050/2121] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:35:35 2022] DELETE /compute/v2.1/servers/eef47923-4943-4736-acb5-5faa2775329e => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:35:35.910114 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2b47e5fd-90ef-4af6-bd77-8738ff45dfb0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:35.928207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2b47e5fd-90ef-4af6-bd77-8738ff45dfb0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:35.950109 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b47e5fd-90ef-4af6-bd77-8738ff45dfb0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:35.951406 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b47e5fd-90ef-4af6-bd77-8738ff45dfb0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:35.953202 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b47e5fd-90ef-4af6-bd77-8738ff45dfb0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:35.954566 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b47e5fd-90ef-4af6-bd77-8738ff45dfb0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:36.089155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b47e5fd-90ef-4af6-bd77-8738ff45dfb0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:36.090324 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b47e5fd-90ef-4af6-bd77-8738ff45dfb0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:36.091352 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-2b47e5fd-90ef-4af6-bd77-8738ff45dfb0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lazy-loading 'fault' on Instance uuid 5d871dc5-0189-41e2-8650-8f753bf98c67 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:35:36.208815 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2b47e5fd-90ef-4af6-bd77-8738ff45dfb0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:36.223053 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2b47e5fd-90ef-4af6-bd77-8738ff45dfb0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:36.225131 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2b47e5fd-90ef-4af6-bd77-8738ff45dfb0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:36.226633 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2b47e5fd-90ef-4af6-bd77-8738ff45dfb0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 200 len: 1376 microversion: 2.25 time: 0.355494 Jul 19 22:35:36.240155 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1051/2122] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:35 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 1376 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:36.246173 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-494bc4c2-f512-4a16-9c56-fee180574dda req-cd763495-1947-4171-9ab9-9e8e8cc3ef54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84f67219-22f4-491d-9f4c-afb31f356e65", "name": "network-vif-plugged", "status": "completed", "tag": "b51a40ab-5c58-4b37-9085-4a6d031b5972"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:36.246793 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e4f10bd7-e7ab-4b3e-8f0b-cf43a6e57202 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52bb4626ba4c00abdcbc0bed7811b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3173e6bfa06f4118842ec55c92b253de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:36.281345 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-494bc4c2-f512-4a16-9c56-fee180574dda req-cd763495-1947-4171-9ab9-9e8e8cc3ef54 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:36.282034 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-494bc4c2-f512-4a16-9c56-fee180574dda req-cd763495-1947-4171-9ab9-9e8e8cc3ef54 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:36.283517 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e4f10bd7-e7ab-4b3e-8f0b-cf43a6e57202 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] 10.222.0.25 "GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056" status: 200 len: 1698 microversion: 2.1 time: 0.504158 Jul 19 22:35:36.293480 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1072/2123] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:35 2022] GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056 => generated 1698 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:36.303824 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-27a4bd9b-8be0-4803-ab48-2d902c6e5495 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:36.305003 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-27a4bd9b-8be0-4803-ab48-2d902c6e5495 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] [instance: 84f67219-22f4-491d-9f4c-afb31f356e65] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:36.326070 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-494bc4c2-f512-4a16-9c56-fee180574dda req-cd763495-1947-4171-9ab9-9e8e8cc3ef54 service nova] Creating event network-vif-plugged:b51a40ab-5c58-4b37-9085-4a6d031b5972 for instance 84f67219-22f4-491d-9f4c-afb31f356e65 on n-h1-847009-3 Jul 19 22:35:36.339585 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-494bc4c2-f512-4a16-9c56-fee180574dda req-cd763495-1947-4171-9ab9-9e8e8cc3ef54 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097152 Jul 19 22:35:36.342584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-27a4bd9b-8be0-4803-ab48-2d902c6e5495 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:36.343507 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-27a4bd9b-8be0-4803-ab48-2d902c6e5495 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:36.343908 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1052/2124] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:36.346470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-27a4bd9b-8be0-4803-ab48-2d902c6e5495 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:36.356262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-27a4bd9b-8be0-4803-ab48-2d902c6e5495 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:36.357595 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c2939393-ad0e-487c-959d-417e2926d6f4 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1936689620", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "e6e615b9-ea1e-442a-be42-579fb635f15f"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:36.469595 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-c2939393-ad0e-487c-959d-417e2926d6f4 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] validate_networks() for [('e6e615b9-ea1e-442a-be42-579fb635f15f', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:35:36.963030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-27a4bd9b-8be0-4803-ab48-2d902c6e5495 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df68a9a9195744b386966b5c574b7878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c566f4290e1b41dcbab2b7cbb866e023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:36.983542 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-27a4bd9b-8be0-4803-ab48-2d902c6e5495 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] 10.222.0.25 "GET /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65" status: 200 len: 1350 microversion: 2.1 time: 0.694311 Jul 19 22:35:36.986667 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1073/2125] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:36 2022] GET /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65 => generated 1350 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:36.997997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-995dc7a1-dab1-461f-bba8-af41d9743df5 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:37.000137 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-995dc7a1-dab1-461f-bba8-af41d9743df5 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:37.008811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-995dc7a1-dab1-461f-bba8-af41d9743df5 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:37.009409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-995dc7a1-dab1-461f-bba8-af41d9743df5 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:37.010663 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-995dc7a1-dab1-461f-bba8-af41d9743df5 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:37.011426 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-995dc7a1-dab1-461f-bba8-af41d9743df5 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:37.388686 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-995dc7a1-dab1-461f-bba8-af41d9743df5 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:37.426250 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-995dc7a1-dab1-461f-bba8-af41d9743df5 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:37.428879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-995dc7a1-dab1-461f-bba8-af41d9743df5 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:37.430482 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-995dc7a1-dab1-461f-bba8-af41d9743df5 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1576 microversion: 2.32 time: 0.441357 Jul 19 22:35:37.431662 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1074/2126] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:36 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1576 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:37.450281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4be1e06b-cbd3-4472-b1e0-d6e1daa36b7f tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:37.451976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4be1e06b-cbd3-4472-b1e0-d6e1daa36b7f tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: c2560d4c-c905-4dbc-9eb8-40410ec01473] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:37.464291 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4be1e06b-cbd3-4472-b1e0-d6e1daa36b7f tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:37.464884 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4be1e06b-cbd3-4472-b1e0-d6e1daa36b7f tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:37.466391 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4be1e06b-cbd3-4472-b1e0-d6e1daa36b7f tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:37.467316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4be1e06b-cbd3-4472-b1e0-d6e1daa36b7f tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:37.555462 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-c2939393-ad0e-487c-959d-417e2926d6f4 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:35:37.558006 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-c2939393-ad0e-487c-959d-417e2926d6f4 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:35:37.558826 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-c2939393-ad0e-487c-959d-417e2926d6f4 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:35:37.560639 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-c2939393-ad0e-487c-959d-417e2926d6f4 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:35:37.562800 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-c2939393-ad0e-487c-959d-417e2926d6f4 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:35:37.587147 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c2939393-ad0e-487c-959d-417e2926d6f4 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:37.587662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c2939393-ad0e-487c-959d-417e2926d6f4 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:37.588515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c2939393-ad0e-487c-959d-417e2926d6f4 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:37.588950 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c2939393-ad0e-487c-959d-417e2926d6f4 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:37.607921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-c2939393-ad0e-487c-959d-417e2926d6f4 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Getting quotas for project 52bcd0bd2cd24c5d86494a3af2d25d59. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:35:37.614595 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-c2939393-ad0e-487c-959d-417e2926d6f4 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Getting quotas for user 7a8abba155f841cea0212bbaad5462ac and project 52bcd0bd2cd24c5d86494a3af2d25d59. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:35:37.628723 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c2939393-ad0e-487c-959d-417e2926d6f4 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Going to run 2 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:35:37.631408 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c2939393-ad0e-487c-959d-417e2926d6f4 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: 350b4c29-cb79-4b1e-a302-b84b2567608a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:35:37.668163 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c2939393-ad0e-487c-959d-417e2926d6f4 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: f3fa3e57-f0c8-4199-a602-8207624e50af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=350b4c29-cb79-4b1e-a302-b84b2567608a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:35:37.732475 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c2939393-ad0e-487c-959d-417e2926d6f4 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.386838 Jul 19 22:35:37.737502 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1053/2127] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:35:36 2022] POST /compute/v2.1/servers => generated 32 bytes in 1389 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 19 22:35:37.739733 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-74ce3a39-42bf-41a8-8196-75499e004588 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:37.740380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-74ce3a39-42bf-41a8-8196-75499e004588 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 5d871dc5-0189-41e2-8650-8f753bf98c67] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:37.748542 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-74ce3a39-42bf-41a8-8196-75499e004588 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:37.749005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-74ce3a39-42bf-41a8-8196-75499e004588 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:37.749879 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-74ce3a39-42bf-41a8-8196-75499e004588 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:37.750393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-74ce3a39-42bf-41a8-8196-75499e004588 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:37.775437 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-74ce3a39-42bf-41a8-8196-75499e004588 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] HTTP exception thrown: Instance 5d871dc5-0189-41e2-8650-8f753bf98c67 could not be found. Jul 19 22:35:37.777171 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-74ce3a39-42bf-41a8-8196-75499e004588 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Request method failure captured: Jul 19 22:35:37.777171 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 HTTP/1.1 Jul 19 22:35:37.777171 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:35:37.777171 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:35:37.777171 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:35:37.777171 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:35:37.777171 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:35:37.777171 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:35:37.777171 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:35:37.777171 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:35:37.777171 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1y-gMMAL5f-xIa7kLu9Egge9ZO_ON0HtwvTyOQ0vs_KbP81_Ma6I2vS-aJF3g39OOCfkCZVdSW4CwqRDmVd8Z35Lx7J2FjWcbc6k_zQor1YeE1MMav0cs0I3iAVJa3gjzEquenecjaME--BluFbvkmQNy63LHmGP4SPyhypKI186Qqg Jul 19 22:35:37.777171 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:35:37.777171 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:35:37.777171 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:35:37.777171 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:35:37.777171 n-d-847009-3 devstack@n-api.service[119338]: X-Openstack-Nova-Api-Version: 2.25 Jul 19 22:35:37.777171 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:35:37.777171 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:35:37.777171 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: d0aa317147bd4c878b3c5e4480ae6289 Jul 19 22:35:37.777171 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-971932489 Jul 19 22:35:37.777171 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:35:37.777171 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:35:37.778336 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d0aa317147bd4c878b3c5e4480ae6289"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d0aa317147bd4c878b3c5e4480ae6289"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d0aa317147bd4c878b3c5e4480ae6289"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d0aa317147bd4c878b3c5e4480ae6289"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:35:37.778336 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-971932489 Jul 19 22:35:37.778336 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: d0aa317147bd4c878b3c5e4480ae6289 Jul 19 22:35:37.778336 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-971932489 Jul 19 22:35:37.778336 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-LiveAutoBlockMigrationV225Test-971932489-project Jul 19 22:35:37.778336 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:35:37.778336 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:35:37.778336 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 113e94f3bdbc4a2bb284a82b0b410d68 Jul 19 22:35:37.778336 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-971932489-project Jul 19 22:35:37.778336 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:35:37.778336 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 5d871dc5-0189-41e2-8650-8f753bf98c67 could not be found. Jul 19 22:35:37.778336 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '5d871dc5-0189-41e2-8650-8f753bf98c67'} Jul 19 22:35:37.778926 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:35:37.778926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:37.778926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:35:37.778926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:35:37.778926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:35:37.778926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:35:37.778926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:35:37.778926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:35:37.778926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:35:37.778926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:35:37.778926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d871dc5-0189-41e2-8650-8f753bf98c67 could not be found. Jul 19 22:35:37.778926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:35:37.778926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:35:37.778926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:35:37.778926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:37.778926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:35:37.778926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:35:37.778926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:35:37.778926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:35:37.778926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:35:37.779891 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:35:37.779891 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:35:37.779891 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:35:37.779891 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:35:37.779891 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:35:37.779891 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:35:37.779891 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:35:37.779891 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d871dc5-0189-41e2-8650-8f753bf98c67 could not be found. Jul 19 22:35:37.779891 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:35:37.779891 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:35:37.779891 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:35:37.779891 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:37.779891 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:35:37.779891 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:35:37.779891 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:35:37.779891 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:35:37.779891 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d871dc5-0189-41e2-8650-8f753bf98c67 could not be found. Jul 19 22:35:37.779891 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:35:37.780738 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-74ce3a39-42bf-41a8-8196-75499e004588 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Returning 404 to user: Instance 5d871dc5-0189-41e2-8650-8f753bf98c67 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:35:37.780738 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-74ce3a39-42bf-41a8-8196-75499e004588 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67" status: 404 len: 111 microversion: 2.25 time: 0.044256 Jul 19 22:35:37.781188 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1054/2128] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:37 2022] GET /compute/v2.1/servers/5d871dc5-0189-41e2-8650-8f753bf98c67 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:35:37.790766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fdefac1b-f2e6-4f1d-bb97-c44ae2b53df7 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:37.791783 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fdefac1b-f2e6-4f1d-bb97-c44ae2b53df7 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] [instance: b33a2a96-d4d2-4835-824d-739d006bf056] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:37.803260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fdefac1b-f2e6-4f1d-bb97-c44ae2b53df7 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:37.803742 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fdefac1b-f2e6-4f1d-bb97-c44ae2b53df7 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:37.804579 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fdefac1b-f2e6-4f1d-bb97-c44ae2b53df7 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:37.805443 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fdefac1b-f2e6-4f1d-bb97-c44ae2b53df7 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:38.087370 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4be1e06b-cbd3-4472-b1e0-d6e1daa36b7f tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:38.101731 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4be1e06b-cbd3-4472-b1e0-d6e1daa36b7f tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473" status: 200 len: 1521 microversion: 2.1 time: 0.668647 Jul 19 22:35:38.102584 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1075/2129] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:37 2022] GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473 => generated 1521 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:38.108553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-090c62c0-b14f-4883-8d06-37c813a5bb04 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:38.112817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-090c62c0-b14f-4883-8d06-37c813a5bb04 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7a8abba155f841cea0212bbaad5462ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:38.113837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-090c62c0-b14f-4883-8d06-37c813a5bb04 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Searching by: {'deleted': False, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59'} {{(pid=119337) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:35:38.171021 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-090c62c0-b14f-4883-8d06-37c813a5bb04 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:38.173270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-090c62c0-b14f-4883-8d06-37c813a5bb04 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:38.177495 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-090c62c0-b14f-4883-8d06-37c813a5bb04 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:38.178151 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-090c62c0-b14f-4883-8d06-37c813a5bb04 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:38.333129 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.multi_cell_list [None req-090c62c0-b14f-4883-8d06-37c813a5bb04 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=119337) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:35:38.379683 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fdefac1b-f2e6-4f1d-bb97-c44ae2b53df7 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52bb4626ba4c00abdcbc0bed7811b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3173e6bfa06f4118842ec55c92b253de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:38.395134 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fdefac1b-f2e6-4f1d-bb97-c44ae2b53df7 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] 10.222.0.25 "GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056" status: 200 len: 1698 microversion: 2.1 time: 0.608286 Jul 19 22:35:38.396696 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1055/2130] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:37 2022] GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056 => generated 1698 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:38.402960 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e580b7b4-44e3-4bf4-bcf4-e1ee1c3f1a8d tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '.version_select at 0x7f7a03a0bd30>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:38.418409 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-090c62c0-b14f-4883-8d06-37c813a5bb04 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.314720 Jul 19 22:35:38.419567 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1076/2131] 10.222.0.25 () {58 vars in 1124 bytes} [Tue Jul 19 22:35:38 2022] GET /compute/v2.1/servers => generated 1335 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:38.426102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b0a3d6b6-3ca9-48c9-920a-c54e63e717af tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:38.426965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b0a3d6b6-3ca9-48c9-920a-c54e63e717af tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] [instance: 84f67219-22f4-491d-9f4c-afb31f356e65] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:38.433839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:35:38.436658 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b0a3d6b6-3ca9-48c9-920a-c54e63e717af tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:38.437336 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b0a3d6b6-3ca9-48c9-920a-c54e63e717af tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:38.438408 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b0a3d6b6-3ca9-48c9-920a-c54e63e717af tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:38.439031 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b0a3d6b6-3ca9-48c9-920a-c54e63e717af tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:38.439475 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e580b7b4-44e3-4bf4-bcf4-e1ee1c3f1a8d tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1744052936" status: 204 len: 0 microversion: 2.25 time: 0.041021 Jul 19 22:35:38.441494 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1056/2132] 10.222.0.25 () {60 vars in 1261 bytes} [Tue Jul 19 22:35:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1744052936 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:35:38.446741 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-db02fe35-7e6c-4dab-a8b0-18dffc964ad3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:38.449413 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-db02fe35-7e6c-4dab-a8b0-18dffc964ad3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: c2560d4c-c905-4dbc-9eb8-40410ec01473] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:38.467247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-db02fe35-7e6c-4dab-a8b0-18dffc964ad3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:38.467766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-db02fe35-7e6c-4dab-a8b0-18dffc964ad3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:38.468824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-db02fe35-7e6c-4dab-a8b0-18dffc964ad3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:38.473755 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-db02fe35-7e6c-4dab-a8b0-18dffc964ad3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:39.015245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b0a3d6b6-3ca9-48c9-920a-c54e63e717af tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df68a9a9195744b386966b5c574b7878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c566f4290e1b41dcbab2b7cbb866e023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:39.033349 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b0a3d6b6-3ca9-48c9-920a-c54e63e717af tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] 10.222.0.25 "GET /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65" status: 200 len: 1350 microversion: 2.1 time: 0.612646 Jul 19 22:35:39.036946 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1077/2133] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:38 2022] GET /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65 => generated 1350 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:39.046062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-89c0714c-631a-40d8-aed3-a68a3e825e34 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:39.050305 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-89c0714c-631a-40d8-aed3-a68a3e825e34 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: f3fa3e57-f0c8-4199-a602-8207624e50af] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:39.086466 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-89c0714c-631a-40d8-aed3-a68a3e825e34 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:39.086928 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-89c0714c-631a-40d8-aed3-a68a3e825e34 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:39.087762 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-89c0714c-631a-40d8-aed3-a68a3e825e34 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:39.088274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-89c0714c-631a-40d8-aed3-a68a3e825e34 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:39.786083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-89c0714c-631a-40d8-aed3-a68a3e825e34 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8abba155f841cea0212bbaad5462ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:39.825593 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-89c0714c-631a-40d8-aed3-a68a3e825e34 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers/f3fa3e57-f0c8-4199-a602-8207624e50af" status: 200 len: 1222 microversion: 2.1 time: 0.787459 Jul 19 22:35:39.849729 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-db02fe35-7e6c-4dab-a8b0-18dffc964ad3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:39.857883 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1078/2134] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:39 2022] GET /compute/v2.1/servers/f3fa3e57-f0c8-4199-a602-8207624e50af => generated 1222 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:39.881616 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-db02fe35-7e6c-4dab-a8b0-18dffc964ad3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473" status: 200 len: 1521 microversion: 2.1 time: 1.438692 Jul 19 22:35:39.917271 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1057/2135] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:38 2022] GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473 => generated 1521 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:39.917467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4999693b-37ef-492f-bfd4-267052b30489 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:39.917467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4999693b-37ef-492f-bfd4-267052b30489 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:39.951031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4fe9df07-e283-4c56-bfb7-54a1ff96ab44 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:39.952123 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4fe9df07-e283-4c56-bfb7-54a1ff96ab44 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] [instance: b33a2a96-d4d2-4835-824d-739d006bf056] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:39.953144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4999693b-37ef-492f-bfd4-267052b30489 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:39.953716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4999693b-37ef-492f-bfd4-267052b30489 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:39.957157 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4999693b-37ef-492f-bfd4-267052b30489 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:39.957787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4999693b-37ef-492f-bfd4-267052b30489 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:39.979992 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4fe9df07-e283-4c56-bfb7-54a1ff96ab44 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:39.983018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4fe9df07-e283-4c56-bfb7-54a1ff96ab44 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:39.984058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4fe9df07-e283-4c56-bfb7-54a1ff96ab44 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:39.986692 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4fe9df07-e283-4c56-bfb7-54a1ff96ab44 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:40.448597 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4999693b-37ef-492f-bfd4-267052b30489 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:40.458773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4999693b-37ef-492f-bfd4-267052b30489 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:40.460369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4999693b-37ef-492f-bfd4-267052b30489 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:40.461613 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4999693b-37ef-492f-bfd4-267052b30489 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1594 microversion: 2.32 time: 0.602447 Jul 19 22:35:40.462498 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1079/2136] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:39 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1594 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:40.474371 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9718d81a-bdaa-4078-884b-8cbce87f705e tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-521356961"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:40.476673 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9718d81a-bdaa-4078-884b-8cbce87f705e tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: c2560d4c-c905-4dbc-9eb8-40410ec01473] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:40.484272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9718d81a-bdaa-4078-884b-8cbce87f705e tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:40.484990 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9718d81a-bdaa-4078-884b-8cbce87f705e tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:40.485978 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9718d81a-bdaa-4078-884b-8cbce87f705e tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:40.486576 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9718d81a-bdaa-4078-884b-8cbce87f705e tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:40.514008 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:35:40.623071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4fe9df07-e283-4c56-bfb7-54a1ff96ab44 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52bb4626ba4c00abdcbc0bed7811b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3173e6bfa06f4118842ec55c92b253de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:40.631820 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4fe9df07-e283-4c56-bfb7-54a1ff96ab44 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] 10.222.0.25 "GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056" status: 200 len: 1698 microversion: 2.1 time: 0.712329 Jul 19 22:35:40.632403 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1058/2137] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:39 2022] GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056 => generated 1698 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:40.642587 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fa8c3428-8ca7-4eff-a188-af4f7ea98e68 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:40.647126 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fa8c3428-8ca7-4eff-a188-af4f7ea98e68 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] [instance: 84f67219-22f4-491d-9f4c-afb31f356e65] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:40.666932 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa8c3428-8ca7-4eff-a188-af4f7ea98e68 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:40.667668 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa8c3428-8ca7-4eff-a188-af4f7ea98e68 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:40.668601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa8c3428-8ca7-4eff-a188-af4f7ea98e68 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:40.669183 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa8c3428-8ca7-4eff-a188-af4f7ea98e68 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:40.714897 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:35:41.020172 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9718d81a-bdaa-4078-884b-8cbce87f705e tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "POST /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473/action" status: 202 len: 0 microversion: 2.1 time: 0.553642 Jul 19 22:35:41.026685 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1080/2138] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:35:40 2022] POST /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 22:35:41.030138 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-781d5371-5be1-4a35-9333-eb6c28911462 req-05128c53-69ce-4abe-9f9a-5e052656e372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eef47923-4943-4736-acb5-5faa2775329e", "name": "network-vif-deleted", "tag": "592405c4-3868-4a35-8878-0c942e38f6c7"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:41.051913 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-781d5371-5be1-4a35-9333-eb6c28911462 req-05128c53-69ce-4abe-9f9a-5e052656e372 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:41.053324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-781d5371-5be1-4a35-9333-eb6c28911462 req-05128c53-69ce-4abe-9f9a-5e052656e372 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:41.063775 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fa8c3428-8ca7-4eff-a188-af4f7ea98e68 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df68a9a9195744b386966b5c574b7878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c566f4290e1b41dcbab2b7cbb866e023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:41.068800 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-781d5371-5be1-4a35-9333-eb6c28911462 req-05128c53-69ce-4abe-9f9a-5e052656e372 service nova] Creating event network-vif-deleted:592405c4-3868-4a35-8878-0c942e38f6c7 for instance eef47923-4943-4736-acb5-5faa2775329e on n-h1-847009-3 Jul 19 22:35:41.074505 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-781d5371-5be1-4a35-9333-eb6c28911462 req-05128c53-69ce-4abe-9f9a-5e052656e372 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050209 Jul 19 22:35:41.075662 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1081/2139] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:41.081784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-01d21ef1-4a2f-4449-bb04-4dd0f543c700 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:41.082494 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fa8c3428-8ca7-4eff-a188-af4f7ea98e68 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] 10.222.0.25 "GET /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65" status: 200 len: 1541 microversion: 2.1 time: 0.443554 Jul 19 22:35:41.082610 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-01d21ef1-4a2f-4449-bb04-4dd0f543c700 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: f3fa3e57-f0c8-4199-a602-8207624e50af] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:41.083097 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1059/2140] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:40 2022] GET /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65 => generated 1541 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:41.090214 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01d21ef1-4a2f-4449-bb04-4dd0f543c700 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:41.090450 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01d21ef1-4a2f-4449-bb04-4dd0f543c700 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:41.094416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01d21ef1-4a2f-4449-bb04-4dd0f543c700 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:41.094902 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01d21ef1-4a2f-4449-bb04-4dd0f543c700 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:41.103268 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5f1eaccc-1be3-4336-87b1-687d04af852e tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:41.103777 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5f1eaccc-1be3-4336-87b1-687d04af852e tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:41.131754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5f1eaccc-1be3-4336-87b1-687d04af852e tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:41.139328 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5f1eaccc-1be3-4336-87b1-687d04af852e tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:41.140193 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5f1eaccc-1be3-4336-87b1-687d04af852e tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:41.140640 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5f1eaccc-1be3-4336-87b1-687d04af852e tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:41.217715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5f1eaccc-1be3-4336-87b1-687d04af852e tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:35:41.229278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-01d21ef1-4a2f-4449-bb04-4dd0f543c700 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8abba155f841cea0212bbaad5462ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:41.240272 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-01d21ef1-4a2f-4449-bb04-4dd0f543c700 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers/f3fa3e57-f0c8-4199-a602-8207624e50af" status: 200 len: 1276 microversion: 2.1 time: 0.163030 Jul 19 22:35:41.241193 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1082/2141] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:41 2022] GET /compute/v2.1/servers/f3fa3e57-f0c8-4199-a602-8207624e50af => generated 1276 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:41.267547 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-98736497-088e-4bde-875d-ca3d702465ac tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '.version_select at 0x7f7a1040f700>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:41.449075 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5f1eaccc-1be3-4336-87b1-687d04af852e tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 204 len: 0 microversion: 2.25 time: 0.350260 Jul 19 22:35:41.452814 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1060/2142] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 22:35:41 2022] DELETE /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:35:41.474943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-14166430-48a5-49ae-b8e6-a731065417d1 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:41.481418 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-14166430-48a5-49ae-b8e6-a731065417d1 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] [instance: 84f67219-22f4-491d-9f4c-afb31f356e65] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:41.503979 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-14166430-48a5-49ae-b8e6-a731065417d1 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:41.506236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-14166430-48a5-49ae-b8e6-a731065417d1 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:41.510152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-14166430-48a5-49ae-b8e6-a731065417d1 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:41.511724 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-14166430-48a5-49ae-b8e6-a731065417d1 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:41.594617 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-98736497-088e-4bde-875d-ca3d702465ac tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "DELETE /compute/v2.1/images/b3bb270d-6e18-42dd-affd-60bc5a5f1d25" status: 204 len: 0 microversion: 2.1 time: 0.352665 Jul 19 22:35:41.595244 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1083/2143] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:41 2022] DELETE /compute/v2.1/images/b3bb270d-6e18-42dd-affd-60bc5a5f1d25 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:35:41.600326 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3f0e20bd-6e27-4d8c-af28-de6a7ebdbd1b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:41.601225 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3f0e20bd-6e27-4d8c-af28-de6a7ebdbd1b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:41.610044 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f0e20bd-6e27-4d8c-af28-de6a7ebdbd1b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:41.610785 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f0e20bd-6e27-4d8c-af28-de6a7ebdbd1b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:41.612329 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f0e20bd-6e27-4d8c-af28-de6a7ebdbd1b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:41.612949 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f0e20bd-6e27-4d8c-af28-de6a7ebdbd1b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:41.814135 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-14166430-48a5-49ae-b8e6-a731065417d1 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] 10.222.0.25 "GET /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.356431 Jul 19 22:35:41.817383 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1061/2144] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 19 22:35:41 2022] GET /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65/os-interface => generated 285 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:41.833444 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0791d29e-1acf-4935-8b80-2a0d9646b379 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:41.835545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0791d29e-1acf-4935-8b80-2a0d9646b379 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:41.849856 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0791d29e-1acf-4935-8b80-2a0d9646b379 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:41.851866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0791d29e-1acf-4935-8b80-2a0d9646b379 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:41.855099 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0791d29e-1acf-4935-8b80-2a0d9646b379 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:41.856296 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0791d29e-1acf-4935-8b80-2a0d9646b379 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:42.260920 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0791d29e-1acf-4935-8b80-2a0d9646b379 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:42.293796 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0791d29e-1acf-4935-8b80-2a0d9646b379 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:42.300355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0791d29e-1acf-4935-8b80-2a0d9646b379 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:42.301942 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0791d29e-1acf-4935-8b80-2a0d9646b379 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1594 microversion: 2.32 time: 0.482474 Jul 19 22:35:42.321695 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3f0e20bd-6e27-4d8c-af28-de6a7ebdbd1b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:42.327043 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1062/2145] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:41 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1594 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:42.341942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-445668a9-f9b8-4745-9175-cedce8f72b21 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '.version_select at 0x7f7a107f5c10>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:42.353342 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3f0e20bd-6e27-4d8c-af28-de6a7ebdbd1b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:42.358683 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3f0e20bd-6e27-4d8c-af28-de6a7ebdbd1b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:42.378023 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3f0e20bd-6e27-4d8c-af28-de6a7ebdbd1b tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 200 len: 1549 microversion: 2.25 time: 0.780627 Jul 19 22:35:42.408485 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1084/2146] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:41 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 1549 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:42.423028 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c0ff61b7-8e68-47bc-9992-f539ceca69f5 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:42.437197 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c0ff61b7-8e68-47bc-9992-f539ceca69f5 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] [instance: b33a2a96-d4d2-4835-824d-739d006bf056] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:42.442247 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-445668a9-f9b8-4745-9175-cedce8f72b21 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] HTTP exception thrown: Image not found. Jul 19 22:35:42.444688 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-445668a9-f9b8-4745-9175-cedce8f72b21 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Request method failure captured: Jul 19 22:35:42.444688 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/images/b3bb270d-6e18-42dd-affd-60bc5a5f1d25 HTTP/1.1 Jul 19 22:35:42.444688 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:35:42.444688 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:35:42.444688 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:35:42.444688 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:35:42.444688 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:35:42.444688 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:35:42.444688 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:35:42.444688 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:35:42.444688 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zFSA7GyoHNV6r8lt0QaILXtfyjU87DAOplAZjQU_9SUIJAdMw3TfBxiMnSQsWy218lpl-le3iOg2K6ZI4fs9ORwE8JiU3d4qrQtSVE6mLVRBodkQTjds8wHcIk6jUHzr1JjH374IFd8C1hu4WJXkMpF_7JvVJQyRRP5WIIvershcNo Jul 19 22:35:42.444688 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:35:42.444688 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:35:42.444688 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:35:42.444688 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:35:42.444688 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:35:42.444688 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:35:42.444688 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:35:42.444688 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:35:42.444688 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:35:42.444688 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:35:42.447142 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:35:42.447142 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:35:42.447142 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:35:42.447142 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:35:42.447142 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:35:42.447142 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:35:42.447142 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:35:42.447142 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: ecca13a073e7447591944e6604d67e4c Jul 19 22:35:42.447142 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:35:42.447142 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:35:42.447142 n-d-847009-3 devstack@n-api.service[119338]: exception: Image not found. Jul 19 22:35:42.447142 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'b3bb270d-6e18-42dd-affd-60bc5a5f1d25'} Jul 19 22:35:42.447142 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:35:42.448590 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:42.448590 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 22:35:42.448590 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 22:35:42.448590 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:35:42.448590 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:35:42.448590 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 22:35:42.448590 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 22:35:42.448590 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:35:42.448590 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:35:42.448590 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 22:35:42.448590 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 22:35:42.448590 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 22:35:42.448590 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 22:35:42.448590 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:35:42.448590 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:35:42.448590 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:35:42.448590 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:35:42.448590 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b3bb270d-6e18-42dd-affd-60bc5a5f1d25 Jul 19 22:35:42.450608 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:35:42.450608 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:35:42.450608 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:35:42.450608 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:42.450608 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 19 22:35:42.450608 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 19 22:35:42.450608 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 22:35:42.450608 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 22:35:42.450608 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 22:35:42.450608 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 22:35:42.450608 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 22:35:42.450608 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 22:35:42.450608 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 22:35:42.450608 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 22:35:42.450608 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:35:42.450608 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:35:42.450608 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 22:35:42.450608 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 22:35:42.450608 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:35:42.450608 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:35:42.453095 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 22:35:42.453095 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 22:35:42.453095 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 22:35:42.453095 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 22:35:42.453095 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:35:42.453095 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:35:42.453095 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:35:42.453095 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:35:42.453095 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b3bb270d-6e18-42dd-affd-60bc5a5f1d25 could not be found. Jul 19 22:35:42.453095 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:35:42.453095 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:35:42.453095 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:35:42.453095 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:42.453095 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:35:42.453095 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:35:42.453095 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:35:42.453095 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:35:42.453095 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:35:42.453095 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:35:42.455304 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:35:42.455304 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:35:42.455304 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 19 22:35:42.455304 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 22:35:42.455304 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 22:35:42.455304 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:35:42.455304 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:35:42.455304 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:35:42.455304 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:42.455304 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:35:42.455304 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:35:42.455304 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:35:42.455304 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:35:42.455304 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 22:35:42.455304 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:35:42.455304 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-445668a9-f9b8-4745-9175-cedce8f72b21 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Returning 404 to user: Image not found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:35:42.457143 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-445668a9-f9b8-4745-9175-cedce8f72b21 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/images/b3bb270d-6e18-42dd-affd-60bc5a5f1d25" status: 404 len: 62 microversion: 2.1 time: 0.117869 Jul 19 22:35:42.457143 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1063/2147] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:35:42 2022] GET /compute/v2.1/images/b3bb270d-6e18-42dd-affd-60bc5a5f1d25 => generated 62 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:35:42.467547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-62e1995e-4c5e-45d9-aa63-871a0661ce98 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:42.469235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-62e1995e-4c5e-45d9-aa63-871a0661ce98 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: f3fa3e57-f0c8-4199-a602-8207624e50af] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:42.476836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c0ff61b7-8e68-47bc-9992-f539ceca69f5 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:42.478312 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c0ff61b7-8e68-47bc-9992-f539ceca69f5 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:42.486098 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c0ff61b7-8e68-47bc-9992-f539ceca69f5 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:42.487923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c0ff61b7-8e68-47bc-9992-f539ceca69f5 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:42.489703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62e1995e-4c5e-45d9-aa63-871a0661ce98 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:42.492411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62e1995e-4c5e-45d9-aa63-871a0661ce98 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:42.496773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62e1995e-4c5e-45d9-aa63-871a0661ce98 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:42.498880 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62e1995e-4c5e-45d9-aa63-871a0661ce98 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:43.803003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-62e1995e-4c5e-45d9-aa63-871a0661ce98 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8abba155f841cea0212bbaad5462ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:43.824528 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-62e1995e-4c5e-45d9-aa63-871a0661ce98 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers/f3fa3e57-f0c8-4199-a602-8207624e50af" status: 200 len: 1276 microversion: 2.1 time: 1.374640 Jul 19 22:35:43.834790 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c0ff61b7-8e68-47bc-9992-f539ceca69f5 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a52bb4626ba4c00abdcbc0bed7811b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3173e6bfa06f4118842ec55c92b253de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:43.840895 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1064/2148] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:42 2022] GET /compute/v2.1/servers/f3fa3e57-f0c8-4199-a602-8207624e50af => generated 1276 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:43.853139 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c0ff61b7-8e68-47bc-9992-f539ceca69f5 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] 10.222.0.25 "GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056" status: 200 len: 1630 microversion: 2.1 time: 1.437302 Jul 19 22:35:43.853537 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1085/2149] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:42 2022] GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056 => generated 1630 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:43.871099 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-78ac170e-1c98-4626-a394-f02d0c5e6ca1 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:43.872278 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-78ac170e-1c98-4626-a394-f02d0c5e6ca1 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: c2560d4c-c905-4dbc-9eb8-40410ec01473] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:43.903590 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78ac170e-1c98-4626-a394-f02d0c5e6ca1 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:43.904769 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78ac170e-1c98-4626-a394-f02d0c5e6ca1 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:43.906574 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78ac170e-1c98-4626-a394-f02d0c5e6ca1 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:43.907692 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78ac170e-1c98-4626-a394-f02d0c5e6ca1 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:44.202520 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=20 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:35:44.420899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-0a4b4f53-b893-4612-9af7-3d4895b18e1d req-080f749e-e8ab-4b4a-b862-9b0946397e96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df9fcf88-5d46-4ed8-b799-faf22cc244f1", "name": "network-vif-deleted", "tag": "2e6eb698-2fcc-4f59-8d7d-10b5d9238fbf"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:44.439825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-0a4b4f53-b893-4612-9af7-3d4895b18e1d req-080f749e-e8ab-4b4a-b862-9b0946397e96 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:44.440483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-0a4b4f53-b893-4612-9af7-3d4895b18e1d req-080f749e-e8ab-4b4a-b862-9b0946397e96 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:44.467821 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-0a4b4f53-b893-4612-9af7-3d4895b18e1d req-080f749e-e8ab-4b4a-b862-9b0946397e96 service nova] Creating event network-vif-deleted:2e6eb698-2fcc-4f59-8d7d-10b5d9238fbf for instance df9fcf88-5d46-4ed8-b799-faf22cc244f1 on n-h2-847009-3 Jul 19 22:35:44.484478 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-0a4b4f53-b893-4612-9af7-3d4895b18e1d req-080f749e-e8ab-4b4a-b862-9b0946397e96 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.624497 Jul 19 22:35:44.485486 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1086/2150] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:44.499734 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-31763796-b778-4c8c-ac91-aa0e2ac77031 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:44.500825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-31763796-b778-4c8c-ac91-aa0e2ac77031 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:44.525034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31763796-b778-4c8c-ac91-aa0e2ac77031 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:44.527008 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31763796-b778-4c8c-ac91-aa0e2ac77031 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:44.528274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31763796-b778-4c8c-ac91-aa0e2ac77031 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:44.530652 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31763796-b778-4c8c-ac91-aa0e2ac77031 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:46.671858 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-78ac170e-1c98-4626-a394-f02d0c5e6ca1 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:46.685928 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-78ac170e-1c98-4626-a394-f02d0c5e6ca1 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473" status: 200 len: 1539 microversion: 2.1 time: 2.842889 Jul 19 22:35:46.702776 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1065/2151] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:43 2022] GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473 => generated 1539 bytes in 2852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:46.705634 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6771bf90-4a54-400a-9039-33a868b831d0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:46.706987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6771bf90-4a54-400a-9039-33a868b831d0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:46.719173 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6771bf90-4a54-400a-9039-33a868b831d0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:46.721945 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6771bf90-4a54-400a-9039-33a868b831d0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:46.727241 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6771bf90-4a54-400a-9039-33a868b831d0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:46.727948 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6771bf90-4a54-400a-9039-33a868b831d0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:46.806920 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-31763796-b778-4c8c-ac91-aa0e2ac77031 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:46.833276 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-31763796-b778-4c8c-ac91-aa0e2ac77031 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:46.835951 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-31763796-b778-4c8c-ac91-aa0e2ac77031 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:46.837372 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-31763796-b778-4c8c-ac91-aa0e2ac77031 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1661 microversion: 2.32 time: 2.342416 Jul 19 22:35:46.839651 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1087/2152] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:44 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1661 bytes in 2353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:46.845567 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3c281a17-9543-4da0-bc69-ae9ccd12046b tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:46.846599 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3c281a17-9543-4da0-bc69-ae9ccd12046b tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: f3fa3e57-f0c8-4199-a602-8207624e50af] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:46.855605 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c281a17-9543-4da0-bc69-ae9ccd12046b tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:46.856220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c281a17-9543-4da0-bc69-ae9ccd12046b tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:46.857178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c281a17-9543-4da0-bc69-ae9ccd12046b tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:46.857767 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c281a17-9543-4da0-bc69-ae9ccd12046b tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:47.575456 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3c281a17-9543-4da0-bc69-ae9ccd12046b tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8abba155f841cea0212bbaad5462ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:47.590655 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6771bf90-4a54-400a-9039-33a868b831d0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:47.609532 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3c281a17-9543-4da0-bc69-ae9ccd12046b tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers/f3fa3e57-f0c8-4199-a602-8207624e50af" status: 200 len: 1318 microversion: 2.1 time: 0.768224 Jul 19 22:35:47.610057 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=10 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:35:47.630190 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1088/2153] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:46 2022] GET /compute/v2.1/servers/f3fa3e57-f0c8-4199-a602-8207624e50af => generated 1318 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:47.630190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8f157e90-eeaa-4850-b398-1fe50f62b790 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:47.630190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8f157e90-eeaa-4850-b398-1fe50f62b790 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] [instance: b33a2a96-d4d2-4835-824d-739d006bf056] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:47.630769 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6771bf90-4a54-400a-9039-33a868b831d0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:47.630931 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6771bf90-4a54-400a-9039-33a868b831d0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:47.632283 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6771bf90-4a54-400a-9039-33a868b831d0 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 200 len: 1549 microversion: 2.25 time: 0.937755 Jul 19 22:35:47.634598 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1066/2154] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:46 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 1549 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:47.637198 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=28 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:35:47.644278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f157e90-eeaa-4850-b398-1fe50f62b790 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:47.650918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f157e90-eeaa-4850-b398-1fe50f62b790 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:47.652434 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f157e90-eeaa-4850-b398-1fe50f62b790 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:47.653163 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f157e90-eeaa-4850-b398-1fe50f62b790 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:47.678693 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-8f157e90-eeaa-4850-b398-1fe50f62b790 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] HTTP exception thrown: Instance b33a2a96-d4d2-4835-824d-739d006bf056 could not be found. Jul 19 22:35:47.681045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8f157e90-eeaa-4850-b398-1fe50f62b790 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Request method failure captured: Jul 19 22:35:47.681045 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056 HTTP/1.1 Jul 19 22:35:47.681045 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:35:47.681045 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:35:47.681045 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:35:47.681045 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:35:47.681045 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:35:47.681045 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:35:47.681045 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:35:47.681045 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:35:47.681045 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zFqLs7BjA2QUstgD2VjGe8Cmua7aueYnFc7pnyrL1nRtq4flnDCzdf9Ou9jJWxK2eA0ay2yqgKc7cnYVfwx23bbeg5Ef8SJwqiboApO-EaIrr_zhKmIeLsor8rfwO0puOgoz3-CSNuoMWjxfPMCX6zSfWNh7vuJeQ6TcQlgkW4XJHE Jul 19 22:35:47.681045 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:35:47.681045 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:35:47.681045 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:35:47.681045 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:35:47.681045 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:35:47.681045 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:35:47.681045 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 3173e6bfa06f4118842ec55c92b253de Jul 19 22:35:47.681045 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersTestJSON-1380886480 Jul 19 22:35:47.681045 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:35:47.681045 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:35:47.682237 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3173e6bfa06f4118842ec55c92b253de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3173e6bfa06f4118842ec55c92b253de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3173e6bfa06f4118842ec55c92b253de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3173e6bfa06f4118842ec55c92b253de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:35:47.682237 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersTestJSON-1380886480 Jul 19 22:35:47.682237 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 3173e6bfa06f4118842ec55c92b253de Jul 19 22:35:47.682237 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersTestJSON-1380886480 Jul 19 22:35:47.682237 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersTestJSON-1380886480-project Jul 19 22:35:47.682237 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:35:47.682237 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:35:47.682237 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 5a52bb4626ba4c00abdcbc0bed7811b0 Jul 19 22:35:47.682237 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersTestJSON-1380886480-project Jul 19 22:35:47.682237 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:35:47.682237 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance b33a2a96-d4d2-4835-824d-739d006bf056 could not be found. Jul 19 22:35:47.682237 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'b33a2a96-d4d2-4835-824d-739d006bf056'} Jul 19 22:35:47.682900 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:35:47.682900 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:47.682900 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:35:47.682900 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:35:47.682900 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:35:47.682900 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:35:47.682900 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:35:47.682900 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:35:47.682900 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:35:47.682900 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:35:47.682900 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b33a2a96-d4d2-4835-824d-739d006bf056 could not be found. Jul 19 22:35:47.682900 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:47.682900 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:35:47.682900 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:47.682900 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:47.682900 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:35:47.682900 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:35:47.682900 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:35:47.682900 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:35:47.682900 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:35:47.684010 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:35:47.684010 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:35:47.684010 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:35:47.684010 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:35:47.684010 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:35:47.684010 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:35:47.684010 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:35:47.684010 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b33a2a96-d4d2-4835-824d-739d006bf056 could not be found. Jul 19 22:35:47.684010 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:47.684010 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:35:47.684010 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:47.684010 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:47.684010 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:35:47.684010 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:35:47.684010 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:35:47.684010 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:35:47.684010 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b33a2a96-d4d2-4835-824d-739d006bf056 could not be found. Jul 19 22:35:47.684010 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:47.686321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8f157e90-eeaa-4850-b398-1fe50f62b790 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Returning 404 to user: Instance b33a2a96-d4d2-4835-824d-739d006bf056 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:35:47.687399 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8f157e90-eeaa-4850-b398-1fe50f62b790 tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] 10.222.0.25 "GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056" status: 404 len: 111 microversion: 2.1 time: 0.067228 Jul 19 22:35:47.688488 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1089/2155] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:47 2022] GET /compute/v2.1/servers/b33a2a96-d4d2-4835-824d-739d006bf056 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:35:47.700411 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-7e0eb971-0b29-4e2d-8695-7e754186b6b5 req-463ba42f-1d65-4535-a898-fb576cdc83da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b33a2a96-d4d2-4835-824d-739d006bf056", "name": "network-vif-deleted", "tag": "f02a3722-57d9-4b04-bd6c-cae51d4d500c"}, {"name": "network-changed", "server_uuid": "f3fa3e57-f0c8-4199-a602-8207624e50af", "tag": "db62c69f-c2d5-43c9-af11-34c92a7d341d"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:47.712109 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-7e0eb971-0b29-4e2d-8695-7e754186b6b5 req-463ba42f-1d65-4535-a898-fb576cdc83da service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:47.712958 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-7e0eb971-0b29-4e2d-8695-7e754186b6b5 req-463ba42f-1d65-4535-a898-fb576cdc83da service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:47.732764 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-7e0eb971-0b29-4e2d-8695-7e754186b6b5 req-463ba42f-1d65-4535-a898-fb576cdc83da service nova] Creating event network-vif-deleted:f02a3722-57d9-4b04-bd6c-cae51d4d500c for instance b33a2a96-d4d2-4835-824d-739d006bf056 on n-h2-847009-3 Jul 19 22:35:47.734002 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-7e0eb971-0b29-4e2d-8695-7e754186b6b5 req-463ba42f-1d65-4535-a898-fb576cdc83da service nova] Creating event network-changed:db62c69f-c2d5-43c9-af11-34c92a7d341d for instance f3fa3e57-f0c8-4199-a602-8207624e50af on n-h2-847009-3 Jul 19 22:35:47.744545 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-7e0eb971-0b29-4e2d-8695-7e754186b6b5 req-463ba42f-1d65-4535-a898-fb576cdc83da service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.054380 Jul 19 22:35:47.746696 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1090/2156] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:47.758843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-78a04cb5-b154-4835-b856-8b126d7f888a req-3786b302-d141-4d02-8055-9a783b5111c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef1f3571-2f57-4f5b-b607-16d82d41d8d2", "name": "network-vif-deleted", "tag": "01a778f9-5da2-424c-9cea-9f854afa416c"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:47.792451 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-78a04cb5-b154-4835-b856-8b126d7f888a req-3786b302-d141-4d02-8055-9a783b5111c6 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:47.793873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-78a04cb5-b154-4835-b856-8b126d7f888a req-3786b302-d141-4d02-8055-9a783b5111c6 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:47.815721 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-78a04cb5-b154-4835-b856-8b126d7f888a req-3786b302-d141-4d02-8055-9a783b5111c6 service nova] Creating event network-vif-deleted:01a778f9-5da2-424c-9cea-9f854afa416c for instance ef1f3571-2f57-4f5b-b607-16d82d41d8d2 on n-h1-847009-3 Jul 19 22:35:47.824408 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-78a04cb5-b154-4835-b856-8b126d7f888a req-3786b302-d141-4d02-8055-9a783b5111c6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073132 Jul 19 22:35:47.825924 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1091/2157] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:47.833288 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8ec5ac95-fd8f-4db9-9238-405be29c907f tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] Calling method '.version_select at 0x7f7a106ba820>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:47.868512 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8ec5ac95-fd8f-4db9-9238-405be29c907f tempest-ServersTestJSON-1380886480 tempest-ServersTestJSON-1380886480-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-463013240" status: 202 len: 0 microversion: 2.1 time: 0.040454 Jul 19 22:35:47.870340 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1092/2158] 10.222.0.25 () {58 vars in 1217 bytes} [Tue Jul 19 22:35:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-463013240 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:35:47.880741 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bb844b31-4f90-4a56-b30b-b82f3f29c579 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:47.882413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bb844b31-4f90-4a56-b30b-b82f3f29c579 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: c2560d4c-c905-4dbc-9eb8-40410ec01473] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:47.895658 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb844b31-4f90-4a56-b30b-b82f3f29c579 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:47.896872 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb844b31-4f90-4a56-b30b-b82f3f29c579 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:47.898055 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb844b31-4f90-4a56-b30b-b82f3f29c579 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:47.898745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb844b31-4f90-4a56-b30b-b82f3f29c579 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:48.193716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-76fc8f54-691a-4de3-806a-e40a7f0a9893 tempest-SecurityGroupsTestAdminJSON-830295932 tempest-SecurityGroupsTestAdminJSON-830295932-project] Action: 'create', calling method: .version_select at 0x7f7a03993f70>, body: {"security_group": {"name": "tempest-securitygroup-1197452898", "description": "tempest-description-1066883457"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:48.268951 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=11 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:35:48.472657 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bb844b31-4f90-4a56-b30b-b82f3f29c579 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:48.481117 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bb844b31-4f90-4a56-b30b-b82f3f29c579 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473" status: 200 len: 1521 microversion: 2.1 time: 0.608663 Jul 19 22:35:48.493469 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1093/2159] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:47 2022] GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473 => generated 1521 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:48.498660 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5b80ceeb-8411-4a98-b0a8-31610dea0b2e tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:48.499431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5b80ceeb-8411-4a98-b0a8-31610dea0b2e tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:48.508174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b80ceeb-8411-4a98-b0a8-31610dea0b2e tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:48.509118 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b80ceeb-8411-4a98-b0a8-31610dea0b2e tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:48.510058 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b80ceeb-8411-4a98-b0a8-31610dea0b2e tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:48.510649 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b80ceeb-8411-4a98-b0a8-31610dea0b2e tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:49.398978 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5b80ceeb-8411-4a98-b0a8-31610dea0b2e tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:49.417325 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5b80ceeb-8411-4a98-b0a8-31610dea0b2e tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:49.419281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5b80ceeb-8411-4a98-b0a8-31610dea0b2e tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:49.420661 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5b80ceeb-8411-4a98-b0a8-31610dea0b2e tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1661 microversion: 2.32 time: 0.926049 Jul 19 22:35:49.421706 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1094/2160] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:48 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1661 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:49.431618 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1346c99e-31f3-4478-a0f7-30c7deddad9e tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:49.432384 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1346c99e-31f3-4478-a0f7-30c7deddad9e tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: c2560d4c-c905-4dbc-9eb8-40410ec01473] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:49.439133 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1346c99e-31f3-4478-a0f7-30c7deddad9e tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:49.440334 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1346c99e-31f3-4478-a0f7-30c7deddad9e tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:49.441622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1346c99e-31f3-4478-a0f7-30c7deddad9e tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:49.442148 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1346c99e-31f3-4478-a0f7-30c7deddad9e tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:49.473319 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1346c99e-31f3-4478-a0f7-30c7deddad9e tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: c2560d4c-c905-4dbc-9eb8-40410ec01473] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:35:49.588076 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1346c99e-31f3-4478-a0f7-30c7deddad9e tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473" status: 204 len: 0 microversion: 2.1 time: 0.164831 Jul 19 22:35:49.592427 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1095/2161] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:35:49 2022] DELETE /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:35:49.600770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-21e6c568-3a94-4568-9cc9-1b19e333a29a tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:49.601697 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-21e6c568-3a94-4568-9cc9-1b19e333a29a tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: f3fa3e57-f0c8-4199-a602-8207624e50af] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:49.610304 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-21e6c568-3a94-4568-9cc9-1b19e333a29a tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:49.610865 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-21e6c568-3a94-4568-9cc9-1b19e333a29a tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:49.611970 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-21e6c568-3a94-4568-9cc9-1b19e333a29a tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:49.613077 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-21e6c568-3a94-4568-9cc9-1b19e333a29a tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:50.639485 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-21e6c568-3a94-4568-9cc9-1b19e333a29a tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8abba155f841cea0212bbaad5462ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:50.681194 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-21e6c568-3a94-4568-9cc9-1b19e333a29a tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers/f3fa3e57-f0c8-4199-a602-8207624e50af" status: 200 len: 1318 microversion: 2.1 time: 1.086962 Jul 19 22:35:50.711926 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1096/2162] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:49 2022] GET /compute/v2.1/servers/f3fa3e57-f0c8-4199-a602-8207624e50af => generated 1318 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:50.738736 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6ceeca35-648a-44dc-90ea-9d111e82d6df tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:50.742117 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6ceeca35-648a-44dc-90ea-9d111e82d6df tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: ef1f3571-2f57-4f5b-b607-16d82d41d8d2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:50.756416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6ceeca35-648a-44dc-90ea-9d111e82d6df tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:50.760758 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6ceeca35-648a-44dc-90ea-9d111e82d6df tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:50.762108 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6ceeca35-648a-44dc-90ea-9d111e82d6df tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:50.763687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6ceeca35-648a-44dc-90ea-9d111e82d6df tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:50.804856 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-6ceeca35-648a-44dc-90ea-9d111e82d6df tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] HTTP exception thrown: Instance ef1f3571-2f57-4f5b-b607-16d82d41d8d2 could not be found. Jul 19 22:35:50.815811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6ceeca35-648a-44dc-90ea-9d111e82d6df tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Request method failure captured: Jul 19 22:35:50.815811 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 HTTP/1.1 Jul 19 22:35:50.815811 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:35:50.815811 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:35:50.815811 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:35:50.815811 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:35:50.815811 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:35:50.815811 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:35:50.815811 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:35:50.815811 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:35:50.815811 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y-gMMAL5f-xIa7kLu9Egge9ZO_ON0HtwvTyOQ0vs_KbP81_Ma6I2vS-aJF3g39OOCfkCZVdSW4CwqRDmVd8Z35Lx7J2FjWcbc6k_zQor1YeE1MMav0cs0I3iAVJa3gjzEquenecjaME--BluFbvkmQNy63LHmGP4SPyhypKI186Qqg Jul 19 22:35:50.815811 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:35:50.815811 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:35:50.815811 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:35:50.815811 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:35:50.815811 n-d-847009-3 devstack@n-api.service[119337]: X-Openstack-Nova-Api-Version: 2.25 Jul 19 22:35:50.815811 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:35:50.815811 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:35:50.815811 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: d0aa317147bd4c878b3c5e4480ae6289 Jul 19 22:35:50.815811 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-971932489 Jul 19 22:35:50.815811 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:35:50.815811 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:35:50.817309 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d0aa317147bd4c878b3c5e4480ae6289"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d0aa317147bd4c878b3c5e4480ae6289"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d0aa317147bd4c878b3c5e4480ae6289"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d0aa317147bd4c878b3c5e4480ae6289"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:35:50.817309 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-971932489 Jul 19 22:35:50.817309 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: d0aa317147bd4c878b3c5e4480ae6289 Jul 19 22:35:50.817309 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-971932489 Jul 19 22:35:50.817309 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-LiveAutoBlockMigrationV225Test-971932489-project Jul 19 22:35:50.817309 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:35:50.817309 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:35:50.817309 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 113e94f3bdbc4a2bb284a82b0b410d68 Jul 19 22:35:50.817309 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-971932489-project Jul 19 22:35:50.817309 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:35:50.817309 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance ef1f3571-2f57-4f5b-b607-16d82d41d8d2 could not be found. Jul 19 22:35:50.817309 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'ef1f3571-2f57-4f5b-b607-16d82d41d8d2'} Jul 19 22:35:50.818065 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:35:50.818065 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:50.818065 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:35:50.818065 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:35:50.818065 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:35:50.818065 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:35:50.818065 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:35:50.818065 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:35:50.818065 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:35:50.818065 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:35:50.818065 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef1f3571-2f57-4f5b-b607-16d82d41d8d2 could not be found. Jul 19 22:35:50.818065 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:50.818065 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:35:50.818065 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:50.818065 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:50.818065 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:35:50.818065 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:35:50.818065 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:35:50.818065 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:35:50.818065 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:35:50.820355 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:35:50.820355 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:35:50.820355 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:35:50.820355 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:35:50.820355 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:35:50.820355 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:35:50.820355 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:35:50.820355 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef1f3571-2f57-4f5b-b607-16d82d41d8d2 could not be found. Jul 19 22:35:50.820355 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:50.820355 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:35:50.820355 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:50.820355 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:50.820355 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:35:50.820355 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:35:50.820355 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:35:50.820355 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:35:50.820355 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef1f3571-2f57-4f5b-b607-16d82d41d8d2 could not be found. Jul 19 22:35:50.820355 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:50.824514 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6ceeca35-648a-44dc-90ea-9d111e82d6df tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Returning 404 to user: Instance ef1f3571-2f57-4f5b-b607-16d82d41d8d2 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:35:50.824514 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6ceeca35-648a-44dc-90ea-9d111e82d6df tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2" status: 404 len: 111 microversion: 2.25 time: 0.108189 Jul 19 22:35:50.824514 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1097/2163] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:50 2022] GET /compute/v2.1/servers/ef1f3571-2f57-4f5b-b607-16d82d41d8d2 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:35:50.838153 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6203e315-4685-477d-86de-81819c48bcad tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:50.839585 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6203e315-4685-477d-86de-81819c48bcad tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: c2560d4c-c905-4dbc-9eb8-40410ec01473] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:50.840016 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-76fc8f54-691a-4de3-806a-e40a7f0a9893 tempest-SecurityGroupsTestAdminJSON-830295932 tempest-SecurityGroupsTestAdminJSON-830295932-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 3.203911 Jul 19 22:35:50.841168 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1067/2164] 10.222.0.25 () {60 vars in 1179 bytes} [Tue Jul 19 22:35:47 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 3206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:50.852519 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-345a8f2e-f88c-476c-904b-8ea283d947ce req-522f75f4-ca7c-48f2-b7a4-227661bbc416 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "350b4c29-cb79-4b1e-a302-b84b2567608a", "tag": "7cab0dfa-9e76-4cb6-b727-d482a0dd0c70"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:50.872804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6203e315-4685-477d-86de-81819c48bcad tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:50.874172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6203e315-4685-477d-86de-81819c48bcad tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:50.876417 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6203e315-4685-477d-86de-81819c48bcad tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:50.881613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6203e315-4685-477d-86de-81819c48bcad tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:50.882664 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-345a8f2e-f88c-476c-904b-8ea283d947ce req-522f75f4-ca7c-48f2-b7a4-227661bbc416 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:50.883716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-345a8f2e-f88c-476c-904b-8ea283d947ce req-522f75f4-ca7c-48f2-b7a4-227661bbc416 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:50.930406 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-345a8f2e-f88c-476c-904b-8ea283d947ce req-522f75f4-ca7c-48f2-b7a4-227661bbc416 service nova] Creating event network-changed:7cab0dfa-9e76-4cb6-b727-d482a0dd0c70 for instance 350b4c29-cb79-4b1e-a302-b84b2567608a on n-h1-847009-3 Jul 19 22:35:50.939788 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-345a8f2e-f88c-476c-904b-8ea283d947ce req-522f75f4-ca7c-48f2-b7a4-227661bbc416 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096796 Jul 19 22:35:50.941897 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1068/2165] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:50.973318 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-27d10808-f855-4d3d-9fe6-73fb4ce7f3ba tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:50.978018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-27d10808-f855-4d3d-9fe6-73fb4ce7f3ba tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:51.006994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-27d10808-f855-4d3d-9fe6-73fb4ce7f3ba tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:51.007921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-27d10808-f855-4d3d-9fe6-73fb4ce7f3ba tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:51.009027 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-27d10808-f855-4d3d-9fe6-73fb4ce7f3ba tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:51.010159 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-27d10808-f855-4d3d-9fe6-73fb4ce7f3ba tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:51.516662 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6203e315-4685-477d-86de-81819c48bcad tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:51.561708 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6203e315-4685-477d-86de-81819c48bcad tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473" status: 200 len: 1527 microversion: 2.1 time: 0.730541 Jul 19 22:35:51.566077 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1098/2166] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:50 2022] GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473 => generated 1527 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:51.595163 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-79627c2c-5377-40bd-aa50-c0e2400e66d7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:51.600238 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-79627c2c-5377-40bd-aa50-c0e2400e66d7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:51.629908 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-79627c2c-5377-40bd-aa50-c0e2400e66d7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:51.630521 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-79627c2c-5377-40bd-aa50-c0e2400e66d7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:51.631771 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-79627c2c-5377-40bd-aa50-c0e2400e66d7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:51.632190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-79627c2c-5377-40bd-aa50-c0e2400e66d7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:51.648828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-27d10808-f855-4d3d-9fe6-73fb4ce7f3ba tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:51.665538 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-27d10808-f855-4d3d-9fe6-73fb4ce7f3ba tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:51.673275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-27d10808-f855-4d3d-9fe6-73fb4ce7f3ba tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:51.678193 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-27d10808-f855-4d3d-9fe6-73fb4ce7f3ba tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1707 microversion: 2.32 time: 0.734940 Jul 19 22:35:51.683827 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1069/2167] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:50 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1707 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:51.697372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-99e98ba0-7227-4860-a4d4-5c3ffe73853d tempest-SecurityGroupsTestAdminJSON-830295932 tempest-SecurityGroupsTestAdminJSON-830295932-project] Action: 'create', calling method: .version_select at 0x7f7a1561d700>, body: {"security_group": {"name": "tempest-securitygroup-2043274606", "description": "tempest-description-1690319633"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:51.702561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-79627c2c-5377-40bd-aa50-c0e2400e66d7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:35:51.745739 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:35:51.900210 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-79627c2c-5377-40bd-aa50-c0e2400e66d7 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "DELETE /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 204 len: 0 microversion: 2.25 time: 0.315433 Jul 19 22:35:51.908462 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1099/2168] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 22:35:51 2022] DELETE /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:35:51.916805 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d63353f7-71b8-4fec-8d9a-980408759c0f tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:51.924600 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d63353f7-71b8-4fec-8d9a-980408759c0f tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: f3fa3e57-f0c8-4199-a602-8207624e50af] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:51.947526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d63353f7-71b8-4fec-8d9a-980408759c0f tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:51.950979 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d63353f7-71b8-4fec-8d9a-980408759c0f tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:51.960844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d63353f7-71b8-4fec-8d9a-980408759c0f tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:51.962914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d63353f7-71b8-4fec-8d9a-980408759c0f tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:52.560275 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-99e98ba0-7227-4860-a4d4-5c3ffe73853d tempest-SecurityGroupsTestAdminJSON-830295932 tempest-SecurityGroupsTestAdminJSON-830295932-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.875142 Jul 19 22:35:52.562018 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1070/2169] 10.222.0.25 () {60 vars in 1179 bytes} [Tue Jul 19 22:35:51 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:52.573180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1e846e06-72a4-435a-a9fe-339591359a68 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:52.574104 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1e846e06-72a4-435a-a9fe-339591359a68 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:52.595535 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1e846e06-72a4-435a-a9fe-339591359a68 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:52.596710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1e846e06-72a4-435a-a9fe-339591359a68 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:52.603451 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1e846e06-72a4-435a-a9fe-339591359a68 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:52.604340 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1e846e06-72a4-435a-a9fe-339591359a68 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:52.734936 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d63353f7-71b8-4fec-8d9a-980408759c0f tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8abba155f841cea0212bbaad5462ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:52.754282 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d63353f7-71b8-4fec-8d9a-980408759c0f tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers/f3fa3e57-f0c8-4199-a602-8207624e50af" status: 200 len: 1318 microversion: 2.1 time: 0.843100 Jul 19 22:35:52.765154 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1100/2170] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:51 2022] GET /compute/v2.1/servers/f3fa3e57-f0c8-4199-a602-8207624e50af => generated 1318 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:53.274861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-192f7cb6-e871-45b2-b021-1dcf6c5c14d4 tempest-SecurityGroupsTestAdminJSON-902325881 tempest-SecurityGroupsTestAdminJSON-902325881-project-admin] Action: 'create', calling method: .version_select at 0x7f7a107b7940>, body: {"security_group": {"name": "tempest-securitygroup-1180680453", "description": "tempest-description-864462837"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:53.362336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1e846e06-72a4-435a-a9fe-339591359a68 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:53.397379 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1e846e06-72a4-435a-a9fe-339591359a68 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:53.409475 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1e846e06-72a4-435a-a9fe-339591359a68 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:53.420206 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1e846e06-72a4-435a-a9fe-339591359a68 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 1563 microversion: 2.25 time: 0.855280 Jul 19 22:35:53.440370 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1071/2171] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:52 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 1563 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:53.454401 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1be79f49-0f0d-4778-b481-606c8e49234c tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:53.455557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1be79f49-0f0d-4778-b481-606c8e49234c tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: c2560d4c-c905-4dbc-9eb8-40410ec01473] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:53.465216 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1be79f49-0f0d-4778-b481-606c8e49234c tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:53.467725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1be79f49-0f0d-4778-b481-606c8e49234c tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:53.468720 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1be79f49-0f0d-4778-b481-606c8e49234c tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:53.469681 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1be79f49-0f0d-4778-b481-606c8e49234c tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:53.948860 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1be79f49-0f0d-4778-b481-606c8e49234c tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:53.968632 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1be79f49-0f0d-4778-b481-606c8e49234c tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473" status: 200 len: 1485 microversion: 2.1 time: 0.524453 Jul 19 22:35:53.985098 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1072/2172] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:53 2022] GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473 => generated 1485 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:53.996968 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-43d115a2-bf02-4572-8470-56041e5ecaa4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:54.000300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-43d115a2-bf02-4572-8470-56041e5ecaa4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:54.010247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43d115a2-bf02-4572-8470-56041e5ecaa4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:54.011021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43d115a2-bf02-4572-8470-56041e5ecaa4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:54.012062 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43d115a2-bf02-4572-8470-56041e5ecaa4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:54.012692 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43d115a2-bf02-4572-8470-56041e5ecaa4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:55.427371 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-43d115a2-bf02-4572-8470-56041e5ecaa4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:55.440912 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-43d115a2-bf02-4572-8470-56041e5ecaa4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:55.443330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-43d115a2-bf02-4572-8470-56041e5ecaa4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:55.444755 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-43d115a2-bf02-4572-8470-56041e5ecaa4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1753 microversion: 2.32 time: 1.458311 Jul 19 22:35:55.456848 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1073/2173] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:53 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1753 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:55.461821 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-cb992562-9dfb-420a-b17f-46b37dce5b17 req-1e28722a-8a24-4903-a432-b36f21de734a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84f67219-22f4-491d-9f4c-afb31f356e65", "tag": "b51a40ab-5c58-4b37-9085-4a6d031b5972"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:55.470469 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-cb992562-9dfb-420a-b17f-46b37dce5b17 req-1e28722a-8a24-4903-a432-b36f21de734a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:55.472641 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-cb992562-9dfb-420a-b17f-46b37dce5b17 req-1e28722a-8a24-4903-a432-b36f21de734a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:55.488037 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-cb992562-9dfb-420a-b17f-46b37dce5b17 req-1e28722a-8a24-4903-a432-b36f21de734a service nova] Creating event network-changed:b51a40ab-5c58-4b37-9085-4a6d031b5972 for instance 84f67219-22f4-491d-9f4c-afb31f356e65 on n-h1-847009-3 Jul 19 22:35:55.494244 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-cb992562-9dfb-420a-b17f-46b37dce5b17 req-1e28722a-8a24-4903-a432-b36f21de734a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039448 Jul 19 22:35:55.495454 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1074/2174] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:55.504528 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-28c5eb32-50a1-4771-85ed-f915c5fcd7c1 tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Calling method '.version_select at 0x7f7a1561d940>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:55.565537 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-28c5eb32-50a1-4771-85ed-f915c5fcd7c1 tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] 10.222.0.25 "GET /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63" status: 200 len: 637 microversion: 2.1 time: 0.068407 Jul 19 22:35:55.566783 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1075/2175] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:35:55 2022] GET /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63 => generated 637 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:55.572169 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-affed973-26ab-4c01-a6fc-396c26210d83 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:55.573114 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-affed973-26ab-4c01-a6fc-396c26210d83 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: f3fa3e57-f0c8-4199-a602-8207624e50af] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:55.583499 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-affed973-26ab-4c01-a6fc-396c26210d83 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:55.584079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-affed973-26ab-4c01-a6fc-396c26210d83 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:55.585603 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-affed973-26ab-4c01-a6fc-396c26210d83 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:55.586694 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-affed973-26ab-4c01-a6fc-396c26210d83 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:56.306579 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-192f7cb6-e871-45b2-b021-1dcf6c5c14d4 tempest-SecurityGroupsTestAdminJSON-902325881 tempest-SecurityGroupsTestAdminJSON-902325881-project-admin] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 3.547727 Jul 19 22:35:56.314065 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1101/2176] 10.222.0.25 () {60 vars in 1179 bytes} [Tue Jul 19 22:35:52 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 3549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:56.314065 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-e489d2f8-0bf4-4fdc-982e-ec0ab0511429 req-8654bb23-f3bd-49c1-aa4b-b6a47e9dfc1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2560d4c-c905-4dbc-9eb8-40410ec01473", "name": "network-vif-deleted", "tag": "c0c2894d-78f3-43fb-9c7e-679991ba2b43"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:56.322668 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-affed973-26ab-4c01-a6fc-396c26210d83 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8abba155f841cea0212bbaad5462ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:56.330768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e489d2f8-0bf4-4fdc-982e-ec0ab0511429 req-8654bb23-f3bd-49c1-aa4b-b6a47e9dfc1b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:56.331556 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e489d2f8-0bf4-4fdc-982e-ec0ab0511429 req-8654bb23-f3bd-49c1-aa4b-b6a47e9dfc1b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:56.332111 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-affed973-26ab-4c01-a6fc-396c26210d83 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers/f3fa3e57-f0c8-4199-a602-8207624e50af" status: 200 len: 1318 microversion: 2.1 time: 0.763891 Jul 19 22:35:56.332706 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1076/2177] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:55 2022] GET /compute/v2.1/servers/f3fa3e57-f0c8-4199-a602-8207624e50af => generated 1318 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:56.344517 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-e489d2f8-0bf4-4fdc-982e-ec0ab0511429 req-8654bb23-f3bd-49c1-aa4b-b6a47e9dfc1b service nova] Creating event network-vif-deleted:c0c2894d-78f3-43fb-9c7e-679991ba2b43 for instance c2560d4c-c905-4dbc-9eb8-40410ec01473 on n-h2-847009-3 Jul 19 22:35:56.348709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a39fe482-e639-41f3-aa7e-c9d730112443 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:56.349602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a39fe482-e639-41f3-aa7e-c9d730112443 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:56.351226 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-e489d2f8-0bf4-4fdc-982e-ec0ab0511429 req-8654bb23-f3bd-49c1-aa4b-b6a47e9dfc1b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042131 Jul 19 22:35:56.352253 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1102/2178] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:56.357030 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a39fe482-e639-41f3-aa7e-c9d730112443 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:56.357686 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a39fe482-e639-41f3-aa7e-c9d730112443 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:56.358633 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a39fe482-e639-41f3-aa7e-c9d730112443 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:56.359433 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a39fe482-e639-41f3-aa7e-c9d730112443 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:56.364073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-291a9766-005c-4924-81b4-625919714d01 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:56.365158 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-291a9766-005c-4924-81b4-625919714d01 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: c2560d4c-c905-4dbc-9eb8-40410ec01473] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:56.376885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-291a9766-005c-4924-81b4-625919714d01 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:56.379526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-291a9766-005c-4924-81b4-625919714d01 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:56.383203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-291a9766-005c-4924-81b4-625919714d01 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:56.383786 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-291a9766-005c-4924-81b4-625919714d01 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:56.419002 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-291a9766-005c-4924-81b4-625919714d01 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] HTTP exception thrown: Instance c2560d4c-c905-4dbc-9eb8-40410ec01473 could not be found. Jul 19 22:35:56.420831 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-291a9766-005c-4924-81b4-625919714d01 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Request method failure captured: Jul 19 22:35:56.420831 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473 HTTP/1.1 Jul 19 22:35:56.420831 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:35:56.420831 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:35:56.420831 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:35:56.420831 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:35:56.420831 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:35:56.420831 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:35:56.420831 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:35:56.420831 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:35:56.420831 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zFSA7GyoHNV6r8lt0QaILXtfyjU87DAOplAZjQU_9SUIJAdMw3TfBxiMnSQsWy218lpl-le3iOg2K6ZI4fs9ORwE8JiU3d4qrQtSVE6mLVRBodkQTjds8wHcIk6jUHzr1JjH374IFd8C1hu4WJXkMpF_7JvVJQyRRP5WIIvershcNo Jul 19 22:35:56.420831 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:35:56.420831 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:35:56.420831 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:35:56.420831 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:35:56.420831 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:35:56.420831 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:35:56.420831 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:35:56.420831 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:35:56.420831 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:35:56.420831 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:35:56.422193 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:35:56.422193 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:35:56.422193 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:35:56.422193 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:35:56.422193 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:35:56.422193 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:35:56.422193 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:35:56.422193 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: ecca13a073e7447591944e6604d67e4c Jul 19 22:35:56.422193 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:35:56.422193 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:35:56.422193 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance c2560d4c-c905-4dbc-9eb8-40410ec01473 could not be found. Jul 19 22:35:56.422193 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'c2560d4c-c905-4dbc-9eb8-40410ec01473'} Jul 19 22:35:56.422961 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:35:56.422961 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:56.422961 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:35:56.422961 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:35:56.422961 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:35:56.422961 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:35:56.422961 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:35:56.422961 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:35:56.422961 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:35:56.422961 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:35:56.422961 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2560d4c-c905-4dbc-9eb8-40410ec01473 could not be found. Jul 19 22:35:56.422961 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:56.422961 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:35:56.422961 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:56.422961 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:56.422961 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:35:56.422961 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:35:56.422961 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:35:56.422961 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:35:56.422961 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:35:56.424780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:35:56.424780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:35:56.424780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:35:56.424780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:35:56.424780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:35:56.424780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:35:56.424780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:35:56.424780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2560d4c-c905-4dbc-9eb8-40410ec01473 could not be found. Jul 19 22:35:56.424780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:56.424780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:35:56.424780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:56.424780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:56.424780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:35:56.424780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:35:56.424780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:35:56.424780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:35:56.424780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2560d4c-c905-4dbc-9eb8-40410ec01473 could not be found. Jul 19 22:35:56.424780 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:56.426283 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-291a9766-005c-4924-81b4-625919714d01 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Returning 404 to user: Instance c2560d4c-c905-4dbc-9eb8-40410ec01473 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:35:56.427500 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-291a9766-005c-4924-81b4-625919714d01 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473" status: 404 len: 111 microversion: 2.1 time: 0.073814 Jul 19 22:35:56.437463 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1103/2179] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:56 2022] GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:35:56.444272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8cd65b61-9402-4949-bd0a-609dcd9684d8 tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Action: 'update_all', calling method: .version_select at 0x7f7a108a5ca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:56.522721 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-8cd65b61-9402-4949-bd0a-609dcd9684d8 tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Getting quotas for project 1e7260a8799f47599c244cc39cff74b5. Resources: dict_keys(['metadata_items']) {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:35:56.541220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-8cd65b61-9402-4949-bd0a-609dcd9684d8 tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Getting quotas for user 636bf131c1d1464786a05ceedb782531 and project 1e7260a8799f47599c244cc39cff74b5. Resources: dict_keys(['metadata_items']) {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:35:56.653161 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a39fe482-e639-41f3-aa7e-c9d730112443 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:56.664224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a39fe482-e639-41f3-aa7e-c9d730112443 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:56.665766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a39fe482-e639-41f3-aa7e-c9d730112443 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '113e94f3bdbc4a2bb284a82b0b410d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0aa317147bd4c878b3c5e4480ae6289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:56.666970 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a39fe482-e639-41f3-aa7e-c9d730112443 tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 200 len: 1521 microversion: 2.25 time: 0.322749 Jul 19 22:35:56.690083 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1077/2180] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:56 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:56.694944 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-f2dc1956-f1ea-487c-97b2-f316cca6b402 req-dd07e163-a9cd-41f0-96ab-d58e541b183d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fa3e57-f0c8-4199-a602-8207624e50af", "name": "network-vif-plugged", "status": "completed", "tag": "db62c69f-c2d5-43c9-af11-34c92a7d341d"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:56.717410 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f2dc1956-f1ea-487c-97b2-f316cca6b402 req-dd07e163-a9cd-41f0-96ab-d58e541b183d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:56.717864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f2dc1956-f1ea-487c-97b2-f316cca6b402 req-dd07e163-a9cd-41f0-96ab-d58e541b183d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:56.746050 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-f2dc1956-f1ea-487c-97b2-f316cca6b402 req-dd07e163-a9cd-41f0-96ab-d58e541b183d service nova] Creating event network-vif-plugged:db62c69f-c2d5-43c9-af11-34c92a7d341d for instance f3fa3e57-f0c8-4199-a602-8207624e50af on n-h2-847009-3 Jul 19 22:35:56.765052 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-f2dc1956-f1ea-487c-97b2-f316cca6b402 req-dd07e163-a9cd-41f0-96ab-d58e541b183d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073638 Jul 19 22:35:56.774298 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1078/2181] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:56.786308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d39dda60-bb1a-49da-a56e-6be757821ff8 tempest-SecurityGroupsTestAdminJSON-902325881 tempest-SecurityGroupsTestAdminJSON-902325881-project-admin] Action: 'create', calling method: .version_select at 0x7f7a10779700>, body: {"security_group": {"name": "tempest-securitygroup-109876759", "description": "tempest-description-1977422329"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:57.294501 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8cd65b61-9402-4949-bd0a-609dcd9684d8 tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] 10.222.0.25 "PUT /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata" status: 200 len: 61 microversion: 2.1 time: 0.855042 Jul 19 22:35:57.295603 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1104/2182] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 22:35:56 2022] PUT /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata => generated 61 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:35:57.305533 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6cca13e3-4897-4e82-a188-8749bf7f0b9f tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:57.306266 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6cca13e3-4897-4e82-a188-8749bf7f0b9f tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:57.318056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6cca13e3-4897-4e82-a188-8749bf7f0b9f tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:57.318707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6cca13e3-4897-4e82-a188-8749bf7f0b9f tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:57.319550 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6cca13e3-4897-4e82-a188-8749bf7f0b9f tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:57.320219 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6cca13e3-4897-4e82-a188-8749bf7f0b9f tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:57.853989 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d39dda60-bb1a-49da-a56e-6be757821ff8 tempest-SecurityGroupsTestAdminJSON-902325881 tempest-SecurityGroupsTestAdminJSON-902325881-project-admin] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.078034 Jul 19 22:35:57.855363 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1079/2183] 10.222.0.25 () {60 vars in 1179 bytes} [Tue Jul 19 22:35:56 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:57.860608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ae8e63bb-e1d2-4acb-b482-386b08372e63 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1187617784", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:57.874501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6cca13e3-4897-4e82-a188-8749bf7f0b9f tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:57.906472 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6cca13e3-4897-4e82-a188-8749bf7f0b9f tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:57.920738 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6cca13e3-4897-4e82-a188-8749bf7f0b9f tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:57.929271 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6cca13e3-4897-4e82-a188-8749bf7f0b9f tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1753 microversion: 2.32 time: 0.626454 Jul 19 22:35:57.932947 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1105/2184] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:57 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1753 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:35:57.943262 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-ae8e63bb-e1d2-4acb-b482-386b08372e63 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] validate_networks() for [('6d053fb3-7842-42eb-ace2-41e8e82ce28b', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:35:57.945339 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-01b32214-91fb-471a-9ce3-61a7f737b26b tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Calling method '.version_select at 0x7f7a03f78c10>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:58.475756 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-01b32214-91fb-471a-9ce3-61a7f737b26b tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] 10.222.0.25 "DELETE /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.540167 Jul 19 22:35:58.478083 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1106/2185] 10.222.0.25 () {58 vars in 1295 bytes} [Tue Jul 19 22:35:57 2022] DELETE /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata/os_version => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:35:58.499988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-38ea342f-b31c-4cbb-8803-8b3653c4f023 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:58.499988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-38ea342f-b31c-4cbb-8803-8b3653c4f023 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: f3fa3e57-f0c8-4199-a602-8207624e50af] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:58.499988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-38ea342f-b31c-4cbb-8803-8b3653c4f023 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:58.499988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-38ea342f-b31c-4cbb-8803-8b3653c4f023 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:58.500642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-38ea342f-b31c-4cbb-8803-8b3653c4f023 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:58.500642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-38ea342f-b31c-4cbb-8803-8b3653c4f023 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:58.828514 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-ae8e63bb-e1d2-4acb-b482-386b08372e63 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:35:58.829250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-ae8e63bb-e1d2-4acb-b482-386b08372e63 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:35:58.829845 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-ae8e63bb-e1d2-4acb-b482-386b08372e63 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:35:58.830903 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-ae8e63bb-e1d2-4acb-b482-386b08372e63 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:35:58.832023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-ae8e63bb-e1d2-4acb-b482-386b08372e63 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:35:58.844785 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ae8e63bb-e1d2-4acb-b482-386b08372e63 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:58.845411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ae8e63bb-e1d2-4acb-b482-386b08372e63 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:58.847842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ae8e63bb-e1d2-4acb-b482-386b08372e63 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:58.848620 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ae8e63bb-e1d2-4acb-b482-386b08372e63 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:58.865186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-38ea342f-b31c-4cbb-8803-8b3653c4f023 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8abba155f841cea0212bbaad5462ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:35:58.877510 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-38ea342f-b31c-4cbb-8803-8b3653c4f023 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers/f3fa3e57-f0c8-4199-a602-8207624e50af" status: 200 len: 1318 microversion: 2.1 time: 0.397374 Jul 19 22:35:58.879329 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1107/2186] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:35:58 2022] GET /compute/v2.1/servers/f3fa3e57-f0c8-4199-a602-8207624e50af => generated 1318 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:35:58.886792 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-49ef2d6c-b7fa-4c04-8479-8521055c2235 req-64fde15c-3378-4139-b906-5a3758c39ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374ab7ad-b415-4516-8aa8-282bdfaa6600", "name": "network-vif-deleted", "tag": "726ca660-8b38-4bdc-a645-af1d096b28e4"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:58.902513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-ae8e63bb-e1d2-4acb-b482-386b08372e63 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Getting quotas for project 3eca98474bca4a64af425dffb9ecb5b3. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:35:58.910630 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-ae8e63bb-e1d2-4acb-b482-386b08372e63 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Getting quotas for user ecca13a073e7447591944e6604d67e4c and project 3eca98474bca4a64af425dffb9ecb5b3. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:35:58.913332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-49ef2d6c-b7fa-4c04-8479-8521055c2235 req-64fde15c-3378-4139-b906-5a3758c39ab0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:58.913830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-49ef2d6c-b7fa-4c04-8479-8521055c2235 req-64fde15c-3378-4139-b906-5a3758c39ab0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:58.932982 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ae8e63bb-e1d2-4acb-b482-386b08372e63 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:35:58.933926 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-49ef2d6c-b7fa-4c04-8479-8521055c2235 req-64fde15c-3378-4139-b906-5a3758c39ab0 service nova] Creating event network-vif-deleted:726ca660-8b38-4bdc-a645-af1d096b28e4 for instance 374ab7ad-b415-4516-8aa8-282bdfaa6600 on n-h1-847009-3 Jul 19 22:35:58.935737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ae8e63bb-e1d2-4acb-b482-386b08372e63 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: bde3700e-991b-4d67-be79-6c4da0e27275] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:35:58.939995 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-49ef2d6c-b7fa-4c04-8479-8521055c2235 req-64fde15c-3378-4139-b906-5a3758c39ab0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056274 Jul 19 22:35:58.941161 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1108/2187] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:58.948092 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:35:58.951759 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ba699c1b-190c-4812-af5c-a120b400962f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:58.953506 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ba699c1b-190c-4812-af5c-a120b400962f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] [instance: 374ab7ad-b415-4516-8aa8-282bdfaa6600] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:58.961920 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba699c1b-190c-4812-af5c-a120b400962f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:58.962728 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba699c1b-190c-4812-af5c-a120b400962f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:58.964258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba699c1b-190c-4812-af5c-a120b400962f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:58.964944 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba699c1b-190c-4812-af5c-a120b400962f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:58.989594 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-ba699c1b-190c-4812-af5c-a120b400962f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] HTTP exception thrown: Instance 374ab7ad-b415-4516-8aa8-282bdfaa6600 could not be found. Jul 19 22:35:58.994103 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ba699c1b-190c-4812-af5c-a120b400962f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Request method failure captured: Jul 19 22:35:58.994103 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 HTTP/1.1 Jul 19 22:35:58.994103 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:35:58.994103 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:35:58.994103 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:35:58.994103 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:35:58.994103 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:35:58.994103 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:35:58.994103 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:35:58.994103 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:35:58.994103 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1y-gMMAL5f-xIa7kLu9Egge9ZO_ON0HtwvTyOQ0vs_KbP81_Ma6I2vS-aJF3g39OOCfkCZVdSW4CwqRDmVd8Z35Lx7J2FjWcbc6k_zQor1YeE1MMav0cs0I3iAVJa3gjzEquenecjaME--BluFbvkmQNy63LHmGP4SPyhypKI186Qqg Jul 19 22:35:58.994103 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:35:58.994103 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:35:58.994103 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:35:58.994103 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:35:58.994103 n-d-847009-3 devstack@n-api.service[119337]: X-Openstack-Nova-Api-Version: 2.25 Jul 19 22:35:58.994103 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:35:58.994103 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:35:58.994103 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: d0aa317147bd4c878b3c5e4480ae6289 Jul 19 22:35:58.994103 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-971932489 Jul 19 22:35:58.994103 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:35:58.994103 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:35:58.995969 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d0aa317147bd4c878b3c5e4480ae6289"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d0aa317147bd4c878b3c5e4480ae6289"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d0aa317147bd4c878b3c5e4480ae6289"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d0aa317147bd4c878b3c5e4480ae6289"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:35:58.995969 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-971932489 Jul 19 22:35:58.995969 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: d0aa317147bd4c878b3c5e4480ae6289 Jul 19 22:35:58.995969 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-971932489 Jul 19 22:35:58.995969 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-LiveAutoBlockMigrationV225Test-971932489-project Jul 19 22:35:58.995969 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:35:58.995969 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:35:58.995969 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 113e94f3bdbc4a2bb284a82b0b410d68 Jul 19 22:35:58.995969 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-971932489-project Jul 19 22:35:58.995969 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:35:58.995969 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 374ab7ad-b415-4516-8aa8-282bdfaa6600 could not be found. Jul 19 22:35:58.995969 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '374ab7ad-b415-4516-8aa8-282bdfaa6600'} Jul 19 22:35:58.996774 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:35:58.996774 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:58.996774 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:35:58.996774 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:35:58.996774 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:35:58.996774 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:35:58.996774 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:35:58.996774 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:35:58.996774 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:35:58.996774 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:35:58.996774 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 374ab7ad-b415-4516-8aa8-282bdfaa6600 could not be found. Jul 19 22:35:58.996774 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:58.996774 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:35:58.996774 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:58.996774 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:58.996774 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:35:58.996774 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:35:58.996774 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:35:58.996774 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:35:58.996774 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:35:58.997819 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:35:58.997819 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:35:58.997819 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:35:58.997819 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:35:58.997819 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:35:58.997819 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:35:58.997819 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:35:58.997819 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 374ab7ad-b415-4516-8aa8-282bdfaa6600 could not be found. Jul 19 22:35:58.997819 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:58.997819 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:35:58.997819 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:58.997819 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:35:58.997819 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:35:58.997819 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:35:58.997819 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:35:58.997819 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:35:58.997819 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 374ab7ad-b415-4516-8aa8-282bdfaa6600 could not be found. Jul 19 22:35:58.997819 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:35:59.004410 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ba699c1b-190c-4812-af5c-a120b400962f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] Returning 404 to user: Instance 374ab7ad-b415-4516-8aa8-282bdfaa6600 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:35:59.005910 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ba699c1b-190c-4812-af5c-a120b400962f tempest-LiveAutoBlockMigrationV225Test-971932489 tempest-LiveAutoBlockMigrationV225Test-971932489-project] 10.222.0.25 "GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600" status: 404 len: 111 microversion: 2.25 time: 0.063333 Jul 19 22:35:59.010822 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1109/2188] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:58 2022] GET /compute/v2.1/servers/374ab7ad-b415-4516-8aa8-282bdfaa6600 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:35:59.013351 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ae8e63bb-e1d2-4acb-b482-386b08372e63 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.156748 Jul 19 22:35:59.014904 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1080/2189] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:35:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 1159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:35:59.016654 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a14cca7f-677f-4d63-ba9e-6a38cd4818df tempest-SecurityGroupsTestAdminJSON-902325881 tempest-SecurityGroupsTestAdminJSON-902325881-project-admin] Calling method '.version_select at 0x7f7a107b93a0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:59.031788 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a59b5435-9a8e-427e-8bed-6026c3dbab3e tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Calling method '.version_select at 0x7f7a1109b280>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:59.114560 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a59b5435-9a8e-427e-8bed-6026c3dbab3e tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] 10.222.0.25 "GET /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata" status: 200 len: 37 microversion: 2.1 time: 0.098266 Jul 19 22:35:59.115172 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1081/2190] 10.222.0.25 () {58 vars in 1259 bytes} [Tue Jul 19 22:35:59 2022] GET /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata => generated 37 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:35:59.130874 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-41e3812e-6eff-42a7-a33b-b51936c3cbb4 req-6a133c1e-23f6-4477-8b8f-01eedebca5aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "350b4c29-cb79-4b1e-a302-b84b2567608a", "name": "network-vif-plugged", "status": "completed", "tag": "7cab0dfa-9e76-4cb6-b727-d482a0dd0c70"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:35:59.154461 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-41e3812e-6eff-42a7-a33b-b51936c3cbb4 req-6a133c1e-23f6-4477-8b8f-01eedebca5aa service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:59.156539 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-41e3812e-6eff-42a7-a33b-b51936c3cbb4 req-6a133c1e-23f6-4477-8b8f-01eedebca5aa service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:59.186516 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-41e3812e-6eff-42a7-a33b-b51936c3cbb4 req-6a133c1e-23f6-4477-8b8f-01eedebca5aa service nova] Creating event network-vif-plugged:7cab0dfa-9e76-4cb6-b727-d482a0dd0c70 for instance 350b4c29-cb79-4b1e-a302-b84b2567608a on n-h1-847009-3 Jul 19 22:35:59.197120 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-41e3812e-6eff-42a7-a33b-b51936c3cbb4 req-6a133c1e-23f6-4477-8b8f-01eedebca5aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075260 Jul 19 22:35:59.197743 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1082/2191] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:35:59.210902 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-50835de5-ea9d-4daa-acd4-4456164be556 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:35:59.211661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-50835de5-ea9d-4daa-acd4-4456164be556 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:35:59.228416 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50835de5-ea9d-4daa-acd4-4456164be556 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:59.232937 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50835de5-ea9d-4daa-acd4-4456164be556 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:35:59.233768 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50835de5-ea9d-4daa-acd4-4456164be556 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:35:59.234463 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50835de5-ea9d-4daa-acd4-4456164be556 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:00.188438 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-50835de5-ea9d-4daa-acd4-4456164be556 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:00.200431 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:36:00.214121 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-50835de5-ea9d-4daa-acd4-4456164be556 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:00.216340 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-50835de5-ea9d-4daa-acd4-4456164be556 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:00.218433 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-50835de5-ea9d-4daa-acd4-4456164be556 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1799 microversion: 2.32 time: 1.016373 Jul 19 22:36:00.219580 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1083/2192] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:35:59 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1799 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:36:00.230906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8c9028c3-15ba-4db2-a89c-63728dc9224b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:00.231846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8c9028c3-15ba-4db2-a89c-63728dc9224b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: bde3700e-991b-4d67-be79-6c4da0e27275] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:00.264036 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8c9028c3-15ba-4db2-a89c-63728dc9224b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:00.264797 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8c9028c3-15ba-4db2-a89c-63728dc9224b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:00.266058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8c9028c3-15ba-4db2-a89c-63728dc9224b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:00.267266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8c9028c3-15ba-4db2-a89c-63728dc9224b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:00.418332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8c9028c3-15ba-4db2-a89c-63728dc9224b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:00.433840 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8c9028c3-15ba-4db2-a89c-63728dc9224b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275" status: 200 len: 1277 microversion: 2.1 time: 0.212678 Jul 19 22:36:00.437320 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1084/2193] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:00 2022] GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275 => generated 1277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:00.461722 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0ec6ae3a-3d91-4622-9536-e96a9d84d18d tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Action: 'update_all', calling method: .version_select at 0x7f7a1052f5e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:00.570614 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-0ec6ae3a-3d91-4622-9536-e96a9d84d18d tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Getting quotas for project 1e7260a8799f47599c244cc39cff74b5. Resources: dict_keys(['metadata_items']) {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:36:00.585265 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-0ec6ae3a-3d91-4622-9536-e96a9d84d18d tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Getting quotas for user 636bf131c1d1464786a05ceedb782531 and project 1e7260a8799f47599c244cc39cff74b5. Resources: dict_keys(['metadata_items']) {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:36:01.199805 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0ec6ae3a-3d91-4622-9536-e96a9d84d18d tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] 10.222.0.25 "PUT /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata" status: 200 len: 61 microversion: 2.1 time: 0.760267 Jul 19 22:36:01.200425 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1085/2194] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 22:36:00 2022] PUT /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata => generated 61 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:36:01.213710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e6607a5c-549c-4e45-b5bd-4ec6a5c17b25 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:01.214579 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e6607a5c-549c-4e45-b5bd-4ec6a5c17b25 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: f3fa3e57-f0c8-4199-a602-8207624e50af] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:01.221653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e6607a5c-549c-4e45-b5bd-4ec6a5c17b25 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:01.222115 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e6607a5c-549c-4e45-b5bd-4ec6a5c17b25 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:01.222912 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e6607a5c-549c-4e45-b5bd-4ec6a5c17b25 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:01.232358 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e6607a5c-549c-4e45-b5bd-4ec6a5c17b25 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:01.876200 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e6607a5c-549c-4e45-b5bd-4ec6a5c17b25 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8abba155f841cea0212bbaad5462ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:01.888129 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e6607a5c-549c-4e45-b5bd-4ec6a5c17b25 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers/f3fa3e57-f0c8-4199-a602-8207624e50af" status: 200 len: 1506 microversion: 2.1 time: 0.683898 Jul 19 22:36:01.889815 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1086/2195] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:01 2022] GET /compute/v2.1/servers/f3fa3e57-f0c8-4199-a602-8207624e50af => generated 1506 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:01.902718 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ecc1b513-aa3a-423b-af18-3475925c5e2c tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Calling method '.version_select at 0x7f7a10553040>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:01.961299 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ecc1b513-aa3a-423b-af18-3475925c5e2c tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] 10.222.0.25 "GET /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.068435 Jul 19 22:36:01.967523 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1087/2196] 10.222.0.25 () {58 vars in 1289 bytes} [Tue Jul 19 22:36:01 2022] GET /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata/os_distro => generated 33 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:36:01.972779 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f5e22c6d-91cf-4ce9-9470-3cb8442506fd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:01.973416 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f5e22c6d-91cf-4ce9-9470-3cb8442506fd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:01.989551 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f5e22c6d-91cf-4ce9-9470-3cb8442506fd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:01.993402 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f5e22c6d-91cf-4ce9-9470-3cb8442506fd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:01.994501 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f5e22c6d-91cf-4ce9-9470-3cb8442506fd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:01.998189 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f5e22c6d-91cf-4ce9-9470-3cb8442506fd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:02.818279 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f5e22c6d-91cf-4ce9-9470-3cb8442506fd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:02.832617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f5e22c6d-91cf-4ce9-9470-3cb8442506fd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:02.834605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f5e22c6d-91cf-4ce9-9470-3cb8442506fd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:02.848569 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f5e22c6d-91cf-4ce9-9470-3cb8442506fd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1845 microversion: 2.32 time: 0.879648 Jul 19 22:36:02.855982 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1088/2197] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:36:01 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1845 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:36:02.865378 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-519e1106-8a2e-4f3b-b49c-8903d2d37700 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:02.870064 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-519e1106-8a2e-4f3b-b49c-8903d2d37700 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: bde3700e-991b-4d67-be79-6c4da0e27275] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:02.885995 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-519e1106-8a2e-4f3b-b49c-8903d2d37700 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:02.886840 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-519e1106-8a2e-4f3b-b49c-8903d2d37700 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:02.887914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-519e1106-8a2e-4f3b-b49c-8903d2d37700 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:02.888649 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-519e1106-8a2e-4f3b-b49c-8903d2d37700 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:03.102542 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-519e1106-8a2e-4f3b-b49c-8903d2d37700 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:03.114675 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-519e1106-8a2e-4f3b-b49c-8903d2d37700 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275" status: 200 len: 1283 microversion: 2.1 time: 0.257137 Jul 19 22:36:03.117770 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1089/2198] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:02 2022] GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275 => generated 1283 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:03.150284 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5a6b323f-9f33-4ffc-a04e-8bc8374ea5d3 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:03.167412 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5a6b323f-9f33-4ffc-a04e-8bc8374ea5d3 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: 350b4c29-cb79-4b1e-a302-b84b2567608a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:03.177685 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5a6b323f-9f33-4ffc-a04e-8bc8374ea5d3 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:03.178598 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5a6b323f-9f33-4ffc-a04e-8bc8374ea5d3 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:03.179875 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5a6b323f-9f33-4ffc-a04e-8bc8374ea5d3 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:03.180533 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5a6b323f-9f33-4ffc-a04e-8bc8374ea5d3 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:03.660878 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5a6b323f-9f33-4ffc-a04e-8bc8374ea5d3 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8abba155f841cea0212bbaad5462ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:03.670887 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5a6b323f-9f33-4ffc-a04e-8bc8374ea5d3 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers/350b4c29-cb79-4b1e-a302-b84b2567608a" status: 200 len: 1506 microversion: 2.1 time: 0.536751 Jul 19 22:36:03.682397 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1090/2199] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:03 2022] GET /compute/v2.1/servers/350b4c29-cb79-4b1e-a302-b84b2567608a => generated 1506 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:03.692815 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ec7a5255-869e-422b-ae1f-cd73e5ab1e4e tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Action: 'update_all', calling method: .version_select at 0x7f7a1073b040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:03.768181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-ec7a5255-869e-422b-ae1f-cd73e5ab1e4e tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Getting quotas for project 1e7260a8799f47599c244cc39cff74b5. Resources: dict_keys(['metadata_items']) {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:36:03.779454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-ec7a5255-869e-422b-ae1f-cd73e5ab1e4e tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Getting quotas for user 636bf131c1d1464786a05ceedb782531 and project 1e7260a8799f47599c244cc39cff74b5. Resources: dict_keys(['metadata_items']) {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:36:04.242006 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ec7a5255-869e-422b-ae1f-cd73e5ab1e4e tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] 10.222.0.25 "PUT /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata" status: 200 len: 61 microversion: 2.1 time: 0.558331 Jul 19 22:36:04.251746 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1091/2200] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 22:36:03 2022] PUT /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata => generated 61 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:36:04.260016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-0fe3e372-f1bc-457e-9af2-c95a737b8100 req-40b52574-2ffa-4017-95ff-b71026cd2f8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e509d1e-b5d6-4f5f-a017-c2df1d2433f4", "tag": "3e008d29-c997-484e-89f5-bf52efc1c101"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:04.274062 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0fe3e372-f1bc-457e-9af2-c95a737b8100 req-40b52574-2ffa-4017-95ff-b71026cd2f8c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:04.275695 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0fe3e372-f1bc-457e-9af2-c95a737b8100 req-40b52574-2ffa-4017-95ff-b71026cd2f8c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:04.318793 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-0fe3e372-f1bc-457e-9af2-c95a737b8100 req-40b52574-2ffa-4017-95ff-b71026cd2f8c service nova] Creating event network-changed:3e008d29-c997-484e-89f5-bf52efc1c101 for instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 on n-h2-847009-3 Jul 19 22:36:04.339240 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-0fe3e372-f1bc-457e-9af2-c95a737b8100 req-40b52574-2ffa-4017-95ff-b71026cd2f8c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076395 Jul 19 22:36:04.357698 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1092/2201] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:36:04.376146 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-488ae79e-fbe5-44c7-822f-05084d82dfd8 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:04.378171 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-488ae79e-fbe5-44c7-822f-05084d82dfd8 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: 350b4c29-cb79-4b1e-a302-b84b2567608a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:04.403157 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-488ae79e-fbe5-44c7-822f-05084d82dfd8 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:04.403992 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-488ae79e-fbe5-44c7-822f-05084d82dfd8 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:04.405058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-488ae79e-fbe5-44c7-822f-05084d82dfd8 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:04.405632 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-488ae79e-fbe5-44c7-822f-05084d82dfd8 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:04.476052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-488ae79e-fbe5-44c7-822f-05084d82dfd8 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: 350b4c29-cb79-4b1e-a302-b84b2567608a] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:36:04.607832 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-488ae79e-fbe5-44c7-822f-05084d82dfd8 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "DELETE /compute/v2.1/servers/350b4c29-cb79-4b1e-a302-b84b2567608a" status: 204 len: 0 microversion: 2.1 time: 0.245458 Jul 19 22:36:04.610393 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1093/2202] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:36:04 2022] DELETE /compute/v2.1/servers/350b4c29-cb79-4b1e-a302-b84b2567608a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:36:04.627427 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a28b499a-0e1d-4b84-a119-e9f103dc3ff3 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:04.628350 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a28b499a-0e1d-4b84-a119-e9f103dc3ff3 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:04.636896 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a28b499a-0e1d-4b84-a119-e9f103dc3ff3 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:04.637577 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a28b499a-0e1d-4b84-a119-e9f103dc3ff3 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:04.638493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a28b499a-0e1d-4b84-a119-e9f103dc3ff3 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:04.639042 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a28b499a-0e1d-4b84-a119-e9f103dc3ff3 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:05.266884 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a28b499a-0e1d-4b84-a119-e9f103dc3ff3 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:05.281275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a28b499a-0e1d-4b84-a119-e9f103dc3ff3 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:05.282811 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a28b499a-0e1d-4b84-a119-e9f103dc3ff3 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:05.296428 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a28b499a-0e1d-4b84-a119-e9f103dc3ff3 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1845 microversion: 2.32 time: 0.683550 Jul 19 22:36:05.297050 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1094/2203] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:36:04 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1845 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:36:05.316445 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c7b1d146-179c-4556-a3f8-16aecedff9e5 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:05.317079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c7b1d146-179c-4556-a3f8-16aecedff9e5 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: bde3700e-991b-4d67-be79-6c4da0e27275] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:05.344020 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7b1d146-179c-4556-a3f8-16aecedff9e5 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:05.344484 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7b1d146-179c-4556-a3f8-16aecedff9e5 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:05.345284 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7b1d146-179c-4556-a3f8-16aecedff9e5 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:05.346277 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7b1d146-179c-4556-a3f8-16aecedff9e5 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:05.811817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c7b1d146-179c-4556-a3f8-16aecedff9e5 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:05.837888 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c7b1d146-179c-4556-a3f8-16aecedff9e5 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275" status: 200 len: 1325 microversion: 2.1 time: 0.515683 Jul 19 22:36:05.837888 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1095/2204] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:05 2022] GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275 => generated 1325 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:05.842207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ff2a9a38-e8cd-400c-ab78-653504547cef tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Calling method '.version_select at 0x7f7a03a0b9d0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:05.899901 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ff2a9a38-e8cd-400c-ab78-653504547cef tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] 10.222.0.25 "GET /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata" status: 200 len: 61 microversion: 2.1 time: 0.070518 Jul 19 22:36:05.900487 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1096/2205] 10.222.0.25 () {58 vars in 1259 bytes} [Tue Jul 19 22:36:05 2022] GET /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata => generated 61 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:36:05.910287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c088bdba-f628-42a2-8a63-8c1fa21fe754 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:05.911142 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c088bdba-f628-42a2-8a63-8c1fa21fe754 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: f3fa3e57-f0c8-4199-a602-8207624e50af] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:05.925699 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c088bdba-f628-42a2-8a63-8c1fa21fe754 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:05.926371 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c088bdba-f628-42a2-8a63-8c1fa21fe754 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:05.927358 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c088bdba-f628-42a2-8a63-8c1fa21fe754 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:05.928056 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c088bdba-f628-42a2-8a63-8c1fa21fe754 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:05.974851 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c088bdba-f628-42a2-8a63-8c1fa21fe754 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: f3fa3e57-f0c8-4199-a602-8207624e50af] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:36:06.117178 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c088bdba-f628-42a2-8a63-8c1fa21fe754 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f3fa3e57-f0c8-4199-a602-8207624e50af" status: 204 len: 0 microversion: 2.1 time: 0.212259 Jul 19 22:36:06.118076 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1097/2206] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:36:05 2022] DELETE /compute/v2.1/servers/f3fa3e57-f0c8-4199-a602-8207624e50af => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:36:06.128190 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8cc48e0c-73c6-4ed4-96a2-5348af826929 tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Action: 'update_all', calling method: .version_select at 0x7f7a1073b820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:06.206761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-8cc48e0c-73c6-4ed4-96a2-5348af826929 tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Getting quotas for project 1e7260a8799f47599c244cc39cff74b5. Resources: dict_keys(['metadata_items']) {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:36:06.217004 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-8cc48e0c-73c6-4ed4-96a2-5348af826929 tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Getting quotas for user 636bf131c1d1464786a05ceedb782531 and project 1e7260a8799f47599c244cc39cff74b5. Resources: dict_keys(['metadata_items']) {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:36:06.554432 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=4 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:36:06.696780 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8cc48e0c-73c6-4ed4-96a2-5348af826929 tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] 10.222.0.25 "PUT /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata" status: 200 len: 61 microversion: 2.1 time: 0.576207 Jul 19 22:36:06.698406 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1098/2207] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 22:36:06 2022] PUT /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata => generated 61 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:36:06.709612 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2de59da2-6d7f-4143-acc2-f2c392e0a800 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:06.710702 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2de59da2-6d7f-4143-acc2-f2c392e0a800 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: 350b4c29-cb79-4b1e-a302-b84b2567608a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:06.731310 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2de59da2-6d7f-4143-acc2-f2c392e0a800 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:06.732335 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2de59da2-6d7f-4143-acc2-f2c392e0a800 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:06.733627 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2de59da2-6d7f-4143-acc2-f2c392e0a800 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:06.734295 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2de59da2-6d7f-4143-acc2-f2c392e0a800 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:07.481611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2de59da2-6d7f-4143-acc2-f2c392e0a800 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8abba155f841cea0212bbaad5462ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:07.495938 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2de59da2-6d7f-4143-acc2-f2c392e0a800 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers/350b4c29-cb79-4b1e-a302-b84b2567608a" status: 200 len: 1512 microversion: 2.1 time: 0.796144 Jul 19 22:36:07.497080 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1099/2208] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:06 2022] GET /compute/v2.1/servers/350b4c29-cb79-4b1e-a302-b84b2567608a => generated 1512 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:07.514533 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-179448b0-1409-432e-b89f-10d54a91fdf8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:07.515555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-179448b0-1409-432e-b89f-10d54a91fdf8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:07.522931 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-179448b0-1409-432e-b89f-10d54a91fdf8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:07.523825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-179448b0-1409-432e-b89f-10d54a91fdf8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:07.524818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-179448b0-1409-432e-b89f-10d54a91fdf8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:07.525459 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-179448b0-1409-432e-b89f-10d54a91fdf8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:07.966017 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a14cca7f-677f-4d63-ba9e-6a38cd4818df tempest-SecurityGroupsTestAdminJSON-902325881 tempest-SecurityGroupsTestAdminJSON-902325881-project-admin] 10.222.0.25 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10924 microversion: 2.1 time: 8.954341 Jul 19 22:36:07.966611 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1110/2209] 10.222.0.25 () {58 vars in 1190 bytes} [Tue Jul 19 22:35:59 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10924 bytes in 8956 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:36:07.971351 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-2b0ca6c8-7251-488b-a78c-f0c6c833b127 req-8bb54dfa-fdc5-4d5b-a889-25f954d97abe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e509d1e-b5d6-4f5f-a017-c2df1d2433f4", "tag": "5b0e7351-eaff-4dcf-814a-86252ed1286b"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:07.995076 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-2b0ca6c8-7251-488b-a78c-f0c6c833b127 req-8bb54dfa-fdc5-4d5b-a889-25f954d97abe service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:07.995553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-2b0ca6c8-7251-488b-a78c-f0c6c833b127 req-8bb54dfa-fdc5-4d5b-a889-25f954d97abe service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:08.007826 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-2b0ca6c8-7251-488b-a78c-f0c6c833b127 req-8bb54dfa-fdc5-4d5b-a889-25f954d97abe service nova] Creating event network-changed:5b0e7351-eaff-4dcf-814a-86252ed1286b for instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 on n-h2-847009-3 Jul 19 22:36:08.014278 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-2b0ca6c8-7251-488b-a78c-f0c6c833b127 req-8bb54dfa-fdc5-4d5b-a889-25f954d97abe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046252 Jul 19 22:36:08.015064 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1111/2210] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:36:08.022837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a443f763-a72b-4ed0-93dd-892ca709c157 tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Action: 'update_all', calling method: .version_select at 0x7f7a106cfaf0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:08.082674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-a443f763-a72b-4ed0-93dd-892ca709c157 tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Getting quotas for project 1e7260a8799f47599c244cc39cff74b5. Resources: dict_keys(['metadata_items']) {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:36:08.089684 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-a443f763-a72b-4ed0-93dd-892ca709c157 tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Getting quotas for user 636bf131c1d1464786a05ceedb782531 and project 1e7260a8799f47599c244cc39cff74b5. Resources: dict_keys(['metadata_items']) {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:36:08.332999 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-179448b0-1409-432e-b89f-10d54a91fdf8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:08.353983 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-179448b0-1409-432e-b89f-10d54a91fdf8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:08.362615 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-179448b0-1409-432e-b89f-10d54a91fdf8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:08.368447 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-179448b0-1409-432e-b89f-10d54a91fdf8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1866 microversion: 2.32 time: 0.858029 Jul 19 22:36:08.369354 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1100/2211] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:36:07 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1866 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:36:08.385314 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-728c76e9-ddba-4922-999a-8961262bfc08 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:08.386128 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-728c76e9-ddba-4922-999a-8961262bfc08 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: bde3700e-991b-4d67-be79-6c4da0e27275] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:08.397360 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-728c76e9-ddba-4922-999a-8961262bfc08 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:08.400993 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-728c76e9-ddba-4922-999a-8961262bfc08 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:08.402049 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-728c76e9-ddba-4922-999a-8961262bfc08 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:08.402433 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-728c76e9-ddba-4922-999a-8961262bfc08 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:08.602766 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a443f763-a72b-4ed0-93dd-892ca709c157 tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] 10.222.0.25 "PUT /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata" status: 200 len: 64 microversion: 2.1 time: 0.586216 Jul 19 22:36:08.603526 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1112/2212] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 22:36:08 2022] PUT /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata => generated 64 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:36:08.612247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2dfbeeb9-81af-47e1-a0c2-352f1cbe36a8 tempest-SecurityGroupsTestAdminJSON-830295932 tempest-SecurityGroupsTestAdminJSON-830295932-project] Calling method '.version_select at 0x7f7a10458e50>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:08.871601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:36:09.444694 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-728c76e9-ddba-4922-999a-8961262bfc08 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:09.454004 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-728c76e9-ddba-4922-999a-8961262bfc08 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275" status: 200 len: 1325 microversion: 2.1 time: 1.083262 Jul 19 22:36:09.464303 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1101/2213] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:08 2022] GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275 => generated 1325 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:09.469989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-76932d7d-b4f7-43a9-b79c-0406ffd81c76 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:09.470835 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-76932d7d-b4f7-43a9-b79c-0406ffd81c76 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: 350b4c29-cb79-4b1e-a302-b84b2567608a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:09.484671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-76932d7d-b4f7-43a9-b79c-0406ffd81c76 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:09.485128 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-76932d7d-b4f7-43a9-b79c-0406ffd81c76 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:09.487013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-76932d7d-b4f7-43a9-b79c-0406ffd81c76 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:09.487502 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-76932d7d-b4f7-43a9-b79c-0406ffd81c76 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:09.502697 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-76932d7d-b4f7-43a9-b79c-0406ffd81c76 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] HTTP exception thrown: Instance 350b4c29-cb79-4b1e-a302-b84b2567608a could not be found. Jul 19 22:36:09.504438 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-76932d7d-b4f7-43a9-b79c-0406ffd81c76 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Request method failure captured: Jul 19 22:36:09.504438 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/350b4c29-cb79-4b1e-a302-b84b2567608a HTTP/1.1 Jul 19 22:36:09.504438 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:36:09.504438 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:36:09.504438 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:36:09.504438 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:36:09.504438 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:36:09.504438 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:36:09.504438 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:36:09.504438 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:36:09.504438 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zGPP46609N51VfbMUAHXlC0gwb_ezLMM0J_CWTBgOg9N_S1AR-lKVjnycSmnOiD0QtkcRFVR6CE3XFFJzo7C4K1DWbj7Dz_BTI7n8aagbPMVUWdJAtCt_b0Mb9D7DgQ3AZ9V6CkdEKDDFfrj_ieO7O5aUuSoBhogcqBPgRd9fQSGc4 Jul 19 22:36:09.504438 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:36:09.504438 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:36:09.504438 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:36:09.504438 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:36:09.504438 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:36:09.504438 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:36:09.504438 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 52bcd0bd2cd24c5d86494a3af2d25d59 Jul 19 22:36:09.504438 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-MultipleCreateTestJSON-380550692 Jul 19 22:36:09.504438 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:36:09.504438 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:36:09.505866 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_52bcd0bd2cd24c5d86494a3af2d25d59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/52bcd0bd2cd24c5d86494a3af2d25d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/52bcd0bd2cd24c5d86494a3af2d25d59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/52bcd0bd2cd24c5d86494a3af2d25d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:36:09.505866 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-MultipleCreateTestJSON-380550692 Jul 19 22:36:09.505866 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 52bcd0bd2cd24c5d86494a3af2d25d59 Jul 19 22:36:09.505866 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-MultipleCreateTestJSON-380550692 Jul 19 22:36:09.505866 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-MultipleCreateTestJSON-380550692-project Jul 19 22:36:09.505866 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:36:09.505866 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:36:09.505866 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 7a8abba155f841cea0212bbaad5462ac Jul 19 22:36:09.505866 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-MultipleCreateTestJSON-380550692-project Jul 19 22:36:09.505866 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:36:09.505866 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 350b4c29-cb79-4b1e-a302-b84b2567608a could not be found. Jul 19 22:36:09.505866 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '350b4c29-cb79-4b1e-a302-b84b2567608a'} Jul 19 22:36:09.506619 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:36:09.506619 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:09.506619 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:36:09.506619 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:36:09.506619 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:36:09.506619 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:36:09.506619 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:36:09.506619 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:36:09.506619 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:36:09.506619 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:36:09.506619 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 350b4c29-cb79-4b1e-a302-b84b2567608a could not be found. Jul 19 22:36:09.506619 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:09.506619 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:36:09.506619 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:09.506619 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:09.506619 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:36:09.506619 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:36:09.506619 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:36:09.506619 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:36:09.506619 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:36:09.507976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:36:09.507976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:36:09.507976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:36:09.507976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:36:09.507976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:36:09.507976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:36:09.507976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:36:09.507976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 350b4c29-cb79-4b1e-a302-b84b2567608a could not be found. Jul 19 22:36:09.507976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:09.507976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:36:09.507976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:09.507976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:09.507976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:36:09.507976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:36:09.507976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:36:09.507976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:36:09.507976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 350b4c29-cb79-4b1e-a302-b84b2567608a could not be found. Jul 19 22:36:09.507976 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:09.510369 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-76932d7d-b4f7-43a9-b79c-0406ffd81c76 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Returning 404 to user: Instance 350b4c29-cb79-4b1e-a302-b84b2567608a could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:36:09.511635 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-76932d7d-b4f7-43a9-b79c-0406ffd81c76 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers/350b4c29-cb79-4b1e-a302-b84b2567608a" status: 404 len: 111 microversion: 2.1 time: 0.045993 Jul 19 22:36:09.515484 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1102/2214] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:09 2022] GET /compute/v2.1/servers/350b4c29-cb79-4b1e-a302-b84b2567608a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:36:09.521241 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-84e6438b-59a9-4ff2-9b6c-b454a2b2f298 tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Calling method '.version_select at 0x7f7a03a0b670>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:09.592158 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-84e6438b-59a9-4ff2-9b6c-b454a2b2f298 tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] 10.222.0.25 "GET /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata" status: 200 len: 64 microversion: 2.1 time: 0.075269 Jul 19 22:36:09.593048 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1103/2215] 10.222.0.25 () {58 vars in 1259 bytes} [Tue Jul 19 22:36:09 2022] GET /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata => generated 64 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:36:09.600871 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5988f0b2-2e61-4790-abed-352e601458e5 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:09.601517 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5988f0b2-2e61-4790-abed-352e601458e5 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:09.609326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5988f0b2-2e61-4790-abed-352e601458e5 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:09.609787 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5988f0b2-2e61-4790-abed-352e601458e5 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:09.610656 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5988f0b2-2e61-4790-abed-352e601458e5 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:09.611806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5988f0b2-2e61-4790-abed-352e601458e5 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:09.635692 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:36:09.876391 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2dfbeeb9-81af-47e1-a0c2-352f1cbe36a8 tempest-SecurityGroupsTestAdminJSON-830295932 tempest-SecurityGroupsTestAdminJSON-830295932-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1113 microversion: 2.1 time: 1.271067 Jul 19 22:36:09.878275 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1113/2216] 10.222.0.25 () {58 vars in 1190 bytes} [Tue Jul 19 22:36:08 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1113 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:09.883624 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7ad1238e-7a3b-48db-8252-e2a782f07af2 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:09.884520 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7ad1238e-7a3b-48db-8252-e2a782f07af2 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: f3fa3e57-f0c8-4199-a602-8207624e50af] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:09.893843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:36:09.902177 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7ad1238e-7a3b-48db-8252-e2a782f07af2 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:09.902845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7ad1238e-7a3b-48db-8252-e2a782f07af2 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:09.904300 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7ad1238e-7a3b-48db-8252-e2a782f07af2 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:09.904893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7ad1238e-7a3b-48db-8252-e2a782f07af2 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:10.132317 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7ad1238e-7a3b-48db-8252-e2a782f07af2 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8abba155f841cea0212bbaad5462ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bcd0bd2cd24c5d86494a3af2d25d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:10.174645 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7ad1238e-7a3b-48db-8252-e2a782f07af2 tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers/f3fa3e57-f0c8-4199-a602-8207624e50af" status: 200 len: 1470 microversion: 2.1 time: 0.294141 Jul 19 22:36:10.179009 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1114/2217] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:09 2022] GET /compute/v2.1/servers/f3fa3e57-f0c8-4199-a602-8207624e50af => generated 1470 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:10.185616 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a27c8725-0b46-4e68-be3c-2cfeecae316e tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Action: 'update_all', calling method: .version_select at 0x7f7a1040f700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:10.233370 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5988f0b2-2e61-4790-abed-352e601458e5 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:10.246079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5988f0b2-2e61-4790-abed-352e601458e5 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:10.261302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5988f0b2-2e61-4790-abed-352e601458e5 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:10.265380 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5988f0b2-2e61-4790-abed-352e601458e5 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 0.671290 Jul 19 22:36:10.271124 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1104/2218] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:36:09 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:36:10.276267 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d483d442-4424-4515-abe7-2a717a6c945b tempest-SecurityGroupsTestAdminJSON-902325881 tempest-SecurityGroupsTestAdminJSON-902325881-project-admin] Calling method '.version_select at 0x7f7a104b73a0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:10.276651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-a27c8725-0b46-4e68-be3c-2cfeecae316e tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Getting quotas for project 1e7260a8799f47599c244cc39cff74b5. Resources: dict_keys(['metadata_items']) {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:36:10.293550 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-a27c8725-0b46-4e68-be3c-2cfeecae316e tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Getting quotas for user 636bf131c1d1464786a05ceedb782531 and project 1e7260a8799f47599c244cc39cff74b5. Resources: dict_keys(['metadata_items']) {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:36:10.961629 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a27c8725-0b46-4e68-be3c-2cfeecae316e tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] 10.222.0.25 "PUT /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata" status: 200 len: 61 microversion: 2.1 time: 0.780682 Jul 19 22:36:10.964185 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1115/2219] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 22:36:10 2022] PUT /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata => generated 61 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:36:10.970534 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-5776ba82-fd4f-4309-b055-c43e784a9456 req-0890bdbb-2f83-4aca-95c3-9a1440f23c13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "350b4c29-cb79-4b1e-a302-b84b2567608a", "name": "network-vif-deleted", "tag": "7cab0dfa-9e76-4cb6-b727-d482a0dd0c70"}, {"name": "network-changed", "server_uuid": "bde3700e-991b-4d67-be79-6c4da0e27275", "tag": "342c9c83-1d04-473c-88ea-d3b8d92a8627"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:10.998442 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-5776ba82-fd4f-4309-b055-c43e784a9456 req-0890bdbb-2f83-4aca-95c3-9a1440f23c13 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:10.999194 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-5776ba82-fd4f-4309-b055-c43e784a9456 req-0890bdbb-2f83-4aca-95c3-9a1440f23c13 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:11.041067 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-5776ba82-fd4f-4309-b055-c43e784a9456 req-0890bdbb-2f83-4aca-95c3-9a1440f23c13 service nova] Creating event network-vif-deleted:7cab0dfa-9e76-4cb6-b727-d482a0dd0c70 for instance 350b4c29-cb79-4b1e-a302-b84b2567608a on n-h1-847009-3 Jul 19 22:36:11.048094 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-5776ba82-fd4f-4309-b055-c43e784a9456 req-0890bdbb-2f83-4aca-95c3-9a1440f23c13 service nova] Creating event network-changed:342c9c83-1d04-473c-88ea-d3b8d92a8627 for instance bde3700e-991b-4d67-be79-6c4da0e27275 on n-h1-847009-3 Jul 19 22:36:11.057136 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-5776ba82-fd4f-4309-b055-c43e784a9456 req-0890bdbb-2f83-4aca-95c3-9a1440f23c13 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.091230 Jul 19 22:36:11.058580 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1116/2220] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:36:11.064965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-1e6cf1e3-274f-4826-b15f-f6a6922f52d2 req-e1ff6378-6753-4685-9f32-9b92744c80e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fa3e57-f0c8-4199-a602-8207624e50af", "name": "network-vif-deleted", "tag": "db62c69f-c2d5-43c9-af11-34c92a7d341d"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:11.076166 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1e6cf1e3-274f-4826-b15f-f6a6922f52d2 req-e1ff6378-6753-4685-9f32-9b92744c80e4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:11.076809 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1e6cf1e3-274f-4826-b15f-f6a6922f52d2 req-e1ff6378-6753-4685-9f32-9b92744c80e4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:11.112031 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-1e6cf1e3-274f-4826-b15f-f6a6922f52d2 req-e1ff6378-6753-4685-9f32-9b92744c80e4 service nova] Creating event network-vif-deleted:db62c69f-c2d5-43c9-af11-34c92a7d341d for instance f3fa3e57-f0c8-4199-a602-8207624e50af on n-h2-847009-3 Jul 19 22:36:11.117492 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-1e6cf1e3-274f-4826-b15f-f6a6922f52d2 req-e1ff6378-6753-4685-9f32-9b92744c80e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057226 Jul 19 22:36:11.118616 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1117/2221] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:36:11.129124 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-10588b62-f4fc-4690-a5b8-97f4842b83ce tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:11.129931 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-10588b62-f4fc-4690-a5b8-97f4842b83ce tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: bde3700e-991b-4d67-be79-6c4da0e27275] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:11.143713 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-10588b62-f4fc-4690-a5b8-97f4842b83ce tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:11.144173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-10588b62-f4fc-4690-a5b8-97f4842b83ce tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:11.144976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-10588b62-f4fc-4690-a5b8-97f4842b83ce tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:11.145419 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-10588b62-f4fc-4690-a5b8-97f4842b83ce tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:11.602612 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d483d442-4424-4515-abe7-2a717a6c945b tempest-SecurityGroupsTestAdminJSON-902325881 tempest-SecurityGroupsTestAdminJSON-902325881-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/efb4e5bf-534d-4a57-a533-08d024946929" status: 202 len: 0 microversion: 2.1 time: 1.329873 Jul 19 22:36:11.603272 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1105/2222] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:36:10 2022] DELETE /compute/v2.1/os-security-groups/efb4e5bf-534d-4a57-a533-08d024946929 => generated 0 bytes in 1331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:36:11.612096 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-87bb404c-cbaf-4df0-977c-9bf01e47a79e tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Action: 'update', calling method: .version_select at 0x7f7a107f5940>, body: {"meta": {"os_version": "alt"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:11.635429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-10588b62-f4fc-4690-a5b8-97f4842b83ce tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:11.645251 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-10588b62-f4fc-4690-a5b8-97f4842b83ce tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275" status: 200 len: 1325 microversion: 2.1 time: 0.524788 Jul 19 22:36:11.646474 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1118/2223] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:11 2022] GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275 => generated 1325 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:11.651273 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8e56b215-69a6-4ee0-a2ba-03b44e4681ef tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:11.651985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8e56b215-69a6-4ee0-a2ba-03b44e4681ef tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] [instance: f3fa3e57-f0c8-4199-a602-8207624e50af] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:11.658856 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8e56b215-69a6-4ee0-a2ba-03b44e4681ef tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:11.659435 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8e56b215-69a6-4ee0-a2ba-03b44e4681ef tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:11.660298 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8e56b215-69a6-4ee0-a2ba-03b44e4681ef tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:11.660819 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8e56b215-69a6-4ee0-a2ba-03b44e4681ef tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:11.667596 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-87bb404c-cbaf-4df0-977c-9bf01e47a79e tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Getting quotas for project 1e7260a8799f47599c244cc39cff74b5. Resources: dict_keys(['metadata_items']) {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:36:11.674386 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-87bb404c-cbaf-4df0-977c-9bf01e47a79e tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Getting quotas for user 636bf131c1d1464786a05ceedb782531 and project 1e7260a8799f47599c244cc39cff74b5. Resources: dict_keys(['metadata_items']) {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:36:11.677783 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-8e56b215-69a6-4ee0-a2ba-03b44e4681ef tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] HTTP exception thrown: Instance f3fa3e57-f0c8-4199-a602-8207624e50af could not be found. Jul 19 22:36:11.679593 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8e56b215-69a6-4ee0-a2ba-03b44e4681ef tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Request method failure captured: Jul 19 22:36:11.679593 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/f3fa3e57-f0c8-4199-a602-8207624e50af HTTP/1.1 Jul 19 22:36:11.679593 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:36:11.679593 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:36:11.679593 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:36:11.679593 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:36:11.679593 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:36:11.679593 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:36:11.679593 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:36:11.679593 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:36:11.679593 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zGPP46609N51VfbMUAHXlC0gwb_ezLMM0J_CWTBgOg9N_S1AR-lKVjnycSmnOiD0QtkcRFVR6CE3XFFJzo7C4K1DWbj7Dz_BTI7n8aagbPMVUWdJAtCt_b0Mb9D7DgQ3AZ9V6CkdEKDDFfrj_ieO7O5aUuSoBhogcqBPgRd9fQSGc4 Jul 19 22:36:11.679593 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:36:11.679593 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:36:11.679593 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:36:11.679593 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:36:11.679593 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:36:11.679593 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:36:11.679593 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 52bcd0bd2cd24c5d86494a3af2d25d59 Jul 19 22:36:11.679593 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-MultipleCreateTestJSON-380550692 Jul 19 22:36:11.679593 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:36:11.679593 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:36:11.680827 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_52bcd0bd2cd24c5d86494a3af2d25d59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/52bcd0bd2cd24c5d86494a3af2d25d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/52bcd0bd2cd24c5d86494a3af2d25d59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/52bcd0bd2cd24c5d86494a3af2d25d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:36:11.680827 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-MultipleCreateTestJSON-380550692 Jul 19 22:36:11.680827 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 52bcd0bd2cd24c5d86494a3af2d25d59 Jul 19 22:36:11.680827 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-MultipleCreateTestJSON-380550692 Jul 19 22:36:11.680827 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-MultipleCreateTestJSON-380550692-project Jul 19 22:36:11.680827 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:36:11.680827 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:36:11.680827 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 7a8abba155f841cea0212bbaad5462ac Jul 19 22:36:11.680827 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-MultipleCreateTestJSON-380550692-project Jul 19 22:36:11.680827 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:36:11.680827 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance f3fa3e57-f0c8-4199-a602-8207624e50af could not be found. Jul 19 22:36:11.680827 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'f3fa3e57-f0c8-4199-a602-8207624e50af'} Jul 19 22:36:11.681475 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:36:11.681475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:11.681475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:36:11.681475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:36:11.681475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:36:11.681475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:36:11.681475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:36:11.681475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:36:11.681475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:36:11.681475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:36:11.681475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3fa3e57-f0c8-4199-a602-8207624e50af could not be found. Jul 19 22:36:11.681475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:36:11.681475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:36:11.681475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:36:11.681475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:11.681475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:36:11.681475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:36:11.681475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:36:11.681475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:36:11.681475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:36:11.682561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:36:11.682561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:36:11.682561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:36:11.682561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:36:11.682561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:36:11.682561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:36:11.682561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:36:11.682561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3fa3e57-f0c8-4199-a602-8207624e50af could not be found. Jul 19 22:36:11.682561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:36:11.682561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:36:11.682561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:36:11.682561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:11.682561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:36:11.682561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:36:11.682561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:36:11.682561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:36:11.682561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3fa3e57-f0c8-4199-a602-8207624e50af could not be found. Jul 19 22:36:11.682561 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:36:11.683512 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8e56b215-69a6-4ee0-a2ba-03b44e4681ef tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] Returning 404 to user: Instance f3fa3e57-f0c8-4199-a602-8207624e50af could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:36:11.683512 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8e56b215-69a6-4ee0-a2ba-03b44e4681ef tempest-MultipleCreateTestJSON-380550692 tempest-MultipleCreateTestJSON-380550692-project] 10.222.0.25 "GET /compute/v2.1/servers/f3fa3e57-f0c8-4199-a602-8207624e50af" status: 404 len: 111 microversion: 2.1 time: 0.033444 Jul 19 22:36:11.683512 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1119/2224] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:11 2022] GET /compute/v2.1/servers/f3fa3e57-f0c8-4199-a602-8207624e50af => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:36:11.686311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-be237cd8-16eb-42d4-8c49-7656c4267497 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:11.687225 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-be237cd8-16eb-42d4-8c49-7656c4267497 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:11.694710 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be237cd8-16eb-42d4-8c49-7656c4267497 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:11.695198 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be237cd8-16eb-42d4-8c49-7656c4267497 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:11.696241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be237cd8-16eb-42d4-8c49-7656c4267497 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:11.696680 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be237cd8-16eb-42d4-8c49-7656c4267497 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:12.119750 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-87bb404c-cbaf-4df0-977c-9bf01e47a79e tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] 10.222.0.25 "PUT /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.512127 Jul 19 22:36:12.120784 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1106/2225] 10.222.0.25 () {60 vars in 1312 bytes} [Tue Jul 19 22:36:11 2022] PUT /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata/os_version => generated 31 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:36:12.127439 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0f4b5dfe-e488-47d4-9240-f4c48dff12ee tempest-SecurityGroupsTestAdminJSON-902325881 tempest-SecurityGroupsTestAdminJSON-902325881-project-admin] Calling method '.version_select at 0x7f7a03a0bb80>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:12.242632 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-be237cd8-16eb-42d4-8c49-7656c4267497 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:12.256604 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-be237cd8-16eb-42d4-8c49-7656c4267497 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:12.258505 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-be237cd8-16eb-42d4-8c49-7656c4267497 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:12.264654 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-be237cd8-16eb-42d4-8c49-7656c4267497 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 0.581853 Jul 19 22:36:12.265443 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1120/2226] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:36:11 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:36:12.504966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-68245ca5-9ab6-4994-8db9-1acf9f6a8057 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Action: 'create', calling method: .version_select at 0x7f7a1050ec10>, body: {"keypair": {"name": "tempest-keypair-1917630425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+u2Lxab15NcBq9WsKYgEidxyMRgqu/B3pxSVLvBJa3YQWsGAjmuTrUCUG7BqDjCp0cLAjHRirosWyJ9J9B/N/jVmgnBzOcE56RSH2KbWMAtOSGc+m+pbW3EaGtPJdJ8w=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:12.528241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-68245ca5-9ab6-4994-8db9-1acf9f6a8057 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Getting quotas for project 04569d19c85640c48496efb72ef4c20f. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:36:12.535708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-68245ca5-9ab6-4994-8db9-1acf9f6a8057 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Getting quotas for user 35f357f1737d4f29b2d594939a06a79f and project 04569d19c85640c48496efb72ef4c20f. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:36:12.599370 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-68245ca5-9ab6-4994-8db9-1acf9f6a8057 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.328594 Jul 19 22:36:12.599997 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1121/2227] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:36:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:36:12.604773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0f926087-30c9-4781-89e9-eb523a6e6fcc tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Calling method '.version_select at 0x7f7a105385e0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:12.688184 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0f926087-30c9-4781-89e9-eb523a6e6fcc tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] 10.222.0.25 "GET /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata" status: 200 len: 58 microversion: 2.1 time: 0.085945 Jul 19 22:36:12.690203 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1122/2228] 10.222.0.25 () {58 vars in 1259 bytes} [Tue Jul 19 22:36:12 2022] GET /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata => generated 58 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:36:12.699028 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b1e00747-abf4-40f9-af5d-5fba461ebf99 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:12.700319 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b1e00747-abf4-40f9-af5d-5fba461ebf99 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: bde3700e-991b-4d67-be79-6c4da0e27275] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:12.708693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b1e00747-abf4-40f9-af5d-5fba461ebf99 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:12.709752 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b1e00747-abf4-40f9-af5d-5fba461ebf99 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:12.710902 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b1e00747-abf4-40f9-af5d-5fba461ebf99 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:12.712514 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b1e00747-abf4-40f9-af5d-5fba461ebf99 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:13.312721 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b1e00747-abf4-40f9-af5d-5fba461ebf99 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:13.322365 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b1e00747-abf4-40f9-af5d-5fba461ebf99 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275" status: 200 len: 1325 microversion: 2.1 time: 0.630343 Jul 19 22:36:13.331911 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1123/2229] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:12 2022] GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275 => generated 1325 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:13.337542 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8f416099-8b28-491c-adee-2039b95df1d7 tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Action: 'update_all', calling method: .version_select at 0x7f7a108a5ca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:13.444250 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-8f416099-8b28-491c-adee-2039b95df1d7 tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Getting quotas for project 1e7260a8799f47599c244cc39cff74b5. Resources: dict_keys(['metadata_items']) {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:36:13.456996 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-8f416099-8b28-491c-adee-2039b95df1d7 tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Getting quotas for user 636bf131c1d1464786a05ceedb782531 and project 1e7260a8799f47599c244cc39cff74b5. Resources: dict_keys(['metadata_items']) {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:36:13.603340 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0f4b5dfe-e488-47d4-9240-f4c48dff12ee tempest-SecurityGroupsTestAdminJSON-902325881 tempest-SecurityGroupsTestAdminJSON-902325881-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/c93dee0b-5eac-4819-8aa7-5c87f550cb1e" status: 202 len: 0 microversion: 2.1 time: 1.480929 Jul 19 22:36:13.603954 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1107/2230] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:36:12 2022] DELETE /compute/v2.1/os-security-groups/c93dee0b-5eac-4819-8aa7-5c87f550cb1e => generated 0 bytes in 1482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:36:13.611464 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4d8a3249-d77f-4586-8822-3b020180875d tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:13.612167 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4d8a3249-d77f-4586-8822-3b020180875d tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:13.640622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d8a3249-d77f-4586-8822-3b020180875d tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:13.641360 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d8a3249-d77f-4586-8822-3b020180875d tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:13.643738 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d8a3249-d77f-4586-8822-3b020180875d tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:13.645767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d8a3249-d77f-4586-8822-3b020180875d tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:14.171476 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8f416099-8b28-491c-adee-2039b95df1d7 tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] 10.222.0.25 "PUT /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata" status: 200 len: 61 microversion: 2.1 time: 0.837624 Jul 19 22:36:14.172394 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1124/2231] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 22:36:13 2022] PUT /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata => generated 61 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:36:14.178351 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-83cd924e-3424-46e8-8976-29f326687479 req-da32617a-464b-4938-bbbc-566ddc00bc66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e509d1e-b5d6-4f5f-a017-c2df1d2433f4", "tag": "4b814275-8b47-43f3-88da-1bc97c3e05e3"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:14.198304 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-83cd924e-3424-46e8-8976-29f326687479 req-da32617a-464b-4938-bbbc-566ddc00bc66 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:14.202054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-83cd924e-3424-46e8-8976-29f326687479 req-da32617a-464b-4938-bbbc-566ddc00bc66 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:14.227095 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-83cd924e-3424-46e8-8976-29f326687479 req-da32617a-464b-4938-bbbc-566ddc00bc66 service nova] Creating event network-changed:4b814275-8b47-43f3-88da-1bc97c3e05e3 for instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 on n-h2-847009-3 Jul 19 22:36:14.244563 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-83cd924e-3424-46e8-8976-29f326687479 req-da32617a-464b-4938-bbbc-566ddc00bc66 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070638 Jul 19 22:36:14.245314 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1125/2232] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:36:14.256490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e6286a80-3805-4215-abf6-e408b75317b6 tempest-SecurityGroupsTestAdminJSON-830295932 tempest-SecurityGroupsTestAdminJSON-830295932-project] Calling method '.version_select at 0x7f7a106cf700>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:14.735843 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4d8a3249-d77f-4586-8822-3b020180875d tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:14.755261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4d8a3249-d77f-4586-8822-3b020180875d tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:14.758479 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4d8a3249-d77f-4586-8822-3b020180875d tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:14.760120 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4d8a3249-d77f-4586-8822-3b020180875d tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 1.155217 Jul 19 22:36:14.763170 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1108/2233] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:36:13 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:36:14.776193 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cce188f4-38e9-40c4-8ef5-e823bb716b56 tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Action: 'create', calling method: .version_select at 0x7f7a104aec10>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:14.911542 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-cce188f4-38e9-40c4-8ef5-e823bb716b56 tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Getting quotas for project 1e7260a8799f47599c244cc39cff74b5. Resources: dict_keys(['metadata_items']) {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:36:14.933907 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-cce188f4-38e9-40c4-8ef5-e823bb716b56 tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Getting quotas for user 636bf131c1d1464786a05ceedb782531 and project 1e7260a8799f47599c244cc39cff74b5. Resources: dict_keys(['metadata_items']) {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:36:15.513928 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cce188f4-38e9-40c4-8ef5-e823bb716b56 tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] 10.222.0.25 "POST /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata" status: 200 len: 85 microversion: 2.1 time: 0.747565 Jul 19 22:36:15.515376 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1109/2234] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Jul 19 22:36:14 2022] POST /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata => generated 85 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:36:15.525090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-22b7a67d-eb30-430f-8116-fe5a2623708d tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:15.526247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-22b7a67d-eb30-430f-8116-fe5a2623708d tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: bde3700e-991b-4d67-be79-6c4da0e27275] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:15.536713 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-22b7a67d-eb30-430f-8116-fe5a2623708d tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:15.537487 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-22b7a67d-eb30-430f-8116-fe5a2623708d tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:15.538437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-22b7a67d-eb30-430f-8116-fe5a2623708d tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:15.540090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-22b7a67d-eb30-430f-8116-fe5a2623708d tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:15.982130 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e6286a80-3805-4215-abf6-e408b75317b6 tempest-SecurityGroupsTestAdminJSON-830295932 tempest-SecurityGroupsTestAdminJSON-830295932-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/3f96701f-75ce-4d36-b61d-6f2f4c72d3cf" status: 202 len: 0 microversion: 2.1 time: 1.734558 Jul 19 22:36:15.982864 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1126/2235] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:36:14 2022] DELETE /compute/v2.1/os-security-groups/3f96701f-75ce-4d36-b61d-6f2f4c72d3cf => generated 0 bytes in 1737 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:36:15.990524 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-44003511-f981-4c4b-9e52-ea5e4047ceff tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] Calling method '.version_select at 0x7f7a107b93a0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:16.079171 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-44003511-f981-4c4b-9e52-ea5e4047ceff tempest-ImagesMetadataTestJSON-937320651 tempest-ImagesMetadataTestJSON-937320651-project] 10.222.0.25 "GET /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata" status: 200 len: 85 microversion: 2.1 time: 0.094773 Jul 19 22:36:16.081532 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1127/2236] 10.222.0.25 () {58 vars in 1259 bytes} [Tue Jul 19 22:36:15 2022] GET /compute/v2.1/images/0c251f14-d99d-437e-a03a-e2f449db2d63/metadata => generated 85 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:36:16.089137 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-88fb1215-52d7-4e2e-a872-be5ed24048e4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:16.090068 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-88fb1215-52d7-4e2e-a872-be5ed24048e4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:16.103064 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88fb1215-52d7-4e2e-a872-be5ed24048e4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:16.104929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88fb1215-52d7-4e2e-a872-be5ed24048e4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:16.107766 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88fb1215-52d7-4e2e-a872-be5ed24048e4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:16.108808 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88fb1215-52d7-4e2e-a872-be5ed24048e4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:16.199618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-22b7a67d-eb30-430f-8116-fe5a2623708d tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:16.209791 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-22b7a67d-eb30-430f-8116-fe5a2623708d tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275" status: 200 len: 1325 microversion: 2.1 time: 0.693055 Jul 19 22:36:16.214100 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1110/2237] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:15 2022] GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275 => generated 1325 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:16.219293 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-95f32d37-0849-4970-8449-c29afed6ea37 tempest-SecurityGroupsTestAdminJSON-830295932 tempest-SecurityGroupsTestAdminJSON-830295932-project] Calling method '.version_select at 0x7f7a104b7280>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:17.080534 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-88fb1215-52d7-4e2e-a872-be5ed24048e4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:17.093530 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-88fb1215-52d7-4e2e-a872-be5ed24048e4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:17.099072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-88fb1215-52d7-4e2e-a872-be5ed24048e4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:17.105293 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-88fb1215-52d7-4e2e-a872-be5ed24048e4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 1.022183 Jul 19 22:36:17.105988 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1128/2238] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:36:16 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:36:17.118416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-30eac63b-f8bb-4c60-ba52-e2c3e9f9f0d6 req-cba075bc-a400-47ab-85e2-c68977033f86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e509d1e-b5d6-4f5f-a017-c2df1d2433f4", "tag": "5842fe2c-d08f-4a4f-8daf-6a8e5788ff55"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:17.142532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-30eac63b-f8bb-4c60-ba52-e2c3e9f9f0d6 req-cba075bc-a400-47ab-85e2-c68977033f86 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:17.145622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-30eac63b-f8bb-4c60-ba52-e2c3e9f9f0d6 req-cba075bc-a400-47ab-85e2-c68977033f86 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:17.174614 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-30eac63b-f8bb-4c60-ba52-e2c3e9f9f0d6 req-cba075bc-a400-47ab-85e2-c68977033f86 service nova] Creating event network-changed:5842fe2c-d08f-4a4f-8daf-6a8e5788ff55 for instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 on n-h2-847009-3 Jul 19 22:36:17.185937 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-30eac63b-f8bb-4c60-ba52-e2c3e9f9f0d6 req-cba075bc-a400-47ab-85e2-c68977033f86 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074655 Jul 19 22:36:17.193875 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1129/2239] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:36:17.235088 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c7beeda6-a324-49d3-9081-a5663fab6cc2 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:17.240109 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c7beeda6-a324-49d3-9081-a5663fab6cc2 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: bde3700e-991b-4d67-be79-6c4da0e27275] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:17.258198 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c7beeda6-a324-49d3-9081-a5663fab6cc2 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:17.260604 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c7beeda6-a324-49d3-9081-a5663fab6cc2 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:17.261836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c7beeda6-a324-49d3-9081-a5663fab6cc2 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:17.264029 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c7beeda6-a324-49d3-9081-a5663fab6cc2 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:17.755321 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-95f32d37-0849-4970-8449-c29afed6ea37 tempest-SecurityGroupsTestAdminJSON-830295932 tempest-SecurityGroupsTestAdminJSON-830295932-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/ab7542cd-5af5-4cd1-956a-0471bc84535d" status: 202 len: 0 microversion: 2.1 time: 1.537429 Jul 19 22:36:17.760103 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1111/2240] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:36:16 2022] DELETE /compute/v2.1/os-security-groups/ab7542cd-5af5-4cd1-956a-0471bc84535d => generated 0 bytes in 1545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:36:17.783805 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c7beeda6-a324-49d3-9081-a5663fab6cc2 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:17.800175 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c7beeda6-a324-49d3-9081-a5663fab6cc2 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275" status: 200 len: 1325 microversion: 2.1 time: 0.571920 Jul 19 22:36:17.801191 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1130/2241] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:17 2022] GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275 => generated 1325 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:36:17.801557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-85d5241d-188b-4a2c-bba1-d9912a0fe770 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-765014273", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "15cd252e-57f3-43cb-ab06-2b05e441b375"}], "security_groups": [{"name": "tempest-securitygroup--44060395"}], "key_name": "tempest-keypair-1917630425", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:17.815137 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-e6d53d42-c459-408d-8910-944dad24d3fd req-e70c2c28-ab77-4b8b-88bd-90a4e98389d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde3700e-991b-4d67-be79-6c4da0e27275", "name": "network-vif-plugged", "status": "completed", "tag": "342c9c83-1d04-473c-88ea-d3b8d92a8627"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:17.833297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e6d53d42-c459-408d-8910-944dad24d3fd req-e70c2c28-ab77-4b8b-88bd-90a4e98389d4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:17.835008 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e6d53d42-c459-408d-8910-944dad24d3fd req-e70c2c28-ab77-4b8b-88bd-90a4e98389d4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:17.885751 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-e6d53d42-c459-408d-8910-944dad24d3fd req-e70c2c28-ab77-4b8b-88bd-90a4e98389d4 service nova] Creating event network-vif-plugged:342c9c83-1d04-473c-88ea-d3b8d92a8627 for instance bde3700e-991b-4d67-be79-6c4da0e27275 on n-h1-847009-3 Jul 19 22:36:17.904754 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-e6d53d42-c459-408d-8910-944dad24d3fd req-e70c2c28-ab77-4b8b-88bd-90a4e98389d4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100343 Jul 19 22:36:17.910905 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1131/2242] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:36:17.926642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d1f610ac-6c7b-4832-811f-517368743af9 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:17.929448 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d1f610ac-6c7b-4832-811f-517368743af9 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] [instance: 84f67219-22f4-491d-9f4c-afb31f356e65] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:17.939912 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d1f610ac-6c7b-4832-811f-517368743af9 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:17.942612 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d1f610ac-6c7b-4832-811f-517368743af9 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:17.944525 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d1f610ac-6c7b-4832-811f-517368743af9 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:17.964709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d1f610ac-6c7b-4832-811f-517368743af9 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:18.051907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d1f610ac-6c7b-4832-811f-517368743af9 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] [instance: 84f67219-22f4-491d-9f4c-afb31f356e65] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:36:18.147805 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:36:18.226099 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d1f610ac-6c7b-4832-811f-517368743af9 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] 10.222.0.25 "DELETE /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65" status: 204 len: 0 microversion: 2.1 time: 0.312069 Jul 19 22:36:18.227260 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1132/2243] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:36:17 2022] DELETE /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:36:18.235600 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-39b14595-cff9-47ff-9a76-63387287e080 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:18.240958 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-39b14595-cff9-47ff-9a76-63387287e080 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:18.253194 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39b14595-cff9-47ff-9a76-63387287e080 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:18.253708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39b14595-cff9-47ff-9a76-63387287e080 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:18.255087 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39b14595-cff9-47ff-9a76-63387287e080 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:18.259479 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39b14595-cff9-47ff-9a76-63387287e080 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:18.395633 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-85d5241d-188b-4a2c-bba1-d9912a0fe770 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] validate_networks() for [('15cd252e-57f3-43cb-ab06-2b05e441b375', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:36:18.893819 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-39b14595-cff9-47ff-9a76-63387287e080 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:18.916011 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-39b14595-cff9-47ff-9a76-63387287e080 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:18.924206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-39b14595-cff9-47ff-9a76-63387287e080 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:18.929146 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-39b14595-cff9-47ff-9a76-63387287e080 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 0.699477 Jul 19 22:36:18.931917 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1133/2244] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:36:18 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:36:18.944392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0d89a827-75bd-4f24-a2d6-9c57a7b04b42 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:18.945020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0d89a827-75bd-4f24-a2d6-9c57a7b04b42 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] [instance: 84f67219-22f4-491d-9f4c-afb31f356e65] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:18.961800 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d89a827-75bd-4f24-a2d6-9c57a7b04b42 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:18.962598 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d89a827-75bd-4f24-a2d6-9c57a7b04b42 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:18.963416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d89a827-75bd-4f24-a2d6-9c57a7b04b42 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:18.964011 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d89a827-75bd-4f24-a2d6-9c57a7b04b42 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:19.326461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0d89a827-75bd-4f24-a2d6-9c57a7b04b42 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df68a9a9195744b386966b5c574b7878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c566f4290e1b41dcbab2b7cbb866e023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:19.339613 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0d89a827-75bd-4f24-a2d6-9c57a7b04b42 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] 10.222.0.25 "GET /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65" status: 200 len: 1666 microversion: 2.1 time: 0.406492 Jul 19 22:36:19.340215 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1134/2245] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:18 2022] GET /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65 => generated 1666 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:19.355464 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-08a561f7-bb5c-42fe-83ff-9430bc19ac05 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:19.356407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-08a561f7-bb5c-42fe-83ff-9430bc19ac05 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: bde3700e-991b-4d67-be79-6c4da0e27275] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:19.380096 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08a561f7-bb5c-42fe-83ff-9430bc19ac05 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:19.385497 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08a561f7-bb5c-42fe-83ff-9430bc19ac05 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:19.387063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08a561f7-bb5c-42fe-83ff-9430bc19ac05 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:19.387565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08a561f7-bb5c-42fe-83ff-9430bc19ac05 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:19.724518 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-85d5241d-188b-4a2c-bba1-d9912a0fe770 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Getting quotas for project 04569d19c85640c48496efb72ef4c20f. Resources: dict_keys(['metadata_items']) {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:36:19.767799 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=95,nova_api:UPDATE=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:36:19.770348 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-85d5241d-188b-4a2c-bba1-d9912a0fe770 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Getting quotas for user 35f357f1737d4f29b2d594939a06a79f and project 04569d19c85640c48496efb72ef4c20f. Resources: dict_keys(['metadata_items']) {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:36:19.813525 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-08a561f7-bb5c-42fe-83ff-9430bc19ac05 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:19.822462 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-08a561f7-bb5c-42fe-83ff-9430bc19ac05 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275" status: 200 len: 1325 microversion: 2.1 time: 0.481105 Jul 19 22:36:19.829017 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-85d5241d-188b-4a2c-bba1-d9912a0fe770 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:36:19.833658 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1135/2246] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:19 2022] GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275 => generated 1325 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:19.834374 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-85d5241d-188b-4a2c-bba1-d9912a0fe770 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:36:19.836317 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-85d5241d-188b-4a2c-bba1-d9912a0fe770 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:36:19.836317 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-85d5241d-188b-4a2c-bba1-d9912a0fe770 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:36:19.836317 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-85d5241d-188b-4a2c-bba1-d9912a0fe770 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:36:19.843753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-2615292b-5a10-420a-920f-003bc6524204 req-bfb2ee42-587f-4263-a95f-a3dbc8238c63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e509d1e-b5d6-4f5f-a017-c2df1d2433f4", "tag": "e9261124-5553-4103-8f06-754a9b357217"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:19.856926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85d5241d-188b-4a2c-bba1-d9912a0fe770 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:19.857893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85d5241d-188b-4a2c-bba1-d9912a0fe770 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:19.859426 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85d5241d-188b-4a2c-bba1-d9912a0fe770 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:19.860180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85d5241d-188b-4a2c-bba1-d9912a0fe770 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:19.867973 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-2615292b-5a10-420a-920f-003bc6524204 req-bfb2ee42-587f-4263-a95f-a3dbc8238c63 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:19.868773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-2615292b-5a10-420a-920f-003bc6524204 req-bfb2ee42-587f-4263-a95f-a3dbc8238c63 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:19.890066 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-2615292b-5a10-420a-920f-003bc6524204 req-bfb2ee42-587f-4263-a95f-a3dbc8238c63 service nova] Creating event network-changed:e9261124-5553-4103-8f06-754a9b357217 for instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 on n-h2-847009-3 Jul 19 22:36:19.905871 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-2615292b-5a10-420a-920f-003bc6524204 req-bfb2ee42-587f-4263-a95f-a3dbc8238c63 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070235 Jul 19 22:36:19.907470 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1136/2247] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:36:19.932463 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-85d5241d-188b-4a2c-bba1-d9912a0fe770 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Getting quotas for project 04569d19c85640c48496efb72ef4c20f. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:36:19.938805 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-85d5241d-188b-4a2c-bba1-d9912a0fe770 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Getting quotas for user 35f357f1737d4f29b2d594939a06a79f and project 04569d19c85640c48496efb72ef4c20f. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:36:19.948621 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7ed80fe8-0a7b-4ea9-9ae0-2b2aaf053c87 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:19.949439 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7ed80fe8-0a7b-4ea9-9ae0-2b2aaf053c87 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:19.964257 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7ed80fe8-0a7b-4ea9-9ae0-2b2aaf053c87 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:19.968911 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7ed80fe8-0a7b-4ea9-9ae0-2b2aaf053c87 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:19.970302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7ed80fe8-0a7b-4ea9-9ae0-2b2aaf053c87 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:19.972557 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7ed80fe8-0a7b-4ea9-9ae0-2b2aaf053c87 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:19.994148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-85d5241d-188b-4a2c-bba1-d9912a0fe770 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:36:20.005480 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-85d5241d-188b-4a2c-bba1-d9912a0fe770 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] [instance: d6189bec-a398-4e64-8e79-0b766af2f833] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:36:20.122732 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-85d5241d-188b-4a2c-bba1-d9912a0fe770 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.360831 Jul 19 22:36:20.124395 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1112/2248] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:36:17 2022] POST /compute/v2.1/servers => generated 407 bytes in 2363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:36:20.137244 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6f078235-fd05-4205-8bb9-b849f3b83eb2 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:20.140919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6f078235-fd05-4205-8bb9-b849f3b83eb2 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] [instance: d6189bec-a398-4e64-8e79-0b766af2f833] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:20.852666 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6f078235-fd05-4205-8bb9-b849f3b83eb2 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f357f1737d4f29b2d594939a06a79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04569d19c85640c48496efb72ef4c20f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:20.868331 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6f078235-fd05-4205-8bb9-b849f3b83eb2 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] 10.222.0.25 "GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833" status: 200 len: 1277 microversion: 2.1 time: 0.735667 Jul 19 22:36:20.871286 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1113/2249] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:20 2022] GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833 => generated 1277 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:20.885962 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ba5bde52-f097-426c-b6d1-bb505e5a562b tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:20.887898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ba5bde52-f097-426c-b6d1-bb505e5a562b tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] [instance: 84f67219-22f4-491d-9f4c-afb31f356e65] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:20.908852 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba5bde52-f097-426c-b6d1-bb505e5a562b tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:20.911333 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba5bde52-f097-426c-b6d1-bb505e5a562b tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:20.912895 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba5bde52-f097-426c-b6d1-bb505e5a562b tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:20.915311 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba5bde52-f097-426c-b6d1-bb505e5a562b tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:20.930392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7ed80fe8-0a7b-4ea9-9ae0-2b2aaf053c87 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:20.944387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7ed80fe8-0a7b-4ea9-9ae0-2b2aaf053c87 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:20.952955 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7ed80fe8-0a7b-4ea9-9ae0-2b2aaf053c87 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:20.954219 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7ed80fe8-0a7b-4ea9-9ae0-2b2aaf053c87 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 1.009958 Jul 19 22:36:20.955334 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1137/2250] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:36:19 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:36:20.977710 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-68cf16f5-88bb-4e7b-a516-3d006f78090b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:20.981089 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-68cf16f5-88bb-4e7b-a516-3d006f78090b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: bde3700e-991b-4d67-be79-6c4da0e27275] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:20.992364 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-68cf16f5-88bb-4e7b-a516-3d006f78090b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:20.993875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-68cf16f5-88bb-4e7b-a516-3d006f78090b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:20.995666 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-68cf16f5-88bb-4e7b-a516-3d006f78090b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:20.996455 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-68cf16f5-88bb-4e7b-a516-3d006f78090b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:21.567251 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ba5bde52-f097-426c-b6d1-bb505e5a562b tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df68a9a9195744b386966b5c574b7878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c566f4290e1b41dcbab2b7cbb866e023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:21.591810 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ba5bde52-f097-426c-b6d1-bb505e5a562b tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] 10.222.0.25 "GET /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65" status: 200 len: 1666 microversion: 2.1 time: 0.717956 Jul 19 22:36:21.592396 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1114/2251] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:20 2022] GET /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65 => generated 1666 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:21.889808 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3eff7978-9f52-4825-b9aa-0bf13225edf1 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:21.891186 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3eff7978-9f52-4825-b9aa-0bf13225edf1 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] [instance: d6189bec-a398-4e64-8e79-0b766af2f833] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:21.906901 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3eff7978-9f52-4825-b9aa-0bf13225edf1 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:21.907851 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3eff7978-9f52-4825-b9aa-0bf13225edf1 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:21.909373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3eff7978-9f52-4825-b9aa-0bf13225edf1 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:21.910456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3eff7978-9f52-4825-b9aa-0bf13225edf1 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:22.493005 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-68cf16f5-88bb-4e7b-a516-3d006f78090b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:22.523781 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-68cf16f5-88bb-4e7b-a516-3d006f78090b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275" status: 200 len: 1522 microversion: 2.1 time: 1.554346 Jul 19 22:36:22.542394 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1138/2252] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:20 2022] GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275 => generated 1522 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:22.563739 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3c8ef311-d488-4710-a7e2-b4a7ce199fc9 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:22.573227 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3c8ef311-d488-4710-a7e2-b4a7ce199fc9 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:22.586754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c8ef311-d488-4710-a7e2-b4a7ce199fc9 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:22.587240 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c8ef311-d488-4710-a7e2-b4a7ce199fc9 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:22.594200 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c8ef311-d488-4710-a7e2-b4a7ce199fc9 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:22.594904 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c8ef311-d488-4710-a7e2-b4a7ce199fc9 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:22.741359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3eff7978-9f52-4825-b9aa-0bf13225edf1 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f357f1737d4f29b2d594939a06a79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04569d19c85640c48496efb72ef4c20f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:22.752525 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3eff7978-9f52-4825-b9aa-0bf13225edf1 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] 10.222.0.25 "GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833" status: 200 len: 1329 microversion: 2.1 time: 0.868100 Jul 19 22:36:22.753131 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1115/2253] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:21 2022] GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833 => generated 1329 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:22.766997 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-f3f8cdac-babb-4295-952f-407433b65964 req-a7a92a03-181d-4bd9-954d-3ec162a7e4b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e509d1e-b5d6-4f5f-a017-c2df1d2433f4", "tag": "2c7186d7-bc64-4766-af9a-aacc09242cdb"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:22.784466 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f3f8cdac-babb-4295-952f-407433b65964 req-a7a92a03-181d-4bd9-954d-3ec162a7e4b7 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:22.788624 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f3f8cdac-babb-4295-952f-407433b65964 req-a7a92a03-181d-4bd9-954d-3ec162a7e4b7 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:22.814276 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-f3f8cdac-babb-4295-952f-407433b65964 req-a7a92a03-181d-4bd9-954d-3ec162a7e4b7 service nova] Creating event network-changed:2c7186d7-bc64-4766-af9a-aacc09242cdb for instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 on n-h2-847009-3 Jul 19 22:36:22.830449 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-f3f8cdac-babb-4295-952f-407433b65964 req-a7a92a03-181d-4bd9-954d-3ec162a7e4b7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068751 Jul 19 22:36:22.831237 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1116/2254] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:36:22.840650 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f806b686-c111-46c0-9790-6c4c4035b15b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:22.844925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f806b686-c111-46c0-9790-6c4c4035b15b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: bde3700e-991b-4d67-be79-6c4da0e27275] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:22.860603 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f806b686-c111-46c0-9790-6c4c4035b15b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:22.861683 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f806b686-c111-46c0-9790-6c4c4035b15b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:22.862535 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f806b686-c111-46c0-9790-6c4c4035b15b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:22.863828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f806b686-c111-46c0-9790-6c4c4035b15b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:22.946487 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f806b686-c111-46c0-9790-6c4c4035b15b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: bde3700e-991b-4d67-be79-6c4da0e27275] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:36:23.130141 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f806b686-c111-46c0-9790-6c4c4035b15b tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275" status: 204 len: 0 microversion: 2.1 time: 0.294265 Jul 19 22:36:23.135641 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1117/2255] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:36:22 2022] DELETE /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:36:23.146243 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2e9b7e30-51b5-45f4-a117-005d3461228e tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:23.147310 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2e9b7e30-51b5-45f4-a117-005d3461228e tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] [instance: 84f67219-22f4-491d-9f4c-afb31f356e65] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:23.157400 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2e9b7e30-51b5-45f4-a117-005d3461228e tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:23.158755 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2e9b7e30-51b5-45f4-a117-005d3461228e tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:23.159815 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2e9b7e30-51b5-45f4-a117-005d3461228e tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:23.160414 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2e9b7e30-51b5-45f4-a117-005d3461228e tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:23.473200 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3c8ef311-d488-4710-a7e2-b4a7ce199fc9 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:23.497160 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3c8ef311-d488-4710-a7e2-b4a7ce199fc9 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:23.502440 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2e9b7e30-51b5-45f4-a117-005d3461228e tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df68a9a9195744b386966b5c574b7878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c566f4290e1b41dcbab2b7cbb866e023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:23.503502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3c8ef311-d488-4710-a7e2-b4a7ce199fc9 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:23.505996 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3c8ef311-d488-4710-a7e2-b4a7ce199fc9 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 0.961769 Jul 19 22:36:23.511253 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1139/2256] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:36:22 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:36:23.512911 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2e9b7e30-51b5-45f4-a117-005d3461228e tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] 10.222.0.25 "GET /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65" status: 200 len: 1599 microversion: 2.1 time: 0.374673 Jul 19 22:36:23.526128 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1118/2257] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:23 2022] GET /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65 => generated 1599 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:23.526215 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-908223f4-0110-42f8-b337-ce425115d629 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:23.526215 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-908223f4-0110-42f8-b337-ce425115d629 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: bde3700e-991b-4d67-be79-6c4da0e27275] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:23.530614 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=16 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:36:23.547620 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-908223f4-0110-42f8-b337-ce425115d629 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:23.549173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-908223f4-0110-42f8-b337-ce425115d629 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:23.552783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-908223f4-0110-42f8-b337-ce425115d629 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:23.554656 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-908223f4-0110-42f8-b337-ce425115d629 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:23.587808 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4ab1821f-5c02-4dbe-acc0-5d5dc1f112d6 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a10461280>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:23.691231 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4ab1821f-5c02-4dbe-acc0-5d5dc1f112d6 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/3745c07b-c5d0-4785-9aaf-e35b51b6132d" status: 200 len: 660 microversion: 2.1 time: 0.107671 Jul 19 22:36:23.691849 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1119/2258] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:36:23 2022] GET /compute/v2.1/images/3745c07b-c5d0-4785-9aaf-e35b51b6132d => generated 660 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:36:23.708527 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-252f9f3b-ae04-48cd-bcaf-dffd8e9671ba tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a1098a940>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:23.810412 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-252f9f3b-ae04-48cd-bcaf-dffd8e9671ba tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/3745c07b-c5d0-4785-9aaf-e35b51b6132d" status: 200 len: 660 microversion: 2.1 time: 0.109033 Jul 19 22:36:23.811927 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1120/2259] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:36:23 2022] GET /compute/v2.1/images/3745c07b-c5d0-4785-9aaf-e35b51b6132d => generated 660 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:36:23.837749 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4cf6a629-9da3-4c72-8b86-af55153297bc tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:23.847050 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4cf6a629-9da3-4c72-8b86-af55153297bc tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] [instance: d6189bec-a398-4e64-8e79-0b766af2f833] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:23.880350 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4cf6a629-9da3-4c72-8b86-af55153297bc tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:23.880818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4cf6a629-9da3-4c72-8b86-af55153297bc tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:23.881723 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4cf6a629-9da3-4c72-8b86-af55153297bc tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:23.882306 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4cf6a629-9da3-4c72-8b86-af55153297bc tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:24.038666 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-908223f4-0110-42f8-b337-ce425115d629 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:24.068646 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-908223f4-0110-42f8-b337-ce425115d629 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275" status: 200 len: 1528 microversion: 2.1 time: 0.545766 Jul 19 22:36:24.068646 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1140/2260] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:23 2022] GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275 => generated 1528 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:24.081458 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4cf6a629-9da3-4c72-8b86-af55153297bc tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f357f1737d4f29b2d594939a06a79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04569d19c85640c48496efb72ef4c20f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:24.110637 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4cf6a629-9da3-4c72-8b86-af55153297bc tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] 10.222.0.25 "GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833" status: 200 len: 1335 microversion: 2.1 time: 0.286623 Jul 19 22:36:24.113461 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1121/2261] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:23 2022] GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833 => generated 1335 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:24.529054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5b8fcdd8-3c52-421f-9628-b979ce2cbb78 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:24.529691 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5b8fcdd8-3c52-421f-9628-b979ce2cbb78 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:24.530329 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-81d1afba-7d35-465b-88d7-ad697ffdf25c tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:24.530969 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-81d1afba-7d35-465b-88d7-ad697ffdf25c tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] [instance: 84f67219-22f4-491d-9f4c-afb31f356e65] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:24.542912 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b8fcdd8-3c52-421f-9628-b979ce2cbb78 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:24.550765 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b8fcdd8-3c52-421f-9628-b979ce2cbb78 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:24.553164 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81d1afba-7d35-465b-88d7-ad697ffdf25c tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:24.553637 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81d1afba-7d35-465b-88d7-ad697ffdf25c tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:24.554636 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81d1afba-7d35-465b-88d7-ad697ffdf25c tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:24.555265 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81d1afba-7d35-465b-88d7-ad697ffdf25c tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:24.569411 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b8fcdd8-3c52-421f-9628-b979ce2cbb78 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:24.570978 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b8fcdd8-3c52-421f-9628-b979ce2cbb78 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:24.650550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81d1afba-7d35-465b-88d7-ad697ffdf25c tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:24.658579 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81d1afba-7d35-465b-88d7-ad697ffdf25c tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:24.659356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-81d1afba-7d35-465b-88d7-ad697ffdf25c tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lazy-loading 'fault' on Instance uuid 84f67219-22f4-491d-9f4c-afb31f356e65 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:36:25.097592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-81d1afba-7d35-465b-88d7-ad697ffdf25c tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df68a9a9195744b386966b5c574b7878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c566f4290e1b41dcbab2b7cbb866e023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:25.108358 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-81d1afba-7d35-465b-88d7-ad697ffdf25c tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] 10.222.0.25 "GET /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65" status: 200 len: 1315 microversion: 2.1 time: 0.582540 Jul 19 22:36:25.123554 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1122/2262] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:24 2022] GET /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65 => generated 1315 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:25.643298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-225ac155-4363-4d7d-9a01-929a147c763d tempest-QuotaClassesAdmin257Test-204571207 tempest-QuotaClassesAdmin257Test-204571207-project-admin] Calling method '.version_select at 0x7f7a1089e0d0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:25.644408 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:36:25.644408 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:36:25.669870 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-225ac155-4363-4d7d-9a01-929a147c763d tempest-QuotaClassesAdmin257Test-204571207 tempest-QuotaClassesAdmin257Test-204571207-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.543143 Jul 19 22:36:25.670664 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1123/2263] 10.222.0.25 () {60 vars in 1225 bytes} [Tue Jul 19 22:36:25 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:36:25.687148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-2b5d9a95-26f7-4715-b4ef-cfd71bb1a371 req-9bf0e9a2-9441-4f8c-9e8c-68759f3c7484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84f67219-22f4-491d-9f4c-afb31f356e65", "name": "network-vif-deleted", "tag": "b51a40ab-5c58-4b37-9085-4a6d031b5972"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:25.710360 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-2b5d9a95-26f7-4715-b4ef-cfd71bb1a371 req-9bf0e9a2-9441-4f8c-9e8c-68759f3c7484 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:25.712456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-2b5d9a95-26f7-4715-b4ef-cfd71bb1a371 req-9bf0e9a2-9441-4f8c-9e8c-68759f3c7484 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:25.750582 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-2b5d9a95-26f7-4715-b4ef-cfd71bb1a371 req-9bf0e9a2-9441-4f8c-9e8c-68759f3c7484 service nova] Creating event network-vif-deleted:b51a40ab-5c58-4b37-9085-4a6d031b5972 for instance 84f67219-22f4-491d-9f4c-afb31f356e65 on n-h1-847009-3 Jul 19 22:36:25.769215 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-2b5d9a95-26f7-4715-b4ef-cfd71bb1a371 req-9bf0e9a2-9441-4f8c-9e8c-68759f3c7484 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091127 Jul 19 22:36:25.771794 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1124/2264] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:36:25.833599 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5b8fcdd8-3c52-421f-9628-b979ce2cbb78 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:25.853315 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5b8fcdd8-3c52-421f-9628-b979ce2cbb78 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:25.863952 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5b8fcdd8-3c52-421f-9628-b979ce2cbb78 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:25.869858 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5b8fcdd8-3c52-421f-9628-b979ce2cbb78 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 1.345457 Jul 19 22:36:25.884741 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1141/2265] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:36:24 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:36:25.896203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-801376b2-3766-4f97-96db-ce133d8e3360 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:25.902165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-801376b2-3766-4f97-96db-ce133d8e3360 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: bde3700e-991b-4d67-be79-6c4da0e27275] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:25.916746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-801376b2-3766-4f97-96db-ce133d8e3360 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:25.932538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-801376b2-3766-4f97-96db-ce133d8e3360 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:25.934190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-801376b2-3766-4f97-96db-ce133d8e3360 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:25.934780 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-801376b2-3766-4f97-96db-ce133d8e3360 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:26.057920 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d8847e3c-aeba-4ad8-974c-36952b76fa26 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1209479821", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:26.135255 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-d8847e3c-aeba-4ad8-974c-36952b76fa26 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] validate_networks() for None {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:36:26.850770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-801376b2-3766-4f97-96db-ce133d8e3360 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:26.868642 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-801376b2-3766-4f97-96db-ce133d8e3360 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275" status: 200 len: 1528 microversion: 2.1 time: 0.980691 Jul 19 22:36:26.869260 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1142/2266] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:25 2022] GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275 => generated 1528 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:26.875627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ff94b00f-577a-4a1f-8d52-688eb00daa90 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:26.876585 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ff94b00f-577a-4a1f-8d52-688eb00daa90 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] [instance: d6189bec-a398-4e64-8e79-0b766af2f833] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:26.888102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ff94b00f-577a-4a1f-8d52-688eb00daa90 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:26.888559 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ff94b00f-577a-4a1f-8d52-688eb00daa90 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:26.889342 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ff94b00f-577a-4a1f-8d52-688eb00daa90 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:26.889784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ff94b00f-577a-4a1f-8d52-688eb00daa90 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:27.428257 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-d8847e3c-aeba-4ad8-974c-36952b76fa26 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:36:27.428938 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-d8847e3c-aeba-4ad8-974c-36952b76fa26 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:36:27.430018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-d8847e3c-aeba-4ad8-974c-36952b76fa26 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:36:27.430637 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-d8847e3c-aeba-4ad8-974c-36952b76fa26 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:36:27.431456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-d8847e3c-aeba-4ad8-974c-36952b76fa26 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:36:27.447084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d8847e3c-aeba-4ad8-974c-36952b76fa26 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:27.448761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d8847e3c-aeba-4ad8-974c-36952b76fa26 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:27.450192 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d8847e3c-aeba-4ad8-974c-36952b76fa26 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:27.450951 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d8847e3c-aeba-4ad8-974c-36952b76fa26 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:27.477673 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-d8847e3c-aeba-4ad8-974c-36952b76fa26 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Getting quotas for project 6a0799fad79e47d0b0180c0f8834341e. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:36:27.487857 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-d8847e3c-aeba-4ad8-974c-36952b76fa26 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Getting quotas for user 5f958eb846b04f0fbbe7b95da7d5c328 and project 6a0799fad79e47d0b0180c0f8834341e. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:36:27.506245 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d8847e3c-aeba-4ad8-974c-36952b76fa26 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:36:27.509713 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d8847e3c-aeba-4ad8-974c-36952b76fa26 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 0ee48b19-107c-4883-8d87-5868a5201d08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:36:27.533272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ff94b00f-577a-4a1f-8d52-688eb00daa90 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f357f1737d4f29b2d594939a06a79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04569d19c85640c48496efb72ef4c20f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:27.550025 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ff94b00f-577a-4a1f-8d52-688eb00daa90 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] 10.222.0.25 "GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833" status: 200 len: 1401 microversion: 2.1 time: 0.679350 Jul 19 22:36:27.562377 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1143/2267] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:26 2022] GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833 => generated 1401 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:27.567781 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-21df2a9b-f9e1-4d37-b117-61b0e2458f2b tempest-QuotaClassesAdmin257Test-204571207 tempest-QuotaClassesAdmin257Test-204571207-project-admin] Action: 'update', calling method: .version_select at 0x7f7a10458430>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:27.569817 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:36:27.569817 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:36:27.608970 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d8847e3c-aeba-4ad8-974c-36952b76fa26 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.835538 Jul 19 22:36:27.620635 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1125/2268] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:36:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:36:27.636866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4b829fbf-61d8-4236-aa07-8666f88e1ac7 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a03a0b550>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:27.717299 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4b829fbf-61d8-4236-aa07-8666f88e1ac7 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/fdde4761-e615-430b-a69a-0a19db33957f" status: 200 len: 661 microversion: 2.1 time: 0.093050 Jul 19 22:36:27.718309 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1126/2269] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:36:27 2022] GET /compute/v2.1/images/fdde4761-e615-430b-a69a-0a19db33957f => generated 661 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:36:27.725218 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-da969279-ffd6-4204-af44-9ad2e0613c2f tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:27.725861 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-da969279-ffd6-4204-af44-9ad2e0613c2f tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] [instance: 84f67219-22f4-491d-9f4c-afb31f356e65] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:27.733817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da969279-ffd6-4204-af44-9ad2e0613c2f tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:27.738424 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da969279-ffd6-4204-af44-9ad2e0613c2f tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:27.739645 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da969279-ffd6-4204-af44-9ad2e0613c2f tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:27.740276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da969279-ffd6-4204-af44-9ad2e0613c2f tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:27.759749 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-da969279-ffd6-4204-af44-9ad2e0613c2f tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] HTTP exception thrown: Instance 84f67219-22f4-491d-9f4c-afb31f356e65 could not be found. Jul 19 22:36:27.762023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-da969279-ffd6-4204-af44-9ad2e0613c2f tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Request method failure captured: Jul 19 22:36:27.762023 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65 HTTP/1.1 Jul 19 22:36:27.762023 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:36:27.762023 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:36:27.762023 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:36:27.762023 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:36:27.762023 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:36:27.762023 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:36:27.762023 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:36:27.762023 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:36:27.762023 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zGcmpaJDiURHaHsvjALVZ2uwazGnenjhjJWmeDVbId16eXdVX5kNtDIGiE8jOX0Ce5nJb3EYLPag-Qe-HhvBvWDLNB6V-S53CTl7pYXfnsxB2zjIjY_f8CGKntjIWhv_5He41EzUGqe-SJcCVcs34jJ7UvOZqE4-MI5qX5OXXUxoTk Jul 19 22:36:27.762023 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:36:27.762023 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:36:27.762023 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:36:27.762023 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:36:27.762023 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:36:27.762023 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:36:27.762023 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: c566f4290e1b41dcbab2b7cbb866e023 Jul 19 22:36:27.762023 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersTestFqdnHostnames-1418262540 Jul 19 22:36:27.762023 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:36:27.762023 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:36:27.763540 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c566f4290e1b41dcbab2b7cbb866e023"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c566f4290e1b41dcbab2b7cbb866e023"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c566f4290e1b41dcbab2b7cbb866e023"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c566f4290e1b41dcbab2b7cbb866e023"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:36:27.763540 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersTestFqdnHostnames-1418262540 Jul 19 22:36:27.763540 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: c566f4290e1b41dcbab2b7cbb866e023 Jul 19 22:36:27.763540 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1418262540 Jul 19 22:36:27.763540 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersTestFqdnHostnames-1418262540-project Jul 19 22:36:27.763540 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:36:27.763540 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:36:27.763540 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: df68a9a9195744b386966b5c574b7878 Jul 19 22:36:27.763540 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersTestFqdnHostnames-1418262540-project Jul 19 22:36:27.763540 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:36:27.763540 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 84f67219-22f4-491d-9f4c-afb31f356e65 could not be found. Jul 19 22:36:27.763540 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '84f67219-22f4-491d-9f4c-afb31f356e65'} Jul 19 22:36:27.764326 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:36:27.764326 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:27.764326 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:36:27.764326 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:36:27.764326 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:36:27.764326 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:36:27.764326 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:36:27.764326 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:36:27.764326 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:36:27.764326 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:36:27.764326 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84f67219-22f4-491d-9f4c-afb31f356e65 could not be found. Jul 19 22:36:27.764326 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:27.764326 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:36:27.764326 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:27.764326 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:27.764326 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:36:27.764326 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:36:27.764326 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:36:27.764326 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:36:27.764326 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:36:27.765684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:36:27.765684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:36:27.765684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:36:27.765684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:36:27.765684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:36:27.765684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:36:27.765684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:36:27.765684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84f67219-22f4-491d-9f4c-afb31f356e65 could not be found. Jul 19 22:36:27.765684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:27.765684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:36:27.765684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:27.765684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:27.765684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:36:27.765684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:36:27.765684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:36:27.765684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:36:27.765684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84f67219-22f4-491d-9f4c-afb31f356e65 could not be found. Jul 19 22:36:27.765684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:27.768723 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-da969279-ffd6-4204-af44-9ad2e0613c2f tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Returning 404 to user: Instance 84f67219-22f4-491d-9f4c-afb31f356e65 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:36:27.769789 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-da969279-ffd6-4204-af44-9ad2e0613c2f tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] 10.222.0.25 "GET /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65" status: 404 len: 111 microversion: 2.1 time: 0.050174 Jul 19 22:36:27.770520 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1127/2270] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:27 2022] GET /compute/v2.1/servers/84f67219-22f4-491d-9f4c-afb31f356e65 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:36:27.776062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=2,nova_api:UPDATE=8 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:36:27.781360 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-89172ded-c76b-43b4-8e01-7512bdcfdffb req-7f7d5413-ec07-479b-ac21-79db0ae1b382 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6189bec-a398-4e64-8e79-0b766af2f833", "tag": "ab5c88e8-cfda-4225-9739-f4f3e8403327"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:27.799818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-89172ded-c76b-43b4-8e01-7512bdcfdffb req-7f7d5413-ec07-479b-ac21-79db0ae1b382 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:27.800847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-89172ded-c76b-43b4-8e01-7512bdcfdffb req-7f7d5413-ec07-479b-ac21-79db0ae1b382 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:27.824254 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-89172ded-c76b-43b4-8e01-7512bdcfdffb req-7f7d5413-ec07-479b-ac21-79db0ae1b382 service nova] Creating event network-changed:ab5c88e8-cfda-4225-9739-f4f3e8403327 for instance d6189bec-a398-4e64-8e79-0b766af2f833 on n-h2-847009-3 Jul 19 22:36:27.835540 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-89172ded-c76b-43b4-8e01-7512bdcfdffb req-7f7d5413-ec07-479b-ac21-79db0ae1b382 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059203 Jul 19 22:36:27.835758 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-21df2a9b-f9e1-4d37-b117-61b0e2458f2b tempest-QuotaClassesAdmin257Test-204571207 tempest-QuotaClassesAdmin257Test-204571207-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.280547 Jul 19 22:36:27.837270 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1128/2271] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:36:27.845747 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1144/2272] 10.222.0.25 () {62 vars in 1246 bytes} [Tue Jul 19 22:36:27 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:36:27.850304 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2f48ba9f-84cb-4837-8fb8-a4396ff57279 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:27.851661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2f48ba9f-84cb-4837-8fb8-a4396ff57279 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:27.863398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f48ba9f-84cb-4837-8fb8-a4396ff57279 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:27.864331 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f48ba9f-84cb-4837-8fb8-a4396ff57279 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:27.865753 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f48ba9f-84cb-4837-8fb8-a4396ff57279 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:27.866626 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f48ba9f-84cb-4837-8fb8-a4396ff57279 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:27.878123 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e5b1511e-41af-44ab-a0cb-e041a9e7fdfb tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:27.878777 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e5b1511e-41af-44ab-a0cb-e041a9e7fdfb tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 0ee48b19-107c-4883-8d87-5868a5201d08] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:28.046700 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e5b1511e-41af-44ab-a0cb-e041a9e7fdfb tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:28.064571 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e5b1511e-41af-44ab-a0cb-e041a9e7fdfb tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08" status: 200 len: 1222 microversion: 2.1 time: 0.216597 Jul 19 22:36:28.068266 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1145/2273] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:27 2022] GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08 => generated 1222 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:28.074341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-517dea77-028d-42f7-bd15-dd0ee48650b2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a107c7820>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:28.136377 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-517dea77-028d-42f7-bd15-dd0ee48650b2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/fdde4761-e615-430b-a69a-0a19db33957f" status: 200 len: 661 microversion: 2.1 time: 0.065908 Jul 19 22:36:28.138137 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1146/2274] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:36:28 2022] GET /compute/v2.1/images/fdde4761-e615-430b-a69a-0a19db33957f => generated 661 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:36:28.176020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4cb4662b-bf4e-4e88-a63f-506dc477af51 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] Calling method '.version_select at 0x7f7a10fa2310>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:28.193112 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2f48ba9f-84cb-4837-8fb8-a4396ff57279 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:28.205695 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2f48ba9f-84cb-4837-8fb8-a4396ff57279 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:28.207952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2f48ba9f-84cb-4837-8fb8-a4396ff57279 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:28.209423 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2f48ba9f-84cb-4837-8fb8-a4396ff57279 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 0.370285 Jul 19 22:36:28.216355 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4cb4662b-bf4e-4e88-a63f-506dc477af51 tempest-ServersTestFqdnHostnames-1418262540 tempest-ServersTestFqdnHostnames-1418262540-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-680148385" status: 202 len: 0 microversion: 2.1 time: 0.077058 Jul 19 22:36:28.222319 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1147/2275] 10.222.0.25 () {58 vars in 1217 bytes} [Tue Jul 19 22:36:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-680148385 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:36:28.244102 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1129/2276] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:36:27 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:36:28.247574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-30bddbfc-7392-4247-9d04-498727e7e33e req-e4ee06f5-a397-4276-a706-b52879aeec38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e509d1e-b5d6-4f5f-a017-c2df1d2433f4", "tag": "12f72f3f-a741-4a92-92f8-08f8ec7273ff"}, {"server_uuid": "bde3700e-991b-4d67-be79-6c4da0e27275", "name": "network-vif-deleted", "tag": "342c9c83-1d04-473c-88ea-d3b8d92a8627"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:28.261551 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-30bddbfc-7392-4247-9d04-498727e7e33e req-e4ee06f5-a397-4276-a706-b52879aeec38 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:28.262244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-30bddbfc-7392-4247-9d04-498727e7e33e req-e4ee06f5-a397-4276-a706-b52879aeec38 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:28.262762 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7eddb3a0-c0af-4957-9601-c187f47d1ff0 tempest-QuotaClassesAdmin257Test-204571207 tempest-QuotaClassesAdmin257Test-204571207-project-admin] Calling method '.version_select at 0x7f7a104aedc0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:28.264219 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:36:28.264219 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:36:28.276117 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=47 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:36:28.281759 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7eddb3a0-c0af-4957-9601-c187f47d1ff0 tempest-QuotaClassesAdmin257Test-204571207 tempest-QuotaClassesAdmin257Test-204571207-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.033774 Jul 19 22:36:28.283059 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1130/2277] 10.222.0.25 () {60 vars in 1225 bytes} [Tue Jul 19 22:36:28 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:36:28.289366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0af9e7e9-eb05-482a-b3de-d9b1719216a3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:28.290301 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0af9e7e9-eb05-482a-b3de-d9b1719216a3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: bde3700e-991b-4d67-be79-6c4da0e27275] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:28.292532 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-30bddbfc-7392-4247-9d04-498727e7e33e req-e4ee06f5-a397-4276-a706-b52879aeec38 service nova] Creating event network-changed:12f72f3f-a741-4a92-92f8-08f8ec7273ff for instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 on n-h2-847009-3 Jul 19 22:36:28.294806 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-30bddbfc-7392-4247-9d04-498727e7e33e req-e4ee06f5-a397-4276-a706-b52879aeec38 service nova] Creating event network-vif-deleted:342c9c83-1d04-473c-88ea-d3b8d92a8627 for instance bde3700e-991b-4d67-be79-6c4da0e27275 on n-h1-847009-3 Jul 19 22:36:28.297445 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0af9e7e9-eb05-482a-b3de-d9b1719216a3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:28.298712 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0af9e7e9-eb05-482a-b3de-d9b1719216a3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:28.299788 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0af9e7e9-eb05-482a-b3de-d9b1719216a3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:28.300452 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0af9e7e9-eb05-482a-b3de-d9b1719216a3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:28.325502 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-30bddbfc-7392-4247-9d04-498727e7e33e req-e4ee06f5-a397-4276-a706-b52879aeec38 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.098668 Jul 19 22:36:28.326239 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1148/2278] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:36:28.340614 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0f99022b-9f29-4521-9366-15c593fbd0ae tempest-QuotaClassesAdmin257Test-204571207 tempest-QuotaClassesAdmin257Test-204571207-project-admin] Action: 'update', calling method: .version_select at 0x7f7a106cfca0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:28.342256 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:36:28.342256 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:36:28.367660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0af9e7e9-eb05-482a-b3de-d9b1719216a3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:28.368272 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0af9e7e9-eb05-482a-b3de-d9b1719216a3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:28.368858 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-0af9e7e9-eb05-482a-b3de-d9b1719216a3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lazy-loading 'fault' on Instance uuid bde3700e-991b-4d67-be79-6c4da0e27275 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:36:28.462553 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0f99022b-9f29-4521-9366-15c593fbd0ae tempest-QuotaClassesAdmin257Test-204571207 tempest-QuotaClassesAdmin257Test-204571207-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.132504 Jul 19 22:36:28.463893 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1149/2279] 10.222.0.25 () {62 vars in 1246 bytes} [Tue Jul 19 22:36:28 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:36:28.466531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0af9e7e9-eb05-482a-b3de-d9b1719216a3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca13a073e7447591944e6604d67e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eca98474bca4a64af425dffb9ecb5b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:28.476139 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0af9e7e9-eb05-482a-b3de-d9b1719216a3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275" status: 200 len: 1315 microversion: 2.1 time: 0.191782 Jul 19 22:36:28.487554 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1131/2280] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:28 2022] GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:28.574056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d37d3744-9216-4669-8b9d-ea07673e7828 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:28.575440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d37d3744-9216-4669-8b9d-ea07673e7828 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] [instance: d6189bec-a398-4e64-8e79-0b766af2f833] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:28.592272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d37d3744-9216-4669-8b9d-ea07673e7828 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:28.593258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d37d3744-9216-4669-8b9d-ea07673e7828 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:28.597254 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d37d3744-9216-4669-8b9d-ea07673e7828 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:28.598093 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d37d3744-9216-4669-8b9d-ea07673e7828 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:29.084672 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-53cf4da3-fee6-4fd3-9a76-7a0baf674907 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:29.085714 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-53cf4da3-fee6-4fd3-9a76-7a0baf674907 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 0ee48b19-107c-4883-8d87-5868a5201d08] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:29.099272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d37d3744-9216-4669-8b9d-ea07673e7828 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f357f1737d4f29b2d594939a06a79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04569d19c85640c48496efb72ef4c20f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:29.107818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53cf4da3-fee6-4fd3-9a76-7a0baf674907 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:29.116184 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53cf4da3-fee6-4fd3-9a76-7a0baf674907 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:29.118590 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53cf4da3-fee6-4fd3-9a76-7a0baf674907 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:29.120168 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53cf4da3-fee6-4fd3-9a76-7a0baf674907 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:29.126081 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d37d3744-9216-4669-8b9d-ea07673e7828 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] 10.222.0.25 "GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833" status: 200 len: 1401 microversion: 2.1 time: 0.558821 Jul 19 22:36:29.129298 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1150/2281] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:28 2022] GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833 => generated 1401 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:29.229398 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0bb8b495-5c0d-4f80-b292-ef7564b96e8b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:29.230695 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0bb8b495-5c0d-4f80-b292-ef7564b96e8b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:29.243594 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0bb8b495-5c0d-4f80-b292-ef7564b96e8b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:29.244246 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0bb8b495-5c0d-4f80-b292-ef7564b96e8b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:29.247416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0bb8b495-5c0d-4f80-b292-ef7564b96e8b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:29.249260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0bb8b495-5c0d-4f80-b292-ef7564b96e8b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:29.304414 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-53cf4da3-fee6-4fd3-9a76-7a0baf674907 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:29.322178 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-53cf4da3-fee6-4fd3-9a76-7a0baf674907 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08" status: 200 len: 1274 microversion: 2.1 time: 0.242232 Jul 19 22:36:29.323282 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1132/2282] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:29 2022] GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08 => generated 1274 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:29.493745 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b9c53b2c-9488-4bb5-9d66-972d09bf98bd tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:29.494373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b9c53b2c-9488-4bb5-9d66-972d09bf98bd tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: bde3700e-991b-4d67-be79-6c4da0e27275] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:29.501973 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b9c53b2c-9488-4bb5-9d66-972d09bf98bd tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:29.505056 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b9c53b2c-9488-4bb5-9d66-972d09bf98bd tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:29.506332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b9c53b2c-9488-4bb5-9d66-972d09bf98bd tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:29.507443 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b9c53b2c-9488-4bb5-9d66-972d09bf98bd tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:29.531744 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-b9c53b2c-9488-4bb5-9d66-972d09bf98bd tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] HTTP exception thrown: Instance bde3700e-991b-4d67-be79-6c4da0e27275 could not be found. Jul 19 22:36:29.534365 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b9c53b2c-9488-4bb5-9d66-972d09bf98bd tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Request method failure captured: Jul 19 22:36:29.534365 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275 HTTP/1.1 Jul 19 22:36:29.534365 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:36:29.534365 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:36:29.534365 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:36:29.534365 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:36:29.534365 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:36:29.534365 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:36:29.534365 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:36:29.534365 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:36:29.534365 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zFSA7GyoHNV6r8lt0QaILXtfyjU87DAOplAZjQU_9SUIJAdMw3TfBxiMnSQsWy218lpl-le3iOg2K6ZI4fs9ORwE8JiU3d4qrQtSVE6mLVRBodkQTjds8wHcIk6jUHzr1JjH374IFd8C1hu4WJXkMpF_7JvVJQyRRP5WIIvershcNo Jul 19 22:36:29.534365 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:36:29.534365 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:36:29.534365 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:36:29.534365 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:36:29.534365 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:36:29.534365 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:36:29.534365 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:36:29.534365 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:36:29.534365 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:36:29.534365 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:36:29.535949 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:36:29.535949 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:36:29.535949 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:36:29.535949 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:36:29.535949 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:36:29.535949 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:36:29.535949 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:36:29.535949 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: ecca13a073e7447591944e6604d67e4c Jul 19 22:36:29.535949 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:36:29.535949 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:36:29.535949 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance bde3700e-991b-4d67-be79-6c4da0e27275 could not be found. Jul 19 22:36:29.535949 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'bde3700e-991b-4d67-be79-6c4da0e27275'} Jul 19 22:36:29.536764 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:36:29.536764 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:29.536764 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:36:29.536764 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:36:29.536764 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:36:29.536764 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:36:29.536764 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:36:29.536764 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:36:29.536764 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:36:29.536764 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:36:29.536764 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bde3700e-991b-4d67-be79-6c4da0e27275 could not be found. Jul 19 22:36:29.536764 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:29.536764 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:36:29.536764 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:29.536764 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:29.536764 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:36:29.536764 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:36:29.536764 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:36:29.536764 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:36:29.536764 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:36:29.538035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:36:29.538035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:36:29.538035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:36:29.538035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:36:29.538035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:36:29.538035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:36:29.538035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:36:29.538035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bde3700e-991b-4d67-be79-6c4da0e27275 could not be found. Jul 19 22:36:29.538035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:29.538035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:36:29.538035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:29.538035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:29.538035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:36:29.538035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:36:29.538035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:36:29.538035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:36:29.538035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bde3700e-991b-4d67-be79-6c4da0e27275 could not be found. Jul 19 22:36:29.538035 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:29.541933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b9c53b2c-9488-4bb5-9d66-972d09bf98bd tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Returning 404 to user: Instance bde3700e-991b-4d67-be79-6c4da0e27275 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:36:29.543484 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b9c53b2c-9488-4bb5-9d66-972d09bf98bd tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275" status: 404 len: 111 microversion: 2.1 time: 0.053331 Jul 19 22:36:29.547870 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1133/2283] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:29 2022] GET /compute/v2.1/servers/bde3700e-991b-4d67-be79-6c4da0e27275 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:36:29.562071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-36528645-6081-49c2-bd2e-ea6ffc168232 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '.version_select at 0x7f7a10770c10>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:29.645125 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-36528645-6081-49c2-bd2e-ea6ffc168232 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] HTTP exception thrown: Image not found. Jul 19 22:36:29.647221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-36528645-6081-49c2-bd2e-ea6ffc168232 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Request method failure captured: Jul 19 22:36:29.647221 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/images/b3bb270d-6e18-42dd-affd-60bc5a5f1d25 HTTP/1.1 Jul 19 22:36:29.647221 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:36:29.647221 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:36:29.647221 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:36:29.647221 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:36:29.647221 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:36:29.647221 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:36:29.647221 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:36:29.647221 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:36:29.647221 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zFSA7GyoHNV6r8lt0QaILXtfyjU87DAOplAZjQU_9SUIJAdMw3TfBxiMnSQsWy218lpl-le3iOg2K6ZI4fs9ORwE8JiU3d4qrQtSVE6mLVRBodkQTjds8wHcIk6jUHzr1JjH374IFd8C1hu4WJXkMpF_7JvVJQyRRP5WIIvershcNo Jul 19 22:36:29.647221 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:36:29.647221 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:36:29.647221 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:36:29.647221 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:36:29.647221 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:36:29.647221 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:36:29.647221 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:36:29.647221 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:36:29.647221 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:36:29.647221 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:36:29.648650 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:36:29.648650 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:36:29.648650 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:36:29.648650 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:36:29.648650 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:36:29.648650 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:36:29.648650 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:36:29.648650 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: ecca13a073e7447591944e6604d67e4c Jul 19 22:36:29.648650 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:36:29.648650 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:36:29.648650 n-d-847009-3 devstack@n-api.service[119338]: exception: Image not found. Jul 19 22:36:29.648650 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'b3bb270d-6e18-42dd-affd-60bc5a5f1d25'} Jul 19 22:36:29.648650 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:36:29.649520 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:29.649520 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 22:36:29.649520 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 22:36:29.649520 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:36:29.649520 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:36:29.649520 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:36:29.649520 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:36:29.649520 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 22:36:29.649520 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 22:36:29.649520 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 22:36:29.649520 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 22:36:29.649520 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:36:29.649520 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:36:29.649520 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:36:29.649520 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:36:29.649520 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b3bb270d-6e18-42dd-affd-60bc5a5f1d25 to delete Jul 19 22:36:29.649520 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:29.649520 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:36:29.649520 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:29.650848 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:29.650848 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 22:36:29.650848 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 22:36:29.650848 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 22:36:29.650848 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 22:36:29.650848 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 22:36:29.650848 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 22:36:29.650848 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b3bb270d-6e18-42dd-affd-60bc5a5f1d25 could not be found. Jul 19 22:36:29.650848 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:29.650848 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:36:29.650848 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:29.650848 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:29.650848 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:36:29.650848 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:36:29.650848 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:36:29.650848 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:36:29.650848 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:36:29.650848 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:36:29.650848 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:36:29.650848 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:36:29.653714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 22:36:29.653714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 22:36:29.653714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 22:36:29.653714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:29.653714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:36:29.653714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:29.653714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:29.653714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:36:29.653714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:36:29.653714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:36:29.653714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:36:29.653714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 22:36:29.653714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:29.675212 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-36528645-6081-49c2-bd2e-ea6ffc168232 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Returning 404 to user: Image not found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:36:29.677476 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-36528645-6081-49c2-bd2e-ea6ffc168232 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "DELETE /compute/v2.1/images/b3bb270d-6e18-42dd-affd-60bc5a5f1d25" status: 404 len: 62 microversion: 2.1 time: 0.128213 Jul 19 22:36:29.680366 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1134/2284] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:29 2022] DELETE /compute/v2.1/images/b3bb270d-6e18-42dd-affd-60bc5a5f1d25 => generated 62 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:36:29.722250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-48d471cc-8a30-4879-8c7d-29aae670a1d6 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:29.724516 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-48d471cc-8a30-4879-8c7d-29aae670a1d6 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: c2560d4c-c905-4dbc-9eb8-40410ec01473] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:29.738742 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48d471cc-8a30-4879-8c7d-29aae670a1d6 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:29.741316 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48d471cc-8a30-4879-8c7d-29aae670a1d6 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:29.742377 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48d471cc-8a30-4879-8c7d-29aae670a1d6 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:29.743342 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48d471cc-8a30-4879-8c7d-29aae670a1d6 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:29.784500 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-48d471cc-8a30-4879-8c7d-29aae670a1d6 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] HTTP exception thrown: Instance c2560d4c-c905-4dbc-9eb8-40410ec01473 could not be found. Jul 19 22:36:29.793583 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-48d471cc-8a30-4879-8c7d-29aae670a1d6 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Request method failure captured: Jul 19 22:36:29.793583 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473 HTTP/1.1 Jul 19 22:36:29.793583 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:36:29.793583 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:36:29.793583 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:36:29.793583 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:36:29.793583 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:36:29.793583 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:36:29.793583 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:36:29.793583 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:36:29.793583 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zFSA7GyoHNV6r8lt0QaILXtfyjU87DAOplAZjQU_9SUIJAdMw3TfBxiMnSQsWy218lpl-le3iOg2K6ZI4fs9ORwE8JiU3d4qrQtSVE6mLVRBodkQTjds8wHcIk6jUHzr1JjH374IFd8C1hu4WJXkMpF_7JvVJQyRRP5WIIvershcNo Jul 19 22:36:29.793583 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:36:29.793583 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:36:29.793583 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:36:29.793583 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:36:29.793583 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:36:29.793583 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:36:29.793583 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:36:29.793583 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:36:29.793583 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:36:29.793583 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:36:29.794731 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:36:29.794731 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:36:29.794731 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:36:29.794731 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:36:29.794731 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:36:29.794731 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:36:29.794731 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:36:29.794731 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: ecca13a073e7447591944e6604d67e4c Jul 19 22:36:29.794731 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:36:29.794731 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:36:29.794731 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance c2560d4c-c905-4dbc-9eb8-40410ec01473 could not be found. Jul 19 22:36:29.794731 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'c2560d4c-c905-4dbc-9eb8-40410ec01473'} Jul 19 22:36:29.795648 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:36:29.795648 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:29.795648 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:36:29.795648 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:36:29.795648 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:36:29.795648 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:36:29.795648 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:36:29.795648 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:36:29.795648 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:36:29.795648 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:36:29.795648 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2560d4c-c905-4dbc-9eb8-40410ec01473 could not be found. Jul 19 22:36:29.795648 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:29.795648 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:36:29.795648 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:29.795648 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:29.795648 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:36:29.795648 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:36:29.795648 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:36:29.795648 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:36:29.795648 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:36:29.796679 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:36:29.796679 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:36:29.796679 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:36:29.796679 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:36:29.796679 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:36:29.796679 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:36:29.796679 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:36:29.796679 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:36:29.796679 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:36:29.796679 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2560d4c-c905-4dbc-9eb8-40410ec01473 could not be found. Jul 19 22:36:29.796679 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:29.796679 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:36:29.796679 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:29.796679 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:29.796679 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:36:29.796679 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:36:29.796679 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:36:29.796679 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:36:29.796679 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2560d4c-c905-4dbc-9eb8-40410ec01473 could not be found. Jul 19 22:36:29.796679 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:29.801186 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-48d471cc-8a30-4879-8c7d-29aae670a1d6 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Returning 404 to user: Instance c2560d4c-c905-4dbc-9eb8-40410ec01473 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:36:29.801186 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-48d471cc-8a30-4879-8c7d-29aae670a1d6 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473" status: 404 len: 111 microversion: 2.1 time: 0.093509 Jul 19 22:36:29.801186 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1135/2285] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:36:29 2022] DELETE /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:36:29.807289 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4acc63a3-3c99-41f0-9d46-15eb899e4ab3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:29.808079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4acc63a3-3c99-41f0-9d46-15eb899e4ab3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: c2560d4c-c905-4dbc-9eb8-40410ec01473] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:29.816235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4acc63a3-3c99-41f0-9d46-15eb899e4ab3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:29.817000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4acc63a3-3c99-41f0-9d46-15eb899e4ab3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:29.817987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4acc63a3-3c99-41f0-9d46-15eb899e4ab3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:29.818602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4acc63a3-3c99-41f0-9d46-15eb899e4ab3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:29.823731 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:36:29.847280 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-4acc63a3-3c99-41f0-9d46-15eb899e4ab3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] HTTP exception thrown: Instance c2560d4c-c905-4dbc-9eb8-40410ec01473 could not be found. Jul 19 22:36:29.849574 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4acc63a3-3c99-41f0-9d46-15eb899e4ab3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Request method failure captured: Jul 19 22:36:29.849574 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473 HTTP/1.1 Jul 19 22:36:29.849574 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:36:29.849574 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:36:29.849574 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:36:29.849574 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:36:29.849574 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:36:29.849574 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:36:29.849574 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:36:29.849574 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:36:29.849574 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zFSA7GyoHNV6r8lt0QaILXtfyjU87DAOplAZjQU_9SUIJAdMw3TfBxiMnSQsWy218lpl-le3iOg2K6ZI4fs9ORwE8JiU3d4qrQtSVE6mLVRBodkQTjds8wHcIk6jUHzr1JjH374IFd8C1hu4WJXkMpF_7JvVJQyRRP5WIIvershcNo Jul 19 22:36:29.849574 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:36:29.849574 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:36:29.849574 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:36:29.849574 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:36:29.849574 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:36:29.849574 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:36:29.849574 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:36:29.849574 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:36:29.849574 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:36:29.849574 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:36:29.851404 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:36:29.851404 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:36:29.851404 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:36:29.851404 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:36:29.851404 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:36:29.851404 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:36:29.851404 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:36:29.851404 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: ecca13a073e7447591944e6604d67e4c Jul 19 22:36:29.851404 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:36:29.851404 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:36:29.851404 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance c2560d4c-c905-4dbc-9eb8-40410ec01473 could not be found. Jul 19 22:36:29.851404 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'c2560d4c-c905-4dbc-9eb8-40410ec01473'} Jul 19 22:36:29.852260 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:36:29.852260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:29.852260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:36:29.852260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:36:29.852260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:36:29.852260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:36:29.852260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:36:29.852260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:36:29.852260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:36:29.852260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:36:29.852260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2560d4c-c905-4dbc-9eb8-40410ec01473 could not be found. Jul 19 22:36:29.852260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:29.852260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:36:29.852260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:29.852260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:29.852260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:36:29.852260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:36:29.852260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:36:29.852260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:36:29.852260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:36:29.853552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:36:29.853552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:36:29.853552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:36:29.853552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:36:29.853552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:36:29.853552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:36:29.853552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:36:29.853552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2560d4c-c905-4dbc-9eb8-40410ec01473 could not be found. Jul 19 22:36:29.853552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:29.853552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:36:29.853552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:29.853552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:29.853552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:36:29.853552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:36:29.853552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:36:29.853552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:36:29.853552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2560d4c-c905-4dbc-9eb8-40410ec01473 could not be found. Jul 19 22:36:29.853552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:29.855874 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4acc63a3-3c99-41f0-9d46-15eb899e4ab3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Returning 404 to user: Instance c2560d4c-c905-4dbc-9eb8-40410ec01473 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:36:29.855874 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4acc63a3-3c99-41f0-9d46-15eb899e4ab3 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473" status: 404 len: 111 microversion: 2.1 time: 0.049144 Jul 19 22:36:29.857478 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1136/2286] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:29 2022] GET /compute/v2.1/servers/c2560d4c-c905-4dbc-9eb8-40410ec01473 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:36:29.864882 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6e6c95f9-ff61-46c4-a587-41dd719487a0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '.version_select at 0x7f7a10410670>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:29.895275 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6e6c95f9-ff61-46c4-a587-41dd719487a0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-725684013" status: 202 len: 0 microversion: 2.1 time: 0.036428 Jul 19 22:36:29.896689 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1137/2287] 10.222.0.25 () {58 vars in 1217 bytes} [Tue Jul 19 22:36:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-725684013 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:36:29.967175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1b276838-2e66-4e23-8e85-32de0ef98145 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a105108b0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:30.022410 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1b276838-2e66-4e23-8e85-32de0ef98145 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/8dcbbe7c-675b-4c98-abb1-4ae1f952d3df" status: 200 len: 662 microversion: 2.1 time: 0.059658 Jul 19 22:36:30.023455 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1138/2288] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:36:29 2022] GET /compute/v2.1/images/8dcbbe7c-675b-4c98-abb1-4ae1f952d3df => generated 662 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:36:30.035721 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dc3eb1bb-4cbb-49cb-8731-1c8afc889af7 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a104b73a0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:30.037439 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0bb8b495-5c0d-4f80-b292-ef7564b96e8b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:30.052995 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0bb8b495-5c0d-4f80-b292-ef7564b96e8b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:30.054680 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0bb8b495-5c0d-4f80-b292-ef7564b96e8b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:30.056015 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0bb8b495-5c0d-4f80-b292-ef7564b96e8b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 0.831166 Jul 19 22:36:30.057663 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1151/2289] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:36:29 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:36:30.098841 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dc3eb1bb-4cbb-49cb-8731-1c8afc889af7 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/8dcbbe7c-675b-4c98-abb1-4ae1f952d3df" status: 200 len: 662 microversion: 2.1 time: 0.063526 Jul 19 22:36:30.099535 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1139/2290] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:36:30 2022] GET /compute/v2.1/images/8dcbbe7c-675b-4c98-abb1-4ae1f952d3df => generated 662 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:36:30.148455 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2fae745b-2789-4d65-8ba8-bdaf8e2c56aa tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:30.149032 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2fae745b-2789-4d65-8ba8-bdaf8e2c56aa tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] [instance: d6189bec-a398-4e64-8e79-0b766af2f833] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:30.158178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fae745b-2789-4d65-8ba8-bdaf8e2c56aa tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:30.158870 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fae745b-2789-4d65-8ba8-bdaf8e2c56aa tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:30.159856 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fae745b-2789-4d65-8ba8-bdaf8e2c56aa tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:30.160625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fae745b-2789-4d65-8ba8-bdaf8e2c56aa tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:30.233749 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d918a153-93c9-4a79-aca2-eba4a4eed6b2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-669573073", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:30.302909 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-d918a153-93c9-4a79-aca2-eba4a4eed6b2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] validate_networks() for None {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:36:30.901838 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2fae745b-2789-4d65-8ba8-bdaf8e2c56aa tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f357f1737d4f29b2d594939a06a79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04569d19c85640c48496efb72ef4c20f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:30.926426 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2fae745b-2789-4d65-8ba8-bdaf8e2c56aa tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] 10.222.0.25 "GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833" status: 200 len: 1401 microversion: 2.1 time: 0.782866 Jul 19 22:36:30.928274 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1152/2291] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:30 2022] GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833 => generated 1401 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:30.945908 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e27a537c-9524-451c-b454-4fbd3ff0e57a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:30.948380 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e27a537c-9524-451c-b454-4fbd3ff0e57a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 0ee48b19-107c-4883-8d87-5868a5201d08] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:30.969205 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e27a537c-9524-451c-b454-4fbd3ff0e57a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:30.972827 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e27a537c-9524-451c-b454-4fbd3ff0e57a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:30.982369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e27a537c-9524-451c-b454-4fbd3ff0e57a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:30.992340 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e27a537c-9524-451c-b454-4fbd3ff0e57a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:31.213239 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e27a537c-9524-451c-b454-4fbd3ff0e57a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:31.229473 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e27a537c-9524-451c-b454-4fbd3ff0e57a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08" status: 200 len: 1280 microversion: 2.1 time: 0.299239 Jul 19 22:36:31.249837 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1153/2292] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:30 2022] GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08 => generated 1280 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:31.255310 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-70f5e44b-bbf5-4044-b1d6-32908c1c6710 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:31.256148 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-70f5e44b-bbf5-4044-b1d6-32908c1c6710 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:31.265365 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-d918a153-93c9-4a79-aca2-eba4a4eed6b2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:36:31.266422 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-d918a153-93c9-4a79-aca2-eba4a4eed6b2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:36:31.267610 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-d918a153-93c9-4a79-aca2-eba4a4eed6b2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:36:31.268309 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-d918a153-93c9-4a79-aca2-eba4a4eed6b2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:36:31.268878 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-d918a153-93c9-4a79-aca2-eba4a4eed6b2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:36:31.275959 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-70f5e44b-bbf5-4044-b1d6-32908c1c6710 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:31.280147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-70f5e44b-bbf5-4044-b1d6-32908c1c6710 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:31.284009 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-70f5e44b-bbf5-4044-b1d6-32908c1c6710 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:31.284659 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-70f5e44b-bbf5-4044-b1d6-32908c1c6710 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:31.293047 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d918a153-93c9-4a79-aca2-eba4a4eed6b2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:31.297335 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d918a153-93c9-4a79-aca2-eba4a4eed6b2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:31.300271 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d918a153-93c9-4a79-aca2-eba4a4eed6b2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:31.301538 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d918a153-93c9-4a79-aca2-eba4a4eed6b2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:31.355807 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-d918a153-93c9-4a79-aca2-eba4a4eed6b2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Getting quotas for project 994ee0e2b71b4eff88a19b70351ada06. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:36:31.370248 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-d918a153-93c9-4a79-aca2-eba4a4eed6b2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Getting quotas for user 1cdcb86f99184c839022f5f19d730e9a and project 994ee0e2b71b4eff88a19b70351ada06. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:36:31.391240 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:36:31.394083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d918a153-93c9-4a79-aca2-eba4a4eed6b2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:36:31.397132 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d918a153-93c9-4a79-aca2-eba4a4eed6b2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: bf0396df-c757-4ec7-9697-e71026a34525] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:36:31.472553 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d918a153-93c9-4a79-aca2-eba4a4eed6b2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.243862 Jul 19 22:36:31.473803 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1140/2293] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:36:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 22:36:31.575051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0b394103-dccc-41c6-b515-952ba7ef786f tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1563985180", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:31.658830 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-0b394103-dccc-41c6-b515-952ba7ef786f tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] validate_networks() for None {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:36:32.474725 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-70f5e44b-bbf5-4044-b1d6-32908c1c6710 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:32.484827 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-70f5e44b-bbf5-4044-b1d6-32908c1c6710 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:32.486794 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-70f5e44b-bbf5-4044-b1d6-32908c1c6710 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:32.488029 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-70f5e44b-bbf5-4044-b1d6-32908c1c6710 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 1.237120 Jul 19 22:36:32.488614 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1154/2294] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:36:31 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:36:32.528770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b8aca938-5184-496f-842b-bb6c60d7b1b3 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:32.529450 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b8aca938-5184-496f-842b-bb6c60d7b1b3 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] [instance: d6189bec-a398-4e64-8e79-0b766af2f833] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:32.547051 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8aca938-5184-496f-842b-bb6c60d7b1b3 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:32.547796 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8aca938-5184-496f-842b-bb6c60d7b1b3 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:32.549727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8aca938-5184-496f-842b-bb6c60d7b1b3 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:32.551099 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8aca938-5184-496f-842b-bb6c60d7b1b3 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:32.976634 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-0b394103-dccc-41c6-b515-952ba7ef786f tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:36:32.977139 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-0b394103-dccc-41c6-b515-952ba7ef786f tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:36:32.977779 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-0b394103-dccc-41c6-b515-952ba7ef786f tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:36:32.978351 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-0b394103-dccc-41c6-b515-952ba7ef786f tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:36:32.978925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-0b394103-dccc-41c6-b515-952ba7ef786f tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:36:33.002556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b394103-dccc-41c6-b515-952ba7ef786f tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:33.003399 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b394103-dccc-41c6-b515-952ba7ef786f tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:33.004430 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b394103-dccc-41c6-b515-952ba7ef786f tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:33.005104 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b394103-dccc-41c6-b515-952ba7ef786f tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:33.041517 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-0b394103-dccc-41c6-b515-952ba7ef786f tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Getting quotas for project 994ee0e2b71b4eff88a19b70351ada06. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:36:33.053377 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-0b394103-dccc-41c6-b515-952ba7ef786f tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Getting quotas for user 1cdcb86f99184c839022f5f19d730e9a and project 994ee0e2b71b4eff88a19b70351ada06. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:36:33.093113 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0b394103-dccc-41c6-b515-952ba7ef786f tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:36:33.102487 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0b394103-dccc-41c6-b515-952ba7ef786f tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: 7a846129-bc22-4520-bd5b-d33fcd0a94a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:36:33.301411 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0b394103-dccc-41c6-b515-952ba7ef786f tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.731801 Jul 19 22:36:33.306633 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1141/2295] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:36:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:36:33.352677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6a9ac29d-c82e-4036-8510-436b325eb0d7 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '.version_select at 0x7f7a1045d550>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:33.374761 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b8aca938-5184-496f-842b-bb6c60d7b1b3 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f357f1737d4f29b2d594939a06a79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04569d19c85640c48496efb72ef4c20f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:33.377171 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:36:33.388274 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b8aca938-5184-496f-842b-bb6c60d7b1b3 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] 10.222.0.25 "GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833" status: 200 len: 1401 microversion: 2.1 time: 0.898502 Jul 19 22:36:33.390061 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1155/2296] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:32 2022] GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833 => generated 1401 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:33.405405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-532fdcc1-c742-4f2c-ac98-a655c080452f tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:33.414787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-532fdcc1-c742-4f2c-ac98-a655c080452f tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 0ee48b19-107c-4883-8d87-5868a5201d08] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:33.420704 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-6a9ac29d-c82e-4036-8510-436b325eb0d7 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] HTTP exception thrown: Image not found. Jul 19 22:36:33.425662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6a9ac29d-c82e-4036-8510-436b325eb0d7 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Request method failure captured: Jul 19 22:36:33.425662 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/images/ab95208e-f3f9-4eb7-8809-25bde63b8c0b HTTP/1.1 Jul 19 22:36:33.425662 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:36:33.425662 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:36:33.425662 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:36:33.425662 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:36:33.425662 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:36:33.425662 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:36:33.425662 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:36:33.425662 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:36:33.425662 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zFSA7GyoHNV6r8lt0QaILXtfyjU87DAOplAZjQU_9SUIJAdMw3TfBxiMnSQsWy218lpl-le3iOg2K6ZI4fs9ORwE8JiU3d4qrQtSVE6mLVRBodkQTjds8wHcIk6jUHzr1JjH374IFd8C1hu4WJXkMpF_7JvVJQyRRP5WIIvershcNo Jul 19 22:36:33.425662 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:36:33.425662 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:36:33.425662 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:36:33.425662 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:36:33.425662 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:36:33.425662 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:36:33.425662 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:36:33.425662 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:36:33.425662 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:36:33.425662 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:36:33.427205 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:36:33.427205 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:36:33.427205 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:36:33.427205 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:36:33.427205 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:36:33.427205 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:36:33.427205 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:36:33.427205 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: ecca13a073e7447591944e6604d67e4c Jul 19 22:36:33.427205 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:36:33.427205 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:36:33.427205 n-d-847009-3 devstack@n-api.service[119338]: exception: Image not found. Jul 19 22:36:33.427205 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'ab95208e-f3f9-4eb7-8809-25bde63b8c0b'} Jul 19 22:36:33.427205 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:36:33.428198 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:33.428198 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 22:36:33.428198 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 22:36:33.428198 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:36:33.428198 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:36:33.428198 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:36:33.428198 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:36:33.428198 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 22:36:33.428198 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 22:36:33.428198 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 22:36:33.428198 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 22:36:33.428198 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:36:33.428198 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:36:33.428198 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:36:33.428198 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:36:33.428198 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ab95208e-f3f9-4eb7-8809-25bde63b8c0b to delete Jul 19 22:36:33.428198 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:33.428198 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:36:33.428198 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:33.429463 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:33.429463 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 22:36:33.429463 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 22:36:33.429463 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 22:36:33.429463 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 22:36:33.429463 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 22:36:33.429463 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 22:36:33.429463 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ab95208e-f3f9-4eb7-8809-25bde63b8c0b could not be found. Jul 19 22:36:33.429463 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:33.429463 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:36:33.429463 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:33.429463 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:33.429463 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:36:33.429463 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:36:33.429463 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:36:33.429463 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:36:33.429463 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:36:33.429463 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:36:33.429463 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:36:33.429463 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:36:33.430761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 22:36:33.430761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 22:36:33.430761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 22:36:33.430761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:33.430761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:36:33.430761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:33.430761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:33.430761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:36:33.430761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:36:33.430761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:36:33.430761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:36:33.430761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 22:36:33.430761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:33.432569 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6a9ac29d-c82e-4036-8510-436b325eb0d7 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Returning 404 to user: Image not found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:36:33.433671 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6a9ac29d-c82e-4036-8510-436b325eb0d7 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "DELETE /compute/v2.1/images/ab95208e-f3f9-4eb7-8809-25bde63b8c0b" status: 404 len: 62 microversion: 2.1 time: 0.124137 Jul 19 22:36:33.434428 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1142/2297] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:33 2022] DELETE /compute/v2.1/images/ab95208e-f3f9-4eb7-8809-25bde63b8c0b => generated 62 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:36:33.438205 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-532fdcc1-c742-4f2c-ac98-a655c080452f tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:33.438788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-532fdcc1-c742-4f2c-ac98-a655c080452f tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:33.439785 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-532fdcc1-c742-4f2c-ac98-a655c080452f tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:33.440223 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-532fdcc1-c742-4f2c-ac98-a655c080452f tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:33.455753 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-94db7e03-7522-4e91-94a1-55b3f939d5da req-54e85c95-a287-4524-95bb-919d6d48091d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6189bec-a398-4e64-8e79-0b766af2f833", "name": "network-vif-plugged", "status": "completed", "tag": "ab5c88e8-cfda-4225-9739-f4f3e8403327"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:33.484254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-94db7e03-7522-4e91-94a1-55b3f939d5da req-54e85c95-a287-4524-95bb-919d6d48091d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:33.488428 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-94db7e03-7522-4e91-94a1-55b3f939d5da req-54e85c95-a287-4524-95bb-919d6d48091d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:33.527056 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-94db7e03-7522-4e91-94a1-55b3f939d5da req-54e85c95-a287-4524-95bb-919d6d48091d service nova] Creating event network-vif-plugged:ab5c88e8-cfda-4225-9739-f4f3e8403327 for instance d6189bec-a398-4e64-8e79-0b766af2f833 on n-h2-847009-3 Jul 19 22:36:33.552640 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-94db7e03-7522-4e91-94a1-55b3f939d5da req-54e85c95-a287-4524-95bb-919d6d48091d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114828 Jul 19 22:36:33.553244 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1143/2298] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:36:33.563403 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-552d66fe-c294-4a1b-846b-71d25c478fb2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:33.564889 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-552d66fe-c294-4a1b-846b-71d25c478fb2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: 7a846129-bc22-4520-bd5b-d33fcd0a94a2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:33.761735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-532fdcc1-c742-4f2c-ac98-a655c080452f tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:33.771943 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-532fdcc1-c742-4f2c-ac98-a655c080452f tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08" status: 200 len: 1280 microversion: 2.1 time: 0.380657 Jul 19 22:36:33.774488 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1156/2299] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:33 2022] GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08 => generated 1280 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:33.787257 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c4e74d4d-7c15-4319-ab57-b9451331cda0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:33.788362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c4e74d4d-7c15-4319-ab57-b9451331cda0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:33.803867 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c4e74d4d-7c15-4319-ab57-b9451331cda0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:33.804510 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c4e74d4d-7c15-4319-ab57-b9451331cda0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:33.806469 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c4e74d4d-7c15-4319-ab57-b9451331cda0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:33.807284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c4e74d4d-7c15-4319-ab57-b9451331cda0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:33.829650 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-c4e74d4d-7c15-4319-ab57-b9451331cda0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] HTTP exception thrown: Instance 44b7e41a-9a4f-469b-9561-5f798bebeb47 could not be found. Jul 19 22:36:33.831362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c4e74d4d-7c15-4319-ab57-b9451331cda0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Request method failure captured: Jul 19 22:36:33.831362 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 HTTP/1.1 Jul 19 22:36:33.831362 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:36:33.831362 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:36:33.831362 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:36:33.831362 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:36:33.831362 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:36:33.831362 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:36:33.831362 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:36:33.831362 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:36:33.831362 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zFSA7GyoHNV6r8lt0QaILXtfyjU87DAOplAZjQU_9SUIJAdMw3TfBxiMnSQsWy218lpl-le3iOg2K6ZI4fs9ORwE8JiU3d4qrQtSVE6mLVRBodkQTjds8wHcIk6jUHzr1JjH374IFd8C1hu4WJXkMpF_7JvVJQyRRP5WIIvershcNo Jul 19 22:36:33.831362 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:36:33.831362 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:36:33.831362 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:36:33.831362 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:36:33.831362 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:36:33.831362 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:36:33.831362 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:36:33.831362 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:36:33.831362 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:36:33.831362 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:36:33.832751 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:36:33.832751 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:36:33.832751 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:36:33.832751 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:36:33.832751 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:36:33.832751 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:36:33.832751 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:36:33.832751 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: ecca13a073e7447591944e6604d67e4c Jul 19 22:36:33.832751 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:36:33.832751 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:36:33.832751 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 44b7e41a-9a4f-469b-9561-5f798bebeb47 could not be found. Jul 19 22:36:33.832751 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '44b7e41a-9a4f-469b-9561-5f798bebeb47'} Jul 19 22:36:33.833497 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:36:33.833497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:33.833497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:36:33.833497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:36:33.833497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:36:33.833497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:36:33.833497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:36:33.833497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:36:33.833497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:36:33.833497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:36:33.833497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44b7e41a-9a4f-469b-9561-5f798bebeb47 could not be found. Jul 19 22:36:33.833497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:36:33.833497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:36:33.833497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:36:33.833497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:33.833497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:36:33.833497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:36:33.833497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:36:33.833497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:36:33.833497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:36:33.834554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:36:33.834554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:36:33.834554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:36:33.834554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:36:33.834554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:36:33.834554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:36:33.834554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:36:33.834554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:36:33.834554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:36:33.834554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44b7e41a-9a4f-469b-9561-5f798bebeb47 could not be found. Jul 19 22:36:33.834554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:36:33.834554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:36:33.834554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:36:33.834554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:33.834554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:36:33.834554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:36:33.834554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:36:33.834554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:36:33.834554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44b7e41a-9a4f-469b-9561-5f798bebeb47 could not be found. Jul 19 22:36:33.834554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:36:33.836711 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-552d66fe-c294-4a1b-846b-71d25c478fb2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdcb86f99184c839022f5f19d730e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '994ee0e2b71b4eff88a19b70351ada06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:33.837692 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c4e74d4d-7c15-4319-ab57-b9451331cda0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Returning 404 to user: Instance 44b7e41a-9a4f-469b-9561-5f798bebeb47 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:36:33.838735 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c4e74d4d-7c15-4319-ab57-b9451331cda0 tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "DELETE /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 404 len: 111 microversion: 2.1 time: 0.063062 Jul 19 22:36:33.839815 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1157/2300] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:36:33 2022] DELETE /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:36:33.845942 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-462b8fcd-3ae7-4598-851d-df96818613bd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:33.846850 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-462b8fcd-3ae7-4598-851d-df96818613bd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:33.853711 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-462b8fcd-3ae7-4598-851d-df96818613bd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:33.854687 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-552d66fe-c294-4a1b-846b-71d25c478fb2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2" status: 200 len: 1218 microversion: 2.1 time: 0.296865 Jul 19 22:36:33.855631 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-462b8fcd-3ae7-4598-851d-df96818613bd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:33.856687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-462b8fcd-3ae7-4598-851d-df96818613bd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:33.858075 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-462b8fcd-3ae7-4598-851d-df96818613bd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:33.863214 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1144/2301] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:33 2022] GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2 => generated 1218 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:33.869086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d3dee0b6-de18-4d50-9fec-bafc11eb64da tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:33.869997 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d3dee0b6-de18-4d50-9fec-bafc11eb64da tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] [instance: 44b7e41a-9a4f-469b-9561-5f798bebeb47] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:33.880829 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3dee0b6-de18-4d50-9fec-bafc11eb64da tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:33.881647 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3dee0b6-de18-4d50-9fec-bafc11eb64da tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:33.882925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3dee0b6-de18-4d50-9fec-bafc11eb64da tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:33.883670 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3dee0b6-de18-4d50-9fec-bafc11eb64da tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:33.913035 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-d3dee0b6-de18-4d50-9fec-bafc11eb64da tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] HTTP exception thrown: Instance 44b7e41a-9a4f-469b-9561-5f798bebeb47 could not be found. Jul 19 22:36:33.915909 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d3dee0b6-de18-4d50-9fec-bafc11eb64da tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Request method failure captured: Jul 19 22:36:33.915909 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 HTTP/1.1 Jul 19 22:36:33.915909 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:36:33.915909 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:36:33.915909 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:36:33.915909 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:36:33.915909 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:36:33.915909 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:36:33.915909 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:36:33.915909 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:36:33.915909 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zFSA7GyoHNV6r8lt0QaILXtfyjU87DAOplAZjQU_9SUIJAdMw3TfBxiMnSQsWy218lpl-le3iOg2K6ZI4fs9ORwE8JiU3d4qrQtSVE6mLVRBodkQTjds8wHcIk6jUHzr1JjH374IFd8C1hu4WJXkMpF_7JvVJQyRRP5WIIvershcNo Jul 19 22:36:33.915909 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:36:33.915909 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:36:33.915909 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:36:33.915909 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:36:33.915909 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:36:33.915909 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:36:33.915909 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:36:33.915909 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:36:33.915909 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:36:33.915909 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:36:33.917117 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3eca98474bca4a64af425dffb9ecb5b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:36:33.917117 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:36:33.917117 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 3eca98474bca4a64af425dffb9ecb5b3 Jul 19 22:36:33.917117 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978 Jul 19 22:36:33.917117 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:36:33.917117 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:36:33.917117 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:36:33.917117 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: ecca13a073e7447591944e6604d67e4c Jul 19 22:36:33.917117 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1434728978-project Jul 19 22:36:33.917117 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:36:33.917117 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 44b7e41a-9a4f-469b-9561-5f798bebeb47 could not be found. Jul 19 22:36:33.917117 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '44b7e41a-9a4f-469b-9561-5f798bebeb47'} Jul 19 22:36:33.917782 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:36:33.917782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:33.917782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:36:33.917782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:36:33.917782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:36:33.917782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:36:33.917782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:36:33.917782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:36:33.917782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:36:33.917782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:36:33.917782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44b7e41a-9a4f-469b-9561-5f798bebeb47 could not be found. Jul 19 22:36:33.917782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:33.917782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:36:33.917782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:33.917782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:33.917782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:36:33.917782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:36:33.917782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:36:33.917782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:36:33.917782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:36:33.918835 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:36:33.918835 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:36:33.918835 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:36:33.918835 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:36:33.918835 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:36:33.918835 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:36:33.918835 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:36:33.918835 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44b7e41a-9a4f-469b-9561-5f798bebeb47 could not be found. Jul 19 22:36:33.918835 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:33.918835 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:36:33.918835 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:33.918835 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:36:33.918835 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:36:33.918835 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:36:33.918835 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:36:33.918835 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:36:33.918835 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44b7e41a-9a4f-469b-9561-5f798bebeb47 could not be found. Jul 19 22:36:33.918835 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:36:33.919885 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d3dee0b6-de18-4d50-9fec-bafc11eb64da tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] Returning 404 to user: Instance 44b7e41a-9a4f-469b-9561-5f798bebeb47 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:36:33.919885 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d3dee0b6-de18-4d50-9fec-bafc11eb64da tempest-ImagesOneServerNegativeTestJSON-1434728978 tempest-ImagesOneServerNegativeTestJSON-1434728978-project] 10.222.0.25 "GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47" status: 404 len: 111 microversion: 2.1 time: 0.053998 Jul 19 22:36:33.924256 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1145/2302] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:33 2022] GET /compute/v2.1/servers/44b7e41a-9a4f-469b-9561-5f798bebeb47 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:36:34.408311 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-61f6c4a7-830b-454b-908f-573860324d60 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:34.409025 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-61f6c4a7-830b-454b-908f-573860324d60 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] [instance: d6189bec-a398-4e64-8e79-0b766af2f833] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:34.427595 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-61f6c4a7-830b-454b-908f-573860324d60 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:34.428319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-61f6c4a7-830b-454b-908f-573860324d60 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:34.429408 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-61f6c4a7-830b-454b-908f-573860324d60 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:34.440359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-61f6c4a7-830b-454b-908f-573860324d60 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:35.444682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-462b8fcd-3ae7-4598-851d-df96818613bd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:35.462677 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-462b8fcd-3ae7-4598-851d-df96818613bd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:35.473957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-462b8fcd-3ae7-4598-851d-df96818613bd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:35.477428 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-462b8fcd-3ae7-4598-851d-df96818613bd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 1.636342 Jul 19 22:36:35.480746 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1158/2303] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:36:33 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:36:35.496652 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-598c156a-a927-48e6-ae62-0a731bdf3800 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:35.499155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-598c156a-a927-48e6-ae62-0a731bdf3800 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 0ee48b19-107c-4883-8d87-5868a5201d08] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:35.523061 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-598c156a-a927-48e6-ae62-0a731bdf3800 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:35.523558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-598c156a-a927-48e6-ae62-0a731bdf3800 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:35.529612 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-598c156a-a927-48e6-ae62-0a731bdf3800 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:35.530076 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-598c156a-a927-48e6-ae62-0a731bdf3800 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:36.453028 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-61f6c4a7-830b-454b-908f-573860324d60 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f357f1737d4f29b2d594939a06a79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04569d19c85640c48496efb72ef4c20f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:36.462078 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-61f6c4a7-830b-454b-908f-573860324d60 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] 10.222.0.25 "GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833" status: 200 len: 1401 microversion: 2.1 time: 2.058865 Jul 19 22:36:36.463140 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1146/2304] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:34 2022] GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833 => generated 1401 bytes in 2061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:36:36.472292 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-80dbafc4-6396-4f7d-b276-181bdd10e4f2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:36.476009 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-80dbafc4-6396-4f7d-b276-181bdd10e4f2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: 7a846129-bc22-4520-bd5b-d33fcd0a94a2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:36.490196 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-80dbafc4-6396-4f7d-b276-181bdd10e4f2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:36.490196 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-80dbafc4-6396-4f7d-b276-181bdd10e4f2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:36.490196 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-80dbafc4-6396-4f7d-b276-181bdd10e4f2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:36.490196 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-80dbafc4-6396-4f7d-b276-181bdd10e4f2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:36.718770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-80dbafc4-6396-4f7d-b276-181bdd10e4f2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdcb86f99184c839022f5f19d730e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '994ee0e2b71b4eff88a19b70351ada06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:36.728317 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-80dbafc4-6396-4f7d-b276-181bdd10e4f2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2" status: 200 len: 1276 microversion: 2.1 time: 0.263635 Jul 19 22:36:36.729438 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1147/2305] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:36 2022] GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2 => generated 1276 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:36.738094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-19e040d7-4ced-4d25-8d9c-020a246703f2 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:36.739229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-19e040d7-4ced-4d25-8d9c-020a246703f2 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:36.748252 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-19e040d7-4ced-4d25-8d9c-020a246703f2 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:36.749260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-19e040d7-4ced-4d25-8d9c-020a246703f2 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:36.750202 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-19e040d7-4ced-4d25-8d9c-020a246703f2 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:36.750811 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-19e040d7-4ced-4d25-8d9c-020a246703f2 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:36.756021 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-598c156a-a927-48e6-ae62-0a731bdf3800 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:36.764248 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-598c156a-a927-48e6-ae62-0a731bdf3800 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08" status: 200 len: 1322 microversion: 2.1 time: 1.281991 Jul 19 22:36:36.774353 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1159/2306] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:35 2022] GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08 => generated 1322 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:37.481620 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8921f340-34da-4f3d-97bd-5d999ed9d77d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:37.482243 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8921f340-34da-4f3d-97bd-5d999ed9d77d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] [instance: d6189bec-a398-4e64-8e79-0b766af2f833] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:37.494757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8921f340-34da-4f3d-97bd-5d999ed9d77d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:37.495240 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8921f340-34da-4f3d-97bd-5d999ed9d77d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:37.496030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8921f340-34da-4f3d-97bd-5d999ed9d77d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:37.496467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8921f340-34da-4f3d-97bd-5d999ed9d77d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:37.941648 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-19e040d7-4ced-4d25-8d9c-020a246703f2 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:37.953122 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-19e040d7-4ced-4d25-8d9c-020a246703f2 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:37.955278 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-19e040d7-4ced-4d25-8d9c-020a246703f2 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:37.963342 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-19e040d7-4ced-4d25-8d9c-020a246703f2 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 1.225698 Jul 19 22:36:37.964035 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1148/2307] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:36:36 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:36:37.970663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0157297a-cb33-4f94-8a87-564cff3ec5e1 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:37.971631 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0157297a-cb33-4f94-8a87-564cff3ec5e1 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: 7a846129-bc22-4520-bd5b-d33fcd0a94a2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:37.981482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0157297a-cb33-4f94-8a87-564cff3ec5e1 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:37.982224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0157297a-cb33-4f94-8a87-564cff3ec5e1 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:37.983253 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0157297a-cb33-4f94-8a87-564cff3ec5e1 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:37.983940 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0157297a-cb33-4f94-8a87-564cff3ec5e1 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:38.457593 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=12,nova_cell0:UPDATE=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:36:38.523639 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0157297a-cb33-4f94-8a87-564cff3ec5e1 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdcb86f99184c839022f5f19d730e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '994ee0e2b71b4eff88a19b70351ada06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:38.536502 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0157297a-cb33-4f94-8a87-564cff3ec5e1 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2" status: 200 len: 1276 microversion: 2.1 time: 0.569978 Jul 19 22:36:38.540276 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1149/2308] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:37 2022] GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2 => generated 1276 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:38.545758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d3e22cca-49da-429b-814a-238d4ffe25d3 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:38.546673 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d3e22cca-49da-429b-814a-238d4ffe25d3 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 0ee48b19-107c-4883-8d87-5868a5201d08] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:38.556909 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3e22cca-49da-429b-814a-238d4ffe25d3 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:38.557531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3e22cca-49da-429b-814a-238d4ffe25d3 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:38.558335 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3e22cca-49da-429b-814a-238d4ffe25d3 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:38.558895 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3e22cca-49da-429b-814a-238d4ffe25d3 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:38.708419 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8921f340-34da-4f3d-97bd-5d999ed9d77d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f357f1737d4f29b2d594939a06a79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04569d19c85640c48496efb72ef4c20f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:38.721785 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8921f340-34da-4f3d-97bd-5d999ed9d77d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] 10.222.0.25 "GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833" status: 200 len: 1588 microversion: 2.1 time: 1.244148 Jul 19 22:36:38.734057 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1160/2309] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:37 2022] GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833 => generated 1588 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:36:38.740462 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d23bf091-f54f-43a5-8e5b-a2bf6be21c5d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:38.741330 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d23bf091-f54f-43a5-8e5b-a2bf6be21c5d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] [instance: d6189bec-a398-4e64-8e79-0b766af2f833] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:38.748779 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d23bf091-f54f-43a5-8e5b-a2bf6be21c5d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:38.749901 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d23bf091-f54f-43a5-8e5b-a2bf6be21c5d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:38.751417 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d23bf091-f54f-43a5-8e5b-a2bf6be21c5d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:38.752549 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d23bf091-f54f-43a5-8e5b-a2bf6be21c5d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:39.066118 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d23bf091-f54f-43a5-8e5b-a2bf6be21c5d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] 10.222.0.25 "GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.330470 Jul 19 22:36:39.072836 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1161/2310] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 19 22:36:38 2022] GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833/os-interface => generated 285 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:36:39.076277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d4cd7919-6860-4521-aba5-f6c5f6626d78 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:39.076904 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d4cd7919-6860-4521-aba5-f6c5f6626d78 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:39.093955 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d4cd7919-6860-4521-aba5-f6c5f6626d78 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:39.094624 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d4cd7919-6860-4521-aba5-f6c5f6626d78 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:39.095952 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d4cd7919-6860-4521-aba5-f6c5f6626d78 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:39.096393 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d4cd7919-6860-4521-aba5-f6c5f6626d78 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:39.223102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d3e22cca-49da-429b-814a-238d4ffe25d3 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:39.243002 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d3e22cca-49da-429b-814a-238d4ffe25d3 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08" status: 200 len: 1322 microversion: 2.1 time: 0.701476 Jul 19 22:36:39.243560 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1150/2311] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:38 2022] GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08 => generated 1322 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:39.556732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e66a61d4-ce7b-47ba-835d-a258f1c156a3 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:39.557607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e66a61d4-ce7b-47ba-835d-a258f1c156a3 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: 7a846129-bc22-4520-bd5b-d33fcd0a94a2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:39.573985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e66a61d4-ce7b-47ba-835d-a258f1c156a3 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:39.574455 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e66a61d4-ce7b-47ba-835d-a258f1c156a3 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:39.575324 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e66a61d4-ce7b-47ba-835d-a258f1c156a3 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:39.577176 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e66a61d4-ce7b-47ba-835d-a258f1c156a3 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:40.093094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e66a61d4-ce7b-47ba-835d-a258f1c156a3 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdcb86f99184c839022f5f19d730e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '994ee0e2b71b4eff88a19b70351ada06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:40.104781 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e66a61d4-ce7b-47ba-835d-a258f1c156a3 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2" status: 200 len: 1276 microversion: 2.1 time: 0.552296 Jul 19 22:36:40.105649 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1151/2312] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:39 2022] GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2 => generated 1276 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:36:40.260356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d2fdfcea-6682-4cd1-b424-80f6a966f612 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:40.260985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d2fdfcea-6682-4cd1-b424-80f6a966f612 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 0ee48b19-107c-4883-8d87-5868a5201d08] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:40.274769 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2fdfcea-6682-4cd1-b424-80f6a966f612 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:40.275536 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2fdfcea-6682-4cd1-b424-80f6a966f612 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:40.276343 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2fdfcea-6682-4cd1-b424-80f6a966f612 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:40.276798 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2fdfcea-6682-4cd1-b424-80f6a966f612 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:40.617796 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d4cd7919-6860-4521-aba5-f6c5f6626d78 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:40.633182 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d4cd7919-6860-4521-aba5-f6c5f6626d78 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:40.635638 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d4cd7919-6860-4521-aba5-f6c5f6626d78 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:40.637654 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d4cd7919-6860-4521-aba5-f6c5f6626d78 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 1.569597 Jul 19 22:36:40.638809 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1162/2313] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:36:39 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:36:41.124300 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3bed076a-baaf-4dd9-a0c6-ef258c7d70bb tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:41.126948 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3bed076a-baaf-4dd9-a0c6-ef258c7d70bb tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: 7a846129-bc22-4520-bd5b-d33fcd0a94a2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:41.140971 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3bed076a-baaf-4dd9-a0c6-ef258c7d70bb tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:41.143859 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3bed076a-baaf-4dd9-a0c6-ef258c7d70bb tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:41.144908 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3bed076a-baaf-4dd9-a0c6-ef258c7d70bb tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:41.146666 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3bed076a-baaf-4dd9-a0c6-ef258c7d70bb tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:41.653874 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3bed076a-baaf-4dd9-a0c6-ef258c7d70bb tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdcb86f99184c839022f5f19d730e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '994ee0e2b71b4eff88a19b70351ada06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:41.666911 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3bed076a-baaf-4dd9-a0c6-ef258c7d70bb tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2" status: 200 len: 1276 microversion: 2.1 time: 0.546928 Jul 19 22:36:41.682142 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1163/2314] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:41 2022] GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2 => generated 1276 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:41.689348 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cf865352-5b12-4f81-90e0-1ae45ce040bf tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:41.690831 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cf865352-5b12-4f81-90e0-1ae45ce040bf tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:41.707672 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d2fdfcea-6682-4cd1-b424-80f6a966f612 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:41.723552 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cf865352-5b12-4f81-90e0-1ae45ce040bf tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:41.725386 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d2fdfcea-6682-4cd1-b424-80f6a966f612 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08" status: 200 len: 1322 microversion: 2.1 time: 1.468808 Jul 19 22:36:41.726051 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cf865352-5b12-4f81-90e0-1ae45ce040bf tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:41.726953 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cf865352-5b12-4f81-90e0-1ae45ce040bf tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:41.727699 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1152/2315] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:40 2022] GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08 => generated 1322 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:36:41.728266 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cf865352-5b12-4f81-90e0-1ae45ce040bf tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:42.390997 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-e1310812-838a-4ea0-9e78-13a893e03ead req-f87e263f-a4d1-438f-9565-6ac84fee7164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ee48b19-107c-4883-8d87-5868a5201d08", "tag": "b4de2026-c6d2-47b7-a650-4bd04fa9128f"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:42.404870 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e1310812-838a-4ea0-9e78-13a893e03ead req-f87e263f-a4d1-438f-9565-6ac84fee7164 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:42.411983 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e1310812-838a-4ea0-9e78-13a893e03ead req-f87e263f-a4d1-438f-9565-6ac84fee7164 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:42.439140 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-e1310812-838a-4ea0-9e78-13a893e03ead req-f87e263f-a4d1-438f-9565-6ac84fee7164 service nova] Creating event network-changed:b4de2026-c6d2-47b7-a650-4bd04fa9128f for instance 0ee48b19-107c-4883-8d87-5868a5201d08 on n-h1-847009-3 Jul 19 22:36:42.450095 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-e1310812-838a-4ea0-9e78-13a893e03ead req-f87e263f-a4d1-438f-9565-6ac84fee7164 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064506 Jul 19 22:36:42.451165 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1153/2316] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:36:42.686433 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3a6e008e-e7ea-44aa-9b95-7516fe192e44 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:42.687052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3a6e008e-e7ea-44aa-9b95-7516fe192e44 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: 7a846129-bc22-4520-bd5b-d33fcd0a94a2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:42.700898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a6e008e-e7ea-44aa-9b95-7516fe192e44 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:42.701389 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a6e008e-e7ea-44aa-9b95-7516fe192e44 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:42.702532 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a6e008e-e7ea-44aa-9b95-7516fe192e44 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:42.704053 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a6e008e-e7ea-44aa-9b95-7516fe192e44 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:43.016437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=8 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:36:43.695204 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cf865352-5b12-4f81-90e0-1ae45ce040bf tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:43.710799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cf865352-5b12-4f81-90e0-1ae45ce040bf tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:43.712734 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cf865352-5b12-4f81-90e0-1ae45ce040bf tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:43.714426 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cf865352-5b12-4f81-90e0-1ae45ce040bf tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 2.030666 Jul 19 22:36:43.728505 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1164/2317] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:36:41 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 2045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:36:43.735269 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-753f6349-1a98-4b8a-b08c-89356566881c tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:43.736626 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-753f6349-1a98-4b8a-b08c-89356566881c tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 0ee48b19-107c-4883-8d87-5868a5201d08] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:43.746823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-753f6349-1a98-4b8a-b08c-89356566881c tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:43.748342 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-753f6349-1a98-4b8a-b08c-89356566881c tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:43.749666 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-753f6349-1a98-4b8a-b08c-89356566881c tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:43.750457 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-753f6349-1a98-4b8a-b08c-89356566881c tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:43.853570 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=15 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:36:44.276976 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3a6e008e-e7ea-44aa-9b95-7516fe192e44 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdcb86f99184c839022f5f19d730e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '994ee0e2b71b4eff88a19b70351ada06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:44.304403 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3a6e008e-e7ea-44aa-9b95-7516fe192e44 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2" status: 200 len: 1318 microversion: 2.1 time: 1.622077 Jul 19 22:36:44.324020 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1154/2318] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:42 2022] GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2 => generated 1318 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:36:44.334655 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-5beef479-37aa-4c1b-bc78-d88a0208c3cb req-9c637049-b0a6-4a29-9e1b-79f7fda5a267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a846129-bc22-4520-bd5b-d33fcd0a94a2", "tag": "f07043ec-4940-4a2a-bfd4-8d23d6ddf88d"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:44.352356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5beef479-37aa-4c1b-bc78-d88a0208c3cb req-9c637049-b0a6-4a29-9e1b-79f7fda5a267 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:44.353447 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5beef479-37aa-4c1b-bc78-d88a0208c3cb req-9c637049-b0a6-4a29-9e1b-79f7fda5a267 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:44.371785 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-5beef479-37aa-4c1b-bc78-d88a0208c3cb req-9c637049-b0a6-4a29-9e1b-79f7fda5a267 service nova] Creating event network-changed:f07043ec-4940-4a2a-bfd4-8d23d6ddf88d for instance 7a846129-bc22-4520-bd5b-d33fcd0a94a2 on n-h2-847009-3 Jul 19 22:36:44.377654 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-5beef479-37aa-4c1b-bc78-d88a0208c3cb req-9c637049-b0a6-4a29-9e1b-79f7fda5a267 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051258 Jul 19 22:36:44.379037 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1155/2319] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:36:44.619228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-753f6349-1a98-4b8a-b08c-89356566881c tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:44.631060 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-753f6349-1a98-4b8a-b08c-89356566881c tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08" status: 200 len: 1322 microversion: 2.1 time: 0.899240 Jul 19 22:36:44.632289 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1165/2320] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:43 2022] GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08 => generated 1322 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:44.737053 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ee23fde9-5bfe-4c4a-a931-2e93f39757bd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:44.738118 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ee23fde9-5bfe-4c4a-a931-2e93f39757bd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:44.748500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee23fde9-5bfe-4c4a-a931-2e93f39757bd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:44.749479 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee23fde9-5bfe-4c4a-a931-2e93f39757bd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:44.750733 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee23fde9-5bfe-4c4a-a931-2e93f39757bd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:44.751967 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee23fde9-5bfe-4c4a-a931-2e93f39757bd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:45.462168 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9e9c5609-f724-4a8e-963a-86e1b0a0c6d0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1885076340", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "0c4e10b3-9ece-4e7a-b6a5-7a85afc8792f"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:45.566222 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-9e9c5609-f724-4a8e-963a-86e1b0a0c6d0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] validate_networks() for [('0c4e10b3-9ece-4e7a-b6a5-7a85afc8792f', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:36:46.677418 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ee23fde9-5bfe-4c4a-a931-2e93f39757bd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:46.715235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ee23fde9-5bfe-4c4a-a931-2e93f39757bd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:46.727965 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ee23fde9-5bfe-4c4a-a931-2e93f39757bd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:46.749200 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ee23fde9-5bfe-4c4a-a931-2e93f39757bd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 1.998745 Jul 19 22:36:46.751397 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1156/2321] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:36:44 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 2022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:36:46.784563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1f0a3818-188d-4253-8300-fa2f3b2167fb tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:46.785442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1f0a3818-188d-4253-8300-fa2f3b2167fb tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: 7a846129-bc22-4520-bd5b-d33fcd0a94a2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:46.795047 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1f0a3818-188d-4253-8300-fa2f3b2167fb tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:46.795744 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1f0a3818-188d-4253-8300-fa2f3b2167fb tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:46.796955 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1f0a3818-188d-4253-8300-fa2f3b2167fb tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:46.798029 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1f0a3818-188d-4253-8300-fa2f3b2167fb tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:47.780507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1f0a3818-188d-4253-8300-fa2f3b2167fb tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdcb86f99184c839022f5f19d730e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '994ee0e2b71b4eff88a19b70351ada06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:47.795952 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1f0a3818-188d-4253-8300-fa2f3b2167fb tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2" status: 200 len: 1318 microversion: 2.1 time: 1.041184 Jul 19 22:36:47.797240 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1157/2322] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:46 2022] GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2 => generated 1318 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:47.816813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e0a2eea3-4512-44c5-be3e-8a674d2fe5b0 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:47.817734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e0a2eea3-4512-44c5-be3e-8a674d2fe5b0 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 0ee48b19-107c-4883-8d87-5868a5201d08] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:47.828757 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e0a2eea3-4512-44c5-be3e-8a674d2fe5b0 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:47.830628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e0a2eea3-4512-44c5-be3e-8a674d2fe5b0 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:47.832001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e0a2eea3-4512-44c5-be3e-8a674d2fe5b0 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:47.834108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e0a2eea3-4512-44c5-be3e-8a674d2fe5b0 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:48.573385 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-9e9c5609-f724-4a8e-963a-86e1b0a0c6d0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:36:48.574733 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-9e9c5609-f724-4a8e-963a-86e1b0a0c6d0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:36:48.575768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-9e9c5609-f724-4a8e-963a-86e1b0a0c6d0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:36:48.576417 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-9e9c5609-f724-4a8e-963a-86e1b0a0c6d0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:36:48.577054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-9e9c5609-f724-4a8e-963a-86e1b0a0c6d0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:36:48.600572 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9e9c5609-f724-4a8e-963a-86e1b0a0c6d0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:48.602382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9e9c5609-f724-4a8e-963a-86e1b0a0c6d0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:48.606124 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9e9c5609-f724-4a8e-963a-86e1b0a0c6d0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:48.607067 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9e9c5609-f724-4a8e-963a-86e1b0a0c6d0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:48.666893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-9e9c5609-f724-4a8e-963a-86e1b0a0c6d0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Getting quotas for project ef7242ed05524293b5dae6a33e520cfc. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:36:48.684155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-9e9c5609-f724-4a8e-963a-86e1b0a0c6d0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Getting quotas for user b6ece721a99a4080a059c635b23761e4 and project ef7242ed05524293b5dae6a33e520cfc. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:36:48.756968 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9e9c5609-f724-4a8e-963a-86e1b0a0c6d0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:36:48.763763 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9e9c5609-f724-4a8e-963a-86e1b0a0c6d0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:36:48.894562 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9e9c5609-f724-4a8e-963a-86e1b0a0c6d0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.725707 Jul 19 22:36:48.906487 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1166/2323] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:36:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:36:48.913226 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b9a20bd7-aa1e-439e-9cc8-6f0058f54d7a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:48.916742 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b9a20bd7-aa1e-439e-9cc8-6f0058f54d7a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:48.927173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b9a20bd7-aa1e-439e-9cc8-6f0058f54d7a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:48.927974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b9a20bd7-aa1e-439e-9cc8-6f0058f54d7a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:48.928948 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b9a20bd7-aa1e-439e-9cc8-6f0058f54d7a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:48.930141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b9a20bd7-aa1e-439e-9cc8-6f0058f54d7a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:49.025866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e0a2eea3-4512-44c5-be3e-8a674d2fe5b0 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:49.052998 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e0a2eea3-4512-44c5-be3e-8a674d2fe5b0 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08" status: 200 len: 1322 microversion: 2.1 time: 1.253150 Jul 19 22:36:49.063223 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1158/2324] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:47 2022] GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08 => generated 1322 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:49.241893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-82415729-1950-4554-b228-0412837b8eea tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'create', calling method: .version_select at 0x7f7a103b34c0>, body: {"keypair": {"name": "tempest-keypair-2054002135", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQcIQy84M/S1R6n21IQ5CrYPavwxrMJ393YRkn4YPNAr5XeXTpoUI4AmiUkq6GYNLw1YNXeBt4P+WdxyXkJR1QqkpwZPnGzw8GzaUXF6ZaHX1P1jQAtL7AKvLM+hPyKpQ=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:49.290763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-82415729-1950-4554-b228-0412837b8eea tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Getting quotas for project 038e4783159e41e3b2cb88df1f8f4a97. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:36:49.301100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-82415729-1950-4554-b228-0412837b8eea tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Getting quotas for user 1f2613ad65b047e8b9a68907406d1874 and project 038e4783159e41e3b2cb88df1f8f4a97. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:36:49.380151 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-82415729-1950-4554-b228-0412837b8eea tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.312829 Jul 19 22:36:49.383459 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1159/2325] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:36:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:36:49.405740 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9f0ec875-09ca-4bb4-b5f3-9e2d92da515c tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:49.407722 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9f0ec875-09ca-4bb4-b5f3-9e2d92da515c tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] [instance: d6189bec-a398-4e64-8e79-0b766af2f833] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:49.427425 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9f0ec875-09ca-4bb4-b5f3-9e2d92da515c tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:49.428063 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9f0ec875-09ca-4bb4-b5f3-9e2d92da515c tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:49.431038 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9f0ec875-09ca-4bb4-b5f3-9e2d92da515c tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:49.431711 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9f0ec875-09ca-4bb4-b5f3-9e2d92da515c tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:51.260665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9f0ec875-09ca-4bb4-b5f3-9e2d92da515c tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f357f1737d4f29b2d594939a06a79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04569d19c85640c48496efb72ef4c20f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:51.267343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b9a20bd7-aa1e-439e-9cc8-6f0058f54d7a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:51.276525 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9f0ec875-09ca-4bb4-b5f3-9e2d92da515c tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] 10.222.0.25 "GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833" status: 200 len: 1588 microversion: 2.1 time: 1.883423 Jul 19 22:36:51.277315 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1160/2326] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:49 2022] GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833 => generated 1588 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:51.289467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b9a20bd7-aa1e-439e-9cc8-6f0058f54d7a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:51.290205 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-5ac61aaf-d622-4af0-a597-01b2e1fe5fd3 req-d15de9fe-d711-434b-ad2f-17c76e90ec7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6189bec-a398-4e64-8e79-0b766af2f833", "tag": "ab5c88e8-cfda-4225-9739-f4f3e8403327"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:51.299214 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b9a20bd7-aa1e-439e-9cc8-6f0058f54d7a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:51.300755 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b9a20bd7-aa1e-439e-9cc8-6f0058f54d7a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 2.392201 Jul 19 22:36:51.301447 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1167/2327] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:36:48 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 2394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:36:51.326622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5ac61aaf-d622-4af0-a597-01b2e1fe5fd3 req-d15de9fe-d711-434b-ad2f-17c76e90ec7a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:51.328842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5ac61aaf-d622-4af0-a597-01b2e1fe5fd3 req-d15de9fe-d711-434b-ad2f-17c76e90ec7a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:51.342083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c7865407-c5a8-4398-a45e-47396b6914e4 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:51.342856 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c7865407-c5a8-4398-a45e-47396b6914e4 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: 7a846129-bc22-4520-bd5b-d33fcd0a94a2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:51.361990 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-5ac61aaf-d622-4af0-a597-01b2e1fe5fd3 req-d15de9fe-d711-434b-ad2f-17c76e90ec7a service nova] Creating event network-changed:ab5c88e8-cfda-4225-9739-f4f3e8403327 for instance d6189bec-a398-4e64-8e79-0b766af2f833 on n-h2-847009-3 Jul 19 22:36:51.379804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c7865407-c5a8-4398-a45e-47396b6914e4 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:51.380274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c7865407-c5a8-4398-a45e-47396b6914e4 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:51.382783 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-5ac61aaf-d622-4af0-a597-01b2e1fe5fd3 req-d15de9fe-d711-434b-ad2f-17c76e90ec7a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102700 Jul 19 22:36:51.385692 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c7865407-c5a8-4398-a45e-47396b6914e4 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:51.386325 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1161/2328] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:36:51.386803 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c7865407-c5a8-4398-a45e-47396b6914e4 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:51.402316 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4d34fe18-0e78-4bd3-9bc0-8df52c2978d5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:51.403691 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4d34fe18-0e78-4bd3-9bc0-8df52c2978d5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:51.424316 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d34fe18-0e78-4bd3-9bc0-8df52c2978d5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:51.425116 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d34fe18-0e78-4bd3-9bc0-8df52c2978d5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:51.430006 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d34fe18-0e78-4bd3-9bc0-8df52c2978d5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:51.430678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d34fe18-0e78-4bd3-9bc0-8df52c2978d5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:51.735828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4d34fe18-0e78-4bd3-9bc0-8df52c2978d5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ece721a99a4080a059c635b23761e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7242ed05524293b5dae6a33e520cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:51.749467 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4d34fe18-0e78-4bd3-9bc0-8df52c2978d5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e" status: 200 len: 1282 microversion: 2.1 time: 0.357010 Jul 19 22:36:51.751582 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1162/2329] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:51 2022] GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e => generated 1282 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:51.760208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a0f97d9e-2365-4519-b638-e9aa32eb9145 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:51.764423 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a0f97d9e-2365-4519-b638-e9aa32eb9145 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 0ee48b19-107c-4883-8d87-5868a5201d08] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:51.788718 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0f97d9e-2365-4519-b638-e9aa32eb9145 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:51.789589 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0f97d9e-2365-4519-b638-e9aa32eb9145 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:51.791454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0f97d9e-2365-4519-b638-e9aa32eb9145 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:51.795313 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0f97d9e-2365-4519-b638-e9aa32eb9145 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:52.220572 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c7865407-c5a8-4398-a45e-47396b6914e4 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdcb86f99184c839022f5f19d730e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '994ee0e2b71b4eff88a19b70351ada06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:52.233065 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c7865407-c5a8-4398-a45e-47396b6914e4 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2" status: 200 len: 1318 microversion: 2.1 time: 0.905777 Jul 19 22:36:52.238153 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1168/2330] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:51 2022] GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2 => generated 1318 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:52.326997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fe878832-a9ec-482c-8979-593ce8251afb tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:52.328701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fe878832-a9ec-482c-8979-593ce8251afb tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:52.348828 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fe878832-a9ec-482c-8979-593ce8251afb tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:52.350173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fe878832-a9ec-482c-8979-593ce8251afb tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:52.351261 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fe878832-a9ec-482c-8979-593ce8251afb tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:52.351915 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fe878832-a9ec-482c-8979-593ce8251afb tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:53.184690 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fe878832-a9ec-482c-8979-593ce8251afb tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:53.211858 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fe878832-a9ec-482c-8979-593ce8251afb tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:53.218064 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fe878832-a9ec-482c-8979-593ce8251afb tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:53.227329 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fe878832-a9ec-482c-8979-593ce8251afb tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 0.902729 Jul 19 22:36:53.227329 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1169/2331] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:36:52 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:36:53.256315 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-893af124-18ca-4bad-8dc4-38019620b621 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:53.257374 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-893af124-18ca-4bad-8dc4-38019620b621 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:53.270057 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-893af124-18ca-4bad-8dc4-38019620b621 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:53.270859 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-893af124-18ca-4bad-8dc4-38019620b621 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:53.272845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-893af124-18ca-4bad-8dc4-38019620b621 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:53.273520 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-893af124-18ca-4bad-8dc4-38019620b621 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:53.406737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a0f97d9e-2365-4519-b638-e9aa32eb9145 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:53.474369 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a0f97d9e-2365-4519-b638-e9aa32eb9145 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08" status: 200 len: 1322 microversion: 2.1 time: 1.706367 Jul 19 22:36:53.475598 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1163/2332] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:51 2022] GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08 => generated 1322 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:53.483066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-325300ac-d8ee-42cc-98ee-2d88b69acfab tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:53.489678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-325300ac-d8ee-42cc-98ee-2d88b69acfab tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: 7a846129-bc22-4520-bd5b-d33fcd0a94a2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:53.510052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-325300ac-d8ee-42cc-98ee-2d88b69acfab tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:53.511919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-325300ac-d8ee-42cc-98ee-2d88b69acfab tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:53.521739 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-325300ac-d8ee-42cc-98ee-2d88b69acfab tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:53.522475 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-325300ac-d8ee-42cc-98ee-2d88b69acfab tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:53.527740 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:36:53.633205 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-893af124-18ca-4bad-8dc4-38019620b621 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ece721a99a4080a059c635b23761e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7242ed05524293b5dae6a33e520cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:53.646309 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-893af124-18ca-4bad-8dc4-38019620b621 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e" status: 200 len: 1282 microversion: 2.1 time: 0.416124 Jul 19 22:36:53.652788 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1170/2333] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:53 2022] GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e => generated 1282 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:53.667633 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-0e37d709-6363-4372-bb61-c639f2916bb4 req-2f46239d-c1a0-421a-9171-b5b0286df6b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf0396df-c757-4ec7-9697-e71026a34525", "tag": "80ac4ef8-2707-46cd-8487-6e07db74d986"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:53.685457 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-0e37d709-6363-4372-bb61-c639f2916bb4 req-2f46239d-c1a0-421a-9171-b5b0286df6b6 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:53.691965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-0e37d709-6363-4372-bb61-c639f2916bb4 req-2f46239d-c1a0-421a-9171-b5b0286df6b6 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:53.725690 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-0e37d709-6363-4372-bb61-c639f2916bb4 req-2f46239d-c1a0-421a-9171-b5b0286df6b6 service nova] Creating event network-changed:80ac4ef8-2707-46cd-8487-6e07db74d986 for instance bf0396df-c757-4ec7-9697-e71026a34525 on n-h1-847009-3 Jul 19 22:36:53.737162 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-0e37d709-6363-4372-bb61-c639f2916bb4 req-2f46239d-c1a0-421a-9171-b5b0286df6b6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082469 Jul 19 22:36:53.737648 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1171/2334] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:36:54.074824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-325300ac-d8ee-42cc-98ee-2d88b69acfab tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdcb86f99184c839022f5f19d730e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '994ee0e2b71b4eff88a19b70351ada06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:54.088354 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-325300ac-d8ee-42cc-98ee-2d88b69acfab tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2" status: 200 len: 1318 microversion: 2.1 time: 0.611430 Jul 19 22:36:54.091866 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1164/2335] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:53 2022] GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2 => generated 1318 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:54.249356 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-08df216e-6387-4feb-936a-4bd78a683af4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:54.250490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-08df216e-6387-4feb-936a-4bd78a683af4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:54.265679 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08df216e-6387-4feb-936a-4bd78a683af4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:54.267628 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08df216e-6387-4feb-936a-4bd78a683af4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:54.272903 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08df216e-6387-4feb-936a-4bd78a683af4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:54.274469 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08df216e-6387-4feb-936a-4bd78a683af4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:54.493558 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-51f988f7-e135-46d5-82f6-db7a1a5d9ae4 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:54.494118 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-51f988f7-e135-46d5-82f6-db7a1a5d9ae4 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 0ee48b19-107c-4883-8d87-5868a5201d08] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:54.503087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51f988f7-e135-46d5-82f6-db7a1a5d9ae4 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:54.503651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51f988f7-e135-46d5-82f6-db7a1a5d9ae4 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:54.504467 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51f988f7-e135-46d5-82f6-db7a1a5d9ae4 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:54.504912 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51f988f7-e135-46d5-82f6-db7a1a5d9ae4 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:55.267957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-08df216e-6387-4feb-936a-4bd78a683af4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:55.285816 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-08df216e-6387-4feb-936a-4bd78a683af4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:55.292303 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-08df216e-6387-4feb-936a-4bd78a683af4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:55.296976 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-08df216e-6387-4feb-936a-4bd78a683af4 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 1.053982 Jul 19 22:36:55.309804 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1172/2336] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:36:54 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:36:55.318291 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-43e18a9f-5ed4-4038-9f53-903a5bb6b26a tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:55.319443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-43e18a9f-5ed4-4038-9f53-903a5bb6b26a tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:55.335351 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-43e18a9f-5ed4-4038-9f53-903a5bb6b26a tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:55.336534 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-43e18a9f-5ed4-4038-9f53-903a5bb6b26a tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:55.337514 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-43e18a9f-5ed4-4038-9f53-903a5bb6b26a tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:55.338111 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-43e18a9f-5ed4-4038-9f53-903a5bb6b26a tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:55.954856 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-43e18a9f-5ed4-4038-9f53-903a5bb6b26a tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ece721a99a4080a059c635b23761e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7242ed05524293b5dae6a33e520cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:55.962764 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-51f988f7-e135-46d5-82f6-db7a1a5d9ae4 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:55.996473 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-51f988f7-e135-46d5-82f6-db7a1a5d9ae4 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08" status: 200 len: 1322 microversion: 2.1 time: 1.506296 Jul 19 22:36:56.001604 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-43e18a9f-5ed4-4038-9f53-903a5bb6b26a tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e" status: 200 len: 1282 microversion: 2.1 time: 0.683080 Jul 19 22:36:56.004657 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1165/2337] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:54 2022] GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08 => generated 1322 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:56.027571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dcae484b-4bec-4b2b-9554-e1db635e3ea8 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:56.028129 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1173/2338] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:55 2022] GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e => generated 1282 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:56.034875 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dcae484b-4bec-4b2b-9554-e1db635e3ea8 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: 7a846129-bc22-4520-bd5b-d33fcd0a94a2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:56.074159 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dcae484b-4bec-4b2b-9554-e1db635e3ea8 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:56.076719 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dcae484b-4bec-4b2b-9554-e1db635e3ea8 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:56.077789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dcae484b-4bec-4b2b-9554-e1db635e3ea8 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:56.078650 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dcae484b-4bec-4b2b-9554-e1db635e3ea8 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:56.323052 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c49d9110-de00-445e-8e4c-8fb23f773dca tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:56.325372 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c49d9110-de00-445e-8e4c-8fb23f773dca tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:56.361127 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c49d9110-de00-445e-8e4c-8fb23f773dca tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:56.361912 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c49d9110-de00-445e-8e4c-8fb23f773dca tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:56.363384 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c49d9110-de00-445e-8e4c-8fb23f773dca tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:56.364207 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c49d9110-de00-445e-8e4c-8fb23f773dca tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:56.615683 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dcae484b-4bec-4b2b-9554-e1db635e3ea8 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdcb86f99184c839022f5f19d730e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '994ee0e2b71b4eff88a19b70351ada06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:56.639900 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dcae484b-4bec-4b2b-9554-e1db635e3ea8 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2" status: 200 len: 1318 microversion: 2.1 time: 0.633822 Jul 19 22:36:56.660459 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1166/2339] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:56 2022] GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2 => generated 1318 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:56.874999 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-b314d836-a744-4284-924f-6cababd020a1 req-4fd8c3dc-2b20-49ff-9a0c-7e3042dc4990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee48b19-107c-4883-8d87-5868a5201d08", "name": "network-vif-plugged", "status": "completed", "tag": "b4de2026-c6d2-47b7-a650-4bd04fa9128f"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:56.897067 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c49d9110-de00-445e-8e4c-8fb23f773dca tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:56.904431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:36:56.917706 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c49d9110-de00-445e-8e4c-8fb23f773dca tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:56.929806 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c49d9110-de00-445e-8e4c-8fb23f773dca tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:56.932172 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c49d9110-de00-445e-8e4c-8fb23f773dca tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 0.617756 Jul 19 22:36:56.945439 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1174/2340] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:36:56 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:36:56.955621 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b314d836-a744-4284-924f-6cababd020a1 req-4fd8c3dc-2b20-49ff-9a0c-7e3042dc4990 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:56.958554 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b314d836-a744-4284-924f-6cababd020a1 req-4fd8c3dc-2b20-49ff-9a0c-7e3042dc4990 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:56.985726 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-b314d836-a744-4284-924f-6cababd020a1 req-4fd8c3dc-2b20-49ff-9a0c-7e3042dc4990 service nova] Creating event network-vif-plugged:b4de2026-c6d2-47b7-a650-4bd04fa9128f for instance 0ee48b19-107c-4883-8d87-5868a5201d08 on n-h1-847009-3 Jul 19 22:36:56.992137 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-b314d836-a744-4284-924f-6cababd020a1 req-4fd8c3dc-2b20-49ff-9a0c-7e3042dc4990 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132341 Jul 19 22:36:56.993820 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1167/2341] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:36:57.014733 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4d24644d-80e0-4030-9c49-1e978b50dcfa tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:57.015151 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4d24644d-80e0-4030-9c49-1e978b50dcfa tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 0ee48b19-107c-4883-8d87-5868a5201d08] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:57.032810 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-df6a65f4-4101-4829-9795-70a7404f1882 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:57.033683 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-df6a65f4-4101-4829-9795-70a7404f1882 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:57.045310 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4d24644d-80e0-4030-9c49-1e978b50dcfa tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:57.045977 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4d24644d-80e0-4030-9c49-1e978b50dcfa tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:57.047556 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4d24644d-80e0-4030-9c49-1e978b50dcfa tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:57.051797 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4d24644d-80e0-4030-9c49-1e978b50dcfa tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:57.063018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-df6a65f4-4101-4829-9795-70a7404f1882 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:57.063867 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-df6a65f4-4101-4829-9795-70a7404f1882 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:57.064850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-df6a65f4-4101-4829-9795-70a7404f1882 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:57.065298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-df6a65f4-4101-4829-9795-70a7404f1882 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:57.737547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-df6a65f4-4101-4829-9795-70a7404f1882 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ece721a99a4080a059c635b23761e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7242ed05524293b5dae6a33e520cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:57.740204 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4d24644d-80e0-4030-9c49-1e978b50dcfa tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:57.748497 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4d24644d-80e0-4030-9c49-1e978b50dcfa tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08" status: 200 len: 1322 microversion: 2.1 time: 0.738323 Jul 19 22:36:57.749105 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1175/2342] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:57 2022] GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08 => generated 1322 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:57.753742 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-df6a65f4-4101-4829-9795-70a7404f1882 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e" status: 200 len: 1324 microversion: 2.1 time: 0.728721 Jul 19 22:36:57.755958 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1168/2343] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:57 2022] GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e => generated 1324 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:57.771270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-58335f79-219b-4932-9f56-d699b7ad6733 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:57.771910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-58335f79-219b-4932-9f56-d699b7ad6733 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: 7a846129-bc22-4520-bd5b-d33fcd0a94a2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:57.793107 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58335f79-219b-4932-9f56-d699b7ad6733 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:57.793572 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58335f79-219b-4932-9f56-d699b7ad6733 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:57.796292 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58335f79-219b-4932-9f56-d699b7ad6733 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:57.796483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58335f79-219b-4932-9f56-d699b7ad6733 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:57.951452 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7b0969cd-130d-41d5-9988-c907947f4642 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:57.953311 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7b0969cd-130d-41d5-9988-c907947f4642 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:57.971420 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b0969cd-130d-41d5-9988-c907947f4642 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:57.972052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b0969cd-130d-41d5-9988-c907947f4642 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:57.973011 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b0969cd-130d-41d5-9988-c907947f4642 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:57.983153 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b0969cd-130d-41d5-9988-c907947f4642 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:58.558329 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-58335f79-219b-4932-9f56-d699b7ad6733 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdcb86f99184c839022f5f19d730e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '994ee0e2b71b4eff88a19b70351ada06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:58.568446 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-58335f79-219b-4932-9f56-d699b7ad6733 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2" status: 200 len: 1318 microversion: 2.1 time: 0.818245 Jul 19 22:36:58.574351 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1176/2344] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:57 2022] GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2 => generated 1318 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:58.583389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-36b441fb-27e7-40cb-8c93-dacdd37cf1d3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-170098623", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e83a825-a2fd-461e-9b4f-f6a6a85fd752"}], "security_groups": [{"name": "tempest-securitygroup--924866741"}], "key_name": "tempest-keypair-2054002135", "user_data": "}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:36:58.627716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=86,nova_api:DELETE=1,nova_api:UPDATE=7 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:36:58.646432 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:36:58.735440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:36:59.085528 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7b0969cd-130d-41d5-9988-c907947f4642 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:59.089512 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-36b441fb-27e7-40cb-8c93-dacdd37cf1d3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] validate_networks() for [('9e83a825-a2fd-461e-9b4f-f6a6a85fd752', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:36:59.103686 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7b0969cd-130d-41d5-9988-c907947f4642 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:59.114992 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7b0969cd-130d-41d5-9988-c907947f4642 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:59.121996 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7b0969cd-130d-41d5-9988-c907947f4642 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 1.172642 Jul 19 22:36:59.124480 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1169/2345] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:36:57 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:36:59.142946 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4fc00417-575c-4a88-a040-f6fc32624ce5 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:59.143662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4fc00417-575c-4a88-a040-f6fc32624ce5 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 0ee48b19-107c-4883-8d87-5868a5201d08] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:59.161673 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4fc00417-575c-4a88-a040-f6fc32624ce5 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:59.167658 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4fc00417-575c-4a88-a040-f6fc32624ce5 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:59.168785 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4fc00417-575c-4a88-a040-f6fc32624ce5 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:59.169398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4fc00417-575c-4a88-a040-f6fc32624ce5 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:59.317292 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:36:59.777208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4fc00417-575c-4a88-a040-f6fc32624ce5 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:36:59.802595 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4fc00417-575c-4a88-a040-f6fc32624ce5 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08" status: 200 len: 1322 microversion: 2.1 time: 0.674357 Jul 19 22:36:59.804635 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1170/2346] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:59 2022] GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08 => generated 1322 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:36:59.810163 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7b24e058-f537-415d-b05e-464230b5b7a2 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:36:59.811644 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7b24e058-f537-415d-b05e-464230b5b7a2 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:36:59.838301 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b24e058-f537-415d-b05e-464230b5b7a2 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:59.840925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b24e058-f537-415d-b05e-464230b5b7a2 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:36:59.842014 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b24e058-f537-415d-b05e-464230b5b7a2 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:36:59.842675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b24e058-f537-415d-b05e-464230b5b7a2 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:00.348798 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7b24e058-f537-415d-b05e-464230b5b7a2 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ece721a99a4080a059c635b23761e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7242ed05524293b5dae6a33e520cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:00.368678 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7b24e058-f537-415d-b05e-464230b5b7a2 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e" status: 200 len: 1324 microversion: 2.1 time: 0.560652 Jul 19 22:37:00.381310 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1171/2347] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:36:59 2022] GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e => generated 1324 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:00.392240 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-c518c2f8-394b-4599-842c-b4037b0b20d0 req-b882c566-887a-4da4-bfaf-ca4069b95a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a846129-bc22-4520-bd5b-d33fcd0a94a2", "name": "network-vif-plugged", "status": "completed", "tag": "f07043ec-4940-4a2a-bfd4-8d23d6ddf88d"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:00.410272 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c518c2f8-394b-4599-842c-b4037b0b20d0 req-b882c566-887a-4da4-bfaf-ca4069b95a66 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:00.410728 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c518c2f8-394b-4599-842c-b4037b0b20d0 req-b882c566-887a-4da4-bfaf-ca4069b95a66 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:00.442650 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-c518c2f8-394b-4599-842c-b4037b0b20d0 req-b882c566-887a-4da4-bfaf-ca4069b95a66 service nova] Creating event network-vif-plugged:f07043ec-4940-4a2a-bfd4-8d23d6ddf88d for instance 7a846129-bc22-4520-bd5b-d33fcd0a94a2 on n-h2-847009-3 Jul 19 22:37:00.448485 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-c518c2f8-394b-4599-842c-b4037b0b20d0 req-b882c566-887a-4da4-bfaf-ca4069b95a66 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065456 Jul 19 22:37:00.449414 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1172/2348] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:00.456333 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c7edd06f-0c7f-4d4f-8067-644f42c21a95 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:00.464822 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c7edd06f-0c7f-4d4f-8067-644f42c21a95 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: 7a846129-bc22-4520-bd5b-d33fcd0a94a2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:00.473132 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7edd06f-0c7f-4d4f-8067-644f42c21a95 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:00.474268 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7edd06f-0c7f-4d4f-8067-644f42c21a95 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:00.475363 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7edd06f-0c7f-4d4f-8067-644f42c21a95 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:00.476698 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7edd06f-0c7f-4d4f-8067-644f42c21a95 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:00.694119 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-36b441fb-27e7-40cb-8c93-dacdd37cf1d3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:37:00.694683 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-36b441fb-27e7-40cb-8c93-dacdd37cf1d3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:37:00.695630 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-36b441fb-27e7-40cb-8c93-dacdd37cf1d3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:37:00.696160 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-36b441fb-27e7-40cb-8c93-dacdd37cf1d3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:37:00.696670 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-36b441fb-27e7-40cb-8c93-dacdd37cf1d3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:37:00.730212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36b441fb-27e7-40cb-8c93-dacdd37cf1d3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:00.731447 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36b441fb-27e7-40cb-8c93-dacdd37cf1d3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:00.733555 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36b441fb-27e7-40cb-8c93-dacdd37cf1d3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:00.734308 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36b441fb-27e7-40cb-8c93-dacdd37cf1d3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:00.761332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-36b441fb-27e7-40cb-8c93-dacdd37cf1d3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Getting quotas for project 038e4783159e41e3b2cb88df1f8f4a97. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:37:00.774672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-36b441fb-27e7-40cb-8c93-dacdd37cf1d3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Getting quotas for user 1f2613ad65b047e8b9a68907406d1874 and project 038e4783159e41e3b2cb88df1f8f4a97. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:37:00.800370 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-36b441fb-27e7-40cb-8c93-dacdd37cf1d3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:37:00.804471 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-36b441fb-27e7-40cb-8c93-dacdd37cf1d3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:37:00.882093 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-36b441fb-27e7-40cb-8c93-dacdd37cf1d3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.305713 Jul 19 22:37:00.883440 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1177/2349] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:36:58 2022] POST /compute/v2.1/servers => generated 408 bytes in 2308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:37:00.893045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9553201a-5c03-4713-863a-04c258345967 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:00.894227 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9553201a-5c03-4713-863a-04c258345967 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:00.908265 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9553201a-5c03-4713-863a-04c258345967 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:00.909395 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9553201a-5c03-4713-863a-04c258345967 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:00.910941 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9553201a-5c03-4713-863a-04c258345967 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:00.911753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9553201a-5c03-4713-863a-04c258345967 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:00.965390 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c7edd06f-0c7f-4d4f-8067-644f42c21a95 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdcb86f99184c839022f5f19d730e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '994ee0e2b71b4eff88a19b70351ada06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:00.981085 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c7edd06f-0c7f-4d4f-8067-644f42c21a95 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2" status: 200 len: 1318 microversion: 2.1 time: 0.526943 Jul 19 22:37:00.984268 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1173/2350] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:00 2022] GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2 => generated 1318 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:00.992343 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6b20d3b4-60c4-469e-8015-580694d5115a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:00.995963 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6b20d3b4-60c4-469e-8015-580694d5115a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 0ee48b19-107c-4883-8d87-5868a5201d08] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:01.011357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b20d3b4-60c4-469e-8015-580694d5115a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:01.012198 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b20d3b4-60c4-469e-8015-580694d5115a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:01.013275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b20d3b4-60c4-469e-8015-580694d5115a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:01.013939 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b20d3b4-60c4-469e-8015-580694d5115a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:01.588073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9553201a-5c03-4713-863a-04c258345967 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:01.615372 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9553201a-5c03-4713-863a-04c258345967 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:01.621768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9553201a-5c03-4713-863a-04c258345967 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:01.623236 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9553201a-5c03-4713-863a-04c258345967 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 0.738285 Jul 19 22:37:01.623886 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1178/2351] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:37:00 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:37:01.665744 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6b20d3b4-60c4-469e-8015-580694d5115a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:01.668712 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cc0aae68-37e7-4b1f-8ffe-151142d330b2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:01.669683 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cc0aae68-37e7-4b1f-8ffe-151142d330b2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:01.683131 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6b20d3b4-60c4-469e-8015-580694d5115a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08" status: 200 len: 1471 microversion: 2.1 time: 0.697176 Jul 19 22:37:01.684778 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1174/2352] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:00 2022] GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08 => generated 1471 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:01.691245 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6b9f8c3d-6217-4d60-8fea-c922f592d091 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:01.692114 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6b9f8c3d-6217-4d60-8fea-c922f592d091 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:01.696235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:37:01.698078 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc0aae68-37e7-4b1f-8ffe-151142d330b2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:01.698828 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc0aae68-37e7-4b1f-8ffe-151142d330b2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:01.699461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc0aae68-37e7-4b1f-8ffe-151142d330b2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:01.699948 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc0aae68-37e7-4b1f-8ffe-151142d330b2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:01.706478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b9f8c3d-6217-4d60-8fea-c922f592d091 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:01.707393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b9f8c3d-6217-4d60-8fea-c922f592d091 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:01.708735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b9f8c3d-6217-4d60-8fea-c922f592d091 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:01.709623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b9f8c3d-6217-4d60-8fea-c922f592d091 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:01.871470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cc0aae68-37e7-4b1f-8ffe-151142d330b2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:01.881543 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cc0aae68-37e7-4b1f-8ffe-151142d330b2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1242 microversion: 2.1 time: 0.249599 Jul 19 22:37:01.886789 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1179/2353] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:01 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1242 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:01.896495 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-1774b8fa-d63d-4707-9b31-b50039ff5d11 req-5fda419c-62cf-43f1-9454-e847cf37ec4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caf65365-ee09-4edc-87d7-e6111559ca2e", "tag": "3d5f4107-f97a-4ed8-ad9b-376b9b2e9563"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:01.925804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1774b8fa-d63d-4707-9b31-b50039ff5d11 req-5fda419c-62cf-43f1-9454-e847cf37ec4b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:01.926273 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1774b8fa-d63d-4707-9b31-b50039ff5d11 req-5fda419c-62cf-43f1-9454-e847cf37ec4b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:01.956545 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-1774b8fa-d63d-4707-9b31-b50039ff5d11 req-5fda419c-62cf-43f1-9454-e847cf37ec4b service nova] Creating event network-changed:3d5f4107-f97a-4ed8-ad9b-376b9b2e9563 for instance caf65365-ee09-4edc-87d7-e6111559ca2e on n-h1-847009-3 Jul 19 22:37:01.966001 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-1774b8fa-d63d-4707-9b31-b50039ff5d11 req-5fda419c-62cf-43f1-9454-e847cf37ec4b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073253 Jul 19 22:37:01.975621 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1180/2354] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:02.163156 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6b9f8c3d-6217-4d60-8fea-c922f592d091 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ece721a99a4080a059c635b23761e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7242ed05524293b5dae6a33e520cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:02.181215 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6b9f8c3d-6217-4d60-8fea-c922f592d091 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e" status: 200 len: 1324 microversion: 2.1 time: 0.494115 Jul 19 22:37:02.185329 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1175/2355] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:01 2022] GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e => generated 1324 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:02.194422 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-80ae4eb7-0c97-45b8-b7b3-d4abaf7e51a3 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:02.196240 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-80ae4eb7-0c97-45b8-b7b3-d4abaf7e51a3 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: 7a846129-bc22-4520-bd5b-d33fcd0a94a2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:02.234198 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-80ae4eb7-0c97-45b8-b7b3-d4abaf7e51a3 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:02.238101 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-80ae4eb7-0c97-45b8-b7b3-d4abaf7e51a3 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:02.242628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-80ae4eb7-0c97-45b8-b7b3-d4abaf7e51a3 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:02.244170 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-80ae4eb7-0c97-45b8-b7b3-d4abaf7e51a3 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:02.350032 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6fbb7f3c-7bff-4c69-8767-74f4b4e66a2f tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:02.350844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6fbb7f3c-7bff-4c69-8767-74f4b4e66a2f tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] [instance: 48ee0e19-21e0-40fe-ac44-af81bf23bafa] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:02.359602 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-6fbb7f3c-7bff-4c69-8767-74f4b4e66a2f tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] HTTP exception thrown: Instance 48ee0e19-21e0-40fe-ac44-af81bf23bafa could not be found. Jul 19 22:37:02.362453 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6fbb7f3c-7bff-4c69-8767-74f4b4e66a2f tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Request method failure captured: Jul 19 22:37:02.362453 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/48ee0e19-21e0-40fe-ac44-af81bf23bafa/action HTTP/1.1 Jul 19 22:37:02.362453 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:37:02.362453 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:37:02.362453 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:37:02.362453 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 15 Jul 19 22:37:02.362453 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:37:02.362453 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:37:02.362453 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:37:02.362453 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:37:02.362453 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zHoS-MiJ-vT6Puf1EBG4ouJC0rtoTTCJYnnxjQlTQzirLLlX12hT4eLLidn_EwHEdT6CMAh-9XRndEe8gIAuIWLm8vWP0XfQB6bz4rLi8NPWrqmhOZFT90Unp2wlgSrdKGDU5M1rszCzMUhs2xckW2PNOGszAnuXr-7_8leS0FACxc Jul 19 22:37:02.362453 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:37:02.362453 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:37:02.362453 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:37:02.362453 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:37:02.362453 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:37:02.362453 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:37:02.362453 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 8d65a1a0a96d4308a22281311d2cd399 Jul 19 22:37:02.362453 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1396123827 Jul 19 22:37:02.362453 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:37:02.362453 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:37:02.364362 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8d65a1a0a96d4308a22281311d2cd399"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8d65a1a0a96d4308a22281311d2cd399"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8d65a1a0a96d4308a22281311d2cd399"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8d65a1a0a96d4308a22281311d2cd399"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:37:02.364362 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1396123827 Jul 19 22:37:02.364362 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 8d65a1a0a96d4308a22281311d2cd399 Jul 19 22:37:02.364362 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1396123827 Jul 19 22:37:02.364362 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersAdminNegativeTestJSON-1396123827-project-admin Jul 19 22:37:02.364362 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:37:02.364362 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:37:02.364362 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 787f532c168847ef83cbc3a75c1ec49d Jul 19 22:37:02.364362 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1396123827-project-admin Jul 19 22:37:02.364362 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:37:02.364362 n-d-847009-3 devstack@n-api.service[119337]: {"migrate": {}} Jul 19 22:37:02.364362 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:37:02.364362 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 48ee0e19-21e0-40fe-ac44-af81bf23bafa could not be found. Jul 19 22:37:02.365377 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '48ee0e19-21e0-40fe-ac44-af81bf23bafa', 'body': {'migrate': {}}} Jul 19 22:37:02.365377 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:37:02.365377 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:37:02.365377 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:37:02.365377 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:37:02.365377 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:37:02.365377 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:37:02.365377 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 22:37:02.365377 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 22:37:02.365377 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48ee0e19-21e0-40fe-ac44-af81bf23bafa could not be found. Jul 19 22:37:02.365377 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:37:02.365377 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:37:02.365377 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:37:02.365377 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:37:02.365377 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:37:02.365377 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:37:02.365377 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:37:02.365377 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:37:02.365377 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:37:02.365377 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:37:02.366803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:37:02.366803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:37:02.366803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 19 22:37:02.366803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 19 22:37:02.366803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:37:02.366803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:37:02.366803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48ee0e19-21e0-40fe-ac44-af81bf23bafa could not be found. Jul 19 22:37:02.366803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:37:02.366803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:37:02.366803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:37:02.366803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:37:02.366803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:37:02.366803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:37:02.366803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:37:02.366803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:37:02.366803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48ee0e19-21e0-40fe-ac44-af81bf23bafa could not be found. Jul 19 22:37:02.366803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:37:02.367993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6fbb7f3c-7bff-4c69-8767-74f4b4e66a2f tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Returning 404 to user: Instance 48ee0e19-21e0-40fe-ac44-af81bf23bafa could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:37:02.369285 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6fbb7f3c-7bff-4c69-8767-74f4b4e66a2f tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/48ee0e19-21e0-40fe-ac44-af81bf23bafa/action" status: 404 len: 111 microversion: 2.1 time: 0.386321 Jul 19 22:37:02.371285 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1181/2356] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:37:01 2022] POST /compute/v2.1/servers/48ee0e19-21e0-40fe-ac44-af81bf23bafa/action => generated 111 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:37:02.420064 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c83f3e0f-5b4f-43df-be9c-ac31ce2e2c2c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-522328863", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "e8d35d5b-f040-43d1-b043-a556d72602ea"}, {"uuid": "ced94d55-1f7d-449f-8ef0-9bc01070c082"}, {"uuid": "e8d35d5b-f040-43d1-b043-a556d72602ea"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:02.519391 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-c83f3e0f-5b4f-43df-be9c-ac31ce2e2c2c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] validate_networks() for [('e8d35d5b-f040-43d1-b043-a556d72602ea', None, None, None, None, None), ('ced94d55-1f7d-449f-8ef0-9bc01070c082', None, None, None, None, None), ('e8d35d5b-f040-43d1-b043-a556d72602ea', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:37:03.272599 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-80ae4eb7-0c97-45b8-b7b3-d4abaf7e51a3 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdcb86f99184c839022f5f19d730e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '994ee0e2b71b4eff88a19b70351ada06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:03.292695 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-80ae4eb7-0c97-45b8-b7b3-d4abaf7e51a3 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2" status: 200 len: 1318 microversion: 2.1 time: 1.105746 Jul 19 22:37:03.307023 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1176/2357] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:02 2022] GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2 => generated 1318 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:03.326718 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a1202d65-5864-4e89-9903-63a10b1deb71 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-633234053", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:03.434663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-a1202d65-5864-4e89-9903-63a10b1deb71 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] validate_networks() for None {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:37:04.305175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-a1202d65-5864-4e89-9903-63a10b1deb71 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:37:04.306060 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-a1202d65-5864-4e89-9903-63a10b1deb71 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:37:04.310990 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-a1202d65-5864-4e89-9903-63a10b1deb71 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:37:04.311886 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-a1202d65-5864-4e89-9903-63a10b1deb71 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:37:04.313731 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-a1202d65-5864-4e89-9903-63a10b1deb71 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:37:04.346014 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1202d65-5864-4e89-9903-63a10b1deb71 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:04.347029 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1202d65-5864-4e89-9903-63a10b1deb71 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:04.348614 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1202d65-5864-4e89-9903-63a10b1deb71 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:04.349562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1202d65-5864-4e89-9903-63a10b1deb71 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:04.395437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-a1202d65-5864-4e89-9903-63a10b1deb71 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Getting quotas for project 6a0799fad79e47d0b0180c0f8834341e. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:37:04.407404 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-a1202d65-5864-4e89-9903-63a10b1deb71 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Getting quotas for user 5f958eb846b04f0fbbe7b95da7d5c328 and project 6a0799fad79e47d0b0180c0f8834341e. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:37:04.435688 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a1202d65-5864-4e89-9903-63a10b1deb71 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:37:04.439400 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a1202d65-5864-4e89-9903-63a10b1deb71 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 4cd615b0-c9c8-422d-bcbb-3de7da85e703] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:37:04.524903 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a1202d65-5864-4e89-9903-63a10b1deb71 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.215845 Jul 19 22:37:04.527685 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1177/2358] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:37:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:37:04.539470 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-4cced65c-0a39-4e1c-85d7-220ae777dc56 req-f2509137-ee89-4d15-a699-82d4f320cce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf0396df-c757-4ec7-9697-e71026a34525", "name": "network-vif-plugged", "status": "completed", "tag": "80ac4ef8-2707-46cd-8487-6e07db74d986"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:04.561076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-4cced65c-0a39-4e1c-85d7-220ae777dc56 req-f2509137-ee89-4d15-a699-82d4f320cce5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:04.561861 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-4cced65c-0a39-4e1c-85d7-220ae777dc56 req-f2509137-ee89-4d15-a699-82d4f320cce5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:04.587042 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-4cced65c-0a39-4e1c-85d7-220ae777dc56 req-f2509137-ee89-4d15-a699-82d4f320cce5 service nova] Creating event network-vif-plugged:80ac4ef8-2707-46cd-8487-6e07db74d986 for instance bf0396df-c757-4ec7-9697-e71026a34525 on n-h1-847009-3 Jul 19 22:37:04.608729 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-4cced65c-0a39-4e1c-85d7-220ae777dc56 req-f2509137-ee89-4d15-a699-82d4f320cce5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078340 Jul 19 22:37:04.619548 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1178/2359] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:04.625088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e080b201-5716-4c55-8ae8-5659e79d32e3 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:04.632549 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e080b201-5716-4c55-8ae8-5659e79d32e3 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:04.657191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e080b201-5716-4c55-8ae8-5659e79d32e3 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:04.657953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e080b201-5716-4c55-8ae8-5659e79d32e3 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:04.667332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e080b201-5716-4c55-8ae8-5659e79d32e3 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:04.668300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e080b201-5716-4c55-8ae8-5659e79d32e3 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:05.116027 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-c83f3e0f-5b4f-43df-be9c-ac31ce2e2c2c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:37:05.117405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-c83f3e0f-5b4f-43df-be9c-ac31ce2e2c2c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:37:05.118200 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-c83f3e0f-5b4f-43df-be9c-ac31ce2e2c2c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:37:05.118790 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-c83f3e0f-5b4f-43df-be9c-ac31ce2e2c2c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:37:05.119511 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-c83f3e0f-5b4f-43df-be9c-ac31ce2e2c2c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:37:05.146542 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c83f3e0f-5b4f-43df-be9c-ac31ce2e2c2c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:05.148928 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c83f3e0f-5b4f-43df-be9c-ac31ce2e2c2c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:05.157559 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c83f3e0f-5b4f-43df-be9c-ac31ce2e2c2c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:05.159522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c83f3e0f-5b4f-43df-be9c-ac31ce2e2c2c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:05.220998 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-c83f3e0f-5b4f-43df-be9c-ac31ce2e2c2c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Getting quotas for project 0f375b652401428bb916ce1f5b04b622. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:37:05.236281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-c83f3e0f-5b4f-43df-be9c-ac31ce2e2c2c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Getting quotas for user d4b3fc46823645a6842433476c0e9b26 and project 0f375b652401428bb916ce1f5b04b622. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:37:05.265587 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c83f3e0f-5b4f-43df-be9c-ac31ce2e2c2c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:37:05.276971 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c83f3e0f-5b4f-43df-be9c-ac31ce2e2c2c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:37:05.401812 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c83f3e0f-5b4f-43df-be9c-ac31ce2e2c2c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.986815 Jul 19 22:37:05.403270 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1182/2360] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:37:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:37:05.412271 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b6c77fb6-c217-48e7-b334-3b61b197497c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:05.413331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b6c77fb6-c217-48e7-b334-3b61b197497c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:05.422166 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6c77fb6-c217-48e7-b334-3b61b197497c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:05.423576 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6c77fb6-c217-48e7-b334-3b61b197497c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:05.425788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6c77fb6-c217-48e7-b334-3b61b197497c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:05.426745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6c77fb6-c217-48e7-b334-3b61b197497c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:05.485432 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e080b201-5716-4c55-8ae8-5659e79d32e3 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:05.512244 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e080b201-5716-4c55-8ae8-5659e79d32e3 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:05.515716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e080b201-5716-4c55-8ae8-5659e79d32e3 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:05.521944 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e080b201-5716-4c55-8ae8-5659e79d32e3 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 0.900953 Jul 19 22:37:05.527461 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1179/2361] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:37:04 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:37:05.540017 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-304eb5bc-87fd-48c7-801c-5ef5e89231d5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:05.540017 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-304eb5bc-87fd-48c7-801c-5ef5e89231d5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:05.552081 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-304eb5bc-87fd-48c7-801c-5ef5e89231d5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:05.552581 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-304eb5bc-87fd-48c7-801c-5ef5e89231d5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:05.553393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-304eb5bc-87fd-48c7-801c-5ef5e89231d5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:05.553818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-304eb5bc-87fd-48c7-801c-5ef5e89231d5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:05.580218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b6c77fb6-c217-48e7-b334-3b61b197497c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:05.590831 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b6c77fb6-c217-48e7-b334-3b61b197497c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1296 microversion: 2.1 time: 0.186297 Jul 19 22:37:05.592276 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1183/2362] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:05 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1296 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:05.607137 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d1ce756f-1485-4ad3-b703-f1be34bdeb14 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:05.608052 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d1ce756f-1485-4ad3-b703-f1be34bdeb14 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: 7a846129-bc22-4520-bd5b-d33fcd0a94a2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:05.635333 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d1ce756f-1485-4ad3-b703-f1be34bdeb14 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:05.635786 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d1ce756f-1485-4ad3-b703-f1be34bdeb14 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:05.636761 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d1ce756f-1485-4ad3-b703-f1be34bdeb14 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:05.637366 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d1ce756f-1485-4ad3-b703-f1be34bdeb14 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:05.941013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-304eb5bc-87fd-48c7-801c-5ef5e89231d5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ece721a99a4080a059c635b23761e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7242ed05524293b5dae6a33e520cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:05.949242 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-304eb5bc-87fd-48c7-801c-5ef5e89231d5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e" status: 200 len: 1324 microversion: 2.1 time: 0.420350 Jul 19 22:37:05.949814 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1180/2363] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:05 2022] GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e => generated 1324 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:05.968470 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f311d9c1-ea98-43e1-a27f-ad19690fa224 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:05.969922 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f311d9c1-ea98-43e1-a27f-ad19690fa224 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 4cd615b0-c9c8-422d-bcbb-3de7da85e703] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:05.994793 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f311d9c1-ea98-43e1-a27f-ad19690fa224 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:05.995623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f311d9c1-ea98-43e1-a27f-ad19690fa224 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:05.996830 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f311d9c1-ea98-43e1-a27f-ad19690fa224 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:05.997653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f311d9c1-ea98-43e1-a27f-ad19690fa224 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:06.045547 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d1ce756f-1485-4ad3-b703-f1be34bdeb14 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdcb86f99184c839022f5f19d730e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '994ee0e2b71b4eff88a19b70351ada06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:06.065173 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d1ce756f-1485-4ad3-b703-f1be34bdeb14 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2" status: 200 len: 1468 microversion: 2.1 time: 0.461717 Jul 19 22:37:06.067250 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1184/2364] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:05 2022] GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2 => generated 1468 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:06.077297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-edb367f3-ad99-44f3-b1d9-a3f2419ac70a tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:06.100277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-edb367f3-ad99-44f3-b1d9-a3f2419ac70a tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:06.238980 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f311d9c1-ea98-43e1-a27f-ad19690fa224 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:06.369031 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f311d9c1-ea98-43e1-a27f-ad19690fa224 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703" status: 200 len: 1273 microversion: 2.1 time: 0.407146 Jul 19 22:37:06.376959 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1181/2365] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:05 2022] GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703 => generated 1273 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:06.382252 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a0ec7434-5a7a-417c-849c-e55ac3959a4a tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:06.385352 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a0ec7434-5a7a-417c-849c-e55ac3959a4a tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: bf0396df-c757-4ec7-9697-e71026a34525] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:06.409470 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0ec7434-5a7a-417c-849c-e55ac3959a4a tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:06.410120 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0ec7434-5a7a-417c-849c-e55ac3959a4a tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:06.411207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0ec7434-5a7a-417c-849c-e55ac3959a4a tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:06.411730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0ec7434-5a7a-417c-849c-e55ac3959a4a tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:06.485924 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-edb367f3-ad99-44f3-b1d9-a3f2419ac70a tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:06.532853 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-edb367f3-ad99-44f3-b1d9-a3f2419ac70a tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 200 len: 1212 microversion: 2.1 time: 0.457251 Jul 19 22:37:06.552045 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1185/2366] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:06 2022] GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 1212 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:06.560716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e3befaaf-e1c0-440a-b98c-45fc2530aa43 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:06.565882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e3befaaf-e1c0-440a-b98c-45fc2530aa43 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:06.588515 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3befaaf-e1c0-440a-b98c-45fc2530aa43 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:06.589501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3befaaf-e1c0-440a-b98c-45fc2530aa43 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:06.593726 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3befaaf-e1c0-440a-b98c-45fc2530aa43 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:06.594820 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3befaaf-e1c0-440a-b98c-45fc2530aa43 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:07.305595 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a0ec7434-5a7a-417c-849c-e55ac3959a4a tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdcb86f99184c839022f5f19d730e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '994ee0e2b71b4eff88a19b70351ada06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:07.341511 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a0ec7434-5a7a-417c-849c-e55ac3959a4a tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/bf0396df-c757-4ec7-9697-e71026a34525" status: 200 len: 1317 microversion: 2.1 time: 0.962797 Jul 19 22:37:07.348965 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1182/2367] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:06 2022] GET /compute/v2.1/servers/bf0396df-c757-4ec7-9697-e71026a34525 => generated 1317 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:07.367621 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7bc430db-7bf7-4232-bf5a-9520718b9278 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:07.369571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7bc430db-7bf7-4232-bf5a-9520718b9278 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:07.417887 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bc430db-7bf7-4232-bf5a-9520718b9278 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:07.419539 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bc430db-7bf7-4232-bf5a-9520718b9278 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:07.423617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bc430db-7bf7-4232-bf5a-9520718b9278 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:07.424477 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bc430db-7bf7-4232-bf5a-9520718b9278 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:07.498133 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:37:08.245163 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e3befaaf-e1c0-440a-b98c-45fc2530aa43 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:08.260298 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e3befaaf-e1c0-440a-b98c-45fc2530aa43 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:08.274992 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e3befaaf-e1c0-440a-b98c-45fc2530aa43 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:08.276897 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e3befaaf-e1c0-440a-b98c-45fc2530aa43 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 1.734289 Jul 19 22:37:08.278111 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1186/2368] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:37:06 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:37:08.283931 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6bee1562-b00e-45a1-8ef8-bb3923162dc1 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:08.292754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6bee1562-b00e-45a1-8ef8-bb3923162dc1 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:08.306082 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6bee1562-b00e-45a1-8ef8-bb3923162dc1 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:08.306544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6bee1562-b00e-45a1-8ef8-bb3923162dc1 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:08.307562 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6bee1562-b00e-45a1-8ef8-bb3923162dc1 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:08.308013 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6bee1562-b00e-45a1-8ef8-bb3923162dc1 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:09.201291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7bc430db-7bf7-4232-bf5a-9520718b9278 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:09.228709 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7bc430db-7bf7-4232-bf5a-9520718b9278 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1363 microversion: 2.1 time: 1.877382 Jul 19 22:37:09.229888 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1183/2369] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:07 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1363 bytes in 1880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:09.237556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-48fdb62d-72b1-4ab3-a82b-fdf1f0e9a4e3 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:09.238576 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-48fdb62d-72b1-4ab3-a82b-fdf1f0e9a4e3 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 4cd615b0-c9c8-422d-bcbb-3de7da85e703] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:09.245934 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48fdb62d-72b1-4ab3-a82b-fdf1f0e9a4e3 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:09.246711 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48fdb62d-72b1-4ab3-a82b-fdf1f0e9a4e3 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:09.247751 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48fdb62d-72b1-4ab3-a82b-fdf1f0e9a4e3 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:09.248421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48fdb62d-72b1-4ab3-a82b-fdf1f0e9a4e3 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:09.379065 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6bee1562-b00e-45a1-8ef8-bb3923162dc1 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ece721a99a4080a059c635b23761e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7242ed05524293b5dae6a33e520cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:09.404735 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6bee1562-b00e-45a1-8ef8-bb3923162dc1 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e" status: 200 len: 1324 microversion: 2.1 time: 1.125128 Jul 19 22:37:09.406004 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1187/2370] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:08 2022] GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e => generated 1324 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:09.413655 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bc7543c6-5cb1-4b05-a145-29db51098598 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:09.421264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bc7543c6-5cb1-4b05-a145-29db51098598 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:09.435994 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc7543c6-5cb1-4b05-a145-29db51098598 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:09.438967 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc7543c6-5cb1-4b05-a145-29db51098598 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:09.447156 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc7543c6-5cb1-4b05-a145-29db51098598 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:09.447967 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc7543c6-5cb1-4b05-a145-29db51098598 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:09.480988 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-48fdb62d-72b1-4ab3-a82b-fdf1f0e9a4e3 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:09.514976 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-48fdb62d-72b1-4ab3-a82b-fdf1f0e9a4e3 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703" status: 200 len: 1279 microversion: 2.1 time: 0.282872 Jul 19 22:37:09.518729 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1184/2371] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:09 2022] GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703 => generated 1279 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:09.544114 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5b4fda2c-7120-4273-a326-4fb6d8286eca tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:09.550281 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5b4fda2c-7120-4273-a326-4fb6d8286eca tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: bf0396df-c757-4ec7-9697-e71026a34525] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:09.578026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b4fda2c-7120-4273-a326-4fb6d8286eca tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:09.584197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b4fda2c-7120-4273-a326-4fb6d8286eca tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:09.586012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b4fda2c-7120-4273-a326-4fb6d8286eca tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:09.587728 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b4fda2c-7120-4273-a326-4fb6d8286eca tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:09.589897 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bc7543c6-5cb1-4b05-a145-29db51098598 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:09.635542 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bc7543c6-5cb1-4b05-a145-29db51098598 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 200 len: 1270 microversion: 2.1 time: 0.221843 Jul 19 22:37:09.636469 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1188/2372] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:09 2022] GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 1270 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:09.665454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-57e68bc6-19b0-421b-876b-7efb25aa8e7f tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:09.667066 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-57e68bc6-19b0-421b-876b-7efb25aa8e7f tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:09.688257 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57e68bc6-19b0-421b-876b-7efb25aa8e7f tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:09.689454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57e68bc6-19b0-421b-876b-7efb25aa8e7f tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:09.693459 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57e68bc6-19b0-421b-876b-7efb25aa8e7f tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:09.694822 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57e68bc6-19b0-421b-876b-7efb25aa8e7f tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:10.863825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5b4fda2c-7120-4273-a326-4fb6d8286eca tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdcb86f99184c839022f5f19d730e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '994ee0e2b71b4eff88a19b70351ada06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:10.882221 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5b4fda2c-7120-4273-a326-4fb6d8286eca tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/bf0396df-c757-4ec7-9697-e71026a34525" status: 200 len: 1466 microversion: 2.1 time: 1.359298 Jul 19 22:37:10.883668 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1185/2373] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:09 2022] GET /compute/v2.1/servers/bf0396df-c757-4ec7-9697-e71026a34525 => generated 1466 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:10.890369 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-de7058ad-0391-4e44-a21a-26f49ccd386b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:10.891713 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-de7058ad-0391-4e44-a21a-26f49ccd386b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:10.908658 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de7058ad-0391-4e44-a21a-26f49ccd386b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:10.909448 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de7058ad-0391-4e44-a21a-26f49ccd386b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:10.910490 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de7058ad-0391-4e44-a21a-26f49ccd386b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:10.911163 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de7058ad-0391-4e44-a21a-26f49ccd386b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:10.937879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-57e68bc6-19b0-421b-876b-7efb25aa8e7f tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:10.959628 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-57e68bc6-19b0-421b-876b-7efb25aa8e7f tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:10.963289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-57e68bc6-19b0-421b-876b-7efb25aa8e7f tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:10.968299 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-57e68bc6-19b0-421b-876b-7efb25aa8e7f tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 1.311218 Jul 19 22:37:10.982227 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1189/2374] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:37:09 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:37:11.003222 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b167e6b1-899b-4e24-8697-3f134b58081e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:11.006295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b167e6b1-899b-4e24-8697-3f134b58081e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:11.021524 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b167e6b1-899b-4e24-8697-3f134b58081e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:11.022249 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b167e6b1-899b-4e24-8697-3f134b58081e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:11.023299 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b167e6b1-899b-4e24-8697-3f134b58081e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:11.025109 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b167e6b1-899b-4e24-8697-3f134b58081e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:11.667773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-de7058ad-0391-4e44-a21a-26f49ccd386b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:11.682178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b167e6b1-899b-4e24-8697-3f134b58081e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ece721a99a4080a059c635b23761e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7242ed05524293b5dae6a33e520cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:11.696662 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b167e6b1-899b-4e24-8697-3f134b58081e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e" status: 200 len: 1324 microversion: 2.1 time: 0.710847 Jul 19 22:37:11.697412 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-de7058ad-0391-4e44-a21a-26f49ccd386b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1363 microversion: 2.1 time: 0.812306 Jul 19 22:37:11.698251 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1186/2375] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:10 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1363 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:11.700512 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1190/2376] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:10 2022] GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e => generated 1324 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:11.713907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-12135f93-4c1e-498f-8d3d-5f6985d4cfc8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:11.715808 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6aed0fd3-a953-4af5-b943-aeb3f024f06d tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:11.717750 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6aed0fd3-a953-4af5-b943-aeb3f024f06d tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 4cd615b0-c9c8-422d-bcbb-3de7da85e703] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:11.718222 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-12135f93-4c1e-498f-8d3d-5f6985d4cfc8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:11.739955 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6aed0fd3-a953-4af5-b943-aeb3f024f06d tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:11.740928 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6aed0fd3-a953-4af5-b943-aeb3f024f06d tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:11.741947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6aed0fd3-a953-4af5-b943-aeb3f024f06d tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:11.742558 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6aed0fd3-a953-4af5-b943-aeb3f024f06d tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:11.747824 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12135f93-4c1e-498f-8d3d-5f6985d4cfc8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:11.748297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12135f93-4c1e-498f-8d3d-5f6985d4cfc8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:11.749114 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12135f93-4c1e-498f-8d3d-5f6985d4cfc8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:11.749558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12135f93-4c1e-498f-8d3d-5f6985d4cfc8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:12.568350 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-12135f93-4c1e-498f-8d3d-5f6985d4cfc8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:12.592181 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-12135f93-4c1e-498f-8d3d-5f6985d4cfc8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 200 len: 1312 microversion: 2.1 time: 0.888461 Jul 19 22:37:12.596411 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1191/2377] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:11 2022] GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 1312 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:12.604521 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5528c61a-4e61-4585-8f61-ecf55a506c6b tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1049642133"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:12.611371 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5528c61a-4e61-4585-8f61-ecf55a506c6b tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: bf0396df-c757-4ec7-9697-e71026a34525] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:12.624828 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5528c61a-4e61-4585-8f61-ecf55a506c6b tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:12.626412 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5528c61a-4e61-4585-8f61-ecf55a506c6b tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:12.628882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5528c61a-4e61-4585-8f61-ecf55a506c6b tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:12.631882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5528c61a-4e61-4585-8f61-ecf55a506c6b tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:12.636364 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6aed0fd3-a953-4af5-b943-aeb3f024f06d tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:12.654475 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6aed0fd3-a953-4af5-b943-aeb3f024f06d tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703" status: 200 len: 1321 microversion: 2.1 time: 0.954325 Jul 19 22:37:12.655627 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1187/2378] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:11 2022] GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703 => generated 1321 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:12.661682 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-8f3ddb18-f5cb-43bc-8880-67aba8cd2e71 req-d01556b5-0feb-42f5-a2aa-ce28f56804a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9ae7d22-3925-465a-9507-250b670ecc77", "tag": "3196bd8c-6a69-4858-81a6-622d724377b1"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:12.684166 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-8f3ddb18-f5cb-43bc-8880-67aba8cd2e71 req-d01556b5-0feb-42f5-a2aa-ce28f56804a3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:12.684874 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-8f3ddb18-f5cb-43bc-8880-67aba8cd2e71 req-d01556b5-0feb-42f5-a2aa-ce28f56804a3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:12.712283 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-8f3ddb18-f5cb-43bc-8880-67aba8cd2e71 req-d01556b5-0feb-42f5-a2aa-ce28f56804a3 service nova] Creating event network-changed:3196bd8c-6a69-4858-81a6-622d724377b1 for instance b9ae7d22-3925-465a-9507-250b670ecc77 on n-h2-847009-3 Jul 19 22:37:12.728685 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-8f3ddb18-f5cb-43bc-8880-67aba8cd2e71 req-d01556b5-0feb-42f5-a2aa-ce28f56804a3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065211 Jul 19 22:37:12.729652 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1188/2379] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:12.735579 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-16848d0b-bfce-4ca1-af18-2f6176682830 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:12.736296 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-16848d0b-bfce-4ca1-af18-2f6176682830 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:12.755074 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16848d0b-bfce-4ca1-af18-2f6176682830 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:12.768067 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16848d0b-bfce-4ca1-af18-2f6176682830 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:12.769221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16848d0b-bfce-4ca1-af18-2f6176682830 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:12.769828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16848d0b-bfce-4ca1-af18-2f6176682830 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:13.203866 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5528c61a-4e61-4585-8f61-ecf55a506c6b tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "POST /compute/v2.1/servers/bf0396df-c757-4ec7-9697-e71026a34525/action" status: 202 len: 0 microversion: 2.1 time: 0.604682 Jul 19 22:37:13.212810 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1192/2380] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:37:12 2022] POST /compute/v2.1/servers/bf0396df-c757-4ec7-9697-e71026a34525/action => generated 0 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 22:37:13.227929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6451fef9-9e41-446a-8161-070215c57a7d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:13.229382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6451fef9-9e41-446a-8161-070215c57a7d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:13.238564 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6451fef9-9e41-446a-8161-070215c57a7d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:13.239443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6451fef9-9e41-446a-8161-070215c57a7d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:13.240528 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6451fef9-9e41-446a-8161-070215c57a7d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:13.241349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6451fef9-9e41-446a-8161-070215c57a7d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:13.566464 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-16848d0b-bfce-4ca1-af18-2f6176682830 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:13.584755 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-16848d0b-bfce-4ca1-af18-2f6176682830 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:13.586340 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-16848d0b-bfce-4ca1-af18-2f6176682830 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:13.587590 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-16848d0b-bfce-4ca1-af18-2f6176682830 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 0.856435 Jul 19 22:37:13.613325 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1189/2381] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:37:12 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:37:13.621593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7c6a9592-b09c-4b88-9b46-e1ff32a38e55 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:13.624685 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7c6a9592-b09c-4b88-9b46-e1ff32a38e55 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:13.638708 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7c6a9592-b09c-4b88-9b46-e1ff32a38e55 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:13.639904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7c6a9592-b09c-4b88-9b46-e1ff32a38e55 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:13.642474 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7c6a9592-b09c-4b88-9b46-e1ff32a38e55 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:13.643142 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7c6a9592-b09c-4b88-9b46-e1ff32a38e55 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:13.758534 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6451fef9-9e41-446a-8161-070215c57a7d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:13.837902 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6451fef9-9e41-446a-8161-070215c57a7d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1363 microversion: 2.1 time: 0.616041 Jul 19 22:37:13.839741 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1193/2382] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:13 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1363 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:13.859031 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e79856df-5d4a-498b-882d-748f3ff3f73f tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a156571f0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:13.969058 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e79856df-5d4a-498b-882d-748f3ff3f73f tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b976644c-69fb-42e4-880b-c54968aac66c" status: 200 len: 1455 microversion: 2.1 time: 0.121886 Jul 19 22:37:13.979453 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1194/2383] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:37:13 2022] GET /compute/v2.1/images/b976644c-69fb-42e4-880b-c54968aac66c => generated 1455 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:13.988356 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a6e1b9d0-16f3-46a6-83a7-34e0675d79b8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:13.990565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a6e1b9d0-16f3-46a6-83a7-34e0675d79b8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:14.006518 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6e1b9d0-16f3-46a6-83a7-34e0675d79b8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:14.012089 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6e1b9d0-16f3-46a6-83a7-34e0675d79b8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:14.014442 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6e1b9d0-16f3-46a6-83a7-34e0675d79b8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:14.015406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6e1b9d0-16f3-46a6-83a7-34e0675d79b8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:14.069933 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:37:14.093354 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7c6a9592-b09c-4b88-9b46-e1ff32a38e55 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ece721a99a4080a059c635b23761e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7242ed05524293b5dae6a33e520cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:14.117042 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7c6a9592-b09c-4b88-9b46-e1ff32a38e55 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e" status: 200 len: 1324 microversion: 2.1 time: 0.501578 Jul 19 22:37:14.137452 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1190/2384] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:13 2022] GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e => generated 1324 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:14.144568 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2b15b256-07ea-4256-b5d3-3fc2dd73a2d1 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:14.145286 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2b15b256-07ea-4256-b5d3-3fc2dd73a2d1 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 4cd615b0-c9c8-422d-bcbb-3de7da85e703] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:14.152287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b15b256-07ea-4256-b5d3-3fc2dd73a2d1 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:14.152855 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b15b256-07ea-4256-b5d3-3fc2dd73a2d1 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:14.153728 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b15b256-07ea-4256-b5d3-3fc2dd73a2d1 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:14.154246 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b15b256-07ea-4256-b5d3-3fc2dd73a2d1 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:14.374866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:37:14.430798 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:37:14.517943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a6e1b9d0-16f3-46a6-83a7-34e0675d79b8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:14.525994 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a6e1b9d0-16f3-46a6-83a7-34e0675d79b8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 200 len: 1312 microversion: 2.1 time: 0.548570 Jul 19 22:37:14.526600 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1195/2385] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:13 2022] GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 1312 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:14.607460 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2b15b256-07ea-4256-b5d3-3fc2dd73a2d1 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:14.618090 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2b15b256-07ea-4256-b5d3-3fc2dd73a2d1 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703" status: 200 len: 1321 microversion: 2.1 time: 0.478822 Jul 19 22:37:14.619317 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1191/2386] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:14 2022] GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703 => generated 1321 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:14.628005 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-97f9aad1-c8e7-4f94-83f3-38f8e0bc3961 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1352672359", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "a64f0a57-5630-4e13-b241-c604d3323992"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:14.644659 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-ae695378-59be-468e-b6a1-0370f0d90df6 req-28dc48a3-721d-4ab1-872f-27f585de8cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cd615b0-c9c8-422d-bcbb-3de7da85e703", "tag": "83aba1bc-e96e-49f4-b92a-4482e94fb923"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:14.660195 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-ae695378-59be-468e-b6a1-0370f0d90df6 req-28dc48a3-721d-4ab1-872f-27f585de8cd7 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:14.660843 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-ae695378-59be-468e-b6a1-0370f0d90df6 req-28dc48a3-721d-4ab1-872f-27f585de8cd7 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:14.704366 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-ae695378-59be-468e-b6a1-0370f0d90df6 req-28dc48a3-721d-4ab1-872f-27f585de8cd7 service nova] Creating event network-changed:83aba1bc-e96e-49f4-b92a-4482e94fb923 for instance 4cd615b0-c9c8-422d-bcbb-3de7da85e703 on n-h1-847009-3 Jul 19 22:37:14.713037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-97f9aad1-c8e7-4f94-83f3-38f8e0bc3961 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] validate_networks() for [('a64f0a57-5630-4e13-b241-c604d3323992', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:37:14.714522 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-ae695378-59be-468e-b6a1-0370f0d90df6 req-28dc48a3-721d-4ab1-872f-27f585de8cd7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093434 Jul 19 22:37:14.715783 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1192/2387] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:14.728039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-227cce5a-e833-48f5-a3fc-b45266cc1f85 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:14.729458 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-227cce5a-e833-48f5-a3fc-b45266cc1f85 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:14.750445 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-227cce5a-e833-48f5-a3fc-b45266cc1f85 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:14.751755 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-227cce5a-e833-48f5-a3fc-b45266cc1f85 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:14.754052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-227cce5a-e833-48f5-a3fc-b45266cc1f85 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:14.755219 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-227cce5a-e833-48f5-a3fc-b45266cc1f85 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:15.193059 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=4 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:37:15.541097 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-227cce5a-e833-48f5-a3fc-b45266cc1f85 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:15.561943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-227cce5a-e833-48f5-a3fc-b45266cc1f85 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:15.563694 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-227cce5a-e833-48f5-a3fc-b45266cc1f85 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:15.568314 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-227cce5a-e833-48f5-a3fc-b45266cc1f85 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 0.850342 Jul 19 22:37:15.568927 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1193/2388] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:37:14 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:37:15.575230 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-666fba70-5973-4400-927d-f2b4f561f6df tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:15.577522 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-666fba70-5973-4400-927d-f2b4f561f6df tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:15.585494 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-666fba70-5973-4400-927d-f2b4f561f6df tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:15.586312 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-666fba70-5973-4400-927d-f2b4f561f6df tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:15.587388 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-666fba70-5973-4400-927d-f2b4f561f6df tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:15.588047 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-666fba70-5973-4400-927d-f2b4f561f6df tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:16.476839 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-666fba70-5973-4400-927d-f2b4f561f6df tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:16.504155 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-666fba70-5973-4400-927d-f2b4f561f6df tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1363 microversion: 2.1 time: 0.932840 Jul 19 22:37:16.504961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=14 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:37:16.516641 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1194/2389] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:15 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1363 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:16.523516 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-4e44d24d-437b-4773-86d1-4d08b96b245b req-4c55cc72-9a32-4b13-a227-896e5d828d80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf65365-ee09-4edc-87d7-e6111559ca2e", "name": "network-vif-plugged", "status": "completed", "tag": "3d5f4107-f97a-4ed8-ad9b-376b9b2e9563"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:16.535912 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-4e44d24d-437b-4773-86d1-4d08b96b245b req-4c55cc72-9a32-4b13-a227-896e5d828d80 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:16.536637 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-4e44d24d-437b-4773-86d1-4d08b96b245b req-4c55cc72-9a32-4b13-a227-896e5d828d80 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:16.554323 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-4e44d24d-437b-4773-86d1-4d08b96b245b req-4c55cc72-9a32-4b13-a227-896e5d828d80 service nova] Creating event network-vif-plugged:3d5f4107-f97a-4ed8-ad9b-376b9b2e9563 for instance caf65365-ee09-4edc-87d7-e6111559ca2e on n-h1-847009-3 Jul 19 22:37:16.574825 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-4e44d24d-437b-4773-86d1-4d08b96b245b req-4c55cc72-9a32-4b13-a227-896e5d828d80 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056070 Jul 19 22:37:16.580057 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1195/2390] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:16.634597 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-55eb6e09-ebff-428c-a2c1-e76bf1c7cfd2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a104263a0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:16.761504 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-55eb6e09-ebff-428c-a2c1-e76bf1c7cfd2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b976644c-69fb-42e4-880b-c54968aac66c" status: 200 len: 1455 microversion: 2.1 time: 0.156198 Jul 19 22:37:16.762102 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1196/2391] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:37:16 2022] GET /compute/v2.1/images/b976644c-69fb-42e4-880b-c54968aac66c => generated 1455 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:16.768417 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-95372062-7c05-4530-9184-d0443640bbe0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:16.769388 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-95372062-7c05-4530-9184-d0443640bbe0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:16.776544 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-95372062-7c05-4530-9184-d0443640bbe0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:16.777272 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-95372062-7c05-4530-9184-d0443640bbe0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:16.778256 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-95372062-7c05-4530-9184-d0443640bbe0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:16.779138 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-95372062-7c05-4530-9184-d0443640bbe0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:17.319769 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-95372062-7c05-4530-9184-d0443640bbe0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ece721a99a4080a059c635b23761e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7242ed05524293b5dae6a33e520cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:17.333446 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-95372062-7c05-4530-9184-d0443640bbe0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e" status: 200 len: 1324 microversion: 2.1 time: 0.570076 Jul 19 22:37:17.334689 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1197/2392] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:16 2022] GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e => generated 1324 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:17.343093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5bf8a7d9-e57b-48ad-941d-ad5ec05c0326 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:17.348087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5bf8a7d9-e57b-48ad-941d-ad5ec05c0326 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:17.357624 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-97f9aad1-c8e7-4f94-83f3-38f8e0bc3961 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:37:17.360628 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-97f9aad1-c8e7-4f94-83f3-38f8e0bc3961 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:37:17.361184 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-97f9aad1-c8e7-4f94-83f3-38f8e0bc3961 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:37:17.361924 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-97f9aad1-c8e7-4f94-83f3-38f8e0bc3961 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:37:17.362493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-97f9aad1-c8e7-4f94-83f3-38f8e0bc3961 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:37:17.371504 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5bf8a7d9-e57b-48ad-941d-ad5ec05c0326 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:17.371984 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5bf8a7d9-e57b-48ad-941d-ad5ec05c0326 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:17.372892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5bf8a7d9-e57b-48ad-941d-ad5ec05c0326 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:17.373340 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5bf8a7d9-e57b-48ad-941d-ad5ec05c0326 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:17.405632 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-97f9aad1-c8e7-4f94-83f3-38f8e0bc3961 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:17.408376 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-97f9aad1-c8e7-4f94-83f3-38f8e0bc3961 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:17.412523 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-97f9aad1-c8e7-4f94-83f3-38f8e0bc3961 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:17.413016 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-97f9aad1-c8e7-4f94-83f3-38f8e0bc3961 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:17.486892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-97f9aad1-c8e7-4f94-83f3-38f8e0bc3961 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Getting quotas for project 6dced22c1fb648bea264ba11fa53884f. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:37:17.497550 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-97f9aad1-c8e7-4f94-83f3-38f8e0bc3961 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Getting quotas for user b22a4202c81a43de895f85ffe1ce00cb and project 6dced22c1fb648bea264ba11fa53884f. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:37:17.530031 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-97f9aad1-c8e7-4f94-83f3-38f8e0bc3961 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:37:17.534405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-97f9aad1-c8e7-4f94-83f3-38f8e0bc3961 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:37:17.646951 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-97f9aad1-c8e7-4f94-83f3-38f8e0bc3961 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.116866 Jul 19 22:37:17.650914 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1196/2393] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:37:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:37:17.674651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a658e4ed-1087-4952-a361-2a28776e6f94 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:17.680431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a658e4ed-1087-4952-a361-2a28776e6f94 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 4cd615b0-c9c8-422d-bcbb-3de7da85e703] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:17.739699 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a658e4ed-1087-4952-a361-2a28776e6f94 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:17.740322 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a658e4ed-1087-4952-a361-2a28776e6f94 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:17.749052 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a658e4ed-1087-4952-a361-2a28776e6f94 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:17.752601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a658e4ed-1087-4952-a361-2a28776e6f94 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:17.767435 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5bf8a7d9-e57b-48ad-941d-ad5ec05c0326 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:17.792091 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5bf8a7d9-e57b-48ad-941d-ad5ec05c0326 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 200 len: 1333 microversion: 2.1 time: 0.453573 Jul 19 22:37:17.806470 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1198/2394] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:17 2022] GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 1333 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:17.815291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-193d2112-ccf8-4877-a95c-75365a603da9 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:17.820396 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-193d2112-ccf8-4877-a95c-75365a603da9 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:17.836701 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-193d2112-ccf8-4877-a95c-75365a603da9 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:17.837703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-193d2112-ccf8-4877-a95c-75365a603da9 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:17.840533 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-193d2112-ccf8-4877-a95c-75365a603da9 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:17.841188 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-193d2112-ccf8-4877-a95c-75365a603da9 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:19.288982 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-193d2112-ccf8-4877-a95c-75365a603da9 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:19.294890 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a658e4ed-1087-4952-a361-2a28776e6f94 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:19.314951 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-193d2112-ccf8-4877-a95c-75365a603da9 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:19.321799 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-193d2112-ccf8-4877-a95c-75365a603da9 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:19.333016 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-193d2112-ccf8-4877-a95c-75365a603da9 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 1.517985 Jul 19 22:37:19.336648 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a658e4ed-1087-4952-a361-2a28776e6f94 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703" status: 200 len: 1321 microversion: 2.1 time: 1.666447 Jul 19 22:37:19.339922 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1197/2395] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:17 2022] GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703 => generated 1321 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:19.352317 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1199/2396] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:37:17 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:37:19.366364 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a5443523-421a-4984-bfe8-01e441828ebf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:19.372698 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a5443523-421a-4984-bfe8-01e441828ebf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:19.383577 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ec00485a-1b1f-4cdd-829f-5391ea08a7c4 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:19.391250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ec00485a-1b1f-4cdd-829f-5391ea08a7c4 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:19.415633 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec00485a-1b1f-4cdd-829f-5391ea08a7c4 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:19.416801 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec00485a-1b1f-4cdd-829f-5391ea08a7c4 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:19.423921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec00485a-1b1f-4cdd-829f-5391ea08a7c4 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:19.426861 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec00485a-1b1f-4cdd-829f-5391ea08a7c4 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:19.427511 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5443523-421a-4984-bfe8-01e441828ebf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:19.428297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5443523-421a-4984-bfe8-01e441828ebf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:19.429926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5443523-421a-4984-bfe8-01e441828ebf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:19.430673 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5443523-421a-4984-bfe8-01e441828ebf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:19.853428 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ec00485a-1b1f-4cdd-829f-5391ea08a7c4 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:19.880081 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ec00485a-1b1f-4cdd-829f-5391ea08a7c4 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1270 microversion: 2.1 time: 0.523988 Jul 19 22:37:19.885619 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1200/2397] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:19 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1270 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:19.904896 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ac99237a-330c-47f4-a22b-df73778bc946 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a104263a0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:20.079892 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ac99237a-330c-47f4-a22b-df73778bc946 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b976644c-69fb-42e4-880b-c54968aac66c" status: 200 len: 1455 microversion: 2.1 time: 0.191364 Jul 19 22:37:20.085742 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1201/2398] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:37:19 2022] GET /compute/v2.1/images/b976644c-69fb-42e4-880b-c54968aac66c => generated 1455 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:20.094575 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dbcaebd3-3590-4e78-99c9-96904ff981e0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:20.114781 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dbcaebd3-3590-4e78-99c9-96904ff981e0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:20.133046 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dbcaebd3-3590-4e78-99c9-96904ff981e0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:20.135437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dbcaebd3-3590-4e78-99c9-96904ff981e0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:20.142948 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dbcaebd3-3590-4e78-99c9-96904ff981e0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:20.144083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dbcaebd3-3590-4e78-99c9-96904ff981e0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:20.548975 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a5443523-421a-4984-bfe8-01e441828ebf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:20.601439 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a5443523-421a-4984-bfe8-01e441828ebf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1363 microversion: 2.1 time: 1.259390 Jul 19 22:37:20.616342 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1198/2399] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:19 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1363 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:20.660789 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7484b6f8-32e2-4a34-895a-0d96707d8e01 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:20.661959 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7484b6f8-32e2-4a34-895a-0d96707d8e01 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:20.720676 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7484b6f8-32e2-4a34-895a-0d96707d8e01 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:20.727323 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7484b6f8-32e2-4a34-895a-0d96707d8e01 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:20.749155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7484b6f8-32e2-4a34-895a-0d96707d8e01 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:20.749716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7484b6f8-32e2-4a34-895a-0d96707d8e01 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:21.799659 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7484b6f8-32e2-4a34-895a-0d96707d8e01 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:21.819045 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7484b6f8-32e2-4a34-895a-0d96707d8e01 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 200 len: 1354 microversion: 2.1 time: 1.200104 Jul 19 22:37:21.820082 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1199/2400] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:20 2022] GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 1354 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:21.829581 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-21371480-cf4d-41c8-9bc0-77ddcdda1167 req-4ce5eb4e-57cd-49b8-a8ee-e5b9478fa5ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf0396df-c757-4ec7-9697-e71026a34525", "name": "network-vif-plugged", "status": "completed", "tag": "80ac4ef8-2707-46cd-8487-6e07db74d986"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:21.848007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-21371480-cf4d-41c8-9bc0-77ddcdda1167 req-4ce5eb4e-57cd-49b8-a8ee-e5b9478fa5ea service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:21.851605 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-21371480-cf4d-41c8-9bc0-77ddcdda1167 req-4ce5eb4e-57cd-49b8-a8ee-e5b9478fa5ea service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:21.852688 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dbcaebd3-3590-4e78-99c9-96904ff981e0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ece721a99a4080a059c635b23761e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7242ed05524293b5dae6a33e520cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:21.885305 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dbcaebd3-3590-4e78-99c9-96904ff981e0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e" status: 200 len: 1520 microversion: 2.1 time: 1.797529 Jul 19 22:37:21.888165 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1202/2401] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:20 2022] GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e => generated 1520 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:21.893416 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-21371480-cf4d-41c8-9bc0-77ddcdda1167 req-4ce5eb4e-57cd-49b8-a8ee-e5b9478fa5ea service nova] Creating event network-vif-plugged:80ac4ef8-2707-46cd-8487-6e07db74d986 for instance bf0396df-c757-4ec7-9697-e71026a34525 on n-h1-847009-3 Jul 19 22:37:21.897525 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dd893a7a-7301-4018-99d3-60ce50a3f76d tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:21.903663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dd893a7a-7301-4018-99d3-60ce50a3f76d tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 4cd615b0-c9c8-422d-bcbb-3de7da85e703] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:21.915207 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-21371480-cf4d-41c8-9bc0-77ddcdda1167 req-4ce5eb4e-57cd-49b8-a8ee-e5b9478fa5ea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093441 Jul 19 22:37:21.921100 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1200/2402] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:21.921883 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd893a7a-7301-4018-99d3-60ce50a3f76d tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:21.926079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd893a7a-7301-4018-99d3-60ce50a3f76d tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:21.927670 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd893a7a-7301-4018-99d3-60ce50a3f76d tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:21.928302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd893a7a-7301-4018-99d3-60ce50a3f76d tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:21.937900 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9db0a7bb-76f5-4ab0-9751-ab88e986924b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:21.939003 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9db0a7bb-76f5-4ab0-9751-ab88e986924b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:21.979688 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9db0a7bb-76f5-4ab0-9751-ab88e986924b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:21.993769 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9db0a7bb-76f5-4ab0-9751-ab88e986924b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:21.997523 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9db0a7bb-76f5-4ab0-9751-ab88e986924b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:22.003241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9db0a7bb-76f5-4ab0-9751-ab88e986924b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:23.120210 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9db0a7bb-76f5-4ab0-9751-ab88e986924b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:23.138316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9db0a7bb-76f5-4ab0-9751-ab88e986924b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:23.146396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9db0a7bb-76f5-4ab0-9751-ab88e986924b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:23.150726 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9db0a7bb-76f5-4ab0-9751-ab88e986924b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 1.227498 Jul 19 22:37:23.154667 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1201/2403] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:37:21 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:37:23.168245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-09192d54-76d5-404b-abae-9e6c3d6ed239 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:23.168892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-09192d54-76d5-404b-abae-9e6c3d6ed239 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:23.179322 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-09192d54-76d5-404b-abae-9e6c3d6ed239 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:23.180161 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-09192d54-76d5-404b-abae-9e6c3d6ed239 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:23.192608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dd893a7a-7301-4018-99d3-60ce50a3f76d tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:23.193192 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-09192d54-76d5-404b-abae-9e6c3d6ed239 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:23.193611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-09192d54-76d5-404b-abae-9e6c3d6ed239 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:23.214435 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dd893a7a-7301-4018-99d3-60ce50a3f76d tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703" status: 200 len: 1321 microversion: 2.1 time: 1.322729 Jul 19 22:37:23.218681 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1203/2404] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:21 2022] GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703 => generated 1321 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:23.231357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a7b29a31-45b4-4636-9320-ade163106871 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a105640d0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:23.315321 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a7b29a31-45b4-4636-9320-ade163106871 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b976644c-69fb-42e4-880b-c54968aac66c" status: 200 len: 1455 microversion: 2.1 time: 0.094307 Jul 19 22:37:23.316175 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1204/2405] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:37:23 2022] GET /compute/v2.1/images/b976644c-69fb-42e4-880b-c54968aac66c => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:23.321605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a77ca33b-8f67-4d9a-98ba-789457ca23a6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:23.322590 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a77ca33b-8f67-4d9a-98ba-789457ca23a6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:23.353506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a77ca33b-8f67-4d9a-98ba-789457ca23a6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:23.354077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a77ca33b-8f67-4d9a-98ba-789457ca23a6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:23.354942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a77ca33b-8f67-4d9a-98ba-789457ca23a6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:23.355425 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a77ca33b-8f67-4d9a-98ba-789457ca23a6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:23.420532 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:37:23.696569 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-09192d54-76d5-404b-abae-9e6c3d6ed239 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:23.706170 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-09192d54-76d5-404b-abae-9e6c3d6ed239 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1318 microversion: 2.1 time: 0.550208 Jul 19 22:37:23.713518 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1202/2406] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:23 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1318 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:23.718535 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-66cdf877-6538-40ae-9a99-f4f02d112a7c tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Action: 'create', calling method: .version_select at 0x7f7a107c74c0>, body: {"pool": null} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:23.981546 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a77ca33b-8f67-4d9a-98ba-789457ca23a6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:23.998194 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a77ca33b-8f67-4d9a-98ba-789457ca23a6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1363 microversion: 2.1 time: 0.680386 Jul 19 22:37:23.999186 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1205/2407] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:23 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1363 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:24.013382 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-256ca91c-f24b-448c-8ff4-e35f73c4b73f tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:24.014113 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-256ca91c-f24b-448c-8ff4-e35f73c4b73f tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:24.024563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-256ca91c-f24b-448c-8ff4-e35f73c4b73f tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:24.025303 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-256ca91c-f24b-448c-8ff4-e35f73c4b73f tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:24.026435 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-256ca91c-f24b-448c-8ff4-e35f73c4b73f tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:24.027964 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-256ca91c-f24b-448c-8ff4-e35f73c4b73f tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:25.404308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-256ca91c-f24b-448c-8ff4-e35f73c4b73f tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:25.418363 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-256ca91c-f24b-448c-8ff4-e35f73c4b73f tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 200 len: 1354 microversion: 2.1 time: 1.418089 Jul 19 22:37:25.431603 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1206/2408] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:23 2022] GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 1354 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:25.446175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-fae8ae4d-894a-4601-9207-52bdc1c34581 req-d54080ff-fc1e-4bc8-be20-5c975ba8c2d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e509d1e-b5d6-4f5f-a017-c2df1d2433f4", "name": "network-vif-plugged", "status": "completed", "tag": "5b0e7351-eaff-4dcf-814a-86252ed1286b"}, {"server_uuid": "6e509d1e-b5d6-4f5f-a017-c2df1d2433f4", "name": "network-vif-plugged", "status": "completed", "tag": "3e008d29-c997-484e-89f5-bf52efc1c101"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:25.469882 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-fae8ae4d-894a-4601-9207-52bdc1c34581 req-d54080ff-fc1e-4bc8-be20-5c975ba8c2d5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:25.473175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-fae8ae4d-894a-4601-9207-52bdc1c34581 req-d54080ff-fc1e-4bc8-be20-5c975ba8c2d5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:25.515143 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-fae8ae4d-894a-4601-9207-52bdc1c34581 req-d54080ff-fc1e-4bc8-be20-5c975ba8c2d5 service nova] Creating event network-vif-plugged:5b0e7351-eaff-4dcf-814a-86252ed1286b for instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 on n-h2-847009-3 Jul 19 22:37:25.516942 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-fae8ae4d-894a-4601-9207-52bdc1c34581 req-d54080ff-fc1e-4bc8-be20-5c975ba8c2d5 service nova] Creating event network-vif-plugged:3e008d29-c997-484e-89f5-bf52efc1c101 for instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 on n-h2-847009-3 Jul 19 22:37:25.530289 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-fae8ae4d-894a-4601-9207-52bdc1c34581 req-d54080ff-fc1e-4bc8-be20-5c975ba8c2d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.094725 Jul 19 22:37:25.534655 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1207/2409] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:25.545845 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ac977a92-d49f-4257-a4f6-d135ea453c8d tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:25.550937 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ac977a92-d49f-4257-a4f6-d135ea453c8d tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:25.583246 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac977a92-d49f-4257-a4f6-d135ea453c8d tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:25.585766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac977a92-d49f-4257-a4f6-d135ea453c8d tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:25.587199 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac977a92-d49f-4257-a4f6-d135ea453c8d tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:25.601235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac977a92-d49f-4257-a4f6-d135ea453c8d tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:27.085184 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ac977a92-d49f-4257-a4f6-d135ea453c8d tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:27.112271 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ac977a92-d49f-4257-a4f6-d135ea453c8d tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:27.114137 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ac977a92-d49f-4257-a4f6-d135ea453c8d tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:27.115867 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ac977a92-d49f-4257-a4f6-d135ea453c8d tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 1.579677 Jul 19 22:37:27.117207 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1208/2410] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:37:25 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:37:27.123311 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-80eeeb5a-01aa-4b07-8f53-7608c348f056 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:27.125756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-80eeeb5a-01aa-4b07-8f53-7608c348f056 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 4cd615b0-c9c8-422d-bcbb-3de7da85e703] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:27.135343 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-80eeeb5a-01aa-4b07-8f53-7608c348f056 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:27.136219 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-80eeeb5a-01aa-4b07-8f53-7608c348f056 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:27.137051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-80eeeb5a-01aa-4b07-8f53-7608c348f056 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:27.137516 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-80eeeb5a-01aa-4b07-8f53-7608c348f056 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:27.456381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:37:27.521473 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:37:27.758973 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-80eeeb5a-01aa-4b07-8f53-7608c348f056 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:27.773467 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-80eeeb5a-01aa-4b07-8f53-7608c348f056 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703" status: 200 len: 1321 microversion: 2.1 time: 0.654737 Jul 19 22:37:27.783439 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1209/2411] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:27 2022] GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703 => generated 1321 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:27.799194 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ff65e527-4ad8-4545-8c51-9c948fb0de48 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a1012e3a0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:27.886134 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ff65e527-4ad8-4545-8c51-9c948fb0de48 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b976644c-69fb-42e4-880b-c54968aac66c" status: 200 len: 1455 microversion: 2.1 time: 0.094857 Jul 19 22:37:27.894201 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1210/2412] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:37:27 2022] GET /compute/v2.1/images/b976644c-69fb-42e4-880b-c54968aac66c => generated 1455 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:27.900682 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-00d0f691-8b35-4b28-b416-7b4b3735d951 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:27.901832 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-00d0f691-8b35-4b28-b416-7b4b3735d951 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:27.911138 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00d0f691-8b35-4b28-b416-7b4b3735d951 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:27.912016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00d0f691-8b35-4b28-b416-7b4b3735d951 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:27.913299 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00d0f691-8b35-4b28-b416-7b4b3735d951 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:27.914565 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00d0f691-8b35-4b28-b416-7b4b3735d951 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:28.555050 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-00d0f691-8b35-4b28-b416-7b4b3735d951 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:28.564963 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-00d0f691-8b35-4b28-b416-7b4b3735d951 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1318 microversion: 2.1 time: 0.668555 Jul 19 22:37:28.565902 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1211/2413] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:27 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1318 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:28.571467 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-34600d9c-310d-4506-ba9b-8f7526b343e1 req-9dabe372-45dd-4856-b85e-de7ac0765e27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f0e6a34-7136-4af6-b710-1b4c0ef0c97a", "tag": "643e30b9-db43-4c54-82b7-713417e3c041"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:28.581754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-34600d9c-310d-4506-ba9b-8f7526b343e1 req-9dabe372-45dd-4856-b85e-de7ac0765e27 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:28.582666 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-34600d9c-310d-4506-ba9b-8f7526b343e1 req-9dabe372-45dd-4856-b85e-de7ac0765e27 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:28.608615 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-34600d9c-310d-4506-ba9b-8f7526b343e1 req-9dabe372-45dd-4856-b85e-de7ac0765e27 service nova] Creating event network-changed:643e30b9-db43-4c54-82b7-713417e3c041 for instance 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a on n-h2-847009-3 Jul 19 22:37:28.621375 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-34600d9c-310d-4506-ba9b-8f7526b343e1 req-9dabe372-45dd-4856-b85e-de7ac0765e27 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052513 Jul 19 22:37:28.623329 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1212/2414] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:28.637821 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5936fafd-d478-4dac-b249-182b725bf9ea tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:28.640432 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5936fafd-d478-4dac-b249-182b725bf9ea tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:28.649273 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5936fafd-d478-4dac-b249-182b725bf9ea tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:28.650871 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5936fafd-d478-4dac-b249-182b725bf9ea tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:28.652989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5936fafd-d478-4dac-b249-182b725bf9ea tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:28.654078 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5936fafd-d478-4dac-b249-182b725bf9ea tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:29.209275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5936fafd-d478-4dac-b249-182b725bf9ea tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:29.238400 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5936fafd-d478-4dac-b249-182b725bf9ea tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1363 microversion: 2.1 time: 0.609678 Jul 19 22:37:29.241723 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1213/2415] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:28 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1363 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:29.257975 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-83ba1b8e-a172-46b8-ba3c-8909d8473c38 req-ad726d2e-0fff-4900-8a75-f64c6d208577 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68ea88aa-1db0-490d-a791-5abd31245b37", "tag": "7f9a6270-b52e-4ef8-8c55-12d663495830"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:29.277340 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-83ba1b8e-a172-46b8-ba3c-8909d8473c38 req-ad726d2e-0fff-4900-8a75-f64c6d208577 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:29.278060 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-83ba1b8e-a172-46b8-ba3c-8909d8473c38 req-ad726d2e-0fff-4900-8a75-f64c6d208577 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:29.314391 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-83ba1b8e-a172-46b8-ba3c-8909d8473c38 req-ad726d2e-0fff-4900-8a75-f64c6d208577 service nova] Creating event network-changed:7f9a6270-b52e-4ef8-8c55-12d663495830 for instance 68ea88aa-1db0-490d-a791-5abd31245b37 on n-h1-847009-3 Jul 19 22:37:29.321709 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-83ba1b8e-a172-46b8-ba3c-8909d8473c38 req-ad726d2e-0fff-4900-8a75-f64c6d208577 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076773 Jul 19 22:37:29.328525 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1214/2416] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:29.335850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-947ad4bc-6f6d-49b9-8063-055c36911abb tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:29.342496 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-947ad4bc-6f6d-49b9-8063-055c36911abb tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:29.358979 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-947ad4bc-6f6d-49b9-8063-055c36911abb tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:29.366259 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-947ad4bc-6f6d-49b9-8063-055c36911abb tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:29.367906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-947ad4bc-6f6d-49b9-8063-055c36911abb tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:29.367906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-947ad4bc-6f6d-49b9-8063-055c36911abb tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:30.023023 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-66cdf877-6538-40ae-9a99-f4f02d112a7c tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.307334 Jul 19 22:37:30.037245 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1203/2417] 10.222.0.25 () {60 vars in 1169 bytes} [Tue Jul 19 22:37:23 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:30.054512 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-88bc3f3b-4a0b-4ba1-b859-2652d1a8da74 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:30.057398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-947ad4bc-6f6d-49b9-8063-055c36911abb tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:30.059187 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-88bc3f3b-4a0b-4ba1-b859-2652d1a8da74 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '35f357f1737d4f29b2d594939a06a79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04569d19c85640c48496efb72ef4c20f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:30.061113 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-88bc3f3b-4a0b-4ba1-b859-2652d1a8da74 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Searching by: {'deleted': False, 'project_id': '04569d19c85640c48496efb72ef4c20f'} {{(pid=119337) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:37:30.068271 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=9 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:37:30.071293 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88bc3f3b-4a0b-4ba1-b859-2652d1a8da74 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:30.072007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88bc3f3b-4a0b-4ba1-b859-2652d1a8da74 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:30.076050 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88bc3f3b-4a0b-4ba1-b859-2652d1a8da74 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:30.076787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88bc3f3b-4a0b-4ba1-b859-2652d1a8da74 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:30.077367 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-947ad4bc-6f6d-49b9-8063-055c36911abb tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 200 len: 1354 microversion: 2.1 time: 0.746412 Jul 19 22:37:30.084074 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1215/2418] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:29 2022] GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 1354 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:30.091420 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-76826d5f-b6eb-4f94-b11d-0f5ad511d56b req-bf449354-2ed5-42fb-b02a-ca8e037306b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e509d1e-b5d6-4f5f-a017-c2df1d2433f4", "name": "network-vif-plugged", "status": "completed", "tag": "12f72f3f-a741-4a92-92f8-08f8ec7273ff"}, {"server_uuid": "4cd615b0-c9c8-422d-bcbb-3de7da85e703", "name": "network-vif-plugged", "status": "completed", "tag": "83aba1bc-e96e-49f4-b92a-4482e94fb923"}, {"server_uuid": "6e509d1e-b5d6-4f5f-a017-c2df1d2433f4", "name": "network-vif-plugged", "status": "completed", "tag": "e9261124-5553-4103-8f06-754a9b357217"}, {"server_uuid": "6e509d1e-b5d6-4f5f-a017-c2df1d2433f4", "name": "network-vif-plugged", "status": "completed", "tag": "4b814275-8b47-43f3-88da-1bc97c3e05e3"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:30.120516 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.multi_cell_list [None req-88bc3f3b-4a0b-4ba1-b859-2652d1a8da74 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119337) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:37:30.137362 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-76826d5f-b6eb-4f94-b11d-0f5ad511d56b req-bf449354-2ed5-42fb-b02a-ca8e037306b4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:30.139159 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-76826d5f-b6eb-4f94-b11d-0f5ad511d56b req-bf449354-2ed5-42fb-b02a-ca8e037306b4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:30.159936 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-88bc3f3b-4a0b-4ba1-b859-2652d1a8da74 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.121251 Jul 19 22:37:30.161230 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1204/2419] 10.222.0.25 () {58 vars in 1124 bytes} [Tue Jul 19 22:37:30 2022] GET /compute/v2.1/servers => generated 339 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:30.167098 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e50ca2e3-e5fd-4c33-8636-53be61266205 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:30.168010 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e50ca2e3-e5fd-4c33-8636-53be61266205 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:30.175128 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e50ca2e3-e5fd-4c33-8636-53be61266205 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:30.176355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e50ca2e3-e5fd-4c33-8636-53be61266205 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:30.177333 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e50ca2e3-e5fd-4c33-8636-53be61266205 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:30.177927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e50ca2e3-e5fd-4c33-8636-53be61266205 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:30.179643 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-76826d5f-b6eb-4f94-b11d-0f5ad511d56b req-bf449354-2ed5-42fb-b02a-ca8e037306b4 service nova] Creating event network-vif-plugged:12f72f3f-a741-4a92-92f8-08f8ec7273ff for instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 on n-h2-847009-3 Jul 19 22:37:30.181843 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-76826d5f-b6eb-4f94-b11d-0f5ad511d56b req-bf449354-2ed5-42fb-b02a-ca8e037306b4 service nova] Creating event network-vif-plugged:83aba1bc-e96e-49f4-b92a-4482e94fb923 for instance 4cd615b0-c9c8-422d-bcbb-3de7da85e703 on n-h1-847009-3 Jul 19 22:37:30.182550 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-76826d5f-b6eb-4f94-b11d-0f5ad511d56b req-bf449354-2ed5-42fb-b02a-ca8e037306b4 service nova] Creating event network-vif-plugged:e9261124-5553-4103-8f06-754a9b357217 for instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 on n-h2-847009-3 Jul 19 22:37:30.183462 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-76826d5f-b6eb-4f94-b11d-0f5ad511d56b req-bf449354-2ed5-42fb-b02a-ca8e037306b4 service nova] Creating event network-vif-plugged:4b814275-8b47-43f3-88da-1bc97c3e05e3 for instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 on n-h2-847009-3 Jul 19 22:37:30.213557 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-76826d5f-b6eb-4f94-b11d-0f5ad511d56b req-bf449354-2ed5-42fb-b02a-ca8e037306b4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.121892 Jul 19 22:37:30.215698 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1216/2420] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:30.230100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7af00fc6-e228-4c7c-97d1-2ff99eda12d6 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:30.238134 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7af00fc6-e228-4c7c-97d1-2ff99eda12d6 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 4cd615b0-c9c8-422d-bcbb-3de7da85e703] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:30.255149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7af00fc6-e228-4c7c-97d1-2ff99eda12d6 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:30.256010 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7af00fc6-e228-4c7c-97d1-2ff99eda12d6 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:30.259276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7af00fc6-e228-4c7c-97d1-2ff99eda12d6 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:30.260822 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7af00fc6-e228-4c7c-97d1-2ff99eda12d6 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:31.212845 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7af00fc6-e228-4c7c-97d1-2ff99eda12d6 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:31.222356 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7af00fc6-e228-4c7c-97d1-2ff99eda12d6 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703" status: 200 len: 1321 microversion: 2.1 time: 1.001241 Jul 19 22:37:31.226186 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1217/2421] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:30 2022] GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703 => generated 1321 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:31.233605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-73754a85-2c0e-4c91-a7d1-3edf68264342 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a104aed30>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:31.238488 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e50ca2e3-e5fd-4c33-8636-53be61266205 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:31.260944 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e50ca2e3-e5fd-4c33-8636-53be61266205 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:31.262473 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e50ca2e3-e5fd-4c33-8636-53be61266205 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:31.263973 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e50ca2e3-e5fd-4c33-8636-53be61266205 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 1.101319 Jul 19 22:37:31.269973 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1205/2422] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:37:30 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:37:31.274545 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4f6c1b64-8253-487e-90b9-56cf663aa77c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:31.275204 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4f6c1b64-8253-487e-90b9-56cf663aa77c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:31.286220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f6c1b64-8253-487e-90b9-56cf663aa77c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:31.286673 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f6c1b64-8253-487e-90b9-56cf663aa77c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:31.287675 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f6c1b64-8253-487e-90b9-56cf663aa77c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:31.288126 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f6c1b64-8253-487e-90b9-56cf663aa77c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:31.330482 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-73754a85-2c0e-4c91-a7d1-3edf68264342 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b976644c-69fb-42e4-880b-c54968aac66c" status: 200 len: 1455 microversion: 2.1 time: 0.101993 Jul 19 22:37:31.331671 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1218/2423] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:37:31 2022] GET /compute/v2.1/images/b976644c-69fb-42e4-880b-c54968aac66c => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:31.340164 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b25a1a4a-6dfb-4f79-9acb-851e4378036e tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:31.349767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b25a1a4a-6dfb-4f79-9acb-851e4378036e tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '35f357f1737d4f29b2d594939a06a79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04569d19c85640c48496efb72ef4c20f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:31.351427 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b25a1a4a-6dfb-4f79-9acb-851e4378036e tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Searching by: {'deleted': False, 'project_id': '04569d19c85640c48496efb72ef4c20f'} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:37:31.358793 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b25a1a4a-6dfb-4f79-9acb-851e4378036e tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:31.360922 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b25a1a4a-6dfb-4f79-9acb-851e4378036e tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:31.361914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b25a1a4a-6dfb-4f79-9acb-851e4378036e tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:31.362748 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b25a1a4a-6dfb-4f79-9acb-851e4378036e tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:31.434905 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.multi_cell_list [None req-b25a1a4a-6dfb-4f79-9acb-851e4378036e tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119338) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:37:31.502167 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b25a1a4a-6dfb-4f79-9acb-851e4378036e tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f357f1737d4f29b2d594939a06a79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04569d19c85640c48496efb72ef4c20f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:31.509229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b25a1a4a-6dfb-4f79-9acb-851e4378036e tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:31.509673 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b25a1a4a-6dfb-4f79-9acb-851e4378036e tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:31.738972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4f6c1b64-8253-487e-90b9-56cf663aa77c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:31.747370 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4f6c1b64-8253-487e-90b9-56cf663aa77c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1318 microversion: 2.1 time: 0.476461 Jul 19 22:37:31.748260 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1206/2424] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:31 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1318 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:31.758676 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3271fe91-1ad9-4ee0-b719-7fe033d4ab6d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:31.759596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3271fe91-1ad9-4ee0-b719-7fe033d4ab6d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:31.788884 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3271fe91-1ad9-4ee0-b719-7fe033d4ab6d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:31.791044 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3271fe91-1ad9-4ee0-b719-7fe033d4ab6d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:31.792122 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3271fe91-1ad9-4ee0-b719-7fe033d4ab6d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:31.793321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3271fe91-1ad9-4ee0-b719-7fe033d4ab6d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:31.869259 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b25a1a4a-6dfb-4f79-9acb-851e4378036e tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.536022 Jul 19 22:37:31.870057 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1219/2425] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:37:31 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:31.889157 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-35264eb1-aa32-43f6-8274-f9a6c569300b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-174412259", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "0c4e10b3-9ece-4e7a-b6a5-7a85afc8792f"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:31.909450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:37:32.009831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-35264eb1-aa32-43f6-8274-f9a6c569300b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] validate_networks() for [('0c4e10b3-9ece-4e7a-b6a5-7a85afc8792f', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:37:32.295877 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3271fe91-1ad9-4ee0-b719-7fe033d4ab6d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:32.316645 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3271fe91-1ad9-4ee0-b719-7fe033d4ab6d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1363 microversion: 2.1 time: 0.565267 Jul 19 22:37:32.330298 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1207/2426] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:31 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1363 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:32.334478 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c93698b8-de7c-44e1-96e3-533ebad5ce79 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:32.335208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c93698b8-de7c-44e1-96e3-533ebad5ce79 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:32.348662 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c93698b8-de7c-44e1-96e3-533ebad5ce79 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:32.349543 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c93698b8-de7c-44e1-96e3-533ebad5ce79 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:32.350595 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c93698b8-de7c-44e1-96e3-533ebad5ce79 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:32.354417 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c93698b8-de7c-44e1-96e3-533ebad5ce79 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:32.867918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c93698b8-de7c-44e1-96e3-533ebad5ce79 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:32.884518 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c93698b8-de7c-44e1-96e3-533ebad5ce79 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 200 len: 1354 microversion: 2.1 time: 0.559093 Jul 19 22:37:32.885148 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1208/2427] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:32 2022] GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 1354 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:32.891068 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-92ba0a53-3dea-48c4-b9dc-ecc1e8dc5329 req-6b971bc1-ef9c-4260-a158-99a066709546 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68ea88aa-1db0-490d-a791-5abd31245b37", "tag": "0e205eb3-7b4d-4e1f-a7b0-ab13afcd2c93"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:32.904853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-92ba0a53-3dea-48c4-b9dc-ecc1e8dc5329 req-6b971bc1-ef9c-4260-a158-99a066709546 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:32.905687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-92ba0a53-3dea-48c4-b9dc-ecc1e8dc5329 req-6b971bc1-ef9c-4260-a158-99a066709546 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:32.928018 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-92ba0a53-3dea-48c4-b9dc-ecc1e8dc5329 req-6b971bc1-ef9c-4260-a158-99a066709546 service nova] Creating event network-changed:0e205eb3-7b4d-4e1f-a7b0-ab13afcd2c93 for instance 68ea88aa-1db0-490d-a791-5abd31245b37 on n-h1-847009-3 Jul 19 22:37:32.933802 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-92ba0a53-3dea-48c4-b9dc-ecc1e8dc5329 req-6b971bc1-ef9c-4260-a158-99a066709546 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047371 Jul 19 22:37:32.934911 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1209/2428] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:32.941584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-596439eb-0eec-40ec-94bc-c424f611de67 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:32.952154 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-596439eb-0eec-40ec-94bc-c424f611de67 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015912 Jul 19 22:37:32.952746 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1210/2429] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:37:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:32.960423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-89c3b802-9bcf-45bb-b25f-5386618b5eee tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:32.961187 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-89c3b802-9bcf-45bb-b25f-5386618b5eee tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 4cd615b0-c9c8-422d-bcbb-3de7da85e703] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:32.969564 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-89c3b802-9bcf-45bb-b25f-5386618b5eee tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:32.970135 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-89c3b802-9bcf-45bb-b25f-5386618b5eee tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:32.970772 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-89c3b802-9bcf-45bb-b25f-5386618b5eee tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:32.971613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-89c3b802-9bcf-45bb-b25f-5386618b5eee tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:33.264923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-89c3b802-9bcf-45bb-b25f-5386618b5eee tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:33.272882 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-89c3b802-9bcf-45bb-b25f-5386618b5eee tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703" status: 200 len: 1471 microversion: 2.1 time: 0.316903 Jul 19 22:37:33.280605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-35264eb1-aa32-43f6-8274-f9a6c569300b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:37:33.280605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-35264eb1-aa32-43f6-8274-f9a6c569300b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:37:33.280605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-35264eb1-aa32-43f6-8274-f9a6c569300b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:37:33.280605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-35264eb1-aa32-43f6-8274-f9a6c569300b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:37:33.280605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-35264eb1-aa32-43f6-8274-f9a6c569300b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:37:33.283671 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1211/2430] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:32 2022] GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703 => generated 1471 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:33.298215 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35264eb1-aa32-43f6-8274-f9a6c569300b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:33.298974 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35264eb1-aa32-43f6-8274-f9a6c569300b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:33.299943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-b75d2688-0145-430e-b46f-ebf0b9afe8ef req-f71f0aa3-b532-4fbd-8541-22f9e3fd72be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9ae7d22-3925-465a-9507-250b670ecc77", "name": "network-vif-plugged", "status": "completed", "tag": "3196bd8c-6a69-4858-81a6-622d724377b1"}, {"server_uuid": "6e509d1e-b5d6-4f5f-a017-c2df1d2433f4", "name": "network-vif-plugged", "status": "completed", "tag": "2c7186d7-bc64-4766-af9a-aacc09242cdb"}, {"server_uuid": "6e509d1e-b5d6-4f5f-a017-c2df1d2433f4", "name": "network-vif-plugged", "status": "completed", "tag": "5842fe2c-d08f-4a4f-8daf-6a8e5788ff55"}, {"server_uuid": "1f0e6a34-7136-4af6-b710-1b4c0ef0c97a", "name": "network-vif-plugged", "status": "completed", "tag": "643e30b9-db43-4c54-82b7-713417e3c041"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:33.300837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35264eb1-aa32-43f6-8274-f9a6c569300b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:33.301655 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35264eb1-aa32-43f6-8274-f9a6c569300b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:33.322328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b75d2688-0145-430e-b46f-ebf0b9afe8ef req-f71f0aa3-b532-4fbd-8541-22f9e3fd72be service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:33.322773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b75d2688-0145-430e-b46f-ebf0b9afe8ef req-f71f0aa3-b532-4fbd-8541-22f9e3fd72be service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:33.329447 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-35264eb1-aa32-43f6-8274-f9a6c569300b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Getting quotas for project ef7242ed05524293b5dae6a33e520cfc. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:37:33.336622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-35264eb1-aa32-43f6-8274-f9a6c569300b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Getting quotas for user b6ece721a99a4080a059c635b23761e4 and project ef7242ed05524293b5dae6a33e520cfc. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:37:33.349361 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-b75d2688-0145-430e-b46f-ebf0b9afe8ef req-f71f0aa3-b532-4fbd-8541-22f9e3fd72be service nova] Creating event network-vif-plugged:3196bd8c-6a69-4858-81a6-622d724377b1 for instance b9ae7d22-3925-465a-9507-250b670ecc77 on n-h2-847009-3 Jul 19 22:37:33.350591 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-b75d2688-0145-430e-b46f-ebf0b9afe8ef req-f71f0aa3-b532-4fbd-8541-22f9e3fd72be service nova] Creating event network-vif-plugged:2c7186d7-bc64-4766-af9a-aacc09242cdb for instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 on n-h2-847009-3 Jul 19 22:37:33.351373 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-b75d2688-0145-430e-b46f-ebf0b9afe8ef req-f71f0aa3-b532-4fbd-8541-22f9e3fd72be service nova] Creating event network-vif-plugged:5842fe2c-d08f-4a4f-8daf-6a8e5788ff55 for instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 on n-h2-847009-3 Jul 19 22:37:33.352159 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-b75d2688-0145-430e-b46f-ebf0b9afe8ef req-f71f0aa3-b532-4fbd-8541-22f9e3fd72be service nova] Creating event network-vif-plugged:643e30b9-db43-4c54-82b7-713417e3c041 for instance 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a on n-h2-847009-3 Jul 19 22:37:33.355787 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-35264eb1-aa32-43f6-8274-f9a6c569300b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:37:33.358103 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-35264eb1-aa32-43f6-8274-f9a6c569300b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: 3e15d03f-3614-4eba-bf41-a0c059b15d56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:37:33.363834 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-b75d2688-0145-430e-b46f-ebf0b9afe8ef req-f71f0aa3-b532-4fbd-8541-22f9e3fd72be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.077896 Jul 19 22:37:33.365149 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1212/2431] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:33.373945 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bcc5a099-28a7-4feb-9573-e6d2e2569b56 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:33.375636 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bcc5a099-28a7-4feb-9573-e6d2e2569b56 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:33.384230 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bcc5a099-28a7-4feb-9573-e6d2e2569b56 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:33.385205 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bcc5a099-28a7-4feb-9573-e6d2e2569b56 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:33.386374 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bcc5a099-28a7-4feb-9573-e6d2e2569b56 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:33.387061 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bcc5a099-28a7-4feb-9573-e6d2e2569b56 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:33.499532 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-35264eb1-aa32-43f6-8274-f9a6c569300b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.618317 Jul 19 22:37:33.507183 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1220/2432] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:37:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:37:33.514008 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-26ffe14c-0ac0-4f14-b4f1-b709d72e3729 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a103c49d0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:33.600063 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-26ffe14c-0ac0-4f14-b4f1-b709d72e3729 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b976644c-69fb-42e4-880b-c54968aac66c" status: 200 len: 1455 microversion: 2.1 time: 0.097512 Jul 19 22:37:33.606476 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1221/2433] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:37:33 2022] GET /compute/v2.1/images/b976644c-69fb-42e4-880b-c54968aac66c => generated 1455 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:33.612499 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-67de4c6a-0449-4805-b045-c8a71e0d4211 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:33.613127 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-67de4c6a-0449-4805-b045-c8a71e0d4211 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:33.635656 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67de4c6a-0449-4805-b045-c8a71e0d4211 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:33.638728 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67de4c6a-0449-4805-b045-c8a71e0d4211 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:33.642878 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67de4c6a-0449-4805-b045-c8a71e0d4211 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:33.643385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67de4c6a-0449-4805-b045-c8a71e0d4211 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:34.049684 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bcc5a099-28a7-4feb-9573-e6d2e2569b56 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:34.067231 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bcc5a099-28a7-4feb-9573-e6d2e2569b56 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:34.068969 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bcc5a099-28a7-4feb-9573-e6d2e2569b56 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:34.070193 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bcc5a099-28a7-4feb-9573-e6d2e2569b56 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 0.703167 Jul 19 22:37:34.070766 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1213/2434] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:37:33 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:37:34.084888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a6e2e537-9b1e-40b8-90d5-97db17472303 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:34.085470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a6e2e537-9b1e-40b8-90d5-97db17472303 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] [instance: 4cd615b0-c9c8-422d-bcbb-3de7da85e703] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:34.102988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6e2e537-9b1e-40b8-90d5-97db17472303 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:34.103643 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6e2e537-9b1e-40b8-90d5-97db17472303 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:34.104698 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6e2e537-9b1e-40b8-90d5-97db17472303 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:34.105236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6e2e537-9b1e-40b8-90d5-97db17472303 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:34.165737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-a6e2e537-9b1e-40b8-90d5-97db17472303 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Lazy-loading 'flavor' on Instance uuid 4cd615b0-c9c8-422d-bcbb-3de7da85e703 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:37:34.219090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-67de4c6a-0449-4805-b045-c8a71e0d4211 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:34.241480 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-67de4c6a-0449-4805-b045-c8a71e0d4211 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1318 microversion: 2.1 time: 0.633766 Jul 19 22:37:34.250625 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1222/2435] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:33 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1318 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:34.259072 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-258f7455-331d-44de-b6f5-b55f1bc5cd4d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:34.260443 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-258f7455-331d-44de-b6f5-b55f1bc5cd4d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] [instance: d6189bec-a398-4e64-8e79-0b766af2f833] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:34.275898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-258f7455-331d-44de-b6f5-b55f1bc5cd4d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:34.278114 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-258f7455-331d-44de-b6f5-b55f1bc5cd4d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:34.279100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-258f7455-331d-44de-b6f5-b55f1bc5cd4d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:34.284264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-258f7455-331d-44de-b6f5-b55f1bc5cd4d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:34.309298 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:37:34.349010 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-258f7455-331d-44de-b6f5-b55f1bc5cd4d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] [instance: d6189bec-a398-4e64-8e79-0b766af2f833] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:37:34.358309 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a6e2e537-9b1e-40b8-90d5-97db17472303 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703/action" status: 202 len: 0 microversion: 2.1 time: 0.283888 Jul 19 22:37:34.362241 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1214/2436] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:37:34 2022] POST /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:37:34.373574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3f736e8a-6815-4e39-a0b4-59182e85cd21 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:34.375261 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3f736e8a-6815-4e39-a0b4-59182e85cd21 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:34.399511 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f736e8a-6815-4e39-a0b4-59182e85cd21 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:34.401460 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f736e8a-6815-4e39-a0b4-59182e85cd21 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:34.403673 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f736e8a-6815-4e39-a0b4-59182e85cd21 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:34.407457 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f736e8a-6815-4e39-a0b4-59182e85cd21 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:34.537878 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-258f7455-331d-44de-b6f5-b55f1bc5cd4d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833" status: 204 len: 0 microversion: 2.1 time: 0.283853 Jul 19 22:37:34.539568 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1223/2437] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:37:34 2022] DELETE /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:37:34.551019 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2b7b5037-57e5-4e19-a572-2a68317ac9b3 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:34.553291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2b7b5037-57e5-4e19-a572-2a68317ac9b3 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: 3e15d03f-3614-4eba-bf41-a0c059b15d56] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:34.568327 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b7b5037-57e5-4e19-a572-2a68317ac9b3 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:34.568972 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b7b5037-57e5-4e19-a572-2a68317ac9b3 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:34.570171 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b7b5037-57e5-4e19-a572-2a68317ac9b3 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:34.570838 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b7b5037-57e5-4e19-a572-2a68317ac9b3 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:34.688672 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2b7b5037-57e5-4e19-a572-2a68317ac9b3 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ece721a99a4080a059c635b23761e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7242ed05524293b5dae6a33e520cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:34.721369 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2b7b5037-57e5-4e19-a572-2a68317ac9b3 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56" status: 200 len: 1227 microversion: 2.1 time: 0.180070 Jul 19 22:37:34.729964 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1224/2438] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:34 2022] GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56 => generated 1227 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:34.742812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-02286205-8e82-434e-9295-b2972702642a tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:34.744224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-02286205-8e82-434e-9295-b2972702642a tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:34.753618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02286205-8e82-434e-9295-b2972702642a tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:34.754244 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02286205-8e82-434e-9295-b2972702642a tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:34.755186 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02286205-8e82-434e-9295-b2972702642a tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:34.755734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02286205-8e82-434e-9295-b2972702642a tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:34.798044 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3f736e8a-6815-4e39-a0b4-59182e85cd21 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:34.806853 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3f736e8a-6815-4e39-a0b4-59182e85cd21 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1363 microversion: 2.1 time: 0.442358 Jul 19 22:37:34.822333 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1215/2439] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:34 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1363 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:34.827185 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dcd42844-31ac-4aad-a3de-27c5f6a9492d tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:34.828106 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dcd42844-31ac-4aad-a3de-27c5f6a9492d tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] [instance: 4cd615b0-c9c8-422d-bcbb-3de7da85e703] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:34.835161 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dcd42844-31ac-4aad-a3de-27c5f6a9492d tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:34.835774 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dcd42844-31ac-4aad-a3de-27c5f6a9492d tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:34.836674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dcd42844-31ac-4aad-a3de-27c5f6a9492d tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:34.837338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dcd42844-31ac-4aad-a3de-27c5f6a9492d tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:35.252857 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-02286205-8e82-434e-9295-b2972702642a tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:35.257701 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:37:35.292078 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-02286205-8e82-434e-9295-b2972702642a tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 200 len: 1354 microversion: 2.1 time: 0.558983 Jul 19 22:37:35.294754 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1225/2440] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:34 2022] GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 1354 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:35.300892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-18d5d04e-57bf-4d9b-b6b7-dfa17a6c6fe8 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:35.302035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-18d5d04e-57bf-4d9b-b6b7-dfa17a6c6fe8 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] [instance: d6189bec-a398-4e64-8e79-0b766af2f833] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:35.318469 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-18d5d04e-57bf-4d9b-b6b7-dfa17a6c6fe8 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:35.319467 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-18d5d04e-57bf-4d9b-b6b7-dfa17a6c6fe8 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:35.320555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-18d5d04e-57bf-4d9b-b6b7-dfa17a6c6fe8 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:35.321240 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-18d5d04e-57bf-4d9b-b6b7-dfa17a6c6fe8 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:35.754246 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-18d5d04e-57bf-4d9b-b6b7-dfa17a6c6fe8 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f357f1737d4f29b2d594939a06a79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04569d19c85640c48496efb72ef4c20f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:35.765849 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dcd42844-31ac-4aad-a3de-27c5f6a9492d tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703" status: 200 len: 1630 microversion: 2.1 time: 0.938485 Jul 19 22:37:35.768154 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1216/2441] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:34 2022] GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703 => generated 1630 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:35.773575 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cb7ebe89-56c5-428b-86f5-d70cb86ab639 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a156a7a60>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:35.850019 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-18d5d04e-57bf-4d9b-b6b7-dfa17a6c6fe8 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] 10.222.0.25 "GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833" status: 200 len: 1713 microversion: 2.1 time: 0.553102 Jul 19 22:37:35.856675 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1226/2442] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:35 2022] GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833 => generated 1713 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:35.862643 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-49c556f1-c3c5-4664-ade9-44b20cd1493a req-b6745031-0eaa-48f0-97ee-267f431596dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68ea88aa-1db0-490d-a791-5abd31245b37", "tag": "cb002f98-bd53-40ce-a87d-725fad84c3c7"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:35.875766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-49c556f1-c3c5-4664-ade9-44b20cd1493a req-b6745031-0eaa-48f0-97ee-267f431596dd service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:35.876287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-49c556f1-c3c5-4664-ade9-44b20cd1493a req-b6745031-0eaa-48f0-97ee-267f431596dd service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:35.879756 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cb7ebe89-56c5-428b-86f5-d70cb86ab639 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b976644c-69fb-42e4-880b-c54968aac66c" status: 200 len: 1455 microversion: 2.1 time: 0.109934 Jul 19 22:37:35.880567 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1217/2443] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:37:35 2022] GET /compute/v2.1/images/b976644c-69fb-42e4-880b-c54968aac66c => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:35.885446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-836e8414-e4e5-44bc-9bcb-8bf73dba9972 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:35.890963 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-836e8414-e4e5-44bc-9bcb-8bf73dba9972 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:35.893807 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-836e8414-e4e5-44bc-9bcb-8bf73dba9972 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:35.894960 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-836e8414-e4e5-44bc-9bcb-8bf73dba9972 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:35.895946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-836e8414-e4e5-44bc-9bcb-8bf73dba9972 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:35.896266 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-836e8414-e4e5-44bc-9bcb-8bf73dba9972 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:35.900200 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-49c556f1-c3c5-4664-ade9-44b20cd1493a req-b6745031-0eaa-48f0-97ee-267f431596dd service nova] Creating event network-changed:cb002f98-bd53-40ce-a87d-725fad84c3c7 for instance 68ea88aa-1db0-490d-a791-5abd31245b37 on n-h1-847009-3 Jul 19 22:37:35.911141 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-49c556f1-c3c5-4664-ade9-44b20cd1493a req-b6745031-0eaa-48f0-97ee-267f431596dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052393 Jul 19 22:37:35.912762 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1227/2444] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:35.923253 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ae7d0e71-3da7-4449-8b20-dfa3c1b7aff0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:35.924550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ae7d0e71-3da7-4449-8b20-dfa3c1b7aff0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:35.937732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ae7d0e71-3da7-4449-8b20-dfa3c1b7aff0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:35.938595 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ae7d0e71-3da7-4449-8b20-dfa3c1b7aff0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:35.939718 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ae7d0e71-3da7-4449-8b20-dfa3c1b7aff0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:35.941278 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ae7d0e71-3da7-4449-8b20-dfa3c1b7aff0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:36.313846 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-836e8414-e4e5-44bc-9bcb-8bf73dba9972 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:36.323378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-836e8414-e4e5-44bc-9bcb-8bf73dba9972 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:36.325500 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-836e8414-e4e5-44bc-9bcb-8bf73dba9972 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:36.326811 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-836e8414-e4e5-44bc-9bcb-8bf73dba9972 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 0.445150 Jul 19 22:37:36.338753 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1218/2445] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:37:35 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:37:36.344153 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c58890d3-5ccb-4a56-93f1-41aad87f7d11 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:36.345195 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c58890d3-5ccb-4a56-93f1-41aad87f7d11 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: 3e15d03f-3614-4eba-bf41-a0c059b15d56] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:36.349911 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ae7d0e71-3da7-4449-8b20-dfa3c1b7aff0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:36.352825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c58890d3-5ccb-4a56-93f1-41aad87f7d11 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:36.353368 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c58890d3-5ccb-4a56-93f1-41aad87f7d11 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:36.354249 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c58890d3-5ccb-4a56-93f1-41aad87f7d11 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:36.354897 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c58890d3-5ccb-4a56-93f1-41aad87f7d11 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:36.364006 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ae7d0e71-3da7-4449-8b20-dfa3c1b7aff0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1318 microversion: 2.1 time: 0.449471 Jul 19 22:37:36.370646 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1228/2446] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:35 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:36.375622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fe6e7c33-5410-42da-b9bd-34d23c20d4ff tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:36.376492 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fe6e7c33-5410-42da-b9bd-34d23c20d4ff tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:36.386926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe6e7c33-5410-42da-b9bd-34d23c20d4ff tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:36.388879 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe6e7c33-5410-42da-b9bd-34d23c20d4ff tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:36.391011 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe6e7c33-5410-42da-b9bd-34d23c20d4ff tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:36.391855 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe6e7c33-5410-42da-b9bd-34d23c20d4ff tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:36.456265 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c58890d3-5ccb-4a56-93f1-41aad87f7d11 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ece721a99a4080a059c635b23761e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7242ed05524293b5dae6a33e520cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:36.470224 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c58890d3-5ccb-4a56-93f1-41aad87f7d11 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56" status: 200 len: 1219 microversion: 2.1 time: 0.129682 Jul 19 22:37:36.471223 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1219/2447] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:36 2022] GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56 => generated 1219 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:36.476954 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8f3c515d-98c5-454d-ba28-cb92a51bf36b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:36.477433 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8f3c515d-98c5-454d-ba28-cb92a51bf36b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:36.485137 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f3c515d-98c5-454d-ba28-cb92a51bf36b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:36.492470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f3c515d-98c5-454d-ba28-cb92a51bf36b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:36.493758 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f3c515d-98c5-454d-ba28-cb92a51bf36b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:36.494704 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f3c515d-98c5-454d-ba28-cb92a51bf36b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:36.680701 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fe6e7c33-5410-42da-b9bd-34d23c20d4ff tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:36.689606 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fe6e7c33-5410-42da-b9bd-34d23c20d4ff tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1550 microversion: 2.1 time: 0.323308 Jul 19 22:37:36.690496 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1229/2448] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:36 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1550 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:36.710473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-afdf1d31-b458-48e9-8ee0-382e13bd033f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:36.710988 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-afdf1d31-b458-48e9-8ee0-382e13bd033f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:36.712415 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8f3c515d-98c5-454d-ba28-cb92a51bf36b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:36.718179 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-afdf1d31-b458-48e9-8ee0-382e13bd033f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:36.719533 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-afdf1d31-b458-48e9-8ee0-382e13bd033f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:36.720067 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-afdf1d31-b458-48e9-8ee0-382e13bd033f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:36.720437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-afdf1d31-b458-48e9-8ee0-382e13bd033f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:36.724917 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8f3c515d-98c5-454d-ba28-cb92a51bf36b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 200 len: 1354 microversion: 2.1 time: 0.252112 Jul 19 22:37:36.725700 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1220/2449] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:36 2022] GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 1354 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:36.791645 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c889fc49-a67b-4a10-88f3-991a0d58730b tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:36.792539 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c889fc49-a67b-4a10-88f3-991a0d58730b tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] [instance: 4cd615b0-c9c8-422d-bcbb-3de7da85e703] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:36.799328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c889fc49-a67b-4a10-88f3-991a0d58730b tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:36.800055 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c889fc49-a67b-4a10-88f3-991a0d58730b tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:36.800874 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c889fc49-a67b-4a10-88f3-991a0d58730b tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:36.801292 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c889fc49-a67b-4a10-88f3-991a0d58730b tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:36.811761 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-afdf1d31-b458-48e9-8ee0-382e13bd033f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105286 Jul 19 22:37:36.812603 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1230/2450] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 19 22:37:36 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:37:36.883725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-200b2160-eb03-4112-a036-746a7a5b6403 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:36.884250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-200b2160-eb03-4112-a036-746a7a5b6403 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] [instance: d6189bec-a398-4e64-8e79-0b766af2f833] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:36.894127 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-200b2160-eb03-4112-a036-746a7a5b6403 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:36.894901 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-200b2160-eb03-4112-a036-746a7a5b6403 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:36.896577 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-200b2160-eb03-4112-a036-746a7a5b6403 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:36.897357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-200b2160-eb03-4112-a036-746a7a5b6403 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:37.619976 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c889fc49-a67b-4a10-88f3-991a0d58730b tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703" status: 200 len: 1613 microversion: 2.1 time: 0.832050 Jul 19 22:37:37.630467 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1221/2451] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:36 2022] GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703 => generated 1613 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:37.630467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-aac080cf-737d-40b4-8d51-b26cbb4ffa6b tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a104b9b80>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:37.692040 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-aac080cf-737d-40b4-8d51-b26cbb4ffa6b tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b976644c-69fb-42e4-880b-c54968aac66c" status: 200 len: 1464 microversion: 2.1 time: 0.069343 Jul 19 22:37:37.693085 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1222/2452] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:37:37 2022] GET /compute/v2.1/images/b976644c-69fb-42e4-880b-c54968aac66c => generated 1464 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:37.696209 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-200b2160-eb03-4112-a036-746a7a5b6403 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f357f1737d4f29b2d594939a06a79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04569d19c85640c48496efb72ef4c20f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:37.697697 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-78f3d555-550b-461c-927d-f3817aad694a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:37.698333 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-78f3d555-550b-461c-927d-f3817aad694a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:37.706571 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-78f3d555-550b-461c-927d-f3817aad694a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:37.707034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-78f3d555-550b-461c-927d-f3817aad694a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:37.707862 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-78f3d555-550b-461c-927d-f3817aad694a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:37.708312 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-78f3d555-550b-461c-927d-f3817aad694a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:37.709930 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-200b2160-eb03-4112-a036-746a7a5b6403 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] 10.222.0.25 "GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833" status: 200 len: 1713 microversion: 2.1 time: 0.830667 Jul 19 22:37:37.723417 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1231/2453] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:36 2022] GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833 => generated 1713 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:37:37.723417 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6c1482d1-cbeb-4d2e-b51c-1a47607b5f86 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:37.723417 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6c1482d1-cbeb-4d2e-b51c-1a47607b5f86 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:37.724609 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c1482d1-cbeb-4d2e-b51c-1a47607b5f86 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:37.724855 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c1482d1-cbeb-4d2e-b51c-1a47607b5f86 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:37.729039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c1482d1-cbeb-4d2e-b51c-1a47607b5f86 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:37.729039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c1482d1-cbeb-4d2e-b51c-1a47607b5f86 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:38.290070 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6c1482d1-cbeb-4d2e-b51c-1a47607b5f86 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:38.303408 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6c1482d1-cbeb-4d2e-b51c-1a47607b5f86 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1508 microversion: 2.1 time: 0.591203 Jul 19 22:37:38.304152 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1232/2454] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:37 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1508 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:38.309358 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dde10cf5-4b83-47e2-aef9-47e44cf8a7f5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:38.309563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dde10cf5-4b83-47e2-aef9-47e44cf8a7f5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: 3e15d03f-3614-4eba-bf41-a0c059b15d56] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:38.319874 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dde10cf5-4b83-47e2-aef9-47e44cf8a7f5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:38.320544 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dde10cf5-4b83-47e2-aef9-47e44cf8a7f5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:38.321421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dde10cf5-4b83-47e2-aef9-47e44cf8a7f5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:38.322217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dde10cf5-4b83-47e2-aef9-47e44cf8a7f5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:38.396899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-78f3d555-550b-461c-927d-f3817aad694a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:38.411431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-78f3d555-550b-461c-927d-f3817aad694a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:38.413442 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-78f3d555-550b-461c-927d-f3817aad694a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:38.414707 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-78f3d555-550b-461c-927d-f3817aad694a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1875 microversion: 2.32 time: 0.720809 Jul 19 22:37:38.426635 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1223/2455] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:37:37 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1875 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:37:38.426635 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a2f4480a-2b06-4ec8-b0db-e1e4ee6ab9a0 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:38.426635 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a2f4480a-2b06-4ec8-b0db-e1e4ee6ab9a0 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] [instance: 4cd615b0-c9c8-422d-bcbb-3de7da85e703] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:38.434137 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a2f4480a-2b06-4ec8-b0db-e1e4ee6ab9a0 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:38.434591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a2f4480a-2b06-4ec8-b0db-e1e4ee6ab9a0 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:38.436126 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a2f4480a-2b06-4ec8-b0db-e1e4ee6ab9a0 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:38.436567 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a2f4480a-2b06-4ec8-b0db-e1e4ee6ab9a0 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:38.539882 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-a2f4480a-2b06-4ec8-b0db-e1e4ee6ab9a0 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] HTTP exception thrown: Cannot 'migrate' instance 4cd615b0-c9c8-422d-bcbb-3de7da85e703 while it is in vm_state suspended Jul 19 22:37:38.544743 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a2f4480a-2b06-4ec8-b0db-e1e4ee6ab9a0 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Request method failure captured: Jul 19 22:37:38.544743 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703/action HTTP/1.1 Jul 19 22:37:38.544743 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:37:38.544743 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:37:38.544743 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:37:38.544743 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 15 Jul 19 22:37:38.544743 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:37:38.544743 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:37:38.544743 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:37:38.544743 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:37:38.544743 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zHoS-MiJ-vT6Puf1EBG4ouJC0rtoTTCJYnnxjQlTQzirLLlX12hT4eLLidn_EwHEdT6CMAh-9XRndEe8gIAuIWLm8vWP0XfQB6bz4rLi8NPWrqmhOZFT90Unp2wlgSrdKGDU5M1rszCzMUhs2xckW2PNOGszAnuXr-7_8leS0FACxc Jul 19 22:37:38.544743 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:37:38.544743 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:37:38.544743 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:37:38.544743 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:37:38.544743 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:37:38.544743 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:37:38.544743 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 8d65a1a0a96d4308a22281311d2cd399 Jul 19 22:37:38.544743 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1396123827 Jul 19 22:37:38.544743 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:37:38.544743 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:37:38.547294 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8d65a1a0a96d4308a22281311d2cd399"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8d65a1a0a96d4308a22281311d2cd399"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8d65a1a0a96d4308a22281311d2cd399"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8d65a1a0a96d4308a22281311d2cd399"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:37:38.547294 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1396123827 Jul 19 22:37:38.547294 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 8d65a1a0a96d4308a22281311d2cd399 Jul 19 22:37:38.547294 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1396123827 Jul 19 22:37:38.547294 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersAdminNegativeTestJSON-1396123827-project-admin Jul 19 22:37:38.547294 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:37:38.547294 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:37:38.547294 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 787f532c168847ef83cbc3a75c1ec49d Jul 19 22:37:38.547294 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1396123827-project-admin Jul 19 22:37:38.547294 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:37:38.547294 n-d-847009-3 devstack@n-api.service[119337]: {"migrate": {}} Jul 19 22:37:38.547294 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:37:38.547294 n-d-847009-3 devstack@n-api.service[119337]: exception: Cannot 'migrate' instance 4cd615b0-c9c8-422d-bcbb-3de7da85e703 while it is in vm_state suspended Jul 19 22:37:38.550085 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '4cd615b0-c9c8-422d-bcbb-3de7da85e703', 'body': {'migrate': {}}} Jul 19 22:37:38.550085 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:37:38.550085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:37:38.550085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 19 22:37:38.550085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 19 22:37:38.550085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 19 22:37:38.550085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 22:37:38.550085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 19 22:37:38.550085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 22:37:38.550085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 19 22:37:38.550085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 22:37:38.550085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 19 22:37:38.550085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 22:37:38.550085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 22:37:38.550085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 22:37:38.550085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 22:37:38.550085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 22:37:38.550085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4cd615b0-c9c8-422d-bcbb-3de7da85e703 in vm_state suspended. Cannot resize while the instance is in this state. Jul 19 22:37:38.550085 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:37:38.562281 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:37:38.562281 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:37:38.562281 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:37:38.562281 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:37:38.562281 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:37:38.562281 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:37:38.562281 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:37:38.562281 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:37:38.562281 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:37:38.562281 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:37:38.562281 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:37:38.562281 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 19 22:37:38.562281 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 22:37:38.562281 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 22:37:38.562281 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 22:37:38.562281 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 4cd615b0-c9c8-422d-bcbb-3de7da85e703 while it is in vm_state suspended Jul 19 22:37:38.562281 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:37:38.562281 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:37:38.562281 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:37:38.562281 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:37:38.567020 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:37:38.567020 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:37:38.567020 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:37:38.567020 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:37:38.567020 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 4cd615b0-c9c8-422d-bcbb-3de7da85e703 while it is in vm_state suspended Jul 19 22:37:38.567020 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:37:38.567020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a2f4480a-2b06-4ec8-b0db-e1e4ee6ab9a0 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Returning 409 to user: Cannot 'migrate' instance 4cd615b0-c9c8-422d-bcbb-3de7da85e703 while it is in vm_state suspended {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:37:38.569490 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dde10cf5-4b83-47e2-aef9-47e44cf8a7f5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ece721a99a4080a059c635b23761e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7242ed05524293b5dae6a33e520cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:38.569766 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a2f4480a-2b06-4ec8-b0db-e1e4ee6ab9a0 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703/action" status: 409 len: 148 microversion: 2.1 time: 0.133189 Jul 19 22:37:38.569766 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1224/2456] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:37:38 2022] POST /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703/action => generated 148 bytes in 137 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:37:38.570158 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dde10cf5-4b83-47e2-aef9-47e44cf8a7f5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56" status: 200 len: 1219 microversion: 2.1 time: 0.258448 Jul 19 22:37:38.570158 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1233/2457] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:38 2022] GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56 => generated 1219 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:38.573491 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fc6e3952-ff93-456b-b616-38e61e8cdf71 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a15613550>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:38.573791 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e3244fda-0d23-4733-8a1e-34c3822069d9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:38.573791 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e3244fda-0d23-4733-8a1e-34c3822069d9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:38.583628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e3244fda-0d23-4733-8a1e-34c3822069d9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:38.584573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e3244fda-0d23-4733-8a1e-34c3822069d9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:38.586218 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e3244fda-0d23-4733-8a1e-34c3822069d9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:38.587634 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e3244fda-0d23-4733-8a1e-34c3822069d9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:38.663251 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fc6e3952-ff93-456b-b616-38e61e8cdf71 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b976644c-69fb-42e4-880b-c54968aac66c" status: 200 len: 1464 microversion: 2.1 time: 0.107788 Jul 19 22:37:38.664398 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1225/2458] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:37:38 2022] GET /compute/v2.1/images/b976644c-69fb-42e4-880b-c54968aac66c => generated 1464 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:38.675252 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e93f7d38-74b7-44f4-b82a-42ea1592d70c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:38.676435 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e93f7d38-74b7-44f4-b82a-42ea1592d70c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:38.690308 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e93f7d38-74b7-44f4-b82a-42ea1592d70c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:38.691239 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e93f7d38-74b7-44f4-b82a-42ea1592d70c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:38.692510 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e93f7d38-74b7-44f4-b82a-42ea1592d70c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:38.693240 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e93f7d38-74b7-44f4-b82a-42ea1592d70c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:39.282630 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e3244fda-0d23-4733-8a1e-34c3822069d9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:39.303632 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e3244fda-0d23-4733-8a1e-34c3822069d9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 200 len: 1354 microversion: 2.1 time: 0.736457 Jul 19 22:37:39.305276 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1234/2459] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:38 2022] GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 1354 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:39.314314 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-178e4845-3174-403b-9006-c3ce9cd82585 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:39.319731 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-178e4845-3174-403b-9006-c3ce9cd82585 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Request method failure captured: Jul 19 22:37:39.319731 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08/action HTTP/1.1 Jul 19 22:37:39.319731 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:37:39.319731 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:37:39.319731 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:37:39.319731 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 39 Jul 19 22:37:39.319731 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:37:39.319731 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:37:39.319731 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:37:39.319731 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:37:39.319731 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zHoS-MiJ-vT6Puf1EBG4ouJC0rtoTTCJYnnxjQlTQzirLLlX12hT4eLLidn_EwHEdT6CMAh-9XRndEe8gIAuIWLm8vWP0XfQB6bz4rLi8NPWrqmhOZFT90Unp2wlgSrdKGDU5M1rszCzMUhs2xckW2PNOGszAnuXr-7_8leS0FACxc Jul 19 22:37:39.319731 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:37:39.319731 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:37:39.319731 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:37:39.319731 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:37:39.319731 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:37:39.319731 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:37:39.319731 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 8d65a1a0a96d4308a22281311d2cd399 Jul 19 22:37:39.319731 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1396123827 Jul 19 22:37:39.319731 n-d-847009-3 devstack@n-api.service[119338]: X-Role: admin,member,reader Jul 19 22:37:39.319731 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: admin,member,reader Jul 19 22:37:39.320981 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8d65a1a0a96d4308a22281311d2cd399"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8d65a1a0a96d4308a22281311d2cd399"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8d65a1a0a96d4308a22281311d2cd399"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8d65a1a0a96d4308a22281311d2cd399"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:37:39.320981 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1396123827 Jul 19 22:37:39.320981 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 8d65a1a0a96d4308a22281311d2cd399 Jul 19 22:37:39.320981 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1396123827 Jul 19 22:37:39.320981 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersAdminNegativeTestJSON-1396123827-project-admin Jul 19 22:37:39.320981 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:37:39.320981 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:37:39.320981 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 787f532c168847ef83cbc3a75c1ec49d Jul 19 22:37:39.320981 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1396123827-project-admin Jul 19 22:37:39.320981 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:37:39.320981 n-d-847009-3 devstack@n-api.service[119338]: {"os-resetState": {"state": "invalid"}} Jul 19 22:37:39.320981 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:37:39.321656 n-d-847009-3 devstack@n-api.service[119338]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 19 22:37:39.321656 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '0ee48b19-107c-4883-8d87-5868a5201d08', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 19 22:37:39.321656 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:37:39.321656 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:37:39.321656 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:37:39.321656 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:37:39.321656 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:37:39.321656 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:37:39.321656 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 19 22:37:39.321656 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:37:39.321656 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 19 22:37:39.321656 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 19 22:37:39.321656 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:37:39.321656 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 19 22:37:39.321656 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi 'invalid' Jul 19 22:37:39.321656 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:37:39.321656 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:37:39.321656 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:37:39.321656 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:37:39.321656 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:37:39.321656 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:37:39.321656 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:37:39.322936 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:37:39.322936 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:37:39.322936 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:37:39.322936 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:37:39.322936 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:37:39.322936 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:37:39.322936 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:37:39.322936 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:37:39.322936 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:37:39.322936 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 19 22:37:39.322936 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:37:39.322936 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:37:39.322936 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:37:39.322936 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:37:39.322936 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:37:39.322936 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:37:39.322936 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:37:39.322936 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:37:39.322936 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 19 22:37:39.324054 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:37:39.324054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-178e4845-3174-403b-9006-c3ce9cd82585 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:37:39.324054 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-178e4845-3174-403b-9006-c3ce9cd82585 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08/action" status: 400 len: 144 microversion: 2.1 time: 0.015180 Jul 19 22:37:39.324054 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1235/2460] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:37:39 2022] POST /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08/action => generated 144 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:37:39.353256 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-41b56b92-6bf1-4883-a27f-8bc6b281b477 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:39.357203 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-41b56b92-6bf1-4883-a27f-8bc6b281b477 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: bf0396df-c757-4ec7-9697-e71026a34525] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:39.375513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-41b56b92-6bf1-4883-a27f-8bc6b281b477 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:39.381387 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-41b56b92-6bf1-4883-a27f-8bc6b281b477 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:39.382637 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-41b56b92-6bf1-4883-a27f-8bc6b281b477 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:39.388187 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-41b56b92-6bf1-4883-a27f-8bc6b281b477 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:39.454284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e93f7d38-74b7-44f4-b82a-42ea1592d70c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:39.465639 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e93f7d38-74b7-44f4-b82a-42ea1592d70c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1508 microversion: 2.1 time: 0.799780 Jul 19 22:37:39.475711 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1226/2461] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:38 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1508 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:39.481890 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7055caf4-f05f-4509-80d2-1aa716062299 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:39.482737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7055caf4-f05f-4509-80d2-1aa716062299 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] [instance: d6189bec-a398-4e64-8e79-0b766af2f833] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:39.503734 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7055caf4-f05f-4509-80d2-1aa716062299 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:39.504507 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7055caf4-f05f-4509-80d2-1aa716062299 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:39.505458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7055caf4-f05f-4509-80d2-1aa716062299 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:39.506165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7055caf4-f05f-4509-80d2-1aa716062299 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:40.098178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:37:40.605576 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7055caf4-f05f-4509-80d2-1aa716062299 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f357f1737d4f29b2d594939a06a79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04569d19c85640c48496efb72ef4c20f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:40.634662 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7055caf4-f05f-4509-80d2-1aa716062299 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] 10.222.0.25 "GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833" status: 200 len: 1713 microversion: 2.1 time: 1.156458 Jul 19 22:37:40.637003 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1227/2462] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:39 2022] GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833 => generated 1713 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:40.646287 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-23d4869d-3260-4cb9-b579-41634f239461 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:40.655285 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-23d4869d-3260-4cb9-b579-41634f239461 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Request method failure captured: Jul 19 22:37:40.655285 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08/action HTTP/1.1 Jul 19 22:37:40.655285 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:37:40.655285 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:37:40.655285 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:37:40.655285 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 31 Jul 19 22:37:40.655285 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:37:40.655285 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:37:40.655285 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:37:40.655285 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:37:40.655285 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zHoS-MiJ-vT6Puf1EBG4ouJC0rtoTTCJYnnxjQlTQzirLLlX12hT4eLLidn_EwHEdT6CMAh-9XRndEe8gIAuIWLm8vWP0XfQB6bz4rLi8NPWrqmhOZFT90Unp2wlgSrdKGDU5M1rszCzMUhs2xckW2PNOGszAnuXr-7_8leS0FACxc Jul 19 22:37:40.655285 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:37:40.655285 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:37:40.655285 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:37:40.655285 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:37:40.655285 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:37:40.655285 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:37:40.655285 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 8d65a1a0a96d4308a22281311d2cd399 Jul 19 22:37:40.655285 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1396123827 Jul 19 22:37:40.655285 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 22:37:40.655285 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 22:37:40.658759 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8d65a1a0a96d4308a22281311d2cd399"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8d65a1a0a96d4308a22281311d2cd399"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8d65a1a0a96d4308a22281311d2cd399"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8d65a1a0a96d4308a22281311d2cd399"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:37:40.658759 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1396123827 Jul 19 22:37:40.658759 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 8d65a1a0a96d4308a22281311d2cd399 Jul 19 22:37:40.658759 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1396123827 Jul 19 22:37:40.658759 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersAdminNegativeTestJSON-1396123827-project-admin Jul 19 22:37:40.658759 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:37:40.658759 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:37:40.658759 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 787f532c168847ef83cbc3a75c1ec49d Jul 19 22:37:40.658759 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1396123827-project-admin Jul 19 22:37:40.658759 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:37:40.658759 n-d-847009-3 devstack@n-api.service[119337]: {"os-resetState": {"state": 1}} Jul 19 22:37:40.658759 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:37:40.658759 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 19 22:37:40.663086 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '0ee48b19-107c-4883-8d87-5868a5201d08', 'body': {'os-resetState': {'state': 1}}} Jul 19 22:37:40.663086 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:37:40.663086 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:37:40.663086 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:37:40.663086 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:37:40.663086 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:37:40.663086 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:37:40.663086 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 19 22:37:40.663086 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:37:40.663086 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 19 22:37:40.663086 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 19 22:37:40.663086 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:37:40.663086 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 19 22:37:40.663086 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 1 Jul 19 22:37:40.663086 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:37:40.663086 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:37:40.663086 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:37:40.663086 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:37:40.663086 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:37:40.663086 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:37:40.663086 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:37:40.663086 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:37:40.667821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:37:40.667821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:37:40.667821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:37:40.667821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:37:40.667821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:37:40.667821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:37:40.667821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:37:40.667821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:37:40.667821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 19 22:37:40.667821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:37:40.667821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:37:40.667821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:37:40.667821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:37:40.667821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:37:40.667821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:37:40.667821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:37:40.667821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:37:40.667821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 19 22:37:40.667821 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:37:40.676707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-23d4869d-3260-4cb9-b579-41634f239461 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:37:40.676707 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-23d4869d-3260-4cb9-b579-41634f239461 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08/action" status: 400 len: 120 microversion: 2.1 time: 0.019480 Jul 19 22:37:40.676707 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1228/2463] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:37:40 2022] POST /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08/action => generated 120 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:37:40.676707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c2003536-b017-4b59-b31b-66183f825548 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:40.676707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c2003536-b017-4b59-b31b-66183f825548 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:40.685418 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c2003536-b017-4b59-b31b-66183f825548 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:40.693149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c2003536-b017-4b59-b31b-66183f825548 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:40.694753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c2003536-b017-4b59-b31b-66183f825548 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:40.696116 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c2003536-b017-4b59-b31b-66183f825548 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:40.880445 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-41b56b92-6bf1-4883-a27f-8bc6b281b477 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdcb86f99184c839022f5f19d730e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '994ee0e2b71b4eff88a19b70351ada06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:40.893461 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-41b56b92-6bf1-4883-a27f-8bc6b281b477 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/bf0396df-c757-4ec7-9697-e71026a34525" status: 200 len: 1466 microversion: 2.1 time: 1.567841 Jul 19 22:37:40.894400 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1236/2464] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:39 2022] GET /compute/v2.1/servers/bf0396df-c757-4ec7-9697-e71026a34525 => generated 1466 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:40.903856 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c0b25d18-9d72-4b3d-8f77-b9806574910d tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:40.908102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c0b25d18-9d72-4b3d-8f77-b9806574910d tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:40.930138 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0b25d18-9d72-4b3d-8f77-b9806574910d tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:40.931165 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0b25d18-9d72-4b3d-8f77-b9806574910d tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:40.933008 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0b25d18-9d72-4b3d-8f77-b9806574910d tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:40.934219 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0b25d18-9d72-4b3d-8f77-b9806574910d tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:41.145597 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-c0b25d18-9d72-4b3d-8f77-b9806574910d tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:37:41.146623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-c0b25d18-9d72-4b3d-8f77-b9806574910d tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:37:41.147682 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-c0b25d18-9d72-4b3d-8f77-b9806574910d tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:37:41.148569 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-c0b25d18-9d72-4b3d-8f77-b9806574910d tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:37:41.150789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-c0b25d18-9d72-4b3d-8f77-b9806574910d tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:37:41.340389 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c0b25d18-9d72-4b3d-8f77-b9806574910d tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:41.361786 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0b25d18-9d72-4b3d-8f77-b9806574910d tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:41.363794 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0b25d18-9d72-4b3d-8f77-b9806574910d tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:41.367793 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0b25d18-9d72-4b3d-8f77-b9806574910d tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:41.368653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0b25d18-9d72-4b3d-8f77-b9806574910d tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:41.511346 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c0b25d18-9d72-4b3d-8f77-b9806574910d tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "POST /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a/action" status: 202 len: 1110 microversion: 2.1 time: 0.614555 Jul 19 22:37:41.513637 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1237/2465] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:37:40 2022] POST /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a/action => generated 1110 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 19 22:37:41.524974 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-afe531cc-a574-4cdf-bb8a-7c95006503a4 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:41.526063 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-afe531cc-a574-4cdf-bb8a-7c95006503a4 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: 3e15d03f-3614-4eba-bf41-a0c059b15d56] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:41.540415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-afe531cc-a574-4cdf-bb8a-7c95006503a4 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:41.541656 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-afe531cc-a574-4cdf-bb8a-7c95006503a4 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:41.543135 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-afe531cc-a574-4cdf-bb8a-7c95006503a4 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:41.543965 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-afe531cc-a574-4cdf-bb8a-7c95006503a4 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:41.809172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c2003536-b017-4b59-b31b-66183f825548 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:41.857489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c2003536-b017-4b59-b31b-66183f825548 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:41.859847 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c2003536-b017-4b59-b31b-66183f825548 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:41.861211 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c2003536-b017-4b59-b31b-66183f825548 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 2827 microversion: 2.32 time: 1.200612 Jul 19 22:37:41.863044 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1229/2466] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:37:40 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 2827 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:37:41.880777 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9f2f4f24-d90c-46e5-bc17-5ede2a5e6357 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:41.882238 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9f2f4f24-d90c-46e5-bc17-5ede2a5e6357 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:41.891166 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9f2f4f24-d90c-46e5-bc17-5ede2a5e6357 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:41.891908 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9f2f4f24-d90c-46e5-bc17-5ede2a5e6357 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:41.893060 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9f2f4f24-d90c-46e5-bc17-5ede2a5e6357 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:41.893661 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9f2f4f24-d90c-46e5-bc17-5ede2a5e6357 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:42.387467 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-afe531cc-a574-4cdf-bb8a-7c95006503a4 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ece721a99a4080a059c635b23761e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7242ed05524293b5dae6a33e520cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:42.412004 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-afe531cc-a574-4cdf-bb8a-7c95006503a4 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56" status: 200 len: 1323 microversion: 2.1 time: 0.885975 Jul 19 22:37:42.432122 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1238/2467] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:41 2022] GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56 => generated 1323 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:42.443937 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-eb568098-9759-4380-a5f6-4bdafbfddac8 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:42.446052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-eb568098-9759-4380-a5f6-4bdafbfddac8 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Failed to fetch instance by id 999 {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 19 22:37:42.447307 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-eb568098-9759-4380-a5f6-4bdafbfddac8 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 19 22:37:42.458537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-eb568098-9759-4380-a5f6-4bdafbfddac8 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Request method failure captured: Jul 19 22:37:42.458537 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 19 22:37:42.458537 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:37:42.458537 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:37:42.458537 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:37:42.458537 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 37 Jul 19 22:37:42.458537 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:37:42.458537 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:37:42.458537 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:37:42.458537 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:37:42.458537 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zHoS-MiJ-vT6Puf1EBG4ouJC0rtoTTCJYnnxjQlTQzirLLlX12hT4eLLidn_EwHEdT6CMAh-9XRndEe8gIAuIWLm8vWP0XfQB6bz4rLi8NPWrqmhOZFT90Unp2wlgSrdKGDU5M1rszCzMUhs2xckW2PNOGszAnuXr-7_8leS0FACxc Jul 19 22:37:42.458537 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:37:42.458537 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:37:42.458537 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:37:42.458537 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:37:42.458537 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:37:42.458537 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:37:42.458537 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 8d65a1a0a96d4308a22281311d2cd399 Jul 19 22:37:42.458537 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1396123827 Jul 19 22:37:42.458537 n-d-847009-3 devstack@n-api.service[119338]: X-Role: admin,member,reader Jul 19 22:37:42.458537 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: admin,member,reader Jul 19 22:37:42.461389 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8d65a1a0a96d4308a22281311d2cd399"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8d65a1a0a96d4308a22281311d2cd399"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8d65a1a0a96d4308a22281311d2cd399"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8d65a1a0a96d4308a22281311d2cd399"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:37:42.461389 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1396123827 Jul 19 22:37:42.461389 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 8d65a1a0a96d4308a22281311d2cd399 Jul 19 22:37:42.461389 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1396123827 Jul 19 22:37:42.461389 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersAdminNegativeTestJSON-1396123827-project-admin Jul 19 22:37:42.461389 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:37:42.461389 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:37:42.461389 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 787f532c168847ef83cbc3a75c1ec49d Jul 19 22:37:42.461389 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1396123827-project-admin Jul 19 22:37:42.461389 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:37:42.461389 n-d-847009-3 devstack@n-api.service[119338]: {"os-resetState": {"state": "error"}} Jul 19 22:37:42.461389 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:37:42.461389 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 999 could not be found. Jul 19 22:37:42.462893 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 19 22:37:42.462893 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:37:42.462893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:37:42.462893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:37:42.462893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:37:42.462893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 19 22:37:42.462893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 19 22:37:42.462893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 19 22:37:42.462893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:37:42.462893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:37:42.462893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:37:42.462893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:37:42.462893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:37:42.462893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:37:42.462893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:37:42.462893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:37:42.462893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:37:42.462893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:37:42.462893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:37:42.462893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:37:42.462893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 19 22:37:42.465166 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 19 22:37:42.465166 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:37:42.465166 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:37:42.465166 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 19 22:37:42.465166 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:37:42.465166 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:37:42.465166 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:37:42.465166 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:37:42.465166 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:37:42.465166 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:37:42.465166 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:37:42.465166 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:37:42.465166 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 19 22:37:42.465166 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:37:42.477629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-eb568098-9759-4380-a5f6-4bdafbfddac8 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:37:42.479596 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-eb568098-9759-4380-a5f6-4bdafbfddac8 tempest-ServersAdminNegativeTestJSON-1396123827 tempest-ServersAdminNegativeTestJSON-1396123827-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.045549 Jul 19 22:37:42.481886 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1239/2468] 10.222.0.25 () {60 vars in 1178 bytes} [Tue Jul 19 22:37:42 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:37:42.493755 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-29fd485c-13c6-4077-9d2f-2ac407d15a33 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2000593619"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:42.504175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-29fd485c-13c6-4077-9d2f-2ac407d15a33 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: 7a846129-bc22-4520-bd5b-d33fcd0a94a2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:42.512490 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29fd485c-13c6-4077-9d2f-2ac407d15a33 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:42.513148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29fd485c-13c6-4077-9d2f-2ac407d15a33 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:42.514211 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29fd485c-13c6-4077-9d2f-2ac407d15a33 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:42.514781 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29fd485c-13c6-4077-9d2f-2ac407d15a33 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:42.705090 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9f2f4f24-d90c-46e5-bc17-5ede2a5e6357 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:42.729661 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9f2f4f24-d90c-46e5-bc17-5ede2a5e6357 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 200 len: 1354 microversion: 2.1 time: 0.863685 Jul 19 22:37:42.742517 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1230/2469] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:41 2022] GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 1354 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:42.757444 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-63cf0777-ad71-4d0d-9745-2b22fd92855a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:42.758346 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-63cf0777-ad71-4d0d-9745-2b22fd92855a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:42.769125 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63cf0777-ad71-4d0d-9745-2b22fd92855a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:42.769656 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63cf0777-ad71-4d0d-9745-2b22fd92855a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:42.770574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63cf0777-ad71-4d0d-9745-2b22fd92855a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:42.771224 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63cf0777-ad71-4d0d-9745-2b22fd92855a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:43.101854 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-29fd485c-13c6-4077-9d2f-2ac407d15a33 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "POST /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2/action" status: 202 len: 0 microversion: 2.1 time: 0.616400 Jul 19 22:37:43.103303 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1240/2470] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:37:42 2022] POST /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2/action => generated 0 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 22:37:43.116372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6da42481-4784-40c4-ac00-4656bb2c2748 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:43.117833 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6da42481-4784-40c4-ac00-4656bb2c2748 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] [instance: d6189bec-a398-4e64-8e79-0b766af2f833] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:43.129205 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6da42481-4784-40c4-ac00-4656bb2c2748 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:43.130202 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6da42481-4784-40c4-ac00-4656bb2c2748 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:43.138822 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6da42481-4784-40c4-ac00-4656bb2c2748 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:43.139789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6da42481-4784-40c4-ac00-4656bb2c2748 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:43.291224 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-63cf0777-ad71-4d0d-9745-2b22fd92855a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:43.301269 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-63cf0777-ad71-4d0d-9745-2b22fd92855a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1515 microversion: 2.1 time: 0.557084 Jul 19 22:37:43.312710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6da42481-4784-40c4-ac00-4656bb2c2748 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f357f1737d4f29b2d594939a06a79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04569d19c85640c48496efb72ef4c20f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:43.313842 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1231/2471] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:42 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1515 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:43.319332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4f3f4808-25f5-4948-8a75-ff7bbb9c2edd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:43.320191 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4f3f4808-25f5-4948-8a75-ff7bbb9c2edd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:43.323686 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:37:43.329063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f3f4808-25f5-4948-8a75-ff7bbb9c2edd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:43.329887 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f3f4808-25f5-4948-8a75-ff7bbb9c2edd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:43.330222 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6da42481-4784-40c4-ac00-4656bb2c2748 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] 10.222.0.25 "GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833" status: 200 len: 1647 microversion: 2.1 time: 0.222747 Jul 19 22:37:43.331303 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f3f4808-25f5-4948-8a75-ff7bbb9c2edd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:43.331817 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1241/2472] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:43 2022] GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833 => generated 1647 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:43.332245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f3f4808-25f5-4948-8a75-ff7bbb9c2edd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:43.342587 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-e3d2b411-fca8-4870-9442-7be17c6cb363 req-3f13a774-94d2-421c-b069-6223e8c46743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e15d03f-3614-4eba-bf41-a0c059b15d56", "tag": "cbe37743-8894-46d0-a28d-912d057c4b98"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:43.359160 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=8 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:37:43.362797 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e3d2b411-fca8-4870-9442-7be17c6cb363 req-3f13a774-94d2-421c-b069-6223e8c46743 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:43.363552 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e3d2b411-fca8-4870-9442-7be17c6cb363 req-3f13a774-94d2-421c-b069-6223e8c46743 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:43.372459 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:37:43.388723 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-e3d2b411-fca8-4870-9442-7be17c6cb363 req-3f13a774-94d2-421c-b069-6223e8c46743 service nova] Creating event network-changed:cbe37743-8894-46d0-a28d-912d057c4b98 for instance 3e15d03f-3614-4eba-bf41-a0c059b15d56 on n-h2-847009-3 Jul 19 22:37:43.398584 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-e3d2b411-fca8-4870-9442-7be17c6cb363 req-3f13a774-94d2-421c-b069-6223e8c46743 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064496 Jul 19 22:37:43.399669 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1242/2473] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:43.411553 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-1771cd51-2ca3-4b77-9452-9e02df1475e7 req-771a34e2-a210-4b47-9471-e951a4e4897a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9ae7d22-3925-465a-9507-250b670ecc77", "tag": "3196bd8c-6a69-4858-81a6-622d724377b1"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:43.431070 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-1771cd51-2ca3-4b77-9452-9e02df1475e7 req-771a34e2-a210-4b47-9471-e951a4e4897a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:43.431898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-1771cd51-2ca3-4b77-9452-9e02df1475e7 req-771a34e2-a210-4b47-9471-e951a4e4897a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:43.449627 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-1771cd51-2ca3-4b77-9452-9e02df1475e7 req-771a34e2-a210-4b47-9471-e951a4e4897a service nova] Creating event network-changed:3196bd8c-6a69-4858-81a6-622d724377b1 for instance b9ae7d22-3925-465a-9507-250b670ecc77 on n-h2-847009-3 Jul 19 22:37:43.459543 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-1771cd51-2ca3-4b77-9452-9e02df1475e7 req-771a34e2-a210-4b47-9471-e951a4e4897a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057014 Jul 19 22:37:43.461009 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1243/2474] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:43.471970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dab7b69d-adc9-4f5f-b165-2d096aae3c4a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:43.473314 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dab7b69d-adc9-4f5f-b165-2d096aae3c4a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 4cd615b0-c9c8-422d-bcbb-3de7da85e703] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:43.486766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dab7b69d-adc9-4f5f-b165-2d096aae3c4a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:43.487907 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dab7b69d-adc9-4f5f-b165-2d096aae3c4a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:43.489586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dab7b69d-adc9-4f5f-b165-2d096aae3c4a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:43.490660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dab7b69d-adc9-4f5f-b165-2d096aae3c4a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:43.542138 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dab7b69d-adc9-4f5f-b165-2d096aae3c4a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 4cd615b0-c9c8-422d-bcbb-3de7da85e703] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:37:43.621477 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4f3f4808-25f5-4948-8a75-ff7bbb9c2edd tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.301586 Jul 19 22:37:43.624271 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1232/2475] 10.222.0.25 () {60 vars in 1315 bytes} [Tue Jul 19 22:37:43 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4/os-interface => generated 1831 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:37:43.656222 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-f19aacaf-b770-40b8-a31d-30b690fced97 req-59b0beab-f31d-4ca6-975f-d6e89b747798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf0396df-c757-4ec7-9697-e71026a34525", "name": "network-vif-unplugged", "status": "completed", "tag": "80ac4ef8-2707-46cd-8487-6e07db74d986"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:43.692675 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-f19aacaf-b770-40b8-a31d-30b690fced97 req-59b0beab-f31d-4ca6-975f-d6e89b747798 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:43.696785 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-f19aacaf-b770-40b8-a31d-30b690fced97 req-59b0beab-f31d-4ca6-975f-d6e89b747798 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:43.719045 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dab7b69d-adc9-4f5f-b165-2d096aae3c4a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703" status: 204 len: 0 microversion: 2.1 time: 0.254768 Jul 19 22:37:43.725015 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1244/2476] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:37:43 2022] DELETE /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:37:43.748543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-783ee0e7-c34b-40f3-b14c-04dc2200136b tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a03a0bd30>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:43.759646 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-f19aacaf-b770-40b8-a31d-30b690fced97 req-59b0beab-f31d-4ca6-975f-d6e89b747798 service nova] Creating event network-vif-unplugged:80ac4ef8-2707-46cd-8487-6e07db74d986 for instance bf0396df-c757-4ec7-9697-e71026a34525 on n-h1-847009-3 Jul 19 22:37:43.774028 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-f19aacaf-b770-40b8-a31d-30b690fced97 req-59b0beab-f31d-4ca6-975f-d6e89b747798 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.146487 Jul 19 22:37:43.783342 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1233/2477] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:43.794923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fbf1ae99-e94b-4720-b8f6-6da9a63b6615 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:43.804879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fbf1ae99-e94b-4720-b8f6-6da9a63b6615 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: 3e15d03f-3614-4eba-bf41-a0c059b15d56] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:43.825802 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fbf1ae99-e94b-4720-b8f6-6da9a63b6615 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:43.827179 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fbf1ae99-e94b-4720-b8f6-6da9a63b6615 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:43.842938 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fbf1ae99-e94b-4720-b8f6-6da9a63b6615 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:43.844349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fbf1ae99-e94b-4720-b8f6-6da9a63b6615 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:43.868153 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-783ee0e7-c34b-40f3-b14c-04dc2200136b tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993" status: 200 len: 1455 microversion: 2.1 time: 0.126024 Jul 19 22:37:43.869843 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1245/2478] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:37:43 2022] GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993 => generated 1455 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:43.889005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7363f0be-4cc1-40f0-a80f-b9d7411cfb90 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:43.890457 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7363f0be-4cc1-40f0-a80f-b9d7411cfb90 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 4cd615b0-c9c8-422d-bcbb-3de7da85e703] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:43.908167 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7363f0be-4cc1-40f0-a80f-b9d7411cfb90 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:43.909156 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7363f0be-4cc1-40f0-a80f-b9d7411cfb90 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:43.915040 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7363f0be-4cc1-40f0-a80f-b9d7411cfb90 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:43.916344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7363f0be-4cc1-40f0-a80f-b9d7411cfb90 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:44.204283 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fbf1ae99-e94b-4720-b8f6-6da9a63b6615 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ece721a99a4080a059c635b23761e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7242ed05524293b5dae6a33e520cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:44.236539 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fbf1ae99-e94b-4720-b8f6-6da9a63b6615 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56" status: 200 len: 1323 microversion: 2.1 time: 0.449309 Jul 19 22:37:44.237566 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1234/2479] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:43 2022] GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56 => generated 1323 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:44.257519 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4f4b3e18-51db-450e-abae-dca97d5f707c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:44.258566 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4f4b3e18-51db-450e-abae-dca97d5f707c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:44.278821 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f4b3e18-51db-450e-abae-dca97d5f707c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:44.280097 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f4b3e18-51db-450e-abae-dca97d5f707c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:44.285640 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f4b3e18-51db-450e-abae-dca97d5f707c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:44.286972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f4b3e18-51db-450e-abae-dca97d5f707c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:44.293356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7363f0be-4cc1-40f0-a80f-b9d7411cfb90 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:44.318840 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7363f0be-4cc1-40f0-a80f-b9d7411cfb90 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703" status: 200 len: 1468 microversion: 2.1 time: 0.446072 Jul 19 22:37:44.326559 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1246/2480] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:43 2022] GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703 => generated 1468 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:44.341555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f132d8b0-42d8-4f7c-851f-ce9368abecae tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:44.348513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f132d8b0-42d8-4f7c-851f-ce9368abecae tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:44.375373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f132d8b0-42d8-4f7c-851f-ce9368abecae tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:44.376287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f132d8b0-42d8-4f7c-851f-ce9368abecae tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:44.380465 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f132d8b0-42d8-4f7c-851f-ce9368abecae tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:44.381417 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f132d8b0-42d8-4f7c-851f-ce9368abecae tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:44.810662 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4f4b3e18-51db-450e-abae-dca97d5f707c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:44.813786 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f132d8b0-42d8-4f7c-851f-ce9368abecae tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:44.839732 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4f4b3e18-51db-450e-abae-dca97d5f707c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 200 len: 1354 microversion: 2.1 time: 0.599134 Jul 19 22:37:44.844947 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1235/2481] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:44 2022] GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 1354 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:44.868457 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-92813a7d-1f28-4393-be49-96af7635d90a tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:44.870254 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-92813a7d-1f28-4393-be49-96af7635d90a tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] [instance: d6189bec-a398-4e64-8e79-0b766af2f833] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:44.871001 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f132d8b0-42d8-4f7c-851f-ce9368abecae tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1515 microversion: 2.1 time: 0.539992 Jul 19 22:37:44.873373 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1247/2482] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:44 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1515 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:44.897012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c07fec74-5317-437f-a103-11891123fea0 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a10625040>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:44.911037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-92813a7d-1f28-4393-be49-96af7635d90a tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:44.911900 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-92813a7d-1f28-4393-be49-96af7635d90a tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:44.913736 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-92813a7d-1f28-4393-be49-96af7635d90a tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:44.914533 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-92813a7d-1f28-4393-be49-96af7635d90a tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:44.993744 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:37:44.997543 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c07fec74-5317-437f-a103-11891123fea0 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993" status: 200 len: 1455 microversion: 2.1 time: 0.112748 Jul 19 22:37:45.005969 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1248/2483] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:37:44 2022] GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993 => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:45.109648 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-92813a7d-1f28-4393-be49-96af7635d90a tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f357f1737d4f29b2d594939a06a79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04569d19c85640c48496efb72ef4c20f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:45.129295 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-92813a7d-1f28-4393-be49-96af7635d90a tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] 10.222.0.25 "GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833" status: 200 len: 1362 microversion: 2.1 time: 0.281232 Jul 19 22:37:45.131784 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1236/2484] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:44 2022] GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833 => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:45.270038 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a5ef3b70-b40e-4d44-b603-d36e5fc60135 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:45.276116 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a5ef3b70-b40e-4d44-b603-d36e5fc60135 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: 3e15d03f-3614-4eba-bf41-a0c059b15d56] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:45.290756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a5ef3b70-b40e-4d44-b603-d36e5fc60135 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:45.291994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a5ef3b70-b40e-4d44-b603-d36e5fc60135 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:45.294056 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a5ef3b70-b40e-4d44-b603-d36e5fc60135 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:45.295154 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a5ef3b70-b40e-4d44-b603-d36e5fc60135 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:45.350844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a3d1117f-02c1-4c62-a8eb-9a91877d2a94 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:45.352335 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a3d1117f-02c1-4c62-a8eb-9a91877d2a94 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 4cd615b0-c9c8-422d-bcbb-3de7da85e703] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:45.365375 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a3d1117f-02c1-4c62-a8eb-9a91877d2a94 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:45.366517 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a3d1117f-02c1-4c62-a8eb-9a91877d2a94 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:45.368787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a3d1117f-02c1-4c62-a8eb-9a91877d2a94 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:45.369791 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a3d1117f-02c1-4c62-a8eb-9a91877d2a94 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:46.192433 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a3d1117f-02c1-4c62-a8eb-9a91877d2a94 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:46.211748 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a3d1117f-02c1-4c62-a8eb-9a91877d2a94 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703" status: 200 len: 1468 microversion: 2.1 time: 0.869433 Jul 19 22:37:46.212784 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1237/2485] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:45 2022] GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703 => generated 1468 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:46.224064 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-1d18ded7-7600-4f8a-8607-068cf31f149e req-6f60726c-488a-4009-ad93-0e4e0edc702a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6189bec-a398-4e64-8e79-0b766af2f833", "name": "network-vif-deleted", "tag": "ab5c88e8-cfda-4225-9739-f4f3e8403327"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:46.240592 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1d18ded7-7600-4f8a-8607-068cf31f149e req-6f60726c-488a-4009-ad93-0e4e0edc702a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:46.241989 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1d18ded7-7600-4f8a-8607-068cf31f149e req-6f60726c-488a-4009-ad93-0e4e0edc702a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:46.259373 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-1d18ded7-7600-4f8a-8607-068cf31f149e req-6f60726c-488a-4009-ad93-0e4e0edc702a service nova] Creating event network-vif-deleted:ab5c88e8-cfda-4225-9739-f4f3e8403327 for instance d6189bec-a398-4e64-8e79-0b766af2f833 on n-h2-847009-3 Jul 19 22:37:46.268365 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-1d18ded7-7600-4f8a-8607-068cf31f149e req-6f60726c-488a-4009-ad93-0e4e0edc702a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053564 Jul 19 22:37:46.275623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a5ef3b70-b40e-4d44-b603-d36e5fc60135 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ece721a99a4080a059c635b23761e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7242ed05524293b5dae6a33e520cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:46.282447 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1238/2486] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:46.297216 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-da2c1570-d8e3-465a-b16b-7a1f569578b9 req-e527b788-1ad3-48f8-adfb-b306ab8f697a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68ea88aa-1db0-490d-a791-5abd31245b37", "name": "network-vif-plugged", "status": "completed", "tag": "cb002f98-bd53-40ce-a87d-725fad84c3c7"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:46.301694 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a5ef3b70-b40e-4d44-b603-d36e5fc60135 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56" status: 200 len: 1323 microversion: 2.1 time: 1.036996 Jul 19 22:37:46.303141 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1249/2487] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:45 2022] GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56 => generated 1323 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:46.325634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-da2c1570-d8e3-465a-b16b-7a1f569578b9 req-e527b788-1ad3-48f8-adfb-b306ab8f697a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:46.326358 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-da2c1570-d8e3-465a-b16b-7a1f569578b9 req-e527b788-1ad3-48f8-adfb-b306ab8f697a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:46.328693 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-62481089-81be-4c91-ac8b-3b16348a3fa8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:46.332843 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-62481089-81be-4c91-ac8b-3b16348a3fa8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:46.363947 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-da2c1570-d8e3-465a-b16b-7a1f569578b9 req-e527b788-1ad3-48f8-adfb-b306ab8f697a service nova] Creating event network-vif-plugged:cb002f98-bd53-40ce-a87d-725fad84c3c7 for instance 68ea88aa-1db0-490d-a791-5abd31245b37 on n-h1-847009-3 Jul 19 22:37:46.367312 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62481089-81be-4c91-ac8b-3b16348a3fa8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:46.384449 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-da2c1570-d8e3-465a-b16b-7a1f569578b9 req-e527b788-1ad3-48f8-adfb-b306ab8f697a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095199 Jul 19 22:37:46.385326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62481089-81be-4c91-ac8b-3b16348a3fa8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:46.386282 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1239/2488] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:46.392035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62481089-81be-4c91-ac8b-3b16348a3fa8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:46.394903 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-75db9715-7aee-4bbe-9146-8b503e614146 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:46.396175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62481089-81be-4c91-ac8b-3b16348a3fa8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:46.396517 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-75db9715-7aee-4bbe-9146-8b503e614146 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:46.410744 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-75db9715-7aee-4bbe-9146-8b503e614146 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:46.411346 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-75db9715-7aee-4bbe-9146-8b503e614146 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:46.417229 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-75db9715-7aee-4bbe-9146-8b503e614146 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:46.418143 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-75db9715-7aee-4bbe-9146-8b503e614146 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:47.446974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-75db9715-7aee-4bbe-9146-8b503e614146 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:47.464263 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-75db9715-7aee-4bbe-9146-8b503e614146 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1515 microversion: 2.1 time: 1.074631 Jul 19 22:37:47.466728 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1240/2489] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:46 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1515 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:47.483921 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e651dbc2-0c98-4f13-b937-31ce5d4b8a72 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a1094a820>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:47.496147 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-62481089-81be-4c91-ac8b-3b16348a3fa8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:47.513100 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-62481089-81be-4c91-ac8b-3b16348a3fa8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 200 len: 1354 microversion: 2.1 time: 1.208372 Jul 19 22:37:47.514617 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1250/2490] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:46 2022] GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 1354 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:47.520698 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7e08adf7-abf2-40a5-93f3-96bde62b8e2d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:47.521733 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7e08adf7-abf2-40a5-93f3-96bde62b8e2d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] [instance: d6189bec-a398-4e64-8e79-0b766af2f833] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:47.529742 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e08adf7-abf2-40a5-93f3-96bde62b8e2d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:47.530709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e08adf7-abf2-40a5-93f3-96bde62b8e2d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:47.532550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e08adf7-abf2-40a5-93f3-96bde62b8e2d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:47.533273 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e08adf7-abf2-40a5-93f3-96bde62b8e2d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:47.549172 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-7e08adf7-abf2-40a5-93f3-96bde62b8e2d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] HTTP exception thrown: Instance d6189bec-a398-4e64-8e79-0b766af2f833 could not be found. Jul 19 22:37:47.551573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7e08adf7-abf2-40a5-93f3-96bde62b8e2d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Request method failure captured: Jul 19 22:37:47.551573 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833 HTTP/1.1 Jul 19 22:37:47.551573 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:37:47.551573 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:37:47.551573 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:37:47.551573 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:37:47.551573 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:37:47.551573 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:37:47.551573 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:37:47.551573 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:37:47.551573 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zHb4q-ZMViV5YAfeIrm_vUa6E0-tAZnlhcqyQnnF-Yn0PtCmWhNkYDM_kGi-MMnIfo6FYxJ83L_vMSQQMgWUREFMv1_TO8ZCYq_a_mF8xdLSl4_b5nVHEaMIz3rrz7dEt_Mcfde032gutNk96zBYvwy8HNsxCZm1rzVAN8nwpX8bH4 Jul 19 22:37:47.551573 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:37:47.551573 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:37:47.551573 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:37:47.551573 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:37:47.551573 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:37:47.551573 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:37:47.551573 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 04569d19c85640c48496efb72ef4c20f Jul 19 22:37:47.551573 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersTestManualDisk-858317139 Jul 19 22:37:47.551573 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:37:47.551573 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:37:47.553108 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_04569d19c85640c48496efb72ef4c20f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/04569d19c85640c48496efb72ef4c20f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/04569d19c85640c48496efb72ef4c20f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/04569d19c85640c48496efb72ef4c20f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:37:47.553108 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersTestManualDisk-858317139 Jul 19 22:37:47.553108 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 04569d19c85640c48496efb72ef4c20f Jul 19 22:37:47.553108 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersTestManualDisk-858317139 Jul 19 22:37:47.553108 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersTestManualDisk-858317139-project Jul 19 22:37:47.553108 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:37:47.553108 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:37:47.553108 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 35f357f1737d4f29b2d594939a06a79f Jul 19 22:37:47.553108 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersTestManualDisk-858317139-project Jul 19 22:37:47.553108 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:37:47.553108 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance d6189bec-a398-4e64-8e79-0b766af2f833 could not be found. Jul 19 22:37:47.553108 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'd6189bec-a398-4e64-8e79-0b766af2f833'} Jul 19 22:37:47.554003 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:37:47.554003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:37:47.554003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:37:47.554003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:37:47.554003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:37:47.554003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:37:47.554003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:37:47.554003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:37:47.554003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:37:47.554003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:37:47.554003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6189bec-a398-4e64-8e79-0b766af2f833 could not be found. Jul 19 22:37:47.554003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:37:47.554003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:37:47.554003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:37:47.554003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:37:47.554003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:37:47.554003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:37:47.554003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:37:47.554003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:37:47.554003 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:37:47.555423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:37:47.555423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:37:47.555423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:37:47.555423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:37:47.555423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:37:47.555423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:37:47.555423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:37:47.555423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6189bec-a398-4e64-8e79-0b766af2f833 could not be found. Jul 19 22:37:47.555423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:37:47.555423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:37:47.555423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:37:47.555423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:37:47.555423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:37:47.555423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:37:47.555423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:37:47.555423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:37:47.555423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6189bec-a398-4e64-8e79-0b766af2f833 could not be found. Jul 19 22:37:47.555423 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:37:47.558018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7e08adf7-abf2-40a5-93f3-96bde62b8e2d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Returning 404 to user: Instance d6189bec-a398-4e64-8e79-0b766af2f833 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:37:47.559063 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7e08adf7-abf2-40a5-93f3-96bde62b8e2d tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] 10.222.0.25 "GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833" status: 404 len: 111 microversion: 2.1 time: 0.042513 Jul 19 22:37:47.564120 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1251/2491] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:47 2022] GET /compute/v2.1/servers/d6189bec-a398-4e64-8e79-0b766af2f833 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:37:47.575056 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-d06503a2-1511-4a27-8731-6f3ba40bb937 req-604522de-a9a8-4d88-857b-e542ac0e93e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e509d1e-b5d6-4f5f-a017-c2df1d2433f4", "tag": "3e008d29-c997-484e-89f5-bf52efc1c101"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:47.580650 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e651dbc2-0c98-4f13-b937-31ce5d4b8a72 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993" status: 200 len: 1455 microversion: 2.1 time: 0.110434 Jul 19 22:37:47.583076 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1241/2492] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:37:47 2022] GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993 => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:47.588435 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d9c3a22f-9e07-4752-ac6d-f4767378fd44 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:47.589341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d9c3a22f-9e07-4752-ac6d-f4767378fd44 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 4cd615b0-c9c8-422d-bcbb-3de7da85e703] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:47.598832 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d06503a2-1511-4a27-8731-6f3ba40bb937 req-604522de-a9a8-4d88-857b-e542ac0e93e4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:47.600188 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d06503a2-1511-4a27-8731-6f3ba40bb937 req-604522de-a9a8-4d88-857b-e542ac0e93e4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:47.601951 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d9c3a22f-9e07-4752-ac6d-f4767378fd44 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:47.602792 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d9c3a22f-9e07-4752-ac6d-f4767378fd44 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:47.604336 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d9c3a22f-9e07-4752-ac6d-f4767378fd44 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:47.605187 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d9c3a22f-9e07-4752-ac6d-f4767378fd44 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:47.628848 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-d06503a2-1511-4a27-8731-6f3ba40bb937 req-604522de-a9a8-4d88-857b-e542ac0e93e4 service nova] Creating event network-changed:3e008d29-c997-484e-89f5-bf52efc1c101 for instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 on n-h2-847009-3 Jul 19 22:37:47.640986 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-d06503a2-1511-4a27-8731-6f3ba40bb937 req-604522de-a9a8-4d88-857b-e542ac0e93e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071845 Jul 19 22:37:47.642607 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1252/2493] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:47.654037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1fb2cd2c-c518-4800-8d2a-532c1811389b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:47.656938 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1fb2cd2c-c518-4800-8d2a-532c1811389b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: 3e15d03f-3614-4eba-bf41-a0c059b15d56] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:47.671852 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1fb2cd2c-c518-4800-8d2a-532c1811389b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:47.673219 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1fb2cd2c-c518-4800-8d2a-532c1811389b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:47.674157 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1fb2cd2c-c518-4800-8d2a-532c1811389b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:47.674958 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1fb2cd2c-c518-4800-8d2a-532c1811389b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:48.157817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d9c3a22f-9e07-4752-ac6d-f4767378fd44 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:48.180267 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d9c3a22f-9e07-4752-ac6d-f4767378fd44 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703" status: 200 len: 1468 microversion: 2.1 time: 0.595407 Jul 19 22:37:48.203036 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1242/2494] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:47 2022] GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703 => generated 1468 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:48.219424 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5e700f86-2f8e-435e-b7fc-db6c40d8a5a8 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] Calling method '.version_select at 0x7f7a1563f940>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:48.287927 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5e700f86-2f8e-435e-b7fc-db6c40d8a5a8 tempest-ServersTestManualDisk-858317139 tempest-ServersTestManualDisk-858317139-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1917630425" status: 202 len: 0 microversion: 2.1 time: 0.078826 Jul 19 22:37:48.290984 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1243/2495] 10.222.0.25 () {58 vars in 1220 bytes} [Tue Jul 19 22:37:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1917630425 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:37:48.360996 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-7c44587d-676b-47ce-9c2a-8d4581d504a9 req-fedee3a7-20c1-4e31-9cfe-ceb7fd4a41e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cd615b0-c9c8-422d-bcbb-3de7da85e703", "name": "network-vif-deleted", "tag": "83aba1bc-e96e-49f4-b92a-4482e94fb923"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:48.379584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-7c44587d-676b-47ce-9c2a-8d4581d504a9 req-fedee3a7-20c1-4e31-9cfe-ceb7fd4a41e8 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:48.380177 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1fb2cd2c-c518-4800-8d2a-532c1811389b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ece721a99a4080a059c635b23761e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7242ed05524293b5dae6a33e520cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:48.381212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-7c44587d-676b-47ce-9c2a-8d4581d504a9 req-fedee3a7-20c1-4e31-9cfe-ceb7fd4a41e8 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:48.410596 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-7c44587d-676b-47ce-9c2a-8d4581d504a9 req-fedee3a7-20c1-4e31-9cfe-ceb7fd4a41e8 service nova] Creating event network-vif-deleted:83aba1bc-e96e-49f4-b92a-4482e94fb923 for instance 4cd615b0-c9c8-422d-bcbb-3de7da85e703 on n-h1-847009-3 Jul 19 22:37:48.421823 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-7c44587d-676b-47ce-9c2a-8d4581d504a9 req-fedee3a7-20c1-4e31-9cfe-ceb7fd4a41e8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077614 Jul 19 22:37:48.423597 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1244/2496] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:48.446057 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1fb2cd2c-c518-4800-8d2a-532c1811389b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56" status: 200 len: 1323 microversion: 2.1 time: 0.800499 Jul 19 22:37:48.448428 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1253/2497] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:47 2022] GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56 => generated 1323 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:48.483974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-49e054bb-a2ba-4fa0-8a67-281c03451f3a req-ed2fea57-f9b2-48d6-8ac9-7efb5909d8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68ea88aa-1db0-490d-a791-5abd31245b37", "name": "network-vif-plugged", "status": "completed", "tag": "7f9a6270-b52e-4ef8-8c55-12d663495830"}, {"server_uuid": "68ea88aa-1db0-490d-a791-5abd31245b37", "name": "network-vif-plugged", "status": "completed", "tag": "0e205eb3-7b4d-4e1f-a7b0-ab13afcd2c93"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:48.503428 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7e511495-9bfa-4c0d-a47f-3a73c240b522 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:48.508577 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7e511495-9bfa-4c0d-a47f-3a73c240b522 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:48.528351 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-49e054bb-a2ba-4fa0-8a67-281c03451f3a req-ed2fea57-f9b2-48d6-8ac9-7efb5909d8c8 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:48.531279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-49e054bb-a2ba-4fa0-8a67-281c03451f3a req-ed2fea57-f9b2-48d6-8ac9-7efb5909d8c8 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:48.543852 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e511495-9bfa-4c0d-a47f-3a73c240b522 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:48.545776 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e511495-9bfa-4c0d-a47f-3a73c240b522 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:48.554832 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e511495-9bfa-4c0d-a47f-3a73c240b522 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:48.558762 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e511495-9bfa-4c0d-a47f-3a73c240b522 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:48.575174 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-49e054bb-a2ba-4fa0-8a67-281c03451f3a req-ed2fea57-f9b2-48d6-8ac9-7efb5909d8c8 service nova] Creating event network-vif-plugged:7f9a6270-b52e-4ef8-8c55-12d663495830 for instance 68ea88aa-1db0-490d-a791-5abd31245b37 on n-h1-847009-3 Jul 19 22:37:48.575823 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-49e054bb-a2ba-4fa0-8a67-281c03451f3a req-ed2fea57-f9b2-48d6-8ac9-7efb5909d8c8 service nova] Creating event network-vif-plugged:0e205eb3-7b4d-4e1f-a7b0-ab13afcd2c93 for instance 68ea88aa-1db0-490d-a791-5abd31245b37 on n-h1-847009-3 Jul 19 22:37:48.585516 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-49e054bb-a2ba-4fa0-8a67-281c03451f3a req-ed2fea57-f9b2-48d6-8ac9-7efb5909d8c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.111846 Jul 19 22:37:48.587084 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1245/2498] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:48.597297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-684d42c0-73d5-4143-b43e-32af391e1f61 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:48.599664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-684d42c0-73d5-4143-b43e-32af391e1f61 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:48.610388 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-684d42c0-73d5-4143-b43e-32af391e1f61 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:48.611287 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-684d42c0-73d5-4143-b43e-32af391e1f61 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:48.612499 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-684d42c0-73d5-4143-b43e-32af391e1f61 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:48.617961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-684d42c0-73d5-4143-b43e-32af391e1f61 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:49.127247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7e511495-9bfa-4c0d-a47f-3a73c240b522 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:49.142167 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7e511495-9bfa-4c0d-a47f-3a73c240b522 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1515 microversion: 2.1 time: 0.647778 Jul 19 22:37:49.156270 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1254/2499] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:48 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1515 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:37:49.165555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-15efb823-4e73-4c89-b39e-b34ea03d1ef5 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a039c3700>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:49.171801 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-684d42c0-73d5-4143-b43e-32af391e1f61 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:49.186486 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-684d42c0-73d5-4143-b43e-32af391e1f61 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 200 len: 1354 microversion: 2.1 time: 0.596819 Jul 19 22:37:49.188651 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1246/2500] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:48 2022] GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 1354 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:49.220816 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-25d1b4d1-f1ee-419b-a193-fadbc0747dc5 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:49.223882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-25d1b4d1-f1ee-419b-a193-fadbc0747dc5 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 4cd615b0-c9c8-422d-bcbb-3de7da85e703] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:49.251858 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-25d1b4d1-f1ee-419b-a193-fadbc0747dc5 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:49.252341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-25d1b4d1-f1ee-419b-a193-fadbc0747dc5 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:49.253265 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-25d1b4d1-f1ee-419b-a193-fadbc0747dc5 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:49.253877 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-25d1b4d1-f1ee-419b-a193-fadbc0747dc5 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:49.261946 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-15efb823-4e73-4c89-b39e-b34ea03d1ef5 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993" status: 200 len: 1455 microversion: 2.1 time: 0.100968 Jul 19 22:37:49.272681 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1255/2501] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:37:49 2022] GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993 => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:49.344797 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-25d1b4d1-f1ee-419b-a193-fadbc0747dc5 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:49.345351 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-25d1b4d1-f1ee-419b-a193-fadbc0747dc5 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:49.345889 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-25d1b4d1-f1ee-419b-a193-fadbc0747dc5 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lazy-loading 'fault' on Instance uuid 4cd615b0-c9c8-422d-bcbb-3de7da85e703 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:37:49.427135 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-25d1b4d1-f1ee-419b-a193-fadbc0747dc5 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:49.438692 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-25d1b4d1-f1ee-419b-a193-fadbc0747dc5 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703" status: 200 len: 1311 microversion: 2.1 time: 0.232584 Jul 19 22:37:49.439335 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1247/2502] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:49 2022] GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703 => generated 1311 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:49.478743 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1e33fd41-1d2f-4d58-8cd0-cc044caffcbd tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:49.482075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1e33fd41-1d2f-4d58-8cd0-cc044caffcbd tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: 3e15d03f-3614-4eba-bf41-a0c059b15d56] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:49.500775 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1e33fd41-1d2f-4d58-8cd0-cc044caffcbd tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:49.502676 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1e33fd41-1d2f-4d58-8cd0-cc044caffcbd tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:49.504257 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1e33fd41-1d2f-4d58-8cd0-cc044caffcbd tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:49.507102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1e33fd41-1d2f-4d58-8cd0-cc044caffcbd tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:49.730249 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1e33fd41-1d2f-4d58-8cd0-cc044caffcbd tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ece721a99a4080a059c635b23761e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7242ed05524293b5dae6a33e520cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:49.743678 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1e33fd41-1d2f-4d58-8cd0-cc044caffcbd tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56" status: 200 len: 1323 microversion: 2.1 time: 0.274213 Jul 19 22:37:49.744366 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1256/2503] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:49 2022] GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56 => generated 1323 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:50.168523 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-68a73a78-97f3-4e3c-84b9-9054b83dae97 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:50.172218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-68a73a78-97f3-4e3c-84b9-9054b83dae97 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:50.212028 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-020021de-e769-48d7-b377-29db70e0a74d tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:50.223534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-020021de-e769-48d7-b377-29db70e0a74d tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:50.225672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-68a73a78-97f3-4e3c-84b9-9054b83dae97 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:50.229595 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-68a73a78-97f3-4e3c-84b9-9054b83dae97 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:50.239966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-68a73a78-97f3-4e3c-84b9-9054b83dae97 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:50.244092 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-68a73a78-97f3-4e3c-84b9-9054b83dae97 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:50.260137 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-020021de-e769-48d7-b377-29db70e0a74d tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:50.265750 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-020021de-e769-48d7-b377-29db70e0a74d tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:50.267625 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-020021de-e769-48d7-b377-29db70e0a74d tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:50.275245 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-020021de-e769-48d7-b377-29db70e0a74d tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:50.955788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-68a73a78-97f3-4e3c-84b9-9054b83dae97 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:50.978898 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-68a73a78-97f3-4e3c-84b9-9054b83dae97 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1515 microversion: 2.1 time: 0.817588 Jul 19 22:37:50.989934 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1248/2504] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:50 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1515 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:50.994757 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-020021de-e769-48d7-b377-29db70e0a74d tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:50.998754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fb3d9158-21eb-456b-8955-af25a1be7403 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a156a7310>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:51.006483 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-020021de-e769-48d7-b377-29db70e0a74d tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 200 len: 1354 microversion: 2.1 time: 0.802710 Jul 19 22:37:51.018808 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1257/2505] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:50 2022] GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 1354 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:51.024349 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-71adfb9b-a925-4d9c-ab8f-9adc8bd8d945 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:51.025190 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-71adfb9b-a925-4d9c-ab8f-9adc8bd8d945 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 4cd615b0-c9c8-422d-bcbb-3de7da85e703] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:51.034655 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71adfb9b-a925-4d9c-ab8f-9adc8bd8d945 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:51.035600 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71adfb9b-a925-4d9c-ab8f-9adc8bd8d945 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:51.036553 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71adfb9b-a925-4d9c-ab8f-9adc8bd8d945 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:51.037149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71adfb9b-a925-4d9c-ab8f-9adc8bd8d945 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:51.089573 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-71adfb9b-a925-4d9c-ab8f-9adc8bd8d945 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] HTTP exception thrown: Instance 4cd615b0-c9c8-422d-bcbb-3de7da85e703 could not be found. Jul 19 22:37:51.092519 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-71adfb9b-a925-4d9c-ab8f-9adc8bd8d945 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Request method failure captured: Jul 19 22:37:51.092519 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703 HTTP/1.1 Jul 19 22:37:51.092519 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:37:51.092519 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:37:51.092519 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:37:51.092519 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:37:51.092519 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:37:51.092519 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:37:51.092519 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:37:51.092519 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:37:51.092519 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zHmVUlLPYCUOkwL-2nRuuCNlNdaVwbQtPjF7xiHm1ro0jVrvR0bSeKKcXltP9wwiNj84JrlhqfRdAdGDCC6Ur8qZMtDWItMDHz2tP90KfDmbC96Ev1paGn0Wmj7HmyEy-jxHXUZzI8YvECGBy9UDivOjNuUZCejHh3NGg94jdGJf8M Jul 19 22:37:51.092519 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:37:51.092519 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:37:51.092519 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:37:51.092519 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:37:51.092519 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:37:51.092519 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:37:51.092519 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 6a0799fad79e47d0b0180c0f8834341e Jul 19 22:37:51.092519 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1366135536 Jul 19 22:37:51.092519 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:37:51.092519 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:37:51.094870 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6a0799fad79e47d0b0180c0f8834341e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6a0799fad79e47d0b0180c0f8834341e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6a0799fad79e47d0b0180c0f8834341e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6a0799fad79e47d0b0180c0f8834341e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:37:51.094870 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1366135536 Jul 19 22:37:51.094870 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 6a0799fad79e47d0b0180c0f8834341e Jul 19 22:37:51.094870 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1366135536 Jul 19 22:37:51.094870 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersAdminNegativeTestJSON-1366135536-project Jul 19 22:37:51.094870 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:37:51.094870 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:37:51.094870 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 5f958eb846b04f0fbbe7b95da7d5c328 Jul 19 22:37:51.094870 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1366135536-project Jul 19 22:37:51.094870 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:37:51.094870 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 4cd615b0-c9c8-422d-bcbb-3de7da85e703 could not be found. Jul 19 22:37:51.094870 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '4cd615b0-c9c8-422d-bcbb-3de7da85e703'} Jul 19 22:37:51.095787 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:37:51.095787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:37:51.095787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:37:51.095787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:37:51.095787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:37:51.095787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:37:51.095787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:37:51.095787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:37:51.095787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:37:51.095787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:37:51.095787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cd615b0-c9c8-422d-bcbb-3de7da85e703 could not be found. Jul 19 22:37:51.095787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:37:51.095787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:37:51.095787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:37:51.095787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:37:51.095787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:37:51.095787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:37:51.095787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:37:51.095787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:37:51.095787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:37:51.097505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:37:51.097505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:37:51.097505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:37:51.097505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:37:51.097505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:37:51.097505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:37:51.097505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:37:51.097505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cd615b0-c9c8-422d-bcbb-3de7da85e703 could not be found. Jul 19 22:37:51.097505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:37:51.097505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:37:51.097505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:37:51.097505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:37:51.097505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:37:51.097505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:37:51.097505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:37:51.097505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:37:51.097505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cd615b0-c9c8-422d-bcbb-3de7da85e703 could not be found. Jul 19 22:37:51.097505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:37:51.099792 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-71adfb9b-a925-4d9c-ab8f-9adc8bd8d945 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Returning 404 to user: Instance 4cd615b0-c9c8-422d-bcbb-3de7da85e703 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:37:51.101102 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-71adfb9b-a925-4d9c-ab8f-9adc8bd8d945 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703" status: 404 len: 111 microversion: 2.1 time: 0.080566 Jul 19 22:37:51.102233 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1258/2506] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:51 2022] GET /compute/v2.1/servers/4cd615b0-c9c8-422d-bcbb-3de7da85e703 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:37:51.116626 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fa12d40f-8969-44ba-9037-ebcdedcb26a1 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:51.117437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fa12d40f-8969-44ba-9037-ebcdedcb26a1 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: 3e15d03f-3614-4eba-bf41-a0c059b15d56] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:51.124374 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa12d40f-8969-44ba-9037-ebcdedcb26a1 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:51.125089 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa12d40f-8969-44ba-9037-ebcdedcb26a1 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:51.126033 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa12d40f-8969-44ba-9037-ebcdedcb26a1 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:51.127308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa12d40f-8969-44ba-9037-ebcdedcb26a1 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:51.145081 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fb3d9158-21eb-456b-8955-af25a1be7403 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993" status: 200 len: 1455 microversion: 2.1 time: 0.162272 Jul 19 22:37:51.166851 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1249/2507] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:37:50 2022] GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993 => generated 1455 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:51.179150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-29c80cca-9d1f-4624-9b46-edcf12b0b797 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:51.180083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-29c80cca-9d1f-4624-9b46-edcf12b0b797 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 0ee48b19-107c-4883-8d87-5868a5201d08] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:51.196833 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-29c80cca-9d1f-4624-9b46-edcf12b0b797 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:51.200047 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-29c80cca-9d1f-4624-9b46-edcf12b0b797 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:51.201871 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-29c80cca-9d1f-4624-9b46-edcf12b0b797 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:51.204890 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-29c80cca-9d1f-4624-9b46-edcf12b0b797 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:51.287444 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-29c80cca-9d1f-4624-9b46-edcf12b0b797 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 0ee48b19-107c-4883-8d87-5868a5201d08] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:37:51.460550 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-29c80cca-9d1f-4624-9b46-edcf12b0b797 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08" status: 204 len: 0 microversion: 2.1 time: 0.291355 Jul 19 22:37:51.461160 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1250/2508] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:37:51 2022] DELETE /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:37:51.487629 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3f5f0489-e126-4b40-9722-cbf3a39dfe20 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:51.489018 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3f5f0489-e126-4b40-9722-cbf3a39dfe20 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 0ee48b19-107c-4883-8d87-5868a5201d08] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:51.498258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f5f0489-e126-4b40-9722-cbf3a39dfe20 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:51.500933 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f5f0489-e126-4b40-9722-cbf3a39dfe20 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:51.503428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f5f0489-e126-4b40-9722-cbf3a39dfe20 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:51.504484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f5f0489-e126-4b40-9722-cbf3a39dfe20 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:51.702473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fa12d40f-8969-44ba-9037-ebcdedcb26a1 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ece721a99a4080a059c635b23761e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7242ed05524293b5dae6a33e520cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:51.730056 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fa12d40f-8969-44ba-9037-ebcdedcb26a1 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56" status: 200 len: 1323 microversion: 2.1 time: 0.615067 Jul 19 22:37:51.731552 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1259/2509] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:51 2022] GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56 => generated 1323 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:51.911141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3f5f0489-e126-4b40-9722-cbf3a39dfe20 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:51.930582 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3f5f0489-e126-4b40-9722-cbf3a39dfe20 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08" status: 200 len: 1477 microversion: 2.1 time: 0.454638 Jul 19 22:37:51.931967 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1251/2510] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:51 2022] GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08 => generated 1477 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:52.002900 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a0f26635-f2c9-436f-a034-4279a25f55d9 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:52.006554 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a0f26635-f2c9-436f-a034-4279a25f55d9 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:52.028092 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0f26635-f2c9-436f-a034-4279a25f55d9 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:52.030277 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0f26635-f2c9-436f-a034-4279a25f55d9 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:52.032314 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0f26635-f2c9-436f-a034-4279a25f55d9 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:52.033355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0f26635-f2c9-436f-a034-4279a25f55d9 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:52.036900 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cfc60004-3ebc-469b-9162-0f7e87635700 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:52.037909 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cfc60004-3ebc-469b-9162-0f7e87635700 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:52.059030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cfc60004-3ebc-469b-9162-0f7e87635700 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:52.059839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cfc60004-3ebc-469b-9162-0f7e87635700 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:52.077112 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cfc60004-3ebc-469b-9162-0f7e87635700 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:52.079537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cfc60004-3ebc-469b-9162-0f7e87635700 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:52.475978 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a0f26635-f2c9-436f-a034-4279a25f55d9 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:52.489858 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a0f26635-f2c9-436f-a034-4279a25f55d9 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1515 microversion: 2.1 time: 0.494392 Jul 19 22:37:52.508586 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1260/2511] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:51 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1515 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:52.525724 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1bfb9e09-61eb-44e1-a83b-2ff72889ecb1 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a1045d940>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:52.646278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cfc60004-3ebc-469b-9162-0f7e87635700 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:52.658903 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1bfb9e09-61eb-44e1-a83b-2ff72889ecb1 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993" status: 200 len: 1455 microversion: 2.1 time: 0.148072 Jul 19 22:37:52.676048 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1261/2512] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:37:52 2022] GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993 => generated 1455 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:52.679522 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cfc60004-3ebc-469b-9162-0f7e87635700 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 200 len: 1805 microversion: 2.1 time: 0.656904 Jul 19 22:37:52.690168 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1252/2513] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:52 2022] GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 1805 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:52.709299 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-86f07b8c-f26f-49e4-9e40-2505a3ff781b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:52.710318 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-86f07b8c-f26f-49e4-9e40-2505a3ff781b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:52.721001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:37:52.725144 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86f07b8c-f26f-49e4-9e40-2505a3ff781b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:52.726052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86f07b8c-f26f-49e4-9e40-2505a3ff781b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:52.727245 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86f07b8c-f26f-49e4-9e40-2505a3ff781b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:52.727851 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86f07b8c-f26f-49e4-9e40-2505a3ff781b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:52.756154 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-61495a97-00d7-43f6-a5a5-d5e20d068cd0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:52.757195 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-61495a97-00d7-43f6-a5a5-d5e20d068cd0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: 3e15d03f-3614-4eba-bf41-a0c059b15d56] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:52.803458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61495a97-00d7-43f6-a5a5-d5e20d068cd0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:52.809337 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61495a97-00d7-43f6-a5a5-d5e20d068cd0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:52.812566 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61495a97-00d7-43f6-a5a5-d5e20d068cd0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:52.816072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61495a97-00d7-43f6-a5a5-d5e20d068cd0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:52.842414 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-86f07b8c-f26f-49e4-9e40-2505a3ff781b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37/ips" status: 200 len: 219 microversion: 2.1 time: 0.133527 Jul 19 22:37:52.853180 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1262/2514] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 19 22:37:52 2022] GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37/ips => generated 219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:37:52.872482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-88be757a-4fe6-4780-92ab-fb78f777150d tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:52.873391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-88be757a-4fe6-4780-92ab-fb78f777150d tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:52.899945 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-88be757a-4fe6-4780-92ab-fb78f777150d tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:52.900683 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-88be757a-4fe6-4780-92ab-fb78f777150d tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:52.905239 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-88be757a-4fe6-4780-92ab-fb78f777150d tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:52.908048 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-88be757a-4fe6-4780-92ab-fb78f777150d tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:53.018356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-88be757a-4fe6-4780-92ab-fb78f777150d tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:37:53.244343 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:37:53.393517 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-88be757a-4fe6-4780-92ab-fb78f777150d tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "DELETE /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 204 len: 0 microversion: 2.1 time: 0.538496 Jul 19 22:37:53.398373 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1263/2515] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:37:52 2022] DELETE /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:37:53.405556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-22924654-2741-410e-970e-e5deeba3ba2a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:53.406600 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-22924654-2741-410e-970e-e5deeba3ba2a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 0ee48b19-107c-4883-8d87-5868a5201d08] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:53.413971 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-22924654-2741-410e-970e-e5deeba3ba2a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:53.414744 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-22924654-2741-410e-970e-e5deeba3ba2a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:53.417182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-22924654-2741-410e-970e-e5deeba3ba2a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:53.417828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-22924654-2741-410e-970e-e5deeba3ba2a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:53.883606 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-22924654-2741-410e-970e-e5deeba3ba2a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:53.927942 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-22924654-2741-410e-970e-e5deeba3ba2a tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08" status: 200 len: 1477 microversion: 2.1 time: 0.522488 Jul 19 22:37:53.929691 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1264/2516] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:53 2022] GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08 => generated 1477 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:53.949891 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d3066bd0-a8e3-4170-bd9e-a22373f22cec tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:53.951052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d3066bd0-a8e3-4170-bd9e-a22373f22cec tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:53.965067 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3066bd0-a8e3-4170-bd9e-a22373f22cec tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:53.965865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3066bd0-a8e3-4170-bd9e-a22373f22cec tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:53.980367 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3066bd0-a8e3-4170-bd9e-a22373f22cec tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:53.981795 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3066bd0-a8e3-4170-bd9e-a22373f22cec tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:54.614378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-61495a97-00d7-43f6-a5a5-d5e20d068cd0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ece721a99a4080a059c635b23761e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7242ed05524293b5dae6a33e520cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:54.632065 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-61495a97-00d7-43f6-a5a5-d5e20d068cd0 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56" status: 200 len: 1323 microversion: 2.1 time: 1.882168 Jul 19 22:37:54.633983 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1253/2517] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:52 2022] GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56 => generated 1323 bytes in 1885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:37:54.639730 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-1ae64559-159a-418a-94f2-7e73ef14c537 req-83ece30c-2eca-4ff0-a952-8a127d1ae86e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e15d03f-3614-4eba-bf41-a0c059b15d56", "name": "network-vif-plugged", "status": "completed", "tag": "cbe37743-8894-46d0-a28d-912d057c4b98"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:54.671491 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1ae64559-159a-418a-94f2-7e73ef14c537 req-83ece30c-2eca-4ff0-a952-8a127d1ae86e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:54.672132 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1ae64559-159a-418a-94f2-7e73ef14c537 req-83ece30c-2eca-4ff0-a952-8a127d1ae86e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:54.718464 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-1ae64559-159a-418a-94f2-7e73ef14c537 req-83ece30c-2eca-4ff0-a952-8a127d1ae86e service nova] Creating event network-vif-plugged:cbe37743-8894-46d0-a28d-912d057c4b98 for instance 3e15d03f-3614-4eba-bf41-a0c059b15d56 on n-h2-847009-3 Jul 19 22:37:54.731670 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-1ae64559-159a-418a-94f2-7e73ef14c537 req-83ece30c-2eca-4ff0-a952-8a127d1ae86e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093189 Jul 19 22:37:54.735020 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1254/2518] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:54.748782 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8657694f-70b5-4970-ab86-7152b941bdb2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:54.760333 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8657694f-70b5-4970-ab86-7152b941bdb2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:54.762526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:37:54.774543 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8657694f-70b5-4970-ab86-7152b941bdb2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:54.775532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8657694f-70b5-4970-ab86-7152b941bdb2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:54.776682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8657694f-70b5-4970-ab86-7152b941bdb2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:54.777429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8657694f-70b5-4970-ab86-7152b941bdb2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:55.089169 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d3066bd0-a8e3-4170-bd9e-a22373f22cec tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:55.117735 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d3066bd0-a8e3-4170-bd9e-a22373f22cec tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 200 len: 1811 microversion: 2.1 time: 1.186165 Jul 19 22:37:55.118930 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1265/2519] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:53 2022] GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 1811 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:55.153330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b9acd02d-1d09-499f-a032-f4c1bd87328d tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a102a7310>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:55.294038 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b9acd02d-1d09-499f-a032-f4c1bd87328d tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993" status: 200 len: 1455 microversion: 2.1 time: 0.148206 Jul 19 22:37:55.297702 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1266/2520] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:37:55 2022] GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993 => generated 1455 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:55.316145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-89648a9f-a8af-43b3-97d1-fcb337d1d410 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:55.317079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-89648a9f-a8af-43b3-97d1-fcb337d1d410 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 0ee48b19-107c-4883-8d87-5868a5201d08] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:55.333953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-89648a9f-a8af-43b3-97d1-fcb337d1d410 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:55.336659 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-89648a9f-a8af-43b3-97d1-fcb337d1d410 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:55.337713 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-89648a9f-a8af-43b3-97d1-fcb337d1d410 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:55.341414 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-89648a9f-a8af-43b3-97d1-fcb337d1d410 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:55.869209 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-89648a9f-a8af-43b3-97d1-fcb337d1d410 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:55.881481 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-89648a9f-a8af-43b3-97d1-fcb337d1d410 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08" status: 200 len: 1477 microversion: 2.1 time: 0.579572 Jul 19 22:37:55.883427 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1267/2521] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:55 2022] GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08 => generated 1477 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:55.888381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-479bab4d-0a8f-41cd-a8bc-907940c7b136 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:55.889028 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-479bab4d-0a8f-41cd-a8bc-907940c7b136 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: 3e15d03f-3614-4eba-bf41-a0c059b15d56] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:55.897126 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-479bab4d-0a8f-41cd-a8bc-907940c7b136 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:55.898462 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-479bab4d-0a8f-41cd-a8bc-907940c7b136 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:55.899698 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-479bab4d-0a8f-41cd-a8bc-907940c7b136 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:55.900730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-479bab4d-0a8f-41cd-a8bc-907940c7b136 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:55.945951 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8657694f-70b5-4970-ab86-7152b941bdb2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:55.988333 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8657694f-70b5-4970-ab86-7152b941bdb2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1515 microversion: 2.1 time: 1.250561 Jul 19 22:37:55.992739 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1255/2522] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:54 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1515 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:56.151746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d653be88-0890-44df-beb7-509bf1590a92 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:56.152589 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d653be88-0890-44df-beb7-509bf1590a92 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:56.167061 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d653be88-0890-44df-beb7-509bf1590a92 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:56.168129 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d653be88-0890-44df-beb7-509bf1590a92 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:56.169695 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d653be88-0890-44df-beb7-509bf1590a92 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:56.170635 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d653be88-0890-44df-beb7-509bf1590a92 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:56.653763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-479bab4d-0a8f-41cd-a8bc-907940c7b136 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ece721a99a4080a059c635b23761e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7242ed05524293b5dae6a33e520cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:56.678085 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-479bab4d-0a8f-41cd-a8bc-907940c7b136 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56" status: 200 len: 1323 microversion: 2.1 time: 0.793329 Jul 19 22:37:56.680126 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1268/2523] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:55 2022] GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56 => generated 1323 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:56.690454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-87480178-a152-43e2-a8b7-3dc574b72b8f tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a156baa60>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:56.813643 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-87480178-a152-43e2-a8b7-3dc574b72b8f tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993" status: 200 len: 1455 microversion: 2.1 time: 0.131227 Jul 19 22:37:56.815603 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1269/2524] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:37:56 2022] GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993 => generated 1455 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:56.825075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-daa076a8-9c71-45a9-97a7-acf3b6c330ed req-48712ff7-23b0-4177-8d26-7454aa089673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a846129-bc22-4520-bd5b-d33fcd0a94a2", "name": "network-vif-plugged", "status": "completed", "tag": "f07043ec-4940-4a2a-bfd4-8d23d6ddf88d"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:56.844715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-daa076a8-9c71-45a9-97a7-acf3b6c330ed req-48712ff7-23b0-4177-8d26-7454aa089673 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:56.845928 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-daa076a8-9c71-45a9-97a7-acf3b6c330ed req-48712ff7-23b0-4177-8d26-7454aa089673 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:56.870919 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-daa076a8-9c71-45a9-97a7-acf3b6c330ed req-48712ff7-23b0-4177-8d26-7454aa089673 service nova] Creating event network-vif-plugged:f07043ec-4940-4a2a-bfd4-8d23d6ddf88d for instance 7a846129-bc22-4520-bd5b-d33fcd0a94a2 on n-h2-847009-3 Jul 19 22:37:56.880867 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-daa076a8-9c71-45a9-97a7-acf3b6c330ed req-48712ff7-23b0-4177-8d26-7454aa089673 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062923 Jul 19 22:37:56.882346 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1270/2525] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:56.932349 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-10cfc4ee-4171-43a7-aa09-0939c86170f8 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:56.945657 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-10cfc4ee-4171-43a7-aa09-0939c86170f8 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 0ee48b19-107c-4883-8d87-5868a5201d08] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:56.998841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-10cfc4ee-4171-43a7-aa09-0939c86170f8 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:57.000857 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-10cfc4ee-4171-43a7-aa09-0939c86170f8 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:57.001901 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-10cfc4ee-4171-43a7-aa09-0939c86170f8 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:57.003017 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-10cfc4ee-4171-43a7-aa09-0939c86170f8 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:57.094264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d653be88-0890-44df-beb7-509bf1590a92 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:57.114953 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d653be88-0890-44df-beb7-509bf1590a92 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 200 len: 1811 microversion: 2.1 time: 0.968203 Jul 19 22:37:57.126136 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1256/2526] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:56 2022] GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 1811 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:57.139375 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8f0ba297-56e6-440c-ba87-69d1d897e332 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:57.151101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8f0ba297-56e6-440c-ba87-69d1d897e332 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:57.177299 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f0ba297-56e6-440c-ba87-69d1d897e332 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:57.185393 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f0ba297-56e6-440c-ba87-69d1d897e332 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:57.188280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f0ba297-56e6-440c-ba87-69d1d897e332 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:57.194354 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f0ba297-56e6-440c-ba87-69d1d897e332 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:57.246842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:37:57.317391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-10cfc4ee-4171-43a7-aa09-0939c86170f8 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f958eb846b04f0fbbe7b95da7d5c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0799fad79e47d0b0180c0f8834341e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:57.339320 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-10cfc4ee-4171-43a7-aa09-0939c86170f8 tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08" status: 200 len: 1435 microversion: 2.1 time: 0.422910 Jul 19 22:37:57.363690 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1271/2527] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:56 2022] GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08 => generated 1435 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:57.372825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-aad999af-2a55-478a-8962-30568622735e req-51b637a7-bdca-4f76-90ec-22e338aea135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee48b19-107c-4883-8d87-5868a5201d08", "name": "network-vif-deleted", "tag": "b4de2026-c6d2-47b7-a650-4bd04fa9128f"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:57.398931 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-aad999af-2a55-478a-8962-30568622735e req-51b637a7-bdca-4f76-90ec-22e338aea135 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:57.399433 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-aad999af-2a55-478a-8962-30568622735e req-51b637a7-bdca-4f76-90ec-22e338aea135 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:57.427511 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-aad999af-2a55-478a-8962-30568622735e req-51b637a7-bdca-4f76-90ec-22e338aea135 service nova] Creating event network-vif-deleted:b4de2026-c6d2-47b7-a650-4bd04fa9128f for instance 0ee48b19-107c-4883-8d87-5868a5201d08 on n-h1-847009-3 Jul 19 22:37:57.445356 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-aad999af-2a55-478a-8962-30568622735e req-51b637a7-bdca-4f76-90ec-22e338aea135 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079339 Jul 19 22:37:57.447480 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1272/2528] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:57.706337 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7cd14275-4e11-451a-91ab-e7ad0799f855 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:57.721544 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7cd14275-4e11-451a-91ab-e7ad0799f855 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: 3e15d03f-3614-4eba-bf41-a0c059b15d56] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:57.754087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7cd14275-4e11-451a-91ab-e7ad0799f855 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:57.757588 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7cd14275-4e11-451a-91ab-e7ad0799f855 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:57.763570 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7cd14275-4e11-451a-91ab-e7ad0799f855 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:57.766491 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7cd14275-4e11-451a-91ab-e7ad0799f855 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:58.172118 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8f0ba297-56e6-440c-ba87-69d1d897e332 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:58.182951 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8f0ba297-56e6-440c-ba87-69d1d897e332 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1515 microversion: 2.1 time: 1.054902 Jul 19 22:37:58.192732 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1257/2529] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:57 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1515 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:58.197806 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a610be64-b200-4c29-83e1-de6e1b6c542d tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a15613e50>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:58.387860 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a610be64-b200-4c29-83e1-de6e1b6c542d tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993" status: 200 len: 1455 microversion: 2.1 time: 0.193687 Jul 19 22:37:58.388768 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1258/2530] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:37:58 2022] GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993 => generated 1455 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:58.400239 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4f6ca0cc-27db-40f0-89cb-a5be86bc56dd tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:58.401319 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4f6ca0cc-27db-40f0-89cb-a5be86bc56dd tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:58.431418 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f6ca0cc-27db-40f0-89cb-a5be86bc56dd tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:58.431978 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f6ca0cc-27db-40f0-89cb-a5be86bc56dd tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:58.432865 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f6ca0cc-27db-40f0-89cb-a5be86bc56dd tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:58.433486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f6ca0cc-27db-40f0-89cb-a5be86bc56dd tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:58.435394 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7cd14275-4e11-451a-91ab-e7ad0799f855 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ece721a99a4080a059c635b23761e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7242ed05524293b5dae6a33e520cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:58.494182 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7cd14275-4e11-451a-91ab-e7ad0799f855 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56" status: 200 len: 1323 microversion: 2.1 time: 0.797267 Jul 19 22:37:58.497703 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1273/2531] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:57 2022] GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56 => generated 1323 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:58.514355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0cda119f-d190-44a7-aaf4-3caf0a4fb1aa tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:58.516722 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0cda119f-d190-44a7-aaf4-3caf0a4fb1aa tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] [instance: 0ee48b19-107c-4883-8d87-5868a5201d08] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:58.529981 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cda119f-d190-44a7-aaf4-3caf0a4fb1aa tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:58.532606 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cda119f-d190-44a7-aaf4-3caf0a4fb1aa tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:58.534614 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cda119f-d190-44a7-aaf4-3caf0a4fb1aa tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:58.535934 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cda119f-d190-44a7-aaf4-3caf0a4fb1aa tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:58.585046 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-0cda119f-d190-44a7-aaf4-3caf0a4fb1aa tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] HTTP exception thrown: Instance 0ee48b19-107c-4883-8d87-5868a5201d08 could not be found. Jul 19 22:37:58.586912 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0cda119f-d190-44a7-aaf4-3caf0a4fb1aa tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Request method failure captured: Jul 19 22:37:58.586912 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08 HTTP/1.1 Jul 19 22:37:58.586912 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:37:58.586912 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:37:58.586912 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:37:58.586912 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:37:58.586912 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:37:58.586912 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:37:58.586912 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:37:58.586912 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:37:58.586912 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zHmVUlLPYCUOkwL-2nRuuCNlNdaVwbQtPjF7xiHm1ro0jVrvR0bSeKKcXltP9wwiNj84JrlhqfRdAdGDCC6Ur8qZMtDWItMDHz2tP90KfDmbC96Ev1paGn0Wmj7HmyEy-jxHXUZzI8YvECGBy9UDivOjNuUZCejHh3NGg94jdGJf8M Jul 19 22:37:58.586912 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:37:58.586912 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:37:58.586912 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:37:58.586912 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:37:58.586912 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:37:58.586912 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:37:58.586912 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 6a0799fad79e47d0b0180c0f8834341e Jul 19 22:37:58.586912 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1366135536 Jul 19 22:37:58.586912 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:37:58.586912 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:37:58.588440 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6a0799fad79e47d0b0180c0f8834341e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6a0799fad79e47d0b0180c0f8834341e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6a0799fad79e47d0b0180c0f8834341e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6a0799fad79e47d0b0180c0f8834341e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:37:58.588440 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1366135536 Jul 19 22:37:58.588440 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 6a0799fad79e47d0b0180c0f8834341e Jul 19 22:37:58.588440 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1366135536 Jul 19 22:37:58.588440 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersAdminNegativeTestJSON-1366135536-project Jul 19 22:37:58.588440 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:37:58.588440 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:37:58.588440 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 5f958eb846b04f0fbbe7b95da7d5c328 Jul 19 22:37:58.588440 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1366135536-project Jul 19 22:37:58.588440 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:37:58.588440 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 0ee48b19-107c-4883-8d87-5868a5201d08 could not be found. Jul 19 22:37:58.588440 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '0ee48b19-107c-4883-8d87-5868a5201d08'} Jul 19 22:37:58.589243 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:37:58.589243 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:37:58.589243 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:37:58.589243 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:37:58.589243 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:37:58.589243 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:37:58.589243 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:37:58.589243 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:37:58.589243 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:37:58.589243 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:37:58.589243 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ee48b19-107c-4883-8d87-5868a5201d08 could not be found. Jul 19 22:37:58.589243 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:37:58.589243 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:37:58.589243 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:37:58.589243 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:37:58.589243 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:37:58.589243 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:37:58.589243 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:37:58.589243 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:37:58.589243 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:37:58.590599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:37:58.590599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:37:58.590599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:37:58.590599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:37:58.590599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:37:58.590599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:37:58.590599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:37:58.590599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ee48b19-107c-4883-8d87-5868a5201d08 could not be found. Jul 19 22:37:58.590599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:37:58.590599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:37:58.590599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:37:58.590599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:37:58.590599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:37:58.590599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:37:58.590599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:37:58.590599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:37:58.590599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ee48b19-107c-4883-8d87-5868a5201d08 could not be found. Jul 19 22:37:58.590599 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:37:58.591834 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0cda119f-d190-44a7-aaf4-3caf0a4fb1aa tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] Returning 404 to user: Instance 0ee48b19-107c-4883-8d87-5868a5201d08 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:37:58.591834 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0cda119f-d190-44a7-aaf4-3caf0a4fb1aa tempest-ServersAdminNegativeTestJSON-1366135536 tempest-ServersAdminNegativeTestJSON-1366135536-project] 10.222.0.25 "GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08" status: 404 len: 111 microversion: 2.1 time: 0.088646 Jul 19 22:37:58.593840 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1274/2532] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:58 2022] GET /compute/v2.1/servers/0ee48b19-107c-4883-8d87-5868a5201d08 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:37:59.092661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-c5b6f717-092d-4446-a9e9-72965535e66b req-d83f3a69-3db0-4155-8e3c-ba276cfe5662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68ea88aa-1db0-490d-a791-5abd31245b37", "name": "network-vif-unplugged", "status": "completed", "tag": "7f9a6270-b52e-4ef8-8c55-12d663495830"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:59.154534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c5b6f717-092d-4446-a9e9-72965535e66b req-d83f3a69-3db0-4155-8e3c-ba276cfe5662 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:59.160516 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c5b6f717-092d-4446-a9e9-72965535e66b req-d83f3a69-3db0-4155-8e3c-ba276cfe5662 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:59.250211 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-c5b6f717-092d-4446-a9e9-72965535e66b req-d83f3a69-3db0-4155-8e3c-ba276cfe5662 service nova] Creating event network-vif-unplugged:7f9a6270-b52e-4ef8-8c55-12d663495830 for instance 68ea88aa-1db0-490d-a791-5abd31245b37 on n-h1-847009-3 Jul 19 22:37:59.274348 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-c5b6f717-092d-4446-a9e9-72965535e66b req-d83f3a69-3db0-4155-8e3c-ba276cfe5662 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.197410 Jul 19 22:37:59.278409 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1275/2533] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:37:59.308293 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5154fcc1-3c0f-420f-809f-345aee0a1c56 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:59.314058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5154fcc1-3c0f-420f-809f-345aee0a1c56 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:59.350921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5154fcc1-3c0f-420f-809f-345aee0a1c56 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:59.356110 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5154fcc1-3c0f-420f-809f-345aee0a1c56 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:59.359556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5154fcc1-3c0f-420f-809f-345aee0a1c56 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:59.366693 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5154fcc1-3c0f-420f-809f-345aee0a1c56 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:59.483355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4f6ca0cc-27db-40f0-89cb-a5be86bc56dd tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:37:59.541579 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4f6ca0cc-27db-40f0-89cb-a5be86bc56dd tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 200 len: 1790 microversion: 2.1 time: 1.139137 Jul 19 22:37:59.559461 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1259/2534] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:58 2022] GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 1790 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:59.565530 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7f8518a6-398d-41f6-bce3-370402f35f4a tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a155c9820>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:59.734582 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7f8518a6-398d-41f6-bce3-370402f35f4a tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993" status: 200 len: 1455 microversion: 2.1 time: 0.173663 Jul 19 22:37:59.735256 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1260/2535] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:37:59 2022] GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993 => generated 1455 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:37:59.742907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-43748e27-af61-4349-b2e3-a164341ff479 req-90621473-4e31-4a65-8823-cfc7c83d1368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68ea88aa-1db0-490d-a791-5abd31245b37", "name": "network-vif-deleted", "tag": "0e205eb3-7b4d-4e1f-a7b0-ab13afcd2c93"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:37:59.785976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-43748e27-af61-4349-b2e3-a164341ff479 req-90621473-4e31-4a65-8823-cfc7c83d1368 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:59.786515 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-43748e27-af61-4349-b2e3-a164341ff479 req-90621473-4e31-4a65-8823-cfc7c83d1368 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:59.801579 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-43748e27-af61-4349-b2e3-a164341ff479 req-90621473-4e31-4a65-8823-cfc7c83d1368 service nova] Creating event network-vif-deleted:0e205eb3-7b4d-4e1f-a7b0-ab13afcd2c93 for instance 68ea88aa-1db0-490d-a791-5abd31245b37 on n-h1-847009-3 Jul 19 22:37:59.835041 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-43748e27-af61-4349-b2e3-a164341ff479 req-90621473-4e31-4a65-8823-cfc7c83d1368 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097928 Jul 19 22:37:59.841042 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1261/2536] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:37:59.859311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5a822312-4215-49b3-bea2-17da4231fed5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:37:59.860748 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5a822312-4215-49b3-bea2-17da4231fed5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: 3e15d03f-3614-4eba-bf41-a0c059b15d56] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:37:59.870540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a822312-4215-49b3-bea2-17da4231fed5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:59.871880 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a822312-4215-49b3-bea2-17da4231fed5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:37:59.873726 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a822312-4215-49b3-bea2-17da4231fed5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:37:59.874469 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a822312-4215-49b3-bea2-17da4231fed5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:00.397623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5154fcc1-3c0f-420f-809f-345aee0a1c56 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:00.435273 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5154fcc1-3c0f-420f-809f-345aee0a1c56 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1515 microversion: 2.1 time: 1.153923 Jul 19 22:38:00.436653 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1276/2537] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:59 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1515 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:00.568270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4705a673-de63-49bb-88f7-064d85b048d9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:00.568924 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4705a673-de63-49bb-88f7-064d85b048d9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:00.597594 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4705a673-de63-49bb-88f7-064d85b048d9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:00.598050 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4705a673-de63-49bb-88f7-064d85b048d9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:00.599483 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4705a673-de63-49bb-88f7-064d85b048d9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:00.602745 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4705a673-de63-49bb-88f7-064d85b048d9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:00.615183 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5a822312-4215-49b3-bea2-17da4231fed5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ece721a99a4080a059c635b23761e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7242ed05524293b5dae6a33e520cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:00.641113 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5a822312-4215-49b3-bea2-17da4231fed5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56" status: 200 len: 1519 microversion: 2.1 time: 0.794992 Jul 19 22:38:00.649057 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1262/2538] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:37:59 2022] GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56 => generated 1519 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:00.678003 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7e87df04-f72e-4678-882c-d2771c6dead4 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.85"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:00.684490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7e87df04-f72e-4678-882c-d2771c6dead4 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:00.707927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e87df04-f72e-4678-882c-d2771c6dead4 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:00.711861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e87df04-f72e-4678-882c-d2771c6dead4 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:00.715729 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e87df04-f72e-4678-882c-d2771c6dead4 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:00.717141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e87df04-f72e-4678-882c-d2771c6dead4 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:00.792062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e87df04-f72e-4678-882c-d2771c6dead4 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Acquired lock "refresh_cache-caf65365-ee09-4edc-87d7-e6111559ca2e" {{(pid=119337) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 22:38:01.490892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4705a673-de63-49bb-88f7-064d85b048d9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:01.506793 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4705a673-de63-49bb-88f7-064d85b048d9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 200 len: 1631 microversion: 2.1 time: 0.945929 Jul 19 22:38:01.520000 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1277/2539] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:00 2022] GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 1631 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:01.528217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d2d7b131-5ca7-4448-a285-a013cbc3c6dd tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a104241f0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:01.707641 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d2d7b131-5ca7-4448-a285-a013cbc3c6dd tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993" status: 200 len: 1455 microversion: 2.1 time: 0.185627 Jul 19 22:38:01.709886 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1278/2540] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:38:01 2022] GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993 => generated 1455 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:01.721003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-4961d51e-b29d-4ba6-9af3-a0864353b1b0 req-513d49e1-d017-40d7-821e-4ab4b764e393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68ea88aa-1db0-490d-a791-5abd31245b37", "name": "network-vif-unplugged", "status": "completed", "tag": "cb002f98-bd53-40ce-a87d-725fad84c3c7"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:01.742162 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-4961d51e-b29d-4ba6-9af3-a0864353b1b0 req-513d49e1-d017-40d7-821e-4ab4b764e393 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:01.743434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-4961d51e-b29d-4ba6-9af3-a0864353b1b0 req-513d49e1-d017-40d7-821e-4ab4b764e393 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:01.769784 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-4961d51e-b29d-4ba6-9af3-a0864353b1b0 req-513d49e1-d017-40d7-821e-4ab4b764e393 service nova] Creating event network-vif-unplugged:cb002f98-bd53-40ce-a87d-725fad84c3c7 for instance 68ea88aa-1db0-490d-a791-5abd31245b37 on n-h1-847009-3 Jul 19 22:38:01.789010 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-4961d51e-b29d-4ba6-9af3-a0864353b1b0 req-513d49e1-d017-40d7-821e-4ab4b764e393 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076608 Jul 19 22:38:01.791819 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1279/2541] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:01.807161 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-11ef873a-d429-4935-8420-f2f223069210 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:01.809341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-11ef873a-d429-4935-8420-f2f223069210 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:01.824316 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-11ef873a-d429-4935-8420-f2f223069210 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:01.825431 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-11ef873a-d429-4935-8420-f2f223069210 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:01.828651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-11ef873a-d429-4935-8420-f2f223069210 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:01.830116 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-11ef873a-d429-4935-8420-f2f223069210 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:02.794362 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-11ef873a-d429-4935-8420-f2f223069210 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:02.816442 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-11ef873a-d429-4935-8420-f2f223069210 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1515 microversion: 2.1 time: 1.020522 Jul 19 22:38:02.817786 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1280/2542] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:01 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1515 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:02.834167 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-12ec8142-b9d9-4e64-bdb9-508da2fac654 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:02.835970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-12ec8142-b9d9-4e64-bdb9-508da2fac654 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:02.858093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-12ec8142-b9d9-4e64-bdb9-508da2fac654 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:02.859643 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-12ec8142-b9d9-4e64-bdb9-508da2fac654 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:02.860213 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-12ec8142-b9d9-4e64-bdb9-508da2fac654 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:02.860820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-12ec8142-b9d9-4e64-bdb9-508da2fac654 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:03.526261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-12ec8142-b9d9-4e64-bdb9-508da2fac654 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:03.549359 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-12ec8142-b9d9-4e64-bdb9-508da2fac654 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 200 len: 1610 microversion: 2.1 time: 0.729048 Jul 19 22:38:03.553794 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1281/2543] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:02 2022] GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 1610 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:03.569884 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-df1b5a53-f399-4c49-9efb-867d86b7d118 req-340f3797-e5db-4e48-a8cf-bb49385664bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68ea88aa-1db0-490d-a791-5abd31245b37", "name": "network-vif-deleted", "tag": "cb002f98-bd53-40ce-a87d-725fad84c3c7"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:03.602100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-df1b5a53-f399-4c49-9efb-867d86b7d118 req-340f3797-e5db-4e48-a8cf-bb49385664bf service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:03.603355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-df1b5a53-f399-4c49-9efb-867d86b7d118 req-340f3797-e5db-4e48-a8cf-bb49385664bf service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:03.664568 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-df1b5a53-f399-4c49-9efb-867d86b7d118 req-340f3797-e5db-4e48-a8cf-bb49385664bf service nova] Creating event network-vif-deleted:cb002f98-bd53-40ce-a87d-725fad84c3c7 for instance 68ea88aa-1db0-490d-a791-5abd31245b37 on n-h1-847009-3 Jul 19 22:38:03.696314 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-df1b5a53-f399-4c49-9efb-867d86b7d118 req-340f3797-e5db-4e48-a8cf-bb49385664bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140134 Jul 19 22:38:03.698303 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1282/2544] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:03.723285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1c970878-6939-4cc2-875f-3c193f9671ea tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a156baaf0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:03.842278 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1c970878-6939-4cc2-875f-3c193f9671ea tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993" status: 200 len: 1455 microversion: 2.1 time: 0.138139 Jul 19 22:38:03.843849 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1283/2545] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:38:03 2022] GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993 => generated 1455 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:03.867731 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8646eaa7-7e42-4a95-b82d-ede0a4bac3ad tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:03.872867 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8646eaa7-7e42-4a95-b82d-ede0a4bac3ad tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:03.897908 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8646eaa7-7e42-4a95-b82d-ede0a4bac3ad tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:03.898266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8646eaa7-7e42-4a95-b82d-ede0a4bac3ad tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:03.899364 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8646eaa7-7e42-4a95-b82d-ede0a4bac3ad tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:03.899833 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8646eaa7-7e42-4a95-b82d-ede0a4bac3ad tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:04.906899 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8646eaa7-7e42-4a95-b82d-ede0a4bac3ad tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:04.921084 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8646eaa7-7e42-4a95-b82d-ede0a4bac3ad tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1515 microversion: 2.1 time: 1.075945 Jul 19 22:38:04.928336 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1284/2546] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:03 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1515 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:04.940783 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-263eef78-167e-4dea-a9f5-fab1cd69e0db tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:04.942295 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-263eef78-167e-4dea-a9f5-fab1cd69e0db tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:04.972822 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-263eef78-167e-4dea-a9f5-fab1cd69e0db tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:04.973798 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-263eef78-167e-4dea-a9f5-fab1cd69e0db tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:04.977362 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-263eef78-167e-4dea-a9f5-fab1cd69e0db tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:04.980258 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-263eef78-167e-4dea-a9f5-fab1cd69e0db tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:05.221178 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-263eef78-167e-4dea-a9f5-fab1cd69e0db tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:05.246064 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-263eef78-167e-4dea-a9f5-fab1cd69e0db tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 200 len: 1453 microversion: 2.1 time: 0.316128 Jul 19 22:38:05.259236 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1285/2547] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:04 2022] GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 1453 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:05.298478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ffbe694e-5c42-44a5-b177-6963a1cbe480 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a105101f0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:05.379810 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ffbe694e-5c42-44a5-b177-6963a1cbe480 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993" status: 200 len: 1455 microversion: 2.1 time: 0.118641 Jul 19 22:38:05.382067 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1286/2548] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:38:05 2022] GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993 => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:05.939797 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-918102ec-f364-4500-8f3b-cbb34d1da994 req-3cf94fd7-1731-4b41-b4a6-60a691b270b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68ea88aa-1db0-490d-a791-5abd31245b37", "name": "network-vif-deleted", "tag": "7f9a6270-b52e-4ef8-8c55-12d663495830"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:05.963718 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-918102ec-f364-4500-8f3b-cbb34d1da994 req-3cf94fd7-1731-4b41-b4a6-60a691b270b5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:05.964326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-918102ec-f364-4500-8f3b-cbb34d1da994 req-3cf94fd7-1731-4b41-b4a6-60a691b270b5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:05.991394 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-918102ec-f364-4500-8f3b-cbb34d1da994 req-3cf94fd7-1731-4b41-b4a6-60a691b270b5 service nova] Creating event network-vif-deleted:7f9a6270-b52e-4ef8-8c55-12d663495830 for instance 68ea88aa-1db0-490d-a791-5abd31245b37 on n-h1-847009-3 Jul 19 22:38:06.001466 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-918102ec-f364-4500-8f3b-cbb34d1da994 req-3cf94fd7-1731-4b41-b4a6-60a691b270b5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069880 Jul 19 22:38:06.004009 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1287/2549] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:38:06.017276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-de2153e3-639b-432a-a3dc-9e77368e89cd tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:06.018823 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-de2153e3-639b-432a-a3dc-9e77368e89cd tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:06.035936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de2153e3-639b-432a-a3dc-9e77368e89cd tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:06.036742 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de2153e3-639b-432a-a3dc-9e77368e89cd tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:06.046138 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de2153e3-639b-432a-a3dc-9e77368e89cd tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:06.046893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de2153e3-639b-432a-a3dc-9e77368e89cd tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:06.167272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-7e87df04-f72e-4678-882c-d2771c6dead4 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Building network info cache for instance {{(pid=119337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 22:38:06.628770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-de2153e3-639b-432a-a3dc-9e77368e89cd tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:06.652251 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-de2153e3-639b-432a-a3dc-9e77368e89cd tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1515 microversion: 2.1 time: 0.644793 Jul 19 22:38:06.666196 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1288/2550] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:06 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1515 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:06.676899 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-78756806-1538-4727-892e-34b47e350d14 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:06.677850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-78756806-1538-4727-892e-34b47e350d14 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:06.687281 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78756806-1538-4727-892e-34b47e350d14 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:06.689102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78756806-1538-4727-892e-34b47e350d14 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:06.690618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78756806-1538-4727-892e-34b47e350d14 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:06.691658 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78756806-1538-4727-892e-34b47e350d14 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:06.719953 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-78756806-1538-4727-892e-34b47e350d14 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] HTTP exception thrown: Instance 68ea88aa-1db0-490d-a791-5abd31245b37 could not be found. Jul 19 22:38:06.723441 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-78756806-1538-4727-892e-34b47e350d14 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Request method failure captured: Jul 19 22:38:06.723441 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 HTTP/1.1 Jul 19 22:38:06.723441 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:38:06.723441 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:38:06.723441 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:38:06.723441 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:38:06.723441 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:38:06.723441 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:38:06.723441 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:38:06.723441 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:38:06.723441 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zIJuD9a7KRX8Xp_Rx1DyMj4h_N9HwvmQHmJanbA4zf-tGlm9LBOAyWsMng3Zi6orJapbZv-F1fCOtEk2TbM2K1_vXSwDtLqsWNYLByCj4mYByOtvzpIdyKl4xrRWtXiU-LaV38yd4SQDOXPdcT2ZQ3GazbpgQ4iT8EVuriu-toTiHU Jul 19 22:38:06.723441 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:38:06.723441 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:38:06.723441 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:38:06.723441 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:38:06.723441 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:38:06.723441 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:38:06.723441 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 0f375b652401428bb916ce1f5b04b622 Jul 19 22:38:06.723441 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersTestMultiNic-1913922030 Jul 19 22:38:06.723441 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:38:06.723441 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:38:06.726082 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f375b652401428bb916ce1f5b04b622"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f375b652401428bb916ce1f5b04b622"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f375b652401428bb916ce1f5b04b622"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f375b652401428bb916ce1f5b04b622"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:38:06.726082 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersTestMultiNic-1913922030 Jul 19 22:38:06.726082 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 0f375b652401428bb916ce1f5b04b622 Jul 19 22:38:06.726082 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersTestMultiNic-1913922030 Jul 19 22:38:06.726082 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersTestMultiNic-1913922030-project Jul 19 22:38:06.726082 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:38:06.726082 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:38:06.726082 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: d4b3fc46823645a6842433476c0e9b26 Jul 19 22:38:06.726082 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersTestMultiNic-1913922030-project Jul 19 22:38:06.726082 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:38:06.726082 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 68ea88aa-1db0-490d-a791-5abd31245b37 could not be found. Jul 19 22:38:06.726082 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '68ea88aa-1db0-490d-a791-5abd31245b37'} Jul 19 22:38:06.727603 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:38:06.727603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:38:06.727603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:38:06.727603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:38:06.727603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:38:06.727603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:38:06.727603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:38:06.727603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:38:06.727603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:38:06.727603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:38:06.727603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68ea88aa-1db0-490d-a791-5abd31245b37 could not be found. Jul 19 22:38:06.727603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:06.727603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:38:06.727603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:06.727603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:38:06.727603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:38:06.727603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:38:06.727603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:38:06.727603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:38:06.727603 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:38:06.729869 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:38:06.729869 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:38:06.729869 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:38:06.729869 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:38:06.729869 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:38:06.729869 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:38:06.729869 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:38:06.729869 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68ea88aa-1db0-490d-a791-5abd31245b37 could not be found. Jul 19 22:38:06.729869 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:06.729869 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:38:06.729869 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:06.729869 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:38:06.729869 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:38:06.729869 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:38:06.729869 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:38:06.729869 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:38:06.729869 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68ea88aa-1db0-490d-a791-5abd31245b37 could not be found. Jul 19 22:38:06.729869 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:06.734680 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-78756806-1538-4727-892e-34b47e350d14 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Returning 404 to user: Instance 68ea88aa-1db0-490d-a791-5abd31245b37 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:38:06.736854 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-78756806-1538-4727-892e-34b47e350d14 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 404 len: 111 microversion: 2.1 time: 0.068912 Jul 19 22:38:06.738601 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1289/2551] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:06 2022] GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:38:06.748118 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b89f01c2-7b39-40bd-ab3c-1873a4f24bcf tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a10230820>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:06.845396 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b89f01c2-7b39-40bd-ab3c-1873a4f24bcf tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993" status: 200 len: 1455 microversion: 2.1 time: 0.102385 Jul 19 22:38:06.856915 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1290/2552] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:38:06 2022] GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993 => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:07.536966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-7e87df04-f72e-4678-882c-d2771c6dead4 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Updating instance_info_cache with network_info: [{"id": "3d5f4107-f97a-4ed8-ad9b-376b9b2e9563", "address": "fa:16:3e:14:ce:22", "network": {"id": "0c4e10b3-9ece-4e7a-b6a5-7a85afc8792f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1161400161-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ef7242ed05524293b5dae6a33e520cfc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3d5f4107-f9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 22:38:07.551421 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e87df04-f72e-4678-882c-d2771c6dead4 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Releasing lock "refresh_cache-caf65365-ee09-4edc-87d7-e6111559ca2e" {{(pid=119337) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 22:38:07.552984 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7e87df04-f72e-4678-882c-d2771c6dead4 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "POST /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e/action" status: 202 len: 0 microversion: 2.1 time: 6.882676 Jul 19 22:38:07.553900 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1263/2553] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:38:00 2022] POST /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e/action => generated 0 bytes in 6885 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Jul 19 22:38:07.569859 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7e997e15-52a2-49c6-a265-3176d9345428 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.85"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:07.578276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7e997e15-52a2-49c6-a265-3176d9345428 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: 3e15d03f-3614-4eba-bf41-a0c059b15d56] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:07.606827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e997e15-52a2-49c6-a265-3176d9345428 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:07.611329 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e997e15-52a2-49c6-a265-3176d9345428 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:07.620478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e997e15-52a2-49c6-a265-3176d9345428 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:07.621565 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e997e15-52a2-49c6-a265-3176d9345428 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:07.687685 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:38:07.701123 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e997e15-52a2-49c6-a265-3176d9345428 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Acquired lock "refresh_cache-3e15d03f-3614-4eba-bf41-a0c059b15d56" {{(pid=119338) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 22:38:08.593642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-03a66d15-1126-4270-b07e-7e14a8411734 tempest-ServicesAdminTestJSON-777907187 tempest-ServicesAdminTestJSON-777907187-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:08.596165 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:38:08.596165 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:38:08.598055 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-03a66d15-1126-4270-b07e-7e14a8411734 tempest-ServicesAdminTestJSON-777907187 tempest-ServicesAdminTestJSON-777907187-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:08.598702 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-03a66d15-1126-4270-b07e-7e14a8411734 tempest-ServicesAdminTestJSON-777907187 tempest-ServicesAdminTestJSON-777907187-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:08.600007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-03a66d15-1126-4270-b07e-7e14a8411734 tempest-ServicesAdminTestJSON-777907187 tempest-ServicesAdminTestJSON-777907187-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:08.600799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-03a66d15-1126-4270-b07e-7e14a8411734 tempest-ServicesAdminTestJSON-777907187 tempest-ServicesAdminTestJSON-777907187-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:08.666099 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-03a66d15-1126-4270-b07e-7e14a8411734 tempest-ServicesAdminTestJSON-777907187 tempest-ServicesAdminTestJSON-777907187-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 1.044527 Jul 19 22:38:08.678269 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1264/2554] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:38:07 2022] GET /compute/v2.1/os-services => generated 944 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:08.678549 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b09f89ab-5811-4101-af72-5750d44f36f8 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:08.680370 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b09f89ab-5811-4101-af72-5750d44f36f8 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:08.694543 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b09f89ab-5811-4101-af72-5750d44f36f8 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:08.695440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b09f89ab-5811-4101-af72-5750d44f36f8 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:08.696540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b09f89ab-5811-4101-af72-5750d44f36f8 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:08.697501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b09f89ab-5811-4101-af72-5750d44f36f8 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:09.778670 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b09f89ab-5811-4101-af72-5750d44f36f8 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:09.797868 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b09f89ab-5811-4101-af72-5750d44f36f8 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1515 microversion: 2.1 time: 1.126088 Jul 19 22:38:09.809746 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1265/2555] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:08 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1515 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:09.821047 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-835dfb77-cb1e-400a-be2d-dd73171b41fc tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a155c9700>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:09.944326 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-835dfb77-cb1e-400a-be2d-dd73171b41fc tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993" status: 200 len: 1455 microversion: 2.1 time: 0.132749 Jul 19 22:38:09.945812 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1266/2556] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:38:09 2022] GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993 => generated 1455 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:09.957392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6481f3e8-ac85-48d8-9709-c8f93f9bafb3 tempest-ServicesAdminTestJSON-777907187 tempest-ServicesAdminTestJSON-777907187-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:09.960852 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:38:09.960852 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:38:09.964310 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6481f3e8-ac85-48d8-9709-c8f93f9bafb3 tempest-ServicesAdminTestJSON-777907187 tempest-ServicesAdminTestJSON-777907187-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:09.965910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6481f3e8-ac85-48d8-9709-c8f93f9bafb3 tempest-ServicesAdminTestJSON-777907187 tempest-ServicesAdminTestJSON-777907187-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:09.969592 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6481f3e8-ac85-48d8-9709-c8f93f9bafb3 tempest-ServicesAdminTestJSON-777907187 tempest-ServicesAdminTestJSON-777907187-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:09.971373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6481f3e8-ac85-48d8-9709-c8f93f9bafb3 tempest-ServicesAdminTestJSON-777907187 tempest-ServicesAdminTestJSON-777907187-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:10.030670 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6481f3e8-ac85-48d8-9709-c8f93f9bafb3 tempest-ServicesAdminTestJSON-777907187 tempest-ServicesAdminTestJSON-777907187-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-847009-3" status: 200 len: 578 microversion: 2.1 time: 0.082268 Jul 19 22:38:10.046080 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1267/2557] 10.222.0.25 () {58 vars in 1171 bytes} [Tue Jul 19 22:38:09 2022] GET /compute/v2.1/os-services?host=n-d-847009-3 => generated 578 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:10.074840 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-695b0db5-5534-4a58-a703-c6548266a997 req-f9ef59b7-fb91-4516-b3e8-ae5177438cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caf65365-ee09-4edc-87d7-e6111559ca2e", "tag": "3d5f4107-f97a-4ed8-ad9b-376b9b2e9563"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:10.104341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-695b0db5-5534-4a58-a703-c6548266a997 req-f9ef59b7-fb91-4516-b3e8-ae5177438cd0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:10.105779 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-695b0db5-5534-4a58-a703-c6548266a997 req-f9ef59b7-fb91-4516-b3e8-ae5177438cd0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:10.136761 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-695b0db5-5534-4a58-a703-c6548266a997 req-f9ef59b7-fb91-4516-b3e8-ae5177438cd0 service nova] Creating event network-changed:3d5f4107-f97a-4ed8-ad9b-376b9b2e9563 for instance caf65365-ee09-4edc-87d7-e6111559ca2e on n-h1-847009-3 Jul 19 22:38:10.149664 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-695b0db5-5534-4a58-a703-c6548266a997 req-f9ef59b7-fb91-4516-b3e8-ae5177438cd0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100334 Jul 19 22:38:10.151564 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1268/2558] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:10.162897 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-63e72793-facc-4a7c-a213-c07827900bba tempest-ServicesAdminTestJSON-777907187 tempest-ServicesAdminTestJSON-777907187-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:10.166393 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:38:10.166393 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:38:10.170385 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63e72793-facc-4a7c-a213-c07827900bba tempest-ServicesAdminTestJSON-777907187 tempest-ServicesAdminTestJSON-777907187-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:10.172008 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63e72793-facc-4a7c-a213-c07827900bba tempest-ServicesAdminTestJSON-777907187 tempest-ServicesAdminTestJSON-777907187-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:10.174032 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63e72793-facc-4a7c-a213-c07827900bba tempest-ServicesAdminTestJSON-777907187 tempest-ServicesAdminTestJSON-777907187-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:10.175211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63e72793-facc-4a7c-a213-c07827900bba tempest-ServicesAdminTestJSON-777907187 tempest-ServicesAdminTestJSON-777907187-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:10.263422 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-63e72793-facc-4a7c-a213-c07827900bba tempest-ServicesAdminTestJSON-777907187 tempest-ServicesAdminTestJSON-777907187-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.109087 Jul 19 22:38:10.276439 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1269/2559] 10.222.0.25 () {58 vars in 1175 bytes} [Tue Jul 19 22:38:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:10.287936 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-378f93f7-b056-4c6e-a58e-49e799319c6e tempest-ServicesAdminTestJSON-777907187 tempest-ServicesAdminTestJSON-777907187-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:10.291691 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:38:10.291691 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:38:10.294658 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-378f93f7-b056-4c6e-a58e-49e799319c6e tempest-ServicesAdminTestJSON-777907187 tempest-ServicesAdminTestJSON-777907187-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:10.296656 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-378f93f7-b056-4c6e-a58e-49e799319c6e tempest-ServicesAdminTestJSON-777907187 tempest-ServicesAdminTestJSON-777907187-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:10.298485 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-378f93f7-b056-4c6e-a58e-49e799319c6e tempest-ServicesAdminTestJSON-777907187 tempest-ServicesAdminTestJSON-777907187-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:10.299641 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-378f93f7-b056-4c6e-a58e-49e799319c6e tempest-ServicesAdminTestJSON-777907187 tempest-ServicesAdminTestJSON-777907187-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:10.356515 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-378f93f7-b056-4c6e-a58e-49e799319c6e tempest-ServicesAdminTestJSON-777907187 tempest-ServicesAdminTestJSON-777907187-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.077100 Jul 19 22:38:10.357971 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1270/2560] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:38:10 2022] GET /compute/v2.1/os-services => generated 944 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:10.824799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-acdd9a95-216d-433d-a2ad-6143d7889690 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:10.827510 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-acdd9a95-216d-433d-a2ad-6143d7889690 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:10.845504 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-acdd9a95-216d-433d-a2ad-6143d7889690 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:10.846683 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-acdd9a95-216d-433d-a2ad-6143d7889690 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:10.848642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-acdd9a95-216d-433d-a2ad-6143d7889690 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:10.849709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-acdd9a95-216d-433d-a2ad-6143d7889690 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:11.873075 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-acdd9a95-216d-433d-a2ad-6143d7889690 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:11.884587 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-acdd9a95-216d-433d-a2ad-6143d7889690 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1515 microversion: 2.1 time: 1.069312 Jul 19 22:38:11.890788 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1271/2561] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:10 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1515 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:38:11.908829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-95f3866d-d3ab-4d66-a054-bc63f23399c3 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a10fa2040>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:12.010983 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-95f3866d-d3ab-4d66-a054-bc63f23399c3 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993" status: 200 len: 1455 microversion: 2.1 time: 0.111377 Jul 19 22:38:12.021030 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1272/2562] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:38:11 2022] GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993 => generated 1455 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:12.922897 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-12504f8a-e6ff-447b-bced-69dd310c319a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:12.923902 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-12504f8a-e6ff-447b-bced-69dd310c319a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:12.946234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12504f8a-e6ff-447b-bced-69dd310c319a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:12.946706 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12504f8a-e6ff-447b-bced-69dd310c319a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:12.950566 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12504f8a-e6ff-447b-bced-69dd310c319a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:12.953278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12504f8a-e6ff-447b-bced-69dd310c319a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:14.288260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-12504f8a-e6ff-447b-bced-69dd310c319a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:14.328463 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-12504f8a-e6ff-447b-bced-69dd310c319a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1515 microversion: 2.1 time: 1.409757 Jul 19 22:38:14.329390 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1273/2563] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:12 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1515 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:14.353471 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d01f5e22-5916-4cc2-874e-034676fb65e6 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a10fa2040>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:14.488789 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d01f5e22-5916-4cc2-874e-034676fb65e6 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993" status: 200 len: 1455 microversion: 2.1 time: 0.155781 Jul 19 22:38:14.495822 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1274/2564] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:38:14 2022] GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993 => generated 1455 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:14.977947 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-bcb29568-1904-46fa-90ac-381a64569e2f req-39471c8e-ad63-4bbe-a893-d3b62d8960a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caf65365-ee09-4edc-87d7-e6111559ca2e", "tag": "3d5f4107-f97a-4ed8-ad9b-376b9b2e9563"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:15.032321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-bcb29568-1904-46fa-90ac-381a64569e2f req-39471c8e-ad63-4bbe-a893-d3b62d8960a0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:15.033202 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-bcb29568-1904-46fa-90ac-381a64569e2f req-39471c8e-ad63-4bbe-a893-d3b62d8960a0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:15.080660 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-bcb29568-1904-46fa-90ac-381a64569e2f req-39471c8e-ad63-4bbe-a893-d3b62d8960a0 service nova] Creating event network-changed:3d5f4107-f97a-4ed8-ad9b-376b9b2e9563 for instance caf65365-ee09-4edc-87d7-e6111559ca2e on n-h1-847009-3 Jul 19 22:38:15.117760 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-bcb29568-1904-46fa-90ac-381a64569e2f req-39471c8e-ad63-4bbe-a893-d3b62d8960a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142972 Jul 19 22:38:15.141258 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1275/2565] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:15.370708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cea23add-9803-45dc-8524-23b9fa020d11 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:15.382034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cea23add-9803-45dc-8524-23b9fa020d11 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:15.391863 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cea23add-9803-45dc-8524-23b9fa020d11 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:15.392532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cea23add-9803-45dc-8524-23b9fa020d11 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:15.393495 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cea23add-9803-45dc-8524-23b9fa020d11 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:15.394101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cea23add-9803-45dc-8524-23b9fa020d11 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:16.158095 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.network.neutron [None req-7e997e15-52a2-49c6-a265-3176d9345428 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: 3e15d03f-3614-4eba-bf41-a0c059b15d56] re-assign floating IP 172.25.7.85 from instance caf65365-ee09-4edc-87d7-e6111559ca2e Jul 19 22:38:16.355776 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-7e997e15-52a2-49c6-a265-3176d9345428 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Building network info cache for instance {{(pid=119338) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 22:38:16.703511 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cea23add-9803-45dc-8524-23b9fa020d11 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:16.722027 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cea23add-9803-45dc-8524-23b9fa020d11 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1515 microversion: 2.1 time: 1.362333 Jul 19 22:38:16.722964 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1276/2566] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:15 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1515 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:16.727982 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b8ffcd07-8bb7-403c-a206-935db4c6e673 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a105509d0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:16.854601 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b8ffcd07-8bb7-403c-a206-935db4c6e673 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993" status: 200 len: 1464 microversion: 2.1 time: 0.129943 Jul 19 22:38:16.856416 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1277/2567] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:38:16 2022] GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993 => generated 1464 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:16.877302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ebcbcc44-0933-4a91-87b8-78cf3c81fbd4 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a155fc310>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:16.975753 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ebcbcc44-0933-4a91-87b8-78cf3c81fbd4 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993" status: 200 len: 1464 microversion: 2.1 time: 0.107090 Jul 19 22:38:16.977902 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1278/2568] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:38:16 2022] GET /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993 => generated 1464 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:38:16.995957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e0e5d7a6-77d7-4359-810c-f292962550be tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:17.002350 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e0e5d7a6-77d7-4359-810c-f292962550be tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: 7a846129-bc22-4520-bd5b-d33fcd0a94a2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:17.022149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0e5d7a6-77d7-4359-810c-f292962550be tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:17.023312 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0e5d7a6-77d7-4359-810c-f292962550be tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:17.025110 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0e5d7a6-77d7-4359-810c-f292962550be tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:17.026206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0e5d7a6-77d7-4359-810c-f292962550be tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:17.604384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:38:17.692199 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e0e5d7a6-77d7-4359-810c-f292962550be tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdcb86f99184c839022f5f19d730e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '994ee0e2b71b4eff88a19b70351ada06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:17.750320 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e0e5d7a6-77d7-4359-810c-f292962550be tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2" status: 200 len: 1468 microversion: 2.1 time: 0.760524 Jul 19 22:38:17.751790 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1279/2569] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:16 2022] GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2 => generated 1468 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:17.773530 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6a05aed4-5265-4118-ac96-2423c2af8b37 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:17.775709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6a05aed4-5265-4118-ac96-2423c2af8b37 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:17.793559 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6a05aed4-5265-4118-ac96-2423c2af8b37 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:17.794927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6a05aed4-5265-4118-ac96-2423c2af8b37 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:17.797025 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6a05aed4-5265-4118-ac96-2423c2af8b37 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:17.797837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6a05aed4-5265-4118-ac96-2423c2af8b37 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:18.566726 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6a05aed4-5265-4118-ac96-2423c2af8b37 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:18.595352 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6a05aed4-5265-4118-ac96-2423c2af8b37 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1515 microversion: 2.1 time: 0.841774 Jul 19 22:38:18.604441 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1280/2570] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:17 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1515 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:18.629750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-977c7841-7265-4ac9-9d27-f3d781060a76 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1695026869"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:18.634290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-977c7841-7265-4ac9-9d27-f3d781060a76 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: bf0396df-c757-4ec7-9697-e71026a34525] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:18.646752 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-977c7841-7265-4ac9-9d27-f3d781060a76 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:18.648127 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-977c7841-7265-4ac9-9d27-f3d781060a76 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:18.650560 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-977c7841-7265-4ac9-9d27-f3d781060a76 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:18.651591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-977c7841-7265-4ac9-9d27-f3d781060a76 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:18.851372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-7e997e15-52a2-49c6-a265-3176d9345428 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Updating instance_info_cache with network_info: [{"id": "3d5f4107-f97a-4ed8-ad9b-376b9b2e9563", "address": "fa:16:3e:14:ce:22", "network": {"id": "0c4e10b3-9ece-4e7a-b6a5-7a85afc8792f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1161400161-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ef7242ed05524293b5dae6a33e520cfc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3d5f4107-f9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119338) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 22:38:18.878505 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-7e997e15-52a2-49c6-a265-3176d9345428 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: 3e15d03f-3614-4eba-bf41-a0c059b15d56] Building network info cache for instance {{(pid=119338) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 22:38:19.415308 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-977c7841-7265-4ac9-9d27-f3d781060a76 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "POST /compute/v2.1/servers/bf0396df-c757-4ec7-9697-e71026a34525/action" status: 202 len: 0 microversion: 2.1 time: 0.808676 Jul 19 22:38:19.415985 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1281/2571] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:38:18 2022] POST /compute/v2.1/servers/bf0396df-c757-4ec7-9697-e71026a34525/action => generated 0 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 22:38:19.435006 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-d31f80dd-fbf3-4ebc-ad2d-52a49b5f1d4e req-9d40924c-047d-4fe7-ab72-769c69575a37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e15d03f-3614-4eba-bf41-a0c059b15d56", "tag": "cbe37743-8894-46d0-a28d-912d057c4b98"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:19.445746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d31f80dd-fbf3-4ebc-ad2d-52a49b5f1d4e req-9d40924c-047d-4fe7-ab72-769c69575a37 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:19.446293 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d31f80dd-fbf3-4ebc-ad2d-52a49b5f1d4e req-9d40924c-047d-4fe7-ab72-769c69575a37 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:19.468329 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-d31f80dd-fbf3-4ebc-ad2d-52a49b5f1d4e req-9d40924c-047d-4fe7-ab72-769c69575a37 service nova] Creating event network-changed:cbe37743-8894-46d0-a28d-912d057c4b98 for instance 3e15d03f-3614-4eba-bf41-a0c059b15d56 on n-h2-847009-3 Jul 19 22:38:19.491520 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-d31f80dd-fbf3-4ebc-ad2d-52a49b5f1d4e req-9d40924c-047d-4fe7-ab72-769c69575a37 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062115 Jul 19 22:38:19.492741 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1282/2572] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:19.502742 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b25103c8-12e0-4830-931e-1ed18051a26a tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a1563fee0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:19.634827 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b25103c8-12e0-4830-931e-1ed18051a26a tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b1a4c605-7ea8-4ce0-9728-b7e1c746ec9f" status: 200 len: 1455 microversion: 2.1 time: 0.139645 Jul 19 22:38:19.636023 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1283/2573] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:38:19 2022] GET /compute/v2.1/images/b1a4c605-7ea8-4ce0-9728-b7e1c746ec9f => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:19.672283 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c3824c7d-3dec-4eac-b19c-08437969cfdb tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:19.679236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c3824c7d-3dec-4eac-b19c-08437969cfdb tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:19.706255 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c3824c7d-3dec-4eac-b19c-08437969cfdb tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:19.709819 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c3824c7d-3dec-4eac-b19c-08437969cfdb tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:19.722072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c3824c7d-3dec-4eac-b19c-08437969cfdb tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:19.722676 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c3824c7d-3dec-4eac-b19c-08437969cfdb tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:20.313258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c3824c7d-3dec-4eac-b19c-08437969cfdb tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:20.318744 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=8 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:38:20.343967 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c3824c7d-3dec-4eac-b19c-08437969cfdb tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1515 microversion: 2.1 time: 0.705027 Jul 19 22:38:20.345210 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1284/2574] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:19 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1515 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:20.366298 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-95823fd2-505e-4afa-a33f-066fc1ad91bd req-664bf82e-9e43-466f-87c6-143e32edf976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a846129-bc22-4520-bd5b-d33fcd0a94a2", "name": "network-vif-unplugged", "status": "completed", "tag": "f07043ec-4940-4a2a-bfd4-8d23d6ddf88d"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:20.405753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-95823fd2-505e-4afa-a33f-066fc1ad91bd req-664bf82e-9e43-466f-87c6-143e32edf976 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:20.412447 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-95823fd2-505e-4afa-a33f-066fc1ad91bd req-664bf82e-9e43-466f-87c6-143e32edf976 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:20.417286 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:38:20.430855 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-95823fd2-505e-4afa-a33f-066fc1ad91bd req-664bf82e-9e43-466f-87c6-143e32edf976 service nova] Creating event network-vif-unplugged:f07043ec-4940-4a2a-bfd4-8d23d6ddf88d for instance 7a846129-bc22-4520-bd5b-d33fcd0a94a2 on n-h2-847009-3 Jul 19 22:38:20.441636 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-95823fd2-505e-4afa-a33f-066fc1ad91bd req-664bf82e-9e43-466f-87c6-143e32edf976 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094738 Jul 19 22:38:20.442925 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1285/2575] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:20.885326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-7e997e15-52a2-49c6-a265-3176d9345428 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: 3e15d03f-3614-4eba-bf41-a0c059b15d56] Updating instance_info_cache with network_info: [{"id": "cbe37743-8894-46d0-a28d-912d057c4b98", "address": "fa:16:3e:c6:28:92", "network": {"id": "0c4e10b3-9ece-4e7a-b6a5-7a85afc8792f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1161400161-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ef7242ed05524293b5dae6a33e520cfc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapcbe37743-88", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119338) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 22:38:20.907040 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e997e15-52a2-49c6-a265-3176d9345428 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Releasing lock "refresh_cache-3e15d03f-3614-4eba-bf41-a0c059b15d56" {{(pid=119338) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 22:38:20.910202 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7e997e15-52a2-49c6-a265-3176d9345428 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "POST /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56/action" status: 202 len: 0 microversion: 2.1 time: 13.349894 Jul 19 22:38:20.916242 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1291/2576] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:38:07 2022] POST /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56/action => generated 0 bytes in 13357 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 19 22:38:20.935086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-43dfde35-922c-45cf-9310-3085fa53905b tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a03fe5820>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:21.042234 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-43dfde35-922c-45cf-9310-3085fa53905b tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b1a4c605-7ea8-4ce0-9728-b7e1c746ec9f" status: 200 len: 1455 microversion: 2.1 time: 0.124453 Jul 19 22:38:21.043473 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1292/2577] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:38:20 2022] GET /compute/v2.1/images/b1a4c605-7ea8-4ce0-9728-b7e1c746ec9f => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:21.057852 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f8793538-b248-4364-a875-d37043825ead tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Action: 'action', calling method: .version_select at 0x7f7a1310fdc0>, body: {"removeFloatingIp": {"address": "172.25.7.85"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:21.177530 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-478a05fa-99e6-4e49-9261-c8b091210444 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1227725365", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "87c331fb-040c-45fc-a9a1-e946f840de97"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:21.324747 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-478a05fa-99e6-4e49-9261-c8b091210444 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] validate_networks() for [('87c331fb-040c-45fc-a9a1-e946f840de97', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:38:21.822572 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f8793538-b248-4364-a875-d37043825ead tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: 3e15d03f-3614-4eba-bf41-a0c059b15d56] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:21.841743 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8793538-b248-4364-a875-d37043825ead tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:21.842383 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8793538-b248-4364-a875-d37043825ead tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:21.843532 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8793538-b248-4364-a875-d37043825ead tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:21.843921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8793538-b248-4364-a875-d37043825ead tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:22.493455 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-f8793538-b248-4364-a875-d37043825ead tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] HTTP exception thrown: Floating IP 172.25.7.85 is not associated with instance caf65365-ee09-4edc-87d7-e6111559ca2e. Jul 19 22:38:22.500235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f8793538-b248-4364-a875-d37043825ead tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Request method failure captured: Jul 19 22:38:22.500235 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e/action HTTP/1.1 Jul 19 22:38:22.500235 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:38:22.500235 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:38:22.500235 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:38:22.500235 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 48 Jul 19 22:38:22.500235 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:38:22.500235 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:38:22.500235 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:38:22.500235 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:38:22.500235 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zH89DNXCIQWv41yHAvGRXSNtFbm6pSJ5huYNyBU6eJ9WJdlQUHFO2gtCgyRi0Ry5MiOLhV18p5AG56_t0NEtd10n3dYDM-qrros2fcMDDL4A-Y8bS8dOpf5mPSuTR33nFcO0B7-3Xg1vopdTWvSM6sz19ASnxkjWNJQcLZPyESzOqY Jul 19 22:38:22.500235 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:38:22.500235 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:38:22.500235 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:38:22.500235 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:38:22.500235 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:38:22.500235 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:38:22.500235 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: ef7242ed05524293b5dae6a33e520cfc Jul 19 22:38:22.500235 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1371103150 Jul 19 22:38:22.500235 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:38:22.500235 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:38:22.501705 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ef7242ed05524293b5dae6a33e520cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef7242ed05524293b5dae6a33e520cfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ef7242ed05524293b5dae6a33e520cfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef7242ed05524293b5dae6a33e520cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:38:22.501705 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1371103150 Jul 19 22:38:22.501705 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: ef7242ed05524293b5dae6a33e520cfc Jul 19 22:38:22.501705 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1371103150 Jul 19 22:38:22.501705 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-FloatingIPsAssociationTestJSON-1371103150-project Jul 19 22:38:22.501705 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:38:22.501705 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:38:22.501705 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: b6ece721a99a4080a059c635b23761e4 Jul 19 22:38:22.501705 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1371103150-project Jul 19 22:38:22.501705 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:38:22.501705 n-d-847009-3 devstack@n-api.service[119338]: {"removeFloatingIp": {"address": "172.25.7.85"}} Jul 19 22:38:22.501705 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:38:22.501705 n-d-847009-3 devstack@n-api.service[119338]: exception: Floating IP 172.25.7.85 is not associated with instance caf65365-ee09-4edc-87d7-e6111559ca2e. Jul 19 22:38:22.502551 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'caf65365-ee09-4edc-87d7-e6111559ca2e', 'body': {'removeFloatingIp': {'address': '172.25.7.85'}}} Jul 19 22:38:22.502551 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:38:22.502551 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:38:22.502551 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:38:22.502551 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:38:22.502551 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:38:22.502551 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:38:22.502551 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:38:22.502551 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:38:22.502551 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:38:22.502551 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:38:22.502551 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:38:22.502551 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:38:22.502551 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 19 22:38:22.502551 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 22:38:22.502551 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.7.85 is not associated with instance caf65365-ee09-4edc-87d7-e6111559ca2e. Jul 19 22:38:22.502551 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:22.502551 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:38:22.502551 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:22.502551 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:38:22.504094 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:38:22.504094 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:38:22.504094 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:38:22.504094 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:38:22.504094 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.7.85 is not associated with instance caf65365-ee09-4edc-87d7-e6111559ca2e. Jul 19 22:38:22.504094 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:22.506732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f8793538-b248-4364-a875-d37043825ead tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Returning 409 to user: Floating IP 172.25.7.85 is not associated with instance caf65365-ee09-4edc-87d7-e6111559ca2e. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:38:22.509874 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f8793538-b248-4364-a875-d37043825ead tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "POST /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e/action" status: 409 len: 145 microversion: 2.1 time: 1.463238 Jul 19 22:38:22.518302 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1293/2578] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:38:21 2022] POST /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e/action => generated 145 bytes in 1474 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:38:22.843659 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b6aafa98-eb86-43ae-8330-5ab950fb36be tempest-TenantUsagesNegativeTestJSON-324067141 tempest-TenantUsagesNegativeTestJSON-324067141-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-18T22%3A38%3A21.320413&end=2022-07-20T22%3A38%3A21.320413" status: 404 len: 112 microversion: - time: 0.322805 Jul 19 22:38:22.845329 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1294/2579] 10.222.0.25 () {58 vars in 1315 bytes} [Tue Jul 19 22:38:22 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-18T22%3A38%3A21.320413&end=2022-07-20T22%3A38%3A21.320413 => generated 112 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 19 22:38:22.859761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8e9c76da-e80c-43af-90aa-d5aa4d522882 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:22.861551 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8e9c76da-e80c-43af-90aa-d5aa4d522882 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:22.874427 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8e9c76da-e80c-43af-90aa-d5aa4d522882 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:22.876072 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8e9c76da-e80c-43af-90aa-d5aa4d522882 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:22.877588 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8e9c76da-e80c-43af-90aa-d5aa4d522882 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:22.878334 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8e9c76da-e80c-43af-90aa-d5aa4d522882 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:23.006590 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-478a05fa-99e6-4e49-9261-c8b091210444 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:38:23.009029 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-478a05fa-99e6-4e49-9261-c8b091210444 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:38:23.009770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-478a05fa-99e6-4e49-9261-c8b091210444 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:38:23.010385 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-478a05fa-99e6-4e49-9261-c8b091210444 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:38:23.010971 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-478a05fa-99e6-4e49-9261-c8b091210444 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:38:23.035563 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-478a05fa-99e6-4e49-9261-c8b091210444 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:23.036260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-478a05fa-99e6-4e49-9261-c8b091210444 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:23.037292 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-478a05fa-99e6-4e49-9261-c8b091210444 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:23.037927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-478a05fa-99e6-4e49-9261-c8b091210444 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:23.103764 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-478a05fa-99e6-4e49-9261-c8b091210444 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Getting quotas for project a2bcdb843a7d4a1ebe467160eee0d6e1. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:38:23.124022 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-478a05fa-99e6-4e49-9261-c8b091210444 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Getting quotas for user f4f40233895248229ddfdcd06fb65361 and project a2bcdb843a7d4a1ebe467160eee0d6e1. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:38:23.165705 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-478a05fa-99e6-4e49-9261-c8b091210444 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:38:23.173064 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-478a05fa-99e6-4e49-9261-c8b091210444 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9c365853-9c4b-45db-97c8-26d0f6e797bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:38:23.196245 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8e9c76da-e80c-43af-90aa-d5aa4d522882 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:23.220443 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8e9c76da-e80c-43af-90aa-d5aa4d522882 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1515 microversion: 2.1 time: 0.373082 Jul 19 22:38:23.222581 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1295/2580] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:22 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1515 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:23.260843 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0e93189a-1b98-4500-ab05-75025460ada1 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a156ba940>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:23.284965 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-478a05fa-99e6-4e49-9261-c8b091210444 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.787261 Jul 19 22:38:23.286076 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1286/2581] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:38:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:38:23.298216 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c14fac45-7f9c-401c-ba51-e8c796eed39e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.85"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:23.354010 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0e93189a-1b98-4500-ab05-75025460ada1 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b1a4c605-7ea8-4ce0-9728-b7e1c746ec9f" status: 200 len: 1455 microversion: 2.1 time: 0.115893 Jul 19 22:38:23.354615 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1296/2582] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:38:23 2022] GET /compute/v2.1/images/b1a4c605-7ea8-4ce0-9728-b7e1c746ec9f => generated 1455 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:23.366107 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5efb60e8-68de-40c2-bf77-7e8dc8730e2e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1767851023", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "5e3fad09-47c6-4b64-91e4-12b0e288c10a"}, {"uuid": "b79a1e11-ab16-4375-8656-2dfef2734025"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:23.554028 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-5efb60e8-68de-40c2-bf77-7e8dc8730e2e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] validate_networks() for [('5e3fad09-47c6-4b64-91e4-12b0e288c10a', None, None, None, None, None), ('b79a1e11-ab16-4375-8656-2dfef2734025', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:38:23.815519 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c14fac45-7f9c-401c-ba51-e8c796eed39e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: 3e15d03f-3614-4eba-bf41-a0c059b15d56] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:23.835674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c14fac45-7f9c-401c-ba51-e8c796eed39e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:23.838374 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c14fac45-7f9c-401c-ba51-e8c796eed39e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:23.847770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c14fac45-7f9c-401c-ba51-e8c796eed39e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:23.850766 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c14fac45-7f9c-401c-ba51-e8c796eed39e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:24.738576 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c14fac45-7f9c-401c-ba51-e8c796eed39e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Acquired lock "refresh_cache-3e15d03f-3614-4eba-bf41-a0c059b15d56" {{(pid=119337) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 22:38:26.907406 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-5efb60e8-68de-40c2-bf77-7e8dc8730e2e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:38:26.908806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-5efb60e8-68de-40c2-bf77-7e8dc8730e2e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:38:26.909414 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-5efb60e8-68de-40c2-bf77-7e8dc8730e2e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:38:26.910085 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-5efb60e8-68de-40c2-bf77-7e8dc8730e2e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:38:26.910713 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-5efb60e8-68de-40c2-bf77-7e8dc8730e2e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:38:26.932748 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5efb60e8-68de-40c2-bf77-7e8dc8730e2e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:26.939438 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5efb60e8-68de-40c2-bf77-7e8dc8730e2e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:26.942612 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5efb60e8-68de-40c2-bf77-7e8dc8730e2e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:26.943417 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5efb60e8-68de-40c2-bf77-7e8dc8730e2e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:27.005659 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-5efb60e8-68de-40c2-bf77-7e8dc8730e2e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Getting quotas for project 0f375b652401428bb916ce1f5b04b622. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:38:27.030693 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-5efb60e8-68de-40c2-bf77-7e8dc8730e2e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Getting quotas for user d4b3fc46823645a6842433476c0e9b26 and project 0f375b652401428bb916ce1f5b04b622. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:38:27.086857 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5efb60e8-68de-40c2-bf77-7e8dc8730e2e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:38:27.098181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5efb60e8-68de-40c2-bf77-7e8dc8730e2e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 8f51c52b-0d6b-40bd-9b31-ad0a91304d78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:38:27.220315 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5efb60e8-68de-40c2-bf77-7e8dc8730e2e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.864258 Jul 19 22:38:27.221463 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1297/2583] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:38:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:38:27.243472 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a86ba287-ffe7-48cd-a246-a7568ef98c7b tempest-TenantUsagesNegativeTestJSON-324067141 tempest-TenantUsagesNegativeTestJSON-324067141-project-admin] Calling method '.version_select at 0x7f7a03986700>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:27.250799 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-a86ba287-ffe7-48cd-a246-a7568ef98c7b tempest-TenantUsagesNegativeTestJSON-324067141 tempest-TenantUsagesNegativeTestJSON-324067141-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 19 22:38:27.268714 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a86ba287-ffe7-48cd-a246-a7568ef98c7b tempest-TenantUsagesNegativeTestJSON-324067141 tempest-TenantUsagesNegativeTestJSON-324067141-project-admin] Request method failure captured: Jul 19 22:38:27.268714 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/os-simple-tenant-usage/c968c74fbba74938a6fc5f4f68b14f74?start=2022-07-20T22%3A38%3A21.320413&end=2022-07-18T22%3A38%3A21.320413 HTTP/1.1 Jul 19 22:38:27.268714 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:38:27.268714 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:38:27.268714 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:38:27.268714 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:38:27.268714 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:38:27.268714 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:38:27.268714 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:38:27.268714 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:38:27.268714 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zJdVH3Cmky94VkCUgWBYw7TRHo5FcCspzpST4E5_iJXcMP2b4l4OmjGD8E6fCQF8T5wt5OCfYfQJNnFrlMw-UnAvH31yQMfK91Wvd-wgxFbk1Os53DyUyQgrhbJrOfFpn6-XL5VJDI5W3MHLuML8si5tryELaTk2MQnFhj9nv1CeZg Jul 19 22:38:27.268714 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:38:27.268714 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:38:27.268714 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:38:27.268714 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:38:27.268714 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:38:27.268714 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:38:27.268714 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 7f55c2759d1c4be3935d34f404759b3c Jul 19 22:38:27.268714 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-324067141 Jul 19 22:38:27.268714 n-d-847009-3 devstack@n-api.service[119338]: X-Role: admin,member,reader Jul 19 22:38:27.268714 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: admin,member,reader Jul 19 22:38:27.270934 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7f55c2759d1c4be3935d34f404759b3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f55c2759d1c4be3935d34f404759b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7f55c2759d1c4be3935d34f404759b3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f55c2759d1c4be3935d34f404759b3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:38:27.270934 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-324067141 Jul 19 22:38:27.270934 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 7f55c2759d1c4be3935d34f404759b3c Jul 19 22:38:27.270934 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-324067141 Jul 19 22:38:27.270934 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TenantUsagesNegativeTestJSON-324067141-project-admin Jul 19 22:38:27.270934 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:38:27.270934 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:38:27.270934 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 52d775bc40e64d899bdd55ab46d85d3f Jul 19 22:38:27.270934 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-324067141-project-admin Jul 19 22:38:27.270934 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:38:27.270934 n-d-847009-3 devstack@n-api.service[119338]: exception: Invalid start time. The start time cannot occur after the end time. Jul 19 22:38:27.270934 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'c968c74fbba74938a6fc5f4f68b14f74'} Jul 19 22:38:27.272413 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:38:27.272413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:38:27.272413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:38:27.272413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:38:27.272413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:38:27.272413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:38:27.272413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:38:27.272413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:38:27.272413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 22:38:27.272413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:38:27.272413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:38:27.272413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:38:27.272413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 19 22:38:27.272413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 19 22:38:27.272413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 19 22:38:27.272413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 19 22:38:27.272413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 19 22:38:27.272413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 19 22:38:27.272413 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 19 22:38:27.274751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:27.274751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:38:27.274751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:27.274751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:38:27.274751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:38:27.274751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:38:27.274751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:38:27.274751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:38:27.274751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 19 22:38:27.274751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:27.277353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a86ba287-ffe7-48cd-a246-a7568ef98c7b tempest-TenantUsagesNegativeTestJSON-324067141 tempest-TenantUsagesNegativeTestJSON-324067141-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:38:27.282090 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a86ba287-ffe7-48cd-a246-a7568ef98c7b tempest-TenantUsagesNegativeTestJSON-324067141 tempest-TenantUsagesNegativeTestJSON-324067141-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/c968c74fbba74938a6fc5f4f68b14f74?start=2022-07-20T22%3A38%3A21.320413&end=2022-07-18T22%3A38%3A21.320413" status: 400 len: 111 microversion: 2.1 time: 0.056568 Jul 19 22:38:27.298987 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1298/2584] 10.222.0.25 () {58 vars in 1411 bytes} [Tue Jul 19 22:38:27 2022] GET /compute/v2.1/os-simple-tenant-usage/c968c74fbba74938a6fc5f4f68b14f74?start=2022-07-20T22%3A38%3A21.320413&end=2022-07-18T22%3A38%3A21.320413 => generated 111 bytes in 77 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:38:27.309451 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0b38aff9-cfdf-43ee-bce2-288582c95922 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:27.312444 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0b38aff9-cfdf-43ee-bce2-288582c95922 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9c365853-9c4b-45db-97c8-26d0f6e797bd] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:27.323641 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b38aff9-cfdf-43ee-bce2-288582c95922 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:27.327297 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b38aff9-cfdf-43ee-bce2-288582c95922 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:27.338390 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b38aff9-cfdf-43ee-bce2-288582c95922 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:27.340318 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b38aff9-cfdf-43ee-bce2-288582c95922 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:27.526089 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0b38aff9-cfdf-43ee-bce2-288582c95922 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:27.562624 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0b38aff9-cfdf-43ee-bce2-288582c95922 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd" status: 200 len: 1273 microversion: 2.1 time: 0.262061 Jul 19 22:38:27.578024 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1299/2585] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:27 2022] GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd => generated 1273 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:27.604336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7054223d-51e6-404c-aea8-d956a65837e1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:27.606193 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7054223d-51e6-404c-aea8-d956a65837e1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:27.622671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7054223d-51e6-404c-aea8-d956a65837e1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:27.637562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7054223d-51e6-404c-aea8-d956a65837e1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:27.640270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7054223d-51e6-404c-aea8-d956a65837e1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:27.642651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7054223d-51e6-404c-aea8-d956a65837e1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:28.318239 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-c14fac45-7f9c-401c-ba51-e8c796eed39e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: 3e15d03f-3614-4eba-bf41-a0c059b15d56] Building network info cache for instance {{(pid=119337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 22:38:28.820677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7054223d-51e6-404c-aea8-d956a65837e1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:28.839966 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7054223d-51e6-404c-aea8-d956a65837e1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1515 microversion: 2.1 time: 1.258329 Jul 19 22:38:28.847014 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1300/2586] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:27 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1515 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:28.866892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6db3aa71-dbb4-4d70-9c30-e0695e09f753 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a15571160>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:29.010946 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6db3aa71-dbb4-4d70-9c30-e0695e09f753 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b1a4c605-7ea8-4ce0-9728-b7e1c746ec9f" status: 200 len: 1455 microversion: 2.1 time: 0.161621 Jul 19 22:38:29.023559 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1301/2587] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:38:28 2022] GET /compute/v2.1/images/b1a4c605-7ea8-4ce0-9728-b7e1c746ec9f => generated 1455 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:29.038616 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f21fed77-f112-494d-a523-64d06943e845 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:29.042514 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f21fed77-f112-494d-a523-64d06943e845 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 8f51c52b-0d6b-40bd-9b31-ad0a91304d78] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:29.078220 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f21fed77-f112-494d-a523-64d06943e845 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:29.079459 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f21fed77-f112-494d-a523-64d06943e845 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:29.082786 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f21fed77-f112-494d-a523-64d06943e845 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:29.087083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f21fed77-f112-494d-a523-64d06943e845 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:29.491841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f21fed77-f112-494d-a523-64d06943e845 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:29.547684 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f21fed77-f112-494d-a523-64d06943e845 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78" status: 200 len: 1217 microversion: 2.1 time: 0.520689 Jul 19 22:38:29.550644 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1302/2588] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:29 2022] GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78 => generated 1217 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:29.821233 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-497fb9e3-e55d-487d-85ea-6e94e42b223c tempest-TenantUsagesNegativeTestJSON-1204713793 tempest-TenantUsagesNegativeTestJSON-1204713793-project] Calling method '.version_select at 0x7f7a039c34c0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:29.872467 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-497fb9e3-e55d-487d-85ea-6e94e42b223c tempest-TenantUsagesNegativeTestJSON-1204713793 tempest-TenantUsagesNegativeTestJSON-1204713793-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '4c078da3efcf465e9e8d3e2054b36bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968c74fbba74938a6fc5f4f68b14f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:29.890461 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-497fb9e3-e55d-487d-85ea-6e94e42b223c tempest-TenantUsagesNegativeTestJSON-1204713793 tempest-TenantUsagesNegativeTestJSON-1204713793-project] Request method failure captured: Jul 19 22:38:29.890461 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-18T22%3A38%3A21.320413&end=2022-07-20T22%3A38%3A21.320413&detailed=1 HTTP/1.1 Jul 19 22:38:29.890461 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:38:29.890461 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:38:29.890461 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:38:29.890461 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:38:29.890461 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:38:29.890461 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:38:29.890461 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:38:29.890461 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:38:29.890461 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zJbrg3zI6YYBIHiNPbQ2NgYW9lVK8lN012zujF0kQjgR32xceaO1QcF75Ud5voE61d9o-4kRFtyRjRiKpAcRUBKkUzylEMYSeRIr-V6OXQ-Md19owu4wNRRFpYUzb43HrlAYPaRqKPzvoBRIoKUNwY-Bm0quPjl6runjGWZauKvy1Y Jul 19 22:38:29.890461 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:38:29.890461 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:38:29.890461 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:38:29.890461 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:38:29.890461 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:38:29.890461 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:38:29.890461 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: c968c74fbba74938a6fc5f4f68b14f74 Jul 19 22:38:29.890461 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1204713793 Jul 19 22:38:29.890461 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:38:29.890461 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:38:29.892145 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c968c74fbba74938a6fc5f4f68b14f74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c968c74fbba74938a6fc5f4f68b14f74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c968c74fbba74938a6fc5f4f68b14f74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c968c74fbba74938a6fc5f4f68b14f74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:38:29.892145 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1204713793 Jul 19 22:38:29.892145 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: c968c74fbba74938a6fc5f4f68b14f74 Jul 19 22:38:29.892145 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1204713793 Jul 19 22:38:29.892145 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TenantUsagesNegativeTestJSON-1204713793-project Jul 19 22:38:29.892145 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:38:29.892145 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:38:29.892145 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 4c078da3efcf465e9e8d3e2054b36bf5 Jul 19 22:38:29.892145 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1204713793-project Jul 19 22:38:29.892145 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:38:29.892145 n-d-847009-3 devstack@n-api.service[119338]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 19 22:38:29.892145 n-d-847009-3 devstack@n-api.service[119338]: action_args: {} Jul 19 22:38:29.892145 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:38:29.892991 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:38:29.892991 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:38:29.892991 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:38:29.892991 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:38:29.892991 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:38:29.892991 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:38:29.892991 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:38:29.892991 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 22:38:29.892991 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:38:29.892991 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:38:29.892991 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:38:29.892991 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 19 22:38:29.892991 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 19 22:38:29.892991 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 19 22:38:29.892991 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 19 22:38:29.892991 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 19 22:38:29.892991 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 19 22:38:29.892991 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 19 22:38:29.892991 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 19 22:38:29.894137 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:38:29.894137 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:38:29.894137 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:38:29.894137 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:38:29.894137 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 19 22:38:29.894137 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 19 22:38:29.894137 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 19 22:38:29.894137 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 19 22:38:29.894137 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 22:38:29.894137 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 19 22:38:29.894137 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 19 22:38:29.894137 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:29.894137 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:38:29.894137 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:29.894137 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:38:29.894137 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:38:29.894137 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:38:29.894137 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 19 22:38:29.894137 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 19 22:38:29.895713 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 19 22:38:29.895713 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:29.900422 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-497fb9e3-e55d-487d-85ea-6e94e42b223c tempest-TenantUsagesNegativeTestJSON-1204713793 tempest-TenantUsagesNegativeTestJSON-1204713793-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:38:29.903344 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-497fb9e3-e55d-487d-85ea-6e94e42b223c tempest-TenantUsagesNegativeTestJSON-1204713793 tempest-TenantUsagesNegativeTestJSON-1204713793-project] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-18T22%3A38%3A21.320413&end=2022-07-20T22%3A38%3A21.320413&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.348866 Jul 19 22:38:29.905326 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1303/2589] 10.222.0.25 () {58 vars in 1334 bytes} [Tue Jul 19 22:38:29 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-18T22%3A38%3A21.320413&end=2022-07-20T22%3A38%3A21.320413&detailed=1 => generated 123 bytes in 354 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:38:29.950912 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-2d683727-7c7e-4dea-ae5e-533727bec203 req-8683addb-c20d-421c-9643-4c0a0f4efe61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e15d03f-3614-4eba-bf41-a0c059b15d56", "tag": "cbe37743-8894-46d0-a28d-912d057c4b98"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:29.993475 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-2d683727-7c7e-4dea-ae5e-533727bec203 req-8683addb-c20d-421c-9643-4c0a0f4efe61 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:30.005648 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-2d683727-7c7e-4dea-ae5e-533727bec203 req-8683addb-c20d-421c-9643-4c0a0f4efe61 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:30.043596 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-2d683727-7c7e-4dea-ae5e-533727bec203 req-8683addb-c20d-421c-9643-4c0a0f4efe61 service nova] Creating event network-changed:cbe37743-8894-46d0-a28d-912d057c4b98 for instance 3e15d03f-3614-4eba-bf41-a0c059b15d56 on n-h2-847009-3 Jul 19 22:38:30.065304 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-2d683727-7c7e-4dea-ae5e-533727bec203 req-8683addb-c20d-421c-9643-4c0a0f4efe61 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158286 Jul 19 22:38:30.066029 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1304/2590] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:30.079435 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3de891db-9187-4837-a4f3-8144c5b46fa7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:30.081770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3de891db-9187-4837-a4f3-8144c5b46fa7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9c365853-9c4b-45db-97c8-26d0f6e797bd] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:30.099602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3de891db-9187-4837-a4f3-8144c5b46fa7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:30.100559 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3de891db-9187-4837-a4f3-8144c5b46fa7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:30.103816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3de891db-9187-4837-a4f3-8144c5b46fa7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:30.104300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3de891db-9187-4837-a4f3-8144c5b46fa7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:31.878162 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3de891db-9187-4837-a4f3-8144c5b46fa7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:31.923192 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3de891db-9187-4837-a4f3-8144c5b46fa7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd" status: 200 len: 1315 microversion: 2.1 time: 1.855154 Jul 19 22:38:31.930100 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1305/2591] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:30 2022] GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd => generated 1315 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:31.948561 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-2eaba947-1c67-4bff-a9b7-41cb85feba4a req-e2493b23-fdd8-4095-879e-0621c14ee5f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf0396df-c757-4ec7-9697-e71026a34525", "name": "network-vif-plugged", "status": "completed", "tag": "80ac4ef8-2707-46cd-8487-6e07db74d986"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:31.991997 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-2eaba947-1c67-4bff-a9b7-41cb85feba4a req-e2493b23-fdd8-4095-879e-0621c14ee5f4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:31.992799 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-2eaba947-1c67-4bff-a9b7-41cb85feba4a req-e2493b23-fdd8-4095-879e-0621c14ee5f4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:32.044440 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-2eaba947-1c67-4bff-a9b7-41cb85feba4a req-e2493b23-fdd8-4095-879e-0621c14ee5f4 service nova] Creating event network-vif-plugged:80ac4ef8-2707-46cd-8487-6e07db74d986 for instance bf0396df-c757-4ec7-9697-e71026a34525 on n-h1-847009-3 Jul 19 22:38:32.055205 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-2eaba947-1c67-4bff-a9b7-41cb85feba4a req-e2493b23-fdd8-4095-879e-0621c14ee5f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121627 Jul 19 22:38:32.059762 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1306/2592] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:32.073015 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5c523142-0bd0-4d51-bf2b-e9f1b594c1ca tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:32.078498 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5c523142-0bd0-4d51-bf2b-e9f1b594c1ca tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:32.106867 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5c523142-0bd0-4d51-bf2b-e9f1b594c1ca tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:32.107663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5c523142-0bd0-4d51-bf2b-e9f1b594c1ca tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:32.109112 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5c523142-0bd0-4d51-bf2b-e9f1b594c1ca tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:32.109824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5c523142-0bd0-4d51-bf2b-e9f1b594c1ca tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:32.777833 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5c523142-0bd0-4d51-bf2b-e9f1b594c1ca tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:32.793242 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5c523142-0bd0-4d51-bf2b-e9f1b594c1ca tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1521 microversion: 2.1 time: 0.731091 Jul 19 22:38:32.807194 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1307/2593] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:32 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1521 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:32.843503 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5b25e351-e388-4b82-af9d-52fd9bc4e236 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a03a33ca0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:32.969376 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5b25e351-e388-4b82-af9d-52fd9bc4e236 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b1a4c605-7ea8-4ce0-9728-b7e1c746ec9f" status: 200 len: 1455 microversion: 2.1 time: 0.160377 Jul 19 22:38:32.980581 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1308/2594] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:38:32 2022] GET /compute/v2.1/images/b1a4c605-7ea8-4ce0-9728-b7e1c746ec9f => generated 1455 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:32.991965 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6a9213ae-85d6-444e-b76a-5d3885319035 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:32.993851 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6a9213ae-85d6-444e-b76a-5d3885319035 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 8f51c52b-0d6b-40bd-9b31-ad0a91304d78] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:33.006618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a9213ae-85d6-444e-b76a-5d3885319035 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:33.007406 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a9213ae-85d6-444e-b76a-5d3885319035 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:33.009165 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a9213ae-85d6-444e-b76a-5d3885319035 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:33.009780 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a9213ae-85d6-444e-b76a-5d3885319035 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:33.070336 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:38:33.152224 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:38:33.242289 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6a9213ae-85d6-444e-b76a-5d3885319035 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:33.274159 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6a9213ae-85d6-444e-b76a-5d3885319035 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78" status: 200 len: 1271 microversion: 2.1 time: 0.291091 Jul 19 22:38:33.281604 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1309/2595] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:32 2022] GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78 => generated 1271 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:33.302453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5f5c7074-680f-4535-b728-41e7daf18ca2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:33.304534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5f5c7074-680f-4535-b728-41e7daf18ca2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9c365853-9c4b-45db-97c8-26d0f6e797bd] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:33.333565 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5f5c7074-680f-4535-b728-41e7daf18ca2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:33.339205 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5f5c7074-680f-4535-b728-41e7daf18ca2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:33.341058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5f5c7074-680f-4535-b728-41e7daf18ca2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:33.342402 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5f5c7074-680f-4535-b728-41e7daf18ca2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:33.833830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:38:33.922796 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-c14fac45-7f9c-401c-ba51-e8c796eed39e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: 3e15d03f-3614-4eba-bf41-a0c059b15d56] Updating instance_info_cache with network_info: [{"id": "cbe37743-8894-46d0-a28d-912d057c4b98", "address": "fa:16:3e:c6:28:92", "network": {"id": "0c4e10b3-9ece-4e7a-b6a5-7a85afc8792f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1161400161-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ef7242ed05524293b5dae6a33e520cfc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapcbe37743-88", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 22:38:33.943646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c14fac45-7f9c-401c-ba51-e8c796eed39e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Releasing lock "refresh_cache-3e15d03f-3614-4eba-bf41-a0c059b15d56" {{(pid=119337) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 22:38:33.948720 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c14fac45-7f9c-401c-ba51-e8c796eed39e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "POST /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56/action" status: 202 len: 0 microversion: 2.1 time: 10.659740 Jul 19 22:38:33.953016 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1287/2596] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:38:23 2022] POST /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56/action => generated 0 bytes in 10665 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 19 22:38:33.966352 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2417a8dd-b64f-454b-90a6-db05a20d7cf6 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:33.967762 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2417a8dd-b64f-454b-90a6-db05a20d7cf6 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:33.991082 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2417a8dd-b64f-454b-90a6-db05a20d7cf6 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:33.992670 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2417a8dd-b64f-454b-90a6-db05a20d7cf6 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:33.994551 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5f5c7074-680f-4535-b728-41e7daf18ca2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:33.995720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2417a8dd-b64f-454b-90a6-db05a20d7cf6 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:33.996287 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2417a8dd-b64f-454b-90a6-db05a20d7cf6 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:34.010127 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5f5c7074-680f-4535-b728-41e7daf18ca2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd" status: 200 len: 1315 microversion: 2.1 time: 0.726245 Jul 19 22:38:34.010873 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1310/2597] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:33 2022] GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd => generated 1315 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:34.069019 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-da8eeef7-f617-4cb0-ac8f-ac5ae503cac5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:34.070150 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-da8eeef7-f617-4cb0-ac8f-ac5ae503cac5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: 3e15d03f-3614-4eba-bf41-a0c059b15d56] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:34.088277 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da8eeef7-f617-4cb0-ac8f-ac5ae503cac5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:34.088739 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da8eeef7-f617-4cb0-ac8f-ac5ae503cac5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:34.089696 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da8eeef7-f617-4cb0-ac8f-ac5ae503cac5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:34.091488 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da8eeef7-f617-4cb0-ac8f-ac5ae503cac5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:34.181523 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-da8eeef7-f617-4cb0-ac8f-ac5ae503cac5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: 3e15d03f-3614-4eba-bf41-a0c059b15d56] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:38:34.423031 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-da8eeef7-f617-4cb0-ac8f-ac5ae503cac5 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56" status: 204 len: 0 microversion: 2.1 time: 0.401398 Jul 19 22:38:34.426127 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1311/2598] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:38:34 2022] DELETE /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:38:34.470467 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9915067e-6fc2-43e0-a12f-2201fc6ffc68 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a102a7f70>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:34.593801 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9915067e-6fc2-43e0-a12f-2201fc6ffc68 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b1a4c605-7ea8-4ce0-9728-b7e1c746ec9f" status: 200 len: 1455 microversion: 2.1 time: 0.162766 Jul 19 22:38:34.606932 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1312/2599] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:38:34 2022] GET /compute/v2.1/images/b1a4c605-7ea8-4ce0-9728-b7e1c746ec9f => generated 1455 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:34.635477 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ceb96130-bd35-4bb3-ab29-2b28c6a9ce57 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:34.637329 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ceb96130-bd35-4bb3-ab29-2b28c6a9ce57 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 8f51c52b-0d6b-40bd-9b31-ad0a91304d78] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:34.679906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ceb96130-bd35-4bb3-ab29-2b28c6a9ce57 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:34.683255 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ceb96130-bd35-4bb3-ab29-2b28c6a9ce57 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:34.689376 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ceb96130-bd35-4bb3-ab29-2b28c6a9ce57 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:34.693461 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ceb96130-bd35-4bb3-ab29-2b28c6a9ce57 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:34.720046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2417a8dd-b64f-454b-90a6-db05a20d7cf6 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:34.745565 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2417a8dd-b64f-454b-90a6-db05a20d7cf6 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1521 microversion: 2.1 time: 0.790671 Jul 19 22:38:34.759632 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1288/2600] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:33 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1521 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:34.766560 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-62a65ba5-03cb-4fcf-aacd-739244b14312 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.85"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:34.771923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-62a65ba5-03cb-4fcf-aacd-739244b14312 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:34.804951 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62a65ba5-03cb-4fcf-aacd-739244b14312 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:34.805627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62a65ba5-03cb-4fcf-aacd-739244b14312 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:34.806579 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62a65ba5-03cb-4fcf-aacd-739244b14312 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:34.807383 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62a65ba5-03cb-4fcf-aacd-739244b14312 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:34.852409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62a65ba5-03cb-4fcf-aacd-739244b14312 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Acquired lock "refresh_cache-caf65365-ee09-4edc-87d7-e6111559ca2e" {{(pid=119337) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 22:38:34.941967 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ceb96130-bd35-4bb3-ab29-2b28c6a9ce57 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:34.964004 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ceb96130-bd35-4bb3-ab29-2b28c6a9ce57 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78" status: 200 len: 1271 microversion: 2.1 time: 0.363556 Jul 19 22:38:34.966778 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1313/2601] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:34 2022] GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78 => generated 1271 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:35.027763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-459836fd-d504-4fa4-a3da-80717abd4adf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:35.028904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-459836fd-d504-4fa4-a3da-80717abd4adf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9c365853-9c4b-45db-97c8-26d0f6e797bd] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:35.040882 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-459836fd-d504-4fa4-a3da-80717abd4adf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:35.046327 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-459836fd-d504-4fa4-a3da-80717abd4adf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:35.047491 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-459836fd-d504-4fa4-a3da-80717abd4adf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:35.048015 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-459836fd-d504-4fa4-a3da-80717abd4adf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:35.056794 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:38:36.065129 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-459836fd-d504-4fa4-a3da-80717abd4adf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:36.091069 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-459836fd-d504-4fa4-a3da-80717abd4adf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd" status: 200 len: 1315 microversion: 2.1 time: 1.067665 Jul 19 22:38:36.096464 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1314/2602] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:35 2022] GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd => generated 1315 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:38:36.118450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-00c3e9b7-a876-4299-a24f-a466e10df743 req-f8ee79e3-25e1-423d-bb70-54e698ac3794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f0e6a34-7136-4af6-b710-1b4c0ef0c97a", "name": "network-vif-unplugged", "status": "completed", "tag": "643e30b9-db43-4c54-82b7-713417e3c041"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:36.137623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-00c3e9b7-a876-4299-a24f-a466e10df743 req-f8ee79e3-25e1-423d-bb70-54e698ac3794 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:36.138339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-00c3e9b7-a876-4299-a24f-a466e10df743 req-f8ee79e3-25e1-423d-bb70-54e698ac3794 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:36.179733 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-00c3e9b7-a876-4299-a24f-a466e10df743 req-f8ee79e3-25e1-423d-bb70-54e698ac3794 service nova] Creating event network-vif-unplugged:643e30b9-db43-4c54-82b7-713417e3c041 for instance 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a on n-h2-847009-3 Jul 19 22:38:36.189247 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-00c3e9b7-a876-4299-a24f-a466e10df743 req-f8ee79e3-25e1-423d-bb70-54e698ac3794 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091518 Jul 19 22:38:36.190602 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1315/2603] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:36.203290 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-23478a43-d7d7-4a53-8ebc-f3c43bff6901 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a039c45e0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:36.312830 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-23478a43-d7d7-4a53-8ebc-f3c43bff6901 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b1a4c605-7ea8-4ce0-9728-b7e1c746ec9f" status: 200 len: 1455 microversion: 2.1 time: 0.119947 Jul 19 22:38:36.321455 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1316/2604] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:38:36 2022] GET /compute/v2.1/images/b1a4c605-7ea8-4ce0-9728-b7e1c746ec9f => generated 1455 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:36.328583 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c3fbd193-815b-4fbc-b5b3-6a6a79ca0bdb tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:36.330481 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c3fbd193-815b-4fbc-b5b3-6a6a79ca0bdb tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:36.369221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c3fbd193-815b-4fbc-b5b3-6a6a79ca0bdb tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:36.375867 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c3fbd193-815b-4fbc-b5b3-6a6a79ca0bdb tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:36.387510 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c3fbd193-815b-4fbc-b5b3-6a6a79ca0bdb tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:36.388518 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c3fbd193-815b-4fbc-b5b3-6a6a79ca0bdb tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:36.963631 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:38:37.062668 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:38:37.804018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c3fbd193-815b-4fbc-b5b3-6a6a79ca0bdb tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:37.837217 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c3fbd193-815b-4fbc-b5b3-6a6a79ca0bdb tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1521 microversion: 2.1 time: 1.514323 Jul 19 22:38:37.838862 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1317/2605] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:36 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1521 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:37.845808 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0a11914e-44a6-413b-afcb-dfc6524a052c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:37.849149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0a11914e-44a6-413b-afcb-dfc6524a052c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 8f51c52b-0d6b-40bd-9b31-ad0a91304d78] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:37.865806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a11914e-44a6-413b-afcb-dfc6524a052c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:37.867709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a11914e-44a6-413b-afcb-dfc6524a052c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:37.868868 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a11914e-44a6-413b-afcb-dfc6524a052c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:37.869740 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a11914e-44a6-413b-afcb-dfc6524a052c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:38.629817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0a11914e-44a6-413b-afcb-dfc6524a052c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:38.641737 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0a11914e-44a6-413b-afcb-dfc6524a052c tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78" status: 200 len: 1313 microversion: 2.1 time: 0.800942 Jul 19 22:38:38.652291 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1318/2606] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:37 2022] GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78 => generated 1313 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:38.659071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-d28dd2eb-6637-4fa3-b0f5-3df002251e53 req-8f1356c8-8c2b-4955-9de5-a87345ff8b06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c365853-9c4b-45db-97c8-26d0f6e797bd", "tag": "b561cd1a-117e-42d5-8543-cc93dd6943c5"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:38.669160 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d28dd2eb-6637-4fa3-b0f5-3df002251e53 req-8f1356c8-8c2b-4955-9de5-a87345ff8b06 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:38.669956 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d28dd2eb-6637-4fa3-b0f5-3df002251e53 req-8f1356c8-8c2b-4955-9de5-a87345ff8b06 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:38.683154 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-d28dd2eb-6637-4fa3-b0f5-3df002251e53 req-8f1356c8-8c2b-4955-9de5-a87345ff8b06 service nova] Creating event network-changed:b561cd1a-117e-42d5-8543-cc93dd6943c5 for instance 9c365853-9c4b-45db-97c8-26d0f6e797bd on n-h1-847009-3 Jul 19 22:38:38.689681 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-d28dd2eb-6637-4fa3-b0f5-3df002251e53 req-8f1356c8-8c2b-4955-9de5-a87345ff8b06 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035843 Jul 19 22:38:38.690535 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1319/2607] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:38.928527 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f43d57db-1120-493c-994c-89477007fb13 tempest-FlavorsV2NegativeTest-342743613 tempest-FlavorsV2NegativeTest-342743613-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:38.960022 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f43d57db-1120-493c-994c-89477007fb13 tempest-FlavorsV2NegativeTest-342743613 tempest-FlavorsV2NegativeTest-342743613-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.267504 Jul 19 22:38:38.974210 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1320/2608] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:38:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:38.983923 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-02c5c0ba-8623-4f87-b2dc-9d00f48de74d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:38.985872 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-02c5c0ba-8623-4f87-b2dc-9d00f48de74d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9c365853-9c4b-45db-97c8-26d0f6e797bd] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:38.995098 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02c5c0ba-8623-4f87-b2dc-9d00f48de74d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:38.996219 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02c5c0ba-8623-4f87-b2dc-9d00f48de74d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:38.997028 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02c5c0ba-8623-4f87-b2dc-9d00f48de74d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:38.998218 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02c5c0ba-8623-4f87-b2dc-9d00f48de74d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:39.496791 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-02c5c0ba-8623-4f87-b2dc-9d00f48de74d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:39.524639 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-02c5c0ba-8623-4f87-b2dc-9d00f48de74d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd" status: 200 len: 1315 microversion: 2.1 time: 0.548671 Jul 19 22:38:39.534874 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1321/2609] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:38 2022] GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd => generated 1315 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:39.552716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0560a0a7-d6ef-422d-86a1-e0a7ce84df42 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a03a15820>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:39.658887 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-62a65ba5-03cb-4fcf-aacd-739244b14312 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Building network info cache for instance {{(pid=119337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 22:38:39.995804 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0560a0a7-d6ef-422d-86a1-e0a7ce84df42 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b1a4c605-7ea8-4ce0-9728-b7e1c746ec9f" status: 200 len: 1455 microversion: 2.1 time: 0.458647 Jul 19 22:38:40.002035 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1322/2610] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:38:39 2022] GET /compute/v2.1/images/b1a4c605-7ea8-4ce0-9728-b7e1c746ec9f => generated 1455 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:40.007632 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-51fa07c7-a56d-4c0e-bdc1-71a0ea19413c req-3b46cd6c-23f8-4337-9901-1571ab9da8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e15d03f-3614-4eba-bf41-a0c059b15d56", "name": "network-vif-deleted", "tag": "cbe37743-8894-46d0-a28d-912d057c4b98"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:40.017763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-51fa07c7-a56d-4c0e-bdc1-71a0ea19413c req-3b46cd6c-23f8-4337-9901-1571ab9da8a2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:40.018218 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-51fa07c7-a56d-4c0e-bdc1-71a0ea19413c req-3b46cd6c-23f8-4337-9901-1571ab9da8a2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:40.033977 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-51fa07c7-a56d-4c0e-bdc1-71a0ea19413c req-3b46cd6c-23f8-4337-9901-1571ab9da8a2 service nova] Creating event network-vif-deleted:cbe37743-8894-46d0-a28d-912d057c4b98 for instance 3e15d03f-3614-4eba-bf41-a0c059b15d56 on n-h2-847009-3 Jul 19 22:38:40.040875 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-51fa07c7-a56d-4c0e-bdc1-71a0ea19413c req-3b46cd6c-23f8-4337-9901-1571ab9da8a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037289 Jul 19 22:38:40.041928 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1323/2611] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:40.054012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-c50061f8-6c14-4273-b34c-381dfeaae9a9 req-4b142cc8-f743-4c52-96ad-33212663be33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f0e6a34-7136-4af6-b710-1b4c0ef0c97a", "name": "network-vif-plugged", "status": "completed", "tag": "643e30b9-db43-4c54-82b7-713417e3c041"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:40.064603 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c50061f8-6c14-4273-b34c-381dfeaae9a9 req-4b142cc8-f743-4c52-96ad-33212663be33 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:40.065325 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c50061f8-6c14-4273-b34c-381dfeaae9a9 req-4b142cc8-f743-4c52-96ad-33212663be33 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:40.079677 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-c50061f8-6c14-4273-b34c-381dfeaae9a9 req-4b142cc8-f743-4c52-96ad-33212663be33 service nova] Creating event network-vif-plugged:643e30b9-db43-4c54-82b7-713417e3c041 for instance 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a on n-h2-847009-3 Jul 19 22:38:40.087571 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-c50061f8-6c14-4273-b34c-381dfeaae9a9 req-4b142cc8-f743-4c52-96ad-33212663be33 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041792 Jul 19 22:38:40.088753 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1324/2612] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:40.099057 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-847e73c7-fe4d-490f-9449-a99324701739 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:40.100165 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-847e73c7-fe4d-490f-9449-a99324701739 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:40.109064 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-847e73c7-fe4d-490f-9449-a99324701739 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:40.109981 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-847e73c7-fe4d-490f-9449-a99324701739 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:40.111729 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-847e73c7-fe4d-490f-9449-a99324701739 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:40.112352 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-847e73c7-fe4d-490f-9449-a99324701739 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:40.769625 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-847e73c7-fe4d-490f-9449-a99324701739 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:40.780471 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-847e73c7-fe4d-490f-9449-a99324701739 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1521 microversion: 2.1 time: 0.688528 Jul 19 22:38:40.792288 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1325/2613] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:40 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1521 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:40.797984 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-442a6466-22e5-48b0-b729-12ec5b3e699e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:40.799566 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-442a6466-22e5-48b0-b729-12ec5b3e699e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 8f51c52b-0d6b-40bd-9b31-ad0a91304d78] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:40.809065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-442a6466-22e5-48b0-b729-12ec5b3e699e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:40.817127 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-442a6466-22e5-48b0-b729-12ec5b3e699e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:40.818382 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-442a6466-22e5-48b0-b729-12ec5b3e699e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:40.819051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-442a6466-22e5-48b0-b729-12ec5b3e699e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:41.569329 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-442a6466-22e5-48b0-b729-12ec5b3e699e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:41.584322 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-442a6466-22e5-48b0-b729-12ec5b3e699e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78" status: 200 len: 1334 microversion: 2.1 time: 0.790258 Jul 19 22:38:41.593757 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1326/2614] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:40 2022] GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78 => generated 1334 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:41.599093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3c6e69e1-06a5-4ccd-8ec7-b2132dc1215f tempest-FlavorsV2NegativeTest-342743613 tempest-FlavorsV2NegativeTest-342743613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-33764213", "imageRef": "e80f3f5d-3965-4c85-b708-781df98ba910", "flavorRef": "452"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:41.683785 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-3c6e69e1-06a5-4ccd-8ec7-b2132dc1215f tempest-FlavorsV2NegativeTest-342743613 tempest-FlavorsV2NegativeTest-342743613-project] validate_networks() for None {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:38:41.832688 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-62a65ba5-03cb-4fcf-aacd-739244b14312 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Updating instance_info_cache with network_info: [{"id": "3d5f4107-f97a-4ed8-ad9b-376b9b2e9563", "address": "fa:16:3e:14:ce:22", "network": {"id": "0c4e10b3-9ece-4e7a-b6a5-7a85afc8792f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1161400161-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ef7242ed05524293b5dae6a33e520cfc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3d5f4107-f9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 22:38:41.875206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62a65ba5-03cb-4fcf-aacd-739244b14312 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Releasing lock "refresh_cache-caf65365-ee09-4edc-87d7-e6111559ca2e" {{(pid=119337) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 22:38:41.879571 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-62a65ba5-03cb-4fcf-aacd-739244b14312 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "POST /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e/action" status: 202 len: 0 microversion: 2.1 time: 7.115582 Jul 19 22:38:41.881828 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1289/2615] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:38:34 2022] POST /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e/action => generated 0 bytes in 7121 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 19 22:38:41.897908 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f183b753-0ce5-4d80-9aeb-ebdc1c34bb4a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:41.898530 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f183b753-0ce5-4d80-9aeb-ebdc1c34bb4a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9c365853-9c4b-45db-97c8-26d0f6e797bd] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:41.906315 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f183b753-0ce5-4d80-9aeb-ebdc1c34bb4a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:41.906800 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f183b753-0ce5-4d80-9aeb-ebdc1c34bb4a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:41.907702 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f183b753-0ce5-4d80-9aeb-ebdc1c34bb4a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:41.908147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f183b753-0ce5-4d80-9aeb-ebdc1c34bb4a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:42.761509 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f183b753-0ce5-4d80-9aeb-ebdc1c34bb4a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:42.779793 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f183b753-0ce5-4d80-9aeb-ebdc1c34bb4a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd" status: 200 len: 1315 microversion: 2.1 time: 0.894785 Jul 19 22:38:42.787365 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1290/2616] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:41 2022] GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd => generated 1315 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:42.809463 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-ca8909c2-efb5-4cc8-a52c-5857c5050880 req-b0d426c8-03d8-4954-af2c-f135b9998133 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caf65365-ee09-4edc-87d7-e6111559ca2e", "tag": "3d5f4107-f97a-4ed8-ad9b-376b9b2e9563"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:42.848608 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-ca8909c2-efb5-4cc8-a52c-5857c5050880 req-b0d426c8-03d8-4954-af2c-f135b9998133 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:42.849392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-ca8909c2-efb5-4cc8-a52c-5857c5050880 req-b0d426c8-03d8-4954-af2c-f135b9998133 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:42.874917 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-ca8909c2-efb5-4cc8-a52c-5857c5050880 req-b0d426c8-03d8-4954-af2c-f135b9998133 service nova] Creating event network-changed:3d5f4107-f97a-4ed8-ad9b-376b9b2e9563 for instance caf65365-ee09-4edc-87d7-e6111559ca2e on n-h1-847009-3 Jul 19 22:38:42.893744 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-ca8909c2-efb5-4cc8-a52c-5857c5050880 req-b0d426c8-03d8-4954-af2c-f135b9998133 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103908 Jul 19 22:38:42.895029 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1291/2617] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:42.901931 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4ca5fdba-6fd3-4796-ae3e-a644eb8a20f9 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a155c9ee0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:42.954924 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-3c6e69e1-06a5-4ccd-8ec7-b2132dc1215f tempest-FlavorsV2NegativeTest-342743613 tempest-FlavorsV2NegativeTest-342743613-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 19 22:38:42.957263 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3c6e69e1-06a5-4ccd-8ec7-b2132dc1215f tempest-FlavorsV2NegativeTest-342743613 tempest-FlavorsV2NegativeTest-342743613-project] Request method failure captured: Jul 19 22:38:42.957263 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:38:42.957263 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:38:42.957263 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:38:42.957263 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:38:42.957263 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 141 Jul 19 22:38:42.957263 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:38:42.957263 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:38:42.957263 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:38:42.957263 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:38:42.957263 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zJse1TP0k8syXpuIxMXuLr5OUgovuJApB4t5xUktwgWXWX0-LmbX2YWarhQRibggLmvKIoiQ2HoHXS2OzlB4bBu8Jw419lgDNfQ-GuwjH5lwk5jWWhzpcAHQnAc39Wuv3VhtvjvZH-UE3GRPVrR1bVgvet1GLPnxQOBy5Qhq3E8lZM Jul 19 22:38:42.957263 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:38:42.957263 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:38:42.957263 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:38:42.957263 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:38:42.957263 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:38:42.957263 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:38:42.957263 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 74bf92e07c54448883e8faab8c9065d7 Jul 19 22:38:42.957263 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-FlavorsV2NegativeTest-342743613 Jul 19 22:38:42.957263 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:38:42.957263 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:38:42.958816 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_74bf92e07c54448883e8faab8c9065d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/74bf92e07c54448883e8faab8c9065d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/74bf92e07c54448883e8faab8c9065d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/74bf92e07c54448883e8faab8c9065d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:38:42.958816 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-FlavorsV2NegativeTest-342743613 Jul 19 22:38:42.958816 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 74bf92e07c54448883e8faab8c9065d7 Jul 19 22:38:42.958816 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-342743613 Jul 19 22:38:42.958816 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-FlavorsV2NegativeTest-342743613-project Jul 19 22:38:42.958816 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:38:42.958816 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:38:42.958816 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: ce00fdd1e19e43cf9dfdffb749501a00 Jul 19 22:38:42.958816 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-FlavorsV2NegativeTest-342743613-project Jul 19 22:38:42.958816 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:38:42.958816 n-d-847009-3 devstack@n-api.service[119338]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-33764213", "imageRef": "e80f3f5d-3965-4c85-b708-781df98ba910", "flavorRef": "452"}} Jul 19 22:38:42.958816 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:38:42.958816 n-d-847009-3 devstack@n-api.service[119338]: exception: Flavor's memory is too small for requested image. Jul 19 22:38:42.959758 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-33764213', 'imageRef': 'e80f3f5d-3965-4c85-b708-781df98ba910', 'flavorRef': '452'}}} Jul 19 22:38:42.959758 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:38:42.959758 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:38:42.959758 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 19 22:38:42.959758 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 19 22:38:42.959758 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 19 22:38:42.959758 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 19 22:38:42.959758 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 19 22:38:42.959758 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 19 22:38:42.959758 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jul 19 22:38:42.959758 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 19 22:38:42.959758 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jul 19 22:38:42.959758 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 19 22:38:42.959758 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jul 19 22:38:42.959758 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 19 22:38:42.959758 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 19 22:38:42.959758 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:42.959758 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:38:42.959758 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:42.959758 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:38:42.961234 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:38:42.961234 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:38:42.961234 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:38:42.961234 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:38:42.961234 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:38:42.961234 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:38:42.961234 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:38:42.961234 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:38:42.961234 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:38:42.961234 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:38:42.961234 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:38:42.961234 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:38:42.961234 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 22:38:42.961234 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 19 22:38:42.961234 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 19 22:38:42.961234 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 19 22:38:42.961234 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:42.961234 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:38:42.961234 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:42.961234 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:38:42.962557 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:38:42.962557 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:38:42.962557 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:38:42.962557 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:38:42.962557 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 19 22:38:42.962557 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:42.962557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3c6e69e1-06a5-4ccd-8ec7-b2132dc1215f tempest-FlavorsV2NegativeTest-342743613 tempest-FlavorsV2NegativeTest-342743613-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:38:42.962557 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3c6e69e1-06a5-4ccd-8ec7-b2132dc1215f tempest-FlavorsV2NegativeTest-342743613 tempest-FlavorsV2NegativeTest-342743613-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.363862 Jul 19 22:38:42.962557 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1327/2618] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:38:41 2022] POST /compute/v2.1/servers => generated 93 bytes in 1365 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 22:38:42.966854 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1bce1957-ad06-4c84-85d2-5c115e968c33 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:42.971426 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1bce1957-ad06-4c84-85d2-5c115e968c33 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:42.988919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1bce1957-ad06-4c84-85d2-5c115e968c33 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:42.990443 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1bce1957-ad06-4c84-85d2-5c115e968c33 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:42.994929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1bce1957-ad06-4c84-85d2-5c115e968c33 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:42.994929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1bce1957-ad06-4c84-85d2-5c115e968c33 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:43.481353 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4ca5fdba-6fd3-4796-ae3e-a644eb8a20f9 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b1a4c605-7ea8-4ce0-9728-b7e1c746ec9f" status: 200 len: 1455 microversion: 2.1 time: 0.584259 Jul 19 22:38:43.483341 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1292/2619] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:38:42 2022] GET /compute/v2.1/images/b1a4c605-7ea8-4ce0-9728-b7e1c746ec9f => generated 1455 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:43.489660 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dbe9ae19-1601-48b0-b2de-2565d7c6df5b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '.version_select at 0x7f7a155ac160>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:43.653808 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1bce1957-ad06-4c84-85d2-5c115e968c33 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:43.684169 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1bce1957-ad06-4c84-85d2-5c115e968c33 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1506 microversion: 2.1 time: 0.723295 Jul 19 22:38:43.691587 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1328/2620] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:42 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1506 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:43.706969 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c3e38c66-2071-4bb8-b0d5-39eb8a6bfcb3 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:43.709896 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c3e38c66-2071-4bb8-b0d5-39eb8a6bfcb3 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 8f51c52b-0d6b-40bd-9b31-ad0a91304d78] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:43.734305 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c3e38c66-2071-4bb8-b0d5-39eb8a6bfcb3 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:43.741249 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c3e38c66-2071-4bb8-b0d5-39eb8a6bfcb3 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:43.745968 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c3e38c66-2071-4bb8-b0d5-39eb8a6bfcb3 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:43.748588 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c3e38c66-2071-4bb8-b0d5-39eb8a6bfcb3 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:44.646455 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c3e38c66-2071-4bb8-b0d5-39eb8a6bfcb3 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:44.683417 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c3e38c66-2071-4bb8-b0d5-39eb8a6bfcb3 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78" status: 200 len: 1334 microversion: 2.1 time: 0.989584 Jul 19 22:38:44.686899 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dbe9ae19-1601-48b0-b2de-2565d7c6df5b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/602c40bf-d2f0-48d7-b0c6-46768196d970" status: 200 len: 183 microversion: 2.1 time: 1.201929 Jul 19 22:38:44.689591 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1293/2621] 10.222.0.25 () {58 vars in 1259 bytes} [Tue Jul 19 22:38:43 2022] GET /compute/v2.1/os-floating-ips/602c40bf-d2f0-48d7-b0c6-46768196d970 => generated 183 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:44.696053 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1329/2622] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:43 2022] GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78 => generated 1334 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:44.696756 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e8f1ed5d-da46-4bf3-9129-3419c615aa15 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:44.697594 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e8f1ed5d-da46-4bf3-9129-3419c615aa15 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:44.761212 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-163fc3f0-62c7-43fb-b1c7-11ed3f088287 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:44.774179 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-163fc3f0-62c7-43fb-b1c7-11ed3f088287 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9c365853-9c4b-45db-97c8-26d0f6e797bd] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:44.783613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e8f1ed5d-da46-4bf3-9129-3419c615aa15 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:44.785344 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e8f1ed5d-da46-4bf3-9129-3419c615aa15 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:44.798745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e8f1ed5d-da46-4bf3-9129-3419c615aa15 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:44.804470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e8f1ed5d-da46-4bf3-9129-3419c615aa15 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:44.813392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-163fc3f0-62c7-43fb-b1c7-11ed3f088287 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:44.814134 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-163fc3f0-62c7-43fb-b1c7-11ed3f088287 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:44.815068 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-163fc3f0-62c7-43fb-b1c7-11ed3f088287 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:44.815804 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-163fc3f0-62c7-43fb-b1c7-11ed3f088287 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:45.887042 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e8f1ed5d-da46-4bf3-9129-3419c615aa15 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:45.898391 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e8f1ed5d-da46-4bf3-9129-3419c615aa15 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 200 len: 1506 microversion: 2.1 time: 1.207061 Jul 19 22:38:45.907299 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-163fc3f0-62c7-43fb-b1c7-11ed3f088287 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:45.915800 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-163fc3f0-62c7-43fb-b1c7-11ed3f088287 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd" status: 200 len: 1315 microversion: 2.1 time: 1.205996 Jul 19 22:38:45.917471 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1330/2623] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:44 2022] GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd => generated 1315 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:45.918753 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1294/2624] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:44 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 1506 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:45.929706 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-264d762b-ebdf-4e4e-80fe-2488bd10fb38 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a155ac280>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:45.937974 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-0267508f-446b-44e8-a03c-de78151e9760 req-56c3a161-d183-40d4-95a0-380b86138366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c365853-9c4b-45db-97c8-26d0f6e797bd", "name": "network-vif-plugged", "status": "completed", "tag": "b561cd1a-117e-42d5-8543-cc93dd6943c5"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:45.960471 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0267508f-446b-44e8-a03c-de78151e9760 req-56c3a161-d183-40d4-95a0-380b86138366 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:45.963747 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0267508f-446b-44e8-a03c-de78151e9760 req-56c3a161-d183-40d4-95a0-380b86138366 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:46.003034 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-0267508f-446b-44e8-a03c-de78151e9760 req-56c3a161-d183-40d4-95a0-380b86138366 service nova] Creating event network-vif-plugged:b561cd1a-117e-42d5-8543-cc93dd6943c5 for instance 9c365853-9c4b-45db-97c8-26d0f6e797bd on n-h1-847009-3 Jul 19 22:38:46.009966 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-0267508f-446b-44e8-a03c-de78151e9760 req-56c3a161-d183-40d4-95a0-380b86138366 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087404 Jul 19 22:38:46.011149 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1331/2625] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:46.018736 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-264d762b-ebdf-4e4e-80fe-2488bd10fb38 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b1a4c605-7ea8-4ce0-9728-b7e1c746ec9f" status: 200 len: 1455 microversion: 2.1 time: 0.096606 Jul 19 22:38:46.027602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b3272b9b-a035-469d-a854-f9dfcc96eb69 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.85"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:46.027947 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1295/2626] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:38:45 2022] GET /compute/v2.1/images/b1a4c605-7ea8-4ce0-9728-b7e1c746ec9f => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:46.034280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-1afa0c78-5665-4dc8-9d80-9f1267e7598d req-58f9dad0-9461-41f8-9569-47b02a0971a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f51c52b-0d6b-40bd-9b31-ad0a91304d78", "tag": "a67ebbd2-ea44-45b3-a0d8-ad47909966a4"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:46.051205 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1afa0c78-5665-4dc8-9d80-9f1267e7598d req-58f9dad0-9461-41f8-9569-47b02a0971a3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:46.052824 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1afa0c78-5665-4dc8-9d80-9f1267e7598d req-58f9dad0-9461-41f8-9569-47b02a0971a3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:46.073367 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-1afa0c78-5665-4dc8-9d80-9f1267e7598d req-58f9dad0-9461-41f8-9569-47b02a0971a3 service nova] Creating event network-changed:a67ebbd2-ea44-45b3-a0d8-ad47909966a4 for instance 8f51c52b-0d6b-40bd-9b31-ad0a91304d78 on n-h1-847009-3 Jul 19 22:38:46.079603 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-1afa0c78-5665-4dc8-9d80-9f1267e7598d req-58f9dad0-9461-41f8-9569-47b02a0971a3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050142 Jul 19 22:38:46.080708 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1296/2627] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:46.087394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3d46ba93-2d65-4629-a094-d44aafc4757e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:46.088244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3d46ba93-2d65-4629-a094-d44aafc4757e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 8f51c52b-0d6b-40bd-9b31-ad0a91304d78] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:46.096071 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d46ba93-2d65-4629-a094-d44aafc4757e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:46.096681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d46ba93-2d65-4629-a094-d44aafc4757e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:46.098509 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d46ba93-2d65-4629-a094-d44aafc4757e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:46.099235 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d46ba93-2d65-4629-a094-d44aafc4757e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:46.637368 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b3272b9b-a035-469d-a854-f9dfcc96eb69 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:46.648155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b3272b9b-a035-469d-a854-f9dfcc96eb69 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:46.649021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b3272b9b-a035-469d-a854-f9dfcc96eb69 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:46.649930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b3272b9b-a035-469d-a854-f9dfcc96eb69 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:46.650526 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b3272b9b-a035-469d-a854-f9dfcc96eb69 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:46.724129 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3d46ba93-2d65-4629-a094-d44aafc4757e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:46.734390 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3d46ba93-2d65-4629-a094-d44aafc4757e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78" status: 200 len: 1334 microversion: 2.1 time: 0.651858 Jul 19 22:38:46.735293 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1297/2628] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:46 2022] GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78 => generated 1334 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:46.739879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0b64b12a-5525-46b0-a541-66575a461bef tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:46.740364 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0b64b12a-5525-46b0-a541-66575a461bef tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:46.747771 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0b64b12a-5525-46b0-a541-66575a461bef tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:46.749027 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0b64b12a-5525-46b0-a541-66575a461bef tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:46.751671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0b64b12a-5525-46b0-a541-66575a461bef tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:46.752263 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0b64b12a-5525-46b0-a541-66575a461bef tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:46.796220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0b64b12a-5525-46b0-a541-66575a461bef tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:38:46.891989 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0b64b12a-5525-46b0-a541-66575a461bef tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 204 len: 0 microversion: 2.1 time: 0.155133 Jul 19 22:38:46.892878 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1298/2629] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:38:46 2022] DELETE /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:38:46.944335 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b3272b9b-a035-469d-a854-f9dfcc96eb69 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Acquired lock "refresh_cache-caf65365-ee09-4edc-87d7-e6111559ca2e" {{(pid=119338) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 22:38:47.129228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6eca1e03-8a2e-42b7-bc84-7a94bf738cf2 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-546982253", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:47.185868 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-6eca1e03-8a2e-42b7-bc84-7a94bf738cf2 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] validate_networks() for None {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:38:47.651794 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-6eca1e03-8a2e-42b7-bc84-7a94bf738cf2 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:38:47.652289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-6eca1e03-8a2e-42b7-bc84-7a94bf738cf2 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:38:47.652774 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-6eca1e03-8a2e-42b7-bc84-7a94bf738cf2 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:38:47.653183 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-6eca1e03-8a2e-42b7-bc84-7a94bf738cf2 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:38:47.653643 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-6eca1e03-8a2e-42b7-bc84-7a94bf738cf2 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:38:47.664417 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6eca1e03-8a2e-42b7-bc84-7a94bf738cf2 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:47.664942 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6eca1e03-8a2e-42b7-bc84-7a94bf738cf2 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:47.665783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6eca1e03-8a2e-42b7-bc84-7a94bf738cf2 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:47.666459 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6eca1e03-8a2e-42b7-bc84-7a94bf738cf2 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:47.690136 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-6eca1e03-8a2e-42b7-bc84-7a94bf738cf2 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Getting quotas for project 4fe347c5b18f487ab2fc6b6de7e959e4. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:38:47.695627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-6eca1e03-8a2e-42b7-bc84-7a94bf738cf2 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Getting quotas for user 746810a196b24e8884a9526580cdc2a2 and project 4fe347c5b18f487ab2fc6b6de7e959e4. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:38:47.711502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6eca1e03-8a2e-42b7-bc84-7a94bf738cf2 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:38:47.713882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6eca1e03-8a2e-42b7-bc84-7a94bf738cf2 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] [instance: 3b617584-f9bc-43a8-af3c-78546d0d9889] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:38:47.762752 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6eca1e03-8a2e-42b7-bc84-7a94bf738cf2 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.868696 Jul 19 22:38:47.769642 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1299/2630] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:38:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:38:47.772499 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0a680412-274a-4766-a048-d11ea0cb76f9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:47.773133 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0a680412-274a-4766-a048-d11ea0cb76f9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9c365853-9c4b-45db-97c8-26d0f6e797bd] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:47.781948 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a680412-274a-4766-a048-d11ea0cb76f9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:47.782406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a680412-274a-4766-a048-d11ea0cb76f9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:47.783277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a680412-274a-4766-a048-d11ea0cb76f9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:47.783725 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a680412-274a-4766-a048-d11ea0cb76f9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:48.143432 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0a680412-274a-4766-a048-d11ea0cb76f9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:48.159430 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0a680412-274a-4766-a048-d11ea0cb76f9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd" status: 200 len: 1315 microversion: 2.1 time: 0.393947 Jul 19 22:38:48.161159 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1300/2631] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:47 2022] GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:48.167932 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fcfcd6a6-0e45-49fa-8f41-96518a6a073a tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a155ebee0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:48.256959 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fcfcd6a6-0e45-49fa-8f41-96518a6a073a tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b1a4c605-7ea8-4ce0-9728-b7e1c746ec9f" status: 200 len: 1464 microversion: 2.1 time: 0.094197 Jul 19 22:38:48.258330 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1301/2632] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:38:48 2022] GET /compute/v2.1/images/b1a4c605-7ea8-4ce0-9728-b7e1c746ec9f => generated 1464 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:48.271224 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-20dbe724-b66b-4af0-af88-41e14e064e1e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-189939639", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "a64f0a57-5630-4e13-b241-c604d3323992"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:48.356782 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-b3272b9b-a035-469d-a854-f9dfcc96eb69 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Building network info cache for instance {{(pid=119338) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 22:38:48.371369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-20dbe724-b66b-4af0-af88-41e14e064e1e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] validate_networks() for [('a64f0a57-5630-4e13-b241-c604d3323992', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:38:50.018641 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-20dbe724-b66b-4af0-af88-41e14e064e1e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:38:50.020014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-20dbe724-b66b-4af0-af88-41e14e064e1e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:38:50.020014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-20dbe724-b66b-4af0-af88-41e14e064e1e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:38:50.020014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-20dbe724-b66b-4af0-af88-41e14e064e1e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:38:50.020389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-20dbe724-b66b-4af0-af88-41e14e064e1e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:38:50.031605 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-20dbe724-b66b-4af0-af88-41e14e064e1e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:50.032523 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-20dbe724-b66b-4af0-af88-41e14e064e1e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:50.033553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-20dbe724-b66b-4af0-af88-41e14e064e1e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:50.034198 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-20dbe724-b66b-4af0-af88-41e14e064e1e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:50.059664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-20dbe724-b66b-4af0-af88-41e14e064e1e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Getting quotas for project 6dced22c1fb648bea264ba11fa53884f. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:38:50.069682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-20dbe724-b66b-4af0-af88-41e14e064e1e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Getting quotas for user b22a4202c81a43de895f85ffe1ce00cb and project 6dced22c1fb648bea264ba11fa53884f. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:38:50.093967 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-20dbe724-b66b-4af0-af88-41e14e064e1e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:38:50.098139 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-20dbe724-b66b-4af0-af88-41e14e064e1e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:38:50.197632 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-20dbe724-b66b-4af0-af88-41e14e064e1e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.937198 Jul 19 22:38:50.203650 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1302/2633] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:38:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:38:50.205378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-83ac3dac-19ff-489c-a553-7883dfe0e7c9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:50.206122 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-83ac3dac-19ff-489c-a553-7883dfe0e7c9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 8f51c52b-0d6b-40bd-9b31-ad0a91304d78] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:50.215690 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-83ac3dac-19ff-489c-a553-7883dfe0e7c9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:50.217150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-83ac3dac-19ff-489c-a553-7883dfe0e7c9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:50.217705 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-83ac3dac-19ff-489c-a553-7883dfe0e7c9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:50.218178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-83ac3dac-19ff-489c-a553-7883dfe0e7c9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:50.315061 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-b3272b9b-a035-469d-a854-f9dfcc96eb69 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Updating instance_info_cache with network_info: [{"id": "3d5f4107-f97a-4ed8-ad9b-376b9b2e9563", "address": "fa:16:3e:14:ce:22", "network": {"id": "0c4e10b3-9ece-4e7a-b6a5-7a85afc8792f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1161400161-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ef7242ed05524293b5dae6a33e520cfc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3d5f4107-f9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119338) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 22:38:50.334575 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b3272b9b-a035-469d-a854-f9dfcc96eb69 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Releasing lock "refresh_cache-caf65365-ee09-4edc-87d7-e6111559ca2e" {{(pid=119338) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 22:38:50.338538 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b3272b9b-a035-469d-a854-f9dfcc96eb69 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "POST /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e/action" status: 202 len: 0 microversion: 2.1 time: 4.324563 Jul 19 22:38:50.346849 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1332/2634] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:38:46 2022] POST /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e/action => generated 0 bytes in 4335 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 19 22:38:50.356834 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9b649719-689b-4252-a3c5-019a90f767d9 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:50.358985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9b649719-689b-4252-a3c5-019a90f767d9 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] [instance: 3b617584-f9bc-43a8-af3c-78546d0d9889] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:50.369947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:38:50.374166 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b649719-689b-4252-a3c5-019a90f767d9 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:50.375311 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b649719-689b-4252-a3c5-019a90f767d9 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:50.376904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b649719-689b-4252-a3c5-019a90f767d9 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:50.378077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b649719-689b-4252-a3c5-019a90f767d9 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:50.518602 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-83ac3dac-19ff-489c-a553-7883dfe0e7c9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:50.541544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=75,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:38:50.547227 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9b649719-689b-4252-a3c5-019a90f767d9 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746810a196b24e8884a9526580cdc2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe347c5b18f487ab2fc6b6de7e959e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:50.557350 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-83ac3dac-19ff-489c-a553-7883dfe0e7c9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78" status: 200 len: 1334 microversion: 2.1 time: 0.357262 Jul 19 22:38:50.560174 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1303/2635] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:50 2022] GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78 => generated 1334 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:50.564769 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9b649719-689b-4252-a3c5-019a90f767d9 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889" status: 200 len: 1274 microversion: 2.1 time: 0.214976 Jul 19 22:38:50.574216 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1333/2636] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:50 2022] GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889 => generated 1274 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:50.577754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-929f1c28-efe9-4871-8781-4cee39c16782 req-64564d7d-be8e-4b6c-a328-365382205888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f51c52b-0d6b-40bd-9b31-ad0a91304d78", "tag": "1abdc581-adbd-4c5f-bdbd-8bfed514d4b0"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:50.592949 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8905cfda-6aa8-403a-b9a9-418ba6449e30 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a15571790>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:50.602478 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-929f1c28-efe9-4871-8781-4cee39c16782 req-64564d7d-be8e-4b6c-a328-365382205888 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:50.604093 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-929f1c28-efe9-4871-8781-4cee39c16782 req-64564d7d-be8e-4b6c-a328-365382205888 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:50.628675 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-929f1c28-efe9-4871-8781-4cee39c16782 req-64564d7d-be8e-4b6c-a328-365382205888 service nova] Creating event network-changed:1abdc581-adbd-4c5f-bdbd-8bfed514d4b0 for instance 8f51c52b-0d6b-40bd-9b31-ad0a91304d78 on n-h1-847009-3 Jul 19 22:38:50.638086 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-929f1c28-efe9-4871-8781-4cee39c16782 req-64564d7d-be8e-4b6c-a328-365382205888 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073614 Jul 19 22:38:50.640518 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1304/2637] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:50.647008 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5bee108a-f359-4f59-a97d-466b547aa1ef tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:50.648216 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5bee108a-f359-4f59-a97d-466b547aa1ef tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:50.654813 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8905cfda-6aa8-403a-b9a9-418ba6449e30 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/b1a4c605-7ea8-4ce0-9728-b7e1c746ec9f" status: 200 len: 1464 microversion: 2.1 time: 0.078533 Jul 19 22:38:50.656199 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1334/2638] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:38:50 2022] GET /compute/v2.1/images/b1a4c605-7ea8-4ce0-9728-b7e1c746ec9f => generated 1464 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:50.661743 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-44b0160d-c7af-4f1a-b644-e7622c85f619 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:50.663854 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-44b0160d-c7af-4f1a-b644-e7622c85f619 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9c365853-9c4b-45db-97c8-26d0f6e797bd] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:50.664280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5bee108a-f359-4f59-a97d-466b547aa1ef tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:50.665041 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5bee108a-f359-4f59-a97d-466b547aa1ef tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:50.666194 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5bee108a-f359-4f59-a97d-466b547aa1ef tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:50.666841 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5bee108a-f359-4f59-a97d-466b547aa1ef tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:50.671784 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44b0160d-c7af-4f1a-b644-e7622c85f619 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:50.672328 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44b0160d-c7af-4f1a-b644-e7622c85f619 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:50.673238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44b0160d-c7af-4f1a-b644-e7622c85f619 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:50.675212 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44b0160d-c7af-4f1a-b644-e7622c85f619 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:51.012309 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5bee108a-f359-4f59-a97d-466b547aa1ef tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:51.020408 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5bee108a-f359-4f59-a97d-466b547aa1ef tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.378591 Jul 19 22:38:51.032382 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1305/2639] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:50 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:51.037735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-edebba8a-8163-43a1-929e-3f4af8a95601 req-a1268d04-c39d-4b1c-91b3-7122947fb834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f0e6a34-7136-4af6-b710-1b4c0ef0c97a", "name": "network-vif-deleted", "tag": "643e30b9-db43-4c54-82b7-713417e3c041"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:51.047698 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-edebba8a-8163-43a1-929e-3f4af8a95601 req-a1268d04-c39d-4b1c-91b3-7122947fb834 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:51.048592 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-edebba8a-8163-43a1-929e-3f4af8a95601 req-a1268d04-c39d-4b1c-91b3-7122947fb834 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:51.060995 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-edebba8a-8163-43a1-929e-3f4af8a95601 req-a1268d04-c39d-4b1c-91b3-7122947fb834 service nova] Creating event network-vif-deleted:643e30b9-db43-4c54-82b7-713417e3c041 for instance 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a on n-h2-847009-3 Jul 19 22:38:51.065362 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-44b0160d-c7af-4f1a-b644-e7622c85f619 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:51.076179 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-44b0160d-c7af-4f1a-b644-e7622c85f619 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd" status: 200 len: 1502 microversion: 2.1 time: 0.418552 Jul 19 22:38:51.077350 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1335/2640] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:50 2022] GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd => generated 1502 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:51.080600 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-edebba8a-8163-43a1-929e-3f4af8a95601 req-a1268d04-c39d-4b1c-91b3-7122947fb834 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046418 Jul 19 22:38:51.083650 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1306/2641] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:51.089379 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0d5f55a1-2b43-4c1f-bb52-ef4ef0bae0c0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:51.090370 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0d5f55a1-2b43-4c1f-bb52-ef4ef0bae0c0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:51.094939 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-096f809f-0782-40e0-a8e8-b92641b60d2b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:51.100030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-096f809f-0782-40e0-a8e8-b92641b60d2b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: 3e15d03f-3614-4eba-bf41-a0c059b15d56] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:51.103525 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d5f55a1-2b43-4c1f-bb52-ef4ef0bae0c0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:51.107002 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d5f55a1-2b43-4c1f-bb52-ef4ef0bae0c0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:51.109791 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d5f55a1-2b43-4c1f-bb52-ef4ef0bae0c0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:51.112589 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-096f809f-0782-40e0-a8e8-b92641b60d2b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:51.113173 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d5f55a1-2b43-4c1f-bb52-ef4ef0bae0c0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:51.118215 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-096f809f-0782-40e0-a8e8-b92641b60d2b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:51.119608 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-096f809f-0782-40e0-a8e8-b92641b60d2b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:51.120314 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-096f809f-0782-40e0-a8e8-b92641b60d2b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:51.147975 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-096f809f-0782-40e0-a8e8-b92641b60d2b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] HTTP exception thrown: Instance 3e15d03f-3614-4eba-bf41-a0c059b15d56 could not be found. Jul 19 22:38:51.150118 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-096f809f-0782-40e0-a8e8-b92641b60d2b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Request method failure captured: Jul 19 22:38:51.150118 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56 HTTP/1.1 Jul 19 22:38:51.150118 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:38:51.150118 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:38:51.150118 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:38:51.150118 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:38:51.150118 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:38:51.150118 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:38:51.150118 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:38:51.150118 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:38:51.150118 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zH89DNXCIQWv41yHAvGRXSNtFbm6pSJ5huYNyBU6eJ9WJdlQUHFO2gtCgyRi0Ry5MiOLhV18p5AG56_t0NEtd10n3dYDM-qrros2fcMDDL4A-Y8bS8dOpf5mPSuTR33nFcO0B7-3Xg1vopdTWvSM6sz19ASnxkjWNJQcLZPyESzOqY Jul 19 22:38:51.150118 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:38:51.150118 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:38:51.150118 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:38:51.150118 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:38:51.150118 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:38:51.150118 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:38:51.150118 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: ef7242ed05524293b5dae6a33e520cfc Jul 19 22:38:51.150118 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1371103150 Jul 19 22:38:51.150118 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:38:51.150118 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:38:51.151831 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ef7242ed05524293b5dae6a33e520cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef7242ed05524293b5dae6a33e520cfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ef7242ed05524293b5dae6a33e520cfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef7242ed05524293b5dae6a33e520cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:38:51.151831 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1371103150 Jul 19 22:38:51.151831 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: ef7242ed05524293b5dae6a33e520cfc Jul 19 22:38:51.151831 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1371103150 Jul 19 22:38:51.151831 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-FloatingIPsAssociationTestJSON-1371103150-project Jul 19 22:38:51.151831 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:38:51.151831 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:38:51.151831 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: b6ece721a99a4080a059c635b23761e4 Jul 19 22:38:51.151831 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1371103150-project Jul 19 22:38:51.151831 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:38:51.151831 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 3e15d03f-3614-4eba-bf41-a0c059b15d56 could not be found. Jul 19 22:38:51.151831 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '3e15d03f-3614-4eba-bf41-a0c059b15d56'} Jul 19 22:38:51.152690 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:38:51.152690 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:38:51.152690 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:38:51.152690 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:38:51.152690 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:38:51.152690 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:38:51.152690 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:38:51.152690 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:38:51.152690 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:38:51.152690 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:38:51.152690 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e15d03f-3614-4eba-bf41-a0c059b15d56 could not be found. Jul 19 22:38:51.152690 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:38:51.152690 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:38:51.152690 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:38:51.152690 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:38:51.152690 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:38:51.152690 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:38:51.152690 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:38:51.152690 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:38:51.152690 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:38:51.154425 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:38:51.154425 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:38:51.154425 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:38:51.154425 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:38:51.154425 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:38:51.154425 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:38:51.154425 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:38:51.154425 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:38:51.154425 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:38:51.154425 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e15d03f-3614-4eba-bf41-a0c059b15d56 could not be found. Jul 19 22:38:51.154425 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:38:51.154425 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:38:51.154425 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:38:51.154425 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:38:51.154425 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:38:51.154425 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:38:51.154425 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:38:51.154425 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:38:51.154425 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e15d03f-3614-4eba-bf41-a0c059b15d56 could not be found. Jul 19 22:38:51.154425 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:38:51.156210 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-096f809f-0782-40e0-a8e8-b92641b60d2b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Returning 404 to user: Instance 3e15d03f-3614-4eba-bf41-a0c059b15d56 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:38:51.156210 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-096f809f-0782-40e0-a8e8-b92641b60d2b tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56" status: 404 len: 111 microversion: 2.1 time: 0.067830 Jul 19 22:38:51.157903 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1307/2642] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:38:51 2022] DELETE /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:38:51.162701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1d2209ad-6e78-44a3-8538-d03ff16e02ea tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:51.163461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1d2209ad-6e78-44a3-8538-d03ff16e02ea tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: bf0396df-c757-4ec7-9697-e71026a34525] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:51.170392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d2209ad-6e78-44a3-8538-d03ff16e02ea tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:51.171233 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d2209ad-6e78-44a3-8538-d03ff16e02ea tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:51.172593 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d2209ad-6e78-44a3-8538-d03ff16e02ea tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:51.172593 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d2209ad-6e78-44a3-8538-d03ff16e02ea tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:51.292240 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0d5f55a1-2b43-4c1f-bb52-ef4ef0bae0c0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:51.304687 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0d5f55a1-2b43-4c1f-bb52-ef4ef0bae0c0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1213 microversion: 2.1 time: 0.225997 Jul 19 22:38:51.305305 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1336/2643] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:51 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1213 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:51.310157 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b4ea4126-aafe-48d0-a41e-cfbb86fb4f61 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:51.311088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b4ea4126-aafe-48d0-a41e-cfbb86fb4f61 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:51.318495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b4ea4126-aafe-48d0-a41e-cfbb86fb4f61 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:51.319211 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b4ea4126-aafe-48d0-a41e-cfbb86fb4f61 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:51.320394 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b4ea4126-aafe-48d0-a41e-cfbb86fb4f61 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:51.320866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b4ea4126-aafe-48d0-a41e-cfbb86fb4f61 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:51.562398 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1d2209ad-6e78-44a3-8538-d03ff16e02ea tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdcb86f99184c839022f5f19d730e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '994ee0e2b71b4eff88a19b70351ada06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:51.573511 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1d2209ad-6e78-44a3-8538-d03ff16e02ea tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/bf0396df-c757-4ec7-9697-e71026a34525" status: 200 len: 1466 microversion: 2.1 time: 0.414417 Jul 19 22:38:51.574288 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1308/2644] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:51 2022] GET /compute/v2.1/servers/bf0396df-c757-4ec7-9697-e71026a34525 => generated 1466 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:51.588760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b41c8752-9a9c-4076-93de-f04d9efa0357 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:51.589849 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b41c8752-9a9c-4076-93de-f04d9efa0357 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9c365853-9c4b-45db-97c8-26d0f6e797bd] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:51.611392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b41c8752-9a9c-4076-93de-f04d9efa0357 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:51.611973 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b41c8752-9a9c-4076-93de-f04d9efa0357 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:51.612838 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b41c8752-9a9c-4076-93de-f04d9efa0357 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:51.613330 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b41c8752-9a9c-4076-93de-f04d9efa0357 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:51.656612 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b41c8752-9a9c-4076-93de-f04d9efa0357 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9c365853-9c4b-45db-97c8-26d0f6e797bd] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:38:51.708347 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b4ea4126-aafe-48d0-a41e-cfbb86fb4f61 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:51.721855 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b4ea4126-aafe-48d0-a41e-cfbb86fb4f61 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.414277 Jul 19 22:38:51.734349 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1337/2645] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:51 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:51.736853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-07c46f5b-5488-413f-81d4-532528b4275e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:51.737645 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-07c46f5b-5488-413f-81d4-532528b4275e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: 3e15d03f-3614-4eba-bf41-a0c059b15d56] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:51.750230 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07c46f5b-5488-413f-81d4-532528b4275e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:51.750786 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07c46f5b-5488-413f-81d4-532528b4275e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:51.751875 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07c46f5b-5488-413f-81d4-532528b4275e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:51.752828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07c46f5b-5488-413f-81d4-532528b4275e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:51.808885 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-07c46f5b-5488-413f-81d4-532528b4275e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] HTTP exception thrown: Instance 3e15d03f-3614-4eba-bf41-a0c059b15d56 could not be found. Jul 19 22:38:51.815766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-07c46f5b-5488-413f-81d4-532528b4275e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Request method failure captured: Jul 19 22:38:51.815766 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56 HTTP/1.1 Jul 19 22:38:51.815766 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:38:51.815766 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:38:51.815766 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:38:51.815766 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:38:51.815766 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:38:51.815766 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:38:51.815766 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:38:51.815766 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:38:51.815766 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zH89DNXCIQWv41yHAvGRXSNtFbm6pSJ5huYNyBU6eJ9WJdlQUHFO2gtCgyRi0Ry5MiOLhV18p5AG56_t0NEtd10n3dYDM-qrros2fcMDDL4A-Y8bS8dOpf5mPSuTR33nFcO0B7-3Xg1vopdTWvSM6sz19ASnxkjWNJQcLZPyESzOqY Jul 19 22:38:51.815766 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:38:51.815766 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:38:51.815766 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:38:51.815766 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:38:51.815766 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:38:51.815766 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:38:51.815766 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: ef7242ed05524293b5dae6a33e520cfc Jul 19 22:38:51.815766 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1371103150 Jul 19 22:38:51.815766 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:38:51.815766 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:38:51.817211 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ef7242ed05524293b5dae6a33e520cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef7242ed05524293b5dae6a33e520cfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ef7242ed05524293b5dae6a33e520cfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef7242ed05524293b5dae6a33e520cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:38:51.817211 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1371103150 Jul 19 22:38:51.817211 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: ef7242ed05524293b5dae6a33e520cfc Jul 19 22:38:51.817211 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1371103150 Jul 19 22:38:51.817211 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-FloatingIPsAssociationTestJSON-1371103150-project Jul 19 22:38:51.817211 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:38:51.817211 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:38:51.817211 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: b6ece721a99a4080a059c635b23761e4 Jul 19 22:38:51.817211 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1371103150-project Jul 19 22:38:51.817211 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:38:51.817211 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 3e15d03f-3614-4eba-bf41-a0c059b15d56 could not be found. Jul 19 22:38:51.817211 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '3e15d03f-3614-4eba-bf41-a0c059b15d56'} Jul 19 22:38:51.817911 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:38:51.817911 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:38:51.817911 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:38:51.817911 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:38:51.817911 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:38:51.817911 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:38:51.817911 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:38:51.817911 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:38:51.817911 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:38:51.817911 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:38:51.817911 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e15d03f-3614-4eba-bf41-a0c059b15d56 could not be found. Jul 19 22:38:51.817911 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:51.817911 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:38:51.817911 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:51.817911 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:38:51.817911 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:38:51.817911 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:38:51.817911 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:38:51.817911 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:38:51.817911 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:38:51.819595 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:38:51.819595 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:38:51.819595 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:38:51.819595 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:38:51.819595 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:38:51.819595 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:38:51.819595 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:38:51.819595 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e15d03f-3614-4eba-bf41-a0c059b15d56 could not be found. Jul 19 22:38:51.819595 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:51.819595 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:38:51.819595 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:51.819595 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:38:51.819595 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:38:51.819595 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:38:51.819595 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:38:51.819595 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:38:51.819595 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e15d03f-3614-4eba-bf41-a0c059b15d56 could not be found. Jul 19 22:38:51.819595 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:51.821320 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-07c46f5b-5488-413f-81d4-532528b4275e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Returning 404 to user: Instance 3e15d03f-3614-4eba-bf41-a0c059b15d56 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:38:51.821320 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-07c46f5b-5488-413f-81d4-532528b4275e tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56" status: 404 len: 111 microversion: 2.1 time: 0.088245 Jul 19 22:38:51.821320 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1338/2646] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:51 2022] GET /compute/v2.1/servers/3e15d03f-3614-4eba-bf41-a0c059b15d56 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:38:51.831783 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3874391a-76c3-4b95-ac28-ecf132c1bb88 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:51.832385 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b41c8752-9a9c-4076-93de-f04d9efa0357 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd" status: 204 len: 0 microversion: 2.1 time: 0.255819 Jul 19 22:38:51.832722 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3874391a-76c3-4b95-ac28-ecf132c1bb88 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 8f51c52b-0d6b-40bd-9b31-ad0a91304d78] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:51.833409 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1309/2647] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:38:51 2022] DELETE /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:38:51.843683 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3874391a-76c3-4b95-ac28-ecf132c1bb88 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:51.844149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3874391a-76c3-4b95-ac28-ecf132c1bb88 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:51.844946 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3874391a-76c3-4b95-ac28-ecf132c1bb88 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:51.845268 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bd451f37-8811-4171-996f-453001591923 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a155aaee0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:51.845437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3874391a-76c3-4b95-ac28-ecf132c1bb88 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:51.848400 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:38:52.045543 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bd451f37-8811-4171-996f-453001591923 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images?changes-since=2022-07-19T22%3A36%3A28Z" status: 200 len: 1904 microversion: 2.1 time: 0.206517 Jul 19 22:38:52.047541 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1310/2648] 10.222.0.25 () {58 vars in 1198 bytes} [Tue Jul 19 22:38:51 2022] GET /compute/v2.1/images?changes-since=2022-07-19T22%3A36%3A28Z => generated 1904 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:52.053558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9d2eec0e-d613-44e8-960f-e775f73a9cb3 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:52.054835 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9d2eec0e-d613-44e8-960f-e775f73a9cb3 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] [instance: 3b617584-f9bc-43a8-af3c-78546d0d9889] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:52.090941 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d2eec0e-d613-44e8-960f-e775f73a9cb3 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:52.091811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d2eec0e-d613-44e8-960f-e775f73a9cb3 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:52.093255 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d2eec0e-d613-44e8-960f-e775f73a9cb3 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:52.094006 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d2eec0e-d613-44e8-960f-e775f73a9cb3 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:52.257727 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3874391a-76c3-4b95-ac28-ecf132c1bb88 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:52.266995 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3874391a-76c3-4b95-ac28-ecf132c1bb88 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78" status: 200 len: 1334 microversion: 2.1 time: 0.448044 Jul 19 22:38:52.268099 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1339/2649] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:51 2022] GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78 => generated 1334 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:52.274289 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7dc154f8-ea8c-420c-a9a5-64991f8b9ea4 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:52.275647 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7dc154f8-ea8c-420c-a9a5-64991f8b9ea4 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:52.283663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7dc154f8-ea8c-420c-a9a5-64991f8b9ea4 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:52.284310 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7dc154f8-ea8c-420c-a9a5-64991f8b9ea4 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:52.285384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7dc154f8-ea8c-420c-a9a5-64991f8b9ea4 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:52.285987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7dc154f8-ea8c-420c-a9a5-64991f8b9ea4 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:52.436297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9d2eec0e-d613-44e8-960f-e775f73a9cb3 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746810a196b24e8884a9526580cdc2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe347c5b18f487ab2fc6b6de7e959e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:52.444080 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9d2eec0e-d613-44e8-960f-e775f73a9cb3 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889" status: 200 len: 1316 microversion: 2.1 time: 0.394824 Jul 19 22:38:52.444759 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1311/2650] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:52 2022] GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889 => generated 1316 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:52.450472 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c07a5530-886d-410d-be4c-413bced6f153 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '.version_select at 0x7f7a103530d0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:52.710045 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7dc154f8-ea8c-420c-a9a5-64991f8b9ea4 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:52.717933 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7dc154f8-ea8c-420c-a9a5-64991f8b9ea4 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.448103 Jul 19 22:38:52.718707 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1340/2651] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:52 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:52.723945 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-72c1f52d-f839-418b-99d5-6f83aa08128a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:52.724736 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-72c1f52d-f839-418b-99d5-6f83aa08128a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9c365853-9c4b-45db-97c8-26d0f6e797bd] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:52.731622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-72c1f52d-f839-418b-99d5-6f83aa08128a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:52.732812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-72c1f52d-f839-418b-99d5-6f83aa08128a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:52.733855 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-72c1f52d-f839-418b-99d5-6f83aa08128a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:52.734452 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-72c1f52d-f839-418b-99d5-6f83aa08128a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:53.626604 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-72c1f52d-f839-418b-99d5-6f83aa08128a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:53.639942 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-72c1f52d-f839-418b-99d5-6f83aa08128a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd" status: 200 len: 1508 microversion: 2.1 time: 0.919865 Jul 19 22:38:53.645247 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1341/2652] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:52 2022] GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd => generated 1508 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:53.658782 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bcc488c7-3ed3-4f9c-a7bc-d7a8b3ea848d tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a038144c0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:53.796356 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bcc488c7-3ed3-4f9c-a7bc-d7a8b3ea848d tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-67535250" status: 200 len: 483 microversion: 2.1 time: 0.148408 Jul 19 22:38:53.800277 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1342/2653] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Jul 19 22:38:53 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-67535250 => generated 483 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:53.811278 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-548509f9-41fc-44ae-ae32-27ed0359f04e req-3fd8590a-ef54-4cef-9ab4-6df18797a943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf0396df-c757-4ec7-9697-e71026a34525", "name": "network-vif-unplugged", "status": "completed", "tag": "80ac4ef8-2707-46cd-8487-6e07db74d986"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:53.826854 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-548509f9-41fc-44ae-ae32-27ed0359f04e req-3fd8590a-ef54-4cef-9ab4-6df18797a943 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:53.827150 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-548509f9-41fc-44ae-ae32-27ed0359f04e req-3fd8590a-ef54-4cef-9ab4-6df18797a943 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:53.843743 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-548509f9-41fc-44ae-ae32-27ed0359f04e req-3fd8590a-ef54-4cef-9ab4-6df18797a943 service nova] Creating event network-vif-unplugged:80ac4ef8-2707-46cd-8487-6e07db74d986 for instance bf0396df-c757-4ec7-9697-e71026a34525 on n-h1-847009-3 Jul 19 22:38:53.859301 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-548509f9-41fc-44ae-ae32-27ed0359f04e req-3fd8590a-ef54-4cef-9ab4-6df18797a943 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057647 Jul 19 22:38:53.860820 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1343/2654] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:53.867242 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e1b7d6a2-9116-4a17-bed5-622799f9942c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:53.868461 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e1b7d6a2-9116-4a17-bed5-622799f9942c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:53.881325 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1b7d6a2-9116-4a17-bed5-622799f9942c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:53.882618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1b7d6a2-9116-4a17-bed5-622799f9942c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:53.884597 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1b7d6a2-9116-4a17-bed5-622799f9942c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:53.885862 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1b7d6a2-9116-4a17-bed5-622799f9942c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:54.471383 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e1b7d6a2-9116-4a17-bed5-622799f9942c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:54.486385 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e1b7d6a2-9116-4a17-bed5-622799f9942c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1317 microversion: 2.1 time: 0.623424 Jul 19 22:38:54.487639 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1344/2655] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:53 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1317 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:54.497590 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bd51fa20-096d-4e9d-b59f-6e0711648fe6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1210067229"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:54.502300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bd51fa20-096d-4e9d-b59f-6e0711648fe6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:54.512026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bd51fa20-096d-4e9d-b59f-6e0711648fe6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:54.512506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bd51fa20-096d-4e9d-b59f-6e0711648fe6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:54.513324 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bd51fa20-096d-4e9d-b59f-6e0711648fe6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:54.515303 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bd51fa20-096d-4e9d-b59f-6e0711648fe6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:54.882433 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bd51fa20-096d-4e9d-b59f-6e0711648fe6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action" status: 202 len: 0 microversion: 2.1 time: 0.393328 Jul 19 22:38:54.883985 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1345/2656] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:38:54 2022] POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 19 22:38:54.918790 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-3722bd95-a20e-4091-87d2-1ff49a623361 req-b8780f36-6f26-45dd-b09d-179af81455bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caf65365-ee09-4edc-87d7-e6111559ca2e", "tag": "3d5f4107-f97a-4ed8-ad9b-376b9b2e9563"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:54.966597 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-3722bd95-a20e-4091-87d2-1ff49a623361 req-b8780f36-6f26-45dd-b09d-179af81455bc service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:54.967929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-3722bd95-a20e-4091-87d2-1ff49a623361 req-b8780f36-6f26-45dd-b09d-179af81455bc service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:54.983454 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-3722bd95-a20e-4091-87d2-1ff49a623361 req-b8780f36-6f26-45dd-b09d-179af81455bc service nova] Creating event network-changed:3d5f4107-f97a-4ed8-ad9b-376b9b2e9563 for instance caf65365-ee09-4edc-87d7-e6111559ca2e on n-h1-847009-3 Jul 19 22:38:54.991420 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-3722bd95-a20e-4091-87d2-1ff49a623361 req-b8780f36-6f26-45dd-b09d-179af81455bc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105127 Jul 19 22:38:54.992578 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1346/2657] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:55.005494 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-81861994-cec6-4f96-9907-35041de2c767 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:55.006497 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-81861994-cec6-4f96-9907-35041de2c767 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 8f51c52b-0d6b-40bd-9b31-ad0a91304d78] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:55.020058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81861994-cec6-4f96-9907-35041de2c767 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:55.020787 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81861994-cec6-4f96-9907-35041de2c767 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:55.022845 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81861994-cec6-4f96-9907-35041de2c767 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:55.023663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81861994-cec6-4f96-9907-35041de2c767 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:55.350755 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c07a5530-886d-410d-be4c-413bced6f153 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/602c40bf-d2f0-48d7-b0c6-46768196d970" status: 202 len: 0 microversion: 2.1 time: 2.904279 Jul 19 22:38:55.354995 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1312/2658] 10.222.0.25 () {58 vars in 1262 bytes} [Tue Jul 19 22:38:52 2022] DELETE /compute/v2.1/os-floating-ips/602c40bf-d2f0-48d7-b0c6-46768196d970 => generated 0 bytes in 2907 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:38:55.358557 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9eb1dd87-47bb-4043-8822-9c28d1ae3cd0 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:55.359894 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9eb1dd87-47bb-4043-8822-9c28d1ae3cd0 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] [instance: 3b617584-f9bc-43a8-af3c-78546d0d9889] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:55.378893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9eb1dd87-47bb-4043-8822-9c28d1ae3cd0 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:55.379422 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9eb1dd87-47bb-4043-8822-9c28d1ae3cd0 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:55.380230 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9eb1dd87-47bb-4043-8822-9c28d1ae3cd0 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:55.380737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9eb1dd87-47bb-4043-8822-9c28d1ae3cd0 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:55.438328 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-81861994-cec6-4f96-9907-35041de2c767 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:55.446992 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-81861994-cec6-4f96-9907-35041de2c767 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78" status: 200 len: 1334 microversion: 2.1 time: 0.452820 Jul 19 22:38:55.447657 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1347/2659] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:54 2022] GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78 => generated 1334 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:55.453136 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-16488e17-4354-424b-a841-f42c823febec tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a102a79d0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:55.551859 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-16488e17-4354-424b-a841-f42c823febec tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images?server=bf0396df-c757-4ec7-9697-e71026a34525" status: 200 len: 958 microversion: 2.1 time: 0.103071 Jul 19 22:38:55.552450 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1348/2660] 10.222.0.25 () {58 vars in 1208 bytes} [Tue Jul 19 22:38:55 2022] GET /compute/v2.1/images?server=bf0396df-c757-4ec7-9697-e71026a34525 => generated 958 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:55.553166 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9eb1dd87-47bb-4043-8822-9c28d1ae3cd0 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746810a196b24e8884a9526580cdc2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe347c5b18f487ab2fc6b6de7e959e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:55.557191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-22ecf9da-4b00-407b-8b12-78d8389ef791 req-a6d4e170-8e0a-42ac-a3ff-fc54c2abd398 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7c28d6e-5bfc-4b93-ab76-85ab7d401744", "tag": "fca80e58-e0cd-4282-b725-470915412593"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:55.563514 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9eb1dd87-47bb-4043-8822-9c28d1ae3cd0 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889" status: 200 len: 1316 microversion: 2.1 time: 0.209781 Jul 19 22:38:55.564227 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1313/2661] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:55 2022] GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889 => generated 1316 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:55.567885 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-22ecf9da-4b00-407b-8b12-78d8389ef791 req-a6d4e170-8e0a-42ac-a3ff-fc54c2abd398 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:55.569939 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-22ecf9da-4b00-407b-8b12-78d8389ef791 req-a6d4e170-8e0a-42ac-a3ff-fc54c2abd398 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:55.572164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-873e3d79-464c-403a-a314-5971f53d1290 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:55.572164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-873e3d79-464c-403a-a314-5971f53d1290 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:55.581461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-873e3d79-464c-403a-a314-5971f53d1290 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:55.581461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-873e3d79-464c-403a-a314-5971f53d1290 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:55.581461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-873e3d79-464c-403a-a314-5971f53d1290 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:55.581889 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-873e3d79-464c-403a-a314-5971f53d1290 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:55.582513 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-22ecf9da-4b00-407b-8b12-78d8389ef791 req-a6d4e170-8e0a-42ac-a3ff-fc54c2abd398 service nova] Creating event network-changed:fca80e58-e0cd-4282-b725-470915412593 for instance a7c28d6e-5bfc-4b93-ab76-85ab7d401744 on n-h2-847009-3 Jul 19 22:38:55.588068 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-22ecf9da-4b00-407b-8b12-78d8389ef791 req-a6d4e170-8e0a-42ac-a3ff-fc54c2abd398 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034265 Jul 19 22:38:55.588712 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1349/2662] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:55.594368 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-411e0018-70f9-4a3c-a64e-ba4c4e6a5fb7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:55.595089 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-411e0018-70f9-4a3c-a64e-ba4c4e6a5fb7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9c365853-9c4b-45db-97c8-26d0f6e797bd] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:55.602055 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-411e0018-70f9-4a3c-a64e-ba4c4e6a5fb7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:55.602593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-411e0018-70f9-4a3c-a64e-ba4c4e6a5fb7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:55.603671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-411e0018-70f9-4a3c-a64e-ba4c4e6a5fb7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:55.604090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-411e0018-70f9-4a3c-a64e-ba4c4e6a5fb7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:55.796622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-411e0018-70f9-4a3c-a64e-ba4c4e6a5fb7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:55.817003 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-411e0018-70f9-4a3c-a64e-ba4c4e6a5fb7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd" status: 200 len: 1300 microversion: 2.1 time: 0.226705 Jul 19 22:38:55.824335 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1350/2663] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:55 2022] GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd => generated 1300 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:55.835062 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6e651982-2b24-4923-a221-bf8c6bc020c6 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:55.844696 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6e651982-2b24-4923-a221-bf8c6bc020c6 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:55.856107 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e651982-2b24-4923-a221-bf8c6bc020c6 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:55.858245 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e651982-2b24-4923-a221-bf8c6bc020c6 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:55.859309 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e651982-2b24-4923-a221-bf8c6bc020c6 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:55.860095 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e651982-2b24-4923-a221-bf8c6bc020c6 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:55.917403 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6e651982-2b24-4923-a221-bf8c6bc020c6 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:38:56.079075 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6e651982-2b24-4923-a221-bf8c6bc020c6 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "DELETE /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e" status: 204 len: 0 microversion: 2.1 time: 0.252558 Jul 19 22:38:56.079702 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1351/2664] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:38:55 2022] DELETE /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:38:56.085205 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0d3b0832-ae50-40ac-99c5-182ee53222f5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:56.085921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0d3b0832-ae50-40ac-99c5-182ee53222f5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:56.094149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d3b0832-ae50-40ac-99c5-182ee53222f5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:56.094715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d3b0832-ae50-40ac-99c5-182ee53222f5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:56.095550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d3b0832-ae50-40ac-99c5-182ee53222f5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:56.095987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d3b0832-ae50-40ac-99c5-182ee53222f5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:56.203007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-873e3d79-464c-403a-a314-5971f53d1290 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:56.219555 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-873e3d79-464c-403a-a314-5971f53d1290 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:56.223010 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-873e3d79-464c-403a-a314-5971f53d1290 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:56.226203 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-873e3d79-464c-403a-a314-5971f53d1290 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 2946 microversion: 2.32 time: 0.660848 Jul 19 22:38:56.227462 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1314/2665] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:38:55 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 2946 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:38:56.234648 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d9445d9f-1c46-44aa-adc6-009f82dde9f2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a15613c10>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:56.363491 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d9445d9f-1c46-44aa-adc6-009f82dde9f2 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2F7a846129-bc22-4520-bd5b-d33fcd0a94a2" status: 200 len: 485 microversion: 2.1 time: 0.134459 Jul 19 22:38:56.365318 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1315/2666] 10.222.0.25 () {58 vars in 1316 bytes} [Tue Jul 19 22:38:56 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2F7a846129-bc22-4520-bd5b-d33fcd0a94a2 => generated 485 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:56.370757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e136eda0-3131-4ddb-9d8a-bf00b5d44f50 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:56.371889 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e136eda0-3131-4ddb-9d8a-bf00b5d44f50 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:56.381452 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e136eda0-3131-4ddb-9d8a-bf00b5d44f50 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:56.382228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e136eda0-3131-4ddb-9d8a-bf00b5d44f50 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:56.383387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e136eda0-3131-4ddb-9d8a-bf00b5d44f50 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:56.384328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e136eda0-3131-4ddb-9d8a-bf00b5d44f50 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:56.607953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0d3b0832-ae50-40ac-99c5-182ee53222f5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:56.620400 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0d3b0832-ae50-40ac-99c5-182ee53222f5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1317 microversion: 2.1 time: 0.539298 Jul 19 22:38:56.627486 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1352/2667] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:56 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1317 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:56.637319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ef9320ba-99e8-4fcb-ba66-f580437eda7b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:56.637985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ef9320ba-99e8-4fcb-ba66-f580437eda7b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:56.647332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ef9320ba-99e8-4fcb-ba66-f580437eda7b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:56.647831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ef9320ba-99e8-4fcb-ba66-f580437eda7b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:56.648761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ef9320ba-99e8-4fcb-ba66-f580437eda7b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:56.649452 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ef9320ba-99e8-4fcb-ba66-f580437eda7b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:56.798000 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e136eda0-3131-4ddb-9d8a-bf00b5d44f50 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ece721a99a4080a059c635b23761e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7242ed05524293b5dae6a33e520cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:56.810822 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e136eda0-3131-4ddb-9d8a-bf00b5d44f50 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e" status: 200 len: 1526 microversion: 2.1 time: 0.443674 Jul 19 22:38:56.811717 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1316/2668] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:56 2022] GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e => generated 1526 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:56.823332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-05a62aa2-a9ae-4062-b596-c65730093611 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a1563f1f0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:56.902074 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ef9320ba-99e8-4fcb-ba66-f580437eda7b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.269477 Jul 19 22:38:56.906952 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-05a62aa2-a9ae-4062-b596-c65730093611 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2F7a846129-bc22-4520-bd5b-d33fcd0a94a2" status: 200 len: 485 microversion: 2.1 time: 0.087162 Jul 19 22:38:56.913243 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1353/2669] 10.222.0.25 () {60 vars in 1315 bytes} [Tue Jul 19 22:38:56 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4/os-interface => generated 1831 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:38:56.920562 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1317/2670] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Jul 19 22:38:56 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2F7a846129-bc22-4520-bd5b-d33fcd0a94a2 => generated 485 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:56.932439 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-16944579-d575-4b2b-9966-45dfa8f0aaff tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:56.934134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-16944579-d575-4b2b-9966-45dfa8f0aaff tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] [instance: 3b617584-f9bc-43a8-af3c-78546d0d9889] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:56.948219 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-16944579-d575-4b2b-9966-45dfa8f0aaff tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:56.950371 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-16944579-d575-4b2b-9966-45dfa8f0aaff tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:56.954127 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-16944579-d575-4b2b-9966-45dfa8f0aaff tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:56.955428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-16944579-d575-4b2b-9966-45dfa8f0aaff tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:56.959071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c8844e7e-c47f-464b-81a3-677c8aa359fe tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:56.964719 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c8844e7e-c47f-464b-81a3-677c8aa359fe tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 8f51c52b-0d6b-40bd-9b31-ad0a91304d78] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:56.978958 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8844e7e-c47f-464b-81a3-677c8aa359fe tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:56.980755 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8844e7e-c47f-464b-81a3-677c8aa359fe tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:56.983412 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8844e7e-c47f-464b-81a3-677c8aa359fe tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:56.984274 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8844e7e-c47f-464b-81a3-677c8aa359fe tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:57.253119 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-16944579-d575-4b2b-9966-45dfa8f0aaff tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746810a196b24e8884a9526580cdc2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe347c5b18f487ab2fc6b6de7e959e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:57.258160 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c8844e7e-c47f-464b-81a3-677c8aa359fe tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:57.267447 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c8844e7e-c47f-464b-81a3-677c8aa359fe tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78" status: 200 len: 1334 microversion: 2.1 time: 0.338613 Jul 19 22:38:57.268086 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-16944579-d575-4b2b-9966-45dfa8f0aaff tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889" status: 200 len: 1316 microversion: 2.1 time: 0.344378 Jul 19 22:38:57.279489 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1354/2671] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:56 2022] GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78 => generated 1334 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:57.282609 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1318/2672] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:56 2022] GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889 => generated 1316 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:57.290829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b93cc43b-e7aa-4484-bbe3-937fa232f0eb tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:57.291822 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b93cc43b-e7aa-4484-bbe3-937fa232f0eb tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9c365853-9c4b-45db-97c8-26d0f6e797bd] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:57.303847 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b93cc43b-e7aa-4484-bbe3-937fa232f0eb tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:57.305045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b93cc43b-e7aa-4484-bbe3-937fa232f0eb tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:57.306106 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-4049a948-0248-4ca3-bf7b-569d69002997 req-5a9d4edf-e48c-4b4d-b6cd-fe13ae6d7d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f51c52b-0d6b-40bd-9b31-ad0a91304d78", "name": "network-vif-plugged", "status": "completed", "tag": "1abdc581-adbd-4c5f-bdbd-8bfed514d4b0"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:57.307255 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b93cc43b-e7aa-4484-bbe3-937fa232f0eb tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:57.308481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b93cc43b-e7aa-4484-bbe3-937fa232f0eb tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:57.327567 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-4049a948-0248-4ca3-bf7b-569d69002997 req-5a9d4edf-e48c-4b4d-b6cd-fe13ae6d7d76 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:57.328957 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-4049a948-0248-4ca3-bf7b-569d69002997 req-5a9d4edf-e48c-4b4d-b6cd-fe13ae6d7d76 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:57.348615 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-4049a948-0248-4ca3-bf7b-569d69002997 req-5a9d4edf-e48c-4b4d-b6cd-fe13ae6d7d76 service nova] Creating event network-vif-plugged:1abdc581-adbd-4c5f-bdbd-8bfed514d4b0 for instance 8f51c52b-0d6b-40bd-9b31-ad0a91304d78 on n-h1-847009-3 Jul 19 22:38:57.354922 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-4049a948-0248-4ca3-bf7b-569d69002997 req-5a9d4edf-e48c-4b4d-b6cd-fe13ae6d7d76 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073411 Jul 19 22:38:57.355817 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1355/2673] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:57.362768 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-47300681-a0ee-4233-904f-980adfd3180c tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a038ad040>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:57.364665 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b93cc43b-e7aa-4484-bbe3-937fa232f0eb tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:57.365268 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b93cc43b-e7aa-4484-bbe3-937fa232f0eb tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:57.365891 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-b93cc43b-e7aa-4484-bbe3-937fa232f0eb tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lazy-loading 'fault' on Instance uuid 9c365853-9c4b-45db-97c8-26d0f6e797bd {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:38:57.443101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b93cc43b-e7aa-4484-bbe3-937fa232f0eb tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:57.453468 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b93cc43b-e7aa-4484-bbe3-937fa232f0eb tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd" status: 200 len: 1305 microversion: 2.1 time: 0.169575 Jul 19 22:38:57.454240 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1319/2674] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:57 2022] GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd => generated 1305 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:57.459789 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-87256313-a55a-4b71-9a4f-797832897be7 req-7c13b18f-2657-4f60-80b5-076356137268 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b617584-f9bc-43a8-af3c-78546d0d9889", "tag": "3b3dc181-31be-470e-abec-b7a8478ff369"}, {"server_uuid": "9c365853-9c4b-45db-97c8-26d0f6e797bd", "name": "network-vif-deleted", "tag": "b561cd1a-117e-42d5-8543-cc93dd6943c5"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:57.474196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-87256313-a55a-4b71-9a4f-797832897be7 req-7c13b18f-2657-4f60-80b5-076356137268 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:57.475589 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-87256313-a55a-4b71-9a4f-797832897be7 req-7c13b18f-2657-4f60-80b5-076356137268 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:57.499927 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-87256313-a55a-4b71-9a4f-797832897be7 req-7c13b18f-2657-4f60-80b5-076356137268 service nova] Creating event network-changed:3b3dc181-31be-470e-abec-b7a8478ff369 for instance 3b617584-f9bc-43a8-af3c-78546d0d9889 on n-h2-847009-3 Jul 19 22:38:57.500600 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-87256313-a55a-4b71-9a4f-797832897be7 req-7c13b18f-2657-4f60-80b5-076356137268 service nova] Creating event network-vif-deleted:b561cd1a-117e-42d5-8543-cc93dd6943c5 for instance 9c365853-9c4b-45db-97c8-26d0f6e797bd on n-h1-847009-3 Jul 19 22:38:57.509949 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-87256313-a55a-4b71-9a4f-797832897be7 req-7c13b18f-2657-4f60-80b5-076356137268 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.054029 Jul 19 22:38:57.510740 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1320/2675] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:57.513183 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-47300681-a0ee-4233-904f-980adfd3180c tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.155524 Jul 19 22:38:57.519345 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1356/2676] 10.222.0.25 () {58 vars in 1148 bytes} [Tue Jul 19 22:38:57 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:57.529345 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c2a1c42c-493f-4b40-b8d6-9e6bf279cd42 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a15551310>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:57.612634 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c2a1c42c-493f-4b40-b8d6-9e6bf279cd42 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1431 microversion: 2.1 time: 0.087426 Jul 19 22:38:57.613511 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1321/2677] 10.222.0.25 () {58 vars in 1148 bytes} [Tue Jul 19 22:38:57 2022] GET /compute/v2.1/images?type=snapshot => generated 1431 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:57.626817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b3ef4532-beec-4f3a-ae1b-647232a45fda tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a03814550>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:57.645065 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-57098bbe-9b70-4bb3-bb46-8ab31494bfb1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:57.646383 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-57098bbe-9b70-4bb3-bb46-8ab31494bfb1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:57.654988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57098bbe-9b70-4bb3-bb46-8ab31494bfb1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:57.655754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57098bbe-9b70-4bb3-bb46-8ab31494bfb1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:57.656698 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57098bbe-9b70-4bb3-bb46-8ab31494bfb1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:57.657424 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57098bbe-9b70-4bb3-bb46-8ab31494bfb1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:57.695041 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b3ef4532-beec-4f3a-ae1b-647232a45fda tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.073282 Jul 19 22:38:57.696048 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1357/2678] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:38:57 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:38:57.708479 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aadea666-c1f3-4bf8-a62d-ac6a248c2d56 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a03814790>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:57.859665 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-aadea666-c1f3-4bf8-a62d-ac6a248c2d56 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/detail?changes-since=2022-07-19T22%3A36%3A21Z" status: 200 len: 6333 microversion: 2.1 time: 0.154933 Jul 19 22:38:57.860296 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1358/2679] 10.222.0.25 () {58 vars in 1219 bytes} [Tue Jul 19 22:38:57 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-19T22%3A36%3A21Z => generated 6333 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:38:57.876661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7e6e3891-37ad-4bb6-a0e9-8dd359ad3a65 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:57.877319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7e6e3891-37ad-4bb6-a0e9-8dd359ad3a65 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:57.884925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e6e3891-37ad-4bb6-a0e9-8dd359ad3a65 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:57.885383 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e6e3891-37ad-4bb6-a0e9-8dd359ad3a65 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:57.886181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e6e3891-37ad-4bb6-a0e9-8dd359ad3a65 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:57.886621 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e6e3891-37ad-4bb6-a0e9-8dd359ad3a65 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:58.586524 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-57098bbe-9b70-4bb3-bb46-8ab31494bfb1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:58.604665 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-57098bbe-9b70-4bb3-bb46-8ab31494bfb1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1317 microversion: 2.1 time: 0.963774 Jul 19 22:38:58.606893 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1322/2680] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:57 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1317 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:58.619949 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4d951a26-046a-4e7b-8fd8-0042459c161a tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a15551550>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:58.706236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7e6e3891-37ad-4bb6-a0e9-8dd359ad3a65 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ece721a99a4080a059c635b23761e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7242ed05524293b5dae6a33e520cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:58.718596 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7e6e3891-37ad-4bb6-a0e9-8dd359ad3a65 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e" status: 200 len: 1526 microversion: 2.1 time: 0.846607 Jul 19 22:38:58.737893 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1359/2681] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:57 2022] GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e => generated 1526 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:58.737893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-79e87e8a-3ac3-4cac-9a12-40e2730c7006 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:58.737893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-79e87e8a-3ac3-4cac-9a12-40e2730c7006 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 8f51c52b-0d6b-40bd-9b31-ad0a91304d78] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:58.757471 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79e87e8a-3ac3-4cac-9a12-40e2730c7006 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:58.758270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79e87e8a-3ac3-4cac-9a12-40e2730c7006 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:58.759481 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79e87e8a-3ac3-4cac-9a12-40e2730c7006 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:58.760680 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79e87e8a-3ac3-4cac-9a12-40e2730c7006 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:58.798895 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4d951a26-046a-4e7b-8fd8-0042459c161a tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-67535250" status: 200 len: 663 microversion: 2.1 time: 0.187923 Jul 19 22:38:58.808233 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1323/2682] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 19 22:38:58 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-67535250 => generated 663 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:58.814775 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6149dd63-4db5-4654-92f4-636111e640cc tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:58.815443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6149dd63-4db5-4654-92f4-636111e640cc tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] [instance: 3b617584-f9bc-43a8-af3c-78546d0d9889] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:58.835863 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6149dd63-4db5-4654-92f4-636111e640cc tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:58.836477 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6149dd63-4db5-4654-92f4-636111e640cc tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:58.837400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6149dd63-4db5-4654-92f4-636111e640cc tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:58.837943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6149dd63-4db5-4654-92f4-636111e640cc tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:59.300810 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-79e87e8a-3ac3-4cac-9a12-40e2730c7006 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:59.304043 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:38:59.313215 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-79e87e8a-3ac3-4cac-9a12-40e2730c7006 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78" status: 200 len: 1334 microversion: 2.1 time: 0.587039 Jul 19 22:38:59.313826 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1360/2683] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:58 2022] GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78 => generated 1334 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:59.319731 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b6e4f47a-6f7c-4f61-b495-f25af5556892 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:59.320655 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b6e4f47a-6f7c-4f61-b495-f25af5556892 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9c365853-9c4b-45db-97c8-26d0f6e797bd] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:59.330212 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b6e4f47a-6f7c-4f61-b495-f25af5556892 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:59.330665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b6e4f47a-6f7c-4f61-b495-f25af5556892 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:59.331511 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b6e4f47a-6f7c-4f61-b495-f25af5556892 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:59.332289 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b6e4f47a-6f7c-4f61-b495-f25af5556892 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:59.347729 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-b6e4f47a-6f7c-4f61-b495-f25af5556892 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] HTTP exception thrown: Instance 9c365853-9c4b-45db-97c8-26d0f6e797bd could not be found. Jul 19 22:38:59.349416 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b6e4f47a-6f7c-4f61-b495-f25af5556892 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Request method failure captured: Jul 19 22:38:59.349416 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd HTTP/1.1 Jul 19 22:38:59.349416 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:38:59.349416 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:38:59.349416 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:38:59.349416 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:38:59.349416 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:38:59.349416 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:38:59.349416 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:38:59.349416 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:38:59.349416 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zJcOd8ioSoO4Ag7p0FuZhdyFBnwQELvoxLAsblThyrJ_2NxEo2CJ37EEfRT2CZdbZlGMRgWXNVEuSQUWOfX5krUiSHAMeusL8iD4FHXx0Nd2OURbeGsEBn_IDvsFz7TmW6c-8lxScCQfbEdKUx47XHZCtuEAW7dgjTFB9ANV0LmkTU Jul 19 22:38:59.349416 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:38:59.349416 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:38:59.349416 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:38:59.349416 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:38:59.349416 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:38:59.349416 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:38:59.349416 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:38:59.349416 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:38:59.349416 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:38:59.349416 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:38:59.352399 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:38:59.352399 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:38:59.352399 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:38:59.352399 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:38:59.352399 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:38:59.352399 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:38:59.352399 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:38:59.352399 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: f4f40233895248229ddfdcd06fb65361 Jul 19 22:38:59.352399 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:38:59.352399 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:38:59.352399 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 9c365853-9c4b-45db-97c8-26d0f6e797bd could not be found. Jul 19 22:38:59.352399 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '9c365853-9c4b-45db-97c8-26d0f6e797bd'} Jul 19 22:38:59.354018 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:38:59.354018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:38:59.354018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:38:59.354018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:38:59.354018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:38:59.354018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:38:59.354018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:38:59.354018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:38:59.354018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:38:59.354018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:38:59.354018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c365853-9c4b-45db-97c8-26d0f6e797bd could not be found. Jul 19 22:38:59.354018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:59.354018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:38:59.354018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:59.354018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:38:59.354018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:38:59.354018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:38:59.354018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:38:59.354018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:38:59.354018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:38:59.356111 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:38:59.356111 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:38:59.356111 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:38:59.356111 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:38:59.356111 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:38:59.356111 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:38:59.356111 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:38:59.356111 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c365853-9c4b-45db-97c8-26d0f6e797bd could not be found. Jul 19 22:38:59.356111 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:59.356111 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:38:59.356111 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:59.356111 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:38:59.356111 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:38:59.356111 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:38:59.356111 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:38:59.356111 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:38:59.356111 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c365853-9c4b-45db-97c8-26d0f6e797bd could not be found. Jul 19 22:38:59.356111 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:38:59.358441 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b6e4f47a-6f7c-4f61-b495-f25af5556892 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Returning 404 to user: Instance 9c365853-9c4b-45db-97c8-26d0f6e797bd could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:38:59.358441 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b6e4f47a-6f7c-4f61-b495-f25af5556892 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd" status: 404 len: 111 microversion: 2.1 time: 0.035882 Jul 19 22:38:59.358441 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1361/2684] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:59 2022] GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:38:59.358441 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5108dac3-0400-4d54-9169-1bdb09eafc72 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a03a33700>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:59.360902 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6149dd63-4db5-4654-92f4-636111e640cc tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746810a196b24e8884a9526580cdc2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe347c5b18f487ab2fc6b6de7e959e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:38:59.381197 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6149dd63-4db5-4654-92f4-636111e640cc tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889" status: 200 len: 1316 microversion: 2.1 time: 0.570335 Jul 19 22:38:59.395580 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1324/2685] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:58 2022] GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889 => generated 1316 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:59.420747 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-9a2c3906-a5d9-4f65-9a66-8bc6728b2518 req-9668458f-aa23-4edd-ae8d-5de4afc52e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f51c52b-0d6b-40bd-9b31-ad0a91304d78", "name": "network-vif-plugged", "status": "completed", "tag": "a67ebbd2-ea44-45b3-a0d8-ad47909966a4"}, {"server_uuid": "a7c28d6e-5bfc-4b93-ab76-85ab7d401744", "name": "network-vif-plugged", "status": "completed", "tag": "fca80e58-e0cd-4282-b725-470915412593"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:59.432292 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-9a2c3906-a5d9-4f65-9a66-8bc6728b2518 req-9668458f-aa23-4edd-ae8d-5de4afc52e87 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:59.433501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-9a2c3906-a5d9-4f65-9a66-8bc6728b2518 req-9668458f-aa23-4edd-ae8d-5de4afc52e87 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:59.454129 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5108dac3-0400-4d54-9169-1bdb09eafc72 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2F7a846129-bc22-4520-bd5b-d33fcd0a94a2" status: 200 len: 1467 microversion: 2.1 time: 0.100631 Jul 19 22:38:59.455288 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1362/2686] 10.222.0.25 () {58 vars in 1337 bytes} [Tue Jul 19 22:38:59 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2F7a846129-bc22-4520-bd5b-d33fcd0a94a2 => generated 1467 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:59.476450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a2276c72-1c3b-4a16-9e15-8ea7c43c8f19 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a10525310>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:59.490543 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-9a2c3906-a5d9-4f65-9a66-8bc6728b2518 req-9668458f-aa23-4edd-ae8d-5de4afc52e87 service nova] Creating event network-vif-plugged:a67ebbd2-ea44-45b3-a0d8-ad47909966a4 for instance 8f51c52b-0d6b-40bd-9b31-ad0a91304d78 on n-h1-847009-3 Jul 19 22:38:59.492170 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-9a2c3906-a5d9-4f65-9a66-8bc6728b2518 req-9668458f-aa23-4edd-ae8d-5de4afc52e87 service nova] Creating event network-vif-plugged:fca80e58-e0cd-4282-b725-470915412593 for instance a7c28d6e-5bfc-4b93-ab76-85ab7d401744 on n-h2-847009-3 Jul 19 22:38:59.527303 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-9a2c3906-a5d9-4f65-9a66-8bc6728b2518 req-9668458f-aa23-4edd-ae8d-5de4afc52e87 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.126992 Jul 19 22:38:59.529211 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1325/2687] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:59.540205 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3bbbdcff-b669-4515-9621-904b91acccb2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1435178601", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "87c331fb-040c-45fc-a9a1-e946f840de97"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:59.563152 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:38:59.609535 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a2276c72-1c3b-4a16-9e15-8ea7c43c8f19 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2F7a846129-bc22-4520-bd5b-d33fcd0a94a2" status: 200 len: 1467 microversion: 2.1 time: 0.134385 Jul 19 22:38:59.616650 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1363/2688] 10.222.0.25 () {58 vars in 1323 bytes} [Tue Jul 19 22:38:59 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2F7a846129-bc22-4520-bd5b-d33fcd0a94a2 => generated 1467 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:38:59.650299 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-3bbbdcff-b669-4515-9621-904b91acccb2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] validate_networks() for [('87c331fb-040c-45fc-a9a1-e946f840de97', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:38:59.653344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-4f4bdafd-c069-43dd-be96-487e0db3c9c3 req-b4c66954-3cf5-4af0-bc8d-0f070928dc0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf65365-ee09-4edc-87d7-e6111559ca2e", "name": "network-vif-deleted", "tag": "3d5f4107-f97a-4ed8-ad9b-376b9b2e9563"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:38:59.676885 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-4f4bdafd-c069-43dd-be96-487e0db3c9c3 req-b4c66954-3cf5-4af0-bc8d-0f070928dc0e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:59.677913 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-4f4bdafd-c069-43dd-be96-487e0db3c9c3 req-b4c66954-3cf5-4af0-bc8d-0f070928dc0e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:59.695291 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-4f4bdafd-c069-43dd-be96-487e0db3c9c3 req-b4c66954-3cf5-4af0-bc8d-0f070928dc0e service nova] Creating event network-vif-deleted:3d5f4107-f97a-4ed8-ad9b-376b9b2e9563 for instance caf65365-ee09-4edc-87d7-e6111559ca2e on n-h1-847009-3 Jul 19 22:38:59.701643 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-4f4bdafd-c069-43dd-be96-487e0db3c9c3 req-b4c66954-3cf5-4af0-bc8d-0f070928dc0e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060886 Jul 19 22:38:59.702805 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1364/2689] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:38:59.709396 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4aac5ee3-0eed-4c7d-915e-92d52832c1e1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:38:59.711280 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4aac5ee3-0eed-4c7d-915e-92d52832c1e1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:38:59.719913 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4aac5ee3-0eed-4c7d-915e-92d52832c1e1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:59.721083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4aac5ee3-0eed-4c7d-915e-92d52832c1e1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:38:59.722597 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4aac5ee3-0eed-4c7d-915e-92d52832c1e1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:38:59.723691 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4aac5ee3-0eed-4c7d-915e-92d52832c1e1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:00.042857 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=4 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:39:00.081656 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=12 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:39:00.105832 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4aac5ee3-0eed-4c7d-915e-92d52832c1e1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:00.115006 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4aac5ee3-0eed-4c7d-915e-92d52832c1e1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1317 microversion: 2.1 time: 0.410287 Jul 19 22:39:00.115660 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1365/2690] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:38:59 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1317 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:00.122225 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6317185b-83d5-4816-996e-18cca514640f tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a103f4f70>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:00.375955 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6317185b-83d5-4816-996e-18cca514640f tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7108 microversion: 2.1 time: 0.258488 Jul 19 22:39:00.377396 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1366/2691] 10.222.0.25 () {58 vars in 1169 bytes} [Tue Jul 19 22:39:00 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7108 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:00.384520 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e90c8499-746c-47f8-aa20-89179e724739 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:00.385304 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e90c8499-746c-47f8-aa20-89179e724739 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] [instance: caf65365-ee09-4edc-87d7-e6111559ca2e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:00.397703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e90c8499-746c-47f8-aa20-89179e724739 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:00.400046 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e90c8499-746c-47f8-aa20-89179e724739 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:00.401365 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e90c8499-746c-47f8-aa20-89179e724739 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:00.402167 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e90c8499-746c-47f8-aa20-89179e724739 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:00.428466 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-e90c8499-746c-47f8-aa20-89179e724739 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] HTTP exception thrown: Instance caf65365-ee09-4edc-87d7-e6111559ca2e could not be found. Jul 19 22:39:00.433610 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e90c8499-746c-47f8-aa20-89179e724739 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Request method failure captured: Jul 19 22:39:00.433610 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e HTTP/1.1 Jul 19 22:39:00.433610 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:39:00.433610 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:39:00.433610 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:39:00.433610 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:39:00.433610 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:39:00.433610 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:39:00.433610 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:39:00.433610 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:39:00.433610 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zH89DNXCIQWv41yHAvGRXSNtFbm6pSJ5huYNyBU6eJ9WJdlQUHFO2gtCgyRi0Ry5MiOLhV18p5AG56_t0NEtd10n3dYDM-qrros2fcMDDL4A-Y8bS8dOpf5mPSuTR33nFcO0B7-3Xg1vopdTWvSM6sz19ASnxkjWNJQcLZPyESzOqY Jul 19 22:39:00.433610 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:39:00.433610 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:39:00.433610 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:39:00.433610 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:39:00.433610 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:39:00.433610 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:39:00.433610 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: ef7242ed05524293b5dae6a33e520cfc Jul 19 22:39:00.433610 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1371103150 Jul 19 22:39:00.433610 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:39:00.433610 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:39:00.436324 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ef7242ed05524293b5dae6a33e520cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef7242ed05524293b5dae6a33e520cfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ef7242ed05524293b5dae6a33e520cfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef7242ed05524293b5dae6a33e520cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:39:00.436324 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1371103150 Jul 19 22:39:00.436324 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: ef7242ed05524293b5dae6a33e520cfc Jul 19 22:39:00.436324 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1371103150 Jul 19 22:39:00.436324 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-FloatingIPsAssociationTestJSON-1371103150-project Jul 19 22:39:00.436324 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:39:00.436324 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:39:00.436324 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: b6ece721a99a4080a059c635b23761e4 Jul 19 22:39:00.436324 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1371103150-project Jul 19 22:39:00.436324 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:39:00.436324 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance caf65365-ee09-4edc-87d7-e6111559ca2e could not be found. Jul 19 22:39:00.436324 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'caf65365-ee09-4edc-87d7-e6111559ca2e'} Jul 19 22:39:00.437563 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:39:00.437563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:00.437563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:39:00.437563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:39:00.437563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:39:00.437563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:39:00.437563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:39:00.437563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:39:00.437563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:39:00.437563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:39:00.437563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caf65365-ee09-4edc-87d7-e6111559ca2e could not be found. Jul 19 22:39:00.437563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:00.437563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:00.437563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:00.437563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:00.437563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:00.437563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:00.437563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:39:00.437563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:39:00.437563 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:39:00.441019 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:39:00.441019 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:39:00.441019 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:39:00.441019 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:39:00.441019 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:39:00.441019 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:39:00.441019 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:39:00.441019 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf65365-ee09-4edc-87d7-e6111559ca2e could not be found. Jul 19 22:39:00.441019 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:00.441019 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:00.441019 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:00.441019 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:00.441019 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:00.441019 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:00.441019 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:39:00.441019 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:39:00.441019 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf65365-ee09-4edc-87d7-e6111559ca2e could not be found. Jul 19 22:39:00.441019 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:00.444316 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e90c8499-746c-47f8-aa20-89179e724739 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] Returning 404 to user: Instance caf65365-ee09-4edc-87d7-e6111559ca2e could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:39:00.444316 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e90c8499-746c-47f8-aa20-89179e724739 tempest-FloatingIPsAssociationTestJSON-1371103150 tempest-FloatingIPsAssociationTestJSON-1371103150-project] 10.222.0.25 "GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e" status: 404 len: 111 microversion: 2.1 time: 0.058247 Jul 19 22:39:00.444316 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1367/2692] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:00 2022] GET /compute/v2.1/servers/caf65365-ee09-4edc-87d7-e6111559ca2e => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:39:00.456475 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ebfd21b7-6061-45d9-9e28-92055648235b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:00.457853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ebfd21b7-6061-45d9-9e28-92055648235b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 8f51c52b-0d6b-40bd-9b31-ad0a91304d78] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:00.467639 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ebfd21b7-6061-45d9-9e28-92055648235b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:00.468901 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ebfd21b7-6061-45d9-9e28-92055648235b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:00.470252 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ebfd21b7-6061-45d9-9e28-92055648235b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:00.471233 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ebfd21b7-6061-45d9-9e28-92055648235b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:00.799537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-3bbbdcff-b669-4515-9621-904b91acccb2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:39:00.800624 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-3bbbdcff-b669-4515-9621-904b91acccb2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:39:00.801124 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-3bbbdcff-b669-4515-9621-904b91acccb2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:39:00.801546 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-3bbbdcff-b669-4515-9621-904b91acccb2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:39:00.801974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-3bbbdcff-b669-4515-9621-904b91acccb2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:39:00.816155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ebfd21b7-6061-45d9-9e28-92055648235b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:00.828235 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ebfd21b7-6061-45d9-9e28-92055648235b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78" status: 200 len: 1334 microversion: 2.1 time: 0.386267 Jul 19 22:39:00.829578 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1368/2693] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:00 2022] GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78 => generated 1334 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:00.831382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3bbbdcff-b669-4515-9621-904b91acccb2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:00.831848 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3bbbdcff-b669-4515-9621-904b91acccb2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:00.832664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3bbbdcff-b669-4515-9621-904b91acccb2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:00.833154 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3bbbdcff-b669-4515-9621-904b91acccb2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:00.835930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-edbe3d2c-b986-4e08-a877-c0a899dfeb79 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a03a33700>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:00.873850 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-3bbbdcff-b669-4515-9621-904b91acccb2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Getting quotas for project a2bcdb843a7d4a1ebe467160eee0d6e1. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:39:00.881775 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-3bbbdcff-b669-4515-9621-904b91acccb2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Getting quotas for user f4f40233895248229ddfdcd06fb65361 and project a2bcdb843a7d4a1ebe467160eee0d6e1. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:39:00.897514 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3bbbdcff-b669-4515-9621-904b91acccb2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:39:00.900728 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3bbbdcff-b669-4515-9621-904b91acccb2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9177ec40-9593-42f5-97ad-d896faeb9e83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:39:00.960091 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-edbe3d2c-b986-4e08-a877-c0a899dfeb79 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4377 microversion: 2.1 time: 0.127685 Jul 19 22:39:00.960664 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1369/2694] 10.222.0.25 () {58 vars in 1169 bytes} [Tue Jul 19 22:39:00 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4377 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:00.991790 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3bbbdcff-b669-4515-9621-904b91acccb2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.458338 Jul 19 22:39:00.995820 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1326/2695] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:38:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:39:00.999149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f6c20a68-1617-4aa3-873d-709d729b6b01 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:01.004191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f6c20a68-1617-4aa3-873d-709d729b6b01 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] [instance: 3b617584-f9bc-43a8-af3c-78546d0d9889] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:01.012823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2d41f202-b926-41bd-bf8b-b6a5fdfa43ba tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a1559d670>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:01.016333 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f6c20a68-1617-4aa3-873d-709d729b6b01 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:01.017266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f6c20a68-1617-4aa3-873d-709d729b6b01 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:01.018365 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f6c20a68-1617-4aa3-873d-709d729b6b01 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:01.019244 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f6c20a68-1617-4aa3-873d-709d729b6b01 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:01.068801 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2d41f202-b926-41bd-bf8b-b6a5fdfa43ba tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/3a7659a5-b1a8-4e19-8bfc-eda9874ee691" status: 200 len: 784 microversion: 2.1 time: 0.065317 Jul 19 22:39:01.070024 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1327/2696] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:39:00 2022] GET /compute/v2.1/images/3a7659a5-b1a8-4e19-8bfc-eda9874ee691 => generated 784 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:39:01.075140 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-627a9330-2c8d-43b4-960c-858382dbe483 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:01.079363 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-627a9330-2c8d-43b4-960c-858382dbe483 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9177ec40-9593-42f5-97ad-d896faeb9e83] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:01.179613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-627a9330-2c8d-43b4-960c-858382dbe483 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:01.190795 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-627a9330-2c8d-43b4-960c-858382dbe483 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83" status: 200 len: 1215 microversion: 2.1 time: 0.119201 Jul 19 22:39:01.197814 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1328/2697] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:01 2022] GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83 => generated 1215 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:01.210621 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-122d9ebb-491f-404c-8971-af0684c5b679 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a155fce50>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:01.328211 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-122d9ebb-491f-404c-8971-af0684c5b679 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.127088 Jul 19 22:39:01.329113 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1329/2698] 10.222.0.25 () {58 vars in 1157 bytes} [Tue Jul 19 22:39:01 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:01.351996 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-803f58ad-57f3-4955-9335-26a28dc8c6d4 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:01.353272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-803f58ad-57f3-4955-9335-26a28dc8c6d4 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:01.358185 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f6c20a68-1617-4aa3-873d-709d729b6b01 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746810a196b24e8884a9526580cdc2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe347c5b18f487ab2fc6b6de7e959e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:01.376574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-803f58ad-57f3-4955-9335-26a28dc8c6d4 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:01.377649 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-803f58ad-57f3-4955-9335-26a28dc8c6d4 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:01.382139 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f6c20a68-1617-4aa3-873d-709d729b6b01 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889" status: 200 len: 1316 microversion: 2.1 time: 0.405116 Jul 19 22:39:01.384002 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-803f58ad-57f3-4955-9335-26a28dc8c6d4 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:01.384374 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-803f58ad-57f3-4955-9335-26a28dc8c6d4 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:01.392108 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1370/2699] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:00 2022] GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889 => generated 1316 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:01.401628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6c36d63e-4f51-4997-90f6-d28ec47ed831 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a038140d0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:01.877582 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-803f58ad-57f3-4955-9335-26a28dc8c6d4 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:01.889496 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-803f58ad-57f3-4955-9335-26a28dc8c6d4 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1317 microversion: 2.1 time: 0.558973 Jul 19 22:39:01.891149 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1330/2700] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:01 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1317 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:01.929062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cc65c87f-dc0f-42c8-a713-7f78a6076c98 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:01.929705 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cc65c87f-dc0f-42c8-a713-7f78a6076c98 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 8f51c52b-0d6b-40bd-9b31-ad0a91304d78] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:01.940132 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc65c87f-dc0f-42c8-a713-7f78a6076c98 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:01.940768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc65c87f-dc0f-42c8-a713-7f78a6076c98 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:01.941580 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc65c87f-dc0f-42c8-a713-7f78a6076c98 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:01.942019 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc65c87f-dc0f-42c8-a713-7f78a6076c98 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:01.974116 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:39:02.326922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cc65c87f-dc0f-42c8-a713-7f78a6076c98 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:02.349577 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cc65c87f-dc0f-42c8-a713-7f78a6076c98 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78" status: 200 len: 1668 microversion: 2.1 time: 0.452061 Jul 19 22:39:02.352686 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1331/2701] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:01 2022] GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78 => generated 1668 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:02.396034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f56ded90-93a5-44d5-a3f3-0c7905134720 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:02.398233 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f56ded90-93a5-44d5-a3f3-0c7905134720 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9177ec40-9593-42f5-97ad-d896faeb9e83] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:02.434486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f56ded90-93a5-44d5-a3f3-0c7905134720 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:02.435910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f56ded90-93a5-44d5-a3f3-0c7905134720 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:02.437398 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f56ded90-93a5-44d5-a3f3-0c7905134720 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:02.439895 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f56ded90-93a5-44d5-a3f3-0c7905134720 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:02.561963 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f56ded90-93a5-44d5-a3f3-0c7905134720 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:02.595779 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f56ded90-93a5-44d5-a3f3-0c7905134720 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83" status: 200 len: 1267 microversion: 2.1 time: 0.236488 Jul 19 22:39:02.597712 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1332/2702] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:02 2022] GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83 => generated 1267 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:02.620985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-208c0aad-db1d-491a-9f90-eafdfc7fb902 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:02.624888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-208c0aad-db1d-491a-9f90-eafdfc7fb902 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 8f51c52b-0d6b-40bd-9b31-ad0a91304d78] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:02.648522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-208c0aad-db1d-491a-9f90-eafdfc7fb902 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:02.652232 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-208c0aad-db1d-491a-9f90-eafdfc7fb902 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:02.657010 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-208c0aad-db1d-491a-9f90-eafdfc7fb902 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:02.658308 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-208c0aad-db1d-491a-9f90-eafdfc7fb902 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:02.708555 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-208c0aad-db1d-491a-9f90-eafdfc7fb902 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78/ips" status: 200 len: 178 microversion: 2.1 time: 0.109461 Jul 19 22:39:02.710280 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1333/2703] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 19 22:39:02 2022] GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78/ips => generated 178 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:39:02.711937 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6c36d63e-4f51-4997-90f6-d28ec47ed831 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "DELETE /compute/v2.1/images/b1a4c605-7ea8-4ce0-9728-b7e1c746ec9f" status: 204 len: 0 microversion: 2.1 time: 1.317380 Jul 19 22:39:02.713351 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1371/2704] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:01 2022] DELETE /compute/v2.1/images/b1a4c605-7ea8-4ce0-9728-b7e1c746ec9f => generated 0 bytes in 1320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:39:02.731713 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3e93fcea-59b3-4ca8-bd1f-21f59219138b tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:02.736177 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3e93fcea-59b3-4ca8-bd1f-21f59219138b tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] [instance: 3b617584-f9bc-43a8-af3c-78546d0d9889] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:02.749155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c8a12808-d149-43ee-a17f-c72e4b267eb8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:02.750335 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c8a12808-d149-43ee-a17f-c72e4b267eb8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 8f51c52b-0d6b-40bd-9b31-ad0a91304d78] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:02.755064 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e93fcea-59b3-4ca8-bd1f-21f59219138b tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:02.757664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e93fcea-59b3-4ca8-bd1f-21f59219138b tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:02.760839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e93fcea-59b3-4ca8-bd1f-21f59219138b tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:02.761325 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e93fcea-59b3-4ca8-bd1f-21f59219138b tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:02.764698 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8a12808-d149-43ee-a17f-c72e4b267eb8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:02.765448 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8a12808-d149-43ee-a17f-c72e4b267eb8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:02.766911 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8a12808-d149-43ee-a17f-c72e4b267eb8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:02.767850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8a12808-d149-43ee-a17f-c72e4b267eb8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:02.840198 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c8a12808-d149-43ee-a17f-c72e4b267eb8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 8f51c52b-0d6b-40bd-9b31-ad0a91304d78] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:39:03.067575 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c8a12808-d149-43ee-a17f-c72e4b267eb8 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78" status: 204 len: 0 microversion: 2.1 time: 0.347554 Jul 19 22:39:03.068477 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1372/2705] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:39:02 2022] DELETE /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:39:03.088576 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c3da701e-fa10-4386-aa73-aaaf0bc04635 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a038ad790>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:03.224133 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3e93fcea-59b3-4ca8-bd1f-21f59219138b tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746810a196b24e8884a9526580cdc2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe347c5b18f487ab2fc6b6de7e959e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:03.255386 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3e93fcea-59b3-4ca8-bd1f-21f59219138b tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889" status: 200 len: 1316 microversion: 2.1 time: 0.542924 Jul 19 22:39:03.256903 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1334/2706] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:02 2022] GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889 => generated 1316 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:03.270541 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f076b50e-c39f-4a18-b688-b52123e2d684 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:03.271423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f076b50e-c39f-4a18-b688-b52123e2d684 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:03.288190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f076b50e-c39f-4a18-b688-b52123e2d684 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:03.289214 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f076b50e-c39f-4a18-b688-b52123e2d684 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:03.291766 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f076b50e-c39f-4a18-b688-b52123e2d684 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:03.292705 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f076b50e-c39f-4a18-b688-b52123e2d684 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:03.550068 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f076b50e-c39f-4a18-b688-b52123e2d684 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:03.563697 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f076b50e-c39f-4a18-b688-b52123e2d684 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1507 microversion: 2.1 time: 0.297362 Jul 19 22:39:03.571203 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1335/2707] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:03 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1507 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:03.579332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7d5e4dda-bfe6-462c-a0d7-54075e4c276e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:03.581039 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7d5e4dda-bfe6-462c-a0d7-54075e4c276e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 8f51c52b-0d6b-40bd-9b31-ad0a91304d78] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:03.596186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d5e4dda-bfe6-462c-a0d7-54075e4c276e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:03.597058 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d5e4dda-bfe6-462c-a0d7-54075e4c276e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:03.598086 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d5e4dda-bfe6-462c-a0d7-54075e4c276e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:03.598750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d5e4dda-bfe6-462c-a0d7-54075e4c276e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:03.968343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7d5e4dda-bfe6-462c-a0d7-54075e4c276e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:03.995407 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7d5e4dda-bfe6-462c-a0d7-54075e4c276e tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78" status: 200 len: 1674 microversion: 2.1 time: 0.422362 Jul 19 22:39:03.996500 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1336/2708] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:03 2022] GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78 => generated 1674 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:04.013682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c12ae7fb-c9a5-4a43-910d-ff3bc36c3fd0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:04.018464 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c12ae7fb-c9a5-4a43-910d-ff3bc36c3fd0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:04.033973 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c12ae7fb-c9a5-4a43-910d-ff3bc36c3fd0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:04.037636 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c12ae7fb-c9a5-4a43-910d-ff3bc36c3fd0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:04.038912 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c12ae7fb-c9a5-4a43-910d-ff3bc36c3fd0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:04.039637 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c12ae7fb-c9a5-4a43-910d-ff3bc36c3fd0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:04.193299 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c3da701e-fa10-4386-aa73-aaaf0bc04635 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "DELETE /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993" status: 204 len: 0 microversion: 2.1 time: 1.123421 Jul 19 22:39:04.194709 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1373/2709] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:03 2022] DELETE /compute/v2.1/images/b7961779-1967-4863-8f88-e93cf0a98993 => generated 0 bytes in 1126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:39:04.199739 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-237e5e1d-7a25-4989-97fd-7572eb314ee4 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:04.200943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-237e5e1d-7a25-4989-97fd-7572eb314ee4 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9177ec40-9593-42f5-97ad-d896faeb9e83] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:04.222050 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-237e5e1d-7a25-4989-97fd-7572eb314ee4 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:04.223222 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-237e5e1d-7a25-4989-97fd-7572eb314ee4 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:04.226653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-237e5e1d-7a25-4989-97fd-7572eb314ee4 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:04.228152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-237e5e1d-7a25-4989-97fd-7572eb314ee4 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:04.504945 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-237e5e1d-7a25-4989-97fd-7572eb314ee4 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:04.518463 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-237e5e1d-7a25-4989-97fd-7572eb314ee4 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83" status: 200 len: 1285 microversion: 2.1 time: 0.321992 Jul 19 22:39:04.521195 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1374/2710] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:04 2022] GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83 => generated 1285 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:04.527958 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e67b7411-abd7-45b8-900e-1c0e0eab9d3b tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a10525c10>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:04.999811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c12ae7fb-c9a5-4a43-910d-ff3bc36c3fd0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:05.015939 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c12ae7fb-c9a5-4a43-910d-ff3bc36c3fd0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1507 microversion: 2.1 time: 1.014546 Jul 19 22:39:05.022716 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1337/2711] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:04 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1507 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:05.037720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b9847b55-95f5-49d8-96dd-a72cbd690661 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:05.038317 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b9847b55-95f5-49d8-96dd-a72cbd690661 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] [instance: 3b617584-f9bc-43a8-af3c-78546d0d9889] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:05.058847 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b9847b55-95f5-49d8-96dd-a72cbd690661 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:05.063999 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b9847b55-95f5-49d8-96dd-a72cbd690661 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:05.065016 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b9847b55-95f5-49d8-96dd-a72cbd690661 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:05.065611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b9847b55-95f5-49d8-96dd-a72cbd690661 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:05.556832 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e67b7411-abd7-45b8-900e-1c0e0eab9d3b tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "DELETE /compute/v2.1/images/b976644c-69fb-42e4-880b-c54968aac66c" status: 204 len: 0 microversion: 2.1 time: 1.033556 Jul 19 22:39:05.557743 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1375/2712] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:04 2022] DELETE /compute/v2.1/images/b976644c-69fb-42e4-880b-c54968aac66c => generated 0 bytes in 1036 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:39:05.568718 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-d108061b-894b-4b60-b868-7775348f98cd req-57558dbd-83b4-495b-a7c4-d68a65418a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9ae7d22-3925-465a-9507-250b670ecc77", "name": "network-vif-plugged", "status": "completed", "tag": "3196bd8c-6a69-4858-81a6-622d724377b1"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:39:05.586726 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d108061b-894b-4b60-b868-7775348f98cd req-57558dbd-83b4-495b-a7c4-d68a65418a99 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:05.587579 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d108061b-894b-4b60-b868-7775348f98cd req-57558dbd-83b4-495b-a7c4-d68a65418a99 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:05.605240 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-d108061b-894b-4b60-b868-7775348f98cd req-57558dbd-83b4-495b-a7c4-d68a65418a99 service nova] Creating event network-vif-plugged:3196bd8c-6a69-4858-81a6-622d724377b1 for instance b9ae7d22-3925-465a-9507-250b670ecc77 on n-h2-847009-3 Jul 19 22:39:05.612015 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-d108061b-894b-4b60-b868-7775348f98cd req-57558dbd-83b4-495b-a7c4-d68a65418a99 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052075 Jul 19 22:39:05.612924 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1376/2713] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:39:05.619875 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b6a36418-c526-4d87-8c67-5a2cdeb5ea6d tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:05.620836 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b6a36418-c526-4d87-8c67-5a2cdeb5ea6d tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 8f51c52b-0d6b-40bd-9b31-ad0a91304d78] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:05.628783 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b6a36418-c526-4d87-8c67-5a2cdeb5ea6d tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:05.629584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b6a36418-c526-4d87-8c67-5a2cdeb5ea6d tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:05.631706 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b6a36418-c526-4d87-8c67-5a2cdeb5ea6d tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:05.632432 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b6a36418-c526-4d87-8c67-5a2cdeb5ea6d tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:05.695836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b9847b55-95f5-49d8-96dd-a72cbd690661 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746810a196b24e8884a9526580cdc2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe347c5b18f487ab2fc6b6de7e959e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:05.707514 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b9847b55-95f5-49d8-96dd-a72cbd690661 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889" status: 200 len: 1316 microversion: 2.1 time: 0.683055 Jul 19 22:39:05.708289 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1338/2714] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:05 2022] GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889 => generated 1316 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:05.718054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-efeffc88-2625-4ed6-8f5c-4bec00a8bbd2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:39:05.720499 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-efeffc88-2625-4ed6-8f5c-4bec00a8bbd2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:05.728214 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-efeffc88-2625-4ed6-8f5c-4bec00a8bbd2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:05.729267 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-efeffc88-2625-4ed6-8f5c-4bec00a8bbd2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:05.730056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-efeffc88-2625-4ed6-8f5c-4bec00a8bbd2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:05.730510 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-efeffc88-2625-4ed6-8f5c-4bec00a8bbd2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:05.820436 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-efeffc88-2625-4ed6-8f5c-4bec00a8bbd2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "PUT /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1079 microversion: 2.1 time: 0.109308 Jul 19 22:39:05.821288 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1339/2715] 10.222.0.25 () {60 vars in 1255 bytes} [Tue Jul 19 22:39:05 2022] PUT /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1079 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:05.826378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0d68a0ec-6a62-4ae4-8a0f-cd4ac914ef2f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:05.827238 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0d68a0ec-6a62-4ae4-8a0f-cd4ac914ef2f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9177ec40-9593-42f5-97ad-d896faeb9e83] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:05.834079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d68a0ec-6a62-4ae4-8a0f-cd4ac914ef2f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:05.834536 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d68a0ec-6a62-4ae4-8a0f-cd4ac914ef2f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:05.836017 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d68a0ec-6a62-4ae4-8a0f-cd4ac914ef2f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:05.836466 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d68a0ec-6a62-4ae4-8a0f-cd4ac914ef2f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:06.012613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0d68a0ec-6a62-4ae4-8a0f-cd4ac914ef2f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:06.037425 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0d68a0ec-6a62-4ae4-8a0f-cd4ac914ef2f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83" status: 200 len: 1273 microversion: 2.1 time: 0.210375 Jul 19 22:39:06.038128 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1340/2716] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:05 2022] GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83 => generated 1273 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:06.055292 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a813ce2b-c007-4771-a111-a236bddb4f1e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:06.056157 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a813ce2b-c007-4771-a111-a236bddb4f1e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: 7a846129-bc22-4520-bd5b-d33fcd0a94a2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:06.080910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a813ce2b-c007-4771-a111-a236bddb4f1e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:06.081645 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a813ce2b-c007-4771-a111-a236bddb4f1e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:06.082632 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a813ce2b-c007-4771-a111-a236bddb4f1e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:06.083305 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a813ce2b-c007-4771-a111-a236bddb4f1e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:06.147181 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a813ce2b-c007-4771-a111-a236bddb4f1e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: 7a846129-bc22-4520-bd5b-d33fcd0a94a2] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:39:06.234465 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b6a36418-c526-4d87-8c67-5a2cdeb5ea6d tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:06.245885 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b6a36418-c526-4d87-8c67-5a2cdeb5ea6d tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78" status: 200 len: 1674 microversion: 2.1 time: 0.631546 Jul 19 22:39:06.250238 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1377/2717] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:05 2022] GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78 => generated 1674 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:06.265411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f4793ce4-503f-4072-9895-631dd9a4e97e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:06.270401 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f4793ce4-503f-4072-9895-631dd9a4e97e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:06.285892 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a813ce2b-c007-4771-a111-a236bddb4f1e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2" status: 204 len: 0 microversion: 2.1 time: 0.245892 Jul 19 22:39:06.287016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4793ce4-503f-4072-9895-631dd9a4e97e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:06.287271 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1341/2718] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:39:06 2022] DELETE /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:39:06.289403 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4793ce4-503f-4072-9895-631dd9a4e97e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:06.291570 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4793ce4-503f-4072-9895-631dd9a4e97e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:06.292185 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4793ce4-503f-4072-9895-631dd9a4e97e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:06.296529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e0c1c710-5c3d-4f7a-8e72-8c8e246e7cde tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:06.297541 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e0c1c710-5c3d-4f7a-8e72-8c8e246e7cde tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: 7a846129-bc22-4520-bd5b-d33fcd0a94a2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:06.305552 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0c1c710-5c3d-4f7a-8e72-8c8e246e7cde tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:06.306154 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0c1c710-5c3d-4f7a-8e72-8c8e246e7cde tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:06.307204 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0c1c710-5c3d-4f7a-8e72-8c8e246e7cde tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:06.307767 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0c1c710-5c3d-4f7a-8e72-8c8e246e7cde tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:06.977246 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f4793ce4-503f-4072-9895-631dd9a4e97e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:06.988919 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f4793ce4-503f-4072-9895-631dd9a4e97e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1505 microversion: 2.1 time: 0.736918 Jul 19 22:39:06.989851 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1378/2719] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:06 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1505 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:07.000314 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e0c1c710-5c3d-4f7a-8e72-8c8e246e7cde tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdcb86f99184c839022f5f19d730e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '994ee0e2b71b4eff88a19b70351ada06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:07.005189 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c72043bf-fde6-4dee-9e93-af49b7fb191b tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:07.008549 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c72043bf-fde6-4dee-9e93-af49b7fb191b tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] [instance: 3b617584-f9bc-43a8-af3c-78546d0d9889] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:07.015163 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e0c1c710-5c3d-4f7a-8e72-8c8e246e7cde tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2" status: 200 len: 1474 microversion: 2.1 time: 0.723398 Jul 19 22:39:07.016692 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1342/2720] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:06 2022] GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2 => generated 1474 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:07.022056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-0c8a9aac-b0cb-4d98-b671-d850bcc6baf9 req-115b6436-aaa5-45e8-9742-d2e0997fbba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f51c52b-0d6b-40bd-9b31-ad0a91304d78", "name": "network-vif-deleted", "tag": "1abdc581-adbd-4c5f-bdbd-8bfed514d4b0"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:39:07.027826 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c72043bf-fde6-4dee-9e93-af49b7fb191b tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:07.028734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c72043bf-fde6-4dee-9e93-af49b7fb191b tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:07.030196 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c72043bf-fde6-4dee-9e93-af49b7fb191b tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:07.030898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c72043bf-fde6-4dee-9e93-af49b7fb191b tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:07.034054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-0c8a9aac-b0cb-4d98-b671-d850bcc6baf9 req-115b6436-aaa5-45e8-9742-d2e0997fbba4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:07.034728 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-0c8a9aac-b0cb-4d98-b671-d850bcc6baf9 req-115b6436-aaa5-45e8-9742-d2e0997fbba4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:07.051778 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-0c8a9aac-b0cb-4d98-b671-d850bcc6baf9 req-115b6436-aaa5-45e8-9742-d2e0997fbba4 service nova] Creating event network-vif-deleted:1abdc581-adbd-4c5f-bdbd-8bfed514d4b0 for instance 8f51c52b-0d6b-40bd-9b31-ad0a91304d78 on n-h1-847009-3 Jul 19 22:39:07.059233 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-0c8a9aac-b0cb-4d98-b671-d850bcc6baf9 req-115b6436-aaa5-45e8-9742-d2e0997fbba4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040341 Jul 19 22:39:07.060700 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1343/2721] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:39:07.071367 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6543d9e4-32cc-493e-a732-8b75532d0b5e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:07.073443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6543d9e4-32cc-493e-a732-8b75532d0b5e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:07.088708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6543d9e4-32cc-493e-a732-8b75532d0b5e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:07.089670 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6543d9e4-32cc-493e-a732-8b75532d0b5e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:07.094736 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6543d9e4-32cc-493e-a732-8b75532d0b5e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:07.096139 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6543d9e4-32cc-493e-a732-8b75532d0b5e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:07.936135 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c72043bf-fde6-4dee-9e93-af49b7fb191b tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746810a196b24e8884a9526580cdc2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe347c5b18f487ab2fc6b6de7e959e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:07.962180 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c72043bf-fde6-4dee-9e93-af49b7fb191b tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889" status: 200 len: 1316 microversion: 2.1 time: 0.966116 Jul 19 22:39:07.965950 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1379/2722] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:06 2022] GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889 => generated 1316 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:07.980479 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fba1747b-db7e-4a06-90a8-1d0cfc3b0c4e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:07.985929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fba1747b-db7e-4a06-90a8-1d0cfc3b0c4e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9177ec40-9593-42f5-97ad-d896faeb9e83] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:08.007045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6543d9e4-32cc-493e-a732-8b75532d0b5e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:08.012734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fba1747b-db7e-4a06-90a8-1d0cfc3b0c4e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:08.014776 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fba1747b-db7e-4a06-90a8-1d0cfc3b0c4e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:08.017439 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fba1747b-db7e-4a06-90a8-1d0cfc3b0c4e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:08.029498 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fba1747b-db7e-4a06-90a8-1d0cfc3b0c4e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:08.031923 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6543d9e4-32cc-493e-a732-8b75532d0b5e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1505 microversion: 2.1 time: 0.969263 Jul 19 22:39:08.042926 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1344/2723] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:07 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1505 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:08.054866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-60e7bc44-3e14-4e45-87ad-826b60abcaa2 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:08.057796 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-60e7bc44-3e14-4e45-87ad-826b60abcaa2 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 8f51c52b-0d6b-40bd-9b31-ad0a91304d78] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:08.073086 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60e7bc44-3e14-4e45-87ad-826b60abcaa2 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:08.073554 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60e7bc44-3e14-4e45-87ad-826b60abcaa2 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:08.076177 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60e7bc44-3e14-4e45-87ad-826b60abcaa2 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:08.076981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60e7bc44-3e14-4e45-87ad-826b60abcaa2 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:09.225878 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-60e7bc44-3e14-4e45-87ad-826b60abcaa2 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:09.237981 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-60e7bc44-3e14-4e45-87ad-826b60abcaa2 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78" status: 200 len: 1495 microversion: 2.1 time: 1.192329 Jul 19 22:39:09.241215 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1345/2724] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:08 2022] GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78 => generated 1495 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:09.251291 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-19076ab9-6ba8-4820-871f-8c7b40953ae7 req-36d82239-f90c-4d61-bf12-2fcc595d4bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b617584-f9bc-43a8-af3c-78546d0d9889", "name": "network-vif-plugged", "status": "completed", "tag": "3b3dc181-31be-470e-abec-b7a8478ff369"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:39:09.305104 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-19076ab9-6ba8-4820-871f-8c7b40953ae7 req-36d82239-f90c-4d61-bf12-2fcc595d4bd1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:09.306607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-19076ab9-6ba8-4820-871f-8c7b40953ae7 req-36d82239-f90c-4d61-bf12-2fcc595d4bd1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:09.341214 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-19076ab9-6ba8-4820-871f-8c7b40953ae7 req-36d82239-f90c-4d61-bf12-2fcc595d4bd1 service nova] Creating event network-vif-plugged:3b3dc181-31be-470e-abec-b7a8478ff369 for instance 3b617584-f9bc-43a8-af3c-78546d0d9889 on n-h2-847009-3 Jul 19 22:39:09.375868 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-19076ab9-6ba8-4820-871f-8c7b40953ae7 req-36d82239-f90c-4d61-bf12-2fcc595d4bd1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129918 Jul 19 22:39:09.378185 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1346/2725] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:39:09.385413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c66149d9-2797-4f6c-8dcf-fbc7bc52891d tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:09.394036 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c66149d9-2797-4f6c-8dcf-fbc7bc52891d tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: 7a846129-bc22-4520-bd5b-d33fcd0a94a2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:09.423992 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c66149d9-2797-4f6c-8dcf-fbc7bc52891d tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:09.427180 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c66149d9-2797-4f6c-8dcf-fbc7bc52891d tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:09.430364 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c66149d9-2797-4f6c-8dcf-fbc7bc52891d tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:09.431635 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c66149d9-2797-4f6c-8dcf-fbc7bc52891d tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:09.470225 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:39:09.563598 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fba1747b-db7e-4a06-90a8-1d0cfc3b0c4e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:09.579301 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fba1747b-db7e-4a06-90a8-1d0cfc3b0c4e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83" status: 200 len: 1315 microversion: 2.1 time: 1.604400 Jul 19 22:39:09.580908 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1380/2726] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:07 2022] GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83 => generated 1315 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:09.602899 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-79fa3e4b-7a27-4d6e-ac70-01a45b2da5a9 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:39:09.605342 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-79fa3e4b-7a27-4d6e-ac70-01a45b2da5a9 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:09.626592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79fa3e4b-7a27-4d6e-ac70-01a45b2da5a9 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:09.641644 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79fa3e4b-7a27-4d6e-ac70-01a45b2da5a9 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:09.646477 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79fa3e4b-7a27-4d6e-ac70-01a45b2da5a9 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:09.647808 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79fa3e4b-7a27-4d6e-ac70-01a45b2da5a9 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:09.909473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-79fa3e4b-7a27-4d6e-ac70-01a45b2da5a9 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:39:09.910636 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-79fa3e4b-7a27-4d6e-ac70-01a45b2da5a9 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:39:09.911665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-79fa3e4b-7a27-4d6e-ac70-01a45b2da5a9 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:39:09.912674 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-79fa3e4b-7a27-4d6e-ac70-01a45b2da5a9 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:39:09.913506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-79fa3e4b-7a27-4d6e-ac70-01a45b2da5a9 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:39:10.018556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-79fa3e4b-7a27-4d6e-ac70-01a45b2da5a9 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:10.027849 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79fa3e4b-7a27-4d6e-ac70-01a45b2da5a9 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:10.028328 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79fa3e4b-7a27-4d6e-ac70-01a45b2da5a9 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:10.030070 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79fa3e4b-7a27-4d6e-ac70-01a45b2da5a9 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:10.030809 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79fa3e4b-7a27-4d6e-ac70-01a45b2da5a9 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:10.066485 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-79fa3e4b-7a27-4d6e-ac70-01a45b2da5a9 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "POST /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744/action" status: 202 len: 1111 microversion: 2.1 time: 0.483087 Jul 19 22:39:10.078283 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1381/2727] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:39:09 2022] POST /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744/action => generated 1111 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 19 22:39:10.083646 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f3fe54ba-8b25-4eba-a45c-4361c9def881 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:10.084440 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f3fe54ba-8b25-4eba-a45c-4361c9def881 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] [instance: 3b617584-f9bc-43a8-af3c-78546d0d9889] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:10.093528 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f3fe54ba-8b25-4eba-a45c-4361c9def881 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:10.093968 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f3fe54ba-8b25-4eba-a45c-4361c9def881 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:10.094865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f3fe54ba-8b25-4eba-a45c-4361c9def881 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:10.095347 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f3fe54ba-8b25-4eba-a45c-4361c9def881 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:10.501656 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c66149d9-2797-4f6c-8dcf-fbc7bc52891d tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdcb86f99184c839022f5f19d730e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '994ee0e2b71b4eff88a19b70351ada06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:10.534817 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c66149d9-2797-4f6c-8dcf-fbc7bc52891d tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2" status: 200 len: 1474 microversion: 2.1 time: 1.153243 Jul 19 22:39:10.547255 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1347/2728] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:09 2022] GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2 => generated 1474 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:10.592216 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-793071f6-c7db-49b0-950d-c6360c14f934 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:10.593787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-793071f6-c7db-49b0-950d-c6360c14f934 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:10.619561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-793071f6-c7db-49b0-950d-c6360c14f934 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:10.621419 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-793071f6-c7db-49b0-950d-c6360c14f934 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:10.623942 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-793071f6-c7db-49b0-950d-c6360c14f934 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:10.625117 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-793071f6-c7db-49b0-950d-c6360c14f934 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:10.905022 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f3fe54ba-8b25-4eba-a45c-4361c9def881 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746810a196b24e8884a9526580cdc2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe347c5b18f487ab2fc6b6de7e959e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:10.921944 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f3fe54ba-8b25-4eba-a45c-4361c9def881 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889" status: 200 len: 1316 microversion: 2.1 time: 0.842401 Jul 19 22:39:10.931807 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1382/2729] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:10 2022] GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889 => generated 1316 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:10.965834 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7dd183fa-f1f3-4f79-8718-1130c85606d9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:10.967319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7dd183fa-f1f3-4f79-8718-1130c85606d9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 8f51c52b-0d6b-40bd-9b31-ad0a91304d78] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:10.983914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7dd183fa-f1f3-4f79-8718-1130c85606d9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:10.984742 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7dd183fa-f1f3-4f79-8718-1130c85606d9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:10.986424 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7dd183fa-f1f3-4f79-8718-1130c85606d9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:10.987021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7dd183fa-f1f3-4f79-8718-1130c85606d9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:11.023627 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:39:11.054833 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7dd183fa-f1f3-4f79-8718-1130c85606d9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:11.063678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7dd183fa-f1f3-4f79-8718-1130c85606d9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:11.064226 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-7dd183fa-f1f3-4f79-8718-1130c85606d9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lazy-loading 'fault' on Instance uuid 8f51c52b-0d6b-40bd-9b31-ad0a91304d78 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:39:11.346339 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:39:11.347346 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=8 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:39:11.367357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7dd183fa-f1f3-4f79-8718-1130c85606d9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b3fc46823645a6842433476c0e9b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f375b652401428bb916ce1f5b04b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:11.380389 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7dd183fa-f1f3-4f79-8718-1130c85606d9 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78" status: 200 len: 1303 microversion: 2.1 time: 0.437469 Jul 19 22:39:11.381371 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1383/2730] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:10 2022] GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78 => generated 1303 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:11.404613 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-c31b5397-0bdf-492f-b198-3d0cb016c8a5 req-80d082f3-5baa-40ad-aeda-b14422f8d960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a846129-bc22-4520-bd5b-d33fcd0a94a2", "name": "network-vif-deleted", "tag": "f07043ec-4940-4a2a-bfd4-8d23d6ddf88d"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:39:11.459332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c31b5397-0bdf-492f-b198-3d0cb016c8a5 req-80d082f3-5baa-40ad-aeda-b14422f8d960 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:11.459810 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c31b5397-0bdf-492f-b198-3d0cb016c8a5 req-80d082f3-5baa-40ad-aeda-b14422f8d960 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:11.542115 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-c31b5397-0bdf-492f-b198-3d0cb016c8a5 req-80d082f3-5baa-40ad-aeda-b14422f8d960 service nova] Creating event network-vif-deleted:f07043ec-4940-4a2a-bfd4-8d23d6ddf88d for instance 7a846129-bc22-4520-bd5b-d33fcd0a94a2 on n-h2-847009-3 Jul 19 22:39:11.564921 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-c31b5397-0bdf-492f-b198-3d0cb016c8a5 req-80d082f3-5baa-40ad-aeda-b14422f8d960 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171931 Jul 19 22:39:11.568735 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1384/2731] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:39:11.582942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d3e3a674-7a9e-4535-b53e-d15c05453453 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:11.584749 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d3e3a674-7a9e-4535-b53e-d15c05453453 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9177ec40-9593-42f5-97ad-d896faeb9e83] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:11.585919 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-793071f6-c7db-49b0-950d-c6360c14f934 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:11.598385 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-793071f6-c7db-49b0-950d-c6360c14f934 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1516 microversion: 2.1 time: 1.021286 Jul 19 22:39:11.599826 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1348/2732] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:10 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1516 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:11.607352 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7da3dc64-8ec0-48ac-8e10-16d2e14e95b7 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:11.608428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7da3dc64-8ec0-48ac-8e10-16d2e14e95b7 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: 7a846129-bc22-4520-bd5b-d33fcd0a94a2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:11.612016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3e3a674-7a9e-4535-b53e-d15c05453453 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:11.612906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3e3a674-7a9e-4535-b53e-d15c05453453 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:11.615850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3e3a674-7a9e-4535-b53e-d15c05453453 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:11.616641 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3e3a674-7a9e-4535-b53e-d15c05453453 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:11.635481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7da3dc64-8ec0-48ac-8e10-16d2e14e95b7 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:11.638104 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7da3dc64-8ec0-48ac-8e10-16d2e14e95b7 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:11.640138 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7da3dc64-8ec0-48ac-8e10-16d2e14e95b7 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:11.649935 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7da3dc64-8ec0-48ac-8e10-16d2e14e95b7 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:11.816739 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7da3dc64-8ec0-48ac-8e10-16d2e14e95b7 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:11.817423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7da3dc64-8ec0-48ac-8e10-16d2e14e95b7 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:11.818073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-7da3dc64-8ec0-48ac-8e10-16d2e14e95b7 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lazy-loading 'fault' on Instance uuid 7a846129-bc22-4520-bd5b-d33fcd0a94a2 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:39:12.016450 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7da3dc64-8ec0-48ac-8e10-16d2e14e95b7 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdcb86f99184c839022f5f19d730e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '994ee0e2b71b4eff88a19b70351ada06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:12.028427 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7da3dc64-8ec0-48ac-8e10-16d2e14e95b7 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2" status: 200 len: 1308 microversion: 2.1 time: 0.424503 Jul 19 22:39:12.032839 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1349/2733] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:11 2022] GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2 => generated 1308 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:12.041511 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c639d1a2-93d1-4ea2-ab33-e79f67e9a85c tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:12.043000 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c639d1a2-93d1-4ea2-ab33-e79f67e9a85c tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] [instance: 3b617584-f9bc-43a8-af3c-78546d0d9889] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:12.058330 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c639d1a2-93d1-4ea2-ab33-e79f67e9a85c tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:12.061489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c639d1a2-93d1-4ea2-ab33-e79f67e9a85c tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:12.062561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c639d1a2-93d1-4ea2-ab33-e79f67e9a85c tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:12.065533 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c639d1a2-93d1-4ea2-ab33-e79f67e9a85c tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:12.388962 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d3e3a674-7a9e-4535-b53e-d15c05453453 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:12.400413 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d3e3a674-7a9e-4535-b53e-d15c05453453 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83" status: 200 len: 1315 microversion: 2.1 time: 0.826488 Jul 19 22:39:12.401004 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1385/2734] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:11 2022] GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83 => generated 1315 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:12.412651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6aed0f4b-8867-4d16-b06b-a3d9c804d897 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:12.413296 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6aed0f4b-8867-4d16-b06b-a3d9c804d897 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 8f51c52b-0d6b-40bd-9b31-ad0a91304d78] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:12.429075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6aed0f4b-8867-4d16-b06b-a3d9c804d897 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:12.429535 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6aed0f4b-8867-4d16-b06b-a3d9c804d897 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:12.430315 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6aed0f4b-8867-4d16-b06b-a3d9c804d897 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:12.430752 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6aed0f4b-8867-4d16-b06b-a3d9c804d897 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:12.459083 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-6aed0f4b-8867-4d16-b06b-a3d9c804d897 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] HTTP exception thrown: Instance 8f51c52b-0d6b-40bd-9b31-ad0a91304d78 could not be found. Jul 19 22:39:12.462502 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6aed0f4b-8867-4d16-b06b-a3d9c804d897 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Request method failure captured: Jul 19 22:39:12.462502 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78 HTTP/1.1 Jul 19 22:39:12.462502 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:39:12.462502 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:39:12.462502 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:39:12.462502 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:39:12.462502 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:39:12.462502 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:39:12.462502 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:39:12.462502 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:39:12.462502 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zIJuD9a7KRX8Xp_Rx1DyMj4h_N9HwvmQHmJanbA4zf-tGlm9LBOAyWsMng3Zi6orJapbZv-F1fCOtEk2TbM2K1_vXSwDtLqsWNYLByCj4mYByOtvzpIdyKl4xrRWtXiU-LaV38yd4SQDOXPdcT2ZQ3GazbpgQ4iT8EVuriu-toTiHU Jul 19 22:39:12.462502 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:39:12.462502 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:39:12.462502 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:39:12.462502 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:39:12.462502 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:39:12.462502 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:39:12.462502 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 0f375b652401428bb916ce1f5b04b622 Jul 19 22:39:12.462502 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersTestMultiNic-1913922030 Jul 19 22:39:12.462502 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:39:12.462502 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:39:12.463880 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f375b652401428bb916ce1f5b04b622"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f375b652401428bb916ce1f5b04b622"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f375b652401428bb916ce1f5b04b622"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f375b652401428bb916ce1f5b04b622"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:39:12.463880 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersTestMultiNic-1913922030 Jul 19 22:39:12.463880 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 0f375b652401428bb916ce1f5b04b622 Jul 19 22:39:12.463880 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersTestMultiNic-1913922030 Jul 19 22:39:12.463880 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersTestMultiNic-1913922030-project Jul 19 22:39:12.463880 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:39:12.463880 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:39:12.463880 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: d4b3fc46823645a6842433476c0e9b26 Jul 19 22:39:12.463880 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersTestMultiNic-1913922030-project Jul 19 22:39:12.463880 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:39:12.463880 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 8f51c52b-0d6b-40bd-9b31-ad0a91304d78 could not be found. Jul 19 22:39:12.463880 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '8f51c52b-0d6b-40bd-9b31-ad0a91304d78'} Jul 19 22:39:12.464757 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:39:12.464757 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:12.464757 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:39:12.464757 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:39:12.464757 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:39:12.464757 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:39:12.464757 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:39:12.464757 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:39:12.464757 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:39:12.464757 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:39:12.464757 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f51c52b-0d6b-40bd-9b31-ad0a91304d78 could not be found. Jul 19 22:39:12.464757 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:12.464757 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:12.464757 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:12.464757 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:12.464757 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:12.464757 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:12.464757 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:39:12.464757 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:39:12.464757 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:39:12.467474 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:39:12.467474 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:39:12.467474 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:39:12.467474 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:39:12.467474 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:39:12.467474 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:39:12.467474 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:39:12.467474 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f51c52b-0d6b-40bd-9b31-ad0a91304d78 could not be found. Jul 19 22:39:12.467474 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:12.467474 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:12.467474 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:12.467474 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:12.467474 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:12.467474 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:12.467474 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:39:12.467474 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:39:12.467474 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f51c52b-0d6b-40bd-9b31-ad0a91304d78 could not be found. Jul 19 22:39:12.467474 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:12.474008 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6aed0f4b-8867-4d16-b06b-a3d9c804d897 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Returning 404 to user: Instance 8f51c52b-0d6b-40bd-9b31-ad0a91304d78 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:39:12.475250 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6aed0f4b-8867-4d16-b06b-a3d9c804d897 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78" status: 404 len: 111 microversion: 2.1 time: 0.072671 Jul 19 22:39:12.476061 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1386/2735] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:12 2022] GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:39:12.488621 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c639d1a2-93d1-4ea2-ab33-e79f67e9a85c tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746810a196b24e8884a9526580cdc2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe347c5b18f487ab2fc6b6de7e959e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:12.497742 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c639d1a2-93d1-4ea2-ab33-e79f67e9a85c tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889" status: 200 len: 1465 microversion: 2.1 time: 0.463422 Jul 19 22:39:12.509543 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1350/2736] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:12 2022] GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889 => generated 1465 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:12.515546 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6f7dfb65-69b8-4c16-85b6-5abc6aa4c175 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-484508095", "metadata": {"image_type": "test"}}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:39:12.516666 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6f7dfb65-69b8-4c16-85b6-5abc6aa4c175 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] [instance: 3b617584-f9bc-43a8-af3c-78546d0d9889] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:12.518667 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:39:12.524772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f7dfb65-69b8-4c16-85b6-5abc6aa4c175 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:12.525473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f7dfb65-69b8-4c16-85b6-5abc6aa4c175 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:12.526456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f7dfb65-69b8-4c16-85b6-5abc6aa4c175 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:12.527058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f7dfb65-69b8-4c16-85b6-5abc6aa4c175 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:12.578344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-6f7dfb65-69b8-4c16-85b6-5abc6aa4c175 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Getting quotas for project 4fe347c5b18f487ab2fc6b6de7e959e4. Resources: dict_keys(['metadata_items']) {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:39:12.596286 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-6f7dfb65-69b8-4c16-85b6-5abc6aa4c175 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Getting quotas for user 746810a196b24e8884a9526580cdc2a2 and project 4fe347c5b18f487ab2fc6b6de7e959e4. Resources: dict_keys(['metadata_items']) {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:39:12.618299 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b227f07c-6512-430b-869c-ccb7bfd82aca tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:12.619144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b227f07c-6512-430b-869c-ccb7bfd82aca tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:12.632188 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b227f07c-6512-430b-869c-ccb7bfd82aca tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:12.633226 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b227f07c-6512-430b-869c-ccb7bfd82aca tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:12.634954 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b227f07c-6512-430b-869c-ccb7bfd82aca tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:12.635961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b227f07c-6512-430b-869c-ccb7bfd82aca tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:12.908535 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b227f07c-6512-430b-869c-ccb7bfd82aca tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:12.922894 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b227f07c-6512-430b-869c-ccb7bfd82aca tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1516 microversion: 2.1 time: 0.309386 Jul 19 22:39:12.923804 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1351/2737] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:12 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1516 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:13.053405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-58a98e52-bb87-4924-937a-e6746f26fa90 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:13.054040 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-58a98e52-bb87-4924-937a-e6746f26fa90 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: 7a846129-bc22-4520-bd5b-d33fcd0a94a2] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:13.063277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58a98e52-bb87-4924-937a-e6746f26fa90 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:13.064777 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58a98e52-bb87-4924-937a-e6746f26fa90 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:13.065940 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58a98e52-bb87-4924-937a-e6746f26fa90 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:13.066814 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58a98e52-bb87-4924-937a-e6746f26fa90 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:13.088680 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-58a98e52-bb87-4924-937a-e6746f26fa90 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] HTTP exception thrown: Instance 7a846129-bc22-4520-bd5b-d33fcd0a94a2 could not be found. Jul 19 22:39:13.090686 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-58a98e52-bb87-4924-937a-e6746f26fa90 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Request method failure captured: Jul 19 22:39:13.090686 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2 HTTP/1.1 Jul 19 22:39:13.090686 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:39:13.090686 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:39:13.090686 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:39:13.090686 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:39:13.090686 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:39:13.090686 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:39:13.090686 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:39:13.090686 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:39:13.090686 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zHkOsMMzI4DG5J0u8xdtaXIFxqBbTCVgFs0lyKCUL1Xj6B3S-hBBU86JvIatOocTmZUEdy8dkTwrQS1l3oz9FyYa1B_UrKNg8W7aJLE1hxM_ZFBdcx-mzJ0tWbG_N9dK5f601lyteje0NPLcMq_SOEWOw8DOZZhclY4cRBQVpl7O-s Jul 19 22:39:13.090686 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:39:13.090686 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:39:13.090686 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:39:13.090686 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:39:13.090686 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:39:13.090686 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:39:13.090686 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 994ee0e2b71b4eff88a19b70351ada06 Jul 19 22:39:13.090686 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ListImageFiltersTestJSON-1278338687 Jul 19 22:39:13.090686 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:39:13.090686 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:39:13.092809 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_994ee0e2b71b4eff88a19b70351ada06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/994ee0e2b71b4eff88a19b70351ada06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/994ee0e2b71b4eff88a19b70351ada06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/994ee0e2b71b4eff88a19b70351ada06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:39:13.092809 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ListImageFiltersTestJSON-1278338687 Jul 19 22:39:13.092809 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 994ee0e2b71b4eff88a19b70351ada06 Jul 19 22:39:13.092809 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1278338687 Jul 19 22:39:13.092809 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ListImageFiltersTestJSON-1278338687-project Jul 19 22:39:13.092809 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:39:13.092809 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:39:13.092809 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1cdcb86f99184c839022f5f19d730e9a Jul 19 22:39:13.092809 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ListImageFiltersTestJSON-1278338687-project Jul 19 22:39:13.092809 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:39:13.092809 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 7a846129-bc22-4520-bd5b-d33fcd0a94a2 could not be found. Jul 19 22:39:13.092809 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '7a846129-bc22-4520-bd5b-d33fcd0a94a2'} Jul 19 22:39:13.093562 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:39:13.093562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:13.093562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:39:13.093562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:39:13.093562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:39:13.093562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:39:13.093562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:39:13.093562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:39:13.093562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:39:13.093562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:39:13.093562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a846129-bc22-4520-bd5b-d33fcd0a94a2 could not be found. Jul 19 22:39:13.093562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:13.093562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:13.093562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:13.093562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:13.093562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:13.093562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:13.093562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:39:13.093562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:39:13.093562 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:39:13.094692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:39:13.094692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:39:13.094692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:39:13.094692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:39:13.094692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:39:13.094692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:39:13.094692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:39:13.094692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a846129-bc22-4520-bd5b-d33fcd0a94a2 could not be found. Jul 19 22:39:13.094692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:13.094692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:13.094692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:13.094692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:13.094692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:13.094692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:13.094692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:39:13.094692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:39:13.094692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a846129-bc22-4520-bd5b-d33fcd0a94a2 could not be found. Jul 19 22:39:13.094692 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:13.097575 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-58a98e52-bb87-4924-937a-e6746f26fa90 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Returning 404 to user: Instance 7a846129-bc22-4520-bd5b-d33fcd0a94a2 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:39:13.098489 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-58a98e52-bb87-4924-937a-e6746f26fa90 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2" status: 404 len: 111 microversion: 2.1 time: 0.049299 Jul 19 22:39:13.100219 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1352/2738] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:13 2022] GET /compute/v2.1/servers/7a846129-bc22-4520-bd5b-d33fcd0a94a2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:39:13.121994 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6f7dfb65-69b8-4c16-85b6-5abc6aa4c175 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "POST /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889/action" status: 202 len: 0 microversion: 2.1 time: 0.610595 Jul 19 22:39:13.123546 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1387/2739] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:39:12 2022] POST /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889/action => generated 0 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 22:39:13.123775 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-be2f8ab4-9db8-4139-ba3d-7ee10314b74e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:13.124389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-be2f8ab4-9db8-4139-ba3d-7ee10314b74e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: bf0396df-c757-4ec7-9697-e71026a34525] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:13.143460 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1ad582b0-67b3-4f12-ab76-8df8e9f72d4f tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a037d0c10>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:13.144607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be2f8ab4-9db8-4139-ba3d-7ee10314b74e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:13.145084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be2f8ab4-9db8-4139-ba3d-7ee10314b74e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:13.147060 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be2f8ab4-9db8-4139-ba3d-7ee10314b74e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:13.149779 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be2f8ab4-9db8-4139-ba3d-7ee10314b74e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:13.228931 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-be2f8ab4-9db8-4139-ba3d-7ee10314b74e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: bf0396df-c757-4ec7-9697-e71026a34525] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:39:13.234348 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1ad582b0-67b3-4f12-ab76-8df8e9f72d4f tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba" status: 200 len: 1423 microversion: 2.1 time: 0.103064 Jul 19 22:39:13.235474 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1388/2740] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:39:13 2022] GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba => generated 1423 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:13.417834 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9874cf6a-6020-4a4b-9a83-bff0446d2b79 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:13.418724 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9874cf6a-6020-4a4b-9a83-bff0446d2b79 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9177ec40-9593-42f5-97ad-d896faeb9e83] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:13.431861 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9874cf6a-6020-4a4b-9a83-bff0446d2b79 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:13.432424 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9874cf6a-6020-4a4b-9a83-bff0446d2b79 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:13.433317 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9874cf6a-6020-4a4b-9a83-bff0446d2b79 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:13.434007 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9874cf6a-6020-4a4b-9a83-bff0446d2b79 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:13.458108 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-be2f8ab4-9db8-4139-ba3d-7ee10314b74e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bf0396df-c757-4ec7-9697-e71026a34525" status: 204 len: 0 microversion: 2.1 time: 0.347754 Jul 19 22:39:13.461178 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1353/2741] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:39:13 2022] DELETE /compute/v2.1/servers/bf0396df-c757-4ec7-9697-e71026a34525 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:39:13.506831 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eb857fba-b3dd-4167-ada6-43adf6f07af5 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:13.507964 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eb857fba-b3dd-4167-ada6-43adf6f07af5 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: bf0396df-c757-4ec7-9697-e71026a34525] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:13.518018 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb857fba-b3dd-4167-ada6-43adf6f07af5 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:13.518851 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb857fba-b3dd-4167-ada6-43adf6f07af5 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:13.520469 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb857fba-b3dd-4167-ada6-43adf6f07af5 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:13.522225 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb857fba-b3dd-4167-ada6-43adf6f07af5 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:14.028974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-eb857fba-b3dd-4167-ada6-43adf6f07af5 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdcb86f99184c839022f5f19d730e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '994ee0e2b71b4eff88a19b70351ada06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:14.044229 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eb857fba-b3dd-4167-ada6-43adf6f07af5 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/bf0396df-c757-4ec7-9697-e71026a34525" status: 200 len: 1472 microversion: 2.1 time: 0.573405 Jul 19 22:39:14.058689 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9874cf6a-6020-4a4b-9a83-bff0446d2b79 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:14.091789 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1354/2742] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:13 2022] GET /compute/v2.1/servers/bf0396df-c757-4ec7-9697-e71026a34525 => generated 1472 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:14.102799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-cc9b2c8f-72a1-4319-b6a6-046ad2f0e086 req-5a0abf30-cbbd-4944-990e-54fee5f0c1c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f51c52b-0d6b-40bd-9b31-ad0a91304d78", "name": "network-vif-deleted", "tag": "a67ebbd2-ea44-45b3-a0d8-ad47909966a4"}, {"name": "network-changed", "server_uuid": "9177ec40-9593-42f5-97ad-d896faeb9e83", "tag": "4379fd27-7b08-49a2-9149-3f70f318cfb0"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:39:14.108216 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9874cf6a-6020-4a4b-9a83-bff0446d2b79 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83" status: 200 len: 1315 microversion: 2.1 time: 0.693721 Jul 19 22:39:14.137101 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1389/2743] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:13 2022] GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83 => generated 1315 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:14.151264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-cc9b2c8f-72a1-4319-b6a6-046ad2f0e086 req-5a0abf30-cbbd-4944-990e-54fee5f0c1c9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:14.152062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-cc9b2c8f-72a1-4319-b6a6-046ad2f0e086 req-5a0abf30-cbbd-4944-990e-54fee5f0c1c9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:14.153202 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ba03debb-a94f-4b69-abcb-99711844fd1c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:14.154449 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ba03debb-a94f-4b69-abcb-99711844fd1c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:14.190829 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba03debb-a94f-4b69-abcb-99711844fd1c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:14.198751 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba03debb-a94f-4b69-abcb-99711844fd1c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:14.205502 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba03debb-a94f-4b69-abcb-99711844fd1c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:14.221424 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba03debb-a94f-4b69-abcb-99711844fd1c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:14.233126 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-cc9b2c8f-72a1-4319-b6a6-046ad2f0e086 req-5a0abf30-cbbd-4944-990e-54fee5f0c1c9 service nova] Creating event network-vif-deleted:a67ebbd2-ea44-45b3-a0d8-ad47909966a4 for instance 8f51c52b-0d6b-40bd-9b31-ad0a91304d78 on n-h1-847009-3 Jul 19 22:39:14.237548 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-cc9b2c8f-72a1-4319-b6a6-046ad2f0e086 req-5a0abf30-cbbd-4944-990e-54fee5f0c1c9 service nova] Creating event network-changed:4379fd27-7b08-49a2-9149-3f70f318cfb0 for instance 9177ec40-9593-42f5-97ad-d896faeb9e83 on n-h1-847009-3 Jul 19 22:39:14.266018 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-cc9b2c8f-72a1-4319-b6a6-046ad2f0e086 req-5a0abf30-cbbd-4944-990e-54fee5f0c1c9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.172052 Jul 19 22:39:14.271615 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1355/2744] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:39:14.288071 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-37fe9fc2-cbc1-47c4-95ef-9cabda4840f0 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a15576040>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:14.392709 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-37fe9fc2-cbc1-47c4-95ef-9cabda4840f0 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba" status: 200 len: 1423 microversion: 2.1 time: 0.119473 Jul 19 22:39:14.407505 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1356/2745] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:39:14 2022] GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba => generated 1423 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:14.773445 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ba03debb-a94f-4b69-abcb-99711844fd1c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:14.787710 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ba03debb-a94f-4b69-abcb-99711844fd1c tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1516 microversion: 2.1 time: 0.646610 Jul 19 22:39:14.788956 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1390/2746] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:14 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1516 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:15.092060 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2049fdb4-d040-4f8c-97c8-bf95917e2d30 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:15.093724 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2049fdb4-d040-4f8c-97c8-bf95917e2d30 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: bf0396df-c757-4ec7-9697-e71026a34525] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:15.125110 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2049fdb4-d040-4f8c-97c8-bf95917e2d30 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:15.126394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2049fdb4-d040-4f8c-97c8-bf95917e2d30 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:15.127426 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2049fdb4-d040-4f8c-97c8-bf95917e2d30 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:15.128042 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2049fdb4-d040-4f8c-97c8-bf95917e2d30 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:15.143615 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-441447d7-fa01-4035-b985-8b3e0e357b6f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:15.144255 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-441447d7-fa01-4035-b985-8b3e0e357b6f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9177ec40-9593-42f5-97ad-d896faeb9e83] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:15.161296 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-441447d7-fa01-4035-b985-8b3e0e357b6f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:15.162394 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-441447d7-fa01-4035-b985-8b3e0e357b6f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:15.163393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-441447d7-fa01-4035-b985-8b3e0e357b6f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:15.164035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-441447d7-fa01-4035-b985-8b3e0e357b6f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:15.508221 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2049fdb4-d040-4f8c-97c8-bf95917e2d30 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdcb86f99184c839022f5f19d730e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '994ee0e2b71b4eff88a19b70351ada06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:15.527202 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2049fdb4-d040-4f8c-97c8-bf95917e2d30 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/bf0396df-c757-4ec7-9697-e71026a34525" status: 200 len: 1472 microversion: 2.1 time: 0.439833 Jul 19 22:39:15.529187 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1357/2747] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:15 2022] GET /compute/v2.1/servers/bf0396df-c757-4ec7-9697-e71026a34525 => generated 1472 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:15.542356 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f1ed9d53-6ca2-42de-84a1-ce3e0dba916c tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a155ac4c0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:15.619856 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f1ed9d53-6ca2-42de-84a1-ce3e0dba916c tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba" status: 200 len: 1423 microversion: 2.1 time: 0.088443 Jul 19 22:39:15.620886 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1358/2748] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:39:15 2022] GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba => generated 1423 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:15.692084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-441447d7-fa01-4035-b985-8b3e0e357b6f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:15.728607 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-441447d7-fa01-4035-b985-8b3e0e357b6f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83" status: 200 len: 1315 microversion: 2.1 time: 0.592125 Jul 19 22:39:15.731039 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1391/2749] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:15 2022] GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83 => generated 1315 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:15.807368 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e762a88e-821b-48bc-b88e-71a3425b1910 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:15.808377 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e762a88e-821b-48bc-b88e-71a3425b1910 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:15.828558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e762a88e-821b-48bc-b88e-71a3425b1910 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:15.829327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e762a88e-821b-48bc-b88e-71a3425b1910 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:15.830349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e762a88e-821b-48bc-b88e-71a3425b1910 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:15.830813 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e762a88e-821b-48bc-b88e-71a3425b1910 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:16.548010 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e147095d-5fc3-4ec8-9ba6-7a5c88519f2e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:16.548666 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e147095d-5fc3-4ec8-9ba6-7a5c88519f2e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: bf0396df-c757-4ec7-9697-e71026a34525] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:16.568803 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e147095d-5fc3-4ec8-9ba6-7a5c88519f2e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:16.569829 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e147095d-5fc3-4ec8-9ba6-7a5c88519f2e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:16.572885 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e147095d-5fc3-4ec8-9ba6-7a5c88519f2e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:16.573936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e147095d-5fc3-4ec8-9ba6-7a5c88519f2e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:17.257224 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e762a88e-821b-48bc-b88e-71a3425b1910 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:17.301918 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e762a88e-821b-48bc-b88e-71a3425b1910 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1516 microversion: 2.1 time: 1.499466 Jul 19 22:39:17.314295 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1359/2750] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:15 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1516 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:17.327633 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a581202b-1982-4f2a-9c62-5481adc82718 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a15551af0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:17.436656 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a581202b-1982-4f2a-9c62-5481adc82718 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba" status: 200 len: 1423 microversion: 2.1 time: 0.120047 Jul 19 22:39:17.441259 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1360/2751] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:39:17 2022] GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba => generated 1423 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:17.458882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-05a59166-6606-4c1e-adf5-043625575453 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:17.463299 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-05a59166-6606-4c1e-adf5-043625575453 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9177ec40-9593-42f5-97ad-d896faeb9e83] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:17.472828 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05a59166-6606-4c1e-adf5-043625575453 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:17.473608 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05a59166-6606-4c1e-adf5-043625575453 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:17.474600 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05a59166-6606-4c1e-adf5-043625575453 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:17.475316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05a59166-6606-4c1e-adf5-043625575453 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:18.065008 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e147095d-5fc3-4ec8-9ba6-7a5c88519f2e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdcb86f99184c839022f5f19d730e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '994ee0e2b71b4eff88a19b70351ada06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:18.126855 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e147095d-5fc3-4ec8-9ba6-7a5c88519f2e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/bf0396df-c757-4ec7-9697-e71026a34525" status: 200 len: 1472 microversion: 2.1 time: 1.582024 Jul 19 22:39:18.136315 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1392/2752] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:16 2022] GET /compute/v2.1/servers/bf0396df-c757-4ec7-9697-e71026a34525 => generated 1472 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:39:18.237380 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-05a59166-6606-4c1e-adf5-043625575453 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:18.253296 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-05a59166-6606-4c1e-adf5-043625575453 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83" status: 200 len: 1315 microversion: 2.1 time: 0.810622 Jul 19 22:39:18.276661 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1361/2753] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:17 2022] GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83 => generated 1315 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:18.291825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-30ca4ed6-587e-4a74-8445-6fc0cd0efc8a tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:18.292247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-30ca4ed6-587e-4a74-8445-6fc0cd0efc8a tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 8f51c52b-0d6b-40bd-9b31-ad0a91304d78] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:18.304740 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-30ca4ed6-587e-4a74-8445-6fc0cd0efc8a tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:18.309532 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-30ca4ed6-587e-4a74-8445-6fc0cd0efc8a tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:18.312387 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-30ca4ed6-587e-4a74-8445-6fc0cd0efc8a tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:18.316100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-30ca4ed6-587e-4a74-8445-6fc0cd0efc8a tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:18.324869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7e6a9b85-179a-4b57-9065-79230eb2526b tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:18.325753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7e6a9b85-179a-4b57-9065-79230eb2526b tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:18.339736 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e6a9b85-179a-4b57-9065-79230eb2526b tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:18.340191 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e6a9b85-179a-4b57-9065-79230eb2526b tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:18.341022 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e6a9b85-179a-4b57-9065-79230eb2526b tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:18.343955 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e6a9b85-179a-4b57-9065-79230eb2526b tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:18.423493 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-30ca4ed6-587e-4a74-8445-6fc0cd0efc8a tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] HTTP exception thrown: Instance 8f51c52b-0d6b-40bd-9b31-ad0a91304d78 could not be found. Jul 19 22:39:18.429560 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-30ca4ed6-587e-4a74-8445-6fc0cd0efc8a tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Request method failure captured: Jul 19 22:39:18.429560 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78 HTTP/1.1 Jul 19 22:39:18.429560 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:39:18.429560 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:39:18.429560 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:39:18.429560 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:39:18.429560 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:39:18.429560 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:39:18.429560 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:39:18.429560 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:39:18.429560 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zIJuD9a7KRX8Xp_Rx1DyMj4h_N9HwvmQHmJanbA4zf-tGlm9LBOAyWsMng3Zi6orJapbZv-F1fCOtEk2TbM2K1_vXSwDtLqsWNYLByCj4mYByOtvzpIdyKl4xrRWtXiU-LaV38yd4SQDOXPdcT2ZQ3GazbpgQ4iT8EVuriu-toTiHU Jul 19 22:39:18.429560 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:39:18.429560 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:39:18.429560 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:39:18.429560 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:39:18.429560 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:39:18.429560 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:39:18.429560 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 0f375b652401428bb916ce1f5b04b622 Jul 19 22:39:18.429560 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersTestMultiNic-1913922030 Jul 19 22:39:18.429560 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:39:18.429560 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:39:18.431151 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f375b652401428bb916ce1f5b04b622"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f375b652401428bb916ce1f5b04b622"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f375b652401428bb916ce1f5b04b622"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f375b652401428bb916ce1f5b04b622"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:39:18.431151 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersTestMultiNic-1913922030 Jul 19 22:39:18.431151 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 0f375b652401428bb916ce1f5b04b622 Jul 19 22:39:18.431151 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersTestMultiNic-1913922030 Jul 19 22:39:18.431151 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersTestMultiNic-1913922030-project Jul 19 22:39:18.431151 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:39:18.431151 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:39:18.431151 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: d4b3fc46823645a6842433476c0e9b26 Jul 19 22:39:18.431151 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersTestMultiNic-1913922030-project Jul 19 22:39:18.431151 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:39:18.431151 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 8f51c52b-0d6b-40bd-9b31-ad0a91304d78 could not be found. Jul 19 22:39:18.431151 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '8f51c52b-0d6b-40bd-9b31-ad0a91304d78'} Jul 19 22:39:18.432001 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:39:18.432001 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:18.432001 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:39:18.432001 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:39:18.432001 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:39:18.432001 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:39:18.432001 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:39:18.432001 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:39:18.432001 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:39:18.432001 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:39:18.432001 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f51c52b-0d6b-40bd-9b31-ad0a91304d78 could not be found. Jul 19 22:39:18.432001 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:18.432001 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:18.432001 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:18.432001 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:18.432001 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:18.432001 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:18.432001 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:39:18.432001 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:39:18.432001 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:39:18.433201 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:39:18.433201 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:39:18.433201 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:39:18.433201 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:39:18.433201 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:39:18.433201 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:39:18.433201 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:39:18.433201 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:39:18.433201 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:39:18.433201 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f51c52b-0d6b-40bd-9b31-ad0a91304d78 could not be found. Jul 19 22:39:18.433201 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:18.433201 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:18.433201 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:18.433201 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:18.433201 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:18.433201 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:18.433201 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:39:18.433201 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:39:18.433201 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f51c52b-0d6b-40bd-9b31-ad0a91304d78 could not be found. Jul 19 22:39:18.433201 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:18.434566 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-30ca4ed6-587e-4a74-8445-6fc0cd0efc8a tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Returning 404 to user: Instance 8f51c52b-0d6b-40bd-9b31-ad0a91304d78 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:39:18.446008 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-30ca4ed6-587e-4a74-8445-6fc0cd0efc8a tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78" status: 404 len: 111 microversion: 2.1 time: 0.158307 Jul 19 22:39:18.451049 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1393/2754] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:39:18 2022] DELETE /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:39:18.472949 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2f366b05-3846-47c8-b75f-4fb210371790 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a03814f70>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:19.581160 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7e6a9b85-179a-4b57-9065-79230eb2526b tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:19.600004 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7e6a9b85-179a-4b57-9065-79230eb2526b tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1516 microversion: 2.1 time: 1.279597 Jul 19 22:39:19.614765 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1362/2755] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:18 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1516 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:39:19.626076 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3a413874-afaf-436b-999f-f0618c1f5910 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:19.626970 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3a413874-afaf-436b-999f-f0618c1f5910 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 8f51c52b-0d6b-40bd-9b31-ad0a91304d78] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:19.635392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3a413874-afaf-436b-999f-f0618c1f5910 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:19.636129 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3a413874-afaf-436b-999f-f0618c1f5910 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:19.637100 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3a413874-afaf-436b-999f-f0618c1f5910 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:19.638270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3a413874-afaf-436b-999f-f0618c1f5910 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:19.680749 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-3a413874-afaf-436b-999f-f0618c1f5910 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] HTTP exception thrown: Instance 8f51c52b-0d6b-40bd-9b31-ad0a91304d78 could not be found. Jul 19 22:39:19.685512 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3a413874-afaf-436b-999f-f0618c1f5910 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Request method failure captured: Jul 19 22:39:19.685512 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78 HTTP/1.1 Jul 19 22:39:19.685512 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:39:19.685512 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:39:19.685512 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:39:19.685512 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:39:19.685512 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:39:19.685512 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:39:19.685512 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:39:19.685512 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:39:19.685512 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zIJuD9a7KRX8Xp_Rx1DyMj4h_N9HwvmQHmJanbA4zf-tGlm9LBOAyWsMng3Zi6orJapbZv-F1fCOtEk2TbM2K1_vXSwDtLqsWNYLByCj4mYByOtvzpIdyKl4xrRWtXiU-LaV38yd4SQDOXPdcT2ZQ3GazbpgQ4iT8EVuriu-toTiHU Jul 19 22:39:19.685512 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:39:19.685512 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:39:19.685512 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:39:19.685512 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:39:19.685512 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:39:19.685512 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:39:19.685512 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 0f375b652401428bb916ce1f5b04b622 Jul 19 22:39:19.685512 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersTestMultiNic-1913922030 Jul 19 22:39:19.685512 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:39:19.685512 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:39:19.687221 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f375b652401428bb916ce1f5b04b622"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f375b652401428bb916ce1f5b04b622"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f375b652401428bb916ce1f5b04b622"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f375b652401428bb916ce1f5b04b622"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:39:19.687221 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersTestMultiNic-1913922030 Jul 19 22:39:19.687221 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 0f375b652401428bb916ce1f5b04b622 Jul 19 22:39:19.687221 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersTestMultiNic-1913922030 Jul 19 22:39:19.687221 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersTestMultiNic-1913922030-project Jul 19 22:39:19.687221 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:39:19.687221 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:39:19.687221 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: d4b3fc46823645a6842433476c0e9b26 Jul 19 22:39:19.687221 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersTestMultiNic-1913922030-project Jul 19 22:39:19.687221 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:39:19.687221 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 8f51c52b-0d6b-40bd-9b31-ad0a91304d78 could not be found. Jul 19 22:39:19.687221 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '8f51c52b-0d6b-40bd-9b31-ad0a91304d78'} Jul 19 22:39:19.688087 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:39:19.688087 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:19.688087 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:39:19.688087 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:39:19.688087 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:39:19.688087 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:39:19.688087 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:39:19.688087 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:39:19.688087 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:39:19.688087 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:39:19.688087 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f51c52b-0d6b-40bd-9b31-ad0a91304d78 could not be found. Jul 19 22:39:19.688087 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:19.688087 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:19.688087 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:19.688087 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:19.688087 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:19.688087 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:19.688087 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:39:19.688087 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:39:19.688087 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:39:19.689477 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:39:19.689477 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:39:19.689477 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:39:19.689477 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:39:19.689477 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:39:19.689477 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:39:19.689477 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:39:19.689477 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f51c52b-0d6b-40bd-9b31-ad0a91304d78 could not be found. Jul 19 22:39:19.689477 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:19.689477 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:19.689477 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:19.689477 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:19.689477 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:19.689477 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:19.689477 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:39:19.689477 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:39:19.689477 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f51c52b-0d6b-40bd-9b31-ad0a91304d78 could not be found. Jul 19 22:39:19.689477 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:19.695574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3a413874-afaf-436b-999f-f0618c1f5910 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Returning 404 to user: Instance 8f51c52b-0d6b-40bd-9b31-ad0a91304d78 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:39:19.698871 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3a413874-afaf-436b-999f-f0618c1f5910 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78" status: 404 len: 111 microversion: 2.1 time: 0.082715 Jul 19 22:39:19.702294 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1363/2756] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:19 2022] GET /compute/v2.1/servers/8f51c52b-0d6b-40bd-9b31-ad0a91304d78 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:39:19.711484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-13e3bf38-aee0-4607-a7d4-89b7985f1f8e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:19.712399 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-13e3bf38-aee0-4607-a7d4-89b7985f1f8e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: bf0396df-c757-4ec7-9697-e71026a34525] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:19.736015 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13e3bf38-aee0-4607-a7d4-89b7985f1f8e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:19.736668 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13e3bf38-aee0-4607-a7d4-89b7985f1f8e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:19.737615 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13e3bf38-aee0-4607-a7d4-89b7985f1f8e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:19.738206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13e3bf38-aee0-4607-a7d4-89b7985f1f8e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:19.855689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-13e3bf38-aee0-4607-a7d4-89b7985f1f8e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdcb86f99184c839022f5f19d730e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '994ee0e2b71b4eff88a19b70351ada06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:19.867280 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-13e3bf38-aee0-4607-a7d4-89b7985f1f8e tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/bf0396df-c757-4ec7-9697-e71026a34525" status: 200 len: 1430 microversion: 2.1 time: 0.162894 Jul 19 22:39:19.868509 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1364/2757] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:19 2022] GET /compute/v2.1/servers/bf0396df-c757-4ec7-9697-e71026a34525 => generated 1430 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:19.874128 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-52602f35-5abf-43cd-9587-2460d827c47b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:19.875219 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-52602f35-5abf-43cd-9587-2460d827c47b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9177ec40-9593-42f5-97ad-d896faeb9e83] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:19.882086 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52602f35-5abf-43cd-9587-2460d827c47b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:19.882892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52602f35-5abf-43cd-9587-2460d827c47b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:19.883934 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52602f35-5abf-43cd-9587-2460d827c47b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:19.884605 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52602f35-5abf-43cd-9587-2460d827c47b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:20.417020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-52602f35-5abf-43cd-9587-2460d827c47b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:20.452722 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-52602f35-5abf-43cd-9587-2460d827c47b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83" status: 200 len: 1315 microversion: 2.1 time: 0.572252 Jul 19 22:39:20.464302 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1365/2758] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:19 2022] GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83 => generated 1315 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:20.475196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2fd9fa91-be8f-4826-8fa3-51ca34f6dea1 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:20.478392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2fd9fa91-be8f-4826-8fa3-51ca34f6dea1 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:20.506601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:39:20.515157 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fd9fa91-be8f-4826-8fa3-51ca34f6dea1 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:20.530368 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fd9fa91-be8f-4826-8fa3-51ca34f6dea1 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:20.532703 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fd9fa91-be8f-4826-8fa3-51ca34f6dea1 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:20.535679 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fd9fa91-be8f-4826-8fa3-51ca34f6dea1 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:20.612489 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-2fd9fa91-be8f-4826-8fa3-51ca34f6dea1 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] HTTP exception thrown: Instance 68ea88aa-1db0-490d-a791-5abd31245b37 could not be found. Jul 19 22:39:20.619620 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2fd9fa91-be8f-4826-8fa3-51ca34f6dea1 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Request method failure captured: Jul 19 22:39:20.619620 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 HTTP/1.1 Jul 19 22:39:20.619620 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:39:20.619620 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:39:20.619620 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:39:20.619620 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:39:20.619620 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:39:20.619620 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:39:20.619620 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:39:20.619620 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:39:20.619620 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zIJuD9a7KRX8Xp_Rx1DyMj4h_N9HwvmQHmJanbA4zf-tGlm9LBOAyWsMng3Zi6orJapbZv-F1fCOtEk2TbM2K1_vXSwDtLqsWNYLByCj4mYByOtvzpIdyKl4xrRWtXiU-LaV38yd4SQDOXPdcT2ZQ3GazbpgQ4iT8EVuriu-toTiHU Jul 19 22:39:20.619620 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:39:20.619620 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:39:20.619620 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:39:20.619620 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:39:20.619620 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:39:20.619620 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:39:20.619620 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 0f375b652401428bb916ce1f5b04b622 Jul 19 22:39:20.619620 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersTestMultiNic-1913922030 Jul 19 22:39:20.619620 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:39:20.619620 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:39:20.621479 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f375b652401428bb916ce1f5b04b622"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f375b652401428bb916ce1f5b04b622"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f375b652401428bb916ce1f5b04b622"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f375b652401428bb916ce1f5b04b622"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:39:20.621479 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersTestMultiNic-1913922030 Jul 19 22:39:20.621479 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 0f375b652401428bb916ce1f5b04b622 Jul 19 22:39:20.621479 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersTestMultiNic-1913922030 Jul 19 22:39:20.621479 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersTestMultiNic-1913922030-project Jul 19 22:39:20.621479 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:39:20.621479 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:39:20.621479 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: d4b3fc46823645a6842433476c0e9b26 Jul 19 22:39:20.621479 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersTestMultiNic-1913922030-project Jul 19 22:39:20.621479 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:39:20.621479 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 68ea88aa-1db0-490d-a791-5abd31245b37 could not be found. Jul 19 22:39:20.621479 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '68ea88aa-1db0-490d-a791-5abd31245b37'} Jul 19 22:39:20.623317 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:39:20.623317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:20.623317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:39:20.623317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:39:20.623317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:39:20.623317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:39:20.623317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:39:20.623317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:39:20.623317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:39:20.623317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:39:20.623317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68ea88aa-1db0-490d-a791-5abd31245b37 could not be found. Jul 19 22:39:20.623317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:20.623317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:20.623317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:20.623317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:20.623317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:20.623317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:20.623317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:39:20.623317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:39:20.623317 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:39:20.627546 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:39:20.627546 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:39:20.627546 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:39:20.627546 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:39:20.627546 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:39:20.627546 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:39:20.627546 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:39:20.627546 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:39:20.627546 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:39:20.627546 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68ea88aa-1db0-490d-a791-5abd31245b37 could not be found. Jul 19 22:39:20.627546 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:20.627546 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:20.627546 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:20.627546 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:20.627546 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:20.627546 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:20.627546 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:39:20.627546 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:39:20.627546 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68ea88aa-1db0-490d-a791-5abd31245b37 could not be found. Jul 19 22:39:20.627546 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:20.630569 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2fd9fa91-be8f-4826-8fa3-51ca34f6dea1 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Returning 404 to user: Instance 68ea88aa-1db0-490d-a791-5abd31245b37 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:39:20.630569 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2fd9fa91-be8f-4826-8fa3-51ca34f6dea1 tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "DELETE /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 404 len: 111 microversion: 2.1 time: 0.155838 Jul 19 22:39:20.630569 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1366/2759] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:39:20 2022] DELETE /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:39:20.642636 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-3333a0da-12af-4463-88fc-87b5d7686c48 req-fe00abbe-e9c9-4a85-8609-cf3a5be9b819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf0396df-c757-4ec7-9697-e71026a34525", "name": "network-vif-deleted", "tag": "80ac4ef8-2707-46cd-8487-6e07db74d986"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:39:20.674654 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-3333a0da-12af-4463-88fc-87b5d7686c48 req-fe00abbe-e9c9-4a85-8609-cf3a5be9b819 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:20.680773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-3333a0da-12af-4463-88fc-87b5d7686c48 req-fe00abbe-e9c9-4a85-8609-cf3a5be9b819 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:20.732879 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-3333a0da-12af-4463-88fc-87b5d7686c48 req-fe00abbe-e9c9-4a85-8609-cf3a5be9b819 service nova] Creating event network-vif-deleted:80ac4ef8-2707-46cd-8487-6e07db74d986 for instance bf0396df-c757-4ec7-9697-e71026a34525 on n-h1-847009-3 Jul 19 22:39:20.760319 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-3333a0da-12af-4463-88fc-87b5d7686c48 req-fe00abbe-e9c9-4a85-8609-cf3a5be9b819 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133839 Jul 19 22:39:20.763808 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1367/2760] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:39:20.793451 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2cef1218-bea5-448a-bbe2-8ded1d47b30e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:20.798961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2cef1218-bea5-448a-bbe2-8ded1d47b30e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:20.813711 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2cef1218-bea5-448a-bbe2-8ded1d47b30e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:20.815127 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2cef1218-bea5-448a-bbe2-8ded1d47b30e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:20.816423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2cef1218-bea5-448a-bbe2-8ded1d47b30e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:20.822580 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2cef1218-bea5-448a-bbe2-8ded1d47b30e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:20.863404 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:39:21.116154 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2cef1218-bea5-448a-bbe2-8ded1d47b30e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:21.127130 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2cef1218-bea5-448a-bbe2-8ded1d47b30e tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1516 microversion: 2.1 time: 0.361803 Jul 19 22:39:21.127725 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1368/2761] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:20 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1516 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:21.155213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e1be84b5-5346-47d4-b406-a53521c1813b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:21.158285 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e1be84b5-5346-47d4-b406-a53521c1813b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] [instance: 68ea88aa-1db0-490d-a791-5abd31245b37] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:21.189697 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e1be84b5-5346-47d4-b406-a53521c1813b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:21.190178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e1be84b5-5346-47d4-b406-a53521c1813b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:21.193545 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e1be84b5-5346-47d4-b406-a53521c1813b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:21.194096 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e1be84b5-5346-47d4-b406-a53521c1813b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:21.235895 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-e1be84b5-5346-47d4-b406-a53521c1813b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] HTTP exception thrown: Instance 68ea88aa-1db0-490d-a791-5abd31245b37 could not be found. Jul 19 22:39:21.244245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e1be84b5-5346-47d4-b406-a53521c1813b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Request method failure captured: Jul 19 22:39:21.244245 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 HTTP/1.1 Jul 19 22:39:21.244245 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:39:21.244245 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:39:21.244245 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:39:21.244245 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:39:21.244245 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:39:21.244245 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:39:21.244245 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:39:21.244245 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:39:21.244245 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zIJuD9a7KRX8Xp_Rx1DyMj4h_N9HwvmQHmJanbA4zf-tGlm9LBOAyWsMng3Zi6orJapbZv-F1fCOtEk2TbM2K1_vXSwDtLqsWNYLByCj4mYByOtvzpIdyKl4xrRWtXiU-LaV38yd4SQDOXPdcT2ZQ3GazbpgQ4iT8EVuriu-toTiHU Jul 19 22:39:21.244245 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:39:21.244245 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:39:21.244245 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:39:21.244245 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:39:21.244245 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:39:21.244245 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:39:21.244245 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 0f375b652401428bb916ce1f5b04b622 Jul 19 22:39:21.244245 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersTestMultiNic-1913922030 Jul 19 22:39:21.244245 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:39:21.244245 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:39:21.245689 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f375b652401428bb916ce1f5b04b622"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f375b652401428bb916ce1f5b04b622"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f375b652401428bb916ce1f5b04b622"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f375b652401428bb916ce1f5b04b622"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:39:21.245689 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersTestMultiNic-1913922030 Jul 19 22:39:21.245689 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 0f375b652401428bb916ce1f5b04b622 Jul 19 22:39:21.245689 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersTestMultiNic-1913922030 Jul 19 22:39:21.245689 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersTestMultiNic-1913922030-project Jul 19 22:39:21.245689 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:39:21.245689 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:39:21.245689 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: d4b3fc46823645a6842433476c0e9b26 Jul 19 22:39:21.245689 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersTestMultiNic-1913922030-project Jul 19 22:39:21.245689 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:39:21.245689 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 68ea88aa-1db0-490d-a791-5abd31245b37 could not be found. Jul 19 22:39:21.245689 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '68ea88aa-1db0-490d-a791-5abd31245b37'} Jul 19 22:39:21.246435 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:39:21.246435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:21.246435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:39:21.246435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:39:21.246435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:39:21.246435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:39:21.246435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:39:21.246435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:39:21.246435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:39:21.246435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:39:21.246435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68ea88aa-1db0-490d-a791-5abd31245b37 could not be found. Jul 19 22:39:21.246435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:21.246435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:21.246435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:21.246435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:21.246435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:21.246435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:21.246435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:39:21.246435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:39:21.246435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:39:21.247768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:39:21.247768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:39:21.247768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:39:21.247768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:39:21.247768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:39:21.247768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:39:21.247768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:39:21.247768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68ea88aa-1db0-490d-a791-5abd31245b37 could not be found. Jul 19 22:39:21.247768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:21.247768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:21.247768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:21.247768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:21.247768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:21.247768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:21.247768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:39:21.247768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:39:21.247768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68ea88aa-1db0-490d-a791-5abd31245b37 could not be found. Jul 19 22:39:21.247768 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:21.249293 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e1be84b5-5346-47d4-b406-a53521c1813b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] Returning 404 to user: Instance 68ea88aa-1db0-490d-a791-5abd31245b37 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:39:21.251374 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e1be84b5-5346-47d4-b406-a53521c1813b tempest-ServersTestMultiNic-1913922030 tempest-ServersTestMultiNic-1913922030-project] 10.222.0.25 "GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37" status: 404 len: 111 microversion: 2.1 time: 0.110918 Jul 19 22:39:21.256309 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1369/2762] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:21 2022] GET /compute/v2.1/servers/68ea88aa-1db0-490d-a791-5abd31245b37 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:39:21.268171 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8b81e271-003d-41a5-8b1b-8fedf02a86de tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:21.268816 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8b81e271-003d-41a5-8b1b-8fedf02a86de tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] [instance: bf0396df-c757-4ec7-9697-e71026a34525] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:21.286045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b81e271-003d-41a5-8b1b-8fedf02a86de tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:21.286564 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b81e271-003d-41a5-8b1b-8fedf02a86de tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:21.287330 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b81e271-003d-41a5-8b1b-8fedf02a86de tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:21.287773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b81e271-003d-41a5-8b1b-8fedf02a86de tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:21.313311 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-8b81e271-003d-41a5-8b1b-8fedf02a86de tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] HTTP exception thrown: Instance bf0396df-c757-4ec7-9697-e71026a34525 could not be found. Jul 19 22:39:21.314990 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8b81e271-003d-41a5-8b1b-8fedf02a86de tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Request method failure captured: Jul 19 22:39:21.314990 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/bf0396df-c757-4ec7-9697-e71026a34525 HTTP/1.1 Jul 19 22:39:21.314990 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:39:21.314990 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:39:21.314990 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:39:21.314990 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:39:21.314990 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:39:21.314990 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:39:21.314990 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:39:21.314990 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:39:21.314990 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zHkOsMMzI4DG5J0u8xdtaXIFxqBbTCVgFs0lyKCUL1Xj6B3S-hBBU86JvIatOocTmZUEdy8dkTwrQS1l3oz9FyYa1B_UrKNg8W7aJLE1hxM_ZFBdcx-mzJ0tWbG_N9dK5f601lyteje0NPLcMq_SOEWOw8DOZZhclY4cRBQVpl7O-s Jul 19 22:39:21.314990 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:39:21.314990 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:39:21.314990 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:39:21.314990 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:39:21.314990 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:39:21.314990 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:39:21.314990 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 994ee0e2b71b4eff88a19b70351ada06 Jul 19 22:39:21.314990 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ListImageFiltersTestJSON-1278338687 Jul 19 22:39:21.314990 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:39:21.314990 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:39:21.317380 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_994ee0e2b71b4eff88a19b70351ada06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/994ee0e2b71b4eff88a19b70351ada06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/994ee0e2b71b4eff88a19b70351ada06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/994ee0e2b71b4eff88a19b70351ada06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:39:21.317380 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ListImageFiltersTestJSON-1278338687 Jul 19 22:39:21.317380 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 994ee0e2b71b4eff88a19b70351ada06 Jul 19 22:39:21.317380 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1278338687 Jul 19 22:39:21.317380 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ListImageFiltersTestJSON-1278338687-project Jul 19 22:39:21.317380 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:39:21.317380 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:39:21.317380 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1cdcb86f99184c839022f5f19d730e9a Jul 19 22:39:21.317380 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ListImageFiltersTestJSON-1278338687-project Jul 19 22:39:21.317380 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:39:21.317380 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance bf0396df-c757-4ec7-9697-e71026a34525 could not be found. Jul 19 22:39:21.317380 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'bf0396df-c757-4ec7-9697-e71026a34525'} Jul 19 22:39:21.319381 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:39:21.319381 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:21.319381 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:39:21.319381 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:39:21.319381 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:39:21.319381 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:39:21.319381 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:39:21.319381 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:39:21.319381 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:39:21.319381 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:39:21.319381 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf0396df-c757-4ec7-9697-e71026a34525 could not be found. Jul 19 22:39:21.319381 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:21.319381 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:21.319381 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:21.319381 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:21.319381 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:21.319381 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:21.319381 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:39:21.319381 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:39:21.319381 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:39:21.323183 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:39:21.323183 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:39:21.323183 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:39:21.323183 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:39:21.323183 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:39:21.323183 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:39:21.323183 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:39:21.323183 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf0396df-c757-4ec7-9697-e71026a34525 could not be found. Jul 19 22:39:21.323183 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:21.323183 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:21.323183 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:21.323183 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:21.323183 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:21.323183 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:21.323183 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:39:21.323183 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:39:21.323183 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf0396df-c757-4ec7-9697-e71026a34525 could not be found. Jul 19 22:39:21.323183 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:21.327956 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8b81e271-003d-41a5-8b1b-8fedf02a86de tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Returning 404 to user: Instance bf0396df-c757-4ec7-9697-e71026a34525 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:39:21.327956 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8b81e271-003d-41a5-8b1b-8fedf02a86de tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "GET /compute/v2.1/servers/bf0396df-c757-4ec7-9697-e71026a34525" status: 404 len: 111 microversion: 2.1 time: 0.059283 Jul 19 22:39:21.327956 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1370/2763] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:21 2022] GET /compute/v2.1/servers/bf0396df-c757-4ec7-9697-e71026a34525 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:39:21.327956 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-99ce3433-2ddd-4d7a-85ec-3b97fe460c62 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a15576dc0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:24.593210 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-99ce3433-2ddd-4d7a-85ec-3b97fe460c62 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "DELETE /compute/v2.1/images/8dcbbe7c-675b-4c98-abb1-4ae1f952d3df" status: 204 len: 0 microversion: 2.1 time: 3.271662 Jul 19 22:39:24.598567 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1371/2764] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:21 2022] DELETE /compute/v2.1/images/8dcbbe7c-675b-4c98-abb1-4ae1f952d3df => generated 0 bytes in 3274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:39:24.611147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-415c170a-5afe-4e54-887e-0852c72684c6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:24.613053 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-415c170a-5afe-4e54-887e-0852c72684c6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9177ec40-9593-42f5-97ad-d896faeb9e83] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:24.627918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-415c170a-5afe-4e54-887e-0852c72684c6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:24.628739 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-415c170a-5afe-4e54-887e-0852c72684c6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:24.629889 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-415c170a-5afe-4e54-887e-0852c72684c6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:24.630899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-415c170a-5afe-4e54-887e-0852c72684c6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:24.656137 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2f366b05-3846-47c8-b75f-4fb210371790 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba" status: 200 len: 1423 microversion: 2.1 time: 6.195575 Jul 19 22:39:24.656766 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1394/2765] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:39:18 2022] GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba => generated 1423 bytes in 6206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:24.666430 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3d053baf-11b0-4f45-94ad-25ef670e468d tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:24.667001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3d053baf-11b0-4f45-94ad-25ef670e468d tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:24.688446 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d053baf-11b0-4f45-94ad-25ef670e468d tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:24.688917 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d053baf-11b0-4f45-94ad-25ef670e468d tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:24.689938 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d053baf-11b0-4f45-94ad-25ef670e468d tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:24.690553 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d053baf-11b0-4f45-94ad-25ef670e468d tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:24.941115 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-415c170a-5afe-4e54-887e-0852c72684c6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:24.956291 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-415c170a-5afe-4e54-887e-0852c72684c6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83" status: 200 len: 1315 microversion: 2.1 time: 0.356000 Jul 19 22:39:24.962236 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1372/2766] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:24 2022] GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83 => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:24.970237 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-02fff4a9-e1a4-4b4f-8fce-c9f61642eedd req-0fbb1e06-e5da-41c8-a45f-2597f178fdd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9177ec40-9593-42f5-97ad-d896faeb9e83", "name": "network-vif-plugged", "status": "completed", "tag": "4379fd27-7b08-49a2-9149-3f70f318cfb0"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:39:24.983819 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-02fff4a9-e1a4-4b4f-8fce-c9f61642eedd req-0fbb1e06-e5da-41c8-a45f-2597f178fdd4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:24.984934 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-02fff4a9-e1a4-4b4f-8fce-c9f61642eedd req-0fbb1e06-e5da-41c8-a45f-2597f178fdd4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:25.005316 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-02fff4a9-e1a4-4b4f-8fce-c9f61642eedd req-0fbb1e06-e5da-41c8-a45f-2597f178fdd4 service nova] Creating event network-vif-plugged:4379fd27-7b08-49a2-9149-3f70f318cfb0 for instance 9177ec40-9593-42f5-97ad-d896faeb9e83 on n-h1-847009-3 Jul 19 22:39:25.011992 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-02fff4a9-e1a4-4b4f-8fce-c9f61642eedd req-0fbb1e06-e5da-41c8-a45f-2597f178fdd4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047028 Jul 19 22:39:25.013794 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1373/2767] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:39:25.023717 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c8d9ec05-d231-4946-9046-ec30fd11b5c6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:25.025759 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c8d9ec05-d231-4946-9046-ec30fd11b5c6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:25.036056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c8d9ec05-d231-4946-9046-ec30fd11b5c6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:25.037042 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c8d9ec05-d231-4946-9046-ec30fd11b5c6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:25.038109 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c8d9ec05-d231-4946-9046-ec30fd11b5c6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:25.038761 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c8d9ec05-d231-4946-9046-ec30fd11b5c6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:25.103490 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3d053baf-11b0-4f45-94ad-25ef670e468d tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:25.121799 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3d053baf-11b0-4f45-94ad-25ef670e468d tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1516 microversion: 2.1 time: 0.464007 Jul 19 22:39:25.123520 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1395/2768] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:24 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1516 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:25.474782 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cbc7392f-180b-4b67-bf4b-537b318c1152 tempest-FloatingIPsNegativeTestJSON-1717752116 tempest-FloatingIPsNegativeTestJSON-1717752116-project] Calling method '.version_select at 0x7f7a039c40d0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:25.532197 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c8d9ec05-d231-4946-9046-ec30fd11b5c6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:25.544620 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c8d9ec05-d231-4946-9046-ec30fd11b5c6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1681 microversion: 2.1 time: 0.526880 Jul 19 22:39:25.557066 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1374/2769] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:25 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1681 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:25.562644 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b4de465a-198b-4131-a824-1240b9786c69 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a1563f3a0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:25.627397 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cbc7392f-180b-4b67-bf4b-537b318c1152 tempest-FloatingIPsNegativeTestJSON-1717752116 tempest-FloatingIPsNegativeTestJSON-1717752116-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.502474 Jul 19 22:39:25.627993 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1396/2770] 10.222.0.25 () {58 vars in 1148 bytes} [Tue Jul 19 22:39:25 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:39:25.641104 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3a0d1ba1-e9b1-4b1e-b706-276e102aa4da tempest-FloatingIPsNegativeTestJSON-1717752116 tempest-FloatingIPsNegativeTestJSON-1717752116-project] Action: 'create', calling method: .version_select at 0x7f7a037f3790>, body: {"pool": "non_exist_pool"} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:39:25.755995 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-3a0d1ba1-e9b1-4b1e-b706-276e102aa4da tempest-FloatingIPsNegativeTestJSON-1717752116 tempest-FloatingIPsNegativeTestJSON-1717752116-project] HTTP exception thrown: Floating IP pool not found. Jul 19 22:39:25.758786 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3a0d1ba1-e9b1-4b1e-b706-276e102aa4da tempest-FloatingIPsNegativeTestJSON-1717752116 tempest-FloatingIPsNegativeTestJSON-1717752116-project] Request method failure captured: Jul 19 22:39:25.758786 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 19 22:39:25.758786 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:39:25.758786 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:39:25.758786 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:39:25.758786 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 26 Jul 19 22:39:25.758786 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:39:25.758786 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:39:25.758786 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:39:25.758786 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:39:25.758786 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zKbbjrzHRPuVTob-F2r4PXjI6giElcRYChZFv-rr9Ll8JsIpTToyHeznT4lKnkKE3UCoNTcqvll-bV0x5Bc-B9O9piYeCgAB2xq1AdF8-YL3qjKBcIgxnRnyA8dslNWIezB9zkTErMN0XIpgZqYOT5zdqSUr1ml6vdNTlXuODdkLss Jul 19 22:39:25.758786 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:39:25.758786 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:39:25.758786 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:39:25.758786 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:39:25.758786 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:39:25.758786 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:39:25.758786 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 1e2ec962d4d94cf1a21131ad3e9ee815 Jul 19 22:39:25.758786 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1717752116 Jul 19 22:39:25.758786 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:39:25.758786 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:39:25.761061 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e2ec962d4d94cf1a21131ad3e9ee815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e2ec962d4d94cf1a21131ad3e9ee815"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e2ec962d4d94cf1a21131ad3e9ee815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e2ec962d4d94cf1a21131ad3e9ee815"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:39:25.761061 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1717752116 Jul 19 22:39:25.761061 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 1e2ec962d4d94cf1a21131ad3e9ee815 Jul 19 22:39:25.761061 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1717752116 Jul 19 22:39:25.761061 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-FloatingIPsNegativeTestJSON-1717752116-project Jul 19 22:39:25.761061 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:39:25.761061 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:39:25.761061 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: fd46b1b0699f414280896d2b193b919b Jul 19 22:39:25.761061 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1717752116-project Jul 19 22:39:25.761061 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:39:25.761061 n-d-847009-3 devstack@n-api.service[119338]: {"pool": "non_exist_pool"} Jul 19 22:39:25.761061 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:39:25.761061 n-d-847009-3 devstack@n-api.service[119338]: exception: Floating IP pool not found. Jul 19 22:39:25.761061 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 19 22:39:25.761061 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:39:25.763355 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:25.763355 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 19 22:39:25.763355 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 19 22:39:25.763355 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 19 22:39:25.763355 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 19 22:39:25.763355 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 19 22:39:25.763355 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 19 22:39:25.763355 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 19 22:39:25.763355 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:25.763355 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:25.763355 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:25.763355 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:25.763355 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:25.763355 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:25.763355 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:39:25.763355 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:39:25.763355 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:39:25.763355 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:39:25.763355 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:39:25.763355 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:39:25.765442 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 19 22:39:25.765442 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:39:25.765442 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 19 22:39:25.765442 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:25.765442 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:25.765442 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:25.765442 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:25.765442 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:25.765442 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:25.765442 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:39:25.765442 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:39:25.765442 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 19 22:39:25.765442 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:25.765442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3a0d1ba1-e9b1-4b1e-b706-276e102aa4da tempest-FloatingIPsNegativeTestJSON-1717752116 tempest-FloatingIPsNegativeTestJSON-1717752116-project] Returning 404 to user: Floating IP pool not found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:39:25.765442 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3a0d1ba1-e9b1-4b1e-b706-276e102aa4da tempest-FloatingIPsNegativeTestJSON-1717752116 tempest-FloatingIPsNegativeTestJSON-1717752116-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.124289 Jul 19 22:39:25.768668 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1397/2771] 10.222.0.25 () {60 vars in 1169 bytes} [Tue Jul 19 22:39:25 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 19 22:39:25.782275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-162fb0b5-b3e9-4d83-87e4-0fe658650e1a tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a037ed8b0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:26.418229 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b4de465a-198b-4131-a824-1240b9786c69 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "DELETE /compute/v2.1/images/fdde4761-e615-430b-a69a-0a19db33957f" status: 204 len: 0 microversion: 2.1 time: 0.859150 Jul 19 22:39:26.420198 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1375/2772] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:25 2022] DELETE /compute/v2.1/images/fdde4761-e615-430b-a69a-0a19db33957f => generated 0 bytes in 862 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:39:26.430590 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2bb6208d-4209-4b9d-9931-8b3ef74729c0 tempest-FloatingIPsNegativeTestJSON-1717752116 tempest-FloatingIPsNegativeTestJSON-1717752116-project] Calling method '.version_select at 0x7f7a156a75e0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:26.518356 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-162fb0b5-b3e9-4d83-87e4-0fe658650e1a tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba" status: 200 len: 1423 microversion: 2.1 time: 0.755670 Jul 19 22:39:26.522571 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1398/2773] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:39:25 2022] GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba => generated 1423 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:26.527575 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-36c151ea-a3fb-422d-a2d9-f8fbc90966b2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:26.542936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-36c151ea-a3fb-422d-a2d9-f8fbc90966b2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9177ec40-9593-42f5-97ad-d896faeb9e83] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:26.564208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-36c151ea-a3fb-422d-a2d9-f8fbc90966b2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:26.571354 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-36c151ea-a3fb-422d-a2d9-f8fbc90966b2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:26.574489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG neutronclient.v2_0.client [None req-2bb6208d-4209-4b9d-9931-8b3ef74729c0 tempest-FloatingIPsNegativeTestJSON-1717752116 tempest-FloatingIPsNegativeTestJSON-1717752116-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP cdab35d3-2539-4366-9beb-177124ba0789 could not be found", "detail": ""}} {{(pid=119337) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 22:39:26.576026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-36c151ea-a3fb-422d-a2d9-f8fbc90966b2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:26.576309 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-2bb6208d-4209-4b9d-9931-8b3ef74729c0 tempest-FloatingIPsNegativeTestJSON-1717752116 tempest-FloatingIPsNegativeTestJSON-1717752116-project] HTTP exception thrown: Floating IP not found for ID cdab35d3-2539-4366-9beb-177124ba0789 Jul 19 22:39:26.576669 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-36c151ea-a3fb-422d-a2d9-f8fbc90966b2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:26.579003 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2bb6208d-4209-4b9d-9931-8b3ef74729c0 tempest-FloatingIPsNegativeTestJSON-1717752116 tempest-FloatingIPsNegativeTestJSON-1717752116-project] Request method failure captured: Jul 19 22:39:26.579003 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/os-floating-ips/cdab35d3-2539-4366-9beb-177124ba0789 HTTP/1.1 Jul 19 22:39:26.579003 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:39:26.579003 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:39:26.579003 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:39:26.579003 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:39:26.579003 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:39:26.579003 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:39:26.579003 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:39:26.579003 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:39:26.579003 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zKbbjrzHRPuVTob-F2r4PXjI6giElcRYChZFv-rr9Ll8JsIpTToyHeznT4lKnkKE3UCoNTcqvll-bV0x5Bc-B9O9piYeCgAB2xq1AdF8-YL3qjKBcIgxnRnyA8dslNWIezB9zkTErMN0XIpgZqYOT5zdqSUr1ml6vdNTlXuODdkLss Jul 19 22:39:26.579003 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:39:26.579003 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:39:26.579003 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:39:26.579003 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:39:26.579003 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:39:26.579003 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:39:26.579003 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 1e2ec962d4d94cf1a21131ad3e9ee815 Jul 19 22:39:26.579003 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1717752116 Jul 19 22:39:26.579003 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:39:26.579003 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:39:26.580452 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e2ec962d4d94cf1a21131ad3e9ee815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e2ec962d4d94cf1a21131ad3e9ee815"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e2ec962d4d94cf1a21131ad3e9ee815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e2ec962d4d94cf1a21131ad3e9ee815"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:39:26.580452 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1717752116 Jul 19 22:39:26.580452 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 1e2ec962d4d94cf1a21131ad3e9ee815 Jul 19 22:39:26.580452 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1717752116 Jul 19 22:39:26.580452 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-FloatingIPsNegativeTestJSON-1717752116-project Jul 19 22:39:26.580452 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:39:26.580452 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:39:26.580452 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: fd46b1b0699f414280896d2b193b919b Jul 19 22:39:26.580452 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1717752116-project Jul 19 22:39:26.580452 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:39:26.580452 n-d-847009-3 devstack@n-api.service[119337]: exception: Floating IP not found for ID cdab35d3-2539-4366-9beb-177124ba0789 Jul 19 22:39:26.580452 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'cdab35d3-2539-4366-9beb-177124ba0789'} Jul 19 22:39:26.580452 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:39:26.581276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:26.581276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 19 22:39:26.581276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 19 22:39:26.581276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:39:26.581276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:39:26.581276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 19 22:39:26.581276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 19 22:39:26.581276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:39:26.581276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:39:26.581276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 22:39:26.581276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 22:39:26.581276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:39:26.581276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:39:26.581276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 22:39:26.581276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 22:39:26.581276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:39:26.581276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:39:26.581276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 22:39:26.581276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 22:39:26.582888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:39:26.582888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:39:26.582888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 22:39:26.582888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 22:39:26.582888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 22:39:26.582888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 22:39:26.582888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP cdab35d3-2539-4366-9beb-177124ba0789 could not be found Jul 19 22:39:26.582888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cbb18c59-75f5-43d7-b31b-2162696f900a'] Jul 19 22:39:26.582888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:26.582888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:26.582888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:26.582888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:26.582888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 19 22:39:26.582888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 19 22:39:26.582888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 19 22:39:26.582888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 19 22:39:26.582888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID cdab35d3-2539-4366-9beb-177124ba0789. Jul 19 22:39:26.582888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:26.582888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:26.582888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:26.587315 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:26.587315 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:26.587315 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:26.587315 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:39:26.587315 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:39:26.587315 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:39:26.587315 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:39:26.587315 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:39:26.587315 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:39:26.587315 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 19 22:39:26.587315 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 19 22:39:26.587315 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID cdab35d3-2539-4366-9beb-177124ba0789 Jul 19 22:39:26.587315 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:26.587315 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:26.587315 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:26.587315 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:26.587315 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:26.587315 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:26.587315 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:39:26.587315 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:39:26.590201 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID cdab35d3-2539-4366-9beb-177124ba0789 Jul 19 22:39:26.590201 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:26.590201 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2bb6208d-4209-4b9d-9931-8b3ef74729c0 tempest-FloatingIPsNegativeTestJSON-1717752116 tempest-FloatingIPsNegativeTestJSON-1717752116-project] Returning 404 to user: Floating IP not found for ID cdab35d3-2539-4366-9beb-177124ba0789 {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:39:26.590201 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2bb6208d-4209-4b9d-9931-8b3ef74729c0 tempest-FloatingIPsNegativeTestJSON-1717752116 tempest-FloatingIPsNegativeTestJSON-1717752116-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/cdab35d3-2539-4366-9beb-177124ba0789" status: 404 len: 111 microversion: 2.1 time: 0.159406 Jul 19 22:39:26.590201 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1376/2774] 10.222.0.25 () {58 vars in 1262 bytes} [Tue Jul 19 22:39:26 2022] DELETE /compute/v2.1/os-floating-ips/cdab35d3-2539-4366-9beb-177124ba0789 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:39:26.599637 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6359dac2-afac-4a46-8017-cafc83a5420a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:26.600356 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6359dac2-afac-4a46-8017-cafc83a5420a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:26.637130 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6359dac2-afac-4a46-8017-cafc83a5420a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:26.637871 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6359dac2-afac-4a46-8017-cafc83a5420a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:26.638739 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6359dac2-afac-4a46-8017-cafc83a5420a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:26.639561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6359dac2-afac-4a46-8017-cafc83a5420a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:27.365415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-36c151ea-a3fb-422d-a2d9-f8fbc90966b2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:27.370487 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6359dac2-afac-4a46-8017-cafc83a5420a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:27.379933 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6359dac2-afac-4a46-8017-cafc83a5420a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1516 microversion: 2.1 time: 0.797110 Jul 19 22:39:27.382057 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-36c151ea-a3fb-422d-a2d9-f8fbc90966b2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83" status: 200 len: 1315 microversion: 2.1 time: 0.856621 Jul 19 22:39:27.382695 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1377/2775] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:26 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1516 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:27.385169 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1399/2776] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:26 2022] GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83 => generated 1315 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:27.391067 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-42f02dfc-9ad2-4be0-b21f-eb43568ae4d0 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] Calling method '.version_select at 0x7f7a155acdc0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:27.406344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-595894bf-ccc8-443c-9aee-3e98d32b5292 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:27.406985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-595894bf-ccc8-443c-9aee-3e98d32b5292 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:27.426548 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-595894bf-ccc8-443c-9aee-3e98d32b5292 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:27.430430 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-595894bf-ccc8-443c-9aee-3e98d32b5292 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:27.433940 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-595894bf-ccc8-443c-9aee-3e98d32b5292 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:27.439969 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-595894bf-ccc8-443c-9aee-3e98d32b5292 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:28.037118 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-42f02dfc-9ad2-4be0-b21f-eb43568ae4d0 tempest-ListImageFiltersTestJSON-1278338687 tempest-ListImageFiltersTestJSON-1278338687-project] 10.222.0.25 "DELETE /compute/v2.1/images/3745c07b-c5d0-4785-9aaf-e35b51b6132d" status: 204 len: 0 microversion: 2.1 time: 0.652153 Jul 19 22:39:28.038985 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1378/2777] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:27 2022] DELETE /compute/v2.1/images/3745c07b-c5d0-4785-9aaf-e35b51b6132d => generated 0 bytes in 656 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:39:28.048366 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-a77a070e-0106-4692-8b4a-82174e27908f req-b0973c18-77ba-4869-8040-a377472f4bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b617584-f9bc-43a8-af3c-78546d0d9889", "name": "network-vif-plugged", "status": "completed", "tag": "3b3dc181-31be-470e-abec-b7a8478ff369"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:39:28.079918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a77a070e-0106-4692-8b4a-82174e27908f req-b0973c18-77ba-4869-8040-a377472f4bc8 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:28.083738 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a77a070e-0106-4692-8b4a-82174e27908f req-b0973c18-77ba-4869-8040-a377472f4bc8 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:28.125648 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-a77a070e-0106-4692-8b4a-82174e27908f req-b0973c18-77ba-4869-8040-a377472f4bc8 service nova] Creating event network-vif-plugged:3b3dc181-31be-470e-abec-b7a8478ff369 for instance 3b617584-f9bc-43a8-af3c-78546d0d9889 on n-h2-847009-3 Jul 19 22:39:28.143768 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-a77a070e-0106-4692-8b4a-82174e27908f req-b0973c18-77ba-4869-8040-a377472f4bc8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096067 Jul 19 22:39:28.145433 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1379/2778] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:39:28.151455 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f3a74636-766a-4b50-9c3d-24a793f5adda tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a156a7c10>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:28.250536 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f3a74636-766a-4b50-9c3d-24a793f5adda tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba" status: 200 len: 1423 microversion: 2.1 time: 0.103599 Jul 19 22:39:28.261725 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1380/2779] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:39:28 2022] GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba => generated 1423 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:28.399651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a57531b9-3243-49b5-a896-051d05b34248 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:28.400611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a57531b9-3243-49b5-a896-051d05b34248 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:28.415625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a57531b9-3243-49b5-a896-051d05b34248 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:28.421505 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a57531b9-3243-49b5-a896-051d05b34248 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:28.426096 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a57531b9-3243-49b5-a896-051d05b34248 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:28.427580 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a57531b9-3243-49b5-a896-051d05b34248 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:29.582847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-595894bf-ccc8-443c-9aee-3e98d32b5292 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:29.606043 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-595894bf-ccc8-443c-9aee-3e98d32b5292 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 2.219730 Jul 19 22:39:29.614380 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1400/2780] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:27 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 2227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:29.631035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cee458d4-08f3-41ae-9e24-87261e7f1354 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:29.632023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cee458d4-08f3-41ae-9e24-87261e7f1354 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9177ec40-9593-42f5-97ad-d896faeb9e83] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:29.673353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a57531b9-3243-49b5-a896-051d05b34248 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:29.702359 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a57531b9-3243-49b5-a896-051d05b34248 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1516 microversion: 2.1 time: 1.305750 Jul 19 22:39:29.712400 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cee458d4-08f3-41ae-9e24-87261e7f1354 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:29.716928 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cee458d4-08f3-41ae-9e24-87261e7f1354 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:29.717807 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1381/2781] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:28 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1516 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:39:29.724109 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cee458d4-08f3-41ae-9e24-87261e7f1354 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:29.727167 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cee458d4-08f3-41ae-9e24-87261e7f1354 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:29.732075 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-161cfc9e-ef22-4da5-afd3-9b4d7c7da5af tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a15551a60>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:29.874227 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-161cfc9e-ef22-4da5-afd3-9b4d7c7da5af tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba" status: 200 len: 1423 microversion: 2.1 time: 0.142255 Jul 19 22:39:29.875025 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1382/2782] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:39:29 2022] GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba => generated 1423 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:29.884540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c80e9c86-8b7d-479d-b88c-e475be37752b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-700433560"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:39:29.887500 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c80e9c86-8b7d-479d-b88c-e475be37752b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:29.926953 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c80e9c86-8b7d-479d-b88c-e475be37752b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:29.944654 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c80e9c86-8b7d-479d-b88c-e475be37752b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:29.945821 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c80e9c86-8b7d-479d-b88c-e475be37752b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:29.946294 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c80e9c86-8b7d-479d-b88c-e475be37752b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:30.920755 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c80e9c86-8b7d-479d-b88c-e475be37752b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action" status: 202 len: 0 microversion: 2.1 time: 1.043951 Jul 19 22:39:30.924620 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1383/2783] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:39:29 2022] POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action => generated 0 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 19 22:39:30.932255 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-5a7837de-9b49-4935-9425-1cb2a537c413 req-e97f0d73-327b-4b6e-8be3-aa0cdafaaa8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9ae7d22-3925-465a-9507-250b670ecc77", "name": "network-vif-unplugged", "status": "completed", "tag": "3196bd8c-6a69-4858-81a6-622d724377b1"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:39:30.951785 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-5a7837de-9b49-4935-9425-1cb2a537c413 req-e97f0d73-327b-4b6e-8be3-aa0cdafaaa8c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:30.952486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-5a7837de-9b49-4935-9425-1cb2a537c413 req-e97f0d73-327b-4b6e-8be3-aa0cdafaaa8c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:30.973902 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-5a7837de-9b49-4935-9425-1cb2a537c413 req-e97f0d73-327b-4b6e-8be3-aa0cdafaaa8c service nova] Creating event network-vif-unplugged:3196bd8c-6a69-4858-81a6-622d724377b1 for instance b9ae7d22-3925-465a-9507-250b670ecc77 on n-h2-847009-3 Jul 19 22:39:30.985990 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-5a7837de-9b49-4935-9425-1cb2a537c413 req-e97f0d73-327b-4b6e-8be3-aa0cdafaaa8c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057826 Jul 19 22:39:30.987312 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1384/2784] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:39:31.009461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-11f8ce31-66a3-494b-8809-882599b279a5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:31.018949 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-11f8ce31-66a3-494b-8809-882599b279a5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:31.051909 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-11f8ce31-66a3-494b-8809-882599b279a5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:31.052671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-11f8ce31-66a3-494b-8809-882599b279a5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:31.053650 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-11f8ce31-66a3-494b-8809-882599b279a5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:31.054242 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-11f8ce31-66a3-494b-8809-882599b279a5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:31.140348 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cee458d4-08f3-41ae-9e24-87261e7f1354 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:31.148649 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cee458d4-08f3-41ae-9e24-87261e7f1354 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83" status: 200 len: 1503 microversion: 2.1 time: 1.529682 Jul 19 22:39:31.163564 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1401/2785] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:29 2022] GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83 => generated 1503 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:31.207068 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c25f880a-e167-4ef7-bd7e-8d267673838f tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a03838790>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:31.321228 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c25f880a-e167-4ef7-bd7e-8d267673838f tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba" status: 200 len: 1423 microversion: 2.1 time: 0.146599 Jul 19 22:39:31.322197 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1402/2786] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:39:31 2022] GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba => generated 1423 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:32.296285 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-11f8ce31-66a3-494b-8809-882599b279a5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:32.337376 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-11f8ce31-66a3-494b-8809-882599b279a5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1516 microversion: 2.1 time: 1.345781 Jul 19 22:39:32.338409 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-536571bf-33e1-4da3-92d4-c09620df06e8 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a038ad700>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:32.353945 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1385/2787] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:30 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1516 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:32.532951 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-536571bf-33e1-4da3-92d4-c09620df06e8 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba" status: 200 len: 1423 microversion: 2.1 time: 0.196281 Jul 19 22:39:32.539319 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1403/2788] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:39:32 2022] GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba => generated 1423 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:33.362123 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-db5a60ea-95e6-4ebc-921c-01f3f38fc2cc tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:33.362748 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-db5a60ea-95e6-4ebc-921c-01f3f38fc2cc tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:33.383545 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db5a60ea-95e6-4ebc-921c-01f3f38fc2cc tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:33.384310 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db5a60ea-95e6-4ebc-921c-01f3f38fc2cc tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:33.385399 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db5a60ea-95e6-4ebc-921c-01f3f38fc2cc tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:33.389495 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db5a60ea-95e6-4ebc-921c-01f3f38fc2cc tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:33.560001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6e0902f0-9bdc-4665-b46e-75005d00570c tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a103b3c10>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:33.674966 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6e0902f0-9bdc-4665-b46e-75005d00570c tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba" status: 200 len: 1423 microversion: 2.1 time: 0.107099 Jul 19 22:39:33.679483 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1404/2789] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:39:33 2022] GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba => generated 1423 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:33.776881 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-db5a60ea-95e6-4ebc-921c-01f3f38fc2cc tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:33.795246 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-db5a60ea-95e6-4ebc-921c-01f3f38fc2cc tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1516 microversion: 2.1 time: 0.437449 Jul 19 22:39:33.801454 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1386/2790] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:33 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1516 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:34.695912 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-38b6edb3-e645-4a8a-a8c6-121d901ea156 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a037eddc0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:34.802779 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-38b6edb3-e645-4a8a-a8c6-121d901ea156 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba" status: 200 len: 1423 microversion: 2.1 time: 0.113527 Jul 19 22:39:34.815227 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1405/2791] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:39:34 2022] GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba => generated 1423 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:34.815475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ebe93f13-78b2-4b60-973e-0d20b6a3da6a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:34.816588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ebe93f13-78b2-4b60-973e-0d20b6a3da6a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:34.827909 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ebe93f13-78b2-4b60-973e-0d20b6a3da6a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:34.828731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ebe93f13-78b2-4b60-973e-0d20b6a3da6a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:34.831879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ebe93f13-78b2-4b60-973e-0d20b6a3da6a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:34.834235 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ebe93f13-78b2-4b60-973e-0d20b6a3da6a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:35.410516 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-49d5e008-e23b-4403-a8bf-5400ab034df1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0be8511-8b8e-421e-a097-1a5164a7b2c0"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:39:35.412672 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-49d5e008-e23b-4403-a8bf-5400ab034df1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9177ec40-9593-42f5-97ad-d896faeb9e83] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:35.437974 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49d5e008-e23b-4403-a8bf-5400ab034df1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:35.438453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49d5e008-e23b-4403-a8bf-5400ab034df1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:35.439308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49d5e008-e23b-4403-a8bf-5400ab034df1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:35.439762 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49d5e008-e23b-4403-a8bf-5400ab034df1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:35.473640 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ebe93f13-78b2-4b60-973e-0d20b6a3da6a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:35.489792 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ebe93f13-78b2-4b60-973e-0d20b6a3da6a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1516 microversion: 2.1 time: 0.676641 Jul 19 22:39:35.490763 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1387/2792] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:34 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1516 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:39:35.829976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1c2754e3-e3a4-4e17-a8c1-cb8784655f69 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a155c9ca0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:35.964896 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1c2754e3-e3a4-4e17-a8c1-cb8784655f69 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba" status: 200 len: 1423 microversion: 2.1 time: 0.142174 Jul 19 22:39:35.970518 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1388/2793] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:39:35 2022] GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba => generated 1423 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:39:36.244234 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-49d5e008-e23b-4403-a8bf-5400ab034df1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "POST /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.841458 Jul 19 22:39:36.245683 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1406/2794] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 19 22:39:35 2022] POST /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83/os-volume_attachments => generated 194 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:39:36.525534 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a22e4baa-067c-43d2-bc14-5ac7251553e6 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:36.527336 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a22e4baa-067c-43d2-bc14-5ac7251553e6 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:36.556213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a22e4baa-067c-43d2-bc14-5ac7251553e6 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:36.570458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a22e4baa-067c-43d2-bc14-5ac7251553e6 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:36.571847 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a22e4baa-067c-43d2-bc14-5ac7251553e6 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:36.572714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a22e4baa-067c-43d2-bc14-5ac7251553e6 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:37.198506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-41838e8e-e7df-43b8-813c-d6270dc36143 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-483663341", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "a8a98231-b043-4f20-9ab5-9cf2216d3ed0"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:39:37.602186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a22e4baa-067c-43d2-bc14-5ac7251553e6 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:37.656079 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a22e4baa-067c-43d2-bc14-5ac7251553e6 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1516 microversion: 2.1 time: 1.148839 Jul 19 22:39:37.670168 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1389/2795] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:36 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1516 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:37.699529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fb2eacf7-1049-470f-ba23-3e73aae49941 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a156a7ee0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:44.300479 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-41838e8e-e7df-43b8-813c-d6270dc36143 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] validate_networks() for [('a8a98231-b043-4f20-9ab5-9cf2216d3ed0', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:39:44.328240 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fb2eacf7-1049-470f-ba23-3e73aae49941 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba" status: 200 len: 1432 microversion: 2.1 time: 6.655768 Jul 19 22:39:44.328846 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1390/2796] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:39:37 2022] GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba => generated 1432 bytes in 6658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:44.333708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-45e2330f-db55-41aa-95da-9936fb905e93 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:44.334336 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-45e2330f-db55-41aa-95da-9936fb905e93 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:44.363855 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45e2330f-db55-41aa-95da-9936fb905e93 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:44.364313 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45e2330f-db55-41aa-95da-9936fb905e93 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:44.365113 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45e2330f-db55-41aa-95da-9936fb905e93 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:44.365560 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45e2330f-db55-41aa-95da-9936fb905e93 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:45.374897 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-45e2330f-db55-41aa-95da-9936fb905e93 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:45.393966 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-45e2330f-db55-41aa-95da-9936fb905e93 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1522 microversion: 2.1 time: 1.063989 Jul 19 22:39:45.405392 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1391/2797] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:44 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1522 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:45.416605 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-2caedece-1ab0-4426-97a4-73a3c7404570 req-d2b8122a-aaf7-4025-a689-cd470abea728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9ae7d22-3925-465a-9507-250b670ecc77", "name": "network-vif-plugged", "status": "completed", "tag": "3196bd8c-6a69-4858-81a6-622d724377b1"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:39:45.443507 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-2caedece-1ab0-4426-97a4-73a3c7404570 req-d2b8122a-aaf7-4025-a689-cd470abea728 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:45.444711 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-2caedece-1ab0-4426-97a4-73a3c7404570 req-d2b8122a-aaf7-4025-a689-cd470abea728 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:45.481936 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-2caedece-1ab0-4426-97a4-73a3c7404570 req-d2b8122a-aaf7-4025-a689-cd470abea728 service nova] Creating event network-vif-plugged:3196bd8c-6a69-4858-81a6-622d724377b1 for instance b9ae7d22-3925-465a-9507-250b670ecc77 on n-h2-847009-3 Jul 19 22:39:45.501926 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-2caedece-1ab0-4426-97a4-73a3c7404570 req-d2b8122a-aaf7-4025-a689-cd470abea728 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091565 Jul 19 22:39:45.505306 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1392/2798] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:39:45.953594 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9ff2f2b5-6949-4d21-8055-7f18238d5a75 tempest-ImagesDeleteNegativeTestJSON-360427823 tempest-ImagesDeleteNegativeTestJSON-360427823-project] 10.222.0.25 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.446584 Jul 19 22:39:45.954647 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1393/2799] 10.222.0.25 () {58 vars in 1127 bytes} [Tue Jul 19 22:39:45 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 448 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 19 22:39:45.970417 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-30f16bdb-4bb8-4ae2-990d-81a5a712b743 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a155ac4c0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:46.086847 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-30f16bdb-4bb8-4ae2-990d-81a5a712b743 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba" status: 200 len: 1432 microversion: 2.1 time: 0.130902 Jul 19 22:39:46.087636 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1394/2800] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:39:45 2022] GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba => generated 1432 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:46.096554 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b48620af-1aa3-4ebe-937f-773c81276d52 tempest-ImagesDeleteNegativeTestJSON-360427823 tempest-ImagesDeleteNegativeTestJSON-360427823-project] Calling method '.version_select at 0x7f7a155c9af0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:46.165802 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-b48620af-1aa3-4ebe-937f-773c81276d52 tempest-ImagesDeleteNegativeTestJSON-360427823 tempest-ImagesDeleteNegativeTestJSON-360427823-project] HTTP exception thrown: Image not found. Jul 19 22:39:46.168229 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b48620af-1aa3-4ebe-937f-773c81276d52 tempest-ImagesDeleteNegativeTestJSON-360427823 tempest-ImagesDeleteNegativeTestJSON-360427823-project] Request method failure captured: Jul 19 22:39:46.168229 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 19 22:39:46.168229 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:39:46.168229 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:39:46.168229 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:39:46.168229 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:39:46.168229 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:39:46.168229 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:39:46.168229 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:39:46.168229 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:39:46.168229 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zKuqpaaLT0YuSHciT747G-pcfj4GAnTS0349fT_CYBBejpgq-Zb3pgopsDy6Jxoe16cVhWMkB66FT69dv2Tx2dVARLMeZyNYrswO2bd3itWNBPiX6D77WKSSXuoquQW-ASWd-s3WclYrRstzG_4zbQQfjJDuStQSez5ImT4R6CJaQU Jul 19 22:39:46.168229 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:39:46.168229 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:39:46.168229 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:39:46.168229 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:39:46.168229 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:39:46.168229 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:39:46.168229 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: fd1c6538a69b4c5f943d3ef9d91971a1 Jul 19 22:39:46.168229 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-360427823 Jul 19 22:39:46.168229 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:39:46.168229 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:39:46.170440 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fd1c6538a69b4c5f943d3ef9d91971a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd1c6538a69b4c5f943d3ef9d91971a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fd1c6538a69b4c5f943d3ef9d91971a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd1c6538a69b4c5f943d3ef9d91971a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:39:46.170440 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-360427823 Jul 19 22:39:46.170440 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: fd1c6538a69b4c5f943d3ef9d91971a1 Jul 19 22:39:46.170440 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-360427823 Jul 19 22:39:46.170440 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ImagesDeleteNegativeTestJSON-360427823-project Jul 19 22:39:46.170440 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:39:46.170440 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:39:46.170440 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: eb0a047f23d54d6cbae3e736535c4a17 Jul 19 22:39:46.170440 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-360427823-project Jul 19 22:39:46.170440 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:39:46.170440 n-d-847009-3 devstack@n-api.service[119337]: exception: Image not found. Jul 19 22:39:46.170440 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '-1'} Jul 19 22:39:46.170440 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:39:46.170440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:46.171366 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 22:39:46.171366 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 22:39:46.171366 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:39:46.171366 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:39:46.171366 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:39:46.171366 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:39:46.171366 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 22:39:46.171366 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 22:39:46.171366 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 22:39:46.171366 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 22:39:46.171366 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:39:46.171366 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:39:46.171366 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:39:46.171366 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:39:46.171366 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 19 22:39:46.171366 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:46.171366 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:46.171366 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:46.171366 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:46.173921 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 22:39:46.173921 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 22:39:46.173921 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 22:39:46.173921 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 22:39:46.173921 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 22:39:46.173921 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 22:39:46.173921 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 19 22:39:46.173921 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:46.173921 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:46.173921 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:46.173921 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:46.173921 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:46.173921 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:46.173921 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:39:46.173921 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:39:46.173921 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:39:46.173921 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:39:46.173921 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:39:46.173921 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:39:46.173921 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 22:39:46.176654 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 22:39:46.176654 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 22:39:46.176654 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:46.176654 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:46.176654 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:46.176654 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:46.176654 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:46.176654 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:46.176654 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:39:46.176654 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:39:46.176654 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 22:39:46.176654 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:46.180899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b48620af-1aa3-4ebe-937f-773c81276d52 tempest-ImagesDeleteNegativeTestJSON-360427823 tempest-ImagesDeleteNegativeTestJSON-360427823-project] Returning 404 to user: Image not found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:39:46.182315 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b48620af-1aa3-4ebe-937f-773c81276d52 tempest-ImagesDeleteNegativeTestJSON-360427823 tempest-ImagesDeleteNegativeTestJSON-360427823-project] 10.222.0.25 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.092642 Jul 19 22:39:46.183663 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1395/2801] 10.222.0.25 () {58 vars in 1133 bytes} [Tue Jul 19 22:39:46 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:39:46.205182 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-52f52bc7-bead-433a-bdec-62896a38452f tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:46.206681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-52f52bc7-bead-433a-bdec-62896a38452f tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] [instance: 3b617584-f9bc-43a8-af3c-78546d0d9889] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:46.222163 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:39:46.227284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52f52bc7-bead-433a-bdec-62896a38452f tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:46.228136 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52f52bc7-bead-433a-bdec-62896a38452f tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:46.230300 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52f52bc7-bead-433a-bdec-62896a38452f tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:46.232274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52f52bc7-bead-433a-bdec-62896a38452f tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:46.622927 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-41838e8e-e7df-43b8-813c-d6270dc36143 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:39:46.623984 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-41838e8e-e7df-43b8-813c-d6270dc36143 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:39:46.623984 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-41838e8e-e7df-43b8-813c-d6270dc36143 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:39:46.624225 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-41838e8e-e7df-43b8-813c-d6270dc36143 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:39:46.624639 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-41838e8e-e7df-43b8-813c-d6270dc36143 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:39:46.629478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=32 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:39:46.646495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-41838e8e-e7df-43b8-813c-d6270dc36143 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:46.647149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-41838e8e-e7df-43b8-813c-d6270dc36143 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:46.648166 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-41838e8e-e7df-43b8-813c-d6270dc36143 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:46.649849 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-41838e8e-e7df-43b8-813c-d6270dc36143 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:46.771145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-41838e8e-e7df-43b8-813c-d6270dc36143 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Getting quotas for project 1b633041d58845d1a6d0b9f31f3613d4. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:39:46.771145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-41838e8e-e7df-43b8-813c-d6270dc36143 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Getting quotas for user 0631675f80674534b1e775e521cfea10 and project 1b633041d58845d1a6d0b9f31f3613d4. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:39:46.806745 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-41838e8e-e7df-43b8-813c-d6270dc36143 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:39:46.809961 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-41838e8e-e7df-43b8-813c-d6270dc36143 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 976f2ec1-c70b-4795-a71d-251bed15ad25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:39:46.890065 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-41838e8e-e7df-43b8-813c-d6270dc36143 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.020093 Jul 19 22:39:46.901432 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1407/2802] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:39:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 10033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:39:46.926020 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bbbcda55-9a32-4386-9e01-f224e1876204 tempest-ImagesDeleteNegativeTestJSON-360427823 tempest-ImagesDeleteNegativeTestJSON-360427823-project] Calling method '.version_select at 0x7f7a03838040>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:47.052446 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-bbbcda55-9a32-4386-9e01-f224e1876204 tempest-ImagesDeleteNegativeTestJSON-360427823 tempest-ImagesDeleteNegativeTestJSON-360427823-project] HTTP exception thrown: Image not found. Jul 19 22:39:47.056163 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bbbcda55-9a32-4386-9e01-f224e1876204 tempest-ImagesDeleteNegativeTestJSON-360427823 tempest-ImagesDeleteNegativeTestJSON-360427823-project] Request method failure captured: Jul 19 22:39:47.056163 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/images/ba0d33d6-bf4f-4139-a89e-9965a4d01ecj HTTP/1.1 Jul 19 22:39:47.056163 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:39:47.056163 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:39:47.056163 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:39:47.056163 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:39:47.056163 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:39:47.056163 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:39:47.056163 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:39:47.056163 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:39:47.056163 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zKuqpaaLT0YuSHciT747G-pcfj4GAnTS0349fT_CYBBejpgq-Zb3pgopsDy6Jxoe16cVhWMkB66FT69dv2Tx2dVARLMeZyNYrswO2bd3itWNBPiX6D77WKSSXuoquQW-ASWd-s3WclYrRstzG_4zbQQfjJDuStQSez5ImT4R6CJaQU Jul 19 22:39:47.056163 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:39:47.056163 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:39:47.056163 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:39:47.056163 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:39:47.056163 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:39:47.056163 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:39:47.056163 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: fd1c6538a69b4c5f943d3ef9d91971a1 Jul 19 22:39:47.056163 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-360427823 Jul 19 22:39:47.056163 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:39:47.056163 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:39:47.060628 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fd1c6538a69b4c5f943d3ef9d91971a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd1c6538a69b4c5f943d3ef9d91971a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fd1c6538a69b4c5f943d3ef9d91971a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd1c6538a69b4c5f943d3ef9d91971a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:39:47.060628 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-360427823 Jul 19 22:39:47.060628 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: fd1c6538a69b4c5f943d3ef9d91971a1 Jul 19 22:39:47.060628 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-360427823 Jul 19 22:39:47.060628 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesDeleteNegativeTestJSON-360427823-project Jul 19 22:39:47.060628 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:39:47.060628 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:39:47.060628 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: eb0a047f23d54d6cbae3e736535c4a17 Jul 19 22:39:47.060628 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-360427823-project Jul 19 22:39:47.060628 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:39:47.060628 n-d-847009-3 devstack@n-api.service[119338]: exception: Image not found. Jul 19 22:39:47.060628 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'ba0d33d6-bf4f-4139-a89e-9965a4d01ecj'} Jul 19 22:39:47.060628 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:39:47.064761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:47.064761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 22:39:47.064761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 22:39:47.064761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:39:47.064761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:39:47.064761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:39:47.064761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:39:47.064761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 22:39:47.064761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 22:39:47.064761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 22:39:47.064761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 22:39:47.064761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:39:47.064761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:39:47.064761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:39:47.064761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:39:47.064761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ba0d33d6-bf4f-4139-a89e-9965a4d01ecj to delete Jul 19 22:39:47.064761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:47.064761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:47.064761 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:47.067804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:47.067804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 22:39:47.067804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 22:39:47.067804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 22:39:47.067804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 22:39:47.067804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 22:39:47.067804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 22:39:47.067804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ba0d33d6-bf4f-4139-a89e-9965a4d01ecj could not be found. Jul 19 22:39:47.067804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:47.067804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:47.067804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:47.067804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:47.067804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:47.067804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:47.067804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:39:47.067804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:39:47.067804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:39:47.067804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:39:47.067804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:39:47.067804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:39:47.076942 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 22:39:47.076942 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 22:39:47.076942 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 22:39:47.076942 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:47.076942 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:47.076942 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:47.076942 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:47.076942 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:47.076942 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:47.076942 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:39:47.076942 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:39:47.076942 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 22:39:47.076942 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:47.076942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bbbcda55-9a32-4386-9e01-f224e1876204 tempest-ImagesDeleteNegativeTestJSON-360427823 tempest-ImagesDeleteNegativeTestJSON-360427823-project] Returning 404 to user: Image not found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:39:47.076942 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bbbcda55-9a32-4386-9e01-f224e1876204 tempest-ImagesDeleteNegativeTestJSON-360427823 tempest-ImagesDeleteNegativeTestJSON-360427823-project] 10.222.0.25 "DELETE /compute/v2.1/images/ba0d33d6-bf4f-4139-a89e-9965a4d01ecj" status: 404 len: 62 microversion: 2.1 time: 0.155222 Jul 19 22:39:47.078945 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1408/2803] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:46 2022] DELETE /compute/v2.1/images/ba0d33d6-bf4f-4139-a89e-9965a4d01ecj => generated 62 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:39:47.080921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-07986a72-cd6f-480e-ac6b-4368a88b338b tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:47.081214 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-07986a72-cd6f-480e-ac6b-4368a88b338b tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:47.118171 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07986a72-cd6f-480e-ac6b-4368a88b338b tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:47.119289 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07986a72-cd6f-480e-ac6b-4368a88b338b tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:47.120341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07986a72-cd6f-480e-ac6b-4368a88b338b tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:47.121068 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07986a72-cd6f-480e-ac6b-4368a88b338b tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:47.548814 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-52f52bc7-bead-433a-bdec-62896a38452f tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746810a196b24e8884a9526580cdc2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe347c5b18f487ab2fc6b6de7e959e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:47.562563 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-52f52bc7-bead-433a-bdec-62896a38452f tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889" status: 200 len: 1465 microversion: 2.1 time: 1.367750 Jul 19 22:39:47.566146 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1396/2804] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:46 2022] GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889 => generated 1465 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:47.575382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d3739f3e-2d86-4171-8c99-7ecd6aa715be tempest-ImagesDeleteNegativeTestJSON-360427823 tempest-ImagesDeleteNegativeTestJSON-360427823-project] Calling method '.version_select at 0x7f7a109a2ca0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:47.617273 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-d3739f3e-2d86-4171-8c99-7ecd6aa715be tempest-ImagesDeleteNegativeTestJSON-360427823 tempest-ImagesDeleteNegativeTestJSON-360427823-project] HTTP exception thrown: Image not found. Jul 19 22:39:47.620611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d3739f3e-2d86-4171-8c99-7ecd6aa715be tempest-ImagesDeleteNegativeTestJSON-360427823 tempest-ImagesDeleteNegativeTestJSON-360427823-project] Request method failure captured: Jul 19 22:39:47.620611 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/images/06831dd5-3fed-4b60-9223-a7c717f3984e1 HTTP/1.1 Jul 19 22:39:47.620611 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:39:47.620611 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:39:47.620611 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:39:47.620611 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:39:47.620611 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:39:47.620611 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:39:47.620611 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:39:47.620611 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:39:47.620611 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zKuqpaaLT0YuSHciT747G-pcfj4GAnTS0349fT_CYBBejpgq-Zb3pgopsDy6Jxoe16cVhWMkB66FT69dv2Tx2dVARLMeZyNYrswO2bd3itWNBPiX6D77WKSSXuoquQW-ASWd-s3WclYrRstzG_4zbQQfjJDuStQSez5ImT4R6CJaQU Jul 19 22:39:47.620611 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:39:47.620611 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:39:47.620611 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:39:47.620611 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:39:47.620611 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:39:47.620611 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:39:47.620611 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: fd1c6538a69b4c5f943d3ef9d91971a1 Jul 19 22:39:47.620611 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-360427823 Jul 19 22:39:47.620611 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:39:47.620611 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:39:47.622489 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fd1c6538a69b4c5f943d3ef9d91971a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd1c6538a69b4c5f943d3ef9d91971a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fd1c6538a69b4c5f943d3ef9d91971a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd1c6538a69b4c5f943d3ef9d91971a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:39:47.622489 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-360427823 Jul 19 22:39:47.622489 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: fd1c6538a69b4c5f943d3ef9d91971a1 Jul 19 22:39:47.622489 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-360427823 Jul 19 22:39:47.622489 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ImagesDeleteNegativeTestJSON-360427823-project Jul 19 22:39:47.622489 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:39:47.622489 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:39:47.622489 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: eb0a047f23d54d6cbae3e736535c4a17 Jul 19 22:39:47.622489 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-360427823-project Jul 19 22:39:47.622489 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:39:47.622489 n-d-847009-3 devstack@n-api.service[119337]: exception: Image not found. Jul 19 22:39:47.622489 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '06831dd5-3fed-4b60-9223-a7c717f3984e1'} Jul 19 22:39:47.622489 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:39:47.623290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:47.623290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 22:39:47.623290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 22:39:47.623290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:39:47.623290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:39:47.623290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:39:47.623290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:39:47.623290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 22:39:47.623290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 22:39:47.623290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 22:39:47.623290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 22:39:47.623290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:39:47.623290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:39:47.623290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:39:47.623290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:39:47.623290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 06831dd5-3fed-4b60-9223-a7c717f3984e1 to delete Jul 19 22:39:47.623290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:47.623290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:47.623290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:47.624423 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:47.624423 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 22:39:47.624423 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 22:39:47.624423 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 22:39:47.624423 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 22:39:47.624423 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 22:39:47.624423 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 22:39:47.624423 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 06831dd5-3fed-4b60-9223-a7c717f3984e1 could not be found. Jul 19 22:39:47.624423 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:47.624423 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:47.624423 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:47.624423 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:47.624423 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:47.624423 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:47.624423 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:39:47.624423 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:39:47.624423 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:39:47.624423 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:39:47.624423 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:39:47.624423 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:39:47.625642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 22:39:47.625642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 22:39:47.625642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 22:39:47.625642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:47.625642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:47.625642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:47.625642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:47.625642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:47.625642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:47.625642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:39:47.625642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:39:47.625642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 22:39:47.625642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:47.638658 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d3739f3e-2d86-4171-8c99-7ecd6aa715be tempest-ImagesDeleteNegativeTestJSON-360427823 tempest-ImagesDeleteNegativeTestJSON-360427823-project] Returning 404 to user: Image not found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:39:47.641639 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d3739f3e-2d86-4171-8c99-7ecd6aa715be tempest-ImagesDeleteNegativeTestJSON-360427823 tempest-ImagesDeleteNegativeTestJSON-360427823-project] 10.222.0.25 "DELETE /compute/v2.1/images/06831dd5-3fed-4b60-9223-a7c717f3984e1" status: 404 len: 62 microversion: 2.1 time: 0.071651 Jul 19 22:39:47.643240 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1397/2805] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:39:47 2022] DELETE /compute/v2.1/images/06831dd5-3fed-4b60-9223-a7c717f3984e1 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:39:47.649413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fd29e076-fd6b-403e-a9b0-5491b039a0a1 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2096428106", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "a8a98231-b043-4f20-9ab5-9cf2216d3ed0"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:39:47.776497 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-fd29e076-fd6b-403e-a9b0-5491b039a0a1 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] validate_networks() for [('a8a98231-b043-4f20-9ab5-9cf2216d3ed0', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:39:47.845674 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-07986a72-cd6f-480e-ac6b-4368a88b338b tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:47.857728 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-07986a72-cd6f-480e-ac6b-4368a88b338b tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1522 microversion: 2.1 time: 0.798281 Jul 19 22:39:47.868519 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1409/2806] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:47 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1522 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:47.874142 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aeb7a746-48a6-45ca-919f-ebafcfab2fc4 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a03793ca0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:47.934718 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-aeb7a746-48a6-45ca-919f-ebafcfab2fc4 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/images/3a7659a5-b1a8-4e19-8bfc-eda9874ee691" status: 200 len: 784 microversion: 2.1 time: 0.063849 Jul 19 22:39:47.935356 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1410/2807] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:39:47 2022] GET /compute/v2.1/images/3a7659a5-b1a8-4e19-8bfc-eda9874ee691 => generated 784 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:39:47.947530 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9f743445-269d-42b0-96f2-c9f6e9dfd90b tempest-ImagesDeleteNegativeTestJSON-360427823 tempest-ImagesDeleteNegativeTestJSON-360427823-project] Calling method '.version_select at 0x7f7a0378c790>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:48.008191 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-9f743445-269d-42b0-96f2-c9f6e9dfd90b tempest-ImagesDeleteNegativeTestJSON-360427823 tempest-ImagesDeleteNegativeTestJSON-360427823-project] HTTP exception thrown: Image not found. Jul 19 22:39:48.010002 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9f743445-269d-42b0-96f2-c9f6e9dfd90b tempest-ImagesDeleteNegativeTestJSON-360427823 tempest-ImagesDeleteNegativeTestJSON-360427823-project] Request method failure captured: Jul 19 22:39:48.010002 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/images/tempest-invalid-1874226478 HTTP/1.1 Jul 19 22:39:48.010002 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:39:48.010002 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:39:48.010002 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:39:48.010002 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:39:48.010002 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:39:48.010002 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:39:48.010002 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:39:48.010002 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:39:48.010002 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zKuqpaaLT0YuSHciT747G-pcfj4GAnTS0349fT_CYBBejpgq-Zb3pgopsDy6Jxoe16cVhWMkB66FT69dv2Tx2dVARLMeZyNYrswO2bd3itWNBPiX6D77WKSSXuoquQW-ASWd-s3WclYrRstzG_4zbQQfjJDuStQSez5ImT4R6CJaQU Jul 19 22:39:48.010002 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:39:48.010002 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:39:48.010002 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:39:48.010002 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:39:48.010002 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:39:48.010002 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:39:48.010002 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: fd1c6538a69b4c5f943d3ef9d91971a1 Jul 19 22:39:48.010002 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-360427823 Jul 19 22:39:48.010002 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:39:48.010002 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:39:48.011294 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fd1c6538a69b4c5f943d3ef9d91971a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd1c6538a69b4c5f943d3ef9d91971a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fd1c6538a69b4c5f943d3ef9d91971a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd1c6538a69b4c5f943d3ef9d91971a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:39:48.011294 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-360427823 Jul 19 22:39:48.011294 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: fd1c6538a69b4c5f943d3ef9d91971a1 Jul 19 22:39:48.011294 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-360427823 Jul 19 22:39:48.011294 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesDeleteNegativeTestJSON-360427823-project Jul 19 22:39:48.011294 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:39:48.011294 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:39:48.011294 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: eb0a047f23d54d6cbae3e736535c4a17 Jul 19 22:39:48.011294 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-360427823-project Jul 19 22:39:48.011294 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:39:48.011294 n-d-847009-3 devstack@n-api.service[119338]: exception: Image not found. Jul 19 22:39:48.011294 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'tempest-invalid-1874226478'} Jul 19 22:39:48.011294 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:39:48.012228 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:48.012228 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 22:39:48.012228 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 22:39:48.012228 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:39:48.012228 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:39:48.012228 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:39:48.012228 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:39:48.012228 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 22:39:48.012228 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 22:39:48.012228 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 22:39:48.012228 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 22:39:48.012228 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:39:48.012228 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:39:48.012228 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:39:48.012228 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:39:48.012228 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1874226478 to delete Jul 19 22:39:48.012228 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:48.012228 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:48.012228 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:48.013462 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:48.013462 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 22:39:48.013462 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 22:39:48.013462 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 22:39:48.013462 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 22:39:48.013462 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 22:39:48.013462 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 22:39:48.013462 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1874226478 could not be found. Jul 19 22:39:48.013462 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:48.013462 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:48.013462 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:48.013462 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:48.013462 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:48.013462 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:48.013462 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:39:48.013462 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:39:48.013462 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:39:48.013462 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:39:48.013462 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:39:48.013462 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:39:48.016743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 22:39:48.016743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 22:39:48.016743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 22:39:48.016743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:48.016743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:48.016743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:48.016743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:48.016743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:48.016743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:48.016743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:39:48.016743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:39:48.016743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 22:39:48.016743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:48.016743 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9f743445-269d-42b0-96f2-c9f6e9dfd90b tempest-ImagesDeleteNegativeTestJSON-360427823 tempest-ImagesDeleteNegativeTestJSON-360427823-project] Returning 404 to user: Image not found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:39:48.016743 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9f743445-269d-42b0-96f2-c9f6e9dfd90b tempest-ImagesDeleteNegativeTestJSON-360427823 tempest-ImagesDeleteNegativeTestJSON-360427823-project] 10.222.0.25 "DELETE /compute/v2.1/images/tempest-invalid-1874226478" status: 404 len: 62 microversion: 2.1 time: 0.068970 Jul 19 22:39:48.018664 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1411/2808] 10.222.0.25 () {58 vars in 1205 bytes} [Tue Jul 19 22:39:47 2022] DELETE /compute/v2.1/images/tempest-invalid-1874226478 => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:39:48.026227 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-7734356e-ceda-4391-8375-6049aea83c12 req-5385e4c1-31f7-45e3-9d8f-8f58f680e99b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7c28d6e-5bfc-4b93-ab76-85ab7d401744", "name": "network-vif-unplugged", "status": "completed", "tag": "fca80e58-e0cd-4282-b725-470915412593"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:39:48.055561 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7734356e-ceda-4391-8375-6049aea83c12 req-5385e4c1-31f7-45e3-9d8f-8f58f680e99b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:48.056020 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7734356e-ceda-4391-8375-6049aea83c12 req-5385e4c1-31f7-45e3-9d8f-8f58f680e99b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:48.109885 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-7734356e-ceda-4391-8375-6049aea83c12 req-5385e4c1-31f7-45e3-9d8f-8f58f680e99b service nova] Creating event network-vif-unplugged:fca80e58-e0cd-4282-b725-470915412593 for instance a7c28d6e-5bfc-4b93-ab76-85ab7d401744 on n-h2-847009-3 Jul 19 22:39:48.128907 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-7734356e-ceda-4391-8375-6049aea83c12 req-5385e4c1-31f7-45e3-9d8f-8f58f680e99b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114562 Jul 19 22:39:48.133636 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1412/2809] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:39:48.148671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-49fc762a-d48c-40d6-a5ba-9fd305b87024 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:48.180374 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-49fc762a-d48c-40d6-a5ba-9fd305b87024 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.044068 Jul 19 22:39:48.184928 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1413/2810] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:39:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:39:48.198670 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9fb2f64e-4a7c-4023-85cb-bb1824cb291d tempest-ImagesDeleteNegativeTestJSON-360427823 tempest-ImagesDeleteNegativeTestJSON-360427823-project] Calling method '.version_select at 0x7f7a03793dc0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:48.289418 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-9fb2f64e-4a7c-4023-85cb-bb1824cb291d tempest-ImagesDeleteNegativeTestJSON-360427823 tempest-ImagesDeleteNegativeTestJSON-360427823-project] HTTP exception thrown: Image not found. Jul 19 22:39:48.292722 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9fb2f64e-4a7c-4023-85cb-bb1824cb291d tempest-ImagesDeleteNegativeTestJSON-360427823 tempest-ImagesDeleteNegativeTestJSON-360427823-project] Request method failure captured: Jul 19 22:39:48.292722 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/images/f65af130-a5be-4a67-95dd-05549ffce1d6 HTTP/1.1 Jul 19 22:39:48.292722 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:39:48.292722 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:39:48.292722 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:39:48.292722 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:39:48.292722 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:39:48.292722 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:39:48.292722 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:39:48.292722 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:39:48.292722 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zKuqpaaLT0YuSHciT747G-pcfj4GAnTS0349fT_CYBBejpgq-Zb3pgopsDy6Jxoe16cVhWMkB66FT69dv2Tx2dVARLMeZyNYrswO2bd3itWNBPiX6D77WKSSXuoquQW-ASWd-s3WclYrRstzG_4zbQQfjJDuStQSez5ImT4R6CJaQU Jul 19 22:39:48.292722 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:39:48.292722 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:39:48.292722 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:39:48.292722 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:39:48.292722 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:39:48.292722 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:39:48.292722 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: fd1c6538a69b4c5f943d3ef9d91971a1 Jul 19 22:39:48.292722 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-360427823 Jul 19 22:39:48.292722 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:39:48.292722 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:39:48.295223 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fd1c6538a69b4c5f943d3ef9d91971a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd1c6538a69b4c5f943d3ef9d91971a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fd1c6538a69b4c5f943d3ef9d91971a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd1c6538a69b4c5f943d3ef9d91971a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:39:48.295223 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-360427823 Jul 19 22:39:48.295223 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: fd1c6538a69b4c5f943d3ef9d91971a1 Jul 19 22:39:48.295223 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-360427823 Jul 19 22:39:48.295223 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesDeleteNegativeTestJSON-360427823-project Jul 19 22:39:48.295223 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:39:48.295223 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:39:48.295223 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: eb0a047f23d54d6cbae3e736535c4a17 Jul 19 22:39:48.295223 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-360427823-project Jul 19 22:39:48.295223 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:39:48.295223 n-d-847009-3 devstack@n-api.service[119338]: exception: Image not found. Jul 19 22:39:48.295223 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'f65af130-a5be-4a67-95dd-05549ffce1d6'} Jul 19 22:39:48.295223 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:39:48.296521 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:48.296521 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 22:39:48.296521 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 22:39:48.296521 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:39:48.296521 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:39:48.296521 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:39:48.296521 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:39:48.296521 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 22:39:48.296521 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 22:39:48.296521 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 22:39:48.296521 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 22:39:48.296521 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:39:48.296521 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:39:48.296521 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:39:48.296521 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:39:48.296521 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f65af130-a5be-4a67-95dd-05549ffce1d6 to delete Jul 19 22:39:48.296521 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:48.296521 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:48.296521 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:48.298141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:48.298141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 22:39:48.298141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 22:39:48.298141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 22:39:48.298141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 22:39:48.298141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 22:39:48.298141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 22:39:48.298141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f65af130-a5be-4a67-95dd-05549ffce1d6 could not be found. Jul 19 22:39:48.298141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:48.298141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:48.298141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:48.298141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:48.298141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:48.298141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:48.298141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:39:48.298141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:39:48.298141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:39:48.298141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:39:48.298141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:39:48.298141 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:39:48.300056 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 22:39:48.300056 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 22:39:48.300056 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 22:39:48.300056 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:48.300056 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:48.300056 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:48.300056 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:48.300056 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:48.300056 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:48.300056 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:39:48.300056 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:39:48.300056 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 22:39:48.300056 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:48.302676 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9fb2f64e-4a7c-4023-85cb-bb1824cb291d tempest-ImagesDeleteNegativeTestJSON-360427823 tempest-ImagesDeleteNegativeTestJSON-360427823-project] Returning 404 to user: Image not found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:39:48.303908 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9fb2f64e-4a7c-4023-85cb-bb1824cb291d tempest-ImagesDeleteNegativeTestJSON-360427823 tempest-ImagesDeleteNegativeTestJSON-360427823-project] 10.222.0.25 "DELETE /compute/v2.1/images/f65af130-a5be-4a67-95dd-05549ffce1d6" status: 404 len: 62 microversion: 2.1 time: 0.117579 Jul 19 22:39:48.304865 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1414/2811] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:48 2022] DELETE /compute/v2.1/images/f65af130-a5be-4a67-95dd-05549ffce1d6 => generated 62 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:39:48.337702 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-93f41955-d84b-476c-beab-ac047495b4a6 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a037d0ee0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:50.080860 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-fd29e076-fd6b-403e-a9b0-5491b039a0a1 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:39:50.081954 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-fd29e076-fd6b-403e-a9b0-5491b039a0a1 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:39:50.082671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-fd29e076-fd6b-403e-a9b0-5491b039a0a1 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:39:50.083646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-fd29e076-fd6b-403e-a9b0-5491b039a0a1 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:39:50.094271 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-fd29e076-fd6b-403e-a9b0-5491b039a0a1 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:39:50.160246 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd29e076-fd6b-403e-a9b0-5491b039a0a1 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:50.160882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd29e076-fd6b-403e-a9b0-5491b039a0a1 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:50.167464 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd29e076-fd6b-403e-a9b0-5491b039a0a1 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:50.169322 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd29e076-fd6b-403e-a9b0-5491b039a0a1 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:50.217324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-fd29e076-fd6b-403e-a9b0-5491b039a0a1 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Getting quotas for project 1b633041d58845d1a6d0b9f31f3613d4. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:39:50.230568 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-fd29e076-fd6b-403e-a9b0-5491b039a0a1 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Getting quotas for user 0631675f80674534b1e775e521cfea10 and project 1b633041d58845d1a6d0b9f31f3613d4. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:39:50.285595 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fd29e076-fd6b-403e-a9b0-5491b039a0a1 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:39:50.294149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fd29e076-fd6b-403e-a9b0-5491b039a0a1 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 648bd230-03d9-4186-8cc0-64573fae2ab6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:39:50.401289 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-93f41955-d84b-476c-beab-ac047495b4a6 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "DELETE /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba" status: 204 len: 0 microversion: 2.1 time: 2.089706 Jul 19 22:39:50.402189 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1415/2812] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:48 2022] DELETE /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba => generated 0 bytes in 2097 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:39:50.408872 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d34d7c54-b670-4663-9886-d8ffc32e8ab3 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:50.415007 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d34d7c54-b670-4663-9886-d8ffc32e8ab3 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:50.428338 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fd29e076-fd6b-403e-a9b0-5491b039a0a1 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.780048 Jul 19 22:39:50.429937 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1398/2813] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:39:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:39:50.468319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d34d7c54-b670-4663-9886-d8ffc32e8ab3 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:50.478357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d34d7c54-b670-4663-9886-d8ffc32e8ab3 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:50.484619 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d34d7c54-b670-4663-9886-d8ffc32e8ab3 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:50.491496 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d34d7c54-b670-4663-9886-d8ffc32e8ab3 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:50.530706 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a9c9763c-855a-4063-b338-e84e42fc9d9b tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a156a7160>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:50.613869 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-a9c9763c-855a-4063-b338-e84e42fc9d9b tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] HTTP exception thrown: Image not found. Jul 19 22:39:50.616031 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a9c9763c-855a-4063-b338-e84e42fc9d9b tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Request method failure captured: Jul 19 22:39:50.616031 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba HTTP/1.1 Jul 19 22:39:50.616031 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:39:50.616031 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:39:50.616031 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:39:50.616031 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:39:50.616031 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:39:50.616031 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:39:50.616031 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:39:50.616031 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:39:50.616031 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zJ2JTIuaMJREZTmoErzCNgpGAxoQfQJn3icXHF8M9jisHkNeYsNAFIOobhnk-Xf0jghAPRRFygJESSHz39Kqu5hGgqaPyaJBlRFyZYh99Ih5sRaV0P5zd4aJsh3hD70_ql6Q0SdbzzbxR2J0UxQwLGs4jCLOhk76ozsZ9dCmr3Fgjs Jul 19 22:39:50.616031 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:39:50.616031 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:39:50.616031 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:39:50.616031 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:39:50.616031 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:39:50.616031 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:39:50.616031 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 4fe347c5b18f487ab2fc6b6de7e959e4 Jul 19 22:39:50.616031 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ImagesOneServerTestJSON-2060869421 Jul 19 22:39:50.616031 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:39:50.616031 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:39:50.617589 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4fe347c5b18f487ab2fc6b6de7e959e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4fe347c5b18f487ab2fc6b6de7e959e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4fe347c5b18f487ab2fc6b6de7e959e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4fe347c5b18f487ab2fc6b6de7e959e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:39:50.617589 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ImagesOneServerTestJSON-2060869421 Jul 19 22:39:50.617589 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 4fe347c5b18f487ab2fc6b6de7e959e4 Jul 19 22:39:50.617589 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2060869421 Jul 19 22:39:50.617589 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ImagesOneServerTestJSON-2060869421-project Jul 19 22:39:50.617589 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:39:50.617589 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:39:50.617589 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 746810a196b24e8884a9526580cdc2a2 Jul 19 22:39:50.617589 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ImagesOneServerTestJSON-2060869421-project Jul 19 22:39:50.617589 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:39:50.617589 n-d-847009-3 devstack@n-api.service[119337]: exception: Image not found. Jul 19 22:39:50.617589 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'f3bb4a64-9535-4750-961a-2e14f35308ba'} Jul 19 22:39:50.617589 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:39:50.617589 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:50.618616 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 22:39:50.618616 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 22:39:50.618616 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:39:50.618616 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:39:50.618616 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 22:39:50.618616 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 22:39:50.618616 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:39:50.618616 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:39:50.618616 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 22:39:50.618616 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 22:39:50.618616 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 22:39:50.618616 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 22:39:50.618616 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:39:50.618616 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:39:50.618616 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:39:50.618616 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:39:50.618616 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f3bb4a64-9535-4750-961a-2e14f35308ba Jul 19 22:39:50.618616 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:50.620186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:50.620186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:50.620186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:50.620186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 19 22:39:50.620186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 19 22:39:50.620186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 19 22:39:50.620186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 19 22:39:50.620186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 19 22:39:50.620186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 19 22:39:50.620186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 19 22:39:50.620186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 19 22:39:50.620186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 19 22:39:50.620186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 19 22:39:50.620186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:39:50.620186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:39:50.620186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 19 22:39:50.620186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 19 22:39:50.620186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:39:50.620186 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:39:50.621265 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 19 22:39:50.621265 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 19 22:39:50.621265 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 19 22:39:50.621265 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 19 22:39:50.621265 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:39:50.621265 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:39:50.621265 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:39:50.621265 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:39:50.621265 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f3bb4a64-9535-4750-961a-2e14f35308ba could not be found. Jul 19 22:39:50.621265 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:50.621265 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:50.621265 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:50.621265 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:50.621265 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:50.621265 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:50.621265 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:39:50.621265 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:39:50.621265 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:39:50.621265 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:39:50.622963 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:39:50.622963 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:39:50.622963 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 19 22:39:50.622963 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 22:39:50.622963 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 22:39:50.622963 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:50.622963 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:50.622963 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:50.622963 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:50.622963 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:50.622963 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:50.622963 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:39:50.622963 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:39:50.622963 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 22:39:50.622963 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:39:50.622963 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a9c9763c-855a-4063-b338-e84e42fc9d9b tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Returning 404 to user: Image not found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:39:50.622963 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a9c9763c-855a-4063-b338-e84e42fc9d9b tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba" status: 404 len: 62 microversion: 2.1 time: 0.127620 Jul 19 22:39:50.624130 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1399/2814] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:39:50 2022] GET /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba => generated 62 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:39:50.642835 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c964e348-0035-4bb9-808a-ed81d6f5b5ac tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-539641715"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:39:50.664395 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c964e348-0035-4bb9-808a-ed81d6f5b5ac tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] [instance: 3b617584-f9bc-43a8-af3c-78546d0d9889] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:50.704528 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:39:50.720293 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c964e348-0035-4bb9-808a-ed81d6f5b5ac tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:50.724471 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c964e348-0035-4bb9-808a-ed81d6f5b5ac tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:50.725479 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c964e348-0035-4bb9-808a-ed81d6f5b5ac tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:50.738893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c964e348-0035-4bb9-808a-ed81d6f5b5ac tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:51.575401 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:39:51.737669 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c964e348-0035-4bb9-808a-ed81d6f5b5ac tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "POST /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889/action" status: 202 len: 0 microversion: 2.1 time: 1.101866 Jul 19 22:39:51.745869 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1400/2815] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:39:50 2022] POST /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889/action => generated 0 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 19 22:39:51.773927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9fa53f8f-53ee-479d-bcc7-e88621ee3820 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1962372885", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "451", "networks": [{"uuid": "a8a98231-b043-4f20-9ab5-9cf2216d3ed0"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:39:51.880572 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-9fa53f8f-53ee-479d-bcc7-e88621ee3820 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] validate_networks() for [('a8a98231-b043-4f20-9ab5-9cf2216d3ed0', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:39:52.716120 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d34d7c54-b670-4663-9886-d8ffc32e8ab3 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:52.738564 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d34d7c54-b670-4663-9886-d8ffc32e8ab3 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1522 microversion: 2.1 time: 2.334959 Jul 19 22:39:52.760094 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1416/2816] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:50 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1522 bytes in 2357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:52.772413 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e9590a98-6db2-4854-a635-0751424fcec9 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a038388b0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:52.911142 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e9590a98-6db2-4854-a635-0751424fcec9 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/images/6c492e8a-df35-4d1f-a61d-392f2860512a" status: 200 len: 1428 microversion: 2.1 time: 0.147148 Jul 19 22:39:52.913635 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1417/2817] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:39:52 2022] GET /compute/v2.1/images/6c492e8a-df35-4d1f-a61d-392f2860512a => generated 1428 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:52.947761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-6ec111ea-ffc6-490d-911f-abcd4c6a1623 req-0bf6508a-c3fc-400a-9c14-63814ca602de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7c28d6e-5bfc-4b93-ab76-85ab7d401744", "name": "network-vif-plugged", "status": "completed", "tag": "fca80e58-e0cd-4282-b725-470915412593"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:39:52.982157 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-6ec111ea-ffc6-490d-911f-abcd4c6a1623 req-0bf6508a-c3fc-400a-9c14-63814ca602de service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:52.982683 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-6ec111ea-ffc6-490d-911f-abcd4c6a1623 req-0bf6508a-c3fc-400a-9c14-63814ca602de service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:53.026630 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-6ec111ea-ffc6-490d-911f-abcd4c6a1623 req-0bf6508a-c3fc-400a-9c14-63814ca602de service nova] Creating event network-vif-plugged:fca80e58-e0cd-4282-b725-470915412593 for instance a7c28d6e-5bfc-4b93-ab76-85ab7d401744 on n-h2-847009-3 Jul 19 22:39:53.039464 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-6ec111ea-ffc6-490d-911f-abcd4c6a1623 req-0bf6508a-c3fc-400a-9c14-63814ca602de service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109288 Jul 19 22:39:53.041907 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1418/2818] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:39:53.384926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-eed4f18f-f763-449c-ae41-6c299e70f7e7 tempest-AbsoluteLimitsNegativeTestJSON-335295163 tempest-AbsoluteLimitsNegativeTestJSON-335295163-project] Calling method '.version_select at 0x7f7a03869dc0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:53.402112 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eed4f18f-f763-449c-ae41-6c299e70f7e7 tempest-AbsoluteLimitsNegativeTestJSON-335295163 tempest-AbsoluteLimitsNegativeTestJSON-335295163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:53.402865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eed4f18f-f763-449c-ae41-6c299e70f7e7 tempest-AbsoluteLimitsNegativeTestJSON-335295163 tempest-AbsoluteLimitsNegativeTestJSON-335295163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:53.404227 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eed4f18f-f763-449c-ae41-6c299e70f7e7 tempest-AbsoluteLimitsNegativeTestJSON-335295163 tempest-AbsoluteLimitsNegativeTestJSON-335295163-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:53.405134 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eed4f18f-f763-449c-ae41-6c299e70f7e7 tempest-AbsoluteLimitsNegativeTestJSON-335295163 tempest-AbsoluteLimitsNegativeTestJSON-335295163-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:53.503747 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-eed4f18f-f763-449c-ae41-6c299e70f7e7 tempest-AbsoluteLimitsNegativeTestJSON-335295163 tempest-AbsoluteLimitsNegativeTestJSON-335295163-project] 10.222.0.25 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.458328 Jul 19 22:39:53.507987 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1419/2819] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 22:39:53 2022] GET /compute/v2.1/limits => generated 511 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:39:53.623531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ad744dbf-af39-40be-a28a-6e975bebffb0 tempest-AbsoluteLimitsNegativeTestJSON-335295163 tempest-AbsoluteLimitsNegativeTestJSON-335295163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-220361585", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:39:53.800788 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-ad744dbf-af39-40be-a28a-6e975bebffb0 tempest-AbsoluteLimitsNegativeTestJSON-335295163 tempest-AbsoluteLimitsNegativeTestJSON-335295163-project] validate_networks() for None {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:39:55.104856 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-ad744dbf-af39-40be-a28a-6e975bebffb0 tempest-AbsoluteLimitsNegativeTestJSON-335295163 tempest-AbsoluteLimitsNegativeTestJSON-335295163-project] Getting quotas for project 5a5f51b576ab4041b0017dac78091c8a. Resources: dict_keys(['metadata_items']) {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:39:55.118033 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-ad744dbf-af39-40be-a28a-6e975bebffb0 tempest-AbsoluteLimitsNegativeTestJSON-335295163 tempest-AbsoluteLimitsNegativeTestJSON-335295163-project] Getting quotas for user 7b64acf978114817b7fa6e1b2ff16272 and project 5a5f51b576ab4041b0017dac78091c8a. Resources: dict_keys(['metadata_items']) {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:39:55.120915 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 22:39:55.121360 n-d-847009-3 devstack@n-api.service[119338]: Tue Jul 19 22:39:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Jul 19 22:39:55.197901 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-ad744dbf-af39-40be-a28a-6e975bebffb0 tempest-AbsoluteLimitsNegativeTestJSON-335295163 tempest-AbsoluteLimitsNegativeTestJSON-335295163-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ad744dbf-af39-40be-a28a-6e975bebffb0 tempest-AbsoluteLimitsNegativeTestJSON-335295163 tempest-AbsoluteLimitsNegativeTestJSON-335295163-project] Request method failure captured: Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 1751 Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zK4jD-wAZfsdQpGtoZFEK7mJij1c2PURGw-8oTvmO_Pn045JM_TeiwcFl8O7gIaHncfirIWyy-uxM11B2Aou6Sakqs-__m0DjDBPlp5Zx6cUDg53YvrgIg6l3vb7DiSVi2ldNhpW6p2MlPKdpO9Dtlc58cNSTFLMz8TVY_0dpEhiKs Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 5a5f51b576ab4041b0017dac78091c8a Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-335295163 Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5a5f51b576ab4041b0017dac78091c8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5a5f51b576ab4041b0017dac78091c8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5a5f51b576ab4041b0017dac78091c8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5a5f51b576ab4041b0017dac78091c8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-335295163 Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 5a5f51b576ab4041b0017dac78091c8a Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-335295163 Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-335295163-project Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 7b64acf978114817b7fa6e1b2ff16272 Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-335295163-project Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-220361585", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:39:55.205234 n-d-847009-3 devstack@n-api.service[119338]: exception: Maximum number of metadata items exceeds 128 Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-220361585', 'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:39:55.207877 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:39:55.212467 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:39:55.212467 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 22:39:55.212467 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 19 22:39:55.212467 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 19 22:39:55.212467 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 19 22:39:55.212467 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:55.212467 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:39:55.212467 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:55.212467 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:39:55.212467 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:39:55.212467 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:39:55.212467 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:39:55.212467 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:39:55.212467 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 19 22:39:55.212467 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:39:55.221765 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ad744dbf-af39-40be-a28a-6e975bebffb0 tempest-AbsoluteLimitsNegativeTestJSON-335295163 tempest-AbsoluteLimitsNegativeTestJSON-335295163-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:39:55.222936 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ad744dbf-af39-40be-a28a-6e975bebffb0 tempest-AbsoluteLimitsNegativeTestJSON-335295163 tempest-AbsoluteLimitsNegativeTestJSON-335295163-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.604149 Jul 19 22:39:55.223606 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1420/2820] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Jul 19 22:39:53 2022] POST /compute/v2.1/servers => generated 87 bytes in 1606 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:39:55.248048 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-9fa53f8f-53ee-479d-bcc7-e88621ee3820 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:39:55.248984 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-9fa53f8f-53ee-479d-bcc7-e88621ee3820 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:39:55.250039 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-9fa53f8f-53ee-479d-bcc7-e88621ee3820 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:39:55.251436 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-9fa53f8f-53ee-479d-bcc7-e88621ee3820 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:39:55.252631 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7bd9c996-3a0f-4cfd-bbd5-66551f706f02 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:55.252865 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-9fa53f8f-53ee-479d-bcc7-e88621ee3820 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:39:55.253502 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7bd9c996-3a0f-4cfd-bbd5-66551f706f02 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:55.289406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9fa53f8f-53ee-479d-bcc7-e88621ee3820 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:55.298793 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9fa53f8f-53ee-479d-bcc7-e88621ee3820 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:55.298793 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9fa53f8f-53ee-479d-bcc7-e88621ee3820 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:55.299696 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9fa53f8f-53ee-479d-bcc7-e88621ee3820 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:55.325642 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bd9c996-3a0f-4cfd-bbd5-66551f706f02 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:55.335969 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bd9c996-3a0f-4cfd-bbd5-66551f706f02 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:55.341763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bd9c996-3a0f-4cfd-bbd5-66551f706f02 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:55.345842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bd9c996-3a0f-4cfd-bbd5-66551f706f02 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:55.353302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-9fa53f8f-53ee-479d-bcc7-e88621ee3820 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Getting quotas for project 1b633041d58845d1a6d0b9f31f3613d4. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:39:55.371142 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-9fa53f8f-53ee-479d-bcc7-e88621ee3820 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Getting quotas for user 0631675f80674534b1e775e521cfea10 and project 1b633041d58845d1a6d0b9f31f3613d4. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:39:55.416072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9fa53f8f-53ee-479d-bcc7-e88621ee3820 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:39:55.436615 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9fa53f8f-53ee-479d-bcc7-e88621ee3820 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:39:55.579714 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9fa53f8f-53ee-479d-bcc7-e88621ee3820 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.831841 Jul 19 22:39:55.581083 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1401/2821] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:39:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:39:55.875210 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a9888051-652f-486d-8d4d-7b68892a595e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1804037159", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "e72e6540-fec7-43c7-b728-4c298a159d78"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:39:56.013579 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7bd9c996-3a0f-4cfd-bbd5-66551f706f02 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:56.030993 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7bd9c996-3a0f-4cfd-bbd5-66551f706f02 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1522 microversion: 2.1 time: 0.806035 Jul 19 22:39:56.031693 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1421/2822] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:55 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1522 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:56.037257 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-a9888051-652f-486d-8d4d-7b68892a595e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] validate_networks() for [('e72e6540-fec7-43c7-b728-4c298a159d78', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:39:56.053708 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-669d28b2-b872-407d-8c57-d2d869653933 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a037800d0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:56.254774 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-669d28b2-b872-407d-8c57-d2d869653933 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/images/6c492e8a-df35-4d1f-a61d-392f2860512a" status: 200 len: 1428 microversion: 2.1 time: 0.204593 Jul 19 22:39:56.267499 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1422/2823] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:39:56 2022] GET /compute/v2.1/images/6c492e8a-df35-4d1f-a61d-392f2860512a => generated 1428 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:56.287786 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-a5f2b62b-9b07-429b-8f03-1836b5de750d req-706c6ccd-3f28-4776-a4a7-801e5e77a017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b617584-f9bc-43a8-af3c-78546d0d9889", "name": "network-vif-unplugged", "status": "completed", "tag": "3b3dc181-31be-470e-abec-b7a8478ff369"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:39:56.320178 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-a5f2b62b-9b07-429b-8f03-1836b5de750d req-706c6ccd-3f28-4776-a4a7-801e5e77a017 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:56.323737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-a5f2b62b-9b07-429b-8f03-1836b5de750d req-706c6ccd-3f28-4776-a4a7-801e5e77a017 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:56.384160 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-a5f2b62b-9b07-429b-8f03-1836b5de750d req-706c6ccd-3f28-4776-a4a7-801e5e77a017 service nova] Creating event network-vif-unplugged:3b3dc181-31be-470e-abec-b7a8478ff369 for instance 3b617584-f9bc-43a8-af3c-78546d0d9889 on n-h2-847009-3 Jul 19 22:39:56.397472 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-a5f2b62b-9b07-429b-8f03-1836b5de750d req-706c6ccd-3f28-4776-a4a7-801e5e77a017 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125744 Jul 19 22:39:56.399365 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1423/2824] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:39:56.418785 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0a5e8015-a687-4c04-a1c9-ffcd5c923563 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:56.423902 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0a5e8015-a687-4c04-a1c9-ffcd5c923563 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:56.891546 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0a5e8015-a687-4c04-a1c9-ffcd5c923563 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:56.910379 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0a5e8015-a687-4c04-a1c9-ffcd5c923563 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41" status: 200 len: 1221 microversion: 2.1 time: 0.506836 Jul 19 22:39:56.913712 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1424/2825] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:56 2022] GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41 => generated 1221 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:56.978440 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 22:39:56.979023 n-d-847009-3 devstack@n-api.service[119337]: Tue Jul 19 22:39:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Jul 19 22:39:57.052511 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dc56c2c0-8e54-435b-a845-f19c8d1843a0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:39:57.053340 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dc56c2c0-8e54-435b-a845-f19c8d1843a0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:39:57.089171 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dc56c2c0-8e54-435b-a845-f19c8d1843a0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:57.092681 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dc56c2c0-8e54-435b-a845-f19c8d1843a0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:57.097461 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dc56c2c0-8e54-435b-a845-f19c8d1843a0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:39:57.100293 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dc56c2c0-8e54-435b-a845-f19c8d1843a0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:39:58.994938 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dc56c2c0-8e54-435b-a845-f19c8d1843a0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:39:59.020211 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dc56c2c0-8e54-435b-a845-f19c8d1843a0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1507 microversion: 2.1 time: 1.973986 Jul 19 22:39:59.029140 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1425/2826] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:39:57 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1507 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:39:59.083292 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-339cef3a-8156-4df8-9c35-cbcf10d8f66b tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a03869550>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:01.431979 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-a9888051-652f-486d-8d4d-7b68892a595e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:40:01.434822 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-a9888051-652f-486d-8d4d-7b68892a595e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:40:01.436012 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-a9888051-652f-486d-8d4d-7b68892a595e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:40:01.436985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-a9888051-652f-486d-8d4d-7b68892a595e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:40:01.437922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-a9888051-652f-486d-8d4d-7b68892a595e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:40:01.609259 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9888051-652f-486d-8d4d-7b68892a595e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:01.610063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9888051-652f-486d-8d4d-7b68892a595e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:01.611084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9888051-652f-486d-8d4d-7b68892a595e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:01.611761 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9888051-652f-486d-8d4d-7b68892a595e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:01.687905 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-a9888051-652f-486d-8d4d-7b68892a595e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Getting quotas for project 4f6eabd2343c481b8f7e5b4d7e61f2f6. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:40:01.724770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-a9888051-652f-486d-8d4d-7b68892a595e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Getting quotas for user b609af624e4b4aeeb9bfde36b890b491 and project 4f6eabd2343c481b8f7e5b4d7e61f2f6. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:40:01.796088 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a9888051-652f-486d-8d4d-7b68892a595e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:40:01.798628 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a9888051-652f-486d-8d4d-7b68892a595e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] [instance: d6f5f214-5b73-40e7-a0d0-1518cff74397] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:40:01.956059 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a9888051-652f-486d-8d4d-7b68892a595e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.351436 Jul 19 22:40:01.958372 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1402/2827] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:39:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 6376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:40:01.982414 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fdf2c7be-4cde-4871-ae44-f9d7525c6a2c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:01.983173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fdf2c7be-4cde-4871-ae44-f9d7525c6a2c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:02.021380 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fdf2c7be-4cde-4871-ae44-f9d7525c6a2c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:02.022532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fdf2c7be-4cde-4871-ae44-f9d7525c6a2c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:02.031656 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fdf2c7be-4cde-4871-ae44-f9d7525c6a2c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:02.033754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fdf2c7be-4cde-4871-ae44-f9d7525c6a2c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:02.663233 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fdf2c7be-4cde-4871-ae44-f9d7525c6a2c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:02.692666 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fdf2c7be-4cde-4871-ae44-f9d7525c6a2c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41" status: 200 len: 1279 microversion: 2.1 time: 0.729037 Jul 19 22:40:02.707284 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1403/2828] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:01 2022] GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41 => generated 1279 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:02.717751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eaef3f9f-acb4-45f4-b8b2-11db8bdd6786 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:02.720619 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eaef3f9f-acb4-45f4-b8b2-11db8bdd6786 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9177ec40-9593-42f5-97ad-d896faeb9e83] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:02.736505 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eaef3f9f-acb4-45f4-b8b2-11db8bdd6786 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:02.737125 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eaef3f9f-acb4-45f4-b8b2-11db8bdd6786 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:02.739411 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eaef3f9f-acb4-45f4-b8b2-11db8bdd6786 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:02.740293 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eaef3f9f-acb4-45f4-b8b2-11db8bdd6786 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:02.821333 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eaef3f9f-acb4-45f4-b8b2-11db8bdd6786 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9177ec40-9593-42f5-97ad-d896faeb9e83] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:40:03.098442 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eaef3f9f-acb4-45f4-b8b2-11db8bdd6786 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83" status: 204 len: 0 microversion: 2.1 time: 0.383844 Jul 19 22:40:03.100261 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1404/2829] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:40:02 2022] DELETE /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:40:03.124158 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eee3dbec-399d-4628-9d8a-2e64e1e231f4 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:03.126993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eee3dbec-399d-4628-9d8a-2e64e1e231f4 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:03.139361 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eee3dbec-399d-4628-9d8a-2e64e1e231f4 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:03.140517 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eee3dbec-399d-4628-9d8a-2e64e1e231f4 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:03.142333 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eee3dbec-399d-4628-9d8a-2e64e1e231f4 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:03.149980 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eee3dbec-399d-4628-9d8a-2e64e1e231f4 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:03.470346 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:03.813613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-eee3dbec-399d-4628-9d8a-2e64e1e231f4 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:03.824402 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eee3dbec-399d-4628-9d8a-2e64e1e231f4 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 200 len: 1507 microversion: 2.1 time: 0.721589 Jul 19 22:40:03.825688 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1405/2830] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:03 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 1507 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:03.831841 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-7d6fd5de-d1d3-4cae-809b-e649eae86a9b req-4fe610a3-e162-49a4-a47c-3e3d4efdb122 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b617584-f9bc-43a8-af3c-78546d0d9889", "name": "network-vif-plugged", "status": "completed", "tag": "3b3dc181-31be-470e-abec-b7a8478ff369"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:03.858178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-7d6fd5de-d1d3-4cae-809b-e649eae86a9b req-4fe610a3-e162-49a4-a47c-3e3d4efdb122 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:03.859048 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-7d6fd5de-d1d3-4cae-809b-e649eae86a9b req-4fe610a3-e162-49a4-a47c-3e3d4efdb122 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:03.901400 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-7d6fd5de-d1d3-4cae-809b-e649eae86a9b req-4fe610a3-e162-49a4-a47c-3e3d4efdb122 service nova] Creating event network-vif-plugged:3b3dc181-31be-470e-abec-b7a8478ff369 for instance 3b617584-f9bc-43a8-af3c-78546d0d9889 on n-h2-847009-3 Jul 19 22:40:03.914206 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-7d6fd5de-d1d3-4cae-809b-e649eae86a9b req-4fe610a3-e162-49a4-a47c-3e3d4efdb122 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086749 Jul 19 22:40:03.919189 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1406/2831] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:03.938212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-814d54bb-edbb-445c-8c21-8b3d2c430bbf tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:03.940231 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-814d54bb-edbb-445c-8c21-8b3d2c430bbf tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] [instance: d6f5f214-5b73-40e7-a0d0-1518cff74397] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:03.962838 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-814d54bb-edbb-445c-8c21-8b3d2c430bbf tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:03.965527 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-814d54bb-edbb-445c-8c21-8b3d2c430bbf tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:03.969387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-814d54bb-edbb-445c-8c21-8b3d2c430bbf tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:03.971659 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-814d54bb-edbb-445c-8c21-8b3d2c430bbf tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:04.932444 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-814d54bb-edbb-445c-8c21-8b3d2c430bbf tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b609af624e4b4aeeb9bfde36b890b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6eabd2343c481b8f7e5b4d7e61f2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:04.957918 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-814d54bb-edbb-445c-8c21-8b3d2c430bbf tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] 10.222.0.25 "GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397" status: 200 len: 1277 microversion: 2.1 time: 1.035662 Jul 19 22:40:04.966675 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1407/2832] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:03 2022] GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397 => generated 1277 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:04.978942 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-f2d820a6-3a59-4197-b88c-1241c2ec697a req-8f4f5b12-8391-4859-867a-017bfd427452 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "976f2ec1-c70b-4795-a71d-251bed15ad25", "tag": "c3b703eb-00f7-4fb3-9358-40627991eef1"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:05.030525 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-f2d820a6-3a59-4197-b88c-1241c2ec697a req-8f4f5b12-8391-4859-867a-017bfd427452 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:05.032496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-f2d820a6-3a59-4197-b88c-1241c2ec697a req-8f4f5b12-8391-4859-867a-017bfd427452 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:05.106512 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-f2d820a6-3a59-4197-b88c-1241c2ec697a req-8f4f5b12-8391-4859-867a-017bfd427452 service nova] Creating event network-changed:c3b703eb-00f7-4fb3-9358-40627991eef1 for instance 976f2ec1-c70b-4795-a71d-251bed15ad25 on n-h1-847009-3 Jul 19 22:40:05.144062 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-f2d820a6-3a59-4197-b88c-1241c2ec697a req-8f4f5b12-8391-4859-867a-017bfd427452 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171808 Jul 19 22:40:05.145751 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1408/2833] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:05.226446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6cc64dfd-877c-478c-b918-c55988819977 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:05.232360 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6cc64dfd-877c-478c-b918-c55988819977 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9177ec40-9593-42f5-97ad-d896faeb9e83] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:05.245156 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6cc64dfd-877c-478c-b918-c55988819977 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:05.245914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6cc64dfd-877c-478c-b918-c55988819977 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:05.247311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6cc64dfd-877c-478c-b918-c55988819977 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:05.247967 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6cc64dfd-877c-478c-b918-c55988819977 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:05.928009 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-339cef3a-8156-4df8-9c35-cbcf10d8f66b tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/images/6c492e8a-df35-4d1f-a61d-392f2860512a" status: 200 len: 1428 microversion: 2.1 time: 6.896614 Jul 19 22:40:05.928664 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1426/2834] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:39:59 2022] GET /compute/v2.1/images/6c492e8a-df35-4d1f-a61d-392f2860512a => generated 1428 bytes in 6899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:05.939163 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-294b6055-90d7-4098-8e59-f9cc2f656da2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:05.940120 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-294b6055-90d7-4098-8e59-f9cc2f656da2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:05.951341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-294b6055-90d7-4098-8e59-f9cc2f656da2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:05.955064 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-294b6055-90d7-4098-8e59-f9cc2f656da2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:05.956360 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-294b6055-90d7-4098-8e59-f9cc2f656da2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:05.959005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-294b6055-90d7-4098-8e59-f9cc2f656da2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:06.163929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6cc64dfd-877c-478c-b918-c55988819977 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:06.178845 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6cc64dfd-877c-478c-b918-c55988819977 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83" status: 200 len: 1555 microversion: 2.1 time: 1.025568 Jul 19 22:40:06.180838 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1409/2835] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:05 2022] GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83 => generated 1555 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:06.187740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-74603a5a-2869-414c-85c4-6d8e67afb9fa tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:06.188522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-74603a5a-2869-414c-85c4-6d8e67afb9fa tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:06.199784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74603a5a-2869-414c-85c4-6d8e67afb9fa tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:06.200815 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74603a5a-2869-414c-85c4-6d8e67afb9fa tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:06.214623 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74603a5a-2869-414c-85c4-6d8e67afb9fa tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:06.217115 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74603a5a-2869-414c-85c4-6d8e67afb9fa tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:06.309383 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-74603a5a-2869-414c-85c4-6d8e67afb9fa tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:40:06.833119 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-74603a5a-2869-414c-85c4-6d8e67afb9fa tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 204 len: 0 microversion: 2.1 time: 0.646193 Jul 19 22:40:06.861046 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1410/2836] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:40:06 2022] DELETE /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:40:06.876492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4d2638eb-0613-4ac8-815b-1d05adff9a6a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:06.878175 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4d2638eb-0613-4ac8-815b-1d05adff9a6a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:06.890508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4d2638eb-0613-4ac8-815b-1d05adff9a6a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:06.891754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4d2638eb-0613-4ac8-815b-1d05adff9a6a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:06.893219 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4d2638eb-0613-4ac8-815b-1d05adff9a6a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:06.894222 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4d2638eb-0613-4ac8-815b-1d05adff9a6a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:06.903174 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=14 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:06.975802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-294b6055-90d7-4098-8e59-f9cc2f656da2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:06.999627 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-294b6055-90d7-4098-8e59-f9cc2f656da2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41" status: 200 len: 1321 microversion: 2.1 time: 1.060507 Jul 19 22:40:07.001101 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1427/2837] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:05 2022] GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41 => generated 1321 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:07.028603 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-280e6d4b-0dcc-4a8a-8117-044a92dc70cd tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:07.031205 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-280e6d4b-0dcc-4a8a-8117-044a92dc70cd tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] [instance: d6f5f214-5b73-40e7-a0d0-1518cff74397] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:07.070207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-280e6d4b-0dcc-4a8a-8117-044a92dc70cd tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:07.071307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-280e6d4b-0dcc-4a8a-8117-044a92dc70cd tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:07.072627 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-280e6d4b-0dcc-4a8a-8117-044a92dc70cd tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:07.075792 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-280e6d4b-0dcc-4a8a-8117-044a92dc70cd tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:07.536434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-280e6d4b-0dcc-4a8a-8117-044a92dc70cd tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b609af624e4b4aeeb9bfde36b890b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6eabd2343c481b8f7e5b4d7e61f2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:07.552459 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-280e6d4b-0dcc-4a8a-8117-044a92dc70cd tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] 10.222.0.25 "GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397" status: 200 len: 1283 microversion: 2.1 time: 0.547399 Jul 19 22:40:07.556011 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1428/2838] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:07 2022] GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397 => generated 1283 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:07.572331 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b4e0be22-1a2c-4dce-b2bd-91d1928749a3 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a10525310>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:07.700386 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b4e0be22-1a2c-4dce-b2bd-91d1928749a3 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/images/6c492e8a-df35-4d1f-a61d-392f2860512a" status: 200 len: 1428 microversion: 2.1 time: 0.142910 Jul 19 22:40:07.704800 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1429/2839] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:40:07 2022] GET /compute/v2.1/images/6c492e8a-df35-4d1f-a61d-392f2860512a => generated 1428 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:07.710154 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-78cd1404-8378-43d1-ab89-0bc3b3eb244d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:07.711002 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-78cd1404-8378-43d1-ab89-0bc3b3eb244d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9177ec40-9593-42f5-97ad-d896faeb9e83] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:07.719832 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78cd1404-8378-43d1-ab89-0bc3b3eb244d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:07.720622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78cd1404-8378-43d1-ab89-0bc3b3eb244d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:07.721631 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78cd1404-8378-43d1-ab89-0bc3b3eb244d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:07.722237 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78cd1404-8378-43d1-ab89-0bc3b3eb244d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:08.127035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-78cd1404-8378-43d1-ab89-0bc3b3eb244d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:08.138244 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-78cd1404-8378-43d1-ab89-0bc3b3eb244d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83" status: 200 len: 1346 microversion: 2.1 time: 0.432096 Jul 19 22:40:08.142604 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1430/2840] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:07 2022] GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83 => generated 1346 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:08.155054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3dce64bd-767a-4cd5-9413-553c1187e412 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1824030827", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "a64f0a57-5630-4e13-b241-c604d3323992"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:08.272625 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-3dce64bd-767a-4cd5-9413-553c1187e412 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] validate_networks() for [('a64f0a57-5630-4e13-b241-c604d3323992', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:40:08.616035 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4d2638eb-0613-4ac8-815b-1d05adff9a6a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:08.644467 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4d2638eb-0613-4ac8-815b-1d05adff9a6a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 1.777892 Jul 19 22:40:08.647410 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1411/2841] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:06 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:08.665542 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-2ea670d0-10de-49f6-ba2c-9362758b49cd req-16f592e7-af6a-40fc-b8c1-c1dc3f463734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9177ec40-9593-42f5-97ad-d896faeb9e83", "name": "network-vif-deleted", "tag": "4379fd27-7b08-49a2-9149-3f70f318cfb0"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:08.695600 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-2ea670d0-10de-49f6-ba2c-9362758b49cd req-16f592e7-af6a-40fc-b8c1-c1dc3f463734 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:08.697907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-2ea670d0-10de-49f6-ba2c-9362758b49cd req-16f592e7-af6a-40fc-b8c1-c1dc3f463734 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:08.741821 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-2ea670d0-10de-49f6-ba2c-9362758b49cd req-16f592e7-af6a-40fc-b8c1-c1dc3f463734 service nova] Creating event network-vif-deleted:4379fd27-7b08-49a2-9149-3f70f318cfb0 for instance 9177ec40-9593-42f5-97ad-d896faeb9e83 on n-h1-847009-3 Jul 19 22:40:08.766258 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-2ea670d0-10de-49f6-ba2c-9362758b49cd req-16f592e7-af6a-40fc-b8c1-c1dc3f463734 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114344 Jul 19 22:40:08.769943 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1412/2842] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:08.790476 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-28322090-1360-4026-8264-9b3f502d5e14 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:08.791656 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-28322090-1360-4026-8264-9b3f502d5e14 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:08.825594 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28322090-1360-4026-8264-9b3f502d5e14 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:08.836872 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28322090-1360-4026-8264-9b3f502d5e14 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:08.838300 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28322090-1360-4026-8264-9b3f502d5e14 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:08.839001 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28322090-1360-4026-8264-9b3f502d5e14 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:11.243608 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-28322090-1360-4026-8264-9b3f502d5e14 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:11.274158 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-28322090-1360-4026-8264-9b3f502d5e14 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41" status: 200 len: 1321 microversion: 2.1 time: 2.502223 Jul 19 22:40:11.277832 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1413/2843] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:08 2022] GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41 => generated 1321 bytes in 2507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:11.285384 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5555740d-5734-4f6b-b5bc-1075d926016e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:11.297780 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5555740d-5734-4f6b-b5bc-1075d926016e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] [instance: d6f5f214-5b73-40e7-a0d0-1518cff74397] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:11.320186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5555740d-5734-4f6b-b5bc-1075d926016e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:11.320643 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5555740d-5734-4f6b-b5bc-1075d926016e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:11.321431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5555740d-5734-4f6b-b5bc-1075d926016e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:11.321870 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5555740d-5734-4f6b-b5bc-1075d926016e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:11.629930 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:11.750663 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=18 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:12.141445 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-3dce64bd-767a-4cd5-9413-553c1187e412 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:40:12.141866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-3dce64bd-767a-4cd5-9413-553c1187e412 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:40:12.142385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-3dce64bd-767a-4cd5-9413-553c1187e412 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:40:12.142746 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-3dce64bd-767a-4cd5-9413-553c1187e412 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:40:12.143403 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-3dce64bd-767a-4cd5-9413-553c1187e412 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:40:12.170696 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3dce64bd-767a-4cd5-9413-553c1187e412 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:12.171194 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3dce64bd-767a-4cd5-9413-553c1187e412 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:12.172023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3dce64bd-767a-4cd5-9413-553c1187e412 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:12.172464 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3dce64bd-767a-4cd5-9413-553c1187e412 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:12.264749 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-3dce64bd-767a-4cd5-9413-553c1187e412 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Getting quotas for project 6dced22c1fb648bea264ba11fa53884f. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:40:12.290268 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-3dce64bd-767a-4cd5-9413-553c1187e412 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Getting quotas for user b22a4202c81a43de895f85ffe1ce00cb and project 6dced22c1fb648bea264ba11fa53884f. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:40:12.329302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3dce64bd-767a-4cd5-9413-553c1187e412 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:40:12.337398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3dce64bd-767a-4cd5-9413-553c1187e412 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: f02e1a17-fe38-4d7f-b55b-aaed61eb7006] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:40:12.509850 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3dce64bd-767a-4cd5-9413-553c1187e412 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.365816 Jul 19 22:40:12.519186 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1431/2844] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:40:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 4376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:40:12.534348 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9a67ef8a-c20f-4071-8cf8-c7aab0a19b90 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1516043185"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:12.537677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9a67ef8a-c20f-4071-8cf8-c7aab0a19b90 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:12.553865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a67ef8a-c20f-4071-8cf8-c7aab0a19b90 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:12.554588 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a67ef8a-c20f-4071-8cf8-c7aab0a19b90 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:12.555678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a67ef8a-c20f-4071-8cf8-c7aab0a19b90 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:12.556264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a67ef8a-c20f-4071-8cf8-c7aab0a19b90 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:13.399457 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5555740d-5734-4f6b-b5bc-1075d926016e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b609af624e4b4aeeb9bfde36b890b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6eabd2343c481b8f7e5b4d7e61f2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:13.422804 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5555740d-5734-4f6b-b5bc-1075d926016e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] 10.222.0.25 "GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397" status: 200 len: 1325 microversion: 2.1 time: 2.133085 Jul 19 22:40:13.425496 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1414/2845] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:11 2022] GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397 => generated 1325 bytes in 2147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:13.443626 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cf8d200e-cd40-490b-b7ee-c0532de4bd6e tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a15576790>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:13.516365 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9a67ef8a-c20f-4071-8cf8-c7aab0a19b90 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action" status: 202 len: 0 microversion: 2.1 time: 0.987285 Jul 19 22:40:13.523385 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1432/2846] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:40:12 2022] POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action => generated 0 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 19 22:40:13.539849 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cbd493b1-8951-422a-9497-09e253d8d1f9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:13.547605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cbd493b1-8951-422a-9497-09e253d8d1f9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9177ec40-9593-42f5-97ad-d896faeb9e83] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:13.559373 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cf8d200e-cd40-490b-b7ee-c0532de4bd6e tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/images/6c492e8a-df35-4d1f-a61d-392f2860512a" status: 200 len: 1428 microversion: 2.1 time: 0.131746 Jul 19 22:40:13.560403 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1415/2847] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:40:13 2022] GET /compute/v2.1/images/6c492e8a-df35-4d1f-a61d-392f2860512a => generated 1428 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:13.573286 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cbd493b1-8951-422a-9497-09e253d8d1f9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:13.578910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-4740eff6-773b-43c2-9d7b-be0cfdafc0b7 req-2a7ae9eb-0995-4b5c-807e-cda592087316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9ae7d22-3925-465a-9507-250b670ecc77", "name": "network-vif-unplugged", "status": "completed", "tag": "3196bd8c-6a69-4858-81a6-622d724377b1"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:13.581301 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cbd493b1-8951-422a-9497-09e253d8d1f9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:13.587992 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cbd493b1-8951-422a-9497-09e253d8d1f9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:13.588653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cbd493b1-8951-422a-9497-09e253d8d1f9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:13.611989 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-4740eff6-773b-43c2-9d7b-be0cfdafc0b7 req-2a7ae9eb-0995-4b5c-807e-cda592087316 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:13.615177 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-4740eff6-773b-43c2-9d7b-be0cfdafc0b7 req-2a7ae9eb-0995-4b5c-807e-cda592087316 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:13.660377 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-4740eff6-773b-43c2-9d7b-be0cfdafc0b7 req-2a7ae9eb-0995-4b5c-807e-cda592087316 service nova] Creating event network-vif-unplugged:3196bd8c-6a69-4858-81a6-622d724377b1 for instance b9ae7d22-3925-465a-9507-250b670ecc77 on n-h2-847009-3 Jul 19 22:40:13.681761 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-4740eff6-773b-43c2-9d7b-be0cfdafc0b7 req-2a7ae9eb-0995-4b5c-807e-cda592087316 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116487 Jul 19 22:40:13.685026 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1416/2848] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:13.705781 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-39816a96-81a1-4ae2-bc08-56197d198795 req-5c0d0dc3-2b06-4b5e-a721-e0cbc8d043b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "648bd230-03d9-4186-8cc0-64573fae2ab6", "tag": "76067ba9-e586-4693-977c-0a0a25f007f8"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:13.742196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-39816a96-81a1-4ae2-bc08-56197d198795 req-5c0d0dc3-2b06-4b5e-a721-e0cbc8d043b2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:13.743385 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-39816a96-81a1-4ae2-bc08-56197d198795 req-5c0d0dc3-2b06-4b5e-a721-e0cbc8d043b2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:13.784973 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-39816a96-81a1-4ae2-bc08-56197d198795 req-5c0d0dc3-2b06-4b5e-a721-e0cbc8d043b2 service nova] Creating event network-changed:76067ba9-e586-4693-977c-0a0a25f007f8 for instance 648bd230-03d9-4186-8cc0-64573fae2ab6 on n-h1-847009-3 Jul 19 22:40:13.802472 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-39816a96-81a1-4ae2-bc08-56197d198795 req-5c0d0dc3-2b06-4b5e-a721-e0cbc8d043b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112560 Jul 19 22:40:13.805181 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1417/2849] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:13.823144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-05e9b1b2-e147-4589-b619-57b8d495b517 req-5b9e1fc0-7d08-460f-b64b-1cce4f77ff0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7c28d6e-5bfc-4b93-ab76-85ab7d401744", "name": "network-vif-deleted", "tag": "fca80e58-e0cd-4282-b725-470915412593"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:13.839014 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cbd493b1-8951-422a-9497-09e253d8d1f9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:13.850630 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-05e9b1b2-e147-4589-b619-57b8d495b517 req-5b9e1fc0-7d08-460f-b64b-1cce4f77ff0d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:13.851506 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-05e9b1b2-e147-4589-b619-57b8d495b517 req-5b9e1fc0-7d08-460f-b64b-1cce4f77ff0d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:13.861989 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cbd493b1-8951-422a-9497-09e253d8d1f9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83" status: 200 len: 1346 microversion: 2.1 time: 0.337193 Jul 19 22:40:13.868444 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1433/2850] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:13 2022] GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83 => generated 1346 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:13.883863 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e02b17c3-8b30-4132-84d2-1a3cdc3bee2d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:13.889527 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-05e9b1b2-e147-4589-b619-57b8d495b517 req-5b9e1fc0-7d08-460f-b64b-1cce4f77ff0d service nova] Creating event network-vif-deleted:fca80e58-e0cd-4282-b725-470915412593 for instance a7c28d6e-5bfc-4b93-ab76-85ab7d401744 on n-h2-847009-3 Jul 19 22:40:13.890805 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e02b17c3-8b30-4132-84d2-1a3cdc3bee2d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:13.898564 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-05e9b1b2-e147-4589-b619-57b8d495b517 req-5b9e1fc0-7d08-460f-b64b-1cce4f77ff0d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091892 Jul 19 22:40:13.901767 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1418/2851] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:13.910143 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e02b17c3-8b30-4132-84d2-1a3cdc3bee2d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:13.911309 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e02b17c3-8b30-4132-84d2-1a3cdc3bee2d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:13.912447 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e02b17c3-8b30-4132-84d2-1a3cdc3bee2d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:13.914955 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ad71e862-d8ba-4a14-b334-03ef0fab2277 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:13.915767 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ad71e862-d8ba-4a14-b334-03ef0fab2277 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: f02e1a17-fe38-4d7f-b55b-aaed61eb7006] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:13.916065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e02b17c3-8b30-4132-84d2-1a3cdc3bee2d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:13.942765 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad71e862-d8ba-4a14-b334-03ef0fab2277 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:13.943796 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad71e862-d8ba-4a14-b334-03ef0fab2277 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:13.945400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad71e862-d8ba-4a14-b334-03ef0fab2277 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:13.948974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad71e862-d8ba-4a14-b334-03ef0fab2277 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:14.006605 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:14.251609 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ad71e862-d8ba-4a14-b334-03ef0fab2277 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:14.264114 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ad71e862-d8ba-4a14-b334-03ef0fab2277 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006" status: 200 len: 1222 microversion: 2.1 time: 0.360420 Jul 19 22:40:14.287099 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1419/2852] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:13 2022] GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006 => generated 1222 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:14.303661 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5ae2c152-061d-4a6a-8617-8a8f564d368e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:14.305112 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5ae2c152-061d-4a6a-8617-8a8f564d368e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:14.330286 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ae2c152-061d-4a6a-8617-8a8f564d368e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:14.331091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ae2c152-061d-4a6a-8617-8a8f564d368e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:14.332241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ae2c152-061d-4a6a-8617-8a8f564d368e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:14.335917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ae2c152-061d-4a6a-8617-8a8f564d368e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:15.145726 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e02b17c3-8b30-4132-84d2-1a3cdc3bee2d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:15.161939 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e02b17c3-8b30-4132-84d2-1a3cdc3bee2d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41" status: 200 len: 1321 microversion: 2.1 time: 1.291639 Jul 19 22:40:15.162897 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1434/2853] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:13 2022] GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41 => generated 1321 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:15.169700 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7d279f80-3583-499f-9bd5-dd3335a762f2 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:15.170327 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7d279f80-3583-499f-9bd5-dd3335a762f2 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] [instance: d6f5f214-5b73-40e7-a0d0-1518cff74397] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:15.186743 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7d279f80-3583-499f-9bd5-dd3335a762f2 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:15.190357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7d279f80-3583-499f-9bd5-dd3335a762f2 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:15.191556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7d279f80-3583-499f-9bd5-dd3335a762f2 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:15.192013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7d279f80-3583-499f-9bd5-dd3335a762f2 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:16.091701 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7d279f80-3583-499f-9bd5-dd3335a762f2 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b609af624e4b4aeeb9bfde36b890b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6eabd2343c481b8f7e5b4d7e61f2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:16.109444 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7d279f80-3583-499f-9bd5-dd3335a762f2 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] 10.222.0.25 "GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397" status: 200 len: 1325 microversion: 2.1 time: 0.945212 Jul 19 22:40:16.127797 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1435/2854] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:15 2022] GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397 => generated 1325 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:16.133428 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7b4af547-770a-496a-abfe-b5fb4f348b58 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a03785550>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:16.240696 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7b4af547-770a-496a-abfe-b5fb4f348b58 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/images/6c492e8a-df35-4d1f-a61d-392f2860512a" status: 200 len: 1428 microversion: 2.1 time: 0.111100 Jul 19 22:40:16.249290 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1436/2855] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:40:16 2022] GET /compute/v2.1/images/6c492e8a-df35-4d1f-a61d-392f2860512a => generated 1428 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:16.254796 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b5e4ca81-5495-40a3-a246-3b0b6d2dc29e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:16.261088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b5e4ca81-5495-40a3-a246-3b0b6d2dc29e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9177ec40-9593-42f5-97ad-d896faeb9e83] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:16.280772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b5e4ca81-5495-40a3-a246-3b0b6d2dc29e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:16.281511 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b5e4ca81-5495-40a3-a246-3b0b6d2dc29e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:16.282524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b5e4ca81-5495-40a3-a246-3b0b6d2dc29e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:16.284975 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b5e4ca81-5495-40a3-a246-3b0b6d2dc29e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:16.300623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:16.357663 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5ae2c152-061d-4a6a-8617-8a8f564d368e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:16.373903 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5ae2c152-061d-4a6a-8617-8a8f564d368e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1678 microversion: 2.1 time: 2.085155 Jul 19 22:40:16.388015 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1420/2856] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:14 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1678 bytes in 2099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:16.538281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c695239b-23dd-4c6c-9138-bfbe0766a726 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Action: 'create', calling method: .version_select at 0x7f7a10349c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1340784246", "description": "tempest-description-699318695"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:16.885605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b5e4ca81-5495-40a3-a246-3b0b6d2dc29e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:16.908210 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b5e4ca81-5495-40a3-a246-3b0b6d2dc29e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83" status: 200 len: 1346 microversion: 2.1 time: 0.657202 Jul 19 22:40:16.909885 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1437/2857] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:16 2022] GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83 => generated 1346 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:16.921173 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5b99fc96-3b8f-43e8-8674-ae7f08d517c0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:16.923710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5b99fc96-3b8f-43e8-8674-ae7f08d517c0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: f02e1a17-fe38-4d7f-b55b-aaed61eb7006] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:16.926533 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:16.932727 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b99fc96-3b8f-43e8-8674-ae7f08d517c0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:16.934236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b99fc96-3b8f-43e8-8674-ae7f08d517c0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:16.935966 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b99fc96-3b8f-43e8-8674-ae7f08d517c0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:16.936653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b99fc96-3b8f-43e8-8674-ae7f08d517c0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:18.890573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5b99fc96-3b8f-43e8-8674-ae7f08d517c0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:18.910248 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5b99fc96-3b8f-43e8-8674-ae7f08d517c0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006" status: 200 len: 1318 microversion: 2.1 time: 1.996886 Jul 19 22:40:18.911241 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1438/2858] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:16 2022] GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006 => generated 1318 bytes in 2001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:18.926905 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-599dc881-69ab-42ac-b6b6-582773713ee2 req-958523c3-d829-4475-9196-16c6d03754e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "976f2ec1-c70b-4795-a71d-251bed15ad25", "name": "network-vif-plugged", "status": "completed", "tag": "c3b703eb-00f7-4fb3-9358-40627991eef1"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:18.954497 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-599dc881-69ab-42ac-b6b6-582773713ee2 req-958523c3-d829-4475-9196-16c6d03754e8 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:18.957717 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-599dc881-69ab-42ac-b6b6-582773713ee2 req-958523c3-d829-4475-9196-16c6d03754e8 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:19.016288 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-599dc881-69ab-42ac-b6b6-582773713ee2 req-958523c3-d829-4475-9196-16c6d03754e8 service nova] Creating event network-vif-plugged:c3b703eb-00f7-4fb3-9358-40627991eef1 for instance 976f2ec1-c70b-4795-a71d-251bed15ad25 on n-h1-847009-3 Jul 19 22:40:19.035817 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-599dc881-69ab-42ac-b6b6-582773713ee2 req-958523c3-d829-4475-9196-16c6d03754e8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122215 Jul 19 22:40:19.036350 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1439/2859] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:19.061242 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-d2a6ba12-d1d2-452e-a17b-039548d4fbbe req-3a807560-cd06-4613-929a-06ba6061f4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24930fd1-7b1b-4bdd-9143-d9d0bfa6da41", "tag": "ea6d5ff1-f67a-4eb4-9529-de8c075d640f"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:19.098319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d2a6ba12-d1d2-452e-a17b-039548d4fbbe req-3a807560-cd06-4613-929a-06ba6061f4b8 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:19.098885 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d2a6ba12-d1d2-452e-a17b-039548d4fbbe req-3a807560-cd06-4613-929a-06ba6061f4b8 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:19.166255 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-d2a6ba12-d1d2-452e-a17b-039548d4fbbe req-3a807560-cd06-4613-929a-06ba6061f4b8 service nova] Creating event network-changed:ea6d5ff1-f67a-4eb4-9529-de8c075d640f for instance 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41 on n-h1-847009-3 Jul 19 22:40:19.184324 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-d2a6ba12-d1d2-452e-a17b-039548d4fbbe req-3a807560-cd06-4613-929a-06ba6061f4b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137201 Jul 19 22:40:19.192696 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1440/2860] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:19.211734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c6936daa-9aca-4d5e-a90d-68f7d571f3f4 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:19.215357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c6936daa-9aca-4d5e-a90d-68f7d571f3f4 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:19.240148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6936daa-9aca-4d5e-a90d-68f7d571f3f4 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:19.240148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6936daa-9aca-4d5e-a90d-68f7d571f3f4 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:19.240148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6936daa-9aca-4d5e-a90d-68f7d571f3f4 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:19.243995 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6936daa-9aca-4d5e-a90d-68f7d571f3f4 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:19.397361 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c695239b-23dd-4c6c-9138-bfbe0766a726 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 3.007804 Jul 19 22:40:19.398345 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1421/2861] 10.222.0.25 () {60 vars in 1179 bytes} [Tue Jul 19 22:40:16 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 3010 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:19.407287 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bf65acee-6a23-4078-b293-471fb3fe2d53 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:19.408315 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bf65acee-6a23-4078-b293-471fb3fe2d53 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] [instance: d6f5f214-5b73-40e7-a0d0-1518cff74397] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:19.416955 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bf65acee-6a23-4078-b293-471fb3fe2d53 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:19.418360 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bf65acee-6a23-4078-b293-471fb3fe2d53 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:19.419553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bf65acee-6a23-4078-b293-471fb3fe2d53 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:19.420650 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bf65acee-6a23-4078-b293-471fb3fe2d53 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:20.452297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bf65acee-6a23-4078-b293-471fb3fe2d53 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b609af624e4b4aeeb9bfde36b890b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6eabd2343c481b8f7e5b4d7e61f2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:20.478272 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bf65acee-6a23-4078-b293-471fb3fe2d53 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] 10.222.0.25 "GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397" status: 200 len: 1325 microversion: 2.1 time: 1.074506 Jul 19 22:40:20.480994 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1422/2862] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:19 2022] GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397 => generated 1325 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:20.495800 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-17997ff1-3aca-4d17-8976-a141ab50d313 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a106a8160>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:20.987391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c6936daa-9aca-4d5e-a90d-68f7d571f3f4 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:21.016168 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c6936daa-9aca-4d5e-a90d-68f7d571f3f4 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41" status: 200 len: 1321 microversion: 2.1 time: 1.807676 Jul 19 22:40:21.017192 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1441/2863] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:19 2022] GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41 => generated 1321 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:21.023943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-692dc5b0-6a9e-470e-ae83-41f61ce57879 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:21.024793 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-692dc5b0-6a9e-470e-ae83-41f61ce57879 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:21.048485 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-692dc5b0-6a9e-470e-ae83-41f61ce57879 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:21.049015 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-692dc5b0-6a9e-470e-ae83-41f61ce57879 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:21.049820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-692dc5b0-6a9e-470e-ae83-41f61ce57879 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:21.055036 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-692dc5b0-6a9e-470e-ae83-41f61ce57879 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:22.082839 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-692dc5b0-6a9e-470e-ae83-41f61ce57879 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:22.102630 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-692dc5b0-6a9e-470e-ae83-41f61ce57879 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1681 microversion: 2.1 time: 1.084030 Jul 19 22:40:22.119317 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1442/2864] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:21 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1681 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:22.142842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a9f42954-4f6c-4b15-81c1-e7cfaa6a3f4e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:22.148732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a9f42954-4f6c-4b15-81c1-e7cfaa6a3f4e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9177ec40-9593-42f5-97ad-d896faeb9e83] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:22.176524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a9f42954-4f6c-4b15-81c1-e7cfaa6a3f4e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:22.177177 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a9f42954-4f6c-4b15-81c1-e7cfaa6a3f4e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:22.178176 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a9f42954-4f6c-4b15-81c1-e7cfaa6a3f4e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:22.178936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a9f42954-4f6c-4b15-81c1-e7cfaa6a3f4e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:22.196721 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:22.224930 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-a9f42954-4f6c-4b15-81c1-e7cfaa6a3f4e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] HTTP exception thrown: Instance 9177ec40-9593-42f5-97ad-d896faeb9e83 could not be found. Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a9f42954-4f6c-4b15-81c1-e7cfaa6a3f4e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Request method failure captured: Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83 HTTP/1.1 Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zJcOd8ioSoO4Ag7p0FuZhdyFBnwQELvoxLAsblThyrJ_2NxEo2CJ37EEfRT2CZdbZlGMRgWXNVEuSQUWOfX5krUiSHAMeusL8iD4FHXx0Nd2OURbeGsEBn_IDvsFz7TmW6c-8lxScCQfbEdKUx47XHZCtuEAW7dgjTFB9ANV0LmkTU Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: f4f40233895248229ddfdcd06fb65361 Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 9177ec40-9593-42f5-97ad-d896faeb9e83 could not be found. Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '9177ec40-9593-42f5-97ad-d896faeb9e83'} Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9177ec40-9593-42f5-97ad-d896faeb9e83 could not be found. Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9177ec40-9593-42f5-97ad-d896faeb9e83 could not be found. Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:22.234287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:22.239381 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:22.239381 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:22.239381 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:22.239381 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:40:22.239381 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:40:22.239381 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9177ec40-9593-42f5-97ad-d896faeb9e83 could not be found. Jul 19 22:40:22.239381 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:22.240690 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a9f42954-4f6c-4b15-81c1-e7cfaa6a3f4e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Returning 404 to user: Instance 9177ec40-9593-42f5-97ad-d896faeb9e83 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:22.248232 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a9f42954-4f6c-4b15-81c1-e7cfaa6a3f4e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83" status: 404 len: 111 microversion: 2.1 time: 0.127589 Jul 19 22:40:22.249397 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1443/2865] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:22 2022] GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:40:22.266703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-a21561d3-e593-4c7c-8bdb-a023b79ae9eb req-55f7aac0-bdcc-467c-863f-2b0d70be271a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f02e1a17-fe38-4d7f-b55b-aaed61eb7006", "tag": "050e78eb-b37a-4f0b-b2c4-5541e704e627"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:22.308814 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:22.322638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-a21561d3-e593-4c7c-8bdb-a023b79ae9eb req-55f7aac0-bdcc-467c-863f-2b0d70be271a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:22.323083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-a21561d3-e593-4c7c-8bdb-a023b79ae9eb req-55f7aac0-bdcc-467c-863f-2b0d70be271a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:22.374158 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-a21561d3-e593-4c7c-8bdb-a023b79ae9eb req-55f7aac0-bdcc-467c-863f-2b0d70be271a service nova] Creating event network-changed:050e78eb-b37a-4f0b-b2c4-5541e704e627 for instance f02e1a17-fe38-4d7f-b55b-aaed61eb7006 on n-h2-847009-3 Jul 19 22:40:22.398542 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-a21561d3-e593-4c7c-8bdb-a023b79ae9eb req-55f7aac0-bdcc-467c-863f-2b0d70be271a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146123 Jul 19 22:40:22.400684 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1444/2866] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:22.409046 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bc013fd7-72da-4dde-9d44-8e60b59f45c0 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Action: 'create', calling method: .version_select at 0x7f7a0377f790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-86723233", "description": "tempest-description-632240209"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:23.750333 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bc013fd7-72da-4dde-9d44-8e60b59f45c0 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 1.348273 Jul 19 22:40:23.752734 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1445/2867] 10.222.0.25 () {60 vars in 1179 bytes} [Tue Jul 19 22:40:22 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:23.764070 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-04a45807-738a-414b-b7b7-0519f6c096c6 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:23.765788 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-04a45807-738a-414b-b7b7-0519f6c096c6 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: f02e1a17-fe38-4d7f-b55b-aaed61eb7006] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:23.785845 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04a45807-738a-414b-b7b7-0519f6c096c6 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:23.788753 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04a45807-738a-414b-b7b7-0519f6c096c6 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:23.791634 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04a45807-738a-414b-b7b7-0519f6c096c6 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:23.793300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04a45807-738a-414b-b7b7-0519f6c096c6 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:24.076952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-04a45807-738a-414b-b7b7-0519f6c096c6 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:24.117417 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-04a45807-738a-414b-b7b7-0519f6c096c6 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006" status: 200 len: 1318 microversion: 2.1 time: 0.362925 Jul 19 22:40:24.118374 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1446/2868] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:23 2022] GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006 => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:24.130298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-c3e7d334-a19d-4474-b8f4-cbee3838299e req-8c16f792-cde3-4f4f-b5c4-89d21a4ed130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "648bd230-03d9-4186-8cc0-64573fae2ab6", "name": "network-vif-plugged", "status": "completed", "tag": "76067ba9-e586-4693-977c-0a0a25f007f8"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:24.173680 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c3e7d334-a19d-4474-b8f4-cbee3838299e req-8c16f792-cde3-4f4f-b5c4-89d21a4ed130 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:24.174142 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c3e7d334-a19d-4474-b8f4-cbee3838299e req-8c16f792-cde3-4f4f-b5c4-89d21a4ed130 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:24.204303 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-c3e7d334-a19d-4474-b8f4-cbee3838299e req-8c16f792-cde3-4f4f-b5c4-89d21a4ed130 service nova] Creating event network-vif-plugged:76067ba9-e586-4693-977c-0a0a25f007f8 for instance 648bd230-03d9-4186-8cc0-64573fae2ab6 on n-h1-847009-3 Jul 19 22:40:24.217950 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-c3e7d334-a19d-4474-b8f4-cbee3838299e req-8c16f792-cde3-4f4f-b5c4-89d21a4ed130 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098497 Jul 19 22:40:24.219835 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1447/2869] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:24.235375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e09b6dc3-19ec-4d41-b3c0-df51d8bfe874 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:24.237629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e09b6dc3-19ec-4d41-b3c0-df51d8bfe874 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] [instance: d6f5f214-5b73-40e7-a0d0-1518cff74397] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:24.244830 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e09b6dc3-19ec-4d41-b3c0-df51d8bfe874 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:24.245678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e09b6dc3-19ec-4d41-b3c0-df51d8bfe874 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:24.246700 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e09b6dc3-19ec-4d41-b3c0-df51d8bfe874 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:24.247363 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e09b6dc3-19ec-4d41-b3c0-df51d8bfe874 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:24.744902 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e09b6dc3-19ec-4d41-b3c0-df51d8bfe874 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b609af624e4b4aeeb9bfde36b890b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6eabd2343c481b8f7e5b4d7e61f2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:24.784014 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e09b6dc3-19ec-4d41-b3c0-df51d8bfe874 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] 10.222.0.25 "GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397" status: 200 len: 1325 microversion: 2.1 time: 0.551216 Jul 19 22:40:24.786202 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1448/2870] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:24 2022] GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397 => generated 1325 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:24.799255 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-63377455-7d2a-426d-8051-64d872a9daec req-8dfab5c2-5b90-4681-9f77-b8b3bab61046 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6f5f214-5b73-40e7-a0d0-1518cff74397", "tag": "165c22a8-352f-4506-8cdb-92cbd1613968"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:24.820296 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-63377455-7d2a-426d-8051-64d872a9daec req-8dfab5c2-5b90-4681-9f77-b8b3bab61046 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:24.828754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-63377455-7d2a-426d-8051-64d872a9daec req-8dfab5c2-5b90-4681-9f77-b8b3bab61046 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:24.858846 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-63377455-7d2a-426d-8051-64d872a9daec req-8dfab5c2-5b90-4681-9f77-b8b3bab61046 service nova] Creating event network-changed:165c22a8-352f-4506-8cdb-92cbd1613968 for instance d6f5f214-5b73-40e7-a0d0-1518cff74397 on n-h2-847009-3 Jul 19 22:40:24.880546 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-63377455-7d2a-426d-8051-64d872a9daec req-8dfab5c2-5b90-4681-9f77-b8b3bab61046 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091844 Jul 19 22:40:24.881237 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1449/2871] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:24.891201 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e9cdeb8f-42ac-4665-981f-e1d0a4da1d2b tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:24.892279 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e9cdeb8f-42ac-4665-981f-e1d0a4da1d2b tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:24.908348 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9cdeb8f-42ac-4665-981f-e1d0a4da1d2b tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:24.909091 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9cdeb8f-42ac-4665-981f-e1d0a4da1d2b tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:24.910084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9cdeb8f-42ac-4665-981f-e1d0a4da1d2b tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:24.913150 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9cdeb8f-42ac-4665-981f-e1d0a4da1d2b tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:25.399986 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e9cdeb8f-42ac-4665-981f-e1d0a4da1d2b tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:25.415767 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e9cdeb8f-42ac-4665-981f-e1d0a4da1d2b tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41" status: 200 len: 1321 microversion: 2.1 time: 0.532909 Jul 19 22:40:25.420790 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1450/2872] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:24 2022] GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41 => generated 1321 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:25.429486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-00766d2b-de10-4157-a79b-257b3e27beef tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:25.430706 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-00766d2b-de10-4157-a79b-257b3e27beef tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9177ec40-9593-42f5-97ad-d896faeb9e83] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:25.451429 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00766d2b-de10-4157-a79b-257b3e27beef tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:25.452153 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00766d2b-de10-4157-a79b-257b3e27beef tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:25.453142 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00766d2b-de10-4157-a79b-257b3e27beef tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:25.453945 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00766d2b-de10-4157-a79b-257b3e27beef tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:25.484258 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-00766d2b-de10-4157-a79b-257b3e27beef tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] HTTP exception thrown: Instance 9177ec40-9593-42f5-97ad-d896faeb9e83 could not be found. Jul 19 22:40:25.485782 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-17997ff1-3aca-4d17-8976-a141ab50d313 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/images/6c492e8a-df35-4d1f-a61d-392f2860512a" status: 200 len: 1437 microversion: 2.1 time: 5.002597 Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-00766d2b-de10-4157-a79b-257b3e27beef tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Request method failure captured: Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83/os-volume_attachments HTTP/1.1 Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zJcOd8ioSoO4Ag7p0FuZhdyFBnwQELvoxLAsblThyrJ_2NxEo2CJ37EEfRT2CZdbZlGMRgWXNVEuSQUWOfX5krUiSHAMeusL8iD4FHXx0Nd2OURbeGsEBn_IDvsFz7TmW6c-8lxScCQfbEdKUx47XHZCtuEAW7dgjTFB9ANV0LmkTU Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: f4f40233895248229ddfdcd06fb65361 Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 9177ec40-9593-42f5-97ad-d896faeb9e83 could not be found. Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'server_id': '9177ec40-9593-42f5-97ad-d896faeb9e83'} Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9177ec40-9593-42f5-97ad-d896faeb9e83 could not be found. Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:40:25.487505 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:40:25.492333 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9177ec40-9593-42f5-97ad-d896faeb9e83 could not be found. Jul 19 22:40:25.492333 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:25.492333 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:25.492333 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:25.492333 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:25.492333 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:25.492333 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:25.492333 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:40:25.492333 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:40:25.492333 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9177ec40-9593-42f5-97ad-d896faeb9e83 could not be found. Jul 19 22:40:25.492333 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:25.493231 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1423/2873] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:40:20 2022] GET /compute/v2.1/images/6c492e8a-df35-4d1f-a61d-392f2860512a => generated 1437 bytes in 5006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:25.494124 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-00766d2b-de10-4157-a79b-257b3e27beef tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Returning 404 to user: Instance 9177ec40-9593-42f5-97ad-d896faeb9e83 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:25.495190 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-00766d2b-de10-4157-a79b-257b3e27beef tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.073354 Jul 19 22:40:25.496295 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1451/2874] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:40:25 2022] GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83/os-volume_attachments => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:40:25.499327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-908a9227-e07f-4940-b494-62dc5b092da7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:25.501633 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8ef69f01-3612-4b70-939f-ad2a2eee89c3 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1916823578", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "ee934865-b463-4ab4-828c-235f316df8ae"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:25.503408 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-908a9227-e07f-4940-b494-62dc5b092da7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:25.510642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:25.516149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-908a9227-e07f-4940-b494-62dc5b092da7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:25.518054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-908a9227-e07f-4940-b494-62dc5b092da7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:25.519311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-908a9227-e07f-4940-b494-62dc5b092da7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:25.519929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-908a9227-e07f-4940-b494-62dc5b092da7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:25.611967 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-8ef69f01-3612-4b70-939f-ad2a2eee89c3 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] validate_networks() for [('ee934865-b463-4ab4-828c-235f316df8ae', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:40:26.442960 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-908a9227-e07f-4940-b494-62dc5b092da7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:26.512063 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-908a9227-e07f-4940-b494-62dc5b092da7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1681 microversion: 2.1 time: 1.002583 Jul 19 22:40:26.527768 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1424/2875] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:25 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1681 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:26.528053 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5549410e-40a1-409f-9f32-0f37eb18f7fd tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:26.542955 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5549410e-40a1-409f-9f32-0f37eb18f7fd tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: f02e1a17-fe38-4d7f-b55b-aaed61eb7006] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:26.558484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5549410e-40a1-409f-9f32-0f37eb18f7fd tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:26.564745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5549410e-40a1-409f-9f32-0f37eb18f7fd tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:26.565902 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5549410e-40a1-409f-9f32-0f37eb18f7fd tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:26.566378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5549410e-40a1-409f-9f32-0f37eb18f7fd tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:27.211289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5549410e-40a1-409f-9f32-0f37eb18f7fd tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:27.231246 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5549410e-40a1-409f-9f32-0f37eb18f7fd tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006" status: 200 len: 1318 microversion: 2.1 time: 0.708138 Jul 19 22:40:27.232527 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1425/2876] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:26 2022] GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006 => generated 1318 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:27.240778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-8ef69f01-3612-4b70-939f-ad2a2eee89c3 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:40:27.241977 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-8ef69f01-3612-4b70-939f-ad2a2eee89c3 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:40:27.242595 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-db72510a-d7c0-44de-b594-2f1ea4bf2266 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a1050ec10>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:27.243250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-8ef69f01-3612-4b70-939f-ad2a2eee89c3 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:40:27.243923 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-8ef69f01-3612-4b70-939f-ad2a2eee89c3 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:40:27.244725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-8ef69f01-3612-4b70-939f-ad2a2eee89c3 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:40:27.257974 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ef69f01-3612-4b70-939f-ad2a2eee89c3 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:27.258763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ef69f01-3612-4b70-939f-ad2a2eee89c3 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:27.259825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ef69f01-3612-4b70-939f-ad2a2eee89c3 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:27.260524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ef69f01-3612-4b70-939f-ad2a2eee89c3 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:27.286096 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-8ef69f01-3612-4b70-939f-ad2a2eee89c3 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Getting quotas for project 24647fdcb5d7402ebfdca8ea2ae72e2d. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:40:27.292529 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-db72510a-d7c0-44de-b594-2f1ea4bf2266 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/images/6c492e8a-df35-4d1f-a61d-392f2860512a" status: 200 len: 1437 microversion: 2.1 time: 0.057800 Jul 19 22:40:27.293464 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1426/2877] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 22:40:27 2022] GET /compute/v2.1/images/6c492e8a-df35-4d1f-a61d-392f2860512a => generated 1437 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:27.295077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-8ef69f01-3612-4b70-939f-ad2a2eee89c3 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Getting quotas for user 6994ad3a701847d49163a7b709fba400 and project 24647fdcb5d7402ebfdca8ea2ae72e2d. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:40:27.298394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-84bbc2eb-1a0d-4bf5-94e3-69e3688cc634 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1935807991", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "87c331fb-040c-45fc-a9a1-e946f840de97"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:27.311277 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8ef69f01-3612-4b70-939f-ad2a2eee89c3 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:40:27.314682 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8ef69f01-3612-4b70-939f-ad2a2eee89c3 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: fb624b16-6d57-4542-bae7-36cd5b28be74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:40:27.369333 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-84bbc2eb-1a0d-4bf5-94e3-69e3688cc634 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] validate_networks() for [('87c331fb-040c-45fc-a9a1-e946f840de97', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:40:27.376667 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8ef69f01-3612-4b70-939f-ad2a2eee89c3 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.879133 Jul 19 22:40:27.377963 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1452/2878] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:40:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:40:27.383073 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f30909e6-9aea-4c2c-98a2-a8089479d83e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:27.383976 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f30909e6-9aea-4c2c-98a2-a8089479d83e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] [instance: d6f5f214-5b73-40e7-a0d0-1518cff74397] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:27.409240 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f30909e6-9aea-4c2c-98a2-a8089479d83e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:27.410026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f30909e6-9aea-4c2c-98a2-a8089479d83e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:27.416269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f30909e6-9aea-4c2c-98a2-a8089479d83e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:27.416990 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f30909e6-9aea-4c2c-98a2-a8089479d83e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:27.794220 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f30909e6-9aea-4c2c-98a2-a8089479d83e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b609af624e4b4aeeb9bfde36b890b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6eabd2343c481b8f7e5b4d7e61f2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:27.804799 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f30909e6-9aea-4c2c-98a2-a8089479d83e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] 10.222.0.25 "GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397" status: 200 len: 1325 microversion: 2.1 time: 0.425449 Jul 19 22:40:27.807816 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1453/2879] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:27 2022] GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397 => generated 1325 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:27.923102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-2db3a05d-1145-42ea-b3af-20e33c045685 req-e88f5b96-27d7-4480-be4d-4d5855d11c8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9ae7d22-3925-465a-9507-250b670ecc77", "name": "network-vif-plugged", "status": "completed", "tag": "3196bd8c-6a69-4858-81a6-622d724377b1"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:27.937176 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-2db3a05d-1145-42ea-b3af-20e33c045685 req-e88f5b96-27d7-4480-be4d-4d5855d11c8e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:27.937583 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-2db3a05d-1145-42ea-b3af-20e33c045685 req-e88f5b96-27d7-4480-be4d-4d5855d11c8e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:27.975831 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-2db3a05d-1145-42ea-b3af-20e33c045685 req-e88f5b96-27d7-4480-be4d-4d5855d11c8e service nova] Creating event network-vif-plugged:3196bd8c-6a69-4858-81a6-622d724377b1 for instance b9ae7d22-3925-465a-9507-250b670ecc77 on n-h2-847009-3 Jul 19 22:40:27.988326 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-2db3a05d-1145-42ea-b3af-20e33c045685 req-e88f5b96-27d7-4480-be4d-4d5855d11c8e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177348 Jul 19 22:40:27.990756 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1454/2880] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:28.007805 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-977e784c-29fb-4645-935c-02812636ee30 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:28.008602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-977e784c-29fb-4645-935c-02812636ee30 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:28.033043 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-977e784c-29fb-4645-935c-02812636ee30 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:28.033816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-977e784c-29fb-4645-935c-02812636ee30 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:28.034873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-977e784c-29fb-4645-935c-02812636ee30 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:28.035494 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-977e784c-29fb-4645-935c-02812636ee30 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:28.207862 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-84bbc2eb-1a0d-4bf5-94e3-69e3688cc634 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:40:28.208391 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-84bbc2eb-1a0d-4bf5-94e3-69e3688cc634 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:40:28.208761 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-84bbc2eb-1a0d-4bf5-94e3-69e3688cc634 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:40:28.209363 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-84bbc2eb-1a0d-4bf5-94e3-69e3688cc634 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:40:28.210004 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-84bbc2eb-1a0d-4bf5-94e3-69e3688cc634 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:40:28.231398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-977e784c-29fb-4645-935c-02812636ee30 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:28.234048 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-84bbc2eb-1a0d-4bf5-94e3-69e3688cc634 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:28.234869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-84bbc2eb-1a0d-4bf5-94e3-69e3688cc634 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:28.235889 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-84bbc2eb-1a0d-4bf5-94e3-69e3688cc634 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:28.236509 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-84bbc2eb-1a0d-4bf5-94e3-69e3688cc634 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:28.242766 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-977e784c-29fb-4645-935c-02812636ee30 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41" status: 200 len: 1321 microversion: 2.1 time: 0.249240 Jul 19 22:40:28.244808 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1455/2881] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:27 2022] GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41 => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:28.257921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f8d9a898-66e9-4b68-b280-472a3d14539a tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:28.258757 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f8d9a898-66e9-4b68-b280-472a3d14539a tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] [instance: 3b617584-f9bc-43a8-af3c-78546d0d9889] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:28.267451 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8d9a898-66e9-4b68-b280-472a3d14539a tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:28.268572 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8d9a898-66e9-4b68-b280-472a3d14539a tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:28.269556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8d9a898-66e9-4b68-b280-472a3d14539a tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:28.270738 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8d9a898-66e9-4b68-b280-472a3d14539a tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:28.278544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-84bbc2eb-1a0d-4bf5-94e3-69e3688cc634 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Getting quotas for project a2bcdb843a7d4a1ebe467160eee0d6e1. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:40:28.290260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-84bbc2eb-1a0d-4bf5-94e3-69e3688cc634 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Getting quotas for user f4f40233895248229ddfdcd06fb65361 and project a2bcdb843a7d4a1ebe467160eee0d6e1. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:40:28.318024 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-84bbc2eb-1a0d-4bf5-94e3-69e3688cc634 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:40:28.320987 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-84bbc2eb-1a0d-4bf5-94e3-69e3688cc634 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 0a5f7b5f-76ce-433e-9c96-53d7821b1761] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:40:28.421934 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-84bbc2eb-1a0d-4bf5-94e3-69e3688cc634 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.127234 Jul 19 22:40:28.424100 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1427/2882] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:40:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:40:28.436105 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dc029f3e-81e8-4b5a-a966-25c6ebf8748d tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:28.438544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dc029f3e-81e8-4b5a-a966-25c6ebf8748d tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: fb624b16-6d57-4542-bae7-36cd5b28be74] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:28.448153 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dc029f3e-81e8-4b5a-a966-25c6ebf8748d tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:28.449385 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dc029f3e-81e8-4b5a-a966-25c6ebf8748d tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:28.450635 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dc029f3e-81e8-4b5a-a966-25c6ebf8748d tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:28.451965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dc029f3e-81e8-4b5a-a966-25c6ebf8748d tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:28.503646 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f8d9a898-66e9-4b68-b280-472a3d14539a tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746810a196b24e8884a9526580cdc2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe347c5b18f487ab2fc6b6de7e959e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:28.514634 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f8d9a898-66e9-4b68-b280-472a3d14539a tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889" status: 200 len: 1465 microversion: 2.1 time: 0.259704 Jul 19 22:40:28.531825 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1456/2883] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:28 2022] GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889 => generated 1465 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:28.551494 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7933a3fb-e527-4123-916e-a97f567da6e8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:28.552117 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7933a3fb-e527-4123-916e-a97f567da6e8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:28.570427 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7933a3fb-e527-4123-916e-a97f567da6e8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:28.570906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7933a3fb-e527-4123-916e-a97f567da6e8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:28.575342 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7933a3fb-e527-4123-916e-a97f567da6e8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:28.576749 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7933a3fb-e527-4123-916e-a97f567da6e8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:28.596855 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dc029f3e-81e8-4b5a-a966-25c6ebf8748d tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6994ad3a701847d49163a7b709fba400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24647fdcb5d7402ebfdca8ea2ae72e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:28.610899 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dc029f3e-81e8-4b5a-a966-25c6ebf8748d tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74" status: 200 len: 1220 microversion: 2.1 time: 0.184182 Jul 19 22:40:28.620692 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1428/2884] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:28 2022] GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74 => generated 1220 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:28.630048 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-71f4154d-fb4a-409b-a8a3-43604ac73ee5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:28.630661 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-71f4154d-fb4a-409b-a8a3-43604ac73ee5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: f02e1a17-fe38-4d7f-b55b-aaed61eb7006] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:28.647162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-71f4154d-fb4a-409b-a8a3-43604ac73ee5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:28.647632 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-71f4154d-fb4a-409b-a8a3-43604ac73ee5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:28.648773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-71f4154d-fb4a-409b-a8a3-43604ac73ee5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:28.648876 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-71f4154d-fb4a-409b-a8a3-43604ac73ee5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:28.969842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7933a3fb-e527-4123-916e-a97f567da6e8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:28.981296 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7933a3fb-e527-4123-916e-a97f567da6e8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1681 microversion: 2.1 time: 0.448262 Jul 19 22:40:28.983142 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1457/2885] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:28 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1681 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:28.998344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f1d88020-7058-4470-9684-62dc32938da2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:28.999287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f1d88020-7058-4470-9684-62dc32938da2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 0a5f7b5f-76ce-433e-9c96-53d7821b1761] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:29.028309 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-71f4154d-fb4a-409b-a8a3-43604ac73ee5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:29.040852 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-71f4154d-fb4a-409b-a8a3-43604ac73ee5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006" status: 200 len: 1318 microversion: 2.1 time: 0.428162 Jul 19 22:40:29.042167 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1429/2886] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:28 2022] GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006 => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:29.050688 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-17b3b3cb-68ca-4831-a7d3-edd122eaa37e tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a107c08b0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:29.088715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f1d88020-7058-4470-9684-62dc32938da2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:29.097487 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f1d88020-7058-4470-9684-62dc32938da2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/0a5f7b5f-76ce-433e-9c96-53d7821b1761" status: 200 len: 1215 microversion: 2.1 time: 0.102804 Jul 19 22:40:29.098961 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1458/2887] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:28 2022] GET /compute/v2.1/servers/0a5f7b5f-76ce-433e-9c96-53d7821b1761 => generated 1215 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:29.103853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5854e8ef-9759-417f-87bf-0d11009427af tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:29.109549 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5854e8ef-9759-417f-87bf-0d11009427af tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] [instance: d6f5f214-5b73-40e7-a0d0-1518cff74397] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:29.118905 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5854e8ef-9759-417f-87bf-0d11009427af tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:29.119917 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5854e8ef-9759-417f-87bf-0d11009427af tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:29.123025 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5854e8ef-9759-417f-87bf-0d11009427af tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:29.124171 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5854e8ef-9759-417f-87bf-0d11009427af tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:29.554441 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5854e8ef-9759-417f-87bf-0d11009427af tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b609af624e4b4aeeb9bfde36b890b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6eabd2343c481b8f7e5b4d7e61f2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:29.575924 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5854e8ef-9759-417f-87bf-0d11009427af tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] 10.222.0.25 "GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397" status: 200 len: 1325 microversion: 2.1 time: 0.475548 Jul 19 22:40:29.576822 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1459/2888] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:29 2022] GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397 => generated 1325 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:29.592556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-87d97b41-67fd-4313-abff-286dae75cbc6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:29.593080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-87d97b41-67fd-4313-abff-286dae75cbc6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 0a5f7b5f-76ce-433e-9c96-53d7821b1761] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:29.609662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87d97b41-67fd-4313-abff-286dae75cbc6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:29.610122 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87d97b41-67fd-4313-abff-286dae75cbc6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:29.611999 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87d97b41-67fd-4313-abff-286dae75cbc6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:29.612711 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87d97b41-67fd-4313-abff-286dae75cbc6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:29.645592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-87d97b41-67fd-4313-abff-286dae75cbc6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 0a5f7b5f-76ce-433e-9c96-53d7821b1761] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:40:29.695032 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:29.765631 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-87d97b41-67fd-4313-abff-286dae75cbc6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0a5f7b5f-76ce-433e-9c96-53d7821b1761" status: 204 len: 0 microversion: 2.1 time: 0.180729 Jul 19 22:40:29.770435 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1460/2889] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:40:29 2022] DELETE /compute/v2.1/servers/0a5f7b5f-76ce-433e-9c96-53d7821b1761 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:40:29.798744 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-782fa498-94a4-4b44-9f71-1d880051af0d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:29.799933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-782fa498-94a4-4b44-9f71-1d880051af0d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:29.808322 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-782fa498-94a4-4b44-9f71-1d880051af0d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:29.809292 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-782fa498-94a4-4b44-9f71-1d880051af0d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:29.810422 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-782fa498-94a4-4b44-9f71-1d880051af0d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:29.811827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-782fa498-94a4-4b44-9f71-1d880051af0d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:29.958602 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-17b3b3cb-68ca-4831-a7d3-edd122eaa37e tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "DELETE /compute/v2.1/images/6c492e8a-df35-4d1f-a61d-392f2860512a" status: 204 len: 0 microversion: 2.1 time: 0.914238 Jul 19 22:40:29.960268 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1430/2890] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:29 2022] DELETE /compute/v2.1/images/6c492e8a-df35-4d1f-a61d-392f2860512a => generated 0 bytes in 918 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:40:29.968453 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4c54b7a9-bced-448e-8421-298c01b0df9f tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:29.969398 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4c54b7a9-bced-448e-8421-298c01b0df9f tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: fb624b16-6d57-4542-bae7-36cd5b28be74] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:29.978376 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c54b7a9-bced-448e-8421-298c01b0df9f tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:29.979074 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c54b7a9-bced-448e-8421-298c01b0df9f tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:29.981454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c54b7a9-bced-448e-8421-298c01b0df9f tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:29.982376 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c54b7a9-bced-448e-8421-298c01b0df9f tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:30.117069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4c54b7a9-bced-448e-8421-298c01b0df9f tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6994ad3a701847d49163a7b709fba400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24647fdcb5d7402ebfdca8ea2ae72e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:30.134237 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-782fa498-94a4-4b44-9f71-1d880051af0d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:30.137760 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4c54b7a9-bced-448e-8421-298c01b0df9f tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74" status: 200 len: 1274 microversion: 2.1 time: 0.174891 Jul 19 22:40:30.139219 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1431/2891] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:29 2022] GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74 => generated 1274 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:30.149769 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-782fa498-94a4-4b44-9f71-1d880051af0d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41" status: 200 len: 1321 microversion: 2.1 time: 0.376808 Jul 19 22:40:30.150769 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9d806142-3be0-4b2b-8a06-c073c4ab5d6c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:30.150938 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1461/2892] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:29 2022] GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41 => generated 1321 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:30.152836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9d806142-3be0-4b2b-8a06-c073c4ab5d6c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 0a5f7b5f-76ce-433e-9c96-53d7821b1761] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:30.165163 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d6f0bb3f-ce61-4b88-93fd-f08335c0ff24 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '.version_select at 0x7f7a03869af0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:30.167029 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d806142-3be0-4b2b-8a06-c073c4ab5d6c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:30.168329 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d806142-3be0-4b2b-8a06-c073c4ab5d6c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:30.171095 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d806142-3be0-4b2b-8a06-c073c4ab5d6c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:30.172144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d806142-3be0-4b2b-8a06-c073c4ab5d6c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:30.226568 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-d6f0bb3f-ce61-4b88-93fd-f08335c0ff24 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] HTTP exception thrown: Image not found. Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d6f0bb3f-ce61-4b88-93fd-f08335c0ff24 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Request method failure captured: Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba HTTP/1.1 Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zJ2JTIuaMJREZTmoErzCNgpGAxoQfQJn3icXHF8M9jisHkNeYsNAFIOobhnk-Xf0jghAPRRFygJESSHz39Kqu5hGgqaPyaJBlRFyZYh99Ih5sRaV0P5zd4aJsh3hD70_ql6Q0SdbzzbxR2J0UxQwLGs4jCLOhk76ozsZ9dCmr3Fgjs Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 4fe347c5b18f487ab2fc6b6de7e959e4 Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesOneServerTestJSON-2060869421 Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4fe347c5b18f487ab2fc6b6de7e959e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4fe347c5b18f487ab2fc6b6de7e959e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4fe347c5b18f487ab2fc6b6de7e959e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4fe347c5b18f487ab2fc6b6de7e959e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesOneServerTestJSON-2060869421 Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 4fe347c5b18f487ab2fc6b6de7e959e4 Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2060869421 Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesOneServerTestJSON-2060869421-project Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 746810a196b24e8884a9526580cdc2a2 Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesOneServerTestJSON-2060869421-project Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: exception: Image not found. Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'f3bb4a64-9535-4750-961a-2e14f35308ba'} Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f3bb4a64-9535-4750-961a-2e14f35308ba to delete Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f3bb4a64-9535-4750-961a-2e14f35308ba could not be found. Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:30.228487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:30.234532 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:30.234532 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:30.234532 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:30.234532 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:30.234532 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:40:30.234532 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:40:30.234532 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:30.234532 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:30.234532 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 19 22:40:30.234532 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 19 22:40:30.234532 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 19 22:40:30.234532 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:30.234532 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:30.234532 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:30.234532 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:30.234532 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:30.234532 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:30.234532 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:40:30.234532 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:40:30.234532 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 19 22:40:30.234532 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:30.234532 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d6f0bb3f-ce61-4b88-93fd-f08335c0ff24 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Returning 404 to user: Image not found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:30.234532 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d6f0bb3f-ce61-4b88-93fd-f08335c0ff24 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "DELETE /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba" status: 404 len: 62 microversion: 2.1 time: 0.076225 Jul 19 22:40:30.234532 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1462/2893] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:30 2022] DELETE /compute/v2.1/images/f3bb4a64-9535-4750-961a-2e14f35308ba => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:40:30.247744 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8aaadb00-058f-4526-aade-b83076dc9dd2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:30.249150 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8aaadb00-058f-4526-aade-b83076dc9dd2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:30.263862 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8aaadb00-058f-4526-aade-b83076dc9dd2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:30.264372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8aaadb00-058f-4526-aade-b83076dc9dd2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:30.265725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8aaadb00-058f-4526-aade-b83076dc9dd2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:30.266530 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8aaadb00-058f-4526-aade-b83076dc9dd2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:30.376432 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9d806142-3be0-4b2b-8a06-c073c4ab5d6c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:30.397325 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9d806142-3be0-4b2b-8a06-c073c4ab5d6c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/0a5f7b5f-76ce-433e-9c96-53d7821b1761" status: 200 len: 1273 microversion: 2.1 time: 0.256558 Jul 19 22:40:30.408486 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1432/2894] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:30 2022] GET /compute/v2.1/servers/0a5f7b5f-76ce-433e-9c96-53d7821b1761 => generated 1273 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:30.423551 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-43e7bfcd-80ef-4d88-94f8-6b5173fb648c req-0a1bb17b-ef31-402e-bd57-a2aa7fc6da40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f02e1a17-fe38-4d7f-b55b-aaed61eb7006", "name": "network-vif-plugged", "status": "completed", "tag": "050e78eb-b37a-4f0b-b2c4-5541e704e627"}, {"server_uuid": "24930fd1-7b1b-4bdd-9143-d9d0bfa6da41", "name": "network-vif-plugged", "status": "completed", "tag": "ea6d5ff1-f67a-4eb4-9529-de8c075d640f"}, {"server_uuid": "d6f5f214-5b73-40e7-a0d0-1518cff74397", "name": "network-vif-plugged", "status": "completed", "tag": "165c22a8-352f-4506-8cdb-92cbd1613968"}, {"server_uuid": "3b617584-f9bc-43a8-af3c-78546d0d9889", "name": "network-vif-unplugged", "status": "completed", "tag": "3b3dc181-31be-470e-abec-b7a8478ff369"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:30.438413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-43e7bfcd-80ef-4d88-94f8-6b5173fb648c req-0a1bb17b-ef31-402e-bd57-a2aa7fc6da40 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:30.438990 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-43e7bfcd-80ef-4d88-94f8-6b5173fb648c req-0a1bb17b-ef31-402e-bd57-a2aa7fc6da40 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:30.463084 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-43e7bfcd-80ef-4d88-94f8-6b5173fb648c req-0a1bb17b-ef31-402e-bd57-a2aa7fc6da40 service nova] Creating event network-vif-plugged:050e78eb-b37a-4f0b-b2c4-5541e704e627 for instance f02e1a17-fe38-4d7f-b55b-aaed61eb7006 on n-h2-847009-3 Jul 19 22:40:30.463754 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-43e7bfcd-80ef-4d88-94f8-6b5173fb648c req-0a1bb17b-ef31-402e-bd57-a2aa7fc6da40 service nova] Creating event network-vif-plugged:ea6d5ff1-f67a-4eb4-9529-de8c075d640f for instance 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41 on n-h1-847009-3 Jul 19 22:40:30.466252 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-43e7bfcd-80ef-4d88-94f8-6b5173fb648c req-0a1bb17b-ef31-402e-bd57-a2aa7fc6da40 service nova] Creating event network-vif-plugged:165c22a8-352f-4506-8cdb-92cbd1613968 for instance d6f5f214-5b73-40e7-a0d0-1518cff74397 on n-h2-847009-3 Jul 19 22:40:30.466951 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-43e7bfcd-80ef-4d88-94f8-6b5173fb648c req-0a1bb17b-ef31-402e-bd57-a2aa7fc6da40 service nova] Creating event network-vif-unplugged:3b3dc181-31be-470e-abec-b7a8478ff369 for instance 3b617584-f9bc-43a8-af3c-78546d0d9889 on n-h2-847009-3 Jul 19 22:40:30.487682 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-43e7bfcd-80ef-4d88-94f8-6b5173fb648c req-0a1bb17b-ef31-402e-bd57-a2aa7fc6da40 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.074386 Jul 19 22:40:30.488736 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1433/2895] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:30.494872 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9534c927-696b-4174-a43a-5b29a3b90698 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:30.496402 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9534c927-696b-4174-a43a-5b29a3b90698 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: f02e1a17-fe38-4d7f-b55b-aaed61eb7006] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:30.508946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9534c927-696b-4174-a43a-5b29a3b90698 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:30.509513 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9534c927-696b-4174-a43a-5b29a3b90698 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:30.510435 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9534c927-696b-4174-a43a-5b29a3b90698 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:30.510822 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9534c927-696b-4174-a43a-5b29a3b90698 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:30.746438 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8aaadb00-058f-4526-aade-b83076dc9dd2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:30.758371 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8aaadb00-058f-4526-aade-b83076dc9dd2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1681 microversion: 2.1 time: 0.522600 Jul 19 22:40:30.758970 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1463/2896] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:30 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1681 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:30.770229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3d818328-2735-4880-a419-16c679ce5a2f tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:30.771194 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3d818328-2735-4880-a419-16c679ce5a2f tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] [instance: 3b617584-f9bc-43a8-af3c-78546d0d9889] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:30.782835 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d818328-2735-4880-a419-16c679ce5a2f tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:30.783672 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d818328-2735-4880-a419-16c679ce5a2f tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:30.785025 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d818328-2735-4880-a419-16c679ce5a2f tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:30.785689 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d818328-2735-4880-a419-16c679ce5a2f tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:30.815482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3d818328-2735-4880-a419-16c679ce5a2f tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] [instance: 3b617584-f9bc-43a8-af3c-78546d0d9889] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:40:30.867625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9534c927-696b-4174-a43a-5b29a3b90698 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:30.881216 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9534c927-696b-4174-a43a-5b29a3b90698 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006" status: 200 len: 1318 microversion: 2.1 time: 0.390486 Jul 19 22:40:30.882089 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1434/2897] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:30 2022] GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006 => generated 1318 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:30.896428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-aac74d8f-5e6e-44fc-b41f-53458b530431 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:30.897305 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-aac74d8f-5e6e-44fc-b41f-53458b530431 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] [instance: d6f5f214-5b73-40e7-a0d0-1518cff74397] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:30.909370 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aac74d8f-5e6e-44fc-b41f-53458b530431 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:30.911454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aac74d8f-5e6e-44fc-b41f-53458b530431 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:30.912250 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aac74d8f-5e6e-44fc-b41f-53458b530431 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:30.912713 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aac74d8f-5e6e-44fc-b41f-53458b530431 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:30.959580 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3d818328-2735-4880-a419-16c679ce5a2f tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889" status: 204 len: 0 microversion: 2.1 time: 0.198608 Jul 19 22:40:30.960355 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1464/2898] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:40:30 2022] DELETE /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:40:30.989723 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1934f85a-af19-4b4d-a046-52e83cc91d35 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:30.989723 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1934f85a-af19-4b4d-a046-52e83cc91d35 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] [instance: 3b617584-f9bc-43a8-af3c-78546d0d9889] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:31.017878 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1934f85a-af19-4b4d-a046-52e83cc91d35 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:31.018347 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1934f85a-af19-4b4d-a046-52e83cc91d35 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:31.019176 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1934f85a-af19-4b4d-a046-52e83cc91d35 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:31.019627 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1934f85a-af19-4b4d-a046-52e83cc91d35 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:31.234247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-aac74d8f-5e6e-44fc-b41f-53458b530431 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b609af624e4b4aeeb9bfde36b890b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6eabd2343c481b8f7e5b4d7e61f2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:31.244013 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-aac74d8f-5e6e-44fc-b41f-53458b530431 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] 10.222.0.25 "GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397" status: 200 len: 1325 microversion: 2.1 time: 0.354435 Jul 19 22:40:31.245302 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1435/2899] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:30 2022] GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397 => generated 1325 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:31.265185 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-916a50ed-ec46-487f-a6c7-cc6a67f6d92a tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:31.265901 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-916a50ed-ec46-487f-a6c7-cc6a67f6d92a tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: fb624b16-6d57-4542-bae7-36cd5b28be74] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:31.273108 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-916a50ed-ec46-487f-a6c7-cc6a67f6d92a tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:31.278146 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-916a50ed-ec46-487f-a6c7-cc6a67f6d92a tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:31.279260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-916a50ed-ec46-487f-a6c7-cc6a67f6d92a tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:31.279714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-916a50ed-ec46-487f-a6c7-cc6a67f6d92a tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:31.530974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-916a50ed-ec46-487f-a6c7-cc6a67f6d92a tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6994ad3a701847d49163a7b709fba400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24647fdcb5d7402ebfdca8ea2ae72e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:31.544003 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-916a50ed-ec46-487f-a6c7-cc6a67f6d92a tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74" status: 200 len: 1316 microversion: 2.1 time: 0.294850 Jul 19 22:40:31.547038 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1436/2900] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:31 2022] GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74 => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:31.555342 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3846bf64-f33b-49d3-9548-706ac8adfa5a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:31.556048 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3846bf64-f33b-49d3-9548-706ac8adfa5a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:31.575385 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3846bf64-f33b-49d3-9548-706ac8adfa5a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:31.575948 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3846bf64-f33b-49d3-9548-706ac8adfa5a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:31.578058 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3846bf64-f33b-49d3-9548-706ac8adfa5a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:31.578058 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3846bf64-f33b-49d3-9548-706ac8adfa5a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:31.591483 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1934f85a-af19-4b4d-a046-52e83cc91d35 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746810a196b24e8884a9526580cdc2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe347c5b18f487ab2fc6b6de7e959e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:31.601049 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1934f85a-af19-4b4d-a046-52e83cc91d35 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889" status: 200 len: 1471 microversion: 2.1 time: 0.633871 Jul 19 22:40:31.605927 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1465/2901] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:30 2022] GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889 => generated 1471 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:31.621355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6e8ab288-a6df-44ec-9e7c-8eaa7f25484c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:31.622332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6e8ab288-a6df-44ec-9e7c-8eaa7f25484c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 0a5f7b5f-76ce-433e-9c96-53d7821b1761] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:31.630758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e8ab288-a6df-44ec-9e7c-8eaa7f25484c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:31.631238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e8ab288-a6df-44ec-9e7c-8eaa7f25484c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:31.632024 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e8ab288-a6df-44ec-9e7c-8eaa7f25484c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:31.632468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e8ab288-a6df-44ec-9e7c-8eaa7f25484c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:31.708145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6e8ab288-a6df-44ec-9e7c-8eaa7f25484c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:31.720073 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6e8ab288-a6df-44ec-9e7c-8eaa7f25484c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/0a5f7b5f-76ce-433e-9c96-53d7821b1761" status: 200 len: 1217 microversion: 2.1 time: 0.102492 Jul 19 22:40:31.721002 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1466/2902] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:31 2022] GET /compute/v2.1/servers/0a5f7b5f-76ce-433e-9c96-53d7821b1761 => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:31.780338 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7f4f5ea7-c860-4ac0-8de7-66b07a4a2c27 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:31.781393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7f4f5ea7-c860-4ac0-8de7-66b07a4a2c27 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:31.790128 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7f4f5ea7-c860-4ac0-8de7-66b07a4a2c27 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:31.790617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7f4f5ea7-c860-4ac0-8de7-66b07a4a2c27 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:31.791974 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7f4f5ea7-c860-4ac0-8de7-66b07a4a2c27 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:31.792613 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7f4f5ea7-c860-4ac0-8de7-66b07a4a2c27 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:31.816294 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3846bf64-f33b-49d3-9548-706ac8adfa5a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:31.827966 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3846bf64-f33b-49d3-9548-706ac8adfa5a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41" status: 200 len: 1321 microversion: 2.1 time: 0.279670 Jul 19 22:40:31.828779 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1437/2903] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:31 2022] GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41 => generated 1321 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:31.901254 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2e114168-3a4a-4b73-b10f-170ad622bb90 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:31.903083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2e114168-3a4a-4b73-b10f-170ad622bb90 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: f02e1a17-fe38-4d7f-b55b-aaed61eb7006] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:31.913630 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e114168-3a4a-4b73-b10f-170ad622bb90 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:31.914616 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e114168-3a4a-4b73-b10f-170ad622bb90 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:31.915700 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e114168-3a4a-4b73-b10f-170ad622bb90 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:31.917323 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e114168-3a4a-4b73-b10f-170ad622bb90 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:32.088580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7f4f5ea7-c860-4ac0-8de7-66b07a4a2c27 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:32.101300 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7f4f5ea7-c860-4ac0-8de7-66b07a4a2c27 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1681 microversion: 2.1 time: 0.325709 Jul 19 22:40:32.102083 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1467/2904] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:31 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1681 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:32.130485 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2e114168-3a4a-4b73-b10f-170ad622bb90 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:32.140886 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2e114168-3a4a-4b73-b10f-170ad622bb90 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006" status: 200 len: 1318 microversion: 2.1 time: 0.245431 Jul 19 22:40:32.142315 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1438/2905] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:31 2022] GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:32.263032 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b3aec1ff-d597-4cc0-ab92-e9c96b63802c tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:32.263747 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b3aec1ff-d597-4cc0-ab92-e9c96b63802c tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] [instance: d6f5f214-5b73-40e7-a0d0-1518cff74397] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:32.275999 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b3aec1ff-d597-4cc0-ab92-e9c96b63802c tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:32.276458 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b3aec1ff-d597-4cc0-ab92-e9c96b63802c tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:32.278240 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b3aec1ff-d597-4cc0-ab92-e9c96b63802c tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:32.278696 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b3aec1ff-d597-4cc0-ab92-e9c96b63802c tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:32.448058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b3aec1ff-d597-4cc0-ab92-e9c96b63802c tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b609af624e4b4aeeb9bfde36b890b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6eabd2343c481b8f7e5b4d7e61f2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:32.458977 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b3aec1ff-d597-4cc0-ab92-e9c96b63802c tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] 10.222.0.25 "GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397" status: 200 len: 1325 microversion: 2.1 time: 0.200550 Jul 19 22:40:32.460003 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1468/2906] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:32 2022] GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397 => generated 1325 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:32.563202 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4e145d02-6212-4289-bb55-0eb5b173ce84 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:32.564771 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4e145d02-6212-4289-bb55-0eb5b173ce84 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: fb624b16-6d57-4542-bae7-36cd5b28be74] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:32.575604 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4e145d02-6212-4289-bb55-0eb5b173ce84 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:32.576554 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4e145d02-6212-4289-bb55-0eb5b173ce84 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:32.578010 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4e145d02-6212-4289-bb55-0eb5b173ce84 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:32.579025 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4e145d02-6212-4289-bb55-0eb5b173ce84 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:32.629636 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-021fe0d9-b724-4200-a5e7-5d655077c041 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:32.634587 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-021fe0d9-b724-4200-a5e7-5d655077c041 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] [instance: 3b617584-f9bc-43a8-af3c-78546d0d9889] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:32.660844 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-021fe0d9-b724-4200-a5e7-5d655077c041 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:32.660844 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-021fe0d9-b724-4200-a5e7-5d655077c041 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:32.661279 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-021fe0d9-b724-4200-a5e7-5d655077c041 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:32.661835 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-021fe0d9-b724-4200-a5e7-5d655077c041 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:32.875726 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4e145d02-6212-4289-bb55-0eb5b173ce84 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6994ad3a701847d49163a7b709fba400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24647fdcb5d7402ebfdca8ea2ae72e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:32.894529 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4e145d02-6212-4289-bb55-0eb5b173ce84 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74" status: 200 len: 1316 microversion: 2.1 time: 0.334437 Jul 19 22:40:32.900628 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1439/2907] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:32 2022] GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74 => generated 1316 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:32.906671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-12e736ca-fe80-4157-a9bb-7ae568cd86dd tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:32.907555 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-12e736ca-fe80-4157-a9bb-7ae568cd86dd tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 0a5f7b5f-76ce-433e-9c96-53d7821b1761] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:32.914904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-021fe0d9-b724-4200-a5e7-5d655077c041 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746810a196b24e8884a9526580cdc2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe347c5b18f487ab2fc6b6de7e959e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:32.917294 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12e736ca-fe80-4157-a9bb-7ae568cd86dd tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:32.919564 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12e736ca-fe80-4157-a9bb-7ae568cd86dd tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:32.922356 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12e736ca-fe80-4157-a9bb-7ae568cd86dd tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:32.923020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12e736ca-fe80-4157-a9bb-7ae568cd86dd tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:32.925834 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-021fe0d9-b724-4200-a5e7-5d655077c041 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889" status: 200 len: 1471 microversion: 2.1 time: 0.301506 Jul 19 22:40:32.937206 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1469/2908] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:32 2022] GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889 => generated 1471 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:32.942527 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-28b3cad9-2825-4209-9d51-d445112a7d1d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:32.943515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-28b3cad9-2825-4209-9d51-d445112a7d1d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:32.952817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-28b3cad9-2825-4209-9d51-d445112a7d1d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:32.953380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-28b3cad9-2825-4209-9d51-d445112a7d1d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:32.954247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-28b3cad9-2825-4209-9d51-d445112a7d1d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:32.954770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-28b3cad9-2825-4209-9d51-d445112a7d1d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:33.066480 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-12e736ca-fe80-4157-a9bb-7ae568cd86dd tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:33.076087 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-12e736ca-fe80-4157-a9bb-7ae568cd86dd tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/0a5f7b5f-76ce-433e-9c96-53d7821b1761" status: 200 len: 1217 microversion: 2.1 time: 0.173857 Jul 19 22:40:33.077601 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1440/2909] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:32 2022] GET /compute/v2.1/servers/0a5f7b5f-76ce-433e-9c96-53d7821b1761 => generated 1217 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:33.125007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c66223b8-7de2-4492-ac86-f99140700579 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:33.125661 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c66223b8-7de2-4492-ac86-f99140700579 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:33.133703 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c66223b8-7de2-4492-ac86-f99140700579 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:33.134482 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c66223b8-7de2-4492-ac86-f99140700579 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:33.135755 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c66223b8-7de2-4492-ac86-f99140700579 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:33.137500 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c66223b8-7de2-4492-ac86-f99140700579 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:33.178910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:33.213884 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-28b3cad9-2825-4209-9d51-d445112a7d1d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:33.234192 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-28b3cad9-2825-4209-9d51-d445112a7d1d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41" status: 200 len: 1511 microversion: 2.1 time: 0.295473 Jul 19 22:40:33.239739 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1470/2910] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:32 2022] GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41 => generated 1511 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:33.248316 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2583c81b-e847-4e51-9c1f-69b1b9c39aba tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:33.252838 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2583c81b-e847-4e51-9c1f-69b1b9c39aba tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: f02e1a17-fe38-4d7f-b55b-aaed61eb7006] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:33.259284 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2583c81b-e847-4e51-9c1f-69b1b9c39aba tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:33.260004 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2583c81b-e847-4e51-9c1f-69b1b9c39aba tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:33.261498 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2583c81b-e847-4e51-9c1f-69b1b9c39aba tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:33.262105 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2583c81b-e847-4e51-9c1f-69b1b9c39aba tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:33.530624 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c66223b8-7de2-4492-ac86-f99140700579 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:33.564599 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c66223b8-7de2-4492-ac86-f99140700579 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1681 microversion: 2.1 time: 0.448000 Jul 19 22:40:33.586576 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1441/2911] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:33 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1681 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:40:33.592308 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c52dd62b-5f19-47e6-af92-fc008e417434 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:33.593078 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c52dd62b-5f19-47e6-af92-fc008e417434 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 976f2ec1-c70b-4795-a71d-251bed15ad25] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:33.600810 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c52dd62b-5f19-47e6-af92-fc008e417434 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:33.601468 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c52dd62b-5f19-47e6-af92-fc008e417434 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:33.602424 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c52dd62b-5f19-47e6-af92-fc008e417434 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:33.602976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c52dd62b-5f19-47e6-af92-fc008e417434 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:33.646453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2583c81b-e847-4e51-9c1f-69b1b9c39aba tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:33.657986 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2583c81b-e847-4e51-9c1f-69b1b9c39aba tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006" status: 200 len: 1318 microversion: 2.1 time: 0.416081 Jul 19 22:40:33.659335 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1471/2912] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:33 2022] GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006 => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:33.666998 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9db4aa2f-ed8a-41c3-86b6-2ed8341d3db5 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:33.675035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9db4aa2f-ed8a-41c3-86b6-2ed8341d3db5 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] [instance: d6f5f214-5b73-40e7-a0d0-1518cff74397] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:33.684997 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9db4aa2f-ed8a-41c3-86b6-2ed8341d3db5 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:33.685817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9db4aa2f-ed8a-41c3-86b6-2ed8341d3db5 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:33.686944 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9db4aa2f-ed8a-41c3-86b6-2ed8341d3db5 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:33.687588 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9db4aa2f-ed8a-41c3-86b6-2ed8341d3db5 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:33.925526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c52dd62b-5f19-47e6-af92-fc008e417434 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:33.934515 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c52dd62b-5f19-47e6-af92-fc008e417434 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25" status: 200 len: 1510 microversion: 2.1 time: 0.346653 Jul 19 22:40:33.935462 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1442/2913] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:33 2022] GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25 => generated 1510 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:33.941943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d4b4c89a-51eb-441a-a2c4-c2cd85a401cb tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:33.942958 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d4b4c89a-51eb-441a-a2c4-c2cd85a401cb tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: fb624b16-6d57-4542-bae7-36cd5b28be74] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:33.953069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d4b4c89a-51eb-441a-a2c4-c2cd85a401cb tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:33.953812 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d4b4c89a-51eb-441a-a2c4-c2cd85a401cb tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:33.954796 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d4b4c89a-51eb-441a-a2c4-c2cd85a401cb tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:33.955463 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d4b4c89a-51eb-441a-a2c4-c2cd85a401cb tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:33.992548 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9db4aa2f-ed8a-41c3-86b6-2ed8341d3db5 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b609af624e4b4aeeb9bfde36b890b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6eabd2343c481b8f7e5b4d7e61f2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:34.006416 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9db4aa2f-ed8a-41c3-86b6-2ed8341d3db5 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] 10.222.0.25 "GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397" status: 200 len: 1325 microversion: 2.1 time: 0.344967 Jul 19 22:40:34.016592 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1472/2914] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:33 2022] GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397 => generated 1325 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:34.044727 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-16550e2e-73d5-4a7e-a55e-543277e2e43c tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:34.045865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-16550e2e-73d5-4a7e-a55e-543277e2e43c tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] [instance: 3b617584-f9bc-43a8-af3c-78546d0d9889] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:34.067478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16550e2e-73d5-4a7e-a55e-543277e2e43c tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:34.072330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16550e2e-73d5-4a7e-a55e-543277e2e43c tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:34.074628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16550e2e-73d5-4a7e-a55e-543277e2e43c tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:34.079772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16550e2e-73d5-4a7e-a55e-543277e2e43c tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:34.304438 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d4b4c89a-51eb-441a-a2c4-c2cd85a401cb tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6994ad3a701847d49163a7b709fba400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24647fdcb5d7402ebfdca8ea2ae72e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:34.315875 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d4b4c89a-51eb-441a-a2c4-c2cd85a401cb tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74" status: 200 len: 1316 microversion: 2.1 time: 0.379101 Jul 19 22:40:34.327079 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1443/2915] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:33 2022] GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74 => generated 1316 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:34.332633 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-41be2f6d-c935-401e-bc70-96951f32f88e tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:34.342966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-41be2f6d-c935-401e-bc70-96951f32f88e tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 648bd230-03d9-4186-8cc0-64573fae2ab6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:34.365893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41be2f6d-c935-401e-bc70-96951f32f88e tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:34.367936 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41be2f6d-c935-401e-bc70-96951f32f88e tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:34.369985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41be2f6d-c935-401e-bc70-96951f32f88e tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:34.371052 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41be2f6d-c935-401e-bc70-96951f32f88e tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:34.386959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-16550e2e-73d5-4a7e-a55e-543277e2e43c tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746810a196b24e8884a9526580cdc2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe347c5b18f487ab2fc6b6de7e959e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:34.426422 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-16550e2e-73d5-4a7e-a55e-543277e2e43c tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889" status: 200 len: 1471 microversion: 2.1 time: 0.397903 Jul 19 22:40:34.428165 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1473/2916] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:34 2022] GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889 => generated 1471 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:34.443701 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-439b9526-5327-4f35-95ed-f6834d8edcd5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:34.450350 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-439b9526-5327-4f35-95ed-f6834d8edcd5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 0a5f7b5f-76ce-433e-9c96-53d7821b1761] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:34.468351 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-439b9526-5327-4f35-95ed-f6834d8edcd5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:34.471827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-439b9526-5327-4f35-95ed-f6834d8edcd5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:34.474228 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-439b9526-5327-4f35-95ed-f6834d8edcd5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:34.496247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-439b9526-5327-4f35-95ed-f6834d8edcd5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:34.613764 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-439b9526-5327-4f35-95ed-f6834d8edcd5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:34.622757 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-439b9526-5327-4f35-95ed-f6834d8edcd5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/0a5f7b5f-76ce-433e-9c96-53d7821b1761" status: 200 len: 1217 microversion: 2.1 time: 0.186203 Jul 19 22:40:34.632647 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1474/2917] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:34 2022] GET /compute/v2.1/servers/0a5f7b5f-76ce-433e-9c96-53d7821b1761 => generated 1217 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:34.640470 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b5bf416f-7f54-4d32-aebd-38b359084c69 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:34.641106 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b5bf416f-7f54-4d32-aebd-38b359084c69 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:34.664259 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b5bf416f-7f54-4d32-aebd-38b359084c69 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:34.664633 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b5bf416f-7f54-4d32-aebd-38b359084c69 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:34.665425 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b5bf416f-7f54-4d32-aebd-38b359084c69 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:34.665863 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b5bf416f-7f54-4d32-aebd-38b359084c69 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:34.700972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-41be2f6d-c935-401e-bc70-96951f32f88e tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:34.748839 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-41be2f6d-c935-401e-bc70-96951f32f88e tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/648bd230-03d9-4186-8cc0-64573fae2ab6" status: 200 len: 1512 microversion: 2.1 time: 0.420035 Jul 19 22:40:34.751310 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1444/2918] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:34 2022] GET /compute/v2.1/servers/648bd230-03d9-4186-8cc0-64573fae2ab6 => generated 1512 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:34.764823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c1c591db-5f8a-4459-91d9-75cae139dc66 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:34.765570 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c1c591db-5f8a-4459-91d9-75cae139dc66 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: f02e1a17-fe38-4d7f-b55b-aaed61eb7006] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:34.791900 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c1c591db-5f8a-4459-91d9-75cae139dc66 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:34.793097 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c1c591db-5f8a-4459-91d9-75cae139dc66 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:34.794473 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c1c591db-5f8a-4459-91d9-75cae139dc66 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:34.794993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c1c591db-5f8a-4459-91d9-75cae139dc66 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:35.321844 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b5bf416f-7f54-4d32-aebd-38b359084c69 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:35.339908 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b5bf416f-7f54-4d32-aebd-38b359084c69 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1681 microversion: 2.1 time: 0.705090 Jul 19 22:40:35.340444 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1475/2919] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:34 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1681 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:35.359718 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-44f5cc74-3eff-4de9-9830-5bb79037225a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:35.373293 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-44f5cc74-3eff-4de9-9830-5bb79037225a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:35.373933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-44f5cc74-3eff-4de9-9830-5bb79037225a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4'} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:40:35.376906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:35.402378 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44f5cc74-3eff-4de9-9830-5bb79037225a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:35.403335 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44f5cc74-3eff-4de9-9830-5bb79037225a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:35.404344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44f5cc74-3eff-4de9-9830-5bb79037225a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:35.404966 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44f5cc74-3eff-4de9-9830-5bb79037225a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:35.484892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:35.563065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.multi_cell_list [None req-44f5cc74-3eff-4de9-9830-5bb79037225a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119338) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:40:35.566528 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c1c591db-5f8a-4459-91d9-75cae139dc66 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:35.585566 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c1c591db-5f8a-4459-91d9-75cae139dc66 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006" status: 200 len: 1318 microversion: 2.1 time: 0.829098 Jul 19 22:40:35.605590 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1445/2920] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:34 2022] GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006 => generated 1318 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:35.616260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-49b2838d-1d23-4f1f-bad4-41ca2a19ce49 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:35.617686 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-49b2838d-1d23-4f1f-bad4-41ca2a19ce49 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] [instance: d6f5f214-5b73-40e7-a0d0-1518cff74397] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:35.633425 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49b2838d-1d23-4f1f-bad4-41ca2a19ce49 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:35.634365 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49b2838d-1d23-4f1f-bad4-41ca2a19ce49 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:35.635432 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49b2838d-1d23-4f1f-bad4-41ca2a19ce49 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:35.640120 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49b2838d-1d23-4f1f-bad4-41ca2a19ce49 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:35.688905 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-44f5cc74-3eff-4de9-9830-5bb79037225a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:35.695626 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44f5cc74-3eff-4de9-9830-5bb79037225a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:35.696087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44f5cc74-3eff-4de9-9830-5bb79037225a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:36.039578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-49b2838d-1d23-4f1f-bad4-41ca2a19ce49 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b609af624e4b4aeeb9bfde36b890b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6eabd2343c481b8f7e5b4d7e61f2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:36.057554 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-49b2838d-1d23-4f1f-bad4-41ca2a19ce49 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] 10.222.0.25 "GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397" status: 200 len: 1522 microversion: 2.1 time: 0.449826 Jul 19 22:40:36.070492 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1446/2921] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:35 2022] GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397 => generated 1522 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:36.076224 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-af7a519f-f0a7-4b3d-b276-fad4743e10db tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:36.076860 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-af7a519f-f0a7-4b3d-b276-fad4743e10db tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: fb624b16-6d57-4542-bae7-36cd5b28be74] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:36.083874 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af7a519f-f0a7-4b3d-b276-fad4743e10db tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:36.084718 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af7a519f-f0a7-4b3d-b276-fad4743e10db tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:36.085669 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af7a519f-f0a7-4b3d-b276-fad4743e10db tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:36.086270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af7a519f-f0a7-4b3d-b276-fad4743e10db tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:36.108512 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-44f5cc74-3eff-4de9-9830-5bb79037225a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.764022 Jul 19 22:40:36.109322 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1476/2922] 10.222.0.25 () {58 vars in 1166 bytes} [Tue Jul 19 22:40:35 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:36.117789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6ec87340-ca73-407f-af32-dea3b0c98e27 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:36.118422 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6ec87340-ca73-407f-af32-dea3b0c98e27 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] [instance: 3b617584-f9bc-43a8-af3c-78546d0d9889] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:36.129304 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ec87340-ca73-407f-af32-dea3b0c98e27 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:36.129972 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ec87340-ca73-407f-af32-dea3b0c98e27 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:36.131032 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ec87340-ca73-407f-af32-dea3b0c98e27 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:36.131698 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ec87340-ca73-407f-af32-dea3b0c98e27 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:36.264131 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6ec87340-ca73-407f-af32-dea3b0c98e27 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746810a196b24e8884a9526580cdc2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe347c5b18f487ab2fc6b6de7e959e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:36.280583 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6ec87340-ca73-407f-af32-dea3b0c98e27 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889" status: 200 len: 1301 microversion: 2.1 time: 0.169477 Jul 19 22:40:36.281507 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1477/2923] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:36 2022] GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889 => generated 1301 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:36.389301 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-ce7d99ba-e5dc-4bfa-9818-bbfbb750ae21 req-b48a7f3c-f179-4516-b17f-a349b81204db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb624b16-6d57-4542-bae7-36cd5b28be74", "tag": "553d18df-50d7-4a4c-b5b8-69147cc944ac"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:36.398506 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-af7a519f-f0a7-4b3d-b276-fad4743e10db tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6994ad3a701847d49163a7b709fba400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24647fdcb5d7402ebfdca8ea2ae72e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:36.398827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-ce7d99ba-e5dc-4bfa-9818-bbfbb750ae21 req-b48a7f3c-f179-4516-b17f-a349b81204db service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:36.399347 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-ce7d99ba-e5dc-4bfa-9818-bbfbb750ae21 req-b48a7f3c-f179-4516-b17f-a349b81204db service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:36.418232 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-af7a519f-f0a7-4b3d-b276-fad4743e10db tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74" status: 200 len: 1316 microversion: 2.1 time: 0.345830 Jul 19 22:40:36.418554 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-ce7d99ba-e5dc-4bfa-9818-bbfbb750ae21 req-b48a7f3c-f179-4516-b17f-a349b81204db service nova] Creating event network-changed:553d18df-50d7-4a4c-b5b8-69147cc944ac for instance fb624b16-6d57-4542-bae7-36cd5b28be74 on n-h2-847009-3 Jul 19 22:40:36.419213 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1447/2924] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:36 2022] GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74 => generated 1316 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:36.425142 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-39104fa4-978f-41e9-99bc-42d2b8c9bb85 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:36.425433 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-ce7d99ba-e5dc-4bfa-9818-bbfbb750ae21 req-b48a7f3c-f179-4516-b17f-a349b81204db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141410 Jul 19 22:40:36.425767 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-39104fa4-978f-41e9-99bc-42d2b8c9bb85 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 0a5f7b5f-76ce-433e-9c96-53d7821b1761] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:36.430628 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1478/2925] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:36.432604 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39104fa4-978f-41e9-99bc-42d2b8c9bb85 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:36.433678 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39104fa4-978f-41e9-99bc-42d2b8c9bb85 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:36.434562 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39104fa4-978f-41e9-99bc-42d2b8c9bb85 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:36.434927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39104fa4-978f-41e9-99bc-42d2b8c9bb85 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:36.439659 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-c4a86312-29ac-4315-bb93-3734674cd6b2 req-8269327b-db01-4e88-bb35-d81de2dd2cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b617584-f9bc-43a8-af3c-78546d0d9889", "name": "network-vif-deleted", "tag": "3b3dc181-31be-470e-abec-b7a8478ff369"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:36.448717 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c4a86312-29ac-4315-bb93-3734674cd6b2 req-8269327b-db01-4e88-bb35-d81de2dd2cc4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:36.449282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c4a86312-29ac-4315-bb93-3734674cd6b2 req-8269327b-db01-4e88-bb35-d81de2dd2cc4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:36.462122 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-c4a86312-29ac-4315-bb93-3734674cd6b2 req-8269327b-db01-4e88-bb35-d81de2dd2cc4 service nova] Creating event network-vif-deleted:3b3dc181-31be-470e-abec-b7a8478ff369 for instance 3b617584-f9bc-43a8-af3c-78546d0d9889 on n-h2-847009-3 Jul 19 22:40:36.468089 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-c4a86312-29ac-4315-bb93-3734674cd6b2 req-8269327b-db01-4e88-bb35-d81de2dd2cc4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036581 Jul 19 22:40:36.468707 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1479/2926] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:36.474332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ede0a2a0-3c4f-4456-a8f9-52a345e51a7e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:36.474936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ede0a2a0-3c4f-4456-a8f9-52a345e51a7e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] [instance: d6f5f214-5b73-40e7-a0d0-1518cff74397] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:36.476181 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39104fa4-978f-41e9-99bc-42d2b8c9bb85 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:36.476827 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39104fa4-978f-41e9-99bc-42d2b8c9bb85 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:36.477443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-39104fa4-978f-41e9-99bc-42d2b8c9bb85 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lazy-loading 'fault' on Instance uuid 0a5f7b5f-76ce-433e-9c96-53d7821b1761 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:40:36.482322 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ede0a2a0-3c4f-4456-a8f9-52a345e51a7e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:36.482777 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ede0a2a0-3c4f-4456-a8f9-52a345e51a7e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:36.483601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ede0a2a0-3c4f-4456-a8f9-52a345e51a7e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:36.484042 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ede0a2a0-3c4f-4456-a8f9-52a345e51a7e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:36.516478 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-ede0a2a0-3c4f-4456-a8f9-52a345e51a7e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] HTTP exception thrown: Instance is not a member of specified network Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ede0a2a0-3c4f-4456-a8f9-52a345e51a7e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Request method failure captured: Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397/ips/invalid HTTP/1.1 Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zK53_8E_aNTmpl4vAfvaRciWRQ_kYDGdTSieNzKu02e-ay3Bf0f09iFBiKx87Mi4v5Ac-3pRW7Wg9TC3CV3if-JbaqwwAHr8rKSQGZZ6UCNkPDb8oXOHGdJIfuQOW9Q1HUaEdDVvqS0zVFpnNSa9s3AabRmY_i-_4dy-pGF9D-WxV8 Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 4f6eabd2343c481b8f7e5b4d7e61f2f6 Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-374511618 Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4f6eabd2343c481b8f7e5b4d7e61f2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f6eabd2343c481b8f7e5b4d7e61f2f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4f6eabd2343c481b8f7e5b4d7e61f2f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f6eabd2343c481b8f7e5b4d7e61f2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-374511618 Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 4f6eabd2343c481b8f7e5b4d7e61f2f6 Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-374511618 Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerAddressesNegativeTestJSON-374511618-project Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: b609af624e4b4aeeb9bfde36b890b491 Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-374511618-project Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance is not a member of specified network Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'server_id': 'd6f5f214-5b73-40e7-a0d0-1518cff74397', 'id': 'invalid'} Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 19 22:40:36.521482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:36.528819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ede0a2a0-3c4f-4456-a8f9-52a345e51a7e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Returning 404 to user: Instance is not a member of specified network {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:36.528819 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ede0a2a0-3c4f-4456-a8f9-52a345e51a7e tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] 10.222.0.25 "GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.053280 Jul 19 22:40:36.529204 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-39104fa4-978f-41e9-99bc-42d2b8c9bb85 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:36.529382 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1480/2927] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:40:36 2022] GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397/ips/invalid => generated 91 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:40:36.532390 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4c667ea7-793a-4a97-867b-4614957c2d6c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:36.532998 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-39104fa4-978f-41e9-99bc-42d2b8c9bb85 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/0a5f7b5f-76ce-433e-9c96-53d7821b1761" status: 200 len: 1221 microversion: 2.1 time: 0.112432 Jul 19 22:40:36.533590 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1448/2928] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:36 2022] GET /compute/v2.1/servers/0a5f7b5f-76ce-433e-9c96-53d7821b1761 => generated 1221 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:36.536479 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4c667ea7-793a-4a97-867b-4614957c2d6c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:36.537446 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4c667ea7-793a-4a97-867b-4614957c2d6c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-483663341', 'deleted': False, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4'} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:40:36.538178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4ec3daa6-d6b2-4249-8e3c-679e360986d8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:36.538796 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4ec3daa6-d6b2-4249-8e3c-679e360986d8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:36.546717 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ec3daa6-d6b2-4249-8e3c-679e360986d8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:36.546717 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ec3daa6-d6b2-4249-8e3c-679e360986d8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:36.547056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ec3daa6-d6b2-4249-8e3c-679e360986d8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:36.547413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ec3daa6-d6b2-4249-8e3c-679e360986d8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:36.549083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4c667ea7-793a-4a97-867b-4614957c2d6c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:36.549574 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4c667ea7-793a-4a97-867b-4614957c2d6c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:36.550496 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4c667ea7-793a-4a97-867b-4614957c2d6c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:36.550940 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4c667ea7-793a-4a97-867b-4614957c2d6c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:36.655818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.multi_cell_list [None req-4c667ea7-793a-4a97-867b-4614957c2d6c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119338) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:40:36.745491 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4c667ea7-793a-4a97-867b-4614957c2d6c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:36.765125 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4c667ea7-793a-4a97-867b-4614957c2d6c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:36.765595 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4c667ea7-793a-4a97-867b-4614957c2d6c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:37.143643 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4ec3daa6-d6b2-4249-8e3c-679e360986d8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:37.152383 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4ec3daa6-d6b2-4249-8e3c-679e360986d8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1681 microversion: 2.1 time: 0.616887 Jul 19 22:40:37.152977 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1449/2929] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:36 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1681 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:37.159180 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-33a2fbe0-528e-448b-bafd-c4f552cda4b8 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:37.159819 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-33a2fbe0-528e-448b-bafd-c4f552cda4b8 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Failed to fetch instance by id 999 {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 19 22:40:37.160486 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-33a2fbe0-528e-448b-bafd-c4f552cda4b8 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] HTTP exception thrown: Instance 999 could not be found. Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-33a2fbe0-528e-448b-bafd-c4f552cda4b8 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Request method failure captured: Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zK53_8E_aNTmpl4vAfvaRciWRQ_kYDGdTSieNzKu02e-ay3Bf0f09iFBiKx87Mi4v5Ac-3pRW7Wg9TC3CV3if-JbaqwwAHr8rKSQGZZ6UCNkPDb8oXOHGdJIfuQOW9Q1HUaEdDVvqS0zVFpnNSa9s3AabRmY_i-_4dy-pGF9D-WxV8 Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 4f6eabd2343c481b8f7e5b4d7e61f2f6 Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-374511618 Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4f6eabd2343c481b8f7e5b4d7e61f2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f6eabd2343c481b8f7e5b4d7e61f2f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4f6eabd2343c481b8f7e5b4d7e61f2f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f6eabd2343c481b8f7e5b4d7e61f2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-374511618 Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 4f6eabd2343c481b8f7e5b4d7e61f2f6 Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-374511618 Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerAddressesNegativeTestJSON-374511618-project Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: b609af624e4b4aeeb9bfde36b890b491 Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-374511618-project Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 999 could not be found. Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'server_id': '999'} Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 19 22:40:37.162410 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:37.167298 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-33a2fbe0-528e-448b-bafd-c4f552cda4b8 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Returning 404 to user: Instance 999 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:37.167298 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-33a2fbe0-528e-448b-bafd-c4f552cda4b8 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] 10.222.0.25 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.009777 Jul 19 22:40:37.170170 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1450/2930] 10.222.0.25 () {58 vars in 1148 bytes} [Tue Jul 19 22:40:37 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:40:37.175333 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-156e2ff1-2b0c-43a1-9bad-1859f8f044ed tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:37.175983 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-156e2ff1-2b0c-43a1-9bad-1859f8f044ed tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: f02e1a17-fe38-4d7f-b55b-aaed61eb7006] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:37.184606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-156e2ff1-2b0c-43a1-9bad-1859f8f044ed tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:37.184993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-156e2ff1-2b0c-43a1-9bad-1859f8f044ed tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:37.185779 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-156e2ff1-2b0c-43a1-9bad-1859f8f044ed tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:37.186218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-156e2ff1-2b0c-43a1-9bad-1859f8f044ed tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:37.226632 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4c667ea7-793a-4a97-867b-4614957c2d6c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-483663341" status: 200 len: 1513 microversion: 2.1 time: 0.701334 Jul 19 22:40:37.239346 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1481/2931] 10.222.0.25 () {58 vars in 1260 bytes} [Tue Jul 19 22:40:36 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-483663341 => generated 1513 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:37.239346 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-813c21bb-2e98-4b1c-92d3-647a8df4bee2 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:37.239346 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-813c21bb-2e98-4b1c-92d3-647a8df4bee2 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] [instance: d6f5f214-5b73-40e7-a0d0-1518cff74397] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:37.244534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-813c21bb-2e98-4b1c-92d3-647a8df4bee2 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:37.245112 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-813c21bb-2e98-4b1c-92d3-647a8df4bee2 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:37.247294 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-813c21bb-2e98-4b1c-92d3-647a8df4bee2 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:37.248013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-813c21bb-2e98-4b1c-92d3-647a8df4bee2 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:37.281786 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-813c21bb-2e98-4b1c-92d3-647a8df4bee2 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] [instance: d6f5f214-5b73-40e7-a0d0-1518cff74397] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:40:37.378885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-156e2ff1-2b0c-43a1-9bad-1859f8f044ed tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:37.393167 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-156e2ff1-2b0c-43a1-9bad-1859f8f044ed tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006" status: 200 len: 1508 microversion: 2.1 time: 0.221538 Jul 19 22:40:37.394989 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1451/2932] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:37 2022] GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006 => generated 1508 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:37.395682 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-813c21bb-2e98-4b1c-92d3-647a8df4bee2 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397" status: 204 len: 0 microversion: 2.1 time: 0.164789 Jul 19 22:40:37.396600 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1482/2933] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:40:37 2022] DELETE /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:40:37.403562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-54aa1195-7e2d-48cf-ba12-16f93eccaba2 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:37.404488 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-54aa1195-7e2d-48cf-ba12-16f93eccaba2 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] [instance: 3b617584-f9bc-43a8-af3c-78546d0d9889] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:37.409619 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ab0b875e-0431-4e62-b1a4-2c0c91df6583 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:37.414344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54aa1195-7e2d-48cf-ba12-16f93eccaba2 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:37.414763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54aa1195-7e2d-48cf-ba12-16f93eccaba2 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:37.415822 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54aa1195-7e2d-48cf-ba12-16f93eccaba2 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:37.416134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ab0b875e-0431-4e62-b1a4-2c0c91df6583 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:37.416442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54aa1195-7e2d-48cf-ba12-16f93eccaba2 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:37.417888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ab0b875e-0431-4e62-b1a4-2c0c91df6583 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4'} {{(pid=119337) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:40:37.424787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab0b875e-0431-4e62-b1a4-2c0c91df6583 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:37.425236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab0b875e-0431-4e62-b1a4-2c0c91df6583 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:37.426030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab0b875e-0431-4e62-b1a4-2c0c91df6583 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:37.426574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab0b875e-0431-4e62-b1a4-2c0c91df6583 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:37.455209 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-54aa1195-7e2d-48cf-ba12-16f93eccaba2 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] HTTP exception thrown: Instance 3b617584-f9bc-43a8-af3c-78546d0d9889 could not be found. Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-54aa1195-7e2d-48cf-ba12-16f93eccaba2 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Request method failure captured: Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889 HTTP/1.1 Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zJ2JTIuaMJREZTmoErzCNgpGAxoQfQJn3icXHF8M9jisHkNeYsNAFIOobhnk-Xf0jghAPRRFygJESSHz39Kqu5hGgqaPyaJBlRFyZYh99Ih5sRaV0P5zd4aJsh3hD70_ql6Q0SdbzzbxR2J0UxQwLGs4jCLOhk76ozsZ9dCmr3Fgjs Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 4fe347c5b18f487ab2fc6b6de7e959e4 Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ImagesOneServerTestJSON-2060869421 Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4fe347c5b18f487ab2fc6b6de7e959e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4fe347c5b18f487ab2fc6b6de7e959e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4fe347c5b18f487ab2fc6b6de7e959e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4fe347c5b18f487ab2fc6b6de7e959e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ImagesOneServerTestJSON-2060869421 Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 4fe347c5b18f487ab2fc6b6de7e959e4 Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2060869421 Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ImagesOneServerTestJSON-2060869421-project Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 746810a196b24e8884a9526580cdc2a2 Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ImagesOneServerTestJSON-2060869421-project Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 3b617584-f9bc-43a8-af3c-78546d0d9889 could not be found. Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '3b617584-f9bc-43a8-af3c-78546d0d9889'} Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b617584-f9bc-43a8-af3c-78546d0d9889 could not be found. Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b617584-f9bc-43a8-af3c-78546d0d9889 could not be found. Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:37.457437 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:37.470005 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:37.470005 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:37.470005 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:37.470005 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:40:37.470005 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:40:37.470005 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b617584-f9bc-43a8-af3c-78546d0d9889 could not be found. Jul 19 22:40:37.470005 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:37.470005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-54aa1195-7e2d-48cf-ba12-16f93eccaba2 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] Returning 404 to user: Instance 3b617584-f9bc-43a8-af3c-78546d0d9889 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:37.470005 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-54aa1195-7e2d-48cf-ba12-16f93eccaba2 tempest-ImagesOneServerTestJSON-2060869421 tempest-ImagesOneServerTestJSON-2060869421-project] 10.222.0.25 "GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889" status: 404 len: 111 microversion: 2.1 time: 0.062342 Jul 19 22:40:37.470005 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1483/2934] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:37 2022] GET /compute/v2.1/servers/3b617584-f9bc-43a8-af3c-78546d0d9889 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:40:37.475059 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d98d2fbf-3d90-48f7-b167-7397d2fd6986 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:37.475928 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d98d2fbf-3d90-48f7-b167-7397d2fd6986 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] [instance: d6f5f214-5b73-40e7-a0d0-1518cff74397] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:37.485252 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d98d2fbf-3d90-48f7-b167-7397d2fd6986 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:37.485974 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d98d2fbf-3d90-48f7-b167-7397d2fd6986 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:37.487101 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d98d2fbf-3d90-48f7-b167-7397d2fd6986 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:37.487883 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d98d2fbf-3d90-48f7-b167-7397d2fd6986 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:37.543989 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.multi_cell_list [None req-ab0b875e-0431-4e62-b1a4-2c0c91df6583 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119337) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:40:37.625783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ab0b875e-0431-4e62-b1a4-2c0c91df6583 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:37.637873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab0b875e-0431-4e62-b1a4-2c0c91df6583 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:37.638740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab0b875e-0431-4e62-b1a4-2c0c91df6583 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:37.690581 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d98d2fbf-3d90-48f7-b167-7397d2fd6986 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b609af624e4b4aeeb9bfde36b890b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6eabd2343c481b8f7e5b4d7e61f2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:37.700032 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d98d2fbf-3d90-48f7-b167-7397d2fd6986 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] 10.222.0.25 "GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397" status: 200 len: 1528 microversion: 2.1 time: 0.231156 Jul 19 22:40:37.703169 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1484/2935] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:37 2022] GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397 => generated 1528 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:37.706876 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3fa19a79-4f9a-475c-a0f6-b7596b0a1558 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:37.707533 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3fa19a79-4f9a-475c-a0f6-b7596b0a1558 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: f02e1a17-fe38-4d7f-b55b-aaed61eb7006] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:37.715448 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3fa19a79-4f9a-475c-a0f6-b7596b0a1558 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:37.715910 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3fa19a79-4f9a-475c-a0f6-b7596b0a1558 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:37.716724 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3fa19a79-4f9a-475c-a0f6-b7596b0a1558 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:37.717165 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3fa19a79-4f9a-475c-a0f6-b7596b0a1558 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:37.890910 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ab0b875e-0431-4e62-b1a4-2c0c91df6583 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4516 microversion: 2.1 time: 0.487712 Jul 19 22:40:37.891563 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1452/2936] 10.222.0.25 () {58 vars in 1172 bytes} [Tue Jul 19 22:40:37 2022] GET /compute/v2.1/servers/detail?status=active => generated 4516 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:37.897407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-33bfcc7b-e4c5-493c-9f27-951b89cd5328 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:37.898400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-33bfcc7b-e4c5-493c-9f27-951b89cd5328 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: fb624b16-6d57-4542-bae7-36cd5b28be74] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:37.906071 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-33bfcc7b-e4c5-493c-9f27-951b89cd5328 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:37.906618 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-33bfcc7b-e4c5-493c-9f27-951b89cd5328 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:37.907505 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-33bfcc7b-e4c5-493c-9f27-951b89cd5328 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:37.908052 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-33bfcc7b-e4c5-493c-9f27-951b89cd5328 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:37.922870 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3fa19a79-4f9a-475c-a0f6-b7596b0a1558 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:37.931676 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3fa19a79-4f9a-475c-a0f6-b7596b0a1558 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006" status: 200 len: 1508 microversion: 2.1 time: 0.229681 Jul 19 22:40:37.933537 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1485/2937] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:37 2022] GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006 => generated 1508 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:37.938540 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8f7320a6-8848-4a10-91f9-a43eb8a9ae3a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:37.939401 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8f7320a6-8848-4a10-91f9-a43eb8a9ae3a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 0a5f7b5f-76ce-433e-9c96-53d7821b1761] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:37.946244 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8f7320a6-8848-4a10-91f9-a43eb8a9ae3a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:37.946954 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8f7320a6-8848-4a10-91f9-a43eb8a9ae3a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:37.948061 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8f7320a6-8848-4a10-91f9-a43eb8a9ae3a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:37.948701 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8f7320a6-8848-4a10-91f9-a43eb8a9ae3a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:37.965937 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-8f7320a6-8848-4a10-91f9-a43eb8a9ae3a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] HTTP exception thrown: Instance 0a5f7b5f-76ce-433e-9c96-53d7821b1761 could not be found. Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8f7320a6-8848-4a10-91f9-a43eb8a9ae3a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Request method failure captured: Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/0a5f7b5f-76ce-433e-9c96-53d7821b1761 HTTP/1.1 Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zJcOd8ioSoO4Ag7p0FuZhdyFBnwQELvoxLAsblThyrJ_2NxEo2CJ37EEfRT2CZdbZlGMRgWXNVEuSQUWOfX5krUiSHAMeusL8iD4FHXx0Nd2OURbeGsEBn_IDvsFz7TmW6c-8lxScCQfbEdKUx47XHZCtuEAW7dgjTFB9ANV0LmkTU Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: f4f40233895248229ddfdcd06fb65361 Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 0a5f7b5f-76ce-433e-9c96-53d7821b1761 could not be found. Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '0a5f7b5f-76ce-433e-9c96-53d7821b1761'} Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a5f7b5f-76ce-433e-9c96-53d7821b1761 could not be found. Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a5f7b5f-76ce-433e-9c96-53d7821b1761 could not be found. Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:37.967836 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:37.971658 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:37.971658 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:37.971658 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:37.971658 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:40:37.971658 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:40:37.971658 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a5f7b5f-76ce-433e-9c96-53d7821b1761 could not be found. Jul 19 22:40:37.971658 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:37.972992 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8f7320a6-8848-4a10-91f9-a43eb8a9ae3a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Returning 404 to user: Instance 0a5f7b5f-76ce-433e-9c96-53d7821b1761 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:37.975959 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8f7320a6-8848-4a10-91f9-a43eb8a9ae3a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/0a5f7b5f-76ce-433e-9c96-53d7821b1761" status: 404 len: 111 microversion: 2.1 time: 0.041034 Jul 19 22:40:37.976556 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1486/2938] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:37 2022] GET /compute/v2.1/servers/0a5f7b5f-76ce-433e-9c96-53d7821b1761 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:40:37.987863 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-53b44784-5dbd-4e4f-8f36-5c7743a62011 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:37.994082 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-53b44784-5dbd-4e4f-8f36-5c7743a62011 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:37.994494 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.compute.servers [None req-53b44784-5dbd-4e4f-8f36-5c7743a62011 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Removing options 'limit' from query {{(pid=119338) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 19 22:40:37.996185 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-53b44784-5dbd-4e4f-8f36-5c7743a62011 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Searching by: {'deleted': False, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4'} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:40:38.002538 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53b44784-5dbd-4e4f-8f36-5c7743a62011 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:38.003000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53b44784-5dbd-4e4f-8f36-5c7743a62011 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:38.003837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53b44784-5dbd-4e4f-8f36-5c7743a62011 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:38.004283 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53b44784-5dbd-4e4f-8f36-5c7743a62011 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:38.046283 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-53b44784-5dbd-4e4f-8f36-5c7743a62011 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:38.054319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53b44784-5dbd-4e4f-8f36-5c7743a62011 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:38.054788 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53b44784-5dbd-4e4f-8f36-5c7743a62011 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:38.133522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-33bfcc7b-e4c5-493c-9f27-951b89cd5328 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6994ad3a701847d49163a7b709fba400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24647fdcb5d7402ebfdca8ea2ae72e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:38.142159 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-33bfcc7b-e4c5-493c-9f27-951b89cd5328 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74" status: 200 len: 1316 microversion: 2.1 time: 0.249364 Jul 19 22:40:38.143611 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1453/2939] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:37 2022] GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74 => generated 1316 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:38.148596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7d3531ad-2748-445c-82b2-66f9cb1a7c97 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:38.149993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7d3531ad-2748-445c-82b2-66f9cb1a7c97 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: f02e1a17-fe38-4d7f-b55b-aaed61eb7006] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:38.158295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d3531ad-2748-445c-82b2-66f9cb1a7c97 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:38.159439 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d3531ad-2748-445c-82b2-66f9cb1a7c97 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:38.160831 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d3531ad-2748-445c-82b2-66f9cb1a7c97 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:38.161525 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d3531ad-2748-445c-82b2-66f9cb1a7c97 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:38.248006 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7d3531ad-2748-445c-82b2-66f9cb1a7c97 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "PUT /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006" status: 200 len: 1080 microversion: 2.1 time: 0.102955 Jul 19 22:40:38.248895 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1454/2940] 10.222.0.25 () {60 vars in 1255 bytes} [Tue Jul 19 22:40:38 2022] PUT /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006 => generated 1080 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:38.252759 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-53b44784-5dbd-4e4f-8f36-5c7743a62011 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.270833 Jul 19 22:40:38.255623 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1487/2941] 10.222.0.25 () {58 vars in 1160 bytes} [Tue Jul 19 22:40:37 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:38.257534 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d5295231-a65b-49f5-b340-fa227d48525b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-684536677", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "87c331fb-040c-45fc-a9a1-e946f840de97"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:38.272659 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4c03db16-6978-40cf-9053-d13df1fea0f9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:38.274356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4c03db16-6978-40cf-9053-d13df1fea0f9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:38.287130 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4c03db16-6978-40cf-9053-d13df1fea0f9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:38.288516 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4c03db16-6978-40cf-9053-d13df1fea0f9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:38.290223 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4c03db16-6978-40cf-9053-d13df1fea0f9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:38.291266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4c03db16-6978-40cf-9053-d13df1fea0f9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:38.373761 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-d5295231-a65b-49f5-b340-fa227d48525b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] validate_networks() for [('87c331fb-040c-45fc-a9a1-e946f840de97', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:40:38.593238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4c03db16-6978-40cf-9053-d13df1fea0f9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:38.606340 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4c03db16-6978-40cf-9053-d13df1fea0f9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.348519 Jul 19 22:40:38.607591 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1488/2942] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:38 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:38.622745 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0c15c4c5-378e-4d4a-aeda-3923810a2f35 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:38.624029 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0c15c4c5-378e-4d4a-aeda-3923810a2f35 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: f02e1a17-fe38-4d7f-b55b-aaed61eb7006] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:38.632300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c15c4c5-378e-4d4a-aeda-3923810a2f35 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:38.633775 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c15c4c5-378e-4d4a-aeda-3923810a2f35 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:38.636008 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c15c4c5-378e-4d4a-aeda-3923810a2f35 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:38.637447 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c15c4c5-378e-4d4a-aeda-3923810a2f35 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:38.890174 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0c15c4c5-378e-4d4a-aeda-3923810a2f35 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:38.908403 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0c15c4c5-378e-4d4a-aeda-3923810a2f35 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006" status: 200 len: 1506 microversion: 2.1 time: 0.299493 Jul 19 22:40:38.909039 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1489/2943] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:38 2022] GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006 => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:38.913808 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c202cba9-9a92-477f-9e0b-c98bf8504c51 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:38.918607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c202cba9-9a92-477f-9e0b-c98bf8504c51 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:38.919700 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c202cba9-9a92-477f-9e0b-c98bf8504c51 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4'} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:40:38.925673 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c202cba9-9a92-477f-9e0b-c98bf8504c51 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:38.926200 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c202cba9-9a92-477f-9e0b-c98bf8504c51 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:38.927101 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c202cba9-9a92-477f-9e0b-c98bf8504c51 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:38.927611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c202cba9-9a92-477f-9e0b-c98bf8504c51 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:39.054844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-d5295231-a65b-49f5-b340-fa227d48525b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:40:39.055454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-d5295231-a65b-49f5-b340-fa227d48525b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:40:39.055903 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-d5295231-a65b-49f5-b340-fa227d48525b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:40:39.056422 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-d5295231-a65b-49f5-b340-fa227d48525b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:40:39.056918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-d5295231-a65b-49f5-b340-fa227d48525b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:40:39.078209 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5295231-a65b-49f5-b340-fa227d48525b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:39.079143 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5295231-a65b-49f5-b340-fa227d48525b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:39.080467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5295231-a65b-49f5-b340-fa227d48525b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:39.081185 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5295231-a65b-49f5-b340-fa227d48525b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:39.083090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.multi_cell_list [None req-c202cba9-9a92-477f-9e0b-c98bf8504c51 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119338) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:40:39.100730 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-d5295231-a65b-49f5-b340-fa227d48525b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Getting quotas for project a2bcdb843a7d4a1ebe467160eee0d6e1. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:40:39.107990 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-d5295231-a65b-49f5-b340-fa227d48525b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Getting quotas for user f4f40233895248229ddfdcd06fb65361 and project a2bcdb843a7d4a1ebe467160eee0d6e1. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:40:39.130428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d5295231-a65b-49f5-b340-fa227d48525b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:40:39.133376 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d5295231-a65b-49f5-b340-fa227d48525b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: e0ada988-0937-4623-a7a6-b7bc4a69f517] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:40:39.160432 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c202cba9-9a92-477f-9e0b-c98bf8504c51 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.250262 Jul 19 22:40:39.168626 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1490/2944] 10.222.0.25 () {58 vars in 1151 bytes} [Tue Jul 19 22:40:38 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:39.176395 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-3f9175ef-ab15-4d1c-9ae0-bc2cf3812c88 req-834bc3a0-027d-4f9a-b899-aefda88abde3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9ae7d22-3925-465a-9507-250b670ecc77", "name": "network-vif-unplugged", "status": "completed", "tag": "3196bd8c-6a69-4858-81a6-622d724377b1"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:39.194546 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-3f9175ef-ab15-4d1c-9ae0-bc2cf3812c88 req-834bc3a0-027d-4f9a-b899-aefda88abde3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:39.195246 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-3f9175ef-ab15-4d1c-9ae0-bc2cf3812c88 req-834bc3a0-027d-4f9a-b899-aefda88abde3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:39.207773 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d5295231-a65b-49f5-b340-fa227d48525b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.957070 Jul 19 22:40:39.208461 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1455/2945] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:40:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:40:39.211076 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-3f9175ef-ab15-4d1c-9ae0-bc2cf3812c88 req-834bc3a0-027d-4f9a-b899-aefda88abde3 service nova] Creating event network-vif-unplugged:3196bd8c-6a69-4858-81a6-622d724377b1 for instance b9ae7d22-3925-465a-9507-250b670ecc77 on n-h2-847009-3 Jul 19 22:40:39.213085 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a0f66913-d7b8-43f4-9776-81f53b4a0ddd tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:39.213715 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a0f66913-d7b8-43f4-9776-81f53b4a0ddd tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] [instance: d6f5f214-5b73-40e7-a0d0-1518cff74397] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:39.218528 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-3f9175ef-ab15-4d1c-9ae0-bc2cf3812c88 req-834bc3a0-027d-4f9a-b899-aefda88abde3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056275 Jul 19 22:40:39.223722 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1491/2946] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:39.224008 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0f66913-d7b8-43f4-9776-81f53b4a0ddd tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:39.224483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0f66913-d7b8-43f4-9776-81f53b4a0ddd tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:39.225285 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0f66913-d7b8-43f4-9776-81f53b4a0ddd tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:39.225738 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0f66913-d7b8-43f4-9776-81f53b4a0ddd tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:39.232900 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-345164be-b829-4a43-8694-53188b3a62da tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:39.234125 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-345164be-b829-4a43-8694-53188b3a62da tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:39.241498 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-345164be-b829-4a43-8694-53188b3a62da tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:39.242477 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-345164be-b829-4a43-8694-53188b3a62da tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:39.243865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-345164be-b829-4a43-8694-53188b3a62da tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:39.244568 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-345164be-b829-4a43-8694-53188b3a62da tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:39.482932 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a0f66913-d7b8-43f4-9776-81f53b4a0ddd tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b609af624e4b4aeeb9bfde36b890b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6eabd2343c481b8f7e5b4d7e61f2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:39.491580 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a0f66913-d7b8-43f4-9776-81f53b4a0ddd tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] 10.222.0.25 "GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397" status: 200 len: 1528 microversion: 2.1 time: 0.282053 Jul 19 22:40:39.492338 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1456/2947] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:39 2022] GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397 => generated 1528 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:39.497597 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-345164be-b829-4a43-8694-53188b3a62da tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:39.499016 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5c6b04dc-681a-4083-89eb-5dde1f7a5712 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:39.500011 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5c6b04dc-681a-4083-89eb-5dde1f7a5712 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: f02e1a17-fe38-4d7f-b55b-aaed61eb7006] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:39.508784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c6b04dc-681a-4083-89eb-5dde1f7a5712 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:39.509400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c6b04dc-681a-4083-89eb-5dde1f7a5712 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:39.510102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c6b04dc-681a-4083-89eb-5dde1f7a5712 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:39.510559 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c6b04dc-681a-4083-89eb-5dde1f7a5712 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:39.515373 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-345164be-b829-4a43-8694-53188b3a62da tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.288588 Jul 19 22:40:39.529810 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1492/2948] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:39 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:39.534677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-feed453d-2464-4dff-b5e4-8e7b09007a85 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:39.535584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-feed453d-2464-4dff-b5e4-8e7b09007a85 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: fb624b16-6d57-4542-bae7-36cd5b28be74] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:39.543534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-feed453d-2464-4dff-b5e4-8e7b09007a85 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:39.544328 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-feed453d-2464-4dff-b5e4-8e7b09007a85 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:39.545651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-feed453d-2464-4dff-b5e4-8e7b09007a85 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:39.547068 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-feed453d-2464-4dff-b5e4-8e7b09007a85 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:39.576926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:39.781512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-feed453d-2464-4dff-b5e4-8e7b09007a85 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6994ad3a701847d49163a7b709fba400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24647fdcb5d7402ebfdca8ea2ae72e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:39.788699 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5c6b04dc-681a-4083-89eb-5dde1f7a5712 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:39.791567 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-feed453d-2464-4dff-b5e4-8e7b09007a85 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74" status: 200 len: 1316 microversion: 2.1 time: 0.261251 Jul 19 22:40:39.796658 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1493/2949] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:39 2022] GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74 => generated 1316 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:39.801911 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aee649de-d8fa-497f-b5b2-166b0f21d41d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:39.810310 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-aee649de-d8fa-497f-b5b2-166b0f21d41d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:39.811303 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.compute.servers [None req-aee649de-d8fa-497f-b5b2-166b0f21d41d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Removing options 'limit' from query {{(pid=119338) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 19 22:40:39.812300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-aee649de-d8fa-497f-b5b2-166b0f21d41d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Searching by: {'deleted': False, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4'} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:40:39.815834 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5c6b04dc-681a-4083-89eb-5dde1f7a5712 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006" status: 200 len: 1506 microversion: 2.1 time: 0.321629 Jul 19 22:40:39.817122 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1457/2950] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:39 2022] GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006 => generated 1506 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:39.825674 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aee649de-d8fa-497f-b5b2-166b0f21d41d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:39.826060 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-edbb8ddb-0919-45e8-b22e-6699ca398f49 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:39.827524 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-edbb8ddb-0919-45e8-b22e-6699ca398f49 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: e0ada988-0937-4623-a7a6-b7bc4a69f517] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:39.828138 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aee649de-d8fa-497f-b5b2-166b0f21d41d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:39.836430 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aee649de-d8fa-497f-b5b2-166b0f21d41d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:39.836972 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aee649de-d8fa-497f-b5b2-166b0f21d41d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:39.841183 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-edbb8ddb-0919-45e8-b22e-6699ca398f49 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:39.842290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-edbb8ddb-0919-45e8-b22e-6699ca398f49 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:39.844009 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-edbb8ddb-0919-45e8-b22e-6699ca398f49 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:39.845064 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-edbb8ddb-0919-45e8-b22e-6699ca398f49 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:39.855140 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:39.878409 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.multi_cell_list [None req-aee649de-d8fa-497f-b5b2-166b0f21d41d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119338) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:40:39.916681 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-aee649de-d8fa-497f-b5b2-166b0f21d41d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.118801 Jul 19 22:40:39.920225 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1494/2951] 10.222.0.25 () {58 vars in 1149 bytes} [Tue Jul 19 22:40:39 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:39.998793 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-edbb8ddb-0919-45e8-b22e-6699ca398f49 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:40.016021 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-edbb8ddb-0919-45e8-b22e-6699ca398f49 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517" status: 200 len: 1218 microversion: 2.1 time: 0.196804 Jul 19 22:40:40.019643 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1458/2952] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:39 2022] GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517 => generated 1218 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:40.025145 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2007c7e6-c426-40a8-87d9-070c67835869 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:40.026406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2007c7e6-c426-40a8-87d9-070c67835869 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: f02e1a17-fe38-4d7f-b55b-aaed61eb7006] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:40.051920 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2007c7e6-c426-40a8-87d9-070c67835869 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:40.052696 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2007c7e6-c426-40a8-87d9-070c67835869 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:40.054007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2007c7e6-c426-40a8-87d9-070c67835869 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:40.054611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2007c7e6-c426-40a8-87d9-070c67835869 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:40.190851 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2007c7e6-c426-40a8-87d9-070c67835869 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "PUT /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006" status: 200 len: 1082 microversion: 2.1 time: 0.169438 Jul 19 22:40:40.191552 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1459/2953] 10.222.0.25 () {60 vars in 1255 bytes} [Tue Jul 19 22:40:40 2022] PUT /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006 => generated 1082 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:40.199804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-accc36b9-9c1f-45c9-9457-065228d98d14 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:40.212993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-accc36b9-9c1f-45c9-9457-065228d98d14 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:40.215046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-accc36b9-9c1f-45c9-9457-065228d98d14 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Searching by: {'deleted': False, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4'} {{(pid=119337) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:40:40.222038 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-accc36b9-9c1f-45c9-9457-065228d98d14 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:40.222836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-accc36b9-9c1f-45c9-9457-065228d98d14 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:40.224089 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-accc36b9-9c1f-45c9-9457-065228d98d14 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:40.224808 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-accc36b9-9c1f-45c9-9457-065228d98d14 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:40.258500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c0a14cab-ebc3-4abc-b708-fb558a1d8618 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] Action: 'create', calling method: .version_select at 0x7f7a0379f160>, body: {"keypair": {"name": "tempest-keypair-185946040", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbdYHDl/anVfGAxO6ArrvcQiokFeerWtUfqoeBkvXkRjbF6xIN32wQdLDPT+fXmbcn39VI68j+llaohfFNjzdAmtz1I3Z/2/rPZLifDrdGPbpRdNI67skhOP32Ise/Q7A=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:40.281630 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.multi_cell_list [None req-accc36b9-9c1f-45c9-9457-065228d98d14 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119337) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:40:40.293197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-c0a14cab-ebc3-4abc-b708-fb558a1d8618 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] Getting quotas for project b4ff7261f1494b7180a52edfea60b759. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:40:40.310818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-c0a14cab-ebc3-4abc-b708-fb558a1d8618 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] Getting quotas for user 43ce93fff9c6477687f723eda6ed65db and project b4ff7261f1494b7180a52edfea60b759. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:40:40.321286 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-accc36b9-9c1f-45c9-9457-065228d98d14 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.126812 Jul 19 22:40:40.322646 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1460/2954] 10.222.0.25 () {58 vars in 1124 bytes} [Tue Jul 19 22:40:40 2022] GET /compute/v2.1/servers => generated 1011 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:40.330649 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ac570a16-23f5-4cc6-97ed-c0829b3008c7 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:40.332112 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ac570a16-23f5-4cc6-97ed-c0829b3008c7 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: f02e1a17-fe38-4d7f-b55b-aaed61eb7006] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:40.334742 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:40.343631 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac570a16-23f5-4cc6-97ed-c0829b3008c7 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:40.344663 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac570a16-23f5-4cc6-97ed-c0829b3008c7 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:40.346484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac570a16-23f5-4cc6-97ed-c0829b3008c7 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:40.347239 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac570a16-23f5-4cc6-97ed-c0829b3008c7 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:40.393472 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c0a14cab-ebc3-4abc-b708-fb558a1d8618 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.474001 Jul 19 22:40:40.396273 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1495/2955] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:40:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:40.407519 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7cea7fdb-0951-49a9-9aa8-0cd665f731cf tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:40.412898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7cea7fdb-0951-49a9-9aa8-0cd665f731cf tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:40.413592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7cea7fdb-0951-49a9-9aa8-0cd665f731cf tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4'} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:40:40.428009 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7cea7fdb-0951-49a9-9aa8-0cd665f731cf tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:40.428465 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7cea7fdb-0951-49a9-9aa8-0cd665f731cf tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:40.429269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7cea7fdb-0951-49a9-9aa8-0cd665f731cf tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:40.429713 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7cea7fdb-0951-49a9-9aa8-0cd665f731cf tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:40.584923 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.multi_cell_list [None req-7cea7fdb-0951-49a9-9aa8-0cd665f731cf tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119338) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:40:40.684515 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7cea7fdb-0951-49a9-9aa8-0cd665f731cf tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.285621 Jul 19 22:40:40.685907 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1496/2956] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:40:40 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:40.701633 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4833a10e-bf86-4c48-9c34-879b82d01b36 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] Calling method '.version_select at 0x7f7a03986940>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:40.724385 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4833a10e-bf86-4c48-9c34-879b82d01b36 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-185946040" status: 200 len: 497 microversion: 2.1 time: 0.035840 Jul 19 22:40:40.732176 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1497/2957] 10.222.0.25 () {58 vars in 1214 bytes} [Tue Jul 19 22:40:40 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-185946040 => generated 497 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:40.739440 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f37fdf2a-ef88-452f-ae12-35dc640a02eb tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:40.743071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f37fdf2a-ef88-452f-ae12-35dc640a02eb tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] [instance: d6f5f214-5b73-40e7-a0d0-1518cff74397] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:40.764246 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f37fdf2a-ef88-452f-ae12-35dc640a02eb tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:40.764716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f37fdf2a-ef88-452f-ae12-35dc640a02eb tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:40.765510 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f37fdf2a-ef88-452f-ae12-35dc640a02eb tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:40.766317 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f37fdf2a-ef88-452f-ae12-35dc640a02eb tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:40.851128 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ac570a16-23f5-4cc6-97ed-c0829b3008c7 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:40.861575 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ac570a16-23f5-4cc6-97ed-c0829b3008c7 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006" status: 200 len: 1508 microversion: 2.1 time: 0.536043 Jul 19 22:40:40.867248 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1461/2958] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:40 2022] GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006 => generated 1508 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:40.877112 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-51e96b7b-f17c-48b0-9d13-bea8cc8add8e tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:40.889532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-51e96b7b-f17c-48b0-9d13-bea8cc8add8e tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:40.896084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.compute.servers [None req-51e96b7b-f17c-48b0-9d13-bea8cc8add8e tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Removing options 'limit' from query {{(pid=119337) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 19 22:40:40.896928 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-51e96b7b-f17c-48b0-9d13-bea8cc8add8e tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Searching by: {'deleted': False, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4'} {{(pid=119337) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:40:40.905084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51e96b7b-f17c-48b0-9d13-bea8cc8add8e tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:40.914941 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51e96b7b-f17c-48b0-9d13-bea8cc8add8e tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:40.915892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51e96b7b-f17c-48b0-9d13-bea8cc8add8e tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:40.916343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51e96b7b-f17c-48b0-9d13-bea8cc8add8e tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:40.959849 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-51e96b7b-f17c-48b0-9d13-bea8cc8add8e tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.088633 Jul 19 22:40:40.963437 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1462/2959] 10.222.0.25 () {58 vars in 1139 bytes} [Tue Jul 19 22:40:40 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:40.982473 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d4df683a-e363-4de8-8e20-5cb0881c55ed tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] Calling method '.version_select at 0x7f7a1562e9d0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:41.015535 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d4df683a-e363-4de8-8e20-5cb0881c55ed tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-185946040" status: 202 len: 0 microversion: 2.1 time: 0.050257 Jul 19 22:40:41.025167 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1463/2960] 10.222.0.25 () {58 vars in 1217 bytes} [Tue Jul 19 22:40:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-185946040 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:40:41.025167 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-52c90e5b-db54-4e41-a2d2-5d47ee3ba45b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:41.025167 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-52c90e5b-db54-4e41-a2d2-5d47ee3ba45b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: fb624b16-6d57-4542-bae7-36cd5b28be74] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:41.036462 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52c90e5b-db54-4e41-a2d2-5d47ee3ba45b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:41.037017 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52c90e5b-db54-4e41-a2d2-5d47ee3ba45b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:41.037915 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52c90e5b-db54-4e41-a2d2-5d47ee3ba45b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:41.038676 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52c90e5b-db54-4e41-a2d2-5d47ee3ba45b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:41.236766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f37fdf2a-ef88-452f-ae12-35dc640a02eb tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b609af624e4b4aeeb9bfde36b890b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6eabd2343c481b8f7e5b4d7e61f2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:41.247989 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f37fdf2a-ef88-452f-ae12-35dc640a02eb tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] 10.222.0.25 "GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397" status: 200 len: 1528 microversion: 2.1 time: 0.518365 Jul 19 22:40:41.259365 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1498/2961] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:40 2022] GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397 => generated 1528 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:41.267512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d434380e-da51-42cb-89bb-ec03cadf5b1a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:41.268492 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d434380e-da51-42cb-89bb-ec03cadf5b1a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: f02e1a17-fe38-4d7f-b55b-aaed61eb7006] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:41.275516 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d434380e-da51-42cb-89bb-ec03cadf5b1a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:41.276442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d434380e-da51-42cb-89bb-ec03cadf5b1a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:41.278022 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d434380e-da51-42cb-89bb-ec03cadf5b1a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:41.278639 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d434380e-da51-42cb-89bb-ec03cadf5b1a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:41.562538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-52c90e5b-db54-4e41-a2d2-5d47ee3ba45b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6994ad3a701847d49163a7b709fba400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24647fdcb5d7402ebfdca8ea2ae72e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:41.572132 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-52c90e5b-db54-4e41-a2d2-5d47ee3ba45b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74" status: 200 len: 1316 microversion: 2.1 time: 0.554097 Jul 19 22:40:41.572727 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1464/2962] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:41 2022] GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74 => generated 1316 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:41.578853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7a8fa66d-fca6-4745-b288-d9f5a706c151 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:41.582770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7a8fa66d-fca6-4745-b288-d9f5a706c151 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:41.583490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7a8fa66d-fca6-4745-b288-d9f5a706c151 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-483663341', 'deleted': False, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4'} {{(pid=119337) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:40:41.589182 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a8fa66d-fca6-4745-b288-d9f5a706c151 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:41.589640 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a8fa66d-fca6-4745-b288-d9f5a706c151 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:41.590446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a8fa66d-fca6-4745-b288-d9f5a706c151 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:41.590899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a8fa66d-fca6-4745-b288-d9f5a706c151 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:41.613311 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d434380e-da51-42cb-89bb-ec03cadf5b1a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:41.627455 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d434380e-da51-42cb-89bb-ec03cadf5b1a tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006" status: 200 len: 1508 microversion: 2.1 time: 0.366514 Jul 19 22:40:41.628058 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1499/2963] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:41 2022] GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006 => generated 1508 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:41.633407 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bb9e28e0-7f33-49a8-a77c-092fdee45a10 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] Action: 'create', calling method: .version_select at 0x7f7a03a15160>, body: {"keypair": {"name": "tempest-keypair-786644009", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/HUEmZmekaqq6gb9tlBabWiYLL0gkvhO9FOZbHT/Z0zW26gHlbK2NYbQMPpspfCl3AKPt/5sHwt8p+jnF2GJhjFud+yVJKyE6tseGK85x2P2eQVqAnLgljbzZVOxAoNg=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:41.650144 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-bb9e28e0-7f33-49a8-a77c-092fdee45a10 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] Getting quotas for project b4ff7261f1494b7180a52edfea60b759. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:40:41.656905 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-bb9e28e0-7f33-49a8-a77c-092fdee45a10 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] Getting quotas for user 43ce93fff9c6477687f723eda6ed65db and project b4ff7261f1494b7180a52edfea60b759. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:40:41.689624 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bb9e28e0-7f33-49a8-a77c-092fdee45a10 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060272 Jul 19 22:40:41.690962 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1500/2964] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:40:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:41.696493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0be07f3d-9ec6-45e3-a8d2-5bff2794430f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:41.697394 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0be07f3d-9ec6-45e3-a8d2-5bff2794430f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: e0ada988-0937-4623-a7a6-b7bc4a69f517] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:41.704556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0be07f3d-9ec6-45e3-a8d2-5bff2794430f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:41.705441 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0be07f3d-9ec6-45e3-a8d2-5bff2794430f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:41.706456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0be07f3d-9ec6-45e3-a8d2-5bff2794430f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:41.707174 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0be07f3d-9ec6-45e3-a8d2-5bff2794430f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:41.744250 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.multi_cell_list [None req-7a8fa66d-fca6-4745-b288-d9f5a706c151 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119337) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:40:41.817380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0be07f3d-9ec6-45e3-a8d2-5bff2794430f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:41.826569 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7a8fa66d-fca6-4745-b288-d9f5a706c151 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-483663341" status: 200 len: 345 microversion: 2.1 time: 0.251856 Jul 19 22:40:41.827821 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1465/2965] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Jul 19 22:40:41 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-483663341 => generated 345 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:41.830122 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0be07f3d-9ec6-45e3-a8d2-5bff2794430f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517" status: 200 len: 1272 microversion: 2.1 time: 0.137753 Jul 19 22:40:41.831491 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1501/2966] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:41 2022] GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517 => generated 1272 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:41.833897 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-5d1495c4-619d-483e-9a56-c98e10b316c0 req-c228f3a4-fc5b-4f36-ad05-7f3dc6f95bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f5f214-5b73-40e7-a0d0-1518cff74397", "name": "network-vif-deleted", "tag": "165c22a8-352f-4506-8cdb-92cbd1613968"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:41.847172 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ab20da29-b6a8-4996-9585-8345d011ee18 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:41.848442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ab20da29-b6a8-4996-9585-8345d011ee18 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:41.850689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-5d1495c4-619d-483e-9a56-c98e10b316c0 req-c228f3a4-fc5b-4f36-ad05-7f3dc6f95bf9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:41.851298 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-5d1495c4-619d-483e-9a56-c98e10b316c0 req-c228f3a4-fc5b-4f36-ad05-7f3dc6f95bf9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:41.858953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab20da29-b6a8-4996-9585-8345d011ee18 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:41.860069 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab20da29-b6a8-4996-9585-8345d011ee18 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:41.860952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab20da29-b6a8-4996-9585-8345d011ee18 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:41.862426 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab20da29-b6a8-4996-9585-8345d011ee18 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:41.864013 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-5d1495c4-619d-483e-9a56-c98e10b316c0 req-c228f3a4-fc5b-4f36-ad05-7f3dc6f95bf9 service nova] Creating event network-vif-deleted:165c22a8-352f-4506-8cdb-92cbd1613968 for instance d6f5f214-5b73-40e7-a0d0-1518cff74397 on n-h2-847009-3 Jul 19 22:40:41.872772 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-5d1495c4-619d-483e-9a56-c98e10b316c0 req-c228f3a4-fc5b-4f36-ad05-7f3dc6f95bf9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043238 Jul 19 22:40:41.873740 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1466/2967] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:41.879129 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b7a0ff9a-3684-4032-8a81-a44b44c08ff5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:41.880069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b7a0ff9a-3684-4032-8a81-a44b44c08ff5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: f02e1a17-fe38-4d7f-b55b-aaed61eb7006] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:41.889521 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7a0ff9a-3684-4032-8a81-a44b44c08ff5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:41.889968 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7a0ff9a-3684-4032-8a81-a44b44c08ff5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:41.891245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7a0ff9a-3684-4032-8a81-a44b44c08ff5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:41.891867 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7a0ff9a-3684-4032-8a81-a44b44c08ff5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:41.920202 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b7a0ff9a-3684-4032-8a81-a44b44c08ff5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: f02e1a17-fe38-4d7f-b55b-aaed61eb7006] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:40:42.015508 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b7a0ff9a-3684-4032-8a81-a44b44c08ff5 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006" status: 204 len: 0 microversion: 2.1 time: 0.140272 Jul 19 22:40:42.016143 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1467/2968] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:40:41 2022] DELETE /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:40:42.026128 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c68cf242-867f-4d2a-bc9c-0200aed069f3 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] Calling method '.version_select at 0x7f7a107c08b0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:42.046825 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c68cf242-867f-4d2a-bc9c-0200aed069f3 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-786644009" status: 202 len: 0 microversion: 2.1 time: 0.024732 Jul 19 22:40:42.047786 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1468/2969] 10.222.0.25 () {58 vars in 1217 bytes} [Tue Jul 19 22:40:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-786644009 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:40:42.052547 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1c8f1aec-2954-48a5-a6d0-16815112e21a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:42.062095 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1c8f1aec-2954-48a5-a6d0-16815112e21a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:42.062547 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1c8f1aec-2954-48a5-a6d0-16815112e21a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:42.131164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1c8f1aec-2954-48a5-a6d0-16815112e21a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 976f2ec1-c70b-4795-a71d-251bed15ad25] Going to try to stop instance {{(pid=119337) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 22:40:42.142241 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ab20da29-b6a8-4996-9585-8345d011ee18 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:42.153110 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ab20da29-b6a8-4996-9585-8345d011ee18 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.320044 Jul 19 22:40:42.164174 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1502/2970] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:41 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:42.173466 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7a13cf29-30df-4b07-8b29-9c1413e9a8a1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:42.174731 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7a13cf29-30df-4b07-8b29-9c1413e9a8a1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: f02e1a17-fe38-4d7f-b55b-aaed61eb7006] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:42.184806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a13cf29-30df-4b07-8b29-9c1413e9a8a1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:42.185542 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a13cf29-30df-4b07-8b29-9c1413e9a8a1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:42.187372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a13cf29-30df-4b07-8b29-9c1413e9a8a1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:42.187372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a13cf29-30df-4b07-8b29-9c1413e9a8a1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:42.195778 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1c8f1aec-2954-48a5-a6d0-16815112e21a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "POST /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25/action" status: 202 len: 0 microversion: 2.1 time: 0.146804 Jul 19 22:40:42.196697 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1469/2971] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:40:42 2022] POST /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:40:42.203901 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8806c764-0b2c-4e0e-a5fb-292a5b8742bd tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] Action: 'create', calling method: .version_select at 0x7f7a1040c310>, body: {"keypair": {"name": "tempest-keypair-1368578832", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:42.223503 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7a13cf29-30df-4b07-8b29-9c1413e9a8a1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: f02e1a17-fe38-4d7f-b55b-aaed61eb7006] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:40:42.224642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-8806c764-0b2c-4e0e-a5fb-292a5b8742bd tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] Getting quotas for project b4ff7261f1494b7180a52edfea60b759. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:40:42.232468 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-8806c764-0b2c-4e0e-a5fb-292a5b8742bd tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] Getting quotas for user 43ce93fff9c6477687f723eda6ed65db and project b4ff7261f1494b7180a52edfea60b759. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:40:42.272633 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8806c764-0b2c-4e0e-a5fb-292a5b8742bd tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.074166 Jul 19 22:40:42.278114 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1470/2972] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:40:42 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:42.284308 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0beec4ae-40d0-4914-9363-6009c450d941 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:42.285381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0beec4ae-40d0-4914-9363-6009c450d941 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:42.296324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0beec4ae-40d0-4914-9363-6009c450d941 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:42.296788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0beec4ae-40d0-4914-9363-6009c450d941 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:42.297698 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0beec4ae-40d0-4914-9363-6009c450d941 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:42.298463 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0beec4ae-40d0-4914-9363-6009c450d941 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:42.299156 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.compute.api [None req-7a13cf29-30df-4b07-8b29-9c1413e9a8a1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: f02e1a17-fe38-4d7f-b55b-aaed61eb7006] Instance is already in deleting state, ignoring this request Jul 19 22:40:42.300556 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7a13cf29-30df-4b07-8b29-9c1413e9a8a1 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006" status: 204 len: 0 microversion: 2.1 time: 0.131689 Jul 19 22:40:42.301466 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1503/2973] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:40:42 2022] DELETE /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:40:42.313671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1d04e959-35c5-4728-b260-163e9defa78f tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:42.314582 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1d04e959-35c5-4728-b260-163e9defa78f tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 976f2ec1-c70b-4795-a71d-251bed15ad25] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:42.321891 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d04e959-35c5-4728-b260-163e9defa78f tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:42.322765 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d04e959-35c5-4728-b260-163e9defa78f tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:42.324382 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d04e959-35c5-4728-b260-163e9defa78f tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:42.325344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d04e959-35c5-4728-b260-163e9defa78f tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:42.635389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0beec4ae-40d0-4914-9363-6009c450d941 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:42.637467 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1d04e959-35c5-4728-b260-163e9defa78f tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:42.652173 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1d04e959-35c5-4728-b260-163e9defa78f tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25" status: 200 len: 1520 microversion: 2.1 time: 0.342545 Jul 19 22:40:42.663289 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1504/2974] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:42 2022] GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25 => generated 1520 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:42.665568 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0beec4ae-40d0-4914-9363-6009c450d941 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.385731 Jul 19 22:40:42.671028 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ca4b2b14-52b1-486e-9dda-b5297432ee08 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:42.672482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ca4b2b14-52b1-486e-9dda-b5297432ee08 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] [instance: d6f5f214-5b73-40e7-a0d0-1518cff74397] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:42.673651 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1471/2975] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:42 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:42.681793 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eaa22f32-778c-4922-afa4-c1603ebbb158 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] Calling method '.version_select at 0x7f7a104b9670>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:42.690184 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca4b2b14-52b1-486e-9dda-b5297432ee08 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:42.691329 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca4b2b14-52b1-486e-9dda-b5297432ee08 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:42.692701 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca4b2b14-52b1-486e-9dda-b5297432ee08 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:42.693923 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca4b2b14-52b1-486e-9dda-b5297432ee08 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:42.709477 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eaa22f32-778c-4922-afa4-c1603ebbb158 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1368578832" status: 202 len: 0 microversion: 2.1 time: 0.033628 Jul 19 22:40:42.718073 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1472/2976] 10.222.0.25 () {58 vars in 1220 bytes} [Tue Jul 19 22:40:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1368578832 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:40:42.728249 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-ca4b2b14-52b1-486e-9dda-b5297432ee08 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] HTTP exception thrown: Instance d6f5f214-5b73-40e7-a0d0-1518cff74397 could not be found. Jul 19 22:40:42.729579 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-afe4e514-17e2-4a50-9779-1148d9a002b2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ca4b2b14-52b1-486e-9dda-b5297432ee08 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Request method failure captured: Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397 HTTP/1.1 Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zK53_8E_aNTmpl4vAfvaRciWRQ_kYDGdTSieNzKu02e-ay3Bf0f09iFBiKx87Mi4v5Ac-3pRW7Wg9TC3CV3if-JbaqwwAHr8rKSQGZZ6UCNkPDb8oXOHGdJIfuQOW9Q1HUaEdDVvqS0zVFpnNSa9s3AabRmY_i-_4dy-pGF9D-WxV8 Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 4f6eabd2343c481b8f7e5b4d7e61f2f6 Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-374511618 Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4f6eabd2343c481b8f7e5b4d7e61f2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f6eabd2343c481b8f7e5b4d7e61f2f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4f6eabd2343c481b8f7e5b4d7e61f2f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f6eabd2343c481b8f7e5b4d7e61f2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-374511618 Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 4f6eabd2343c481b8f7e5b4d7e61f2f6 Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-374511618 Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerAddressesNegativeTestJSON-374511618-project Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: b609af624e4b4aeeb9bfde36b890b491 Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-374511618-project Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance d6f5f214-5b73-40e7-a0d0-1518cff74397 could not be found. Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'd6f5f214-5b73-40e7-a0d0-1518cff74397'} Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6f5f214-5b73-40e7-a0d0-1518cff74397 could not be found. Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6f5f214-5b73-40e7-a0d0-1518cff74397 could not be found. Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:42.731755 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:42.744921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:42.744921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:42.744921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:42.744921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:42.744921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:40:42.744921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:40:42.744921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6f5f214-5b73-40e7-a0d0-1518cff74397 could not be found. Jul 19 22:40:42.744921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:42.744921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ca4b2b14-52b1-486e-9dda-b5297432ee08 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] Returning 404 to user: Instance d6f5f214-5b73-40e7-a0d0-1518cff74397 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:42.744921 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ca4b2b14-52b1-486e-9dda-b5297432ee08 tempest-ServerAddressesNegativeTestJSON-374511618 tempest-ServerAddressesNegativeTestJSON-374511618-project] 10.222.0.25 "GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397" status: 404 len: 111 microversion: 2.1 time: 0.078207 Jul 19 22:40:42.744921 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1505/2977] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:42 2022] GET /compute/v2.1/servers/d6f5f214-5b73-40e7-a0d0-1518cff74397 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:40:42.748565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-afe4e514-17e2-4a50-9779-1148d9a002b2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: f02e1a17-fe38-4d7f-b55b-aaed61eb7006] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:42.749001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-05e67e72-ae93-4fcf-841d-2222fe3e73b8 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:42.752226 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-05e67e72-ae93-4fcf-841d-2222fe3e73b8 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: fb624b16-6d57-4542-bae7-36cd5b28be74] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:42.757117 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-afe4e514-17e2-4a50-9779-1148d9a002b2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:42.757898 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-afe4e514-17e2-4a50-9779-1148d9a002b2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:42.762227 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-afe4e514-17e2-4a50-9779-1148d9a002b2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:42.763298 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-afe4e514-17e2-4a50-9779-1148d9a002b2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:42.771417 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-05e67e72-ae93-4fcf-841d-2222fe3e73b8 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:42.773096 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-05e67e72-ae93-4fcf-841d-2222fe3e73b8 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:42.778619 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-05e67e72-ae93-4fcf-841d-2222fe3e73b8 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:42.779994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-05e67e72-ae93-4fcf-841d-2222fe3e73b8 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:43.180231 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-afe4e514-17e2-4a50-9779-1148d9a002b2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:43.194977 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-05e67e72-ae93-4fcf-841d-2222fe3e73b8 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6994ad3a701847d49163a7b709fba400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24647fdcb5d7402ebfdca8ea2ae72e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:43.195409 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-afe4e514-17e2-4a50-9779-1148d9a002b2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006" status: 200 len: 1514 microversion: 2.1 time: 0.475618 Jul 19 22:40:43.196668 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1473/2978] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:42 2022] GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006 => generated 1514 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:43.203909 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-05e67e72-ae93-4fcf-841d-2222fe3e73b8 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74" status: 200 len: 1316 microversion: 2.1 time: 0.466720 Jul 19 22:40:43.213689 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1506/2979] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:42 2022] GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74 => generated 1316 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:43.219461 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-fc6b5898-ff44-4eed-82f8-385b92df0cb4 req-12f9d877-b34e-492c-b31d-987545137134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb624b16-6d57-4542-bae7-36cd5b28be74", "name": "network-vif-plugged", "status": "completed", "tag": "553d18df-50d7-4a4c-b5b8-69147cc944ac"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:43.221060 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d749b006-c154-4dec-8368-5c02c9dfbc81 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:43.222312 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d749b006-c154-4dec-8368-5c02c9dfbc81 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:43.229021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-fc6b5898-ff44-4eed-82f8-385b92df0cb4 req-12f9d877-b34e-492c-b31d-987545137134 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:43.230086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-fc6b5898-ff44-4eed-82f8-385b92df0cb4 req-12f9d877-b34e-492c-b31d-987545137134 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:43.234345 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d749b006-c154-4dec-8368-5c02c9dfbc81 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:43.235300 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d749b006-c154-4dec-8368-5c02c9dfbc81 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:43.236695 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d749b006-c154-4dec-8368-5c02c9dfbc81 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:43.237526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d749b006-c154-4dec-8368-5c02c9dfbc81 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:43.244445 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-fc6b5898-ff44-4eed-82f8-385b92df0cb4 req-12f9d877-b34e-492c-b31d-987545137134 service nova] Creating event network-vif-plugged:553d18df-50d7-4a4c-b5b8-69147cc944ac for instance fb624b16-6d57-4542-bae7-36cd5b28be74 on n-h2-847009-3 Jul 19 22:40:43.252280 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-fc6b5898-ff44-4eed-82f8-385b92df0cb4 req-12f9d877-b34e-492c-b31d-987545137134 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036008 Jul 19 22:40:43.253868 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1507/2980] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:43.263764 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-04eec3ec-bb53-48d8-adb2-35e1072f7220 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] Action: 'create', calling method: .version_select at 0x7f7a03a154c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1307072154", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6m6N88ZGXAu+w5Nb8SU8IzvFOQ+EM/LNgxG7RLwsvfNxGfBWEqKGKjPal2c4sKtWVscqfjx1HJQUlnw8FOZdojz9jTtELoZmGUvQ3fcdPv5TTSmpwQLD3DLkoJqQMClA=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:43.268601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:43.306560 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-04eec3ec-bb53-48d8-adb2-35e1072f7220 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] Getting quotas for project b4ff7261f1494b7180a52edfea60b759. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:40:43.314970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-04eec3ec-bb53-48d8-adb2-35e1072f7220 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] Getting quotas for user 43ce93fff9c6477687f723eda6ed65db and project b4ff7261f1494b7180a52edfea60b759. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:40:43.345963 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-04eec3ec-bb53-48d8-adb2-35e1072f7220 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.090258 Jul 19 22:40:43.346969 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1508/2981] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:40:43 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:43.351898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f0992316-fa3c-4e25-8ed2-7cb6879f1fd1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:43.352878 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f0992316-fa3c-4e25-8ed2-7cb6879f1fd1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: e0ada988-0937-4623-a7a6-b7bc4a69f517] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:43.362299 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f0992316-fa3c-4e25-8ed2-7cb6879f1fd1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:43.362962 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f0992316-fa3c-4e25-8ed2-7cb6879f1fd1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:43.364014 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f0992316-fa3c-4e25-8ed2-7cb6879f1fd1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:43.364676 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f0992316-fa3c-4e25-8ed2-7cb6879f1fd1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:43.966678 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d749b006-c154-4dec-8368-5c02c9dfbc81 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:43.974406 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d749b006-c154-4dec-8368-5c02c9dfbc81 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.765376 Jul 19 22:40:43.974999 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1474/2982] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:43 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:43.990879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-97303322-54bb-45cb-bba5-6050ca989d2d tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] Action: 'create', calling method: .version_select at 0x7f7a10b7af70>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1980582222", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFLQd8qsYHJcgS3RFHN6tiIGQya22d1Gx+zJap79LpO12zKc8fWx9m6DKwrgfUBSiMwF+Gg9yqVtLb9qA6yrkhqwFIB/zI0cxlvjwfVOrSxXJPh3kXKyBlpQ6Uqubp/6A=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:44.015599 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f0992316-fa3c-4e25-8ed2-7cb6879f1fd1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:44.026289 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f0992316-fa3c-4e25-8ed2-7cb6879f1fd1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517" status: 200 len: 1314 microversion: 2.1 time: 0.678433 Jul 19 22:40:44.027456 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1509/2983] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:43 2022] GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517 => generated 1314 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:44.044562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-012b754a-0e92-49c1-8854-98bd42c1628c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:44.045434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-012b754a-0e92-49c1-8854-98bd42c1628c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 976f2ec1-c70b-4795-a71d-251bed15ad25] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:44.052441 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-012b754a-0e92-49c1-8854-98bd42c1628c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:44.053366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-012b754a-0e92-49c1-8854-98bd42c1628c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:44.054542 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-012b754a-0e92-49c1-8854-98bd42c1628c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:44.055192 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-012b754a-0e92-49c1-8854-98bd42c1628c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:44.060123 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-97303322-54bb-45cb-bba5-6050ca989d2d tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] Getting quotas for project b4ff7261f1494b7180a52edfea60b759. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:40:44.071732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-97303322-54bb-45cb-bba5-6050ca989d2d tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] Getting quotas for user 43ce93fff9c6477687f723eda6ed65db and project b4ff7261f1494b7180a52edfea60b759. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:40:44.112022 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-97303322-54bb-45cb-bba5-6050ca989d2d tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.128705 Jul 19 22:40:44.116388 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1475/2984] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:40:43 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:44.122703 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6a594259-520f-4f7b-b5dc-30e9d696a428 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:44.123976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6a594259-520f-4f7b-b5dc-30e9d696a428 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:44.130724 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6a594259-520f-4f7b-b5dc-30e9d696a428 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:44.131217 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6a594259-520f-4f7b-b5dc-30e9d696a428 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:44.132314 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6a594259-520f-4f7b-b5dc-30e9d696a428 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:44.133049 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6a594259-520f-4f7b-b5dc-30e9d696a428 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:44.177979 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:44.240828 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6a594259-520f-4f7b-b5dc-30e9d696a428 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action" status: 202 len: 0 microversion: 2.1 time: 0.122836 Jul 19 22:40:44.241872 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1476/2985] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:40:44 2022] POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:40:44.248804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2a93db9b-ff41-4692-9dc5-5e7fd6897971 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] Action: 'create', calling method: .version_select at 0x7f7a105509d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1030117627", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLldsreJE1SPiKmSW/hKHmNp8YoShQGwvYdtrQdkSdk1AGZDv3H16rEyxaXMJArGe0EIrmHAYubRZsrFhL3jHJaGwcfpYyKUIUIDwf1nO/6wmIpMNL5mTZQVnKUbGLcDEw=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:44.271675 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-2a93db9b-ff41-4692-9dc5-5e7fd6897971 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] Getting quotas for project b4ff7261f1494b7180a52edfea60b759. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:40:44.275740 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-012b754a-0e92-49c1-8854-98bd42c1628c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:44.286587 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-2a93db9b-ff41-4692-9dc5-5e7fd6897971 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] Getting quotas for user 43ce93fff9c6477687f723eda6ed65db and project b4ff7261f1494b7180a52edfea60b759. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:40:44.287955 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-012b754a-0e92-49c1-8854-98bd42c1628c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25" status: 200 len: 1520 microversion: 2.1 time: 0.258792 Jul 19 22:40:44.288556 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1510/2986] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:44 2022] GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25 => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:44.301641 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ed1fd90d-2893-4519-8272-42b01d1f9cde tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:44.302544 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ed1fd90d-2893-4519-8272-42b01d1f9cde tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: fb624b16-6d57-4542-bae7-36cd5b28be74] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:44.326293 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ed1fd90d-2893-4519-8272-42b01d1f9cde tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:44.327013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ed1fd90d-2893-4519-8272-42b01d1f9cde tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:44.327588 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ed1fd90d-2893-4519-8272-42b01d1f9cde tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:44.328043 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ed1fd90d-2893-4519-8272-42b01d1f9cde tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:44.351849 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2a93db9b-ff41-4692-9dc5-5e7fd6897971 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.108399 Jul 19 22:40:44.357594 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1477/2987] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:40:44 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:44.360787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-01ab1847-683b-4c82-af94-8d069f4ea1fc tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:44.361857 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-01ab1847-683b-4c82-af94-8d069f4ea1fc tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: f02e1a17-fe38-4d7f-b55b-aaed61eb7006] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:44.368957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01ab1847-683b-4c82-af94-8d069f4ea1fc tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:44.369407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01ab1847-683b-4c82-af94-8d069f4ea1fc tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:44.370463 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01ab1847-683b-4c82-af94-8d069f4ea1fc tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:44.371155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01ab1847-683b-4c82-af94-8d069f4ea1fc tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:44.815288 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-01ab1847-683b-4c82-af94-8d069f4ea1fc tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22a4202c81a43de895f85ffe1ce00cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dced22c1fb648bea264ba11fa53884f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:44.818057 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ed1fd90d-2893-4519-8272-42b01d1f9cde tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6994ad3a701847d49163a7b709fba400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24647fdcb5d7402ebfdca8ea2ae72e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:44.833381 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ed1fd90d-2893-4519-8272-42b01d1f9cde tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74" status: 200 len: 1316 microversion: 2.1 time: 0.542011 Jul 19 22:40:44.836770 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-01ab1847-683b-4c82-af94-8d069f4ea1fc tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006" status: 200 len: 1514 microversion: 2.1 time: 0.482629 Jul 19 22:40:44.847176 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1511/2988] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:44 2022] GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74 => generated 1316 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:44.860314 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e2b99b62-e95c-4038-b37e-22ac9400f80a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:44.864595 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e2b99b62-e95c-4038-b37e-22ac9400f80a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:44.867362 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1478/2989] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:44 2022] GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006 => generated 1514 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:44.873318 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0a72355d-88b7-42e7-b2ea-24c29ae5df7f tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] Calling method '.version_select at 0x7f7a1083faf0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:44.876820 n-d-847009-3 devstack@n-api.service[119337]: WARNING oslo_db.sqlalchemy.utils [None req-0a72355d-88b7-42e7-b2ea-24c29ae5df7f tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 19 22:40:44.888814 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0a72355d-88b7-42e7-b2ea-24c29ae5df7f tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.020147 Jul 19 22:40:44.889684 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1479/2990] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:40:44 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:44.892549 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2b99b62-e95c-4038-b37e-22ac9400f80a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:44.893588 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2b99b62-e95c-4038-b37e-22ac9400f80a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:44.895303 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2b99b62-e95c-4038-b37e-22ac9400f80a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:44.896421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2b99b62-e95c-4038-b37e-22ac9400f80a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:44.903939 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-69d9de9e-a703-4833-96a2-727bd402fc89 req-b9ba4c61-be42-4523-90b3-ed9023bc1082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0ada988-0937-4623-a7a6-b7bc4a69f517", "tag": "60cde104-fb4e-4266-87dc-e6875242dfb1"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:44.922582 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-69d9de9e-a703-4833-96a2-727bd402fc89 req-b9ba4c61-be42-4523-90b3-ed9023bc1082 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:44.924955 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-69d9de9e-a703-4833-96a2-727bd402fc89 req-b9ba4c61-be42-4523-90b3-ed9023bc1082 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:44.946609 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-69d9de9e-a703-4833-96a2-727bd402fc89 req-b9ba4c61-be42-4523-90b3-ed9023bc1082 service nova] Creating event network-changed:60cde104-fb4e-4266-87dc-e6875242dfb1 for instance e0ada988-0937-4623-a7a6-b7bc4a69f517 on n-h1-847009-3 Jul 19 22:40:44.976330 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-69d9de9e-a703-4833-96a2-727bd402fc89 req-b9ba4c61-be42-4523-90b3-ed9023bc1082 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082677 Jul 19 22:40:44.984110 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1480/2991] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:45.142541 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-6ee4995c-4b0e-4054-88df-7925d74b2c03 req-532a4616-653d-484c-a9de-555a601e2a93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f02e1a17-fe38-4d7f-b55b-aaed61eb7006", "name": "network-vif-deleted", "tag": "050e78eb-b37a-4f0b-b2c4-5541e704e627"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:45.153242 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-6ee4995c-4b0e-4054-88df-7925d74b2c03 req-532a4616-653d-484c-a9de-555a601e2a93 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:45.153693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-6ee4995c-4b0e-4054-88df-7925d74b2c03 req-532a4616-653d-484c-a9de-555a601e2a93 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:45.174637 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-6ee4995c-4b0e-4054-88df-7925d74b2c03 req-532a4616-653d-484c-a9de-555a601e2a93 service nova] Creating event network-vif-deleted:050e78eb-b37a-4f0b-b2c4-5541e704e627 for instance f02e1a17-fe38-4d7f-b55b-aaed61eb7006 on n-h2-847009-3 Jul 19 22:40:45.186178 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-6ee4995c-4b0e-4054-88df-7925d74b2c03 req-532a4616-653d-484c-a9de-555a601e2a93 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200289 Jul 19 22:40:45.186722 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1481/2992] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:45.196924 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-acc75f45-7b36-45d1-be0c-3c3c1dfe3650 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] Calling method '.version_select at 0x7f7a10930160>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:45.237254 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-acc75f45-7b36-45d1-be0c-3c3c1dfe3650 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1030117627" status: 202 len: 0 microversion: 2.1 time: 0.048939 Jul 19 22:40:45.238082 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1482/2993] 10.222.0.25 () {58 vars in 1277 bytes} [Tue Jul 19 22:40:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1030117627 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:40:45.243260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-21f13dcc-d6c0-4fd2-98be-980a286a5dd7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:45.244806 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-21f13dcc-d6c0-4fd2-98be-980a286a5dd7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: e0ada988-0937-4623-a7a6-b7bc4a69f517] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:45.251549 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-21f13dcc-d6c0-4fd2-98be-980a286a5dd7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:45.252228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-21f13dcc-d6c0-4fd2-98be-980a286a5dd7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:45.253192 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-21f13dcc-d6c0-4fd2-98be-980a286a5dd7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:45.253693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-21f13dcc-d6c0-4fd2-98be-980a286a5dd7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:45.442235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e2b99b62-e95c-4038-b37e-22ac9400f80a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:45.456436 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e2b99b62-e95c-4038-b37e-22ac9400f80a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1670 microversion: 2.1 time: 0.606554 Jul 19 22:40:45.458032 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1512/2994] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:44 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1670 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:45.465055 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c915e45a-ff19-4d0f-a6c8-fccd8128d8a9 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] Calling method '.version_select at 0x7f7a03fe5ee0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:45.508462 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c915e45a-ff19-4d0f-a6c8-fccd8128d8a9 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1980582222" status: 202 len: 0 microversion: 2.1 time: 0.048925 Jul 19 22:40:45.509379 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1513/2995] 10.222.0.25 () {58 vars in 1277 bytes} [Tue Jul 19 22:40:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1980582222 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:40:45.515458 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-50cba9ab-f05f-495f-a770-8dba5f9ee258 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:45.516168 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-50cba9ab-f05f-495f-a770-8dba5f9ee258 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 976f2ec1-c70b-4795-a71d-251bed15ad25] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:45.533040 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50cba9ab-f05f-495f-a770-8dba5f9ee258 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:45.533512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50cba9ab-f05f-495f-a770-8dba5f9ee258 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:45.534312 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50cba9ab-f05f-495f-a770-8dba5f9ee258 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:45.534755 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50cba9ab-f05f-495f-a770-8dba5f9ee258 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:45.539645 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:45.640052 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-21f13dcc-d6c0-4fd2-98be-980a286a5dd7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:45.657388 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-21f13dcc-d6c0-4fd2-98be-980a286a5dd7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517" status: 200 len: 1314 microversion: 2.1 time: 0.417984 Jul 19 22:40:45.677170 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1483/2996] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:45 2022] GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:45.683403 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e492d025-ec58-4778-9144-9fe0b1fa9ad1 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] Calling method '.version_select at 0x7f7a108a5af0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:45.719645 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e492d025-ec58-4778-9144-9fe0b1fa9ad1 tempest-KeyPairsV2TestJSON-42307252 tempest-KeyPairsV2TestJSON-42307252-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1307072154" status: 202 len: 0 microversion: 2.1 time: 0.040826 Jul 19 22:40:45.720903 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1484/2997] 10.222.0.25 () {58 vars in 1277 bytes} [Tue Jul 19 22:40:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1307072154 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:40:45.855759 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2d3e77a5-6636-47d9-8891-854b484b2ac2 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:45.856767 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2d3e77a5-6636-47d9-8891-854b484b2ac2 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: fb624b16-6d57-4542-bae7-36cd5b28be74] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:45.868833 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2d3e77a5-6636-47d9-8891-854b484b2ac2 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:45.870094 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2d3e77a5-6636-47d9-8891-854b484b2ac2 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:45.872248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2d3e77a5-6636-47d9-8891-854b484b2ac2 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:45.875488 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2d3e77a5-6636-47d9-8891-854b484b2ac2 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:46.230435 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-50cba9ab-f05f-495f-a770-8dba5f9ee258 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:46.246196 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-50cba9ab-f05f-495f-a770-8dba5f9ee258 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25" status: 200 len: 1520 microversion: 2.1 time: 0.734600 Jul 19 22:40:46.257062 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1514/2998] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:45 2022] GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25 => generated 1520 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:46.263597 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-be604f7a-38ec-4c8a-a87d-2343e84e198f tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:46.265912 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-be604f7a-38ec-4c8a-a87d-2343e84e198f tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: f02e1a17-fe38-4d7f-b55b-aaed61eb7006] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:46.273116 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be604f7a-38ec-4c8a-a87d-2343e84e198f tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:46.273893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be604f7a-38ec-4c8a-a87d-2343e84e198f tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:46.274881 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be604f7a-38ec-4c8a-a87d-2343e84e198f tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:46.275591 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be604f7a-38ec-4c8a-a87d-2343e84e198f tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:46.294946 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-be604f7a-38ec-4c8a-a87d-2343e84e198f tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] HTTP exception thrown: Instance f02e1a17-fe38-4d7f-b55b-aaed61eb7006 could not be found. Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-be604f7a-38ec-4c8a-a87d-2343e84e198f tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Request method failure captured: Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006 HTTP/1.1 Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zIZHpgsHVyOrZtfsyULJBn3THhXvvOW6fBaQQQSyfxVDiKbvvSFrpF-3RRfytJTnVSsQaIhVhfsFz00HGNQF7deLyZ8RkblR30eUtznU-1L6EQXCtW4ADLx5MrsI_sHWJiod4lAzySPbdU_uLBnijjIsozTETvAJaDGnn0CSS39jac Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 6dced22c1fb648bea264ba11fa53884f Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1371201862 Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6dced22c1fb648bea264ba11fa53884f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6dced22c1fb648bea264ba11fa53884f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6dced22c1fb648bea264ba11fa53884f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6dced22c1fb648bea264ba11fa53884f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerDiskConfigTestJSON-1371201862 Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 6dced22c1fb648bea264ba11fa53884f Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1371201862 Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerDiskConfigTestJSON-1371201862-project Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: b22a4202c81a43de895f85ffe1ce00cb Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerDiskConfigTestJSON-1371201862-project Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance f02e1a17-fe38-4d7f-b55b-aaed61eb7006 could not be found. Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'f02e1a17-fe38-4d7f-b55b-aaed61eb7006'} Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f02e1a17-fe38-4d7f-b55b-aaed61eb7006 could not be found. Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f02e1a17-fe38-4d7f-b55b-aaed61eb7006 could not be found. Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:46.297330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:46.302053 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:46.302053 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:46.302053 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:46.302053 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:40:46.302053 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:40:46.302053 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f02e1a17-fe38-4d7f-b55b-aaed61eb7006 could not be found. Jul 19 22:40:46.302053 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:46.302053 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-be604f7a-38ec-4c8a-a87d-2343e84e198f tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Returning 404 to user: Instance f02e1a17-fe38-4d7f-b55b-aaed61eb7006 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:46.302053 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-be604f7a-38ec-4c8a-a87d-2343e84e198f tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006" status: 404 len: 111 microversion: 2.1 time: 0.042177 Jul 19 22:40:46.303100 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1515/2999] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:46 2022] GET /compute/v2.1/servers/f02e1a17-fe38-4d7f-b55b-aaed61eb7006 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:40:46.312658 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-001f31f5-f7df-4cf8-8535-95acfe3404d2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:46.313525 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-001f31f5-f7df-4cf8-8535-95acfe3404d2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:46.320614 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-001f31f5-f7df-4cf8-8535-95acfe3404d2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:46.321290 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-001f31f5-f7df-4cf8-8535-95acfe3404d2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:46.322260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-001f31f5-f7df-4cf8-8535-95acfe3404d2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:46.322985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-001f31f5-f7df-4cf8-8535-95acfe3404d2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:46.334554 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2d3e77a5-6636-47d9-8891-854b484b2ac2 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6994ad3a701847d49163a7b709fba400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24647fdcb5d7402ebfdca8ea2ae72e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:46.344066 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2d3e77a5-6636-47d9-8891-854b484b2ac2 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74" status: 200 len: 1505 microversion: 2.1 time: 0.495048 Jul 19 22:40:46.345322 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1485/3000] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:45 2022] GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74 => generated 1505 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:40:46.346520 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-001f31f5-f7df-4cf8-8535-95acfe3404d2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] HTTP exception thrown: Instance a7c28d6e-5bfc-4b93-ab76-85ab7d401744 could not be found. Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-001f31f5-f7df-4cf8-8535-95acfe3404d2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Request method failure captured: Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 HTTP/1.1 Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zIZHpgsHVyOrZtfsyULJBn3THhXvvOW6fBaQQQSyfxVDiKbvvSFrpF-3RRfytJTnVSsQaIhVhfsFz00HGNQF7deLyZ8RkblR30eUtznU-1L6EQXCtW4ADLx5MrsI_sHWJiod4lAzySPbdU_uLBnijjIsozTETvAJaDGnn0CSS39jac Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 6dced22c1fb648bea264ba11fa53884f Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1371201862 Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6dced22c1fb648bea264ba11fa53884f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6dced22c1fb648bea264ba11fa53884f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6dced22c1fb648bea264ba11fa53884f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6dced22c1fb648bea264ba11fa53884f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerDiskConfigTestJSON-1371201862 Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 6dced22c1fb648bea264ba11fa53884f Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1371201862 Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerDiskConfigTestJSON-1371201862-project Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: b22a4202c81a43de895f85ffe1ce00cb Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerDiskConfigTestJSON-1371201862-project Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance a7c28d6e-5bfc-4b93-ab76-85ab7d401744 could not be found. Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'a7c28d6e-5bfc-4b93-ab76-85ab7d401744'} Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7c28d6e-5bfc-4b93-ab76-85ab7d401744 could not be found. Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:40:46.348468 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:40:46.353000 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7c28d6e-5bfc-4b93-ab76-85ab7d401744 could not be found. Jul 19 22:40:46.353000 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:46.353000 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:46.353000 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:46.353000 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:46.353000 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:46.353000 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:46.353000 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:40:46.353000 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:40:46.353000 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7c28d6e-5bfc-4b93-ab76-85ab7d401744 could not be found. Jul 19 22:40:46.353000 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:46.355327 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-001f31f5-f7df-4cf8-8535-95acfe3404d2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Returning 404 to user: Instance a7c28d6e-5bfc-4b93-ab76-85ab7d401744 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:46.356622 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-001f31f5-f7df-4cf8-8535-95acfe3404d2 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 404 len: 111 microversion: 2.1 time: 0.047758 Jul 19 22:40:46.358123 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1516/3001] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:40:46 2022] DELETE /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:40:46.364786 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bc8c7e3a-462a-4240-ab26-770c420aaaaa tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1340784246"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:46.365344 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bc8c7e3a-462a-4240-ab26-770c420aaaaa tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: fb624b16-6d57-4542-bae7-36cd5b28be74] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:46.372372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-165f74bf-b1db-4ef9-b53e-8364adf79338 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:46.373241 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-165f74bf-b1db-4ef9-b53e-8364adf79338 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: a7c28d6e-5bfc-4b93-ab76-85ab7d401744] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:46.378720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc8c7e3a-462a-4240-ab26-770c420aaaaa tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:46.379354 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc8c7e3a-462a-4240-ab26-770c420aaaaa tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:46.380316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc8c7e3a-462a-4240-ab26-770c420aaaaa tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:46.380609 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-165f74bf-b1db-4ef9-b53e-8364adf79338 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:46.380983 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc8c7e3a-462a-4240-ab26-770c420aaaaa tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:46.381397 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-165f74bf-b1db-4ef9-b53e-8364adf79338 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:46.382348 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-165f74bf-b1db-4ef9-b53e-8364adf79338 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:46.382974 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-165f74bf-b1db-4ef9-b53e-8364adf79338 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:46.400544 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-165f74bf-b1db-4ef9-b53e-8364adf79338 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] HTTP exception thrown: Instance a7c28d6e-5bfc-4b93-ab76-85ab7d401744 could not be found. Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-165f74bf-b1db-4ef9-b53e-8364adf79338 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Request method failure captured: Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 HTTP/1.1 Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zIZHpgsHVyOrZtfsyULJBn3THhXvvOW6fBaQQQSyfxVDiKbvvSFrpF-3RRfytJTnVSsQaIhVhfsFz00HGNQF7deLyZ8RkblR30eUtznU-1L6EQXCtW4ADLx5MrsI_sHWJiod4lAzySPbdU_uLBnijjIsozTETvAJaDGnn0CSS39jac Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 6dced22c1fb648bea264ba11fa53884f Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1371201862 Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6dced22c1fb648bea264ba11fa53884f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6dced22c1fb648bea264ba11fa53884f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6dced22c1fb648bea264ba11fa53884f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6dced22c1fb648bea264ba11fa53884f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerDiskConfigTestJSON-1371201862 Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 6dced22c1fb648bea264ba11fa53884f Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1371201862 Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerDiskConfigTestJSON-1371201862-project Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: b22a4202c81a43de895f85ffe1ce00cb Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerDiskConfigTestJSON-1371201862-project Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance a7c28d6e-5bfc-4b93-ab76-85ab7d401744 could not be found. Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'a7c28d6e-5bfc-4b93-ab76-85ab7d401744'} Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7c28d6e-5bfc-4b93-ab76-85ab7d401744 could not be found. Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7c28d6e-5bfc-4b93-ab76-85ab7d401744 could not be found. Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:46.403961 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:46.408264 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:46.408264 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:46.408264 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:46.408264 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:40:46.408264 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:40:46.408264 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7c28d6e-5bfc-4b93-ab76-85ab7d401744 could not be found. Jul 19 22:40:46.408264 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:46.410933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-165f74bf-b1db-4ef9-b53e-8364adf79338 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Returning 404 to user: Instance a7c28d6e-5bfc-4b93-ab76-85ab7d401744 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:46.412090 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-165f74bf-b1db-4ef9-b53e-8364adf79338 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744" status: 404 len: 111 microversion: 2.1 time: 0.050162 Jul 19 22:40:46.413258 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1517/3002] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:46 2022] GET /compute/v2.1/servers/a7c28d6e-5bfc-4b93-ab76-85ab7d401744 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:40:46.423190 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2c973539-7f39-450d-9207-0db213c74d2f tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:46.424060 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2c973539-7f39-450d-9207-0db213c74d2f tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:46.430854 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c973539-7f39-450d-9207-0db213c74d2f tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:46.431636 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c973539-7f39-450d-9207-0db213c74d2f tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:46.432686 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c973539-7f39-450d-9207-0db213c74d2f tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:46.433133 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c973539-7f39-450d-9207-0db213c74d2f tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:46.450877 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-2c973539-7f39-450d-9207-0db213c74d2f tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] HTTP exception thrown: Instance 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a could not be found. Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2c973539-7f39-450d-9207-0db213c74d2f tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Request method failure captured: Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a HTTP/1.1 Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zIZHpgsHVyOrZtfsyULJBn3THhXvvOW6fBaQQQSyfxVDiKbvvSFrpF-3RRfytJTnVSsQaIhVhfsFz00HGNQF7deLyZ8RkblR30eUtznU-1L6EQXCtW4ADLx5MrsI_sHWJiod4lAzySPbdU_uLBnijjIsozTETvAJaDGnn0CSS39jac Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 6dced22c1fb648bea264ba11fa53884f Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1371201862 Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6dced22c1fb648bea264ba11fa53884f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6dced22c1fb648bea264ba11fa53884f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6dced22c1fb648bea264ba11fa53884f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6dced22c1fb648bea264ba11fa53884f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerDiskConfigTestJSON-1371201862 Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 6dced22c1fb648bea264ba11fa53884f Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1371201862 Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerDiskConfigTestJSON-1371201862-project Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: b22a4202c81a43de895f85ffe1ce00cb Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerDiskConfigTestJSON-1371201862-project Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a could not be found. Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '1f0e6a34-7136-4af6-b710-1b4c0ef0c97a'} Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a could not be found. Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:40:46.453787 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:40:46.457557 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a could not be found. Jul 19 22:40:46.457557 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:46.457557 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:46.457557 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:46.457557 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:46.457557 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:46.457557 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:46.457557 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:40:46.457557 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:40:46.457557 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a could not be found. Jul 19 22:40:46.457557 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:46.457557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2c973539-7f39-450d-9207-0db213c74d2f tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Returning 404 to user: Instance 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:46.457557 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2c973539-7f39-450d-9207-0db213c74d2f tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 404 len: 111 microversion: 2.1 time: 0.038395 Jul 19 22:40:46.461899 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1518/3003] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:40:46 2022] DELETE /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:40:46.471385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f9e284d3-b6fa-4b02-a807-37c56d6aaaf0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:46.472074 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f9e284d3-b6fa-4b02-a807-37c56d6aaaf0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] [instance: 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:46.484948 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9e284d3-b6fa-4b02-a807-37c56d6aaaf0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:46.485633 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9e284d3-b6fa-4b02-a807-37c56d6aaaf0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:46.486558 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9e284d3-b6fa-4b02-a807-37c56d6aaaf0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:46.487563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9e284d3-b6fa-4b02-a807-37c56d6aaaf0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:46.507628 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-f9e284d3-b6fa-4b02-a807-37c56d6aaaf0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] HTTP exception thrown: Instance 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a could not be found. Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f9e284d3-b6fa-4b02-a807-37c56d6aaaf0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Request method failure captured: Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a HTTP/1.1 Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zIZHpgsHVyOrZtfsyULJBn3THhXvvOW6fBaQQQSyfxVDiKbvvSFrpF-3RRfytJTnVSsQaIhVhfsFz00HGNQF7deLyZ8RkblR30eUtznU-1L6EQXCtW4ADLx5MrsI_sHWJiod4lAzySPbdU_uLBnijjIsozTETvAJaDGnn0CSS39jac Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 6dced22c1fb648bea264ba11fa53884f Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1371201862 Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6dced22c1fb648bea264ba11fa53884f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6dced22c1fb648bea264ba11fa53884f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6dced22c1fb648bea264ba11fa53884f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6dced22c1fb648bea264ba11fa53884f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerDiskConfigTestJSON-1371201862 Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 6dced22c1fb648bea264ba11fa53884f Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1371201862 Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerDiskConfigTestJSON-1371201862-project Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: b22a4202c81a43de895f85ffe1ce00cb Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerDiskConfigTestJSON-1371201862-project Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a could not be found. Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '1f0e6a34-7136-4af6-b710-1b4c0ef0c97a'} Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a could not be found. Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a could not be found. Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:46.510262 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:46.517064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:46.517064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:46.517064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:46.517064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:40:46.517064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:40:46.517064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a could not be found. Jul 19 22:40:46.517064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:46.517064 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f9e284d3-b6fa-4b02-a807-37c56d6aaaf0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] Returning 404 to user: Instance 1f0e6a34-7136-4af6-b710-1b4c0ef0c97a could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:46.517064 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f9e284d3-b6fa-4b02-a807-37c56d6aaaf0 tempest-ServerDiskConfigTestJSON-1371201862 tempest-ServerDiskConfigTestJSON-1371201862-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a" status: 404 len: 111 microversion: 2.1 time: 0.050525 Jul 19 22:40:46.518576 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1519/3004] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:46 2022] GET /compute/v2.1/servers/1f0e6a34-7136-4af6-b710-1b4c0ef0c97a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:40:46.532853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dd7b9c87-3f8b-4fc3-86e6-63aea1507e2c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:46.533982 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dd7b9c87-3f8b-4fc3-86e6-63aea1507e2c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:46.545567 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd7b9c87-3f8b-4fc3-86e6-63aea1507e2c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:46.546031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd7b9c87-3f8b-4fc3-86e6-63aea1507e2c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:46.546891 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd7b9c87-3f8b-4fc3-86e6-63aea1507e2c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:46.547427 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd7b9c87-3f8b-4fc3-86e6-63aea1507e2c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:46.663728 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.network.security_group_api [None req-bc8c7e3a-462a-4240-ab26-770c420aaaaa tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Adding security group 4fc1d879-1d71-4d9a-9e53-d1363be51b64 to port 553d18df-50d7-4a4c-b5b8-69147cc944ac Jul 19 22:40:46.893395 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dd7b9c87-3f8b-4fc3-86e6-63aea1507e2c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:46.908926 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dd7b9c87-3f8b-4fc3-86e6-63aea1507e2c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1670 microversion: 2.1 time: 0.389406 Jul 19 22:40:46.909894 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1520/3005] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:46 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1670 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:46.914748 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a67d4c9e-7f74-4f06-940a-61903e30a881 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:46.915515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a67d4c9e-7f74-4f06-940a-61903e30a881 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: e0ada988-0937-4623-a7a6-b7bc4a69f517] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:46.924244 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a67d4c9e-7f74-4f06-940a-61903e30a881 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:46.924697 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a67d4c9e-7f74-4f06-940a-61903e30a881 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:46.925716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a67d4c9e-7f74-4f06-940a-61903e30a881 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:46.926160 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a67d4c9e-7f74-4f06-940a-61903e30a881 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:47.241891 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a67d4c9e-7f74-4f06-940a-61903e30a881 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:47.259179 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a67d4c9e-7f74-4f06-940a-61903e30a881 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517" status: 200 len: 1314 microversion: 2.1 time: 0.347630 Jul 19 22:40:47.260792 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1521/3006] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:46 2022] GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:47.267488 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7836c0fa-5779-4311-9d24-a0f536d39651 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:47.269235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7836c0fa-5779-4311-9d24-a0f536d39651 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 976f2ec1-c70b-4795-a71d-251bed15ad25] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:47.282469 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7836c0fa-5779-4311-9d24-a0f536d39651 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:47.283698 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7836c0fa-5779-4311-9d24-a0f536d39651 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:47.285259 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7836c0fa-5779-4311-9d24-a0f536d39651 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:47.286270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7836c0fa-5779-4311-9d24-a0f536d39651 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:47.356068 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bc8c7e3a-462a-4240-ab26-770c420aaaaa tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "POST /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74/action" status: 202 len: 0 microversion: 2.1 time: 0.990711 Jul 19 22:40:47.360650 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1486/3007] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:40:46 2022] POST /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74/action => generated 0 bytes in 1000 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:40:47.365815 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-1cc29fa5-344d-4e64-a7f2-9df0f9f5e518 req-5cdfe926-5c20-4679-9a59-2ae48c5724e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb624b16-6d57-4542-bae7-36cd5b28be74", "tag": "553d18df-50d7-4a4c-b5b8-69147cc944ac"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:47.388305 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1cc29fa5-344d-4e64-a7f2-9df0f9f5e518 req-5cdfe926-5c20-4679-9a59-2ae48c5724e6 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:47.388707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1cc29fa5-344d-4e64-a7f2-9df0f9f5e518 req-5cdfe926-5c20-4679-9a59-2ae48c5724e6 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:47.413487 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-1cc29fa5-344d-4e64-a7f2-9df0f9f5e518 req-5cdfe926-5c20-4679-9a59-2ae48c5724e6 service nova] Creating event network-changed:553d18df-50d7-4a4c-b5b8-69147cc944ac for instance fb624b16-6d57-4542-bae7-36cd5b28be74 on n-h2-847009-3 Jul 19 22:40:47.427532 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-1cc29fa5-344d-4e64-a7f2-9df0f9f5e518 req-5cdfe926-5c20-4679-9a59-2ae48c5724e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065624 Jul 19 22:40:47.428156 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1487/3008] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:47.453278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d5df7976-d15c-4d1d-a5fc-e87dbfc6fadc tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-86723233"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:47.462050 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d5df7976-d15c-4d1d-a5fc-e87dbfc6fadc tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: fb624b16-6d57-4542-bae7-36cd5b28be74] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:47.464820 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=5,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:47.494748 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5df7976-d15c-4d1d-a5fc-e87dbfc6fadc tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:47.497331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5df7976-d15c-4d1d-a5fc-e87dbfc6fadc tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:47.498379 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5df7976-d15c-4d1d-a5fc-e87dbfc6fadc tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:47.505313 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5df7976-d15c-4d1d-a5fc-e87dbfc6fadc tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:48.092940 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7836c0fa-5779-4311-9d24-a0f536d39651 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:48.107559 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7836c0fa-5779-4311-9d24-a0f536d39651 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25" status: 200 len: 1520 microversion: 2.1 time: 0.844492 Jul 19 22:40:48.120096 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1522/3009] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:47 2022] GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25 => generated 1520 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:48.132398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-808c8ef4-8c8b-4311-8551-6cadf7a56d4c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:48.133754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-808c8ef4-8c8b-4311-8551-6cadf7a56d4c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:48.144611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-808c8ef4-8c8b-4311-8551-6cadf7a56d4c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:48.145468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-808c8ef4-8c8b-4311-8551-6cadf7a56d4c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:48.147696 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-808c8ef4-8c8b-4311-8551-6cadf7a56d4c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:48.148510 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-808c8ef4-8c8b-4311-8551-6cadf7a56d4c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:48.168660 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.network.security_group_api [None req-d5df7976-d15c-4d1d-a5fc-e87dbfc6fadc tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Adding security group 656eb929-caf9-4e63-87a1-a2c4e336e9c3 to port 553d18df-50d7-4a4c-b5b8-69147cc944ac Jul 19 22:40:49.094482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-808c8ef4-8c8b-4311-8551-6cadf7a56d4c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:49.103695 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-808c8ef4-8c8b-4311-8551-6cadf7a56d4c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.979231 Jul 19 22:40:49.104687 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1523/3010] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:48 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:49.121605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-05d8d0f4-48ee-421a-9598-5f25803988c6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:49.125883 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-05d8d0f4-48ee-421a-9598-5f25803988c6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: e0ada988-0937-4623-a7a6-b7bc4a69f517] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:49.132152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-05d8d0f4-48ee-421a-9598-5f25803988c6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:49.132609 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-05d8d0f4-48ee-421a-9598-5f25803988c6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:49.133402 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-05d8d0f4-48ee-421a-9598-5f25803988c6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:49.133823 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-05d8d0f4-48ee-421a-9598-5f25803988c6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:49.626121 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-05d8d0f4-48ee-421a-9598-5f25803988c6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:49.636329 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-05d8d0f4-48ee-421a-9598-5f25803988c6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517" status: 200 len: 1314 microversion: 2.1 time: 0.529256 Jul 19 22:40:49.637851 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1524/3011] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:49 2022] GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517 => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:49.845869 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d5df7976-d15c-4d1d-a5fc-e87dbfc6fadc tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "POST /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74/action" status: 202 len: 0 microversion: 2.1 time: 2.398537 Jul 19 22:40:49.848400 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1488/3012] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:40:47 2022] POST /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74/action => generated 0 bytes in 2402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:40:49.878893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4ad34de8-3b68-46ab-8f0c-08b0df37c8fb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:49.880327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4ad34de8-3b68-46ab-8f0c-08b0df37c8fb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:49.896339 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ad34de8-3b68-46ab-8f0c-08b0df37c8fb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:49.899720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ad34de8-3b68-46ab-8f0c-08b0df37c8fb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:49.902784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ad34de8-3b68-46ab-8f0c-08b0df37c8fb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:49.903779 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ad34de8-3b68-46ab-8f0c-08b0df37c8fb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:49.997139 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4ad34de8-3b68-46ab-8f0c-08b0df37c8fb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action" status: 200 len: 324 microversion: 2.1 time: 0.139227 Jul 19 22:40:49.998094 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1489/3013] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:40:49 2022] POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action => generated 324 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:50.003826 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f4f0b7ca-0083-4ec3-abbd-8a2c26736860 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:50.005461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f4f0b7ca-0083-4ec3-abbd-8a2c26736860 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 976f2ec1-c70b-4795-a71d-251bed15ad25] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:50.017090 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f4f0b7ca-0083-4ec3-abbd-8a2c26736860 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:50.018086 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f4f0b7ca-0083-4ec3-abbd-8a2c26736860 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:50.019706 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f4f0b7ca-0083-4ec3-abbd-8a2c26736860 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:50.022352 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f4f0b7ca-0083-4ec3-abbd-8a2c26736860 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:50.175448 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3a845be9-b6e7-48be-84a9-0863980c4c75 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Action: 'create', calling method: .version_select at 0x7f7a1012e1f0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+fvlR7TdYqPnPYBo9rd0WJUZvNqefvFnKRr7ksmfqwqoQMr3erH7SoIF9i7W8hJHAoAkQ1xyNWc5jVq/tzKWfo1FSFaS9ZT818CUeQ/EioMUlj2kFr0xX7ZvfMFWUesA=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:50.188516 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-3a845be9-b6e7-48be-84a9-0863980c4c75 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3a845be9-b6e7-48be-84a9-0863980c4c75 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Request method failure captured: Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 257 Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zLwA7M1BEJi0J4SvpxQrmWnF2PdhYDMqKLBq5k7kMr6ZLu1CuvopeDEG8WhsZJnYyuH4bSas7DhTP279njB7nE64xn1sv9I33d4qBA7klnClkGsspZlK9gSXpiqkQ-3G7ojzhKcZ-S4EYH5WiGegpUZkmtGeBYQ-Ud3nVfMxarO_so Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 34f408a7de28426f917d66f776b0ec8c Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1796972728 Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1796972728 Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 34f408a7de28426f917d66f776b0ec8c Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1796972728 Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-KeyPairsNegativeTestJSON-1796972728-project Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: a88e5bd9d54e4452b2979b9c013d3a20 Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1796972728-project Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+fvlR7TdYqPnPYBo9rd0WJUZvNqefvFnKRr7ksmfqwqoQMr3erH7SoIF9i7W8hJHAoAkQ1xyNWc5jVq/tzKWfo1FSFaS9ZT818CUeQ/EioMUlj2kFr0xX7ZvfMFWUesA=="}} Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+fvlR7TdYqPnPYBo9rd0WJUZvNqefvFnKRr7ksmfqwqoQMr3erH7SoIF9i7W8hJHAoAkQ1xyNWc5jVq/tzKWfo1FSFaS9ZT818CUeQ/EioMUlj2kFr0xX7ZvfMFWUesA=='}}} Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:40:50.196087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:40:50.200839 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:50.200839 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:50.200839 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:40:50.200839 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:40:50.200839 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:40:50.200839 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:40:50.200839 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 19 22:40:50.200839 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 19 22:40:50.200839 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 19 22:40:50.200839 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 19 22:40:50.200839 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 19 22:40:50.200839 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:50.200839 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:50.200839 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:50.200839 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:50.200839 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:50.200839 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:50.200839 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:40:50.200839 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:40:50.200839 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 19 22:40:50.200839 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:50.200839 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3a845be9-b6e7-48be-84a9-0863980c4c75 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:50.200839 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3a845be9-b6e7-48be-84a9-0863980c4c75 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.558574 Jul 19 22:40:50.220482 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1525/3014] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:40:49 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 578 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:40:50.231728 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9cc38bad-efea-45e5-b0ed-f810787eb843 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:50.232509 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9cc38bad-efea-45e5-b0ed-f810787eb843 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: fb624b16-6d57-4542-bae7-36cd5b28be74] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:50.249887 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9cc38bad-efea-45e5-b0ed-f810787eb843 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:50.251098 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9cc38bad-efea-45e5-b0ed-f810787eb843 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:50.252271 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9cc38bad-efea-45e5-b0ed-f810787eb843 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:50.252914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9cc38bad-efea-45e5-b0ed-f810787eb843 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:50.385371 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f4f0b7ca-0083-4ec3-abbd-8a2c26736860 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:50.399895 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f4f0b7ca-0083-4ec3-abbd-8a2c26736860 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25" status: 200 len: 1520 microversion: 2.1 time: 0.395237 Jul 19 22:40:50.401721 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1490/3015] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:49 2022] GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25 => generated 1520 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:50.406764 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-79297b88-d92c-4526-8757-4c9376ccd718 req-871426f6-2200-4f32-9845-11c50b2fe1eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb624b16-6d57-4542-bae7-36cd5b28be74", "tag": "553d18df-50d7-4a4c-b5b8-69147cc944ac"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:50.415998 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-79297b88-d92c-4526-8757-4c9376ccd718 req-871426f6-2200-4f32-9845-11c50b2fe1eb service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:50.416662 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-79297b88-d92c-4526-8757-4c9376ccd718 req-871426f6-2200-4f32-9845-11c50b2fe1eb service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:50.430050 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-79297b88-d92c-4526-8757-4c9376ccd718 req-871426f6-2200-4f32-9845-11c50b2fe1eb service nova] Creating event network-changed:553d18df-50d7-4a4c-b5b8-69147cc944ac for instance fb624b16-6d57-4542-bae7-36cd5b28be74 on n-h2-847009-3 Jul 19 22:40:50.438141 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-79297b88-d92c-4526-8757-4c9376ccd718 req-871426f6-2200-4f32-9845-11c50b2fe1eb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034292 Jul 19 22:40:50.439476 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1491/3016] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:50.447799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-33141b30-bca0-45fc-bfd0-43cb41faa0a6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:50.448974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-33141b30-bca0-45fc-bfd0-43cb41faa0a6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:50.476175 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-33141b30-bca0-45fc-bfd0-43cb41faa0a6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:50.476785 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-33141b30-bca0-45fc-bfd0-43cb41faa0a6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:50.477612 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-33141b30-bca0-45fc-bfd0-43cb41faa0a6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:50.478061 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-33141b30-bca0-45fc-bfd0-43cb41faa0a6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:50.478976 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=14 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:50.601893 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9cc38bad-efea-45e5-b0ed-f810787eb843 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 0.379772 Jul 19 22:40:50.602861 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1526/3017] 10.222.0.25 () {58 vars in 1292 bytes} [Tue Jul 19 22:40:50 2022] GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74/os-security-groups => generated 1155 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:50.609500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-692f5f19-d74e-42a7-a5e2-cb0e558f1a4f tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Action: 'create', calling method: .version_select at 0x7f7a10230790>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-762394461", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:50.635097 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-692f5f19-d74e-42a7-a5e2-cb0e558f1a4f tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Getting quotas for project 34f408a7de28426f917d66f776b0ec8c. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:40:50.644878 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-692f5f19-d74e-42a7-a5e2-cb0e558f1a4f tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Getting quotas for user a88e5bd9d54e4452b2979b9c013d3a20 and project 34f408a7de28426f917d66f776b0ec8c. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:40:50.668937 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-692f5f19-d74e-42a7-a5e2-cb0e558f1a4f tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-692f5f19-d74e-42a7-a5e2-cb0e558f1a4f tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Request method failure captured: Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 2166 Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zLwA7M1BEJi0J4SvpxQrmWnF2PdhYDMqKLBq5k7kMr6ZLu1CuvopeDEG8WhsZJnYyuH4bSas7DhTP279njB7nE64xn1sv9I33d4qBA7klnClkGsspZlK9gSXpiqkQ-3G7ojzhKcZ-S4EYH5WiGegpUZkmtGeBYQ-Ud3nVfMxarO_so Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 34f408a7de28426f917d66f776b0ec8c Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1796972728 Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1796972728 Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 34f408a7de28426f917d66f776b0ec8c Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1796972728 Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-KeyPairsNegativeTestJSON-1796972728-project Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: a88e5bd9d54e4452b2979b9c013d3a20 Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1796972728-project Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-762394461", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:40:50.677267 n-d-847009-3 devstack@n-api.service[119338]: exception: Keypair data is invalid: failed to generate fingerprint Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-762394461', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:50.679538 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:50.685296 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:40:50.685296 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:40:50.685296 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:40:50.685296 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:40:50.685296 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 19 22:40:50.685296 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 19 22:40:50.685296 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 19 22:40:50.685296 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 19 22:40:50.685296 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 19 22:40:50.685296 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:50.685296 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:50.685296 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:50.685296 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:50.685296 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:50.685296 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:50.685296 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:40:50.685296 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:40:50.685296 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 19 22:40:50.685296 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:50.691674 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-692f5f19-d74e-42a7-a5e2-cb0e558f1a4f tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:50.692786 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-692f5f19-d74e-42a7-a5e2-cb0e558f1a4f tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.088744 Jul 19 22:40:50.693923 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1527/3018] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Jul 19 22:40:50 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 22:40:50.705791 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-32b44f19-1809-4736-a3d0-6b8f41e3016d tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Action: 'create', calling method: .version_select at 0x7f7a1014a430>, body: {"security_group": {"name": " tempest-securitygroup -1530677916 ", "description": "tempest-description-1969214993"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:51.017997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-33141b30-bca0-45fc-bfd0-43cb41faa0a6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:51.025726 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-33141b30-bca0-45fc-bfd0-43cb41faa0a6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.584909 Jul 19 22:40:51.040425 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1492/3019] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:50 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:51.046995 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fdfef041-762a-4f23-8352-4700dd83ea90 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:51.048089 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fdfef041-762a-4f23-8352-4700dd83ea90 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: e0ada988-0937-4623-a7a6-b7bc4a69f517] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:51.060182 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fdfef041-762a-4f23-8352-4700dd83ea90 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:51.061264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fdfef041-762a-4f23-8352-4700dd83ea90 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:51.062801 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fdfef041-762a-4f23-8352-4700dd83ea90 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:51.063716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fdfef041-762a-4f23-8352-4700dd83ea90 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:51.335864 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-32b44f19-1809-4736-a3d0-6b8f41e3016d tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.633333 Jul 19 22:40:51.337240 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1528/3020] 10.222.0.25 () {60 vars in 1179 bytes} [Tue Jul 19 22:40:50 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:51.356381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-381bcd15-247a-4403-a97a-79730f808769 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Action: 'create', calling method: .version_select at 0x7f7a10043c10>, body: {"keypair": {"name": "tempest-keypair-1275991259", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXJYKNtTSETKebXcLBYACC+aqeit2vRpPBp/pBWDZMJFpk5cW+Yxem/5HYtK0Nj8/FYl+mCsYHw3VtJB4n1eY1Lm63bzyflFqd44B0tJS/nxWQLsXSQ5hTulPJGF8JSIw=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:51.402328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fdfef041-762a-4f23-8352-4700dd83ea90 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:51.409699 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-381bcd15-247a-4403-a97a-79730f808769 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Getting quotas for project 34f408a7de28426f917d66f776b0ec8c. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:40:51.416862 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fdfef041-762a-4f23-8352-4700dd83ea90 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517" status: 200 len: 1314 microversion: 2.1 time: 0.374758 Jul 19 22:40:51.428761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-381bcd15-247a-4403-a97a-79730f808769 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Getting quotas for user a88e5bd9d54e4452b2979b9c013d3a20 and project 34f408a7de28426f917d66f776b0ec8c. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:40:51.439643 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1493/3021] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:51 2022] GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517 => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:51.444559 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7fda2df7-fbc4-4042-8f64-30493455f952 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:51.445197 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7fda2df7-fbc4-4042-8f64-30493455f952 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:51.452473 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7fda2df7-fbc4-4042-8f64-30493455f952 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:51.452931 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7fda2df7-fbc4-4042-8f64-30493455f952 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:51.453730 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7fda2df7-fbc4-4042-8f64-30493455f952 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:51.454177 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7fda2df7-fbc4-4042-8f64-30493455f952 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:51.484382 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-381bcd15-247a-4403-a97a-79730f808769 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.143039 Jul 19 22:40:51.487423 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1529/3022] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:40:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:51.502359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ccdac853-da3d-4c49-83e2-5a948e7fcfbf tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '.version_select at 0x7f7a1012e5e0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:51.621268 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=12 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:51.696769 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ccdac853-da3d-4c49-83e2-5a948e7fcfbf tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/4edbc9af-14dc-4899-81a5-6394a338b801" status: 200 len: 224 microversion: 2.1 time: 0.207475 Jul 19 22:40:51.697476 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1530/3023] 10.222.0.25 () {58 vars in 1268 bytes} [Tue Jul 19 22:40:51 2022] GET /compute/v2.1/os-security-groups/4edbc9af-14dc-4899-81a5-6394a338b801 => generated 224 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:51.703460 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-26ff1477-2a64-4476-8243-c1d185a3f4f6 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:51.704506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-26ff1477-2a64-4476-8243-c1d185a3f4f6 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 976f2ec1-c70b-4795-a71d-251bed15ad25] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:51.720753 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-26ff1477-2a64-4476-8243-c1d185a3f4f6 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:51.721463 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-26ff1477-2a64-4476-8243-c1d185a3f4f6 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:51.723338 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-26ff1477-2a64-4476-8243-c1d185a3f4f6 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:51.724129 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-26ff1477-2a64-4476-8243-c1d185a3f4f6 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:51.768440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7fda2df7-fbc4-4042-8f64-30493455f952 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:51.787073 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7fda2df7-fbc4-4042-8f64-30493455f952 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.346041 Jul 19 22:40:51.801344 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1494/3024] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:51 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:51.808670 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-68b08960-7dc3-454e-83a5-bbb8a3d216be tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Action: 'create', calling method: .version_select at 0x7f7a1040c5e0>, body: {"keypair": {"name": "tempest-keypair-1275991259", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1osWinCcNfi788y4Fyi1Gemte4zP+vWXRhI37ISAvpYqtItSscOaYJVQa5fadQdKNyoyihBG9ZNzss4s1cTMuiRIjK/bDsKciKNnDjEJQ//w3vYyHZuF+TPXtIzJ8zqA=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:51.824847 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=27 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:51.826352 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-68b08960-7dc3-454e-83a5-bbb8a3d216be tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Getting quotas for project 34f408a7de28426f917d66f776b0ec8c. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:40:51.833683 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-68b08960-7dc3-454e-83a5-bbb8a3d216be tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Getting quotas for user a88e5bd9d54e4452b2979b9c013d3a20 and project 34f408a7de28426f917d66f776b0ec8c. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:40:51.866401 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-68b08960-7dc3-454e-83a5-bbb8a3d216be tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] HTTP exception thrown: Key pair 'tempest-keypair-1275991259' already exists. Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-68b08960-7dc3-454e-83a5-bbb8a3d216be tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Request method failure captured: Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 273 Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zLwA7M1BEJi0J4SvpxQrmWnF2PdhYDMqKLBq5k7kMr6ZLu1CuvopeDEG8WhsZJnYyuH4bSas7DhTP279njB7nE64xn1sv9I33d4qBA7klnClkGsspZlK9gSXpiqkQ-3G7ojzhKcZ-S4EYH5WiGegpUZkmtGeBYQ-Ud3nVfMxarO_so Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 34f408a7de28426f917d66f776b0ec8c Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1796972728 Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1796972728 Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 34f408a7de28426f917d66f776b0ec8c Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1796972728 Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-KeyPairsNegativeTestJSON-1796972728-project Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: a88e5bd9d54e4452b2979b9c013d3a20 Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1796972728-project Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: {"keypair": {"name": "tempest-keypair-1275991259", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1osWinCcNfi788y4Fyi1Gemte4zP+vWXRhI37ISAvpYqtItSscOaYJVQa5fadQdKNyoyihBG9ZNzss4s1cTMuiRIjK/bDsKciKNnDjEJQ//w3vYyHZuF+TPXtIzJ8zqA=="}} Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: exception: Key pair 'tempest-keypair-1275991259' already exists. Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1275991259', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1osWinCcNfi788y4Fyi1Gemte4zP+vWXRhI37ISAvpYqtItSscOaYJVQa5fadQdKNyoyihBG9ZNzss4s1cTMuiRIjK/bDsKciKNnDjEJQ//w3vYyHZuF+TPXtIzJ8zqA=='}}} Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result.read() Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'a88e5bd9d54e4452b2979b9c013d3a20-tempest-keypair-1275991259' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 19 22:40:51.882984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi session.flush() Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result.read() Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 19 22:40:51.887577 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'a88e5bd9d54e4452b2979b9c013d3a20-tempest-keypair-1275991259' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 19, 22, 40, 51, 855293), 'updated_at': None, 'name': 'tempest-keypair-1275991259', 'user_id': 'a88e5bd9d54e4452b2979b9c013d3a20', 'fingerprint': '17:8b:3b:94:a7:16:7c:64:8f:cb:97:ad:8d:8b:11:be', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1osWinCcNfi788y4Fyi1Gemte4zP+vWXRhI37ISAvpYqtItSscOaYJVQa5fadQdKNyoyihBG9ZNzss4s1cTMuiRIjK/bDsKciKNnDjEJQ//w3vYyHZuF+TPXtIzJ8zqA==', 'type': 'ssh'}] Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi keypair.create() Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._create() Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1275991259' already exists. Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 19 22:40:51.891682 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1275991259' already exists. Jul 19 22:40:51.898361 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:51.898361 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:51.898361 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:51.898361 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:51.898361 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:51.898361 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:51.898361 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:40:51.898361 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:40:51.898361 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1275991259' already exists. Jul 19 22:40:51.898361 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:51.898361 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-68b08960-7dc3-454e-83a5-bbb8a3d216be tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Returning 409 to user: Key pair 'tempest-keypair-1275991259' already exists. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:51.898361 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-68b08960-7dc3-454e-83a5-bbb8a3d216be tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.082522 Jul 19 22:40:51.898361 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1495/3025] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:40:51 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:40:51.898361 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c2224862-293d-491d-984e-7a0b4b428577 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '.version_select at 0x7f7a10822e50>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:51.969343 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-26ff1477-2a64-4476-8243-c1d185a3f4f6 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:51.977158 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-26ff1477-2a64-4476-8243-c1d185a3f4f6 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25" status: 200 len: 1520 microversion: 2.1 time: 0.278242 Jul 19 22:40:51.978424 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1531/3026] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:51 2022] GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25 => generated 1520 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:51.985074 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b194685c-2a08-433e-810c-a1fa786e957b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:51.985924 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b194685c-2a08-433e-810c-a1fa786e957b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:51.992830 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b194685c-2a08-433e-810c-a1fa786e957b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:51.993920 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b194685c-2a08-433e-810c-a1fa786e957b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:51.995047 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b194685c-2a08-433e-810c-a1fa786e957b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:51.995835 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b194685c-2a08-433e-810c-a1fa786e957b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:52.334372 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c2224862-293d-491d-984e-7a0b4b428577 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/4edbc9af-14dc-4899-81a5-6394a338b801" status: 202 len: 0 microversion: 2.1 time: 0.445888 Jul 19 22:40:52.338508 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1496/3027] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:40:51 2022] DELETE /compute/v2.1/os-security-groups/4edbc9af-14dc-4899-81a5-6394a338b801 => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:40:52.340346 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b194685c-2a08-433e-810c-a1fa786e957b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:52.359768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d7220e5a-e4a1-4174-bc40-7baecbe3f74f tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Calling method '.version_select at 0x7f7a155ac940>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:52.371659 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b194685c-2a08-433e-810c-a1fa786e957b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.390391 Jul 19 22:40:52.394518 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1532/3028] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:51 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:52.416443 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aeb6994f-782d-4d84-96f9-a408eaccdd86 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '.version_select at 0x7f7a03804f70>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:52.438042 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d7220e5a-e4a1-4174-bc40-7baecbe3f74f tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1275991259" status: 202 len: 0 microversion: 2.1 time: 0.093096 Jul 19 22:40:52.439762 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1497/3029] 10.222.0.25 () {58 vars in 1220 bytes} [Tue Jul 19 22:40:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1275991259 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:40:52.445981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3fbc9300-b0de-471e-a416-602e7e8f6b13 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:52.446603 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3fbc9300-b0de-471e-a416-602e7e8f6b13 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:52.457291 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3fbc9300-b0de-471e-a416-602e7e8f6b13 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:52.457751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3fbc9300-b0de-471e-a416-602e7e8f6b13 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:52.458539 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3fbc9300-b0de-471e-a416-602e7e8f6b13 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:52.459242 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3fbc9300-b0de-471e-a416-602e7e8f6b13 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:52.550079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG neutronclient.v2_0.client [None req-aeb6994f-782d-4d84-96f9-a408eaccdd86 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4edbc9af-14dc-4899-81a5-6394a338b801 does not exist", "detail": ""}} {{(pid=119338) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 22:40:52.551582 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.security_group_api [None req-aeb6994f-782d-4d84-96f9-a408eaccdd86 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Neutron security group 4edbc9af-14dc-4899-81a5-6394a338b801 not found {{(pid=119338) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 22:40:52.552994 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-aeb6994f-782d-4d84-96f9-a408eaccdd86 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] HTTP exception thrown: Security group 4edbc9af-14dc-4899-81a5-6394a338b801 does not exist Jul 19 22:40:52.552994 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-8ecb81c6-61a4-4585-8aa7-9b215ef8b625'] Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aeb6994f-782d-4d84-96f9-a408eaccdd86 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Request method failure captured: Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/os-security-groups/4edbc9af-14dc-4899-81a5-6394a338b801 HTTP/1.1 Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zLOcBnDO8DB0TvfRIhrSs2i1Z8gf2mXRu9CWG3-L53ppyrrqccAldlD1sn80tAiiaYj788W6zk_H_lFv9A7zGAIhHM_mj3-7IRMW_3igT7vOPEp-kC_qbKwdmn2JH9DflRdkn_IaARtkReZyhJI3DiZyzYUOJLxFUfr88ChX6WBaz8 Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 6994ad3a701847d49163a7b709fba400 Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: exception: Security group 4edbc9af-14dc-4899-81a5-6394a338b801 does not exist Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-8ecb81c6-61a4-4585-8aa7-9b215ef8b625'] Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '4edbc9af-14dc-4899-81a5-6394a338b801'} Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 22:40:52.561235 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4edbc9af-14dc-4899-81a5-6394a338b801 does not exist Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ecb81c6-61a4-4585-8aa7-9b215ef8b625'] Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4edbc9af-14dc-4899-81a5-6394a338b801 does not exist Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ecb81c6-61a4-4585-8aa7-9b215ef8b625'] Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4edbc9af-14dc-4899-81a5-6394a338b801 does not exist Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ecb81c6-61a4-4585-8aa7-9b215ef8b625'] Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4edbc9af-14dc-4899-81a5-6394a338b801 does not exist Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ecb81c6-61a4-4585-8aa7-9b215ef8b625'] Jul 19 22:40:52.569493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:52.580367 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aeb6994f-782d-4d84-96f9-a408eaccdd86 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Returning 404 to user: Security group 4edbc9af-14dc-4899-81a5-6394a338b801 does not exist Jul 19 22:40:52.580367 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-8ecb81c6-61a4-4585-8aa7-9b215ef8b625'] {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:52.583033 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-aeb6994f-782d-4d84-96f9-a408eaccdd86 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/4edbc9af-14dc-4899-81a5-6394a338b801" status: 404 len: 194 microversion: 2.1 time: 0.185856 Jul 19 22:40:52.583722 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1533/3030] 10.222.0.25 () {58 vars in 1268 bytes} [Tue Jul 19 22:40:52 2022] GET /compute/v2.1/os-security-groups/4edbc9af-14dc-4899-81a5-6394a338b801 => generated 194 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:40:52.611830 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d08318b0-c980-48ee-b4ae-23783c398014 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:52.614519 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d08318b0-c980-48ee-b4ae-23783c398014 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: e0ada988-0937-4623-a7a6-b7bc4a69f517] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:52.641855 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d08318b0-c980-48ee-b4ae-23783c398014 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:52.642881 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d08318b0-c980-48ee-b4ae-23783c398014 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:52.644084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d08318b0-c980-48ee-b4ae-23783c398014 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:52.644769 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d08318b0-c980-48ee-b4ae-23783c398014 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:52.930763 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3fbc9300-b0de-471e-a416-602e7e8f6b13 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:52.941137 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3fbc9300-b0de-471e-a416-602e7e8f6b13 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.500297 Jul 19 22:40:52.941909 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1498/3031] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:52 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:52.947462 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-19a04eb2-882b-4873-841a-222c683bd877 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Action: 'create', calling method: .version_select at 0x7f7a10b7af70>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUpI6dIykJosheDtzYvgWBOTP7L3gJ0vVvATirJq5YGRCKxDHKPO7XwpEsJBGyBASYvHQDhK9kobZwJUYYlMQnflekG7JjdzmEk03mhKLFV3HoUjeeZ6AHiNkI2wH9lwg=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-19a04eb2-882b-4873-841a-222c683bd877 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Request method failure captured: Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 247 Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zLwA7M1BEJi0J4SvpxQrmWnF2PdhYDMqKLBq5k7kMr6ZLu1CuvopeDEG8WhsZJnYyuH4bSas7DhTP279njB7nE64xn1sv9I33d4qBA7klnClkGsspZlK9gSXpiqkQ-3G7ojzhKcZ-S4EYH5WiGegpUZkmtGeBYQ-Ud3nVfMxarO_so Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 34f408a7de28426f917d66f776b0ec8c Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1796972728 Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1796972728 Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 34f408a7de28426f917d66f776b0ec8c Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1796972728 Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-KeyPairsNegativeTestJSON-1796972728-project Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: a88e5bd9d54e4452b2979b9c013d3a20 Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1796972728-project Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUpI6dIykJosheDtzYvgWBOTP7L3gJ0vVvATirJq5YGRCKxDHKPO7XwpEsJBGyBASYvHQDhK9kobZwJUYYlMQnflekG7JjdzmEk03mhKLFV3HoUjeeZ6AHiNkI2wH9lwg=="}} Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUpI6dIykJosheDtzYvgWBOTP7L3gJ0vVvATirJq5YGRCKxDHKPO7XwpEsJBGyBASYvHQDhK9kobZwJUYYlMQnflekG7JjdzmEk03mhKLFV3HoUjeeZ6AHiNkI2wH9lwg=='}}} Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi '' Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:40:52.957157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:40:52.961571 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:40:52.961571 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:40:52.961571 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:40:52.961571 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:40:52.961571 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 19 22:40:52.961571 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:52.961571 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:52.961571 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:52.961571 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:52.961571 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:52.961571 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:52.961571 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:40:52.961571 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:40:52.961571 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 19 22:40:52.961571 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:52.965197 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-19a04eb2-882b-4873-841a-222c683bd877 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:52.966354 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-19a04eb2-882b-4873-841a-222c683bd877 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.023243 Jul 19 22:40:52.967675 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1499/3032] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:40:52 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:40:52.981907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c76633f6-e51e-4f04-9b31-377617e39951 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Action: 'create', calling method: .version_select at 0x7f7a1040c5e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1644843700", "description": "tempest-description-1992429456"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:53.056699 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d08318b0-c980-48ee-b4ae-23783c398014 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:53.070427 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d08318b0-c980-48ee-b4ae-23783c398014 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517" status: 200 len: 1314 microversion: 2.1 time: 0.475160 Jul 19 22:40:53.075771 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1534/3033] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:52 2022] GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517 => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:53.091295 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6fd50e2f-ef53-4c6c-ac6d-fb8a85f0e132 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Action: 'create', calling method: .version_select at 0x7f7a10043670>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-808513549", "public_key": " "}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:53.113735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=35 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:53.118254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-6fd50e2f-ef53-4c6c-ac6d-fb8a85f0e132 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Getting quotas for project 34f408a7de28426f917d66f776b0ec8c. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:40:53.126891 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-6fd50e2f-ef53-4c6c-ac6d-fb8a85f0e132 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Getting quotas for user a88e5bd9d54e4452b2979b9c013d3a20 and project 34f408a7de28426f917d66f776b0ec8c. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:40:53.168188 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-6fd50e2f-ef53-4c6c-ac6d-fb8a85f0e132 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6fd50e2f-ef53-4c6c-ac6d-fb8a85f0e132 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Request method failure captured: Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 94 Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zLwA7M1BEJi0J4SvpxQrmWnF2PdhYDMqKLBq5k7kMr6ZLu1CuvopeDEG8WhsZJnYyuH4bSas7DhTP279njB7nE64xn1sv9I33d4qBA7klnClkGsspZlK9gSXpiqkQ-3G7ojzhKcZ-S4EYH5WiGegpUZkmtGeBYQ-Ud3nVfMxarO_so Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 34f408a7de28426f917d66f776b0ec8c Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1796972728 Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1796972728 Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 34f408a7de28426f917d66f776b0ec8c Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1796972728 Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-KeyPairsNegativeTestJSON-1796972728-project Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: a88e5bd9d54e4452b2979b9c013d3a20 Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1796972728-project Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-808513549", "public_key": " "}} Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: exception: Keypair data is invalid: failed to generate fingerprint Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-808513549', 'public_key': ' '}}} Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:53.170263 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6fd50e2f-ef53-4c6c-ac6d-fb8a85f0e132 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6fd50e2f-ef53-4c6c-ac6d-fb8a85f0e132 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.095070 Jul 19 22:40:53.174419 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1535/3034] 10.222.0.25 () {60 vars in 1157 bytes} [Tue Jul 19 22:40:53 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 22:40:53.191270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c8b9b413-a89f-4f32-b211-810128249603 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:53.192033 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c8b9b413-a89f-4f32-b211-810128249603 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 976f2ec1-c70b-4795-a71d-251bed15ad25] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:53.201261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8b9b413-a89f-4f32-b211-810128249603 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:53.201713 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8b9b413-a89f-4f32-b211-810128249603 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:53.202520 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8b9b413-a89f-4f32-b211-810128249603 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:53.202952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8b9b413-a89f-4f32-b211-810128249603 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:53.563527 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c8b9b413-a89f-4f32-b211-810128249603 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:53.584671 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c8b9b413-a89f-4f32-b211-810128249603 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25" status: 200 len: 1497 microversion: 2.1 time: 0.410629 Jul 19 22:40:53.586067 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1536/3035] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:53 2022] GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25 => generated 1497 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:53.592248 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-4215f5f7-09be-4e2e-8690-c76f281f8d2f req-a5eff085-1c2b-45b8-844a-1cbee52123fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ada988-0937-4623-a7a6-b7bc4a69f517", "name": "network-vif-plugged", "status": "completed", "tag": "60cde104-fb4e-4266-87dc-e6875242dfb1"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:53.601979 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-4215f5f7-09be-4e2e-8690-c76f281f8d2f req-a5eff085-1c2b-45b8-844a-1cbee52123fb service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:53.603298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-4215f5f7-09be-4e2e-8690-c76f281f8d2f req-a5eff085-1c2b-45b8-844a-1cbee52123fb service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:53.622783 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-4215f5f7-09be-4e2e-8690-c76f281f8d2f req-a5eff085-1c2b-45b8-844a-1cbee52123fb service nova] Creating event network-vif-plugged:60cde104-fb4e-4266-87dc-e6875242dfb1 for instance e0ada988-0937-4623-a7a6-b7bc4a69f517 on n-h1-847009-3 Jul 19 22:40:53.630497 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-4215f5f7-09be-4e2e-8690-c76f281f8d2f req-a5eff085-1c2b-45b8-844a-1cbee52123fb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042803 Jul 19 22:40:53.631945 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1537/3036] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:53.655768 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c76633f6-e51e-4f04-9b31-377617e39951 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.683040 Jul 19 22:40:53.656900 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1500/3037] 10.222.0.25 () {60 vars in 1179 bytes} [Tue Jul 19 22:40:52 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:53.659861 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c593186a-7ec9-4c1a-b11b-bc762677859d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-426679827", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "9e83a825-a2fd-461e-9b4f-f6a6a85fd752"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:53.667037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-45d0b8ec-4f78-47ba-bf25-a05a809cfd30 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Action: 'create', calling method: .version_select at 0x7f7a155c91f0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrKUs5iymE+bB4i+86D2RhFBCx3QuMCIYF+mVlW0uiM88nTc4HNvlJL2OzWunX3yAlQRDix14qCuuBaXSWrrR37qrKkhMaZFB0XoV4aD5ah0pazc/QZ2Wk0Epo2SbaIbA=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-45d0b8ec-4f78-47ba-bf25-a05a809cfd30 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Request method failure captured: Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 507 Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zLwA7M1BEJi0J4SvpxQrmWnF2PdhYDMqKLBq5k7kMr6ZLu1CuvopeDEG8WhsZJnYyuH4bSas7DhTP279njB7nE64xn1sv9I33d4qBA7klnClkGsspZlK9gSXpiqkQ-3G7ojzhKcZ-S4EYH5WiGegpUZkmtGeBYQ-Ud3nVfMxarO_so Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 34f408a7de28426f917d66f776b0ec8c Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1796972728 Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1796972728 Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 34f408a7de28426f917d66f776b0ec8c Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1796972728 Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-KeyPairsNegativeTestJSON-1796972728-project Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: a88e5bd9d54e4452b2979b9c013d3a20 Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1796972728-project Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrKUs5iymE+bB4i+86D2RhFBCx3QuMCIYF+mVlW0uiM88nTc4HNvlJL2OzWunX3yAlQRDix14qCuuBaXSWrrR37qrKkhMaZFB0XoV4aD5ah0pazc/QZ2Wk0Epo2SbaIbA=="}} Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrKUs5iymE+bB4i+86D2RhFBCx3QuMCIYF+mVlW0uiM88nTc4HNvlJL2OzWunX3yAlQRDix14qCuuBaXSWrrR37qrKkhMaZFB0XoV4aD5ah0pazc/QZ2Wk0Epo2SbaIbA=='}}} Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 19 22:40:53.671224 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 19 22:40:53.676671 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:53.681985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-45d0b8ec-4f78-47ba-bf25-a05a809cfd30 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:53.681985 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-45d0b8ec-4f78-47ba-bf25-a05a809cfd30 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.022452 Jul 19 22:40:53.690347 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1501/3038] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:40:53 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:40:53.706890 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c9c29efb-513c-4c9c-857b-f5a54b393156 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:53.722785 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c9c29efb-513c-4c9c-857b-f5a54b393156 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:53.735992 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c9c29efb-513c-4c9c-857b-f5a54b393156 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4'} {{(pid=119337) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:40:53.749374 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c9c29efb-513c-4c9c-857b-f5a54b393156 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:53.750995 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c9c29efb-513c-4c9c-857b-f5a54b393156 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:53.752419 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c9c29efb-513c-4c9c-857b-f5a54b393156 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:53.757289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c9c29efb-513c-4c9c-857b-f5a54b393156 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:53.778813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-c593186a-7ec9-4c1a-b11b-bc762677859d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] validate_networks() for [('9e83a825-a2fd-461e-9b4f-f6a6a85fd752', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:40:53.797904 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.multi_cell_list [None req-c9c29efb-513c-4c9c-857b-f5a54b393156 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119337) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:40:53.856693 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c9c29efb-513c-4c9c-857b-f5a54b393156 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.165171 Jul 19 22:40:53.857845 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1502/3039] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Jul 19 22:40:53 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:53.862726 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2e2abc91-acb1-4d41-bc4c-0f66c82f429c tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Action: 'create', calling method: .version_select at 0x7f7a102f1820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1071855411", "description": "tempest-description-1791228717"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:54.200216 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2e2abc91-acb1-4d41-bc4c-0f66c82f429c tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.340149 Jul 19 22:40:54.216187 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1503/3040] 10.222.0.25 () {60 vars in 1179 bytes} [Tue Jul 19 22:40:53 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:54.229435 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ff699683-c87d-4118-8750-a3ce9be915b8 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Action: 'create', calling method: .version_select at 0x7f7a10cbdd30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1220098674", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:54.258313 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-ff699683-c87d-4118-8750-a3ce9be915b8 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Getting quotas for project 34f408a7de28426f917d66f776b0ec8c. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:40:54.266715 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-ff699683-c87d-4118-8750-a3ce9be915b8 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Getting quotas for user a88e5bd9d54e4452b2979b9c013d3a20 and project 34f408a7de28426f917d66f776b0ec8c. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:40:54.288012 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-ff699683-c87d-4118-8750-a3ce9be915b8 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ff699683-c87d-4118-8750-a3ce9be915b8 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Request method failure captured: Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 118 Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zLwA7M1BEJi0J4SvpxQrmWnF2PdhYDMqKLBq5k7kMr6ZLu1CuvopeDEG8WhsZJnYyuH4bSas7DhTP279njB7nE64xn1sv9I33d4qBA7klnClkGsspZlK9gSXpiqkQ-3G7ojzhKcZ-S4EYH5WiGegpUZkmtGeBYQ-Ud3nVfMxarO_so Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 34f408a7de28426f917d66f776b0ec8c Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1796972728 Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1796972728 Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 34f408a7de28426f917d66f776b0ec8c Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1796972728 Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-KeyPairsNegativeTestJSON-1796972728-project Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: a88e5bd9d54e4452b2979b9c013d3a20 Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1796972728-project Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1220098674", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: exception: Keypair data is invalid: failed to generate fingerprint Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1220098674', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 19 22:40:54.290394 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ff699683-c87d-4118-8750-a3ce9be915b8 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ff699683-c87d-4118-8750-a3ce9be915b8 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.073806 Jul 19 22:40:54.297412 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1504/3041] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:40:54 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 22:40:54.302532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f5f742a7-7218-47be-9ad1-a0273e131d42 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:54.307084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f5f742a7-7218-47be-9ad1-a0273e131d42 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:54.308162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f5f742a7-7218-47be-9ad1-a0273e131d42 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:54.336066 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f5f742a7-7218-47be-9ad1-a0273e131d42 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 976f2ec1-c70b-4795-a71d-251bed15ad25] Going to try to start instance {{(pid=119337) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 22:40:54.393594 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f5f742a7-7218-47be-9ad1-a0273e131d42 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "POST /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25/action" status: 202 len: 0 microversion: 2.1 time: 0.098897 Jul 19 22:40:54.394345 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1505/3042] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:40:54 2022] POST /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:40:54.402025 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-49afe6e2-9f0a-48b3-8f78-de348aac4a59 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:54.404103 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-49afe6e2-9f0a-48b3-8f78-de348aac4a59 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: e0ada988-0937-4623-a7a6-b7bc4a69f517] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:54.413971 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49afe6e2-9f0a-48b3-8f78-de348aac4a59 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:54.415400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49afe6e2-9f0a-48b3-8f78-de348aac4a59 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:54.416692 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49afe6e2-9f0a-48b3-8f78-de348aac4a59 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:54.417526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49afe6e2-9f0a-48b3-8f78-de348aac4a59 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:54.434607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-c593186a-7ec9-4c1a-b11b-bc762677859d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:40:54.435063 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-c593186a-7ec9-4c1a-b11b-bc762677859d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:40:54.435675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-c593186a-7ec9-4c1a-b11b-bc762677859d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:40:54.436094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-c593186a-7ec9-4c1a-b11b-bc762677859d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:40:54.436509 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-c593186a-7ec9-4c1a-b11b-bc762677859d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:40:54.449592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c593186a-7ec9-4c1a-b11b-bc762677859d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:54.450839 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c593186a-7ec9-4c1a-b11b-bc762677859d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:54.452788 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c593186a-7ec9-4c1a-b11b-bc762677859d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:54.453410 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c593186a-7ec9-4c1a-b11b-bc762677859d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:54.475126 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-c593186a-7ec9-4c1a-b11b-bc762677859d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Getting quotas for project 038e4783159e41e3b2cb88df1f8f4a97. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:40:54.481657 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-c593186a-7ec9-4c1a-b11b-bc762677859d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Getting quotas for user 1f2613ad65b047e8b9a68907406d1874 and project 038e4783159e41e3b2cb88df1f8f4a97. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:40:54.492917 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:54.500025 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c593186a-7ec9-4c1a-b11b-bc762677859d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:40:54.508611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c593186a-7ec9-4c1a-b11b-bc762677859d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:40:54.636718 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c593186a-7ec9-4c1a-b11b-bc762677859d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.003332 Jul 19 22:40:54.647775 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1538/3043] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:40:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:40:54.659163 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-106e04a6-d2b9-4514-b0a4-f7e2609109d9 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Action: 'create', calling method: .version_select at 0x7f7a1014a3a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2067649701", "description": "tempest-description-1229685346"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:54.740409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-49afe6e2-9f0a-48b3-8f78-de348aac4a59 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:54.745583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:54.769173 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-49afe6e2-9f0a-48b3-8f78-de348aac4a59 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517" status: 200 len: 1314 microversion: 2.1 time: 0.372857 Jul 19 22:40:54.782228 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1506/3044] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:54 2022] GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:54.798449 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-23933543-b029-458f-9489-e5132a325ad2 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Calling method '.version_select at 0x7f7a10458310>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:54.828144 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-23933543-b029-458f-9489-e5132a325ad2 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1472357180 not found for user a88e5bd9d54e4452b2979b9c013d3a20 Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-23933543-b029-458f-9489-e5132a325ad2 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Request method failure captured: Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1472357180 HTTP/1.1 Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zLwA7M1BEJi0J4SvpxQrmWnF2PdhYDMqKLBq5k7kMr6ZLu1CuvopeDEG8WhsZJnYyuH4bSas7DhTP279njB7nE64xn1sv9I33d4qBA7klnClkGsspZlK9gSXpiqkQ-3G7ojzhKcZ-S4EYH5WiGegpUZkmtGeBYQ-Ud3nVfMxarO_so Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 34f408a7de28426f917d66f776b0ec8c Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1796972728 Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/34f408a7de28426f917d66f776b0ec8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1796972728 Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 34f408a7de28426f917d66f776b0ec8c Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1796972728 Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-KeyPairsNegativeTestJSON-1796972728-project Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: a88e5bd9d54e4452b2979b9c013d3a20 Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1796972728-project Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: exception: Keypair tempest-keypair-non-existent-1472357180 not found for user a88e5bd9d54e4452b2979b9c013d3a20 Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'tempest-keypair-non-existent-1472357180'} Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise self.value Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1472357180 not found for user a88e5bd9d54e4452b2979b9c013d3a20 Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:54.842711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1472357180 not found for user a88e5bd9d54e4452b2979b9c013d3a20 Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1472357180 not found for user a88e5bd9d54e4452b2979b9c013d3a20 Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:54.847497 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-23933543-b029-458f-9489-e5132a325ad2 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1472357180 not found for user a88e5bd9d54e4452b2979b9c013d3a20 {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:54.849483 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-23933543-b029-458f-9489-e5132a325ad2 tempest-KeyPairsNegativeTestJSON-1796972728 tempest-KeyPairsNegativeTestJSON-1796972728-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1472357180" status: 404 len: 145 microversion: 2.1 time: 0.062980 Jul 19 22:40:54.849483 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1507/3045] 10.222.0.25 () {58 vars in 1259 bytes} [Tue Jul 19 22:40:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1472357180 => generated 145 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:40:54.953041 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-12ac78e4-8da1-4c8e-a0de-38cda95122fe tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:54.962696 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-12ac78e4-8da1-4c8e-a0de-38cda95122fe tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 976f2ec1-c70b-4795-a71d-251bed15ad25] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:55.002447 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12ac78e4-8da1-4c8e-a0de-38cda95122fe tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:55.002914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12ac78e4-8da1-4c8e-a0de-38cda95122fe tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:55.004817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12ac78e4-8da1-4c8e-a0de-38cda95122fe tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:55.008687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12ac78e4-8da1-4c8e-a0de-38cda95122fe tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:55.144718 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-106e04a6-d2b9-4514-b0a4-f7e2609109d9 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.493481 Jul 19 22:40:55.148591 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1539/3046] 10.222.0.25 () {60 vars in 1179 bytes} [Tue Jul 19 22:40:54 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:40:55.165379 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e717a3dd-6ffa-4a00-891a-749a2df144e4 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:55.172692 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e717a3dd-6ffa-4a00-891a-749a2df144e4 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:55.432162 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e717a3dd-6ffa-4a00-891a-749a2df144e4 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:55.440510 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e717a3dd-6ffa-4a00-891a-749a2df144e4 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1214 microversion: 2.1 time: 0.290818 Jul 19 22:40:55.441649 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1540/3047] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:55 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1214 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:55.446564 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-05258ad1-2805-4e53-a3ad-6973e0ff60f0 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '.version_select at 0x7f7a1014a700>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:55.988168 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-12ac78e4-8da1-4c8e-a0de-38cda95122fe tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:55.998958 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-12ac78e4-8da1-4c8e-a0de-38cda95122fe tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25" status: 200 len: 1506 microversion: 2.1 time: 1.076777 Jul 19 22:40:55.999999 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1508/3048] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:54 2022] GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25 => generated 1506 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:56.004914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2462dd81-b355-4d98-9ef0-005b48d0271c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:56.005809 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2462dd81-b355-4d98-9ef0-005b48d0271c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: e0ada988-0937-4623-a7a6-b7bc4a69f517] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:56.012443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2462dd81-b355-4d98-9ef0-005b48d0271c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:56.013206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2462dd81-b355-4d98-9ef0-005b48d0271c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:56.014187 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2462dd81-b355-4d98-9ef0-005b48d0271c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:56.014817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2462dd81-b355-4d98-9ef0-005b48d0271c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:56.425862 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-05258ad1-2805-4e53-a3ad-6973e0ff60f0 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.981941 Jul 19 22:40:56.425862 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1541/3049] 10.222.0.25 () {58 vars in 1157 bytes} [Tue Jul 19 22:40:55 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:56.440888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2462dd81-b355-4d98-9ef0-005b48d0271c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:56.494040 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2462dd81-b355-4d98-9ef0-005b48d0271c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517" status: 200 len: 1501 microversion: 2.1 time: 0.492264 Jul 19 22:40:56.499265 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1509/3050] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:56 2022] GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517 => generated 1501 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:56.517413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9af18cce-8790-4b70-87c0-4c7032981a00 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '.version_select at 0x7f7a105504c0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:56.718924 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b0dc55ef-5a85-48a3-9f58-b38e0f962c3d tempest-MultipleCreateNegativeTestJSON-1105717856 tempest-MultipleCreateNegativeTestJSON-1105717856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-292240818", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:56.721061 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-b0dc55ef-5a85-48a3-9f58-b38e0f962c3d tempest-MultipleCreateNegativeTestJSON-1105717856 tempest-MultipleCreateNegativeTestJSON-1105717856-project] HTTP exception thrown: min_count must be <= max_count Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b0dc55ef-5a85-48a3-9f58-b38e0f962c3d tempest-MultipleCreateNegativeTestJSON-1105717856 tempest-MultipleCreateNegativeTestJSON-1105717856-project] Request method failure captured: Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 183 Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zL35jXPbdpYI60Tlc3XcmM6UwqTERypRwwuoFkWBZB3tMzw40Ame5pqnx0CioaxLlibwF58lzSOtMNmv5h8Z0TPd52fU84WfV58Waz-ls09DGQN4oexTrIq9CH-eSevDK79tVfqWLAdqsaqQRSyMQucar9PvBvv3iXMSTj7UOMx_rw Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 878b11dc2b3f4e2ba447c40d1d5264b9 Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1105717856 Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_878b11dc2b3f4e2ba447c40d1d5264b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/878b11dc2b3f4e2ba447c40d1d5264b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/878b11dc2b3f4e2ba447c40d1d5264b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/878b11dc2b3f4e2ba447c40d1d5264b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1105717856 Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 878b11dc2b3f4e2ba447c40d1d5264b9 Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1105717856 Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-MultipleCreateNegativeTestJSON-1105717856-project Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 333027a0fdd04277b60832884d58830b Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1105717856-project Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-292240818", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: exception: min_count must be <= max_count Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-292240818', 'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 19 22:40:56.722763 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:56.728661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b0dc55ef-5a85-48a3-9f58-b38e0f962c3d tempest-MultipleCreateNegativeTestJSON-1105717856 tempest-MultipleCreateNegativeTestJSON-1105717856-project] Returning 400 to user: min_count must be <= max_count {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:56.728661 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b0dc55ef-5a85-48a3-9f58-b38e0f962c3d tempest-MultipleCreateNegativeTestJSON-1105717856 tempest-MultipleCreateNegativeTestJSON-1105717856-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.299245 Jul 19 22:40:56.729389 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1542/3051] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:40:56 2022] POST /compute/v2.1/servers => generated 74 bytes in 303 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 22:40:56.737330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e93742ae-aa64-4ae4-bc15-dbef4519b50e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:56.742029 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e93742ae-aa64-4ae4-bc15-dbef4519b50e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:56.762691 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e93742ae-aa64-4ae4-bc15-dbef4519b50e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:56.769945 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e93742ae-aa64-4ae4-bc15-dbef4519b50e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:56.771299 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e93742ae-aa64-4ae4-bc15-dbef4519b50e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:56.771939 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e93742ae-aa64-4ae4-bc15-dbef4519b50e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:56.988068 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e93742ae-aa64-4ae4-bc15-dbef4519b50e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:56.998243 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e93742ae-aa64-4ae4-bc15-dbef4519b50e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1284 microversion: 2.1 time: 0.267517 Jul 19 22:40:57.016780 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1543/3052] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:56 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1284 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:57.024089 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-422165ff-7df8-49dc-9e1c-8d0d60039dd4 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:57.024918 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-422165ff-7df8-49dc-9e1c-8d0d60039dd4 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: e0ada988-0937-4623-a7a6-b7bc4a69f517] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:57.033638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-422165ff-7df8-49dc-9e1c-8d0d60039dd4 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:57.034896 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-422165ff-7df8-49dc-9e1c-8d0d60039dd4 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:57.035930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-422165ff-7df8-49dc-9e1c-8d0d60039dd4 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:57.036539 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-422165ff-7df8-49dc-9e1c-8d0d60039dd4 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:57.209544 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-422165ff-7df8-49dc-9e1c-8d0d60039dd4 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "POST /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517/action" status: 202 len: 0 microversion: 2.1 time: 0.189002 Jul 19 22:40:57.215034 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1544/3053] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:40:57 2022] POST /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:40:57.230720 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1f56958a-7604-4201-bcc5-bb0eb436707d tempest-MultipleCreateNegativeTestJSON-1105717856 tempest-MultipleCreateNegativeTestJSON-1105717856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1102370878", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "max_count": 0}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1f56958a-7604-4201-bcc5-bb0eb436707d tempest-MultipleCreateNegativeTestJSON-1105717856 tempest-MultipleCreateNegativeTestJSON-1105717856-project] Request method failure captured: Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 168 Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zL35jXPbdpYI60Tlc3XcmM6UwqTERypRwwuoFkWBZB3tMzw40Ame5pqnx0CioaxLlibwF58lzSOtMNmv5h8Z0TPd52fU84WfV58Waz-ls09DGQN4oexTrIq9CH-eSevDK79tVfqWLAdqsaqQRSyMQucar9PvBvv3iXMSTj7UOMx_rw Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 878b11dc2b3f4e2ba447c40d1d5264b9 Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1105717856 Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_878b11dc2b3f4e2ba447c40d1d5264b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/878b11dc2b3f4e2ba447c40d1d5264b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/878b11dc2b3f4e2ba447c40d1d5264b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/878b11dc2b3f4e2ba447c40d1d5264b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1105717856 Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 878b11dc2b3f4e2ba447c40d1d5264b9 Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1105717856 Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-MultipleCreateNegativeTestJSON-1105717856-project Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 333027a0fdd04277b60832884d58830b Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1105717856-project Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1102370878", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "max_count": 0}} Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1102370878', 'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691', 'flavorRef': '452', 'max_count': 0}}} Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi 0 Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:40:57.236472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:40:57.241444 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:40:57.241444 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:40:57.241444 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:40:57.241444 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:40:57.241444 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 19 22:40:57.241444 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:57.241444 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:57.241444 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:57.241444 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:57.241444 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:57.241444 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:57.241444 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:40:57.241444 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:40:57.241444 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 19 22:40:57.241444 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:57.244571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1f56958a-7604-4201-bcc5-bb0eb436707d tempest-MultipleCreateNegativeTestJSON-1105717856 tempest-MultipleCreateNegativeTestJSON-1105717856-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:57.246952 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1f56958a-7604-4201-bcc5-bb0eb436707d tempest-MultipleCreateNegativeTestJSON-1105717856 tempest-MultipleCreateNegativeTestJSON-1105717856-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.030554 Jul 19 22:40:57.248087 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1545/3054] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:40:57 2022] POST /compute/v2.1/servers => generated 130 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:40:57.253810 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0afca4dd-cd34-4b4b-8e6b-281efe5bfa2c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:57.254946 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0afca4dd-cd34-4b4b-8e6b-281efe5bfa2c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 976f2ec1-c70b-4795-a71d-251bed15ad25] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:57.292635 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0afca4dd-cd34-4b4b-8e6b-281efe5bfa2c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:57.294468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0afca4dd-cd34-4b4b-8e6b-281efe5bfa2c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:57.297959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0afca4dd-cd34-4b4b-8e6b-281efe5bfa2c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:57.300272 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0afca4dd-cd34-4b4b-8e6b-281efe5bfa2c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:57.307994 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9af18cce-8790-4b70-87c0-4c7032981a00 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/1ba2402f-1f96-4ba2-bce4-da2b77251282" status: 202 len: 0 microversion: 2.1 time: 0.806194 Jul 19 22:40:57.309340 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1510/3055] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:40:56 2022] DELETE /compute/v2.1/os-security-groups/1ba2402f-1f96-4ba2-bce4-da2b77251282 => generated 0 bytes in 809 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:40:57.315762 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a1697b72-d3a0-482a-a07f-b27c4a176dba tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:57.316827 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a1697b72-d3a0-482a-a07f-b27c4a176dba tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: e0ada988-0937-4623-a7a6-b7bc4a69f517] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:57.337151 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a1697b72-d3a0-482a-a07f-b27c4a176dba tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:57.337960 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a1697b72-d3a0-482a-a07f-b27c4a176dba tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:57.340096 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a1697b72-d3a0-482a-a07f-b27c4a176dba tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:57.342395 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a1697b72-d3a0-482a-a07f-b27c4a176dba tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:57.829023 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a1697b72-d3a0-482a-a07f-b27c4a176dba tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:57.840824 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a1697b72-d3a0-482a-a07f-b27c4a176dba tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517" status: 200 len: 1506 microversion: 2.1 time: 0.530062 Jul 19 22:40:57.844022 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1511/3056] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:57 2022] GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517 => generated 1506 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:57.849560 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0afca4dd-cd34-4b4b-8e6b-281efe5bfa2c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:57.855090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:40:57.863411 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0afca4dd-cd34-4b4b-8e6b-281efe5bfa2c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25" status: 200 len: 1506 microversion: 2.1 time: 0.614017 Jul 19 22:40:57.866882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-db0c7dd8-532c-467b-8f6a-e17b437472f4 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '.version_select at 0x7f7a106bae50>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:57.893357 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1546/3057] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:57 2022] GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25 => generated 1506 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:57.899771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9941fd0a-23cb-4fe2-8c97-218427ed4c7b tempest-MultipleCreateNegativeTestJSON-1105717856 tempest-MultipleCreateNegativeTestJSON-1105717856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1247221736", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "max_count": 2.5}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9941fd0a-23cb-4fe2-8c97-218427ed4c7b tempest-MultipleCreateNegativeTestJSON-1105717856 tempest-MultipleCreateNegativeTestJSON-1105717856-project] Request method failure captured: Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 170 Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zL35jXPbdpYI60Tlc3XcmM6UwqTERypRwwuoFkWBZB3tMzw40Ame5pqnx0CioaxLlibwF58lzSOtMNmv5h8Z0TPd52fU84WfV58Waz-ls09DGQN4oexTrIq9CH-eSevDK79tVfqWLAdqsaqQRSyMQucar9PvBvv3iXMSTj7UOMx_rw Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 878b11dc2b3f4e2ba447c40d1d5264b9 Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1105717856 Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_878b11dc2b3f4e2ba447c40d1d5264b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/878b11dc2b3f4e2ba447c40d1d5264b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/878b11dc2b3f4e2ba447c40d1d5264b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/878b11dc2b3f4e2ba447c40d1d5264b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1105717856 Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 878b11dc2b3f4e2ba447c40d1d5264b9 Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1105717856 Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-MultipleCreateNegativeTestJSON-1105717856-project Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 333027a0fdd04277b60832884d58830b Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1105717856-project Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1247221736", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "max_count": 2.5}} Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1247221736', 'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691', 'flavorRef': '452', 'max_count': 2.5}}} Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi 2.5 Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:40:57.907313 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:40:57.912751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:40:57.912751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:40:57.912751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:40:57.912751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:40:57.912751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 19 22:40:57.912751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:57.912751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:57.912751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:57.912751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:57.912751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:57.912751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:57.912751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:40:57.912751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:40:57.912751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 19 22:40:57.912751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:40:57.919061 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9941fd0a-23cb-4fe2-8c97-218427ed4c7b tempest-MultipleCreateNegativeTestJSON-1105717856 tempest-MultipleCreateNegativeTestJSON-1105717856-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:57.920742 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9941fd0a-23cb-4fe2-8c97-218427ed4c7b tempest-MultipleCreateNegativeTestJSON-1105717856 tempest-MultipleCreateNegativeTestJSON-1105717856-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.025698 Jul 19 22:40:57.922100 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1547/3058] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:40:57 2022] POST /compute/v2.1/servers => generated 139 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:40:57.960123 n-d-847009-3 devstack@n-api.service[119337]: DEBUG neutronclient.v2_0.client [None req-db0c7dd8-532c-467b-8f6a-e17b437472f4 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1ba2402f-1f96-4ba2-bce4-da2b77251282 does not exist", "detail": ""}} {{(pid=119337) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 22:40:57.961466 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.security_group_api [None req-db0c7dd8-532c-467b-8f6a-e17b437472f4 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Neutron security group 1ba2402f-1f96-4ba2-bce4-da2b77251282 not found {{(pid=119337) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 22:40:57.962450 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-db0c7dd8-532c-467b-8f6a-e17b437472f4 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] HTTP exception thrown: Security group 1ba2402f-1f96-4ba2-bce4-da2b77251282 does not exist Jul 19 22:40:57.962450 n-d-847009-3 devstack@n-api.service[119337]: Neutron server returns request_ids: ['req-ce42bed9-e112-43ed-b7d1-d5adcef11647'] Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-db0c7dd8-532c-467b-8f6a-e17b437472f4 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Request method failure captured: Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/os-security-groups/1ba2402f-1f96-4ba2-bce4-da2b77251282 HTTP/1.1 Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zLOcBnDO8DB0TvfRIhrSs2i1Z8gf2mXRu9CWG3-L53ppyrrqccAldlD1sn80tAiiaYj788W6zk_H_lFv9A7zGAIhHM_mj3-7IRMW_3igT7vOPEp-kC_qbKwdmn2JH9DflRdkn_IaARtkReZyhJI3DiZyzYUOJLxFUfr88ChX6WBaz8 Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 6994ad3a701847d49163a7b709fba400 Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: exception: Security group 1ba2402f-1f96-4ba2-bce4-da2b77251282 does not exist Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: Neutron server returns request_ids: ['req-ce42bed9-e112-43ed-b7d1-d5adcef11647'] Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '1ba2402f-1f96-4ba2-bce4-da2b77251282'} Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 22:40:57.965016 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1ba2402f-1f96-4ba2-bce4-da2b77251282 does not exist Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce42bed9-e112-43ed-b7d1-d5adcef11647'] Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1ba2402f-1f96-4ba2-bce4-da2b77251282 does not exist Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce42bed9-e112-43ed-b7d1-d5adcef11647'] Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1ba2402f-1f96-4ba2-bce4-da2b77251282 does not exist Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce42bed9-e112-43ed-b7d1-d5adcef11647'] Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1ba2402f-1f96-4ba2-bce4-da2b77251282 does not exist Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce42bed9-e112-43ed-b7d1-d5adcef11647'] Jul 19 22:40:57.969519 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:57.976726 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-db0c7dd8-532c-467b-8f6a-e17b437472f4 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Returning 404 to user: Security group 1ba2402f-1f96-4ba2-bce4-da2b77251282 does not exist Jul 19 22:40:57.976726 n-d-847009-3 devstack@n-api.service[119337]: Neutron server returns request_ids: ['req-ce42bed9-e112-43ed-b7d1-d5adcef11647'] {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:57.976726 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-db0c7dd8-532c-467b-8f6a-e17b437472f4 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/1ba2402f-1f96-4ba2-bce4-da2b77251282" status: 404 len: 194 microversion: 2.1 time: 0.130671 Jul 19 22:40:57.976726 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1512/3059] 10.222.0.25 () {58 vars in 1268 bytes} [Tue Jul 19 22:40:57 2022] GET /compute/v2.1/os-security-groups/1ba2402f-1f96-4ba2-bce4-da2b77251282 => generated 194 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:40:57.990538 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-28350e49-080f-4ffb-8eeb-7120136c3367 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '.version_select at 0x7f7a1012e4c0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:58.022842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-972050d2-3152-4c2a-a29d-bb37f327cdbf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:58.023856 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-972050d2-3152-4c2a-a29d-bb37f327cdbf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:58.043560 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-972050d2-3152-4c2a-a29d-bb37f327cdbf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:58.046382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-972050d2-3152-4c2a-a29d-bb37f327cdbf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:58.048403 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-972050d2-3152-4c2a-a29d-bb37f327cdbf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:58.050745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-972050d2-3152-4c2a-a29d-bb37f327cdbf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:58.214996 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-972050d2-3152-4c2a-a29d-bb37f327cdbf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:58.233577 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-972050d2-3152-4c2a-a29d-bb37f327cdbf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1272 microversion: 2.1 time: 0.216148 Jul 19 22:40:58.243284 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1513/3060] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:58 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1272 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:40:58.252876 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-70144803-0a1f-4c56-99f9-1ef1cef8de20 tempest-MultipleCreateNegativeTestJSON-1105717856 tempest-MultipleCreateNegativeTestJSON-1105717856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1089722883", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "min_count": 0}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-70144803-0a1f-4c56-99f9-1ef1cef8de20 tempest-MultipleCreateNegativeTestJSON-1105717856 tempest-MultipleCreateNegativeTestJSON-1105717856-project] Request method failure captured: Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 168 Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zL35jXPbdpYI60Tlc3XcmM6UwqTERypRwwuoFkWBZB3tMzw40Ame5pqnx0CioaxLlibwF58lzSOtMNmv5h8Z0TPd52fU84WfV58Waz-ls09DGQN4oexTrIq9CH-eSevDK79tVfqWLAdqsaqQRSyMQucar9PvBvv3iXMSTj7UOMx_rw Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 878b11dc2b3f4e2ba447c40d1d5264b9 Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1105717856 Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_878b11dc2b3f4e2ba447c40d1d5264b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/878b11dc2b3f4e2ba447c40d1d5264b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/878b11dc2b3f4e2ba447c40d1d5264b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/878b11dc2b3f4e2ba447c40d1d5264b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1105717856 Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 878b11dc2b3f4e2ba447c40d1d5264b9 Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1105717856 Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-MultipleCreateNegativeTestJSON-1105717856-project Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 333027a0fdd04277b60832884d58830b Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1105717856-project Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1089722883", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "min_count": 0}} Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1089722883', 'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691', 'flavorRef': '452', 'min_count': 0}}} Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 0 Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:40:58.256801 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:40:58.262550 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:40:58.262550 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:40:58.262550 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:40:58.262550 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:40:58.262550 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 19 22:40:58.262550 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:58.262550 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:58.262550 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:58.262550 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:58.262550 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:58.262550 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:58.262550 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:40:58.262550 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:40:58.262550 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 19 22:40:58.262550 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:58.267876 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-70144803-0a1f-4c56-99f9-1ef1cef8de20 tempest-MultipleCreateNegativeTestJSON-1105717856 tempest-MultipleCreateNegativeTestJSON-1105717856-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:58.276915 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-70144803-0a1f-4c56-99f9-1ef1cef8de20 tempest-MultipleCreateNegativeTestJSON-1105717856 tempest-MultipleCreateNegativeTestJSON-1105717856-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.023007 Jul 19 22:40:58.279757 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1514/3061] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:40:58 2022] POST /compute/v2.1/servers => generated 130 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:40:58.488802 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c2fd9a50-bf0c-4775-9a94-16feff7260d5 tempest-MultipleCreateNegativeTestJSON-1105717856 tempest-MultipleCreateNegativeTestJSON-1105717856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-280004141", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "min_count": 2.5}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c2fd9a50-bf0c-4775-9a94-16feff7260d5 tempest-MultipleCreateNegativeTestJSON-1105717856 tempest-MultipleCreateNegativeTestJSON-1105717856-project] Request method failure captured: Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 169 Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zL35jXPbdpYI60Tlc3XcmM6UwqTERypRwwuoFkWBZB3tMzw40Ame5pqnx0CioaxLlibwF58lzSOtMNmv5h8Z0TPd52fU84WfV58Waz-ls09DGQN4oexTrIq9CH-eSevDK79tVfqWLAdqsaqQRSyMQucar9PvBvv3iXMSTj7UOMx_rw Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 878b11dc2b3f4e2ba447c40d1d5264b9 Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1105717856 Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_878b11dc2b3f4e2ba447c40d1d5264b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/878b11dc2b3f4e2ba447c40d1d5264b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/878b11dc2b3f4e2ba447c40d1d5264b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/878b11dc2b3f4e2ba447c40d1d5264b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1105717856 Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 878b11dc2b3f4e2ba447c40d1d5264b9 Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1105717856 Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-MultipleCreateNegativeTestJSON-1105717856-project Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 333027a0fdd04277b60832884d58830b Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1105717856-project Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-280004141", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "min_count": 2.5}} Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-280004141', 'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691', 'flavorRef': '452', 'min_count': 2.5}}} Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 2.5 Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:40:58.492530 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:40:58.501276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:40:58.501276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:40:58.501276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:40:58.501276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:40:58.501276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 19 22:40:58.501276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:58.501276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:58.501276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:58.501276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:58.501276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:58.501276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:58.501276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:40:58.501276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:40:58.501276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 19 22:40:58.501276 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:58.506964 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c2fd9a50-bf0c-4775-9a94-16feff7260d5 tempest-MultipleCreateNegativeTestJSON-1105717856 tempest-MultipleCreateNegativeTestJSON-1105717856-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:58.512589 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c2fd9a50-bf0c-4775-9a94-16feff7260d5 tempest-MultipleCreateNegativeTestJSON-1105717856 tempest-MultipleCreateNegativeTestJSON-1105717856-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.032536 Jul 19 22:40:58.518655 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1515/3062] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:40:58 2022] POST /compute/v2.1/servers => generated 139 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:40:58.745916 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-28350e49-080f-4ffb-8eeb-7120136c3367 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/ebfecb56-4dfa-4ea3-af2d-6457426dbc5e" status: 202 len: 0 microversion: 2.1 time: 0.762243 Jul 19 22:40:58.746729 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1548/3063] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:40:57 2022] DELETE /compute/v2.1/os-security-groups/ebfecb56-4dfa-4ea3-af2d-6457426dbc5e => generated 0 bytes in 764 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:40:58.767061 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ed56fd10-5733-4dcc-92d2-88c3de006426 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '.version_select at 0x7f7a105509d0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:58.861183 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b79765bb-89c8-4e28-9ea2-0cc3722821e9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:58.862456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b79765bb-89c8-4e28-9ea2-0cc3722821e9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: e0ada988-0937-4623-a7a6-b7bc4a69f517] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:58.876090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b79765bb-89c8-4e28-9ea2-0cc3722821e9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:58.876798 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b79765bb-89c8-4e28-9ea2-0cc3722821e9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:58.879184 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b79765bb-89c8-4e28-9ea2-0cc3722821e9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:58.880358 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b79765bb-89c8-4e28-9ea2-0cc3722821e9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:58.886961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG neutronclient.v2_0.client [None req-ed56fd10-5733-4dcc-92d2-88c3de006426 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ebfecb56-4dfa-4ea3-af2d-6457426dbc5e does not exist", "detail": ""}} {{(pid=119337) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 22:40:58.890976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.security_group_api [None req-ed56fd10-5733-4dcc-92d2-88c3de006426 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Neutron security group ebfecb56-4dfa-4ea3-af2d-6457426dbc5e not found {{(pid=119337) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 22:40:58.895754 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-ed56fd10-5733-4dcc-92d2-88c3de006426 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] HTTP exception thrown: Security group ebfecb56-4dfa-4ea3-af2d-6457426dbc5e does not exist Jul 19 22:40:58.895754 n-d-847009-3 devstack@n-api.service[119337]: Neutron server returns request_ids: ['req-4b7a0799-76ab-465c-ba71-73a33479a35f'] Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ed56fd10-5733-4dcc-92d2-88c3de006426 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Request method failure captured: Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/os-security-groups/ebfecb56-4dfa-4ea3-af2d-6457426dbc5e HTTP/1.1 Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zLOcBnDO8DB0TvfRIhrSs2i1Z8gf2mXRu9CWG3-L53ppyrrqccAldlD1sn80tAiiaYj788W6zk_H_lFv9A7zGAIhHM_mj3-7IRMW_3igT7vOPEp-kC_qbKwdmn2JH9DflRdkn_IaARtkReZyhJI3DiZyzYUOJLxFUfr88ChX6WBaz8 Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 6994ad3a701847d49163a7b709fba400 Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: exception: Security group ebfecb56-4dfa-4ea3-af2d-6457426dbc5e does not exist Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: Neutron server returns request_ids: ['req-4b7a0799-76ab-465c-ba71-73a33479a35f'] Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'ebfecb56-4dfa-4ea3-af2d-6457426dbc5e'} Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 22:40:58.909001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ebfecb56-4dfa-4ea3-af2d-6457426dbc5e does not exist Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b7a0799-76ab-465c-ba71-73a33479a35f'] Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ebfecb56-4dfa-4ea3-af2d-6457426dbc5e does not exist Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b7a0799-76ab-465c-ba71-73a33479a35f'] Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ebfecb56-4dfa-4ea3-af2d-6457426dbc5e does not exist Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b7a0799-76ab-465c-ba71-73a33479a35f'] Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ebfecb56-4dfa-4ea3-af2d-6457426dbc5e does not exist Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b7a0799-76ab-465c-ba71-73a33479a35f'] Jul 19 22:40:58.921826 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:40:58.940579 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ed56fd10-5733-4dcc-92d2-88c3de006426 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Returning 404 to user: Security group ebfecb56-4dfa-4ea3-af2d-6457426dbc5e does not exist Jul 19 22:40:58.940579 n-d-847009-3 devstack@n-api.service[119337]: Neutron server returns request_ids: ['req-4b7a0799-76ab-465c-ba71-73a33479a35f'] {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:40:58.950930 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ed56fd10-5733-4dcc-92d2-88c3de006426 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/ebfecb56-4dfa-4ea3-af2d-6457426dbc5e" status: 404 len: 194 microversion: 2.1 time: 0.195715 Jul 19 22:40:58.956801 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1516/3064] 10.222.0.25 () {58 vars in 1268 bytes} [Tue Jul 19 22:40:58 2022] GET /compute/v2.1/os-security-groups/ebfecb56-4dfa-4ea3-af2d-6457426dbc5e => generated 194 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:40:58.988490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-656eb48b-90f1-4dd9-84fd-e615c3ce08e2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:58.999767 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-656eb48b-90f1-4dd9-84fd-e615c3ce08e2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 976f2ec1-c70b-4795-a71d-251bed15ad25] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:59.015054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-656eb48b-90f1-4dd9-84fd-e615c3ce08e2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:59.016952 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-656eb48b-90f1-4dd9-84fd-e615c3ce08e2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:59.019092 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-656eb48b-90f1-4dd9-84fd-e615c3ce08e2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:59.020375 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-656eb48b-90f1-4dd9-84fd-e615c3ce08e2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:59.609608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b79765bb-89c8-4e28-9ea2-0cc3722821e9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:59.618953 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b79765bb-89c8-4e28-9ea2-0cc3722821e9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517" status: 200 len: 1486 microversion: 2.1 time: 0.761758 Jul 19 22:40:59.621444 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1549/3065] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:58 2022] GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517 => generated 1486 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:40:59.627818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-16e22b97-9ca5-4d4c-84a7-f8189a4621c9 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '.version_select at 0x7f7a1098a040>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:59.734393 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-656eb48b-90f1-4dd9-84fd-e615c3ce08e2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:40:59.746164 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-656eb48b-90f1-4dd9-84fd-e615c3ce08e2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25" status: 200 len: 1510 microversion: 2.1 time: 0.782428 Jul 19 22:40:59.756511 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1517/3066] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:58 2022] GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25 => generated 1510 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:40:59.769922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4c2e5fe2-a5df-4477-a3eb-2ea27033a1a6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:40:59.770868 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4c2e5fe2-a5df-4477-a3eb-2ea27033a1a6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:40:59.796467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c2e5fe2-a5df-4477-a3eb-2ea27033a1a6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:59.801026 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c2e5fe2-a5df-4477-a3eb-2ea27033a1a6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:40:59.802725 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c2e5fe2-a5df-4477-a3eb-2ea27033a1a6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:40:59.806675 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c2e5fe2-a5df-4477-a3eb-2ea27033a1a6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:00.632727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4c2e5fe2-a5df-4477-a3eb-2ea27033a1a6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:00.657099 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4c2e5fe2-a5df-4477-a3eb-2ea27033a1a6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1314 microversion: 2.1 time: 0.907906 Jul 19 22:41:00.659663 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1518/3067] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:40:59 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1314 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:00.667876 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-702a0f77-df4b-44e9-8071-ab3c011333bf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:00.668923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-702a0f77-df4b-44e9-8071-ab3c011333bf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: e0ada988-0937-4623-a7a6-b7bc4a69f517] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:00.679021 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-702a0f77-df4b-44e9-8071-ab3c011333bf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:00.680495 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-702a0f77-df4b-44e9-8071-ab3c011333bf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:00.681963 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-702a0f77-df4b-44e9-8071-ab3c011333bf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:00.683453 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-702a0f77-df4b-44e9-8071-ab3c011333bf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:00.772079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-702a0f77-df4b-44e9-8071-ab3c011333bf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: e0ada988-0937-4623-a7a6-b7bc4a69f517] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:41:01.032288 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-702a0f77-df4b-44e9-8071-ab3c011333bf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517" status: 204 len: 0 microversion: 2.1 time: 0.369654 Jul 19 22:41:01.033964 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-16e22b97-9ca5-4d4c-84a7-f8189a4621c9 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/3eb12adc-a23a-4260-a3b1-210ae36edac7" status: 202 len: 0 microversion: 2.1 time: 1.411037 Jul 19 22:41:01.034674 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1550/3068] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:40:59 2022] DELETE /compute/v2.1/os-security-groups/3eb12adc-a23a-4260-a3b1-210ae36edac7 => generated 0 bytes in 1412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:41:01.036216 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1519/3069] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:41:00 2022] DELETE /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:41:01.040263 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c8b360ca-a339-437c-b630-8c9556b59f50 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:01.044956 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c8b360ca-a339-437c-b630-8c9556b59f50 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:01.045416 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.compute.servers [None req-c8b360ca-a339-437c-b630-8c9556b59f50 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Removing options 'limit' from query {{(pid=119338) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 19 22:41:01.052725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c8b360ca-a339-437c-b630-8c9556b59f50 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Searching by: {'deleted': False, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4'} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:41:01.064164 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8b360ca-a339-437c-b630-8c9556b59f50 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:01.066451 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8b360ca-a339-437c-b630-8c9556b59f50 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:01.085600 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8b360ca-a339-437c-b630-8c9556b59f50 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:01.087573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8b360ca-a339-437c-b630-8c9556b59f50 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:01.091806 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c8b360ca-a339-437c-b630-8c9556b59f50 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.055985 Jul 19 22:41:01.106622 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1551/3070] 10.222.0.25 () {58 vars in 1139 bytes} [Tue Jul 19 22:41:01 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:41:01.115034 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-194d51be-948e-4d6a-95a6-df82c97cbb3b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '.version_select at 0x7f7a10043790>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:01.312692 n-d-847009-3 devstack@n-api.service[119338]: DEBUG neutronclient.v2_0.client [None req-194d51be-948e-4d6a-95a6-df82c97cbb3b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3eb12adc-a23a-4260-a3b1-210ae36edac7 does not exist", "detail": ""}} {{(pid=119338) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 22:41:01.313868 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.security_group_api [None req-194d51be-948e-4d6a-95a6-df82c97cbb3b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Neutron security group 3eb12adc-a23a-4260-a3b1-210ae36edac7 not found {{(pid=119338) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 22:41:01.314640 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-194d51be-948e-4d6a-95a6-df82c97cbb3b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] HTTP exception thrown: Security group 3eb12adc-a23a-4260-a3b1-210ae36edac7 does not exist Jul 19 22:41:01.314640 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-d3c0486c-e35c-4769-ba9f-bd57e93667bd'] Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-194d51be-948e-4d6a-95a6-df82c97cbb3b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Request method failure captured: Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/os-security-groups/3eb12adc-a23a-4260-a3b1-210ae36edac7 HTTP/1.1 Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zLOcBnDO8DB0TvfRIhrSs2i1Z8gf2mXRu9CWG3-L53ppyrrqccAldlD1sn80tAiiaYj788W6zk_H_lFv9A7zGAIhHM_mj3-7IRMW_3igT7vOPEp-kC_qbKwdmn2JH9DflRdkn_IaARtkReZyhJI3DiZyzYUOJLxFUfr88ChX6WBaz8 Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 6994ad3a701847d49163a7b709fba400 Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: exception: Security group 3eb12adc-a23a-4260-a3b1-210ae36edac7 does not exist Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-d3c0486c-e35c-4769-ba9f-bd57e93667bd'] Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '3eb12adc-a23a-4260-a3b1-210ae36edac7'} Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 22:41:01.317704 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3eb12adc-a23a-4260-a3b1-210ae36edac7 does not exist Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3c0486c-e35c-4769-ba9f-bd57e93667bd'] Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3eb12adc-a23a-4260-a3b1-210ae36edac7 does not exist Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3c0486c-e35c-4769-ba9f-bd57e93667bd'] Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3eb12adc-a23a-4260-a3b1-210ae36edac7 does not exist Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3c0486c-e35c-4769-ba9f-bd57e93667bd'] Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3eb12adc-a23a-4260-a3b1-210ae36edac7 does not exist Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3c0486c-e35c-4769-ba9f-bd57e93667bd'] Jul 19 22:41:01.322073 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:01.328126 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-194d51be-948e-4d6a-95a6-df82c97cbb3b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Returning 404 to user: Security group 3eb12adc-a23a-4260-a3b1-210ae36edac7 does not exist Jul 19 22:41:01.328126 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-d3c0486c-e35c-4769-ba9f-bd57e93667bd'] {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:41:01.330075 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-194d51be-948e-4d6a-95a6-df82c97cbb3b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/3eb12adc-a23a-4260-a3b1-210ae36edac7" status: 404 len: 194 microversion: 2.1 time: 0.221898 Jul 19 22:41:01.330813 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1552/3071] 10.222.0.25 () {58 vars in 1268 bytes} [Tue Jul 19 22:41:01 2022] GET /compute/v2.1/os-security-groups/3eb12adc-a23a-4260-a3b1-210ae36edac7 => generated 194 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:41:01.342754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-da1d04a8-9b99-4da2-98e4-9d41e050203b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:01.343400 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-da1d04a8-9b99-4da2-98e4-9d41e050203b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: e0ada988-0937-4623-a7a6-b7bc4a69f517] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:01.354979 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da1d04a8-9b99-4da2-98e4-9d41e050203b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:01.355498 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da1d04a8-9b99-4da2-98e4-9d41e050203b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:01.361407 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da1d04a8-9b99-4da2-98e4-9d41e050203b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:01.361847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da1d04a8-9b99-4da2-98e4-9d41e050203b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:01.539764 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-af2e901b-f8a5-47ea-b115-d34833002084 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1411957752", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:01.665388 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-af2e901b-f8a5-47ea-b115-d34833002084 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] validate_networks() for [('28157aa0-af40-4f43-80ee-68fa54c01fa6', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:41:02.082841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-da1d04a8-9b99-4da2-98e4-9d41e050203b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:02.098169 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-da1d04a8-9b99-4da2-98e4-9d41e050203b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517" status: 200 len: 1492 microversion: 2.1 time: 0.764069 Jul 19 22:41:02.102322 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1553/3072] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:01 2022] GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517 => generated 1492 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:02.108329 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e4e8ef7c-a096-451c-88d9-d1a4c2661b44 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:02.109073 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e4e8ef7c-a096-451c-88d9-d1a4c2661b44 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 976f2ec1-c70b-4795-a71d-251bed15ad25] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:02.125494 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e4e8ef7c-a096-451c-88d9-d1a4c2661b44 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:02.126627 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e4e8ef7c-a096-451c-88d9-d1a4c2661b44 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:02.128065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e4e8ef7c-a096-451c-88d9-d1a4c2661b44 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:02.129163 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e4e8ef7c-a096-451c-88d9-d1a4c2661b44 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:03.190989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e4e8ef7c-a096-451c-88d9-d1a4c2661b44 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:03.209762 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e4e8ef7c-a096-451c-88d9-d1a4c2661b44 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25" status: 200 len: 1510 microversion: 2.1 time: 1.105676 Jul 19 22:41:03.212374 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1554/3073] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:02 2022] GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25 => generated 1510 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:03.224738 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b730bed2-afae-49e6-88b7-6ec88f33db4a tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '.version_select at 0x7f7a104268b0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:03.765177 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:41:03.885888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-af2e901b-f8a5-47ea-b115-d34833002084 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:41:03.886327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-af2e901b-f8a5-47ea-b115-d34833002084 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:41:03.886808 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-af2e901b-f8a5-47ea-b115-d34833002084 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:41:03.887514 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-af2e901b-f8a5-47ea-b115-d34833002084 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:41:03.887974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-af2e901b-f8a5-47ea-b115-d34833002084 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:41:03.915842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af2e901b-f8a5-47ea-b115-d34833002084 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:03.919991 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af2e901b-f8a5-47ea-b115-d34833002084 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:03.922126 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af2e901b-f8a5-47ea-b115-d34833002084 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:03.923262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af2e901b-f8a5-47ea-b115-d34833002084 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:03.980800 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-af2e901b-f8a5-47ea-b115-d34833002084 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Getting quotas for project 5a26234ff8b14bbcb4891ef363fb4739. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:41:03.998288 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-af2e901b-f8a5-47ea-b115-d34833002084 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Getting quotas for user 7bc703828daa4c7ea61106f3b4e3bc3f and project 5a26234ff8b14bbcb4891ef363fb4739. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:41:04.031286 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-af2e901b-f8a5-47ea-b115-d34833002084 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:41:04.038306 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-af2e901b-f8a5-47ea-b115-d34833002084 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:41:04.192401 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-af2e901b-f8a5-47ea-b115-d34833002084 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.151526 Jul 19 22:41:04.201061 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1520/3074] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:41:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 3162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:41:04.225538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6e234a07-f6d8-4357-9a04-c304c50a2bd6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:04.226586 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6e234a07-f6d8-4357-9a04-c304c50a2bd6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:04.258553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e234a07-f6d8-4357-9a04-c304c50a2bd6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:04.261170 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e234a07-f6d8-4357-9a04-c304c50a2bd6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:04.263213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e234a07-f6d8-4357-9a04-c304c50a2bd6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:04.265363 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e234a07-f6d8-4357-9a04-c304c50a2bd6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:04.461287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:41:04.495063 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b730bed2-afae-49e6-88b7-6ec88f33db4a tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 1.280405 Jul 19 22:41:04.504489 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1555/3075] 10.222.0.25 () {58 vars in 1157 bytes} [Tue Jul 19 22:41:03 2022] GET /compute/v2.1/os-security-groups => generated 1155 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:04.827380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9cd47690-3caf-4ede-868c-03e398237b4f tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-213756587", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": "none"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:04.966681 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-9cd47690-3caf-4ede-868c-03e398237b4f tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:41:04.970043 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-9cd47690-3caf-4ede-868c-03e398237b4f tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:41:04.970769 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-9cd47690-3caf-4ede-868c-03e398237b4f tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:41:04.971688 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-9cd47690-3caf-4ede-868c-03e398237b4f tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:41:04.974973 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-9cd47690-3caf-4ede-868c-03e398237b4f tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:41:05.007781 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9cd47690-3caf-4ede-868c-03e398237b4f tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:05.012990 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9cd47690-3caf-4ede-868c-03e398237b4f tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:05.018671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9cd47690-3caf-4ede-868c-03e398237b4f tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:05.020197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9cd47690-3caf-4ede-868c-03e398237b4f tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:05.071820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-9cd47690-3caf-4ede-868c-03e398237b4f tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Getting quotas for project b2244dc755db4aa3bde9af782c0057ae. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:41:05.080878 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-9cd47690-3caf-4ede-868c-03e398237b4f tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Getting quotas for user 2820a440dc2341fcac6354e455963476 and project b2244dc755db4aa3bde9af782c0057ae. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:41:05.099927 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9cd47690-3caf-4ede-868c-03e398237b4f tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:41:05.102880 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9cd47690-3caf-4ede-868c-03e398237b4f tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 7bf08dc5-caee-4c7b-90b0-9742966bdcef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:41:05.118613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6e234a07-f6d8-4357-9a04-c304c50a2bd6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:05.131168 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6e234a07-f6d8-4357-9a04-c304c50a2bd6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1314 microversion: 2.1 time: 0.927094 Jul 19 22:41:05.131783 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1521/3076] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:04 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1314 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:05.155133 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-6f6a8df2-6417-4d6e-9250-9b0f10c1e5a0 req-f77b1b60-d4f1-4f1f-917b-a6ad4c8678bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "946bac4e-860b-4803-bb7c-bf7e9c8bd421", "tag": "7d347f88-5e47-4a16-a516-39b82c71196a"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:05.199872 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9cd47690-3caf-4ede-868c-03e398237b4f tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.693753 Jul 19 22:41:05.210067 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1556/3077] 10.222.0.25 () {62 vars in 1187 bytes} [Tue Jul 19 22:41:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 22:41:05.210868 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-6f6a8df2-6417-4d6e-9250-9b0f10c1e5a0 req-f77b1b60-d4f1-4f1f-917b-a6ad4c8678bb service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:05.215876 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-6f6a8df2-6417-4d6e-9250-9b0f10c1e5a0 req-f77b1b60-d4f1-4f1f-917b-a6ad4c8678bb service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:05.234887 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0ac1b070-ba65-41b8-868d-edd002eebdb6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:05.235975 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0ac1b070-ba65-41b8-868d-edd002eebdb6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: e0ada988-0937-4623-a7a6-b7bc4a69f517] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:05.247554 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ac1b070-ba65-41b8-868d-edd002eebdb6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:05.248743 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ac1b070-ba65-41b8-868d-edd002eebdb6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:05.250804 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ac1b070-ba65-41b8-868d-edd002eebdb6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:05.252024 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ac1b070-ba65-41b8-868d-edd002eebdb6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:05.279369 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-6f6a8df2-6417-4d6e-9250-9b0f10c1e5a0 req-f77b1b60-d4f1-4f1f-917b-a6ad4c8678bb service nova] Creating event network-changed:7d347f88-5e47-4a16-a516-39b82c71196a for instance 946bac4e-860b-4803-bb7c-bf7e9c8bd421 on n-h2-847009-3 Jul 19 22:41:05.293847 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-6f6a8df2-6417-4d6e-9250-9b0f10c1e5a0 req-f77b1b60-d4f1-4f1f-917b-a6ad4c8678bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145202 Jul 19 22:41:05.294924 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1522/3078] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:05.302704 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-be4a5bc0-433f-400c-b35f-b7be6334b070 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:05.305628 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-be4a5bc0-433f-400c-b35f-b7be6334b070 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 648bd230-03d9-4186-8cc0-64573fae2ab6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:05.339498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be4a5bc0-433f-400c-b35f-b7be6334b070 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:05.345118 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be4a5bc0-433f-400c-b35f-b7be6334b070 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:05.350574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be4a5bc0-433f-400c-b35f-b7be6334b070 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:05.353725 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be4a5bc0-433f-400c-b35f-b7be6334b070 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:05.572189 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0ac1b070-ba65-41b8-868d-edd002eebdb6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:05.620989 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0ac1b070-ba65-41b8-868d-edd002eebdb6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517" status: 200 len: 1450 microversion: 2.1 time: 0.408771 Jul 19 22:41:05.622918 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1557/3079] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:05 2022] GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517 => generated 1450 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:05.643618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e8172a52-9f74-4363-9e41-256b6761be23 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:05.649901 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e8172a52-9f74-4363-9e41-256b6761be23 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:05.694396 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8172a52-9f74-4363-9e41-256b6761be23 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:05.695058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8172a52-9f74-4363-9e41-256b6761be23 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:05.696102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8172a52-9f74-4363-9e41-256b6761be23 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:05.698567 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8172a52-9f74-4363-9e41-256b6761be23 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:05.985147 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e8172a52-9f74-4363-9e41-256b6761be23 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:06.000825 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e8172a52-9f74-4363-9e41-256b6761be23 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1210 microversion: 2.1 time: 0.374231 Jul 19 22:41:06.001465 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1558/3080] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:05 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1210 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:06.045895 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0c0c5c97-27e2-42a0-9b70-370fb48dbb0f tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Action: 'create', calling method: .version_select at 0x7f7a1014a430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-476990381", "description": "tempest-description-727789959"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:06.347299 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-be4a5bc0-433f-400c-b35f-b7be6334b070 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:06.372426 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-be4a5bc0-433f-400c-b35f-b7be6334b070 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/648bd230-03d9-4186-8cc0-64573fae2ab6" status: 200 len: 1512 microversion: 2.1 time: 1.074791 Jul 19 22:41:06.373949 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1523/3081] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:05 2022] GET /compute/v2.1/servers/648bd230-03d9-4186-8cc0-64573fae2ab6 => generated 1512 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:06.656505 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b7f48311-608c-4db4-bcc6-91784f589610 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:06.657155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b7f48311-608c-4db4-bcc6-91784f589610 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:06.666758 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7f48311-608c-4db4-bcc6-91784f589610 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:06.669986 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7f48311-608c-4db4-bcc6-91784f589610 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:06.671267 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7f48311-608c-4db4-bcc6-91784f589610 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:06.672001 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7f48311-608c-4db4-bcc6-91784f589610 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:06.713992 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b7f48311-608c-4db4-bcc6-91784f589610 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:41:06.903134 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0c0c5c97-27e2-42a0-9b70-370fb48dbb0f tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.900347 Jul 19 22:41:06.903944 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1559/3082] 10.222.0.25 () {60 vars in 1179 bytes} [Tue Jul 19 22:41:06 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:06.910054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-91db0b05-db53-4617-8dc3-0b64d25c8a66 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:06.918042 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-91db0b05-db53-4617-8dc3-0b64d25c8a66 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 7bf08dc5-caee-4c7b-90b0-9742966bdcef] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:06.949050 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91db0b05-db53-4617-8dc3-0b64d25c8a66 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:06.952473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91db0b05-db53-4617-8dc3-0b64d25c8a66 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:06.956899 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91db0b05-db53-4617-8dc3-0b64d25c8a66 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:06.957693 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91db0b05-db53-4617-8dc3-0b64d25c8a66 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:07.018239 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b7f48311-608c-4db4-bcc6-91784f589610 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 204 len: 0 microversion: 2.32 time: 0.642438 Jul 19 22:41:07.021875 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1524/3083] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 22:41:06 2022] DELETE /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:41:07.049861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bdd30f6e-df5c-438a-80ab-9809b059b4bf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:07.050957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bdd30f6e-df5c-438a-80ab-9809b059b4bf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:07.086738 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:41:07.088971 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bdd30f6e-df5c-438a-80ab-9809b059b4bf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:07.089681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bdd30f6e-df5c-438a-80ab-9809b059b4bf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:07.090680 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bdd30f6e-df5c-438a-80ab-9809b059b4bf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:07.091324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bdd30f6e-df5c-438a-80ab-9809b059b4bf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:07.437225 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-91db0b05-db53-4617-8dc3-0b64d25c8a66 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:07.451631 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-91db0b05-db53-4617-8dc3-0b64d25c8a66 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:07.458616 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-91db0b05-db53-4617-8dc3-0b64d25c8a66 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:07.459777 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-91db0b05-db53-4617-8dc3-0b64d25c8a66 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf08dc5-caee-4c7b-90b0-9742966bdcef" status: 200 len: 1273 microversion: 2.47 time: 0.554494 Jul 19 22:41:07.467629 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1560/3084] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:06 2022] GET /compute/v2.1/servers/7bf08dc5-caee-4c7b-90b0-9742966bdcef => generated 1273 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:07.476089 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ee5c0df8-f92d-481a-ae2a-cb27eb522826 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:07.490812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ee5c0df8-f92d-481a-ae2a-cb27eb522826 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:07.501470 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee5c0df8-f92d-481a-ae2a-cb27eb522826 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:07.502249 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee5c0df8-f92d-481a-ae2a-cb27eb522826 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:07.503358 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee5c0df8-f92d-481a-ae2a-cb27eb522826 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:07.504013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee5c0df8-f92d-481a-ae2a-cb27eb522826 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:07.817566 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bdd30f6e-df5c-438a-80ab-9809b059b4bf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:07.841071 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bdd30f6e-df5c-438a-80ab-9809b059b4bf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1314 microversion: 2.1 time: 0.809782 Jul 19 22:41:07.842795 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1525/3085] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:07 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1314 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:07.854500 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-954cb2e6-108e-4f55-8ad1-1d3e42f2beab tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:07.855235 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-954cb2e6-108e-4f55-8ad1-1d3e42f2beab tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: e0ada988-0937-4623-a7a6-b7bc4a69f517] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:07.872816 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-954cb2e6-108e-4f55-8ad1-1d3e42f2beab tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:07.873253 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-954cb2e6-108e-4f55-8ad1-1d3e42f2beab tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:07.874059 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-954cb2e6-108e-4f55-8ad1-1d3e42f2beab tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:07.874502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-954cb2e6-108e-4f55-8ad1-1d3e42f2beab tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:07.934246 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-954cb2e6-108e-4f55-8ad1-1d3e42f2beab tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] HTTP exception thrown: Instance e0ada988-0937-4623-a7a6-b7bc4a69f517 could not be found. Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-954cb2e6-108e-4f55-8ad1-1d3e42f2beab tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Request method failure captured: Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517 HTTP/1.1 Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zJcOd8ioSoO4Ag7p0FuZhdyFBnwQELvoxLAsblThyrJ_2NxEo2CJ37EEfRT2CZdbZlGMRgWXNVEuSQUWOfX5krUiSHAMeusL8iD4FHXx0Nd2OURbeGsEBn_IDvsFz7TmW6c-8lxScCQfbEdKUx47XHZCtuEAW7dgjTFB9ANV0LmkTU Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: f4f40233895248229ddfdcd06fb65361 Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance e0ada988-0937-4623-a7a6-b7bc4a69f517 could not be found. Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'e0ada988-0937-4623-a7a6-b7bc4a69f517'} Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0ada988-0937-4623-a7a6-b7bc4a69f517 could not be found. Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0ada988-0937-4623-a7a6-b7bc4a69f517 could not be found. Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:07.935978 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:07.940063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:07.940063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:07.940063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:07.940063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:41:07.940063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:41:07.940063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0ada988-0937-4623-a7a6-b7bc4a69f517 could not be found. Jul 19 22:41:07.940063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:07.940063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-954cb2e6-108e-4f55-8ad1-1d3e42f2beab tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Returning 404 to user: Instance e0ada988-0937-4623-a7a6-b7bc4a69f517 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:41:07.940063 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-954cb2e6-108e-4f55-8ad1-1d3e42f2beab tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517" status: 404 len: 111 microversion: 2.1 time: 0.091997 Jul 19 22:41:07.969508 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1526/3086] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:07 2022] GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:41:07.990224 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d7f0c5c1-efcd-48ef-9781-500a640341ed tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Action: 'create', calling method: .version_select at 0x7f7a107b7280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1807043392", "description": "tempest-description-2083286647"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:08.212418 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ee5c0df8-f92d-481a-ae2a-cb27eb522826 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:08.229041 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ee5c0df8-f92d-481a-ae2a-cb27eb522826 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41" status: 200 len: 1511 microversion: 2.1 time: 0.759827 Jul 19 22:41:08.230675 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1561/3087] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:07 2022] GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41 => generated 1511 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:08.236696 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bb61584c-3ff1-48df-8be9-0fe816262c64 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:08.237576 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bb61584c-3ff1-48df-8be9-0fe816262c64 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:08.256738 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bb61584c-3ff1-48df-8be9-0fe816262c64 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:08.257414 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bb61584c-3ff1-48df-8be9-0fe816262c64 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:08.258963 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bb61584c-3ff1-48df-8be9-0fe816262c64 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:08.260009 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bb61584c-3ff1-48df-8be9-0fe816262c64 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:08.377282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bb61584c-3ff1-48df-8be9-0fe816262c64 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:08.389688 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bb61584c-3ff1-48df-8be9-0fe816262c64 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1272 microversion: 2.1 time: 0.157517 Jul 19 22:41:08.405012 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1562/3088] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:08 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1272 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:08.413671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6b107b9a-a741-44d2-8d8f-df11cfb698e2 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:08.414393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6b107b9a-a741-44d2-8d8f-df11cfb698e2 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:08.428566 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b107b9a-a741-44d2-8d8f-df11cfb698e2 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:08.429267 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b107b9a-a741-44d2-8d8f-df11cfb698e2 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:08.430671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b107b9a-a741-44d2-8d8f-df11cfb698e2 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:08.433939 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b107b9a-a741-44d2-8d8f-df11cfb698e2 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:08.597437 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d7f0c5c1-efcd-48ef-9781-500a640341ed tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.625933 Jul 19 22:41:08.599323 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1527/3089] 10.222.0.25 () {60 vars in 1179 bytes} [Tue Jul 19 22:41:07 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:08.629311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-75ddecda-077f-42c5-9b6b-44693d7e888f req-c4af0a10-1a22-4018-b6a8-c1b29f038828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ada988-0937-4623-a7a6-b7bc4a69f517", "name": "network-vif-deleted", "tag": "60cde104-fb4e-4266-87dc-e6875242dfb1"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:08.684338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-75ddecda-077f-42c5-9b6b-44693d7e888f req-c4af0a10-1a22-4018-b6a8-c1b29f038828 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:08.684338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-75ddecda-077f-42c5-9b6b-44693d7e888f req-c4af0a10-1a22-4018-b6a8-c1b29f038828 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:08.718427 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-75ddecda-077f-42c5-9b6b-44693d7e888f req-c4af0a10-1a22-4018-b6a8-c1b29f038828 service nova] Creating event network-vif-deleted:60cde104-fb4e-4266-87dc-e6875242dfb1 for instance e0ada988-0937-4623-a7a6-b7bc4a69f517 on n-h1-847009-3 Jul 19 22:41:08.739777 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-75ddecda-077f-42c5-9b6b-44693d7e888f req-c4af0a10-1a22-4018-b6a8-c1b29f038828 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134640 Jul 19 22:41:08.740676 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1528/3090] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:08.759589 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eb3779f9-0cd0-4bcb-a263-6c50eacb9d8e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1429974043", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": "none"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:08.875602 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-eb3779f9-0cd0-4bcb-a263-6c50eacb9d8e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:41:08.876362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-eb3779f9-0cd0-4bcb-a263-6c50eacb9d8e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:41:08.876626 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-eb3779f9-0cd0-4bcb-a263-6c50eacb9d8e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:41:08.877057 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-eb3779f9-0cd0-4bcb-a263-6c50eacb9d8e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:41:08.877479 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-eb3779f9-0cd0-4bcb-a263-6c50eacb9d8e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:41:08.892945 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb3779f9-0cd0-4bcb-a263-6c50eacb9d8e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:08.893707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb3779f9-0cd0-4bcb-a263-6c50eacb9d8e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:08.894766 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb3779f9-0cd0-4bcb-a263-6c50eacb9d8e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:08.895516 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb3779f9-0cd0-4bcb-a263-6c50eacb9d8e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:08.918448 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-eb3779f9-0cd0-4bcb-a263-6c50eacb9d8e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Getting quotas for project b2244dc755db4aa3bde9af782c0057ae. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:41:08.925157 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-eb3779f9-0cd0-4bcb-a263-6c50eacb9d8e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Getting quotas for user 2820a440dc2341fcac6354e455963476 and project b2244dc755db4aa3bde9af782c0057ae. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:41:08.926309 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6b107b9a-a741-44d2-8d8f-df11cfb698e2 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:08.950052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6b107b9a-a741-44d2-8d8f-df11cfb698e2 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:08.952212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eb3779f9-0cd0-4bcb-a263-6c50eacb9d8e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:41:08.952373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6b107b9a-a741-44d2-8d8f-df11cfb698e2 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:08.955626 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6b107b9a-a741-44d2-8d8f-df11cfb698e2 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 2952 microversion: 2.32 time: 0.546224 Jul 19 22:41:08.967319 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1563/3091] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:08 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 2952 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:08.968041 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eb3779f9-0cd0-4bcb-a263-6c50eacb9d8e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:41:09.035004 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eb3779f9-0cd0-4bcb-a263-6c50eacb9d8e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.291417 Jul 19 22:41:09.038263 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1529/3092] 10.222.0.25 () {62 vars in 1187 bytes} [Tue Jul 19 22:41:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 297 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 22:41:09.052240 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4c3bbf0b-3d75-4944-86b5-300d6ac17b87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-42136497", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "87c331fb-040c-45fc-a9a1-e946f840de97"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:09.092138 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6bdd0bbe-83b5-43ab-8a74-b087a565989e tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Action: 'create', calling method: .version_select at 0x7f7a03fce670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1138350450", "description": "tempest-description-654090079"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:09.197462 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-4c3bbf0b-3d75-4944-86b5-300d6ac17b87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] validate_networks() for [('87c331fb-040c-45fc-a9a1-e946f840de97', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:41:10.168321 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6bdd0bbe-83b5-43ab-8a74-b087a565989e tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.209679 Jul 19 22:41:10.169217 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1564/3093] 10.222.0.25 () {60 vars in 1179 bytes} [Tue Jul 19 22:41:08 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:10.182722 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-65da80c0-f55e-4b17-bf35-1018e38bd1c2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:10.188222 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-65da80c0-f55e-4b17-bf35-1018e38bd1c2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:10.189629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-65da80c0-f55e-4b17-bf35-1018e38bd1c2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4'} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:41:10.586771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65da80c0-f55e-4b17-bf35-1018e38bd1c2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:10.586771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65da80c0-f55e-4b17-bf35-1018e38bd1c2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:10.586771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65da80c0-f55e-4b17-bf35-1018e38bd1c2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:10.588249 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65da80c0-f55e-4b17-bf35-1018e38bd1c2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:10.788963 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.multi_cell_list [None req-65da80c0-f55e-4b17-bf35-1018e38bd1c2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119338) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:41:10.888693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4c3bbf0b-3d75-4944-86b5-300d6ac17b87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:41:10.889340 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4c3bbf0b-3d75-4944-86b5-300d6ac17b87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:41:10.889655 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4c3bbf0b-3d75-4944-86b5-300d6ac17b87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:41:10.890073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4c3bbf0b-3d75-4944-86b5-300d6ac17b87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:41:10.890524 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4c3bbf0b-3d75-4944-86b5-300d6ac17b87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:41:10.911360 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c3bbf0b-3d75-4944-86b5-300d6ac17b87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:10.912265 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c3bbf0b-3d75-4944-86b5-300d6ac17b87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:10.913257 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c3bbf0b-3d75-4944-86b5-300d6ac17b87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:10.913857 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c3bbf0b-3d75-4944-86b5-300d6ac17b87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:10.921534 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-65da80c0-f55e-4b17-bf35-1018e38bd1c2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 346 microversion: 2.1 time: 0.751217 Jul 19 22:41:10.922669 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1565/3094] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Jul 19 22:41:10 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 346 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:10.931194 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-21375694-8355-4336-acd5-35929837c1ec tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-827151604", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "ee934865-b463-4ab4-828c-235f316df8ae"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:10.969777 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-4c3bbf0b-3d75-4944-86b5-300d6ac17b87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Getting quotas for project a2bcdb843a7d4a1ebe467160eee0d6e1. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:41:10.976741 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-4c3bbf0b-3d75-4944-86b5-300d6ac17b87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Getting quotas for user f4f40233895248229ddfdcd06fb65361 and project a2bcdb843a7d4a1ebe467160eee0d6e1. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:41:11.017478 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4c3bbf0b-3d75-4944-86b5-300d6ac17b87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:41:11.020048 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4c3bbf0b-3d75-4944-86b5-300d6ac17b87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:41:11.052283 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-21375694-8355-4336-acd5-35929837c1ec tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] validate_networks() for [('ee934865-b463-4ab4-828c-235f316df8ae', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:41:11.075926 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4c3bbf0b-3d75-4944-86b5-300d6ac17b87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.035588 Jul 19 22:41:11.077654 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1530/3095] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:41:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:41:11.086372 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-92b10515-0744-45d2-94aa-fcb3cb5cd760 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:11.088055 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-92b10515-0744-45d2-94aa-fcb3cb5cd760 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:11.097379 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-92b10515-0744-45d2-94aa-fcb3cb5cd760 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:11.098416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-92b10515-0744-45d2-94aa-fcb3cb5cd760 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:11.100130 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-92b10515-0744-45d2-94aa-fcb3cb5cd760 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:11.101091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-92b10515-0744-45d2-94aa-fcb3cb5cd760 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:11.108280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:41:11.700320 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-92b10515-0744-45d2-94aa-fcb3cb5cd760 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:11.712401 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-92b10515-0744-45d2-94aa-fcb3cb5cd760 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1314 microversion: 2.1 time: 0.632748 Jul 19 22:41:11.715163 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1531/3096] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:11 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1314 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:11.734131 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e78d387c-c610-4e5d-b706-d4922b37ea61 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:11.736569 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e78d387c-c610-4e5d-b706-d4922b37ea61 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:11.748741 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e78d387c-c610-4e5d-b706-d4922b37ea61 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:11.750010 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e78d387c-c610-4e5d-b706-d4922b37ea61 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:11.751626 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e78d387c-c610-4e5d-b706-d4922b37ea61 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:11.752617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e78d387c-c610-4e5d-b706-d4922b37ea61 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:11.830583 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e78d387c-c610-4e5d-b706-d4922b37ea61 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "PUT /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 200 len: 1048 microversion: 2.47 time: 0.112359 Jul 19 22:41:11.834443 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1532/3097] 10.222.0.25 () {62 vars in 1296 bytes} [Tue Jul 19 22:41:11 2022] PUT /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 1048 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:11.842449 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-949fdfec-9344-47b2-bd0e-5b7d933a2492 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:11.844173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-949fdfec-9344-47b2-bd0e-5b7d933a2492 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:11.853836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-949fdfec-9344-47b2-bd0e-5b7d933a2492 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:11.855094 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-949fdfec-9344-47b2-bd0e-5b7d933a2492 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:11.856234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-949fdfec-9344-47b2-bd0e-5b7d933a2492 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:11.856902 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-949fdfec-9344-47b2-bd0e-5b7d933a2492 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:12.417877 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-21375694-8355-4336-acd5-35929837c1ec tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:41:12.419042 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-21375694-8355-4336-acd5-35929837c1ec tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:41:12.419827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-21375694-8355-4336-acd5-35929837c1ec tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:41:12.420690 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-21375694-8355-4336-acd5-35929837c1ec tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:41:12.421354 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-21375694-8355-4336-acd5-35929837c1ec tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:41:12.433706 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-21375694-8355-4336-acd5-35929837c1ec tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:12.434570 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-21375694-8355-4336-acd5-35929837c1ec tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:12.435812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-21375694-8355-4336-acd5-35929837c1ec tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:12.436736 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-21375694-8355-4336-acd5-35929837c1ec tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:12.478183 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-21375694-8355-4336-acd5-35929837c1ec tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Getting quotas for project 24647fdcb5d7402ebfdca8ea2ae72e2d. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:41:12.487231 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-21375694-8355-4336-acd5-35929837c1ec tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Getting quotas for user 6994ad3a701847d49163a7b709fba400 and project 24647fdcb5d7402ebfdca8ea2ae72e2d. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:41:12.506813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-21375694-8355-4336-acd5-35929837c1ec tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:41:12.510933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-21375694-8355-4336-acd5-35929837c1ec tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: 063af6c1-3ce5-4da4-95f7-dae4e720f7fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:41:12.519361 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-949fdfec-9344-47b2-bd0e-5b7d933a2492 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:12.540136 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-949fdfec-9344-47b2-bd0e-5b7d933a2492 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1314 microversion: 2.1 time: 0.704033 Jul 19 22:41:12.541514 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1533/3098] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:11 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1314 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:12.546533 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6ae511dc-53d3-4f28-8975-ba7e2f65963a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:12.552135 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6ae511dc-53d3-4f28-8975-ba7e2f65963a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:12.569358 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6ae511dc-53d3-4f28-8975-ba7e2f65963a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:12.571296 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6ae511dc-53d3-4f28-8975-ba7e2f65963a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:12.573695 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6ae511dc-53d3-4f28-8975-ba7e2f65963a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:12.576470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6ae511dc-53d3-4f28-8975-ba7e2f65963a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:12.622274 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-21375694-8355-4336-acd5-35929837c1ec tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.697703 Jul 19 22:41:12.624273 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1566/3099] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:41:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:41:12.635934 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1f05171d-1837-4120-9d7b-4a690d2ff716 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Action: 'create', calling method: .version_select at 0x7f7a03fe5040>, body: {"security_group_rule": {"parent_group_id": "e5302362-be66-4e05-a182-85cccbc21391", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:13.168374 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6ae511dc-53d3-4f28-8975-ba7e2f65963a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:13.199160 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6ae511dc-53d3-4f28-8975-ba7e2f65963a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:13.218149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6ae511dc-53d3-4f28-8975-ba7e2f65963a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:13.223487 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6ae511dc-53d3-4f28-8975-ba7e2f65963a tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 2952 microversion: 2.32 time: 0.680510 Jul 19 22:41:13.224934 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1534/3100] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:12 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 2952 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:13.243047 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9e5f9097-edb1-46c1-b457-fbf6c62728b4 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:13.243711 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9e5f9097-edb1-46c1-b457-fbf6c62728b4 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 976f2ec1-c70b-4795-a71d-251bed15ad25] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:13.256994 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9e5f9097-edb1-46c1-b457-fbf6c62728b4 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:13.257454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9e5f9097-edb1-46c1-b457-fbf6c62728b4 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:13.258978 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9e5f9097-edb1-46c1-b457-fbf6c62728b4 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:13.259864 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9e5f9097-edb1-46c1-b457-fbf6c62728b4 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:13.871307 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1f05171d-1837-4120-9d7b-4a690d2ff716 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.245149 Jul 19 22:41:13.881174 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1567/3101] 10.222.0.25 () {60 vars in 1194 bytes} [Tue Jul 19 22:41:12 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:13.886703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-53698a1a-29a7-4bb6-88ac-b4bfac6be027 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:13.887650 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-53698a1a-29a7-4bb6-88ac-b4bfac6be027 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:13.896926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53698a1a-29a7-4bb6-88ac-b4bfac6be027 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:13.897399 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53698a1a-29a7-4bb6-88ac-b4bfac6be027 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:13.898218 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53698a1a-29a7-4bb6-88ac-b4bfac6be027 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:13.898882 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53698a1a-29a7-4bb6-88ac-b4bfac6be027 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:13.964423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9e5f9097-edb1-46c1-b457-fbf6c62728b4 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:13.976102 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9e5f9097-edb1-46c1-b457-fbf6c62728b4 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25" status: 200 len: 1510 microversion: 2.1 time: 0.749217 Jul 19 22:41:13.978122 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1535/3102] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:13 2022] GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25 => generated 1510 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:13.984483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e49862cb-3d93-4543-a1ae-d02b7b52647e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:13.985434 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e49862cb-3d93-4543-a1ae-d02b7b52647e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:13.996189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e49862cb-3d93-4543-a1ae-d02b7b52647e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:13.996966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e49862cb-3d93-4543-a1ae-d02b7b52647e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:13.998331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e49862cb-3d93-4543-a1ae-d02b7b52647e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:13.998981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e49862cb-3d93-4543-a1ae-d02b7b52647e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:14.112161 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-53698a1a-29a7-4bb6-88ac-b4bfac6be027 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:14.123415 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-53698a1a-29a7-4bb6-88ac-b4bfac6be027 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1271 microversion: 2.1 time: 0.240740 Jul 19 22:41:14.124233 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1568/3103] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:13 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1271 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:14.129277 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-d58017d8-c5ca-4094-8119-9c1fc831394a req-c2adec00-d3d0-457d-80ea-c092842e161f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "946bac4e-860b-4803-bb7c-bf7e9c8bd421", "name": "network-vif-plugged", "status": "completed", "tag": "7d347f88-5e47-4a16-a516-39b82c71196a"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:14.148186 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d58017d8-c5ca-4094-8119-9c1fc831394a req-c2adec00-d3d0-457d-80ea-c092842e161f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:14.149763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d58017d8-c5ca-4094-8119-9c1fc831394a req-c2adec00-d3d0-457d-80ea-c092842e161f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:14.166833 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-d58017d8-c5ca-4094-8119-9c1fc831394a req-c2adec00-d3d0-457d-80ea-c092842e161f service nova] Creating event network-vif-plugged:7d347f88-5e47-4a16-a516-39b82c71196a for instance 946bac4e-860b-4803-bb7c-bf7e9c8bd421 on n-h2-847009-3 Jul 19 22:41:14.173917 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-d58017d8-c5ca-4094-8119-9c1fc831394a req-c2adec00-d3d0-457d-80ea-c092842e161f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048050 Jul 19 22:41:14.174644 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1569/3104] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:14.183478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f367fd26-3511-437e-bf6c-fa980d21d17e tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:14.184210 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f367fd26-3511-437e-bf6c-fa980d21d17e tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: 063af6c1-3ce5-4da4-95f7-dae4e720f7fe] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:14.192081 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f367fd26-3511-437e-bf6c-fa980d21d17e tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:14.192548 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f367fd26-3511-437e-bf6c-fa980d21d17e tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:14.193361 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f367fd26-3511-437e-bf6c-fa980d21d17e tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:14.193806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f367fd26-3511-437e-bf6c-fa980d21d17e tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:14.560594 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e49862cb-3d93-4543-a1ae-d02b7b52647e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:14.576935 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e49862cb-3d93-4543-a1ae-d02b7b52647e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:14.578921 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e49862cb-3d93-4543-a1ae-d02b7b52647e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:14.580275 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e49862cb-3d93-4543-a1ae-d02b7b52647e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 200 len: 1336 microversion: 2.47 time: 0.600236 Jul 19 22:41:14.581101 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1536/3105] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:13 2022] GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 1336 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:14.586242 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b65804de-ee79-47f9-9b26-5d99f63fe5ec tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:14.587294 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b65804de-ee79-47f9-9b26-5d99f63fe5ec tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:14.603315 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b65804de-ee79-47f9-9b26-5d99f63fe5ec tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:14.608268 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b65804de-ee79-47f9-9b26-5d99f63fe5ec tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:14.609132 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b65804de-ee79-47f9-9b26-5d99f63fe5ec tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:14.609645 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b65804de-ee79-47f9-9b26-5d99f63fe5ec tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:14.722067 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f367fd26-3511-437e-bf6c-fa980d21d17e tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6994ad3a701847d49163a7b709fba400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24647fdcb5d7402ebfdca8ea2ae72e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:14.734828 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f367fd26-3511-437e-bf6c-fa980d21d17e tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe" status: 200 len: 1267 microversion: 2.1 time: 0.558234 Jul 19 22:41:14.736188 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1570/3106] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:14 2022] GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe => generated 1267 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:14.748320 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-86a1faf7-b8ee-4aad-a522-236cb8812782 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:14.751909 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-86a1faf7-b8ee-4aad-a522-236cb8812782 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:14.762234 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86a1faf7-b8ee-4aad-a522-236cb8812782 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:14.763035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86a1faf7-b8ee-4aad-a522-236cb8812782 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:14.763894 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86a1faf7-b8ee-4aad-a522-236cb8812782 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:14.764329 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86a1faf7-b8ee-4aad-a522-236cb8812782 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:15.390866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b65804de-ee79-47f9-9b26-5d99f63fe5ec tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:15.404178 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b65804de-ee79-47f9-9b26-5d99f63fe5ec tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1314 microversion: 2.1 time: 0.821616 Jul 19 22:41:15.405169 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1537/3107] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:14 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1314 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:15.422293 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-257ec419-face-4bfd-a173-73a2ddae648a req-7ce9cb70-17fb-49f5-a83a-dcc6dd709734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a3cbc11-0fe9-42de-aa59-739f3bd3eee7", "tag": "47b8b803-0985-4c3b-8e17-6396443f207d"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:15.447981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-257ec419-face-4bfd-a173-73a2ddae648a req-7ce9cb70-17fb-49f5-a83a-dcc6dd709734 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:15.449028 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-257ec419-face-4bfd-a173-73a2ddae648a req-7ce9cb70-17fb-49f5-a83a-dcc6dd709734 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:15.475473 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-257ec419-face-4bfd-a173-73a2ddae648a req-7ce9cb70-17fb-49f5-a83a-dcc6dd709734 service nova] Creating event network-changed:47b8b803-0985-4c3b-8e17-6396443f207d for instance 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 on n-h1-847009-3 Jul 19 22:41:15.481975 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-257ec419-face-4bfd-a173-73a2ddae648a req-7ce9cb70-17fb-49f5-a83a-dcc6dd709734 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074021 Jul 19 22:41:15.483179 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1538/3108] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:15.489268 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-31bbcc2b-d833-42f4-bd29-cdb14edb46a1 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Action: 'create', calling method: .version_select at 0x7f7a03f881f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1150781434", "description": "tempest-description-1643856653"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:15.510824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-86a1faf7-b8ee-4aad-a522-236cb8812782 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:15.521210 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-86a1faf7-b8ee-4aad-a522-236cb8812782 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1314 microversion: 2.1 time: 0.784252 Jul 19 22:41:15.522930 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1571/3109] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:14 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1314 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:15.549336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5c220ea3-5490-42af-bfb3-e54847f444b2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:15.550204 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5c220ea3-5490-42af-bfb3-e54847f444b2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 648bd230-03d9-4186-8cc0-64573fae2ab6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:15.562949 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5c220ea3-5490-42af-bfb3-e54847f444b2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:15.564187 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5c220ea3-5490-42af-bfb3-e54847f444b2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:15.565594 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5c220ea3-5490-42af-bfb3-e54847f444b2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:15.566182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5c220ea3-5490-42af-bfb3-e54847f444b2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:16.283556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5c220ea3-5490-42af-bfb3-e54847f444b2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:16.308342 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5c220ea3-5490-42af-bfb3-e54847f444b2 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/648bd230-03d9-4186-8cc0-64573fae2ab6" status: 200 len: 1512 microversion: 2.1 time: 0.782095 Jul 19 22:41:16.309304 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1572/3110] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:15 2022] GET /compute/v2.1/servers/648bd230-03d9-4186-8cc0-64573fae2ab6 => generated 1512 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:16.342299 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-16499869-a837-4e47-acad-0ab0cbcff0ef tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:16.343298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-16499869-a837-4e47-acad-0ab0cbcff0ef tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:16.362907 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16499869-a837-4e47-acad-0ab0cbcff0ef tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:16.364168 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16499869-a837-4e47-acad-0ab0cbcff0ef tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:16.365887 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16499869-a837-4e47-acad-0ab0cbcff0ef tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:16.366938 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16499869-a837-4e47-acad-0ab0cbcff0ef tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:16.469580 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-31bbcc2b-d833-42f4-bd29-cdb14edb46a1 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.980787 Jul 19 22:41:16.470690 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1539/3111] 10.222.0.25 () {60 vars in 1179 bytes} [Tue Jul 19 22:41:15 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:16.491804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0d5d2de5-0f70-4e3c-84db-a4cf1a58556b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:16.497438 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0d5d2de5-0f70-4e3c-84db-a4cf1a58556b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:16.532954 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d5d2de5-0f70-4e3c-84db-a4cf1a58556b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:16.533518 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d5d2de5-0f70-4e3c-84db-a4cf1a58556b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:16.534613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d5d2de5-0f70-4e3c-84db-a4cf1a58556b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:16.535256 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d5d2de5-0f70-4e3c-84db-a4cf1a58556b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:17.481331 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-16499869-a837-4e47-acad-0ab0cbcff0ef tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:17.503468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-16499869-a837-4e47-acad-0ab0cbcff0ef tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:17.511819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-16499869-a837-4e47-acad-0ab0cbcff0ef tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:17.515475 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-16499869-a837-4e47-acad-0ab0cbcff0ef tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 2931 microversion: 2.32 time: 1.178255 Jul 19 22:41:17.519523 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0d5d2de5-0f70-4e3c-84db-a4cf1a58556b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:17.531014 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1573/3112] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:16 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 2931 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:17.535950 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0d5d2de5-0f70-4e3c-84db-a4cf1a58556b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1313 microversion: 2.1 time: 1.051090 Jul 19 22:41:17.539132 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a2f29a02-1d61-4a9e-b3f6-53668bbf4c27 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:17.540788 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a2f29a02-1d61-4a9e-b3f6-53668bbf4c27 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:17.548082 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1540/3113] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:16 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1313 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:17.553294 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a2f29a02-1d61-4a9e-b3f6-53668bbf4c27 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:17.554906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a2f29a02-1d61-4a9e-b3f6-53668bbf4c27 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:17.556009 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a2f29a02-1d61-4a9e-b3f6-53668bbf4c27 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:17.557840 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a2f29a02-1d61-4a9e-b3f6-53668bbf4c27 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:17.563715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:41:17.565220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cfef9736-8d60-4dd3-b680-e5645c4dde27 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:17.565921 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cfef9736-8d60-4dd3-b680-e5645c4dde27 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: 063af6c1-3ce5-4da4-95f7-dae4e720f7fe] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:17.583057 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cfef9736-8d60-4dd3-b680-e5645c4dde27 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:17.584688 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cfef9736-8d60-4dd3-b680-e5645c4dde27 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:17.587738 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cfef9736-8d60-4dd3-b680-e5645c4dde27 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:17.589440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cfef9736-8d60-4dd3-b680-e5645c4dde27 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:18.018298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a2f29a02-1d61-4a9e-b3f6-53668bbf4c27 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:18.032714 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a2f29a02-1d61-4a9e-b3f6-53668bbf4c27 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:18.035619 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a2f29a02-1d61-4a9e-b3f6-53668bbf4c27 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:18.037852 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a2f29a02-1d61-4a9e-b3f6-53668bbf4c27 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 200 len: 1357 microversion: 2.47 time: 0.505013 Jul 19 22:41:18.038745 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1574/3114] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:17 2022] GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 1357 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:18.044761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-7044682c-26ce-44b2-a7ed-b26e45effcc3 req-80a99d0e-4432-450b-8b51-d70a609e6548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e509d1e-b5d6-4f5f-a017-c2df1d2433f4", "name": "network-vif-unplugged", "status": "completed", "tag": "12f72f3f-a741-4a92-92f8-08f8ec7273ff"}, {"server_uuid": "6e509d1e-b5d6-4f5f-a017-c2df1d2433f4", "name": "network-vif-unplugged", "status": "completed", "tag": "e9261124-5553-4103-8f06-754a9b357217"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:18.057482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7044682c-26ce-44b2-a7ed-b26e45effcc3 req-80a99d0e-4432-450b-8b51-d70a609e6548 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:18.058443 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7044682c-26ce-44b2-a7ed-b26e45effcc3 req-80a99d0e-4432-450b-8b51-d70a609e6548 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:18.119905 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-7044682c-26ce-44b2-a7ed-b26e45effcc3 req-80a99d0e-4432-450b-8b51-d70a609e6548 service nova] Creating event network-vif-unplugged:12f72f3f-a741-4a92-92f8-08f8ec7273ff for instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 on n-h2-847009-3 Jul 19 22:41:18.120992 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-7044682c-26ce-44b2-a7ed-b26e45effcc3 req-80a99d0e-4432-450b-8b51-d70a609e6548 service nova] Creating event network-vif-unplugged:e9261124-5553-4103-8f06-754a9b357217 for instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 on n-h2-847009-3 Jul 19 22:41:18.137820 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-7044682c-26ce-44b2-a7ed-b26e45effcc3 req-80a99d0e-4432-450b-8b51-d70a609e6548 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.097460 Jul 19 22:41:18.140579 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1575/3115] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:18.151266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6859b529-ed30-4869-90ae-0afcaa51f665 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:18.152509 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6859b529-ed30-4869-90ae-0afcaa51f665 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:18.183777 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6859b529-ed30-4869-90ae-0afcaa51f665 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:18.184239 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6859b529-ed30-4869-90ae-0afcaa51f665 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:18.185043 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6859b529-ed30-4869-90ae-0afcaa51f665 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:18.185487 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6859b529-ed30-4869-90ae-0afcaa51f665 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:18.583732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cfef9736-8d60-4dd3-b680-e5645c4dde27 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6994ad3a701847d49163a7b709fba400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24647fdcb5d7402ebfdca8ea2ae72e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:18.597246 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cfef9736-8d60-4dd3-b680-e5645c4dde27 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe" status: 200 len: 1315 microversion: 2.1 time: 1.046472 Jul 19 22:41:18.599454 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1541/3116] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:17 2022] GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe => generated 1315 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:18.605398 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-14c077b1-101a-41fb-a295-2bad8a33a269 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:18.606428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-14c077b1-101a-41fb-a295-2bad8a33a269 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:18.617483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14c077b1-101a-41fb-a295-2bad8a33a269 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:18.618718 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14c077b1-101a-41fb-a295-2bad8a33a269 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:18.620849 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14c077b1-101a-41fb-a295-2bad8a33a269 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:18.621481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14c077b1-101a-41fb-a295-2bad8a33a269 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:19.217376 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6859b529-ed30-4869-90ae-0afcaa51f665 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:19.238324 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6859b529-ed30-4869-90ae-0afcaa51f665 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41" status: 200 len: 1511 microversion: 2.1 time: 1.095604 Jul 19 22:41:19.239951 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1576/3117] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:18 2022] GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41 => generated 1511 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:19.251922 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9d45ede2-94a4-4ef1-8ec2-81e60fce550a tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Action: 'create', calling method: .version_select at 0x7f7a1014aaf0>, body: {"security_group_rule": {"parent_group_id": "b6adf8b5-5736-4e49-a123-44ef303623a1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:19.717228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-14c077b1-101a-41fb-a295-2bad8a33a269 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:19.733035 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-14c077b1-101a-41fb-a295-2bad8a33a269 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1502 microversion: 2.1 time: 1.131900 Jul 19 22:41:19.734319 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1542/3118] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:18 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1502 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:19.743020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-47151ca3-0911-4cd4-a5d3-4a84b0051886 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:19.745177 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-47151ca3-0911-4cd4-a5d3-4a84b0051886 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:19.761489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-47151ca3-0911-4cd4-a5d3-4a84b0051886 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:19.762321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-47151ca3-0911-4cd4-a5d3-4a84b0051886 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:19.763745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-47151ca3-0911-4cd4-a5d3-4a84b0051886 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:19.764768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-47151ca3-0911-4cd4-a5d3-4a84b0051886 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:20.070221 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-47151ca3-0911-4cd4-a5d3-4a84b0051886 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:20.080248 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-47151ca3-0911-4cd4-a5d3-4a84b0051886 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1314 microversion: 2.1 time: 0.344416 Jul 19 22:41:20.081930 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1543/3119] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:19 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:20.090040 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0a6f2750-1ba5-4a06-bde6-432b11ce1c33 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:20.093707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0a6f2750-1ba5-4a06-bde6-432b11ce1c33 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:20.104725 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a6f2750-1ba5-4a06-bde6-432b11ce1c33 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:20.105604 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a6f2750-1ba5-4a06-bde6-432b11ce1c33 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:20.107556 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a6f2750-1ba5-4a06-bde6-432b11ce1c33 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:20.108489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a6f2750-1ba5-4a06-bde6-432b11ce1c33 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:20.196131 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9d45ede2-94a4-4ef1-8ec2-81e60fce550a tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.953680 Jul 19 22:41:20.198593 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1577/3120] 10.222.0.25 () {60 vars in 1194 bytes} [Tue Jul 19 22:41:19 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:20.228411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-14c0d113-3acd-47b3-bff1-b987ae79e6d0 req-a53470fc-3e53-487f-99f7-1d713a39a578 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "063af6c1-3ce5-4da4-95f7-dae4e720f7fe", "tag": "14665aa9-4185-4b76-b88c-3d89b7130fba"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:20.268846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-14c0d113-3acd-47b3-bff1-b987ae79e6d0 req-a53470fc-3e53-487f-99f7-1d713a39a578 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:20.270028 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-14c0d113-3acd-47b3-bff1-b987ae79e6d0 req-a53470fc-3e53-487f-99f7-1d713a39a578 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:20.280975 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-0a6f2750-1ba5-4a06-bde6-432b11ce1c33 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:41:20.281459 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-0a6f2750-1ba5-4a06-bde6-432b11ce1c33 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:41:20.281936 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-0a6f2750-1ba5-4a06-bde6-432b11ce1c33 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:41:20.282343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-0a6f2750-1ba5-4a06-bde6-432b11ce1c33 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:41:20.282762 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-0a6f2750-1ba5-4a06-bde6-432b11ce1c33 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:41:20.292720 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-14c0d113-3acd-47b3-bff1-b987ae79e6d0 req-a53470fc-3e53-487f-99f7-1d713a39a578 service nova] Creating event network-changed:14665aa9-4185-4b76-b88c-3d89b7130fba for instance 063af6c1-3ce5-4da4-95f7-dae4e720f7fe on n-h2-847009-3 Jul 19 22:41:20.309581 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-14c0d113-3acd-47b3-bff1-b987ae79e6d0 req-a53470fc-3e53-487f-99f7-1d713a39a578 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109829 Jul 19 22:41:20.311222 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1578/3121] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:20.322739 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c5f7a86e-59c8-4279-9ecb-bad6456d3808 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:20.324079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c5f7a86e-59c8-4279-9ecb-bad6456d3808 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:20.336972 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c5f7a86e-59c8-4279-9ecb-bad6456d3808 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:20.337925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c5f7a86e-59c8-4279-9ecb-bad6456d3808 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:20.339814 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c5f7a86e-59c8-4279-9ecb-bad6456d3808 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:20.348454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c5f7a86e-59c8-4279-9ecb-bad6456d3808 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:20.406813 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0a6f2750-1ba5-4a06-bde6-432b11ce1c33 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:20.414055 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a6f2750-1ba5-4a06-bde6-432b11ce1c33 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:20.414800 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a6f2750-1ba5-4a06-bde6-432b11ce1c33 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:20.415764 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a6f2750-1ba5-4a06-bde6-432b11ce1c33 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:20.416891 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a6f2750-1ba5-4a06-bde6-432b11ce1c33 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:20.455387 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0a6f2750-1ba5-4a06-bde6-432b11ce1c33 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "POST /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780/action" status: 202 len: 1079 microversion: 2.47 time: 0.372103 Jul 19 22:41:20.456901 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1544/3122] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Jul 19 22:41:20 2022] POST /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780/action => generated 1079 bytes in 374 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 19 22:41:20.462604 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1f0b0623-bc1a-4085-a33f-b76653a4c7ae tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:20.464353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1f0b0623-bc1a-4085-a33f-b76653a4c7ae tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:20.474480 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1f0b0623-bc1a-4085-a33f-b76653a4c7ae tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:20.475515 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1f0b0623-bc1a-4085-a33f-b76653a4c7ae tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:20.477663 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1f0b0623-bc1a-4085-a33f-b76653a4c7ae tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:20.478188 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1f0b0623-bc1a-4085-a33f-b76653a4c7ae tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:20.935258 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c5f7a86e-59c8-4279-9ecb-bad6456d3808 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:20.944604 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:41:20.953105 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c5f7a86e-59c8-4279-9ecb-bad6456d3808 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1313 microversion: 2.1 time: 0.639945 Jul 19 22:41:20.954245 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1579/3123] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:20 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1313 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:20.962623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fe9549a9-4c3c-4d95-8c5b-35085598e593 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:20.971361 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fe9549a9-4c3c-4d95-8c5b-35085598e593 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:20.973397 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fe9549a9-4c3c-4d95-8c5b-35085598e593 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Searching by: {'deleted': False, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4'} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:41:20.984143 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe9549a9-4c3c-4d95-8c5b-35085598e593 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:20.985241 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe9549a9-4c3c-4d95-8c5b-35085598e593 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:20.987188 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe9549a9-4c3c-4d95-8c5b-35085598e593 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:20.988201 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe9549a9-4c3c-4d95-8c5b-35085598e593 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:21.004558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=25 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:41:21.057985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.multi_cell_list [None req-fe9549a9-4c3c-4d95-8c5b-35085598e593 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119338) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:41:21.073586 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1f0b0623-bc1a-4085-a33f-b76653a4c7ae tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:21.096090 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1f0b0623-bc1a-4085-a33f-b76653a4c7ae tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:21.103619 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1f0b0623-bc1a-4085-a33f-b76653a4c7ae tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:21.105433 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1f0b0623-bc1a-4085-a33f-b76653a4c7ae tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 2910 microversion: 2.32 time: 0.647330 Jul 19 22:41:21.108311 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1545/3124] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:20 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 2910 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:21.114770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0ec0df1a-71dc-4164-b3a8-ef208dbc9f7b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:21.119885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0ec0df1a-71dc-4164-b3a8-ef208dbc9f7b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: 063af6c1-3ce5-4da4-95f7-dae4e720f7fe] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:21.143829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ec0df1a-71dc-4164-b3a8-ef208dbc9f7b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:21.144407 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fe9549a9-4c3c-4d95-8c5b-35085598e593 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:21.146348 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ec0df1a-71dc-4164-b3a8-ef208dbc9f7b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:21.147372 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ec0df1a-71dc-4164-b3a8-ef208dbc9f7b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:21.147943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ec0df1a-71dc-4164-b3a8-ef208dbc9f7b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:21.159320 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe9549a9-4c3c-4d95-8c5b-35085598e593 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:21.160031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe9549a9-4c3c-4d95-8c5b-35085598e593 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:21.653420 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0ec0df1a-71dc-4164-b3a8-ef208dbc9f7b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6994ad3a701847d49163a7b709fba400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24647fdcb5d7402ebfdca8ea2ae72e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:21.660892 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fe9549a9-4c3c-4d95-8c5b-35085598e593 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 4516 microversion: 2.1 time: 0.704290 Jul 19 22:41:21.662298 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1580/3125] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:41:20 2022] GET /compute/v2.1/servers/detail => generated 4516 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:21.673669 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ef4c0139-d24a-4d66-ac9c-08e3c79171d5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:21.688834 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0ec0df1a-71dc-4164-b3a8-ef208dbc9f7b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe" status: 200 len: 1315 microversion: 2.1 time: 0.578446 Jul 19 22:41:21.691679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ef4c0139-d24a-4d66-ac9c-08e3c79171d5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:21.693254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ef4c0139-d24a-4d66-ac9c-08e3c79171d5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:21.699963 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1546/3126] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:21 2022] GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe => generated 1315 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:21.710544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-321c409d-3dd6-4822-a207-20355d4f8e5f req-6139b99c-5c9d-402d-af29-82890b40320b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e509d1e-b5d6-4f5f-a017-c2df1d2433f4", "name": "network-vif-unplugged", "status": "completed", "tag": "4b814275-8b47-43f3-88da-1bc97c3e05e3"}, {"server_uuid": "6e509d1e-b5d6-4f5f-a017-c2df1d2433f4", "name": "network-vif-unplugged", "status": "completed", "tag": "2c7186d7-bc64-4766-af9a-aacc09242cdb"}, {"server_uuid": "6e509d1e-b5d6-4f5f-a017-c2df1d2433f4", "name": "network-vif-unplugged", "status": "completed", "tag": "5842fe2c-d08f-4a4f-8daf-6a8e5788ff55"}, {"server_uuid": "6e509d1e-b5d6-4f5f-a017-c2df1d2433f4", "name": "network-vif-unplugged", "status": "completed", "tag": "3e008d29-c997-484e-89f5-bf52efc1c101"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:21.730594 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-321c409d-3dd6-4822-a207-20355d4f8e5f req-6139b99c-5c9d-402d-af29-82890b40320b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:21.732095 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-321c409d-3dd6-4822-a207-20355d4f8e5f req-6139b99c-5c9d-402d-af29-82890b40320b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:21.744730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ef4c0139-d24a-4d66-ac9c-08e3c79171d5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Going to try to stop instance {{(pid=119338) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 22:41:21.754621 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-321c409d-3dd6-4822-a207-20355d4f8e5f req-6139b99c-5c9d-402d-af29-82890b40320b service nova] Creating event network-vif-unplugged:4b814275-8b47-43f3-88da-1bc97c3e05e3 for instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 on n-h2-847009-3 Jul 19 22:41:21.755608 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-321c409d-3dd6-4822-a207-20355d4f8e5f req-6139b99c-5c9d-402d-af29-82890b40320b service nova] Creating event network-vif-unplugged:2c7186d7-bc64-4766-af9a-aacc09242cdb for instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 on n-h2-847009-3 Jul 19 22:41:21.756796 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-321c409d-3dd6-4822-a207-20355d4f8e5f req-6139b99c-5c9d-402d-af29-82890b40320b service nova] Creating event network-vif-unplugged:5842fe2c-d08f-4a4f-8daf-6a8e5788ff55 for instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 on n-h2-847009-3 Jul 19 22:41:21.757669 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-321c409d-3dd6-4822-a207-20355d4f8e5f req-6139b99c-5c9d-402d-af29-82890b40320b service nova] Creating event network-vif-unplugged:3e008d29-c997-484e-89f5-bf52efc1c101 for instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 on n-h2-847009-3 Jul 19 22:41:21.771758 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-321c409d-3dd6-4822-a207-20355d4f8e5f req-6139b99c-5c9d-402d-af29-82890b40320b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.068646 Jul 19 22:41:21.781009 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1547/3127] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:21.796566 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-eb582647-5f06-4163-a68f-025b86b9db83 req-271322b0-c243-4f86-8dc9-ba2e2624337b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7727fc2-2016-482d-aff6-0940874c3b28", "tag": "e9e1128e-eb72-4508-89fa-0c1047cf6872"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:21.814872 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-eb582647-5f06-4163-a68f-025b86b9db83 req-271322b0-c243-4f86-8dc9-ba2e2624337b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:21.815655 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-eb582647-5f06-4163-a68f-025b86b9db83 req-271322b0-c243-4f86-8dc9-ba2e2624337b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:21.834333 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ef4c0139-d24a-4d66-ac9c-08e3c79171d5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421/action" status: 202 len: 0 microversion: 2.1 time: 0.169957 Jul 19 22:41:21.835354 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1581/3128] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:41:21 2022] POST /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:41:21.842934 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-eb582647-5f06-4163-a68f-025b86b9db83 req-271322b0-c243-4f86-8dc9-ba2e2624337b service nova] Creating event network-changed:e9e1128e-eb72-4508-89fa-0c1047cf6872 for instance d7727fc2-2016-482d-aff6-0940874c3b28 on n-h1-847009-3 Jul 19 22:41:21.844072 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d21fd195-41cb-4b79-bcba-60a273ee107c tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Action: 'create', calling method: .version_select at 0x7f7a03a4a820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-6028670", "description": "tempest-description-1734396070"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:21.854809 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-eb582647-5f06-4163-a68f-025b86b9db83 req-271322b0-c243-4f86-8dc9-ba2e2624337b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070414 Jul 19 22:41:21.855939 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1548/3129] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:21.866317 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c00148e4-5659-4b04-97cb-931268142222 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:21.869001 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c00148e4-5659-4b04-97cb-931268142222 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:21.876648 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c00148e4-5659-4b04-97cb-931268142222 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:21.877106 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c00148e4-5659-4b04-97cb-931268142222 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:21.877953 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c00148e4-5659-4b04-97cb-931268142222 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:21.878484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c00148e4-5659-4b04-97cb-931268142222 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:21.885815 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:41:21.995355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c00148e4-5659-4b04-97cb-931268142222 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:22.008926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c00148e4-5659-4b04-97cb-931268142222 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:22.011684 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c00148e4-5659-4b04-97cb-931268142222 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:22.013253 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c00148e4-5659-4b04-97cb-931268142222 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 200 len: 1366 microversion: 2.47 time: 0.155215 Jul 19 22:41:22.013974 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1549/3130] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:21 2022] GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:22.021890 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-14dce2cb-848d-4250-a95f-f92f75862e11 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:22.024306 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-14dce2cb-848d-4250-a95f-f92f75862e11 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:22.035799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14dce2cb-848d-4250-a95f-f92f75862e11 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:22.036713 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14dce2cb-848d-4250-a95f-f92f75862e11 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:22.038166 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14dce2cb-848d-4250-a95f-f92f75862e11 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:22.039236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14dce2cb-848d-4250-a95f-f92f75862e11 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:22.335677 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d21fd195-41cb-4b79-bcba-60a273ee107c tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.498810 Jul 19 22:41:22.336256 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1582/3131] 10.222.0.25 () {60 vars in 1179 bytes} [Tue Jul 19 22:41:21 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:22.342583 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-69ba7554-70a6-4e2b-9a6a-79d040ce1229 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:22.356966 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-69ba7554-70a6-4e2b-9a6a-79d040ce1229 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:22.358132 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-69ba7554-70a6-4e2b-9a6a-79d040ce1229 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4'} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:41:22.375650 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-14dce2cb-848d-4250-a95f-f92f75862e11 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:22.384559 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-14dce2cb-848d-4250-a95f-f92f75862e11 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1314 microversion: 2.1 time: 0.369265 Jul 19 22:41:22.394909 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1550/3132] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:22 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:22.394909 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a0db3302-97fd-464e-921a-cea34b45d374 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:22.394909 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a0db3302-97fd-464e-921a-cea34b45d374 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:22.402291 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0db3302-97fd-464e-921a-cea34b45d374 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:22.402975 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0db3302-97fd-464e-921a-cea34b45d374 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:22.404273 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0db3302-97fd-464e-921a-cea34b45d374 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:22.404939 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0db3302-97fd-464e-921a-cea34b45d374 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:22.483837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-69ba7554-70a6-4e2b-9a6a-79d040ce1229 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:22.484504 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-69ba7554-70a6-4e2b-9a6a-79d040ce1229 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:22.485650 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-69ba7554-70a6-4e2b-9a6a-79d040ce1229 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:22.486061 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-69ba7554-70a6-4e2b-9a6a-79d040ce1229 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:22.530059 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.multi_cell_list [None req-69ba7554-70a6-4e2b-9a6a-79d040ce1229 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119338) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:41:22.577503 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-69ba7554-70a6-4e2b-9a6a-79d040ce1229 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.239682 Jul 19 22:41:22.584105 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1583/3133] 10.222.0.25 () {58 vars in 1149 bytes} [Tue Jul 19 22:41:22 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:22.584984 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2435f57e-9378-483f-8a91-2568074c758d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:22.586810 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2435f57e-9378-483f-8a91-2568074c758d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:22.599689 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2435f57e-9378-483f-8a91-2568074c758d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:22.606893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2435f57e-9378-483f-8a91-2568074c758d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:22.608277 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2435f57e-9378-483f-8a91-2568074c758d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:22.609038 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2435f57e-9378-483f-8a91-2568074c758d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:22.820690 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a0db3302-97fd-464e-921a-cea34b45d374 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:22.835373 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a0db3302-97fd-464e-921a-cea34b45d374 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1512 microversion: 2.1 time: 0.447643 Jul 19 22:41:22.836192 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1551/3134] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:22 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1512 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:22.844370 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-83076b85-d38d-46e7-94e9-f9183867be37 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:22.848912 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-83076b85-d38d-46e7-94e9-f9183867be37 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:22.861532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-83076b85-d38d-46e7-94e9-f9183867be37 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:22.862291 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-83076b85-d38d-46e7-94e9-f9183867be37 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:22.863714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-83076b85-d38d-46e7-94e9-f9183867be37 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:22.864493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-83076b85-d38d-46e7-94e9-f9183867be37 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:23.412989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2435f57e-9378-483f-8a91-2568074c758d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:23.425749 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2435f57e-9378-483f-8a91-2568074c758d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1313 microversion: 2.1 time: 0.845580 Jul 19 22:41:23.427574 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1584/3135] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:22 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1313 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:23.437679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aef936fb-fabd-432e-a1e2-cedcf218a521 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Action: 'create', calling method: .version_select at 0x7f7a03804f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1590860140", "description": "tempest-description-2060392750"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:23.642411 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-83076b85-d38d-46e7-94e9-f9183867be37 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:23.662136 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-83076b85-d38d-46e7-94e9-f9183867be37 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:23.665347 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-83076b85-d38d-46e7-94e9-f9183867be37 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:23.666788 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-83076b85-d38d-46e7-94e9-f9183867be37 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 2864 microversion: 2.32 time: 0.829301 Jul 19 22:41:23.679136 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1552/3136] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:22 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 2864 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:23.686021 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-79faf94d-8339-427b-9cb6-4e778eb5613a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:23.691095 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-79faf94d-8339-427b-9cb6-4e778eb5613a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:23.691929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-79faf94d-8339-427b-9cb6-4e778eb5613a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4'} {{(pid=119337) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:41:23.700099 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-79faf94d-8339-427b-9cb6-4e778eb5613a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:23.700548 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-79faf94d-8339-427b-9cb6-4e778eb5613a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:23.701407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-79faf94d-8339-427b-9cb6-4e778eb5613a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:23.701840 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-79faf94d-8339-427b-9cb6-4e778eb5613a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:23.857001 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.multi_cell_list [None req-79faf94d-8339-427b-9cb6-4e778eb5613a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119337) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:41:23.960153 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-79faf94d-8339-427b-9cb6-4e778eb5613a tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.291135 Jul 19 22:41:23.966987 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1553/3137] 10.222.0.25 () {58 vars in 1211 bytes} [Tue Jul 19 22:41:23 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:23.973949 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-18d922f4-14ee-465d-bab2-5fcb09c08c4b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:23.975084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-18d922f4-14ee-465d-bab2-5fcb09c08c4b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: 063af6c1-3ce5-4da4-95f7-dae4e720f7fe] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:23.984878 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-18d922f4-14ee-465d-bab2-5fcb09c08c4b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:23.985522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-18d922f4-14ee-465d-bab2-5fcb09c08c4b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:23.986493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-18d922f4-14ee-465d-bab2-5fcb09c08c4b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:23.987082 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-18d922f4-14ee-465d-bab2-5fcb09c08c4b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:24.245689 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-aef936fb-fabd-432e-a1e2-cedcf218a521 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.815754 Jul 19 22:41:24.246717 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1585/3138] 10.222.0.25 () {60 vars in 1179 bytes} [Tue Jul 19 22:41:23 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:24.254607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1cd3fab9-a372-4a9f-a8e5-88da21ba8142 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:24.255822 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1cd3fab9-a372-4a9f-a8e5-88da21ba8142 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:24.268009 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1cd3fab9-a372-4a9f-a8e5-88da21ba8142 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:24.268478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1cd3fab9-a372-4a9f-a8e5-88da21ba8142 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:24.269280 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1cd3fab9-a372-4a9f-a8e5-88da21ba8142 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:24.269724 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1cd3fab9-a372-4a9f-a8e5-88da21ba8142 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:24.396122 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1cd3fab9-a372-4a9f-a8e5-88da21ba8142 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:24.410034 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1cd3fab9-a372-4a9f-a8e5-88da21ba8142 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:24.412034 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1cd3fab9-a372-4a9f-a8e5-88da21ba8142 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:24.414545 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1cd3fab9-a372-4a9f-a8e5-88da21ba8142 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 200 len: 1366 microversion: 2.47 time: 0.166389 Jul 19 22:41:24.416012 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1586/3139] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:24 2022] GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:24.429143 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9e1ce1d0-8ad7-446d-833f-5d99630d9598 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:24.431060 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9e1ce1d0-8ad7-446d-833f-5d99630d9598 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:24.452206 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e1ce1d0-8ad7-446d-833f-5d99630d9598 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:24.454913 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e1ce1d0-8ad7-446d-833f-5d99630d9598 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:24.457359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e1ce1d0-8ad7-446d-833f-5d99630d9598 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:24.458439 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e1ce1d0-8ad7-446d-833f-5d99630d9598 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:24.485092 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-18d922f4-14ee-465d-bab2-5fcb09c08c4b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6994ad3a701847d49163a7b709fba400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24647fdcb5d7402ebfdca8ea2ae72e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:24.497574 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-18d922f4-14ee-465d-bab2-5fcb09c08c4b tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe" status: 200 len: 1315 microversion: 2.1 time: 0.529147 Jul 19 22:41:24.498243 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1554/3140] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:23 2022] GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe => generated 1315 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:24.503437 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-8c00e6b6-5a3e-4eec-af00-75106e6e2749 req-35449d08-5427-4caa-8eb3-4765999d641b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a3cbc11-0fe9-42de-aa59-739f3bd3eee7", "name": "network-vif-plugged", "status": "completed", "tag": "47b8b803-0985-4c3b-8e17-6396443f207d"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:24.530221 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-8c00e6b6-5a3e-4eec-af00-75106e6e2749 req-35449d08-5427-4caa-8eb3-4765999d641b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:24.531544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-8c00e6b6-5a3e-4eec-af00-75106e6e2749 req-35449d08-5427-4caa-8eb3-4765999d641b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:24.555064 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-8c00e6b6-5a3e-4eec-af00-75106e6e2749 req-35449d08-5427-4caa-8eb3-4765999d641b service nova] Creating event network-vif-plugged:47b8b803-0985-4c3b-8e17-6396443f207d for instance 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 on n-h1-847009-3 Jul 19 22:41:24.563950 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-8c00e6b6-5a3e-4eec-af00-75106e6e2749 req-35449d08-5427-4caa-8eb3-4765999d641b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064167 Jul 19 22:41:24.566075 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1555/3141] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:24.575345 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e3a91c83-c18c-460c-bdbf-7218d4a6328b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:24.577039 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e3a91c83-c18c-460c-bdbf-7218d4a6328b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:24.588724 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3a91c83-c18c-460c-bdbf-7218d4a6328b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:24.590199 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3a91c83-c18c-460c-bdbf-7218d4a6328b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:24.591440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3a91c83-c18c-460c-bdbf-7218d4a6328b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:24.591894 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3a91c83-c18c-460c-bdbf-7218d4a6328b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:25.184230 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e3a91c83-c18c-460c-bdbf-7218d4a6328b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:25.201019 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e3a91c83-c18c-460c-bdbf-7218d4a6328b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1512 microversion: 2.1 time: 0.631663 Jul 19 22:41:25.203255 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1556/3142] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:24 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1512 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:25.209211 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9e1ce1d0-8ad7-446d-833f-5d99630d9598 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:25.212739 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-18b465fc-f21e-4cf8-ad29-eb0349aa206e req-9ec9da38-e8e5-443d-977f-225df4a81a7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e509d1e-b5d6-4f5f-a017-c2df1d2433f4", "name": "network-vif-deleted", "tag": "3e008d29-c997-484e-89f5-bf52efc1c101"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:25.223836 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9e1ce1d0-8ad7-446d-833f-5d99630d9598 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1314 microversion: 2.1 time: 0.805081 Jul 19 22:41:25.225737 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1587/3143] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:24 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1314 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:25.234958 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-18b465fc-f21e-4cf8-ad29-eb0349aa206e req-9ec9da38-e8e5-443d-977f-225df4a81a7f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:25.237997 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-45ceeeaf-b597-44d2-b199-0dc48a5e72bb tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:25.241587 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-18b465fc-f21e-4cf8-ad29-eb0349aa206e req-9ec9da38-e8e5-443d-977f-225df4a81a7f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:25.263991 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-45ceeeaf-b597-44d2-b199-0dc48a5e72bb tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:25.267439 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-45ceeeaf-b597-44d2-b199-0dc48a5e72bb tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4'} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:41:25.281704 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:41:25.296237 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-45ceeeaf-b597-44d2-b199-0dc48a5e72bb tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:25.302148 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-18b465fc-f21e-4cf8-ad29-eb0349aa206e req-9ec9da38-e8e5-443d-977f-225df4a81a7f service nova] Creating event network-vif-deleted:3e008d29-c997-484e-89f5-bf52efc1c101 for instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 on n-h2-847009-3 Jul 19 22:41:25.302592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-45ceeeaf-b597-44d2-b199-0dc48a5e72bb tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:25.303696 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-45ceeeaf-b597-44d2-b199-0dc48a5e72bb tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:25.304231 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-45ceeeaf-b597-44d2-b199-0dc48a5e72bb tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:25.319080 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-18b465fc-f21e-4cf8-ad29-eb0349aa206e req-9ec9da38-e8e5-443d-977f-225df4a81a7f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113657 Jul 19 22:41:25.320970 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1557/3144] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:25.329237 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-81cabad2-9502-4d9b-9e9e-dff909fb617e tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Action: 'create', calling method: .version_select at 0x7f7a03f6eee0>, body: {"security_group_rule": {"parent_group_id": "6ca25e7c-4774-4431-ae17-9ea79f6cc71b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "2f852d96-6567-4b4b-9f03-eb33b78d7fd1"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:25.433062 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.multi_cell_list [None req-45ceeeaf-b597-44d2-b199-0dc48a5e72bb tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119338) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:41:25.521112 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-45ceeeaf-b597-44d2-b199-0dc48a5e72bb tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.293098 Jul 19 22:41:25.522715 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1588/3145] 10.222.0.25 () {58 vars in 1195 bytes} [Tue Jul 19 22:41:25 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:25.532594 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e1e427b1-e626-41a0-bfce-0afe7456c098 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:25.533896 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e1e427b1-e626-41a0-bfce-0afe7456c098 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:25.542725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1e427b1-e626-41a0-bfce-0afe7456c098 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:25.543322 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1e427b1-e626-41a0-bfce-0afe7456c098 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:25.544377 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1e427b1-e626-41a0-bfce-0afe7456c098 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:25.545101 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1e427b1-e626-41a0-bfce-0afe7456c098 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:25.967821 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e1e427b1-e626-41a0-bfce-0afe7456c098 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:25.982808 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e1e427b1-e626-41a0-bfce-0afe7456c098 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1313 microversion: 2.1 time: 0.458007 Jul 19 22:41:25.983330 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1589/3146] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:25 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1313 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:25.992550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-27f48a59-b5e6-4bc4-a375-2aefb035e7e0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:25.992550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-27f48a59-b5e6-4bc4-a375-2aefb035e7e0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:25.994859 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-27f48a59-b5e6-4bc4-a375-2aefb035e7e0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:25.995385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-27f48a59-b5e6-4bc4-a375-2aefb035e7e0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:25.996193 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-27f48a59-b5e6-4bc4-a375-2aefb035e7e0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:25.996642 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-27f48a59-b5e6-4bc4-a375-2aefb035e7e0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:26.322952 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-81cabad2-9502-4d9b-9e9e-dff909fb617e tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.999511 Jul 19 22:41:26.324723 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1558/3147] 10.222.0.25 () {60 vars in 1194 bytes} [Tue Jul 19 22:41:25 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:26.333588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d1c4adfa-7f6b-4610-a5e0-850884d213a5 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:26.334992 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d1c4adfa-7f6b-4610-a5e0-850884d213a5 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:26.352735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d1c4adfa-7f6b-4610-a5e0-850884d213a5 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:26.354137 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d1c4adfa-7f6b-4610-a5e0-850884d213a5 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:26.356625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d1c4adfa-7f6b-4610-a5e0-850884d213a5 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:26.357683 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d1c4adfa-7f6b-4610-a5e0-850884d213a5 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:26.375422 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-27f48a59-b5e6-4bc4-a375-2aefb035e7e0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:26.397390 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-27f48a59-b5e6-4bc4-a375-2aefb035e7e0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:26.404699 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-27f48a59-b5e6-4bc4-a375-2aefb035e7e0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:26.406560 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-27f48a59-b5e6-4bc4-a375-2aefb035e7e0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 2486 microversion: 2.32 time: 0.422103 Jul 19 22:41:26.418480 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1590/3148] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:25 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 2486 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:26.430024 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-772e8a60-b7ac-4df9-9435-8396da55d227 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:26.430868 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-772e8a60-b7ac-4df9-9435-8396da55d227 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: 063af6c1-3ce5-4da4-95f7-dae4e720f7fe] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:26.445206 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-772e8a60-b7ac-4df9-9435-8396da55d227 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:26.447336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-772e8a60-b7ac-4df9-9435-8396da55d227 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:26.449026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-772e8a60-b7ac-4df9-9435-8396da55d227 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:26.450364 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-772e8a60-b7ac-4df9-9435-8396da55d227 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:26.549892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d1c4adfa-7f6b-4610-a5e0-850884d213a5 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:26.559386 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d1c4adfa-7f6b-4610-a5e0-850884d213a5 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:26.561221 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d1c4adfa-7f6b-4610-a5e0-850884d213a5 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:26.562878 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d1c4adfa-7f6b-4610-a5e0-850884d213a5 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 200 len: 1366 microversion: 2.47 time: 0.236938 Jul 19 22:41:26.581967 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1559/3149] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:26 2022] GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:26.589284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9bb30e07-4bc3-46ed-b7c4-762743cb6e46 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:26.593397 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9bb30e07-4bc3-46ed-b7c4-762743cb6e46 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:26.594455 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9bb30e07-4bc3-46ed-b7c4-762743cb6e46 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Searching by: {'name': '-483663341', 'deleted': False, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4'} {{(pid=119337) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:41:26.604797 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9bb30e07-4bc3-46ed-b7c4-762743cb6e46 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:26.605588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9bb30e07-4bc3-46ed-b7c4-762743cb6e46 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:26.606770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9bb30e07-4bc3-46ed-b7c4-762743cb6e46 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:26.607588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9bb30e07-4bc3-46ed-b7c4-762743cb6e46 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:26.695059 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-772e8a60-b7ac-4df9-9435-8396da55d227 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6994ad3a701847d49163a7b709fba400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24647fdcb5d7402ebfdca8ea2ae72e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:26.703538 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-772e8a60-b7ac-4df9-9435-8396da55d227 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe" status: 200 len: 1315 microversion: 2.1 time: 0.282704 Jul 19 22:41:26.705028 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1591/3150] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:26 2022] GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:26.712270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d2b18a23-6547-465a-915d-c5eacff058df tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:26.713660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d2b18a23-6547-465a-915d-c5eacff058df tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:26.720394 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2b18a23-6547-465a-915d-c5eacff058df tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:26.721237 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2b18a23-6547-465a-915d-c5eacff058df tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:26.722263 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2b18a23-6547-465a-915d-c5eacff058df tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:26.723131 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2b18a23-6547-465a-915d-c5eacff058df tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:26.736386 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.multi_cell_list [None req-9bb30e07-4bc3-46ed-b7c4-762743cb6e46 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119337) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:41:26.813588 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9bb30e07-4bc3-46ed-b7c4-762743cb6e46 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers?name=-483663341" status: 200 len: 345 microversion: 2.1 time: 0.230523 Jul 19 22:41:26.814378 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1560/3151] 10.222.0.25 () {58 vars in 1155 bytes} [Tue Jul 19 22:41:26 2022] GET /compute/v2.1/servers?name=-483663341 => generated 345 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:26.819317 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-339f51b5-da87-4c19-9878-673d2fe38828 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:26.819945 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-339f51b5-da87-4c19-9878-673d2fe38828 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:26.826846 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-339f51b5-da87-4c19-9878-673d2fe38828 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:26.827337 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-339f51b5-da87-4c19-9878-673d2fe38828 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:26.828161 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-339f51b5-da87-4c19-9878-673d2fe38828 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:26.828957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-339f51b5-da87-4c19-9878-673d2fe38828 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:27.039654 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d2b18a23-6547-465a-915d-c5eacff058df tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:27.045793 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:41:27.051300 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d2b18a23-6547-465a-915d-c5eacff058df tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1512 microversion: 2.1 time: 0.344460 Jul 19 22:41:27.052050 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1592/3152] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:26 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1512 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:27.057150 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-edbbef96-2611-4c3e-8255-b8732c93d11c tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Action: 'create', calling method: .version_select at 0x7f7a103c4670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1204070910", "description": "tempest-description-1870193080"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:27.207186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-339f51b5-da87-4c19-9878-673d2fe38828 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:27.221356 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-339f51b5-da87-4c19-9878-673d2fe38828 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1500 microversion: 2.1 time: 0.405482 Jul 19 22:41:27.222358 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1561/3153] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:26 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1500 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:27.228083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-b13c5cd4-90ff-49e4-98ed-1d8fc7e05de0 req-a22abb71-8a4f-4693-aac6-6f64094d6b9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "063af6c1-3ce5-4da4-95f7-dae4e720f7fe", "name": "network-vif-plugged", "status": "completed", "tag": "14665aa9-4185-4b76-b88c-3d89b7130fba"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:27.233473 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:41:27.239938 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b13c5cd4-90ff-49e4-98ed-1d8fc7e05de0 req-a22abb71-8a4f-4693-aac6-6f64094d6b9c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:27.240376 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b13c5cd4-90ff-49e4-98ed-1d8fc7e05de0 req-a22abb71-8a4f-4693-aac6-6f64094d6b9c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:27.254333 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-b13c5cd4-90ff-49e4-98ed-1d8fc7e05de0 req-a22abb71-8a4f-4693-aac6-6f64094d6b9c service nova] Creating event network-vif-plugged:14665aa9-4185-4b76-b88c-3d89b7130fba for instance 063af6c1-3ce5-4da4-95f7-dae4e720f7fe on n-h2-847009-3 Jul 19 22:41:27.259229 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-b13c5cd4-90ff-49e4-98ed-1d8fc7e05de0 req-a22abb71-8a4f-4693-aac6-6f64094d6b9c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035889 Jul 19 22:41:27.261046 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1562/3154] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:27.265917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fe5ab36b-d883-42a6-bce5-d1a5121918eb tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:27.269470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fe5ab36b-d883-42a6-bce5-d1a5121918eb tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:27.270229 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fe5ab36b-d883-42a6-bce5-d1a5121918eb tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4'} {{(pid=119337) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:41:27.275880 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fe5ab36b-d883-42a6-bce5-d1a5121918eb tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:27.276313 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fe5ab36b-d883-42a6-bce5-d1a5121918eb tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:27.277064 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fe5ab36b-d883-42a6-bce5-d1a5121918eb tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:27.277495 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fe5ab36b-d883-42a6-bce5-d1a5121918eb tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:27.448716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.multi_cell_list [None req-fe5ab36b-d883-42a6-bce5-d1a5121918eb tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119337) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:41:27.572526 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fe5ab36b-d883-42a6-bce5-d1a5121918eb tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.310086 Jul 19 22:41:27.574013 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1563/3155] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Jul 19 22:41:27 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:27.580733 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bae0ef58-c4dd-4dd0-8a0c-83cafc445a91 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:27.581698 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bae0ef58-c4dd-4dd0-8a0c-83cafc445a91 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:27.593408 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bae0ef58-c4dd-4dd0-8a0c-83cafc445a91 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:27.594119 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bae0ef58-c4dd-4dd0-8a0c-83cafc445a91 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:27.595893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bae0ef58-c4dd-4dd0-8a0c-83cafc445a91 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:27.597040 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bae0ef58-c4dd-4dd0-8a0c-83cafc445a91 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:27.607072 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-edbbef96-2611-4c3e-8255-b8732c93d11c tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.553588 Jul 19 22:41:27.608481 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1593/3156] 10.222.0.25 () {60 vars in 1179 bytes} [Tue Jul 19 22:41:27 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:27.618603 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cd0e40ca-3839-49b8-ba34-2b8f3abdcabc tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:27.621820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cd0e40ca-3839-49b8-ba34-2b8f3abdcabc tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:27.650011 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd0e40ca-3839-49b8-ba34-2b8f3abdcabc tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:27.651761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd0e40ca-3839-49b8-ba34-2b8f3abdcabc tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:27.653220 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd0e40ca-3839-49b8-ba34-2b8f3abdcabc tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:27.654050 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd0e40ca-3839-49b8-ba34-2b8f3abdcabc tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:27.689710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-cd0e40ca-3839-49b8-ba34-2b8f3abdcabc tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lazy-loading 'flavor' on Instance uuid 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:41:27.813925 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cd0e40ca-3839-49b8-ba34-2b8f3abdcabc tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "POST /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7/action" status: 200 len: 32 microversion: 2.1 time: 0.202889 Jul 19 22:41:27.815430 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1594/3157] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:41:27 2022] POST /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7/action => generated 32 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:41:27.826031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-a723474f-a6d8-47d2-9eab-e51cc537afe1 req-cd99fa9b-aeb3-4cfa-85ba-bbdccfb3c164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e509d1e-b5d6-4f5f-a017-c2df1d2433f4", "name": "network-vif-deleted", "tag": "e9261124-5553-4103-8f06-754a9b357217"}, {"server_uuid": "6e509d1e-b5d6-4f5f-a017-c2df1d2433f4", "name": "network-vif-deleted", "tag": "5842fe2c-d08f-4a4f-8daf-6a8e5788ff55"}, {"server_uuid": "6e509d1e-b5d6-4f5f-a017-c2df1d2433f4", "name": "network-vif-deleted", "tag": "12f72f3f-a741-4a92-92f8-08f8ec7273ff"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:27.842659 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-a723474f-a6d8-47d2-9eab-e51cc537afe1 req-cd99fa9b-aeb3-4cfa-85ba-bbdccfb3c164 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:27.843464 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-a723474f-a6d8-47d2-9eab-e51cc537afe1 req-cd99fa9b-aeb3-4cfa-85ba-bbdccfb3c164 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:27.867502 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-a723474f-a6d8-47d2-9eab-e51cc537afe1 req-cd99fa9b-aeb3-4cfa-85ba-bbdccfb3c164 service nova] Creating event network-vif-deleted:e9261124-5553-4103-8f06-754a9b357217 for instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 on n-h2-847009-3 Jul 19 22:41:27.868446 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-a723474f-a6d8-47d2-9eab-e51cc537afe1 req-cd99fa9b-aeb3-4cfa-85ba-bbdccfb3c164 service nova] Creating event network-vif-deleted:5842fe2c-d08f-4a4f-8daf-6a8e5788ff55 for instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 on n-h2-847009-3 Jul 19 22:41:27.869457 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-a723474f-a6d8-47d2-9eab-e51cc537afe1 req-cd99fa9b-aeb3-4cfa-85ba-bbdccfb3c164 service nova] Creating event network-vif-deleted:12f72f3f-a741-4a92-92f8-08f8ec7273ff for instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 on n-h2-847009-3 Jul 19 22:41:27.880822 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-a723474f-a6d8-47d2-9eab-e51cc537afe1 req-cd99fa9b-aeb3-4cfa-85ba-bbdccfb3c164 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.062856 Jul 19 22:41:27.881946 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1595/3158] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:27.892355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2b0a6f77-ef64-41e6-89b9-23233266a1c0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:27.893644 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2b0a6f77-ef64-41e6-89b9-23233266a1c0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:27.906204 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b0a6f77-ef64-41e6-89b9-23233266a1c0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:27.907028 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b0a6f77-ef64-41e6-89b9-23233266a1c0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:27.908455 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b0a6f77-ef64-41e6-89b9-23233266a1c0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:27.909261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b0a6f77-ef64-41e6-89b9-23233266a1c0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:28.095017 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bae0ef58-c4dd-4dd0-8a0c-83cafc445a91 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:28.105231 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bae0ef58-c4dd-4dd0-8a0c-83cafc445a91 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1313 microversion: 2.1 time: 0.529410 Jul 19 22:41:28.106159 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1564/3159] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:27 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1313 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:28.120011 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-42d5a7a6-8284-4a80-b91e-10429f912212 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:28.120892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-42d5a7a6-8284-4a80-b91e-10429f912212 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:28.128017 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42d5a7a6-8284-4a80-b91e-10429f912212 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:28.128564 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42d5a7a6-8284-4a80-b91e-10429f912212 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:28.129409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42d5a7a6-8284-4a80-b91e-10429f912212 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:28.129917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42d5a7a6-8284-4a80-b91e-10429f912212 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:28.252473 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-42d5a7a6-8284-4a80-b91e-10429f912212 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:28.264665 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-42d5a7a6-8284-4a80-b91e-10429f912212 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:28.266524 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-42d5a7a6-8284-4a80-b91e-10429f912212 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:28.267893 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-42d5a7a6-8284-4a80-b91e-10429f912212 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 200 len: 1366 microversion: 2.47 time: 0.152167 Jul 19 22:41:28.280418 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1565/3160] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:28 2022] GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:28.280418 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b166433e-ca61-4804-8660-96234051c3af tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:28.280418 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b166433e-ca61-4804-8660-96234051c3af tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:28.280418 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b166433e-ca61-4804-8660-96234051c3af tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-48366334', 'deleted': False, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4'} {{(pid=119337) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:41:28.286953 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b166433e-ca61-4804-8660-96234051c3af tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:28.287768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b166433e-ca61-4804-8660-96234051c3af tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:28.289153 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b166433e-ca61-4804-8660-96234051c3af tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:28.289749 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b166433e-ca61-4804-8660-96234051c3af tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:28.315549 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2b0a6f77-ef64-41e6-89b9-23233266a1c0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:28.329598 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2b0a6f77-ef64-41e6-89b9-23233266a1c0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:28.332214 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2b0a6f77-ef64-41e6-89b9-23233266a1c0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:28.333897 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2b0a6f77-ef64-41e6-89b9-23233266a1c0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 2326 microversion: 2.32 time: 0.450055 Jul 19 22:41:28.334952 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1596/3161] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:27 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 2326 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:28.353120 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1c434151-0b10-43c6-b448-555765f9f827 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Action: 'create', calling method: .version_select at 0x7f7a104b79d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-113681454", "description": "tempest-description-880262031"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:28.409728 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.multi_cell_list [None req-b166433e-ca61-4804-8660-96234051c3af tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119337) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:41:28.488478 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b166433e-ca61-4804-8660-96234051c3af tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-48366334" status: 200 len: 345 microversion: 2.1 time: 0.218424 Jul 19 22:41:28.489481 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1566/3162] 10.222.0.25 () {58 vars in 1225 bytes} [Tue Jul 19 22:41:28 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-48366334 => generated 345 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:28.495647 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bfd1c573-455c-414b-bc9c-27c042218953 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:28.496966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bfd1c573-455c-414b-bc9c-27c042218953 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: 063af6c1-3ce5-4da4-95f7-dae4e720f7fe] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:28.502894 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bfd1c573-455c-414b-bc9c-27c042218953 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:28.503379 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bfd1c573-455c-414b-bc9c-27c042218953 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:28.504162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bfd1c573-455c-414b-bc9c-27c042218953 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:28.504599 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bfd1c573-455c-414b-bc9c-27c042218953 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:28.539935 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:41:29.228982 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bfd1c573-455c-414b-bc9c-27c042218953 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6994ad3a701847d49163a7b709fba400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24647fdcb5d7402ebfdca8ea2ae72e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:29.242527 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1c434151-0b10-43c6-b448-555765f9f827 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.899700 Jul 19 22:41:29.243710 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1597/3163] 10.222.0.25 () {60 vars in 1179 bytes} [Tue Jul 19 22:41:28 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:29.248718 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bfd1c573-455c-414b-bc9c-27c042218953 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe" status: 200 len: 1315 microversion: 2.1 time: 0.757732 Jul 19 22:41:29.249018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-77f91d03-13bf-438b-8330-8fa418fa1a74 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:29.249586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-77f91d03-13bf-438b-8330-8fa418fa1a74 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:29.251927 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1567/3164] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:28 2022] GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe => generated 1315 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:29.264799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7041fc48-14c3-4141-bb07-79089cb1733e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:29.269008 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-77f91d03-13bf-438b-8330-8fa418fa1a74 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:29.269465 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-77f91d03-13bf-438b-8330-8fa418fa1a74 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:29.270262 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-77f91d03-13bf-438b-8330-8fa418fa1a74 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:29.270691 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7041fc48-14c3-4141-bb07-79089cb1733e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:29.270883 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-77f91d03-13bf-438b-8330-8fa418fa1a74 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:29.306992 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7041fc48-14c3-4141-bb07-79089cb1733e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:29.309395 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7041fc48-14c3-4141-bb07-79089cb1733e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:29.311968 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7041fc48-14c3-4141-bb07-79089cb1733e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:29.313163 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7041fc48-14c3-4141-bb07-79089cb1733e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:29.561730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-77f91d03-13bf-438b-8330-8fa418fa1a74 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:29.579551 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-77f91d03-13bf-438b-8330-8fa418fa1a74 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1506 microversion: 2.1 time: 0.334235 Jul 19 22:41:29.580994 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1598/3165] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:29 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:29.589737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5bce8964-4e73-4a4a-a5da-b1ac4485dcfb tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:29.590503 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5bce8964-4e73-4a4a-a5da-b1ac4485dcfb tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:29.607151 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7041fc48-14c3-4141-bb07-79089cb1733e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:29.613400 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5bce8964-4e73-4a4a-a5da-b1ac4485dcfb tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:29.614076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5bce8964-4e73-4a4a-a5da-b1ac4485dcfb tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:29.616873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5bce8964-4e73-4a4a-a5da-b1ac4485dcfb tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:29.621383 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5bce8964-4e73-4a4a-a5da-b1ac4485dcfb tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:29.623287 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7041fc48-14c3-4141-bb07-79089cb1733e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1512 microversion: 2.1 time: 0.368758 Jul 19 22:41:29.623957 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1568/3166] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:29 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1512 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:29.631411 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fc80b4d2-a292-4d4c-96fe-e5f3e6bca891 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:29.632465 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fc80b4d2-a292-4d4c-96fe-e5f3e6bca891 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:29.643252 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc80b4d2-a292-4d4c-96fe-e5f3e6bca891 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:29.644431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc80b4d2-a292-4d4c-96fe-e5f3e6bca891 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:29.645500 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc80b4d2-a292-4d4c-96fe-e5f3e6bca891 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:29.646661 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc80b4d2-a292-4d4c-96fe-e5f3e6bca891 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:29.674975 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5bce8964-4e73-4a4a-a5da-b1ac4485dcfb tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:41:29.790188 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5bce8964-4e73-4a4a-a5da-b1ac4485dcfb tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "DELETE /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41" status: 204 len: 0 microversion: 2.1 time: 0.206539 Jul 19 22:41:29.791650 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1599/3167] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:41:29 2022] DELETE /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:41:29.801663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e20a8f1c-981a-4ff3-bb7c-267a6ef16a67 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Action: 'create', calling method: .version_select at 0x7f7a104105e0>, body: {"security_group_rule": {"parent_group_id": "ad35b81f-3b8c-4e8e-9b54-7ddfb539976e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "a2d2ca8f-673c-4707-92d8-5d3083e5a0d5"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:29.932019 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fc80b4d2-a292-4d4c-96fe-e5f3e6bca891 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:29.943593 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fc80b4d2-a292-4d4c-96fe-e5f3e6bca891 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1313 microversion: 2.1 time: 0.317919 Jul 19 22:41:29.945250 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1569/3168] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:29 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:29.954431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-5d6280f6-67fd-445c-8877-9f8ada07ca69 req-6634af72-104a-46ae-be57-93c7564891ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7727fc2-2016-482d-aff6-0940874c3b28", "name": "network-vif-plugged", "status": "completed", "tag": "e9e1128e-eb72-4508-89fa-0c1047cf6872"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:29.969247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-5d6280f6-67fd-445c-8877-9f8ada07ca69 req-6634af72-104a-46ae-be57-93c7564891ea service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:29.969866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-5d6280f6-67fd-445c-8877-9f8ada07ca69 req-6634af72-104a-46ae-be57-93c7564891ea service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:29.990324 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-5d6280f6-67fd-445c-8877-9f8ada07ca69 req-6634af72-104a-46ae-be57-93c7564891ea service nova] Creating event network-vif-plugged:e9e1128e-eb72-4508-89fa-0c1047cf6872 for instance d7727fc2-2016-482d-aff6-0940874c3b28 on n-h1-847009-3 Jul 19 22:41:29.995709 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-5d6280f6-67fd-445c-8877-9f8ada07ca69 req-6634af72-104a-46ae-be57-93c7564891ea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048517 Jul 19 22:41:29.996785 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1570/3169] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:30.001867 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ecfbea7d-527b-4112-a288-9721330fe125 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:30.002664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ecfbea7d-527b-4112-a288-9721330fe125 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:30.010453 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ecfbea7d-527b-4112-a288-9721330fe125 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:30.010913 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ecfbea7d-527b-4112-a288-9721330fe125 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:30.011733 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ecfbea7d-527b-4112-a288-9721330fe125 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:30.012173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ecfbea7d-527b-4112-a288-9721330fe125 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:30.099148 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ecfbea7d-527b-4112-a288-9721330fe125 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:30.115443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ecfbea7d-527b-4112-a288-9721330fe125 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:30.118372 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ecfbea7d-527b-4112-a288-9721330fe125 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:30.121120 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ecfbea7d-527b-4112-a288-9721330fe125 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 200 len: 1366 microversion: 2.47 time: 0.123039 Jul 19 22:41:30.122147 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1571/3170] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:29 2022] GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 1366 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:30.131199 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-18ffc960-03e7-4d92-a8c0-8fd19d5d48d8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:30.132560 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-18ffc960-03e7-4d92-a8c0-8fd19d5d48d8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:30.144358 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-18ffc960-03e7-4d92-a8c0-8fd19d5d48d8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:30.145117 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-18ffc960-03e7-4d92-a8c0-8fd19d5d48d8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:30.146485 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-18ffc960-03e7-4d92-a8c0-8fd19d5d48d8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:30.147889 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-18ffc960-03e7-4d92-a8c0-8fd19d5d48d8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:30.269213 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e20a8f1c-981a-4ff3-bb7c-267a6ef16a67 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.475314 Jul 19 22:41:30.279275 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1600/3171] 10.222.0.25 () {60 vars in 1194 bytes} [Tue Jul 19 22:41:29 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:30.279473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a658e764-885a-4689-a194-1e7603044229 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:30.280645 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a658e764-885a-4689-a194-1e7603044229 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:30.295557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a658e764-885a-4689-a194-1e7603044229 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:30.296395 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a658e764-885a-4689-a194-1e7603044229 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:30.297863 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a658e764-885a-4689-a194-1e7603044229 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:30.298702 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a658e764-885a-4689-a194-1e7603044229 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:30.328819 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-18ffc960-03e7-4d92-a8c0-8fd19d5d48d8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:30.342055 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-18ffc960-03e7-4d92-a8c0-8fd19d5d48d8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:30.344377 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-18ffc960-03e7-4d92-a8c0-8fd19d5d48d8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:30.345544 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-18ffc960-03e7-4d92-a8c0-8fd19d5d48d8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1605 microversion: 2.32 time: 0.221750 Jul 19 22:41:30.346433 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1572/3172] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:30 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1605 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:30.351301 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-e2f1d5bb-8f72-4a4e-9bb3-fbcdaace9a46 req-3e436920-89f9-447b-983e-64fc115122e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e509d1e-b5d6-4f5f-a017-c2df1d2433f4", "name": "network-vif-deleted", "tag": "2c7186d7-bc64-4766-af9a-aacc09242cdb"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:30.365232 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e2f1d5bb-8f72-4a4e-9bb3-fbcdaace9a46 req-3e436920-89f9-447b-983e-64fc115122e1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:30.366343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e2f1d5bb-8f72-4a4e-9bb3-fbcdaace9a46 req-3e436920-89f9-447b-983e-64fc115122e1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:30.390997 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-e2f1d5bb-8f72-4a4e-9bb3-fbcdaace9a46 req-3e436920-89f9-447b-983e-64fc115122e1 service nova] Creating event network-vif-deleted:2c7186d7-bc64-4766-af9a-aacc09242cdb for instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 on n-h2-847009-3 Jul 19 22:41:30.398936 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-e2f1d5bb-8f72-4a4e-9bb3-fbcdaace9a46 req-3e436920-89f9-447b-983e-64fc115122e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050463 Jul 19 22:41:30.400060 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1573/3173] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:30.407536 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c7b4a30e-4bf1-4939-974f-28f13a817df8 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:30.408547 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c7b4a30e-4bf1-4939-974f-28f13a817df8 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: 063af6c1-3ce5-4da4-95f7-dae4e720f7fe] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:30.417988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c7b4a30e-4bf1-4939-974f-28f13a817df8 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:30.418446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c7b4a30e-4bf1-4939-974f-28f13a817df8 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:30.419266 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c7b4a30e-4bf1-4939-974f-28f13a817df8 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:30.419715 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c7b4a30e-4bf1-4939-974f-28f13a817df8 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:30.545593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a658e764-885a-4689-a194-1e7603044229 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:30.558976 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a658e764-885a-4689-a194-1e7603044229 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41" status: 200 len: 1517 microversion: 2.1 time: 0.286849 Jul 19 22:41:30.560061 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1601/3174] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:30 2022] GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41 => generated 1517 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:30.567074 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a964cc5d-2883-4deb-beac-de929c6326f9 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Calling method '.version_select at 0x7f7a104b7670>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:30.704602 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c7b4a30e-4bf1-4939-974f-28f13a817df8 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6994ad3a701847d49163a7b709fba400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24647fdcb5d7402ebfdca8ea2ae72e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:30.717938 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c7b4a30e-4bf1-4939-974f-28f13a817df8 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe" status: 200 len: 1503 microversion: 2.1 time: 0.315380 Jul 19 22:41:30.731280 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1574/3175] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:30 2022] GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe => generated 1503 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:30.731280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6b113a70-8ff3-4a79-b13a-ac321cc6176e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:30.731280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6b113a70-8ff3-4a79-b13a-ac321cc6176e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:30.745424 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b113a70-8ff3-4a79-b13a-ac321cc6176e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:30.746244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b113a70-8ff3-4a79-b13a-ac321cc6176e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:30.748491 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b113a70-8ff3-4a79-b13a-ac321cc6176e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:30.748966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b113a70-8ff3-4a79-b13a-ac321cc6176e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:31.045284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6b113a70-8ff3-4a79-b13a-ac321cc6176e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:31.059904 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6b113a70-8ff3-4a79-b13a-ac321cc6176e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1506 microversion: 2.1 time: 0.334645 Jul 19 22:41:31.060987 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1575/3176] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:30 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:31.063255 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a964cc5d-2883-4deb-beac-de929c6326f9 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/a2d2ca8f-673c-4707-92d8-5d3083e5a0d5" status: 202 len: 0 microversion: 2.1 time: 0.501298 Jul 19 22:41:31.064082 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1602/3177] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:41:30 2022] DELETE /compute/v2.1/os-security-groups/a2d2ca8f-673c-4707-92d8-5d3083e5a0d5 => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:41:31.070091 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6768f0d4-5ce8-43f5-9e43-6f056202fe52 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-476990381"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:31.070924 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6768f0d4-5ce8-43f5-9e43-6f056202fe52 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: 063af6c1-3ce5-4da4-95f7-dae4e720f7fe] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:31.074607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bfd765f8-e1ad-46cd-8e76-79c4e0525c35 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:31.075369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bfd765f8-e1ad-46cd-8e76-79c4e0525c35 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:31.087642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bfd765f8-e1ad-46cd-8e76-79c4e0525c35 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:31.089023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6768f0d4-5ce8-43f5-9e43-6f056202fe52 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:31.089949 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bfd765f8-e1ad-46cd-8e76-79c4e0525c35 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:31.090105 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6768f0d4-5ce8-43f5-9e43-6f056202fe52 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:31.091144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bfd765f8-e1ad-46cd-8e76-79c4e0525c35 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:31.091633 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6768f0d4-5ce8-43f5-9e43-6f056202fe52 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:31.092081 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bfd765f8-e1ad-46cd-8e76-79c4e0525c35 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:31.092392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6768f0d4-5ce8-43f5-9e43-6f056202fe52 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:31.156905 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=25 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:41:31.535536 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bfd765f8-e1ad-46cd-8e76-79c4e0525c35 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:31.541816 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.network.security_group_api [None req-6768f0d4-5ce8-43f5-9e43-6f056202fe52 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Adding security group cd4d191e-7a55-4cd2-92d1-99a3ef45c087 to port 14665aa9-4185-4b76-b88c-3d89b7130fba Jul 19 22:41:31.554201 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bfd765f8-e1ad-46cd-8e76-79c4e0525c35 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1512 microversion: 2.1 time: 0.491530 Jul 19 22:41:31.555726 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1576/3178] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:31 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1512 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:31.562489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6ccba6bb-4c13-4376-b58c-9772914be91c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:31.563157 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6ccba6bb-4c13-4376-b58c-9772914be91c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:31.570411 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6ccba6bb-4c13-4376-b58c-9772914be91c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:31.573309 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6ccba6bb-4c13-4376-b58c-9772914be91c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:31.573691 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6ccba6bb-4c13-4376-b58c-9772914be91c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:31.574108 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6ccba6bb-4c13-4376-b58c-9772914be91c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:32.000530 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6ccba6bb-4c13-4376-b58c-9772914be91c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:32.016453 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6ccba6bb-4c13-4376-b58c-9772914be91c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1313 microversion: 2.1 time: 0.458501 Jul 19 22:41:32.028315 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1577/3179] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:31 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1313 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:32.028315 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-498e5469-e583-4c0e-ab85-32039f767169 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Calling method '.version_select at 0x7f7a03e04040>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:32.230770 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-498e5469-e583-4c0e-ab85-32039f767169 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/ad35b81f-3b8c-4e8e-9b54-7ddfb539976e" status: 200 len: 248 microversion: 2.1 time: 0.211801 Jul 19 22:41:32.237089 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1578/3180] 10.222.0.25 () {58 vars in 1268 bytes} [Tue Jul 19 22:41:32 2022] GET /compute/v2.1/os-security-groups/ad35b81f-3b8c-4e8e-9b54-7ddfb539976e => generated 248 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:32.246718 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c5133a0d-449e-40ce-afa9-89c094f9e7dc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:32.247663 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c5133a0d-449e-40ce-afa9-89c094f9e7dc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:32.255643 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5133a0d-449e-40ce-afa9-89c094f9e7dc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:32.256111 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5133a0d-449e-40ce-afa9-89c094f9e7dc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:32.257078 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5133a0d-449e-40ce-afa9-89c094f9e7dc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:32.257340 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5133a0d-449e-40ce-afa9-89c094f9e7dc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:32.398853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c5133a0d-449e-40ce-afa9-89c094f9e7dc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:32.414053 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c5133a0d-449e-40ce-afa9-89c094f9e7dc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:32.415653 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c5133a0d-449e-40ce-afa9-89c094f9e7dc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:32.417599 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c5133a0d-449e-40ce-afa9-89c094f9e7dc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 200 len: 1366 microversion: 2.47 time: 0.182061 Jul 19 22:41:32.418482 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1579/3181] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:32 2022] GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:32.439562 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-217ecfb6-abe3-4208-a7ae-38ad44f1b580 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:32.441268 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-217ecfb6-abe3-4208-a7ae-38ad44f1b580 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:32.453823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-217ecfb6-abe3-4208-a7ae-38ad44f1b580 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:32.454665 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-217ecfb6-abe3-4208-a7ae-38ad44f1b580 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:32.457046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-217ecfb6-abe3-4208-a7ae-38ad44f1b580 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:32.457822 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-217ecfb6-abe3-4208-a7ae-38ad44f1b580 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:32.679132 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-217ecfb6-abe3-4208-a7ae-38ad44f1b580 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:32.713799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-217ecfb6-abe3-4208-a7ae-38ad44f1b580 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:32.716886 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-217ecfb6-abe3-4208-a7ae-38ad44f1b580 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:32.727879 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-217ecfb6-abe3-4208-a7ae-38ad44f1b580 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1605 microversion: 2.32 time: 0.290563 Jul 19 22:41:32.730656 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1580/3182] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:32 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1605 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:32.745288 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6768f0d4-5ce8-43f5-9e43-6f056202fe52 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "POST /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe/action" status: 202 len: 0 microversion: 2.1 time: 1.678449 Jul 19 22:41:32.746511 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1603/3183] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:41:31 2022] POST /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe/action => generated 0 bytes in 1682 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:41:32.750440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-91a52255-c5fd-4e56-b0fa-b82d2a7e27a4 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:32.751081 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-91a52255-c5fd-4e56-b0fa-b82d2a7e27a4 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:32.781718 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-91a52255-c5fd-4e56-b0fa-b82d2a7e27a4 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:32.783611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-91a52255-c5fd-4e56-b0fa-b82d2a7e27a4 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:32.794054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-91a52255-c5fd-4e56-b0fa-b82d2a7e27a4 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:32.795083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-91a52255-c5fd-4e56-b0fa-b82d2a7e27a4 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:32.803979 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-506a69b7-eab6-46bb-b5a5-e13c93f1d882 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:32.813180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-506a69b7-eab6-46bb-b5a5-e13c93f1d882 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:32.843034 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-506a69b7-eab6-46bb-b5a5-e13c93f1d882 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:32.849435 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-506a69b7-eab6-46bb-b5a5-e13c93f1d882 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:32.851341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-506a69b7-eab6-46bb-b5a5-e13c93f1d882 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:32.852547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-506a69b7-eab6-46bb-b5a5-e13c93f1d882 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:32.993248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-91a52255-c5fd-4e56-b0fa-b82d2a7e27a4 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:33.013616 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-91a52255-c5fd-4e56-b0fa-b82d2a7e27a4 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41" status: 200 len: 1475 microversion: 2.1 time: 0.275076 Jul 19 22:41:33.035742 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1581/3184] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:32 2022] GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41 => generated 1475 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:33.044972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-afdafdfd-75fc-43da-b69f-821c2d3a0f19 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Action: 'create', calling method: .version_select at 0x7f7a03d43d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-355797090", "description": "tempest-description-1288421221"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:33.356327 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-506a69b7-eab6-46bb-b5a5-e13c93f1d882 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:33.375763 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-506a69b7-eab6-46bb-b5a5-e13c93f1d882 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1506 microversion: 2.1 time: 0.626725 Jul 19 22:41:33.378458 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1604/3185] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:32 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1506 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:33.389164 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5daee199-1e88-4e3b-84a9-dd0edbd95e7c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:33.391005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5daee199-1e88-4e3b-84a9-dd0edbd95e7c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:33.404105 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5daee199-1e88-4e3b-84a9-dd0edbd95e7c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:33.404663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5daee199-1e88-4e3b-84a9-dd0edbd95e7c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:33.406264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5daee199-1e88-4e3b-84a9-dd0edbd95e7c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:33.407186 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5daee199-1e88-4e3b-84a9-dd0edbd95e7c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:33.606832 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-afdafdfd-75fc-43da-b69f-821c2d3a0f19 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.569339 Jul 19 22:41:33.608036 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1582/3186] 10.222.0.25 () {60 vars in 1179 bytes} [Tue Jul 19 22:41:33 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:33.613135 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-b4590708-53ed-42e0-bf0b-fa1a8c4b716b req-c7e58bd5-8e22-41be-b7dd-f415a4cb6eec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24930fd1-7b1b-4bdd-9143-d9d0bfa6da41", "name": "network-vif-deleted", "tag": "ea6d5ff1-f67a-4eb4-9529-de8c075d640f"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:33.642190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b4590708-53ed-42e0-bf0b-fa1a8c4b716b req-c7e58bd5-8e22-41be-b7dd-f415a4cb6eec service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:33.646150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b4590708-53ed-42e0-bf0b-fa1a8c4b716b req-c7e58bd5-8e22-41be-b7dd-f415a4cb6eec service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:33.678077 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-b4590708-53ed-42e0-bf0b-fa1a8c4b716b req-c7e58bd5-8e22-41be-b7dd-f415a4cb6eec service nova] Creating event network-vif-deleted:ea6d5ff1-f67a-4eb4-9529-de8c075d640f for instance 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41 on n-h1-847009-3 Jul 19 22:41:33.690301 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-b4590708-53ed-42e0-bf0b-fa1a8c4b716b req-c7e58bd5-8e22-41be-b7dd-f415a4cb6eec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080717 Jul 19 22:41:33.702150 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5daee199-1e88-4e3b-84a9-dd0edbd95e7c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:33.708176 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1583/3187] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:33.728922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-72254f8e-dac8-4e6b-a6cc-e46354cadb43 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '.version_select at 0x7f7a03f80280>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:33.736485 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5daee199-1e88-4e3b-84a9-dd0edbd95e7c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1512 microversion: 2.1 time: 0.355686 Jul 19 22:41:33.737813 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1605/3188] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:33 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1512 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:33.757601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-992393e3-7007-4e87-9880-d50467e52b8a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:33.762185 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-992393e3-7007-4e87-9880-d50467e52b8a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:33.809090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-992393e3-7007-4e87-9880-d50467e52b8a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:33.810240 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-992393e3-7007-4e87-9880-d50467e52b8a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:33.811896 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-992393e3-7007-4e87-9880-d50467e52b8a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:33.812893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-992393e3-7007-4e87-9880-d50467e52b8a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:34.027320 n-d-847009-3 devstack@n-api.service[119337]: DEBUG neutronclient.v2_0.client [None req-72254f8e-dac8-4e6b-a6cc-e46354cadb43 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group cd4d191e-7a55-4cd2-92d1-99a3ef45c087 in use.", "detail": ""}} {{(pid=119337) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 22:41:34.028101 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-72254f8e-dac8-4e6b-a6cc-e46354cadb43 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] HTTP exception thrown: Security Group cd4d191e-7a55-4cd2-92d1-99a3ef45c087 in use. Jul 19 22:41:34.028101 n-d-847009-3 devstack@n-api.service[119337]: Neutron server returns request_ids: ['req-40042a2c-92c9-421c-b5ba-6c097ceef387'] Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-72254f8e-dac8-4e6b-a6cc-e46354cadb43 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Request method failure captured: Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/os-security-groups/cd4d191e-7a55-4cd2-92d1-99a3ef45c087 HTTP/1.1 Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zLOcBnDO8DB0TvfRIhrSs2i1Z8gf2mXRu9CWG3-L53ppyrrqccAldlD1sn80tAiiaYj788W6zk_H_lFv9A7zGAIhHM_mj3-7IRMW_3igT7vOPEp-kC_qbKwdmn2JH9DflRdkn_IaARtkReZyhJI3DiZyzYUOJLxFUfr88ChX6WBaz8 Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 6994ad3a701847d49163a7b709fba400 Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: exception: Security Group cd4d191e-7a55-4cd2-92d1-99a3ef45c087 in use. Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: Neutron server returns request_ids: ['req-40042a2c-92c9-421c-b5ba-6c097ceef387'] Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'cd4d191e-7a55-4cd2-92d1-99a3ef45c087'} Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 22:41:34.030027 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group cd4d191e-7a55-4cd2-92d1-99a3ef45c087 in use. Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40042a2c-92c9-421c-b5ba-6c097ceef387'] Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group cd4d191e-7a55-4cd2-92d1-99a3ef45c087 in use. Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40042a2c-92c9-421c-b5ba-6c097ceef387'] Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group cd4d191e-7a55-4cd2-92d1-99a3ef45c087 in use. Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40042a2c-92c9-421c-b5ba-6c097ceef387'] Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group cd4d191e-7a55-4cd2-92d1-99a3ef45c087 in use. Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40042a2c-92c9-421c-b5ba-6c097ceef387'] Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-72254f8e-dac8-4e6b-a6cc-e46354cadb43 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Returning 400 to user: Security Group cd4d191e-7a55-4cd2-92d1-99a3ef45c087 in use. Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: Neutron server returns request_ids: ['req-40042a2c-92c9-421c-b5ba-6c097ceef387'] {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-72254f8e-dac8-4e6b-a6cc-e46354cadb43 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/cd4d191e-7a55-4cd2-92d1-99a3ef45c087" status: 400 len: 185 microversion: 2.1 time: 0.319280 Jul 19 22:41:34.040503 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1584/3189] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:41:33 2022] DELETE /compute/v2.1/os-security-groups/cd4d191e-7a55-4cd2-92d1-99a3ef45c087 => generated 185 bytes in 327 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:41:34.051369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9d19b979-b55c-4160-af09-39618f5045ea tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:34.051369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9d19b979-b55c-4160-af09-39618f5045ea tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:34.051369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d19b979-b55c-4160-af09-39618f5045ea tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:34.051369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d19b979-b55c-4160-af09-39618f5045ea tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:34.051369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d19b979-b55c-4160-af09-39618f5045ea tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:34.052504 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d19b979-b55c-4160-af09-39618f5045ea tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:34.117446 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-992393e3-7007-4e87-9880-d50467e52b8a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:34.127853 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-992393e3-7007-4e87-9880-d50467e52b8a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1501 microversion: 2.1 time: 0.387525 Jul 19 22:41:34.128430 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1606/3190] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:33 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1501 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:34.133154 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-52703296-befb-4fd3-908d-7663c7805181 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Action: 'create', calling method: .version_select at 0x7f7a1042b4c0>, body: {"security_group_rule": {"parent_group_id": "974e760d-f653-412f-99ba-fddcfc67e978", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:34.145126 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9d19b979-b55c-4160-af09-39618f5045ea tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:34.163019 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9d19b979-b55c-4160-af09-39618f5045ea tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:34.164715 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9d19b979-b55c-4160-af09-39618f5045ea tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:34.167315 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9d19b979-b55c-4160-af09-39618f5045ea tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 200 len: 1366 microversion: 2.47 time: 0.130152 Jul 19 22:41:34.168284 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1585/3191] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:34 2022] GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 1366 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:34.175760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fa28cc04-5713-4adc-9347-85afc84ec2a7 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:34.178122 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fa28cc04-5713-4adc-9347-85afc84ec2a7 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:34.186842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa28cc04-5713-4adc-9347-85afc84ec2a7 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:34.187918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa28cc04-5713-4adc-9347-85afc84ec2a7 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:34.189399 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa28cc04-5713-4adc-9347-85afc84ec2a7 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:34.190174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa28cc04-5713-4adc-9347-85afc84ec2a7 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:34.284914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fa28cc04-5713-4adc-9347-85afc84ec2a7 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:34.303224 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fa28cc04-5713-4adc-9347-85afc84ec2a7 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:34.306760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fa28cc04-5713-4adc-9347-85afc84ec2a7 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:34.309338 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fa28cc04-5713-4adc-9347-85afc84ec2a7 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1605 microversion: 2.32 time: 0.139498 Jul 19 22:41:34.318027 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1586/3192] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:34 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1605 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:34.329885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e6d29725-2673-4e40-a08d-f9cac63cac21 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:34.331035 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e6d29725-2673-4e40-a08d-f9cac63cac21 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:34.342078 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6d29725-2673-4e40-a08d-f9cac63cac21 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:34.342886 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6d29725-2673-4e40-a08d-f9cac63cac21 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:34.344405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6d29725-2673-4e40-a08d-f9cac63cac21 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:34.345167 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6d29725-2673-4e40-a08d-f9cac63cac21 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:34.372108 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-e6d29725-2673-4e40-a08d-f9cac63cac21 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] HTTP exception thrown: Instance 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41 could not be found. Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e6d29725-2673-4e40-a08d-f9cac63cac21 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Request method failure captured: Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41 HTTP/1.1 Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zKoq_vhusXnDANbcr3Sa5SWzyS4aLTqhiTRhUL04Uit83u4qZhnIUT5la9P9_Xp0JNuobdlOuEQMGgnXDRkWvZ6eC79pAPBsg6riRz7xiynuljTjhPoHHzR79phDQMiu20IH4gODtcUDQ17FZj4H5GwZDdOObgVxk-gHjspvmTLK0o Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 1b633041d58845d1a6d0b9f31f3613d4 Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ListServerFiltersTestJSON-1412242091 Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1b633041d58845d1a6d0b9f31f3613d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1b633041d58845d1a6d0b9f31f3613d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1b633041d58845d1a6d0b9f31f3613d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1b633041d58845d1a6d0b9f31f3613d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ListServerFiltersTestJSON-1412242091 Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 1b633041d58845d1a6d0b9f31f3613d4 Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1412242091 Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ListServerFiltersTestJSON-1412242091-project Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 0631675f80674534b1e775e521cfea10 Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ListServerFiltersTestJSON-1412242091-project Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41 could not be found. Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '24930fd1-7b1b-4bdd-9143-d9d0bfa6da41'} Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41 could not be found. Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41 could not be found. Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:34.375718 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:34.384989 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:34.384989 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:34.384989 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:34.384989 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:41:34.384989 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:41:34.384989 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41 could not be found. Jul 19 22:41:34.384989 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:34.384989 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e6d29725-2673-4e40-a08d-f9cac63cac21 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Returning 404 to user: Instance 24930fd1-7b1b-4bdd-9143-d9d0bfa6da41 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:41:34.384989 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e6d29725-2673-4e40-a08d-f9cac63cac21 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41" status: 404 len: 111 microversion: 2.1 time: 0.065054 Jul 19 22:41:34.384989 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1587/3193] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:34 2022] GET /compute/v2.1/servers/24930fd1-7b1b-4bdd-9143-d9d0bfa6da41 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:41:34.386527 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-96bbd336-ed29-4fe9-a31e-d15a901b4543 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:34.388234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-96bbd336-ed29-4fe9-a31e-d15a901b4543 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: 063af6c1-3ce5-4da4-95f7-dae4e720f7fe] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:34.398541 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-96bbd336-ed29-4fe9-a31e-d15a901b4543 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:34.399062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-96bbd336-ed29-4fe9-a31e-d15a901b4543 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:34.400609 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-96bbd336-ed29-4fe9-a31e-d15a901b4543 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:34.401245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-96bbd336-ed29-4fe9-a31e-d15a901b4543 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:34.496356 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-52703296-befb-4fd3-908d-7663c7805181 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.366257 Jul 19 22:41:34.498026 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1607/3194] 10.222.0.25 () {60 vars in 1194 bytes} [Tue Jul 19 22:41:34 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:34.508888 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6e3f82fd-3f68-43c3-b6e2-1f43951e5a1f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:34.510487 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6e3f82fd-3f68-43c3-b6e2-1f43951e5a1f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:34.520272 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e3f82fd-3f68-43c3-b6e2-1f43951e5a1f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:34.521239 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e3f82fd-3f68-43c3-b6e2-1f43951e5a1f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:34.522336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e3f82fd-3f68-43c3-b6e2-1f43951e5a1f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:34.523016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e3f82fd-3f68-43c3-b6e2-1f43951e5a1f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:34.523498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:41:34.539937 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-96bbd336-ed29-4fe9-a31e-d15a901b4543 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "POST /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe/action" status: 202 len: 0 microversion: 2.1 time: 0.158621 Jul 19 22:41:34.543557 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1588/3195] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:41:34 2022] POST /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:41:34.550512 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0f66ea7c-0959-4ac9-abb6-92ec18344bc1 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:34.551842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0f66ea7c-0959-4ac9-abb6-92ec18344bc1 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 648bd230-03d9-4186-8cc0-64573fae2ab6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:34.562745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0f66ea7c-0959-4ac9-abb6-92ec18344bc1 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:34.563399 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0f66ea7c-0959-4ac9-abb6-92ec18344bc1 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:34.565274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0f66ea7c-0959-4ac9-abb6-92ec18344bc1 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:34.565941 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0f66ea7c-0959-4ac9-abb6-92ec18344bc1 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:34.567027 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-6e3f82fd-3f68-43c3-b6e2-1f43951e5a1f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lazy-loading 'flavor' on Instance uuid d7727fc2-2016-482d-aff6-0940874c3b28 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:41:34.610975 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0f66ea7c-0959-4ac9-abb6-92ec18344bc1 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 648bd230-03d9-4186-8cc0-64573fae2ab6] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:41:34.730406 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0f66ea7c-0959-4ac9-abb6-92ec18344bc1 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "DELETE /compute/v2.1/servers/648bd230-03d9-4186-8cc0-64573fae2ab6" status: 204 len: 0 microversion: 2.1 time: 0.187691 Jul 19 22:41:34.731043 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1589/3196] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:41:34 2022] DELETE /compute/v2.1/servers/648bd230-03d9-4186-8cc0-64573fae2ab6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:41:34.740515 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3aa7a077-b749-451c-96f5-6721817b9ca8 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:34.741876 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3aa7a077-b749-451c-96f5-6721817b9ca8 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:34.752365 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3aa7a077-b749-451c-96f5-6721817b9ca8 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:34.753407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3aa7a077-b749-451c-96f5-6721817b9ca8 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:34.756814 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3aa7a077-b749-451c-96f5-6721817b9ca8 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:34.757924 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3aa7a077-b749-451c-96f5-6721817b9ca8 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:35.008256 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6e3f82fd-3f68-43c3-b6e2-1f43951e5a1f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "POST /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28/action" status: 202 len: 0 microversion: 2.1 time: 0.508724 Jul 19 22:41:35.013554 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1608/3197] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:41:34 2022] POST /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:41:35.019218 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9d19f4a2-009e-435f-8383-a2613f06d1d9 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Action: 'create', calling method: .version_select at 0x7f7a1012ed30>, body: {"security_group_rule": {"parent_group_id": "974e760d-f653-412f-99ba-fddcfc67e978", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:35.169072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3aa7a077-b749-451c-96f5-6721817b9ca8 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:35.183942 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3aa7a077-b749-451c-96f5-6721817b9ca8 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1506 microversion: 2.1 time: 0.451347 Jul 19 22:41:35.187092 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1590/3198] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:34 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1506 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:35.195575 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-46049ab8-945b-4374-9eaf-f711754c964a tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:35.197076 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-46049ab8-945b-4374-9eaf-f711754c964a tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: 063af6c1-3ce5-4da4-95f7-dae4e720f7fe] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:35.209281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46049ab8-945b-4374-9eaf-f711754c964a tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:35.210420 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46049ab8-945b-4374-9eaf-f711754c964a tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:35.214396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46049ab8-945b-4374-9eaf-f711754c964a tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:35.215262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46049ab8-945b-4374-9eaf-f711754c964a tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:35.383383 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=12 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:41:35.566225 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9d19f4a2-009e-435f-8383-a2613f06d1d9 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.550738 Jul 19 22:41:35.568745 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1609/3199] 10.222.0.25 () {60 vars in 1194 bytes} [Tue Jul 19 22:41:35 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:35.578478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f11d2516-0097-4fe2-b4a7-337f1d05f46d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:35.579437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f11d2516-0097-4fe2-b4a7-337f1d05f46d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 648bd230-03d9-4186-8cc0-64573fae2ab6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:35.586662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f11d2516-0097-4fe2-b4a7-337f1d05f46d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:35.587292 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f11d2516-0097-4fe2-b4a7-337f1d05f46d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:35.589580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f11d2516-0097-4fe2-b4a7-337f1d05f46d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:35.590305 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f11d2516-0097-4fe2-b4a7-337f1d05f46d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:35.643822 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-46049ab8-945b-4374-9eaf-f711754c964a tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6994ad3a701847d49163a7b709fba400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24647fdcb5d7402ebfdca8ea2ae72e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:35.653610 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-46049ab8-945b-4374-9eaf-f711754c964a tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe" status: 200 len: 1573 microversion: 2.1 time: 0.464660 Jul 19 22:41:35.654206 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1591/3200] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:35 2022] GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe => generated 1573 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:35.660949 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2dcec379-befd-4414-968e-2731607570c5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:35.662048 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2dcec379-befd-4414-968e-2731607570c5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:35.676128 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2dcec379-befd-4414-968e-2731607570c5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:35.676995 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2dcec379-befd-4414-968e-2731607570c5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:35.677972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2dcec379-befd-4414-968e-2731607570c5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:35.678570 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2dcec379-befd-4414-968e-2731607570c5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:35.952623 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2dcec379-befd-4414-968e-2731607570c5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:35.953504 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f11d2516-0097-4fe2-b4a7-337f1d05f46d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:35.956990 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:41:35.968941 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2dcec379-befd-4414-968e-2731607570c5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1512 microversion: 2.1 time: 0.313284 Jul 19 22:41:35.969290 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f11d2516-0097-4fe2-b4a7-337f1d05f46d tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/648bd230-03d9-4186-8cc0-64573fae2ab6" status: 200 len: 1518 microversion: 2.1 time: 0.398026 Jul 19 22:41:35.970583 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1592/3201] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:35 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1512 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:35.984076 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1610/3202] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:35 2022] GET /compute/v2.1/servers/648bd230-03d9-4186-8cc0-64573fae2ab6 => generated 1518 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:35.984076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a7d580a8-f8d2-49c8-b250-08f1385f0dad tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:35.984076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a7d580a8-f8d2-49c8-b250-08f1385f0dad tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:35.991701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-763c5941-da8d-4f4c-a894-9f6f1a56f348 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:35.992689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-763c5941-da8d-4f4c-a894-9f6f1a56f348 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:35.996167 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a7d580a8-f8d2-49c8-b250-08f1385f0dad tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:35.998439 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a7d580a8-f8d2-49c8-b250-08f1385f0dad tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:36.000079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a7d580a8-f8d2-49c8-b250-08f1385f0dad tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:36.000885 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a7d580a8-f8d2-49c8-b250-08f1385f0dad tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:36.011166 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-763c5941-da8d-4f4c-a894-9f6f1a56f348 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:36.012640 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-763c5941-da8d-4f4c-a894-9f6f1a56f348 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:36.013547 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-763c5941-da8d-4f4c-a894-9f6f1a56f348 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:36.014245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-763c5941-da8d-4f4c-a894-9f6f1a56f348 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:36.162215 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a7d580a8-f8d2-49c8-b250-08f1385f0dad tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:36.178686 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a7d580a8-f8d2-49c8-b250-08f1385f0dad tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:36.184290 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a7d580a8-f8d2-49c8-b250-08f1385f0dad tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:36.188731 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a7d580a8-f8d2-49c8-b250-08f1385f0dad tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 200 len: 1366 microversion: 2.47 time: 0.212184 Jul 19 22:41:36.189326 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1611/3203] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:35 2022] GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:36.198672 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-587e94ee-be85-4ff3-b946-523510d1628b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:36.199949 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-587e94ee-be85-4ff3-b946-523510d1628b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:36.211314 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-587e94ee-be85-4ff3-b946-523510d1628b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:36.212648 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-587e94ee-be85-4ff3-b946-523510d1628b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:36.213655 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-587e94ee-be85-4ff3-b946-523510d1628b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:36.214567 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-587e94ee-be85-4ff3-b946-523510d1628b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:36.223584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-763c5941-da8d-4f4c-a894-9f6f1a56f348 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:36.236628 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-763c5941-da8d-4f4c-a894-9f6f1a56f348 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1507 microversion: 2.1 time: 0.249111 Jul 19 22:41:36.237376 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1593/3204] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:35 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1507 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:36.246051 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2f0b21a0-5a6b-432d-a47c-8e0d242bb381 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Calling method '.version_select at 0x7f7a03ea9af0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:36.351190 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-587e94ee-be85-4ff3-b946-523510d1628b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:36.365514 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-587e94ee-be85-4ff3-b946-523510d1628b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:36.368006 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-587e94ee-be85-4ff3-b946-523510d1628b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:36.370584 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-587e94ee-be85-4ff3-b946-523510d1628b tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1605 microversion: 2.32 time: 0.178766 Jul 19 22:41:36.371752 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1612/3205] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:36 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1605 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:36.379866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-0069ebc0-a348-4484-896a-7b7ba0133aeb req-6943de90-b5ab-4b0a-b49d-e6841941549f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "063af6c1-3ce5-4da4-95f7-dae4e720f7fe", "tag": "14665aa9-4185-4b76-b88c-3d89b7130fba"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:36.394463 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2f0b21a0-5a6b-432d-a47c-8e0d242bb381 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/974e760d-f653-412f-99ba-fddcfc67e978" status: 200 len: 664 microversion: 2.1 time: 0.155493 Jul 19 22:41:36.395837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0069ebc0-a348-4484-896a-7b7ba0133aeb req-6943de90-b5ab-4b0a-b49d-e6841941549f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:36.397047 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0069ebc0-a348-4484-896a-7b7ba0133aeb req-6943de90-b5ab-4b0a-b49d-e6841941549f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:36.397231 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1594/3206] 10.222.0.25 () {58 vars in 1268 bytes} [Tue Jul 19 22:41:36 2022] GET /compute/v2.1/os-security-groups/974e760d-f653-412f-99ba-fddcfc67e978 => generated 664 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:36.411486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1195e8cd-ad88-41a3-8141-61265dcae21b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:36.412422 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1195e8cd-ad88-41a3-8141-61265dcae21b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:36.425178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1195e8cd-ad88-41a3-8141-61265dcae21b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:36.426140 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1195e8cd-ad88-41a3-8141-61265dcae21b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:36.426464 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-0069ebc0-a348-4484-896a-7b7ba0133aeb req-6943de90-b5ab-4b0a-b49d-e6841941549f service nova] Creating event network-changed:14665aa9-4185-4b76-b88c-3d89b7130fba for instance 063af6c1-3ce5-4da4-95f7-dae4e720f7fe on n-h2-847009-3 Jul 19 22:41:36.428520 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1195e8cd-ad88-41a3-8141-61265dcae21b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:36.429185 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1195e8cd-ad88-41a3-8141-61265dcae21b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:36.436336 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-0069ebc0-a348-4484-896a-7b7ba0133aeb req-6943de90-b5ab-4b0a-b49d-e6841941549f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062023 Jul 19 22:41:36.437887 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1613/3207] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:36.448273 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6dea1bb8-e1c9-45e5-9f31-6c0e750d7bb1 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Calling method '.version_select at 0x7f7a10840430>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:36.974811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1195e8cd-ad88-41a3-8141-61265dcae21b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:36.987208 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1195e8cd-ad88-41a3-8141-61265dcae21b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1506 microversion: 2.1 time: 0.585101 Jul 19 22:41:36.988655 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1595/3208] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:36 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1506 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:36.999325 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a6141f27-245b-4621-bb83-b54629a02919 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:37.001780 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a6141f27-245b-4621-bb83-b54629a02919 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: 063af6c1-3ce5-4da4-95f7-dae4e720f7fe] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:37.012727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6141f27-245b-4621-bb83-b54629a02919 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:37.013349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6141f27-245b-4621-bb83-b54629a02919 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:37.014900 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6141f27-245b-4621-bb83-b54629a02919 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:37.015760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6141f27-245b-4621-bb83-b54629a02919 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:37.310953 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6dea1bb8-e1c9-45e5-9f31-6c0e750d7bb1 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/02f456d1-fa82-4f9b-940d-2861949d500c" status: 202 len: 0 microversion: 2.1 time: 0.871304 Jul 19 22:41:37.317649 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1614/3209] 10.222.0.25 () {58 vars in 1286 bytes} [Tue Jul 19 22:41:36 2022] DELETE /compute/v2.1/os-security-group-rules/02f456d1-fa82-4f9b-940d-2861949d500c => generated 0 bytes in 874 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:41:37.321016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6c6c8019-b279-42b3-9d04-42849c092264 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:37.321868 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6c6c8019-b279-42b3-9d04-42849c092264 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 648bd230-03d9-4186-8cc0-64573fae2ab6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:37.330162 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c6c8019-b279-42b3-9d04-42849c092264 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:37.330619 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c6c8019-b279-42b3-9d04-42849c092264 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:37.331618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c6c8019-b279-42b3-9d04-42849c092264 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:37.332061 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c6c8019-b279-42b3-9d04-42849c092264 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:38.064498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a6141f27-245b-4621-bb83-b54629a02919 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6994ad3a701847d49163a7b709fba400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24647fdcb5d7402ebfdca8ea2ae72e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:38.077870 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a6141f27-245b-4621-bb83-b54629a02919 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe" status: 200 len: 1571 microversion: 2.1 time: 1.086201 Jul 19 22:41:38.080082 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1596/3210] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:36 2022] GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe => generated 1571 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:38.096949 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-41a3abe2-483c-41f5-9b78-43e78cf323e0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:38.098396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-41a3abe2-483c-41f5-9b78-43e78cf323e0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:38.111752 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41a3abe2-483c-41f5-9b78-43e78cf323e0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:38.112282 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41a3abe2-483c-41f5-9b78-43e78cf323e0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:38.113144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41a3abe2-483c-41f5-9b78-43e78cf323e0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:38.113653 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41a3abe2-483c-41f5-9b78-43e78cf323e0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:38.254226 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6c6c8019-b279-42b3-9d04-42849c092264 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:38.271604 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6c6c8019-b279-42b3-9d04-42849c092264 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/648bd230-03d9-4186-8cc0-64573fae2ab6" status: 200 len: 1518 microversion: 2.1 time: 0.957811 Jul 19 22:41:38.272683 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1615/3211] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:37 2022] GET /compute/v2.1/servers/648bd230-03d9-4186-8cc0-64573fae2ab6 => generated 1518 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:38.278194 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-40364ae7-f3d9-40e8-bed2-1464c0a7c736 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:38.278889 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-40364ae7-f3d9-40e8-bed2-1464c0a7c736 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:38.285983 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-40364ae7-f3d9-40e8-bed2-1464c0a7c736 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:38.286433 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-40364ae7-f3d9-40e8-bed2-1464c0a7c736 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:38.287675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-40364ae7-f3d9-40e8-bed2-1464c0a7c736 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:38.288040 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-40364ae7-f3d9-40e8-bed2-1464c0a7c736 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:38.328855 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=8 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:41:38.498661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-40364ae7-f3d9-40e8-bed2-1464c0a7c736 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:38.513727 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-40364ae7-f3d9-40e8-bed2-1464c0a7c736 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:38.518273 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-40364ae7-f3d9-40e8-bed2-1464c0a7c736 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:38.521395 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-40364ae7-f3d9-40e8-bed2-1464c0a7c736 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 200 len: 1366 microversion: 2.47 time: 0.247198 Jul 19 22:41:38.522726 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1616/3212] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:38 2022] GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:38.532496 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-23ac349e-bc30-4d15-af8f-880dd1e1da9c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:38.534066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-23ac349e-bc30-4d15-af8f-880dd1e1da9c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:38.552819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-23ac349e-bc30-4d15-af8f-880dd1e1da9c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:38.565634 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-23ac349e-bc30-4d15-af8f-880dd1e1da9c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:38.573585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-23ac349e-bc30-4d15-af8f-880dd1e1da9c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:38.573585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-23ac349e-bc30-4d15-af8f-880dd1e1da9c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:38.590692 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-41a3abe2-483c-41f5-9b78-43e78cf323e0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:38.604801 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-41a3abe2-483c-41f5-9b78-43e78cf323e0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1512 microversion: 2.1 time: 0.522754 Jul 19 22:41:38.618051 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1597/3213] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:38 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1512 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:38.618051 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-91cebc6f-f8c7-45eb-8295-fe3f01ea4017 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Calling method '.version_select at 0x7f7a03d26160>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:38.967933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-23ac349e-bc30-4d15-af8f-880dd1e1da9c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:38.982734 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-23ac349e-bc30-4d15-af8f-880dd1e1da9c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1507 microversion: 2.1 time: 0.458141 Jul 19 22:41:38.983718 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1617/3214] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:38 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1507 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:38.988913 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cca642c1-7936-4030-9f8c-ce7a9ecfe2d0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:38.989993 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cca642c1-7936-4030-9f8c-ce7a9ecfe2d0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:38.997497 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cca642c1-7936-4030-9f8c-ce7a9ecfe2d0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:38.998508 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cca642c1-7936-4030-9f8c-ce7a9ecfe2d0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:38.999608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cca642c1-7936-4030-9f8c-ce7a9ecfe2d0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:39.000295 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cca642c1-7936-4030-9f8c-ce7a9ecfe2d0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:39.136388 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cca642c1-7936-4030-9f8c-ce7a9ecfe2d0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:39.146595 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cca642c1-7936-4030-9f8c-ce7a9ecfe2d0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:39.148593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cca642c1-7936-4030-9f8c-ce7a9ecfe2d0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:39.151097 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cca642c1-7936-4030-9f8c-ce7a9ecfe2d0 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1605 microversion: 2.32 time: 0.165250 Jul 19 22:41:39.152458 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1618/3215] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:38 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1605 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:39.157616 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-353314d8-4442-4182-be6b-929dfec10c17 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:39.158372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-353314d8-4442-4182-be6b-929dfec10c17 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:39.164966 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-353314d8-4442-4182-be6b-929dfec10c17 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:39.166573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-353314d8-4442-4182-be6b-929dfec10c17 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:39.167887 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-353314d8-4442-4182-be6b-929dfec10c17 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:39.168619 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-353314d8-4442-4182-be6b-929dfec10c17 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:39.188701 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-91cebc6f-f8c7-45eb-8295-fe3f01ea4017 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/974e760d-f653-412f-99ba-fddcfc67e978" status: 202 len: 0 microversion: 2.1 time: 0.582065 Jul 19 22:41:39.192637 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1598/3216] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:41:38 2022] DELETE /compute/v2.1/os-security-groups/974e760d-f653-412f-99ba-fddcfc67e978 => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:41:39.195094 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-220965b8-f429-4406-abcf-f10e27eb2cbb tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1807043392"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:39.195674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-220965b8-f429-4406-abcf-f10e27eb2cbb tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: 063af6c1-3ce5-4da4-95f7-dae4e720f7fe] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:39.209315 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-220965b8-f429-4406-abcf-f10e27eb2cbb tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:39.209751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-220965b8-f429-4406-abcf-f10e27eb2cbb tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:39.215299 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-220965b8-f429-4406-abcf-f10e27eb2cbb tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:39.216153 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-220965b8-f429-4406-abcf-f10e27eb2cbb tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:39.438249 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-353314d8-4442-4182-be6b-929dfec10c17 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:39.449505 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.network.security_group_api [None req-220965b8-f429-4406-abcf-f10e27eb2cbb tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Adding security group 3fe6438b-12d6-40b8-82bc-8af63bb8e912 to port 14665aa9-4185-4b76-b88c-3d89b7130fba Jul 19 22:41:39.452480 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-353314d8-4442-4182-be6b-929dfec10c17 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1506 microversion: 2.1 time: 0.298503 Jul 19 22:41:39.455146 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1619/3217] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:39 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:39.461893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-b5e53257-93fa-492c-8c23-f402e5c89890 req-8865dd05-73c8-4cc1-bc98-380a9ff8b808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "648bd230-03d9-4186-8cc0-64573fae2ab6", "name": "network-vif-deleted", "tag": "76067ba9-e586-4693-977c-0a0a25f007f8"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:39.476509 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b5e53257-93fa-492c-8c23-f402e5c89890 req-8865dd05-73c8-4cc1-bc98-380a9ff8b808 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:39.477253 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b5e53257-93fa-492c-8c23-f402e5c89890 req-8865dd05-73c8-4cc1-bc98-380a9ff8b808 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:39.491960 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-b5e53257-93fa-492c-8c23-f402e5c89890 req-8865dd05-73c8-4cc1-bc98-380a9ff8b808 service nova] Creating event network-vif-deleted:76067ba9-e586-4693-977c-0a0a25f007f8 for instance 648bd230-03d9-4186-8cc0-64573fae2ab6 on n-h1-847009-3 Jul 19 22:41:39.499489 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-b5e53257-93fa-492c-8c23-f402e5c89890 req-8865dd05-73c8-4cc1-bc98-380a9ff8b808 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043627 Jul 19 22:41:39.500425 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1620/3218] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:39.506356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-02467b7a-160c-4f14-9990-070cddf49eaa tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Calling method '.version_select at 0x7f7a102b7e50>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:39.562528 n-d-847009-3 devstack@n-api.service[119338]: DEBUG neutronclient.v2_0.client [None req-02467b7a-160c-4f14-9990-070cddf49eaa tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a2d2ca8f-673c-4707-92d8-5d3083e5a0d5 does not exist", "detail": ""}} {{(pid=119338) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 22:41:39.563386 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.security_group_api [None req-02467b7a-160c-4f14-9990-070cddf49eaa tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Neutron security group a2d2ca8f-673c-4707-92d8-5d3083e5a0d5 not found {{(pid=119338) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 22:41:39.564710 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-02467b7a-160c-4f14-9990-070cddf49eaa tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] HTTP exception thrown: Security group a2d2ca8f-673c-4707-92d8-5d3083e5a0d5 does not exist Jul 19 22:41:39.564710 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-597e5fb3-aa2d-4db4-a3c9-299cccd3ca9b'] Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-02467b7a-160c-4f14-9990-070cddf49eaa tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Request method failure captured: Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/os-security-groups/a2d2ca8f-673c-4707-92d8-5d3083e5a0d5 HTTP/1.1 Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zMDJQ51QRvDfIU7Dtr63bQ3F1BDoFmuLYGepQgd_CgsUqN--KdJv4h1xuPtamiT-fwAGcKEJ7hVL76wxMIiotVRazhKJeaqBg1NPgoB9FzLmhrF3Efj0CbhThz28-gcErG1GWT2y1aPcWcj3k9iEb1TxbRqwzSwdHyknY6dIGNUb-U Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a390fbac782f48c7bd027e88e8bf30ca Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-570724335 Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a390fbac782f48c7bd027e88e8bf30ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a390fbac782f48c7bd027e88e8bf30ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a390fbac782f48c7bd027e88e8bf30ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a390fbac782f48c7bd027e88e8bf30ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-SecurityGroupRulesTestJSON-570724335 Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a390fbac782f48c7bd027e88e8bf30ca Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-570724335 Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-SecurityGroupRulesTestJSON-570724335-project Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 2c79e75f40084b94a6e155d9c1242869 Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-SecurityGroupRulesTestJSON-570724335-project Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: exception: Security group a2d2ca8f-673c-4707-92d8-5d3083e5a0d5 does not exist Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-597e5fb3-aa2d-4db4-a3c9-299cccd3ca9b'] Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'a2d2ca8f-673c-4707-92d8-5d3083e5a0d5'} Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 22:41:39.569807 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a2d2ca8f-673c-4707-92d8-5d3083e5a0d5 does not exist Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-597e5fb3-aa2d-4db4-a3c9-299cccd3ca9b'] Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a2d2ca8f-673c-4707-92d8-5d3083e5a0d5 does not exist Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-597e5fb3-aa2d-4db4-a3c9-299cccd3ca9b'] Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a2d2ca8f-673c-4707-92d8-5d3083e5a0d5 does not exist Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-597e5fb3-aa2d-4db4-a3c9-299cccd3ca9b'] Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a2d2ca8f-673c-4707-92d8-5d3083e5a0d5 does not exist Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-597e5fb3-aa2d-4db4-a3c9-299cccd3ca9b'] Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-02467b7a-160c-4f14-9990-070cddf49eaa tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Returning 404 to user: Security group a2d2ca8f-673c-4707-92d8-5d3083e5a0d5 does not exist Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-597e5fb3-aa2d-4db4-a3c9-299cccd3ca9b'] {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:41:39.574041 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-02467b7a-160c-4f14-9990-070cddf49eaa tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/a2d2ca8f-673c-4707-92d8-5d3083e5a0d5" status: 404 len: 194 microversion: 2.1 time: 0.070840 Jul 19 22:41:39.579332 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1621/3219] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:41:39 2022] DELETE /compute/v2.1/os-security-groups/a2d2ca8f-673c-4707-92d8-5d3083e5a0d5 => generated 194 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:41:39.584801 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e2c8052d-c184-456f-ab17-0789e351506c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:39.586953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e2c8052d-c184-456f-ab17-0789e351506c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 648bd230-03d9-4186-8cc0-64573fae2ab6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:39.594846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2c8052d-c184-456f-ab17-0789e351506c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:39.595297 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2c8052d-c184-456f-ab17-0789e351506c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:39.596054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2c8052d-c184-456f-ab17-0789e351506c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:39.596502 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2c8052d-c184-456f-ab17-0789e351506c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:39.613108 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-e2c8052d-c184-456f-ab17-0789e351506c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] HTTP exception thrown: Instance 648bd230-03d9-4186-8cc0-64573fae2ab6 could not be found. Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e2c8052d-c184-456f-ab17-0789e351506c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Request method failure captured: Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/648bd230-03d9-4186-8cc0-64573fae2ab6 HTTP/1.1 Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zKoq_vhusXnDANbcr3Sa5SWzyS4aLTqhiTRhUL04Uit83u4qZhnIUT5la9P9_Xp0JNuobdlOuEQMGgnXDRkWvZ6eC79pAPBsg6riRz7xiynuljTjhPoHHzR79phDQMiu20IH4gODtcUDQ17FZj4H5GwZDdOObgVxk-gHjspvmTLK0o Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 1b633041d58845d1a6d0b9f31f3613d4 Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ListServerFiltersTestJSON-1412242091 Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1b633041d58845d1a6d0b9f31f3613d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1b633041d58845d1a6d0b9f31f3613d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1b633041d58845d1a6d0b9f31f3613d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1b633041d58845d1a6d0b9f31f3613d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ListServerFiltersTestJSON-1412242091 Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 1b633041d58845d1a6d0b9f31f3613d4 Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1412242091 Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ListServerFiltersTestJSON-1412242091-project Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 0631675f80674534b1e775e521cfea10 Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ListServerFiltersTestJSON-1412242091-project Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 648bd230-03d9-4186-8cc0-64573fae2ab6 could not be found. Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '648bd230-03d9-4186-8cc0-64573fae2ab6'} Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 648bd230-03d9-4186-8cc0-64573fae2ab6 could not be found. Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 648bd230-03d9-4186-8cc0-64573fae2ab6 could not be found. Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:39.614699 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:39.624555 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:39.624555 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:39.624555 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:39.624555 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:41:39.624555 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:41:39.624555 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 648bd230-03d9-4186-8cc0-64573fae2ab6 could not be found. Jul 19 22:41:39.624555 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:39.624555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e2c8052d-c184-456f-ab17-0789e351506c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Returning 404 to user: Instance 648bd230-03d9-4186-8cc0-64573fae2ab6 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:41:39.624555 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e2c8052d-c184-456f-ab17-0789e351506c tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/648bd230-03d9-4186-8cc0-64573fae2ab6" status: 404 len: 111 microversion: 2.1 time: 0.040814 Jul 19 22:41:39.624555 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1622/3220] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:39 2022] GET /compute/v2.1/servers/648bd230-03d9-4186-8cc0-64573fae2ab6 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:41:39.626121 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9584f08c-0939-43ee-9096-9c8cd48f562a tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:39.626632 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9584f08c-0939-43ee-9096-9c8cd48f562a tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:39.635958 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9584f08c-0939-43ee-9096-9c8cd48f562a tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:39.636408 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9584f08c-0939-43ee-9096-9c8cd48f562a tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:39.637191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9584f08c-0939-43ee-9096-9c8cd48f562a tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:39.637633 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9584f08c-0939-43ee-9096-9c8cd48f562a tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:39.737368 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9584f08c-0939-43ee-9096-9c8cd48f562a tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:39.750994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9584f08c-0939-43ee-9096-9c8cd48f562a tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:39.752902 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9584f08c-0939-43ee-9096-9c8cd48f562a tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:39.753914 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9584f08c-0939-43ee-9096-9c8cd48f562a tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 200 len: 1366 microversion: 2.47 time: 0.131908 Jul 19 22:41:39.754500 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1623/3221] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:39 2022] GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 1366 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:39.759915 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-393eed1a-1f1e-4262-9557-b3155cfb4d3d tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Calling method '.version_select at 0x7f7a104b1670>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:40.111506 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-220965b8-f429-4406-abcf-f10e27eb2cbb tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "POST /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe/action" status: 202 len: 0 microversion: 2.1 time: 0.920416 Jul 19 22:41:40.112201 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1599/3222] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:41:39 2022] POST /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe/action => generated 0 bytes in 922 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:41:40.118099 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-39331ebd-1074-4e12-9b5a-3b0eddad513c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:40.124358 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-39331ebd-1074-4e12-9b5a-3b0eddad513c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:40.141001 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39331ebd-1074-4e12-9b5a-3b0eddad513c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:40.141558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39331ebd-1074-4e12-9b5a-3b0eddad513c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:40.142954 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39331ebd-1074-4e12-9b5a-3b0eddad513c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:40.155967 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39331ebd-1074-4e12-9b5a-3b0eddad513c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:40.298933 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-393eed1a-1f1e-4262-9557-b3155cfb4d3d tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/ad35b81f-3b8c-4e8e-9b54-7ddfb539976e" status: 202 len: 0 microversion: 2.1 time: 0.543313 Jul 19 22:41:40.300709 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1624/3223] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:41:39 2022] DELETE /compute/v2.1/os-security-groups/ad35b81f-3b8c-4e8e-9b54-7ddfb539976e => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:41:40.309236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ade8de4e-f5ab-4cbd-9d59-243a1528a13f tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:40.309751 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ade8de4e-f5ab-4cbd-9d59-243a1528a13f tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 976f2ec1-c70b-4795-a71d-251bed15ad25] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:40.326608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ade8de4e-f5ab-4cbd-9d59-243a1528a13f tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:40.326836 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ade8de4e-f5ab-4cbd-9d59-243a1528a13f tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:40.330588 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ade8de4e-f5ab-4cbd-9d59-243a1528a13f tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:40.336003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ade8de4e-f5ab-4cbd-9d59-243a1528a13f tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:40.395066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ade8de4e-f5ab-4cbd-9d59-243a1528a13f tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 976f2ec1-c70b-4795-a71d-251bed15ad25] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:41:40.483454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-39331ebd-1074-4e12-9b5a-3b0eddad513c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:40.494662 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-39331ebd-1074-4e12-9b5a-3b0eddad513c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1512 microversion: 2.1 time: 0.380737 Jul 19 22:41:40.496310 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1600/3224] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:40 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1512 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:40.503284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-51a8938c-8561-4c72-87f2-d1af8fe15c60 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:40.504381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-51a8938c-8561-4c72-87f2-d1af8fe15c60 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:40.516087 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51a8938c-8561-4c72-87f2-d1af8fe15c60 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:40.517416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51a8938c-8561-4c72-87f2-d1af8fe15c60 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:40.519154 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51a8938c-8561-4c72-87f2-d1af8fe15c60 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:40.520091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51a8938c-8561-4c72-87f2-d1af8fe15c60 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:40.564353 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ade8de4e-f5ab-4cbd-9d59-243a1528a13f tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "DELETE /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25" status: 204 len: 0 microversion: 2.1 time: 0.261581 Jul 19 22:41:40.567333 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1625/3225] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:41:40 2022] DELETE /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:41:40.575330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-254ca785-4e31-4697-bb23-ccc4d8fe7b31 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '.version_select at 0x7f7a10410940>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:40.823171 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-51a8938c-8561-4c72-87f2-d1af8fe15c60 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:40.833868 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-51a8938c-8561-4c72-87f2-d1af8fe15c60 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1507 microversion: 2.1 time: 0.335312 Jul 19 22:41:40.835216 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1601/3226] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:40 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1507 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:40.843573 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-552484a5-92fa-45d9-ba47-601759f36190 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:40.845058 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-552484a5-92fa-45d9-ba47-601759f36190 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:40.854127 n-d-847009-3 devstack@n-api.service[119338]: DEBUG neutronclient.v2_0.client [None req-254ca785-4e31-4697-bb23-ccc4d8fe7b31 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 3fe6438b-12d6-40b8-82bc-8af63bb8e912 in use.", "detail": ""}} {{(pid=119338) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 22:41:40.855343 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-254ca785-4e31-4697-bb23-ccc4d8fe7b31 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] HTTP exception thrown: Security Group 3fe6438b-12d6-40b8-82bc-8af63bb8e912 in use. Jul 19 22:41:40.855343 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-1bc59b2e-ab44-4a53-b143-520d378861fc'] Jul 19 22:41:40.856562 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-552484a5-92fa-45d9-ba47-601759f36190 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:40.857030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-552484a5-92fa-45d9-ba47-601759f36190 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:40.858091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-552484a5-92fa-45d9-ba47-601759f36190 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-254ca785-4e31-4697-bb23-ccc4d8fe7b31 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Request method failure captured: Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/os-security-groups/3fe6438b-12d6-40b8-82bc-8af63bb8e912 HTTP/1.1 Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zLOcBnDO8DB0TvfRIhrSs2i1Z8gf2mXRu9CWG3-L53ppyrrqccAldlD1sn80tAiiaYj788W6zk_H_lFv9A7zGAIhHM_mj3-7IRMW_3igT7vOPEp-kC_qbKwdmn2JH9DflRdkn_IaARtkReZyhJI3DiZyzYUOJLxFUfr88ChX6WBaz8 Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 6994ad3a701847d49163a7b709fba400 Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: exception: Security Group 3fe6438b-12d6-40b8-82bc-8af63bb8e912 in use. Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-1bc59b2e-ab44-4a53-b143-520d378861fc'] Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '3fe6438b-12d6-40b8-82bc-8af63bb8e912'} Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 22:41:40.858484 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 3fe6438b-12d6-40b8-82bc-8af63bb8e912 in use. Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1bc59b2e-ab44-4a53-b143-520d378861fc'] Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 3fe6438b-12d6-40b8-82bc-8af63bb8e912 in use. Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1bc59b2e-ab44-4a53-b143-520d378861fc'] Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 3fe6438b-12d6-40b8-82bc-8af63bb8e912 in use. Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1bc59b2e-ab44-4a53-b143-520d378861fc'] Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 3fe6438b-12d6-40b8-82bc-8af63bb8e912 in use. Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1bc59b2e-ab44-4a53-b143-520d378861fc'] Jul 19 22:41:40.863042 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:40.865911 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-552484a5-92fa-45d9-ba47-601759f36190 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:40.867633 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-254ca785-4e31-4697-bb23-ccc4d8fe7b31 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Returning 400 to user: Security Group 3fe6438b-12d6-40b8-82bc-8af63bb8e912 in use. Jul 19 22:41:40.867633 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-1bc59b2e-ab44-4a53-b143-520d378861fc'] {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:41:40.869359 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-254ca785-4e31-4697-bb23-ccc4d8fe7b31 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/3fe6438b-12d6-40b8-82bc-8af63bb8e912" status: 400 len: 185 microversion: 2.1 time: 0.300030 Jul 19 22:41:40.874009 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1626/3227] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:41:40 2022] DELETE /compute/v2.1/os-security-groups/3fe6438b-12d6-40b8-82bc-8af63bb8e912 => generated 185 bytes in 306 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:41:40.879563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c13b81b0-428a-4742-a007-c61db357bb9c tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Calling method '.version_select at 0x7f7a104b11f0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:40.960722 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-552484a5-92fa-45d9-ba47-601759f36190 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:40.983259 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-552484a5-92fa-45d9-ba47-601759f36190 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:40.985095 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-552484a5-92fa-45d9-ba47-601759f36190 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:40.986663 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-552484a5-92fa-45d9-ba47-601759f36190 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1605 microversion: 2.32 time: 0.149887 Jul 19 22:41:40.987818 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1602/3228] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:40 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1605 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:40.993132 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d6793eef-b969-4021-95de-9ce6f996368e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:40.994081 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d6793eef-b969-4021-95de-9ce6f996368e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:41.002225 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d6793eef-b969-4021-95de-9ce6f996368e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:41.002690 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d6793eef-b969-4021-95de-9ce6f996368e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:41.003921 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d6793eef-b969-4021-95de-9ce6f996368e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:41.004020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d6793eef-b969-4021-95de-9ce6f996368e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:41.219183 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d6793eef-b969-4021-95de-9ce6f996368e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:41.240483 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d6793eef-b969-4021-95de-9ce6f996368e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1506 microversion: 2.1 time: 0.251213 Jul 19 22:41:41.241963 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1603/3229] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:40 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1506 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:41.258302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b9b9e97c-62ae-43f6-bf66-5c8d51e6d170 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:41.259146 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b9b9e97c-62ae-43f6-bf66-5c8d51e6d170 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 976f2ec1-c70b-4795-a71d-251bed15ad25] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:41.268092 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c13b81b0-428a-4742-a007-c61db357bb9c tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/2f852d96-6567-4b4b-9f03-eb33b78d7fd1" status: 202 len: 0 microversion: 2.1 time: 0.392731 Jul 19 22:41:41.269220 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1627/3230] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:41:40 2022] DELETE /compute/v2.1/os-security-groups/2f852d96-6567-4b4b-9f03-eb33b78d7fd1 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:41:41.274900 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-773c6ddb-3961-4447-8b0f-1851318114da tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:41.275954 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-773c6ddb-3961-4447-8b0f-1851318114da tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:41.279940 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b9b9e97c-62ae-43f6-bf66-5c8d51e6d170 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:41.280398 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b9b9e97c-62ae-43f6-bf66-5c8d51e6d170 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:41.281189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b9b9e97c-62ae-43f6-bf66-5c8d51e6d170 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:41.291965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b9b9e97c-62ae-43f6-bf66-5c8d51e6d170 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:41.298133 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-773c6ddb-3961-4447-8b0f-1851318114da tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:41.298598 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-773c6ddb-3961-4447-8b0f-1851318114da tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:41.299490 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-773c6ddb-3961-4447-8b0f-1851318114da tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:41.302254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-773c6ddb-3961-4447-8b0f-1851318114da tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:41.400842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-773c6ddb-3961-4447-8b0f-1851318114da tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:41.419394 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-773c6ddb-3961-4447-8b0f-1851318114da tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:41.421518 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-773c6ddb-3961-4447-8b0f-1851318114da tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:41.423857 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-773c6ddb-3961-4447-8b0f-1851318114da tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 200 len: 1366 microversion: 2.47 time: 0.153368 Jul 19 22:41:41.425027 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1628/3231] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:41 2022] GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:41.432140 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-662dee79-ec70-429d-a868-936345aa0c69 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:41.432997 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-662dee79-ec70-429d-a868-936345aa0c69 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: 063af6c1-3ce5-4da4-95f7-dae4e720f7fe] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:41.447898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-662dee79-ec70-429d-a868-936345aa0c69 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:41.448957 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-662dee79-ec70-429d-a868-936345aa0c69 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:41.450610 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-662dee79-ec70-429d-a868-936345aa0c69 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:41.451437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-662dee79-ec70-429d-a868-936345aa0c69 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:41.483343 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-662dee79-ec70-429d-a868-936345aa0c69 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: 063af6c1-3ce5-4da4-95f7-dae4e720f7fe] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:41:41.555783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b9b9e97c-62ae-43f6-bf66-5c8d51e6d170 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:41.563981 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b9b9e97c-62ae-43f6-bf66-5c8d51e6d170 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25" status: 200 len: 1516 microversion: 2.1 time: 0.310988 Jul 19 22:41:41.564738 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1604/3232] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:41 2022] GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25 => generated 1516 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:41.569568 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2f643faf-3962-4230-80d9-6123a450ab0a tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Calling method '.version_select at 0x7f7a03e7d8b0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:41.587276 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-662dee79-ec70-429d-a868-936345aa0c69 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "DELETE /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe" status: 204 len: 0 microversion: 2.1 time: 0.159696 Jul 19 22:41:41.589424 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1629/3233] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:41:41 2022] DELETE /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:41:41.596756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-67fad649-3fce-44bc-83aa-071ddf17dbd1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:41.598275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-67fad649-3fce-44bc-83aa-071ddf17dbd1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:41.611028 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67fad649-3fce-44bc-83aa-071ddf17dbd1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:41.613250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67fad649-3fce-44bc-83aa-071ddf17dbd1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:41.613250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67fad649-3fce-44bc-83aa-071ddf17dbd1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:41.613643 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67fad649-3fce-44bc-83aa-071ddf17dbd1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:41.864423 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-67fad649-3fce-44bc-83aa-071ddf17dbd1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:41.878943 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-67fad649-3fce-44bc-83aa-071ddf17dbd1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1512 microversion: 2.1 time: 0.287650 Jul 19 22:41:41.879738 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1630/3234] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:41 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1512 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:41.887482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-4284af62-8743-451f-9787-fb781da6c51b req-5bbed54a-d251-434c-bee4-52977beeb6d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "063af6c1-3ce5-4da4-95f7-dae4e720f7fe", "tag": "14665aa9-4185-4b76-b88c-3d89b7130fba"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:41.896521 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-4284af62-8743-451f-9787-fb781da6c51b req-5bbed54a-d251-434c-bee4-52977beeb6d7 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:41.896978 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-4284af62-8743-451f-9787-fb781da6c51b req-5bbed54a-d251-434c-bee4-52977beeb6d7 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:41.902779 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:41:41.917576 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-4284af62-8743-451f-9787-fb781da6c51b req-5bbed54a-d251-434c-bee4-52977beeb6d7 service nova] Creating event network-changed:14665aa9-4185-4b76-b88c-3d89b7130fba for instance 063af6c1-3ce5-4da4-95f7-dae4e720f7fe on n-h2-847009-3 Jul 19 22:41:41.923495 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-4284af62-8743-451f-9787-fb781da6c51b req-5bbed54a-d251-434c-bee4-52977beeb6d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041708 Jul 19 22:41:41.924233 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1631/3235] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:41.932998 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dae6068f-8509-4652-8b49-a9b3ed58a48c tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:41.934210 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dae6068f-8509-4652-8b49-a9b3ed58a48c tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: 063af6c1-3ce5-4da4-95f7-dae4e720f7fe] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:41.946195 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2f643faf-3962-4230-80d9-6123a450ab0a tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/6ca25e7c-4774-4431-ae17-9ea79f6cc71b" status: 202 len: 0 microversion: 2.1 time: 0.379921 Jul 19 22:41:41.949524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dae6068f-8509-4652-8b49-a9b3ed58a48c tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:41.950399 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1605/3236] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:41:41 2022] DELETE /compute/v2.1/os-security-groups/6ca25e7c-4774-4431-ae17-9ea79f6cc71b => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:41:41.950804 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dae6068f-8509-4652-8b49-a9b3ed58a48c tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:41.952418 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dae6068f-8509-4652-8b49-a9b3ed58a48c tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:41.953416 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dae6068f-8509-4652-8b49-a9b3ed58a48c tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:41.958655 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2f61ae9e-5f77-4aea-9bf0-cec481b403df tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:41.960133 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2f61ae9e-5f77-4aea-9bf0-cec481b403df tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:41.971716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2f61ae9e-5f77-4aea-9bf0-cec481b403df tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:41.972369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2f61ae9e-5f77-4aea-9bf0-cec481b403df tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:41.973987 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2f61ae9e-5f77-4aea-9bf0-cec481b403df tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:41.975361 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2f61ae9e-5f77-4aea-9bf0-cec481b403df tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:42.262918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2f61ae9e-5f77-4aea-9bf0-cec481b403df tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:42.276822 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2f61ae9e-5f77-4aea-9bf0-cec481b403df tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1507 microversion: 2.1 time: 0.324233 Jul 19 22:41:42.278763 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1606/3237] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:41 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1507 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:42.288051 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d70b4f7d-c74c-4dba-b56f-dab126879e6e tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Calling method '.version_select at 0x7f7a03efbc10>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:42.311491 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dae6068f-8509-4652-8b49-a9b3ed58a48c tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6994ad3a701847d49163a7b709fba400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24647fdcb5d7402ebfdca8ea2ae72e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:42.330308 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dae6068f-8509-4652-8b49-a9b3ed58a48c tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe" status: 200 len: 1646 microversion: 2.1 time: 0.404740 Jul 19 22:41:42.339829 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1632/3238] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:41 2022] GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe => generated 1646 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:42.339829 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-51da0c51-1ea0-4142-b3cb-80c7cca08bfa tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:42.339829 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-51da0c51-1ea0-4142-b3cb-80c7cca08bfa tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:42.346144 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51da0c51-1ea0-4142-b3cb-80c7cca08bfa tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:42.346601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51da0c51-1ea0-4142-b3cb-80c7cca08bfa tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:42.347467 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51da0c51-1ea0-4142-b3cb-80c7cca08bfa tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:42.347915 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51da0c51-1ea0-4142-b3cb-80c7cca08bfa tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:42.473588 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-51da0c51-1ea0-4142-b3cb-80c7cca08bfa tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:42.489211 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-51da0c51-1ea0-4142-b3cb-80c7cca08bfa tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:42.492530 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-51da0c51-1ea0-4142-b3cb-80c7cca08bfa tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:42.495154 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-51da0c51-1ea0-4142-b3cb-80c7cca08bfa tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1605 microversion: 2.32 time: 0.162249 Jul 19 22:41:42.496278 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1633/3239] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:42 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1605 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:42.502578 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cf67e5d0-97ff-4dc8-8e33-a492dbd90951 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:42.503649 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cf67e5d0-97ff-4dc8-8e33-a492dbd90951 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:42.514906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf67e5d0-97ff-4dc8-8e33-a492dbd90951 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:42.515730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf67e5d0-97ff-4dc8-8e33-a492dbd90951 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:42.517170 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf67e5d0-97ff-4dc8-8e33-a492dbd90951 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:42.517956 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf67e5d0-97ff-4dc8-8e33-a492dbd90951 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:42.854941 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cf67e5d0-97ff-4dc8-8e33-a492dbd90951 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:42.870368 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cf67e5d0-97ff-4dc8-8e33-a492dbd90951 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1506 microversion: 2.1 time: 0.370819 Jul 19 22:41:42.882653 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d70b4f7d-c74c-4dba-b56f-dab126879e6e tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/b6adf8b5-5736-4e49-a123-44ef303623a1" status: 202 len: 0 microversion: 2.1 time: 0.594683 Jul 19 22:41:42.883802 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1634/3240] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:42 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1506 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:42.891740 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8d3d38de-c6fe-43f6-8a2a-fab1fe9da2d0 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:42.891740 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8d3d38de-c6fe-43f6-8a2a-fab1fe9da2d0 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:42.894732 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1607/3241] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:41:42 2022] DELETE /compute/v2.1/os-security-groups/b6adf8b5-5736-4e49-a123-44ef303623a1 => generated 0 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:41:42.901588 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d3d38de-c6fe-43f6-8a2a-fab1fe9da2d0 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:42.902303 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d3d38de-c6fe-43f6-8a2a-fab1fe9da2d0 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:42.903193 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dcf9a4e9-4fb9-49df-8eb9-c90504ebd950 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:42.904017 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d3d38de-c6fe-43f6-8a2a-fab1fe9da2d0 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:42.904808 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d3d38de-c6fe-43f6-8a2a-fab1fe9da2d0 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:42.905889 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dcf9a4e9-4fb9-49df-8eb9-c90504ebd950 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 976f2ec1-c70b-4795-a71d-251bed15ad25] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:42.925322 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dcf9a4e9-4fb9-49df-8eb9-c90504ebd950 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:42.926083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dcf9a4e9-4fb9-49df-8eb9-c90504ebd950 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:42.927741 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dcf9a4e9-4fb9-49df-8eb9-c90504ebd950 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:42.928569 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dcf9a4e9-4fb9-49df-8eb9-c90504ebd950 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:42.964361 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:41:43.097268 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8d3d38de-c6fe-43f6-8a2a-fab1fe9da2d0 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:43.116144 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8d3d38de-c6fe-43f6-8a2a-fab1fe9da2d0 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:43.121643 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8d3d38de-c6fe-43f6-8a2a-fab1fe9da2d0 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:43.123583 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8d3d38de-c6fe-43f6-8a2a-fab1fe9da2d0 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 200 len: 1366 microversion: 2.47 time: 0.237882 Jul 19 22:41:43.133249 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1635/3242] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:42 2022] GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:43.140323 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e0c21199-430d-4570-82c8-41eaa1e9beb7 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] Calling method '.version_select at 0x7f7a1012e310>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:43.295289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dcf9a4e9-4fb9-49df-8eb9-c90504ebd950 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0631675f80674534b1e775e521cfea10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b633041d58845d1a6d0b9f31f3613d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:43.311024 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dcf9a4e9-4fb9-49df-8eb9-c90504ebd950 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25" status: 200 len: 1516 microversion: 2.1 time: 0.414239 Jul 19 22:41:43.312584 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1608/3243] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:42 2022] GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25 => generated 1516 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:43.322693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f1187ccf-7675-4397-b553-a5224931551c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:43.323256 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f1187ccf-7675-4397-b553-a5224931551c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:43.331227 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f1187ccf-7675-4397-b553-a5224931551c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:43.331762 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f1187ccf-7675-4397-b553-a5224931551c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:43.332873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f1187ccf-7675-4397-b553-a5224931551c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:43.333774 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f1187ccf-7675-4397-b553-a5224931551c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:43.668605 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f1187ccf-7675-4397-b553-a5224931551c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:43.679301 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f1187ccf-7675-4397-b553-a5224931551c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1512 microversion: 2.1 time: 0.364801 Jul 19 22:41:43.682086 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1609/3244] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:43 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1512 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:43.692927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ea44876b-433f-4426-b6c2-558e0c9c405f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:43.694250 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ea44876b-433f-4426-b6c2-558e0c9c405f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:43.708188 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea44876b-433f-4426-b6c2-558e0c9c405f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:43.708901 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea44876b-433f-4426-b6c2-558e0c9c405f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:43.709857 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea44876b-433f-4426-b6c2-558e0c9c405f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:43.710459 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea44876b-433f-4426-b6c2-558e0c9c405f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:43.742294 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e0c21199-430d-4570-82c8-41eaa1e9beb7 tempest-SecurityGroupRulesTestJSON-570724335 tempest-SecurityGroupRulesTestJSON-570724335-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/e5302362-be66-4e05-a182-85cccbc21391" status: 202 len: 0 microversion: 2.1 time: 0.606917 Jul 19 22:41:43.743610 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1636/3245] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:41:43 2022] DELETE /compute/v2.1/os-security-groups/e5302362-be66-4e05-a182-85cccbc21391 => generated 0 bytes in 609 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:41:43.749132 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4a752779-417d-422e-ad5c-4ae890f4a2ab tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:43.750248 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4a752779-417d-422e-ad5c-4ae890f4a2ab tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: 063af6c1-3ce5-4da4-95f7-dae4e720f7fe] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:43.763583 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4a752779-417d-422e-ad5c-4ae890f4a2ab tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:43.768747 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4a752779-417d-422e-ad5c-4ae890f4a2ab tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:43.770298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4a752779-417d-422e-ad5c-4ae890f4a2ab tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:43.770928 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4a752779-417d-422e-ad5c-4ae890f4a2ab tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:44.293133 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ea44876b-433f-4426-b6c2-558e0c9c405f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:44.321474 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ea44876b-433f-4426-b6c2-558e0c9c405f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1507 microversion: 2.1 time: 0.636295 Jul 19 22:41:44.323481 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1610/3246] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:43 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1507 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:44.331025 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-532417a1-22ef-4e04-a6d3-9ec81b7b4fd6 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:44.332101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-532417a1-22ef-4e04-a6d3-9ec81b7b4fd6 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:44.341487 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-532417a1-22ef-4e04-a6d3-9ec81b7b4fd6 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:44.342493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-532417a1-22ef-4e04-a6d3-9ec81b7b4fd6 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:44.343661 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-532417a1-22ef-4e04-a6d3-9ec81b7b4fd6 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:44.344414 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-532417a1-22ef-4e04-a6d3-9ec81b7b4fd6 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:44.410626 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4a752779-417d-422e-ad5c-4ae890f4a2ab tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6994ad3a701847d49163a7b709fba400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24647fdcb5d7402ebfdca8ea2ae72e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:44.423348 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4a752779-417d-422e-ad5c-4ae890f4a2ab tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe" status: 200 len: 1646 microversion: 2.1 time: 0.677772 Jul 19 22:41:44.425326 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1637/3247] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:43 2022] GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe => generated 1646 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:44.432864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-273fa13d-8d6b-4502-9b25-7b99c0945aba tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:44.433922 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-273fa13d-8d6b-4502-9b25-7b99c0945aba tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:44.440919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-273fa13d-8d6b-4502-9b25-7b99c0945aba tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:44.441758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-273fa13d-8d6b-4502-9b25-7b99c0945aba tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:44.443547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-273fa13d-8d6b-4502-9b25-7b99c0945aba tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:44.444458 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-273fa13d-8d6b-4502-9b25-7b99c0945aba tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:44.532843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-532417a1-22ef-4e04-a6d3-9ec81b7b4fd6 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:44.557575 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-532417a1-22ef-4e04-a6d3-9ec81b7b4fd6 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:44.561643 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-532417a1-22ef-4e04-a6d3-9ec81b7b4fd6 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:44.564028 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-532417a1-22ef-4e04-a6d3-9ec81b7b4fd6 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1605 microversion: 2.32 time: 0.239075 Jul 19 22:41:44.565224 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1611/3248] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:44 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1605 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:44.587044 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-4523f978-a88b-4cc4-98ad-b619104514f7 req-6dee4b5c-5927-4a13-a387-c7f4678049ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "976f2ec1-c70b-4795-a71d-251bed15ad25", "name": "network-vif-deleted", "tag": "c3b703eb-00f7-4fb3-9358-40627991eef1"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:44.608323 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-4523f978-a88b-4cc4-98ad-b619104514f7 req-6dee4b5c-5927-4a13-a387-c7f4678049ca service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:44.608769 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-4523f978-a88b-4cc4-98ad-b619104514f7 req-6dee4b5c-5927-4a13-a387-c7f4678049ca service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:44.635295 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-4523f978-a88b-4cc4-98ad-b619104514f7 req-6dee4b5c-5927-4a13-a387-c7f4678049ca service nova] Creating event network-vif-deleted:c3b703eb-00f7-4fb3-9358-40627991eef1 for instance 976f2ec1-c70b-4795-a71d-251bed15ad25 on n-h1-847009-3 Jul 19 22:41:44.642692 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-4523f978-a88b-4cc4-98ad-b619104514f7 req-6dee4b5c-5927-4a13-a387-c7f4678049ca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067316 Jul 19 22:41:44.643628 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1612/3249] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:44.657139 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ea9523f2-2422-4cca-8e66-6283357dd6ce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:44.658213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ea9523f2-2422-4cca-8e66-6283357dd6ce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:44.684608 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea9523f2-2422-4cca-8e66-6283357dd6ce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:44.685694 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea9523f2-2422-4cca-8e66-6283357dd6ce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:44.687416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea9523f2-2422-4cca-8e66-6283357dd6ce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:44.699825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea9523f2-2422-4cca-8e66-6283357dd6ce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:45.069433 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ea9523f2-2422-4cca-8e66-6283357dd6ce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:45.085632 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ea9523f2-2422-4cca-8e66-6283357dd6ce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:45.090049 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ea9523f2-2422-4cca-8e66-6283357dd6ce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:45.090649 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ea9523f2-2422-4cca-8e66-6283357dd6ce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 200 len: 1366 microversion: 2.47 time: 0.443528 Jul 19 22:41:45.094267 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1613/3250] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:44 2022] GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 1366 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:45.098599 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bc1138c9-e9ae-4d86-b84b-86798941d1d3 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:45.099927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bc1138c9-e9ae-4d86-b84b-86798941d1d3 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] [instance: 976f2ec1-c70b-4795-a71d-251bed15ad25] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:45.109333 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc1138c9-e9ae-4d86-b84b-86798941d1d3 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:45.110409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc1138c9-e9ae-4d86-b84b-86798941d1d3 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:45.111428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc1138c9-e9ae-4d86-b84b-86798941d1d3 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:45.113918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc1138c9-e9ae-4d86-b84b-86798941d1d3 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:45.147868 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-bc1138c9-e9ae-4d86-b84b-86798941d1d3 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] HTTP exception thrown: Instance 976f2ec1-c70b-4795-a71d-251bed15ad25 could not be found. Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bc1138c9-e9ae-4d86-b84b-86798941d1d3 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Request method failure captured: Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25 HTTP/1.1 Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zKoq_vhusXnDANbcr3Sa5SWzyS4aLTqhiTRhUL04Uit83u4qZhnIUT5la9P9_Xp0JNuobdlOuEQMGgnXDRkWvZ6eC79pAPBsg6riRz7xiynuljTjhPoHHzR79phDQMiu20IH4gODtcUDQ17FZj4H5GwZDdOObgVxk-gHjspvmTLK0o Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 1b633041d58845d1a6d0b9f31f3613d4 Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ListServerFiltersTestJSON-1412242091 Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1b633041d58845d1a6d0b9f31f3613d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1b633041d58845d1a6d0b9f31f3613d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1b633041d58845d1a6d0b9f31f3613d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1b633041d58845d1a6d0b9f31f3613d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ListServerFiltersTestJSON-1412242091 Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 1b633041d58845d1a6d0b9f31f3613d4 Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1412242091 Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ListServerFiltersTestJSON-1412242091-project Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 0631675f80674534b1e775e521cfea10 Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ListServerFiltersTestJSON-1412242091-project Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 976f2ec1-c70b-4795-a71d-251bed15ad25 could not be found. Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '976f2ec1-c70b-4795-a71d-251bed15ad25'} Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 976f2ec1-c70b-4795-a71d-251bed15ad25 could not be found. Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 976f2ec1-c70b-4795-a71d-251bed15ad25 could not be found. Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:45.150707 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:45.155504 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:45.155504 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:45.155504 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:45.155504 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:41:45.155504 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:41:45.155504 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 976f2ec1-c70b-4795-a71d-251bed15ad25 could not be found. Jul 19 22:41:45.155504 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:45.155504 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bc1138c9-e9ae-4d86-b84b-86798941d1d3 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] Returning 404 to user: Instance 976f2ec1-c70b-4795-a71d-251bed15ad25 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:41:45.155504 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bc1138c9-e9ae-4d86-b84b-86798941d1d3 tempest-ListServerFiltersTestJSON-1412242091 tempest-ListServerFiltersTestJSON-1412242091-project] 10.222.0.25 "GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25" status: 404 len: 111 microversion: 2.1 time: 0.059423 Jul 19 22:41:45.155504 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1614/3251] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:45 2022] GET /compute/v2.1/servers/976f2ec1-c70b-4795-a71d-251bed15ad25 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:41:45.171811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-88178ef1-6506-4a74-a02f-aa443ab03455 req-6ae8c18c-1b73-48d9-82b1-d599e9cf1db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "063af6c1-3ce5-4da4-95f7-dae4e720f7fe", "name": "network-vif-deleted", "tag": "14665aa9-4185-4b76-b88c-3d89b7130fba"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:45.181720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-88178ef1-6506-4a74-a02f-aa443ab03455 req-6ae8c18c-1b73-48d9-82b1-d599e9cf1db9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:45.188213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-88178ef1-6506-4a74-a02f-aa443ab03455 req-6ae8c18c-1b73-48d9-82b1-d599e9cf1db9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:45.202820 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-88178ef1-6506-4a74-a02f-aa443ab03455 req-6ae8c18c-1b73-48d9-82b1-d599e9cf1db9 service nova] Creating event network-vif-deleted:14665aa9-4185-4b76-b88c-3d89b7130fba for instance 063af6c1-3ce5-4da4-95f7-dae4e720f7fe on n-h2-847009-3 Jul 19 22:41:45.208783 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-88178ef1-6506-4a74-a02f-aa443ab03455 req-6ae8c18c-1b73-48d9-82b1-d599e9cf1db9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044113 Jul 19 22:41:45.211183 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1615/3252] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:45.219356 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4686b9f0-6ee8-485c-9123-61688e5bbfcc tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:45.220545 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4686b9f0-6ee8-485c-9123-61688e5bbfcc tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:45.225507 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:41:45.229870 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4686b9f0-6ee8-485c-9123-61688e5bbfcc tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:45.230881 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4686b9f0-6ee8-485c-9123-61688e5bbfcc tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:45.232194 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4686b9f0-6ee8-485c-9123-61688e5bbfcc tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:45.232895 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4686b9f0-6ee8-485c-9123-61688e5bbfcc tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:45.236746 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-273fa13d-8d6b-4502-9b25-7b99c0945aba tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:45.245938 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-273fa13d-8d6b-4502-9b25-7b99c0945aba tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1506 microversion: 2.1 time: 0.819037 Jul 19 22:41:45.248659 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1638/3253] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:44 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1506 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:45.344921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-155665e7-b733-4fb3-bd5e-537c6a97c52c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:45.346038 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-155665e7-b733-4fb3-bd5e-537c6a97c52c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:45.365658 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-155665e7-b733-4fb3-bd5e-537c6a97c52c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:45.366397 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-155665e7-b733-4fb3-bd5e-537c6a97c52c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:45.367969 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-155665e7-b733-4fb3-bd5e-537c6a97c52c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:45.369541 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-155665e7-b733-4fb3-bd5e-537c6a97c52c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:45.684168 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4686b9f0-6ee8-485c-9123-61688e5bbfcc tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:45.693314 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4686b9f0-6ee8-485c-9123-61688e5bbfcc tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1512 microversion: 2.1 time: 0.480597 Jul 19 22:41:45.693870 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-155665e7-b733-4fb3-bd5e-537c6a97c52c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:45.696798 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1616/3254] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:45 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1512 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:45.703009 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-59e0c8d6-3fdd-42f2-82c8-52e461a271f4 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:45.706681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-59e0c8d6-3fdd-42f2-82c8-52e461a271f4 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: 063af6c1-3ce5-4da4-95f7-dae4e720f7fe] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:45.716472 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-155665e7-b733-4fb3-bd5e-537c6a97c52c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1507 microversion: 2.1 time: 0.379784 Jul 19 22:41:45.717674 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1639/3255] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:45 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1507 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:41:45.722682 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f3df87d5-716c-4481-8afb-938be413f957 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:45.728998 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f3df87d5-716c-4481-8afb-938be413f957 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:45.738433 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-59e0c8d6-3fdd-42f2-82c8-52e461a271f4 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:45.741679 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-59e0c8d6-3fdd-42f2-82c8-52e461a271f4 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:45.746305 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-59e0c8d6-3fdd-42f2-82c8-52e461a271f4 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:45.748121 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-59e0c8d6-3fdd-42f2-82c8-52e461a271f4 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:45.755917 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f3df87d5-716c-4481-8afb-938be413f957 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:45.757527 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f3df87d5-716c-4481-8afb-938be413f957 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:45.779816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f3df87d5-716c-4481-8afb-938be413f957 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:45.784646 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-59e0c8d6-3fdd-42f2-82c8-52e461a271f4 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] HTTP exception thrown: Instance 063af6c1-3ce5-4da4-95f7-dae4e720f7fe could not be found. Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-59e0c8d6-3fdd-42f2-82c8-52e461a271f4 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Request method failure captured: Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe HTTP/1.1 Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zLOcBnDO8DB0TvfRIhrSs2i1Z8gf2mXRu9CWG3-L53ppyrrqccAldlD1sn80tAiiaYj788W6zk_H_lFv9A7zGAIhHM_mj3-7IRMW_3igT7vOPEp-kC_qbKwdmn2JH9DflRdkn_IaARtkReZyhJI3DiZyzYUOJLxFUfr88ChX6WBaz8 Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 6994ad3a701847d49163a7b709fba400 Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 063af6c1-3ce5-4da4-95f7-dae4e720f7fe could not be found. Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '063af6c1-3ce5-4da4-95f7-dae4e720f7fe'} Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 063af6c1-3ce5-4da4-95f7-dae4e720f7fe could not be found. Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 063af6c1-3ce5-4da4-95f7-dae4e720f7fe could not be found. Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:45.787006 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:45.793666 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:45.793666 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:45.793666 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:45.793666 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:41:45.793666 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:41:45.793666 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 063af6c1-3ce5-4da4-95f7-dae4e720f7fe could not be found. Jul 19 22:41:45.793666 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:45.794631 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f3df87d5-716c-4481-8afb-938be413f957 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:45.798690 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-59e0c8d6-3fdd-42f2-82c8-52e461a271f4 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Returning 404 to user: Instance 063af6c1-3ce5-4da4-95f7-dae4e720f7fe could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:41:45.801006 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-59e0c8d6-3fdd-42f2-82c8-52e461a271f4 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe" status: 404 len: 111 microversion: 2.1 time: 0.102793 Jul 19 22:41:45.811526 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1617/3256] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:45 2022] GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:41:45.819476 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3bd879a4-b71a-440c-abe0-afb6c27b1a00 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '.version_select at 0x7f7a03e64160>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:45.869460 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:41:45.877401 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f3df87d5-716c-4481-8afb-938be413f957 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:45.882902 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f3df87d5-716c-4481-8afb-938be413f957 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:45.887865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-f3df87d5-716c-4481-8afb-938be413f957 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lazy-loading 'fault' on Instance uuid 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:41:46.001087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f3df87d5-716c-4481-8afb-938be413f957 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:46.035640 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f3df87d5-716c-4481-8afb-938be413f957 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:46.046338 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f3df87d5-716c-4481-8afb-938be413f957 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56b9fae8a5b14153a3715a6514ae84ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ab27ce610d4b02a14a4fa7ff565555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:46.049420 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f3df87d5-716c-4481-8afb-938be413f957 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 200 len: 1372 microversion: 2.32 time: 0.330161 Jul 19 22:41:46.051180 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1640/3257] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:45 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 1372 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:46.136483 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1bf5e967-05af-4526-bd47-0c536656a5ac tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:46.137761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1bf5e967-05af-4526-bd47-0c536656a5ac tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:46.146648 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1bf5e967-05af-4526-bd47-0c536656a5ac tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:46.148136 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1bf5e967-05af-4526-bd47-0c536656a5ac tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:46.149185 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1bf5e967-05af-4526-bd47-0c536656a5ac tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:46.150576 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1bf5e967-05af-4526-bd47-0c536656a5ac tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:46.324269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1bf5e967-05af-4526-bd47-0c536656a5ac tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:46.341997 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1bf5e967-05af-4526-bd47-0c536656a5ac tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:46.344752 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1bf5e967-05af-4526-bd47-0c536656a5ac tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:46.358296 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1bf5e967-05af-4526-bd47-0c536656a5ac tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 200 len: 1366 microversion: 2.47 time: 0.233933 Jul 19 22:41:46.358933 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1641/3258] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:46 2022] GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:46.366706 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-af0305cb-1fe5-4acc-9ed1-b75e186d30c1 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:46.367534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-af0305cb-1fe5-4acc-9ed1-b75e186d30c1 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:46.387935 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-af0305cb-1fe5-4acc-9ed1-b75e186d30c1 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:46.388894 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-af0305cb-1fe5-4acc-9ed1-b75e186d30c1 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:46.390275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-af0305cb-1fe5-4acc-9ed1-b75e186d30c1 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:46.391011 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-af0305cb-1fe5-4acc-9ed1-b75e186d30c1 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:46.461609 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3bd879a4-b71a-440c-abe0-afb6c27b1a00 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/cd4d191e-7a55-4cd2-92d1-99a3ef45c087" status: 202 len: 0 microversion: 2.1 time: 0.647923 Jul 19 22:41:46.463912 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1618/3259] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:41:45 2022] DELETE /compute/v2.1/os-security-groups/cd4d191e-7a55-4cd2-92d1-99a3ef45c087 => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:41:46.483919 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-13b9c7de-4288-4715-8a6b-fe7684ba95a9 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '.version_select at 0x7f7a03d43790>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:46.729101 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-af0305cb-1fe5-4acc-9ed1-b75e186d30c1 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:46.737352 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-af0305cb-1fe5-4acc-9ed1-b75e186d30c1 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1506 microversion: 2.1 time: 0.376848 Jul 19 22:41:46.737938 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1642/3260] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:46 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1506 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:46.753764 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f4261aa8-c233-49cf-b448-b442452f141f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:46.754385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f4261aa8-c233-49cf-b448-b442452f141f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:46.764153 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4261aa8-c233-49cf-b448-b442452f141f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:46.764610 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4261aa8-c233-49cf-b448-b442452f141f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:46.765395 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4261aa8-c233-49cf-b448-b442452f141f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:46.765841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4261aa8-c233-49cf-b448-b442452f141f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:47.159087 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-13b9c7de-4288-4715-8a6b-fe7684ba95a9 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/3fe6438b-12d6-40b8-82bc-8af63bb8e912" status: 202 len: 0 microversion: 2.1 time: 0.690801 Jul 19 22:41:47.165488 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1619/3261] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:41:46 2022] DELETE /compute/v2.1/os-security-groups/3fe6438b-12d6-40b8-82bc-8af63bb8e912 => generated 0 bytes in 698 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 22:41:47.171372 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7fc7cf87-50a4-453e-9c85-384634e1be28 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:47.172015 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7fc7cf87-50a4-453e-9c85-384634e1be28 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:47.189562 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7fc7cf87-50a4-453e-9c85-384634e1be28 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:47.190016 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7fc7cf87-50a4-453e-9c85-384634e1be28 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:47.190841 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7fc7cf87-50a4-453e-9c85-384634e1be28 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:47.191311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7fc7cf87-50a4-453e-9c85-384634e1be28 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:47.243276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f4261aa8-c233-49cf-b448-b442452f141f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:47.254453 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f4261aa8-c233-49cf-b448-b442452f141f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1512 microversion: 2.1 time: 0.504271 Jul 19 22:41:47.271390 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1643/3262] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:46 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1512 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:47.277116 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1cf856ef-8b7d-4f53-9498-72a75b0a39ff tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:47.277754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1cf856ef-8b7d-4f53-9498-72a75b0a39ff tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:47.285969 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1cf856ef-8b7d-4f53-9498-72a75b0a39ff tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:47.286437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1cf856ef-8b7d-4f53-9498-72a75b0a39ff tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:47.287275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1cf856ef-8b7d-4f53-9498-72a75b0a39ff tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:47.287918 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1cf856ef-8b7d-4f53-9498-72a75b0a39ff tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:47.313958 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-1cf856ef-8b7d-4f53-9498-72a75b0a39ff tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] HTTP exception thrown: Instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 could not be found. Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1cf856ef-8b7d-4f53-9498-72a75b0a39ff tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Request method failure captured: Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 HTTP/1.1 Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zFVnv4iJU4o5JfHXp6HYKQOX1YGUMJ6NSNw4Pt466UdZIKmLFu9xXgUxWOO6vLY4q1wxso6po6867iaFXDGby-IcoID9zY-dLWH5Z3WnY3y7_pxjOT9zw19Fop7roywQ6SUwPumAOMK_HxJzh9V2g-7_ttP4Yfpr0UW5emD4-09Mxs Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: X-Openstack-Nova-Api-Version: 2.32 Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 29ab27ce610d4b02a14a4fa7ff565555 Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TaggedBootDevicesTest-1939592602 Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_29ab27ce610d4b02a14a4fa7ff565555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29ab27ce610d4b02a14a4fa7ff565555"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/29ab27ce610d4b02a14a4fa7ff565555"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29ab27ce610d4b02a14a4fa7ff565555"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TaggedBootDevicesTest-1939592602 Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 29ab27ce610d4b02a14a4fa7ff565555 Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1939592602 Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TaggedBootDevicesTest-1939592602-project Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 56b9fae8a5b14153a3715a6514ae84ff Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TaggedBootDevicesTest-1939592602-project Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 could not be found. Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '6e509d1e-b5d6-4f5f-a017-c2df1d2433f4'} Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 could not be found. Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 could not be found. Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:47.315972 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:47.320371 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:47.320371 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:47.320371 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:47.320371 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:41:47.320371 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:41:47.320371 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 could not be found. Jul 19 22:41:47.320371 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:47.320371 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1cf856ef-8b7d-4f53-9498-72a75b0a39ff tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Returning 404 to user: Instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:41:47.320371 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1cf856ef-8b7d-4f53-9498-72a75b0a39ff tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 404 len: 111 microversion: 2.32 time: 0.056522 Jul 19 22:41:47.320371 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1644/3263] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:47 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:41:47.326898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ac195f89-4135-499e-be9b-915e19cbcc82 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Action: 'create', calling method: .version_select at 0x7f7a1044c430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-490924903", "description": "tempest-description-1801250251"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:47.503294 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7fc7cf87-50a4-453e-9c85-384634e1be28 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:47.514312 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7fc7cf87-50a4-453e-9c85-384634e1be28 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1507 microversion: 2.1 time: 0.347241 Jul 19 22:41:47.514974 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1620/3264] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:47 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1507 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:47.530206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-efcd5df1-95f8-4058-b372-9cc2ea908856 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '.version_select at 0x7f7a03ea95e0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:47.551647 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-efcd5df1-95f8-4058-b372-9cc2ea908856 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1975000311" status: 204 len: 0 microversion: 2.32 time: 0.024893 Jul 19 22:41:47.553199 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1621/3265] 10.222.0.25 () {60 vars in 1261 bytes} [Tue Jul 19 22:41:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1975000311 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:41:47.559369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ffc5f852-9af2-4f50-b578-981af0057dce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:47.560072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ffc5f852-9af2-4f50-b578-981af0057dce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:47.566696 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ffc5f852-9af2-4f50-b578-981af0057dce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:47.567468 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ffc5f852-9af2-4f50-b578-981af0057dce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:47.568460 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ffc5f852-9af2-4f50-b578-981af0057dce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:47.569651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ffc5f852-9af2-4f50-b578-981af0057dce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:47.712002 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ffc5f852-9af2-4f50-b578-981af0057dce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:47.728403 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ffc5f852-9af2-4f50-b578-981af0057dce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:47.730617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ffc5f852-9af2-4f50-b578-981af0057dce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:47.733956 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ffc5f852-9af2-4f50-b578-981af0057dce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 200 len: 1366 microversion: 2.47 time: 0.178300 Jul 19 22:41:47.735712 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1622/3266] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:47 2022] GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:47.755726 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-34ed6458-4d40-44e0-9af7-f9e52f2c1f93 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:47.756662 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-34ed6458-4d40-44e0-9af7-f9e52f2c1f93 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:47.766411 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-34ed6458-4d40-44e0-9af7-f9e52f2c1f93 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:47.767176 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-34ed6458-4d40-44e0-9af7-f9e52f2c1f93 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:47.768381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-34ed6458-4d40-44e0-9af7-f9e52f2c1f93 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:47.768909 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-34ed6458-4d40-44e0-9af7-f9e52f2c1f93 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:47.998391 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ac195f89-4135-499e-be9b-915e19cbcc82 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.678692 Jul 19 22:41:48.000083 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1645/3267] 10.222.0.25 () {60 vars in 1179 bytes} [Tue Jul 19 22:41:47 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:48.013434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2f1ace0d-cd71-42a1-b432-3012ca1788e4 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Action: 'update', calling method: .version_select at 0x7f7a10461b80>, body: {"security_group": {"name": "tempest-sg-hth-209494548", "description": "tempest-description-hth-1612123211"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:48.124098 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-34ed6458-4d40-44e0-9af7-f9e52f2c1f93 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:48.145230 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-34ed6458-4d40-44e0-9af7-f9e52f2c1f93 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1506 microversion: 2.1 time: 0.393667 Jul 19 22:41:48.145828 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1623/3268] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:47 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1506 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:41:48.551160 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2f1ace0d-cd71-42a1-b432-3012ca1788e4 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "PUT /compute/v2.1/os-security-groups/f30599c5-b8d3-416f-8297-255eeb9cff35" status: 200 len: 217 microversion: 2.1 time: 0.543508 Jul 19 22:41:48.552322 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1646/3269] 10.222.0.25 () {60 vars in 1289 bytes} [Tue Jul 19 22:41:48 2022] PUT /compute/v2.1/os-security-groups/f30599c5-b8d3-416f-8297-255eeb9cff35 => generated 217 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:48.559205 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c48a91ee-bbd7-4ca0-9195-084cae9dff83 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:48.560045 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c48a91ee-bbd7-4ca0-9195-084cae9dff83 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:48.585245 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c48a91ee-bbd7-4ca0-9195-084cae9dff83 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:48.588453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c48a91ee-bbd7-4ca0-9195-084cae9dff83 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:48.589338 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c48a91ee-bbd7-4ca0-9195-084cae9dff83 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:48.589795 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c48a91ee-bbd7-4ca0-9195-084cae9dff83 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:48.714533 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-37548eda-50d4-4a0d-9615-4b0b03401c9b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:48.715781 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-37548eda-50d4-4a0d-9615-4b0b03401c9b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:48.725902 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37548eda-50d4-4a0d-9615-4b0b03401c9b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:48.726349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37548eda-50d4-4a0d-9615-4b0b03401c9b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:48.728655 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37548eda-50d4-4a0d-9615-4b0b03401c9b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:48.729277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37548eda-50d4-4a0d-9615-4b0b03401c9b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:49.021025 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c48a91ee-bbd7-4ca0-9195-084cae9dff83 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:49.035290 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c48a91ee-bbd7-4ca0-9195-084cae9dff83 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1507 microversion: 2.1 time: 0.481401 Jul 19 22:41:49.036223 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1647/3270] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:48 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1507 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:49.043398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8d95e7c1-2068-440f-b39f-8a8cbd21e0a5 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '.version_select at 0x7f7a03a4a820>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:49.180656 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-37548eda-50d4-4a0d-9615-4b0b03401c9b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:49.189564 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-37548eda-50d4-4a0d-9615-4b0b03401c9b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1512 microversion: 2.1 time: 0.909461 Jul 19 22:41:49.190222 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1624/3271] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:48 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1512 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:41:49.195734 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4944cdc5-9980-478a-8789-6023a0f11418 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:49.198297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4944cdc5-9980-478a-8789-6023a0f11418 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:49.216100 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4944cdc5-9980-478a-8789-6023a0f11418 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:49.216568 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4944cdc5-9980-478a-8789-6023a0f11418 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:49.217391 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4944cdc5-9980-478a-8789-6023a0f11418 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:49.218007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4944cdc5-9980-478a-8789-6023a0f11418 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:49.271481 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8d95e7c1-2068-440f-b39f-8a8cbd21e0a5 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/f30599c5-b8d3-416f-8297-255eeb9cff35" status: 200 len: 217 microversion: 2.1 time: 0.233726 Jul 19 22:41:49.272965 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1648/3272] 10.222.0.25 () {58 vars in 1268 bytes} [Tue Jul 19 22:41:49 2022] GET /compute/v2.1/os-security-groups/f30599c5-b8d3-416f-8297-255eeb9cff35 => generated 217 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:49.283438 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2598f57f-35a0-44cc-bd2f-ad28dddd202c tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:49.284066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2598f57f-35a0-44cc-bd2f-ad28dddd202c tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:49.291671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2598f57f-35a0-44cc-bd2f-ad28dddd202c tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:49.292420 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2598f57f-35a0-44cc-bd2f-ad28dddd202c tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:49.293224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2598f57f-35a0-44cc-bd2f-ad28dddd202c tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:49.293837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2598f57f-35a0-44cc-bd2f-ad28dddd202c tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:49.375815 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4944cdc5-9980-478a-8789-6023a0f11418 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:49.388972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4944cdc5-9980-478a-8789-6023a0f11418 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:49.391983 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4944cdc5-9980-478a-8789-6023a0f11418 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:49.394044 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4944cdc5-9980-478a-8789-6023a0f11418 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 200 len: 1366 microversion: 2.47 time: 0.202345 Jul 19 22:41:49.394997 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1625/3273] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:49 2022] GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:49.411733 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1a038bb5-050e-418c-ad87-4b02b142df27 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '.version_select at 0x7f7a03ea9ee0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:50.086841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2598f57f-35a0-44cc-bd2f-ad28dddd202c tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:50.096571 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2598f57f-35a0-44cc-bd2f-ad28dddd202c tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1506 microversion: 2.1 time: 0.822239 Jul 19 22:41:50.097710 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1649/3274] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:49 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1506 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:50.103484 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-07ad6806-8c64-48e9-878e-3d59b114a9c3 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:50.104433 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-07ad6806-8c64-48e9-878e-3d59b114a9c3 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:50.112654 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07ad6806-8c64-48e9-878e-3d59b114a9c3 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:50.113359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07ad6806-8c64-48e9-878e-3d59b114a9c3 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:50.114381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07ad6806-8c64-48e9-878e-3d59b114a9c3 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:50.115071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07ad6806-8c64-48e9-878e-3d59b114a9c3 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:50.514012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-07ad6806-8c64-48e9-878e-3d59b114a9c3 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:50.528259 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1a038bb5-050e-418c-ad87-4b02b142df27 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/f30599c5-b8d3-416f-8297-255eeb9cff35" status: 202 len: 0 microversion: 2.1 time: 1.120368 Jul 19 22:41:50.528855 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1626/3275] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:41:49 2022] DELETE /compute/v2.1/os-security-groups/f30599c5-b8d3-416f-8297-255eeb9cff35 => generated 0 bytes in 1133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:41:50.537243 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4e6011d4-6fca-4fa8-a067-82f85cd06f0b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:50.538075 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4e6011d4-6fca-4fa8-a067-82f85cd06f0b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:50.541307 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-07ad6806-8c64-48e9-878e-3d59b114a9c3 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1507 microversion: 2.1 time: 0.441336 Jul 19 22:41:50.547863 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1650/3276] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:50 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1507 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:50.553046 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d469d7d5-d4fb-44e5-ac8f-398878e24db9 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:50.554950 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4e6011d4-6fca-4fa8-a067-82f85cd06f0b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:50.555300 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4e6011d4-6fca-4fa8-a067-82f85cd06f0b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:50.556155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4e6011d4-6fca-4fa8-a067-82f85cd06f0b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:50.556618 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4e6011d4-6fca-4fa8-a067-82f85cd06f0b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:50.560027 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d469d7d5-d4fb-44e5-ac8f-398878e24db9 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:50.576145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d469d7d5-d4fb-44e5-ac8f-398878e24db9 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:50.578816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d469d7d5-d4fb-44e5-ac8f-398878e24db9 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:50.581126 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d469d7d5-d4fb-44e5-ac8f-398878e24db9 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:50.582191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d469d7d5-d4fb-44e5-ac8f-398878e24db9 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:50.807060 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d469d7d5-d4fb-44e5-ac8f-398878e24db9 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:50.825388 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d469d7d5-d4fb-44e5-ac8f-398878e24db9 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:50.827031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d469d7d5-d4fb-44e5-ac8f-398878e24db9 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:50.831477 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d469d7d5-d4fb-44e5-ac8f-398878e24db9 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 200 len: 1366 microversion: 2.47 time: 0.281991 Jul 19 22:41:50.836192 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1651/3277] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:50 2022] GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:50.846325 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f4469d06-bd95-492f-bee3-a88e40d8e26c tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:50.846835 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f4469d06-bd95-492f-bee3-a88e40d8e26c tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: 063af6c1-3ce5-4da4-95f7-dae4e720f7fe] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:50.859256 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4469d06-bd95-492f-bee3-a88e40d8e26c tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:50.860431 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4469d06-bd95-492f-bee3-a88e40d8e26c tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:50.861341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4469d06-bd95-492f-bee3-a88e40d8e26c tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:50.861796 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4469d06-bd95-492f-bee3-a88e40d8e26c tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:50.880951 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-f4469d06-bd95-492f-bee3-a88e40d8e26c tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] HTTP exception thrown: Instance 063af6c1-3ce5-4da4-95f7-dae4e720f7fe could not be found. Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f4469d06-bd95-492f-bee3-a88e40d8e26c tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Request method failure captured: Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe HTTP/1.1 Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zLOcBnDO8DB0TvfRIhrSs2i1Z8gf2mXRu9CWG3-L53ppyrrqccAldlD1sn80tAiiaYj788W6zk_H_lFv9A7zGAIhHM_mj3-7IRMW_3igT7vOPEp-kC_qbKwdmn2JH9DflRdkn_IaARtkReZyhJI3DiZyzYUOJLxFUfr88ChX6WBaz8 Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 6994ad3a701847d49163a7b709fba400 Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 063af6c1-3ce5-4da4-95f7-dae4e720f7fe could not be found. Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '063af6c1-3ce5-4da4-95f7-dae4e720f7fe'} Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 063af6c1-3ce5-4da4-95f7-dae4e720f7fe could not be found. Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:41:50.882746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:41:50.887002 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 063af6c1-3ce5-4da4-95f7-dae4e720f7fe could not be found. Jul 19 22:41:50.887002 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:50.887002 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:50.887002 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:50.887002 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:50.887002 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:50.887002 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:50.887002 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:41:50.887002 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:41:50.887002 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 063af6c1-3ce5-4da4-95f7-dae4e720f7fe could not be found. Jul 19 22:41:50.887002 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:50.887002 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f4469d06-bd95-492f-bee3-a88e40d8e26c tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Returning 404 to user: Instance 063af6c1-3ce5-4da4-95f7-dae4e720f7fe could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:41:50.887002 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f4469d06-bd95-492f-bee3-a88e40d8e26c tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "DELETE /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe" status: 404 len: 111 microversion: 2.1 time: 0.047556 Jul 19 22:41:50.890338 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1652/3278] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:41:50 2022] DELETE /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:41:50.896462 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-231ed3d1-86c8-412d-97f9-52f518d1bd40 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:50.897298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-231ed3d1-86c8-412d-97f9-52f518d1bd40 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: 063af6c1-3ce5-4da4-95f7-dae4e720f7fe] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:50.905863 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-231ed3d1-86c8-412d-97f9-52f518d1bd40 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:50.906333 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-231ed3d1-86c8-412d-97f9-52f518d1bd40 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:50.907147 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-231ed3d1-86c8-412d-97f9-52f518d1bd40 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:50.907618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-231ed3d1-86c8-412d-97f9-52f518d1bd40 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:50.923989 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-231ed3d1-86c8-412d-97f9-52f518d1bd40 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] HTTP exception thrown: Instance 063af6c1-3ce5-4da4-95f7-dae4e720f7fe could not be found. Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-231ed3d1-86c8-412d-97f9-52f518d1bd40 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Request method failure captured: Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe HTTP/1.1 Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zLOcBnDO8DB0TvfRIhrSs2i1Z8gf2mXRu9CWG3-L53ppyrrqccAldlD1sn80tAiiaYj788W6zk_H_lFv9A7zGAIhHM_mj3-7IRMW_3igT7vOPEp-kC_qbKwdmn2JH9DflRdkn_IaARtkReZyhJI3DiZyzYUOJLxFUfr88ChX6WBaz8 Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 6994ad3a701847d49163a7b709fba400 Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 063af6c1-3ce5-4da4-95f7-dae4e720f7fe could not be found. Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '063af6c1-3ce5-4da4-95f7-dae4e720f7fe'} Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 063af6c1-3ce5-4da4-95f7-dae4e720f7fe could not be found. Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 063af6c1-3ce5-4da4-95f7-dae4e720f7fe could not be found. Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:50.925577 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:50.929539 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:50.929539 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:50.929539 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:50.929539 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:41:50.929539 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:41:50.929539 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 063af6c1-3ce5-4da4-95f7-dae4e720f7fe could not be found. Jul 19 22:41:50.929539 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:50.929539 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-231ed3d1-86c8-412d-97f9-52f518d1bd40 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Returning 404 to user: Instance 063af6c1-3ce5-4da4-95f7-dae4e720f7fe could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:41:50.929539 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-231ed3d1-86c8-412d-97f9-52f518d1bd40 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe" status: 404 len: 111 microversion: 2.1 time: 0.035824 Jul 19 22:41:50.932049 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1653/3279] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:50 2022] GET /compute/v2.1/servers/063af6c1-3ce5-4da4-95f7-dae4e720f7fe => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:41:50.937381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b2780dba-3a38-4c7d-8750-1b7db45363a6 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '.version_select at 0x7f7a1052f670>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:51.028491 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4e6011d4-6fca-4fa8-a067-82f85cd06f0b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:51.038713 n-d-847009-3 devstack@n-api.service[119338]: DEBUG neutronclient.v2_0.client [None req-b2780dba-3a38-4c7d-8750-1b7db45363a6 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3fe6438b-12d6-40b8-82bc-8af63bb8e912 does not exist", "detail": ""}} {{(pid=119338) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 22:41:51.042416 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.security_group_api [None req-b2780dba-3a38-4c7d-8750-1b7db45363a6 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Neutron security group 3fe6438b-12d6-40b8-82bc-8af63bb8e912 not found {{(pid=119338) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 22:41:51.044263 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-b2780dba-3a38-4c7d-8750-1b7db45363a6 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] HTTP exception thrown: Security group 3fe6438b-12d6-40b8-82bc-8af63bb8e912 does not exist Jul 19 22:41:51.044263 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-5edb2c79-e05e-45ad-ac4d-2ac17420b9b3'] Jul 19 22:41:51.051314 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4e6011d4-6fca-4fa8-a067-82f85cd06f0b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1512 microversion: 2.1 time: 0.521157 Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b2780dba-3a38-4c7d-8750-1b7db45363a6 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Request method failure captured: Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/os-security-groups/3fe6438b-12d6-40b8-82bc-8af63bb8e912 HTTP/1.1 Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zLOcBnDO8DB0TvfRIhrSs2i1Z8gf2mXRu9CWG3-L53ppyrrqccAldlD1sn80tAiiaYj788W6zk_H_lFv9A7zGAIhHM_mj3-7IRMW_3igT7vOPEp-kC_qbKwdmn2JH9DflRdkn_IaARtkReZyhJI3DiZyzYUOJLxFUfr88ChX6WBaz8 Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 6994ad3a701847d49163a7b709fba400 Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: exception: Security group 3fe6438b-12d6-40b8-82bc-8af63bb8e912 does not exist Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-5edb2c79-e05e-45ad-ac4d-2ac17420b9b3'] Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '3fe6438b-12d6-40b8-82bc-8af63bb8e912'} Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 22:41:51.053822 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3fe6438b-12d6-40b8-82bc-8af63bb8e912 does not exist Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5edb2c79-e05e-45ad-ac4d-2ac17420b9b3'] Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3fe6438b-12d6-40b8-82bc-8af63bb8e912 does not exist Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5edb2c79-e05e-45ad-ac4d-2ac17420b9b3'] Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3fe6438b-12d6-40b8-82bc-8af63bb8e912 does not exist Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5edb2c79-e05e-45ad-ac4d-2ac17420b9b3'] Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3fe6438b-12d6-40b8-82bc-8af63bb8e912 does not exist Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5edb2c79-e05e-45ad-ac4d-2ac17420b9b3'] Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b2780dba-3a38-4c7d-8750-1b7db45363a6 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Returning 404 to user: Security group 3fe6438b-12d6-40b8-82bc-8af63bb8e912 does not exist Jul 19 22:41:51.058931 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-5edb2c79-e05e-45ad-ac4d-2ac17420b9b3'] {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:41:51.069158 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b2780dba-3a38-4c7d-8750-1b7db45363a6 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/3fe6438b-12d6-40b8-82bc-8af63bb8e912" status: 404 len: 194 microversion: 2.1 time: 0.133075 Jul 19 22:41:51.070419 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1654/3280] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:41:50 2022] DELETE /compute/v2.1/os-security-groups/3fe6438b-12d6-40b8-82bc-8af63bb8e912 => generated 194 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:41:51.075282 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1627/3281] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:50 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1512 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:51.091325 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-61fac65a-1fc0-40c9-b1de-bc50f47fd3e6 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '.version_select at 0x7f7a105534c0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:51.122190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2ff79a87-f39f-4989-9d5a-dcbf6e0ab405 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:51.128142 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2ff79a87-f39f-4989-9d5a-dcbf6e0ab405 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:51.139386 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2ff79a87-f39f-4989-9d5a-dcbf6e0ab405 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:51.142511 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2ff79a87-f39f-4989-9d5a-dcbf6e0ab405 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:51.143462 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2ff79a87-f39f-4989-9d5a-dcbf6e0ab405 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:51.148390 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2ff79a87-f39f-4989-9d5a-dcbf6e0ab405 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:51.227317 n-d-847009-3 devstack@n-api.service[119338]: DEBUG neutronclient.v2_0.client [None req-61fac65a-1fc0-40c9-b1de-bc50f47fd3e6 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cd4d191e-7a55-4cd2-92d1-99a3ef45c087 does not exist", "detail": ""}} {{(pid=119338) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 22:41:51.229164 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.security_group_api [None req-61fac65a-1fc0-40c9-b1de-bc50f47fd3e6 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Neutron security group cd4d191e-7a55-4cd2-92d1-99a3ef45c087 not found {{(pid=119338) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 22:41:51.230071 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-61fac65a-1fc0-40c9-b1de-bc50f47fd3e6 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] HTTP exception thrown: Security group cd4d191e-7a55-4cd2-92d1-99a3ef45c087 does not exist Jul 19 22:41:51.230071 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-d6207a5d-4d47-4cd7-93f8-08170b25f3d8'] Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-61fac65a-1fc0-40c9-b1de-bc50f47fd3e6 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Request method failure captured: Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/os-security-groups/cd4d191e-7a55-4cd2-92d1-99a3ef45c087 HTTP/1.1 Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zLOcBnDO8DB0TvfRIhrSs2i1Z8gf2mXRu9CWG3-L53ppyrrqccAldlD1sn80tAiiaYj788W6zk_H_lFv9A7zGAIhHM_mj3-7IRMW_3igT7vOPEp-kC_qbKwdmn2JH9DflRdkn_IaARtkReZyhJI3DiZyzYUOJLxFUfr88ChX6WBaz8 Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 6994ad3a701847d49163a7b709fba400 Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: exception: Security group cd4d191e-7a55-4cd2-92d1-99a3ef45c087 does not exist Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-d6207a5d-4d47-4cd7-93f8-08170b25f3d8'] Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'cd4d191e-7a55-4cd2-92d1-99a3ef45c087'} Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 22:41:51.235374 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cd4d191e-7a55-4cd2-92d1-99a3ef45c087 does not exist Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6207a5d-4d47-4cd7-93f8-08170b25f3d8'] Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cd4d191e-7a55-4cd2-92d1-99a3ef45c087 does not exist Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6207a5d-4d47-4cd7-93f8-08170b25f3d8'] Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cd4d191e-7a55-4cd2-92d1-99a3ef45c087 does not exist Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6207a5d-4d47-4cd7-93f8-08170b25f3d8'] Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cd4d191e-7a55-4cd2-92d1-99a3ef45c087 does not exist Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6207a5d-4d47-4cd7-93f8-08170b25f3d8'] Jul 19 22:41:51.242249 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.249859 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-61fac65a-1fc0-40c9-b1de-bc50f47fd3e6 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Returning 404 to user: Security group cd4d191e-7a55-4cd2-92d1-99a3ef45c087 does not exist Jul 19 22:41:51.249859 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-d6207a5d-4d47-4cd7-93f8-08170b25f3d8'] {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:41:51.250420 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-61fac65a-1fc0-40c9-b1de-bc50f47fd3e6 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/cd4d191e-7a55-4cd2-92d1-99a3ef45c087" status: 404 len: 194 microversion: 2.1 time: 0.172822 Jul 19 22:41:51.251972 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1655/3282] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:41:51 2022] DELETE /compute/v2.1/os-security-groups/cd4d191e-7a55-4cd2-92d1-99a3ef45c087 => generated 194 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:41:51.266607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-379761c8-de02-468a-b98d-1f7a9580c97d tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '.version_select at 0x7f7a10553b80>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:51.382455 n-d-847009-3 devstack@n-api.service[119338]: DEBUG neutronclient.v2_0.client [None req-379761c8-de02-468a-b98d-1f7a9580c97d tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3eb12adc-a23a-4260-a3b1-210ae36edac7 does not exist", "detail": ""}} {{(pid=119338) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 22:41:51.383238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.security_group_api [None req-379761c8-de02-468a-b98d-1f7a9580c97d tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Neutron security group 3eb12adc-a23a-4260-a3b1-210ae36edac7 not found {{(pid=119338) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 22:41:51.383651 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-379761c8-de02-468a-b98d-1f7a9580c97d tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] HTTP exception thrown: Security group 3eb12adc-a23a-4260-a3b1-210ae36edac7 does not exist Jul 19 22:41:51.383651 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-ff99a54b-6845-40ef-8516-c38cbc2490c0'] Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-379761c8-de02-468a-b98d-1f7a9580c97d tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Request method failure captured: Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/os-security-groups/3eb12adc-a23a-4260-a3b1-210ae36edac7 HTTP/1.1 Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zLOcBnDO8DB0TvfRIhrSs2i1Z8gf2mXRu9CWG3-L53ppyrrqccAldlD1sn80tAiiaYj788W6zk_H_lFv9A7zGAIhHM_mj3-7IRMW_3igT7vOPEp-kC_qbKwdmn2JH9DflRdkn_IaARtkReZyhJI3DiZyzYUOJLxFUfr88ChX6WBaz8 Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 6994ad3a701847d49163a7b709fba400 Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: exception: Security group 3eb12adc-a23a-4260-a3b1-210ae36edac7 does not exist Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-ff99a54b-6845-40ef-8516-c38cbc2490c0'] Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '3eb12adc-a23a-4260-a3b1-210ae36edac7'} Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 22:41:51.385930 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3eb12adc-a23a-4260-a3b1-210ae36edac7 does not exist Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff99a54b-6845-40ef-8516-c38cbc2490c0'] Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3eb12adc-a23a-4260-a3b1-210ae36edac7 does not exist Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff99a54b-6845-40ef-8516-c38cbc2490c0'] Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3eb12adc-a23a-4260-a3b1-210ae36edac7 does not exist Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff99a54b-6845-40ef-8516-c38cbc2490c0'] Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3eb12adc-a23a-4260-a3b1-210ae36edac7 does not exist Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff99a54b-6845-40ef-8516-c38cbc2490c0'] Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-379761c8-de02-468a-b98d-1f7a9580c97d tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Returning 404 to user: Security group 3eb12adc-a23a-4260-a3b1-210ae36edac7 does not exist Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-ff99a54b-6845-40ef-8516-c38cbc2490c0'] {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-379761c8-de02-468a-b98d-1f7a9580c97d tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/3eb12adc-a23a-4260-a3b1-210ae36edac7" status: 404 len: 194 microversion: 2.1 time: 0.126886 Jul 19 22:41:51.390499 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1656/3283] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:41:51 2022] DELETE /compute/v2.1/os-security-groups/3eb12adc-a23a-4260-a3b1-210ae36edac7 => generated 194 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:41:51.409805 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-da990e4f-649e-4488-adb7-b669217b6ca7 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '.version_select at 0x7f7a1052f700>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:51.550667 n-d-847009-3 devstack@n-api.service[119338]: DEBUG neutronclient.v2_0.client [None req-da990e4f-649e-4488-adb7-b669217b6ca7 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ebfecb56-4dfa-4ea3-af2d-6457426dbc5e does not exist", "detail": ""}} {{(pid=119338) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 22:41:51.551388 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.security_group_api [None req-da990e4f-649e-4488-adb7-b669217b6ca7 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Neutron security group ebfecb56-4dfa-4ea3-af2d-6457426dbc5e not found {{(pid=119338) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 22:41:51.551920 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-da990e4f-649e-4488-adb7-b669217b6ca7 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] HTTP exception thrown: Security group ebfecb56-4dfa-4ea3-af2d-6457426dbc5e does not exist Jul 19 22:41:51.551920 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-3601dd34-6945-4258-a73b-05eeac2cca6e'] Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-da990e4f-649e-4488-adb7-b669217b6ca7 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Request method failure captured: Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/os-security-groups/ebfecb56-4dfa-4ea3-af2d-6457426dbc5e HTTP/1.1 Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zLOcBnDO8DB0TvfRIhrSs2i1Z8gf2mXRu9CWG3-L53ppyrrqccAldlD1sn80tAiiaYj788W6zk_H_lFv9A7zGAIhHM_mj3-7IRMW_3igT7vOPEp-kC_qbKwdmn2JH9DflRdkn_IaARtkReZyhJI3DiZyzYUOJLxFUfr88ChX6WBaz8 Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 6994ad3a701847d49163a7b709fba400 Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: exception: Security group ebfecb56-4dfa-4ea3-af2d-6457426dbc5e does not exist Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-3601dd34-6945-4258-a73b-05eeac2cca6e'] Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'ebfecb56-4dfa-4ea3-af2d-6457426dbc5e'} Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 22:41:51.555087 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ebfecb56-4dfa-4ea3-af2d-6457426dbc5e does not exist Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3601dd34-6945-4258-a73b-05eeac2cca6e'] Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ebfecb56-4dfa-4ea3-af2d-6457426dbc5e does not exist Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3601dd34-6945-4258-a73b-05eeac2cca6e'] Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ebfecb56-4dfa-4ea3-af2d-6457426dbc5e does not exist Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3601dd34-6945-4258-a73b-05eeac2cca6e'] Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ebfecb56-4dfa-4ea3-af2d-6457426dbc5e does not exist Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3601dd34-6945-4258-a73b-05eeac2cca6e'] Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-da990e4f-649e-4488-adb7-b669217b6ca7 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Returning 404 to user: Security group ebfecb56-4dfa-4ea3-af2d-6457426dbc5e does not exist Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: Neutron server returns request_ids: ['req-3601dd34-6945-4258-a73b-05eeac2cca6e'] {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-da990e4f-649e-4488-adb7-b669217b6ca7 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/ebfecb56-4dfa-4ea3-af2d-6457426dbc5e" status: 404 len: 194 microversion: 2.1 time: 0.159815 Jul 19 22:41:51.560280 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1657/3284] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:41:51 2022] DELETE /compute/v2.1/os-security-groups/ebfecb56-4dfa-4ea3-af2d-6457426dbc5e => generated 194 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:41:51.575239 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9c21314f-2c81-4e62-aeea-223347a48148 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:51.575824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9c21314f-2c81-4e62-aeea-223347a48148 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:51.585123 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9c21314f-2c81-4e62-aeea-223347a48148 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:51.585936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9c21314f-2c81-4e62-aeea-223347a48148 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:51.587073 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9c21314f-2c81-4e62-aeea-223347a48148 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:51.588488 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9c21314f-2c81-4e62-aeea-223347a48148 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:51.625300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:41:51.698809 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2ff79a87-f39f-4989-9d5a-dcbf6e0ab405 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:51.728623 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2ff79a87-f39f-4989-9d5a-dcbf6e0ab405 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1506 microversion: 2.1 time: 0.615398 Jul 19 22:41:51.740830 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1628/3285] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:51 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1506 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:51.754603 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5fd187c8-e44c-427b-a79e-fa521f223255 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '.version_select at 0x7f7a03f5c8b0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:51.902119 n-d-847009-3 devstack@n-api.service[119337]: DEBUG neutronclient.v2_0.client [None req-5fd187c8-e44c-427b-a79e-fa521f223255 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1ba2402f-1f96-4ba2-bce4-da2b77251282 does not exist", "detail": ""}} {{(pid=119337) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 22:41:51.902627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.security_group_api [None req-5fd187c8-e44c-427b-a79e-fa521f223255 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Neutron security group 1ba2402f-1f96-4ba2-bce4-da2b77251282 not found {{(pid=119337) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 22:41:51.903390 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-5fd187c8-e44c-427b-a79e-fa521f223255 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] HTTP exception thrown: Security group 1ba2402f-1f96-4ba2-bce4-da2b77251282 does not exist Jul 19 22:41:51.903390 n-d-847009-3 devstack@n-api.service[119337]: Neutron server returns request_ids: ['req-ae0313e5-b478-4a71-a6f1-875a08a05d37'] Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5fd187c8-e44c-427b-a79e-fa521f223255 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Request method failure captured: Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/os-security-groups/1ba2402f-1f96-4ba2-bce4-da2b77251282 HTTP/1.1 Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zLOcBnDO8DB0TvfRIhrSs2i1Z8gf2mXRu9CWG3-L53ppyrrqccAldlD1sn80tAiiaYj788W6zk_H_lFv9A7zGAIhHM_mj3-7IRMW_3igT7vOPEp-kC_qbKwdmn2JH9DflRdkn_IaARtkReZyhJI3DiZyzYUOJLxFUfr88ChX6WBaz8 Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 6994ad3a701847d49163a7b709fba400 Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: exception: Security group 1ba2402f-1f96-4ba2-bce4-da2b77251282 does not exist Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: Neutron server returns request_ids: ['req-ae0313e5-b478-4a71-a6f1-875a08a05d37'] Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '1ba2402f-1f96-4ba2-bce4-da2b77251282'} Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 22:41:51.905711 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1ba2402f-1f96-4ba2-bce4-da2b77251282 does not exist Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae0313e5-b478-4a71-a6f1-875a08a05d37'] Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1ba2402f-1f96-4ba2-bce4-da2b77251282 does not exist Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae0313e5-b478-4a71-a6f1-875a08a05d37'] Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1ba2402f-1f96-4ba2-bce4-da2b77251282 does not exist Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae0313e5-b478-4a71-a6f1-875a08a05d37'] Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1ba2402f-1f96-4ba2-bce4-da2b77251282 does not exist Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae0313e5-b478-4a71-a6f1-875a08a05d37'] Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5fd187c8-e44c-427b-a79e-fa521f223255 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Returning 404 to user: Security group 1ba2402f-1f96-4ba2-bce4-da2b77251282 does not exist Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: Neutron server returns request_ids: ['req-ae0313e5-b478-4a71-a6f1-875a08a05d37'] {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5fd187c8-e44c-427b-a79e-fa521f223255 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/1ba2402f-1f96-4ba2-bce4-da2b77251282" status: 404 len: 194 microversion: 2.1 time: 0.164215 Jul 19 22:41:51.909563 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1629/3286] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:41:51 2022] DELETE /compute/v2.1/os-security-groups/1ba2402f-1f96-4ba2-bce4-da2b77251282 => generated 194 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:41:51.914508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2cf4dccf-a4d7-4412-b05d-e994bf82954e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:51.917311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2cf4dccf-a4d7-4412-b05d-e994bf82954e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:51.923613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2cf4dccf-a4d7-4412-b05d-e994bf82954e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:51.924064 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2cf4dccf-a4d7-4412-b05d-e994bf82954e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:51.928151 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2cf4dccf-a4d7-4412-b05d-e994bf82954e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:51.928619 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2cf4dccf-a4d7-4412-b05d-e994bf82954e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:52.085648 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2cf4dccf-a4d7-4412-b05d-e994bf82954e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:52.098600 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2cf4dccf-a4d7-4412-b05d-e994bf82954e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:52.103862 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2cf4dccf-a4d7-4412-b05d-e994bf82954e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:52.105564 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2cf4dccf-a4d7-4412-b05d-e994bf82954e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 200 len: 1366 microversion: 2.47 time: 0.196119 Jul 19 22:41:52.106648 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1630/3287] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:51 2022] GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:52.125869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1c8970e6-5640-4b76-bc89-b8e363fad415 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '.version_select at 0x7f7a03f5cc10>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:52.134045 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9c21314f-2c81-4e62-aeea-223347a48148 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:52.148357 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9c21314f-2c81-4e62-aeea-223347a48148 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1507 microversion: 2.1 time: 0.589985 Jul 19 22:41:52.159422 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1658/3288] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:51 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1507 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:52.165151 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9aa90ee2-32a4-49a6-8c2c-6698bcc8cdc2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:52.166153 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9aa90ee2-32a4-49a6-8c2c-6698bcc8cdc2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:52.174350 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9aa90ee2-32a4-49a6-8c2c-6698bcc8cdc2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:52.175999 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9aa90ee2-32a4-49a6-8c2c-6698bcc8cdc2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:52.177358 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9aa90ee2-32a4-49a6-8c2c-6698bcc8cdc2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:52.178288 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9aa90ee2-32a4-49a6-8c2c-6698bcc8cdc2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:52.193653 n-d-847009-3 devstack@n-api.service[119337]: DEBUG neutronclient.v2_0.client [None req-1c8970e6-5640-4b76-bc89-b8e363fad415 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4edbc9af-14dc-4899-81a5-6394a338b801 does not exist", "detail": ""}} {{(pid=119337) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 19 22:41:52.194552 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.security_group_api [None req-1c8970e6-5640-4b76-bc89-b8e363fad415 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Neutron security group 4edbc9af-14dc-4899-81a5-6394a338b801 not found {{(pid=119337) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 19 22:41:52.195433 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-1c8970e6-5640-4b76-bc89-b8e363fad415 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] HTTP exception thrown: Security group 4edbc9af-14dc-4899-81a5-6394a338b801 does not exist Jul 19 22:41:52.195433 n-d-847009-3 devstack@n-api.service[119337]: Neutron server returns request_ids: ['req-8626c652-bee0-401d-a999-2c9db17ac365'] Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1c8970e6-5640-4b76-bc89-b8e363fad415 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Request method failure captured: Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/os-security-groups/4edbc9af-14dc-4899-81a5-6394a338b801 HTTP/1.1 Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zLOcBnDO8DB0TvfRIhrSs2i1Z8gf2mXRu9CWG3-L53ppyrrqccAldlD1sn80tAiiaYj788W6zk_H_lFv9A7zGAIhHM_mj3-7IRMW_3igT7vOPEp-kC_qbKwdmn2JH9DflRdkn_IaARtkReZyhJI3DiZyzYUOJLxFUfr88ChX6WBaz8 Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 6994ad3a701847d49163a7b709fba400 Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: exception: Security group 4edbc9af-14dc-4899-81a5-6394a338b801 does not exist Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: Neutron server returns request_ids: ['req-8626c652-bee0-401d-a999-2c9db17ac365'] Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '4edbc9af-14dc-4899-81a5-6394a338b801'} Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 19 22:41:52.198478 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4edbc9af-14dc-4899-81a5-6394a338b801 does not exist Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8626c652-bee0-401d-a999-2c9db17ac365'] Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4edbc9af-14dc-4899-81a5-6394a338b801 does not exist Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8626c652-bee0-401d-a999-2c9db17ac365'] Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4edbc9af-14dc-4899-81a5-6394a338b801 does not exist Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8626c652-bee0-401d-a999-2c9db17ac365'] Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4edbc9af-14dc-4899-81a5-6394a338b801 does not exist Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8626c652-bee0-401d-a999-2c9db17ac365'] Jul 19 22:41:52.202433 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:52.226948 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1c8970e6-5640-4b76-bc89-b8e363fad415 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Returning 404 to user: Security group 4edbc9af-14dc-4899-81a5-6394a338b801 does not exist Jul 19 22:41:52.226948 n-d-847009-3 devstack@n-api.service[119337]: Neutron server returns request_ids: ['req-8626c652-bee0-401d-a999-2c9db17ac365'] {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:41:52.231724 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1c8970e6-5640-4b76-bc89-b8e363fad415 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/4edbc9af-14dc-4899-81a5-6394a338b801" status: 404 len: 194 microversion: 2.1 time: 0.110630 Jul 19 22:41:52.236579 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1631/3289] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:41:52 2022] DELETE /compute/v2.1/os-security-groups/4edbc9af-14dc-4899-81a5-6394a338b801 => generated 194 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:41:52.255474 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5dd3f37a-d07b-4804-9e51-284a17a949fa tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:52.267053 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5dd3f37a-d07b-4804-9e51-284a17a949fa tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: fb624b16-6d57-4542-bae7-36cd5b28be74] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:52.281012 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5dd3f37a-d07b-4804-9e51-284a17a949fa tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:52.284084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5dd3f37a-d07b-4804-9e51-284a17a949fa tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:52.285945 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5dd3f37a-d07b-4804-9e51-284a17a949fa tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:52.287905 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5dd3f37a-d07b-4804-9e51-284a17a949fa tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:52.370988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5dd3f37a-d07b-4804-9e51-284a17a949fa tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: fb624b16-6d57-4542-bae7-36cd5b28be74] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:41:52.456880 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:41:52.557218 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5dd3f37a-d07b-4804-9e51-284a17a949fa tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74" status: 204 len: 0 microversion: 2.1 time: 0.317940 Jul 19 22:41:52.558693 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1632/3290] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:41:52 2022] DELETE /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:41:52.575302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-31d503b6-8043-4600-baf5-8c3ac7fee3a2 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:52.576805 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-31d503b6-8043-4600-baf5-8c3ac7fee3a2 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: fb624b16-6d57-4542-bae7-36cd5b28be74] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:52.592556 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31d503b6-8043-4600-baf5-8c3ac7fee3a2 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:52.593565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31d503b6-8043-4600-baf5-8c3ac7fee3a2 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:52.594767 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31d503b6-8043-4600-baf5-8c3ac7fee3a2 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:52.595576 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31d503b6-8043-4600-baf5-8c3ac7fee3a2 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:52.913363 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9aa90ee2-32a4-49a6-8c2c-6698bcc8cdc2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:52.927934 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9aa90ee2-32a4-49a6-8c2c-6698bcc8cdc2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1512 microversion: 2.1 time: 0.765110 Jul 19 22:41:52.929015 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1659/3291] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:52 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1512 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:52.950314 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e98d7054-d028-4d59-a28b-7511dc3d870f tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:52.951558 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e98d7054-d028-4d59-a28b-7511dc3d870f tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:52.961865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e98d7054-d028-4d59-a28b-7511dc3d870f tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:52.963534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e98d7054-d028-4d59-a28b-7511dc3d870f tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:52.964600 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e98d7054-d028-4d59-a28b-7511dc3d870f tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:52.966754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e98d7054-d028-4d59-a28b-7511dc3d870f tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:53.352322 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-31d503b6-8043-4600-baf5-8c3ac7fee3a2 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6994ad3a701847d49163a7b709fba400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24647fdcb5d7402ebfdca8ea2ae72e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:53.363736 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-31d503b6-8043-4600-baf5-8c3ac7fee3a2 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74" status: 200 len: 1647 microversion: 2.1 time: 0.800502 Jul 19 22:41:53.364826 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1633/3292] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:52 2022] GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74 => generated 1647 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:53.373972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7a6bd17d-12c5-4a3f-bd50-4055857b3829 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:53.375774 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7a6bd17d-12c5-4a3f-bd50-4055857b3829 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:53.383145 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a6bd17d-12c5-4a3f-bd50-4055857b3829 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:53.383753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a6bd17d-12c5-4a3f-bd50-4055857b3829 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:53.384714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a6bd17d-12c5-4a3f-bd50-4055857b3829 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:53.385591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a6bd17d-12c5-4a3f-bd50-4055857b3829 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:53.408365 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e98d7054-d028-4d59-a28b-7511dc3d870f tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:53.423700 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e98d7054-d028-4d59-a28b-7511dc3d870f tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1506 microversion: 2.1 time: 0.491283 Jul 19 22:41:53.424637 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1660/3293] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:52 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1506 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:53.429873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7acf5488-a0ae-45bc-b4a8-0b9e1ebef67b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:53.430513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7acf5488-a0ae-45bc-b4a8-0b9e1ebef67b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:53.446102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7acf5488-a0ae-45bc-b4a8-0b9e1ebef67b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:53.446672 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7acf5488-a0ae-45bc-b4a8-0b9e1ebef67b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:53.448229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7acf5488-a0ae-45bc-b4a8-0b9e1ebef67b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:53.448680 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7acf5488-a0ae-45bc-b4a8-0b9e1ebef67b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:53.581871 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7a6bd17d-12c5-4a3f-bd50-4055857b3829 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:53.593249 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7a6bd17d-12c5-4a3f-bd50-4055857b3829 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:53.595440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7a6bd17d-12c5-4a3f-bd50-4055857b3829 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:53.597875 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7a6bd17d-12c5-4a3f-bd50-4055857b3829 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 200 len: 1366 microversion: 2.47 time: 0.231061 Jul 19 22:41:53.600205 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1634/3294] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:53 2022] GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:53.882367 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7acf5488-a0ae-45bc-b4a8-0b9e1ebef67b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:53.893180 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7acf5488-a0ae-45bc-b4a8-0b9e1ebef67b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1507 microversion: 2.1 time: 0.467390 Jul 19 22:41:53.894329 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1661/3295] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:53 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1507 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:53.972635 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-26643650-23de-4ad4-b8d6-7ee9d62f1b69 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:53.974414 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-26643650-23de-4ad4-b8d6-7ee9d62f1b69 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:54.004694 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-26643650-23de-4ad4-b8d6-7ee9d62f1b69 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:54.020632 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-26643650-23de-4ad4-b8d6-7ee9d62f1b69 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:54.023653 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-26643650-23de-4ad4-b8d6-7ee9d62f1b69 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:54.024804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-26643650-23de-4ad4-b8d6-7ee9d62f1b69 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:54.293827 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-26643650-23de-4ad4-b8d6-7ee9d62f1b69 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:54.307956 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-26643650-23de-4ad4-b8d6-7ee9d62f1b69 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1512 microversion: 2.1 time: 0.361606 Jul 19 22:41:54.309094 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1635/3296] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:53 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1512 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:54.386404 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-54c7a004-7a42-4483-ae37-a3eb3645de72 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:54.389100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-54c7a004-7a42-4483-ae37-a3eb3645de72 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: fb624b16-6d57-4542-bae7-36cd5b28be74] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:54.398455 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54c7a004-7a42-4483-ae37-a3eb3645de72 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:54.399194 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54c7a004-7a42-4483-ae37-a3eb3645de72 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:54.400970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54c7a004-7a42-4483-ae37-a3eb3645de72 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:54.402457 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54c7a004-7a42-4483-ae37-a3eb3645de72 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:54.449049 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d11565b4-1a71-421b-8e4f-27b66895ec35 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:54.451321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d11565b4-1a71-421b-8e4f-27b66895ec35 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:54.466855 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d11565b4-1a71-421b-8e4f-27b66895ec35 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:54.468489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d11565b4-1a71-421b-8e4f-27b66895ec35 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:54.473976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d11565b4-1a71-421b-8e4f-27b66895ec35 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:54.474992 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d11565b4-1a71-421b-8e4f-27b66895ec35 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:55.253396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d11565b4-1a71-421b-8e4f-27b66895ec35 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:55.263185 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d11565b4-1a71-421b-8e4f-27b66895ec35 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1506 microversion: 2.1 time: 0.818554 Jul 19 22:41:55.267868 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1636/3297] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:54 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1506 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:55.295399 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1210d17a-4ecd-4583-852e-7cfe325f2b80 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:55.298389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1210d17a-4ecd-4583-852e-7cfe325f2b80 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:55.310534 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1210d17a-4ecd-4583-852e-7cfe325f2b80 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:55.312166 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1210d17a-4ecd-4583-852e-7cfe325f2b80 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:55.313390 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1210d17a-4ecd-4583-852e-7cfe325f2b80 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:55.314629 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1210d17a-4ecd-4583-852e-7cfe325f2b80 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:55.431524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-54c7a004-7a42-4483-ae37-a3eb3645de72 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6994ad3a701847d49163a7b709fba400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24647fdcb5d7402ebfdca8ea2ae72e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:55.446005 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-54c7a004-7a42-4483-ae37-a3eb3645de72 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74" status: 200 len: 1647 microversion: 2.1 time: 1.067958 Jul 19 22:41:55.450639 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1662/3298] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:54 2022] GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74 => generated 1647 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:55.469792 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a6ef5aee-57a3-4a6f-a09c-12e62afd4f48 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:55.470873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a6ef5aee-57a3-4a6f-a09c-12e62afd4f48 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:55.512775 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a6ef5aee-57a3-4a6f-a09c-12e62afd4f48 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:55.513229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a6ef5aee-57a3-4a6f-a09c-12e62afd4f48 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:55.514039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a6ef5aee-57a3-4a6f-a09c-12e62afd4f48 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:55.521767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a6ef5aee-57a3-4a6f-a09c-12e62afd4f48 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:55.687152 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1210d17a-4ecd-4583-852e-7cfe325f2b80 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:55.698832 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1210d17a-4ecd-4583-852e-7cfe325f2b80 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:55.700712 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1210d17a-4ecd-4583-852e-7cfe325f2b80 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:55.702575 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1210d17a-4ecd-4583-852e-7cfe325f2b80 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 200 len: 1366 microversion: 2.47 time: 0.433110 Jul 19 22:41:55.716077 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1637/3299] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:55 2022] GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 1366 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:55.722470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-71aa8541-d82c-4548-922a-3f215d563b9f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:55.723782 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-71aa8541-d82c-4548-922a-3f215d563b9f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:55.735302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-71aa8541-d82c-4548-922a-3f215d563b9f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:55.736930 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-71aa8541-d82c-4548-922a-3f215d563b9f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:55.737914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-71aa8541-d82c-4548-922a-3f215d563b9f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:55.738562 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-71aa8541-d82c-4548-922a-3f215d563b9f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:55.998820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a6ef5aee-57a3-4a6f-a09c-12e62afd4f48 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:56.015727 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a6ef5aee-57a3-4a6f-a09c-12e62afd4f48 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1507 microversion: 2.1 time: 0.561345 Jul 19 22:41:56.017289 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1663/3300] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:55 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1507 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:56.120045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-71aa8541-d82c-4548-922a-3f215d563b9f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:56.131707 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-71aa8541-d82c-4548-922a-3f215d563b9f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1489 microversion: 2.1 time: 0.414130 Jul 19 22:41:56.132307 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1638/3301] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:55 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1489 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:56.151582 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a9e1c924-f660-42b5-8399-496dd33e617a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:56.152660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a9e1c924-f660-42b5-8399-496dd33e617a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:56.174706 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a9e1c924-f660-42b5-8399-496dd33e617a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:56.179433 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a9e1c924-f660-42b5-8399-496dd33e617a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:56.180391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a9e1c924-f660-42b5-8399-496dd33e617a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:56.181488 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a9e1c924-f660-42b5-8399-496dd33e617a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:56.285080 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-283150f1-8487-4637-a7e7-0edce241b0e6 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:56.285728 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-283150f1-8487-4637-a7e7-0edce241b0e6 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:56.300653 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-283150f1-8487-4637-a7e7-0edce241b0e6 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:56.301242 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-283150f1-8487-4637-a7e7-0edce241b0e6 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:56.302052 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-283150f1-8487-4637-a7e7-0edce241b0e6 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:56.302528 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-283150f1-8487-4637-a7e7-0edce241b0e6 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:56.736115 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-283150f1-8487-4637-a7e7-0edce241b0e6 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:56.742339 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a9e1c924-f660-42b5-8399-496dd33e617a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action" status: 200 len: 121 microversion: 2.1 time: 0.593893 Jul 19 22:41:56.744955 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1664/3302] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:41:56 2022] POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action => generated 121 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:56.758319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5f219534-6ec3-403d-b788-fa08f476c74e tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:56.762618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5f219534-6ec3-403d-b788-fa08f476c74e tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: fb624b16-6d57-4542-bae7-36cd5b28be74] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:56.763074 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-283150f1-8487-4637-a7e7-0edce241b0e6 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1506 microversion: 2.1 time: 0.482553 Jul 19 22:41:56.771459 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1639/3303] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:56 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1506 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:41:56.779546 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e0e103ea-7759-44a6-9b5d-c023fafe96a3 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:56.780171 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e0e103ea-7759-44a6-9b5d-c023fafe96a3 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:56.800637 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0e103ea-7759-44a6-9b5d-c023fafe96a3 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:56.801364 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0e103ea-7759-44a6-9b5d-c023fafe96a3 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:56.802849 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0e103ea-7759-44a6-9b5d-c023fafe96a3 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:56.804971 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0e103ea-7759-44a6-9b5d-c023fafe96a3 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:56.811922 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5f219534-6ec3-403d-b788-fa08f476c74e tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:56.812591 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5f219534-6ec3-403d-b788-fa08f476c74e tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:56.816449 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5f219534-6ec3-403d-b788-fa08f476c74e tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:56.817211 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5f219534-6ec3-403d-b788-fa08f476c74e tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:56.993919 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e0e103ea-7759-44a6-9b5d-c023fafe96a3 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:57.011290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e0e103ea-7759-44a6-9b5d-c023fafe96a3 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:57.013674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e0e103ea-7759-44a6-9b5d-c023fafe96a3 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:57.015550 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e0e103ea-7759-44a6-9b5d-c023fafe96a3 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 200 len: 1372 microversion: 2.47 time: 0.242751 Jul 19 22:41:57.031362 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1640/3304] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:56 2022] GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 1372 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:57.041352 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-70020be5-0841-4603-9f89-d07d8722a3d0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:57.043437 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-70020be5-0841-4603-9f89-d07d8722a3d0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:57.075064 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-70020be5-0841-4603-9f89-d07d8722a3d0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:57.082529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-70020be5-0841-4603-9f89-d07d8722a3d0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:57.084018 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-70020be5-0841-4603-9f89-d07d8722a3d0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:57.088404 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-70020be5-0841-4603-9f89-d07d8722a3d0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:57.326957 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5f219534-6ec3-403d-b788-fa08f476c74e tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6994ad3a701847d49163a7b709fba400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24647fdcb5d7402ebfdca8ea2ae72e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:57.339002 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5f219534-6ec3-403d-b788-fa08f476c74e tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74" status: 200 len: 1647 microversion: 2.1 time: 0.590052 Jul 19 22:41:57.341292 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1665/3305] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:56 2022] GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74 => generated 1647 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:57.343212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-70020be5-0841-4603-9f89-d07d8722a3d0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:57.357355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-62595bc1-38ac-4159-98e7-57eb0b450953 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:57.358027 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-70020be5-0841-4603-9f89-d07d8722a3d0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.323489 Jul 19 22:41:57.358879 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-62595bc1-38ac-4159-98e7-57eb0b450953 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:57.359097 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1641/3306] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:57 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:57.374507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62595bc1-38ac-4159-98e7-57eb0b450953 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:57.375351 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62595bc1-38ac-4159-98e7-57eb0b450953 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:57.388258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eef14c95-7534-454e-a12c-24a982653d36 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:57.389003 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eef14c95-7534-454e-a12c-24a982653d36 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:57.395172 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62595bc1-38ac-4159-98e7-57eb0b450953 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:57.397014 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62595bc1-38ac-4159-98e7-57eb0b450953 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:57.398294 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eef14c95-7534-454e-a12c-24a982653d36 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:57.398757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eef14c95-7534-454e-a12c-24a982653d36 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:57.400663 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eef14c95-7534-454e-a12c-24a982653d36 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:57.401308 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eef14c95-7534-454e-a12c-24a982653d36 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:57.726886 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-eef14c95-7534-454e-a12c-24a982653d36 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:57.736126 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eef14c95-7534-454e-a12c-24a982653d36 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.358289 Jul 19 22:41:57.736812 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1642/3307] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:57 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:57.741455 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-dc3b9920-f280-404c-9a0d-365df07ceaeb req-7d28858e-9e2c-4746-87e1-f1890ec163b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb624b16-6d57-4542-bae7-36cd5b28be74", "name": "network-vif-deleted", "tag": "553d18df-50d7-4a4c-b5b8-69147cc944ac"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:57.743301 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-62595bc1-38ac-4159-98e7-57eb0b450953 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:57.757410 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-62595bc1-38ac-4159-98e7-57eb0b450953 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1507 microversion: 2.1 time: 0.404364 Jul 19 22:41:57.759554 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-dc3b9920-f280-404c-9a0d-365df07ceaeb req-7d28858e-9e2c-4746-87e1-f1890ec163b5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:57.760221 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-dc3b9920-f280-404c-9a0d-365df07ceaeb req-7d28858e-9e2c-4746-87e1-f1890ec163b5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:57.766506 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1666/3308] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:57 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1507 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:57.778908 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-247b4ff3-797f-4da9-91c2-5c3f834c9811 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:57.782927 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-247b4ff3-797f-4da9-91c2-5c3f834c9811 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:57.789530 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-dc3b9920-f280-404c-9a0d-365df07ceaeb req-7d28858e-9e2c-4746-87e1-f1890ec163b5 service nova] Creating event network-vif-deleted:553d18df-50d7-4a4c-b5b8-69147cc944ac for instance fb624b16-6d57-4542-bae7-36cd5b28be74 on n-h2-847009-3 Jul 19 22:41:57.799035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-247b4ff3-797f-4da9-91c2-5c3f834c9811 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:57.802139 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-247b4ff3-797f-4da9-91c2-5c3f834c9811 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:57.804736 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-247b4ff3-797f-4da9-91c2-5c3f834c9811 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:57.805628 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-dc3b9920-f280-404c-9a0d-365df07ceaeb req-7d28858e-9e2c-4746-87e1-f1890ec163b5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064035 Jul 19 22:41:57.807800 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-247b4ff3-797f-4da9-91c2-5c3f834c9811 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:57.808833 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1643/3309] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:41:57.822148 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a9729b76-c427-4040-8784-3d277fcab1b8 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:57.826794 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a9729b76-c427-4040-8784-3d277fcab1b8 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:57.851778 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9729b76-c427-4040-8784-3d277fcab1b8 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:57.853386 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9729b76-c427-4040-8784-3d277fcab1b8 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:57.854597 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9729b76-c427-4040-8784-3d277fcab1b8 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:57.857990 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9729b76-c427-4040-8784-3d277fcab1b8 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:58.319223 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-247b4ff3-797f-4da9-91c2-5c3f834c9811 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:58.324111 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a9729b76-c427-4040-8784-3d277fcab1b8 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:58.334858 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-247b4ff3-797f-4da9-91c2-5c3f834c9811 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.564433 Jul 19 22:41:58.335199 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a9729b76-c427-4040-8784-3d277fcab1b8 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1506 microversion: 2.1 time: 0.524389 Jul 19 22:41:58.335991 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1644/3310] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:57 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1506 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:58.336741 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1667/3311] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:57 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:58.344076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bd3002b8-1923-4650-93f9-0acbbd2041f7 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:58.345015 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bd3002b8-1923-4650-93f9-0acbbd2041f7 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:58.354992 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bd3002b8-1923-4650-93f9-0acbbd2041f7 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:58.356289 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bd3002b8-1923-4650-93f9-0acbbd2041f7 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:58.357161 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f2099c72-7606-4ebd-bc32-0dcd7b514914 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:58.358739 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bd3002b8-1923-4650-93f9-0acbbd2041f7 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:58.361877 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bd3002b8-1923-4650-93f9-0acbbd2041f7 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:58.364237 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f2099c72-7606-4ebd-bc32-0dcd7b514914 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:58.380300 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f2099c72-7606-4ebd-bc32-0dcd7b514914 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:58.381290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f2099c72-7606-4ebd-bc32-0dcd7b514914 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:58.384695 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f2099c72-7606-4ebd-bc32-0dcd7b514914 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:58.389125 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f2099c72-7606-4ebd-bc32-0dcd7b514914 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:58.417600 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-f2099c72-7606-4ebd-bc32-0dcd7b514914 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] HTTP exception thrown: Instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 could not be found. Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f2099c72-7606-4ebd-bc32-0dcd7b514914 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Request method failure captured: Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 HTTP/1.1 Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zFVnv4iJU4o5JfHXp6HYKQOX1YGUMJ6NSNw4Pt466UdZIKmLFu9xXgUxWOO6vLY4q1wxso6po6867iaFXDGby-IcoID9zY-dLWH5Z3WnY3y7_pxjOT9zw19Fop7roywQ6SUwPumAOMK_HxJzh9V2g-7_ttP4Yfpr0UW5emD4-09Mxs Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: X-Openstack-Nova-Api-Version: 2.32 Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 29ab27ce610d4b02a14a4fa7ff565555 Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-TaggedBootDevicesTest-1939592602 Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_29ab27ce610d4b02a14a4fa7ff565555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29ab27ce610d4b02a14a4fa7ff565555"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/29ab27ce610d4b02a14a4fa7ff565555"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29ab27ce610d4b02a14a4fa7ff565555"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-TaggedBootDevicesTest-1939592602 Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 29ab27ce610d4b02a14a4fa7ff565555 Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1939592602 Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-TaggedBootDevicesTest-1939592602-project Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 56b9fae8a5b14153a3715a6514ae84ff Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-TaggedBootDevicesTest-1939592602-project Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 could not be found. Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '6e509d1e-b5d6-4f5f-a017-c2df1d2433f4'} Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 could not be found. Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:41:58.420080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:41:58.424525 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 could not be found. Jul 19 22:41:58.424525 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:58.424525 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:58.424525 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:58.424525 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:58.424525 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:58.424525 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:58.424525 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:41:58.424525 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:41:58.424525 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 could not be found. Jul 19 22:41:58.424525 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:41:58.424525 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f2099c72-7606-4ebd-bc32-0dcd7b514914 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Returning 404 to user: Instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:41:58.424525 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f2099c72-7606-4ebd-bc32-0dcd7b514914 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 404 len: 111 microversion: 2.32 time: 0.070918 Jul 19 22:41:58.426565 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1645/3312] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 22:41:58 2022] DELETE /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:41:58.514120 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bd3002b8-1923-4650-93f9-0acbbd2041f7 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:58.541703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bd3002b8-1923-4650-93f9-0acbbd2041f7 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:58.548518 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bd3002b8-1923-4650-93f9-0acbbd2041f7 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:58.549961 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bd3002b8-1923-4650-93f9-0acbbd2041f7 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 200 len: 1357 microversion: 2.47 time: 0.211321 Jul 19 22:41:58.550830 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1668/3313] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:58 2022] GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 1357 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:58.565604 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1b8a8e95-b085-4ab8-8260-1869f00c576d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:58.567146 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1b8a8e95-b085-4ab8-8260-1869f00c576d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:58.616944 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b8a8e95-b085-4ab8-8260-1869f00c576d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:58.622171 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b8a8e95-b085-4ab8-8260-1869f00c576d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:58.628063 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b8a8e95-b085-4ab8-8260-1869f00c576d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:58.632915 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b8a8e95-b085-4ab8-8260-1869f00c576d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:58.653518 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c339443a-4e06-49d1-9f24-04fd657562a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1609625796", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "6119d69d-194a-407a-a78f-64890b6702ed"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:41:58.752976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-c339443a-4e06-49d1-9f24-04fd657562a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] validate_networks() for [('6119d69d-194a-407a-a78f-64890b6702ed', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:41:59.126545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1b8a8e95-b085-4ab8-8260-1869f00c576d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:59.139322 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1b8a8e95-b085-4ab8-8260-1869f00c576d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.587029 Jul 19 22:41:59.140097 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1669/3314] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:58 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:59.144743 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-834fce24-43df-45ed-8440-59a7c41aeb56 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:59.145359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-834fce24-43df-45ed-8440-59a7c41aeb56 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] [instance: fb624b16-6d57-4542-bae7-36cd5b28be74] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:59.153333 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-834fce24-43df-45ed-8440-59a7c41aeb56 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:59.154066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-834fce24-43df-45ed-8440-59a7c41aeb56 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:59.155014 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-834fce24-43df-45ed-8440-59a7c41aeb56 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:59.156169 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-834fce24-43df-45ed-8440-59a7c41aeb56 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:59.194757 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-834fce24-43df-45ed-8440-59a7c41aeb56 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] HTTP exception thrown: Instance fb624b16-6d57-4542-bae7-36cd5b28be74 could not be found. Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-834fce24-43df-45ed-8440-59a7c41aeb56 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Request method failure captured: Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74 HTTP/1.1 Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zLOcBnDO8DB0TvfRIhrSs2i1Z8gf2mXRu9CWG3-L53ppyrrqccAldlD1sn80tAiiaYj788W6zk_H_lFv9A7zGAIhHM_mj3-7IRMW_3igT7vOPEp-kC_qbKwdmn2JH9DflRdkn_IaARtkReZyhJI3DiZyzYUOJLxFUfr88ChX6WBaz8 Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24647fdcb5d7402ebfdca8ea2ae72e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 24647fdcb5d7402ebfdca8ea2ae72e2d Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231387690 Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 6994ad3a701847d49163a7b709fba400 Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-SecurityGroupsTestJSON-1231387690-project Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance fb624b16-6d57-4542-bae7-36cd5b28be74 could not be found. Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'fb624b16-6d57-4542-bae7-36cd5b28be74'} Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb624b16-6d57-4542-bae7-36cd5b28be74 could not be found. Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb624b16-6d57-4542-bae7-36cd5b28be74 could not be found. Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:59.198958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:59.203052 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:59.203052 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:59.203052 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:59.203052 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:41:59.203052 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:41:59.203052 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb624b16-6d57-4542-bae7-36cd5b28be74 could not be found. Jul 19 22:41:59.203052 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:59.203052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-834fce24-43df-45ed-8440-59a7c41aeb56 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Returning 404 to user: Instance fb624b16-6d57-4542-bae7-36cd5b28be74 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:41:59.203052 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-834fce24-43df-45ed-8440-59a7c41aeb56 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74" status: 404 len: 111 microversion: 2.1 time: 0.059522 Jul 19 22:41:59.203052 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1670/3315] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:59 2022] GET /compute/v2.1/servers/fb624b16-6d57-4542-bae7-36cd5b28be74 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:41:59.206142 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-de9a2f08-df54-4b61-838b-bd863ab81ba8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:59.206762 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-de9a2f08-df54-4b61-838b-bd863ab81ba8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] [instance: 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:59.214120 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de9a2f08-df54-4b61-838b-bd863ab81ba8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:59.214581 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de9a2f08-df54-4b61-838b-bd863ab81ba8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:59.215407 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de9a2f08-df54-4b61-838b-bd863ab81ba8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:59.216175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de9a2f08-df54-4b61-838b-bd863ab81ba8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:59.235738 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-de9a2f08-df54-4b61-838b-bd863ab81ba8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] HTTP exception thrown: Instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 could not be found. Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-de9a2f08-df54-4b61-838b-bd863ab81ba8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Request method failure captured: Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 HTTP/1.1 Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zFVnv4iJU4o5JfHXp6HYKQOX1YGUMJ6NSNw4Pt466UdZIKmLFu9xXgUxWOO6vLY4q1wxso6po6867iaFXDGby-IcoID9zY-dLWH5Z3WnY3y7_pxjOT9zw19Fop7roywQ6SUwPumAOMK_HxJzh9V2g-7_ttP4Yfpr0UW5emD4-09Mxs Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: X-Openstack-Nova-Api-Version: 2.32 Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 29ab27ce610d4b02a14a4fa7ff565555 Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TaggedBootDevicesTest-1939592602 Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_29ab27ce610d4b02a14a4fa7ff565555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29ab27ce610d4b02a14a4fa7ff565555"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/29ab27ce610d4b02a14a4fa7ff565555"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29ab27ce610d4b02a14a4fa7ff565555"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TaggedBootDevicesTest-1939592602 Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 29ab27ce610d4b02a14a4fa7ff565555 Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1939592602 Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TaggedBootDevicesTest-1939592602-project Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 56b9fae8a5b14153a3715a6514ae84ff Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TaggedBootDevicesTest-1939592602-project Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 could not be found. Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '6e509d1e-b5d6-4f5f-a017-c2df1d2433f4'} Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 could not be found. Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 could not be found. Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:41:59.237871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:59.243409 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:41:59.243409 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:41:59.243409 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:41:59.243409 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:41:59.243409 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:41:59.243409 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 could not be found. Jul 19 22:41:59.243409 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:41:59.243409 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-de9a2f08-df54-4b61-838b-bd863ab81ba8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] Returning 404 to user: Instance 6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:41:59.243409 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-de9a2f08-df54-4b61-838b-bd863ab81ba8 tempest-TaggedBootDevicesTest-1939592602 tempest-TaggedBootDevicesTest-1939592602-project] 10.222.0.25 "GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4" status: 404 len: 111 microversion: 2.32 time: 0.037655 Jul 19 22:41:59.249985 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1671/3316] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:41:59 2022] GET /compute/v2.1/servers/6e509d1e-b5d6-4f5f-a017-c2df1d2433f4 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:41:59.254449 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f188d212-aa8a-41bc-8ec4-1e67ecc4e2b9 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:59.261947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f188d212-aa8a-41bc-8ec4-1e67ecc4e2b9 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:59.264596 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f188d212-aa8a-41bc-8ec4-1e67ecc4e2b9 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Searching by: {'deleted': False, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae'} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:41:59.277501 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f188d212-aa8a-41bc-8ec4-1e67ecc4e2b9 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:59.278260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f188d212-aa8a-41bc-8ec4-1e67ecc4e2b9 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:59.279530 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f188d212-aa8a-41bc-8ec4-1e67ecc4e2b9 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:59.280024 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f188d212-aa8a-41bc-8ec4-1e67ecc4e2b9 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:59.453828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.multi_cell_list [None req-f188d212-aa8a-41bc-8ec4-1e67ecc4e2b9 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119338) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:41:59.616283 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f188d212-aa8a-41bc-8ec4-1e67ecc4e2b9 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:59.632777 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f188d212-aa8a-41bc-8ec4-1e67ecc4e2b9 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:59.633472 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f188d212-aa8a-41bc-8ec4-1e67ecc4e2b9 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:59.652238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f188d212-aa8a-41bc-8ec4-1e67ecc4e2b9 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:59.657776 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f188d212-aa8a-41bc-8ec4-1e67ecc4e2b9 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:59.666123 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-c339443a-4e06-49d1-9f24-04fd657562a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:41:59.666554 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-c339443a-4e06-49d1-9f24-04fd657562a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:41:59.667036 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-c339443a-4e06-49d1-9f24-04fd657562a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:41:59.667486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-c339443a-4e06-49d1-9f24-04fd657562a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:41:59.668154 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-c339443a-4e06-49d1-9f24-04fd657562a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:41:59.679130 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c339443a-4e06-49d1-9f24-04fd657562a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:59.679613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c339443a-4e06-49d1-9f24-04fd657562a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:59.681538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c339443a-4e06-49d1-9f24-04fd657562a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:59.682294 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c339443a-4e06-49d1-9f24-04fd657562a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:59.705366 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-c339443a-4e06-49d1-9f24-04fd657562a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Getting quotas for project 9bd4d0caf2f347218af6ffd52f250c59. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:41:59.708933 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f188d212-aa8a-41bc-8ec4-1e67ecc4e2b9 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.458383 Jul 19 22:41:59.713186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-c339443a-4e06-49d1-9f24-04fd657562a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Getting quotas for user 1db06ac41e9f4fe290e535f703af484d and project 9bd4d0caf2f347218af6ffd52f250c59. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:41:59.723189 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1672/3317] 10.222.0.25 () {60 vars in 1186 bytes} [Tue Jul 19 22:41:59 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:41:59.731506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6ce33d17-0d72-4834-afa0-d9ffc19f7aff tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:59.732703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6ce33d17-0d72-4834-afa0-d9ffc19f7aff tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:41:59.739293 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ce33d17-0d72-4834-afa0-d9ffc19f7aff tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:59.740013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ce33d17-0d72-4834-afa0-d9ffc19f7aff tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:59.741010 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ce33d17-0d72-4834-afa0-d9ffc19f7aff tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:41:59.741657 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ce33d17-0d72-4834-afa0-d9ffc19f7aff tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:41:59.750589 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c339443a-4e06-49d1-9f24-04fd657562a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:41:59.753740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c339443a-4e06-49d1-9f24-04fd657562a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:41:59.838181 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c339443a-4e06-49d1-9f24-04fd657562a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.410141 Jul 19 22:41:59.839632 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1646/3318] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:41:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:41:59.845469 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-39c1235b-bf3f-41b5-8da8-0fbe06f8ce2d tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '.version_select at 0x7f7a03efbca0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:41:59.965478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6ce33d17-0d72-4834-afa0-d9ffc19f7aff tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:41:59.974713 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6ce33d17-0d72-4834-afa0-d9ffc19f7aff tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1507 microversion: 2.1 time: 0.250102 Jul 19 22:41:59.980965 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1673/3319] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:41:59 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1507 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:41:59.986963 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9ac6a11a-0884-4a05-964b-882576750f52 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2031546132", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "9e83a825-a2fd-461e-9b4f-f6a6a85fd752"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:42:00.089869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-9ac6a11a-0884-4a05-964b-882576750f52 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] validate_networks() for [('9e83a825-a2fd-461e-9b4f-f6a6a85fd752', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:42:00.587628 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-39c1235b-bf3f-41b5-8da8-0fbe06f8ce2d tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/656eb929-caf9-4e63-87a1-a2c4e336e9c3" status: 202 len: 0 microversion: 2.1 time: 0.746000 Jul 19 22:42:00.588336 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1647/3320] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:41:59 2022] DELETE /compute/v2.1/os-security-groups/656eb929-caf9-4e63-87a1-a2c4e336e9c3 => generated 0 bytes in 748 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:42:00.594410 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-687591bb-c423-4600-9fb8-1a362ec38ffd tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:00.595213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-687591bb-c423-4600-9fb8-1a362ec38ffd tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:00.605301 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-687591bb-c423-4600-9fb8-1a362ec38ffd tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:00.606364 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-687591bb-c423-4600-9fb8-1a362ec38ffd tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:00.607763 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-687591bb-c423-4600-9fb8-1a362ec38ffd tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:00.608388 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-687591bb-c423-4600-9fb8-1a362ec38ffd tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:01.091029 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-687591bb-c423-4600-9fb8-1a362ec38ffd tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:01.107258 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-687591bb-c423-4600-9fb8-1a362ec38ffd tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1506 microversion: 2.1 time: 0.516988 Jul 19 22:42:01.122879 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1648/3321] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:00 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1506 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:01.155396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8da24084-23e6-4778-803a-c0575b0d84cc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:01.156174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8da24084-23e6-4778-803a-c0575b0d84cc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:01.164468 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8da24084-23e6-4778-803a-c0575b0d84cc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:01.171153 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8da24084-23e6-4778-803a-c0575b0d84cc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:01.172623 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8da24084-23e6-4778-803a-c0575b0d84cc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:01.173241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8da24084-23e6-4778-803a-c0575b0d84cc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:01.241790 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8da24084-23e6-4778-803a-c0575b0d84cc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:42:01.396185 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-9ac6a11a-0884-4a05-964b-882576750f52 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:42:01.396778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-9ac6a11a-0884-4a05-964b-882576750f52 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:42:01.397344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-9ac6a11a-0884-4a05-964b-882576750f52 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:42:01.397895 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-9ac6a11a-0884-4a05-964b-882576750f52 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:42:01.398422 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-9ac6a11a-0884-4a05-964b-882576750f52 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:42:01.398830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:42:01.416174 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ac6a11a-0884-4a05-964b-882576750f52 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:01.418100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ac6a11a-0884-4a05-964b-882576750f52 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:01.419927 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ac6a11a-0884-4a05-964b-882576750f52 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:01.422396 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ac6a11a-0884-4a05-964b-882576750f52 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:01.468731 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8da24084-23e6-4778-803a-c0575b0d84cc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "DELETE /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 204 len: 0 microversion: 2.47 time: 0.337075 Jul 19 22:42:01.472743 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1649/3322] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 22:42:01 2022] DELETE /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:42:01.480186 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-9ac6a11a-0884-4a05-964b-882576750f52 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Getting quotas for project 038e4783159e41e3b2cb88df1f8f4a97. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:42:01.487977 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-9ac6a11a-0884-4a05-964b-882576750f52 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Getting quotas for user 1f2613ad65b047e8b9a68907406d1874 and project 038e4783159e41e3b2cb88df1f8f4a97. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:42:01.500599 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ad15947d-aaae-48d4-8819-ea827063b18d tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:01.501335 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ad15947d-aaae-48d4-8819-ea827063b18d tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:01.516124 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9ac6a11a-0884-4a05-964b-882576750f52 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:42:01.522644 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9ac6a11a-0884-4a05-964b-882576750f52 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:42:01.532550 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad15947d-aaae-48d4-8819-ea827063b18d tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:01.534088 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad15947d-aaae-48d4-8819-ea827063b18d tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:01.535079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad15947d-aaae-48d4-8819-ea827063b18d tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:01.538152 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad15947d-aaae-48d4-8819-ea827063b18d tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:01.652721 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9ac6a11a-0884-4a05-964b-882576750f52 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.670224 Jul 19 22:42:01.666840 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1674/3323] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:41:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:42:01.674955 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3327c1d9-ee8f-400f-a7cd-c2ee92da5d87 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] Calling method '.version_select at 0x7f7a109418b0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:01.723274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ad15947d-aaae-48d4-8819-ea827063b18d tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:01.734727 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ad15947d-aaae-48d4-8819-ea827063b18d tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5" status: 200 len: 1245 microversion: 2.1 time: 0.260498 Jul 19 22:42:01.735887 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1650/3324] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:01 2022] GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 => generated 1245 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:01.740991 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-966b522a-91af-4447-b685-8aaccc7606a2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:01.741611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-966b522a-91af-4447-b685-8aaccc7606a2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:01.761117 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-966b522a-91af-4447-b685-8aaccc7606a2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:01.763407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-966b522a-91af-4447-b685-8aaccc7606a2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:01.767243 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-966b522a-91af-4447-b685-8aaccc7606a2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:01.767806 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-966b522a-91af-4447-b685-8aaccc7606a2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:02.410973 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-966b522a-91af-4447-b685-8aaccc7606a2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:02.422329 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-966b522a-91af-4447-b685-8aaccc7606a2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1507 microversion: 2.1 time: 0.685337 Jul 19 22:42:02.425260 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1651/3325] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:01 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1507 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:02.431896 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-aec7f515-cfb2-435e-9e51-a592bd760278 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:02.444600 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-aec7f515-cfb2-435e-9e51-a592bd760278 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:02.483438 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aec7f515-cfb2-435e-9e51-a592bd760278 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:02.485509 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aec7f515-cfb2-435e-9e51-a592bd760278 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:02.487716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aec7f515-cfb2-435e-9e51-a592bd760278 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:02.488254 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aec7f515-cfb2-435e-9e51-a592bd760278 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:02.719806 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-aec7f515-cfb2-435e-9e51-a592bd760278 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:02.731410 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-aec7f515-cfb2-435e-9e51-a592bd760278 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:02.740320 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-aec7f515-cfb2-435e-9e51-a592bd760278 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:02.752748 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-aec7f515-cfb2-435e-9e51-a592bd760278 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 200 len: 1363 microversion: 2.47 time: 0.326143 Jul 19 22:42:02.775498 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1652/3326] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:42:02 2022] GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 1363 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:42:02.776013 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3327c1d9-ee8f-400f-a7cd-c2ee92da5d87 tempest-SecurityGroupsTestJSON-1231387690 tempest-SecurityGroupsTestJSON-1231387690-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/4fc1d879-1d71-4d9a-9e53-d1363be51b64" status: 202 len: 0 microversion: 2.1 time: 1.107454 Jul 19 22:42:02.776598 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1675/3327] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:42:01 2022] DELETE /compute/v2.1/os-security-groups/4fc1d879-1d71-4d9a-9e53-d1363be51b64 => generated 0 bytes in 1109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:42:02.783893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-532d77d6-d384-4bfd-aa39-7057ef949305 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:02.784532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-532d77d6-d384-4bfd-aa39-7057ef949305 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:02.799027 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5ccf9c82-5804-47ee-b050-b1687fe4c8d3 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:02.799926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5ccf9c82-5804-47ee-b050-b1687fe4c8d3 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:02.815843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-532d77d6-d384-4bfd-aa39-7057ef949305 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:02.822638 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-532d77d6-d384-4bfd-aa39-7057ef949305 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:02.824171 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-532d77d6-d384-4bfd-aa39-7057ef949305 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:02.824796 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-532d77d6-d384-4bfd-aa39-7057ef949305 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:02.842404 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ccf9c82-5804-47ee-b050-b1687fe4c8d3 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:02.853849 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ccf9c82-5804-47ee-b050-b1687fe4c8d3 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:02.864776 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ccf9c82-5804-47ee-b050-b1687fe4c8d3 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:02.867983 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ccf9c82-5804-47ee-b050-b1687fe4c8d3 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:03.147217 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-532d77d6-d384-4bfd-aa39-7057ef949305 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:03.158830 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-532d77d6-d384-4bfd-aa39-7057ef949305 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3" status: 200 len: 1211 microversion: 2.1 time: 0.381814 Jul 19 22:42:03.169257 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1653/3328] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:02 2022] GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3 => generated 1211 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:03.179717 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-caa2b682-c94d-44ee-8ff1-fd12c655f25b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:03.180367 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-caa2b682-c94d-44ee-8ff1-fd12c655f25b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:03.210377 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-caa2b682-c94d-44ee-8ff1-fd12c655f25b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:03.210837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-caa2b682-c94d-44ee-8ff1-fd12c655f25b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:03.211751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-caa2b682-c94d-44ee-8ff1-fd12c655f25b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:03.212938 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-caa2b682-c94d-44ee-8ff1-fd12c655f25b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:03.368319 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-caa2b682-c94d-44ee-8ff1-fd12c655f25b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:03.384174 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-caa2b682-c94d-44ee-8ff1-fd12c655f25b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5" status: 200 len: 1251 microversion: 2.1 time: 0.223645 Jul 19 22:42:03.386014 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1654/3329] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:03 2022] GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 => generated 1251 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:03.441908 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bf1aff81-4c0a-46e1-b008-8c278b35698e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:03.442602 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bf1aff81-4c0a-46e1-b008-8c278b35698e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:03.466551 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bf1aff81-4c0a-46e1-b008-8c278b35698e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:03.467045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bf1aff81-4c0a-46e1-b008-8c278b35698e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:03.467927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bf1aff81-4c0a-46e1-b008-8c278b35698e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:03.468411 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bf1aff81-4c0a-46e1-b008-8c278b35698e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:04.610227 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5ccf9c82-5804-47ee-b050-b1687fe4c8d3 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:04.624080 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5ccf9c82-5804-47ee-b050-b1687fe4c8d3 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1486 microversion: 2.1 time: 1.828743 Jul 19 22:42:04.624991 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1676/3330] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:02 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1486 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:04.635702 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1793328d-f28b-44cb-b941-fd660f72ecfc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:04.643719 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1793328d-f28b-44cb-b941-fd660f72ecfc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:04.671397 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1793328d-f28b-44cb-b941-fd660f72ecfc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:04.675991 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1793328d-f28b-44cb-b941-fd660f72ecfc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:04.677122 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1793328d-f28b-44cb-b941-fd660f72ecfc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:04.684668 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1793328d-f28b-44cb-b941-fd660f72ecfc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:04.759729 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:42:04.859931 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1793328d-f28b-44cb-b941-fd660f72ecfc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:04.860535 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1793328d-f28b-44cb-b941-fd660f72ecfc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:04.861282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-1793328d-f28b-44cb-b941-fd660f72ecfc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lazy-loading 'fault' on Instance uuid 517285bd-f9ec-4314-8763-a77544458780 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:42:05.105291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1793328d-f28b-44cb-b941-fd660f72ecfc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:05.121629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1793328d-f28b-44cb-b941-fd660f72ecfc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:05.124988 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1793328d-f28b-44cb-b941-fd660f72ecfc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:05.128662 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1793328d-f28b-44cb-b941-fd660f72ecfc tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 200 len: 1368 microversion: 2.47 time: 0.502386 Jul 19 22:42:05.137489 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1677/3331] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:42:04 2022] GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 1368 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:42:05.142684 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7175e4f7-6dd3-4f55-9869-a770d10c9dae tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:05.145429 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7175e4f7-6dd3-4f55-9869-a770d10c9dae tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:05.165703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7175e4f7-6dd3-4f55-9869-a770d10c9dae tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:05.169628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7175e4f7-6dd3-4f55-9869-a770d10c9dae tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:05.170486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7175e4f7-6dd3-4f55-9869-a770d10c9dae tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:05.171084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7175e4f7-6dd3-4f55-9869-a770d10c9dae tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:05.272001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7175e4f7-6dd3-4f55-9869-a770d10c9dae tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:05.280323 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7175e4f7-6dd3-4f55-9869-a770d10c9dae tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3" status: 200 len: 1273 microversion: 2.1 time: 0.141360 Jul 19 22:42:05.280924 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1678/3332] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:05 2022] GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3 => generated 1273 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:05.305131 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4718b77e-21bc-48f8-be4e-0329eb2bac63 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:05.306717 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4718b77e-21bc-48f8-be4e-0329eb2bac63 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:05.313717 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4718b77e-21bc-48f8-be4e-0329eb2bac63 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:05.314375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4718b77e-21bc-48f8-be4e-0329eb2bac63 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:05.315353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4718b77e-21bc-48f8-be4e-0329eb2bac63 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:05.316219 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4718b77e-21bc-48f8-be4e-0329eb2bac63 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:05.403313 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bf1aff81-4c0a-46e1-b008-8c278b35698e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:05.419159 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bf1aff81-4c0a-46e1-b008-8c278b35698e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1507 microversion: 2.1 time: 1.980926 Jul 19 22:42:05.422567 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1655/3333] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:03 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1507 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:42:05.437603 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-88ff6467-d8b6-42e2-b487-1f8438c295a2 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-406131927", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:42:05.486008 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4718b77e-21bc-48f8-be4e-0329eb2bac63 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:05.498032 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4718b77e-21bc-48f8-be4e-0329eb2bac63 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5" status: 200 len: 1251 microversion: 2.1 time: 0.213167 Jul 19 22:42:05.500496 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1679/3334] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:05 2022] GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 => generated 1251 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:05.531065 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-88ff6467-d8b6-42e2-b487-1f8438c295a2 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] validate_networks() for [('28157aa0-af40-4f43-80ee-68fa54c01fa6', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:42:06.156179 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-61f78052-69eb-4882-a184-5084945f9649 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:06.157487 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-61f78052-69eb-4882-a184-5084945f9649 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 517285bd-f9ec-4314-8763-a77544458780] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:06.170277 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-61f78052-69eb-4882-a184-5084945f9649 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:06.172728 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-61f78052-69eb-4882-a184-5084945f9649 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:06.177813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-61f78052-69eb-4882-a184-5084945f9649 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:06.178489 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-61f78052-69eb-4882-a184-5084945f9649 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:06.211456 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-61f78052-69eb-4882-a184-5084945f9649 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] HTTP exception thrown: Instance 517285bd-f9ec-4314-8763-a77544458780 could not be found. Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-61f78052-69eb-4882-a184-5084945f9649 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Request method failure captured: Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 HTTP/1.1 Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zL9JS1fdqqr62feiRta10JAaFQVjlwYnbgUvCR4U-2P6UZPzMlzPge6hzd9oPtFcCDDjpwp7V-K4UubkH-6hjTgRkUdZixs-vlK-R0sVMbRpK93f931eKxrSiH4ntkLzDprcg74b5CoHTUcJ5g-qZTlW6Q4mGdlfKzNDkXEL3DIWMY Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: X-Openstack-Nova-Api-Version: 2.47 Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: b2244dc755db4aa3bde9af782c0057ae Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerShowV247Test-1971951972 Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b2244dc755db4aa3bde9af782c0057ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b2244dc755db4aa3bde9af782c0057ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b2244dc755db4aa3bde9af782c0057ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b2244dc755db4aa3bde9af782c0057ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerShowV247Test-1971951972 Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: b2244dc755db4aa3bde9af782c0057ae Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerShowV247Test-1971951972 Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerShowV247Test-1971951972-project Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 2820a440dc2341fcac6354e455963476 Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerShowV247Test-1971951972-project Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 517285bd-f9ec-4314-8763-a77544458780 could not be found. Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '517285bd-f9ec-4314-8763-a77544458780'} Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 517285bd-f9ec-4314-8763-a77544458780 could not be found. Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 517285bd-f9ec-4314-8763-a77544458780 could not be found. Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:42:06.216511 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:42:06.221665 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:42:06.221665 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:42:06.221665 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:42:06.221665 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:42:06.221665 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:42:06.221665 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 517285bd-f9ec-4314-8763-a77544458780 could not be found. Jul 19 22:42:06.221665 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:42:06.221665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-61f78052-69eb-4882-a184-5084945f9649 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Returning 404 to user: Instance 517285bd-f9ec-4314-8763-a77544458780 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:42:06.225806 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-61f78052-69eb-4882-a184-5084945f9649 tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780" status: 404 len: 111 microversion: 2.47 time: 0.070710 Jul 19 22:42:06.230578 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1680/3335] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:42:06 2022] GET /compute/v2.1/servers/517285bd-f9ec-4314-8763-a77544458780 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:42:06.237481 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1d42f36f-ab86-4075-b055-733696ed939e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:06.247880 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1d42f36f-ab86-4075-b055-733696ed939e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 7bf08dc5-caee-4c7b-90b0-9742966bdcef] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:06.268470 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d42f36f-ab86-4075-b055-733696ed939e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:06.268994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d42f36f-ab86-4075-b055-733696ed939e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:06.270018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d42f36f-ab86-4075-b055-733696ed939e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:06.270939 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d42f36f-ab86-4075-b055-733696ed939e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:06.327864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1d42f36f-ab86-4075-b055-733696ed939e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 7bf08dc5-caee-4c7b-90b0-9742966bdcef] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:42:06.546099 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1d42f36f-ab86-4075-b055-733696ed939e tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7bf08dc5-caee-4c7b-90b0-9742966bdcef" status: 204 len: 0 microversion: 2.47 time: 0.312146 Jul 19 22:42:06.556869 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1681/3336] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 22:42:06 2022] DELETE /compute/v2.1/servers/7bf08dc5-caee-4c7b-90b0-9742966bdcef => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:42:06.563949 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e5696f2e-3a68-4cc4-b34a-123b395bd32f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:06.567866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e5696f2e-3a68-4cc4-b34a-123b395bd32f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:06.590088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e5696f2e-3a68-4cc4-b34a-123b395bd32f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:06.590675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e5696f2e-3a68-4cc4-b34a-123b395bd32f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:06.591596 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e5696f2e-3a68-4cc4-b34a-123b395bd32f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:06.592130 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e5696f2e-3a68-4cc4-b34a-123b395bd32f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:07.155950 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e5696f2e-3a68-4cc4-b34a-123b395bd32f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:07.181586 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e5696f2e-3a68-4cc4-b34a-123b395bd32f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3" status: 200 len: 1273 microversion: 2.1 time: 0.621191 Jul 19 22:42:07.195540 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1682/3337] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:06 2022] GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3 => generated 1273 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:07.212410 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7ad5965d-a108-49a7-b870-90913138dd92 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:07.212410 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7ad5965d-a108-49a7-b870-90913138dd92 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:07.229286 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7ad5965d-a108-49a7-b870-90913138dd92 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:07.229751 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7ad5965d-a108-49a7-b870-90913138dd92 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:07.230549 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7ad5965d-a108-49a7-b870-90913138dd92 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:07.233797 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7ad5965d-a108-49a7-b870-90913138dd92 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:08.593391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7ad5965d-a108-49a7-b870-90913138dd92 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:08.604011 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7ad5965d-a108-49a7-b870-90913138dd92 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1528 microversion: 2.1 time: 1.406604 Jul 19 22:42:08.610339 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-88ff6467-d8b6-42e2-b487-1f8438c295a2 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:42:08.610788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-88ff6467-d8b6-42e2-b487-1f8438c295a2 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:42:08.611329 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-88ff6467-d8b6-42e2-b487-1f8438c295a2 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:42:08.611734 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-88ff6467-d8b6-42e2-b487-1f8438c295a2 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:42:08.612260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-88ff6467-d8b6-42e2-b487-1f8438c295a2 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:42:08.615972 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1683/3338] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:07 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1528 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:08.623463 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b2ebd2f2-9656-499e-8794-81120ac28c71 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:08.624783 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b2ebd2f2-9656-499e-8794-81120ac28c71 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:08.631363 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88ff6467-d8b6-42e2-b487-1f8438c295a2 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:08.631751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88ff6467-d8b6-42e2-b487-1f8438c295a2 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:08.633936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b2ebd2f2-9656-499e-8794-81120ac28c71 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:08.635203 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b2ebd2f2-9656-499e-8794-81120ac28c71 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:08.635690 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88ff6467-d8b6-42e2-b487-1f8438c295a2 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:08.636979 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b2ebd2f2-9656-499e-8794-81120ac28c71 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:08.637278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88ff6467-d8b6-42e2-b487-1f8438c295a2 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:08.641246 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b2ebd2f2-9656-499e-8794-81120ac28c71 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:08.688984 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:42:08.709884 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-88ff6467-d8b6-42e2-b487-1f8438c295a2 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Getting quotas for project 5a26234ff8b14bbcb4891ef363fb4739. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:42:08.723207 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-88ff6467-d8b6-42e2-b487-1f8438c295a2 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Getting quotas for user 7bc703828daa4c7ea61106f3b4e3bc3f and project 5a26234ff8b14bbcb4891ef363fb4739. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:42:08.746495 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-88ff6467-d8b6-42e2-b487-1f8438c295a2 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:42:08.749116 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-88ff6467-d8b6-42e2-b487-1f8438c295a2 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:42:08.840488 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-88ff6467-d8b6-42e2-b487-1f8438c295a2 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.407181 Jul 19 22:42:08.844874 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1656/3339] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:42:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 3421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:42:08.855626 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6588f39d-12a1-4cb2-a4a5-f9492b7d6fce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:08.858277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6588f39d-12a1-4cb2-a4a5-f9492b7d6fce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 7bf08dc5-caee-4c7b-90b0-9742966bdcef] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:08.871305 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6588f39d-12a1-4cb2-a4a5-f9492b7d6fce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:08.873113 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6588f39d-12a1-4cb2-a4a5-f9492b7d6fce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:08.875479 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6588f39d-12a1-4cb2-a4a5-f9492b7d6fce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:08.876141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6588f39d-12a1-4cb2-a4a5-f9492b7d6fce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:08.928003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b2ebd2f2-9656-499e-8794-81120ac28c71 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:08.941618 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b2ebd2f2-9656-499e-8794-81120ac28c71 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5" status: 200 len: 1251 microversion: 2.1 time: 0.324143 Jul 19 22:42:08.945220 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1684/3340] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:08 2022] GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 => generated 1251 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:08.959534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-47921005-7393-46ef-8921-16017a8a6d6a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:08.961547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-47921005-7393-46ef-8921-16017a8a6d6a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:08.981723 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-47921005-7393-46ef-8921-16017a8a6d6a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:08.983864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-47921005-7393-46ef-8921-16017a8a6d6a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:08.985198 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-47921005-7393-46ef-8921-16017a8a6d6a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:08.985814 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-47921005-7393-46ef-8921-16017a8a6d6a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:09.356338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6588f39d-12a1-4cb2-a4a5-f9492b7d6fce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:09.374279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6588f39d-12a1-4cb2-a4a5-f9492b7d6fce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:09.375849 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6588f39d-12a1-4cb2-a4a5-f9492b7d6fce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2820a440dc2341fcac6354e455963476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2244dc755db4aa3bde9af782c0057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:09.377074 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6588f39d-12a1-4cb2-a4a5-f9492b7d6fce tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf08dc5-caee-4c7b-90b0-9742966bdcef" status: 200 len: 1362 microversion: 2.47 time: 0.530977 Jul 19 22:42:09.377643 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1657/3341] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:42:08 2022] GET /compute/v2.1/servers/7bf08dc5-caee-4c7b-90b0-9742966bdcef => generated 1362 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:42:09.390409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-390bfdd5-6b5a-4f47-9bc0-ebfeac01e9a0 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:09.391262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-390bfdd5-6b5a-4f47-9bc0-ebfeac01e9a0 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:09.402939 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-47921005-7393-46ef-8921-16017a8a6d6a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:09.415651 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-47921005-7393-46ef-8921-16017a8a6d6a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3" status: 200 len: 1273 microversion: 2.1 time: 0.467630 Jul 19 22:42:09.416499 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1685/3342] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:08 2022] GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3 => generated 1273 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:09.622541 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-03e1c6fa-3b9c-42f0-b1da-0107a96996cd tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:09.623244 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-03e1c6fa-3b9c-42f0-b1da-0107a96996cd tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:09.625282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:42:09.653450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-03e1c6fa-3b9c-42f0-b1da-0107a96996cd tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:09.658601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-03e1c6fa-3b9c-42f0-b1da-0107a96996cd tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:09.665276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-03e1c6fa-3b9c-42f0-b1da-0107a96996cd tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:09.665782 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-03e1c6fa-3b9c-42f0-b1da-0107a96996cd tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:09.764763 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-390bfdd5-6b5a-4f47-9bc0-ebfeac01e9a0 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:09.785375 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-390bfdd5-6b5a-4f47-9bc0-ebfeac01e9a0 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1213 microversion: 2.1 time: 0.406452 Jul 19 22:42:09.785991 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1658/3343] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:09 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1213 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:09.962280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0a95da66-4805-43d5-bfb3-5ade191b7894 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:09.963235 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0a95da66-4805-43d5-bfb3-5ade191b7894 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:09.986214 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a95da66-4805-43d5-bfb3-5ade191b7894 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:09.987040 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a95da66-4805-43d5-bfb3-5ade191b7894 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:09.988005 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a95da66-4805-43d5-bfb3-5ade191b7894 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:09.988616 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a95da66-4805-43d5-bfb3-5ade191b7894 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:10.932305 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-03e1c6fa-3b9c-42f0-b1da-0107a96996cd tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:10.943590 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-03e1c6fa-3b9c-42f0-b1da-0107a96996cd tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1523 microversion: 2.1 time: 1.325144 Jul 19 22:42:10.952082 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1686/3344] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:09 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1523 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:42:10.977468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6c07d426-8f18-48b8-8865-eb3eff63d9bd tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:10.978166 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6c07d426-8f18-48b8-8865-eb3eff63d9bd tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] [instance: 7bf08dc5-caee-4c7b-90b0-9742966bdcef] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:10.996502 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c07d426-8f18-48b8-8865-eb3eff63d9bd tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:11.004138 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c07d426-8f18-48b8-8865-eb3eff63d9bd tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:11.005072 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c07d426-8f18-48b8-8865-eb3eff63d9bd tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:11.005534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c07d426-8f18-48b8-8865-eb3eff63d9bd tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:11.006145 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0a95da66-4805-43d5-bfb3-5ade191b7894 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:11.026567 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0a95da66-4805-43d5-bfb3-5ade191b7894 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5" status: 200 len: 1293 microversion: 2.1 time: 1.068132 Jul 19 22:42:11.039450 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1659/3345] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:09 2022] GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 => generated 1293 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:42:11.061861 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-6c07d426-8f18-48b8-8865-eb3eff63d9bd tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] HTTP exception thrown: Instance 7bf08dc5-caee-4c7b-90b0-9742966bdcef could not be found. Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6c07d426-8f18-48b8-8865-eb3eff63d9bd tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Request method failure captured: Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/7bf08dc5-caee-4c7b-90b0-9742966bdcef HTTP/1.1 Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zL9JS1fdqqr62feiRta10JAaFQVjlwYnbgUvCR4U-2P6UZPzMlzPge6hzd9oPtFcCDDjpwp7V-K4UubkH-6hjTgRkUdZixs-vlK-R0sVMbRpK93f931eKxrSiH4ntkLzDprcg74b5CoHTUcJ5g-qZTlW6Q4mGdlfKzNDkXEL3DIWMY Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: X-Openstack-Nova-Api-Version: 2.47 Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: b2244dc755db4aa3bde9af782c0057ae Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerShowV247Test-1971951972 Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b2244dc755db4aa3bde9af782c0057ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b2244dc755db4aa3bde9af782c0057ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b2244dc755db4aa3bde9af782c0057ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b2244dc755db4aa3bde9af782c0057ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerShowV247Test-1971951972 Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: b2244dc755db4aa3bde9af782c0057ae Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerShowV247Test-1971951972 Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerShowV247Test-1971951972-project Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 2820a440dc2341fcac6354e455963476 Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerShowV247Test-1971951972-project Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 7bf08dc5-caee-4c7b-90b0-9742966bdcef could not be found. Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '7bf08dc5-caee-4c7b-90b0-9742966bdcef'} Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bf08dc5-caee-4c7b-90b0-9742966bdcef could not be found. Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bf08dc5-caee-4c7b-90b0-9742966bdcef could not be found. Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:42:11.063587 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:42:11.072111 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:42:11.072111 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:42:11.072111 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:42:11.072111 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:42:11.072111 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:42:11.072111 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bf08dc5-caee-4c7b-90b0-9742966bdcef could not be found. Jul 19 22:42:11.072111 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:42:11.072111 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6c07d426-8f18-48b8-8865-eb3eff63d9bd tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] Returning 404 to user: Instance 7bf08dc5-caee-4c7b-90b0-9742966bdcef could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:42:11.072111 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6c07d426-8f18-48b8-8865-eb3eff63d9bd tempest-ServerShowV247Test-1971951972 tempest-ServerShowV247Test-1971951972-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf08dc5-caee-4c7b-90b0-9742966bdcef" status: 404 len: 111 microversion: 2.47 time: 0.109020 Jul 19 22:42:11.073217 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ccd72e84-f521-4208-8ca2-9aa18448a47a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:11.077188 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ccd72e84-f521-4208-8ca2-9aa18448a47a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:11.095751 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1687/3346] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:42:10 2022] GET /compute/v2.1/servers/7bf08dc5-caee-4c7b-90b0-9742966bdcef => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:42:11.107878 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ccd72e84-f521-4208-8ca2-9aa18448a47a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:11.108456 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ccd72e84-f521-4208-8ca2-9aa18448a47a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:11.116121 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ccd72e84-f521-4208-8ca2-9aa18448a47a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:11.122943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-eb6c486c-4dc9-4886-bde1-70c337a88b54 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:11.123629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-eb6c486c-4dc9-4886-bde1-70c337a88b54 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:11.126264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ccd72e84-f521-4208-8ca2-9aa18448a47a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:11.159391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eb6c486c-4dc9-4886-bde1-70c337a88b54 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:11.163435 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eb6c486c-4dc9-4886-bde1-70c337a88b54 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:11.165140 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eb6c486c-4dc9-4886-bde1-70c337a88b54 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:11.172834 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eb6c486c-4dc9-4886-bde1-70c337a88b54 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:11.451671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:42:11.499944 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=8 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:42:12.226248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ccd72e84-f521-4208-8ca2-9aa18448a47a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:12.232385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-eb6c486c-4dc9-4886-bde1-70c337a88b54 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:12.240745 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ccd72e84-f521-4208-8ca2-9aa18448a47a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3" status: 200 len: 1315 microversion: 2.1 time: 1.207962 Jul 19 22:42:12.245863 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-eb6c486c-4dc9-4886-bde1-70c337a88b54 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1273 microversion: 2.1 time: 1.147960 Jul 19 22:42:12.247020 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1688/3347] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:11 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1273 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:12.259141 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6632540d-1abf-4892-a56d-e024bfa41575 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:12.260101 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6632540d-1abf-4892-a56d-e024bfa41575 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:12.262773 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1660/3348] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:11 2022] GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3 => generated 1315 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:12.276459 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6632540d-1abf-4892-a56d-e024bfa41575 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:12.279015 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-06ae13a9-4fad-4d74-b96d-890735ceeadb tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:12.279781 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6632540d-1abf-4892-a56d-e024bfa41575 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:12.281952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6632540d-1abf-4892-a56d-e024bfa41575 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:12.282847 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-06ae13a9-4fad-4d74-b96d-890735ceeadb tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:12.283534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6632540d-1abf-4892-a56d-e024bfa41575 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:12.312012 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-06ae13a9-4fad-4d74-b96d-890735ceeadb tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:12.314640 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-06ae13a9-4fad-4d74-b96d-890735ceeadb tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:12.315796 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-06ae13a9-4fad-4d74-b96d-890735ceeadb tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:12.317612 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-06ae13a9-4fad-4d74-b96d-890735ceeadb tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:12.797416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-06ae13a9-4fad-4d74-b96d-890735ceeadb tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:12.809671 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-06ae13a9-4fad-4d74-b96d-890735ceeadb tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5" status: 200 len: 1293 microversion: 2.1 time: 0.545321 Jul 19 22:42:12.814550 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1661/3349] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:12 2022] GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 => generated 1293 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:13.181825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6632540d-1abf-4892-a56d-e024bfa41575 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:13.194129 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6632540d-1abf-4892-a56d-e024bfa41575 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1523 microversion: 2.1 time: 0.945768 Jul 19 22:42:13.198576 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1689/3350] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:12 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1523 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:13.264845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-08cae5fa-f92e-40e2-b3ae-6128458ae465 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:13.265477 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-08cae5fa-f92e-40e2-b3ae-6128458ae465 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:13.278866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e38a8422-8217-4fbc-92f1-6031d2b5fcf7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:13.280223 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e38a8422-8217-4fbc-92f1-6031d2b5fcf7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:13.302226 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08cae5fa-f92e-40e2-b3ae-6128458ae465 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:13.302689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08cae5fa-f92e-40e2-b3ae-6128458ae465 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:13.307374 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e38a8422-8217-4fbc-92f1-6031d2b5fcf7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:13.307835 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e38a8422-8217-4fbc-92f1-6031d2b5fcf7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:13.324997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08cae5fa-f92e-40e2-b3ae-6128458ae465 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:13.325711 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08cae5fa-f92e-40e2-b3ae-6128458ae465 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:13.329813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e38a8422-8217-4fbc-92f1-6031d2b5fcf7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:13.330629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e38a8422-8217-4fbc-92f1-6031d2b5fcf7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:13.759496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-08cae5fa-f92e-40e2-b3ae-6128458ae465 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:13.767738 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-08cae5fa-f92e-40e2-b3ae-6128458ae465 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1271 microversion: 2.1 time: 0.508952 Jul 19 22:42:13.789158 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1662/3351] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:13 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1271 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:13.830100 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3e65b9f2-72b9-44bd-a656-8c9e7eec39e4 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:13.831218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3e65b9f2-72b9-44bd-a656-8c9e7eec39e4 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:13.860702 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e65b9f2-72b9-44bd-a656-8c9e7eec39e4 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:13.861078 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e65b9f2-72b9-44bd-a656-8c9e7eec39e4 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:13.864753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e65b9f2-72b9-44bd-a656-8c9e7eec39e4 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:13.866020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e65b9f2-72b9-44bd-a656-8c9e7eec39e4 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:15.835438 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e38a8422-8217-4fbc-92f1-6031d2b5fcf7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:15.845640 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e38a8422-8217-4fbc-92f1-6031d2b5fcf7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3" status: 200 len: 1315 microversion: 2.1 time: 2.571128 Jul 19 22:42:15.860738 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1690/3352] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:13 2022] GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3 => generated 1315 bytes in 2587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:42:15.874716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-37998d0d-65c8-4c27-9a65-8b2c815862d1 req-7dfd0792-bc40-45d7-85fd-70fc71b266c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "507f8fdc-8dd3-4fb8-81d8-43c0782f48a5", "tag": "904ca1d5-eed3-4af9-8d7e-809aad699209"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:42:15.907602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-37998d0d-65c8-4c27-9a65-8b2c815862d1 req-7dfd0792-bc40-45d7-85fd-70fc71b266c2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:15.912476 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-37998d0d-65c8-4c27-9a65-8b2c815862d1 req-7dfd0792-bc40-45d7-85fd-70fc71b266c2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:15.946890 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-37998d0d-65c8-4c27-9a65-8b2c815862d1 req-7dfd0792-bc40-45d7-85fd-70fc71b266c2 service nova] Creating event network-changed:904ca1d5-eed3-4af9-8d7e-809aad699209 for instance 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 on n-h2-847009-3 Jul 19 22:42:15.975976 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-37998d0d-65c8-4c27-9a65-8b2c815862d1 req-7dfd0792-bc40-45d7-85fd-70fc71b266c2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110478 Jul 19 22:42:15.978328 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1691/3353] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:42:15.991924 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2f19dc43-d02f-4b7f-8b06-f018b5355fed tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:15.996794 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2f19dc43-d02f-4b7f-8b06-f018b5355fed tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:16.020333 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f19dc43-d02f-4b7f-8b06-f018b5355fed tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:16.021186 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f19dc43-d02f-4b7f-8b06-f018b5355fed tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:16.022263 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f19dc43-d02f-4b7f-8b06-f018b5355fed tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:16.022933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f19dc43-d02f-4b7f-8b06-f018b5355fed tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:17.364738 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3e65b9f2-72b9-44bd-a656-8c9e7eec39e4 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:17.378549 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3e65b9f2-72b9-44bd-a656-8c9e7eec39e4 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5" status: 200 len: 1293 microversion: 2.1 time: 3.552580 Jul 19 22:42:17.395510 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1663/3354] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:13 2022] GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 => generated 1293 bytes in 3570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:17.410542 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-4bcf765d-b062-4435-89ac-b05a2a250905 req-6773a9a5-5d38-46c1-87f5-e335b88d4d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7727fc2-2016-482d-aff6-0940874c3b28", "name": "network-vif-plugged", "status": "completed", "tag": "e9e1128e-eb72-4508-89fa-0c1047cf6872"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:42:17.461919 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-4bcf765d-b062-4435-89ac-b05a2a250905 req-6773a9a5-5d38-46c1-87f5-e335b88d4d70 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:17.463018 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-4bcf765d-b062-4435-89ac-b05a2a250905 req-6773a9a5-5d38-46c1-87f5-e335b88d4d70 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:17.504617 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-4bcf765d-b062-4435-89ac-b05a2a250905 req-6773a9a5-5d38-46c1-87f5-e335b88d4d70 service nova] Creating event network-vif-plugged:e9e1128e-eb72-4508-89fa-0c1047cf6872 for instance d7727fc2-2016-482d-aff6-0940874c3b28 on n-h1-847009-3 Jul 19 22:42:17.523484 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-4bcf765d-b062-4435-89ac-b05a2a250905 req-6773a9a5-5d38-46c1-87f5-e335b88d4d70 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126224 Jul 19 22:42:17.535518 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1664/3355] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:42:17.555163 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0c409d6b-63ff-4be4-8ad3-090190024349 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:17.563363 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0c409d6b-63ff-4be4-8ad3-090190024349 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:17.593513 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c409d6b-63ff-4be4-8ad3-090190024349 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:17.601947 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c409d6b-63ff-4be4-8ad3-090190024349 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:17.603666 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c409d6b-63ff-4be4-8ad3-090190024349 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:17.604277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c409d6b-63ff-4be4-8ad3-090190024349 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:18.435885 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2f19dc43-d02f-4b7f-8b06-f018b5355fed tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:18.450949 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2f19dc43-d02f-4b7f-8b06-f018b5355fed tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1523 microversion: 2.1 time: 2.463885 Jul 19 22:42:18.453749 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1692/3356] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:15 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1523 bytes in 2475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:18.472307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ec506d86-39a8-45ed-8df5-b66e9248b083 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:18.479645 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ec506d86-39a8-45ed-8df5-b66e9248b083 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:18.529083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec506d86-39a8-45ed-8df5-b66e9248b083 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:18.531311 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec506d86-39a8-45ed-8df5-b66e9248b083 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:18.532335 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec506d86-39a8-45ed-8df5-b66e9248b083 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:18.535248 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec506d86-39a8-45ed-8df5-b66e9248b083 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:18.677164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=4 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:42:19.490235 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0c409d6b-63ff-4be4-8ad3-090190024349 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:19.504173 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0c409d6b-63ff-4be4-8ad3-090190024349 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1313 microversion: 2.1 time: 1.966960 Jul 19 22:42:19.514447 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1665/3357] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:17 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1313 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:19.541856 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e3085f6a-f2e2-480c-ac27-fdd6e13ddda7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:19.542868 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e3085f6a-f2e2-480c-ac27-fdd6e13ddda7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:19.552109 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3085f6a-f2e2-480c-ac27-fdd6e13ddda7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:19.552948 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3085f6a-f2e2-480c-ac27-fdd6e13ddda7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:19.553950 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3085f6a-f2e2-480c-ac27-fdd6e13ddda7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:19.555295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3085f6a-f2e2-480c-ac27-fdd6e13ddda7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:19.679907 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ec506d86-39a8-45ed-8df5-b66e9248b083 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:19.699047 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ec506d86-39a8-45ed-8df5-b66e9248b083 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3" status: 200 len: 1315 microversion: 2.1 time: 1.241696 Jul 19 22:42:19.702859 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1693/3358] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:18 2022] GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3 => generated 1315 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:19.713800 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-75144cdf-ffc6-4768-a30e-457daf49593f req-aa7cac8e-c830-4cff-93f6-21c088b4ca4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50b53156-37b4-433b-8f13-9b788febd9e1", "tag": "179985b7-ff28-4d68-bdef-077f6dd3d089"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:42:19.749411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-75144cdf-ffc6-4768-a30e-457daf49593f req-aa7cac8e-c830-4cff-93f6-21c088b4ca4d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:19.749873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-75144cdf-ffc6-4768-a30e-457daf49593f req-aa7cac8e-c830-4cff-93f6-21c088b4ca4d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:19.769701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=14 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:42:19.778207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:42:19.792930 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-75144cdf-ffc6-4768-a30e-457daf49593f req-aa7cac8e-c830-4cff-93f6-21c088b4ca4d service nova] Creating event network-changed:179985b7-ff28-4d68-bdef-077f6dd3d089 for instance 50b53156-37b4-433b-8f13-9b788febd9e1 on n-h2-847009-3 Jul 19 22:42:19.807530 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-75144cdf-ffc6-4768-a30e-457daf49593f req-aa7cac8e-c830-4cff-93f6-21c088b4ca4d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102614 Jul 19 22:42:19.811008 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1694/3359] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:42:20.157075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2be68b81-c37c-43ad-a599-3ad18c871b51 tempest-VolumesGetTestJSON-1581966607 tempest-VolumesGetTestJSON-1581966607-project] Action: 'create', calling method: .version_select at 0x7f7a155888b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1450044096", "metadata": {"Type": "work"}}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:42:20.557852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e3085f6a-f2e2-480c-ac27-fdd6e13ddda7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:20.577906 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e3085f6a-f2e2-480c-ac27-fdd6e13ddda7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5" status: 200 len: 1293 microversion: 2.1 time: 1.057168 Jul 19 22:42:20.586321 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1666/3360] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:19 2022] GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 => generated 1293 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:20.605130 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-420ee7b2-e82c-4487-8ed6-466b6ec748a8 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:20.606169 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-420ee7b2-e82c-4487-8ed6-466b6ec748a8 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:20.635245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-420ee7b2-e82c-4487-8ed6-466b6ec748a8 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:20.643653 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-420ee7b2-e82c-4487-8ed6-466b6ec748a8 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:20.644785 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-420ee7b2-e82c-4487-8ed6-466b6ec748a8 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:20.647844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-420ee7b2-e82c-4487-8ed6-466b6ec748a8 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:21.157168 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2be68b81-c37c-43ad-a599-3ad18c871b51 tempest-VolumesGetTestJSON-1581966607 tempest-VolumesGetTestJSON-1581966607-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.343486 Jul 19 22:42:21.160329 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1695/3361] 10.222.0.25 () {60 vars in 1155 bytes} [Tue Jul 19 22:42:19 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1349 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 19 22:42:21.176347 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-4502d088-862e-49e5-9409-d2348e151a71 req-3e8a3deb-2fa6-401f-a16e-c1dc13e31900 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "087dbc3c-3e5c-4c33-87fc-978e640ae6e3", "tag": "47dba747-0185-4742-98ce-83e9e59ded78"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:42:21.236297 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-4502d088-862e-49e5-9409-d2348e151a71 req-3e8a3deb-2fa6-401f-a16e-c1dc13e31900 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:21.237207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-4502d088-862e-49e5-9409-d2348e151a71 req-3e8a3deb-2fa6-401f-a16e-c1dc13e31900 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:21.291065 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-4502d088-862e-49e5-9409-d2348e151a71 req-3e8a3deb-2fa6-401f-a16e-c1dc13e31900 service nova] Creating event network-changed:47dba747-0185-4742-98ce-83e9e59ded78 for instance 087dbc3c-3e5c-4c33-87fc-978e640ae6e3 on n-h1-847009-3 Jul 19 22:42:21.312699 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-4502d088-862e-49e5-9409-d2348e151a71 req-3e8a3deb-2fa6-401f-a16e-c1dc13e31900 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141091 Jul 19 22:42:21.319881 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1696/3362] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:42:21.344092 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-849ac707-b755-400f-b1f0-3c6fe653df9e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:21.344852 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-849ac707-b755-400f-b1f0-3c6fe653df9e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:21.361126 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-849ac707-b755-400f-b1f0-3c6fe653df9e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:21.373089 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-849ac707-b755-400f-b1f0-3c6fe653df9e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:21.374038 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-849ac707-b755-400f-b1f0-3c6fe653df9e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:21.374490 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-849ac707-b755-400f-b1f0-3c6fe653df9e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:22.020374 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-420ee7b2-e82c-4487-8ed6-466b6ec748a8 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:22.029766 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-420ee7b2-e82c-4487-8ed6-466b6ec748a8 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1523 microversion: 2.1 time: 1.441678 Jul 19 22:42:22.037605 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1667/3363] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:20 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1523 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:22.063438 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-933ee0de-07ef-4fab-a84d-451bf74510f3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:22.072216 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-933ee0de-07ef-4fab-a84d-451bf74510f3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:22.098447 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-933ee0de-07ef-4fab-a84d-451bf74510f3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:22.099208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-933ee0de-07ef-4fab-a84d-451bf74510f3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:22.100156 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-933ee0de-07ef-4fab-a84d-451bf74510f3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:22.100778 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-933ee0de-07ef-4fab-a84d-451bf74510f3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:23.444474 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-849ac707-b755-400f-b1f0-3c6fe653df9e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:23.462020 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-849ac707-b755-400f-b1f0-3c6fe653df9e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1313 microversion: 2.1 time: 2.140415 Jul 19 22:42:23.479212 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1697/3364] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:21 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1313 bytes in 2155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:23.512217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-687b77cf-4946-4a60-8796-521539935132 tempest-VolumesGetTestJSON-1581966607 tempest-VolumesGetTestJSON-1581966607-project] Calling method '.version_select at 0x7f7a03a1d5e0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:23.670009 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-687b77cf-4946-4a60-8796-521539935132 tempest-VolumesGetTestJSON-1581966607 tempest-VolumesGetTestJSON-1581966607-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/ae6a7ab1-35b9-44a7-8d7e-e3ed4e9bf25f" status: 200 len: 354 microversion: 2.1 time: 0.189589 Jul 19 22:42:23.670595 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1698/3365] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 19 22:42:23 2022] GET /compute/v2.1/os-volumes/ae6a7ab1-35b9-44a7-8d7e-e3ed4e9bf25f => generated 354 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:42:23.681996 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-54633dbd-872d-4b43-8dd5-41bd9985e87c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:23.682630 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-54633dbd-872d-4b43-8dd5-41bd9985e87c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:23.697713 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54633dbd-872d-4b43-8dd5-41bd9985e87c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:23.698168 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54633dbd-872d-4b43-8dd5-41bd9985e87c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:23.698966 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54633dbd-872d-4b43-8dd5-41bd9985e87c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:23.699434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54633dbd-872d-4b43-8dd5-41bd9985e87c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:23.818118 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-933ee0de-07ef-4fab-a84d-451bf74510f3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:23.830729 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:42:23.833867 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-933ee0de-07ef-4fab-a84d-451bf74510f3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3" status: 200 len: 1315 microversion: 2.1 time: 1.795166 Jul 19 22:42:23.837966 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1668/3366] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:22 2022] GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3 => generated 1315 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:23.848883 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c8b74990-a59a-4ee1-829d-42690500c2bf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:23.850853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c8b74990-a59a-4ee1-829d-42690500c2bf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:23.870696 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c8b74990-a59a-4ee1-829d-42690500c2bf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:23.871067 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c8b74990-a59a-4ee1-829d-42690500c2bf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:23.873687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c8b74990-a59a-4ee1-829d-42690500c2bf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:23.874140 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c8b74990-a59a-4ee1-829d-42690500c2bf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:25.730625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c8b74990-a59a-4ee1-829d-42690500c2bf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:25.762383 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c8b74990-a59a-4ee1-829d-42690500c2bf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1523 microversion: 2.1 time: 1.917809 Jul 19 22:42:25.766571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-54633dbd-872d-4b43-8dd5-41bd9985e87c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:25.781035 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-54633dbd-872d-4b43-8dd5-41bd9985e87c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5" status: 200 len: 1293 microversion: 2.1 time: 2.106247 Jul 19 22:42:25.794987 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1699/3367] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:23 2022] GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 => generated 1293 bytes in 2123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:25.798256 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1669/3368] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:23 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1523 bytes in 1959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:25.821197 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e52314a4-144f-4558-9f44-92175a1d705d tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:25.821420 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b12d223c-144e-4e69-9f67-3b173e29aa4c tempest-VolumesGetTestJSON-1581966607 tempest-VolumesGetTestJSON-1581966607-project] Calling method '.version_select at 0x7f7a10891ca0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:25.826721 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e52314a4-144f-4558-9f44-92175a1d705d tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:25.873687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e52314a4-144f-4558-9f44-92175a1d705d tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:25.877320 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e52314a4-144f-4558-9f44-92175a1d705d tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:25.883604 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e52314a4-144f-4558-9f44-92175a1d705d tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:25.886348 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e52314a4-144f-4558-9f44-92175a1d705d tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:26.020127 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b12d223c-144e-4e69-9f67-3b173e29aa4c tempest-VolumesGetTestJSON-1581966607 tempest-VolumesGetTestJSON-1581966607-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/ae6a7ab1-35b9-44a7-8d7e-e3ed4e9bf25f" status: 200 len: 354 microversion: 2.1 time: 0.223881 Jul 19 22:42:26.020984 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1700/3369] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 19 22:42:25 2022] GET /compute/v2.1/os-volumes/ae6a7ab1-35b9-44a7-8d7e-e3ed4e9bf25f => generated 354 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:42:26.031209 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-66c9f9fc-bec0-4496-b886-d62ad5458a21 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:26.032562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-66c9f9fc-bec0-4496-b886-d62ad5458a21 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:26.066081 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66c9f9fc-bec0-4496-b886-d62ad5458a21 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:26.067420 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66c9f9fc-bec0-4496-b886-d62ad5458a21 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:26.068907 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66c9f9fc-bec0-4496-b886-d62ad5458a21 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:26.078022 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66c9f9fc-bec0-4496-b886-d62ad5458a21 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:26.724971 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e52314a4-144f-4558-9f44-92175a1d705d tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:26.741603 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e52314a4-144f-4558-9f44-92175a1d705d tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1313 microversion: 2.1 time: 0.939655 Jul 19 22:42:26.752488 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1670/3370] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:25 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1313 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:26.756859 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4f758a3e-06d1-44df-b234-5f06600827f5 tempest-VolumesGetTestJSON-1581966607 tempest-VolumesGetTestJSON-1581966607-project] Calling method '.version_select at 0x7f7a03e78f70>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:26.898011 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4f758a3e-06d1-44df-b234-5f06600827f5 tempest-VolumesGetTestJSON-1581966607 tempest-VolumesGetTestJSON-1581966607-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/ae6a7ab1-35b9-44a7-8d7e-e3ed4e9bf25f" status: 202 len: 0 microversion: 2.1 time: 0.144774 Jul 19 22:42:26.898708 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1671/3371] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 19 22:42:26 2022] DELETE /compute/v2.1/os-volumes/ae6a7ab1-35b9-44a7-8d7e-e3ed4e9bf25f => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:42:26.905089 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-71223ced-f530-4a12-a946-cd5cf468e589 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:26.906755 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-71223ced-f530-4a12-a946-cd5cf468e589 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:26.926139 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-71223ced-f530-4a12-a946-cd5cf468e589 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:26.926862 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-71223ced-f530-4a12-a946-cd5cf468e589 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:26.928128 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-71223ced-f530-4a12-a946-cd5cf468e589 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:26.928755 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-71223ced-f530-4a12-a946-cd5cf468e589 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:26.975756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-66c9f9fc-bec0-4496-b886-d62ad5458a21 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:26.995230 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-66c9f9fc-bec0-4496-b886-d62ad5458a21 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3" status: 200 len: 1315 microversion: 2.1 time: 0.972864 Jul 19 22:42:27.007215 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1701/3372] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:26 2022] GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3 => generated 1315 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:27.025485 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5ab96257-c479-4796-b176-728f64353d78 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:27.026115 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5ab96257-c479-4796-b176-728f64353d78 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:27.054735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ab96257-c479-4796-b176-728f64353d78 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:27.058225 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ab96257-c479-4796-b176-728f64353d78 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:27.059332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ab96257-c479-4796-b176-728f64353d78 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:27.063762 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ab96257-c479-4796-b176-728f64353d78 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:27.636917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-71223ced-f530-4a12-a946-cd5cf468e589 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:27.649309 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-71223ced-f530-4a12-a946-cd5cf468e589 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1523 microversion: 2.1 time: 0.748170 Jul 19 22:42:27.650180 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1672/3373] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:26 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1523 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:27.667451 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-31b056a6-6d80-4fb0-8350-8b8e542ce48e tempest-VolumesGetTestJSON-1581966607 tempest-VolumesGetTestJSON-1581966607-project] Calling method '.version_select at 0x7f7a033c74c0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:27.830248 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-31b056a6-6d80-4fb0-8350-8b8e542ce48e tempest-VolumesGetTestJSON-1581966607 tempest-VolumesGetTestJSON-1581966607-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/ae6a7ab1-35b9-44a7-8d7e-e3ed4e9bf25f" status: 200 len: 353 microversion: 2.1 time: 0.168636 Jul 19 22:42:27.830854 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1673/3374] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 19 22:42:27 2022] GET /compute/v2.1/os-volumes/ae6a7ab1-35b9-44a7-8d7e-e3ed4e9bf25f => generated 353 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:42:27.840949 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-01104339-02de-40b6-bcc7-175a473fd6ef tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:27.841583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-01104339-02de-40b6-bcc7-175a473fd6ef tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:27.890000 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01104339-02de-40b6-bcc7-175a473fd6ef tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:27.906891 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01104339-02de-40b6-bcc7-175a473fd6ef tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:27.909893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01104339-02de-40b6-bcc7-175a473fd6ef tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:27.910271 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01104339-02de-40b6-bcc7-175a473fd6ef tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:28.442822 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5ab96257-c479-4796-b176-728f64353d78 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:28.453807 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5ab96257-c479-4796-b176-728f64353d78 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5" status: 200 len: 1293 microversion: 2.1 time: 1.445475 Jul 19 22:42:28.455749 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1702/3375] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:27 2022] GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 => generated 1293 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:28.462410 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ded56e0d-b3c1-4ad9-8c8a-5bb4074bab44 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:28.463480 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ded56e0d-b3c1-4ad9-8c8a-5bb4074bab44 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:28.486270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ded56e0d-b3c1-4ad9-8c8a-5bb4074bab44 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:28.489145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ded56e0d-b3c1-4ad9-8c8a-5bb4074bab44 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:28.490949 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ded56e0d-b3c1-4ad9-8c8a-5bb4074bab44 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:28.493372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ded56e0d-b3c1-4ad9-8c8a-5bb4074bab44 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:28.874830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-01104339-02de-40b6-bcc7-175a473fd6ef tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:28.898062 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-01104339-02de-40b6-bcc7-175a473fd6ef tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1313 microversion: 2.1 time: 1.061492 Jul 19 22:42:28.908560 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1674/3376] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:27 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1313 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:28.913615 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c9259306-37bb-47a0-a4e0-63fa8c0b2325 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:28.914994 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c9259306-37bb-47a0-a4e0-63fa8c0b2325 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:28.931577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c9259306-37bb-47a0-a4e0-63fa8c0b2325 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:28.932326 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c9259306-37bb-47a0-a4e0-63fa8c0b2325 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:28.933463 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c9259306-37bb-47a0-a4e0-63fa8c0b2325 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:28.934063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c9259306-37bb-47a0-a4e0-63fa8c0b2325 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:29.078762 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ded56e0d-b3c1-4ad9-8c8a-5bb4074bab44 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:29.086845 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ded56e0d-b3c1-4ad9-8c8a-5bb4074bab44 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3" status: 200 len: 1315 microversion: 2.1 time: 0.629060 Jul 19 22:42:29.092451 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1703/3377] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:28 2022] GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3 => generated 1315 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:29.097474 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c2eff5b1-f258-4300-a2aa-db2954bd2dca tempest-VolumesGetTestJSON-1581966607 tempest-VolumesGetTestJSON-1581966607-project] Calling method '.version_select at 0x7f7a10461430>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:29.179276 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c2eff5b1-f258-4300-a2aa-db2954bd2dca tempest-VolumesGetTestJSON-1581966607 tempest-VolumesGetTestJSON-1581966607-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/ae6a7ab1-35b9-44a7-8d7e-e3ed4e9bf25f" status: 200 len: 353 microversion: 2.1 time: 0.085356 Jul 19 22:42:29.185061 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1704/3378] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 19 22:42:29 2022] GET /compute/v2.1/os-volumes/ae6a7ab1-35b9-44a7-8d7e-e3ed4e9bf25f => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:42:29.473680 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-61f6aaaf-1ac3-44c5-bdaa-47a11bcb9ec7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:29.474309 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-61f6aaaf-1ac3-44c5-bdaa-47a11bcb9ec7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:29.491157 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-61f6aaaf-1ac3-44c5-bdaa-47a11bcb9ec7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:29.493831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-61f6aaaf-1ac3-44c5-bdaa-47a11bcb9ec7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:29.496129 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-61f6aaaf-1ac3-44c5-bdaa-47a11bcb9ec7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:29.499714 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-61f6aaaf-1ac3-44c5-bdaa-47a11bcb9ec7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:29.927061 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c9259306-37bb-47a0-a4e0-63fa8c0b2325 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:29.948180 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c9259306-37bb-47a0-a4e0-63fa8c0b2325 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1523 microversion: 2.1 time: 1.038183 Jul 19 22:42:29.953560 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1675/3379] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:28 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1523 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:29.973617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-64d9dd43-5488-4607-a761-55ac87ced27d tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:29.980341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-64d9dd43-5488-4607-a761-55ac87ced27d tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:30.005056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-64d9dd43-5488-4607-a761-55ac87ced27d tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:30.005815 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-64d9dd43-5488-4607-a761-55ac87ced27d tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:30.006801 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-64d9dd43-5488-4607-a761-55ac87ced27d tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:30.007501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-64d9dd43-5488-4607-a761-55ac87ced27d tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:30.609316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-64d9dd43-5488-4607-a761-55ac87ced27d tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:30.625724 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-64d9dd43-5488-4607-a761-55ac87ced27d tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1313 microversion: 2.1 time: 0.668914 Jul 19 22:42:30.626930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-61f6aaaf-1ac3-44c5-bdaa-47a11bcb9ec7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:30.629112 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1676/3380] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:29 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1313 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:30.643495 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-61f6aaaf-1ac3-44c5-bdaa-47a11bcb9ec7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5" status: 200 len: 1293 microversion: 2.1 time: 1.174310 Jul 19 22:42:30.644659 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ac5f0e37-1d3d-47bf-975a-b83b7fae3eb8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:30.647357 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ac5f0e37-1d3d-47bf-975a-b83b7fae3eb8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:30.653641 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1705/3381] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:29 2022] GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 => generated 1293 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:30.659920 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4b46c965-98ed-4f64-b3e4-4ff05606fe10 tempest-VolumesGetTestJSON-1581966607 tempest-VolumesGetTestJSON-1581966607-project] Calling method '.version_select at 0x7f7a10415dc0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:30.667672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac5f0e37-1d3d-47bf-975a-b83b7fae3eb8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:30.669762 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac5f0e37-1d3d-47bf-975a-b83b7fae3eb8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:30.670781 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac5f0e37-1d3d-47bf-975a-b83b7fae3eb8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:30.673843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac5f0e37-1d3d-47bf-975a-b83b7fae3eb8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:30.864305 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4b46c965-98ed-4f64-b3e4-4ff05606fe10 tempest-VolumesGetTestJSON-1581966607 tempest-VolumesGetTestJSON-1581966607-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/ae6a7ab1-35b9-44a7-8d7e-e3ed4e9bf25f" status: 200 len: 353 microversion: 2.1 time: 0.209472 Jul 19 22:42:30.864893 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1706/3382] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 19 22:42:30 2022] GET /compute/v2.1/os-volumes/ae6a7ab1-35b9-44a7-8d7e-e3ed4e9bf25f => generated 353 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:42:31.210808 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-34c8449c-fa4c-4046-a43e-67805b16da54 tempest-AZV2TestJSON-926009423 tempest-AZV2TestJSON-926009423-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:31.212862 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-34c8449c-fa4c-4046-a43e-67805b16da54 tempest-AZV2TestJSON-926009423 tempest-AZV2TestJSON-926009423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:31.213500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-34c8449c-fa4c-4046-a43e-67805b16da54 tempest-AZV2TestJSON-926009423 tempest-AZV2TestJSON-926009423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:31.216087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-34c8449c-fa4c-4046-a43e-67805b16da54 tempest-AZV2TestJSON-926009423 tempest-AZV2TestJSON-926009423-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:31.216791 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-34c8449c-fa4c-4046-a43e-67805b16da54 tempest-AZV2TestJSON-926009423 tempest-AZV2TestJSON-926009423-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:31.287685 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ac5f0e37-1d3d-47bf-975a-b83b7fae3eb8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:31.297188 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ac5f0e37-1d3d-47bf-975a-b83b7fae3eb8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3" status: 200 len: 1315 microversion: 2.1 time: 0.666765 Jul 19 22:42:31.297785 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1677/3383] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:30 2022] GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3 => generated 1315 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:31.325387 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-34c8449c-fa4c-4046-a43e-67805b16da54 tempest-AZV2TestJSON-926009423 tempest-AZV2TestJSON-926009423-project] 10.222.0.25 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.459393 Jul 19 22:42:31.327440 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1707/3384] 10.222.0.25 () {58 vars in 1163 bytes} [Tue Jul 19 22:42:30 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:42:31.329870 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-a926fa99-c3b5-438a-9e5e-c51f4f044942 req-7424bbe1-9512-448f-a77a-8586e9af0116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "507f8fdc-8dd3-4fb8-81d8-43c0782f48a5", "name": "network-vif-plugged", "status": "completed", "tag": "904ca1d5-eed3-4af9-8d7e-809aad699209"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:42:31.342493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4ba79df1-4219-4d7d-a587-d24ccebabdac tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:31.344175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4ba79df1-4219-4d7d-a587-d24ccebabdac tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:31.355636 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a926fa99-c3b5-438a-9e5e-c51f4f044942 req-7424bbe1-9512-448f-a77a-8586e9af0116 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:31.356075 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a926fa99-c3b5-438a-9e5e-c51f4f044942 req-7424bbe1-9512-448f-a77a-8586e9af0116 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:31.359065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ba79df1-4219-4d7d-a587-d24ccebabdac tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:31.360391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ba79df1-4219-4d7d-a587-d24ccebabdac tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:31.361952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ba79df1-4219-4d7d-a587-d24ccebabdac tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:31.364134 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ba79df1-4219-4d7d-a587-d24ccebabdac tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:31.392728 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-a926fa99-c3b5-438a-9e5e-c51f4f044942 req-7424bbe1-9512-448f-a77a-8586e9af0116 service nova] Creating event network-vif-plugged:904ca1d5-eed3-4af9-8d7e-809aad699209 for instance 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 on n-h2-847009-3 Jul 19 22:42:31.405001 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-a926fa99-c3b5-438a-9e5e-c51f4f044942 req-7424bbe1-9512-448f-a77a-8586e9af0116 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100422 Jul 19 22:42:31.409214 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1678/3385] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:42:31.648506 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-997d493c-dfd8-458a-9ebb-c2626d468292 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:31.650413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-997d493c-dfd8-458a-9ebb-c2626d468292 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:31.666044 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-997d493c-dfd8-458a-9ebb-c2626d468292 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:31.668274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-997d493c-dfd8-458a-9ebb-c2626d468292 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:31.669421 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-997d493c-dfd8-458a-9ebb-c2626d468292 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:31.670272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-997d493c-dfd8-458a-9ebb-c2626d468292 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:32.561745 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4ba79df1-4219-4d7d-a587-d24ccebabdac tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:32.578275 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4ba79df1-4219-4d7d-a587-d24ccebabdac tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1523 microversion: 2.1 time: 1.247523 Jul 19 22:42:32.580153 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1708/3386] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:31 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1523 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:32.588075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cb8ec827-20d6-4527-b80c-1cbe45df2f39 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:32.589878 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cb8ec827-20d6-4527-b80c-1cbe45df2f39 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:32.613936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cb8ec827-20d6-4527-b80c-1cbe45df2f39 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:32.615077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cb8ec827-20d6-4527-b80c-1cbe45df2f39 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:32.616617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cb8ec827-20d6-4527-b80c-1cbe45df2f39 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:32.619291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cb8ec827-20d6-4527-b80c-1cbe45df2f39 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:32.868548 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-997d493c-dfd8-458a-9ebb-c2626d468292 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:32.878544 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-997d493c-dfd8-458a-9ebb-c2626d468292 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1313 microversion: 2.1 time: 1.237243 Jul 19 22:42:32.883778 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1679/3387] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:31 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1313 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:42:32.909923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2d4b383e-c14f-4c39-ae2d-be633745116c tempest-VolumesGetTestJSON-1581966607 tempest-VolumesGetTestJSON-1581966607-project] Calling method '.version_select at 0x7f7a03f5cc10>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:33.015929 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-2d4b383e-c14f-4c39-ae2d-be633745116c tempest-VolumesGetTestJSON-1581966607 tempest-VolumesGetTestJSON-1581966607-project] HTTP exception thrown: Volume ae6a7ab1-35b9-44a7-8d7e-e3ed4e9bf25f could not be found. Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2d4b383e-c14f-4c39-ae2d-be633745116c tempest-VolumesGetTestJSON-1581966607 tempest-VolumesGetTestJSON-1581966607-project] Request method failure captured: Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/os-volumes/ae6a7ab1-35b9-44a7-8d7e-e3ed4e9bf25f HTTP/1.1 Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zNLvEo4H2LRkfnhD4uzI01aqITQibHx4HwHKsK0JempmcWqIROZ5f7mmfnkYmUmn8q7D-s3DK-F_j--WK7XtAIopqdmif2GKYrewTx-iJf08OcX_kCOi4aqneSOiMPZKDPDB-vF_JwAvbcisVbrpkpSRfglh9-7TM62UtQ3JIzmOu0 Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: fad5e0b861374822a2f2c54dbcf6a919 Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-VolumesGetTestJSON-1581966607 Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fad5e0b861374822a2f2c54dbcf6a919"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad5e0b861374822a2f2c54dbcf6a919"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fad5e0b861374822a2f2c54dbcf6a919"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad5e0b861374822a2f2c54dbcf6a919"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-VolumesGetTestJSON-1581966607 Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: fad5e0b861374822a2f2c54dbcf6a919 Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-VolumesGetTestJSON-1581966607 Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-VolumesGetTestJSON-1581966607-project Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: f94bd80998914d0d9f591a3ef2637a29 Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-VolumesGetTestJSON-1581966607-project Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: exception: Volume ae6a7ab1-35b9-44a7-8d7e-e3ed4e9bf25f could not be found. Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'ae6a7ab1-35b9-44a7-8d7e-e3ed4e9bf25f'} Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ae6a7ab1-35b9-44a7-8d7e-e3ed4e9bf25f could not be found. (HTTP 404) (Request-ID: req-9c30980f-cc27-41bd-a1fb-4e2f077f6d55) Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 22:42:33.031586 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ae6a7ab1-35b9-44a7-8d7e-e3ed4e9bf25f could not be found. Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ae6a7ab1-35b9-44a7-8d7e-e3ed4e9bf25f could not be found. Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ae6a7ab1-35b9-44a7-8d7e-e3ed4e9bf25f could not be found. Jul 19 22:42:33.036720 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:42:33.048751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2d4b383e-c14f-4c39-ae2d-be633745116c tempest-VolumesGetTestJSON-1581966607 tempest-VolumesGetTestJSON-1581966607-project] Returning 404 to user: Volume ae6a7ab1-35b9-44a7-8d7e-e3ed4e9bf25f could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:42:33.049600 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2d4b383e-c14f-4c39-ae2d-be633745116c tempest-VolumesGetTestJSON-1581966607 tempest-VolumesGetTestJSON-1581966607-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/ae6a7ab1-35b9-44a7-8d7e-e3ed4e9bf25f" status: 404 len: 109 microversion: 2.1 time: 0.164045 Jul 19 22:42:33.050348 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1680/3388] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 19 22:42:32 2022] GET /compute/v2.1/os-volumes/ae6a7ab1-35b9-44a7-8d7e-e3ed4e9bf25f => generated 109 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:42:33.095688 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e75fe2ed-bb3d-4d54-8c74-a228e538c23c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:33.097597 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e75fe2ed-bb3d-4d54-8c74-a228e538c23c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:33.120420 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e75fe2ed-bb3d-4d54-8c74-a228e538c23c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:33.121639 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e75fe2ed-bb3d-4d54-8c74-a228e538c23c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:33.124279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e75fe2ed-bb3d-4d54-8c74-a228e538c23c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:33.127469 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e75fe2ed-bb3d-4d54-8c74-a228e538c23c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:34.098128 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cb8ec827-20d6-4527-b80c-1cbe45df2f39 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:34.114197 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cb8ec827-20d6-4527-b80c-1cbe45df2f39 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5" status: 200 len: 1293 microversion: 2.1 time: 1.528783 Jul 19 22:42:34.114847 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1709/3389] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:32 2022] GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 => generated 1293 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:34.133277 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-6b5a745d-4616-4cd8-baed-bfb722cec7e0 req-dbd96e31-de44-4512-a7f1-5566e4f6b8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "087dbc3c-3e5c-4c33-87fc-978e640ae6e3", "name": "network-vif-plugged", "status": "completed", "tag": "47dba747-0185-4742-98ce-83e9e59ded78"}, {"server_uuid": "50b53156-37b4-433b-8f13-9b788febd9e1", "name": "network-vif-plugged", "status": "completed", "tag": "179985b7-ff28-4d68-bdef-077f6dd3d089"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:42:34.163538 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-6b5a745d-4616-4cd8-baed-bfb722cec7e0 req-dbd96e31-de44-4512-a7f1-5566e4f6b8c9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:34.167804 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-6b5a745d-4616-4cd8-baed-bfb722cec7e0 req-dbd96e31-de44-4512-a7f1-5566e4f6b8c9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:34.225985 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-6b5a745d-4616-4cd8-baed-bfb722cec7e0 req-dbd96e31-de44-4512-a7f1-5566e4f6b8c9 service nova] Creating event network-vif-plugged:47dba747-0185-4742-98ce-83e9e59ded78 for instance 087dbc3c-3e5c-4c33-87fc-978e640ae6e3 on n-h1-847009-3 Jul 19 22:42:34.230202 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-6b5a745d-4616-4cd8-baed-bfb722cec7e0 req-dbd96e31-de44-4512-a7f1-5566e4f6b8c9 service nova] Creating event network-vif-plugged:179985b7-ff28-4d68-bdef-077f6dd3d089 for instance 50b53156-37b4-433b-8f13-9b788febd9e1 on n-h2-847009-3 Jul 19 22:42:34.268014 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-6b5a745d-4616-4cd8-baed-bfb722cec7e0 req-dbd96e31-de44-4512-a7f1-5566e4f6b8c9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.148783 Jul 19 22:42:34.271501 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1710/3390] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:42:34.287950 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-59dd814f-1d0f-4831-92b4-f15072cc0933 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:34.292107 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-59dd814f-1d0f-4831-92b4-f15072cc0933 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:34.311539 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-59dd814f-1d0f-4831-92b4-f15072cc0933 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:34.312855 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-59dd814f-1d0f-4831-92b4-f15072cc0933 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:34.318117 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-59dd814f-1d0f-4831-92b4-f15072cc0933 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:34.319715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-59dd814f-1d0f-4831-92b4-f15072cc0933 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:34.612272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e75fe2ed-bb3d-4d54-8c74-a228e538c23c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:34.626913 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e75fe2ed-bb3d-4d54-8c74-a228e538c23c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3" status: 200 len: 1315 microversion: 2.1 time: 1.574561 Jul 19 22:42:34.628302 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1681/3391] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:33 2022] GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3 => generated 1315 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:34.640681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d8775878-532d-4fdb-990a-0de17d3fb969 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:34.641693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d8775878-532d-4fdb-990a-0de17d3fb969 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:34.658210 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d8775878-532d-4fdb-990a-0de17d3fb969 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:34.659066 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d8775878-532d-4fdb-990a-0de17d3fb969 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:34.660156 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d8775878-532d-4fdb-990a-0de17d3fb969 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:34.660827 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d8775878-532d-4fdb-990a-0de17d3fb969 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:35.426161 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-59dd814f-1d0f-4831-92b4-f15072cc0933 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:35.450594 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-59dd814f-1d0f-4831-92b4-f15072cc0933 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1523 microversion: 2.1 time: 1.175145 Jul 19 22:42:35.453173 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1711/3392] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:34 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1523 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:35.487028 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d8775878-532d-4fdb-990a-0de17d3fb969 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:35.487596 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-46f303be-0ec8-455d-8489-b9c28d00609e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:35.489662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-46f303be-0ec8-455d-8489-b9c28d00609e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:35.501576 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d8775878-532d-4fdb-990a-0de17d3fb969 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1313 microversion: 2.1 time: 0.871858 Jul 19 22:42:35.502582 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1682/3393] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:34 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1313 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:35.511065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-46f303be-0ec8-455d-8489-b9c28d00609e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:35.512239 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-46f303be-0ec8-455d-8489-b9c28d00609e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:35.515590 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-46f303be-0ec8-455d-8489-b9c28d00609e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:35.518497 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-46f303be-0ec8-455d-8489-b9c28d00609e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:35.653814 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5491dd7e-9cee-4b09-94e4-bd04e88c1534 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:35.654452 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5491dd7e-9cee-4b09-94e4-bd04e88c1534 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:35.662878 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5491dd7e-9cee-4b09-94e4-bd04e88c1534 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:35.663272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5491dd7e-9cee-4b09-94e4-bd04e88c1534 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:35.666993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5491dd7e-9cee-4b09-94e4-bd04e88c1534 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:35.667477 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5491dd7e-9cee-4b09-94e4-bd04e88c1534 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:36.367333 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-46f303be-0ec8-455d-8489-b9c28d00609e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:36.384318 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-46f303be-0ec8-455d-8489-b9c28d00609e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5" status: 200 len: 1473 microversion: 2.1 time: 0.918653 Jul 19 22:42:36.388235 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1712/3394] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:35 2022] GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 => generated 1473 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:36.429132 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5491dd7e-9cee-4b09-94e4-bd04e88c1534 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:36.446919 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5491dd7e-9cee-4b09-94e4-bd04e88c1534 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3" status: 200 len: 1315 microversion: 2.1 time: 0.792880 Jul 19 22:42:36.458798 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1683/3395] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:35 2022] GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3 => generated 1315 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:36.480878 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f5bfa1b7-ec5a-4004-ab3e-f23017a0e94b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:36.485737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f5bfa1b7-ec5a-4004-ab3e-f23017a0e94b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:36.520696 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-67fa957b-487d-45fb-a0c4-b78d856c6b14 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:36.521312 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-67fa957b-487d-45fb-a0c4-b78d856c6b14 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:36.531721 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f5bfa1b7-ec5a-4004-ab3e-f23017a0e94b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:36.536104 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f5bfa1b7-ec5a-4004-ab3e-f23017a0e94b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:36.537035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f5bfa1b7-ec5a-4004-ab3e-f23017a0e94b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:36.537491 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f5bfa1b7-ec5a-4004-ab3e-f23017a0e94b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:36.538911 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67fa957b-487d-45fb-a0c4-b78d856c6b14 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:36.540361 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67fa957b-487d-45fb-a0c4-b78d856c6b14 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:36.541217 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67fa957b-487d-45fb-a0c4-b78d856c6b14 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:36.541674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67fa957b-487d-45fb-a0c4-b78d856c6b14 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:37.107596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-67fa957b-487d-45fb-a0c4-b78d856c6b14 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:37.113312 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f5bfa1b7-ec5a-4004-ab3e-f23017a0e94b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:37.122331 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f5bfa1b7-ec5a-4004-ab3e-f23017a0e94b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1523 microversion: 2.1 time: 0.650663 Jul 19 22:42:37.122896 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-67fa957b-487d-45fb-a0c4-b78d856c6b14 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1313 microversion: 2.1 time: 0.605703 Jul 19 22:42:37.125425 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1713/3396] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:36 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1523 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:37.134195 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1684/3397] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:36 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1313 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:37.150851 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7a495f4d-6517-418e-8665-6d4cef245561 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1833746281", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:42:37.465318 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-90368fc5-a7a9-427f-aad8-99a29367d892 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:37.475419 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-90368fc5-a7a9-427f-aad8-99a29367d892 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:37.489053 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-90368fc5-a7a9-427f-aad8-99a29367d892 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:37.495126 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-90368fc5-a7a9-427f-aad8-99a29367d892 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:37.499878 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-90368fc5-a7a9-427f-aad8-99a29367d892 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:37.500614 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-90368fc5-a7a9-427f-aad8-99a29367d892 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:38.900005 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-90368fc5-a7a9-427f-aad8-99a29367d892 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:38.910337 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-90368fc5-a7a9-427f-aad8-99a29367d892 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3" status: 200 len: 1502 microversion: 2.1 time: 1.449616 Jul 19 22:42:38.923038 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1685/3398] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:37 2022] GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3 => generated 1502 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:38.923038 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0f37cf64-5be9-407c-be5c-7b08bc1f2c1e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:38.923038 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0f37cf64-5be9-407c-be5c-7b08bc1f2c1e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:38.948325 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:42:38.953401 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0f37cf64-5be9-407c-be5c-7b08bc1f2c1e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:38.954852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0f37cf64-5be9-407c-be5c-7b08bc1f2c1e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:38.956451 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0f37cf64-5be9-407c-be5c-7b08bc1f2c1e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:38.967051 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0f37cf64-5be9-407c-be5c-7b08bc1f2c1e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:39.318096 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0f37cf64-5be9-407c-be5c-7b08bc1f2c1e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:39.338025 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0f37cf64-5be9-407c-be5c-7b08bc1f2c1e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1523 microversion: 2.1 time: 0.416937 Jul 19 22:42:39.341800 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1686/3399] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:38 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1523 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:39.365097 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b8811330-abbd-4f08-8b15-b8b59968f935 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:39.369629 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b8811330-abbd-4f08-8b15-b8b59968f935 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:39.386052 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8811330-abbd-4f08-8b15-b8b59968f935 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:39.388447 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8811330-abbd-4f08-8b15-b8b59968f935 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:39.391935 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8811330-abbd-4f08-8b15-b8b59968f935 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:39.393907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8811330-abbd-4f08-8b15-b8b59968f935 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:39.880538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b8811330-abbd-4f08-8b15-b8b59968f935 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:39.889982 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b8811330-abbd-4f08-8b15-b8b59968f935 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1500 microversion: 2.1 time: 0.546387 Jul 19 22:42:39.902623 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1687/3400] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:39 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1500 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:39.910854 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-69261d78-9efa-4555-ab36-900aeccbcd32 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:42:39.912445 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-69261d78-9efa-4555-ab36-900aeccbcd32 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:39.920821 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69261d78-9efa-4555-ab36-900aeccbcd32 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:39.921590 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69261d78-9efa-4555-ab36-900aeccbcd32 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:39.922866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69261d78-9efa-4555-ab36-900aeccbcd32 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:39.923658 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69261d78-9efa-4555-ab36-900aeccbcd32 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:39.986123 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-69261d78-9efa-4555-ab36-900aeccbcd32 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3/action" status: 200 len: 14 microversion: 2.1 time: 0.081065 Jul 19 22:42:39.987471 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1688/3401] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:42:39 2022] POST /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:42:40.010508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-45587f76-8617-4ac8-9197-0b1e6d0226b5 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:42:40.014281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-45587f76-8617-4ac8-9197-0b1e6d0226b5 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:40.026558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45587f76-8617-4ac8-9197-0b1e6d0226b5 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:40.027355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45587f76-8617-4ac8-9197-0b1e6d0226b5 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:40.028387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45587f76-8617-4ac8-9197-0b1e6d0226b5 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:40.035785 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45587f76-8617-4ac8-9197-0b1e6d0226b5 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:40.078244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:42:40.089433 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-45587f76-8617-4ac8-9197-0b1e6d0226b5 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lazy-loading 'flavor' on Instance uuid 50b53156-37b4-433b-8f13-9b788febd9e1 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:42:40.380403 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-45587f76-8617-4ac8-9197-0b1e6d0226b5 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "POST /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1/action" status: 200 len: 32 microversion: 2.1 time: 0.388943 Jul 19 22:42:40.383486 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1689/3402] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:42:39 2022] POST /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1/action => generated 32 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:42:40.396026 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6f6a6a37-7e84-43bf-828c-dc9cbe77b7f6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:40.397299 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6f6a6a37-7e84-43bf-828c-dc9cbe77b7f6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:40.417656 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6f6a6a37-7e84-43bf-828c-dc9cbe77b7f6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:40.418544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6f6a6a37-7e84-43bf-828c-dc9cbe77b7f6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:40.422067 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6f6a6a37-7e84-43bf-828c-dc9cbe77b7f6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:40.422801 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6f6a6a37-7e84-43bf-828c-dc9cbe77b7f6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:40.816941 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-7a495f4d-6517-418e-8665-6d4cef245561 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] validate_networks() for [('6119d69d-194a-407a-a78f-64890b6702ed', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:42:41.093518 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6f6a6a37-7e84-43bf-828c-dc9cbe77b7f6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:41.102060 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6f6a6a37-7e84-43bf-828c-dc9cbe77b7f6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1523 microversion: 2.1 time: 0.715552 Jul 19 22:42:41.123472 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1690/3403] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:40 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1523 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:41.128670 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e75007f9-da82-46b6-a671-1dd4bece4fcd tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:41.130492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e75007f9-da82-46b6-a671-1dd4bece4fcd tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:41.166696 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e75007f9-da82-46b6-a671-1dd4bece4fcd tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:41.167393 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e75007f9-da82-46b6-a671-1dd4bece4fcd tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:41.168050 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e75007f9-da82-46b6-a671-1dd4bece4fcd tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:41.168492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e75007f9-da82-46b6-a671-1dd4bece4fcd tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:41.243562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:42:42.788840 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e75007f9-da82-46b6-a671-1dd4bece4fcd tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:42.801952 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e75007f9-da82-46b6-a671-1dd4bece4fcd tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1506 microversion: 2.1 time: 1.677302 Jul 19 22:42:42.805965 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1691/3404] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:41 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1506 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:42.822598 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cb902f52-cf2b-4cda-9d94-70388b2f0a8b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:42:42.825806 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cb902f52-cf2b-4cda-9d94-70388b2f0a8b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:42.848093 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cb902f52-cf2b-4cda-9d94-70388b2f0a8b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:42.852147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cb902f52-cf2b-4cda-9d94-70388b2f0a8b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:42.856503 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cb902f52-cf2b-4cda-9d94-70388b2f0a8b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:42.857221 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cb902f52-cf2b-4cda-9d94-70388b2f0a8b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:42.974098 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cb902f52-cf2b-4cda-9d94-70388b2f0a8b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3/action" status: 200 len: 14 microversion: 2.1 time: 0.164866 Jul 19 22:42:42.978569 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1692/3405] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:42:42 2022] POST /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:42:42.990908 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-87804ffa-5ee3-4238-9f9c-1af3300445f5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:42.994343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-87804ffa-5ee3-4238-9f9c-1af3300445f5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:43.008749 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-87804ffa-5ee3-4238-9f9c-1af3300445f5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:43.010586 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-87804ffa-5ee3-4238-9f9c-1af3300445f5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:43.016587 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-87804ffa-5ee3-4238-9f9c-1af3300445f5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:43.017486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-87804ffa-5ee3-4238-9f9c-1af3300445f5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:43.533763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-7a495f4d-6517-418e-8665-6d4cef245561 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:42:43.535475 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-7a495f4d-6517-418e-8665-6d4cef245561 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:42:43.537879 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-7a495f4d-6517-418e-8665-6d4cef245561 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:42:43.539185 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-7a495f4d-6517-418e-8665-6d4cef245561 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:42:43.541580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-7a495f4d-6517-418e-8665-6d4cef245561 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:42:43.544266 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-87804ffa-5ee3-4238-9f9c-1af3300445f5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:43.549709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=50 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:42:43.565361 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-87804ffa-5ee3-4238-9f9c-1af3300445f5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1505 microversion: 2.1 time: 0.586913 Jul 19 22:42:43.565948 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1693/3406] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:42 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1505 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:43.598086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a495f4d-6517-418e-8665-6d4cef245561 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:43.598752 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a495f4d-6517-418e-8665-6d4cef245561 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:43.602356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a495f4d-6517-418e-8665-6d4cef245561 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:43.603665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a495f4d-6517-418e-8665-6d4cef245561 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:43.653462 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-7a495f4d-6517-418e-8665-6d4cef245561 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Getting quotas for project 9bd4d0caf2f347218af6ffd52f250c59. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:42:43.682710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-7a495f4d-6517-418e-8665-6d4cef245561 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Getting quotas for user 1db06ac41e9f4fe290e535f703af484d and project 9bd4d0caf2f347218af6ffd52f250c59. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:42:43.732644 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7a495f4d-6517-418e-8665-6d4cef245561 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:42:43.737018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7a495f4d-6517-418e-8665-6d4cef245561 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 9ef498d1-49a5-4b22-8c82-7de25860efcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:42:43.827042 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f919e539-cd5c-4a22-b50f-43cff5b62154 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:43.827687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f919e539-cd5c-4a22-b50f-43cff5b62154 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:43.844189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f919e539-cd5c-4a22-b50f-43cff5b62154 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:43.846805 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7a495f4d-6517-418e-8665-6d4cef245561 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.719998 Jul 19 22:42:43.848585 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1714/3407] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:42:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 6722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:42:43.857034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f919e539-cd5c-4a22-b50f-43cff5b62154 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:43.858213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f919e539-cd5c-4a22-b50f-43cff5b62154 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:43.861662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-22c1f5a7-a480-4fa4-82a4-19e93b039e95 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:43.863395 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f919e539-cd5c-4a22-b50f-43cff5b62154 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:43.869835 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-22c1f5a7-a480-4fa4-82a4-19e93b039e95 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 9ef498d1-49a5-4b22-8c82-7de25860efcf] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:43.910128 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-22c1f5a7-a480-4fa4-82a4-19e93b039e95 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 9ef498d1-49a5-4b22-8c82-7de25860efcf] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:42:44.066443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f919e539-cd5c-4a22-b50f-43cff5b62154 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:44.077734 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f919e539-cd5c-4a22-b50f-43cff5b62154 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1506 microversion: 2.1 time: 0.260058 Jul 19 22:42:44.080241 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1694/3408] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:43 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1506 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:42:44.091355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-65e6e5d3-6978-4b65-b155-7a8f58797022 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:42:44.093014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-65e6e5d3-6978-4b65-b155-7a8f58797022 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:44.112710 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65e6e5d3-6978-4b65-b155-7a8f58797022 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:44.113939 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65e6e5d3-6978-4b65-b155-7a8f58797022 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:44.115873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65e6e5d3-6978-4b65-b155-7a8f58797022 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:44.118347 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65e6e5d3-6978-4b65-b155-7a8f58797022 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:44.388953 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-22c1f5a7-a480-4fa4-82a4-19e93b039e95 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9ef498d1-49a5-4b22-8c82-7de25860efcf" status: 204 len: 0 microversion: 2.1 time: 0.532022 Jul 19 22:42:44.390210 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1715/3409] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:42:43 2022] DELETE /compute/v2.1/servers/9ef498d1-49a5-4b22-8c82-7de25860efcf => generated 0 bytes in 535 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:42:44.401758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-193aabe9-5948-4ba9-8033-abbdd33e35e7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:44.403389 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-193aabe9-5948-4ba9-8033-abbdd33e35e7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 9ef498d1-49a5-4b22-8c82-7de25860efcf] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:44.425150 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-193aabe9-5948-4ba9-8033-abbdd33e35e7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] HTTP exception thrown: Instance 9ef498d1-49a5-4b22-8c82-7de25860efcf could not be found. Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-193aabe9-5948-4ba9-8033-abbdd33e35e7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Request method failure captured: Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/9ef498d1-49a5-4b22-8c82-7de25860efcf HTTP/1.1 Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zM1CVhkGzrLI27yplqtJpQo-i3-EKMGfRab3BLA-iVFSYzTm_PO2UXoSlqkSOVVu2ip8fmaaUlGTzOcY-1-PKTjTHCVYzWriYi14tgLboJXa9RPch13wobugtzkYLm5uZx9koMts7tA37UlK9MH24L7zFq17JufqAVvZobtx47aYg4 Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersTestJSON-1648920919 Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersTestJSON-1648920919-project Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1db06ac41e9f4fe290e535f703af484d Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersTestJSON-1648920919-project Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 9ef498d1-49a5-4b22-8c82-7de25860efcf could not be found. Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '9ef498d1-49a5-4b22-8c82-7de25860efcf'} Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2877, in _get_instance Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 9ef498d1-49a5-4b22-8c82-7de25860efcf Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2889, in _get_instance Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ef498d1-49a5-4b22-8c82-7de25860efcf could not be found. Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:42:44.435606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:42:44.440558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:42:44.440558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:42:44.440558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:42:44.440558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:42:44.440558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:42:44.440558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:42:44.440558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:42:44.440558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:42:44.440558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:42:44.440558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:42:44.440558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ef498d1-49a5-4b22-8c82-7de25860efcf could not be found. Jul 19 22:42:44.440558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:42:44.440558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:42:44.440558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:42:44.440558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:42:44.440558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:42:44.440558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:42:44.440558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:42:44.440558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:42:44.440558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ef498d1-49a5-4b22-8c82-7de25860efcf could not be found. Jul 19 22:42:44.440558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:42:44.444830 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-193aabe9-5948-4ba9-8033-abbdd33e35e7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Returning 404 to user: Instance 9ef498d1-49a5-4b22-8c82-7de25860efcf could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:42:44.449447 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-193aabe9-5948-4ba9-8033-abbdd33e35e7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/9ef498d1-49a5-4b22-8c82-7de25860efcf" status: 404 len: 111 microversion: 2.1 time: 0.052263 Jul 19 22:42:44.462375 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1716/3410] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:44 2022] GET /compute/v2.1/servers/9ef498d1-49a5-4b22-8c82-7de25860efcf => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:42:44.595693 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-947d2670-4583-485c-9623-ee721240afe5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:44.598217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-947d2670-4583-485c-9623-ee721240afe5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:44.615334 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-947d2670-4583-485c-9623-ee721240afe5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:44.620208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-947d2670-4583-485c-9623-ee721240afe5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:44.622202 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-947d2670-4583-485c-9623-ee721240afe5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:44.626786 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-947d2670-4583-485c-9623-ee721240afe5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:44.955183 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-947d2670-4583-485c-9623-ee721240afe5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:44.983017 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-947d2670-4583-485c-9623-ee721240afe5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1505 microversion: 2.1 time: 0.385189 Jul 19 22:42:44.987094 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1717/3411] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:44 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1505 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:44.994712 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d5646c39-8c2f-4745-ac79-4bfcaace4d14 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1096606096", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "6119d69d-194a-407a-a78f-64890b6702ed"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:42:45.083980 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-d5646c39-8c2f-4745-ac79-4bfcaace4d14 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] validate_networks() for [('6119d69d-194a-407a-a78f-64890b6702ed', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:42:45.222296 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-65e6e5d3-6978-4b65-b155-7a8f58797022 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3/action" status: 200 len: 14 microversion: 2.1 time: 1.140240 Jul 19 22:42:45.227047 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1695/3412] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:42:44 2022] POST /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3/action => generated 14 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:42:45.256427 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a36756d3-2f02-436e-a9d2-1a1ff2075c73 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:45.264117 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a36756d3-2f02-436e-a9d2-1a1ff2075c73 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:45.292667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a36756d3-2f02-436e-a9d2-1a1ff2075c73 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:45.293450 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a36756d3-2f02-436e-a9d2-1a1ff2075c73 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:45.296345 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a36756d3-2f02-436e-a9d2-1a1ff2075c73 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:45.298155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a36756d3-2f02-436e-a9d2-1a1ff2075c73 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:45.869241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a36756d3-2f02-436e-a9d2-1a1ff2075c73 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:45.896471 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a36756d3-2f02-436e-a9d2-1a1ff2075c73 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1506 microversion: 2.1 time: 0.669801 Jul 19 22:42:45.906179 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1696/3413] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:45 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1506 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:45.912946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-7b30b016-5f1a-47af-895d-0557c589e70c req-d598a2e4-f2f5-485d-a6b9-8e9e27735763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7727fc2-2016-482d-aff6-0940874c3b28", "name": "network-vif-unplugged", "status": "completed", "tag": "e9e1128e-eb72-4508-89fa-0c1047cf6872"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:42:45.923851 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-7b30b016-5f1a-47af-895d-0557c589e70c req-d598a2e4-f2f5-485d-a6b9-8e9e27735763 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:45.924712 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-7b30b016-5f1a-47af-895d-0557c589e70c req-d598a2e4-f2f5-485d-a6b9-8e9e27735763 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:45.941230 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-7b30b016-5f1a-47af-895d-0557c589e70c req-d598a2e4-f2f5-485d-a6b9-8e9e27735763 service nova] Creating event network-vif-unplugged:e9e1128e-eb72-4508-89fa-0c1047cf6872 for instance d7727fc2-2016-482d-aff6-0940874c3b28 on n-h1-847009-3 Jul 19 22:42:45.948239 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-7b30b016-5f1a-47af-895d-0557c589e70c req-d598a2e4-f2f5-485d-a6b9-8e9e27735763 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040321 Jul 19 22:42:45.949533 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1697/3414] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:42:46.006519 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-026aa3a9-f022-4b81-b808-e113f02355bf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:46.008277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-026aa3a9-f022-4b81-b808-e113f02355bf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:46.020135 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-026aa3a9-f022-4b81-b808-e113f02355bf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:46.021783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-026aa3a9-f022-4b81-b808-e113f02355bf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:46.024070 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-026aa3a9-f022-4b81-b808-e113f02355bf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:46.029485 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-026aa3a9-f022-4b81-b808-e113f02355bf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:46.077242 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-d5646c39-8c2f-4745-ac79-4bfcaace4d14 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:42:46.077761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-d5646c39-8c2f-4745-ac79-4bfcaace4d14 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:42:46.078139 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-d5646c39-8c2f-4745-ac79-4bfcaace4d14 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:42:46.078553 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-d5646c39-8c2f-4745-ac79-4bfcaace4d14 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:42:46.078975 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-d5646c39-8c2f-4745-ac79-4bfcaace4d14 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:42:46.104676 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5646c39-8c2f-4745-ac79-4bfcaace4d14 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:46.105453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5646c39-8c2f-4745-ac79-4bfcaace4d14 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:46.107338 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5646c39-8c2f-4745-ac79-4bfcaace4d14 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:46.108943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5646c39-8c2f-4745-ac79-4bfcaace4d14 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:46.157752 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-d5646c39-8c2f-4745-ac79-4bfcaace4d14 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Getting quotas for project 9bd4d0caf2f347218af6ffd52f250c59. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:42:46.173654 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-d5646c39-8c2f-4745-ac79-4bfcaace4d14 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Getting quotas for user 1db06ac41e9f4fe290e535f703af484d and project 9bd4d0caf2f347218af6ffd52f250c59. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:42:46.205529 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d5646c39-8c2f-4745-ac79-4bfcaace4d14 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:42:46.216868 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d5646c39-8c2f-4745-ac79-4bfcaace4d14 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: d8568c5f-c480-48e5-85b2-7bae9f2ed0ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:42:46.271022 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-026aa3a9-f022-4b81-b808-e113f02355bf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:46.287306 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-026aa3a9-f022-4b81-b808-e113f02355bf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 200 len: 1508 microversion: 2.1 time: 0.287681 Jul 19 22:42:46.289196 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1698/3415] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:45 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 1508 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:42:46.297167 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-697be756-c1ad-4cdc-8a10-e8b0c35c7403 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:42:46.299454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-697be756-c1ad-4cdc-8a10-e8b0c35c7403 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:46.316601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-697be756-c1ad-4cdc-8a10-e8b0c35c7403 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:46.317073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-697be756-c1ad-4cdc-8a10-e8b0c35c7403 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:46.318956 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-697be756-c1ad-4cdc-8a10-e8b0c35c7403 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:46.319444 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-697be756-c1ad-4cdc-8a10-e8b0c35c7403 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:46.328982 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d5646c39-8c2f-4745-ac79-4bfcaace4d14 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.340723 Jul 19 22:42:46.329943 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1718/3416] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:42:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:42:46.340617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c09838c4-67dd-44b7-b252-1ec4b52a1e87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:46.341387 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c09838c4-67dd-44b7-b252-1ec4b52a1e87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:46.349073 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c09838c4-67dd-44b7-b252-1ec4b52a1e87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:46.349805 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c09838c4-67dd-44b7-b252-1ec4b52a1e87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:46.350953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c09838c4-67dd-44b7-b252-1ec4b52a1e87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:46.351675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c09838c4-67dd-44b7-b252-1ec4b52a1e87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:46.399909 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c09838c4-67dd-44b7-b252-1ec4b52a1e87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:42:46.408258 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.compute.api [None req-c09838c4-67dd-44b7-b252-1ec4b52a1e87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Working on deleting snapshot 471c3a6a-07cb-4009-971b-2d385a56d2f9 from shelved instance... Jul 19 22:42:46.422202 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-697be756-c1ad-4cdc-8a10-e8b0c35c7403 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3/action" status: 200 len: 14 microversion: 2.1 time: 0.129890 Jul 19 22:42:46.425855 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1699/3417] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:42:46 2022] POST /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:42:46.435246 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8df55eaf-b572-4a07-b872-bd21e494c703 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:46.445742 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8df55eaf-b572-4a07-b872-bd21e494c703 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: d8568c5f-c480-48e5-85b2-7bae9f2ed0ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:46.524490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8df55eaf-b572-4a07-b872-bd21e494c703 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:46.533860 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8df55eaf-b572-4a07-b872-bd21e494c703 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab" status: 200 len: 1221 microversion: 2.1 time: 0.108565 Jul 19 22:42:46.534757 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1700/3418] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:46 2022] GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab => generated 1221 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:46.917541 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-00e6b742-135a-440e-8e53-417a9ee8f90f tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:46.918320 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-00e6b742-135a-440e-8e53-417a9ee8f90f tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:46.946852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-00e6b742-135a-440e-8e53-417a9ee8f90f tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:46.947400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-00e6b742-135a-440e-8e53-417a9ee8f90f tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:46.953800 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-00e6b742-135a-440e-8e53-417a9ee8f90f tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:46.954318 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-00e6b742-135a-440e-8e53-417a9ee8f90f tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:47.181307 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-00e6b742-135a-440e-8e53-417a9ee8f90f tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:47.190956 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-00e6b742-135a-440e-8e53-417a9ee8f90f tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1506 microversion: 2.1 time: 0.281889 Jul 19 22:42:47.191952 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1701/3419] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:46 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1506 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:42:47.435566 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-15c4d518-3117-4271-9865-d443c8b95a8c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:42:47.437156 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-15c4d518-3117-4271-9865-d443c8b95a8c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:47.456363 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-15c4d518-3117-4271-9865-d443c8b95a8c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:47.456684 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-15c4d518-3117-4271-9865-d443c8b95a8c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:47.459428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-15c4d518-3117-4271-9865-d443c8b95a8c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:47.471603 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-15c4d518-3117-4271-9865-d443c8b95a8c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:47.606702 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-15c4d518-3117-4271-9865-d443c8b95a8c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3/action" status: 200 len: 14 microversion: 2.1 time: 0.177181 Jul 19 22:42:47.625624 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1702/3420] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:42:47 2022] POST /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3/action => generated 14 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:42:47.648867 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e8c912a2-94dc-4c4e-95b1-5d4085a36492 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:47.649853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e8c912a2-94dc-4c4e-95b1-5d4085a36492 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: d8568c5f-c480-48e5-85b2-7bae9f2ed0ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:47.693126 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e8c912a2-94dc-4c4e-95b1-5d4085a36492 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:47.693588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e8c912a2-94dc-4c4e-95b1-5d4085a36492 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:47.694387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e8c912a2-94dc-4c4e-95b1-5d4085a36492 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:47.694841 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e8c912a2-94dc-4c4e-95b1-5d4085a36492 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:47.944676 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c09838c4-67dd-44b7-b252-1ec4b52a1e87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Doing local delete in cell c9ec50c5-1e53-4d76-a6eb-599548551fc7(cell1) {{(pid=119338) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 19 22:42:47.945735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c09838c4-67dd-44b7-b252-1ec4b52a1e87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:47.950115 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c09838c4-67dd-44b7-b252-1ec4b52a1e87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:47.951127 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.compute.api [None req-c09838c4-67dd-44b7-b252-1ec4b52a1e87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 19 22:42:47.956600 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-c09838c4-67dd-44b7-b252-1ec4b52a1e87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] deallocate_for_instance() {{(pid=119338) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 19 22:42:48.147147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e8c912a2-94dc-4c4e-95b1-5d4085a36492 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:48.201576 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e8c912a2-94dc-4c4e-95b1-5d4085a36492 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab" status: 200 len: 1273 microversion: 2.1 time: 0.572374 Jul 19 22:42:48.205620 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1703/3421] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:47 2022] GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab => generated 1273 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:48.221842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6b020a6b-405e-4910-a1ac-70f5693c6761 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:48.222716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6b020a6b-405e-4910-a1ac-70f5693c6761 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:48.238735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b020a6b-405e-4910-a1ac-70f5693c6761 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:48.241209 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b020a6b-405e-4910-a1ac-70f5693c6761 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:48.245014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b020a6b-405e-4910-a1ac-70f5693c6761 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:48.246489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b020a6b-405e-4910-a1ac-70f5693c6761 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:49.545703 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6b020a6b-405e-4910-a1ac-70f5693c6761 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:49.562041 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6b020a6b-405e-4910-a1ac-70f5693c6761 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1506 microversion: 2.1 time: 1.355026 Jul 19 22:42:49.580180 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1704/3422] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:48 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1506 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:49.605234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ac2b169a-2450-4c88-8ea0-b47713e0edfa tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:42:49.609557 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ac2b169a-2450-4c88-8ea0-b47713e0edfa tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:49.626667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac2b169a-2450-4c88-8ea0-b47713e0edfa tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:49.627793 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac2b169a-2450-4c88-8ea0-b47713e0edfa tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:49.633397 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac2b169a-2450-4c88-8ea0-b47713e0edfa tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:49.635681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac2b169a-2450-4c88-8ea0-b47713e0edfa tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:49.717234 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ac2b169a-2450-4c88-8ea0-b47713e0edfa tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3/action" status: 200 len: 14 microversion: 2.1 time: 0.136560 Jul 19 22:42:49.719035 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1705/3423] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:42:49 2022] POST /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:42:49.741865 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cf6104be-e8a4-48f4-ac81-f6fae7dcce0c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:49.743147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cf6104be-e8a4-48f4-ac81-f6fae7dcce0c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: d8568c5f-c480-48e5-85b2-7bae9f2ed0ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:49.772353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cf6104be-e8a4-48f4-ac81-f6fae7dcce0c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:49.773170 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cf6104be-e8a4-48f4-ac81-f6fae7dcce0c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:49.774355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cf6104be-e8a4-48f4-ac81-f6fae7dcce0c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:49.775045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cf6104be-e8a4-48f4-ac81-f6fae7dcce0c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:49.931574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cf6104be-e8a4-48f4-ac81-f6fae7dcce0c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:49.949098 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cf6104be-e8a4-48f4-ac81-f6fae7dcce0c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab" status: 200 len: 1279 microversion: 2.1 time: 0.226620 Jul 19 22:42:49.952585 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1706/3424] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:49 2022] GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab => generated 1279 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:50.931746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-773f8ff5-42ad-4afb-9e54-1cc8282f7401 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Action: 'create', calling method: .version_select at 0x7f7a0334e280>, body: {"keypair": {"name": "tempest-keypair-1334488762", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoljjTW6OlU//BVh9Rsut3ZV2k13idpVQEjcRL/U7CL4Q8s1GEa3hs4MFFIrH+0g4VhFIF1910zFA4dE0d/c3YHINdMjFaZnl69vWVwUQ4rVWGtIFqvFUQTJ7GJCNxS0g=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:42:50.955180 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-773f8ff5-42ad-4afb-9e54-1cc8282f7401 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Getting quotas for project 6fcd1f228f434f4098ca2c8f7c4c4e1b. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:42:50.962594 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-773f8ff5-42ad-4afb-9e54-1cc8282f7401 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Getting quotas for user a5edfaf424714e3bafaf391932f4a892 and project 6fcd1f228f434f4098ca2c8f7c4c4e1b. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:42:50.996034 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-773f8ff5-42ad-4afb-9e54-1cc8282f7401 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.446373 Jul 19 22:42:51.012399 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1707/3425] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:42:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:42:51.022445 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-415bec33-6bfb-4c83-ac11-e9b6e1550368 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:51.025505 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-415bec33-6bfb-4c83-ac11-e9b6e1550368 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:51.041582 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-415bec33-6bfb-4c83-ac11-e9b6e1550368 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:51.043986 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-415bec33-6bfb-4c83-ac11-e9b6e1550368 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:51.045096 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-415bec33-6bfb-4c83-ac11-e9b6e1550368 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:51.047400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-415bec33-6bfb-4c83-ac11-e9b6e1550368 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:51.091911 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:42:52.083622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:42:52.091754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-c09838c4-67dd-44b7-b252-1ec4b52a1e87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Updating instance_info_cache with network_info: [] {{(pid=119338) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 22:42:52.118733 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-415bec33-6bfb-4c83-ac11-e9b6e1550368 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:52.130421 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-415bec33-6bfb-4c83-ac11-e9b6e1550368 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1506 microversion: 2.1 time: 1.114417 Jul 19 22:42:52.131190 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1708/3426] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:51 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1506 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:52.147493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4bdb997b-23cf-47d0-9b02-efbbde136538 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:42:52.149204 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4bdb997b-23cf-47d0-9b02-efbbde136538 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:52.163227 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4bdb997b-23cf-47d0-9b02-efbbde136538 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:52.164587 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4bdb997b-23cf-47d0-9b02-efbbde136538 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:52.165720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4bdb997b-23cf-47d0-9b02-efbbde136538 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:52.166342 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4bdb997b-23cf-47d0-9b02-efbbde136538 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:52.301170 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4bdb997b-23cf-47d0-9b02-efbbde136538 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3/action" status: 200 len: 16394 microversion: 2.1 time: 0.168425 Jul 19 22:42:52.302584 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1709/3427] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:42:52 2022] POST /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3/action => generated 16394 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:42:52.315338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c28ca689-70fa-4f6d-9533-17b647f66e98 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:52.316367 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c28ca689-70fa-4f6d-9533-17b647f66e98 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: d8568c5f-c480-48e5-85b2-7bae9f2ed0ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:52.335477 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c28ca689-70fa-4f6d-9533-17b647f66e98 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:52.337033 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c28ca689-70fa-4f6d-9533-17b647f66e98 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:52.338025 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c28ca689-70fa-4f6d-9533-17b647f66e98 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:52.343526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c28ca689-70fa-4f6d-9533-17b647f66e98 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:52.706598 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c09838c4-67dd-44b7-b252-1ec4b52a1e87 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 204 len: 0 microversion: 2.1 time: 6.361872 Jul 19 22:42:52.710343 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1719/3428] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:42:46 2022] DELETE /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 0 bytes in 6372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:42:52.718889 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-d3d5d190-5b16-4595-a409-3ec56eccc413 req-35bad12a-68fd-4d2b-8f3f-68bb67b44d8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7727fc2-2016-482d-aff6-0940874c3b28", "name": "network-vif-deleted", "tag": "e9e1128e-eb72-4508-89fa-0c1047cf6872"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:42:52.755560 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d3d5d190-5b16-4595-a409-3ec56eccc413 req-35bad12a-68fd-4d2b-8f3f-68bb67b44d8f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:52.755996 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d3d5d190-5b16-4595-a409-3ec56eccc413 req-35bad12a-68fd-4d2b-8f3f-68bb67b44d8f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:52.817523 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.compute.server_external_events [req-d3d5d190-5b16-4595-a409-3ec56eccc413 req-35bad12a-68fd-4d2b-8f3f-68bb67b44d8f service nova] Unable to find a host for instance d7727fc2-2016-482d-aff6-0940874c3b28. Dropping event network-vif-deleted {{(pid=119338) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 19 22:42:52.820166 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-d3d5d190-5b16-4595-a409-3ec56eccc413 req-35bad12a-68fd-4d2b-8f3f-68bb67b44d8f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.110481 Jul 19 22:42:52.826924 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1720/3429] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 119 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 19 22:42:52.835458 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-258513b7-d400-40dc-983c-66633552664d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:52.840154 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-258513b7-d400-40dc-983c-66633552664d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:52.857734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-258513b7-d400-40dc-983c-66633552664d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:52.858787 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-258513b7-d400-40dc-983c-66633552664d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:52.861961 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-258513b7-d400-40dc-983c-66633552664d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:52.872308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-258513b7-d400-40dc-983c-66633552664d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:53.367236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c28ca689-70fa-4f6d-9533-17b647f66e98 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:53.384436 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c28ca689-70fa-4f6d-9533-17b647f66e98 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab" status: 200 len: 1321 microversion: 2.1 time: 1.079349 Jul 19 22:42:53.386751 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1710/3430] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:52 2022] GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab => generated 1321 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:53.405126 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-de23402c-9d8a-4fd5-90fd-6c64f056e1cf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:53.405798 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-de23402c-9d8a-4fd5-90fd-6c64f056e1cf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:53.418606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de23402c-9d8a-4fd5-90fd-6c64f056e1cf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:53.419356 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de23402c-9d8a-4fd5-90fd-6c64f056e1cf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:53.420736 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de23402c-9d8a-4fd5-90fd-6c64f056e1cf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:53.421414 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de23402c-9d8a-4fd5-90fd-6c64f056e1cf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:53.464199 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-de23402c-9d8a-4fd5-90fd-6c64f056e1cf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] HTTP exception thrown: Instance d7727fc2-2016-482d-aff6-0940874c3b28 could not be found. Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-de23402c-9d8a-4fd5-90fd-6c64f056e1cf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Request method failure captured: Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 HTTP/1.1 Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zJcOd8ioSoO4Ag7p0FuZhdyFBnwQELvoxLAsblThyrJ_2NxEo2CJ37EEfRT2CZdbZlGMRgWXNVEuSQUWOfX5krUiSHAMeusL8iD4FHXx0Nd2OURbeGsEBn_IDvsFz7TmW6c-8lxScCQfbEdKUx47XHZCtuEAW7dgjTFB9ANV0LmkTU Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: f4f40233895248229ddfdcd06fb65361 Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance d7727fc2-2016-482d-aff6-0940874c3b28 could not be found. Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'd7727fc2-2016-482d-aff6-0940874c3b28'} Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7727fc2-2016-482d-aff6-0940874c3b28 could not be found. Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7727fc2-2016-482d-aff6-0940874c3b28 could not be found. Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:42:53.466664 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:42:53.473549 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:42:53.473549 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:42:53.473549 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:42:53.473549 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:42:53.473549 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:42:53.473549 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7727fc2-2016-482d-aff6-0940874c3b28 could not be found. Jul 19 22:42:53.473549 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:42:53.479647 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-de23402c-9d8a-4fd5-90fd-6c64f056e1cf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Returning 404 to user: Instance d7727fc2-2016-482d-aff6-0940874c3b28 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:42:53.479647 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-de23402c-9d8a-4fd5-90fd-6c64f056e1cf tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 404 len: 111 microversion: 2.1 time: 0.088833 Jul 19 22:42:53.479647 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1711/3431] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:53 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:42:53.509276 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e44763fd-225c-4757-ba1f-17b6ff4d148e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:53.510829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e44763fd-225c-4757-ba1f-17b6ff4d148e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:53.520629 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e44763fd-225c-4757-ba1f-17b6ff4d148e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:53.521757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e44763fd-225c-4757-ba1f-17b6ff4d148e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:53.524436 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e44763fd-225c-4757-ba1f-17b6ff4d148e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:53.525326 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e44763fd-225c-4757-ba1f-17b6ff4d148e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:53.942743 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-258513b7-d400-40dc-983c-66633552664d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:53.977390 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-258513b7-d400-40dc-983c-66633552664d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 1.146976 Jul 19 22:42:53.989412 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1721/3432] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:52 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:54.019226 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-abd274ad-85da-4f06-801a-144533aea475 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1797529665", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "87c331fb-040c-45fc-a9a1-e946f840de97"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:42:54.178102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-abd274ad-85da-4f06-801a-144533aea475 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] validate_networks() for [('87c331fb-040c-45fc-a9a1-e946f840de97', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:42:54.912825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e44763fd-225c-4757-ba1f-17b6ff4d148e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:54.934116 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e44763fd-225c-4757-ba1f-17b6ff4d148e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1506 microversion: 2.1 time: 1.455095 Jul 19 22:42:54.935487 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1712/3433] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:53 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1506 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:54.944656 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-91565b89-0420-4cbe-a659-78b9a4e6bda5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:54.948206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-91565b89-0420-4cbe-a659-78b9a4e6bda5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:54.962594 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-91565b89-0420-4cbe-a659-78b9a4e6bda5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:54.967288 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-91565b89-0420-4cbe-a659-78b9a4e6bda5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:54.968270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-91565b89-0420-4cbe-a659-78b9a4e6bda5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:54.968731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-91565b89-0420-4cbe-a659-78b9a4e6bda5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:56.127909 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:42:56.198216 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=14 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:42:56.313206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-91565b89-0420-4cbe-a659-78b9a4e6bda5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:56.338443 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-91565b89-0420-4cbe-a659-78b9a4e6bda5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 1.398969 Jul 19 22:42:56.338983 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1713/3434] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:54 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:56.350329 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ff6230af-b0b5-47f4-9a42-2baa66b33082 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:56.350996 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ff6230af-b0b5-47f4-9a42-2baa66b33082 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: d8568c5f-c480-48e5-85b2-7bae9f2ed0ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:56.381443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ff6230af-b0b5-47f4-9a42-2baa66b33082 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:56.381904 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ff6230af-b0b5-47f4-9a42-2baa66b33082 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:56.392050 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ff6230af-b0b5-47f4-9a42-2baa66b33082 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:56.400902 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ff6230af-b0b5-47f4-9a42-2baa66b33082 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:57.569000 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ff6230af-b0b5-47f4-9a42-2baa66b33082 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:57.587482 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ff6230af-b0b5-47f4-9a42-2baa66b33082 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab" status: 200 len: 1321 microversion: 2.1 time: 1.245647 Jul 19 22:42:57.589137 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1714/3435] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:56 2022] GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab => generated 1321 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:57.605586 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0860171a-ba0e-42be-b434-c8123efecbea tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:57.606599 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0860171a-ba0e-42be-b434-c8123efecbea tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:57.628300 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0860171a-ba0e-42be-b434-c8123efecbea tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:57.630390 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0860171a-ba0e-42be-b434-c8123efecbea tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:57.633303 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0860171a-ba0e-42be-b434-c8123efecbea tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:57.634391 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0860171a-ba0e-42be-b434-c8123efecbea tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:57.733617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-abd274ad-85da-4f06-801a-144533aea475 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:42:57.734150 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-abd274ad-85da-4f06-801a-144533aea475 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:42:57.734516 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-abd274ad-85da-4f06-801a-144533aea475 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:42:57.734933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-abd274ad-85da-4f06-801a-144533aea475 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:42:57.735587 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-abd274ad-85da-4f06-801a-144533aea475 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:42:57.770109 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-abd274ad-85da-4f06-801a-144533aea475 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:57.770809 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-abd274ad-85da-4f06-801a-144533aea475 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:57.772032 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-abd274ad-85da-4f06-801a-144533aea475 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:57.772737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-abd274ad-85da-4f06-801a-144533aea475 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:57.839817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-abd274ad-85da-4f06-801a-144533aea475 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Getting quotas for project a2bcdb843a7d4a1ebe467160eee0d6e1. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:42:57.853373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-abd274ad-85da-4f06-801a-144533aea475 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Getting quotas for user f4f40233895248229ddfdcd06fb65361 and project a2bcdb843a7d4a1ebe467160eee0d6e1. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:42:57.884590 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-abd274ad-85da-4f06-801a-144533aea475 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:42:57.895248 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-abd274ad-85da-4f06-801a-144533aea475 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:42:57.999954 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-abd274ad-85da-4f06-801a-144533aea475 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.009279 Jul 19 22:42:58.002992 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1722/3436] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:42:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 4012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:42:58.019034 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-64a95033-c843-4f2e-bafb-ab57443d190d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:58.021799 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-64a95033-c843-4f2e-bafb-ab57443d190d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:58.044069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0860171a-ba0e-42be-b434-c8123efecbea tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:58.056900 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-64a95033-c843-4f2e-bafb-ab57443d190d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:58.057870 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-64a95033-c843-4f2e-bafb-ab57443d190d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:58.060523 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-64a95033-c843-4f2e-bafb-ab57443d190d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:58.061222 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-64a95033-c843-4f2e-bafb-ab57443d190d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:58.072988 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0860171a-ba0e-42be-b434-c8123efecbea tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1506 microversion: 2.1 time: 0.474762 Jul 19 22:42:58.085852 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1715/3437] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:57 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1506 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:58.094561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9808a988-5749-4ab6-9da7-91bc8f382bb5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:58.105462 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9808a988-5749-4ab6-9da7-91bc8f382bb5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:58.395347 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9808a988-5749-4ab6-9da7-91bc8f382bb5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:58.410627 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9808a988-5749-4ab6-9da7-91bc8f382bb5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1215 microversion: 2.1 time: 0.317196 Jul 19 22:42:58.426235 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1716/3438] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:58 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1215 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:58.443324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-419881c9-c76f-4b54-ad47-d7f0f9a78284 req-3e8598b8-0bbc-405b-8278-75a9cb77a385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8568c5f-c480-48e5-85b2-7bae9f2ed0ab", "tag": "44c9546d-1329-4e17-b985-89687b1ef0fb"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:42:58.479605 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-419881c9-c76f-4b54-ad47-d7f0f9a78284 req-3e8598b8-0bbc-405b-8278-75a9cb77a385 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:58.480431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-419881c9-c76f-4b54-ad47-d7f0f9a78284 req-3e8598b8-0bbc-405b-8278-75a9cb77a385 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:58.517697 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-419881c9-c76f-4b54-ad47-d7f0f9a78284 req-3e8598b8-0bbc-405b-8278-75a9cb77a385 service nova] Creating event network-changed:44c9546d-1329-4e17-b985-89687b1ef0fb for instance d8568c5f-c480-48e5-85b2-7bae9f2ed0ab on n-h1-847009-3 Jul 19 22:42:58.539314 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-419881c9-c76f-4b54-ad47-d7f0f9a78284 req-3e8598b8-0bbc-405b-8278-75a9cb77a385 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107896 Jul 19 22:42:58.540476 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1717/3439] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:42:58.613760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-96da2f1e-63a3-4ab9-a82f-229e6391fb4e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:58.615976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-96da2f1e-63a3-4ab9-a82f-229e6391fb4e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: d8568c5f-c480-48e5-85b2-7bae9f2ed0ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:58.636827 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-96da2f1e-63a3-4ab9-a82f-229e6391fb4e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:58.638821 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-96da2f1e-63a3-4ab9-a82f-229e6391fb4e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:58.643438 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-96da2f1e-63a3-4ab9-a82f-229e6391fb4e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:58.643438 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-96da2f1e-63a3-4ab9-a82f-229e6391fb4e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:58.974126 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-64a95033-c843-4f2e-bafb-ab57443d190d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:58.988502 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-64a95033-c843-4f2e-bafb-ab57443d190d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.982602 Jul 19 22:42:58.996907 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1723/3440] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:58 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:59.016935 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1e4b3f30-265c-4476-b07c-f11c3b96b0c7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:59.018635 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1e4b3f30-265c-4476-b07c-f11c3b96b0c7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:59.037802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1e4b3f30-265c-4476-b07c-f11c3b96b0c7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:59.041883 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1e4b3f30-265c-4476-b07c-f11c3b96b0c7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:59.043603 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1e4b3f30-265c-4476-b07c-f11c3b96b0c7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:59.045672 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1e4b3f30-265c-4476-b07c-f11c3b96b0c7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:59.166942 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-96da2f1e-63a3-4ab9-a82f-229e6391fb4e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:59.181728 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-96da2f1e-63a3-4ab9-a82f-229e6391fb4e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab" status: 200 len: 1321 microversion: 2.1 time: 0.575094 Jul 19 22:42:59.182638 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1718/3441] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:58 2022] GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab => generated 1321 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:42:59.196462 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-99f2d037-ef77-4c4c-8700-31732ece274c tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:59.199640 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-99f2d037-ef77-4c4c-8700-31732ece274c tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:59.215147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99f2d037-ef77-4c4c-8700-31732ece274c tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:59.216134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99f2d037-ef77-4c4c-8700-31732ece274c tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:59.219224 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99f2d037-ef77-4c4c-8700-31732ece274c tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:59.222788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99f2d037-ef77-4c4c-8700-31732ece274c tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:59.706688 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1e4b3f30-265c-4476-b07c-f11c3b96b0c7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:59.718824 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1e4b3f30-265c-4476-b07c-f11c3b96b0c7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.709706 Jul 19 22:42:59.726691 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1724/3442] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:59 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:42:59.741249 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-99f2d037-ef77-4c4c-8700-31732ece274c tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:42:59.757485 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-99f2d037-ef77-4c4c-8700-31732ece274c tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1506 microversion: 2.1 time: 0.573153 Jul 19 22:42:59.763326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5b7efb08-489b-4567-8006-fdf2a201644f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:42:59.764277 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1719/3443] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:59 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1506 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:42:59.765190 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5b7efb08-489b-4567-8006-fdf2a201644f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:59.782691 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f6ed549b-1b1c-4b7d-b72c-c50334e85630 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:42:59.794133 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b7efb08-489b-4567-8006-fdf2a201644f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:59.795737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f6ed549b-1b1c-4b7d-b72c-c50334e85630 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:42:59.798429 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b7efb08-489b-4567-8006-fdf2a201644f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:59.805140 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b7efb08-489b-4567-8006-fdf2a201644f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:59.806177 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b7efb08-489b-4567-8006-fdf2a201644f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:59.812356 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f6ed549b-1b1c-4b7d-b72c-c50334e85630 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:59.819341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f6ed549b-1b1c-4b7d-b72c-c50334e85630 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:59.821036 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f6ed549b-1b1c-4b7d-b72c-c50334e85630 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:42:59.821746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f6ed549b-1b1c-4b7d-b72c-c50334e85630 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:42:59.954285 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f6ed549b-1b1c-4b7d-b72c-c50334e85630 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Locking {{(pid=119337) lock /opt/stack/nova/nova/compute/api.py:4700}} Jul 19 22:43:00.066863 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5b7efb08-489b-4567-8006-fdf2a201644f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:00.085972 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5b7efb08-489b-4567-8006-fdf2a201644f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1211 microversion: 2.1 time: 0.337040 Jul 19 22:43:00.099374 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1725/3444] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:42:59 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1211 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:00.116942 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f6ed549b-1b1c-4b7d-b72c-c50334e85630 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action" status: 202 len: 0 microversion: 2.1 time: 0.348849 Jul 19 22:43:00.119562 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1720/3445] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:42:59 2022] POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:43:00.129455 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b08a39d6-0336-4222-a08b-accc7451e2e7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:00.130735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b08a39d6-0336-4222-a08b-accc7451e2e7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:00.139454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b08a39d6-0336-4222-a08b-accc7451e2e7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:00.140281 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b08a39d6-0336-4222-a08b-accc7451e2e7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:00.141320 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b08a39d6-0336-4222-a08b-accc7451e2e7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:00.142551 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b08a39d6-0336-4222-a08b-accc7451e2e7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:00.198982 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9bb28e80-679c-4139-b8ba-54ae9577996a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:00.199655 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9bb28e80-679c-4139-b8ba-54ae9577996a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: d8568c5f-c480-48e5-85b2-7bae9f2ed0ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:00.229425 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9bb28e80-679c-4139-b8ba-54ae9577996a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:00.230073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9bb28e80-679c-4139-b8ba-54ae9577996a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:00.230807 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9bb28e80-679c-4139-b8ba-54ae9577996a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:00.231292 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9bb28e80-679c-4139-b8ba-54ae9577996a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:00.580908 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9bb28e80-679c-4139-b8ba-54ae9577996a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:00.596820 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9bb28e80-679c-4139-b8ba-54ae9577996a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab" status: 200 len: 1321 microversion: 2.1 time: 0.402363 Jul 19 22:43:00.608125 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1721/3446] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:00 2022] GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab => generated 1321 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:43:00.755497 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b08a39d6-0336-4222-a08b-accc7451e2e7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:00.771783 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b08a39d6-0336-4222-a08b-accc7451e2e7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.647967 Jul 19 22:43:00.773135 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1726/3447] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:00 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:43:00.781654 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-215fe85a-c016-45d4-a05c-4eed138d1daa tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:00.783024 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-215fe85a-c016-45d4-a05c-4eed138d1daa tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:00.805122 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-feaec8c5-1f91-4f30-b8f7-06103ba4e7e0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:00.806686 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-215fe85a-c016-45d4-a05c-4eed138d1daa tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:00.807714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-215fe85a-c016-45d4-a05c-4eed138d1daa tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:00.815892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-215fe85a-c016-45d4-a05c-4eed138d1daa tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:00.818628 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-215fe85a-c016-45d4-a05c-4eed138d1daa tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:00.831744 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-feaec8c5-1f91-4f30-b8f7-06103ba4e7e0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:00.834069 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-feaec8c5-1f91-4f30-b8f7-06103ba4e7e0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:00.878988 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-feaec8c5-1f91-4f30-b8f7-06103ba4e7e0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] HTTP exception thrown: Instance b9ae7d22-3925-465a-9507-250b670ecc77 is locked Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-feaec8c5-1f91-4f30-b8f7-06103ba4e7e0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Request method failure captured: Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action HTTP/1.1 Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 15 Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zH_7tuIYMYFMfF-dNsTqgLOBouujgTx1g47lvb5iq5eveGanI52PRfRNIt8J7p9YtbR2-UcbK9_91u9n4LJtsBL7XHFFF4JD0Ndl-oibDwWUv87SVm5nTpiYOOZL55LCz9q329mnnDxSfKms2aIJ75_j7RvsBiNNB6M3Nswlz42WAY Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 038e4783159e41e3b2cb88df1f8f4a97 Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerActionsTestJSON-1967329631 Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_038e4783159e41e3b2cb88df1f8f4a97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/038e4783159e41e3b2cb88df1f8f4a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/038e4783159e41e3b2cb88df1f8f4a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/038e4783159e41e3b2cb88df1f8f4a97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerActionsTestJSON-1967329631 Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 038e4783159e41e3b2cb88df1f8f4a97 Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerActionsTestJSON-1967329631 Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerActionsTestJSON-1967329631-project Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1f2613ad65b047e8b9a68907406d1874 Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerActionsTestJSON-1967329631-project Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: {"os-stop": {}} Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance b9ae7d22-3925-465a-9507-250b670ecc77 is locked Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'b9ae7d22-3925-465a-9507-250b670ecc77', 'body': {'os-stop': {}}} Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance b9ae7d22-3925-465a-9507-250b670ecc77 is locked Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance b9ae7d22-3925-465a-9507-250b670ecc77 is locked Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9ae7d22-3925-465a-9507-250b670ecc77 is locked Jul 19 22:43:00.881583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:43:00.888299 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-feaec8c5-1f91-4f30-b8f7-06103ba4e7e0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Returning 409 to user: Instance b9ae7d22-3925-465a-9507-250b670ecc77 is locked {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:43:00.889681 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-feaec8c5-1f91-4f30-b8f7-06103ba4e7e0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action" status: 409 len: 107 microversion: 2.1 time: 0.095269 Jul 19 22:43:00.890834 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1727/3448] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:43:00 2022] POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action => generated 107 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:43:00.905974 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d7800827-fd8e-4522-8150-472fde868a75 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:00.911458 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d7800827-fd8e-4522-8150-472fde868a75 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:00.927878 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7800827-fd8e-4522-8150-472fde868a75 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:00.928595 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7800827-fd8e-4522-8150-472fde868a75 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:00.929908 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7800827-fd8e-4522-8150-472fde868a75 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:00.930534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7800827-fd8e-4522-8150-472fde868a75 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:01.092292 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d7800827-fd8e-4522-8150-472fde868a75 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Unlocking {{(pid=119338) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 19 22:43:01.298159 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d7800827-fd8e-4522-8150-472fde868a75 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action" status: 202 len: 0 microversion: 2.1 time: 0.400302 Jul 19 22:43:01.306626 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1728/3449] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:43:00 2022] POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:43:01.314749 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f49c9705-8043-449a-acd3-6423953e8217 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:01.319250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f49c9705-8043-449a-acd3-6423953e8217 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:01.343399 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f49c9705-8043-449a-acd3-6423953e8217 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:01.346307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f49c9705-8043-449a-acd3-6423953e8217 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:01.348708 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f49c9705-8043-449a-acd3-6423953e8217 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:01.349802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f49c9705-8043-449a-acd3-6423953e8217 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:01.412849 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-215fe85a-c016-45d4-a05c-4eed138d1daa tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:01.428508 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-215fe85a-c016-45d4-a05c-4eed138d1daa tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1506 microversion: 2.1 time: 0.650783 Jul 19 22:43:01.432043 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1722/3450] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:00 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1506 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:01.450133 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2e6c265a-111c-46da-a5a3-f7b049501cbe tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:01.477835 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e6c265a-111c-46da-a5a3-f7b049501cbe tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:01.479562 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e6c265a-111c-46da-a5a3-f7b049501cbe tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:01.583395 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2e6c265a-111c-46da-a5a3-f7b049501cbe tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Going to try to stop instance {{(pid=119337) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 22:43:01.703284 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f49c9705-8043-449a-acd3-6423953e8217 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:01.724390 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f49c9705-8043-449a-acd3-6423953e8217 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1275 microversion: 2.1 time: 0.406999 Jul 19 22:43:01.728095 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1729/3451] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:01 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1275 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:01.745024 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f8dee07a-56e6-4cd1-9431-610e58a4125f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:01.751599 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f8dee07a-56e6-4cd1-9431-610e58a4125f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: d8568c5f-c480-48e5-85b2-7bae9f2ed0ab] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:01.753856 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2e6c265a-111c-46da-a5a3-f7b049501cbe tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action" status: 202 len: 0 microversion: 2.1 time: 0.318868 Jul 19 22:43:01.762273 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1723/3452] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:43:01 2022] POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:43:01.796323 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8dee07a-56e6-4cd1-9431-610e58a4125f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:01.808661 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b53a8e56-412b-4f6d-9a87-b8735b3b04ca tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:01.810582 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8dee07a-56e6-4cd1-9431-610e58a4125f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:01.812293 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b53a8e56-412b-4f6d-9a87-b8735b3b04ca tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:01.813722 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8dee07a-56e6-4cd1-9431-610e58a4125f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:01.816479 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8dee07a-56e6-4cd1-9431-610e58a4125f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:01.841178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b53a8e56-412b-4f6d-9a87-b8735b3b04ca tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:01.852853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b53a8e56-412b-4f6d-9a87-b8735b3b04ca tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:01.859171 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b53a8e56-412b-4f6d-9a87-b8735b3b04ca tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:01.860824 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b53a8e56-412b-4f6d-9a87-b8735b3b04ca tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:01.884633 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:UPDATE=19,nova_cell1:SELECT=75,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:43:01.942352 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:43:02.387409 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f8dee07a-56e6-4cd1-9431-610e58a4125f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:02.406188 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f8dee07a-56e6-4cd1-9431-610e58a4125f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab" status: 200 len: 1321 microversion: 2.1 time: 0.674424 Jul 19 22:43:02.407591 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1730/3453] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:01 2022] GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab => generated 1321 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:02.448950 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c496c9ad-99b4-4d99-a894-263f8118f866 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:02.449796 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c496c9ad-99b4-4d99-a894-263f8118f866 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:02.469668 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:43:02.473148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c496c9ad-99b4-4d99-a894-263f8118f866 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:02.475654 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c496c9ad-99b4-4d99-a894-263f8118f866 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:02.477529 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c496c9ad-99b4-4d99-a894-263f8118f866 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:02.491599 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c496c9ad-99b4-4d99-a894-263f8118f866 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:02.974896 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b53a8e56-412b-4f6d-9a87-b8735b3b04ca tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:03.002131 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b53a8e56-412b-4f6d-9a87-b8735b3b04ca tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1678 microversion: 2.1 time: 1.226300 Jul 19 22:43:03.008548 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1724/3454] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:01 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1678 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:03.042291 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c4174e38-13ff-4a7a-9816-ce3d7affb6e2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:03.043385 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c4174e38-13ff-4a7a-9816-ce3d7affb6e2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:03.064090 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c4174e38-13ff-4a7a-9816-ce3d7affb6e2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:03.064619 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c4174e38-13ff-4a7a-9816-ce3d7affb6e2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:03.065442 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c4174e38-13ff-4a7a-9816-ce3d7affb6e2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:03.065947 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c4174e38-13ff-4a7a-9816-ce3d7affb6e2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:03.338643 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c4174e38-13ff-4a7a-9816-ce3d7affb6e2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:03.357399 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c4174e38-13ff-4a7a-9816-ce3d7affb6e2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1273 microversion: 2.1 time: 0.345335 Jul 19 22:43:03.367933 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1725/3455] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:03 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1273 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:03.418075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c496c9ad-99b4-4d99-a894-263f8118f866 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:03.432429 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c496c9ad-99b4-4d99-a894-263f8118f866 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1506 microversion: 2.1 time: 0.988549 Jul 19 22:43:03.433851 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4fd4c789-a8a8-4d04-ab51-85cf1bfecd46 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:03.435279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4fd4c789-a8a8-4d04-ab51-85cf1bfecd46 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: d8568c5f-c480-48e5-85b2-7bae9f2ed0ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:03.443190 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1731/3456] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:02 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1506 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:43:03.453045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4fd4c789-a8a8-4d04-ab51-85cf1bfecd46 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:03.453513 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4fd4c789-a8a8-4d04-ab51-85cf1bfecd46 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:03.454369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4fd4c789-a8a8-4d04-ab51-85cf1bfecd46 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:03.454895 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4fd4c789-a8a8-4d04-ab51-85cf1bfecd46 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:04.034085 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-86ee0309-2d6d-4a54-ac9f-4e6be41335a3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:04.035199 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-86ee0309-2d6d-4a54-ac9f-4e6be41335a3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:04.055551 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86ee0309-2d6d-4a54-ac9f-4e6be41335a3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:04.057134 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86ee0309-2d6d-4a54-ac9f-4e6be41335a3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:04.063437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86ee0309-2d6d-4a54-ac9f-4e6be41335a3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:04.065034 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86ee0309-2d6d-4a54-ac9f-4e6be41335a3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:04.684414 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-86ee0309-2d6d-4a54-ac9f-4e6be41335a3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:04.699904 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-86ee0309-2d6d-4a54-ac9f-4e6be41335a3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1678 microversion: 2.1 time: 0.672753 Jul 19 22:43:04.700494 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1732/3457] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:04 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1678 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:04.707918 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-90fd84eb-874a-4b92-8baf-fee7ecf628c8 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:04.708090 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4fd4c789-a8a8-4d04-ab51-85cf1bfecd46 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:04.713192 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-90fd84eb-874a-4b92-8baf-fee7ecf628c8 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:04.718963 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4fd4c789-a8a8-4d04-ab51-85cf1bfecd46 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab" status: 200 len: 1321 microversion: 2.1 time: 1.290991 Jul 19 22:43:04.726676 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-90fd84eb-874a-4b92-8baf-fee7ecf628c8 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:04.732151 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1726/3458] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:03 2022] GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab => generated 1321 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:04.732431 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-90fd84eb-874a-4b92-8baf-fee7ecf628c8 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:04.733575 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-90fd84eb-874a-4b92-8baf-fee7ecf628c8 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:04.734288 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-90fd84eb-874a-4b92-8baf-fee7ecf628c8 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:04.747295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fe48ece3-d930-47d6-afce-e16d2d829867 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:04.749030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fe48ece3-d930-47d6-afce-e16d2d829867 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:04.777984 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fe48ece3-d930-47d6-afce-e16d2d829867 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:04.779961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fe48ece3-d930-47d6-afce-e16d2d829867 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:04.780811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fe48ece3-d930-47d6-afce-e16d2d829867 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:04.786517 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fe48ece3-d930-47d6-afce-e16d2d829867 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:05.032702 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-90fd84eb-874a-4b92-8baf-fee7ecf628c8 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:05.046137 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-90fd84eb-874a-4b92-8baf-fee7ecf628c8 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1273 microversion: 2.1 time: 0.343917 Jul 19 22:43:05.052072 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1733/3459] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:04 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1273 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:05.722860 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0eac62a2-e2c9-480d-bb63-e6a339f4e303 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:05.723948 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0eac62a2-e2c9-480d-bb63-e6a339f4e303 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:05.749789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0eac62a2-e2c9-480d-bb63-e6a339f4e303 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:05.750235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0eac62a2-e2c9-480d-bb63-e6a339f4e303 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:05.751247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0eac62a2-e2c9-480d-bb63-e6a339f4e303 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:05.751861 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0eac62a2-e2c9-480d-bb63-e6a339f4e303 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:06.850103 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fe48ece3-d930-47d6-afce-e16d2d829867 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:06.865962 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fe48ece3-d930-47d6-afce-e16d2d829867 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1506 microversion: 2.1 time: 2.131113 Jul 19 22:43:06.872255 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1727/3460] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:04 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1506 bytes in 2138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:06.879496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3378573d-2b66-40b6-a13c-ccc947b52943 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:06.880462 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3378573d-2b66-40b6-a13c-ccc947b52943 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: d8568c5f-c480-48e5-85b2-7bae9f2ed0ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:06.888838 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3378573d-2b66-40b6-a13c-ccc947b52943 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:06.889394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3378573d-2b66-40b6-a13c-ccc947b52943 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:06.890264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3378573d-2b66-40b6-a13c-ccc947b52943 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:06.890780 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3378573d-2b66-40b6-a13c-ccc947b52943 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:07.223553 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0eac62a2-e2c9-480d-bb63-e6a339f4e303 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:07.240656 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0eac62a2-e2c9-480d-bb63-e6a339f4e303 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1678 microversion: 2.1 time: 1.522319 Jul 19 22:43:07.244070 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1734/3461] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:05 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1678 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:43:07.260969 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-561fbd59-b7e7-42ba-a9c7-8d60628d647b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:07.261872 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-561fbd59-b7e7-42ba-a9c7-8d60628d647b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:07.276121 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-561fbd59-b7e7-42ba-a9c7-8d60628d647b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:07.277095 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-561fbd59-b7e7-42ba-a9c7-8d60628d647b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:07.285231 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-561fbd59-b7e7-42ba-a9c7-8d60628d647b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:07.285961 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-561fbd59-b7e7-42ba-a9c7-8d60628d647b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:07.795305 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3378573d-2b66-40b6-a13c-ccc947b52943 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:07.809521 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:43:07.812102 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3378573d-2b66-40b6-a13c-ccc947b52943 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab" status: 200 len: 1321 microversion: 2.1 time: 0.938122 Jul 19 22:43:07.813041 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1728/3462] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:06 2022] GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab => generated 1321 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:07.830633 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-b04922bf-68ad-45eb-9642-c5dbf239fa41 req-467a6f63-ae7f-4407-9573-bc19aff6745b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8568c5f-c480-48e5-85b2-7bae9f2ed0ab", "name": "network-vif-plugged", "status": "completed", "tag": "44c9546d-1329-4e17-b985-89687b1ef0fb"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:07.834804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:43:07.841625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b04922bf-68ad-45eb-9642-c5dbf239fa41 req-467a6f63-ae7f-4407-9573-bc19aff6745b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:07.842555 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b04922bf-68ad-45eb-9642-c5dbf239fa41 req-467a6f63-ae7f-4407-9573-bc19aff6745b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:07.861576 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-b04922bf-68ad-45eb-9642-c5dbf239fa41 req-467a6f63-ae7f-4407-9573-bc19aff6745b service nova] Creating event network-vif-plugged:44c9546d-1329-4e17-b985-89687b1ef0fb for instance d8568c5f-c480-48e5-85b2-7bae9f2ed0ab on n-h1-847009-3 Jul 19 22:43:07.869392 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-b04922bf-68ad-45eb-9642-c5dbf239fa41 req-467a6f63-ae7f-4407-9573-bc19aff6745b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044402 Jul 19 22:43:07.870333 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1729/3463] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:43:07.876173 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:43:07.886801 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-042433eb-c728-4f73-94ef-cf7290b64f2b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:07.887816 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-042433eb-c728-4f73-94ef-cf7290b64f2b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:07.916389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-042433eb-c728-4f73-94ef-cf7290b64f2b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:07.917297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-042433eb-c728-4f73-94ef-cf7290b64f2b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:07.920499 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-042433eb-c728-4f73-94ef-cf7290b64f2b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:07.921151 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-042433eb-c728-4f73-94ef-cf7290b64f2b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:08.172789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-561fbd59-b7e7-42ba-a9c7-8d60628d647b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:08.187467 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-561fbd59-b7e7-42ba-a9c7-8d60628d647b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1315 microversion: 2.1 time: 0.941224 Jul 19 22:43:08.189765 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1735/3464] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:07 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1315 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:08.266521 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6ab8fbef-7f15-48b8-ac02-18f280ef893e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:08.267248 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6ab8fbef-7f15-48b8-ac02-18f280ef893e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:08.280036 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ab8fbef-7f15-48b8-ac02-18f280ef893e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:08.283412 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ab8fbef-7f15-48b8-ac02-18f280ef893e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:08.284843 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ab8fbef-7f15-48b8-ac02-18f280ef893e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:08.287299 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ab8fbef-7f15-48b8-ac02-18f280ef893e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:08.402080 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=8 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:43:08.703785 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-042433eb-c728-4f73-94ef-cf7290b64f2b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:08.714123 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-042433eb-c728-4f73-94ef-cf7290b64f2b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1506 microversion: 2.1 time: 0.833992 Jul 19 22:43:08.715925 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1730/3465] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:07 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1506 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:43:08.831794 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ab43c646-cfb3-429c-8c46-026678212fd7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:08.832823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ab43c646-cfb3-429c-8c46-026678212fd7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: d8568c5f-c480-48e5-85b2-7bae9f2ed0ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:08.850965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab43c646-cfb3-429c-8c46-026678212fd7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:08.852073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab43c646-cfb3-429c-8c46-026678212fd7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:08.858463 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab43c646-cfb3-429c-8c46-026678212fd7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:08.860183 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab43c646-cfb3-429c-8c46-026678212fd7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:09.004366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6ab8fbef-7f15-48b8-ac02-18f280ef893e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:09.046747 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6ab8fbef-7f15-48b8-ac02-18f280ef893e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1678 microversion: 2.1 time: 0.772977 Jul 19 22:43:09.047841 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1736/3466] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:08 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1678 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:43:09.209189 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3b44101a-ca75-47e7-8100-7d7d513f24fe tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:09.210251 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3b44101a-ca75-47e7-8100-7d7d513f24fe tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:09.224470 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b44101a-ca75-47e7-8100-7d7d513f24fe tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:09.226518 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b44101a-ca75-47e7-8100-7d7d513f24fe tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:09.229474 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b44101a-ca75-47e7-8100-7d7d513f24fe tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:09.231623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b44101a-ca75-47e7-8100-7d7d513f24fe tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:09.343748 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ab43c646-cfb3-429c-8c46-026678212fd7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:09.364960 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ab43c646-cfb3-429c-8c46-026678212fd7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab" status: 200 len: 1321 microversion: 2.1 time: 0.537648 Jul 19 22:43:09.365973 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1731/3467] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:08 2022] GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab => generated 1321 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:09.740825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5026b68c-549f-41f2-84a0-0de32d8b2226 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:09.742406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5026b68c-549f-41f2-84a0-0de32d8b2226 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:09.774522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5026b68c-549f-41f2-84a0-0de32d8b2226 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:09.775400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5026b68c-549f-41f2-84a0-0de32d8b2226 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:09.785216 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5026b68c-549f-41f2-84a0-0de32d8b2226 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:09.797281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5026b68c-549f-41f2-84a0-0de32d8b2226 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:09.999742 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3b44101a-ca75-47e7-8100-7d7d513f24fe tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:10.015207 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3b44101a-ca75-47e7-8100-7d7d513f24fe tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1315 microversion: 2.1 time: 0.811278 Jul 19 22:43:10.021918 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1737/3468] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:09 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1315 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:10.073432 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dfbbb033-0b48-43b5-8d75-9302957aca6e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:10.074670 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dfbbb033-0b48-43b5-8d75-9302957aca6e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:10.098261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfbbb033-0b48-43b5-8d75-9302957aca6e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:10.107739 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfbbb033-0b48-43b5-8d75-9302957aca6e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:10.115607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfbbb033-0b48-43b5-8d75-9302957aca6e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:10.117820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfbbb033-0b48-43b5-8d75-9302957aca6e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:10.857028 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5026b68c-549f-41f2-84a0-0de32d8b2226 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:10.884953 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5026b68c-549f-41f2-84a0-0de32d8b2226 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1506 microversion: 2.1 time: 1.148088 Jul 19 22:43:10.890668 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1732/3469] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:09 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1506 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:43:10.901275 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-08c1d0c1-014c-43ac-97e0-01ecc92616b5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:10.902478 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-08c1d0c1-014c-43ac-97e0-01ecc92616b5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: d8568c5f-c480-48e5-85b2-7bae9f2ed0ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:10.925454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08c1d0c1-014c-43ac-97e0-01ecc92616b5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:10.927874 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08c1d0c1-014c-43ac-97e0-01ecc92616b5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:10.933824 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08c1d0c1-014c-43ac-97e0-01ecc92616b5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:10.934646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08c1d0c1-014c-43ac-97e0-01ecc92616b5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:11.129180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dfbbb033-0b48-43b5-8d75-9302957aca6e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:11.144890 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dfbbb033-0b48-43b5-8d75-9302957aca6e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1678 microversion: 2.1 time: 1.081385 Jul 19 22:43:11.145568 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1738/3470] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:10 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1678 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:11.161398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e64a7778-809a-413b-92a7-d90176ce8451 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:11.163105 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e64a7778-809a-413b-92a7-d90176ce8451 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:11.205454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e64a7778-809a-413b-92a7-d90176ce8451 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:11.208831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e64a7778-809a-413b-92a7-d90176ce8451 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:11.210113 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e64a7778-809a-413b-92a7-d90176ce8451 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:11.212157 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e64a7778-809a-413b-92a7-d90176ce8451 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:11.501445 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-08c1d0c1-014c-43ac-97e0-01ecc92616b5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:11.523992 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-08c1d0c1-014c-43ac-97e0-01ecc92616b5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab" status: 200 len: 1501 microversion: 2.1 time: 0.630828 Jul 19 22:43:11.534531 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1733/3471] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:10 2022] GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab => generated 1501 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:11.552593 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-42c9fc06-6ef1-4a9c-ab09-f96c28797d73 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:11.554965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-42c9fc06-6ef1-4a9c-ab09-f96c28797d73 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: d8568c5f-c480-48e5-85b2-7bae9f2ed0ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:11.583039 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42c9fc06-6ef1-4a9c-ab09-f96c28797d73 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:11.583543 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42c9fc06-6ef1-4a9c-ab09-f96c28797d73 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:11.584500 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42c9fc06-6ef1-4a9c-ab09-f96c28797d73 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:11.585844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42c9fc06-6ef1-4a9c-ab09-f96c28797d73 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:11.765545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e64a7778-809a-413b-92a7-d90176ce8451 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:11.780546 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e64a7778-809a-413b-92a7-d90176ce8451 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1315 microversion: 2.1 time: 0.628083 Jul 19 22:43:11.780546 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1739/3472] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:11 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1315 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:11.905081 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9fbc5a31-c852-42bc-af11-cd6eee2a691a tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:11.905956 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9fbc5a31-c852-42bc-af11-cd6eee2a691a tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:11.926616 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9fbc5a31-c852-42bc-af11-cd6eee2a691a tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:11.934367 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9fbc5a31-c852-42bc-af11-cd6eee2a691a tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:11.935497 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9fbc5a31-c852-42bc-af11-cd6eee2a691a tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:11.936106 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9fbc5a31-c852-42bc-af11-cd6eee2a691a tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:12.014909 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-42c9fc06-6ef1-4a9c-ab09-f96c28797d73 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:12.034222 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-42c9fc06-6ef1-4a9c-ab09-f96c28797d73 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab" status: 200 len: 1501 microversion: 2.1 time: 0.485590 Jul 19 22:43:12.046358 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1734/3473] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:11 2022] GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab => generated 1501 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:12.051858 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-785d8592-53ba-4d31-8625-ecf34a580332 req-a6498fc3-496e-469f-bf34-22032e0a5a1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1", "tag": "2141535c-9709-4a08-b290-b35a8c739837"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:12.078306 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-785d8592-53ba-4d31-8625-ecf34a580332 req-a6498fc3-496e-469f-bf34-22032e0a5a1c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:12.079036 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-785d8592-53ba-4d31-8625-ecf34a580332 req-a6498fc3-496e-469f-bf34-22032e0a5a1c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:12.104207 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-785d8592-53ba-4d31-8625-ecf34a580332 req-a6498fc3-496e-469f-bf34-22032e0a5a1c service nova] Creating event network-changed:2141535c-9709-4a08-b290-b35a8c739837 for instance 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 on n-h2-847009-3 Jul 19 22:43:12.120256 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-785d8592-53ba-4d31-8625-ecf34a580332 req-a6498fc3-496e-469f-bf34-22032e0a5a1c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077034 Jul 19 22:43:12.121219 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1735/3474] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:43:12.149101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c73ade10-c7c3-47ac-be0c-32af16c933f1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:12.151213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c73ade10-c7c3-47ac-be0c-32af16c933f1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: d8568c5f-c480-48e5-85b2-7bae9f2ed0ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:12.181991 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c73ade10-c7c3-47ac-be0c-32af16c933f1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:12.182469 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c73ade10-c7c3-47ac-be0c-32af16c933f1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:12.183351 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c73ade10-c7c3-47ac-be0c-32af16c933f1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:12.183793 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c73ade10-c7c3-47ac-be0c-32af16c933f1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:12.250172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c73ade10-c7c3-47ac-be0c-32af16c933f1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: d8568c5f-c480-48e5-85b2-7bae9f2ed0ab] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:43:12.513010 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c73ade10-c7c3-47ac-be0c-32af16c933f1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab" status: 204 len: 0 microversion: 2.1 time: 0.389531 Jul 19 22:43:12.516671 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1736/3475] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:43:12 2022] DELETE /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:43:12.542121 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f3845edc-a166-422c-8df3-ca426a6f8fda tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:12.543686 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f3845edc-a166-422c-8df3-ca426a6f8fda tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:12.557060 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3845edc-a166-422c-8df3-ca426a6f8fda tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:12.558048 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3845edc-a166-422c-8df3-ca426a6f8fda tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:12.560106 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3845edc-a166-422c-8df3-ca426a6f8fda tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:12.561277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3845edc-a166-422c-8df3-ca426a6f8fda tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:12.699705 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9fbc5a31-c852-42bc-af11-cd6eee2a691a tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:12.727305 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9fbc5a31-c852-42bc-af11-cd6eee2a691a tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1506 microversion: 2.1 time: 0.826173 Jul 19 22:43:12.740148 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1740/3476] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:11 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1506 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:12.758026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-154c3465-4223-4cda-a63d-d348857d0bd4 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:12.771842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-154c3465-4223-4cda-a63d-d348857d0bd4 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: d8568c5f-c480-48e5-85b2-7bae9f2ed0ab] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:12.798793 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-154c3465-4223-4cda-a63d-d348857d0bd4 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:12.799094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-154c3465-4223-4cda-a63d-d348857d0bd4 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:12.800007 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-154c3465-4223-4cda-a63d-d348857d0bd4 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:12.800473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-154c3465-4223-4cda-a63d-d348857d0bd4 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:13.164108 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f3845edc-a166-422c-8df3-ca426a6f8fda tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:13.179694 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f3845edc-a166-422c-8df3-ca426a6f8fda tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1678 microversion: 2.1 time: 0.654452 Jul 19 22:43:13.190200 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1737/3477] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:12 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1678 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:13.196972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cd8eae57-4c97-4fc4-a714-53365dfa48c2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:13.197919 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cd8eae57-4c97-4fc4-a714-53365dfa48c2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:13.205131 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd8eae57-4c97-4fc4-a714-53365dfa48c2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:13.205904 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd8eae57-4c97-4fc4-a714-53365dfa48c2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:13.206908 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd8eae57-4c97-4fc4-a714-53365dfa48c2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:13.207589 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd8eae57-4c97-4fc4-a714-53365dfa48c2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:13.595066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-154c3465-4223-4cda-a63d-d348857d0bd4 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:13.614241 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-154c3465-4223-4cda-a63d-d348857d0bd4 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab" status: 200 len: 1507 microversion: 2.1 time: 0.870181 Jul 19 22:43:13.624755 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1741/3478] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:12 2022] GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab => generated 1507 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:13.669339 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cd8eae57-4c97-4fc4-a714-53365dfa48c2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:13.691198 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cd8eae57-4c97-4fc4-a714-53365dfa48c2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1315 microversion: 2.1 time: 0.492862 Jul 19 22:43:13.692550 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1738/3479] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:13 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:13.756335 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cb2ce4c4-0562-4f2c-ab62-d35bc9449d6b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:13.757650 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cb2ce4c4-0562-4f2c-ab62-d35bc9449d6b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:13.766610 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cb2ce4c4-0562-4f2c-ab62-d35bc9449d6b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:13.767123 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cb2ce4c4-0562-4f2c-ab62-d35bc9449d6b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:13.767905 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cb2ce4c4-0562-4f2c-ab62-d35bc9449d6b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:13.768348 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cb2ce4c4-0562-4f2c-ab62-d35bc9449d6b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:14.198696 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b13b5dab-49d6-43d3-ad9e-abda73705686 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:14.199578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b13b5dab-49d6-43d3-ad9e-abda73705686 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:14.211627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b13b5dab-49d6-43d3-ad9e-abda73705686 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:14.221915 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b13b5dab-49d6-43d3-ad9e-abda73705686 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:14.227778 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b13b5dab-49d6-43d3-ad9e-abda73705686 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:14.228581 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b13b5dab-49d6-43d3-ad9e-abda73705686 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:14.293519 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cb2ce4c4-0562-4f2c-ab62-d35bc9449d6b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:14.308145 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cb2ce4c4-0562-4f2c-ab62-d35bc9449d6b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1506 microversion: 2.1 time: 0.556701 Jul 19 22:43:14.309019 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1742/3480] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:13 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1506 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:14.669182 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b13b5dab-49d6-43d3-ad9e-abda73705686 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:14.684031 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b13b5dab-49d6-43d3-ad9e-abda73705686 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1678 microversion: 2.1 time: 0.490051 Jul 19 22:43:14.691252 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1739/3481] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:14 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1678 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:14.700889 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d43604d8-42c8-43eb-93c8-057806801825 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:14.703412 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d43604d8-42c8-43eb-93c8-057806801825 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: d8568c5f-c480-48e5-85b2-7bae9f2ed0ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:14.716448 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d43604d8-42c8-43eb-93c8-057806801825 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:14.717046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d43604d8-42c8-43eb-93c8-057806801825 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:14.718208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d43604d8-42c8-43eb-93c8-057806801825 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:14.723422 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d43604d8-42c8-43eb-93c8-057806801825 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:15.146564 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-845fb31e-86e6-4d3a-a9e0-788729fc0dd2 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-2035274995", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "e303539b-888b-4e51-8526-f72fd168a70e"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:15.241023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-845fb31e-86e6-4d3a-a9e0-788729fc0dd2 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] validate_networks() for [('e303539b-888b-4e51-8526-f72fd168a70e', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:43:15.742708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d43604d8-42c8-43eb-93c8-057806801825 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:15.757659 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:43:15.761200 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d43604d8-42c8-43eb-93c8-057806801825 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab" status: 200 len: 1507 microversion: 2.1 time: 1.072077 Jul 19 22:43:15.763073 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1740/3482] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:14 2022] GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab => generated 1507 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:15.772235 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b71fe431-8041-4fc2-874e-d9c36d556538 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:15.774290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b71fe431-8041-4fc2-874e-d9c36d556538 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:15.783478 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b71fe431-8041-4fc2-874e-d9c36d556538 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:15.784208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b71fe431-8041-4fc2-874e-d9c36d556538 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:15.785208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b71fe431-8041-4fc2-874e-d9c36d556538 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:15.785818 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b71fe431-8041-4fc2-874e-d9c36d556538 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:16.174928 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b71fe431-8041-4fc2-874e-d9c36d556538 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:16.184438 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b71fe431-8041-4fc2-874e-d9c36d556538 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1315 microversion: 2.1 time: 0.419334 Jul 19 22:43:16.197148 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1741/3483] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:15 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1315 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:16.215376 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3b88fec7-9280-4433-8442-3a563cb67860 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:16.216112 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3b88fec7-9280-4433-8442-3a563cb67860 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:16.231984 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b88fec7-9280-4433-8442-3a563cb67860 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:16.232278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b88fec7-9280-4433-8442-3a563cb67860 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:16.235367 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b88fec7-9280-4433-8442-3a563cb67860 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:16.237002 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b88fec7-9280-4433-8442-3a563cb67860 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:16.644911 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-845fb31e-86e6-4d3a-a9e0-788729fc0dd2 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:43:16.645419 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-845fb31e-86e6-4d3a-a9e0-788729fc0dd2 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:43:16.645809 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-845fb31e-86e6-4d3a-a9e0-788729fc0dd2 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:43:16.646223 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-845fb31e-86e6-4d3a-a9e0-788729fc0dd2 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:43:16.646905 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-845fb31e-86e6-4d3a-a9e0-788729fc0dd2 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:43:16.662541 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-845fb31e-86e6-4d3a-a9e0-788729fc0dd2 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:16.670079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-845fb31e-86e6-4d3a-a9e0-788729fc0dd2 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:16.671221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-845fb31e-86e6-4d3a-a9e0-788729fc0dd2 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:16.671684 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-845fb31e-86e6-4d3a-a9e0-788729fc0dd2 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:16.720571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-845fb31e-86e6-4d3a-a9e0-788729fc0dd2 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Getting quotas for project 11f103d0425f4843ae7bbb7845062ad4. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:43:16.737957 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-845fb31e-86e6-4d3a-a9e0-788729fc0dd2 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Getting quotas for user 5dfc4784daa844c0bfaa1ecc56ef145f and project 11f103d0425f4843ae7bbb7845062ad4. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:43:16.757679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-845fb31e-86e6-4d3a-a9e0-788729fc0dd2 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:43:16.761524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-845fb31e-86e6-4d3a-a9e0-788729fc0dd2 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] [instance: ca48e3b5-480b-4381-bf77-201225664429] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:43:16.848728 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-845fb31e-86e6-4d3a-a9e0-788729fc0dd2 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.538324 Jul 19 22:43:16.849727 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1743/3484] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:43:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:43:16.865015 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b288adc7-c700-404e-877e-f2d9b323bc2e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:16.869645 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b288adc7-c700-404e-877e-f2d9b323bc2e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:16.881255 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b288adc7-c700-404e-877e-f2d9b323bc2e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:16.914816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b288adc7-c700-404e-877e-f2d9b323bc2e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:16.934608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b288adc7-c700-404e-877e-f2d9b323bc2e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:16.936724 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b288adc7-c700-404e-877e-f2d9b323bc2e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:16.938549 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3b88fec7-9280-4433-8442-3a563cb67860 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:16.956170 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3b88fec7-9280-4433-8442-3a563cb67860 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1506 microversion: 2.1 time: 0.755465 Jul 19 22:43:16.957353 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1742/3485] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:16 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1506 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:16.969324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1b1b0f47-92bf-460d-9b21-9e194eec42c7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:16.972957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1b1b0f47-92bf-460d-9b21-9e194eec42c7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: d8568c5f-c480-48e5-85b2-7bae9f2ed0ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:16.994623 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b1b0f47-92bf-460d-9b21-9e194eec42c7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:16.997926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b1b0f47-92bf-460d-9b21-9e194eec42c7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:16.999067 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b1b0f47-92bf-460d-9b21-9e194eec42c7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:16.999770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b1b0f47-92bf-460d-9b21-9e194eec42c7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:17.227925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1b1b0f47-92bf-460d-9b21-9e194eec42c7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:17.260653 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1b1b0f47-92bf-460d-9b21-9e194eec42c7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab" status: 200 len: 1306 microversion: 2.1 time: 0.301902 Jul 19 22:43:17.261270 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1743/3486] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:16 2022] GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab => generated 1306 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:17.278743 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6f139ce5-3fbb-4d34-bb7e-0dce983e9159 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:17.285012 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6f139ce5-3fbb-4d34-bb7e-0dce983e9159 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] [instance: ca48e3b5-480b-4381-bf77-201225664429] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:17.494591 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b288adc7-c700-404e-877e-f2d9b323bc2e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:17.518157 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b288adc7-c700-404e-877e-f2d9b323bc2e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1678 microversion: 2.1 time: 0.666092 Jul 19 22:43:17.529359 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1744/3487] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:16 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1678 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:17.537049 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-aeb1db4b-f6bc-411b-8c63-d4654ad5d7c0 req-cb80c228-3e9b-43ad-adf6-5f99fe40c507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8568c5f-c480-48e5-85b2-7bae9f2ed0ab", "name": "network-vif-deleted", "tag": "44c9546d-1329-4e17-b985-89687b1ef0fb"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:17.551172 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-aeb1db4b-f6bc-411b-8c63-d4654ad5d7c0 req-cb80c228-3e9b-43ad-adf6-5f99fe40c507 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:17.551996 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-aeb1db4b-f6bc-411b-8c63-d4654ad5d7c0 req-cb80c228-3e9b-43ad-adf6-5f99fe40c507 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:17.573711 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-aeb1db4b-f6bc-411b-8c63-d4654ad5d7c0 req-cb80c228-3e9b-43ad-adf6-5f99fe40c507 service nova] Creating event network-vif-deleted:44c9546d-1329-4e17-b985-89687b1ef0fb for instance d8568c5f-c480-48e5-85b2-7bae9f2ed0ab on n-h1-847009-3 Jul 19 22:43:17.589750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6f139ce5-3fbb-4d34-bb7e-0dce983e9159 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc4784daa844c0bfaa1ecc56ef145f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f103d0425f4843ae7bbb7845062ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:17.592822 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-aeb1db4b-f6bc-411b-8c63-d4654ad5d7c0 req-cb80c228-3e9b-43ad-adf6-5f99fe40c507 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061449 Jul 19 22:43:17.594060 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1745/3488] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:43:17.601880 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6f139ce5-3fbb-4d34-bb7e-0dce983e9159 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] 10.222.0.25 "GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429" status: 200 len: 1225 microversion: 2.1 time: 0.338297 Jul 19 22:43:17.602485 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1744/3489] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:17 2022] GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429 => generated 1225 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:17.617454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7c4132d1-0229-490f-b130-237576910bf1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:17.619512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7c4132d1-0229-490f-b130-237576910bf1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:17.630146 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7c4132d1-0229-490f-b130-237576910bf1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:17.630883 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7c4132d1-0229-490f-b130-237576910bf1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:17.633020 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7c4132d1-0229-490f-b130-237576910bf1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:17.633797 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7c4132d1-0229-490f-b130-237576910bf1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:17.899367 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7c4132d1-0229-490f-b130-237576910bf1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:17.914086 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7c4132d1-0229-490f-b130-237576910bf1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1315 microversion: 2.1 time: 0.317498 Jul 19 22:43:17.916596 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1746/3490] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:17 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:17.982355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-919dcb36-4205-4007-aa24-f124d44c773c tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:17.986792 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-919dcb36-4205-4007-aa24-f124d44c773c tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:18.016746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-919dcb36-4205-4007-aa24-f124d44c773c tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:18.017476 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-919dcb36-4205-4007-aa24-f124d44c773c tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:18.021045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-919dcb36-4205-4007-aa24-f124d44c773c tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:18.023414 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-919dcb36-4205-4007-aa24-f124d44c773c tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:18.276879 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aa9d3df3-d3d3-41e9-bc4d-2a75731d041a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:18.277802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-aa9d3df3-d3d3-41e9-bc4d-2a75731d041a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: d8568c5f-c480-48e5-85b2-7bae9f2ed0ab] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:18.287943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa9d3df3-d3d3-41e9-bc4d-2a75731d041a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:18.304776 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa9d3df3-d3d3-41e9-bc4d-2a75731d041a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:18.306101 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa9d3df3-d3d3-41e9-bc4d-2a75731d041a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:18.306814 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa9d3df3-d3d3-41e9-bc4d-2a75731d041a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:18.339450 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-aa9d3df3-d3d3-41e9-bc4d-2a75731d041a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] HTTP exception thrown: Instance d8568c5f-c480-48e5-85b2-7bae9f2ed0ab could not be found. Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aa9d3df3-d3d3-41e9-bc4d-2a75731d041a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Request method failure captured: Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab HTTP/1.1 Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zM1CVhkGzrLI27yplqtJpQo-i3-EKMGfRab3BLA-iVFSYzTm_PO2UXoSlqkSOVVu2ip8fmaaUlGTzOcY-1-PKTjTHCVYzWriYi14tgLboJXa9RPch13wobugtzkYLm5uZx9koMts7tA37UlK9MH24L7zFq17JufqAVvZobtx47aYg4 Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersTestJSON-1648920919 Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersTestJSON-1648920919-project Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1db06ac41e9f4fe290e535f703af484d Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersTestJSON-1648920919-project Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance d8568c5f-c480-48e5-85b2-7bae9f2ed0ab could not be found. Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'd8568c5f-c480-48e5-85b2-7bae9f2ed0ab'} Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8568c5f-c480-48e5-85b2-7bae9f2ed0ab could not be found. Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8568c5f-c480-48e5-85b2-7bae9f2ed0ab could not be found. Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:43:18.347649 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:43:18.355399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:43:18.355399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:43:18.355399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:43:18.355399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:43:18.355399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8568c5f-c480-48e5-85b2-7bae9f2ed0ab could not be found. Jul 19 22:43:18.355399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:43:18.357154 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aa9d3df3-d3d3-41e9-bc4d-2a75731d041a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Returning 404 to user: Instance d8568c5f-c480-48e5-85b2-7bae9f2ed0ab could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:43:18.358516 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-aa9d3df3-d3d3-41e9-bc4d-2a75731d041a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab" status: 404 len: 111 microversion: 2.1 time: 0.085215 Jul 19 22:43:18.371035 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1747/3491] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:18 2022] GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:43:18.379164 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-97113613-38f9-46be-85fc-7c83ee302f57 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Action: 'create', calling method: .version_select at 0x7f7a109fa700>, body: {"keypair": {"name": "tempest-key-1828141949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxrlYM4coQC8n8jUOsYjuHNk3ePZdIhbPuZXTlHiE50wlygSx9M8QULZrCa1xPHSfs04khzSxU47whpwkY9eehEovnIj+E1PmRgIoV8XbsAa0qfZZS9WHLzjaOW8K7k3w=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:18.408188 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-919dcb36-4205-4007-aa24-f124d44c773c tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:18.421079 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-919dcb36-4205-4007-aa24-f124d44c773c tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1506 microversion: 2.1 time: 0.448601 Jul 19 22:43:18.422971 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-97113613-38f9-46be-85fc-7c83ee302f57 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Getting quotas for project 9bd4d0caf2f347218af6ffd52f250c59. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:43:18.433761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-97113613-38f9-46be-85fc-7c83ee302f57 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Getting quotas for user 1db06ac41e9f4fe290e535f703af484d and project 9bd4d0caf2f347218af6ffd52f250c59. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:43:18.435252 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1745/3492] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:17 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1506 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:18.513807 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-97113613-38f9-46be-85fc-7c83ee302f57 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.140961 Jul 19 22:43:18.517017 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1748/3493] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:43:18 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:43:18.531175 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cd44629c-57fd-4bcc-8a9f-d60db6c85901 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '.version_select at 0x7f7a03e7c550>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:18.534932 n-d-847009-3 devstack@n-api.service[119337]: WARNING oslo_db.sqlalchemy.utils [None req-cd44629c-57fd-4bcc-8a9f-d60db6c85901 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 19 22:43:18.536374 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0bafefb7-45bd-4f8c-91db-70d447b13bf1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:18.537183 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0bafefb7-45bd-4f8c-91db-70d447b13bf1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:18.545779 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cd44629c-57fd-4bcc-8a9f-d60db6c85901 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.021781 Jul 19 22:43:18.547374 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1746/3494] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:43:18 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:43:18.559882 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0bafefb7-45bd-4f8c-91db-70d447b13bf1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:18.562925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0bafefb7-45bd-4f8c-91db-70d447b13bf1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:18.565112 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0bafefb7-45bd-4f8c-91db-70d447b13bf1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:18.568513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0bafefb7-45bd-4f8c-91db-70d447b13bf1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:18.632638 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-985209cd-2975-4c1a-b7fe-898aa4a404bd tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:18.635952 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-985209cd-2975-4c1a-b7fe-898aa4a404bd tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] [instance: ca48e3b5-480b-4381-bf77-201225664429] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:18.661885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-985209cd-2975-4c1a-b7fe-898aa4a404bd tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:18.664143 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-985209cd-2975-4c1a-b7fe-898aa4a404bd tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:18.664998 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-985209cd-2975-4c1a-b7fe-898aa4a404bd tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:18.665601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-985209cd-2975-4c1a-b7fe-898aa4a404bd tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:19.170375 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-985209cd-2975-4c1a-b7fe-898aa4a404bd tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc4784daa844c0bfaa1ecc56ef145f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f103d0425f4843ae7bbb7845062ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:19.184096 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-985209cd-2975-4c1a-b7fe-898aa4a404bd tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] 10.222.0.25 "GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429" status: 200 len: 1277 microversion: 2.1 time: 0.566953 Jul 19 22:43:19.207880 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1747/3495] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:18 2022] GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429 => generated 1277 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:19.217568 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bfaf56a2-86cf-4e35-b1d7-4036fcf03ce6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2123264359", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "key_name": "tempest-key-1828141949", "networks": [{"uuid": "6119d69d-194a-407a-a78f-64890b6702ed"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:19.368280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-bfaf56a2-86cf-4e35-b1d7-4036fcf03ce6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] validate_networks() for [('6119d69d-194a-407a-a78f-64890b6702ed', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:43:19.467080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0bafefb7-45bd-4f8c-91db-70d447b13bf1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:19.482087 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0bafefb7-45bd-4f8c-91db-70d447b13bf1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1655 microversion: 2.1 time: 0.949367 Jul 19 22:43:19.483470 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1749/3496] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:18 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1655 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:19.492690 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5e68f568-7d36-4b8d-91b8-4d9297eec999 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:19.493724 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5e68f568-7d36-4b8d-91b8-4d9297eec999 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:19.507481 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e68f568-7d36-4b8d-91b8-4d9297eec999 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:19.507939 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e68f568-7d36-4b8d-91b8-4d9297eec999 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:19.508747 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e68f568-7d36-4b8d-91b8-4d9297eec999 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:19.509187 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e68f568-7d36-4b8d-91b8-4d9297eec999 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:19.568447 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:43:20.637293 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5e68f568-7d36-4b8d-91b8-4d9297eec999 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:20.648107 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5e68f568-7d36-4b8d-91b8-4d9297eec999 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1315 microversion: 2.1 time: 1.160746 Jul 19 22:43:20.648748 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1750/3497] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:19 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1315 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:20.654985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e94bd04f-f506-45ad-901a-d5f9e5a8f1c3 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:20.655570 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e94bd04f-f506-45ad-901a-d5f9e5a8f1c3 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:20.684792 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e94bd04f-f506-45ad-901a-d5f9e5a8f1c3 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:20.685261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e94bd04f-f506-45ad-901a-d5f9e5a8f1c3 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:20.686069 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e94bd04f-f506-45ad-901a-d5f9e5a8f1c3 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:20.686515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e94bd04f-f506-45ad-901a-d5f9e5a8f1c3 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:21.547425 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e94bd04f-f506-45ad-901a-d5f9e5a8f1c3 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:21.562401 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e94bd04f-f506-45ad-901a-d5f9e5a8f1c3 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1486 microversion: 2.1 time: 0.912558 Jul 19 22:43:21.575483 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1751/3498] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:20 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1486 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:21.589761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3a3ca99f-da7e-442f-8de2-ddba54fab2a4 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:21.616733 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a3ca99f-da7e-442f-8de2-ddba54fab2a4 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:21.617705 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a3ca99f-da7e-442f-8de2-ddba54fab2a4 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:21.696931 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3a3ca99f-da7e-442f-8de2-ddba54fab2a4 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Going to try to start instance {{(pid=119338) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 22:43:21.712332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-bfaf56a2-86cf-4e35-b1d7-4036fcf03ce6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:43:21.713971 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-bfaf56a2-86cf-4e35-b1d7-4036fcf03ce6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:43:21.714669 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-bfaf56a2-86cf-4e35-b1d7-4036fcf03ce6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:43:21.715827 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-bfaf56a2-86cf-4e35-b1d7-4036fcf03ce6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:43:21.716503 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-bfaf56a2-86cf-4e35-b1d7-4036fcf03ce6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:43:21.770530 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bfaf56a2-86cf-4e35-b1d7-4036fcf03ce6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:21.779448 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bfaf56a2-86cf-4e35-b1d7-4036fcf03ce6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:21.784021 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bfaf56a2-86cf-4e35-b1d7-4036fcf03ce6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:21.790432 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bfaf56a2-86cf-4e35-b1d7-4036fcf03ce6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:21.873702 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3a3ca99f-da7e-442f-8de2-ddba54fab2a4 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action" status: 202 len: 0 microversion: 2.1 time: 0.294822 Jul 19 22:43:21.883869 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1752/3499] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:43:21 2022] POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:43:21.906600 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-916b55d4-aec1-4d47-91fc-1a8e7cb2d519 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:21.911075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-916b55d4-aec1-4d47-91fc-1a8e7cb2d519 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] [instance: ca48e3b5-480b-4381-bf77-201225664429] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:21.921343 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-916b55d4-aec1-4d47-91fc-1a8e7cb2d519 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:21.922432 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-916b55d4-aec1-4d47-91fc-1a8e7cb2d519 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:21.923542 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-916b55d4-aec1-4d47-91fc-1a8e7cb2d519 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:21.924643 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-916b55d4-aec1-4d47-91fc-1a8e7cb2d519 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:21.925409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-bfaf56a2-86cf-4e35-b1d7-4036fcf03ce6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Getting quotas for project 9bd4d0caf2f347218af6ffd52f250c59. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:43:21.950702 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-bfaf56a2-86cf-4e35-b1d7-4036fcf03ce6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Getting quotas for user 1db06ac41e9f4fe290e535f703af484d and project 9bd4d0caf2f347218af6ffd52f250c59. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:43:22.016323 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bfaf56a2-86cf-4e35-b1d7-4036fcf03ce6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:43:22.019168 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bfaf56a2-86cf-4e35-b1d7-4036fcf03ce6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:43:22.201567 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bfaf56a2-86cf-4e35-b1d7-4036fcf03ce6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.989576 Jul 19 22:43:22.202156 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1748/3500] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:43:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:43:22.215776 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1d1d40d5-ca1d-42e6-9747-b9ba76d54e10 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:22.216369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1d1d40d5-ca1d-42e6-9747-b9ba76d54e10 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:22.233443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d1d40d5-ca1d-42e6-9747-b9ba76d54e10 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:22.233443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d1d40d5-ca1d-42e6-9747-b9ba76d54e10 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:22.239143 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d1d40d5-ca1d-42e6-9747-b9ba76d54e10 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:22.239143 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d1d40d5-ca1d-42e6-9747-b9ba76d54e10 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:22.443703 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1d1d40d5-ca1d-42e6-9747-b9ba76d54e10 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "POST /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1/action" status: 202 len: 0 microversion: 2.1 time: 0.237251 Jul 19 22:43:22.443899 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1749/3501] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:43:22 2022] POST /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:43:23.374379 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-916b55d4-aec1-4d47-91fc-1a8e7cb2d519 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc4784daa844c0bfaa1ecc56ef145f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f103d0425f4843ae7bbb7845062ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:23.386099 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-916b55d4-aec1-4d47-91fc-1a8e7cb2d519 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] 10.222.0.25 "GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429" status: 200 len: 1325 microversion: 2.1 time: 1.499952 Jul 19 22:43:23.400627 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1753/3502] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:21 2022] GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429 => generated 1325 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:23.423697 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-696a617a-2ea4-454d-ae82-82039c78aa54 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Action: 'create', calling method: .version_select at 0x7f7a03a1d1f0>, body: {"keypair": {"name": "tempest-keypair-1763800021", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7TDil+OT8wuMH6W8ARoBZ4RvRsGnVVaQ3VBfBJSSAFUR+U+W/hzkdip1A3lphj6z5lz3Gc/GGRAEosf8iose54DoCzh8RgUb8WGeibkbV7wXrClADjrfBK3X9et0cdsQ=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:23.497133 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-696a617a-2ea4-454d-ae82-82039c78aa54 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Getting quotas for project a791e36c385948f2b2a879b95fa6b209. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:43:23.513941 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ab237326-3f1b-4acd-a1bb-24f83da13d7d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:23.514690 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ab237326-3f1b-4acd-a1bb-24f83da13d7d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:23.563589 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab237326-3f1b-4acd-a1bb-24f83da13d7d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:23.565206 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-696a617a-2ea4-454d-ae82-82039c78aa54 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Getting quotas for user 424ce594215247f28c0311dd73ac4b17 and project a791e36c385948f2b2a879b95fa6b209. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:43:23.575004 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab237326-3f1b-4acd-a1bb-24f83da13d7d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:23.585491 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab237326-3f1b-4acd-a1bb-24f83da13d7d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:23.586274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab237326-3f1b-4acd-a1bb-24f83da13d7d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:23.777094 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-696a617a-2ea4-454d-ae82-82039c78aa54 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.368891 Jul 19 22:43:23.787811 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1754/3503] 10.222.0.25 () {62 vars in 1199 bytes} [Tue Jul 19 22:43:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 385 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 22:43:23.813483 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6a4877ae-6408-49d8-adb6-24c1aef6e901 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:23.815552 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6a4877ae-6408-49d8-adb6-24c1aef6e901 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:23.883226 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a4877ae-6408-49d8-adb6-24c1aef6e901 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:23.887047 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a4877ae-6408-49d8-adb6-24c1aef6e901 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:23.888800 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a4877ae-6408-49d8-adb6-24c1aef6e901 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:23.891771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a4877ae-6408-49d8-adb6-24c1aef6e901 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:25.693661 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ab237326-3f1b-4acd-a1bb-24f83da13d7d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:25.711806 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ab237326-3f1b-4acd-a1bb-24f83da13d7d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1315 microversion: 2.1 time: 3.263836 Jul 19 22:43:25.712469 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1750/3504] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:22 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1315 bytes in 3268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:25.724893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-312c8a92-cdc0-4866-a324-9d84839d1ff2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:25.732834 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-312c8a92-cdc0-4866-a324-9d84839d1ff2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:25.759256 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-312c8a92-cdc0-4866-a324-9d84839d1ff2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:25.759943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-312c8a92-cdc0-4866-a324-9d84839d1ff2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:25.760888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-312c8a92-cdc0-4866-a324-9d84839d1ff2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:25.761489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-312c8a92-cdc0-4866-a324-9d84839d1ff2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:26.235980 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-312c8a92-cdc0-4866-a324-9d84839d1ff2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:26.259149 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-312c8a92-cdc0-4866-a324-9d84839d1ff2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b" status: 200 len: 1287 microversion: 2.1 time: 0.539330 Jul 19 22:43:26.262665 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1751/3505] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:25 2022] GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b => generated 1287 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:26.291236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9cbaac56-1956-41d1-bfc9-50d86d0d9d72 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:26.293233 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9cbaac56-1956-41d1-bfc9-50d86d0d9d72 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:26.326847 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9cbaac56-1956-41d1-bfc9-50d86d0d9d72 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:26.328150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9cbaac56-1956-41d1-bfc9-50d86d0d9d72 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:26.330023 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9cbaac56-1956-41d1-bfc9-50d86d0d9d72 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:26.331377 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9cbaac56-1956-41d1-bfc9-50d86d0d9d72 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:26.477087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6a4877ae-6408-49d8-adb6-24c1aef6e901 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:26.491206 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6a4877ae-6408-49d8-adb6-24c1aef6e901 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1664 microversion: 2.1 time: 2.699307 Jul 19 22:43:26.492684 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1755/3506] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:23 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1664 bytes in 2704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:26.497738 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-8dc073cc-814f-4a42-8c1b-a65e4aba4931 req-953934d2-4e57-4146-a3b7-76a69243db51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1", "name": "network-vif-plugged", "status": "completed", "tag": "2141535c-9709-4a08-b290-b35a8c739837"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:26.529198 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-8dc073cc-814f-4a42-8c1b-a65e4aba4931 req-953934d2-4e57-4146-a3b7-76a69243db51 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:26.530062 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-8dc073cc-814f-4a42-8c1b-a65e4aba4931 req-953934d2-4e57-4146-a3b7-76a69243db51 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:26.558674 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-8dc073cc-814f-4a42-8c1b-a65e4aba4931 req-953934d2-4e57-4146-a3b7-76a69243db51 service nova] Creating event network-vif-plugged:2141535c-9709-4a08-b290-b35a8c739837 for instance 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 on n-h2-847009-3 Jul 19 22:43:26.566211 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-8dc073cc-814f-4a42-8c1b-a65e4aba4931 req-953934d2-4e57-4146-a3b7-76a69243db51 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071010 Jul 19 22:43:26.567793 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1756/3507] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:43:26.574545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-95a55aa6-6308-4bfa-b854-50cab9655c21 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:26.575708 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-95a55aa6-6308-4bfa-b854-50cab9655c21 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] [instance: ca48e3b5-480b-4381-bf77-201225664429] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:26.635609 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-95a55aa6-6308-4bfa-b854-50cab9655c21 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:26.636355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-95a55aa6-6308-4bfa-b854-50cab9655c21 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:26.637336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-95a55aa6-6308-4bfa-b854-50cab9655c21 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:26.644143 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-95a55aa6-6308-4bfa-b854-50cab9655c21 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:26.696041 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:43:27.281532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9cbaac56-1956-41d1-bfc9-50d86d0d9d72 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:27.293629 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9cbaac56-1956-41d1-bfc9-50d86d0d9d72 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1500 microversion: 2.1 time: 1.026923 Jul 19 22:43:27.305448 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1752/3508] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:26 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1500 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:27.320617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-09199758-5351-4ef2-b263-d97ced78b05c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:27.320617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-09199758-5351-4ef2-b263-d97ced78b05c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:27.346892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-09199758-5351-4ef2-b263-d97ced78b05c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:27.347377 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-09199758-5351-4ef2-b263-d97ced78b05c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:27.348182 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-09199758-5351-4ef2-b263-d97ced78b05c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:27.348631 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-09199758-5351-4ef2-b263-d97ced78b05c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:27.422573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-95a55aa6-6308-4bfa-b854-50cab9655c21 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc4784daa844c0bfaa1ecc56ef145f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f103d0425f4843ae7bbb7845062ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:27.433826 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-95a55aa6-6308-4bfa-b854-50cab9655c21 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] 10.222.0.25 "GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429" status: 200 len: 1325 microversion: 2.1 time: 0.864512 Jul 19 22:43:27.434430 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1757/3509] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:26 2022] GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429 => generated 1325 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:27.464843 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f1ece67c-1e92-4794-a881-45b2a322d821 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:27.465502 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f1ece67c-1e92-4794-a881-45b2a322d821 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:27.482371 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1ece67c-1e92-4794-a881-45b2a322d821 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:27.485953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1ece67c-1e92-4794-a881-45b2a322d821 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:27.486989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1ece67c-1e92-4794-a881-45b2a322d821 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:27.494033 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1ece67c-1e92-4794-a881-45b2a322d821 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:27.833856 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f1ece67c-1e92-4794-a881-45b2a322d821 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:27.854096 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f1ece67c-1e92-4794-a881-45b2a322d821 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b" status: 200 len: 1287 microversion: 2.1 time: 0.395473 Jul 19 22:43:27.855307 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1758/3510] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:27 2022] GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b => generated 1287 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:27.860744 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ab65a51c-56b3-4dcb-9469-0e4da3410898 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:27.865584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ab65a51c-56b3-4dcb-9469-0e4da3410898 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:27.889013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab65a51c-56b3-4dcb-9469-0e4da3410898 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:27.891916 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab65a51c-56b3-4dcb-9469-0e4da3410898 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:27.893935 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab65a51c-56b3-4dcb-9469-0e4da3410898 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:27.894926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab65a51c-56b3-4dcb-9469-0e4da3410898 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:27.970482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ab65a51c-56b3-4dcb-9469-0e4da3410898 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:43:27.976957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-09199758-5351-4ef2-b263-d97ced78b05c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:27.998569 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-09199758-5351-4ef2-b263-d97ced78b05c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1315 microversion: 2.1 time: 0.691494 Jul 19 22:43:28.004151 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1753/3511] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:27 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1315 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:28.018296 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-318dfa87-53f0-4ddc-b218-aecbafcdc365 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:28.021919 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-318dfa87-53f0-4ddc-b218-aecbafcdc365 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:28.040157 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-318dfa87-53f0-4ddc-b218-aecbafcdc365 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:28.049915 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-318dfa87-53f0-4ddc-b218-aecbafcdc365 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:28.051503 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-318dfa87-53f0-4ddc-b218-aecbafcdc365 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:28.052549 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-318dfa87-53f0-4ddc-b218-aecbafcdc365 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:28.205972 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ab65a51c-56b3-4dcb-9469-0e4da3410898 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "DELETE /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 204 len: 0 microversion: 2.1 time: 0.349070 Jul 19 22:43:28.208608 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1759/3512] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:43:27 2022] DELETE /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:43:28.225682 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-387d2242-2595-4897-8e95-2cb4af276eb0 req-456bfeea-6725-4b4d-9ee0-04a230ed26f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca48e3b5-480b-4381-bf77-201225664429", "tag": "ce8e713b-91a7-4c7f-9f02-11795f7f300a"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:28.252052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-387d2242-2595-4897-8e95-2cb4af276eb0 req-456bfeea-6725-4b4d-9ee0-04a230ed26f1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:28.255159 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-387d2242-2595-4897-8e95-2cb4af276eb0 req-456bfeea-6725-4b4d-9ee0-04a230ed26f1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:28.291257 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-387d2242-2595-4897-8e95-2cb4af276eb0 req-456bfeea-6725-4b4d-9ee0-04a230ed26f1 service nova] Creating event network-changed:ce8e713b-91a7-4c7f-9f02-11795f7f300a for instance ca48e3b5-480b-4381-bf77-201225664429 on n-h1-847009-3 Jul 19 22:43:28.316985 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-387d2242-2595-4897-8e95-2cb4af276eb0 req-456bfeea-6725-4b4d-9ee0-04a230ed26f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100568 Jul 19 22:43:28.321047 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1760/3513] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:43:28.337176 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3a910bb7-48dc-4907-abc8-b093ae98c405 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:28.337919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3a910bb7-48dc-4907-abc8-b093ae98c405 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:28.347745 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:43:28.360323 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a910bb7-48dc-4907-abc8-b093ae98c405 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:28.361199 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a910bb7-48dc-4907-abc8-b093ae98c405 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:28.362937 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a910bb7-48dc-4907-abc8-b093ae98c405 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:28.365931 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a910bb7-48dc-4907-abc8-b093ae98c405 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:28.668921 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-318dfa87-53f0-4ddc-b218-aecbafcdc365 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:28.684103 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-318dfa87-53f0-4ddc-b218-aecbafcdc365 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.676352 Jul 19 22:43:28.686460 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1754/3514] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:28 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:28.702513 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-32e9d293-d0ee-4636-9a0b-7ad6724baa39 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:28.703192 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-32e9d293-d0ee-4636-9a0b-7ad6724baa39 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] [instance: ca48e3b5-480b-4381-bf77-201225664429] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:28.719253 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32e9d293-d0ee-4636-9a0b-7ad6724baa39 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:28.721947 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32e9d293-d0ee-4636-9a0b-7ad6724baa39 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:28.722900 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32e9d293-d0ee-4636-9a0b-7ad6724baa39 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:28.726022 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32e9d293-d0ee-4636-9a0b-7ad6724baa39 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:28.930422 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3a910bb7-48dc-4907-abc8-b093ae98c405 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:28.941093 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3a910bb7-48dc-4907-abc8-b093ae98c405 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1506 microversion: 2.1 time: 0.618439 Jul 19 22:43:28.941902 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1761/3515] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:28 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1506 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:28.951140 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-faac00ba-1c64-4770-bf4c-c9ca3664498f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:28.952179 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-faac00ba-1c64-4770-bf4c-c9ca3664498f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:28.961317 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-faac00ba-1c64-4770-bf4c-c9ca3664498f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:28.963155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-faac00ba-1c64-4770-bf4c-c9ca3664498f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:28.964359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-faac00ba-1c64-4770-bf4c-c9ca3664498f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:28.966043 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-faac00ba-1c64-4770-bf4c-c9ca3664498f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:29.216696 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-32e9d293-d0ee-4636-9a0b-7ad6724baa39 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc4784daa844c0bfaa1ecc56ef145f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f103d0425f4843ae7bbb7845062ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:29.226363 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-32e9d293-d0ee-4636-9a0b-7ad6724baa39 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] 10.222.0.25 "GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429" status: 200 len: 1325 microversion: 2.1 time: 0.537346 Jul 19 22:43:29.227526 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1755/3516] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:28 2022] GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429 => generated 1325 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:29.233979 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b75ebcb5-0b9c-4411-8ce0-c9db67a8f168 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-263109856", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ad4f01c9-a1ad-4d3c-878a-dc1583863168"}, {"port": "aaebb168-a0dc-4323-91f4-47daf8a94255", "tag": "port-1"}, {"port": "c237ae7f-dc1c-4392-aa4a-f5d505a41de6", "tag": "port-2"}, {"uuid": "75fccd86-5d90-49af-b91e-262411c2666a", "tag": "net-1"}, {"uuid": "75fccd86-5d90-49af-b91e-262411c2666a"}, {"uuid": "2c155ba1-98b6-4f2a-bf4b-65b15338631d", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "2c155ba1-98b6-4f2a-bf4b-65b15338631d", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "179a4677-bac3-4f99-aa7a-4c9c90e68050", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "225fc73e-072b-4f42-b028-bf5f21431907", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "1079cedd-6d93-4d18-b8a1-888fad1af232", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1731399404"}], "key_name": "tempest-keypair-1763800021", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:29.390271 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-faac00ba-1c64-4770-bf4c-c9ca3664498f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:29.402241 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-faac00ba-1c64-4770-bf4c-c9ca3664498f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.456575 Jul 19 22:43:29.403306 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1762/3517] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:28 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:29.421469 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-793437c6-48f7-4692-92e2-b5ce1624fb87 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:29.427983 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-793437c6-48f7-4692-92e2-b5ce1624fb87 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:29.480609 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-793437c6-48f7-4692-92e2-b5ce1624fb87 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:29.481076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-793437c6-48f7-4692-92e2-b5ce1624fb87 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:29.481885 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-793437c6-48f7-4692-92e2-b5ce1624fb87 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:29.482477 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-793437c6-48f7-4692-92e2-b5ce1624fb87 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:29.532186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-b75ebcb5-0b9c-4411-8ce0-c9db67a8f168 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] validate_networks() for [('ad4f01c9-a1ad-4d3c-878a-dc1583863168', None, None, None, None, None), (None, None, 'aaebb168-a0dc-4323-91f4-47daf8a94255', None, None, None), (None, None, 'c237ae7f-dc1c-4392-aa4a-f5d505a41de6', None, None, None), ('75fccd86-5d90-49af-b91e-262411c2666a', None, None, None, None, None), ('75fccd86-5d90-49af-b91e-262411c2666a', None, None, None, None, None), ('2c155ba1-98b6-4f2a-bf4b-65b15338631d', '10.2.2.100', None, None, None, None), ('2c155ba1-98b6-4f2a-bf4b-65b15338631d', '10.2.2.200', None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:43:29.989332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-793437c6-48f7-4692-92e2-b5ce1624fb87 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:29.997422 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-793437c6-48f7-4692-92e2-b5ce1624fb87 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b" status: 200 len: 1329 microversion: 2.1 time: 0.591734 Jul 19 22:43:30.010439 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1763/3518] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:29 2022] GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b => generated 1329 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:30.015573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-eb77dd77-dc36-4679-9dc3-638e3fa0a949 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:30.016421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-eb77dd77-dc36-4679-9dc3-638e3fa0a949 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:30.024659 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eb77dd77-dc36-4679-9dc3-638e3fa0a949 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:30.025411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eb77dd77-dc36-4679-9dc3-638e3fa0a949 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:30.026272 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eb77dd77-dc36-4679-9dc3-638e3fa0a949 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:30.026796 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eb77dd77-dc36-4679-9dc3-638e3fa0a949 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:30.336478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-eb77dd77-dc36-4679-9dc3-638e3fa0a949 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:30.344307 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-eb77dd77-dc36-4679-9dc3-638e3fa0a949 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1315 microversion: 2.1 time: 0.332658 Jul 19 22:43:30.344900 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1764/3519] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:30 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:30.351061 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f1cdaa5f-0ba8-430f-8897-4bc75a789c84 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:30.351966 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f1cdaa5f-0ba8-430f-8897-4bc75a789c84 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:30.364154 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1cdaa5f-0ba8-430f-8897-4bc75a789c84 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:30.364617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1cdaa5f-0ba8-430f-8897-4bc75a789c84 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:30.365409 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1cdaa5f-0ba8-430f-8897-4bc75a789c84 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:30.365846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1cdaa5f-0ba8-430f-8897-4bc75a789c84 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:30.431485 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:43:30.438537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f1cdaa5f-0ba8-430f-8897-4bc75a789c84 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Unlocking {{(pid=119338) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 19 22:43:30.526031 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f1cdaa5f-0ba8-430f-8897-4bc75a789c84 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action" status: 202 len: 0 microversion: 2.1 time: 0.179114 Jul 19 22:43:30.527120 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1765/3520] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:43:30 2022] POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:43:30.533919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ea3c278e-a286-4b5d-8daf-db5cebc86442 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:30.535535 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ea3c278e-a286-4b5d-8daf-db5cebc86442 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:30.543574 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea3c278e-a286-4b5d-8daf-db5cebc86442 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:30.544170 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea3c278e-a286-4b5d-8daf-db5cebc86442 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:30.545827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea3c278e-a286-4b5d-8daf-db5cebc86442 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:30.546427 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea3c278e-a286-4b5d-8daf-db5cebc86442 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:30.821264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ea3c278e-a286-4b5d-8daf-db5cebc86442 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:30.830364 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ea3c278e-a286-4b5d-8daf-db5cebc86442 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1506 microversion: 2.1 time: 0.301782 Jul 19 22:43:30.831609 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1766/3521] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:30 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1506 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:30.844553 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e510f01a-0f06-43a5-bf77-d0763f290d4c tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:30.849045 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e510f01a-0f06-43a5-bf77-d0763f290d4c tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] [instance: ca48e3b5-480b-4381-bf77-201225664429] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:30.859667 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e510f01a-0f06-43a5-bf77-d0763f290d4c tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:30.860735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e510f01a-0f06-43a5-bf77-d0763f290d4c tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:30.862021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e510f01a-0f06-43a5-bf77-d0763f290d4c tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:30.863469 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e510f01a-0f06-43a5-bf77-d0763f290d4c tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:31.425743 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e510f01a-0f06-43a5-bf77-d0763f290d4c tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc4784daa844c0bfaa1ecc56ef145f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f103d0425f4843ae7bbb7845062ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:31.445268 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e510f01a-0f06-43a5-bf77-d0763f290d4c tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] 10.222.0.25 "GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429" status: 200 len: 1325 microversion: 2.1 time: 0.611812 Jul 19 22:43:31.446713 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1767/3522] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:30 2022] GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429 => generated 1325 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:31.481471 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9745bc1e-e048-4d4d-be42-a881ce2dd042 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:31.483500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9745bc1e-e048-4d4d-be42-a881ce2dd042 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:31.496471 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9745bc1e-e048-4d4d-be42-a881ce2dd042 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:31.498207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9745bc1e-e048-4d4d-be42-a881ce2dd042 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:31.500310 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9745bc1e-e048-4d4d-be42-a881ce2dd042 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:31.501216 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9745bc1e-e048-4d4d-be42-a881ce2dd042 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:31.867751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:43:31.978814 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=8 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:43:32.415418 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9745bc1e-e048-4d4d-be42-a881ce2dd042 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:32.429668 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9745bc1e-e048-4d4d-be42-a881ce2dd042 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.959279 Jul 19 22:43:32.447795 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1768/3523] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:31 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:32.456351 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-557ab398-827e-4035-a9f5-438e302531fb tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:32.457413 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-557ab398-827e-4035-a9f5-438e302531fb tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:32.465241 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-557ab398-827e-4035-a9f5-438e302531fb tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:32.468173 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-557ab398-827e-4035-a9f5-438e302531fb tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:32.470238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-557ab398-827e-4035-a9f5-438e302531fb tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:32.470967 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-557ab398-827e-4035-a9f5-438e302531fb tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:33.184187 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-557ab398-827e-4035-a9f5-438e302531fb tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:33.194475 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-557ab398-827e-4035-a9f5-438e302531fb tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b" status: 200 len: 1329 microversion: 2.1 time: 0.745257 Jul 19 22:43:33.195102 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1769/3524] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:32 2022] GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b => generated 1329 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:33.205552 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-88f2595c-896f-4fa6-8727-1b160eb51b99 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:33.210257 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-88f2595c-896f-4fa6-8727-1b160eb51b99 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:33.228752 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-88f2595c-896f-4fa6-8727-1b160eb51b99 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:33.229216 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-88f2595c-896f-4fa6-8727-1b160eb51b99 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:33.230014 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-88f2595c-896f-4fa6-8727-1b160eb51b99 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:33.230454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-88f2595c-896f-4fa6-8727-1b160eb51b99 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:33.629655 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=14 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:43:33.728148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-88f2595c-896f-4fa6-8727-1b160eb51b99 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:33.738152 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-88f2595c-896f-4fa6-8727-1b160eb51b99 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1502 microversion: 2.1 time: 0.536734 Jul 19 22:43:33.738751 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1770/3525] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:33 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1502 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:33.755863 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f1430bf8-c59a-48f7-8705-59c50a2cc547 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:33.757458 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f1430bf8-c59a-48f7-8705-59c50a2cc547 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:33.764789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1430bf8-c59a-48f7-8705-59c50a2cc547 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:33.765528 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1430bf8-c59a-48f7-8705-59c50a2cc547 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:33.766632 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1430bf8-c59a-48f7-8705-59c50a2cc547 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:33.767949 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1430bf8-c59a-48f7-8705-59c50a2cc547 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:34.404009 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f1430bf8-c59a-48f7-8705-59c50a2cc547 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:34.412079 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f1430bf8-c59a-48f7-8705-59c50a2cc547 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 200 len: 1506 microversion: 2.1 time: 0.660913 Jul 19 22:43:34.412680 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1771/3526] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:33 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 1506 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:34.426457 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-af499a69-97f5-4c87-bd7a-d6c8ee240c5e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:34.429444 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-af499a69-97f5-4c87-bd7a-d6c8ee240c5e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:34.445938 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-af499a69-97f5-4c87-bd7a-d6c8ee240c5e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:34.446419 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-af499a69-97f5-4c87-bd7a-d6c8ee240c5e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:34.447397 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-af499a69-97f5-4c87-bd7a-d6c8ee240c5e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:34.447751 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-af499a69-97f5-4c87-bd7a-d6c8ee240c5e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:35.198925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-af499a69-97f5-4c87-bd7a-d6c8ee240c5e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:35.211477 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-af499a69-97f5-4c87-bd7a-d6c8ee240c5e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.795058 Jul 19 22:43:35.212709 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1772/3527] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:34 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:35.230799 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-81a52a9b-c332-43a9-ab29-9a5f4a03c220 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:35.231566 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-81a52a9b-c332-43a9-ab29-9a5f4a03c220 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] [instance: ca48e3b5-480b-4381-bf77-201225664429] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:35.238684 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81a52a9b-c332-43a9-ab29-9a5f4a03c220 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:35.240342 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81a52a9b-c332-43a9-ab29-9a5f4a03c220 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:35.242433 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81a52a9b-c332-43a9-ab29-9a5f4a03c220 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:35.243017 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81a52a9b-c332-43a9-ab29-9a5f4a03c220 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:35.580071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-81a52a9b-c332-43a9-ab29-9a5f4a03c220 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc4784daa844c0bfaa1ecc56ef145f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f103d0425f4843ae7bbb7845062ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:35.606555 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-81a52a9b-c332-43a9-ab29-9a5f4a03c220 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] 10.222.0.25 "GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429" status: 200 len: 1325 microversion: 2.1 time: 0.392187 Jul 19 22:43:35.607872 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1773/3528] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:35 2022] GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429 => generated 1325 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:35.617786 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-89d4c38b-a61e-456a-93da-5a5667300cab tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:35.635586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-89d4c38b-a61e-456a-93da-5a5667300cab tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:35.636037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-89d4c38b-a61e-456a-93da-5a5667300cab tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:35.661677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-89d4c38b-a61e-456a-93da-5a5667300cab tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Going to try to stop instance {{(pid=119338) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 22:43:35.724596 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-89d4c38b-a61e-456a-93da-5a5667300cab tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "POST /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1/action" status: 202 len: 0 microversion: 2.1 time: 0.113825 Jul 19 22:43:35.728507 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1774/3529] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:43:35 2022] POST /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:43:35.735378 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e34ac419-78ae-4499-91eb-d4356c649f48 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:35.736756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e34ac419-78ae-4499-91eb-d4356c649f48 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:35.744691 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e34ac419-78ae-4499-91eb-d4356c649f48 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:35.745589 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e34ac419-78ae-4499-91eb-d4356c649f48 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:35.746727 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e34ac419-78ae-4499-91eb-d4356c649f48 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:35.747459 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e34ac419-78ae-4499-91eb-d4356c649f48 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:36.033108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e34ac419-78ae-4499-91eb-d4356c649f48 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:36.047362 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e34ac419-78ae-4499-91eb-d4356c649f48 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b" status: 200 len: 1329 microversion: 2.1 time: 0.317058 Jul 19 22:43:36.047962 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1775/3530] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:35 2022] GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b => generated 1329 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:36.058964 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-b75ebcb5-0b9c-4411-8ce0-c9db67a8f168 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:43:36.059516 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-b75ebcb5-0b9c-4411-8ce0-c9db67a8f168 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:43:36.059907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-b75ebcb5-0b9c-4411-8ce0-c9db67a8f168 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:43:36.060544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-b75ebcb5-0b9c-4411-8ce0-c9db67a8f168 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:43:36.060922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-b75ebcb5-0b9c-4411-8ce0-c9db67a8f168 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:43:36.065312 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-8e2a5620-208e-4cd2-8794-0ea9c9e73260 req-8ed934d8-79be-43c3-8445-3165293c4798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ea50d87-53d3-4f21-a4f0-8cd68de4df2b", "tag": "8bb8353c-1279-4e9c-8a81-384791f33d47"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:36.074079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b75ebcb5-0b9c-4411-8ce0-c9db67a8f168 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:36.074964 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b75ebcb5-0b9c-4411-8ce0-c9db67a8f168 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:36.076245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b75ebcb5-0b9c-4411-8ce0-c9db67a8f168 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:36.077035 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b75ebcb5-0b9c-4411-8ce0-c9db67a8f168 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:36.082600 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-8e2a5620-208e-4cd2-8794-0ea9c9e73260 req-8ed934d8-79be-43c3-8445-3165293c4798 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:36.083064 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-8e2a5620-208e-4cd2-8794-0ea9c9e73260 req-8ed934d8-79be-43c3-8445-3165293c4798 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:36.104158 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-b75ebcb5-0b9c-4411-8ce0-c9db67a8f168 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Getting quotas for project a791e36c385948f2b2a879b95fa6b209. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:43:36.111217 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-b75ebcb5-0b9c-4411-8ce0-c9db67a8f168 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Getting quotas for user 424ce594215247f28c0311dd73ac4b17 and project a791e36c385948f2b2a879b95fa6b209. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:43:36.127613 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-8e2a5620-208e-4cd2-8794-0ea9c9e73260 req-8ed934d8-79be-43c3-8445-3165293c4798 service nova] Creating event network-changed:8bb8353c-1279-4e9c-8a81-384791f33d47 for instance 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b on n-h1-847009-3 Jul 19 22:43:36.140090 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-8e2a5620-208e-4cd2-8794-0ea9c9e73260 req-8ed934d8-79be-43c3-8445-3165293c4798 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089514 Jul 19 22:43:36.140769 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1776/3531] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:43:36.148319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1a8aad91-87c7-4a3e-b3fb-ac66c5f0e423 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-453130320", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "2c61a0af-d361-411d-9124-99847f8a27ad"}], "security_groups": [{"name": "tempest-securitygroup--1297455706"}], "key_name": "tempest-keypair-1334488762", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "997e47e8-2837-4e0a-9426-2ca89c163d73", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:36.307682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b75ebcb5-0b9c-4411-8ce0-c9db67a8f168 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:43:36.310683 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b75ebcb5-0b9c-4411-8ce0-c9db67a8f168 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='179a4677-bac3-4f99-aa7a-4c9c90e68050',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='225fc73e-072b-4f42-b028-bf5f21431907',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1079cedd-6d93-4d18-b8a1-888fad1af232',volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:43:36.378332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-1a8aad91-87c7-4a3e-b3fb-ac66c5f0e423 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] validate_networks() for [('2c61a0af-d361-411d-9124-99847f8a27ad', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:43:36.686591 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b75ebcb5-0b9c-4411-8ce0-c9db67a8f168 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 7.457539 Jul 19 22:43:36.687278 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1756/3532] 10.222.0.25 () {62 vars in 1188 bytes} [Tue Jul 19 22:43:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 7459 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 22:43:36.692331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-893a4fb3-7cf7-4e1a-9a28-d25585194838 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:36.693617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-893a4fb3-7cf7-4e1a-9a28-d25585194838 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:36.700601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-893a4fb3-7cf7-4e1a-9a28-d25585194838 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:36.701379 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-893a4fb3-7cf7-4e1a-9a28-d25585194838 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:36.702431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-893a4fb3-7cf7-4e1a-9a28-d25585194838 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:36.703070 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-893a4fb3-7cf7-4e1a-9a28-d25585194838 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:37.164878 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-893a4fb3-7cf7-4e1a-9a28-d25585194838 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:37.174197 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-893a4fb3-7cf7-4e1a-9a28-d25585194838 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.485538 Jul 19 22:43:37.175796 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1757/3533] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:36 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:37.188285 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3fb13692-3e4d-4228-84e5-f3f60a6e057b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:37.189475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3fb13692-3e4d-4228-84e5-f3f60a6e057b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 50b53156-37b4-433b-8f13-9b788febd9e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:37.201037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3fb13692-3e4d-4228-84e5-f3f60a6e057b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:37.201727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3fb13692-3e4d-4228-84e5-f3f60a6e057b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:37.202860 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3fb13692-3e4d-4228-84e5-f3f60a6e057b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:37.203688 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3fb13692-3e4d-4228-84e5-f3f60a6e057b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:37.232514 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-3fb13692-3e4d-4228-84e5-f3f60a6e057b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] HTTP exception thrown: Instance 50b53156-37b4-433b-8f13-9b788febd9e1 could not be found. Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3fb13692-3e4d-4228-84e5-f3f60a6e057b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Request method failure captured: Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 HTTP/1.1 Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zL7lebP250rUpyyKGvwzHnyOvog8MyRmmJHeQqi1MU-LDwhJlQCyxLKZsma9VDPc7O44FE-nJmRUSO-ngUHSbMzsVg7Ly_Cj5mzS0743nCH6UkAWG0ZKs6-5izn29XORcLD1DaZakTKwJDDdXgkmKJrMxH7fQsMHF4CnKvThQWSIBQ Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 5a26234ff8b14bbcb4891ef363fb4739 Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerRescueTestJSON-1513266042 Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5a26234ff8b14bbcb4891ef363fb4739"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5a26234ff8b14bbcb4891ef363fb4739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5a26234ff8b14bbcb4891ef363fb4739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5a26234ff8b14bbcb4891ef363fb4739"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerRescueTestJSON-1513266042 Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 5a26234ff8b14bbcb4891ef363fb4739 Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerRescueTestJSON-1513266042 Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerRescueTestJSON-1513266042-project Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 7bc703828daa4c7ea61106f3b4e3bc3f Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerRescueTestJSON-1513266042-project Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 50b53156-37b4-433b-8f13-9b788febd9e1 could not be found. Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '50b53156-37b4-433b-8f13-9b788febd9e1'} Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50b53156-37b4-433b-8f13-9b788febd9e1 could not be found. Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50b53156-37b4-433b-8f13-9b788febd9e1 could not be found. Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:43:37.236079 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:43:37.241880 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:43:37.241880 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:43:37.241880 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:43:37.241880 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:43:37.241880 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:43:37.241880 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50b53156-37b4-433b-8f13-9b788febd9e1 could not be found. Jul 19 22:43:37.241880 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:43:37.241880 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3fb13692-3e4d-4228-84e5-f3f60a6e057b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Returning 404 to user: Instance 50b53156-37b4-433b-8f13-9b788febd9e1 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:43:37.241880 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3fb13692-3e4d-4228-84e5-f3f60a6e057b tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1" status: 404 len: 111 microversion: 2.1 time: 0.063699 Jul 19 22:43:37.246945 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1758/3534] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:37 2022] GET /compute/v2.1/servers/50b53156-37b4-433b-8f13-9b788febd9e1 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:43:37.250257 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-27339ca2-b101-43b5-b798-3b02a7da03a6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:37.252559 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-27339ca2-b101-43b5-b798-3b02a7da03a6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:37.259072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:43:37.265732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-27339ca2-b101-43b5-b798-3b02a7da03a6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:37.266926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-27339ca2-b101-43b5-b798-3b02a7da03a6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:37.267908 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-27339ca2-b101-43b5-b798-3b02a7da03a6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:37.268216 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-27339ca2-b101-43b5-b798-3b02a7da03a6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:37.399920 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-1a8aad91-87c7-4a3e-b3fb-ac66c5f0e423 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Getting quotas for project 6fcd1f228f434f4098ca2c8f7c4c4e1b. Resources: dict_keys(['metadata_items']) {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:43:37.407001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-1a8aad91-87c7-4a3e-b3fb-ac66c5f0e423 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Getting quotas for user a5edfaf424714e3bafaf391932f4a892 and project 6fcd1f228f434f4098ca2c8f7c4c4e1b. Resources: dict_keys(['metadata_items']) {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:43:37.428138 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-1a8aad91-87c7-4a3e-b3fb-ac66c5f0e423 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:43:37.429333 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-1a8aad91-87c7-4a3e-b3fb-ac66c5f0e423 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:43:37.430115 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-1a8aad91-87c7-4a3e-b3fb-ac66c5f0e423 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:43:37.435659 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-1a8aad91-87c7-4a3e-b3fb-ac66c5f0e423 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:43:37.436130 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-1a8aad91-87c7-4a3e-b3fb-ac66c5f0e423 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:43:37.452592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a8aad91-87c7-4a3e-b3fb-ac66c5f0e423 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:37.453715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a8aad91-87c7-4a3e-b3fb-ac66c5f0e423 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:37.454650 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a8aad91-87c7-4a3e-b3fb-ac66c5f0e423 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:37.455225 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a8aad91-87c7-4a3e-b3fb-ac66c5f0e423 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:37.478984 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-1a8aad91-87c7-4a3e-b3fb-ac66c5f0e423 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Getting quotas for project 6fcd1f228f434f4098ca2c8f7c4c4e1b. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:43:37.486716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-1a8aad91-87c7-4a3e-b3fb-ac66c5f0e423 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Getting quotas for user a5edfaf424714e3bafaf391932f4a892 and project 6fcd1f228f434f4098ca2c8f7c4c4e1b. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:43:37.586714 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1a8aad91-87c7-4a3e-b3fb-ac66c5f0e423 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:43:37.590090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1a8aad91-87c7-4a3e-b3fb-ac66c5f0e423 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='997e47e8-2837-4e0a-9426-2ca89c163d73',volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:43:37.614508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-27339ca2-b101-43b5-b798-3b02a7da03a6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:37.627885 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-27339ca2-b101-43b5-b798-3b02a7da03a6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1512 microversion: 2.1 time: 0.383352 Jul 19 22:43:37.629008 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1759/3535] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:37 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1512 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:37.640307 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-2a2c6967-c472-41bc-8918-10b7643bc361 req-ea857faf-04c8-4102-87de-a2a404ea2ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca48e3b5-480b-4381-bf77-201225664429", "name": "network-vif-plugged", "status": "completed", "tag": "ce8e713b-91a7-4c7f-9f02-11795f7f300a"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:37.650638 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-2a2c6967-c472-41bc-8918-10b7643bc361 req-ea857faf-04c8-4102-87de-a2a404ea2ab6 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:37.651251 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-2a2c6967-c472-41bc-8918-10b7643bc361 req-ea857faf-04c8-4102-87de-a2a404ea2ab6 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:37.669129 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-2a2c6967-c472-41bc-8918-10b7643bc361 req-ea857faf-04c8-4102-87de-a2a404ea2ab6 service nova] Creating event network-vif-plugged:ce8e713b-91a7-4c7f-9f02-11795f7f300a for instance ca48e3b5-480b-4381-bf77-201225664429 on n-h1-847009-3 Jul 19 22:43:37.675561 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-2a2c6967-c472-41bc-8918-10b7643bc361 req-ea857faf-04c8-4102-87de-a2a404ea2ab6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043887 Jul 19 22:43:37.677175 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1760/3536] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:43:37.684822 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4f12d04d-4f78-4351-aac3-6d806d698c41 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:37.685859 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4f12d04d-4f78-4351-aac3-6d806d698c41 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] [instance: ca48e3b5-480b-4381-bf77-201225664429] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:37.702402 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f12d04d-4f78-4351-aac3-6d806d698c41 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:37.702898 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f12d04d-4f78-4351-aac3-6d806d698c41 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:37.703905 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f12d04d-4f78-4351-aac3-6d806d698c41 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:37.704331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f12d04d-4f78-4351-aac3-6d806d698c41 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:37.707477 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:43:37.839869 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1a8aad91-87c7-4a3e-b3fb-ac66c5f0e423 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.697829 Jul 19 22:43:37.866462 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1777/3537] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:43:36 2022] POST /compute/v2.1/servers => generated 407 bytes in 1724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:43:37.873131 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a4ca3dd8-3df8-4c9d-9875-b6497e434bfe tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:37.875600 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a4ca3dd8-3df8-4c9d-9875-b6497e434bfe tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:37.884655 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a4ca3dd8-3df8-4c9d-9875-b6497e434bfe tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:37.885532 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a4ca3dd8-3df8-4c9d-9875-b6497e434bfe tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:37.887053 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a4ca3dd8-3df8-4c9d-9875-b6497e434bfe tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:37.888284 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a4ca3dd8-3df8-4c9d-9875-b6497e434bfe tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:38.102402 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a4ca3dd8-3df8-4c9d-9875-b6497e434bfe tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:38.125091 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a4ca3dd8-3df8-4c9d-9875-b6497e434bfe tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:38.126629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a4ca3dd8-3df8-4c9d-9875-b6497e434bfe tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:38.127852 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a4ca3dd8-3df8-4c9d-9875-b6497e434bfe tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1519 microversion: 2.42 time: 0.260043 Jul 19 22:43:38.128428 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1778/3538] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:43:37 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1519 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:43:38.144154 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-29a171c9-399b-46d8-80a4-ec33ea658a3c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:38.144784 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-29a171c9-399b-46d8-80a4-ec33ea658a3c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:38.152191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29a171c9-399b-46d8-80a4-ec33ea658a3c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:38.152650 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29a171c9-399b-46d8-80a4-ec33ea658a3c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:38.153653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29a171c9-399b-46d8-80a4-ec33ea658a3c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:38.154269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29a171c9-399b-46d8-80a4-ec33ea658a3c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:38.379026 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4f12d04d-4f78-4351-aac3-6d806d698c41 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc4784daa844c0bfaa1ecc56ef145f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f103d0425f4843ae7bbb7845062ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:38.386826 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4f12d04d-4f78-4351-aac3-6d806d698c41 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] 10.222.0.25 "GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429" status: 200 len: 1325 microversion: 2.1 time: 0.708277 Jul 19 22:43:38.387488 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1761/3539] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:37 2022] GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429 => generated 1325 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:38.415425 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-df1c3b50-430f-41ea-a50a-021c84167ee3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:38.415990 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-df1c3b50-430f-41ea-a50a-021c84167ee3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:38.433080 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-df1c3b50-430f-41ea-a50a-021c84167ee3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:38.433615 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-df1c3b50-430f-41ea-a50a-021c84167ee3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:38.439699 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-df1c3b50-430f-41ea-a50a-021c84167ee3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:38.440228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-df1c3b50-430f-41ea-a50a-021c84167ee3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:38.549221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-29a171c9-399b-46d8-80a4-ec33ea658a3c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:38.560652 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-29a171c9-399b-46d8-80a4-ec33ea658a3c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b" status: 200 len: 1329 microversion: 2.1 time: 0.420038 Jul 19 22:43:38.562280 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1779/3540] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:38 2022] GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b => generated 1329 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:38.575087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ecff2959-55c1-4a49-a87d-a665a39a2686 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:38.576702 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ecff2959-55c1-4a49-a87d-a665a39a2686 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:38.604932 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ecff2959-55c1-4a49-a87d-a665a39a2686 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:38.606036 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ecff2959-55c1-4a49-a87d-a665a39a2686 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:38.606906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ecff2959-55c1-4a49-a87d-a665a39a2686 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:38.607420 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ecff2959-55c1-4a49-a87d-a665a39a2686 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:38.657201 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-df1c3b50-430f-41ea-a50a-021c84167ee3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action" status: 202 len: 0 microversion: 2.1 time: 0.254429 Jul 19 22:43:38.657744 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1762/3541] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:43:38 2022] POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:43:38.677313 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1f4025bd-93e3-44f2-a4cd-fbb94efda51c tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:38.679195 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1f4025bd-93e3-44f2-a4cd-fbb94efda51c tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:38.680602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ecff2959-55c1-4a49-a87d-a665a39a2686 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:43:38.711749 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1f4025bd-93e3-44f2-a4cd-fbb94efda51c tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:38.712571 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1f4025bd-93e3-44f2-a4cd-fbb94efda51c tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:38.724819 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1f4025bd-93e3-44f2-a4cd-fbb94efda51c tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:38.725839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1f4025bd-93e3-44f2-a4cd-fbb94efda51c tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:38.743297 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:43:38.941832 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1f4025bd-93e3-44f2-a4cd-fbb94efda51c tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:38.953954 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1f4025bd-93e3-44f2-a4cd-fbb94efda51c tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4" status: 200 len: 1171 microversion: 2.1 time: 0.293424 Jul 19 22:43:38.973619 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1763/3542] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:38 2022] GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 => generated 1171 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:38.982138 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-446f094b-99d6-46d1-8c8c-1e6e2487e7e6 req-ec096c99-c483-48b4-b569-e7b9fd5d3e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50b53156-37b4-433b-8f13-9b788febd9e1", "name": "network-vif-deleted", "tag": "179985b7-ff28-4d68-bdef-077f6dd3d089"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:39.007802 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ecff2959-55c1-4a49-a87d-a665a39a2686 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 204 len: 0 microversion: 2.1 time: 0.443443 Jul 19 22:43:39.008381 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1780/3543] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:43:38 2022] DELETE /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:43:39.017710 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-446f094b-99d6-46d1-8c8c-1e6e2487e7e6 req-ec096c99-c483-48b4-b569-e7b9fd5d3e3f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:39.019737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-446f094b-99d6-46d1-8c8c-1e6e2487e7e6 req-ec096c99-c483-48b4-b569-e7b9fd5d3e3f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:39.025887 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4a6f8251-6f18-4294-960f-6a80644b4615 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:39.029061 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4a6f8251-6f18-4294-960f-6a80644b4615 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:39.050745 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4a6f8251-6f18-4294-960f-6a80644b4615 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:39.051241 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4a6f8251-6f18-4294-960f-6a80644b4615 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:39.052058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4a6f8251-6f18-4294-960f-6a80644b4615 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:39.052509 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4a6f8251-6f18-4294-960f-6a80644b4615 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:39.062122 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-446f094b-99d6-46d1-8c8c-1e6e2487e7e6 req-ec096c99-c483-48b4-b569-e7b9fd5d3e3f service nova] Creating event network-vif-deleted:179985b7-ff28-4d68-bdef-077f6dd3d089 for instance 50b53156-37b4-433b-8f13-9b788febd9e1 on n-h2-847009-3 Jul 19 22:43:39.086666 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-446f094b-99d6-46d1-8c8c-1e6e2487e7e6 req-ec096c99-c483-48b4-b569-e7b9fd5d3e3f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111289 Jul 19 22:43:39.090680 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1764/3544] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:43:39.096330 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-856600f1-d1b9-4cd8-beb5-9b4a24736f4e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:39.098095 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-856600f1-d1b9-4cd8-beb5-9b4a24736f4e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:39.111603 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-856600f1-d1b9-4cd8-beb5-9b4a24736f4e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:39.112124 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-856600f1-d1b9-4cd8-beb5-9b4a24736f4e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:39.113930 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-856600f1-d1b9-4cd8-beb5-9b4a24736f4e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:39.114445 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-856600f1-d1b9-4cd8-beb5-9b4a24736f4e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:39.429842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4a6f8251-6f18-4294-960f-6a80644b4615 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:39.438509 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4a6f8251-6f18-4294-960f-6a80644b4615 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1512 microversion: 2.1 time: 0.428890 Jul 19 22:43:39.439119 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1781/3545] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:39 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1512 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:39.462098 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0c153941-c135-4d15-a837-f2988d2fe062 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:39.464177 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0c153941-c135-4d15-a837-f2988d2fe062 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:39.488628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c153941-c135-4d15-a837-f2988d2fe062 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:39.489178 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c153941-c135-4d15-a837-f2988d2fe062 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:39.490066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c153941-c135-4d15-a837-f2988d2fe062 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:39.493486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c153941-c135-4d15-a837-f2988d2fe062 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:39.556179 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-856600f1-d1b9-4cd8-beb5-9b4a24736f4e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:39.567875 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-856600f1-d1b9-4cd8-beb5-9b4a24736f4e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1653 microversion: 2.1 time: 0.475628 Jul 19 22:43:39.568910 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1765/3546] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:39 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1653 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:39.575212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ca30ebb4-fe14-48f6-a11f-4c4d6efd4367 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:39.576354 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ca30ebb4-fe14-48f6-a11f-4c4d6efd4367 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:39.588004 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca30ebb4-fe14-48f6-a11f-4c4d6efd4367 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:39.588949 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca30ebb4-fe14-48f6-a11f-4c4d6efd4367 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:39.590365 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca30ebb4-fe14-48f6-a11f-4c4d6efd4367 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:39.591441 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca30ebb4-fe14-48f6-a11f-4c4d6efd4367 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:39.941325 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ca30ebb4-fe14-48f6-a11f-4c4d6efd4367 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:39.968088 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ca30ebb4-fe14-48f6-a11f-4c4d6efd4367 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:39.976417 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ca30ebb4-fe14-48f6-a11f-4c4d6efd4367 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:39.978215 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ca30ebb4-fe14-48f6-a11f-4c4d6efd4367 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1593 microversion: 2.42 time: 0.408038 Jul 19 22:43:39.980267 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1766/3547] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:43:39 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1593 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:43:39.987600 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-596a0c66-9b3a-4079-8d9f-68d4239cb801 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:39.988610 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-596a0c66-9b3a-4079-8d9f-68d4239cb801 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] [instance: ca48e3b5-480b-4381-bf77-201225664429] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:40.001558 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0c153941-c135-4d15-a837-f2988d2fe062 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:40.023043 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0c153941-c135-4d15-a837-f2988d2fe062 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1492 microversion: 2.1 time: 0.576624 Jul 19 22:43:40.032077 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-596a0c66-9b3a-4079-8d9f-68d4239cb801 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:40.032888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-596a0c66-9b3a-4079-8d9f-68d4239cb801 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:40.035769 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1782/3548] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:39 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1492 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:40.036929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-596a0c66-9b3a-4079-8d9f-68d4239cb801 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:40.042671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-596a0c66-9b3a-4079-8d9f-68d4239cb801 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:40.054112 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8dfa0d57-4296-45f1-8736-4d7a5f2ed160 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:40.054831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8dfa0d57-4296-45f1-8736-4d7a5f2ed160 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:40.070308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8dfa0d57-4296-45f1-8736-4d7a5f2ed160 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:40.071917 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8dfa0d57-4296-45f1-8736-4d7a5f2ed160 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:40.072967 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8dfa0d57-4296-45f1-8736-4d7a5f2ed160 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:40.075259 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8dfa0d57-4296-45f1-8736-4d7a5f2ed160 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:40.720151 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8dfa0d57-4296-45f1-8736-4d7a5f2ed160 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:40.729015 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8dfa0d57-4296-45f1-8736-4d7a5f2ed160 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b" status: 200 len: 1329 microversion: 2.1 time: 0.690587 Jul 19 22:43:40.736225 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1783/3549] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:40 2022] GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b => generated 1329 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:40.744981 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9f8fb828-067e-456a-8f82-ac1c4ec60c17 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:40.748620 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9f8fb828-067e-456a-8f82-ac1c4ec60c17 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:40.762515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9f8fb828-067e-456a-8f82-ac1c4ec60c17 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:40.763284 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9f8fb828-067e-456a-8f82-ac1c4ec60c17 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:40.766250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9f8fb828-067e-456a-8f82-ac1c4ec60c17 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:40.767478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9f8fb828-067e-456a-8f82-ac1c4ec60c17 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:40.881058 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-596a0c66-9b3a-4079-8d9f-68d4239cb801 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc4784daa844c0bfaa1ecc56ef145f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f103d0425f4843ae7bbb7845062ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:40.896662 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-596a0c66-9b3a-4079-8d9f-68d4239cb801 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] 10.222.0.25 "GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429" status: 200 len: 1325 microversion: 2.1 time: 0.914537 Jul 19 22:43:40.901753 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1767/3550] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:39 2022] GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429 => generated 1325 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:40.931937 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9f8fb828-067e-456a-8f82-ac1c4ec60c17 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action" status: 202 len: 0 microversion: 2.1 time: 0.181910 Jul 19 22:43:40.939166 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fc6e3290-60e6-4052-a482-845021d07117 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:40.939625 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1784/3551] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:43:40 2022] POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:43:40.941665 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fc6e3290-60e6-4052-a482-845021d07117 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:40.955689 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-ce8eaa4e-09e2-4da4-b070-31b0f540d938 req-1af7a9c2-92bc-4016-8b0e-9f297b87f669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ea50d87-53d3-4f21-a4f0-8cd68de4df2b", "name": "network-vif-plugged", "status": "completed", "tag": "8bb8353c-1279-4e9c-8a81-384791f33d47"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:40.957522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc6e3290-60e6-4052-a482-845021d07117 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:40.957971 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc6e3290-60e6-4052-a482-845021d07117 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:40.962966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc6e3290-60e6-4052-a482-845021d07117 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:40.966573 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc6e3290-60e6-4052-a482-845021d07117 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:40.984380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-ce8eaa4e-09e2-4da4-b070-31b0f540d938 req-1af7a9c2-92bc-4016-8b0e-9f297b87f669 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:40.995939 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-ce8eaa4e-09e2-4da4-b070-31b0f540d938 req-1af7a9c2-92bc-4016-8b0e-9f297b87f669 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:41.046633 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-ce8eaa4e-09e2-4da4-b070-31b0f540d938 req-1af7a9c2-92bc-4016-8b0e-9f297b87f669 service nova] Creating event network-vif-plugged:8bb8353c-1279-4e9c-8a81-384791f33d47 for instance 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b on n-h1-847009-3 Jul 19 22:43:41.065415 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-ce8eaa4e-09e2-4da4-b070-31b0f540d938 req-1af7a9c2-92bc-4016-8b0e-9f297b87f669 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123613 Jul 19 22:43:41.070049 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1785/3552] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:43:41.083090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bf0751f6-30e2-4011-9f05-5a82d9e9923d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:41.084237 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bf0751f6-30e2-4011-9f05-5a82d9e9923d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:41.095165 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bf0751f6-30e2-4011-9f05-5a82d9e9923d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:41.095633 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bf0751f6-30e2-4011-9f05-5a82d9e9923d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:41.096840 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bf0751f6-30e2-4011-9f05-5a82d9e9923d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:41.097293 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bf0751f6-30e2-4011-9f05-5a82d9e9923d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:41.703382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fc6e3290-60e6-4052-a482-845021d07117 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:41.716085 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fc6e3290-60e6-4052-a482-845021d07117 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4" status: 200 len: 1219 microversion: 2.1 time: 0.812666 Jul 19 22:43:41.717769 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1768/3553] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:40 2022] GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 => generated 1219 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:41.724909 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ba1ce5a6-1c48-4945-8a49-32ca2934d226 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:41.728211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ba1ce5a6-1c48-4945-8a49-32ca2934d226 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:41.745866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba1ce5a6-1c48-4945-8a49-32ca2934d226 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:41.750185 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba1ce5a6-1c48-4945-8a49-32ca2934d226 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:41.751046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba1ce5a6-1c48-4945-8a49-32ca2934d226 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:41.751530 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba1ce5a6-1c48-4945-8a49-32ca2934d226 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:42.068751 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bf0751f6-30e2-4011-9f05-5a82d9e9923d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:42.077757 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bf0751f6-30e2-4011-9f05-5a82d9e9923d tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1512 microversion: 2.1 time: 1.005872 Jul 19 22:43:42.098853 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1786/3554] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:41 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1512 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:42.123727 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-25ca806c-afee-4106-9568-5767dc494068 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:42.127713 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-25ca806c-afee-4106-9568-5767dc494068 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:42.144662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-25ca806c-afee-4106-9568-5767dc494068 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:42.148691 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-25ca806c-afee-4106-9568-5767dc494068 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:42.149941 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-25ca806c-afee-4106-9568-5767dc494068 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:42.150612 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-25ca806c-afee-4106-9568-5767dc494068 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:42.688416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ba1ce5a6-1c48-4945-8a49-32ca2934d226 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:42.702631 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ba1ce5a6-1c48-4945-8a49-32ca2934d226 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.982808 Jul 19 22:43:42.703396 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1769/3555] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:41 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:42.731858 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7e10d62e-d5df-446d-a1dd-6bb839fc40c6 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:42.733827 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7e10d62e-d5df-446d-a1dd-6bb839fc40c6 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:42.740966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e10d62e-d5df-446d-a1dd-6bb839fc40c6 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:42.741933 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e10d62e-d5df-446d-a1dd-6bb839fc40c6 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:42.742900 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e10d62e-d5df-446d-a1dd-6bb839fc40c6 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:42.743561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e10d62e-d5df-446d-a1dd-6bb839fc40c6 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:42.939493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-25ca806c-afee-4106-9568-5767dc494068 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:42.976501 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-25ca806c-afee-4106-9568-5767dc494068 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:42.980923 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-25ca806c-afee-4106-9568-5767dc494068 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:42.998170 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-25ca806c-afee-4106-9568-5767dc494068 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1661 microversion: 2.42 time: 0.879421 Jul 19 22:43:42.998817 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1787/3556] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:43:42 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1661 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:43:43.010795 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dbe80a8a-58d1-45ce-b6c8-9274ae4257a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:43.018051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dbe80a8a-58d1-45ce-b6c8-9274ae4257a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:43.028422 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dbe80a8a-58d1-45ce-b6c8-9274ae4257a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:43.029202 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dbe80a8a-58d1-45ce-b6c8-9274ae4257a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:43.030189 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dbe80a8a-58d1-45ce-b6c8-9274ae4257a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:43.030873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dbe80a8a-58d1-45ce-b6c8-9274ae4257a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:43.417323 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7e10d62e-d5df-446d-a1dd-6bb839fc40c6 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:43.433255 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7e10d62e-d5df-446d-a1dd-6bb839fc40c6 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1492 microversion: 2.1 time: 0.716905 Jul 19 22:43:43.433989 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1770/3557] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:42 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1492 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:43.451952 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-40501e8b-9c0a-41ce-b53a-2b1d7e0cd609 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:43.452622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-40501e8b-9c0a-41ce-b53a-2b1d7e0cd609 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] [instance: ca48e3b5-480b-4381-bf77-201225664429] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:43.489012 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-40501e8b-9c0a-41ce-b53a-2b1d7e0cd609 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:43.489487 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-40501e8b-9c0a-41ce-b53a-2b1d7e0cd609 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:43.490300 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-40501e8b-9c0a-41ce-b53a-2b1d7e0cd609 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:43.490780 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-40501e8b-9c0a-41ce-b53a-2b1d7e0cd609 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:43.833051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dbe80a8a-58d1-45ce-b6c8-9274ae4257a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:43.864421 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dbe80a8a-58d1-45ce-b6c8-9274ae4257a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b" status: 200 len: 1329 microversion: 2.1 time: 0.859300 Jul 19 22:43:43.867684 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1788/3558] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:43 2022] GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b => generated 1329 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:43.885577 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-03edc64b-a3ad-48f0-b4f9-939102b4335c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:43.886488 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-03edc64b-a3ad-48f0-b4f9-939102b4335c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:43.896143 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-03edc64b-a3ad-48f0-b4f9-939102b4335c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:43.897614 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-03edc64b-a3ad-48f0-b4f9-939102b4335c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:43.898801 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-03edc64b-a3ad-48f0-b4f9-939102b4335c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:43.899628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-03edc64b-a3ad-48f0-b4f9-939102b4335c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:44.013561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-40501e8b-9c0a-41ce-b53a-2b1d7e0cd609 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc4784daa844c0bfaa1ecc56ef145f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f103d0425f4843ae7bbb7845062ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:44.035727 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-40501e8b-9c0a-41ce-b53a-2b1d7e0cd609 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] 10.222.0.25 "GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429" status: 200 len: 1523 microversion: 2.1 time: 0.600227 Jul 19 22:43:44.038918 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1771/3559] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:43 2022] GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429 => generated 1523 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:44.047089 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-28611263-06ab-4b7c-a9a0-8d6a107fd3b1 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:44.048032 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-28611263-06ab-4b7c-a9a0-8d6a107fd3b1 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:44.061151 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28611263-06ab-4b7c-a9a0-8d6a107fd3b1 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:44.062115 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28611263-06ab-4b7c-a9a0-8d6a107fd3b1 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:44.064969 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28611263-06ab-4b7c-a9a0-8d6a107fd3b1 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:44.065638 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28611263-06ab-4b7c-a9a0-8d6a107fd3b1 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:44.239553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-28611263-06ab-4b7c-a9a0-8d6a107fd3b1 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:44.249815 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-28611263-06ab-4b7c-a9a0-8d6a107fd3b1 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4" status: 200 len: 1237 microversion: 2.1 time: 0.209308 Jul 19 22:43:44.251166 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1772/3560] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:44 2022] GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 => generated 1237 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:44.256975 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-08033237-5ce1-4cfd-ae2a-230ef0cc9dd5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:44.257970 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-08033237-5ce1-4cfd-ae2a-230ef0cc9dd5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:44.270634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08033237-5ce1-4cfd-ae2a-230ef0cc9dd5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:44.271353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08033237-5ce1-4cfd-ae2a-230ef0cc9dd5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:44.272605 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08033237-5ce1-4cfd-ae2a-230ef0cc9dd5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:44.273405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08033237-5ce1-4cfd-ae2a-230ef0cc9dd5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:44.511944 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-03edc64b-a3ad-48f0-b4f9-939102b4335c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:44.527248 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-03edc64b-a3ad-48f0-b4f9-939102b4335c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.655869 Jul 19 22:43:44.528697 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1789/3561] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:43 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:44.534151 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-221d4a08-cb67-4f6b-b465-96c602db7a27 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:44.535081 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-221d4a08-cb67-4f6b-b465-96c602db7a27 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:44.542456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-221d4a08-cb67-4f6b-b465-96c602db7a27 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:44.543423 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-221d4a08-cb67-4f6b-b465-96c602db7a27 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:44.544759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-221d4a08-cb67-4f6b-b465-96c602db7a27 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:44.545420 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-221d4a08-cb67-4f6b-b465-96c602db7a27 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:45.031608 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-08033237-5ce1-4cfd-ae2a-230ef0cc9dd5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:45.045970 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-08033237-5ce1-4cfd-ae2a-230ef0cc9dd5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1512 microversion: 2.1 time: 0.793401 Jul 19 22:43:45.051024 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1773/3562] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:44 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1512 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:45.061442 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2bec6ddb-de0e-4b7a-b5a7-db3abd4af285 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:45.063782 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2bec6ddb-de0e-4b7a-b5a7-db3abd4af285 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] [instance: ca48e3b5-480b-4381-bf77-201225664429] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:45.080973 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bec6ddb-de0e-4b7a-b5a7-db3abd4af285 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:45.081434 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bec6ddb-de0e-4b7a-b5a7-db3abd4af285 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:45.082225 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bec6ddb-de0e-4b7a-b5a7-db3abd4af285 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:45.082672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bec6ddb-de0e-4b7a-b5a7-db3abd4af285 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:45.150631 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-2bec6ddb-de0e-4b7a-b5a7-db3abd4af285 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] HTTP exception thrown: Action 999 not found Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2bec6ddb-de0e-4b7a-b5a7-db3abd4af285 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Request method failure captured: Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429/os-instance-actions/999 HTTP/1.1 Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zOBIqWNI64ifVKUcJOF7VjzyuX_GOr9IFdfqTfEYJs8xRE_fqDRzzekP3w_MtmNCINUp0DkACwg2-ph_7euydjj0W21MRtNTlbDSzWac_82nLdsHIn9qHZiOgXgjw5mPaIA7UVuWi0LaW0O0msK6jpakUvjZQzBDakkQx2kbeExtvA Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 11f103d0425f4843ae7bbb7845062ad4 Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2090702024 Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_11f103d0425f4843ae7bbb7845062ad4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11f103d0425f4843ae7bbb7845062ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/11f103d0425f4843ae7bbb7845062ad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11f103d0425f4843ae7bbb7845062ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2090702024 Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 11f103d0425f4843ae7bbb7845062ad4 Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2090702024 Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-InstanceActionsNegativeTestJSON-2090702024-project Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 5dfc4784daa844c0bfaa1ecc56ef145f Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2090702024-project Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: exception: Action 999 not found Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'server_id': 'ca48e3b5-480b-4381-bf77-201225664429', 'id': '999'} Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 19 22:43:45.158950 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:43:45.165062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2bec6ddb-de0e-4b7a-b5a7-db3abd4af285 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Returning 404 to user: Action 999 not found {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:43:45.166168 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2bec6ddb-de0e-4b7a-b5a7-db3abd4af285 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] 10.222.0.25 "GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.113847 Jul 19 22:43:45.167286 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1774/3563] 10.222.0.25 () {58 vars in 1307 bytes} [Tue Jul 19 22:43:45 2022] GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429/os-instance-actions/999 => generated 66 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:43:45.179428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cbe18728-3bc9-4ab9-8187-1b5a93d1ae7e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:45.180375 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cbe18728-3bc9-4ab9-8187-1b5a93d1ae7e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:45.195601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cbe18728-3bc9-4ab9-8187-1b5a93d1ae7e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:45.203181 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cbe18728-3bc9-4ab9-8187-1b5a93d1ae7e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:45.204422 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cbe18728-3bc9-4ab9-8187-1b5a93d1ae7e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:45.205077 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cbe18728-3bc9-4ab9-8187-1b5a93d1ae7e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:45.339150 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-221d4a08-cb67-4f6b-b465-96c602db7a27 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:45.355876 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-221d4a08-cb67-4f6b-b465-96c602db7a27 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:45.357972 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-221d4a08-cb67-4f6b-b465-96c602db7a27 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:45.360285 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-221d4a08-cb67-4f6b-b465-96c602db7a27 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1708 microversion: 2.42 time: 0.830259 Jul 19 22:43:45.372831 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1790/3564] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:43:44 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1708 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:43:45.385647 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8b05b5dd-5c60-43ac-bfe2-d11b9f06bc1c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:45.386740 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8b05b5dd-5c60-43ac-bfe2-d11b9f06bc1c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:45.393636 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8b05b5dd-5c60-43ac-bfe2-d11b9f06bc1c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:45.402338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cbe18728-3bc9-4ab9-8187-1b5a93d1ae7e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc703828daa4c7ea61106f3b4e3bc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26234ff8b14bbcb4891ef363fb4739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:45.408453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8b05b5dd-5c60-43ac-bfe2-d11b9f06bc1c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:45.410106 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8b05b5dd-5c60-43ac-bfe2-d11b9f06bc1c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:45.410976 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8b05b5dd-5c60-43ac-bfe2-d11b9f06bc1c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:45.411262 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cbe18728-3bc9-4ab9-8187-1b5a93d1ae7e tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 200 len: 1285 microversion: 2.1 time: 0.242538 Jul 19 22:43:45.412323 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1775/3565] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:45 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 1285 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:45.418676 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-12a0d1c0-25e3-465b-9443-43ac6549b246 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:45.419669 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-12a0d1c0-25e3-465b-9443-43ac6549b246 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:45.430446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12a0d1c0-25e3-465b-9443-43ac6549b246 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:45.431181 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12a0d1c0-25e3-465b-9443-43ac6549b246 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:45.432261 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12a0d1c0-25e3-465b-9443-43ac6549b246 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:45.432773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12a0d1c0-25e3-465b-9443-43ac6549b246 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:46.089477 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:43:46.119910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:43:46.406180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8b05b5dd-5c60-43ac-bfe2-d11b9f06bc1c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:46.421926 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8b05b5dd-5c60-43ac-bfe2-d11b9f06bc1c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 1.047725 Jul 19 22:43:46.422643 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1791/3566] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:45 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:46.429946 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-e9c2001e-2c22-4068-a137-d7cf397e96b3 req-ebc68eb9-15e4-4b2e-b1b3-c41326532e8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a3cbc11-0fe9-42de-aa59-739f3bd3eee7", "name": "network-vif-deleted", "tag": "47b8b803-0985-4c3b-8e17-6396443f207d"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:46.441179 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-12a0d1c0-25e3-465b-9443-43ac6549b246 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:46.442761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e9c2001e-2c22-4068-a137-d7cf397e96b3 req-ebc68eb9-15e4-4b2e-b1b3-c41326532e8f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:46.443539 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e9c2001e-2c22-4068-a137-d7cf397e96b3 req-ebc68eb9-15e4-4b2e-b1b3-c41326532e8f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:46.457528 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-12a0d1c0-25e3-465b-9443-43ac6549b246 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b" status: 200 len: 1510 microversion: 2.1 time: 1.042128 Jul 19 22:43:46.458588 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1776/3567] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:45 2022] GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b => generated 1510 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:46.463551 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-e9c2001e-2c22-4068-a137-d7cf397e96b3 req-ebc68eb9-15e4-4b2e-b1b3-c41326532e8f service nova] Creating event network-vif-deleted:47b8b803-0985-4c3b-8e17-6396443f207d for instance 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 on n-h1-847009-3 Jul 19 22:43:46.470947 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-e9c2001e-2c22-4068-a137-d7cf397e96b3 req-ebc68eb9-15e4-4b2e-b1b3-c41326532e8f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046137 Jul 19 22:43:46.473223 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1792/3568] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:43:46.478511 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-be7d1a40-707c-4a53-9a9b-4db0fe6317fc tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Calling method '.version_select at 0x7f7a106cfdc0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:46.480710 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-be7d1a40-707c-4a53-9a9b-4db0fe6317fc tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] [instance: 01dda161-929d-45e4-9c48-204adf804e32] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:46.483434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f1825294-00ad-47eb-9aa6-3e148f2e525e tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:46.484646 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f1825294-00ad-47eb-9aa6-3e148f2e525e tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:46.497703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1825294-00ad-47eb-9aa6-3e148f2e525e tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:46.498516 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1825294-00ad-47eb-9aa6-3e148f2e525e tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:46.499589 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1825294-00ad-47eb-9aa6-3e148f2e525e tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:46.500269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1825294-00ad-47eb-9aa6-3e148f2e525e tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:46.517576 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-be7d1a40-707c-4a53-9a9b-4db0fe6317fc tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] HTTP exception thrown: Instance 01dda161-929d-45e4-9c48-204adf804e32 could not be found. Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-be7d1a40-707c-4a53-9a9b-4db0fe6317fc tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Request method failure captured: Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/01dda161-929d-45e4-9c48-204adf804e32/os-instance-actions HTTP/1.1 Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zOBIqWNI64ifVKUcJOF7VjzyuX_GOr9IFdfqTfEYJs8xRE_fqDRzzekP3w_MtmNCINUp0DkACwg2-ph_7euydjj0W21MRtNTlbDSzWac_82nLdsHIn9qHZiOgXgjw5mPaIA7UVuWi0LaW0O0msK6jpakUvjZQzBDakkQx2kbeExtvA Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 11f103d0425f4843ae7bbb7845062ad4 Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2090702024 Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_11f103d0425f4843ae7bbb7845062ad4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11f103d0425f4843ae7bbb7845062ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/11f103d0425f4843ae7bbb7845062ad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11f103d0425f4843ae7bbb7845062ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2090702024 Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 11f103d0425f4843ae7bbb7845062ad4 Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2090702024 Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-InstanceActionsNegativeTestJSON-2090702024-project Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 5dfc4784daa844c0bfaa1ecc56ef145f Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2090702024-project Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 01dda161-929d-45e4-9c48-204adf804e32 could not be found. Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'server_id': '01dda161-929d-45e4-9c48-204adf804e32'} Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01dda161-929d-45e4-9c48-204adf804e32 could not be found. Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:43:46.524364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:43:46.534475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01dda161-929d-45e4-9c48-204adf804e32 could not be found. Jul 19 22:43:46.534475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:43:46.534475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:43:46.534475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:43:46.534475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:43:46.534475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:43:46.534475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:43:46.534475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:43:46.534475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:43:46.534475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01dda161-929d-45e4-9c48-204adf804e32 could not be found. Jul 19 22:43:46.534475 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:43:46.541959 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-be7d1a40-707c-4a53-9a9b-4db0fe6317fc tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Returning 404 to user: Instance 01dda161-929d-45e4-9c48-204adf804e32 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:43:46.543811 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-be7d1a40-707c-4a53-9a9b-4db0fe6317fc tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] 10.222.0.25 "GET /compute/v2.1/servers/01dda161-929d-45e4-9c48-204adf804e32/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.081897 Jul 19 22:43:46.545861 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1777/3569] 10.222.0.25 () {58 vars in 1295 bytes} [Tue Jul 19 22:43:46 2022] GET /compute/v2.1/servers/01dda161-929d-45e4-9c48-204adf804e32/os-instance-actions => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:43:46.560659 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d667b337-a1be-4a6d-a27f-8ec93cb213c1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:46.563513 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d667b337-a1be-4a6d-a27f-8ec93cb213c1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:46.583842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d667b337-a1be-4a6d-a27f-8ec93cb213c1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:46.585790 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d667b337-a1be-4a6d-a27f-8ec93cb213c1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:46.589000 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d667b337-a1be-4a6d-a27f-8ec93cb213c1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:46.590305 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d667b337-a1be-4a6d-a27f-8ec93cb213c1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:46.611925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:43:47.139294 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f1825294-00ad-47eb-9aa6-3e148f2e525e tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:47.157885 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f1825294-00ad-47eb-9aa6-3e148f2e525e tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4" status: 200 len: 1305 microversion: 2.1 time: 0.682826 Jul 19 22:43:47.158328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d667b337-a1be-4a6d-a27f-8ec93cb213c1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:47.171574 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1793/3570] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:46 2022] GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 => generated 1305 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:47.178724 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e302582c-87af-4bec-89a1-025f2a5c8241 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:47.179763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e302582c-87af-4bec-89a1-025f2a5c8241 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:47.187231 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e302582c-87af-4bec-89a1-025f2a5c8241 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:47.188024 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e302582c-87af-4bec-89a1-025f2a5c8241 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:47.189019 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e302582c-87af-4bec-89a1-025f2a5c8241 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:47.189691 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e302582c-87af-4bec-89a1-025f2a5c8241 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:47.190740 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d667b337-a1be-4a6d-a27f-8ec93cb213c1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1512 microversion: 2.1 time: 0.641502 Jul 19 22:43:47.191633 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1778/3571] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:46 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1512 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:47.210626 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9ba5d916-4122-49a8-b9c5-f55cc99a6b12 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:47.211290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9ba5d916-4122-49a8-b9c5-f55cc99a6b12 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] [instance: 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:47.228505 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ba5d916-4122-49a8-b9c5-f55cc99a6b12 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:47.228963 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ba5d916-4122-49a8-b9c5-f55cc99a6b12 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:47.229910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ba5d916-4122-49a8-b9c5-f55cc99a6b12 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:47.230443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ba5d916-4122-49a8-b9c5-f55cc99a6b12 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:47.249320 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-9ba5d916-4122-49a8-b9c5-f55cc99a6b12 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] HTTP exception thrown: Instance 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 could not be found. Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9ba5d916-4122-49a8-b9c5-f55cc99a6b12 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Request method failure captured: Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 HTTP/1.1 Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zL7lebP250rUpyyKGvwzHnyOvog8MyRmmJHeQqi1MU-LDwhJlQCyxLKZsma9VDPc7O44FE-nJmRUSO-ngUHSbMzsVg7Ly_Cj5mzS0743nCH6UkAWG0ZKs6-5izn29XORcLD1DaZakTKwJDDdXgkmKJrMxH7fQsMHF4CnKvThQWSIBQ Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 5a26234ff8b14bbcb4891ef363fb4739 Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerRescueTestJSON-1513266042 Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5a26234ff8b14bbcb4891ef363fb4739"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5a26234ff8b14bbcb4891ef363fb4739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5a26234ff8b14bbcb4891ef363fb4739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5a26234ff8b14bbcb4891ef363fb4739"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerRescueTestJSON-1513266042 Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 5a26234ff8b14bbcb4891ef363fb4739 Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerRescueTestJSON-1513266042 Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerRescueTestJSON-1513266042-project Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 7bc703828daa4c7ea61106f3b4e3bc3f Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerRescueTestJSON-1513266042-project Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 could not be found. Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '2a3cbc11-0fe9-42de-aa59-739f3bd3eee7'} Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 could not be found. Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 could not be found. Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:43:47.251945 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:43:47.268943 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:43:47.268943 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:43:47.268943 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:43:47.268943 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:43:47.268943 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:43:47.268943 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 could not be found. Jul 19 22:43:47.268943 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:43:47.268943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9ba5d916-4122-49a8-b9c5-f55cc99a6b12 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] Returning 404 to user: Instance 2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:43:47.268943 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9ba5d916-4122-49a8-b9c5-f55cc99a6b12 tempest-ServerRescueTestJSON-1513266042 tempest-ServerRescueTestJSON-1513266042-project] 10.222.0.25 "GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7" status: 404 len: 111 microversion: 2.1 time: 0.048489 Jul 19 22:43:47.268943 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1779/3572] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:47 2022] GET /compute/v2.1/servers/2a3cbc11-0fe9-42de-aa59-739f3bd3eee7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:43:47.268943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a455918a-e31a-4589-9681-795c76ddc45e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:47.268943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a455918a-e31a-4589-9681-795c76ddc45e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:47.270587 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a455918a-e31a-4589-9681-795c76ddc45e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:47.270587 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a455918a-e31a-4589-9681-795c76ddc45e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:47.272925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a455918a-e31a-4589-9681-795c76ddc45e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:47.272925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a455918a-e31a-4589-9681-795c76ddc45e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:47.468371 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:43:47.504877 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=10 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:43:47.866401 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e302582c-87af-4bec-89a1-025f2a5c8241 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:47.879450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e302582c-87af-4bec-89a1-025f2a5c8241 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:47.881403 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e302582c-87af-4bec-89a1-025f2a5c8241 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:47.885503 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e302582c-87af-4bec-89a1-025f2a5c8241 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1708 microversion: 2.42 time: 0.711721 Jul 19 22:43:47.887977 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1794/3573] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:43:47 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1708 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:43:47.901635 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e919cdf0-ce56-48b1-9921-05e4246207a8 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:47.902554 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e919cdf0-ce56-48b1-9921-05e4246207a8 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:47.908967 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e919cdf0-ce56-48b1-9921-05e4246207a8 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:47.909685 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e919cdf0-ce56-48b1-9921-05e4246207a8 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:47.910480 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e919cdf0-ce56-48b1-9921-05e4246207a8 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:47.911102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e919cdf0-ce56-48b1-9921-05e4246207a8 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:48.065146 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a455918a-e31a-4589-9681-795c76ddc45e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:48.076519 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a455918a-e31a-4589-9681-795c76ddc45e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.817294 Jul 19 22:43:48.077586 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1780/3574] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:47 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:48.083740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9d3e9fc7-64be-4942-909e-b36b33b1959a tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:48.084501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9d3e9fc7-64be-4942-909e-b36b33b1959a tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] [instance: ca48e3b5-480b-4381-bf77-201225664429] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:48.095536 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d3e9fc7-64be-4942-909e-b36b33b1959a tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:48.096831 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d3e9fc7-64be-4942-909e-b36b33b1959a tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:48.097983 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d3e9fc7-64be-4942-909e-b36b33b1959a tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:48.098597 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d3e9fc7-64be-4942-909e-b36b33b1959a tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:48.134414 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9d3e9fc7-64be-4942-909e-b36b33b1959a tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] [instance: ca48e3b5-480b-4381-bf77-201225664429] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:43:48.251824 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9d3e9fc7-64be-4942-909e-b36b33b1959a tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429" status: 204 len: 0 microversion: 2.1 time: 0.171097 Jul 19 22:43:48.252551 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1781/3575] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:43:48 2022] DELETE /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:43:48.267049 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0f79eb7b-1a2c-412d-b3f4-5fb41ec24cfc tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:48.269192 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0f79eb7b-1a2c-412d-b3f4-5fb41ec24cfc tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:48.298406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0f79eb7b-1a2c-412d-b3f4-5fb41ec24cfc tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:48.298816 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0f79eb7b-1a2c-412d-b3f4-5fb41ec24cfc tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:48.301899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0f79eb7b-1a2c-412d-b3f4-5fb41ec24cfc tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:48.302373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0f79eb7b-1a2c-412d-b3f4-5fb41ec24cfc tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:48.467391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e919cdf0-ce56-48b1-9921-05e4246207a8 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:48.510420 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e919cdf0-ce56-48b1-9921-05e4246207a8 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b" status: 200 len: 1510 microversion: 2.1 time: 0.613765 Jul 19 22:43:48.512964 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1795/3576] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:47 2022] GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b => generated 1510 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:48.525751 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f647fdaf-2337-4ea2-bac7-719aaaa37a31 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:48.528460 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f647fdaf-2337-4ea2-bac7-719aaaa37a31 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:48.558737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:43:48.565819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f647fdaf-2337-4ea2-bac7-719aaaa37a31 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:48.566298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f647fdaf-2337-4ea2-bac7-719aaaa37a31 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:48.567659 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f647fdaf-2337-4ea2-bac7-719aaaa37a31 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:48.568129 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f647fdaf-2337-4ea2-bac7-719aaaa37a31 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:48.620722 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:43:49.478958 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0f79eb7b-1a2c-412d-b3f4-5fb41ec24cfc tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:49.487666 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0f79eb7b-1a2c-412d-b3f4-5fb41ec24cfc tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 1.231880 Jul 19 22:43:49.488528 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1782/3577] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:48 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:49.494025 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-98736e51-9442-4e09-9d75-9782b35f31b3 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:49.495045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-98736e51-9442-4e09-9d75-9782b35f31b3 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:49.503096 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-98736e51-9442-4e09-9d75-9782b35f31b3 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:49.504061 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-98736e51-9442-4e09-9d75-9782b35f31b3 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:49.505053 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-98736e51-9442-4e09-9d75-9782b35f31b3 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:49.505672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-98736e51-9442-4e09-9d75-9782b35f31b3 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:49.580994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f647fdaf-2337-4ea2-bac7-719aaaa37a31 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:49.600722 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f647fdaf-2337-4ea2-bac7-719aaaa37a31 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4" status: 200 len: 1305 microversion: 2.1 time: 1.084888 Jul 19 22:43:49.601635 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1796/3578] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:48 2022] GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 => generated 1305 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:49.606444 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e776605d-58c1-4567-8260-ce7d276c1845 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:49.607388 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e776605d-58c1-4567-8260-ce7d276c1845 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] [instance: ca48e3b5-480b-4381-bf77-201225664429] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:49.625794 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e776605d-58c1-4567-8260-ce7d276c1845 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:49.626257 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e776605d-58c1-4567-8260-ce7d276c1845 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:49.627288 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e776605d-58c1-4567-8260-ce7d276c1845 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:49.627915 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e776605d-58c1-4567-8260-ce7d276c1845 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:50.422617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-98736e51-9442-4e09-9d75-9782b35f31b3 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:50.439752 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-98736e51-9442-4e09-9d75-9782b35f31b3 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1512 microversion: 2.1 time: 0.949311 Jul 19 22:43:50.440822 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1783/3579] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:49 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1512 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:50.462641 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-01e90b78-a7e5-4058-aa95-95b9b5d24771 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:50.463539 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-01e90b78-a7e5-4058-aa95-95b9b5d24771 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:50.491916 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01e90b78-a7e5-4058-aa95-95b9b5d24771 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:50.492613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01e90b78-a7e5-4058-aa95-95b9b5d24771 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:50.493992 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01e90b78-a7e5-4058-aa95-95b9b5d24771 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:50.494778 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-01e90b78-a7e5-4058-aa95-95b9b5d24771 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:50.588246 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-01e90b78-a7e5-4058-aa95-95b9b5d24771 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:43:50.717815 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e776605d-58c1-4567-8260-ce7d276c1845 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc4784daa844c0bfaa1ecc56ef145f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f103d0425f4843ae7bbb7845062ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:50.748399 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e776605d-58c1-4567-8260-ce7d276c1845 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] 10.222.0.25 "GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429" status: 200 len: 1529 microversion: 2.1 time: 1.145097 Jul 19 22:43:50.749739 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1797/3580] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:49 2022] GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429 => generated 1529 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:50.762821 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d6c2b57c-7d91-406c-af6c-986ef8240aeb tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:50.768366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d6c2b57c-7d91-406c-af6c-986ef8240aeb tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:50.795867 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d6c2b57c-7d91-406c-af6c-986ef8240aeb tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:50.798919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d6c2b57c-7d91-406c-af6c-986ef8240aeb tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:50.806054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d6c2b57c-7d91-406c-af6c-986ef8240aeb tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:50.806881 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d6c2b57c-7d91-406c-af6c-986ef8240aeb tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:50.860960 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-01e90b78-a7e5-4058-aa95-95b9b5d24771 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b" status: 204 len: 0 microversion: 2.1 time: 0.409909 Jul 19 22:43:50.869223 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1784/3581] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:43:50 2022] DELETE /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:43:50.887015 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e271fc51-ef05-41b9-9b17-40be8f9ecebc tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:50.888024 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e271fc51-ef05-41b9-9b17-40be8f9ecebc tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:50.900913 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e271fc51-ef05-41b9-9b17-40be8f9ecebc tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:50.905346 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e271fc51-ef05-41b9-9b17-40be8f9ecebc tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:50.906416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e271fc51-ef05-41b9-9b17-40be8f9ecebc tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:50.907889 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e271fc51-ef05-41b9-9b17-40be8f9ecebc tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:52.013696 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e271fc51-ef05-41b9-9b17-40be8f9ecebc tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:52.023179 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e271fc51-ef05-41b9-9b17-40be8f9ecebc tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 1.152523 Jul 19 22:43:52.023785 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1785/3582] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:50 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:52.042630 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-74f28851-5079-4502-9cc7-25e00553b449 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:52.043554 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-74f28851-5079-4502-9cc7-25e00553b449 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:52.065313 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74f28851-5079-4502-9cc7-25e00553b449 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:52.065769 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74f28851-5079-4502-9cc7-25e00553b449 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:52.066549 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74f28851-5079-4502-9cc7-25e00553b449 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:52.066988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74f28851-5079-4502-9cc7-25e00553b449 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:52.110182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d6c2b57c-7d91-406c-af6c-986ef8240aeb tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:52.125173 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d6c2b57c-7d91-406c-af6c-986ef8240aeb tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:52.132003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d6c2b57c-7d91-406c-af6c-986ef8240aeb tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:52.134201 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d6c2b57c-7d91-406c-af6c-986ef8240aeb tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1755 microversion: 2.42 time: 1.382467 Jul 19 22:43:52.135784 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1798/3583] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:43:50 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1755 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:43:52.145346 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c2ee4273-b581-4a3f-bf5f-3c85387e8ce1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:52.148202 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c2ee4273-b581-4a3f-bf5f-3c85387e8ce1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:52.167418 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c2ee4273-b581-4a3f-bf5f-3c85387e8ce1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:52.169517 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c2ee4273-b581-4a3f-bf5f-3c85387e8ce1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:52.172146 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c2ee4273-b581-4a3f-bf5f-3c85387e8ce1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:52.172609 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c2ee4273-b581-4a3f-bf5f-3c85387e8ce1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:52.894562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c2ee4273-b581-4a3f-bf5f-3c85387e8ce1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:52.912944 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c2ee4273-b581-4a3f-bf5f-3c85387e8ce1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b" status: 200 len: 1516 microversion: 2.1 time: 0.769760 Jul 19 22:43:52.914078 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1799/3584] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:52 2022] GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b => generated 1516 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:52.928474 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f75df5a2-fef4-4676-a298-837e2cd7e528 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:52.929299 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f75df5a2-fef4-4676-a298-837e2cd7e528 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:52.951543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f75df5a2-fef4-4676-a298-837e2cd7e528 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:52.952297 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f75df5a2-fef4-4676-a298-837e2cd7e528 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:52.953966 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f75df5a2-fef4-4676-a298-837e2cd7e528 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:52.955302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f75df5a2-fef4-4676-a298-837e2cd7e528 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:53.459056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-74f28851-5079-4502-9cc7-25e00553b449 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:53.468341 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-74f28851-5079-4502-9cc7-25e00553b449 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4" status: 200 len: 1305 microversion: 2.1 time: 1.429768 Jul 19 22:43:53.468948 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1786/3585] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:52 2022] GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 => generated 1305 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:53.486578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a72af845-d733-4ecd-97c5-54f51f883976 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:53.488400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a72af845-d733-4ecd-97c5-54f51f883976 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] [instance: ca48e3b5-480b-4381-bf77-201225664429] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:53.522097 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a72af845-d733-4ecd-97c5-54f51f883976 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:53.524125 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a72af845-d733-4ecd-97c5-54f51f883976 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:53.525554 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a72af845-d733-4ecd-97c5-54f51f883976 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:53.526247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a72af845-d733-4ecd-97c5-54f51f883976 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:53.715250 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a72af845-d733-4ecd-97c5-54f51f883976 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc4784daa844c0bfaa1ecc56ef145f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f103d0425f4843ae7bbb7845062ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:53.730592 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a72af845-d733-4ecd-97c5-54f51f883976 tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] 10.222.0.25 "GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429" status: 200 len: 1310 microversion: 2.1 time: 0.259860 Jul 19 22:43:53.732502 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1787/3586] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:53 2022] GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429 => generated 1310 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:53.740146 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-89f85914-39d5-49a8-bb59-c1f23fc050e9 req-244cd337-6a52-4bf7-aa0c-08a52dc1b6ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fa32776-830f-4a09-814f-536f39a284e4", "tag": "e87d2086-e34b-41a9-a3fc-b54342672708"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:53.752657 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-89f85914-39d5-49a8-bb59-c1f23fc050e9 req-244cd337-6a52-4bf7-aa0c-08a52dc1b6ca service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:53.753603 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-89f85914-39d5-49a8-bb59-c1f23fc050e9 req-244cd337-6a52-4bf7-aa0c-08a52dc1b6ca service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:53.768016 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-89f85914-39d5-49a8-bb59-c1f23fc050e9 req-244cd337-6a52-4bf7-aa0c-08a52dc1b6ca service nova] Creating event network-changed:e87d2086-e34b-41a9-a3fc-b54342672708 for instance 4fa32776-830f-4a09-814f-536f39a284e4 on n-h1-847009-3 Jul 19 22:43:53.777999 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-89f85914-39d5-49a8-bb59-c1f23fc050e9 req-244cd337-6a52-4bf7-aa0c-08a52dc1b6ca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043433 Jul 19 22:43:53.780079 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1788/3587] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:43:53.786784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d37bdfb3-c42f-4ec6-81d5-8a09751e4521 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:53.788366 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d37bdfb3-c42f-4ec6-81d5-8a09751e4521 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:53.796290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d37bdfb3-c42f-4ec6-81d5-8a09751e4521 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:53.797679 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d37bdfb3-c42f-4ec6-81d5-8a09751e4521 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:53.799505 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d37bdfb3-c42f-4ec6-81d5-8a09751e4521 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:53.800160 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d37bdfb3-c42f-4ec6-81d5-8a09751e4521 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:53.999908 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f75df5a2-fef4-4676-a298-837e2cd7e528 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:54.016289 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f75df5a2-fef4-4676-a298-837e2cd7e528 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1512 microversion: 2.1 time: 1.100672 Jul 19 22:43:54.018853 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1800/3588] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:52 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1512 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:54.026912 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-108f154a-cf35-4f4b-a4cb-ac8e20646034 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:54.029585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-108f154a-cf35-4f4b-a4cb-ac8e20646034 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:54.055152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-108f154a-cf35-4f4b-a4cb-ac8e20646034 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:54.056842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-108f154a-cf35-4f4b-a4cb-ac8e20646034 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:54.061189 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-108f154a-cf35-4f4b-a4cb-ac8e20646034 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:54.063740 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-108f154a-cf35-4f4b-a4cb-ac8e20646034 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:54.526078 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d37bdfb3-c42f-4ec6-81d5-8a09751e4521 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:54.541540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d37bdfb3-c42f-4ec6-81d5-8a09751e4521 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:54.544905 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d37bdfb3-c42f-4ec6-81d5-8a09751e4521 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:54.547788 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d37bdfb3-c42f-4ec6-81d5-8a09751e4521 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1802 microversion: 2.42 time: 0.765972 Jul 19 22:43:54.549422 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1789/3589] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:43:53 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1802 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:43:54.571342 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bc1d5dd4-28ed-4ce7-8312-9d3c134f61ca tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:54.572261 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bc1d5dd4-28ed-4ce7-8312-9d3c134f61ca tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:54.593633 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc1d5dd4-28ed-4ce7-8312-9d3c134f61ca tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:54.594675 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc1d5dd4-28ed-4ce7-8312-9d3c134f61ca tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:54.595834 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc1d5dd4-28ed-4ce7-8312-9d3c134f61ca tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:54.596514 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc1d5dd4-28ed-4ce7-8312-9d3c134f61ca tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:54.723440 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-108f154a-cf35-4f4b-a4cb-ac8e20646034 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:54.732880 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-108f154a-cf35-4f4b-a4cb-ac8e20646034 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b" status: 200 len: 1516 microversion: 2.1 time: 0.712669 Jul 19 22:43:54.734491 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1801/3590] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:54 2022] GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b => generated 1516 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:54.770713 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-85441c78-2e96-42d2-9afa-a57aecb35c8f tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:54.773653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-85441c78-2e96-42d2-9afa-a57aecb35c8f tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] [instance: ca48e3b5-480b-4381-bf77-201225664429] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:54.784347 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85441c78-2e96-42d2-9afa-a57aecb35c8f tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:54.785511 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85441c78-2e96-42d2-9afa-a57aecb35c8f tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:54.786663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85441c78-2e96-42d2-9afa-a57aecb35c8f tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:54.788265 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85441c78-2e96-42d2-9afa-a57aecb35c8f tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:54.808687 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-85441c78-2e96-42d2-9afa-a57aecb35c8f tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] HTTP exception thrown: Instance ca48e3b5-480b-4381-bf77-201225664429 could not be found. Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-85441c78-2e96-42d2-9afa-a57aecb35c8f tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Request method failure captured: Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429 HTTP/1.1 Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zOBIqWNI64ifVKUcJOF7VjzyuX_GOr9IFdfqTfEYJs8xRE_fqDRzzekP3w_MtmNCINUp0DkACwg2-ph_7euydjj0W21MRtNTlbDSzWac_82nLdsHIn9qHZiOgXgjw5mPaIA7UVuWi0LaW0O0msK6jpakUvjZQzBDakkQx2kbeExtvA Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 11f103d0425f4843ae7bbb7845062ad4 Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2090702024 Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_11f103d0425f4843ae7bbb7845062ad4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11f103d0425f4843ae7bbb7845062ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/11f103d0425f4843ae7bbb7845062ad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11f103d0425f4843ae7bbb7845062ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2090702024 Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 11f103d0425f4843ae7bbb7845062ad4 Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2090702024 Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-InstanceActionsNegativeTestJSON-2090702024-project Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 5dfc4784daa844c0bfaa1ecc56ef145f Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2090702024-project Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance ca48e3b5-480b-4381-bf77-201225664429 could not be found. Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'ca48e3b5-480b-4381-bf77-201225664429'} Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca48e3b5-480b-4381-bf77-201225664429 could not be found. Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca48e3b5-480b-4381-bf77-201225664429 could not be found. Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:43:54.810736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:43:54.815583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:43:54.815583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:43:54.815583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:43:54.815583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:43:54.815583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:43:54.815583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:43:54.815583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca48e3b5-480b-4381-bf77-201225664429 could not be found. Jul 19 22:43:54.815583 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:43:54.821636 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-85441c78-2e96-42d2-9afa-a57aecb35c8f tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] Returning 404 to user: Instance ca48e3b5-480b-4381-bf77-201225664429 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:43:54.822873 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-85441c78-2e96-42d2-9afa-a57aecb35c8f tempest-InstanceActionsNegativeTestJSON-2090702024 tempest-InstanceActionsNegativeTestJSON-2090702024-project] 10.222.0.25 "GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429" status: 404 len: 111 microversion: 2.1 time: 0.068504 Jul 19 22:43:54.824060 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1802/3591] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:54 2022] GET /compute/v2.1/servers/ca48e3b5-480b-4381-bf77-201225664429 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:43:55.035235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c376ab24-6695-4d8a-9472-85f11d37ac60 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:55.036281 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c376ab24-6695-4d8a-9472-85f11d37ac60 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:55.048445 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c376ab24-6695-4d8a-9472-85f11d37ac60 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:55.048926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c376ab24-6695-4d8a-9472-85f11d37ac60 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:55.049730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c376ab24-6695-4d8a-9472-85f11d37ac60 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:55.050185 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c376ab24-6695-4d8a-9472-85f11d37ac60 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:55.697720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bc1d5dd4-28ed-4ce7-8312-9d3c134f61ca tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:55.713368 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bc1d5dd4-28ed-4ce7-8312-9d3c134f61ca tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4" status: 200 len: 1293 microversion: 2.1 time: 1.160360 Jul 19 22:43:55.714397 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1790/3592] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:54 2022] GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 => generated 1293 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:55.720064 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b543cccf-071c-4ca1-a2bd-b2062bc5775a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:55.721765 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b543cccf-071c-4ca1-a2bd-b2062bc5775a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:55.730424 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b543cccf-071c-4ca1-a2bd-b2062bc5775a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:55.740168 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b543cccf-071c-4ca1-a2bd-b2062bc5775a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:55.741494 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b543cccf-071c-4ca1-a2bd-b2062bc5775a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:55.742273 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b543cccf-071c-4ca1-a2bd-b2062bc5775a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:55.981114 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c376ab24-6695-4d8a-9472-85f11d37ac60 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:55.999180 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c376ab24-6695-4d8a-9472-85f11d37ac60 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1512 microversion: 2.1 time: 0.968596 Jul 19 22:43:56.000683 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1803/3593] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:55 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1512 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:43:56.013263 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b1e1c4f5-7925-4f38-bb13-06fe2a9ecfa9 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:56.016830 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b1e1c4f5-7925-4f38-bb13-06fe2a9ecfa9 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:56.050352 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b1e1c4f5-7925-4f38-bb13-06fe2a9ecfa9 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:56.052149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b1e1c4f5-7925-4f38-bb13-06fe2a9ecfa9 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:56.055451 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b1e1c4f5-7925-4f38-bb13-06fe2a9ecfa9 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:56.056380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b1e1c4f5-7925-4f38-bb13-06fe2a9ecfa9 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:56.135614 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b1e1c4f5-7925-4f38-bb13-06fe2a9ecfa9 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:56.138014 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b1e1c4f5-7925-4f38-bb13-06fe2a9ecfa9 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:56.139397 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-b1e1c4f5-7925-4f38-bb13-06fe2a9ecfa9 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lazy-loading 'fault' on Instance uuid 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:43:56.284903 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b1e1c4f5-7925-4f38-bb13-06fe2a9ecfa9 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:56.297825 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b1e1c4f5-7925-4f38-bb13-06fe2a9ecfa9 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b" status: 200 len: 1319 microversion: 2.1 time: 0.295785 Jul 19 22:43:56.309038 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1804/3594] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:56 2022] GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b => generated 1319 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:56.314313 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-be6bdf19-c668-444a-8886-0f82169ab9ac req-b2808ed6-5a02-40af-91e6-ffab896564f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca48e3b5-480b-4381-bf77-201225664429", "name": "network-vif-deleted", "tag": "ce8e713b-91a7-4c7f-9f02-11795f7f300a"}, {"server_uuid": "9ea50d87-53d3-4f21-a4f0-8cd68de4df2b", "name": "network-vif-deleted", "tag": "8bb8353c-1279-4e9c-8a81-384791f33d47"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:56.343899 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-be6bdf19-c668-444a-8886-0f82169ab9ac req-b2808ed6-5a02-40af-91e6-ffab896564f5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:56.344655 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-be6bdf19-c668-444a-8886-0f82169ab9ac req-b2808ed6-5a02-40af-91e6-ffab896564f5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:56.385382 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-be6bdf19-c668-444a-8886-0f82169ab9ac req-b2808ed6-5a02-40af-91e6-ffab896564f5 service nova] Creating event network-vif-deleted:ce8e713b-91a7-4c7f-9f02-11795f7f300a for instance ca48e3b5-480b-4381-bf77-201225664429 on n-h1-847009-3 Jul 19 22:43:56.386224 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-be6bdf19-c668-444a-8886-0f82169ab9ac req-b2808ed6-5a02-40af-91e6-ffab896564f5 service nova] Creating event network-vif-deleted:8bb8353c-1279-4e9c-8a81-384791f33d47 for instance 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b on n-h1-847009-3 Jul 19 22:43:56.418289 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-be6bdf19-c668-444a-8886-0f82169ab9ac req-b2808ed6-5a02-40af-91e6-ffab896564f5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.107547 Jul 19 22:43:56.423243 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1805/3595] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:43:56.590312 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b543cccf-071c-4ca1-a2bd-b2062bc5775a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:56.613863 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b543cccf-071c-4ca1-a2bd-b2062bc5775a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:56.618673 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b543cccf-071c-4ca1-a2bd-b2062bc5775a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:56.620345 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b543cccf-071c-4ca1-a2bd-b2062bc5775a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1802 microversion: 2.42 time: 0.904482 Jul 19 22:43:56.621836 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1791/3596] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:43:55 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1802 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:43:56.733644 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-81e133e2-7d1d-4c64-80f3-cc82984f539a tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:56.734952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-81e133e2-7d1d-4c64-80f3-cc82984f539a tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:56.742440 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81e133e2-7d1d-4c64-80f3-cc82984f539a tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:56.743035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81e133e2-7d1d-4c64-80f3-cc82984f539a tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:56.744000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81e133e2-7d1d-4c64-80f3-cc82984f539a tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:56.744724 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81e133e2-7d1d-4c64-80f3-cc82984f539a tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:57.029398 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3903fc7b-dfd1-4cc2-89e9-45918fcf86f6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:57.030018 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3903fc7b-dfd1-4cc2-89e9-45918fcf86f6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:57.046961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3903fc7b-dfd1-4cc2-89e9-45918fcf86f6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:57.047925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3903fc7b-dfd1-4cc2-89e9-45918fcf86f6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:57.048940 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3903fc7b-dfd1-4cc2-89e9-45918fcf86f6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:57.049618 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3903fc7b-dfd1-4cc2-89e9-45918fcf86f6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:57.202694 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-81e133e2-7d1d-4c64-80f3-cc82984f539a tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:57.215721 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-81e133e2-7d1d-4c64-80f3-cc82984f539a tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4" status: 200 len: 1293 microversion: 2.1 time: 0.486620 Jul 19 22:43:57.216587 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1806/3597] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:56 2022] GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 => generated 1293 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:43:57.325986 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-27a276ed-4f87-4493-913c-158ae96f6e94 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:57.327949 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-27a276ed-4f87-4493-913c-158ae96f6e94 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:57.355573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-27a276ed-4f87-4493-913c-158ae96f6e94 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:57.357092 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-27a276ed-4f87-4493-913c-158ae96f6e94 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:57.362986 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-27a276ed-4f87-4493-913c-158ae96f6e94 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:57.366645 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-27a276ed-4f87-4493-913c-158ae96f6e94 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:57.410892 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-27a276ed-4f87-4493-913c-158ae96f6e94 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] HTTP exception thrown: Instance 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b could not be found. Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-27a276ed-4f87-4493-913c-158ae96f6e94 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Request method failure captured: Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b HTTP/1.1 Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zM1CVhkGzrLI27yplqtJpQo-i3-EKMGfRab3BLA-iVFSYzTm_PO2UXoSlqkSOVVu2ip8fmaaUlGTzOcY-1-PKTjTHCVYzWriYi14tgLboJXa9RPch13wobugtzkYLm5uZx9koMts7tA37UlK9MH24L7zFq17JufqAVvZobtx47aYg4 Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersTestJSON-1648920919 Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersTestJSON-1648920919-project Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1db06ac41e9f4fe290e535f703af484d Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersTestJSON-1648920919-project Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b could not be found. Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '9ea50d87-53d3-4f21-a4f0-8cd68de4df2b'} Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b could not be found. Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b could not be found. Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:43:57.414770 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:43:57.420142 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:43:57.420142 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:43:57.420142 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:43:57.420142 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:43:57.420142 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b could not be found. Jul 19 22:43:57.420142 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:43:57.421203 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-27a276ed-4f87-4493-913c-158ae96f6e94 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Returning 404 to user: Instance 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:43:57.422285 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-27a276ed-4f87-4493-913c-158ae96f6e94 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b" status: 404 len: 111 microversion: 2.1 time: 0.104068 Jul 19 22:43:57.428550 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1807/3598] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:57 2022] GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:43:57.435973 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e6645e6e-cbfa-4c32-a3db-a78d69a138c6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '.version_select at 0x7f7a1556e5e0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:57.472814 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e6645e6e-cbfa-4c32-a3db-a78d69a138c6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-key-1828141949" status: 202 len: 0 microversion: 2.1 time: 0.042010 Jul 19 22:43:57.486593 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1808/3599] 10.222.0.25 () {58 vars in 1208 bytes} [Tue Jul 19 22:43:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1828141949 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:43:57.645463 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aa82f6fc-0eb0-42d9-938b-3e31806cceb3 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:57.647636 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-aa82f6fc-0eb0-42d9-938b-3e31806cceb3 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:57.669293 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa82f6fc-0eb0-42d9-938b-3e31806cceb3 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:57.669852 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa82f6fc-0eb0-42d9-938b-3e31806cceb3 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:57.670986 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa82f6fc-0eb0-42d9-938b-3e31806cceb3 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:57.671573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa82f6fc-0eb0-42d9-938b-3e31806cceb3 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:57.981507 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3903fc7b-dfd1-4cc2-89e9-45918fcf86f6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:58.017150 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3903fc7b-dfd1-4cc2-89e9-45918fcf86f6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1512 microversion: 2.1 time: 0.990832 Jul 19 22:43:58.030952 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1792/3600] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:57 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1512 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:43:58.045528 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-38ecb390-cde6-4eba-8344-864f21080309 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-888574862", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "6119d69d-194a-407a-a78f-64890b6702ed"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:43:58.129904 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-38ecb390-cde6-4eba-8344-864f21080309 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] validate_networks() for [('6119d69d-194a-407a-a78f-64890b6702ed', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:43:58.152570 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-aa82f6fc-0eb0-42d9-938b-3e31806cceb3 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:58.169012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-aa82f6fc-0eb0-42d9-938b-3e31806cceb3 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:58.170597 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-aa82f6fc-0eb0-42d9-938b-3e31806cceb3 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:58.171907 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-aa82f6fc-0eb0-42d9-938b-3e31806cceb3 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1849 microversion: 2.42 time: 0.533623 Jul 19 22:43:58.172499 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1809/3601] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:43:57 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1849 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:43:58.235908 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-93509adc-5aba-4078-b045-ace2230df8fb tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:58.238351 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-93509adc-5aba-4078-b045-ace2230df8fb tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:58.253019 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93509adc-5aba-4078-b045-ace2230df8fb tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:58.254734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93509adc-5aba-4078-b045-ace2230df8fb tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:58.258270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93509adc-5aba-4078-b045-ace2230df8fb tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:58.259032 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93509adc-5aba-4078-b045-ace2230df8fb tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:58.988728 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-93509adc-5aba-4078-b045-ace2230df8fb tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:59.010872 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-93509adc-5aba-4078-b045-ace2230df8fb tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4" status: 200 len: 1293 microversion: 2.1 time: 0.781464 Jul 19 22:43:59.018616 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1810/3602] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:58 2022] GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 => generated 1293 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:43:59.037019 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1165e379-f2aa-42a6-8389-75e3d670410a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:43:59.038389 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1165e379-f2aa-42a6-8389-75e3d670410a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:43:59.054802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1165e379-f2aa-42a6-8389-75e3d670410a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:59.055803 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1165e379-f2aa-42a6-8389-75e3d670410a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:59.057856 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1165e379-f2aa-42a6-8389-75e3d670410a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:43:59.058730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1165e379-f2aa-42a6-8389-75e3d670410a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:43:59.886122 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1165e379-f2aa-42a6-8389-75e3d670410a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:43:59.963201 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1165e379-f2aa-42a6-8389-75e3d670410a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1512 microversion: 2.1 time: 0.929687 Jul 19 22:43:59.973490 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1811/3603] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:43:59 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1512 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:44:00.012824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c085411c-ca42-4eb6-b5b2-3eae1c6df915 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:00.013620 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c085411c-ca42-4eb6-b5b2-3eae1c6df915 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:00.025956 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c085411c-ca42-4eb6-b5b2-3eae1c6df915 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:00.026563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c085411c-ca42-4eb6-b5b2-3eae1c6df915 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:00.027402 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c085411c-ca42-4eb6-b5b2-3eae1c6df915 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:00.028065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c085411c-ca42-4eb6-b5b2-3eae1c6df915 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:00.058399 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-38ecb390-cde6-4eba-8344-864f21080309 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:44:00.061981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-38ecb390-cde6-4eba-8344-864f21080309 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:44:00.062879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-38ecb390-cde6-4eba-8344-864f21080309 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:44:00.063664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-38ecb390-cde6-4eba-8344-864f21080309 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:44:00.064205 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-38ecb390-cde6-4eba-8344-864f21080309 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:44:00.078952 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-38ecb390-cde6-4eba-8344-864f21080309 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:00.080770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-38ecb390-cde6-4eba-8344-864f21080309 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:00.090640 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-38ecb390-cde6-4eba-8344-864f21080309 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:00.091872 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-38ecb390-cde6-4eba-8344-864f21080309 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:00.135753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:44:00.160209 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-38ecb390-cde6-4eba-8344-864f21080309 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Getting quotas for project 9bd4d0caf2f347218af6ffd52f250c59. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:44:00.168922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-38ecb390-cde6-4eba-8344-864f21080309 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Getting quotas for user 1db06ac41e9f4fe290e535f703af484d and project 9bd4d0caf2f347218af6ffd52f250c59. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:44:00.194458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-38ecb390-cde6-4eba-8344-864f21080309 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:44:00.198289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-38ecb390-cde6-4eba-8344-864f21080309 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 452a29c5-c034-4f02-827f-95ffb5bfffbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:44:00.282505 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-38ecb390-cde6-4eba-8344-864f21080309 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.246534 Jul 19 22:44:00.284301 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1793/3604] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:43:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:44:00.291809 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-469f1fdc-3a4b-4dd8-b152-abcf4ea415bd tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:00.293697 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-469f1fdc-3a4b-4dd8-b152-abcf4ea415bd tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:00.302452 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-469f1fdc-3a4b-4dd8-b152-abcf4ea415bd tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:00.304412 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-469f1fdc-3a4b-4dd8-b152-abcf4ea415bd tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:00.305524 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-469f1fdc-3a4b-4dd8-b152-abcf4ea415bd tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:00.306332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-469f1fdc-3a4b-4dd8-b152-abcf4ea415bd tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:00.452145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c085411c-ca42-4eb6-b5b2-3eae1c6df915 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:00.482113 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c085411c-ca42-4eb6-b5b2-3eae1c6df915 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:00.485640 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c085411c-ca42-4eb6-b5b2-3eae1c6df915 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:00.488049 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c085411c-ca42-4eb6-b5b2-3eae1c6df915 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1849 microversion: 2.42 time: 0.501384 Jul 19 22:44:00.488616 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1812/3605] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:43:59 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1849 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:44:00.499019 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-38af9c77-b59f-4b7f-bba9-b879115b0926 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:00.503972 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-38af9c77-b59f-4b7f-bba9-b879115b0926 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 452a29c5-c034-4f02-827f-95ffb5bfffbb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:00.672955 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-38af9c77-b59f-4b7f-bba9-b879115b0926 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:00.683953 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-38af9c77-b59f-4b7f-bba9-b879115b0926 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb" status: 200 len: 1208 microversion: 2.1 time: 0.191168 Jul 19 22:44:00.695129 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1813/3606] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:00 2022] GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb => generated 1208 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:00.702991 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-5fc5416a-9d16-4549-864e-9c107b92b95f req-c3476054-a82e-4fd6-a73f-582ab4f26a0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d53ca5c-aaa1-44f3-832d-7f2a9a56db39", "tag": "27fff587-1a65-4e04-9a00-c3b15f8c23f1"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:00.719611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5fc5416a-9d16-4549-864e-9c107b92b95f req-c3476054-a82e-4fd6-a73f-582ab4f26a0c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:00.721427 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5fc5416a-9d16-4549-864e-9c107b92b95f req-c3476054-a82e-4fd6-a73f-582ab4f26a0c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:00.740345 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-5fc5416a-9d16-4549-864e-9c107b92b95f req-c3476054-a82e-4fd6-a73f-582ab4f26a0c service nova] Creating event network-changed:27fff587-1a65-4e04-9a00-c3b15f8c23f1 for instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 on n-h2-847009-3 Jul 19 22:44:00.753168 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-5fc5416a-9d16-4549-864e-9c107b92b95f req-c3476054-a82e-4fd6-a73f-582ab4f26a0c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052199 Jul 19 22:44:00.758359 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1814/3607] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:44:00.993000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f9b17539-cc83-4599-ad05-36c7d31b7747 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:00.993724 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f9b17539-cc83-4599-ad05-36c7d31b7747 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:01.020741 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9b17539-cc83-4599-ad05-36c7d31b7747 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:01.021370 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9b17539-cc83-4599-ad05-36c7d31b7747 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:01.024110 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9b17539-cc83-4599-ad05-36c7d31b7747 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:01.025452 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9b17539-cc83-4599-ad05-36c7d31b7747 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:01.329619 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-469f1fdc-3a4b-4dd8-b152-abcf4ea415bd tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:01.342872 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-469f1fdc-3a4b-4dd8-b152-abcf4ea415bd tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4" status: 200 len: 1293 microversion: 2.1 time: 1.056854 Jul 19 22:44:01.349216 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1794/3608] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:00 2022] GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 => generated 1293 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:01.529033 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ad449899-e748-4e0b-ab64-278854116d22 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:01.530975 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ad449899-e748-4e0b-ab64-278854116d22 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:01.549431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad449899-e748-4e0b-ab64-278854116d22 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:01.550400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad449899-e748-4e0b-ab64-278854116d22 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:01.552892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad449899-e748-4e0b-ab64-278854116d22 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:01.557519 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad449899-e748-4e0b-ab64-278854116d22 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:01.707952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f9b17539-cc83-4599-ad05-36c7d31b7747 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:01.726993 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f9b17539-cc83-4599-ad05-36c7d31b7747 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1512 microversion: 2.1 time: 0.739011 Jul 19 22:44:01.727908 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1815/3609] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:00 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1512 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:44:01.736631 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-31430287-659c-4091-a338-4e8cb6f9c0c1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:01.741113 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-31430287-659c-4091-a338-4e8cb6f9c0c1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 452a29c5-c034-4f02-827f-95ffb5bfffbb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:01.758797 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31430287-659c-4091-a338-4e8cb6f9c0c1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:01.759708 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31430287-659c-4091-a338-4e8cb6f9c0c1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:01.760969 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31430287-659c-4091-a338-4e8cb6f9c0c1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:01.761693 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31430287-659c-4091-a338-4e8cb6f9c0c1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:02.258238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-31430287-659c-4091-a338-4e8cb6f9c0c1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:02.275347 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-31430287-659c-4091-a338-4e8cb6f9c0c1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb" status: 200 len: 1260 microversion: 2.1 time: 0.545117 Jul 19 22:44:02.279578 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1816/3610] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:01 2022] GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb => generated 1260 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:02.371027 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e8752f3e-3ad3-44bc-8c0b-2da2e074a09b tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:02.372096 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e8752f3e-3ad3-44bc-8c0b-2da2e074a09b tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:02.404116 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8752f3e-3ad3-44bc-8c0b-2da2e074a09b tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:02.404924 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8752f3e-3ad3-44bc-8c0b-2da2e074a09b tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:02.414066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8752f3e-3ad3-44bc-8c0b-2da2e074a09b tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:02.414864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8752f3e-3ad3-44bc-8c0b-2da2e074a09b tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:02.473298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:44:02.659103 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ad449899-e748-4e0b-ab64-278854116d22 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:02.673403 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ad449899-e748-4e0b-ab64-278854116d22 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:02.674952 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ad449899-e748-4e0b-ab64-278854116d22 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:02.685058 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ad449899-e748-4e0b-ab64-278854116d22 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1849 microversion: 2.42 time: 1.159989 Jul 19 22:44:02.686845 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1795/3611] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:44:01 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1849 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:44:02.754204 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ab6be2c0-0a65-46b7-a820-135a01ad0a4c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:02.754844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ab6be2c0-0a65-46b7-a820-135a01ad0a4c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:02.782497 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:44:02.792118 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab6be2c0-0a65-46b7-a820-135a01ad0a4c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:02.793274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab6be2c0-0a65-46b7-a820-135a01ad0a4c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:02.794297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab6be2c0-0a65-46b7-a820-135a01ad0a4c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:02.794907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab6be2c0-0a65-46b7-a820-135a01ad0a4c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:03.560200 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e8752f3e-3ad3-44bc-8c0b-2da2e074a09b tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:03.574580 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e8752f3e-3ad3-44bc-8c0b-2da2e074a09b tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4" status: 200 len: 1293 microversion: 2.1 time: 1.208704 Jul 19 22:44:03.579534 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1817/3612] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:02 2022] GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 => generated 1293 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:44:03.592956 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9688c13a-0861-4165-bf21-a932d9cf12a9 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:03.595871 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9688c13a-0861-4165-bf21-a932d9cf12a9 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 452a29c5-c034-4f02-827f-95ffb5bfffbb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:03.614776 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9688c13a-0861-4165-bf21-a932d9cf12a9 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:03.617080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9688c13a-0861-4165-bf21-a932d9cf12a9 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:03.622274 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9688c13a-0861-4165-bf21-a932d9cf12a9 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:03.623040 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9688c13a-0861-4165-bf21-a932d9cf12a9 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:03.642543 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ab6be2c0-0a65-46b7-a820-135a01ad0a4c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:03.654002 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ab6be2c0-0a65-46b7-a820-135a01ad0a4c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1512 microversion: 2.1 time: 0.905221 Jul 19 22:44:03.667137 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1796/3613] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:02 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1512 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:44:03.707673 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f4475b66-0e23-4402-9751-65523b000362 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:03.708427 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f4475b66-0e23-4402-9751-65523b000362 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:03.723948 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f4475b66-0e23-4402-9751-65523b000362 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:03.724701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f4475b66-0e23-4402-9751-65523b000362 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:03.725713 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f4475b66-0e23-4402-9751-65523b000362 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:03.726180 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f4475b66-0e23-4402-9751-65523b000362 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:03.880470 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9688c13a-0861-4165-bf21-a932d9cf12a9 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:03.915350 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9688c13a-0861-4165-bf21-a932d9cf12a9 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb" status: 200 len: 1266 microversion: 2.1 time: 0.328537 Jul 19 22:44:03.918835 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1818/3614] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:03 2022] GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb => generated 1266 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:04.603384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-44c4678a-dd09-4d74-8cf7-6ab08e044109 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:04.604107 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-44c4678a-dd09-4d74-8cf7-6ab08e044109 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:04.631887 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44c4678a-dd09-4d74-8cf7-6ab08e044109 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:04.632392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44c4678a-dd09-4d74-8cf7-6ab08e044109 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:04.633291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44c4678a-dd09-4d74-8cf7-6ab08e044109 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:04.633843 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44c4678a-dd09-4d74-8cf7-6ab08e044109 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:05.273680 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f4475b66-0e23-4402-9751-65523b000362 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:05.291279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f4475b66-0e23-4402-9751-65523b000362 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:05.297084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f4475b66-0e23-4402-9751-65523b000362 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:05.298436 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f4475b66-0e23-4402-9751-65523b000362 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1849 microversion: 2.42 time: 1.596348 Jul 19 22:44:05.299060 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1797/3615] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:44:03 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1849 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:44:05.310760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d1c08b1f-599a-4505-b538-d9c8eca745ba tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:05.314421 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d1c08b1f-599a-4505-b538-d9c8eca745ba tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:05.333847 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d1c08b1f-599a-4505-b538-d9c8eca745ba tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:05.335423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d1c08b1f-599a-4505-b538-d9c8eca745ba tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:05.336144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d1c08b1f-599a-4505-b538-d9c8eca745ba tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:05.336783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d1c08b1f-599a-4505-b538-d9c8eca745ba tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:05.518250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-44c4678a-dd09-4d74-8cf7-6ab08e044109 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:05.541752 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-44c4678a-dd09-4d74-8cf7-6ab08e044109 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4" status: 200 len: 1293 microversion: 2.1 time: 0.934355 Jul 19 22:44:05.543613 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1819/3616] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:04 2022] GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 => generated 1293 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:44:05.562247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ec0be092-65fa-4151-b983-a4cc40355073 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:05.564613 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ec0be092-65fa-4151-b983-a4cc40355073 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 452a29c5-c034-4f02-827f-95ffb5bfffbb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:05.587607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec0be092-65fa-4151-b983-a4cc40355073 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:05.588375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec0be092-65fa-4151-b983-a4cc40355073 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:05.590416 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec0be092-65fa-4151-b983-a4cc40355073 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:05.593710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec0be092-65fa-4151-b983-a4cc40355073 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:06.187403 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ec0be092-65fa-4151-b983-a4cc40355073 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:06.218846 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ec0be092-65fa-4151-b983-a4cc40355073 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb" status: 200 len: 1266 microversion: 2.1 time: 0.673863 Jul 19 22:44:06.224041 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1820/3617] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:05 2022] GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb => generated 1266 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:06.319903 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c3de0ca9-1622-40a8-b6a3-0d55a8143db5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:06.321560 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c3de0ca9-1622-40a8-b6a3-0d55a8143db5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:06.348085 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c3de0ca9-1622-40a8-b6a3-0d55a8143db5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:06.349209 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c3de0ca9-1622-40a8-b6a3-0d55a8143db5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:06.351353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c3de0ca9-1622-40a8-b6a3-0d55a8143db5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:06.354209 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c3de0ca9-1622-40a8-b6a3-0d55a8143db5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:06.789703 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d1c08b1f-599a-4505-b538-d9c8eca745ba tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:06.812876 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d1c08b1f-599a-4505-b538-d9c8eca745ba tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1512 microversion: 2.1 time: 1.512707 Jul 19 22:44:06.822601 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1798/3618] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:05 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1512 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:06.837595 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-110289e5-1346-4786-a946-dce4818bd138 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:06.838240 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-110289e5-1346-4786-a946-dce4818bd138 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:06.862757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-110289e5-1346-4786-a946-dce4818bd138 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:06.863237 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-110289e5-1346-4786-a946-dce4818bd138 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:06.864017 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-110289e5-1346-4786-a946-dce4818bd138 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:06.864458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-110289e5-1346-4786-a946-dce4818bd138 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:07.991679 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-110289e5-1346-4786-a946-dce4818bd138 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:08.004691 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-110289e5-1346-4786-a946-dce4818bd138 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4" status: 200 len: 1293 microversion: 2.1 time: 1.171049 Jul 19 22:44:08.011497 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1799/3619] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:06 2022] GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 => generated 1293 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:08.017155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c48b80da-2d69-4ddb-818b-aa44da0f3f2c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:08.017884 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c48b80da-2d69-4ddb-818b-aa44da0f3f2c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 452a29c5-c034-4f02-827f-95ffb5bfffbb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:08.033669 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c3de0ca9-1622-40a8-b6a3-0d55a8143db5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:08.035746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c48b80da-2d69-4ddb-818b-aa44da0f3f2c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:08.036264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c48b80da-2d69-4ddb-818b-aa44da0f3f2c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:08.043229 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c48b80da-2d69-4ddb-818b-aa44da0f3f2c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:08.044013 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c48b80da-2d69-4ddb-818b-aa44da0f3f2c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:08.069527 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c3de0ca9-1622-40a8-b6a3-0d55a8143db5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:08.074614 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c3de0ca9-1622-40a8-b6a3-0d55a8143db5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:08.081094 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c3de0ca9-1622-40a8-b6a3-0d55a8143db5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1870 microversion: 2.42 time: 1.766265 Jul 19 22:44:08.085084 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1821/3620] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:44:06 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1870 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:44:08.098965 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-dd7f0fd7-eb5e-49b8-a356-0315cba11a26 req-14b728e0-9988-4dc7-852f-9a0b05694c00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fa32776-830f-4a09-814f-536f39a284e4", "name": "network-vif-plugged", "status": "completed", "tag": "e87d2086-e34b-41a9-a3fc-b54342672708"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:08.123679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-dd7f0fd7-eb5e-49b8-a356-0315cba11a26 req-14b728e0-9988-4dc7-852f-9a0b05694c00 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:08.126350 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-dd7f0fd7-eb5e-49b8-a356-0315cba11a26 req-14b728e0-9988-4dc7-852f-9a0b05694c00 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:08.163854 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-dd7f0fd7-eb5e-49b8-a356-0315cba11a26 req-14b728e0-9988-4dc7-852f-9a0b05694c00 service nova] Creating event network-vif-plugged:e87d2086-e34b-41a9-a3fc-b54342672708 for instance 4fa32776-830f-4a09-814f-536f39a284e4 on n-h1-847009-3 Jul 19 22:44:08.174053 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-dd7f0fd7-eb5e-49b8-a356-0315cba11a26 req-14b728e0-9988-4dc7-852f-9a0b05694c00 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086387 Jul 19 22:44:08.211292 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1822/3621] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:44:08.233549 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-ae2a48ef-4d74-4390-816d-4eb1cf6b3bf5 req-f524b6a4-b7c9-4f7b-b17c-c923bb0bb7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d53ca5c-aaa1-44f3-832d-7f2a9a56db39", "tag": "aaebb168-a0dc-4323-91f4-47daf8a94255"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:08.258498 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-ae2a48ef-4d74-4390-816d-4eb1cf6b3bf5 req-f524b6a4-b7c9-4f7b-b17c-c923bb0bb7d4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:08.258949 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-ae2a48ef-4d74-4390-816d-4eb1cf6b3bf5 req-f524b6a4-b7c9-4f7b-b17c-c923bb0bb7d4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:08.290124 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-ae2a48ef-4d74-4390-816d-4eb1cf6b3bf5 req-f524b6a4-b7c9-4f7b-b17c-c923bb0bb7d4 service nova] Creating event network-changed:aaebb168-a0dc-4323-91f4-47daf8a94255 for instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 on n-h2-847009-3 Jul 19 22:44:08.295661 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-ae2a48ef-4d74-4390-816d-4eb1cf6b3bf5 req-f524b6a4-b7c9-4f7b-b17c-c923bb0bb7d4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079984 Jul 19 22:44:08.296867 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1823/3622] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:44:08.308949 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d189d770-1d10-4422-bf96-ae675a57f6fc tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:08.310224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d189d770-1d10-4422-bf96-ae675a57f6fc tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:08.321426 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d189d770-1d10-4422-bf96-ae675a57f6fc tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:08.322527 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d189d770-1d10-4422-bf96-ae675a57f6fc tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:08.323542 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d189d770-1d10-4422-bf96-ae675a57f6fc tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:08.324165 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d189d770-1d10-4422-bf96-ae675a57f6fc tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:09.323407 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d189d770-1d10-4422-bf96-ae675a57f6fc tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:09.333644 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d189d770-1d10-4422-bf96-ae675a57f6fc tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1489 microversion: 2.1 time: 1.034982 Jul 19 22:44:09.336842 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1824/3623] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:08 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1489 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:09.361422 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-45e1cc7c-aa7e-4c16-b491-32491cc3397a tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:09.367671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-45e1cc7c-aa7e-4c16-b491-32491cc3397a tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:09.384190 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-45e1cc7c-aa7e-4c16-b491-32491cc3397a tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:09.387261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-45e1cc7c-aa7e-4c16-b491-32491cc3397a tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:09.389596 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-45e1cc7c-aa7e-4c16-b491-32491cc3397a tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:09.390840 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-45e1cc7c-aa7e-4c16-b491-32491cc3397a tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:09.452932 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c48b80da-2d69-4ddb-818b-aa44da0f3f2c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:09.478367 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c48b80da-2d69-4ddb-818b-aa44da0f3f2c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb" status: 200 len: 1308 microversion: 2.1 time: 1.465570 Jul 19 22:44:09.481428 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1800/3624] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:08 2022] GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb => generated 1308 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:09.491018 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4bddb279-0c04-4637-83b5-9c72500a96a8 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:09.492203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4bddb279-0c04-4637-83b5-9c72500a96a8 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:09.510920 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4bddb279-0c04-4637-83b5-9c72500a96a8 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:09.511400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4bddb279-0c04-4637-83b5-9c72500a96a8 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:09.514756 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4bddb279-0c04-4637-83b5-9c72500a96a8 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:09.515249 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4bddb279-0c04-4637-83b5-9c72500a96a8 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:10.137252 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:44:10.181641 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:44:10.313785 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-45e1cc7c-aa7e-4c16-b491-32491cc3397a tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:10.326090 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-45e1cc7c-aa7e-4c16-b491-32491cc3397a tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4" status: 200 len: 1293 microversion: 2.1 time: 0.987986 Jul 19 22:44:10.327051 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1825/3625] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:09 2022] GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 => generated 1293 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:10.335725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d093aee2-bb2d-4900-bb7c-e3db57f62b4a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:10.336629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d093aee2-bb2d-4900-bb7c-e3db57f62b4a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:10.346301 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d093aee2-bb2d-4900-bb7c-e3db57f62b4a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:10.346917 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d093aee2-bb2d-4900-bb7c-e3db57f62b4a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:10.347985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d093aee2-bb2d-4900-bb7c-e3db57f62b4a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:10.348812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d093aee2-bb2d-4900-bb7c-e3db57f62b4a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:10.415338 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d093aee2-bb2d-4900-bb7c-e3db57f62b4a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:44:10.585461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4bddb279-0c04-4637-83b5-9c72500a96a8 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:10.610218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4bddb279-0c04-4637-83b5-9c72500a96a8 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:10.615991 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4bddb279-0c04-4637-83b5-9c72500a96a8 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:10.622098 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4bddb279-0c04-4637-83b5-9c72500a96a8 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1858 microversion: 2.42 time: 1.136744 Jul 19 22:44:10.637933 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1801/3626] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:44:09 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1858 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:44:10.643362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5a9fa6ea-0819-4726-9359-c777626fcf5c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:10.644095 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5a9fa6ea-0819-4726-9359-c777626fcf5c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 452a29c5-c034-4f02-827f-95ffb5bfffbb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:10.653705 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a9fa6ea-0819-4726-9359-c777626fcf5c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:10.654813 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a9fa6ea-0819-4726-9359-c777626fcf5c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:10.656061 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a9fa6ea-0819-4726-9359-c777626fcf5c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:10.656884 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a9fa6ea-0819-4726-9359-c777626fcf5c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:10.686098 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d093aee2-bb2d-4900-bb7c-e3db57f62b4a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 204 len: 0 microversion: 2.1 time: 0.354228 Jul 19 22:44:10.695372 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1826/3627] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:44:10 2022] DELETE /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:44:10.710721 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a1f34b67-f429-40ca-9896-0be6d2e6aae9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:10.717353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a1f34b67-f429-40ca-9896-0be6d2e6aae9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:10.724253 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:44:10.741560 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1f34b67-f429-40ca-9896-0be6d2e6aae9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:10.742014 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1f34b67-f429-40ca-9896-0be6d2e6aae9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:10.745048 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1f34b67-f429-40ca-9896-0be6d2e6aae9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:10.745828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1f34b67-f429-40ca-9896-0be6d2e6aae9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:11.315078 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5a9fa6ea-0819-4726-9359-c777626fcf5c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:11.333566 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5a9fa6ea-0819-4726-9359-c777626fcf5c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb" status: 200 len: 1308 microversion: 2.1 time: 0.694205 Jul 19 22:44:11.337909 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1802/3628] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:10 2022] GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb => generated 1308 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:11.359894 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-563cfb72-1299-44b6-937c-a192aa4c5b80 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:11.367209 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-563cfb72-1299-44b6-937c-a192aa4c5b80 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:11.386061 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-563cfb72-1299-44b6-937c-a192aa4c5b80 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:11.386774 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-563cfb72-1299-44b6-937c-a192aa4c5b80 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:11.402230 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-563cfb72-1299-44b6-937c-a192aa4c5b80 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:11.403458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-563cfb72-1299-44b6-937c-a192aa4c5b80 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:11.485980 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a1f34b67-f429-40ca-9896-0be6d2e6aae9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:11.501295 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a1f34b67-f429-40ca-9896-0be6d2e6aae9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1495 microversion: 2.1 time: 0.803973 Jul 19 22:44:11.511242 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1827/3629] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:10 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1495 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:11.645782 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-56680ad9-234c-4c74-8075-917deb02b964 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:11.647044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-56680ad9-234c-4c74-8075-917deb02b964 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:11.654611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56680ad9-234c-4c74-8075-917deb02b964 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:11.655567 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56680ad9-234c-4c74-8075-917deb02b964 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:11.656583 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56680ad9-234c-4c74-8075-917deb02b964 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:11.657316 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56680ad9-234c-4c74-8075-917deb02b964 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:12.117681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-563cfb72-1299-44b6-937c-a192aa4c5b80 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:12.135332 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-563cfb72-1299-44b6-937c-a192aa4c5b80 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4" status: 200 len: 1483 microversion: 2.1 time: 0.782401 Jul 19 22:44:12.136570 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1803/3630] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:11 2022] GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 => generated 1483 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:44:12.159193 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-6b8de1be-4937-445a-a54f-9b1f39853710 req-2558539a-1d98-46c4-8e52-697febc2936b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "452a29c5-c034-4f02-827f-95ffb5bfffbb", "tag": "610a985c-6bc4-4a7d-b16c-e561d3eb2171"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:12.169209 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-6b8de1be-4937-445a-a54f-9b1f39853710 req-2558539a-1d98-46c4-8e52-697febc2936b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:12.169656 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-6b8de1be-4937-445a-a54f-9b1f39853710 req-2558539a-1d98-46c4-8e52-697febc2936b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:12.187844 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-6b8de1be-4937-445a-a54f-9b1f39853710 req-2558539a-1d98-46c4-8e52-697febc2936b service nova] Creating event network-changed:610a985c-6bc4-4a7d-b16c-e561d3eb2171 for instance 452a29c5-c034-4f02-827f-95ffb5bfffbb on n-h1-847009-3 Jul 19 22:44:12.196325 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-6b8de1be-4937-445a-a54f-9b1f39853710 req-2558539a-1d98-46c4-8e52-697febc2936b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043501 Jul 19 22:44:12.197442 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1804/3631] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:44:12.204604 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e6109639-6253-4d1a-9e59-f8c7bd00b3c9 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:12.206236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e6109639-6253-4d1a-9e59-f8c7bd00b3c9 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:12.230698 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6109639-6253-4d1a-9e59-f8c7bd00b3c9 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:12.233115 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6109639-6253-4d1a-9e59-f8c7bd00b3c9 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:12.236052 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6109639-6253-4d1a-9e59-f8c7bd00b3c9 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:12.236750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6109639-6253-4d1a-9e59-f8c7bd00b3c9 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:12.543806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-56680ad9-234c-4c74-8075-917deb02b964 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:12.556543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-56680ad9-234c-4c74-8075-917deb02b964 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:12.558058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-56680ad9-234c-4c74-8075-917deb02b964 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:12.559287 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-56680ad9-234c-4c74-8075-917deb02b964 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 0.918676 Jul 19 22:44:12.560380 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1828/3632] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:44:11 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:44:12.565261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b0f8707d-e781-42b1-8f30-9b65fcded0f5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:12.566295 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b0f8707d-e781-42b1-8f30-9b65fcded0f5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 452a29c5-c034-4f02-827f-95ffb5bfffbb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:12.577680 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b0f8707d-e781-42b1-8f30-9b65fcded0f5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:12.579392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b0f8707d-e781-42b1-8f30-9b65fcded0f5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:12.581457 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b0f8707d-e781-42b1-8f30-9b65fcded0f5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:12.583025 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b0f8707d-e781-42b1-8f30-9b65fcded0f5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:12.716769 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e6109639-6253-4d1a-9e59-f8c7bd00b3c9 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.516862 Jul 19 22:44:12.718825 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1805/3633] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 19 22:44:12 2022] GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4/os-interface => generated 284 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:44:12.729685 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d14c793c-32f0-4869-af13-5e557ed1b202 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:12.730774 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d14c793c-32f0-4869-af13-5e557ed1b202 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:12.741454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d14c793c-32f0-4869-af13-5e557ed1b202 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:12.742191 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d14c793c-32f0-4869-af13-5e557ed1b202 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:12.743575 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d14c793c-32f0-4869-af13-5e557ed1b202 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:12.744316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d14c793c-32f0-4869-af13-5e557ed1b202 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:13.635954 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b0f8707d-e781-42b1-8f30-9b65fcded0f5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:13.644438 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b0f8707d-e781-42b1-8f30-9b65fcded0f5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb" status: 200 len: 1308 microversion: 2.1 time: 1.082685 Jul 19 22:44:13.656454 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1829/3634] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:12 2022] GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb => generated 1308 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:13.663180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6ab2cba2-d61e-4bb0-8d3c-9da96050e116 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:13.664888 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6ab2cba2-d61e-4bb0-8d3c-9da96050e116 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:13.672071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ab2cba2-d61e-4bb0-8d3c-9da96050e116 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:13.672825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ab2cba2-d61e-4bb0-8d3c-9da96050e116 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:13.673793 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ab2cba2-d61e-4bb0-8d3c-9da96050e116 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:13.674657 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ab2cba2-d61e-4bb0-8d3c-9da96050e116 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:13.781469 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6ab2cba2-d61e-4bb0-8d3c-9da96050e116 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action" status: 202 len: 0 microversion: 2.1 time: 0.123352 Jul 19 22:44:13.794917 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1830/3635] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:44:13 2022] POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:44:13.802066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-2cf47743-a12e-47dd-b79a-cb1338748514 req-5b3207d9-23e3-4809-8e4f-1a9bdbbf23bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1", "name": "network-vif-deleted", "tag": "2141535c-9709-4a08-b290-b35a8c739837"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:13.823507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-2cf47743-a12e-47dd-b79a-cb1338748514 req-5b3207d9-23e3-4809-8e4f-1a9bdbbf23bf service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:13.824326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-2cf47743-a12e-47dd-b79a-cb1338748514 req-5b3207d9-23e3-4809-8e4f-1a9bdbbf23bf service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:13.842296 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-2cf47743-a12e-47dd-b79a-cb1338748514 req-5b3207d9-23e3-4809-8e4f-1a9bdbbf23bf service nova] Creating event network-vif-deleted:2141535c-9709-4a08-b290-b35a8c739837 for instance 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 on n-h2-847009-3 Jul 19 22:44:13.852353 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-2cf47743-a12e-47dd-b79a-cb1338748514 req-5b3207d9-23e3-4809-8e4f-1a9bdbbf23bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056497 Jul 19 22:44:13.853853 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1831/3636] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:44:13.864234 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3e9910f4-aa1e-4c70-a5da-5ad0abfd4e11 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:13.866614 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3e9910f4-aa1e-4c70-a5da-5ad0abfd4e11 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:13.877886 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e9910f4-aa1e-4c70-a5da-5ad0abfd4e11 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:13.878508 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e9910f4-aa1e-4c70-a5da-5ad0abfd4e11 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:13.879869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e9910f4-aa1e-4c70-a5da-5ad0abfd4e11 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:13.880941 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e9910f4-aa1e-4c70-a5da-5ad0abfd4e11 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:13.984447 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d14c793c-32f0-4869-af13-5e557ed1b202 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:14.008192 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d14c793c-32f0-4869-af13-5e557ed1b202 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 200 len: 1495 microversion: 2.1 time: 1.287596 Jul 19 22:44:14.012404 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1806/3637] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:12 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 1495 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:14.022204 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a5d74b4a-2fcc-45ac-a54f-d91857aa2bb5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:14.025195 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a5d74b4a-2fcc-45ac-a54f-d91857aa2bb5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:14.044310 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5d74b4a-2fcc-45ac-a54f-d91857aa2bb5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:14.044891 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5d74b4a-2fcc-45ac-a54f-d91857aa2bb5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:14.045763 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5d74b4a-2fcc-45ac-a54f-d91857aa2bb5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:14.046370 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5d74b4a-2fcc-45ac-a54f-d91857aa2bb5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:14.651195 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a5d74b4a-2fcc-45ac-a54f-d91857aa2bb5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:14.683371 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a5d74b4a-2fcc-45ac-a54f-d91857aa2bb5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1670 microversion: 2.1 time: 0.668851 Jul 19 22:44:14.697996 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1807/3638] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:14 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1670 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:14.704251 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-ffa5319a-2649-49e1-878e-47426d2c83b4 req-055df68a-c370-4135-8307-8ce706600fec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d53ca5c-aaa1-44f3-832d-7f2a9a56db39", "tag": "c237ae7f-dc1c-4392-aa4a-f5d505a41de6"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:14.716904 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-ffa5319a-2649-49e1-878e-47426d2c83b4 req-055df68a-c370-4135-8307-8ce706600fec service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:14.717654 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-ffa5319a-2649-49e1-878e-47426d2c83b4 req-055df68a-c370-4135-8307-8ce706600fec service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:14.744041 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-ffa5319a-2649-49e1-878e-47426d2c83b4 req-055df68a-c370-4135-8307-8ce706600fec service nova] Creating event network-changed:c237ae7f-dc1c-4392-aa4a-f5d505a41de6 for instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 on n-h2-847009-3 Jul 19 22:44:14.751462 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-ffa5319a-2649-49e1-878e-47426d2c83b4 req-055df68a-c370-4135-8307-8ce706600fec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051722 Jul 19 22:44:14.752427 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1808/3639] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:44:14.759119 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7720dd39-daac-49bc-9a1a-9dda24866c5a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:14.762369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7720dd39-daac-49bc-9a1a-9dda24866c5a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 452a29c5-c034-4f02-827f-95ffb5bfffbb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:14.773800 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7720dd39-daac-49bc-9a1a-9dda24866c5a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:14.775749 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7720dd39-daac-49bc-9a1a-9dda24866c5a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:14.778814 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7720dd39-daac-49bc-9a1a-9dda24866c5a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:14.779754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7720dd39-daac-49bc-9a1a-9dda24866c5a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:14.911432 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3e9910f4-aa1e-4c70-a5da-5ad0abfd4e11 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:14.923984 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3e9910f4-aa1e-4c70-a5da-5ad0abfd4e11 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:14.925809 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3e9910f4-aa1e-4c70-a5da-5ad0abfd4e11 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:14.929059 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3e9910f4-aa1e-4c70-a5da-5ad0abfd4e11 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 1.073274 Jul 19 22:44:14.930242 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1832/3640] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:44:13 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:44:14.953293 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a384c26c-d8e4-4c6c-8921-d92dd640daa7 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:14.954979 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a384c26c-d8e4-4c6c-8921-d92dd640daa7 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:14.963887 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a384c26c-d8e4-4c6c-8921-d92dd640daa7 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:14.964939 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a384c26c-d8e4-4c6c-8921-d92dd640daa7 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:14.967883 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a384c26c-d8e4-4c6c-8921-d92dd640daa7 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:14.968598 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a384c26c-d8e4-4c6c-8921-d92dd640daa7 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:15.001800 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:44:15.574016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a384c26c-d8e4-4c6c-8921-d92dd640daa7 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:15.602781 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a384c26c-d8e4-4c6c-8921-d92dd640daa7 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4" status: 200 len: 1483 microversion: 2.1 time: 0.670915 Jul 19 22:44:15.604348 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1833/3641] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:14 2022] GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 => generated 1483 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:15.619858 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9d6a01df-214e-4e24-884f-891018899c40 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:15.621227 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9d6a01df-214e-4e24-884f-891018899c40 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:15.663939 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d6a01df-214e-4e24-884f-891018899c40 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:15.664721 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d6a01df-214e-4e24-884f-891018899c40 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:15.672393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d6a01df-214e-4e24-884f-891018899c40 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:15.673240 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d6a01df-214e-4e24-884f-891018899c40 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:15.703525 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-9d6a01df-214e-4e24-884f-891018899c40 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] HTTP exception thrown: Instance 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 could not be found. Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9d6a01df-214e-4e24-884f-891018899c40 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Request method failure captured: Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 HTTP/1.1 Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zJcOd8ioSoO4Ag7p0FuZhdyFBnwQELvoxLAsblThyrJ_2NxEo2CJ37EEfRT2CZdbZlGMRgWXNVEuSQUWOfX5krUiSHAMeusL8iD4FHXx0Nd2OURbeGsEBn_IDvsFz7TmW6c-8lxScCQfbEdKUx47XHZCtuEAW7dgjTFB9ANV0LmkTU Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: f4f40233895248229ddfdcd06fb65361 Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 could not be found. Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1'} Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 could not be found. Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 could not be found. Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:15.705549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:15.711417 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:15.711417 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:15.711417 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:15.711417 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:44:15.711417 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:44:15.711417 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 could not be found. Jul 19 22:44:15.711417 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:15.714018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9d6a01df-214e-4e24-884f-891018899c40 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Returning 404 to user: Instance 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:44:15.715505 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9d6a01df-214e-4e24-884f-891018899c40 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 404 len: 111 microversion: 2.1 time: 0.108249 Jul 19 22:44:15.717431 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1834/3642] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:15 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:44:15.724064 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f8f8c801-da55-4c8c-995e-d884f04d90c9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:15.725798 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f8f8c801-da55-4c8c-995e-d884f04d90c9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:15.735454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8f8c801-da55-4c8c-995e-d884f04d90c9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:15.740536 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8f8c801-da55-4c8c-995e-d884f04d90c9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:15.743543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8f8c801-da55-4c8c-995e-d884f04d90c9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:15.746707 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8f8c801-da55-4c8c-995e-d884f04d90c9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:15.792988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7720dd39-daac-49bc-9a1a-9dda24866c5a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:15.804119 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7720dd39-daac-49bc-9a1a-9dda24866c5a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb" status: 200 len: 1308 microversion: 2.1 time: 1.049899 Jul 19 22:44:15.808469 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1809/3643] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:14 2022] GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb => generated 1308 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:15.884848 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-546c5d6a-c3b2-42b8-8fd5-c773e63fe433 req-4bae8c69-9d09-463f-8cf0-71d28de34666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fa32776-830f-4a09-814f-536f39a284e4", "tag": "e87d2086-e34b-41a9-a3fc-b54342672708"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:15.908863 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-546c5d6a-c3b2-42b8-8fd5-c773e63fe433 req-4bae8c69-9d09-463f-8cf0-71d28de34666 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:15.909320 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-546c5d6a-c3b2-42b8-8fd5-c773e63fe433 req-4bae8c69-9d09-463f-8cf0-71d28de34666 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:15.938149 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-546c5d6a-c3b2-42b8-8fd5-c773e63fe433 req-4bae8c69-9d09-463f-8cf0-71d28de34666 service nova] Creating event network-changed:e87d2086-e34b-41a9-a3fc-b54342672708 for instance 4fa32776-830f-4a09-814f-536f39a284e4 on n-h1-847009-3 Jul 19 22:44:15.951915 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-546c5d6a-c3b2-42b8-8fd5-c773e63fe433 req-4bae8c69-9d09-463f-8cf0-71d28de34666 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074808 Jul 19 22:44:15.953121 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1810/3644] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:44:15.969149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-25b7ef8d-d1d2-44d1-bc9c-e6c637b71fa5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-345730194", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "87c331fb-040c-45fc-a9a1-e946f840de97"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:16.048530 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-25b7ef8d-d1d2-44d1-bc9c-e6c637b71fa5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] validate_networks() for [('87c331fb-040c-45fc-a9a1-e946f840de97', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:44:16.816162 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f8f8c801-da55-4c8c-995e-d884f04d90c9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:16.829135 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f8f8c801-da55-4c8c-995e-d884f04d90c9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1675 microversion: 2.1 time: 1.110248 Jul 19 22:44:16.829722 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1835/3645] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:15 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1675 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:16.856622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3d2a8039-795e-43f7-a105-89281b5cac1e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:16.857435 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3d2a8039-795e-43f7-a105-89281b5cac1e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:16.866773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d2a8039-795e-43f7-a105-89281b5cac1e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:16.867436 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d2a8039-795e-43f7-a105-89281b5cac1e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:16.868340 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d2a8039-795e-43f7-a105-89281b5cac1e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:16.868888 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d2a8039-795e-43f7-a105-89281b5cac1e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:18.121329 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3d2a8039-795e-43f7-a105-89281b5cac1e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:18.140756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3d2a8039-795e-43f7-a105-89281b5cac1e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:18.145511 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3d2a8039-795e-43f7-a105-89281b5cac1e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:18.152591 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3d2a8039-795e-43f7-a105-89281b5cac1e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 1.306997 Jul 19 22:44:18.154540 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1836/3646] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:44:16 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:44:18.159550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-93495ed0-2a60-4436-933e-ba35e75f7dbe tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:18.163247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-93495ed0-2a60-4436-933e-ba35e75f7dbe tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 452a29c5-c034-4f02-827f-95ffb5bfffbb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:18.188647 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93495ed0-2a60-4436-933e-ba35e75f7dbe tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:18.191781 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93495ed0-2a60-4436-933e-ba35e75f7dbe tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:18.192656 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93495ed0-2a60-4436-933e-ba35e75f7dbe tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:18.193902 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93495ed0-2a60-4436-933e-ba35e75f7dbe tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:19.572460 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-93495ed0-2a60-4436-933e-ba35e75f7dbe tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:19.584892 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-93495ed0-2a60-4436-933e-ba35e75f7dbe tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb" status: 200 len: 1308 microversion: 2.1 time: 1.427929 Jul 19 22:44:19.597189 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1837/3647] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:18 2022] GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb => generated 1308 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:19.727162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-25b7ef8d-d1d2-44d1-bc9c-e6c637b71fa5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:44:19.728387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-25b7ef8d-d1d2-44d1-bc9c-e6c637b71fa5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:44:19.729537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-25b7ef8d-d1d2-44d1-bc9c-e6c637b71fa5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:44:19.730362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-25b7ef8d-d1d2-44d1-bc9c-e6c637b71fa5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:44:19.731466 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-25b7ef8d-d1d2-44d1-bc9c-e6c637b71fa5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:44:19.743163 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-25b7ef8d-d1d2-44d1-bc9c-e6c637b71fa5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:19.743918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-25b7ef8d-d1d2-44d1-bc9c-e6c637b71fa5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:19.744906 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-25b7ef8d-d1d2-44d1-bc9c-e6c637b71fa5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:19.745537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-25b7ef8d-d1d2-44d1-bc9c-e6c637b71fa5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:19.770983 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6aab3d1b-e618-4001-bb0d-0f7783a1ecad tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1462961018", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:19.771843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-25b7ef8d-d1d2-44d1-bc9c-e6c637b71fa5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Getting quotas for project a2bcdb843a7d4a1ebe467160eee0d6e1. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:44:19.793144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-25b7ef8d-d1d2-44d1-bc9c-e6c637b71fa5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Getting quotas for user f4f40233895248229ddfdcd06fb65361 and project a2bcdb843a7d4a1ebe467160eee0d6e1. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:44:19.794470 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:44:19.822939 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-25b7ef8d-d1d2-44d1-bc9c-e6c637b71fa5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:44:19.826031 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-25b7ef8d-d1d2-44d1-bc9c-e6c637b71fa5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 2e2b11e6-8039-4f92-b971-2e0a602481c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:44:19.847631 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-6aab3d1b-e618-4001-bb0d-0f7783a1ecad tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] validate_networks() for [('77eff502-40d6-4b6e-8d67-74356e21174d', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:44:19.888265 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-25b7ef8d-d1d2-44d1-bc9c-e6c637b71fa5 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.923994 Jul 19 22:44:19.889464 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1811/3648] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:44:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 3935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:44:19.894159 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-f3c26678-d2a4-4160-987a-969afa613895 req-6ead2195-99bd-4ac1-a843-d79944e11229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d53ca5c-aaa1-44f3-832d-7f2a9a56db39", "tag": "98a30d5e-ad65-436d-96ad-23f81ba2c4be"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:19.904508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-f3c26678-d2a4-4160-987a-969afa613895 req-6ead2195-99bd-4ac1-a843-d79944e11229 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:19.905381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-f3c26678-d2a4-4160-987a-969afa613895 req-6ead2195-99bd-4ac1-a843-d79944e11229 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:19.937406 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-f3c26678-d2a4-4160-987a-969afa613895 req-6ead2195-99bd-4ac1-a843-d79944e11229 service nova] Creating event network-changed:98a30d5e-ad65-436d-96ad-23f81ba2c4be for instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 on n-h2-847009-3 Jul 19 22:44:19.949706 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-f3c26678-d2a4-4160-987a-969afa613895 req-6ead2195-99bd-4ac1-a843-d79944e11229 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058883 Jul 19 22:44:19.950874 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1812/3649] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:44:19.956633 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fbddd02e-a522-4ce2-9ca8-59e55bca6b68 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:19.957635 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fbddd02e-a522-4ce2-9ca8-59e55bca6b68 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:19.966310 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fbddd02e-a522-4ce2-9ca8-59e55bca6b68 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:19.967060 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fbddd02e-a522-4ce2-9ca8-59e55bca6b68 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:19.968080 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fbddd02e-a522-4ce2-9ca8-59e55bca6b68 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:19.968718 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fbddd02e-a522-4ce2-9ca8-59e55bca6b68 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:21.182349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fbddd02e-a522-4ce2-9ca8-59e55bca6b68 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:21.194447 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fbddd02e-a522-4ce2-9ca8-59e55bca6b68 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 1.242039 Jul 19 22:44:21.195451 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1813/3650] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:19 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:21.203354 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-91ef0a1b-faf2-40d7-b16b-f33af8ba88d0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:21.204286 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-91ef0a1b-faf2-40d7-b16b-f33af8ba88d0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:21.213703 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-91ef0a1b-faf2-40d7-b16b-f33af8ba88d0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:21.214694 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-91ef0a1b-faf2-40d7-b16b-f33af8ba88d0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:21.215834 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-91ef0a1b-faf2-40d7-b16b-f33af8ba88d0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:21.216483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-91ef0a1b-faf2-40d7-b16b-f33af8ba88d0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:21.222446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:44:21.796967 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-91ef0a1b-faf2-40d7-b16b-f33af8ba88d0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:21.816334 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-91ef0a1b-faf2-40d7-b16b-f33af8ba88d0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:21.820084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-91ef0a1b-faf2-40d7-b16b-f33af8ba88d0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:21.824945 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-91ef0a1b-faf2-40d7-b16b-f33af8ba88d0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 0.627685 Jul 19 22:44:21.844125 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1814/3651] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:44:21 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:44:21.851376 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cc4d2746-3d29-431f-b02f-7f0984fbd0e2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:21.852426 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cc4d2746-3d29-431f-b02f-7f0984fbd0e2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 2e2b11e6-8039-4f92-b971-2e0a602481c4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:21.861289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc4d2746-3d29-431f-b02f-7f0984fbd0e2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:21.862091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc4d2746-3d29-431f-b02f-7f0984fbd0e2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:21.862865 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc4d2746-3d29-431f-b02f-7f0984fbd0e2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:21.863511 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc4d2746-3d29-431f-b02f-7f0984fbd0e2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:21.908654 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-6aab3d1b-e618-4001-bb0d-0f7783a1ecad tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:44:21.909812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-6aab3d1b-e618-4001-bb0d-0f7783a1ecad tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:44:21.910513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-6aab3d1b-e618-4001-bb0d-0f7783a1ecad tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:44:21.911264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-6aab3d1b-e618-4001-bb0d-0f7783a1ecad tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:44:21.912471 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-6aab3d1b-e618-4001-bb0d-0f7783a1ecad tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:44:21.926348 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6aab3d1b-e618-4001-bb0d-0f7783a1ecad tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:21.927322 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6aab3d1b-e618-4001-bb0d-0f7783a1ecad tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:21.928869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6aab3d1b-e618-4001-bb0d-0f7783a1ecad tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:21.929571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6aab3d1b-e618-4001-bb0d-0f7783a1ecad tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:21.979302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-6aab3d1b-e618-4001-bb0d-0f7783a1ecad tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Getting quotas for project 95469b549ae7425a83e0d93bb8c10860. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:44:21.989006 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cc4d2746-3d29-431f-b02f-7f0984fbd0e2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:22.001581 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-6aab3d1b-e618-4001-bb0d-0f7783a1ecad tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Getting quotas for user 5f92608789324ac48fef6ce87a745a07 and project 95469b549ae7425a83e0d93bb8c10860. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:44:22.008757 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cc4d2746-3d29-431f-b02f-7f0984fbd0e2 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4" status: 200 len: 1272 microversion: 2.1 time: 0.162994 Jul 19 22:44:22.011597 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1815/3652] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:21 2022] GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4 => generated 1272 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:22.024740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-bcd6c1c6-bddc-4a91-8873-07ebf7aabe66 req-3de05d6e-3140-4c56-93f1-b85f9d2e5866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "452a29c5-c034-4f02-827f-95ffb5bfffbb", "name": "network-vif-plugged", "status": "completed", "tag": "610a985c-6bc4-4a7d-b16c-e561d3eb2171"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:22.042538 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6aab3d1b-e618-4001-bb0d-0f7783a1ecad tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:44:22.045361 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-bcd6c1c6-bddc-4a91-8873-07ebf7aabe66 req-3de05d6e-3140-4c56-93f1-b85f9d2e5866 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:22.048756 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-bcd6c1c6-bddc-4a91-8873-07ebf7aabe66 req-3de05d6e-3140-4c56-93f1-b85f9d2e5866 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:22.050439 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6aab3d1b-e618-4001-bb0d-0f7783a1ecad tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:44:22.085561 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-bcd6c1c6-bddc-4a91-8873-07ebf7aabe66 req-3de05d6e-3140-4c56-93f1-b85f9d2e5866 service nova] Creating event network-vif-plugged:610a985c-6bc4-4a7d-b16c-e561d3eb2171 for instance 452a29c5-c034-4f02-827f-95ffb5bfffbb on n-h1-847009-3 Jul 19 22:44:22.100841 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-bcd6c1c6-bddc-4a91-8873-07ebf7aabe66 req-3de05d6e-3140-4c56-93f1-b85f9d2e5866 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087296 Jul 19 22:44:22.104509 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1816/3653] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:44:22.120926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-14908127-1fc0-4244-a3b4-1bf9d37d9c99 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:22.122186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-14908127-1fc0-4244-a3b4-1bf9d37d9c99 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 452a29c5-c034-4f02-827f-95ffb5bfffbb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:22.134690 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14908127-1fc0-4244-a3b4-1bf9d37d9c99 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:22.136306 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14908127-1fc0-4244-a3b4-1bf9d37d9c99 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:22.137545 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14908127-1fc0-4244-a3b4-1bf9d37d9c99 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:22.138248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14908127-1fc0-4244-a3b4-1bf9d37d9c99 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:22.187665 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6aab3d1b-e618-4001-bb0d-0f7783a1ecad tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.586682 Jul 19 22:44:22.192316 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1838/3654] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:44:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 2594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:44:22.213328 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-877af163-4fb0-4d7d-bdaf-ab3019fdf2b8 req-13d2d0f0-bcb0-474f-8cd1-ffe02b346877 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d53ca5c-aaa1-44f3-832d-7f2a9a56db39", "tag": "0a907ea9-840e-4a11-a8f9-aa989d95ed73"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:22.238707 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-877af163-4fb0-4d7d-bdaf-ab3019fdf2b8 req-13d2d0f0-bcb0-474f-8cd1-ffe02b346877 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:22.245665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-877af163-4fb0-4d7d-bdaf-ab3019fdf2b8 req-13d2d0f0-bcb0-474f-8cd1-ffe02b346877 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:22.276654 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-877af163-4fb0-4d7d-bdaf-ab3019fdf2b8 req-13d2d0f0-bcb0-474f-8cd1-ffe02b346877 service nova] Creating event network-changed:0a907ea9-840e-4a11-a8f9-aa989d95ed73 for instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 on n-h2-847009-3 Jul 19 22:44:22.282805 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-877af163-4fb0-4d7d-bdaf-ab3019fdf2b8 req-13d2d0f0-bcb0-474f-8cd1-ffe02b346877 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076139 Jul 19 22:44:22.284896 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1839/3655] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:44:22.291514 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-442bd5da-85c4-41fa-a1da-2ad3f97d478f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:22.292763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-442bd5da-85c4-41fa-a1da-2ad3f97d478f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:22.586786 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-442bd5da-85c4-41fa-a1da-2ad3f97d478f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:22.598118 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-442bd5da-85c4-41fa-a1da-2ad3f97d478f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae" status: 200 len: 1222 microversion: 2.1 time: 0.310544 Jul 19 22:44:22.615340 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1840/3656] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:22 2022] GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae => generated 1222 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:22.682606 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-05f8dd20-7205-4370-8ae7-d4c48e2ac8fb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1906973333", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:22.762470 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-05f8dd20-7205-4370-8ae7-d4c48e2ac8fb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] validate_networks() for [('77eff502-40d6-4b6e-8d67-74356e21174d', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:44:23.435026 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-14908127-1fc0-4244-a3b4-1bf9d37d9c99 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:23.456781 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-14908127-1fc0-4244-a3b4-1bf9d37d9c99 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb" status: 200 len: 1308 microversion: 2.1 time: 1.347792 Jul 19 22:44:23.459513 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1817/3657] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:22 2022] GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb => generated 1308 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:23.485039 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bdb35fa8-7992-48bb-8b14-e5eaaad1c15a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:23.511375 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bdb35fa8-7992-48bb-8b14-e5eaaad1c15a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:23.527539 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bdb35fa8-7992-48bb-8b14-e5eaaad1c15a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:23.528626 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bdb35fa8-7992-48bb-8b14-e5eaaad1c15a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:23.529768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bdb35fa8-7992-48bb-8b14-e5eaaad1c15a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:23.530429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bdb35fa8-7992-48bb-8b14-e5eaaad1c15a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:24.335534 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bdb35fa8-7992-48bb-8b14-e5eaaad1c15a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:24.349359 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bdb35fa8-7992-48bb-8b14-e5eaaad1c15a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:24.354305 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bdb35fa8-7992-48bb-8b14-e5eaaad1c15a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:24.361027 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bdb35fa8-7992-48bb-8b14-e5eaaad1c15a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 0.895838 Jul 19 22:44:24.362292 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1818/3658] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:44:23 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:44:24.368746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b7d7fca0-6782-4ae9-a63d-ad1d6403c7d1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:24.377980 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b7d7fca0-6782-4ae9-a63d-ad1d6403c7d1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 2e2b11e6-8039-4f92-b971-2e0a602481c4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:24.392439 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7d7fca0-6782-4ae9-a63d-ad1d6403c7d1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:24.393740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7d7fca0-6782-4ae9-a63d-ad1d6403c7d1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:24.394740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7d7fca0-6782-4ae9-a63d-ad1d6403c7d1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:24.395400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7d7fca0-6782-4ae9-a63d-ad1d6403c7d1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:25.496684 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-05f8dd20-7205-4370-8ae7-d4c48e2ac8fb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:44:25.497255 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-05f8dd20-7205-4370-8ae7-d4c48e2ac8fb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:44:25.497953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-05f8dd20-7205-4370-8ae7-d4c48e2ac8fb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:44:25.498107 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-05f8dd20-7205-4370-8ae7-d4c48e2ac8fb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:44:25.498687 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-05f8dd20-7205-4370-8ae7-d4c48e2ac8fb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:44:25.513888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b7d7fca0-6782-4ae9-a63d-ad1d6403c7d1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:25.523324 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b7d7fca0-6782-4ae9-a63d-ad1d6403c7d1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4" status: 200 len: 1314 microversion: 2.1 time: 1.159651 Jul 19 22:44:25.525672 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-05f8dd20-7205-4370-8ae7-d4c48e2ac8fb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:25.536006 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1819/3659] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:24 2022] GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4 => generated 1314 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:25.539261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-05f8dd20-7205-4370-8ae7-d4c48e2ac8fb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:25.540518 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-05f8dd20-7205-4370-8ae7-d4c48e2ac8fb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:25.541230 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-05f8dd20-7205-4370-8ae7-d4c48e2ac8fb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:25.553091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-b5aa21ed-1342-4e7c-bdd5-1422e6dd9488 req-e556b8ba-b9fb-46b4-ac9c-a67953bb2220 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e2b11e6-8039-4f92-b971-2e0a602481c4", "tag": "6ea5b749-54c7-4f97-b59e-d97f34b726c8"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:25.577308 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b5aa21ed-1342-4e7c-bdd5-1422e6dd9488 req-e556b8ba-b9fb-46b4-ac9c-a67953bb2220 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:25.581049 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b5aa21ed-1342-4e7c-bdd5-1422e6dd9488 req-e556b8ba-b9fb-46b4-ac9c-a67953bb2220 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:25.596324 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-05f8dd20-7205-4370-8ae7-d4c48e2ac8fb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Getting quotas for project 95469b549ae7425a83e0d93bb8c10860. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:44:25.611259 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-05f8dd20-7205-4370-8ae7-d4c48e2ac8fb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Getting quotas for user 5f92608789324ac48fef6ce87a745a07 and project 95469b549ae7425a83e0d93bb8c10860. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:44:25.612357 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-b5aa21ed-1342-4e7c-bdd5-1422e6dd9488 req-e556b8ba-b9fb-46b4-ac9c-a67953bb2220 service nova] Creating event network-changed:6ea5b749-54c7-4f97-b59e-d97f34b726c8 for instance 2e2b11e6-8039-4f92-b971-2e0a602481c4 on n-h2-847009-3 Jul 19 22:44:25.625863 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-b5aa21ed-1342-4e7c-bdd5-1422e6dd9488 req-e556b8ba-b9fb-46b4-ac9c-a67953bb2220 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085607 Jul 19 22:44:25.633565 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1820/3660] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:44:25.641563 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b60af7cd-5548-4180-a7bc-6bf46833502c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:25.647291 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b60af7cd-5548-4180-a7bc-6bf46833502c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 452a29c5-c034-4f02-827f-95ffb5bfffbb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:25.649687 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-05f8dd20-7205-4370-8ae7-d4c48e2ac8fb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:44:25.653552 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-05f8dd20-7205-4370-8ae7-d4c48e2ac8fb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:44:25.666844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b60af7cd-5548-4180-a7bc-6bf46833502c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:25.667735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b60af7cd-5548-4180-a7bc-6bf46833502c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:25.668783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b60af7cd-5548-4180-a7bc-6bf46833502c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:25.669458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b60af7cd-5548-4180-a7bc-6bf46833502c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:25.761562 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-05f8dd20-7205-4370-8ae7-d4c48e2ac8fb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.086869 Jul 19 22:44:25.766510 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1841/3661] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:44:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 3093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 22:44:25.777029 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8086369a-9957-4100-9108-5048a51bc8d2 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:25.780272 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8086369a-9957-4100-9108-5048a51bc8d2 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:25.794354 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8086369a-9957-4100-9108-5048a51bc8d2 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:25.795358 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8086369a-9957-4100-9108-5048a51bc8d2 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:25.800254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8086369a-9957-4100-9108-5048a51bc8d2 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:25.801205 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8086369a-9957-4100-9108-5048a51bc8d2 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:27.269993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b60af7cd-5548-4180-a7bc-6bf46833502c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:27.281528 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b60af7cd-5548-4180-a7bc-6bf46833502c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb" status: 200 len: 1488 microversion: 2.1 time: 1.646310 Jul 19 22:44:27.282909 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1821/3662] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:25 2022] GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb => generated 1488 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:27.290794 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-64ca6099-4a7b-4436-b9cd-7749e4dcb32f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:27.293404 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-64ca6099-4a7b-4436-b9cd-7749e4dcb32f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:27.302091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-64ca6099-4a7b-4436-b9cd-7749e4dcb32f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:27.304239 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-64ca6099-4a7b-4436-b9cd-7749e4dcb32f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:27.305402 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-64ca6099-4a7b-4436-b9cd-7749e4dcb32f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:27.306106 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-64ca6099-4a7b-4436-b9cd-7749e4dcb32f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:27.557941 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8086369a-9957-4100-9108-5048a51bc8d2 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:27.566197 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-64ca6099-4a7b-4436-b9cd-7749e4dcb32f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:27.576580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8086369a-9957-4100-9108-5048a51bc8d2 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:27.578621 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8086369a-9957-4100-9108-5048a51bc8d2 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:27.589909 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8086369a-9957-4100-9108-5048a51bc8d2 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 1.819889 Jul 19 22:44:27.591181 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1842/3663] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:44:25 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:44:27.607781 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-998995ed-75db-4946-b70f-6eae52b8a0a4 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:27.610700 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-998995ed-75db-4946-b70f-6eae52b8a0a4 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 2e2b11e6-8039-4f92-b971-2e0a602481c4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:27.617126 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-998995ed-75db-4946-b70f-6eae52b8a0a4 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:27.617574 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-998995ed-75db-4946-b70f-6eae52b8a0a4 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:27.618355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-998995ed-75db-4946-b70f-6eae52b8a0a4 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:27.618826 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-998995ed-75db-4946-b70f-6eae52b8a0a4 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:27.621781 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-64ca6099-4a7b-4436-b9cd-7749e4dcb32f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1274 microversion: 2.1 time: 0.334903 Jul 19 22:44:27.627282 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1822/3664] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:27 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1274 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:27.632813 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-58215760-5bc4-4a6d-b3a2-7bcb59405dae req-9d61ef7e-d404-4ff1-9663-482661ebb877 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d53ca5c-aaa1-44f3-832d-7f2a9a56db39", "tag": "504225f7-9cee-4c36-9a1d-bb80c366dfae"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:27.666852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-58215760-5bc4-4a6d-b3a2-7bcb59405dae req-9d61ef7e-d404-4ff1-9663-482661ebb877 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:27.667340 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-58215760-5bc4-4a6d-b3a2-7bcb59405dae req-9d61ef7e-d404-4ff1-9663-482661ebb877 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:27.714147 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-58215760-5bc4-4a6d-b3a2-7bcb59405dae req-9d61ef7e-d404-4ff1-9663-482661ebb877 service nova] Creating event network-changed:504225f7-9cee-4c36-9a1d-bb80c366dfae for instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 on n-h2-847009-3 Jul 19 22:44:27.724968 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-58215760-5bc4-4a6d-b3a2-7bcb59405dae req-9d61ef7e-d404-4ff1-9663-482661ebb877 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095566 Jul 19 22:44:27.731838 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1823/3665] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:44:27.737976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-61ee0ba4-f3a1-4b3c-8d9b-9fb8cb9b1aa7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-888574862", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "6119d69d-194a-407a-a78f-64890b6702ed"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:27.876179 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-61ee0ba4-f3a1-4b3c-8d9b-9fb8cb9b1aa7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] validate_networks() for [('6119d69d-194a-407a-a78f-64890b6702ed', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:44:28.496856 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-998995ed-75db-4946-b70f-6eae52b8a0a4 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:28.537980 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-998995ed-75db-4946-b70f-6eae52b8a0a4 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4" status: 200 len: 1314 microversion: 2.1 time: 0.939427 Jul 19 22:44:28.542178 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1843/3666] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:27 2022] GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4 => generated 1314 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:28.629142 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a5ed9125-2499-46dc-a493-1bcdc73e9cb5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:28.629791 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a5ed9125-2499-46dc-a493-1bcdc73e9cb5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:28.661964 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a5ed9125-2499-46dc-a493-1bcdc73e9cb5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:28.665627 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a5ed9125-2499-46dc-a493-1bcdc73e9cb5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:28.667729 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a5ed9125-2499-46dc-a493-1bcdc73e9cb5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:28.668362 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a5ed9125-2499-46dc-a493-1bcdc73e9cb5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:29.459506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a5ed9125-2499-46dc-a493-1bcdc73e9cb5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:29.483802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a5ed9125-2499-46dc-a493-1bcdc73e9cb5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:29.488563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a5ed9125-2499-46dc-a493-1bcdc73e9cb5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:29.490972 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a5ed9125-2499-46dc-a493-1bcdc73e9cb5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 0.877526 Jul 19 22:44:29.492416 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1844/3667] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:44:28 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:44:29.511486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dbe2d439-1a09-47a7-90b2-7c2a3f65649b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:29.512603 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dbe2d439-1a09-47a7-90b2-7c2a3f65649b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:29.542681 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dbe2d439-1a09-47a7-90b2-7c2a3f65649b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:29.545483 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dbe2d439-1a09-47a7-90b2-7c2a3f65649b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:29.550719 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dbe2d439-1a09-47a7-90b2-7c2a3f65649b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:29.551349 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dbe2d439-1a09-47a7-90b2-7c2a3f65649b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:29.760906 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:44:29.807944 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:44:29.823187 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dbe2d439-1a09-47a7-90b2-7c2a3f65649b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:29.839192 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dbe2d439-1a09-47a7-90b2-7c2a3f65649b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1280 microversion: 2.1 time: 0.344791 Jul 19 22:44:29.840135 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1845/3668] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:29 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1280 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:29.867584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fb4116bb-2979-42a4-8d17-121fa1670e53 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:29.868657 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fb4116bb-2979-42a4-8d17-121fa1670e53 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 2e2b11e6-8039-4f92-b971-2e0a602481c4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:29.877229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fb4116bb-2979-42a4-8d17-121fa1670e53 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:29.878854 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fb4116bb-2979-42a4-8d17-121fa1670e53 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:29.880069 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fb4116bb-2979-42a4-8d17-121fa1670e53 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:29.881272 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fb4116bb-2979-42a4-8d17-121fa1670e53 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:29.997312 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-61ee0ba4-f3a1-4b3c-8d9b-9fb8cb9b1aa7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:44:29.998443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-61ee0ba4-f3a1-4b3c-8d9b-9fb8cb9b1aa7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:44:29.999863 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-61ee0ba4-f3a1-4b3c-8d9b-9fb8cb9b1aa7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:44:30.000909 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-61ee0ba4-f3a1-4b3c-8d9b-9fb8cb9b1aa7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:44:30.001755 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-61ee0ba4-f3a1-4b3c-8d9b-9fb8cb9b1aa7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:44:30.018770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61ee0ba4-f3a1-4b3c-8d9b-9fb8cb9b1aa7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:30.019456 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61ee0ba4-f3a1-4b3c-8d9b-9fb8cb9b1aa7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:30.022301 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61ee0ba4-f3a1-4b3c-8d9b-9fb8cb9b1aa7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:30.023388 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61ee0ba4-f3a1-4b3c-8d9b-9fb8cb9b1aa7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:30.059670 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-61ee0ba4-f3a1-4b3c-8d9b-9fb8cb9b1aa7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Getting quotas for project 9bd4d0caf2f347218af6ffd52f250c59. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:44:30.066823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-61ee0ba4-f3a1-4b3c-8d9b-9fb8cb9b1aa7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Getting quotas for user 1db06ac41e9f4fe290e535f703af484d and project 9bd4d0caf2f347218af6ffd52f250c59. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:44:30.096385 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-61ee0ba4-f3a1-4b3c-8d9b-9fb8cb9b1aa7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:44:30.099464 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-61ee0ba4-f3a1-4b3c-8d9b-9fb8cb9b1aa7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 617aa88b-23a3-4d6f-bf46-dd8c78af517f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:44:30.173139 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-61ee0ba4-f3a1-4b3c-8d9b-9fb8cb9b1aa7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.439323 Jul 19 22:44:30.175939 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1824/3669] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:44:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:44:30.198365 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4c0cb9fe-2cb1-4bf3-8da1-4c8fdf75cb80 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:30.200746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4c0cb9fe-2cb1-4bf3-8da1-4c8fdf75cb80 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 617aa88b-23a3-4d6f-bf46-dd8c78af517f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:30.395684 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4c0cb9fe-2cb1-4bf3-8da1-4c8fdf75cb80 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:30.413373 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4c0cb9fe-2cb1-4bf3-8da1-4c8fdf75cb80 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f" status: 200 len: 1208 microversion: 2.1 time: 0.228410 Jul 19 22:44:30.416336 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1825/3670] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:30 2022] GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f => generated 1208 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:30.522973 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-59d426a7-2d30-4508-975d-ebf652bbf1a9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:30.523732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-59d426a7-2d30-4508-975d-ebf652bbf1a9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:30.539403 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-59d426a7-2d30-4508-975d-ebf652bbf1a9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:30.540270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-59d426a7-2d30-4508-975d-ebf652bbf1a9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:30.541216 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-59d426a7-2d30-4508-975d-ebf652bbf1a9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:30.541914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-59d426a7-2d30-4508-975d-ebf652bbf1a9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:31.140868 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fb4116bb-2979-42a4-8d17-121fa1670e53 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:31.151133 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fb4116bb-2979-42a4-8d17-121fa1670e53 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4" status: 200 len: 1314 microversion: 2.1 time: 1.289402 Jul 19 22:44:31.152236 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1846/3671] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:29 2022] GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4 => generated 1314 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:31.157325 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7a1d6653-086d-486c-90f5-2b90f21e71ac tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:31.158338 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7a1d6653-086d-486c-90f5-2b90f21e71ac tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:31.175662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a1d6653-086d-486c-90f5-2b90f21e71ac tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:31.176623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a1d6653-086d-486c-90f5-2b90f21e71ac tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:31.179668 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a1d6653-086d-486c-90f5-2b90f21e71ac tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:31.181726 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a1d6653-086d-486c-90f5-2b90f21e71ac tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:31.502346 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-59d426a7-2d30-4508-975d-ebf652bbf1a9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:31.536246 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-59d426a7-2d30-4508-975d-ebf652bbf1a9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:31.546218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-59d426a7-2d30-4508-975d-ebf652bbf1a9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:31.551470 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-59d426a7-2d30-4508-975d-ebf652bbf1a9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 1.032695 Jul 19 22:44:31.558339 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1826/3672] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:44:30 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:44:31.585496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-1ebc498e-b055-4191-bc36-21cadb87ce42 req-07063daf-3f49-4c12-b868-15dc68f35b19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e2b11e6-8039-4f92-b971-2e0a602481c4", "name": "network-vif-plugged", "status": "completed", "tag": "6ea5b749-54c7-4f97-b59e-d97f34b726c8"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:31.624848 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1ebc498e-b055-4191-bc36-21cadb87ce42 req-07063daf-3f49-4c12-b868-15dc68f35b19 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:31.631074 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1ebc498e-b055-4191-bc36-21cadb87ce42 req-07063daf-3f49-4c12-b868-15dc68f35b19 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:31.686117 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-1ebc498e-b055-4191-bc36-21cadb87ce42 req-07063daf-3f49-4c12-b868-15dc68f35b19 service nova] Creating event network-vif-plugged:6ea5b749-54c7-4f97-b59e-d97f34b726c8 for instance 2e2b11e6-8039-4f92-b971-2e0a602481c4 on n-h2-847009-3 Jul 19 22:44:31.712533 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-1ebc498e-b055-4191-bc36-21cadb87ce42 req-07063daf-3f49-4c12-b868-15dc68f35b19 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151412 Jul 19 22:44:31.714498 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1827/3673] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:44:31.736828 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2ff8e430-b836-4cd6-82b4-98fcf7f95bd9 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:31.737746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2ff8e430-b836-4cd6-82b4-98fcf7f95bd9 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 617aa88b-23a3-4d6f-bf46-dd8c78af517f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:31.759279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2ff8e430-b836-4cd6-82b4-98fcf7f95bd9 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:31.760363 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2ff8e430-b836-4cd6-82b4-98fcf7f95bd9 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:31.762017 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2ff8e430-b836-4cd6-82b4-98fcf7f95bd9 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:31.763485 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2ff8e430-b836-4cd6-82b4-98fcf7f95bd9 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:31.998034 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7a1d6653-086d-486c-90f5-2b90f21e71ac tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:32.008635 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7a1d6653-086d-486c-90f5-2b90f21e71ac tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1322 microversion: 2.1 time: 0.855051 Jul 19 22:44:32.009930 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1847/3674] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:31 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1322 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:32.014756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-80dfbb51-6072-46d0-a590-b22d165a38de req-4126cb5a-b808-4429-8461-4aa5513c65da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d53ca5c-aaa1-44f3-832d-7f2a9a56db39", "tag": "30578dff-afdd-4547-842d-9204f90d0883"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:32.024274 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-80dfbb51-6072-46d0-a590-b22d165a38de req-4126cb5a-b808-4429-8461-4aa5513c65da service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:32.026732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-80dfbb51-6072-46d0-a590-b22d165a38de req-4126cb5a-b808-4429-8461-4aa5513c65da service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:32.042045 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-80dfbb51-6072-46d0-a590-b22d165a38de req-4126cb5a-b808-4429-8461-4aa5513c65da service nova] Creating event network-changed:30578dff-afdd-4547-842d-9204f90d0883 for instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 on n-h2-847009-3 Jul 19 22:44:32.054219 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-80dfbb51-6072-46d0-a590-b22d165a38de req-4126cb5a-b808-4429-8461-4aa5513c65da service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038663 Jul 19 22:44:32.056442 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1848/3675] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:44:32.095341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2ff8e430-b836-4cd6-82b4-98fcf7f95bd9 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:32.104422 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2ff8e430-b836-4cd6-82b4-98fcf7f95bd9 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f" status: 200 len: 1260 microversion: 2.1 time: 0.387686 Jul 19 22:44:32.125540 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1828/3676] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:31 2022] GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f => generated 1260 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:32.178600 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-784766ad-3aed-43aa-9240-fa3d36dcb65e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:32.183319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-784766ad-3aed-43aa-9240-fa3d36dcb65e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 2e2b11e6-8039-4f92-b971-2e0a602481c4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:32.218899 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-784766ad-3aed-43aa-9240-fa3d36dcb65e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:32.219933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-784766ad-3aed-43aa-9240-fa3d36dcb65e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:32.221647 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-784766ad-3aed-43aa-9240-fa3d36dcb65e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:32.223030 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-784766ad-3aed-43aa-9240-fa3d36dcb65e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:32.601392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2f631d1e-0206-40f1-bdc6-867b39d0f6f8 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:32.602844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2f631d1e-0206-40f1-bdc6-867b39d0f6f8 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:32.610923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2f631d1e-0206-40f1-bdc6-867b39d0f6f8 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:32.611709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2f631d1e-0206-40f1-bdc6-867b39d0f6f8 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:32.612511 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2f631d1e-0206-40f1-bdc6-867b39d0f6f8 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:32.613327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2f631d1e-0206-40f1-bdc6-867b39d0f6f8 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:32.931302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-784766ad-3aed-43aa-9240-fa3d36dcb65e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:32.949780 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-784766ad-3aed-43aa-9240-fa3d36dcb65e tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4" status: 200 len: 1314 microversion: 2.1 time: 0.776837 Jul 19 22:44:32.961738 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1849/3677] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:32 2022] GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4 => generated 1314 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:32.972367 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-01c1e2b4-ccdd-4892-90e3-5f31e2c8e5a4 req-b0ab2727-c3b3-45e7-9cb7-6fd752c90f94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77e3dc73-fee1-4b35-8506-9acfc60bc789", "tag": "617c6e0e-4424-4a36-8c61-7159e4a929a2"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:32.985085 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-01c1e2b4-ccdd-4892-90e3-5f31e2c8e5a4 req-b0ab2727-c3b3-45e7-9cb7-6fd752c90f94 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:32.985836 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-01c1e2b4-ccdd-4892-90e3-5f31e2c8e5a4 req-b0ab2727-c3b3-45e7-9cb7-6fd752c90f94 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:33.003442 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-01c1e2b4-ccdd-4892-90e3-5f31e2c8e5a4 req-b0ab2727-c3b3-45e7-9cb7-6fd752c90f94 service nova] Creating event network-changed:617c6e0e-4424-4a36-8c61-7159e4a929a2 for instance 77e3dc73-fee1-4b35-8506-9acfc60bc789 on n-h2-847009-3 Jul 19 22:44:33.010481 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-01c1e2b4-ccdd-4892-90e3-5f31e2c8e5a4 req-b0ab2727-c3b3-45e7-9cb7-6fd752c90f94 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046075 Jul 19 22:44:33.012854 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1850/3678] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:44:33.036121 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-44a4e6d7-0940-49d4-812e-a75d09ab46c2 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:33.037550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-44a4e6d7-0940-49d4-812e-a75d09ab46c2 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:33.045778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44a4e6d7-0940-49d4-812e-a75d09ab46c2 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:33.046901 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44a4e6d7-0940-49d4-812e-a75d09ab46c2 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:33.048655 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44a4e6d7-0940-49d4-812e-a75d09ab46c2 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:33.049301 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44a4e6d7-0940-49d4-812e-a75d09ab46c2 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:33.641273 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2f631d1e-0206-40f1-bdc6-867b39d0f6f8 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:33.660180 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2f631d1e-0206-40f1-bdc6-867b39d0f6f8 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:33.668737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2f631d1e-0206-40f1-bdc6-867b39d0f6f8 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:33.670074 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2f631d1e-0206-40f1-bdc6-867b39d0f6f8 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 1.077830 Jul 19 22:44:33.670706 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1829/3679] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:44:32 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:44:33.699293 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3b9a087d-d9e0-494c-bf38-7031dba8940f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:33.700046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3b9a087d-d9e0-494c-bf38-7031dba8940f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 617aa88b-23a3-4d6f-bf46-dd8c78af517f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:33.728793 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:44:33.732996 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b9a087d-d9e0-494c-bf38-7031dba8940f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:33.742663 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b9a087d-d9e0-494c-bf38-7031dba8940f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:33.743662 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b9a087d-d9e0-494c-bf38-7031dba8940f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:33.744121 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b9a087d-d9e0-494c-bf38-7031dba8940f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:33.839724 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-44a4e6d7-0940-49d4-812e-a75d09ab46c2 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:33.849666 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-44a4e6d7-0940-49d4-812e-a75d09ab46c2 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1322 microversion: 2.1 time: 0.823932 Jul 19 22:44:33.854189 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1851/3680] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:33 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1322 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:33.968968 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4b8b7f3f-4d88-4a9d-9174-96f4992f24a6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:33.970060 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4b8b7f3f-4d88-4a9d-9174-96f4992f24a6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 2e2b11e6-8039-4f92-b971-2e0a602481c4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:33.983933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b8b7f3f-4d88-4a9d-9174-96f4992f24a6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:33.984805 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b8b7f3f-4d88-4a9d-9174-96f4992f24a6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:33.986180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b8b7f3f-4d88-4a9d-9174-96f4992f24a6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:33.986866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b8b7f3f-4d88-4a9d-9174-96f4992f24a6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:34.073171 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3b9a087d-d9e0-494c-bf38-7031dba8940f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:34.081975 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3b9a087d-d9e0-494c-bf38-7031dba8940f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f" status: 200 len: 1266 microversion: 2.1 time: 0.391842 Jul 19 22:44:34.082942 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1830/3681] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:33 2022] GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f => generated 1266 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:34.108125 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-ade2304e-a5ed-4afd-b6f4-7101420f4212 req-5818b976-42a3-44d1-a096-19c4626b4c7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08ecb42e-a6ee-4f1e-976d-33e037bdd6ae", "tag": "9e44a163-a1b2-4e28-873d-16feff0d0415"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:34.119269 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-ade2304e-a5ed-4afd-b6f4-7101420f4212 req-5818b976-42a3-44d1-a096-19c4626b4c7d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:34.120096 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-ade2304e-a5ed-4afd-b6f4-7101420f4212 req-5818b976-42a3-44d1-a096-19c4626b4c7d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:34.136173 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-ade2304e-a5ed-4afd-b6f4-7101420f4212 req-5818b976-42a3-44d1-a096-19c4626b4c7d service nova] Creating event network-changed:9e44a163-a1b2-4e28-873d-16feff0d0415 for instance 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae on n-h1-847009-3 Jul 19 22:44:34.141680 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-ade2304e-a5ed-4afd-b6f4-7101420f4212 req-5818b976-42a3-44d1-a096-19c4626b4c7d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038992 Jul 19 22:44:34.142872 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1831/3682] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:44:34.691865 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-51ef3479-43d4-42a9-8b38-e0afda894728 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:34.693301 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-51ef3479-43d4-42a9-8b38-e0afda894728 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:34.708899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51ef3479-43d4-42a9-8b38-e0afda894728 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:34.709378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51ef3479-43d4-42a9-8b38-e0afda894728 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:34.712687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51ef3479-43d4-42a9-8b38-e0afda894728 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:34.712888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51ef3479-43d4-42a9-8b38-e0afda894728 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:35.214826 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4b8b7f3f-4d88-4a9d-9174-96f4992f24a6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:35.224897 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4b8b7f3f-4d88-4a9d-9174-96f4992f24a6 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4" status: 200 len: 1502 microversion: 2.1 time: 1.259353 Jul 19 22:44:35.225905 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1852/3683] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:33 2022] GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4 => generated 1502 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:35.231733 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-111ef1bb-85f8-4fda-aa46-de71b224e826 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:35.232357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-111ef1bb-85f8-4fda-aa46-de71b224e826 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:35.244934 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-111ef1bb-85f8-4fda-aa46-de71b224e826 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:35.245779 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-111ef1bb-85f8-4fda-aa46-de71b224e826 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:35.246732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-111ef1bb-85f8-4fda-aa46-de71b224e826 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:35.247380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-111ef1bb-85f8-4fda-aa46-de71b224e826 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:35.580788 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:44:35.637181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=14 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:44:35.650059 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-51ef3479-43d4-42a9-8b38-e0afda894728 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:35.671705 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-51ef3479-43d4-42a9-8b38-e0afda894728 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:35.678674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-51ef3479-43d4-42a9-8b38-e0afda894728 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:35.684343 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-51ef3479-43d4-42a9-8b38-e0afda894728 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 0.995536 Jul 19 22:44:35.696591 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1832/3684] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:44:34 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:44:35.706476 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3c804c02-7ed4-4d02-ac75-e65a12e68638 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:35.708623 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3c804c02-7ed4-4d02-ac75-e65a12e68638 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 617aa88b-23a3-4d6f-bf46-dd8c78af517f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:35.725310 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c804c02-7ed4-4d02-ac75-e65a12e68638 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:35.726263 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c804c02-7ed4-4d02-ac75-e65a12e68638 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:35.727820 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c804c02-7ed4-4d02-ac75-e65a12e68638 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:35.728638 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c804c02-7ed4-4d02-ac75-e65a12e68638 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:36.015757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3c804c02-7ed4-4d02-ac75-e65a12e68638 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:36.028265 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-111ef1bb-85f8-4fda-aa46-de71b224e826 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:36.042899 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3c804c02-7ed4-4d02-ac75-e65a12e68638 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f" status: 200 len: 1266 microversion: 2.1 time: 0.341613 Jul 19 22:44:36.045709 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-111ef1bb-85f8-4fda-aa46-de71b224e826 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1322 microversion: 2.1 time: 0.817901 Jul 19 22:44:36.048268 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1853/3686] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:35 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1322 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:36.061168 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-be38b515-ebbe-4799-a858-9cda82d2874f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:36.062173 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-be38b515-ebbe-4799-a858-9cda82d2874f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 2e2b11e6-8039-4f92-b971-2e0a602481c4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:36.069765 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1833/3686] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:35 2022] GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f => generated 1266 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:36.090838 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be38b515-ebbe-4799-a858-9cda82d2874f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:36.091935 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be38b515-ebbe-4799-a858-9cda82d2874f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:36.096391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be38b515-ebbe-4799-a858-9cda82d2874f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:36.098829 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be38b515-ebbe-4799-a858-9cda82d2874f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:36.153502 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-be38b515-ebbe-4799-a858-9cda82d2874f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lazy-loading 'flavor' on Instance uuid 2e2b11e6-8039-4f92-b971-2e0a602481c4 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:44:36.184383 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:44:36.398354 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-be38b515-ebbe-4799-a858-9cda82d2874f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "POST /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4/action" status: 202 len: 0 microversion: 2.1 time: 0.346813 Jul 19 22:44:36.403047 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1854/3687] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:44:36 2022] POST /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:44:36.417281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8a0380da-eacc-4263-9c3e-5a10c20f1d12 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:36.420597 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8a0380da-eacc-4263-9c3e-5a10c20f1d12 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 2e2b11e6-8039-4f92-b971-2e0a602481c4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:36.450620 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a0380da-eacc-4263-9c3e-5a10c20f1d12 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:36.451827 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a0380da-eacc-4263-9c3e-5a10c20f1d12 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:36.462371 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a0380da-eacc-4263-9c3e-5a10c20f1d12 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:36.464590 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a0380da-eacc-4263-9c3e-5a10c20f1d12 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:36.764221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a2af43b5-b05a-4381-98f2-15ac42b68f0a tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-2119127805", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "730e50b9-7e5c-425e-b984-b5a5cbdda776"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:36.872322 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-a2af43b5-b05a-4381-98f2-15ac42b68f0a tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] validate_networks() for [('730e50b9-7e5c-425e-b984-b5a5cbdda776', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:44:37.443453 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8a0380da-eacc-4263-9c3e-5a10c20f1d12 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:37.455815 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8a0380da-eacc-4263-9c3e-5a10c20f1d12 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4" status: 200 len: 1510 microversion: 2.1 time: 1.047167 Jul 19 22:44:37.463035 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1834/3688] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:36 2022] GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4 => generated 1510 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:44:37.468527 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3589155d-8e10-4bea-b4fc-b61cfb6028ce tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:37.469169 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3589155d-8e10-4bea-b4fc-b61cfb6028ce tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:37.490100 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3589155d-8e10-4bea-b4fc-b61cfb6028ce tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:37.490703 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3589155d-8e10-4bea-b4fc-b61cfb6028ce tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:37.491404 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3589155d-8e10-4bea-b4fc-b61cfb6028ce tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:37.491854 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3589155d-8e10-4bea-b4fc-b61cfb6028ce tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:38.649298 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3589155d-8e10-4bea-b4fc-b61cfb6028ce tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:38.659022 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:44:38.688263 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3589155d-8e10-4bea-b4fc-b61cfb6028ce tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:38.691577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3589155d-8e10-4bea-b4fc-b61cfb6028ce tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:38.695959 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3589155d-8e10-4bea-b4fc-b61cfb6028ce tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 1.230766 Jul 19 22:44:38.698447 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1835/3689] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:44:37 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:44:38.705805 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8b3cf55f-6226-447c-9637-5114ad5ed35c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:38.709754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8b3cf55f-6226-447c-9637-5114ad5ed35c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 617aa88b-23a3-4d6f-bf46-dd8c78af517f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:38.722114 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b3cf55f-6226-447c-9637-5114ad5ed35c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:38.725315 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b3cf55f-6226-447c-9637-5114ad5ed35c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:38.727094 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b3cf55f-6226-447c-9637-5114ad5ed35c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:38.729531 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b3cf55f-6226-447c-9637-5114ad5ed35c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:39.328852 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-a2af43b5-b05a-4381-98f2-15ac42b68f0a tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:44:39.330653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-a2af43b5-b05a-4381-98f2-15ac42b68f0a tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:44:39.331530 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-a2af43b5-b05a-4381-98f2-15ac42b68f0a tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:44:39.335767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-a2af43b5-b05a-4381-98f2-15ac42b68f0a tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:44:39.336612 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-a2af43b5-b05a-4381-98f2-15ac42b68f0a tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:44:39.353282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a2af43b5-b05a-4381-98f2-15ac42b68f0a tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:39.354052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a2af43b5-b05a-4381-98f2-15ac42b68f0a tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:39.356354 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a2af43b5-b05a-4381-98f2-15ac42b68f0a tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:39.357185 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a2af43b5-b05a-4381-98f2-15ac42b68f0a tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:39.384095 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-a2af43b5-b05a-4381-98f2-15ac42b68f0a tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Getting quotas for project db0b8e600a0c4cbf955e381cb2625c77. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:44:39.393838 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-a2af43b5-b05a-4381-98f2-15ac42b68f0a tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Getting quotas for user 3f88a124b27a44ddb0cf339631e1211e and project db0b8e600a0c4cbf955e381cb2625c77. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:44:39.404031 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8b3cf55f-6226-447c-9637-5114ad5ed35c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:39.430193 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8b3cf55f-6226-447c-9637-5114ad5ed35c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f" status: 200 len: 1308 microversion: 2.1 time: 0.727741 Jul 19 22:44:39.444903 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1836/3690] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:38 2022] GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f => generated 1308 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:39.454754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4496b370-423d-4be1-a5bb-229198bfe353 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:39.460915 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4496b370-423d-4be1-a5bb-229198bfe353 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:39.469071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a2af43b5-b05a-4381-98f2-15ac42b68f0a tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:44:39.477334 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a2af43b5-b05a-4381-98f2-15ac42b68f0a tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] [instance: eed83375-934e-46fc-9955-a2df323c326b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:44:39.480121 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4496b370-423d-4be1-a5bb-229198bfe353 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:39.482055 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4496b370-423d-4be1-a5bb-229198bfe353 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:39.485145 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4496b370-423d-4be1-a5bb-229198bfe353 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:39.488309 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4496b370-423d-4be1-a5bb-229198bfe353 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:39.578125 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a2af43b5-b05a-4381-98f2-15ac42b68f0a tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.957240 Jul 19 22:44:39.580499 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1855/3691] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:44:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 22:44:39.587259 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4473872a-7cc1-4bb6-b3b7-42cb29404323 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:39.588403 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4473872a-7cc1-4bb6-b3b7-42cb29404323 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 2e2b11e6-8039-4f92-b971-2e0a602481c4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:39.598051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4473872a-7cc1-4bb6-b3b7-42cb29404323 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:39.599932 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4473872a-7cc1-4bb6-b3b7-42cb29404323 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:39.601785 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4473872a-7cc1-4bb6-b3b7-42cb29404323 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:39.602623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4473872a-7cc1-4bb6-b3b7-42cb29404323 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:40.047445 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:44:40.308859 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4473872a-7cc1-4bb6-b3b7-42cb29404323 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:40.332241 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4473872a-7cc1-4bb6-b3b7-42cb29404323 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4" status: 200 len: 1493 microversion: 2.1 time: 0.749954 Jul 19 22:44:40.337396 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1856/3692] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:39 2022] GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4 => generated 1493 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:40.354374 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e778d493-747a-4f4c-9acc-e08bd0dd2e87 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:40.357730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e778d493-747a-4f4c-9acc-e08bd0dd2e87 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] [instance: eed83375-934e-46fc-9955-a2df323c326b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:40.412398 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=8 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:44:40.574292 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e778d493-747a-4f4c-9acc-e08bd0dd2e87 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f88a124b27a44ddb0cf339631e1211e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b8e600a0c4cbf955e381cb2625c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:40.584351 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4496b370-423d-4be1-a5bb-229198bfe353 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:40.586213 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e778d493-747a-4f4c-9acc-e08bd0dd2e87 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] 10.222.0.25 "GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b" status: 200 len: 1217 microversion: 2.1 time: 0.245935 Jul 19 22:44:40.589033 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1857/3693] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:40 2022] GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b => generated 1217 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:40.602061 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2c014e28-4e54-4e27-acf6-b2fcb2b57034 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:40.602827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2c014e28-4e54-4e27-acf6-b2fcb2b57034 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:40.604507 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4496b370-423d-4be1-a5bb-229198bfe353 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1322 microversion: 2.1 time: 1.158083 Jul 19 22:44:40.605339 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1837/3694] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:39 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1322 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:40.613164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c4488c19-8af9-453b-98b8-806baf38edc7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:40.614068 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c4488c19-8af9-453b-98b8-806baf38edc7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 2e2b11e6-8039-4f92-b971-2e0a602481c4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:40.619580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c014e28-4e54-4e27-acf6-b2fcb2b57034 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:40.621513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c014e28-4e54-4e27-acf6-b2fcb2b57034 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:40.623695 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c014e28-4e54-4e27-acf6-b2fcb2b57034 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:40.624274 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c014e28-4e54-4e27-acf6-b2fcb2b57034 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:40.625972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c4488c19-8af9-453b-98b8-806baf38edc7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:40.626678 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c4488c19-8af9-453b-98b8-806baf38edc7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:40.628888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c4488c19-8af9-453b-98b8-806baf38edc7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:40.630382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c4488c19-8af9-453b-98b8-806baf38edc7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:40.735625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c4488c19-8af9-453b-98b8-806baf38edc7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 2e2b11e6-8039-4f92-b971-2e0a602481c4] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:44:40.929391 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c4488c19-8af9-453b-98b8-806baf38edc7 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4" status: 204 len: 0 microversion: 2.1 time: 0.319568 Jul 19 22:44:40.930543 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1838/3695] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:44:40 2022] DELETE /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:44:40.939478 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c3211765-c4e2-4e1e-a556-1140b09dd84e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:40.940560 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c3211765-c4e2-4e1e-a556-1140b09dd84e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 617aa88b-23a3-4d6f-bf46-dd8c78af517f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:40.952032 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c3211765-c4e2-4e1e-a556-1140b09dd84e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:40.953371 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c3211765-c4e2-4e1e-a556-1140b09dd84e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:40.955190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c3211765-c4e2-4e1e-a556-1140b09dd84e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:40.956092 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c3211765-c4e2-4e1e-a556-1140b09dd84e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:41.305571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2c014e28-4e54-4e27-acf6-b2fcb2b57034 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:41.340302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2c014e28-4e54-4e27-acf6-b2fcb2b57034 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:41.344879 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2c014e28-4e54-4e27-acf6-b2fcb2b57034 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:41.346954 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2c014e28-4e54-4e27-acf6-b2fcb2b57034 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 0.755619 Jul 19 22:44:41.354767 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1858/3696] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:44:40 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:44:41.388989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b695ebbc-9a0b-49f4-a9df-84b61316b06f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:41.398819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b695ebbc-9a0b-49f4-a9df-84b61316b06f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 2e2b11e6-8039-4f92-b971-2e0a602481c4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:41.448003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b695ebbc-9a0b-49f4-a9df-84b61316b06f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:41.453201 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b695ebbc-9a0b-49f4-a9df-84b61316b06f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:41.456233 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b695ebbc-9a0b-49f4-a9df-84b61316b06f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:41.460104 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b695ebbc-9a0b-49f4-a9df-84b61316b06f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:41.731246 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c3211765-c4e2-4e1e-a556-1140b09dd84e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:41.745283 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c3211765-c4e2-4e1e-a556-1140b09dd84e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f" status: 200 len: 1308 microversion: 2.1 time: 0.812981 Jul 19 22:44:41.753849 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1839/3697] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:40 2022] GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f => generated 1308 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:41.764666 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-0d11c837-de83-49f9-818c-d4f53f5e4c8a req-7417dccb-e181-41a1-99d3-1091f4fcc8c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "617aa88b-23a3-4d6f-bf46-dd8c78af517f", "tag": "9ba1bf61-ba36-4bbd-b8cd-0fadb9e8c959"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:41.798718 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-0d11c837-de83-49f9-818c-d4f53f5e4c8a req-7417dccb-e181-41a1-99d3-1091f4fcc8c3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:41.799340 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-0d11c837-de83-49f9-818c-d4f53f5e4c8a req-7417dccb-e181-41a1-99d3-1091f4fcc8c3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:41.827367 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-0d11c837-de83-49f9-818c-d4f53f5e4c8a req-7417dccb-e181-41a1-99d3-1091f4fcc8c3 service nova] Creating event network-changed:9ba1bf61-ba36-4bbd-b8cd-0fadb9e8c959 for instance 617aa88b-23a3-4d6f-bf46-dd8c78af517f on n-h1-847009-3 Jul 19 22:44:41.835954 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-0d11c837-de83-49f9-818c-d4f53f5e4c8a req-7417dccb-e181-41a1-99d3-1091f4fcc8c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074967 Jul 19 22:44:41.837839 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1840/3698] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:44:41.849195 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-1bc7b2e7-54a6-43c6-b738-cfe957d09d03 req-0b9ea193-1099-4ec3-b518-c73be71b5137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08ecb42e-a6ee-4f1e-976d-33e037bdd6ae", "name": "network-vif-plugged", "status": "completed", "tag": "9e44a163-a1b2-4e28-873d-16feff0d0415"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:41.865837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1bc7b2e7-54a6-43c6-b738-cfe957d09d03 req-0b9ea193-1099-4ec3-b518-c73be71b5137 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:41.866432 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1bc7b2e7-54a6-43c6-b738-cfe957d09d03 req-0b9ea193-1099-4ec3-b518-c73be71b5137 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:41.902278 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-1bc7b2e7-54a6-43c6-b738-cfe957d09d03 req-0b9ea193-1099-4ec3-b518-c73be71b5137 service nova] Creating event network-vif-plugged:9e44a163-a1b2-4e28-873d-16feff0d0415 for instance 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae on n-h1-847009-3 Jul 19 22:44:41.913889 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-1bc7b2e7-54a6-43c6-b738-cfe957d09d03 req-0b9ea193-1099-4ec3-b518-c73be71b5137 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067859 Jul 19 22:44:41.927550 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1841/3699] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:44:41.938403 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-80bd9519-9284-407f-814e-468a7f90b323 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:41.940030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-80bd9519-9284-407f-814e-468a7f90b323 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] [instance: eed83375-934e-46fc-9955-a2df323c326b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:41.950164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-80bd9519-9284-407f-814e-468a7f90b323 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:41.950883 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-80bd9519-9284-407f-814e-468a7f90b323 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:41.951907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-80bd9519-9284-407f-814e-468a7f90b323 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:41.952990 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-80bd9519-9284-407f-814e-468a7f90b323 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:42.135672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-80bd9519-9284-407f-814e-468a7f90b323 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f88a124b27a44ddb0cf339631e1211e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b8e600a0c4cbf955e381cb2625c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:42.136987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b695ebbc-9a0b-49f4-a9df-84b61316b06f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:42.153422 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-80bd9519-9284-407f-814e-468a7f90b323 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] 10.222.0.25 "GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b" status: 200 len: 1269 microversion: 2.1 time: 0.223080 Jul 19 22:44:42.155221 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1842/3700] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:41 2022] GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b => generated 1269 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:42.160101 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b695ebbc-9a0b-49f4-a9df-84b61316b06f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4" status: 200 len: 1499 microversion: 2.1 time: 0.801579 Jul 19 22:44:42.162015 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1859/3701] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:41 2022] GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4 => generated 1499 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:42.180013 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a51aa992-d9ac-48e8-8dc9-9099e402e863 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:42.180875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a51aa992-d9ac-48e8-8dc9-9099e402e863 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:42.188565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a51aa992-d9ac-48e8-8dc9-9099e402e863 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:42.189138 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a51aa992-d9ac-48e8-8dc9-9099e402e863 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:42.190026 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a51aa992-d9ac-48e8-8dc9-9099e402e863 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:42.190544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a51aa992-d9ac-48e8-8dc9-9099e402e863 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:42.378353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cd7c0269-dff9-4a29-9f0f-7ba2708640b7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:42.379186 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cd7c0269-dff9-4a29-9f0f-7ba2708640b7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:42.386400 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd7c0269-dff9-4a29-9f0f-7ba2708640b7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:42.386950 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd7c0269-dff9-4a29-9f0f-7ba2708640b7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:42.388007 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd7c0269-dff9-4a29-9f0f-7ba2708640b7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:42.388519 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd7c0269-dff9-4a29-9f0f-7ba2708640b7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:42.992959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cd7c0269-dff9-4a29-9f0f-7ba2708640b7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:43.015385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cd7c0269-dff9-4a29-9f0f-7ba2708640b7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:43.035335 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cd7c0269-dff9-4a29-9f0f-7ba2708640b7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:43.076027 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cd7c0269-dff9-4a29-9f0f-7ba2708640b7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 0.663245 Jul 19 22:44:43.082875 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1860/3702] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:44:42 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:44:43.100495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f0905b64-1804-47f6-980f-3f53c7b02727 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:43.107125 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f0905b64-1804-47f6-980f-3f53c7b02727 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 617aa88b-23a3-4d6f-bf46-dd8c78af517f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:43.135860 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f0905b64-1804-47f6-980f-3f53c7b02727 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:43.138906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f0905b64-1804-47f6-980f-3f53c7b02727 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:43.144154 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f0905b64-1804-47f6-980f-3f53c7b02727 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:43.144991 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f0905b64-1804-47f6-980f-3f53c7b02727 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:43.200581 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a51aa992-d9ac-48e8-8dc9-9099e402e863 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:43.214841 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a51aa992-d9ac-48e8-8dc9-9099e402e863 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1322 microversion: 2.1 time: 1.039655 Jul 19 22:44:43.216582 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1843/3703] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:42 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1322 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:43.230361 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b46c9733-713f-41bb-a267-de757b042469 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:43.232321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b46c9733-713f-41bb-a267-de757b042469 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] [instance: eed83375-934e-46fc-9955-a2df323c326b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:43.244055 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b46c9733-713f-41bb-a267-de757b042469 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:43.247002 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b46c9733-713f-41bb-a267-de757b042469 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:43.248927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b46c9733-713f-41bb-a267-de757b042469 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:43.249893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b46c9733-713f-41bb-a267-de757b042469 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:43.434111 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b46c9733-713f-41bb-a267-de757b042469 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f88a124b27a44ddb0cf339631e1211e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b8e600a0c4cbf955e381cb2625c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:43.445601 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b46c9733-713f-41bb-a267-de757b042469 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] 10.222.0.25 "GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b" status: 200 len: 1287 microversion: 2.1 time: 0.227642 Jul 19 22:44:43.446780 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1844/3704] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:43 2022] GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b => generated 1287 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:43.453213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5c436582-ff52-49db-aed4-4783a75a1fb1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:43.454244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5c436582-ff52-49db-aed4-4783a75a1fb1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 2e2b11e6-8039-4f92-b971-2e0a602481c4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:43.461642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c436582-ff52-49db-aed4-4783a75a1fb1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:43.463226 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c436582-ff52-49db-aed4-4783a75a1fb1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:43.464387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c436582-ff52-49db-aed4-4783a75a1fb1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:43.465249 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c436582-ff52-49db-aed4-4783a75a1fb1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:43.602789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f0905b64-1804-47f6-980f-3f53c7b02727 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:43.612126 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f0905b64-1804-47f6-980f-3f53c7b02727 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f" status: 200 len: 1308 microversion: 2.1 time: 0.526150 Jul 19 22:44:43.612840 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1861/3705] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:43 2022] GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f => generated 1308 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:43.709923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5c436582-ff52-49db-aed4-4783a75a1fb1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:43.718108 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5c436582-ff52-49db-aed4-4783a75a1fb1 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4" status: 200 len: 1499 microversion: 2.1 time: 0.270106 Jul 19 22:44:43.718709 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1845/3706] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:43 2022] GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4 => generated 1499 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:43.938969 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-c4ac7a64-3d95-456d-b060-047bda1099d8 req-fb23398e-92c0-4e9c-8054-bee26cd40cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77e3dc73-fee1-4b35-8506-9acfc60bc789", "name": "network-vif-plugged", "status": "completed", "tag": "617c6e0e-4424-4a36-8c61-7159e4a929a2"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:43.952052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c4ac7a64-3d95-456d-b060-047bda1099d8 req-fb23398e-92c0-4e9c-8054-bee26cd40cb4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:43.953091 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c4ac7a64-3d95-456d-b060-047bda1099d8 req-fb23398e-92c0-4e9c-8054-bee26cd40cb4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:43.969512 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-c4ac7a64-3d95-456d-b060-047bda1099d8 req-fb23398e-92c0-4e9c-8054-bee26cd40cb4 service nova] Creating event network-vif-plugged:617c6e0e-4424-4a36-8c61-7159e4a929a2 for instance 77e3dc73-fee1-4b35-8506-9acfc60bc789 on n-h2-847009-3 Jul 19 22:44:43.978361 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-c4ac7a64-3d95-456d-b060-047bda1099d8 req-fb23398e-92c0-4e9c-8054-bee26cd40cb4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043150 Jul 19 22:44:43.979199 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1862/3707] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:44:44.102245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bc4a3fa3-a348-43d1-918c-278abfbf343e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:44.102866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bc4a3fa3-a348-43d1-918c-278abfbf343e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:44.118530 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc4a3fa3-a348-43d1-918c-278abfbf343e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:44.119989 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc4a3fa3-a348-43d1-918c-278abfbf343e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:44.121031 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc4a3fa3-a348-43d1-918c-278abfbf343e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:44.121893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc4a3fa3-a348-43d1-918c-278abfbf343e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:44.236659 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a6fca2db-b937-49bc-9117-8e0521a45f90 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:44.237332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a6fca2db-b937-49bc-9117-8e0521a45f90 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:44.247054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a6fca2db-b937-49bc-9117-8e0521a45f90 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:44.247548 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a6fca2db-b937-49bc-9117-8e0521a45f90 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:44.248351 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a6fca2db-b937-49bc-9117-8e0521a45f90 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:44.249003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a6fca2db-b937-49bc-9117-8e0521a45f90 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:44.554830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bc4a3fa3-a348-43d1-918c-278abfbf343e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:44.570514 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bc4a3fa3-a348-43d1-918c-278abfbf343e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:44.572634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bc4a3fa3-a348-43d1-918c-278abfbf343e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:44.574057 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bc4a3fa3-a348-43d1-918c-278abfbf343e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 0.477153 Jul 19 22:44:44.574910 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1846/3708] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:44:44 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:44:44.581317 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ba6d55a7-77c0-4e74-a2fd-0db486215fdd tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:44.584440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ba6d55a7-77c0-4e74-a2fd-0db486215fdd tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] [instance: eed83375-934e-46fc-9955-a2df323c326b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:44.591513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a6fca2db-b937-49bc-9117-8e0521a45f90 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:44.592098 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba6d55a7-77c0-4e74-a2fd-0db486215fdd tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:44.592651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba6d55a7-77c0-4e74-a2fd-0db486215fdd tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:44.602797 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba6d55a7-77c0-4e74-a2fd-0db486215fdd tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:44.603584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba6d55a7-77c0-4e74-a2fd-0db486215fdd tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:44.605392 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a6fca2db-b937-49bc-9117-8e0521a45f90 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1322 microversion: 2.1 time: 0.374127 Jul 19 22:44:44.606936 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1863/3709] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:44 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1322 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:44.641763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0fa8e62e-59d4-4705-acd9-99b7681510ba tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:44.643747 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0fa8e62e-59d4-4705-acd9-99b7681510ba tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 617aa88b-23a3-4d6f-bf46-dd8c78af517f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:44.654600 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0fa8e62e-59d4-4705-acd9-99b7681510ba tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:44.655512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0fa8e62e-59d4-4705-acd9-99b7681510ba tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:44.656651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0fa8e62e-59d4-4705-acd9-99b7681510ba tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:44.658198 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0fa8e62e-59d4-4705-acd9-99b7681510ba tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:44.780737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ba6d55a7-77c0-4e74-a2fd-0db486215fdd tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f88a124b27a44ddb0cf339631e1211e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b8e600a0c4cbf955e381cb2625c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:44.813678 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ba6d55a7-77c0-4e74-a2fd-0db486215fdd tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] 10.222.0.25 "GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b" status: 200 len: 1275 microversion: 2.1 time: 0.236924 Jul 19 22:44:44.824828 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1847/3710] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:44 2022] GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b => generated 1275 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:44.839806 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1a42f635-9b3e-4cf2-b92d-d07432d3333c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:44.840445 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1a42f635-9b3e-4cf2-b92d-d07432d3333c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 2e2b11e6-8039-4f92-b971-2e0a602481c4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:44.872486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a42f635-9b3e-4cf2-b92d-d07432d3333c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:44.873819 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a42f635-9b3e-4cf2-b92d-d07432d3333c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:44.881073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a42f635-9b3e-4cf2-b92d-d07432d3333c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:44.882809 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a42f635-9b3e-4cf2-b92d-d07432d3333c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:45.096899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1a42f635-9b3e-4cf2-b92d-d07432d3333c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:45.119506 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1a42f635-9b3e-4cf2-b92d-d07432d3333c tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4" status: 200 len: 1457 microversion: 2.1 time: 0.283477 Jul 19 22:44:45.120534 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1848/3711] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:44 2022] GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4 => generated 1457 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:45.125817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-dd27b087-dd41-457c-b1fb-05f6371638be req-4a46b790-8a83-428d-b037-7037464ac8e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e2b11e6-8039-4f92-b971-2e0a602481c4", "name": "network-vif-deleted", "tag": "6ea5b749-54c7-4f97-b59e-d97f34b726c8"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:45.166634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-dd27b087-dd41-457c-b1fb-05f6371638be req-4a46b790-8a83-428d-b037-7037464ac8e9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:45.167161 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-dd27b087-dd41-457c-b1fb-05f6371638be req-4a46b790-8a83-428d-b037-7037464ac8e9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:45.197463 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-dd27b087-dd41-457c-b1fb-05f6371638be req-4a46b790-8a83-428d-b037-7037464ac8e9 service nova] Creating event network-vif-deleted:6ea5b749-54c7-4f97-b59e-d97f34b726c8 for instance 2e2b11e6-8039-4f92-b971-2e0a602481c4 on n-h2-847009-3 Jul 19 22:44:45.207628 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-dd27b087-dd41-457c-b1fb-05f6371638be req-4a46b790-8a83-428d-b037-7037464ac8e9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085501 Jul 19 22:44:45.209026 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1849/3712] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:44:45.247854 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0fa8e62e-59d4-4705-acd9-99b7681510ba tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:45.261618 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0fa8e62e-59d4-4705-acd9-99b7681510ba tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f" status: 200 len: 1308 microversion: 2.1 time: 0.629383 Jul 19 22:44:45.264744 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1864/3713] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:44 2022] GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f => generated 1308 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:45.600428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e06a751c-a918-4a0c-b405-b7e938068239 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:45.601877 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e06a751c-a918-4a0c-b405-b7e938068239 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:45.618240 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e06a751c-a918-4a0c-b405-b7e938068239 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:45.619405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e06a751c-a918-4a0c-b405-b7e938068239 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:45.622187 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e06a751c-a918-4a0c-b405-b7e938068239 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:45.622975 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e06a751c-a918-4a0c-b405-b7e938068239 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:45.628012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9dbe9dcd-f484-4222-9934-687d150c6079 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:45.628745 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9dbe9dcd-f484-4222-9934-687d150c6079 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:45.646391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:44:45.650467 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9dbe9dcd-f484-4222-9934-687d150c6079 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:45.651537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9dbe9dcd-f484-4222-9934-687d150c6079 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:45.653885 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9dbe9dcd-f484-4222-9934-687d150c6079 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:45.661717 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9dbe9dcd-f484-4222-9934-687d150c6079 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:46.244886 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9dbe9dcd-f484-4222-9934-687d150c6079 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:46.257695 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9dbe9dcd-f484-4222-9934-687d150c6079 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1322 microversion: 2.1 time: 0.633459 Jul 19 22:44:46.268181 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1865/3714] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:45 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1322 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:46.270952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-eff52bcf-db3c-4a15-a71e-510733e94fd7 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:46.289485 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-eff52bcf-db3c-4a15-a71e-510733e94fd7 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] [instance: eed83375-934e-46fc-9955-a2df323c326b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:46.311432 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eff52bcf-db3c-4a15-a71e-510733e94fd7 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:46.313372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eff52bcf-db3c-4a15-a71e-510733e94fd7 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:46.316670 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eff52bcf-db3c-4a15-a71e-510733e94fd7 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:46.319033 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eff52bcf-db3c-4a15-a71e-510733e94fd7 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:46.345102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e06a751c-a918-4a0c-b405-b7e938068239 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:46.372624 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e06a751c-a918-4a0c-b405-b7e938068239 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:46.374467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e06a751c-a918-4a0c-b405-b7e938068239 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:46.375769 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e06a751c-a918-4a0c-b405-b7e938068239 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 0.786021 Jul 19 22:44:46.389035 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1850/3715] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:44:45 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:44:46.394254 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c680be5f-f3e2-417f-8c11-e65453196594 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:46.406563 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c680be5f-f3e2-417f-8c11-e65453196594 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 2e2b11e6-8039-4f92-b971-2e0a602481c4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:46.421409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c680be5f-f3e2-417f-8c11-e65453196594 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:46.422204 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c680be5f-f3e2-417f-8c11-e65453196594 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:46.426304 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c680be5f-f3e2-417f-8c11-e65453196594 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:46.429585 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c680be5f-f3e2-417f-8c11-e65453196594 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:46.572042 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c680be5f-f3e2-417f-8c11-e65453196594 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:46.572535 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c680be5f-f3e2-417f-8c11-e65453196594 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:46.575095 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-c680be5f-f3e2-417f-8c11-e65453196594 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lazy-loading 'fault' on Instance uuid 2e2b11e6-8039-4f92-b971-2e0a602481c4 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:44:46.727286 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c680be5f-f3e2-417f-8c11-e65453196594 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f40233895248229ddfdcd06fb65361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bcdb843a7d4a1ebe467160eee0d6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:46.741581 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c680be5f-f3e2-417f-8c11-e65453196594 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4" status: 200 len: 1304 microversion: 2.1 time: 0.351194 Jul 19 22:44:46.742702 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1851/3716] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:46 2022] GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4 => generated 1304 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:46.753353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-99938c50-ebae-4fe5-9772-13a4d947f645 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:46.758530 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-99938c50-ebae-4fe5-9772-13a4d947f645 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 617aa88b-23a3-4d6f-bf46-dd8c78af517f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:46.779059 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99938c50-ebae-4fe5-9772-13a4d947f645 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:46.780313 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99938c50-ebae-4fe5-9772-13a4d947f645 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:46.783741 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99938c50-ebae-4fe5-9772-13a4d947f645 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:46.784528 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99938c50-ebae-4fe5-9772-13a4d947f645 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:46.806201 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-eff52bcf-db3c-4a15-a71e-510733e94fd7 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f88a124b27a44ddb0cf339631e1211e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b8e600a0c4cbf955e381cb2625c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:46.817836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:44:46.824910 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-eff52bcf-db3c-4a15-a71e-510733e94fd7 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] 10.222.0.25 "GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b" status: 200 len: 1317 microversion: 2.1 time: 0.563236 Jul 19 22:44:46.827558 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1866/3717] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:46 2022] GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b => generated 1317 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:47.232074 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-a26e3d89-2f85-4d5f-858a-710334d22641 req-bbebad4f-624f-4387-8983-ce8713124f1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eed83375-934e-46fc-9955-a2df323c326b", "tag": "8d65a4f8-b3b6-46f6-b471-2d7ca0b51d32"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:47.247031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-a26e3d89-2f85-4d5f-858a-710334d22641 req-bbebad4f-624f-4387-8983-ce8713124f1e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:47.247850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-a26e3d89-2f85-4d5f-858a-710334d22641 req-bbebad4f-624f-4387-8983-ce8713124f1e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:47.267836 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-a26e3d89-2f85-4d5f-858a-710334d22641 req-bbebad4f-624f-4387-8983-ce8713124f1e service nova] Creating event network-changed:8d65a4f8-b3b6-46f6-b471-2d7ca0b51d32 for instance eed83375-934e-46fc-9955-a2df323c326b on n-h2-847009-3 Jul 19 22:44:47.278462 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-a26e3d89-2f85-4d5f-858a-710334d22641 req-bbebad4f-624f-4387-8983-ce8713124f1e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045902 Jul 19 22:44:47.279981 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1867/3718] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:44:47.287970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-874e600d-8c5f-45de-a8b5-ab2dc21e9048 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:47.289110 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-874e600d-8c5f-45de-a8b5-ab2dc21e9048 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:47.297678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-874e600d-8c5f-45de-a8b5-ab2dc21e9048 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:47.298697 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-874e600d-8c5f-45de-a8b5-ab2dc21e9048 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:47.300020 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-874e600d-8c5f-45de-a8b5-ab2dc21e9048 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:47.300914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-874e600d-8c5f-45de-a8b5-ab2dc21e9048 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:47.771335 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-99938c50-ebae-4fe5-9772-13a4d947f645 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:47.788422 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-99938c50-ebae-4fe5-9772-13a4d947f645 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f" status: 200 len: 1308 microversion: 2.1 time: 1.043971 Jul 19 22:44:47.799340 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1852/3719] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:46 2022] GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f => generated 1308 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:47.807075 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-079129b5-2191-44e0-ac80-2196f7000eb4 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:47.808127 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-079129b5-2191-44e0-ac80-2196f7000eb4 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:47.815923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-079129b5-2191-44e0-ac80-2196f7000eb4 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:47.817035 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-079129b5-2191-44e0-ac80-2196f7000eb4 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:47.818600 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-079129b5-2191-44e0-ac80-2196f7000eb4 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:47.819797 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-079129b5-2191-44e0-ac80-2196f7000eb4 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:48.048294 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-874e600d-8c5f-45de-a8b5-ab2dc21e9048 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:48.060680 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-874e600d-8c5f-45de-a8b5-ab2dc21e9048 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1515 microversion: 2.1 time: 0.779061 Jul 19 22:44:48.064873 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1868/3720] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:47 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1515 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:48.084507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bcda3d00-308f-402a-908a-83be9c9fe6df tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:48.085149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bcda3d00-308f-402a-908a-83be9c9fe6df tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 2e2b11e6-8039-4f92-b971-2e0a602481c4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:48.106967 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bcda3d00-308f-402a-908a-83be9c9fe6df tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:48.107844 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bcda3d00-308f-402a-908a-83be9c9fe6df tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:48.109825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bcda3d00-308f-402a-908a-83be9c9fe6df tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:48.113365 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bcda3d00-308f-402a-908a-83be9c9fe6df tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:48.145132 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-bcda3d00-308f-402a-908a-83be9c9fe6df tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] HTTP exception thrown: Instance 2e2b11e6-8039-4f92-b971-2e0a602481c4 could not be found. Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bcda3d00-308f-402a-908a-83be9c9fe6df tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Request method failure captured: Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4 HTTP/1.1 Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zJcOd8ioSoO4Ag7p0FuZhdyFBnwQELvoxLAsblThyrJ_2NxEo2CJ37EEfRT2CZdbZlGMRgWXNVEuSQUWOfX5krUiSHAMeusL8iD4FHXx0Nd2OURbeGsEBn_IDvsFz7TmW6c-8lxScCQfbEdKUx47XHZCtuEAW7dgjTFB9ANV0LmkTU Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: f4f40233895248229ddfdcd06fb65361 Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 2e2b11e6-8039-4f92-b971-2e0a602481c4 could not be found. Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '2e2b11e6-8039-4f92-b971-2e0a602481c4'} Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e2b11e6-8039-4f92-b971-2e0a602481c4 could not be found. Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e2b11e6-8039-4f92-b971-2e0a602481c4 could not be found. Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:48.147815 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:48.152606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:48.152606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:48.152606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:48.152606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:44:48.152606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:44:48.152606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e2b11e6-8039-4f92-b971-2e0a602481c4 could not be found. Jul 19 22:44:48.152606 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:48.152606 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bcda3d00-308f-402a-908a-83be9c9fe6df tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Returning 404 to user: Instance 2e2b11e6-8039-4f92-b971-2e0a602481c4 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:44:48.152606 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bcda3d00-308f-402a-908a-83be9c9fe6df tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4" status: 404 len: 111 microversion: 2.1 time: 0.073438 Jul 19 22:44:48.152606 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1869/3721] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:48 2022] GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:44:48.159773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-81eca909-0798-41f2-94c3-eaf2f4bb462e tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:48.160566 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-81eca909-0798-41f2-94c3-eaf2f4bb462e tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] [instance: eed83375-934e-46fc-9955-a2df323c326b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:48.168530 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81eca909-0798-41f2-94c3-eaf2f4bb462e tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:48.169129 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81eca909-0798-41f2-94c3-eaf2f4bb462e tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:48.170018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81eca909-0798-41f2-94c3-eaf2f4bb462e tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:48.170566 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81eca909-0798-41f2-94c3-eaf2f4bb462e tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:48.373216 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-079129b5-2191-44e0-ac80-2196f7000eb4 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:48.390258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-079129b5-2191-44e0-ac80-2196f7000eb4 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:48.392278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-079129b5-2191-44e0-ac80-2196f7000eb4 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:48.394152 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-079129b5-2191-44e0-ac80-2196f7000eb4 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 0.593417 Jul 19 22:44:48.405779 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1853/3722] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:44:47 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:44:48.406954 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b9c65ecf-3304-4b02-80c8-4c0d6e907085 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:48.408179 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b9c65ecf-3304-4b02-80c8-4c0d6e907085 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:48.422447 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b9c65ecf-3304-4b02-80c8-4c0d6e907085 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:48.422924 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b9c65ecf-3304-4b02-80c8-4c0d6e907085 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:48.423770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b9c65ecf-3304-4b02-80c8-4c0d6e907085 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:48.424329 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b9c65ecf-3304-4b02-80c8-4c0d6e907085 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:48.474412 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-b9c65ecf-3304-4b02-80c8-4c0d6e907085 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lazy-loading 'flavor' on Instance uuid 77e3dc73-fee1-4b35-8506-9acfc60bc789 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:44:48.500475 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-81eca909-0798-41f2-94c3-eaf2f4bb462e tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f88a124b27a44ddb0cf339631e1211e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b8e600a0c4cbf955e381cb2625c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:48.510536 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-81eca909-0798-41f2-94c3-eaf2f4bb462e tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] 10.222.0.25 "GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b" status: 200 len: 1317 microversion: 2.1 time: 0.358483 Jul 19 22:44:48.512389 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1870/3723] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:48 2022] GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:48.528086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-55260581-0e46-4fad-9e8d-3a6065fb6c3a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:48.529061 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-55260581-0e46-4fad-9e8d-3a6065fb6c3a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 2e2b11e6-8039-4f92-b971-2e0a602481c4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:48.537466 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55260581-0e46-4fad-9e8d-3a6065fb6c3a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:48.538071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55260581-0e46-4fad-9e8d-3a6065fb6c3a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:48.538972 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55260581-0e46-4fad-9e8d-3a6065fb6c3a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:48.539661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55260581-0e46-4fad-9e8d-3a6065fb6c3a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:48.570592 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-55260581-0e46-4fad-9e8d-3a6065fb6c3a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] HTTP exception thrown: Instance 2e2b11e6-8039-4f92-b971-2e0a602481c4 could not be found. Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-55260581-0e46-4fad-9e8d-3a6065fb6c3a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Request method failure captured: Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4 HTTP/1.1 Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zJcOd8ioSoO4Ag7p0FuZhdyFBnwQELvoxLAsblThyrJ_2NxEo2CJ37EEfRT2CZdbZlGMRgWXNVEuSQUWOfX5krUiSHAMeusL8iD4FHXx0Nd2OURbeGsEBn_IDvsFz7TmW6c-8lxScCQfbEdKUx47XHZCtuEAW7dgjTFB9ANV0LmkTU Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: f4f40233895248229ddfdcd06fb65361 Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 2e2b11e6-8039-4f92-b971-2e0a602481c4 could not be found. Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '2e2b11e6-8039-4f92-b971-2e0a602481c4'} Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e2b11e6-8039-4f92-b971-2e0a602481c4 could not be found. Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:44:48.575844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:44:48.581711 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e2b11e6-8039-4f92-b971-2e0a602481c4 could not be found. Jul 19 22:44:48.581711 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:48.581711 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:48.581711 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:48.581711 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:48.581711 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:48.581711 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:48.581711 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:44:48.581711 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:44:48.581711 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e2b11e6-8039-4f92-b971-2e0a602481c4 could not be found. Jul 19 22:44:48.581711 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:48.584222 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-55260581-0e46-4fad-9e8d-3a6065fb6c3a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Returning 404 to user: Instance 2e2b11e6-8039-4f92-b971-2e0a602481c4 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:44:48.607421 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-55260581-0e46-4fad-9e8d-3a6065fb6c3a tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4" status: 404 len: 111 microversion: 2.1 time: 0.075738 Jul 19 22:44:48.608933 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1871/3724] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:44:48 2022] DELETE /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:44:48.620221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6ad24901-98e3-4676-974e-09871df40120 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:48.621353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6ad24901-98e3-4676-974e-09871df40120 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 2e2b11e6-8039-4f92-b971-2e0a602481c4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:48.628973 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ad24901-98e3-4676-974e-09871df40120 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:48.629748 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ad24901-98e3-4676-974e-09871df40120 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:48.632203 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ad24901-98e3-4676-974e-09871df40120 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:48.632940 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ad24901-98e3-4676-974e-09871df40120 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:48.652843 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-6ad24901-98e3-4676-974e-09871df40120 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] HTTP exception thrown: Instance 2e2b11e6-8039-4f92-b971-2e0a602481c4 could not be found. Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6ad24901-98e3-4676-974e-09871df40120 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Request method failure captured: Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4 HTTP/1.1 Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zJcOd8ioSoO4Ag7p0FuZhdyFBnwQELvoxLAsblThyrJ_2NxEo2CJ37EEfRT2CZdbZlGMRgWXNVEuSQUWOfX5krUiSHAMeusL8iD4FHXx0Nd2OURbeGsEBn_IDvsFz7TmW6c-8lxScCQfbEdKUx47XHZCtuEAW7dgjTFB9ANV0LmkTU Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: f4f40233895248229ddfdcd06fb65361 Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 2e2b11e6-8039-4f92-b971-2e0a602481c4 could not be found. Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '2e2b11e6-8039-4f92-b971-2e0a602481c4'} Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e2b11e6-8039-4f92-b971-2e0a602481c4 could not be found. Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e2b11e6-8039-4f92-b971-2e0a602481c4 could not be found. Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:48.654709 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:48.660482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:48.660482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:48.660482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:48.660482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:44:48.660482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:44:48.660482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e2b11e6-8039-4f92-b971-2e0a602481c4 could not be found. Jul 19 22:44:48.660482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:48.662216 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6ad24901-98e3-4676-974e-09871df40120 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Returning 404 to user: Instance 2e2b11e6-8039-4f92-b971-2e0a602481c4 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:44:48.663133 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6ad24901-98e3-4676-974e-09871df40120 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4" status: 404 len: 111 microversion: 2.1 time: 0.047961 Jul 19 22:44:48.664169 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1872/3725] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:48 2022] GET /compute/v2.1/servers/2e2b11e6-8039-4f92-b971-2e0a602481c4 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:44:48.675566 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-03c43e37-a7c0-48af-be9c-d00dd4f67dd9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:48.676116 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-03c43e37-a7c0-48af-be9c-d00dd4f67dd9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:48.692551 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-03c43e37-a7c0-48af-be9c-d00dd4f67dd9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:48.693370 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-03c43e37-a7c0-48af-be9c-d00dd4f67dd9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:48.694834 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-03c43e37-a7c0-48af-be9c-d00dd4f67dd9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:48.695798 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-03c43e37-a7c0-48af-be9c-d00dd4f67dd9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:48.732473 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-03c43e37-a7c0-48af-be9c-d00dd4f67dd9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] HTTP exception thrown: Instance 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 could not be found. Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-03c43e37-a7c0-48af-be9c-d00dd4f67dd9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Request method failure captured: Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 HTTP/1.1 Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zJcOd8ioSoO4Ag7p0FuZhdyFBnwQELvoxLAsblThyrJ_2NxEo2CJ37EEfRT2CZdbZlGMRgWXNVEuSQUWOfX5krUiSHAMeusL8iD4FHXx0Nd2OURbeGsEBn_IDvsFz7TmW6c-8lxScCQfbEdKUx47XHZCtuEAW7dgjTFB9ANV0LmkTU Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: f4f40233895248229ddfdcd06fb65361 Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 could not be found. Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1'} Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 could not be found. Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:44:48.734734 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:44:48.740417 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 could not be found. Jul 19 22:44:48.740417 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:48.740417 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:48.740417 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:48.740417 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:48.740417 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:48.740417 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:48.740417 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:44:48.740417 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:44:48.740417 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 could not be found. Jul 19 22:44:48.740417 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:48.740417 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-03c43e37-a7c0-48af-be9c-d00dd4f67dd9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Returning 404 to user: Instance 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:44:48.740417 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-03c43e37-a7c0-48af-be9c-d00dd4f67dd9 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 404 len: 111 microversion: 2.1 time: 0.066615 Jul 19 22:44:48.740417 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1873/3726] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:44:48 2022] DELETE /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:44:48.750236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e8719d15-5c54-467c-a7fd-89e05b39a86b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:48.751245 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e8719d15-5c54-467c-a7fd-89e05b39a86b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:48.762790 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8719d15-5c54-467c-a7fd-89e05b39a86b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:48.763941 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8719d15-5c54-467c-a7fd-89e05b39a86b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:48.765506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8719d15-5c54-467c-a7fd-89e05b39a86b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:48.770254 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b9c65ecf-3304-4b02-80c8-4c0d6e907085 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "POST /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789/action" status: 200 len: 32 microversion: 2.1 time: 0.371947 Jul 19 22:44:48.772782 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1854/3727] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:44:48 2022] POST /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789/action => generated 32 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:44:48.776395 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8719d15-5c54-467c-a7fd-89e05b39a86b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:48.788763 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-69f500cd-cd65-45ae-9d3e-b59250efba5f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:48.790062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-69f500cd-cd65-45ae-9d3e-b59250efba5f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:48.822781 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69f500cd-cd65-45ae-9d3e-b59250efba5f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:48.824036 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69f500cd-cd65-45ae-9d3e-b59250efba5f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:48.825714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69f500cd-cd65-45ae-9d3e-b59250efba5f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:48.828738 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-e8719d15-5c54-467c-a7fd-89e05b39a86b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] HTTP exception thrown: Instance 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 could not be found. Jul 19 22:44:48.829846 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69f500cd-cd65-45ae-9d3e-b59250efba5f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e8719d15-5c54-467c-a7fd-89e05b39a86b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Request method failure captured: Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 HTTP/1.1 Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zJcOd8ioSoO4Ag7p0FuZhdyFBnwQELvoxLAsblThyrJ_2NxEo2CJ37EEfRT2CZdbZlGMRgWXNVEuSQUWOfX5krUiSHAMeusL8iD4FHXx0Nd2OURbeGsEBn_IDvsFz7TmW6c-8lxScCQfbEdKUx47XHZCtuEAW7dgjTFB9ANV0LmkTU Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: f4f40233895248229ddfdcd06fb65361 Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 could not be found. Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1'} Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 could not be found. Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 could not be found. Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:48.830824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:48.836101 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:48.836101 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:48.836101 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:48.836101 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:44:48.836101 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:44:48.836101 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 could not be found. Jul 19 22:44:48.836101 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:48.838953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e8719d15-5c54-467c-a7fd-89e05b39a86b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Returning 404 to user: Instance 5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:44:48.840224 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e8719d15-5c54-467c-a7fd-89e05b39a86b tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1" status: 404 len: 111 microversion: 2.1 time: 0.096265 Jul 19 22:44:48.840992 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1874/3728] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:48 2022] GET /compute/v2.1/servers/5aad2ae6-0bd5-4ee3-bdbe-154f754d56e1 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:44:48.846723 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9416eea9-372f-46fd-bac5-10567ead8446 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:48.847353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9416eea9-372f-46fd-bac5-10567ead8446 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 617aa88b-23a3-4d6f-bf46-dd8c78af517f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:48.856732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9416eea9-372f-46fd-bac5-10567ead8446 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:48.857396 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9416eea9-372f-46fd-bac5-10567ead8446 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:48.858863 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9416eea9-372f-46fd-bac5-10567ead8446 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:48.859512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9416eea9-372f-46fd-bac5-10567ead8446 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:49.212572 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9416eea9-372f-46fd-bac5-10567ead8446 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:49.242300 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9416eea9-372f-46fd-bac5-10567ead8446 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f" status: 200 len: 1308 microversion: 2.1 time: 0.399273 Jul 19 22:44:49.253610 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1875/3729] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:48 2022] GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f => generated 1308 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:49.262655 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c94d81e4-a561-4bcb-b7e5-eab90bf3c679 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:49.264772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c94d81e4-a561-4bcb-b7e5-eab90bf3c679 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:49.283429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-69f500cd-cd65-45ae-9d3e-b59250efba5f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:49.300759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c94d81e4-a561-4bcb-b7e5-eab90bf3c679 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:49.301225 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c94d81e4-a561-4bcb-b7e5-eab90bf3c679 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:49.303506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c94d81e4-a561-4bcb-b7e5-eab90bf3c679 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:49.304783 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c94d81e4-a561-4bcb-b7e5-eab90bf3c679 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:49.306828 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-69f500cd-cd65-45ae-9d3e-b59250efba5f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1521 microversion: 2.1 time: 0.526288 Jul 19 22:44:49.311082 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1855/3730] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:48 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1521 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:44:49.342782 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-c94d81e4-a561-4bcb-b7e5-eab90bf3c679 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] HTTP exception thrown: Instance d7727fc2-2016-482d-aff6-0940874c3b28 could not be found. Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c94d81e4-a561-4bcb-b7e5-eab90bf3c679 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Request method failure captured: Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 HTTP/1.1 Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zJcOd8ioSoO4Ag7p0FuZhdyFBnwQELvoxLAsblThyrJ_2NxEo2CJ37EEfRT2CZdbZlGMRgWXNVEuSQUWOfX5krUiSHAMeusL8iD4FHXx0Nd2OURbeGsEBn_IDvsFz7TmW6c-8lxScCQfbEdKUx47XHZCtuEAW7dgjTFB9ANV0LmkTU Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: f4f40233895248229ddfdcd06fb65361 Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance d7727fc2-2016-482d-aff6-0940874c3b28 could not be found. Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'd7727fc2-2016-482d-aff6-0940874c3b28'} Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7727fc2-2016-482d-aff6-0940874c3b28 could not be found. Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:44:49.345983 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:44:49.352292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7727fc2-2016-482d-aff6-0940874c3b28 could not be found. Jul 19 22:44:49.352292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.352292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:49.352292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.352292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:49.352292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:49.352292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:49.352292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:44:49.352292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:44:49.352292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7727fc2-2016-482d-aff6-0940874c3b28 could not be found. Jul 19 22:44:49.352292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.357185 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c94d81e4-a561-4bcb-b7e5-eab90bf3c679 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Returning 404 to user: Instance d7727fc2-2016-482d-aff6-0940874c3b28 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:44:49.358900 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c94d81e4-a561-4bcb-b7e5-eab90bf3c679 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 404 len: 111 microversion: 2.1 time: 0.112317 Jul 19 22:44:49.364803 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1876/3731] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:44:49 2022] DELETE /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:44:49.375619 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3a5c06fd-18c6-4f37-8608-8d7894eae41f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:49.376366 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3a5c06fd-18c6-4f37-8608-8d7894eae41f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: d7727fc2-2016-482d-aff6-0940874c3b28] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:49.390731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3a5c06fd-18c6-4f37-8608-8d7894eae41f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:49.392547 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3a5c06fd-18c6-4f37-8608-8d7894eae41f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:49.394558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3a5c06fd-18c6-4f37-8608-8d7894eae41f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:49.396215 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3a5c06fd-18c6-4f37-8608-8d7894eae41f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:49.414810 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9c1ed3e7-db6f-4e10-b5ec-ca1c38681f3c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:49.415754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9c1ed3e7-db6f-4e10-b5ec-ca1c38681f3c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:49.420605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:44:49.431002 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9c1ed3e7-db6f-4e10-b5ec-ca1c38681f3c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:49.432005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9c1ed3e7-db6f-4e10-b5ec-ca1c38681f3c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:49.433436 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9c1ed3e7-db6f-4e10-b5ec-ca1c38681f3c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:49.434100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9c1ed3e7-db6f-4e10-b5ec-ca1c38681f3c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:49.446203 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-3a5c06fd-18c6-4f37-8608-8d7894eae41f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] HTTP exception thrown: Instance d7727fc2-2016-482d-aff6-0940874c3b28 could not be found. Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3a5c06fd-18c6-4f37-8608-8d7894eae41f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Request method failure captured: Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 HTTP/1.1 Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zJcOd8ioSoO4Ag7p0FuZhdyFBnwQELvoxLAsblThyrJ_2NxEo2CJ37EEfRT2CZdbZlGMRgWXNVEuSQUWOfX5krUiSHAMeusL8iD4FHXx0Nd2OURbeGsEBn_IDvsFz7TmW6c-8lxScCQfbEdKUx47XHZCtuEAW7dgjTFB9ANV0LmkTU Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: f4f40233895248229ddfdcd06fb65361 Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance d7727fc2-2016-482d-aff6-0940874c3b28 could not be found. Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'd7727fc2-2016-482d-aff6-0940874c3b28'} Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7727fc2-2016-482d-aff6-0940874c3b28 could not be found. Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7727fc2-2016-482d-aff6-0940874c3b28 could not be found. Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:49.450954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.463435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:49.463435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:49.463435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:49.463435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:44:49.463435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:44:49.463435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7727fc2-2016-482d-aff6-0940874c3b28 could not be found. Jul 19 22:44:49.463435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.464059 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:44:49.464172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3a5c06fd-18c6-4f37-8608-8d7894eae41f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Returning 404 to user: Instance d7727fc2-2016-482d-aff6-0940874c3b28 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:44:49.465304 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3a5c06fd-18c6-4f37-8608-8d7894eae41f tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28" status: 404 len: 111 microversion: 2.1 time: 0.099357 Jul 19 22:44:49.466361 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1856/3732] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:49 2022] GET /compute/v2.1/servers/d7727fc2-2016-482d-aff6-0940874c3b28 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:44:49.485313 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cb38b305-4863-46cc-a88a-9b5685914105 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:49.486781 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cb38b305-4863-46cc-a88a-9b5685914105 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: e0ada988-0937-4623-a7a6-b7bc4a69f517] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:49.498492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cb38b305-4863-46cc-a88a-9b5685914105 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:49.499173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cb38b305-4863-46cc-a88a-9b5685914105 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:49.500234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cb38b305-4863-46cc-a88a-9b5685914105 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:49.500842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cb38b305-4863-46cc-a88a-9b5685914105 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:49.518071 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-cb38b305-4863-46cc-a88a-9b5685914105 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] HTTP exception thrown: Instance e0ada988-0937-4623-a7a6-b7bc4a69f517 could not be found. Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cb38b305-4863-46cc-a88a-9b5685914105 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Request method failure captured: Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517 HTTP/1.1 Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zJcOd8ioSoO4Ag7p0FuZhdyFBnwQELvoxLAsblThyrJ_2NxEo2CJ37EEfRT2CZdbZlGMRgWXNVEuSQUWOfX5krUiSHAMeusL8iD4FHXx0Nd2OURbeGsEBn_IDvsFz7TmW6c-8lxScCQfbEdKUx47XHZCtuEAW7dgjTFB9ANV0LmkTU Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: f4f40233895248229ddfdcd06fb65361 Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance e0ada988-0937-4623-a7a6-b7bc4a69f517 could not be found. Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'e0ada988-0937-4623-a7a6-b7bc4a69f517'} Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0ada988-0937-4623-a7a6-b7bc4a69f517 could not be found. Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:44:49.519723 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:44:49.530460 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0ada988-0937-4623-a7a6-b7bc4a69f517 could not be found. Jul 19 22:44:49.530460 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.530460 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:49.530460 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.530460 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:49.530460 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:49.530460 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:49.530460 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:44:49.530460 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:44:49.530460 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0ada988-0937-4623-a7a6-b7bc4a69f517 could not be found. Jul 19 22:44:49.530460 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.530460 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cb38b305-4863-46cc-a88a-9b5685914105 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Returning 404 to user: Instance e0ada988-0937-4623-a7a6-b7bc4a69f517 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:44:49.530460 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cb38b305-4863-46cc-a88a-9b5685914105 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517" status: 404 len: 111 microversion: 2.1 time: 0.049885 Jul 19 22:44:49.530460 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1857/3733] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:44:49 2022] DELETE /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:44:49.533239 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-185e6a85-1b1d-46cd-a0cb-c355ecaeb2fe tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:49.533239 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-185e6a85-1b1d-46cd-a0cb-c355ecaeb2fe tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: e0ada988-0937-4623-a7a6-b7bc4a69f517] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:49.540425 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-185e6a85-1b1d-46cd-a0cb-c355ecaeb2fe tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:49.541261 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-185e6a85-1b1d-46cd-a0cb-c355ecaeb2fe tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:49.542927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-185e6a85-1b1d-46cd-a0cb-c355ecaeb2fe tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:49.543764 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-185e6a85-1b1d-46cd-a0cb-c355ecaeb2fe tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:49.562461 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-185e6a85-1b1d-46cd-a0cb-c355ecaeb2fe tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] HTTP exception thrown: Instance e0ada988-0937-4623-a7a6-b7bc4a69f517 could not be found. Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-185e6a85-1b1d-46cd-a0cb-c355ecaeb2fe tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Request method failure captured: Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517 HTTP/1.1 Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zJcOd8ioSoO4Ag7p0FuZhdyFBnwQELvoxLAsblThyrJ_2NxEo2CJ37EEfRT2CZdbZlGMRgWXNVEuSQUWOfX5krUiSHAMeusL8iD4FHXx0Nd2OURbeGsEBn_IDvsFz7TmW6c-8lxScCQfbEdKUx47XHZCtuEAW7dgjTFB9ANV0LmkTU Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: f4f40233895248229ddfdcd06fb65361 Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance e0ada988-0937-4623-a7a6-b7bc4a69f517 could not be found. Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'e0ada988-0937-4623-a7a6-b7bc4a69f517'} Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0ada988-0937-4623-a7a6-b7bc4a69f517 could not be found. Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0ada988-0937-4623-a7a6-b7bc4a69f517 could not be found. Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:49.564629 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.569273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:49.569273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:49.569273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:49.569273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:44:49.569273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:44:49.569273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0ada988-0937-4623-a7a6-b7bc4a69f517 could not be found. Jul 19 22:44:49.569273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.571035 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-185e6a85-1b1d-46cd-a0cb-c355ecaeb2fe tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Returning 404 to user: Instance e0ada988-0937-4623-a7a6-b7bc4a69f517 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:44:49.572049 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-185e6a85-1b1d-46cd-a0cb-c355ecaeb2fe tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517" status: 404 len: 111 microversion: 2.1 time: 0.044196 Jul 19 22:44:49.572819 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1858/3734] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:49 2022] GET /compute/v2.1/servers/e0ada988-0937-4623-a7a6-b7bc4a69f517 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:44:49.579024 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3d00581d-1a82-42f9-bedc-9c59fafe46fa tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:49.579817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3d00581d-1a82-42f9-bedc-9c59fafe46fa tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] [instance: eed83375-934e-46fc-9955-a2df323c326b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:49.587197 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d00581d-1a82-42f9-bedc-9c59fafe46fa tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:49.587760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d00581d-1a82-42f9-bedc-9c59fafe46fa tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:49.588657 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d00581d-1a82-42f9-bedc-9c59fafe46fa tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:49.589189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d00581d-1a82-42f9-bedc-9c59fafe46fa tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:49.797690 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9c1ed3e7-db6f-4e10-b5ec-ca1c38681f3c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:49.810285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9c1ed3e7-db6f-4e10-b5ec-ca1c38681f3c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:49.812749 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9c1ed3e7-db6f-4e10-b5ec-ca1c38681f3c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:49.818606 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9c1ed3e7-db6f-4e10-b5ec-ca1c38681f3c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 0.409130 Jul 19 22:44:49.839499 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1877/3735] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:44:49 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:44:49.846155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-765fda83-532c-43f7-b898-ceb417f45854 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:49.846761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-765fda83-532c-43f7-b898-ceb417f45854 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 0a5f7b5f-76ce-433e-9c96-53d7821b1761] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:49.850197 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3d00581d-1a82-42f9-bedc-9c59fafe46fa tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f88a124b27a44ddb0cf339631e1211e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b8e600a0c4cbf955e381cb2625c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:49.855025 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-765fda83-532c-43f7-b898-ceb417f45854 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:49.855597 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-765fda83-532c-43f7-b898-ceb417f45854 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:49.856507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-765fda83-532c-43f7-b898-ceb417f45854 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:49.856939 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-765fda83-532c-43f7-b898-ceb417f45854 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:49.877098 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-765fda83-532c-43f7-b898-ceb417f45854 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] HTTP exception thrown: Instance 0a5f7b5f-76ce-433e-9c96-53d7821b1761 could not be found. Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-765fda83-532c-43f7-b898-ceb417f45854 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Request method failure captured: Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/0a5f7b5f-76ce-433e-9c96-53d7821b1761 HTTP/1.1 Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zJcOd8ioSoO4Ag7p0FuZhdyFBnwQELvoxLAsblThyrJ_2NxEo2CJ37EEfRT2CZdbZlGMRgWXNVEuSQUWOfX5krUiSHAMeusL8iD4FHXx0Nd2OURbeGsEBn_IDvsFz7TmW6c-8lxScCQfbEdKUx47XHZCtuEAW7dgjTFB9ANV0LmkTU Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: f4f40233895248229ddfdcd06fb65361 Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 0a5f7b5f-76ce-433e-9c96-53d7821b1761 could not be found. Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '0a5f7b5f-76ce-433e-9c96-53d7821b1761'} Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a5f7b5f-76ce-433e-9c96-53d7821b1761 could not be found. Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:44:49.878714 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:44:49.884229 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a5f7b5f-76ce-433e-9c96-53d7821b1761 could not be found. Jul 19 22:44:49.884229 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.884229 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:49.884229 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.884229 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:49.884229 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:49.884229 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:49.884229 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:44:49.884229 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:44:49.884229 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a5f7b5f-76ce-433e-9c96-53d7821b1761 could not be found. Jul 19 22:44:49.884229 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.884229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-765fda83-532c-43f7-b898-ceb417f45854 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Returning 404 to user: Instance 0a5f7b5f-76ce-433e-9c96-53d7821b1761 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:44:49.886400 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3d00581d-1a82-42f9-bedc-9c59fafe46fa tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] 10.222.0.25 "GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b" status: 200 len: 1317 microversion: 2.1 time: 0.303570 Jul 19 22:44:49.886617 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-765fda83-532c-43f7-b898-ceb417f45854 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0a5f7b5f-76ce-433e-9c96-53d7821b1761" status: 404 len: 111 microversion: 2.1 time: 0.041989 Jul 19 22:44:49.886617 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1878/3736] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:44:49 2022] DELETE /compute/v2.1/servers/0a5f7b5f-76ce-433e-9c96-53d7821b1761 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:44:49.892153 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-691914e3-749a-45f0-bc88-4f34f7b4d617 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:49.892809 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-691914e3-749a-45f0-bc88-4f34f7b4d617 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 0a5f7b5f-76ce-433e-9c96-53d7821b1761] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:49.898545 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1859/3737] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:49 2022] GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:49.901315 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-691914e3-749a-45f0-bc88-4f34f7b4d617 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:49.901777 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-691914e3-749a-45f0-bc88-4f34f7b4d617 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:49.902571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-691914e3-749a-45f0-bc88-4f34f7b4d617 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:49.903013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-691914e3-749a-45f0-bc88-4f34f7b4d617 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:49.921395 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-691914e3-749a-45f0-bc88-4f34f7b4d617 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] HTTP exception thrown: Instance 0a5f7b5f-76ce-433e-9c96-53d7821b1761 could not be found. Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-691914e3-749a-45f0-bc88-4f34f7b4d617 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Request method failure captured: Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/0a5f7b5f-76ce-433e-9c96-53d7821b1761 HTTP/1.1 Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zJcOd8ioSoO4Ag7p0FuZhdyFBnwQELvoxLAsblThyrJ_2NxEo2CJ37EEfRT2CZdbZlGMRgWXNVEuSQUWOfX5krUiSHAMeusL8iD4FHXx0Nd2OURbeGsEBn_IDvsFz7TmW6c-8lxScCQfbEdKUx47XHZCtuEAW7dgjTFB9ANV0LmkTU Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: f4f40233895248229ddfdcd06fb65361 Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 0a5f7b5f-76ce-433e-9c96-53d7821b1761 could not be found. Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '0a5f7b5f-76ce-433e-9c96-53d7821b1761'} Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a5f7b5f-76ce-433e-9c96-53d7821b1761 could not be found. Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a5f7b5f-76ce-433e-9c96-53d7821b1761 could not be found. Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:49.922962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.931620 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:49.931620 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:49.931620 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:49.931620 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:44:49.931620 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:44:49.931620 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a5f7b5f-76ce-433e-9c96-53d7821b1761 could not be found. Jul 19 22:44:49.931620 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:49.931620 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-691914e3-749a-45f0-bc88-4f34f7b4d617 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Returning 404 to user: Instance 0a5f7b5f-76ce-433e-9c96-53d7821b1761 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:44:49.931620 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-691914e3-749a-45f0-bc88-4f34f7b4d617 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/0a5f7b5f-76ce-433e-9c96-53d7821b1761" status: 404 len: 111 microversion: 2.1 time: 0.036234 Jul 19 22:44:49.931620 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1879/3738] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:49 2022] GET /compute/v2.1/servers/0a5f7b5f-76ce-433e-9c96-53d7821b1761 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:44:50.262678 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f009ccbf-7111-48d4-95a9-d12fa3d700dd tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:50.263663 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f009ccbf-7111-48d4-95a9-d12fa3d700dd tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 617aa88b-23a3-4d6f-bf46-dd8c78af517f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:50.276190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f009ccbf-7111-48d4-95a9-d12fa3d700dd tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:50.278839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f009ccbf-7111-48d4-95a9-d12fa3d700dd tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:50.280384 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f009ccbf-7111-48d4-95a9-d12fa3d700dd tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:50.281354 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f009ccbf-7111-48d4-95a9-d12fa3d700dd tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:50.342818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1e524a2a-c8b8-4327-adb7-0397c5d6b015 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:50.343773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1e524a2a-c8b8-4327-adb7-0397c5d6b015 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:50.359013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1e524a2a-c8b8-4327-adb7-0397c5d6b015 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:50.359727 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1e524a2a-c8b8-4327-adb7-0397c5d6b015 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:50.360601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1e524a2a-c8b8-4327-adb7-0397c5d6b015 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:50.361064 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1e524a2a-c8b8-4327-adb7-0397c5d6b015 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:50.580192 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=8 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:44:50.793652 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f009ccbf-7111-48d4-95a9-d12fa3d700dd tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:50.816656 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f009ccbf-7111-48d4-95a9-d12fa3d700dd tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f" status: 200 len: 1308 microversion: 2.1 time: 0.558106 Jul 19 22:44:50.827267 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1860/3739] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:50 2022] GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f => generated 1308 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:50.846945 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4f2b6408-f3e1-40bd-b28a-5a6147aee76e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:50.850873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4f2b6408-f3e1-40bd-b28a-5a6147aee76e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:50.871619 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f2b6408-f3e1-40bd-b28a-5a6147aee76e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:50.872380 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f2b6408-f3e1-40bd-b28a-5a6147aee76e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:50.876563 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f2b6408-f3e1-40bd-b28a-5a6147aee76e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:50.877265 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f2b6408-f3e1-40bd-b28a-5a6147aee76e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:50.922762 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1e524a2a-c8b8-4327-adb7-0397c5d6b015 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:50.947289 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1e524a2a-c8b8-4327-adb7-0397c5d6b015 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1521 microversion: 2.1 time: 0.608564 Jul 19 22:44:50.948710 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1880/3740] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:50 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1521 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:50.956549 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d7409b8b-ff86-43d1-80e4-b2836e2e10e0 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:50.958399 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d7409b8b-ff86-43d1-80e4-b2836e2e10e0 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] [instance: eed83375-934e-46fc-9955-a2df323c326b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:50.965646 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7409b8b-ff86-43d1-80e4-b2836e2e10e0 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:50.966493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7409b8b-ff86-43d1-80e4-b2836e2e10e0 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:50.967509 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7409b8b-ff86-43d1-80e4-b2836e2e10e0 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:50.968265 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7409b8b-ff86-43d1-80e4-b2836e2e10e0 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:51.576196 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d7409b8b-ff86-43d1-80e4-b2836e2e10e0 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f88a124b27a44ddb0cf339631e1211e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b8e600a0c4cbf955e381cb2625c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:51.605826 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d7409b8b-ff86-43d1-80e4-b2836e2e10e0 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] 10.222.0.25 "GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b" status: 200 len: 1317 microversion: 2.1 time: 0.653707 Jul 19 22:44:51.607225 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1881/3741] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:50 2022] GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b => generated 1317 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:51.612634 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-993f4a52-2a47-4729-aa38-5a30573eeec2 req-035f797d-fc0f-42ac-ba56-9ae3ddd047f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "617aa88b-23a3-4d6f-bf46-dd8c78af517f", "name": "network-vif-plugged", "status": "completed", "tag": "9ba1bf61-ba36-4bbd-b8cd-0fadb9e8c959"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:51.623423 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-993f4a52-2a47-4729-aa38-5a30573eeec2 req-035f797d-fc0f-42ac-ba56-9ae3ddd047f5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:51.624276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-993f4a52-2a47-4729-aa38-5a30573eeec2 req-035f797d-fc0f-42ac-ba56-9ae3ddd047f5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:51.645641 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-993f4a52-2a47-4729-aa38-5a30573eeec2 req-035f797d-fc0f-42ac-ba56-9ae3ddd047f5 service nova] Creating event network-vif-plugged:9ba1bf61-ba36-4bbd-b8cd-0fadb9e8c959 for instance 617aa88b-23a3-4d6f-bf46-dd8c78af517f on n-h1-847009-3 Jul 19 22:44:51.653094 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-993f4a52-2a47-4729-aa38-5a30573eeec2 req-035f797d-fc0f-42ac-ba56-9ae3ddd047f5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044213 Jul 19 22:44:51.659495 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1882/3742] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:44:51.667397 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2a104809-d97f-4014-8d98-86a0b371c3fb tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:51.689087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2a104809-d97f-4014-8d98-86a0b371c3fb tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:51.689087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2a104809-d97f-4014-8d98-86a0b371c3fb tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Searching by: {'deleted': False, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b'} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:44:51.711825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2a104809-d97f-4014-8d98-86a0b371c3fb tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:51.712353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2a104809-d97f-4014-8d98-86a0b371c3fb tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:51.713163 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2a104809-d97f-4014-8d98-86a0b371c3fb tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:51.713634 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2a104809-d97f-4014-8d98-86a0b371c3fb tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:51.736211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4f2b6408-f3e1-40bd-b28a-5a6147aee76e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:51.750367 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.multi_cell_list [None req-2a104809-d97f-4014-8d98-86a0b371c3fb tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119338) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:44:51.764155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4f2b6408-f3e1-40bd-b28a-5a6147aee76e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:51.771853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4f2b6408-f3e1-40bd-b28a-5a6147aee76e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:51.774359 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4f2b6408-f3e1-40bd-b28a-5a6147aee76e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 0.931530 Jul 19 22:44:51.798724 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1861/3743] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:44:50 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:44:51.819660 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2a104809-d97f-4014-8d98-86a0b371c3fb tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.156987 Jul 19 22:44:51.821186 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1883/3744] 10.222.0.25 () {58 vars in 1124 bytes} [Tue Jul 19 22:44:51 2022] GET /compute/v2.1/servers => generated 343 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:44:51.838461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ba32e539-b069-45c7-a778-ab32e781c97c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:51.838717 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e38f8512-f1a5-4891-9d93-68682030f984 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:51.839549 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ba32e539-b069-45c7-a778-ab32e781c97c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 617aa88b-23a3-4d6f-bf46-dd8c78af517f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:51.844515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e38f8512-f1a5-4891-9d93-68682030f984 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:51.850294 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e38f8512-f1a5-4891-9d93-68682030f984 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Searching by: {'deleted': False, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b'} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:44:51.852044 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba32e539-b069-45c7-a778-ab32e781c97c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:51.853377 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba32e539-b069-45c7-a778-ab32e781c97c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:51.865079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e38f8512-f1a5-4891-9d93-68682030f984 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:51.865353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba32e539-b069-45c7-a778-ab32e781c97c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:51.865855 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba32e539-b069-45c7-a778-ab32e781c97c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:51.866263 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e38f8512-f1a5-4891-9d93-68682030f984 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:51.867659 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e38f8512-f1a5-4891-9d93-68682030f984 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:51.868344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e38f8512-f1a5-4891-9d93-68682030f984 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:51.931873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.multi_cell_list [None req-e38f8512-f1a5-4891-9d93-68682030f984 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119338) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:44:52.007621 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e38f8512-f1a5-4891-9d93-68682030f984 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:52.015474 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e38f8512-f1a5-4891-9d93-68682030f984 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:52.016312 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e38f8512-f1a5-4891-9d93-68682030f984 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:52.326639 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ba32e539-b069-45c7-a778-ab32e781c97c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:52.340008 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ba32e539-b069-45c7-a778-ab32e781c97c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f" status: 200 len: 1308 microversion: 2.1 time: 0.506064 Jul 19 22:44:52.354321 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1862/3745] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:51 2022] GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f => generated 1308 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:52.361268 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f30fd3c3-fe23-4ab2-9ece-a5d7900c805e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:52.361268 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f30fd3c3-fe23-4ab2-9ece-a5d7900c805e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:52.372791 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f30fd3c3-fe23-4ab2-9ece-a5d7900c805e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:52.373245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f30fd3c3-fe23-4ab2-9ece-a5d7900c805e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:52.374026 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f30fd3c3-fe23-4ab2-9ece-a5d7900c805e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:52.384203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f30fd3c3-fe23-4ab2-9ece-a5d7900c805e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:52.385999 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e38f8512-f1a5-4891-9d93-68682030f984 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.551858 Jul 19 22:44:52.386674 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1884/3746] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:44:51 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:52.407982 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f782fcfa-0b5c-4f50-942a-8f67f819410d tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:52.419804 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f782fcfa-0b5c-4f50-942a-8f67f819410d tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016930 Jul 19 22:44:52.429047 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1885/3747] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:44:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:44:52.569806 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f30fd3c3-fe23-4ab2-9ece-a5d7900c805e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:52.579184 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f30fd3c3-fe23-4ab2-9ece-a5d7900c805e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1521 microversion: 2.1 time: 0.233353 Jul 19 22:44:52.583168 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1863/3748] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:52 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:52.631764 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2d8d22bf-974b-4b27-93d5-fbe069783bfa tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:52.633114 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2d8d22bf-974b-4b27-93d5-fbe069783bfa tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] [instance: eed83375-934e-46fc-9955-a2df323c326b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:52.655452 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d8d22bf-974b-4b27-93d5-fbe069783bfa tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:52.656827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d8d22bf-974b-4b27-93d5-fbe069783bfa tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:52.658468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d8d22bf-974b-4b27-93d5-fbe069783bfa tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:52.659686 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d8d22bf-974b-4b27-93d5-fbe069783bfa tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:52.813594 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9249916e-b7a9-4c39-895d-d43aba5943bf tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:52.814532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9249916e-b7a9-4c39-895d-d43aba5943bf tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:52.842841 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9249916e-b7a9-4c39-895d-d43aba5943bf tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:52.845672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9249916e-b7a9-4c39-895d-d43aba5943bf tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:52.847622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9249916e-b7a9-4c39-895d-d43aba5943bf tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:52.851919 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9249916e-b7a9-4c39-895d-d43aba5943bf tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:52.929001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2d8d22bf-974b-4b27-93d5-fbe069783bfa tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f88a124b27a44ddb0cf339631e1211e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b8e600a0c4cbf955e381cb2625c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:52.943837 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2d8d22bf-974b-4b27-93d5-fbe069783bfa tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] 10.222.0.25 "GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b" status: 200 len: 1317 microversion: 2.1 time: 0.320722 Jul 19 22:44:52.945440 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1886/3749] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:52 2022] GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b => generated 1317 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:52.974400 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-af454a41-f672-48d9-9631-eba0f5362e0b tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:52.975508 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-af454a41-f672-48d9-9631-eba0f5362e0b tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:52.985392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-af454a41-f672-48d9-9631-eba0f5362e0b tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:52.986203 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-af454a41-f672-48d9-9631-eba0f5362e0b tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:52.987496 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-af454a41-f672-48d9-9631-eba0f5362e0b tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:52.988229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-af454a41-f672-48d9-9631-eba0f5362e0b tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:53.047320 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-af454a41-f672-48d9-9631-eba0f5362e0b tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:44:53.283160 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-af454a41-f672-48d9-9631-eba0f5362e0b tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4" status: 204 len: 0 microversion: 2.1 time: 0.315534 Jul 19 22:44:53.284176 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1887/3750] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:44:52 2022] DELETE /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:44:53.306083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3c7c651f-57e9-4f2d-818e-7aebf0511f25 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:53.311287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3c7c651f-57e9-4f2d-818e-7aebf0511f25 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:53.330844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9249916e-b7a9-4c39-895d-d43aba5943bf tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:53.342035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3c7c651f-57e9-4f2d-818e-7aebf0511f25 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:53.342605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3c7c651f-57e9-4f2d-818e-7aebf0511f25 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:53.344073 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3c7c651f-57e9-4f2d-818e-7aebf0511f25 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:53.344819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3c7c651f-57e9-4f2d-818e-7aebf0511f25 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:53.378839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9249916e-b7a9-4c39-895d-d43aba5943bf tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:53.383805 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9249916e-b7a9-4c39-895d-d43aba5943bf tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:53.386706 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9249916e-b7a9-4c39-895d-d43aba5943bf tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 0.583754 Jul 19 22:44:53.388401 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1864/3751] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:44:52 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:44:53.397852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-52764bbd-3da3-4a7f-b46b-46ecd688a09a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:53.398952 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-52764bbd-3da3-4a7f-b46b-46ecd688a09a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 617aa88b-23a3-4d6f-bf46-dd8c78af517f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:53.430876 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52764bbd-3da3-4a7f-b46b-46ecd688a09a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:53.433101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52764bbd-3da3-4a7f-b46b-46ecd688a09a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:53.434273 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52764bbd-3da3-4a7f-b46b-46ecd688a09a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:53.434703 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52764bbd-3da3-4a7f-b46b-46ecd688a09a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:53.890363 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3c7c651f-57e9-4f2d-818e-7aebf0511f25 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:53.910682 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3c7c651f-57e9-4f2d-818e-7aebf0511f25 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4" status: 200 len: 1608 microversion: 2.1 time: 0.618834 Jul 19 22:44:53.911978 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1888/3752] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:53 2022] GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 => generated 1608 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:53.918007 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-22b987af-728f-45d2-8198-79d75f30174f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:53.919068 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-22b987af-728f-45d2-8198-79d75f30174f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:53.934789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-22b987af-728f-45d2-8198-79d75f30174f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:53.935719 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-22b987af-728f-45d2-8198-79d75f30174f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:53.938790 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-22b987af-728f-45d2-8198-79d75f30174f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:53.941191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-22b987af-728f-45d2-8198-79d75f30174f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:53.951530 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-52764bbd-3da3-4a7f-b46b-46ecd688a09a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:53.973237 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-52764bbd-3da3-4a7f-b46b-46ecd688a09a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f" status: 200 len: 1308 microversion: 2.1 time: 0.576927 Jul 19 22:44:53.974352 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1865/3753] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:53 2022] GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f => generated 1308 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:53.979808 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-823be585-0568-4e38-a94f-f8e7a29c3b22 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:53.982117 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-823be585-0568-4e38-a94f-f8e7a29c3b22 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] [instance: eed83375-934e-46fc-9955-a2df323c326b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:53.992066 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-823be585-0568-4e38-a94f-f8e7a29c3b22 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:53.992849 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-823be585-0568-4e38-a94f-f8e7a29c3b22 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:53.993860 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-823be585-0568-4e38-a94f-f8e7a29c3b22 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:53.994649 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-823be585-0568-4e38-a94f-f8e7a29c3b22 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:54.416693 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-22b987af-728f-45d2-8198-79d75f30174f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:54.430713 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-823be585-0568-4e38-a94f-f8e7a29c3b22 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f88a124b27a44ddb0cf339631e1211e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b8e600a0c4cbf955e381cb2625c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:54.445947 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-823be585-0568-4e38-a94f-f8e7a29c3b22 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] 10.222.0.25 "GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b" status: 200 len: 1317 microversion: 2.1 time: 0.470088 Jul 19 22:44:54.446637 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1866/3754] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:53 2022] GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b => generated 1317 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:54.448451 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-22b987af-728f-45d2-8198-79d75f30174f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1521 microversion: 2.1 time: 0.535129 Jul 19 22:44:54.461016 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1889/3755] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:53 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1521 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:54.468688 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e7d0b3b6-ab03-47bc-9ec7-f3c8ab5dee98 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:54.469585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e7d0b3b6-ab03-47bc-9ec7-f3c8ab5dee98 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9177ec40-9593-42f5-97ad-d896faeb9e83] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:54.479998 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-731fbfe3-5434-4836-9075-1d10d8ec9126 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:54.480858 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-731fbfe3-5434-4836-9075-1d10d8ec9126 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:54.488148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e7d0b3b6-ab03-47bc-9ec7-f3c8ab5dee98 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:54.492916 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-731fbfe3-5434-4836-9075-1d10d8ec9126 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:54.493866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e7d0b3b6-ab03-47bc-9ec7-f3c8ab5dee98 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:54.494554 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-731fbfe3-5434-4836-9075-1d10d8ec9126 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:54.495641 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e7d0b3b6-ab03-47bc-9ec7-f3c8ab5dee98 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:54.496666 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-731fbfe3-5434-4836-9075-1d10d8ec9126 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:54.497355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e7d0b3b6-ab03-47bc-9ec7-f3c8ab5dee98 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:54.498021 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-731fbfe3-5434-4836-9075-1d10d8ec9126 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:54.532459 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-e7d0b3b6-ab03-47bc-9ec7-f3c8ab5dee98 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] HTTP exception thrown: Instance 9177ec40-9593-42f5-97ad-d896faeb9e83 could not be found. Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e7d0b3b6-ab03-47bc-9ec7-f3c8ab5dee98 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Request method failure captured: Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83 HTTP/1.1 Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zJcOd8ioSoO4Ag7p0FuZhdyFBnwQELvoxLAsblThyrJ_2NxEo2CJ37EEfRT2CZdbZlGMRgWXNVEuSQUWOfX5krUiSHAMeusL8iD4FHXx0Nd2OURbeGsEBn_IDvsFz7TmW6c-8lxScCQfbEdKUx47XHZCtuEAW7dgjTFB9ANV0LmkTU Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: f4f40233895248229ddfdcd06fb65361 Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 9177ec40-9593-42f5-97ad-d896faeb9e83 could not be found. Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '9177ec40-9593-42f5-97ad-d896faeb9e83'} Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9177ec40-9593-42f5-97ad-d896faeb9e83 could not be found. Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:44:54.545981 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:44:54.550562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9177ec40-9593-42f5-97ad-d896faeb9e83 could not be found. Jul 19 22:44:54.550562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:54.550562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:54.550562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:54.550562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:54.550562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:54.550562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:54.550562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:44:54.550562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:44:54.550562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9177ec40-9593-42f5-97ad-d896faeb9e83 could not be found. Jul 19 22:44:54.550562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:54.550562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e7d0b3b6-ab03-47bc-9ec7-f3c8ab5dee98 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Returning 404 to user: Instance 9177ec40-9593-42f5-97ad-d896faeb9e83 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:44:54.550562 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e7d0b3b6-ab03-47bc-9ec7-f3c8ab5dee98 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83" status: 404 len: 111 microversion: 2.1 time: 0.085431 Jul 19 22:44:54.550562 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1890/3756] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:44:54 2022] DELETE /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:44:54.559187 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a6f85cf7-94f7-4514-9b0c-4ae1d9176f34 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:54.565028 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a6f85cf7-94f7-4514-9b0c-4ae1d9176f34 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9177ec40-9593-42f5-97ad-d896faeb9e83] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:54.573800 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a6f85cf7-94f7-4514-9b0c-4ae1d9176f34 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:54.574693 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a6f85cf7-94f7-4514-9b0c-4ae1d9176f34 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:54.575937 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a6f85cf7-94f7-4514-9b0c-4ae1d9176f34 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:54.576771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a6f85cf7-94f7-4514-9b0c-4ae1d9176f34 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:54.600834 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-a6f85cf7-94f7-4514-9b0c-4ae1d9176f34 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] HTTP exception thrown: Instance 9177ec40-9593-42f5-97ad-d896faeb9e83 could not be found. Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a6f85cf7-94f7-4514-9b0c-4ae1d9176f34 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Request method failure captured: Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83 HTTP/1.1 Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zJcOd8ioSoO4Ag7p0FuZhdyFBnwQELvoxLAsblThyrJ_2NxEo2CJ37EEfRT2CZdbZlGMRgWXNVEuSQUWOfX5krUiSHAMeusL8iD4FHXx0Nd2OURbeGsEBn_IDvsFz7TmW6c-8lxScCQfbEdKUx47XHZCtuEAW7dgjTFB9ANV0LmkTU Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: f4f40233895248229ddfdcd06fb65361 Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 9177ec40-9593-42f5-97ad-d896faeb9e83 could not be found. Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '9177ec40-9593-42f5-97ad-d896faeb9e83'} Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9177ec40-9593-42f5-97ad-d896faeb9e83 could not be found. Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9177ec40-9593-42f5-97ad-d896faeb9e83 could not be found. Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:54.602716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:54.607951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:54.607951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:54.607951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:54.607951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:44:54.607951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:44:54.607951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9177ec40-9593-42f5-97ad-d896faeb9e83 could not be found. Jul 19 22:44:54.607951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:54.615657 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a6f85cf7-94f7-4514-9b0c-4ae1d9176f34 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Returning 404 to user: Instance 9177ec40-9593-42f5-97ad-d896faeb9e83 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:44:54.616756 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a6f85cf7-94f7-4514-9b0c-4ae1d9176f34 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83" status: 404 len: 111 microversion: 2.1 time: 0.061760 Jul 19 22:44:54.617673 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1891/3757] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:54 2022] GET /compute/v2.1/servers/9177ec40-9593-42f5-97ad-d896faeb9e83 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:44:54.627992 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2b0067e7-ba5a-4c75-934c-20c2dc09e930 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:54.628502 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2b0067e7-ba5a-4c75-934c-20c2dc09e930 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9c365853-9c4b-45db-97c8-26d0f6e797bd] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:54.636053 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b0067e7-ba5a-4c75-934c-20c2dc09e930 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:54.636507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b0067e7-ba5a-4c75-934c-20c2dc09e930 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:54.639266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b0067e7-ba5a-4c75-934c-20c2dc09e930 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:54.639266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b0067e7-ba5a-4c75-934c-20c2dc09e930 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:54.657065 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-2b0067e7-ba5a-4c75-934c-20c2dc09e930 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] HTTP exception thrown: Instance 9c365853-9c4b-45db-97c8-26d0f6e797bd could not be found. Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2b0067e7-ba5a-4c75-934c-20c2dc09e930 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Request method failure captured: Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd HTTP/1.1 Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zJcOd8ioSoO4Ag7p0FuZhdyFBnwQELvoxLAsblThyrJ_2NxEo2CJ37EEfRT2CZdbZlGMRgWXNVEuSQUWOfX5krUiSHAMeusL8iD4FHXx0Nd2OURbeGsEBn_IDvsFz7TmW6c-8lxScCQfbEdKUx47XHZCtuEAW7dgjTFB9ANV0LmkTU Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: f4f40233895248229ddfdcd06fb65361 Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 9c365853-9c4b-45db-97c8-26d0f6e797bd could not be found. Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '9c365853-9c4b-45db-97c8-26d0f6e797bd'} Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c365853-9c4b-45db-97c8-26d0f6e797bd could not be found. Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:44:54.659774 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:44:54.665203 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c365853-9c4b-45db-97c8-26d0f6e797bd could not be found. Jul 19 22:44:54.665203 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:54.665203 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:54.665203 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:54.665203 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:54.665203 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:54.665203 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:54.665203 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:44:54.665203 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:44:54.665203 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c365853-9c4b-45db-97c8-26d0f6e797bd could not be found. Jul 19 22:44:54.665203 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:54.665203 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2b0067e7-ba5a-4c75-934c-20c2dc09e930 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Returning 404 to user: Instance 9c365853-9c4b-45db-97c8-26d0f6e797bd could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:44:54.665203 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2b0067e7-ba5a-4c75-934c-20c2dc09e930 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd" status: 404 len: 111 microversion: 2.1 time: 0.038551 Jul 19 22:44:54.665203 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1892/3758] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:44:54 2022] DELETE /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:44:54.670231 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2baf7ed9-4bc8-47d9-9832-313714d17e68 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:54.671535 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2baf7ed9-4bc8-47d9-9832-313714d17e68 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] [instance: 9c365853-9c4b-45db-97c8-26d0f6e797bd] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:54.680113 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2baf7ed9-4bc8-47d9-9832-313714d17e68 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:54.680590 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2baf7ed9-4bc8-47d9-9832-313714d17e68 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:54.681733 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2baf7ed9-4bc8-47d9-9832-313714d17e68 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:54.682530 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2baf7ed9-4bc8-47d9-9832-313714d17e68 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:54.702471 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-2baf7ed9-4bc8-47d9-9832-313714d17e68 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] HTTP exception thrown: Instance 9c365853-9c4b-45db-97c8-26d0f6e797bd could not be found. Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2baf7ed9-4bc8-47d9-9832-313714d17e68 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Request method failure captured: Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd HTTP/1.1 Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zJcOd8ioSoO4Ag7p0FuZhdyFBnwQELvoxLAsblThyrJ_2NxEo2CJ37EEfRT2CZdbZlGMRgWXNVEuSQUWOfX5krUiSHAMeusL8iD4FHXx0Nd2OURbeGsEBn_IDvsFz7TmW6c-8lxScCQfbEdKUx47XHZCtuEAW7dgjTFB9ANV0LmkTU Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2bcdb843a7d4a1ebe467160eee0d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a2bcdb843a7d4a1ebe467160eee0d6e1 Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111720765 Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: f4f40233895248229ddfdcd06fb65361 Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-DeleteServersTestJSON-1111720765-project Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 9c365853-9c4b-45db-97c8-26d0f6e797bd could not be found. Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '9c365853-9c4b-45db-97c8-26d0f6e797bd'} Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c365853-9c4b-45db-97c8-26d0f6e797bd could not be found. Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c365853-9c4b-45db-97c8-26d0f6e797bd could not be found. Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:44:54.704154 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:54.709208 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:44:54.709208 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:44:54.709208 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:44:54.709208 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:44:54.709208 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:44:54.709208 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c365853-9c4b-45db-97c8-26d0f6e797bd could not be found. Jul 19 22:44:54.709208 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:44:54.709208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2baf7ed9-4bc8-47d9-9832-313714d17e68 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] Returning 404 to user: Instance 9c365853-9c4b-45db-97c8-26d0f6e797bd could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:44:54.709208 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2baf7ed9-4bc8-47d9-9832-313714d17e68 tempest-DeleteServersTestJSON-1111720765 tempest-DeleteServersTestJSON-1111720765-project] 10.222.0.25 "GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd" status: 404 len: 111 microversion: 2.1 time: 0.039412 Jul 19 22:44:54.711405 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1893/3759] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:54 2022] GET /compute/v2.1/servers/9c365853-9c4b-45db-97c8-26d0f6e797bd => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:44:54.937663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4caa2173-8a2e-43c6-a14e-c9c440a4e4c9 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:54.938365 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4caa2173-8a2e-43c6-a14e-c9c440a4e4c9 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:54.955305 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4caa2173-8a2e-43c6-a14e-c9c440a4e4c9 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:54.955779 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4caa2173-8a2e-43c6-a14e-c9c440a4e4c9 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:54.961843 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4caa2173-8a2e-43c6-a14e-c9c440a4e4c9 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:54.962444 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4caa2173-8a2e-43c6-a14e-c9c440a4e4c9 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:54.974612 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-731fbfe3-5434-4836-9075-1d10d8ec9126 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:54.993290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-731fbfe3-5434-4836-9075-1d10d8ec9126 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:54.995152 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-731fbfe3-5434-4836-9075-1d10d8ec9126 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:55.004231 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-731fbfe3-5434-4836-9075-1d10d8ec9126 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 0.528435 Jul 19 22:44:55.005389 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1867/3760] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:44:54 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:44:55.021211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c1d41c7c-501c-4a78-8ecc-d54630bea83e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:55.021843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c1d41c7c-501c-4a78-8ecc-d54630bea83e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 617aa88b-23a3-4d6f-bf46-dd8c78af517f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:55.041605 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c1d41c7c-501c-4a78-8ecc-d54630bea83e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:55.042421 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c1d41c7c-501c-4a78-8ecc-d54630bea83e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:55.050605 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c1d41c7c-501c-4a78-8ecc-d54630bea83e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:55.051353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c1d41c7c-501c-4a78-8ecc-d54630bea83e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:55.677731 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4caa2173-8a2e-43c6-a14e-c9c440a4e4c9 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:55.726071 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4caa2173-8a2e-43c6-a14e-c9c440a4e4c9 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4" status: 200 len: 1608 microversion: 2.1 time: 0.791965 Jul 19 22:44:55.741875 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1894/3761] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:54 2022] GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 => generated 1608 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:44:55.755443 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-7858b7e7-5993-4714-b33c-927cf97693d5 req-46eee607-5d97-4049-a48b-bb2e1e0784be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed83375-934e-46fc-9955-a2df323c326b", "name": "network-vif-plugged", "status": "completed", "tag": "8d65a4f8-b3b6-46f6-b471-2d7ca0b51d32"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:55.767270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7858b7e7-5993-4714-b33c-927cf97693d5 req-46eee607-5d97-4049-a48b-bb2e1e0784be service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:55.768572 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7858b7e7-5993-4714-b33c-927cf97693d5 req-46eee607-5d97-4049-a48b-bb2e1e0784be service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:55.807306 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-7858b7e7-5993-4714-b33c-927cf97693d5 req-46eee607-5d97-4049-a48b-bb2e1e0784be service nova] Creating event network-vif-plugged:8d65a4f8-b3b6-46f6-b471-2d7ca0b51d32 for instance eed83375-934e-46fc-9955-a2df323c326b on n-h2-847009-3 Jul 19 22:44:55.814849 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-7858b7e7-5993-4714-b33c-927cf97693d5 req-46eee607-5d97-4049-a48b-bb2e1e0784be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070688 Jul 19 22:44:55.816084 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1895/3762] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:44:55.826433 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-50b5949f-36fa-49a2-97e5-2f03d86cd9b7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:55.827569 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-50b5949f-36fa-49a2-97e5-2f03d86cd9b7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:55.837028 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50b5949f-36fa-49a2-97e5-2f03d86cd9b7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:55.837711 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50b5949f-36fa-49a2-97e5-2f03d86cd9b7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:55.838619 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50b5949f-36fa-49a2-97e5-2f03d86cd9b7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:55.839568 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50b5949f-36fa-49a2-97e5-2f03d86cd9b7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:56.043549 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c1d41c7c-501c-4a78-8ecc-d54630bea83e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:56.063224 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c1d41c7c-501c-4a78-8ecc-d54630bea83e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f" status: 200 len: 1489 microversion: 2.1 time: 1.054340 Jul 19 22:44:56.064269 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1868/3763] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:55 2022] GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f => generated 1489 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:56.073180 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9dc274ba-a7eb-4c62-885f-542a552d948e tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:56.076051 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9dc274ba-a7eb-4c62-885f-542a552d948e tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] [instance: eed83375-934e-46fc-9955-a2df323c326b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:56.091597 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9dc274ba-a7eb-4c62-885f-542a552d948e tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:56.093811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9dc274ba-a7eb-4c62-885f-542a552d948e tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:56.095991 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9dc274ba-a7eb-4c62-885f-542a552d948e tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:56.097768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9dc274ba-a7eb-4c62-885f-542a552d948e tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:56.134769 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:44:56.601838 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-50b5949f-36fa-49a2-97e5-2f03d86cd9b7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:56.618357 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-50b5949f-36fa-49a2-97e5-2f03d86cd9b7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1521 microversion: 2.1 time: 0.799807 Jul 19 22:44:56.620544 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1896/3764] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:55 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1521 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:56.633198 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-037b4811-9822-4d8d-bc3b-c828640ee468 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:56.634735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-037b4811-9822-4d8d-bc3b-c828640ee468 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:56.647918 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-037b4811-9822-4d8d-bc3b-c828640ee468 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:56.649586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-037b4811-9822-4d8d-bc3b-c828640ee468 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:56.650684 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-037b4811-9822-4d8d-bc3b-c828640ee468 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:56.651514 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-037b4811-9822-4d8d-bc3b-c828640ee468 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:56.682845 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:44:56.829110 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9dc274ba-a7eb-4c62-885f-542a552d948e tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f88a124b27a44ddb0cf339631e1211e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b8e600a0c4cbf955e381cb2625c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:56.849971 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9dc274ba-a7eb-4c62-885f-542a552d948e tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] 10.222.0.25 "GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b" status: 200 len: 1317 microversion: 2.1 time: 0.784215 Jul 19 22:44:56.850591 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1869/3765] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:56 2022] GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b => generated 1317 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:56.868144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1bf26f34-647a-44e7-8193-a197b2e001a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:56.869848 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1bf26f34-647a-44e7-8193-a197b2e001a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 452a29c5-c034-4f02-827f-95ffb5bfffbb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:56.878719 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1bf26f34-647a-44e7-8193-a197b2e001a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:56.879454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1bf26f34-647a-44e7-8193-a197b2e001a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:56.881752 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1bf26f34-647a-44e7-8193-a197b2e001a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:56.882587 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1bf26f34-647a-44e7-8193-a197b2e001a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:56.997526 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 22:44:56.998284 n-d-847009-3 devstack@n-api.service[119337]: Tue Jul 19 22:44:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb (ip 10.222.0.25) !!! Jul 19 22:44:57.151925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-037b4811-9822-4d8d-bc3b-c828640ee468 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:57.172893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-037b4811-9822-4d8d-bc3b-c828640ee468 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:57.174426 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-037b4811-9822-4d8d-bc3b-c828640ee468 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:57.175703 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-037b4811-9822-4d8d-bc3b-c828640ee468 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 0.553587 Jul 19 22:44:57.176274 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1897/3766] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:44:56 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:44:57.189725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-66d15499-e67d-48ab-98a5-fab64b6bc39e tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:57.193768 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-66d15499-e67d-48ab-98a5-fab64b6bc39e tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:57.209232 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66d15499-e67d-48ab-98a5-fab64b6bc39e tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:57.210095 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66d15499-e67d-48ab-98a5-fab64b6bc39e tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:57.212193 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66d15499-e67d-48ab-98a5-fab64b6bc39e tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:57.212836 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66d15499-e67d-48ab-98a5-fab64b6bc39e tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:57.304845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1bf26f34-647a-44e7-8193-a197b2e001a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:57.324135 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1bf26f34-647a-44e7-8193-a197b2e001a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb" status: 200 len: 1488 microversion: 2.1 time: 0.471108 Jul 19 22:44:57.326126 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1870/3767] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:56 2022] GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb => generated 1488 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:57.346205 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-557226da-54bf-4d33-bf07-c188532edccd tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:57.346871 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-557226da-54bf-4d33-bf07-c188532edccd tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 617aa88b-23a3-4d6f-bf46-dd8c78af517f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:57.360676 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-557226da-54bf-4d33-bf07-c188532edccd tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:57.361547 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-557226da-54bf-4d33-bf07-c188532edccd tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:57.362896 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-557226da-54bf-4d33-bf07-c188532edccd tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:57.363561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-557226da-54bf-4d33-bf07-c188532edccd tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:57.696595 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-66d15499-e67d-48ab-98a5-fab64b6bc39e tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:57.716033 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-66d15499-e67d-48ab-98a5-fab64b6bc39e tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4" status: 200 len: 1608 microversion: 2.1 time: 0.530503 Jul 19 22:44:57.717413 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1898/3768] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:57 2022] GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 => generated 1608 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:57.725520 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c5b80bea-a7c4-444a-95cb-9b9754b60bd2 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:57.726537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c5b80bea-a7c4-444a-95cb-9b9754b60bd2 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:57.734392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c5b80bea-a7c4-444a-95cb-9b9754b60bd2 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:57.735426 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c5b80bea-a7c4-444a-95cb-9b9754b60bd2 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:57.735762 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c5b80bea-a7c4-444a-95cb-9b9754b60bd2 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:57.736211 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c5b80bea-a7c4-444a-95cb-9b9754b60bd2 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:57.988495 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-557226da-54bf-4d33-bf07-c188532edccd tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:58.001565 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-557226da-54bf-4d33-bf07-c188532edccd tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f" status: 200 len: 1489 microversion: 2.1 time: 0.662302 Jul 19 22:44:58.005860 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1871/3769] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:57 2022] GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f => generated 1489 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:44:58.013144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dd0e0dab-0739-4e77-b754-ea3421d6c0cc tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:58.023512 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dd0e0dab-0739-4e77-b754-ea3421d6c0cc tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] [instance: eed83375-934e-46fc-9955-a2df323c326b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:58.038419 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dd0e0dab-0739-4e77-b754-ea3421d6c0cc tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:58.039881 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dd0e0dab-0739-4e77-b754-ea3421d6c0cc tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:58.040954 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dd0e0dab-0739-4e77-b754-ea3421d6c0cc tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:58.041661 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dd0e0dab-0739-4e77-b754-ea3421d6c0cc tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:58.213618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c5b80bea-a7c4-444a-95cb-9b9754b60bd2 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:58.222338 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c5b80bea-a7c4-444a-95cb-9b9754b60bd2 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1521 microversion: 2.1 time: 0.503316 Jul 19 22:44:58.223446 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1899/3770] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:57 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1521 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:58.228435 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c4d9d49c-2311-475d-ae4b-cf032392f01a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:58.229260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c4d9d49c-2311-475d-ae4b-cf032392f01a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 617aa88b-23a3-4d6f-bf46-dd8c78af517f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:58.237897 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4d9d49c-2311-475d-ae4b-cf032392f01a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:58.239909 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4d9d49c-2311-475d-ae4b-cf032392f01a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:58.241962 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4d9d49c-2311-475d-ae4b-cf032392f01a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:58.243043 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4d9d49c-2311-475d-ae4b-cf032392f01a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:58.291272 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c4d9d49c-2311-475d-ae4b-cf032392f01a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 617aa88b-23a3-4d6f-bf46-dd8c78af517f] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:44:58.445949 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c4d9d49c-2311-475d-ae4b-cf032392f01a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "DELETE /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f" status: 204 len: 0 microversion: 2.1 time: 0.220117 Jul 19 22:44:58.449999 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1900/3771] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:44:58 2022] DELETE /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:44:58.458306 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8cfed124-c171-4a9d-9251-f306bc509700 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:58.459793 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8cfed124-c171-4a9d-9251-f306bc509700 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:58.471951 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8cfed124-c171-4a9d-9251-f306bc509700 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:58.472755 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8cfed124-c171-4a9d-9251-f306bc509700 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:58.474485 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8cfed124-c171-4a9d-9251-f306bc509700 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:58.474947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8cfed124-c171-4a9d-9251-f306bc509700 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:58.554253 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dd0e0dab-0739-4e77-b754-ea3421d6c0cc tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f88a124b27a44ddb0cf339631e1211e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b8e600a0c4cbf955e381cb2625c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:58.572011 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dd0e0dab-0739-4e77-b754-ea3421d6c0cc tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] 10.222.0.25 "GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b" status: 200 len: 1507 microversion: 2.1 time: 0.563130 Jul 19 22:44:58.572901 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1872/3772] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:58 2022] GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b => generated 1507 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:58.578264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b88ef500-9740-4d9a-98b9-8ad8408c9d69 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:58.579244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b88ef500-9740-4d9a-98b9-8ad8408c9d69 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 617aa88b-23a3-4d6f-bf46-dd8c78af517f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:58.596249 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b88ef500-9740-4d9a-98b9-8ad8408c9d69 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:58.597564 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b88ef500-9740-4d9a-98b9-8ad8408c9d69 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:58.599323 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b88ef500-9740-4d9a-98b9-8ad8408c9d69 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:58.601723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b88ef500-9740-4d9a-98b9-8ad8408c9d69 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:58.991600 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8cfed124-c171-4a9d-9251-f306bc509700 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:59.022117 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8cfed124-c171-4a9d-9251-f306bc509700 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:59.025254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8cfed124-c171-4a9d-9251-f306bc509700 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:59.032985 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8cfed124-c171-4a9d-9251-f306bc509700 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 0.579613 Jul 19 22:44:59.034081 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1901/3773] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:44:58 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:44:59.050738 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f35b0e25-9d6e-41f7-b59c-d8e6329d142d tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:59.054304 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f35b0e25-9d6e-41f7-b59c-d8e6329d142d tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] [instance: eed83375-934e-46fc-9955-a2df323c326b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:59.070077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f35b0e25-9d6e-41f7-b59c-d8e6329d142d tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:59.070336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f35b0e25-9d6e-41f7-b59c-d8e6329d142d tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:59.071318 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f35b0e25-9d6e-41f7-b59c-d8e6329d142d tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:59.075339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f35b0e25-9d6e-41f7-b59c-d8e6329d142d tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:59.109889 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b88ef500-9740-4d9a-98b9-8ad8408c9d69 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:59.121992 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b88ef500-9740-4d9a-98b9-8ad8408c9d69 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f" status: 200 len: 1495 microversion: 2.1 time: 0.546778 Jul 19 22:44:59.124157 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1873/3774] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:58 2022] GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f => generated 1495 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:59.137117 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-99f46442-975e-4c5a-9bae-726d788f4850 req-f2a13846-3b37-4156-9e68-727ff4c84023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fa32776-830f-4a09-814f-536f39a284e4", "name": "network-vif-deleted", "tag": "e87d2086-e34b-41a9-a3fc-b54342672708"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:44:59.154537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-99f46442-975e-4c5a-9bae-726d788f4850 req-f2a13846-3b37-4156-9e68-727ff4c84023 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:59.161244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-99f46442-975e-4c5a-9bae-726d788f4850 req-f2a13846-3b37-4156-9e68-727ff4c84023 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:59.172227 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f35b0e25-9d6e-41f7-b59c-d8e6329d142d tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] 10.222.0.25 "GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b/ips" status: 200 len: 110 microversion: 2.1 time: 0.136476 Jul 19 22:44:59.173463 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1902/3775] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 19 22:44:59 2022] GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b/ips => generated 110 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:44:59.197307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-da7e226e-f8f8-4b98-801b-80c912986dff tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:59.197889 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-99f46442-975e-4c5a-9bae-726d788f4850 req-f2a13846-3b37-4156-9e68-727ff4c84023 service nova] Creating event network-vif-deleted:e87d2086-e34b-41a9-a3fc-b54342672708 for instance 4fa32776-830f-4a09-814f-536f39a284e4 on n-h1-847009-3 Jul 19 22:44:59.198026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-da7e226e-f8f8-4b98-801b-80c912986dff tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:59.208493 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-99f46442-975e-4c5a-9bae-726d788f4850 req-f2a13846-3b37-4156-9e68-727ff4c84023 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082660 Jul 19 22:44:59.210860 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1874/3776] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:44:59.213266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da7e226e-f8f8-4b98-801b-80c912986dff tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:59.213604 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da7e226e-f8f8-4b98-801b-80c912986dff tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:59.216802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da7e226e-f8f8-4b98-801b-80c912986dff tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:59.217239 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da7e226e-f8f8-4b98-801b-80c912986dff tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:59.221123 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1a196e33-202a-498e-b24e-00862cdff381 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:59.224480 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1a196e33-202a-498e-b24e-00862cdff381 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] [instance: eed83375-934e-46fc-9955-a2df323c326b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:59.239855 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a196e33-202a-498e-b24e-00862cdff381 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:59.242153 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a196e33-202a-498e-b24e-00862cdff381 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:59.245933 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a196e33-202a-498e-b24e-00862cdff381 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:59.247660 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a196e33-202a-498e-b24e-00862cdff381 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:59.305165 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1a196e33-202a-498e-b24e-00862cdff381 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] 10.222.0.25 "GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b/ips" status: 200 len: 110 microversion: 2.1 time: 0.091914 Jul 19 22:44:59.309971 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1875/3777] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 19 22:44:59 2022] GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b/ips => generated 110 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:44:59.328158 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fdbc7333-2a45-410e-8990-8c37e530ba18 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:59.329524 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fdbc7333-2a45-410e-8990-8c37e530ba18 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:59.332978 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:44:59.352768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fdbc7333-2a45-410e-8990-8c37e530ba18 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:59.353225 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fdbc7333-2a45-410e-8990-8c37e530ba18 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:59.366506 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fdbc7333-2a45-410e-8990-8c37e530ba18 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:59.366506 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fdbc7333-2a45-410e-8990-8c37e530ba18 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:59.396777 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-da7e226e-f8f8-4b98-801b-80c912986dff tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:59.405862 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-da7e226e-f8f8-4b98-801b-80c912986dff tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4" status: 200 len: 1540 microversion: 2.1 time: 0.231064 Jul 19 22:44:59.406450 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1903/3778] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:59 2022] GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 => generated 1540 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:59.419472 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-87d4bc50-92a4-4d25-a121-99c5fc8f518d tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:59.423781 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-87d4bc50-92a4-4d25-a121-99c5fc8f518d tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] [instance: eed83375-934e-46fc-9955-a2df323c326b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:59.439021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87d4bc50-92a4-4d25-a121-99c5fc8f518d tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:59.448004 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87d4bc50-92a4-4d25-a121-99c5fc8f518d tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:59.448761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87d4bc50-92a4-4d25-a121-99c5fc8f518d tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:59.449217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87d4bc50-92a4-4d25-a121-99c5fc8f518d tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:59.525144 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-87d4bc50-92a4-4d25-a121-99c5fc8f518d tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] 10.222.0.25 "GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b/ips/tempest-ServerAddressesTestJSON-1670765846-network" status: 200 len: 95 microversion: 2.1 time: 0.113835 Jul 19 22:44:59.526083 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1904/3779] 10.222.0.25 () {58 vars in 1400 bytes} [Tue Jul 19 22:44:59 2022] GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b/ips/tempest-ServerAddressesTestJSON-1670765846-network => generated 95 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:44:59.542979 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d78688f6-b13a-4d4a-8218-6959ef6242ba tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:59.544254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d78688f6-b13a-4d4a-8218-6959ef6242ba tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] [instance: eed83375-934e-46fc-9955-a2df323c326b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:59.563091 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d78688f6-b13a-4d4a-8218-6959ef6242ba tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:59.563570 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d78688f6-b13a-4d4a-8218-6959ef6242ba tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:59.566006 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d78688f6-b13a-4d4a-8218-6959ef6242ba tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:59.566599 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d78688f6-b13a-4d4a-8218-6959ef6242ba tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:59.574207 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fdbc7333-2a45-410e-8990-8c37e530ba18 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:44:59.582661 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fdbc7333-2a45-410e-8990-8c37e530ba18 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1521 microversion: 2.1 time: 0.271342 Jul 19 22:44:59.586046 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1876/3780] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:59 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:44:59.601536 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d78688f6-b13a-4d4a-8218-6959ef6242ba tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] [instance: eed83375-934e-46fc-9955-a2df323c326b] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:44:59.721804 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:44:59.729812 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d78688f6-b13a-4d4a-8218-6959ef6242ba tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] 10.222.0.25 "DELETE /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b" status: 204 len: 0 microversion: 2.1 time: 0.190679 Jul 19 22:44:59.731410 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1905/3781] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:44:59 2022] DELETE /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:44:59.742600 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fa0f65e8-6bf2-496e-b38b-c03af1ec5924 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:44:59.744416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fa0f65e8-6bf2-496e-b38b-c03af1ec5924 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] [instance: eed83375-934e-46fc-9955-a2df323c326b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:44:59.750090 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa0f65e8-6bf2-496e-b38b-c03af1ec5924 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:59.750634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa0f65e8-6bf2-496e-b38b-c03af1ec5924 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:59.751727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa0f65e8-6bf2-496e-b38b-c03af1ec5924 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:44:59.752374 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa0f65e8-6bf2-496e-b38b-c03af1ec5924 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:44:59.990715 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fa0f65e8-6bf2-496e-b38b-c03af1ec5924 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f88a124b27a44ddb0cf339631e1211e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b8e600a0c4cbf955e381cb2625c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:00.008730 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fa0f65e8-6bf2-496e-b38b-c03af1ec5924 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] 10.222.0.25 "GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b" status: 200 len: 1513 microversion: 2.1 time: 0.264991 Jul 19 22:45:00.022581 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1877/3782] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:44:59 2022] GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b => generated 1513 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:45:00.056874 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9bd4c3a3-ebde-48ad-98dd-b5e63d27f13c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:00.057927 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9bd4c3a3-ebde-48ad-98dd-b5e63d27f13c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:00.089605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9bd4c3a3-ebde-48ad-98dd-b5e63d27f13c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:00.089605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9bd4c3a3-ebde-48ad-98dd-b5e63d27f13c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:00.094143 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9bd4c3a3-ebde-48ad-98dd-b5e63d27f13c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:00.094972 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9bd4c3a3-ebde-48ad-98dd-b5e63d27f13c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:00.145471 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3d9834d1-8ba9-49f3-8e1e-4fc9bebbb9fc tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:00.154778 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3d9834d1-8ba9-49f3-8e1e-4fc9bebbb9fc tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 617aa88b-23a3-4d6f-bf46-dd8c78af517f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:00.194023 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d9834d1-8ba9-49f3-8e1e-4fc9bebbb9fc tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:00.198768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d9834d1-8ba9-49f3-8e1e-4fc9bebbb9fc tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:00.200050 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d9834d1-8ba9-49f3-8e1e-4fc9bebbb9fc tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:00.200622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d9834d1-8ba9-49f3-8e1e-4fc9bebbb9fc tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:00.542715 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3d9834d1-8ba9-49f3-8e1e-4fc9bebbb9fc tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:00.555453 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3d9834d1-8ba9-49f3-8e1e-4fc9bebbb9fc tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f" status: 200 len: 1495 microversion: 2.1 time: 0.414403 Jul 19 22:45:00.556513 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1878/3783] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:00 2022] GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f => generated 1495 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:00.562829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d58c656d-b070-4be5-b2b7-ebb5442ad9e1 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:00.568317 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d58c656d-b070-4be5-b2b7-ebb5442ad9e1 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:00.583832 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d58c656d-b070-4be5-b2b7-ebb5442ad9e1 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:00.585019 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d58c656d-b070-4be5-b2b7-ebb5442ad9e1 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:00.592781 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d58c656d-b070-4be5-b2b7-ebb5442ad9e1 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:00.593701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d58c656d-b070-4be5-b2b7-ebb5442ad9e1 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:00.701158 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9bd4c3a3-ebde-48ad-98dd-b5e63d27f13c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:00.721904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9bd4c3a3-ebde-48ad-98dd-b5e63d27f13c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:00.733230 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9bd4c3a3-ebde-48ad-98dd-b5e63d27f13c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:00.736149 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9bd4c3a3-ebde-48ad-98dd-b5e63d27f13c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 0.685576 Jul 19 22:45:00.737008 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1906/3784] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:00 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:45:00.744880 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bca8a734-1462-4f69-9e14-b1aa04594b6b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:00.748966 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bca8a734-1462-4f69-9e14-b1aa04594b6b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:00.769795 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bca8a734-1462-4f69-9e14-b1aa04594b6b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:00.790243 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bca8a734-1462-4f69-9e14-b1aa04594b6b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:00.793800 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bca8a734-1462-4f69-9e14-b1aa04594b6b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:00.794485 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bca8a734-1462-4f69-9e14-b1aa04594b6b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:01.146069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d58c656d-b070-4be5-b2b7-ebb5442ad9e1 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:01.160283 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d58c656d-b070-4be5-b2b7-ebb5442ad9e1 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4" status: 200 len: 1252 microversion: 2.1 time: 0.602375 Jul 19 22:45:01.162671 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1879/3785] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:00 2022] GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 => generated 1252 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:01.170827 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a51de9fb-efd8-4c91-adeb-48ade753b857 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:01.177329 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a51de9fb-efd8-4c91-adeb-48ade753b857 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:01.202066 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a51de9fb-efd8-4c91-adeb-48ade753b857 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:01.202780 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a51de9fb-efd8-4c91-adeb-48ade753b857 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:01.206883 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a51de9fb-efd8-4c91-adeb-48ade753b857 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:01.208323 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a51de9fb-efd8-4c91-adeb-48ade753b857 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:01.497459 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bca8a734-1462-4f69-9e14-b1aa04594b6b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:01.515544 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bca8a734-1462-4f69-9e14-b1aa04594b6b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1521 microversion: 2.1 time: 0.772741 Jul 19 22:45:01.516837 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1907/3786] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:00 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1521 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:01.538012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7c3c8489-2133-452e-9668-1bbb69f3c42b tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:01.539366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7c3c8489-2133-452e-9668-1bbb69f3c42b tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] [instance: eed83375-934e-46fc-9955-a2df323c326b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:01.557299 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7c3c8489-2133-452e-9668-1bbb69f3c42b tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:01.559930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7c3c8489-2133-452e-9668-1bbb69f3c42b tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:01.564584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7c3c8489-2133-452e-9668-1bbb69f3c42b tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:01.565544 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7c3c8489-2133-452e-9668-1bbb69f3c42b tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:01.688117 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a51de9fb-efd8-4c91-adeb-48ade753b857 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:01.711263 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a51de9fb-efd8-4c91-adeb-48ade753b857 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.547227 Jul 19 22:45:01.726069 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1880/3787] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:01 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:01.733641 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1ec9b208-89b8-4860-9218-0c9d5ed3f152 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:01.734543 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1ec9b208-89b8-4860-9218-0c9d5ed3f152 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 617aa88b-23a3-4d6f-bf46-dd8c78af517f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:01.748506 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1ec9b208-89b8-4860-9218-0c9d5ed3f152 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:01.749032 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1ec9b208-89b8-4860-9218-0c9d5ed3f152 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:01.750221 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1ec9b208-89b8-4860-9218-0c9d5ed3f152 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:01.752501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1ec9b208-89b8-4860-9218-0c9d5ed3f152 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:01.888919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:45:01.924151 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1ec9b208-89b8-4860-9218-0c9d5ed3f152 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:01.940951 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1ec9b208-89b8-4860-9218-0c9d5ed3f152 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f" status: 200 len: 1453 microversion: 2.1 time: 0.220320 Jul 19 22:45:01.943405 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1881/3788] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:01 2022] GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f => generated 1453 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:01.969048 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-13ec860e-32f1-4e4f-b8a3-ae632144ff35 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:01.969691 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-13ec860e-32f1-4e4f-b8a3-ae632144ff35 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:02.000236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13ec860e-32f1-4e4f-b8a3-ae632144ff35 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:02.000750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13ec860e-32f1-4e4f-b8a3-ae632144ff35 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:02.001600 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13ec860e-32f1-4e4f-b8a3-ae632144ff35 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:02.002046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13ec860e-32f1-4e4f-b8a3-ae632144ff35 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:02.002730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:45:02.243710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7c3c8489-2133-452e-9668-1bbb69f3c42b tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f88a124b27a44ddb0cf339631e1211e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b8e600a0c4cbf955e381cb2625c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:02.268898 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7c3c8489-2133-452e-9668-1bbb69f3c42b tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] 10.222.0.25 "GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b" status: 200 len: 1513 microversion: 2.1 time: 0.750399 Jul 19 22:45:02.272535 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1908/3789] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:01 2022] GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b => generated 1513 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:02.300473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-09a82ed9-55ee-4097-a8b2-0f06fc9b4e18 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:02.301118 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-09a82ed9-55ee-4097-a8b2-0f06fc9b4e18 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:02.319027 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-09a82ed9-55ee-4097-a8b2-0f06fc9b4e18 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:02.319756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-09a82ed9-55ee-4097-a8b2-0f06fc9b4e18 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:02.320797 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-09a82ed9-55ee-4097-a8b2-0f06fc9b4e18 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:02.321953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-09a82ed9-55ee-4097-a8b2-0f06fc9b4e18 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:02.496869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-13ec860e-32f1-4e4f-b8a3-ae632144ff35 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:02.512326 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-13ec860e-32f1-4e4f-b8a3-ae632144ff35 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.557305 Jul 19 22:45:02.528255 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1882/3790] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:01 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:02.537528 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-4264230e-ab5c-4e00-b5a3-2ff6c8c45409 req-4c755b7f-0646-4e51-92b4-c85295605089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "617aa88b-23a3-4d6f-bf46-dd8c78af517f", "name": "network-vif-deleted", "tag": "9ba1bf61-ba36-4bbd-b8cd-0fadb9e8c959"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:02.570719 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-4264230e-ab5c-4e00-b5a3-2ff6c8c45409 req-4c755b7f-0646-4e51-92b4-c85295605089 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:02.576159 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-4264230e-ab5c-4e00-b5a3-2ff6c8c45409 req-4c755b7f-0646-4e51-92b4-c85295605089 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:02.594130 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-4264230e-ab5c-4e00-b5a3-2ff6c8c45409 req-4c755b7f-0646-4e51-92b4-c85295605089 service nova] Creating event network-vif-deleted:9ba1bf61-ba36-4bbd-b8cd-0fadb9e8c959 for instance 617aa88b-23a3-4d6f-bf46-dd8c78af517f on n-h1-847009-3 Jul 19 22:45:02.618505 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-4264230e-ab5c-4e00-b5a3-2ff6c8c45409 req-4c755b7f-0646-4e51-92b4-c85295605089 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088973 Jul 19 22:45:02.619549 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1883/3791] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:45:02.631426 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-15dc027b-c508-417c-9432-a1f9e062f1ec tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:02.632165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-15dc027b-c508-417c-9432-a1f9e062f1ec tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:02.652464 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-15dc027b-c508-417c-9432-a1f9e062f1ec tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:02.652928 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-15dc027b-c508-417c-9432-a1f9e062f1ec tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:02.653720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-15dc027b-c508-417c-9432-a1f9e062f1ec tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:02.654244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-15dc027b-c508-417c-9432-a1f9e062f1ec tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:02.772646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-15dc027b-c508-417c-9432-a1f9e062f1ec tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:02.785014 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-15dc027b-c508-417c-9432-a1f9e062f1ec tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4" status: 200 len: 1252 microversion: 2.1 time: 0.164175 Jul 19 22:45:02.785661 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1884/3792] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:02 2022] GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 => generated 1252 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:02.802778 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-231a2962-7f37-4abb-b1fb-db2bf764c32a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:02.806767 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-231a2962-7f37-4abb-b1fb-db2bf764c32a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:02.824328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-231a2962-7f37-4abb-b1fb-db2bf764c32a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:02.825532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-231a2962-7f37-4abb-b1fb-db2bf764c32a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:02.826556 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-231a2962-7f37-4abb-b1fb-db2bf764c32a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:02.827022 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-231a2962-7f37-4abb-b1fb-db2bf764c32a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:02.865272 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-09a82ed9-55ee-4097-a8b2-0f06fc9b4e18 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:02.884697 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-09a82ed9-55ee-4097-a8b2-0f06fc9b4e18 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:02.887082 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-09a82ed9-55ee-4097-a8b2-0f06fc9b4e18 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:02.891231 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-09a82ed9-55ee-4097-a8b2-0f06fc9b4e18 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 0.614552 Jul 19 22:45:02.897793 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1909/3793] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:02 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:45:02.909907 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0f9a8486-53de-4075-8b57-f28bbb646962 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:02.913057 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0f9a8486-53de-4075-8b57-f28bbb646962 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:02.925622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0f9a8486-53de-4075-8b57-f28bbb646962 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:02.926930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0f9a8486-53de-4075-8b57-f28bbb646962 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:02.927965 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0f9a8486-53de-4075-8b57-f28bbb646962 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:02.928593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0f9a8486-53de-4075-8b57-f28bbb646962 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:03.022037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-231a2962-7f37-4abb-b1fb-db2bf764c32a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:03.032729 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-231a2962-7f37-4abb-b1fb-db2bf764c32a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.239848 Jul 19 22:45:03.033950 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1885/3794] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:02 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:03.040199 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-120ab30f-f2d0-4c30-a797-0251407dabde tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:03.041075 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-120ab30f-f2d0-4c30-a797-0251407dabde tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 617aa88b-23a3-4d6f-bf46-dd8c78af517f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:03.048553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-120ab30f-f2d0-4c30-a797-0251407dabde tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:03.049537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-120ab30f-f2d0-4c30-a797-0251407dabde tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:03.050614 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-120ab30f-f2d0-4c30-a797-0251407dabde tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:03.056980 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-120ab30f-f2d0-4c30-a797-0251407dabde tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:03.077048 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-120ab30f-f2d0-4c30-a797-0251407dabde tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] HTTP exception thrown: Instance 617aa88b-23a3-4d6f-bf46-dd8c78af517f could not be found. Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-120ab30f-f2d0-4c30-a797-0251407dabde tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Request method failure captured: Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f HTTP/1.1 Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zM1CVhkGzrLI27yplqtJpQo-i3-EKMGfRab3BLA-iVFSYzTm_PO2UXoSlqkSOVVu2ip8fmaaUlGTzOcY-1-PKTjTHCVYzWriYi14tgLboJXa9RPch13wobugtzkYLm5uZx9koMts7tA37UlK9MH24L7zFq17JufqAVvZobtx47aYg4 Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersTestJSON-1648920919 Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersTestJSON-1648920919-project Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1db06ac41e9f4fe290e535f703af484d Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersTestJSON-1648920919-project Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 617aa88b-23a3-4d6f-bf46-dd8c78af517f could not be found. Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '617aa88b-23a3-4d6f-bf46-dd8c78af517f'} Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 617aa88b-23a3-4d6f-bf46-dd8c78af517f could not be found. Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 617aa88b-23a3-4d6f-bf46-dd8c78af517f could not be found. Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:03.078746 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:03.086162 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:45:03.086162 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:45:03.086162 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:45:03.086162 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:45:03.086162 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 617aa88b-23a3-4d6f-bf46-dd8c78af517f could not be found. Jul 19 22:45:03.086162 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:03.086162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-120ab30f-f2d0-4c30-a797-0251407dabde tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Returning 404 to user: Instance 617aa88b-23a3-4d6f-bf46-dd8c78af517f could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:45:03.086162 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-120ab30f-f2d0-4c30-a797-0251407dabde tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f" status: 404 len: 111 microversion: 2.1 time: 0.045144 Jul 19 22:45:03.086162 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1886/3795] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:03 2022] GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:45:03.090843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0c5e6096-051a-4c85-8125-cfedb7f3b309 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:03.091499 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0c5e6096-051a-4c85-8125-cfedb7f3b309 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:03.098761 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c5e6096-051a-4c85-8125-cfedb7f3b309 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:03.099922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c5e6096-051a-4c85-8125-cfedb7f3b309 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:03.100804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c5e6096-051a-4c85-8125-cfedb7f3b309 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:03.101178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c5e6096-051a-4c85-8125-cfedb7f3b309 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:03.403772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0f9a8486-53de-4075-8b57-f28bbb646962 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:03.428630 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0f9a8486-53de-4075-8b57-f28bbb646962 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1521 microversion: 2.1 time: 0.529362 Jul 19 22:45:03.444803 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1910/3796] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:02 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1521 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:03.459504 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0c5e6096-051a-4c85-8125-cfedb7f3b309 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:03.460571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7ad83a1d-1e6b-4973-b839-e1ef3eaa12d6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:03.461083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7ad83a1d-1e6b-4973-b839-e1ef3eaa12d6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 452a29c5-c034-4f02-827f-95ffb5bfffbb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:03.467888 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0c5e6096-051a-4c85-8125-cfedb7f3b309 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.380631 Jul 19 22:45:03.468492 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1887/3797] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:03 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:03.492320 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7ad83a1d-1e6b-4973-b839-e1ef3eaa12d6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:03.495526 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7ad83a1d-1e6b-4973-b839-e1ef3eaa12d6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:03.498376 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-931fc765-2b85-4404-b3f3-d343265dd6f8 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:03.499021 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-931fc765-2b85-4404-b3f3-d343265dd6f8 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] [instance: eed83375-934e-46fc-9955-a2df323c326b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:03.500322 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7ad83a1d-1e6b-4973-b839-e1ef3eaa12d6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:03.501350 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7ad83a1d-1e6b-4973-b839-e1ef3eaa12d6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:03.519432 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-931fc765-2b85-4404-b3f3-d343265dd6f8 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:03.520491 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-931fc765-2b85-4404-b3f3-d343265dd6f8 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:03.522044 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-931fc765-2b85-4404-b3f3-d343265dd6f8 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:03.522494 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-931fc765-2b85-4404-b3f3-d343265dd6f8 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:03.542324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:45:03.575570 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:45:03.617218 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7ad83a1d-1e6b-4973-b839-e1ef3eaa12d6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 452a29c5-c034-4f02-827f-95ffb5bfffbb] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:45:03.865112 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7ad83a1d-1e6b-4973-b839-e1ef3eaa12d6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "DELETE /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb" status: 204 len: 0 microversion: 2.1 time: 0.414471 Jul 19 22:45:03.868402 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-931fc765-2b85-4404-b3f3-d343265dd6f8 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f88a124b27a44ddb0cf339631e1211e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b8e600a0c4cbf955e381cb2625c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:03.872897 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1911/3798] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:45:03 2022] DELETE /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:45:03.889084 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-931fc765-2b85-4404-b3f3-d343265dd6f8 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] 10.222.0.25 "GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b" status: 200 len: 1471 microversion: 2.1 time: 0.403637 Jul 19 22:45:03.890158 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7ef14423-069c-4f3c-b805-a9a0005ae8d1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1259528113", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "9e83a825-a2fd-461e-9b4f-f6a6a85fd752"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:03.891040 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1888/3799] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:03 2022] GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b => generated 1471 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:03.907566 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-8586583f-9dd1-4013-adc3-e33c7d6cc203 req-4d4a0948-2297-4eab-ad5e-0b3db4d78a69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed83375-934e-46fc-9955-a2df323c326b", "name": "network-vif-deleted", "tag": "8d65a4f8-b3b6-46f6-b471-2d7ca0b51d32"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:03.937610 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-8586583f-9dd1-4013-adc3-e33c7d6cc203 req-4d4a0948-2297-4eab-ad5e-0b3db4d78a69 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:03.939577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-8586583f-9dd1-4013-adc3-e33c7d6cc203 req-4d4a0948-2297-4eab-ad5e-0b3db4d78a69 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:03.991949 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-8586583f-9dd1-4013-adc3-e33c7d6cc203 req-4d4a0948-2297-4eab-ad5e-0b3db4d78a69 service nova] Creating event network-vif-deleted:8d65a4f8-b3b6-46f6-b471-2d7ca0b51d32 for instance eed83375-934e-46fc-9955-a2df323c326b on n-h2-847009-3 Jul 19 22:45:04.009126 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-8586583f-9dd1-4013-adc3-e33c7d6cc203 req-4d4a0948-2297-4eab-ad5e-0b3db4d78a69 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115330 Jul 19 22:45:04.012940 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1889/3800] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:45:04.018902 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-60306f75-06e3-466c-a241-0f9853279a41 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:04.019523 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-60306f75-06e3-466c-a241-0f9853279a41 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:04.027929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60306f75-06e3-466c-a241-0f9853279a41 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:04.028577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60306f75-06e3-466c-a241-0f9853279a41 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:04.029620 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60306f75-06e3-466c-a241-0f9853279a41 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:04.030262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60306f75-06e3-466c-a241-0f9853279a41 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:04.032864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-7ef14423-069c-4f3c-b805-a9a0005ae8d1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] validate_networks() for [('9e83a825-a2fd-461e-9b4f-f6a6a85fd752', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:45:04.132892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-60306f75-06e3-466c-a241-0f9853279a41 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:04.148619 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-60306f75-06e3-466c-a241-0f9853279a41 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4" status: 200 len: 1252 microversion: 2.1 time: 0.133943 Jul 19 22:45:04.171591 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1890/3801] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:04 2022] GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 => generated 1252 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:04.194796 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-09bf2f48-68f2-442b-9175-76ce079bd789 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:04.195522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-09bf2f48-68f2-442b-9175-76ce079bd789 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 452a29c5-c034-4f02-827f-95ffb5bfffbb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:04.203422 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-09bf2f48-68f2-442b-9175-76ce079bd789 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:04.203885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-09bf2f48-68f2-442b-9175-76ce079bd789 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:04.205032 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-09bf2f48-68f2-442b-9175-76ce079bd789 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:04.205175 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-09bf2f48-68f2-442b-9175-76ce079bd789 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:04.689608 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-09bf2f48-68f2-442b-9175-76ce079bd789 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:04.708502 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-09bf2f48-68f2-442b-9175-76ce079bd789 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb" status: 200 len: 1494 microversion: 2.1 time: 0.534347 Jul 19 22:45:04.709463 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1891/3802] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:04 2022] GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb => generated 1494 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:04.715834 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a4980675-5f91-4efe-a8b3-e4c7a516f9a7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:04.717457 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a4980675-5f91-4efe-a8b3-e4c7a516f9a7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:04.724326 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a4980675-5f91-4efe-a8b3-e4c7a516f9a7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:04.739216 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a4980675-5f91-4efe-a8b3-e4c7a516f9a7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:04.740417 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a4980675-5f91-4efe-a8b3-e4c7a516f9a7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:04.741055 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a4980675-5f91-4efe-a8b3-e4c7a516f9a7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:05.877088 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a4980675-5f91-4efe-a8b3-e4c7a516f9a7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:05.893636 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a4980675-5f91-4efe-a8b3-e4c7a516f9a7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:05.896361 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a4980675-5f91-4efe-a8b3-e4c7a516f9a7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:05.897976 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a4980675-5f91-4efe-a8b3-e4c7a516f9a7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 1.187211 Jul 19 22:45:05.899171 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1892/3803] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:04 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:45:05.904139 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5fc85f8b-8d23-4859-a6fa-faf43a81d562 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:05.905099 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5fc85f8b-8d23-4859-a6fa-faf43a81d562 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:05.912719 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5fc85f8b-8d23-4859-a6fa-faf43a81d562 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:05.913565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5fc85f8b-8d23-4859-a6fa-faf43a81d562 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:05.914625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5fc85f8b-8d23-4859-a6fa-faf43a81d562 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:05.915344 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5fc85f8b-8d23-4859-a6fa-faf43a81d562 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:05.978901 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-7ef14423-069c-4f3c-b805-a9a0005ae8d1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:45:05.979763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-7ef14423-069c-4f3c-b805-a9a0005ae8d1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:45:05.987435 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-7ef14423-069c-4f3c-b805-a9a0005ae8d1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:45:05.988807 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-7ef14423-069c-4f3c-b805-a9a0005ae8d1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:45:05.992279 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-7ef14423-069c-4f3c-b805-a9a0005ae8d1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:45:06.016758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7ef14423-069c-4f3c-b805-a9a0005ae8d1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:06.017209 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7ef14423-069c-4f3c-b805-a9a0005ae8d1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:06.018019 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7ef14423-069c-4f3c-b805-a9a0005ae8d1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:06.029403 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7ef14423-069c-4f3c-b805-a9a0005ae8d1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:06.073488 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-7ef14423-069c-4f3c-b805-a9a0005ae8d1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Getting quotas for project 038e4783159e41e3b2cb88df1f8f4a97. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:45:06.082335 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-7ef14423-069c-4f3c-b805-a9a0005ae8d1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Getting quotas for user 1f2613ad65b047e8b9a68907406d1874 and project 038e4783159e41e3b2cb88df1f8f4a97. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:45:06.099977 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7ef14423-069c-4f3c-b805-a9a0005ae8d1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:45:06.103474 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7ef14423-069c-4f3c-b805-a9a0005ae8d1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:45:06.191093 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7ef14423-069c-4f3c-b805-a9a0005ae8d1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.315385 Jul 19 22:45:06.193295 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1912/3804] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:45:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:45:06.198997 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4ba8570f-a540-4fd1-8ffc-3fb2f109c1d7 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:06.199920 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4ba8570f-a540-4fd1-8ffc-3fb2f109c1d7 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] [instance: eed83375-934e-46fc-9955-a2df323c326b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:06.208013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ba8570f-a540-4fd1-8ffc-3fb2f109c1d7 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:06.209067 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ba8570f-a540-4fd1-8ffc-3fb2f109c1d7 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:06.210264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ba8570f-a540-4fd1-8ffc-3fb2f109c1d7 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:06.210944 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ba8570f-a540-4fd1-8ffc-3fb2f109c1d7 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:06.235633 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-4ba8570f-a540-4fd1-8ffc-3fb2f109c1d7 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] HTTP exception thrown: Instance eed83375-934e-46fc-9955-a2df323c326b could not be found. Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4ba8570f-a540-4fd1-8ffc-3fb2f109c1d7 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Request method failure captured: Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b HTTP/1.1 Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zPUk_S7l-1mURLrwhLNLCM_S8_4Tgb_IH2gLu6GH5GGAu9LC7nSceFAXFBy8wAlqlNxBMEM2DewcO1IgG1OmpT-cknGhriyLXNhXBf36EENFh2n6yIGlGpE2GYZlM6m4_qhkSyO_ijUZs67eqWlOJJsRq6ObpmdDk4JG5iMM_-Irh8 Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: db0b8e600a0c4cbf955e381cb2625c77 Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerAddressesTestJSON-1234262250 Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_db0b8e600a0c4cbf955e381cb2625c77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/db0b8e600a0c4cbf955e381cb2625c77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/db0b8e600a0c4cbf955e381cb2625c77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/db0b8e600a0c4cbf955e381cb2625c77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerAddressesTestJSON-1234262250 Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: db0b8e600a0c4cbf955e381cb2625c77 Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1234262250 Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerAddressesTestJSON-1234262250-project Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 3f88a124b27a44ddb0cf339631e1211e Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerAddressesTestJSON-1234262250-project Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance eed83375-934e-46fc-9955-a2df323c326b could not be found. Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'eed83375-934e-46fc-9955-a2df323c326b'} Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eed83375-934e-46fc-9955-a2df323c326b could not be found. Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eed83375-934e-46fc-9955-a2df323c326b could not be found. Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:45:06.237612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:06.243209 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:06.243209 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:45:06.243209 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:45:06.243209 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:45:06.243209 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:45:06.243209 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eed83375-934e-46fc-9955-a2df323c326b could not be found. Jul 19 22:45:06.243209 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:06.245640 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4ba8570f-a540-4fd1-8ffc-3fb2f109c1d7 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] Returning 404 to user: Instance eed83375-934e-46fc-9955-a2df323c326b could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:45:06.246868 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4ba8570f-a540-4fd1-8ffc-3fb2f109c1d7 tempest-ServerAddressesTestJSON-1234262250 tempest-ServerAddressesTestJSON-1234262250-project] 10.222.0.25 "GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b" status: 404 len: 111 microversion: 2.1 time: 0.052463 Jul 19 22:45:06.247980 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1913/3805] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:06 2022] GET /compute/v2.1/servers/eed83375-934e-46fc-9955-a2df323c326b => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:45:06.277329 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e3a29a8b-10aa-4015-aa09-3903af2a5bed tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:06.278692 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e3a29a8b-10aa-4015-aa09-3903af2a5bed tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:06.294538 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e3a29a8b-10aa-4015-aa09-3903af2a5bed tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:06.297715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e3a29a8b-10aa-4015-aa09-3903af2a5bed tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:06.301494 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e3a29a8b-10aa-4015-aa09-3903af2a5bed tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:06.302677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e3a29a8b-10aa-4015-aa09-3903af2a5bed tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:06.611849 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5fc85f8b-8d23-4859-a6fa-faf43a81d562 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:06.627549 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5fc85f8b-8d23-4859-a6fa-faf43a81d562 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1521 microversion: 2.1 time: 0.726717 Jul 19 22:45:06.630508 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1893/3806] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:05 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1521 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:06.639445 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3020b7ca-ad25-4ad9-b097-7bf474c784a2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:06.640896 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3020b7ca-ad25-4ad9-b097-7bf474c784a2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 452a29c5-c034-4f02-827f-95ffb5bfffbb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:06.649359 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3020b7ca-ad25-4ad9-b097-7bf474c784a2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:06.650939 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3020b7ca-ad25-4ad9-b097-7bf474c784a2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:06.651979 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3020b7ca-ad25-4ad9-b097-7bf474c784a2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:06.652852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3020b7ca-ad25-4ad9-b097-7bf474c784a2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:06.983487 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3020b7ca-ad25-4ad9-b097-7bf474c784a2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:06.999618 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3020b7ca-ad25-4ad9-b097-7bf474c784a2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb" status: 200 len: 1452 microversion: 2.1 time: 0.367554 Jul 19 22:45:07.002057 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1894/3807] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:06 2022] GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb => generated 1452 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:07.012810 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0c3dd410-0448-42c6-af80-54ad04853b20 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:07.014919 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0c3dd410-0448-42c6-af80-54ad04853b20 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:07.030668 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c3dd410-0448-42c6-af80-54ad04853b20 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:07.031956 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c3dd410-0448-42c6-af80-54ad04853b20 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:07.033146 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c3dd410-0448-42c6-af80-54ad04853b20 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:07.033932 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c3dd410-0448-42c6-af80-54ad04853b20 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:07.154586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e3a29a8b-10aa-4015-aa09-3903af2a5bed tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:07.164405 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e3a29a8b-10aa-4015-aa09-3903af2a5bed tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4" status: 200 len: 1252 microversion: 2.1 time: 0.915063 Jul 19 22:45:07.164989 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1914/3808] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:06 2022] GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 => generated 1252 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:07.190622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-15cbed3c-f58d-4b4a-b039-0b665b7df441 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:07.193704 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-15cbed3c-f58d-4b4a-b039-0b665b7df441 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:07.220430 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-15cbed3c-f58d-4b4a-b039-0b665b7df441 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:07.220854 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-15cbed3c-f58d-4b4a-b039-0b665b7df441 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:07.224298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-15cbed3c-f58d-4b4a-b039-0b665b7df441 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:07.224762 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-15cbed3c-f58d-4b4a-b039-0b665b7df441 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:07.280268 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0c3dd410-0448-42c6-af80-54ad04853b20 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:07.291806 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0c3dd410-0448-42c6-af80-54ad04853b20 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9" status: 200 len: 1219 microversion: 2.1 time: 0.287783 Jul 19 22:45:07.292419 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1895/3809] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:07 2022] GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 => generated 1219 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:07.321023 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-c551ddf0-5f50-4ed8-9aba-12bbc9ec1020 req-0063a7c6-c8ec-44f3-a2b8-5348a4ab8188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "452a29c5-c034-4f02-827f-95ffb5bfffbb", "name": "network-vif-deleted", "tag": "610a985c-6bc4-4a7d-b16c-e561d3eb2171"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:07.335406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-c551ddf0-5f50-4ed8-9aba-12bbc9ec1020 req-0063a7c6-c8ec-44f3-a2b8-5348a4ab8188 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:07.347948 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-c551ddf0-5f50-4ed8-9aba-12bbc9ec1020 req-0063a7c6-c8ec-44f3-a2b8-5348a4ab8188 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:07.394439 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-c551ddf0-5f50-4ed8-9aba-12bbc9ec1020 req-0063a7c6-c8ec-44f3-a2b8-5348a4ab8188 service nova] Creating event network-vif-deleted:610a985c-6bc4-4a7d-b16c-e561d3eb2171 for instance 452a29c5-c034-4f02-827f-95ffb5bfffbb on n-h1-847009-3 Jul 19 22:45:07.412082 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-c551ddf0-5f50-4ed8-9aba-12bbc9ec1020 req-0063a7c6-c8ec-44f3-a2b8-5348a4ab8188 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094030 Jul 19 22:45:07.417651 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1896/3810] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:45:07.650948 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-71bae7c8-0428-467a-bff1-dac78e2e2beb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:07.651842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-71bae7c8-0428-467a-bff1-dac78e2e2beb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:07.664859 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-71bae7c8-0428-467a-bff1-dac78e2e2beb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:07.665249 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-71bae7c8-0428-467a-bff1-dac78e2e2beb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:07.666056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-71bae7c8-0428-467a-bff1-dac78e2e2beb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:07.666520 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-71bae7c8-0428-467a-bff1-dac78e2e2beb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:08.245600 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-71bae7c8-0428-467a-bff1-dac78e2e2beb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:08.265733 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-71bae7c8-0428-467a-bff1-dac78e2e2beb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1521 microversion: 2.1 time: 0.623369 Jul 19 22:45:08.268399 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1897/3811] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:07 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1521 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:45:08.284914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-15cbed3c-f58d-4b4a-b039-0b665b7df441 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:08.293160 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f232c33c-5786-4b3b-ae7b-deeee8d30e0f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:08.297693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f232c33c-5786-4b3b-ae7b-deeee8d30e0f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 452a29c5-c034-4f02-827f-95ffb5bfffbb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:08.303667 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-15cbed3c-f58d-4b4a-b039-0b665b7df441 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:08.306170 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-15cbed3c-f58d-4b4a-b039-0b665b7df441 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:08.308229 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-15cbed3c-f58d-4b4a-b039-0b665b7df441 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 1.129758 Jul 19 22:45:08.309277 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1915/3812] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:07 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:45:08.315357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4dc6ffc7-eb1d-473e-83fc-cc660bf8324d tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:08.315977 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4dc6ffc7-eb1d-473e-83fc-cc660bf8324d tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:08.323541 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4dc6ffc7-eb1d-473e-83fc-cc660bf8324d tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:08.324237 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4dc6ffc7-eb1d-473e-83fc-cc660bf8324d tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:08.325174 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4dc6ffc7-eb1d-473e-83fc-cc660bf8324d tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:08.325806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4dc6ffc7-eb1d-473e-83fc-cc660bf8324d tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:08.327051 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f232c33c-5786-4b3b-ae7b-deeee8d30e0f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:08.327825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f232c33c-5786-4b3b-ae7b-deeee8d30e0f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:08.329216 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f232c33c-5786-4b3b-ae7b-deeee8d30e0f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:08.329922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f232c33c-5786-4b3b-ae7b-deeee8d30e0f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:08.346838 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-f232c33c-5786-4b3b-ae7b-deeee8d30e0f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] HTTP exception thrown: Instance 452a29c5-c034-4f02-827f-95ffb5bfffbb could not be found. Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f232c33c-5786-4b3b-ae7b-deeee8d30e0f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Request method failure captured: Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb HTTP/1.1 Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zM1CVhkGzrLI27yplqtJpQo-i3-EKMGfRab3BLA-iVFSYzTm_PO2UXoSlqkSOVVu2ip8fmaaUlGTzOcY-1-PKTjTHCVYzWriYi14tgLboJXa9RPch13wobugtzkYLm5uZx9koMts7tA37UlK9MH24L7zFq17JufqAVvZobtx47aYg4 Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersTestJSON-1648920919 Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersTestJSON-1648920919-project Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1db06ac41e9f4fe290e535f703af484d Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersTestJSON-1648920919-project Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 452a29c5-c034-4f02-827f-95ffb5bfffbb could not be found. Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '452a29c5-c034-4f02-827f-95ffb5bfffbb'} Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 452a29c5-c034-4f02-827f-95ffb5bfffbb could not be found. Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 452a29c5-c034-4f02-827f-95ffb5bfffbb could not be found. Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:08.349080 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:08.353648 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:45:08.353648 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:45:08.353648 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:45:08.353648 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:45:08.353648 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 452a29c5-c034-4f02-827f-95ffb5bfffbb could not be found. Jul 19 22:45:08.353648 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:08.358280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f232c33c-5786-4b3b-ae7b-deeee8d30e0f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Returning 404 to user: Instance 452a29c5-c034-4f02-827f-95ffb5bfffbb could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:45:08.360507 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f232c33c-5786-4b3b-ae7b-deeee8d30e0f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb" status: 404 len: 111 microversion: 2.1 time: 0.081847 Jul 19 22:45:08.365763 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1898/3813] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:08 2022] GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:45:08.371004 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fc77ea68-348c-46bc-a33e-908075ce925a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:08.371968 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fc77ea68-348c-46bc-a33e-908075ce925a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:08.381244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc77ea68-348c-46bc-a33e-908075ce925a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:08.381544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc77ea68-348c-46bc-a33e-908075ce925a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:08.382969 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc77ea68-348c-46bc-a33e-908075ce925a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:08.384201 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc77ea68-348c-46bc-a33e-908075ce925a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:08.414292 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4dc6ffc7-eb1d-473e-83fc-cc660bf8324d tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:08.414789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4dc6ffc7-eb1d-473e-83fc-cc660bf8324d tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:08.415284 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-4dc6ffc7-eb1d-473e-83fc-cc660bf8324d tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lazy-loading 'fault' on Instance uuid 4fa32776-830f-4a09-814f-536f39a284e4 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:45:08.480594 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fc77ea68-348c-46bc-a33e-908075ce925a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:08.489270 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fc77ea68-348c-46bc-a33e-908075ce925a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9" status: 200 len: 1275 microversion: 2.1 time: 0.122000 Jul 19 22:45:08.494134 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1899/3814] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:08 2022] GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 => generated 1275 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:08.526972 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4dc6ffc7-eb1d-473e-83fc-cc660bf8324d tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5edfaf424714e3bafaf391932f4a892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fcd1f228f434f4098ca2c8f7c4c4e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:08.533559 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-36f0357d-e4f0-4dfa-914d-7e75f84ba213 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1690360510", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "6119d69d-194a-407a-a78f-64890b6702ed"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:08.536486 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4dc6ffc7-eb1d-473e-83fc-cc660bf8324d tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4" status: 200 len: 1257 microversion: 2.1 time: 0.225059 Jul 19 22:45:08.538189 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1916/3815] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:08 2022] GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 => generated 1257 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:08.610671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-36f0357d-e4f0-4dfa-914d-7e75f84ba213 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] validate_networks() for [('6119d69d-194a-407a-a78f-64890b6702ed', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:45:09.287558 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-49f1486c-a27b-4706-9f8c-875aade20d88 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:09.288373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-49f1486c-a27b-4706-9f8c-875aade20d88 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:09.306737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49f1486c-a27b-4706-9f8c-875aade20d88 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:09.307987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49f1486c-a27b-4706-9f8c-875aade20d88 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:09.308922 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49f1486c-a27b-4706-9f8c-875aade20d88 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:09.309644 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49f1486c-a27b-4706-9f8c-875aade20d88 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:09.392213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-36f0357d-e4f0-4dfa-914d-7e75f84ba213 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:45:09.393234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-36f0357d-e4f0-4dfa-914d-7e75f84ba213 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:45:09.393969 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-36f0357d-e4f0-4dfa-914d-7e75f84ba213 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:45:09.394624 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-36f0357d-e4f0-4dfa-914d-7e75f84ba213 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:45:09.396017 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-36f0357d-e4f0-4dfa-914d-7e75f84ba213 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:45:09.428884 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36f0357d-e4f0-4dfa-914d-7e75f84ba213 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:09.429744 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36f0357d-e4f0-4dfa-914d-7e75f84ba213 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:09.432778 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36f0357d-e4f0-4dfa-914d-7e75f84ba213 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:09.436976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36f0357d-e4f0-4dfa-914d-7e75f84ba213 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:09.497673 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-36f0357d-e4f0-4dfa-914d-7e75f84ba213 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Getting quotas for project 9bd4d0caf2f347218af6ffd52f250c59. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:45:09.509420 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-36f0357d-e4f0-4dfa-914d-7e75f84ba213 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Getting quotas for user 1db06ac41e9f4fe290e535f703af484d and project 9bd4d0caf2f347218af6ffd52f250c59. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:45:09.541204 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-36f0357d-e4f0-4dfa-914d-7e75f84ba213 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:45:09.552083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-36f0357d-e4f0-4dfa-914d-7e75f84ba213 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: c56a1af0-7bb0-42ee-8139-fe6c8a6772d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:45:09.713974 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-36f0357d-e4f0-4dfa-914d-7e75f84ba213 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.187167 Jul 19 22:45:09.715786 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1900/3816] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:45:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 22:45:09.738855 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4f10699b-b13d-4607-bab5-2e4f7ee13d90 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:09.743719 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4f10699b-b13d-4607-bab5-2e4f7ee13d90 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:09.752238 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f10699b-b13d-4607-bab5-2e4f7ee13d90 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:09.752713 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f10699b-b13d-4607-bab5-2e4f7ee13d90 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:09.755375 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f10699b-b13d-4607-bab5-2e4f7ee13d90 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:09.755375 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f10699b-b13d-4607-bab5-2e4f7ee13d90 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:11.152065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-49f1486c-a27b-4706-9f8c-875aade20d88 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:11.184984 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-49f1486c-a27b-4706-9f8c-875aade20d88 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1521 microversion: 2.1 time: 1.902846 Jul 19 22:45:11.186160 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1917/3817] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:09 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1521 bytes in 1905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:11.193600 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d62e6a21-a8f3-44d7-b298-53e410afbc61 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:11.195254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d62e6a21-a8f3-44d7-b298-53e410afbc61 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:11.205003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d62e6a21-a8f3-44d7-b298-53e410afbc61 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:11.205726 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d62e6a21-a8f3-44d7-b298-53e410afbc61 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:11.206732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d62e6a21-a8f3-44d7-b298-53e410afbc61 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:11.207302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d62e6a21-a8f3-44d7-b298-53e410afbc61 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:11.328503 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4f10699b-b13d-4607-bab5-2e4f7ee13d90 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:11.348697 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4f10699b-b13d-4607-bab5-2e4f7ee13d90 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:11.351709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4f10699b-b13d-4607-bab5-2e4f7ee13d90 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:11.355627 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4f10699b-b13d-4607-bab5-2e4f7ee13d90 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 1.628793 Jul 19 22:45:11.358517 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1901/3818] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:09 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:45:11.370639 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ad55b96b-c5c5-41d0-a7a0-96ab7eca7cd5 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:11.374567 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ad55b96b-c5c5-41d0-a7a0-96ab7eca7cd5 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] [instance: 4fa32776-830f-4a09-814f-536f39a284e4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:11.390710 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad55b96b-c5c5-41d0-a7a0-96ab7eca7cd5 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:11.401338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad55b96b-c5c5-41d0-a7a0-96ab7eca7cd5 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:11.405214 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad55b96b-c5c5-41d0-a7a0-96ab7eca7cd5 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:11.408897 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad55b96b-c5c5-41d0-a7a0-96ab7eca7cd5 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:11.456402 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-ad55b96b-c5c5-41d0-a7a0-96ab7eca7cd5 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] HTTP exception thrown: Instance 4fa32776-830f-4a09-814f-536f39a284e4 could not be found. Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ad55b96b-c5c5-41d0-a7a0-96ab7eca7cd5 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Request method failure captured: Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 HTTP/1.1 Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zNqpbSnYtFNPX-de8-INkeKwYulRIEEvwQvN0fW2zdS9yfktweHjyKcElBJ-3fPuJysrPK_4yh9VLHie8OonlRCl64YnmyFyD1P1IYkfetygVSue-l5_tO4WjoQdKquYPTVaa-n6LsT4F6hQO3rLyG6bPrAzHoKJlXY6kp0gAK95iQ Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 6fcd1f228f434f4098ca2c8f7c4c4e1b Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersTestBootFromVolume-90995487 Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6fcd1f228f434f4098ca2c8f7c4c4e1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6fcd1f228f434f4098ca2c8f7c4c4e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6fcd1f228f434f4098ca2c8f7c4c4e1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6fcd1f228f434f4098ca2c8f7c4c4e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersTestBootFromVolume-90995487 Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 6fcd1f228f434f4098ca2c8f7c4c4e1b Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersTestBootFromVolume-90995487 Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersTestBootFromVolume-90995487-project Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: a5edfaf424714e3bafaf391932f4a892 Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersTestBootFromVolume-90995487-project Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 4fa32776-830f-4a09-814f-536f39a284e4 could not be found. Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '4fa32776-830f-4a09-814f-536f39a284e4'} Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fa32776-830f-4a09-814f-536f39a284e4 could not be found. Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fa32776-830f-4a09-814f-536f39a284e4 could not be found. Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:45:11.463277 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:11.468310 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:11.468310 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:45:11.468310 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:45:11.468310 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:45:11.468310 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:45:11.468310 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fa32776-830f-4a09-814f-536f39a284e4 could not be found. Jul 19 22:45:11.468310 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:11.469776 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ad55b96b-c5c5-41d0-a7a0-96ab7eca7cd5 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Returning 404 to user: Instance 4fa32776-830f-4a09-814f-536f39a284e4 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:45:11.470862 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ad55b96b-c5c5-41d0-a7a0-96ab7eca7cd5 tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4" status: 404 len: 111 microversion: 2.1 time: 0.108884 Jul 19 22:45:11.471740 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1902/3819] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:11 2022] GET /compute/v2.1/servers/4fa32776-830f-4a09-814f-536f39a284e4 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:45:11.481731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a37f43be-3d25-44d5-b6b9-ebe3a1591e2b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:11.488799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a37f43be-3d25-44d5-b6b9-ebe3a1591e2b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: c56a1af0-7bb0-42ee-8139-fe6c8a6772d4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:11.508551 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a37f43be-3d25-44d5-b6b9-ebe3a1591e2b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:11.511553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a37f43be-3d25-44d5-b6b9-ebe3a1591e2b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:11.514592 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a37f43be-3d25-44d5-b6b9-ebe3a1591e2b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:11.517092 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a37f43be-3d25-44d5-b6b9-ebe3a1591e2b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:11.775425 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a37f43be-3d25-44d5-b6b9-ebe3a1591e2b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:11.784857 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a37f43be-3d25-44d5-b6b9-ebe3a1591e2b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4" status: 200 len: 1269 microversion: 2.1 time: 0.310436 Jul 19 22:45:11.792210 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1903/3820] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:11 2022] GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 => generated 1269 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:11.807159 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-54094646-0b9e-48b8-9900-4c7ec857e6ae tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] Calling method '.version_select at 0x7f7a03427b80>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:11.845201 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-54094646-0b9e-48b8-9900-4c7ec857e6ae tempest-ServersTestBootFromVolume-90995487 tempest-ServersTestBootFromVolume-90995487-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1334488762" status: 202 len: 0 microversion: 2.1 time: 0.051591 Jul 19 22:45:11.849479 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1904/3821] 10.222.0.25 () {58 vars in 1220 bytes} [Tue Jul 19 22:45:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1334488762 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:45:12.046164 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d62e6a21-a8f3-44d7-b298-53e410afbc61 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:12.058288 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d62e6a21-a8f3-44d7-b298-53e410afbc61 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9" status: 200 len: 1315 microversion: 2.1 time: 0.870607 Jul 19 22:45:12.060075 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1918/3822] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:11 2022] GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 => generated 1315 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:12.206226 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-38249341-6edf-43ca-98c5-48953a0190ed tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:12.206777 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-38249341-6edf-43ca-98c5-48953a0190ed tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:12.224085 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-38249341-6edf-43ca-98c5-48953a0190ed tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:12.224545 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-38249341-6edf-43ca-98c5-48953a0190ed tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:12.225350 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-38249341-6edf-43ca-98c5-48953a0190ed tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:12.226016 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-38249341-6edf-43ca-98c5-48953a0190ed tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:12.392434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-323d0b2a-8cfd-4125-b740-d68f6670684e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:12.393983 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-323d0b2a-8cfd-4125-b740-d68f6670684e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:12.424147 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-323d0b2a-8cfd-4125-b740-d68f6670684e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:12.428710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-323d0b2a-8cfd-4125-b740-d68f6670684e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:12.434089 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-323d0b2a-8cfd-4125-b740-d68f6670684e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:12.438357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-323d0b2a-8cfd-4125-b740-d68f6670684e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:13.370996 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-323d0b2a-8cfd-4125-b740-d68f6670684e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:13.411009 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-323d0b2a-8cfd-4125-b740-d68f6670684e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:13.419555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-323d0b2a-8cfd-4125-b740-d68f6670684e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:13.423524 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-323d0b2a-8cfd-4125-b740-d68f6670684e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 1.038384 Jul 19 22:45:13.428915 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1919/3823] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:12 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:45:13.445493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-af84d306-8ac2-4c42-b3c0-0581520051f1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:13.449021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-af84d306-8ac2-4c42-b3c0-0581520051f1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: c56a1af0-7bb0-42ee-8139-fe6c8a6772d4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:13.465799 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-af84d306-8ac2-4c42-b3c0-0581520051f1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:13.466276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-af84d306-8ac2-4c42-b3c0-0581520051f1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:13.467063 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-af84d306-8ac2-4c42-b3c0-0581520051f1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:13.467544 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-af84d306-8ac2-4c42-b3c0-0581520051f1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:13.534878 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-38249341-6edf-43ca-98c5-48953a0190ed tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:13.554663 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-38249341-6edf-43ca-98c5-48953a0190ed tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1521 microversion: 2.1 time: 1.352225 Jul 19 22:45:13.556405 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1905/3824] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:12 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1521 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:13.565364 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d10edfe2-89ad-42de-a79e-bfc6559419a2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:13.572170 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d10edfe2-89ad-42de-a79e-bfc6559419a2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:13.589903 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d10edfe2-89ad-42de-a79e-bfc6559419a2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:13.591413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d10edfe2-89ad-42de-a79e-bfc6559419a2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:13.592485 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d10edfe2-89ad-42de-a79e-bfc6559419a2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:13.593178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d10edfe2-89ad-42de-a79e-bfc6559419a2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:13.767792 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-af84d306-8ac2-4c42-b3c0-0581520051f1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:13.801090 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-af84d306-8ac2-4c42-b3c0-0581520051f1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4" status: 200 len: 1267 microversion: 2.1 time: 0.370141 Jul 19 22:45:13.809929 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1920/3825] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:13 2022] GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 => generated 1267 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:14.297309 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d10edfe2-89ad-42de-a79e-bfc6559419a2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:14.312839 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d10edfe2-89ad-42de-a79e-bfc6559419a2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9" status: 200 len: 1315 microversion: 2.1 time: 0.751353 Jul 19 22:45:14.315503 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1906/3826] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:13 2022] GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 => generated 1315 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:14.448052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0b177ff6-b99e-4f6d-95d7-9506ddba25c9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:14.449498 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0b177ff6-b99e-4f6d-95d7-9506ddba25c9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:14.463337 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b177ff6-b99e-4f6d-95d7-9506ddba25c9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:14.464200 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b177ff6-b99e-4f6d-95d7-9506ddba25c9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:14.465346 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b177ff6-b99e-4f6d-95d7-9506ddba25c9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:14.467263 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b177ff6-b99e-4f6d-95d7-9506ddba25c9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:14.574659 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1acf8675-0fb1-493f-9249-e69f4f7727c8 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:14.575385 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1acf8675-0fb1-493f-9249-e69f4f7727c8 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:14.583181 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1acf8675-0fb1-493f-9249-e69f4f7727c8 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:14.584727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1acf8675-0fb1-493f-9249-e69f4f7727c8 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:14.586096 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1acf8675-0fb1-493f-9249-e69f4f7727c8 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:14.586986 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1acf8675-0fb1-493f-9249-e69f4f7727c8 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:15.688708 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0b177ff6-b99e-4f6d-95d7-9506ddba25c9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:15.751438 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0b177ff6-b99e-4f6d-95d7-9506ddba25c9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:15.757992 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0b177ff6-b99e-4f6d-95d7-9506ddba25c9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:15.762927 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0b177ff6-b99e-4f6d-95d7-9506ddba25c9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 1.318231 Jul 19 22:45:15.763755 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1921/3827] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:14 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:45:15.801723 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-f77c7ba8-2047-4834-a2a8-e6176a545cbb req-390cd1e4-9f38-4ba7-bac9-7ac8e898d84e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9", "tag": "b9484698-cfca-4fb0-a643-cbdc6e37402e"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:15.813134 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f77c7ba8-2047-4834-a2a8-e6176a545cbb req-390cd1e4-9f38-4ba7-bac9-7ac8e898d84e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:15.813594 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f77c7ba8-2047-4834-a2a8-e6176a545cbb req-390cd1e4-9f38-4ba7-bac9-7ac8e898d84e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:15.844115 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-f77c7ba8-2047-4834-a2a8-e6176a545cbb req-390cd1e4-9f38-4ba7-bac9-7ac8e898d84e service nova] Creating event network-changed:b9484698-cfca-4fb0-a643-cbdc6e37402e for instance 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 on n-h1-847009-3 Jul 19 22:45:15.852802 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-f77c7ba8-2047-4834-a2a8-e6176a545cbb req-390cd1e4-9f38-4ba7-bac9-7ac8e898d84e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075905 Jul 19 22:45:15.854621 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1922/3828] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:45:15.866536 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-65107df0-27e1-453d-897a-90227be6658c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:15.868376 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-65107df0-27e1-453d-897a-90227be6658c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: c56a1af0-7bb0-42ee-8139-fe6c8a6772d4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:15.881384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65107df0-27e1-453d-897a-90227be6658c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:15.882362 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65107df0-27e1-453d-897a-90227be6658c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:15.884100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65107df0-27e1-453d-897a-90227be6658c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:15.885056 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65107df0-27e1-453d-897a-90227be6658c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:16.046966 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:45:16.096523 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:45:16.221864 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1acf8675-0fb1-493f-9249-e69f4f7727c8 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:16.231819 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1acf8675-0fb1-493f-9249-e69f4f7727c8 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1521 microversion: 2.1 time: 1.661824 Jul 19 22:45:16.245835 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1907/3829] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:14 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1521 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:16.251403 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c61b605d-27e4-4c67-a1eb-746a46d04eee tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:16.252341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c61b605d-27e4-4c67-a1eb-746a46d04eee tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:16.265280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c61b605d-27e4-4c67-a1eb-746a46d04eee tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:16.266428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c61b605d-27e4-4c67-a1eb-746a46d04eee tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:16.267971 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c61b605d-27e4-4c67-a1eb-746a46d04eee tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:16.270214 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c61b605d-27e4-4c67-a1eb-746a46d04eee tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:17.427437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-65107df0-27e1-453d-897a-90227be6658c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:17.463218 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-65107df0-27e1-453d-897a-90227be6658c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4" status: 200 len: 1309 microversion: 2.1 time: 1.605506 Jul 19 22:45:17.466842 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1923/3830] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:15 2022] GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 => generated 1309 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:17.484182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a80a8ec8-1515-4000-a123-18b5aeb08b2a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:17.485433 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a80a8ec8-1515-4000-a123-18b5aeb08b2a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:17.501615 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a80a8ec8-1515-4000-a123-18b5aeb08b2a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:17.502815 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a80a8ec8-1515-4000-a123-18b5aeb08b2a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:17.505037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a80a8ec8-1515-4000-a123-18b5aeb08b2a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:17.506283 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a80a8ec8-1515-4000-a123-18b5aeb08b2a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:17.664320 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c61b605d-27e4-4c67-a1eb-746a46d04eee tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:17.725163 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c61b605d-27e4-4c67-a1eb-746a46d04eee tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9" status: 200 len: 1315 microversion: 2.1 time: 1.474534 Jul 19 22:45:17.751267 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1908/3831] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:16 2022] GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 => generated 1315 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:17.793960 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1d8728a8-ad8d-4615-9ce9-46279d7cf0da tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:17.800063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1d8728a8-ad8d-4615-9ce9-46279d7cf0da tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:17.812720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d8728a8-ad8d-4615-9ce9-46279d7cf0da tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:17.813387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d8728a8-ad8d-4615-9ce9-46279d7cf0da tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:17.814423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d8728a8-ad8d-4615-9ce9-46279d7cf0da tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:17.815144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d8728a8-ad8d-4615-9ce9-46279d7cf0da tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:17.830254 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:45:18.572285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a80a8ec8-1515-4000-a123-18b5aeb08b2a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:18.585782 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a80a8ec8-1515-4000-a123-18b5aeb08b2a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:18.587481 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a80a8ec8-1515-4000-a123-18b5aeb08b2a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:18.590412 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a80a8ec8-1515-4000-a123-18b5aeb08b2a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 1.121695 Jul 19 22:45:18.591506 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1924/3832] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:17 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:45:18.596915 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-20fbd676-ae6b-4153-b3e4-a3c64de1be1e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:18.597202 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-20fbd676-ae6b-4153-b3e4-a3c64de1be1e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: c56a1af0-7bb0-42ee-8139-fe6c8a6772d4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:18.614869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-20fbd676-ae6b-4153-b3e4-a3c64de1be1e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:18.615624 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-20fbd676-ae6b-4153-b3e4-a3c64de1be1e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:18.616702 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-20fbd676-ae6b-4153-b3e4-a3c64de1be1e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:18.617384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-20fbd676-ae6b-4153-b3e4-a3c64de1be1e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:18.865171 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1d8728a8-ad8d-4615-9ce9-46279d7cf0da tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:18.877856 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1d8728a8-ad8d-4615-9ce9-46279d7cf0da tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1521 microversion: 2.1 time: 1.124010 Jul 19 22:45:18.896795 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1909/3833] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:17 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1521 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:18.919799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f2ec67ab-0dcc-4278-bab7-cf2375eb9ff9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:18.920498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f2ec67ab-0dcc-4278-bab7-cf2375eb9ff9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:18.953778 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f2ec67ab-0dcc-4278-bab7-cf2375eb9ff9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:18.954544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f2ec67ab-0dcc-4278-bab7-cf2375eb9ff9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:18.955765 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f2ec67ab-0dcc-4278-bab7-cf2375eb9ff9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:18.956230 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f2ec67ab-0dcc-4278-bab7-cf2375eb9ff9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:19.473493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:45:19.518735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:45:19.839429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f2ec67ab-0dcc-4278-bab7-cf2375eb9ff9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:19.858655 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f2ec67ab-0dcc-4278-bab7-cf2375eb9ff9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9" status: 200 len: 1315 microversion: 2.1 time: 0.960077 Jul 19 22:45:19.860398 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1910/3834] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:18 2022] GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 => generated 1315 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:19.869248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f20883b2-4872-4e92-bd55-cf7f5a6f8b5f tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:19.880097 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f20883b2-4872-4e92-bd55-cf7f5a6f8b5f tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:19.902613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f20883b2-4872-4e92-bd55-cf7f5a6f8b5f tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:19.903927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f20883b2-4872-4e92-bd55-cf7f5a6f8b5f tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:19.906378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f20883b2-4872-4e92-bd55-cf7f5a6f8b5f tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:19.907731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f20883b2-4872-4e92-bd55-cf7f5a6f8b5f tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:20.139562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-20fbd676-ae6b-4153-b3e4-a3c64de1be1e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:20.190269 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-20fbd676-ae6b-4153-b3e4-a3c64de1be1e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4" status: 200 len: 1309 microversion: 2.1 time: 1.597525 Jul 19 22:45:20.199502 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1925/3835] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:18 2022] GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 => generated 1309 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:20.216021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fc957d22-812c-4a6d-9733-af900037d26c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:20.217613 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fc957d22-812c-4a6d-9733-af900037d26c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:20.241060 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc957d22-812c-4a6d-9733-af900037d26c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:20.241531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc957d22-812c-4a6d-9733-af900037d26c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:20.242335 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc957d22-812c-4a6d-9733-af900037d26c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:20.242783 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc957d22-812c-4a6d-9733-af900037d26c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:21.036211 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fc957d22-812c-4a6d-9733-af900037d26c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:21.050405 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fc957d22-812c-4a6d-9733-af900037d26c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1521 microversion: 2.1 time: 0.847627 Jul 19 22:45:21.054444 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1926/3836] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:20 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1521 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:21.066259 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-72441ec5-2cfd-4021-aad7-9cb315c80a50 req-235df419-a857-4f5f-8414-fb5d66e36723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d53ca5c-aaa1-44f3-832d-7f2a9a56db39", "name": "network-vif-plugged", "status": "completed", "tag": "aaebb168-a0dc-4323-91f4-47daf8a94255"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:21.079093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-72441ec5-2cfd-4021-aad7-9cb315c80a50 req-235df419-a857-4f5f-8414-fb5d66e36723 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:21.081270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-72441ec5-2cfd-4021-aad7-9cb315c80a50 req-235df419-a857-4f5f-8414-fb5d66e36723 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:21.105380 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f20883b2-4872-4e92-bd55-cf7f5a6f8b5f tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:21.122962 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-72441ec5-2cfd-4021-aad7-9cb315c80a50 req-235df419-a857-4f5f-8414-fb5d66e36723 service nova] Creating event network-vif-plugged:aaebb168-a0dc-4323-91f4-47daf8a94255 for instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 on n-h2-847009-3 Jul 19 22:45:21.130971 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-72441ec5-2cfd-4021-aad7-9cb315c80a50 req-235df419-a857-4f5f-8414-fb5d66e36723 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071202 Jul 19 22:45:21.132521 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1927/3837] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:45:21.134939 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f20883b2-4872-4e92-bd55-cf7f5a6f8b5f tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:21.142044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7df39867-bf56-4ca9-b2a1-ce61e19296d7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:21.144317 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7df39867-bf56-4ca9-b2a1-ce61e19296d7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:21.148039 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f20883b2-4872-4e92-bd55-cf7f5a6f8b5f tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:21.149253 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f20883b2-4872-4e92-bd55-cf7f5a6f8b5f tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 1.287539 Jul 19 22:45:21.164799 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1911/3838] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:19 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:45:21.169931 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7df39867-bf56-4ca9-b2a1-ce61e19296d7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:21.170700 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7df39867-bf56-4ca9-b2a1-ce61e19296d7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:21.172041 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7df39867-bf56-4ca9-b2a1-ce61e19296d7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:21.172784 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7df39867-bf56-4ca9-b2a1-ce61e19296d7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:21.401026 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ca238087-c0d2-4c1f-b81e-86c3279b6069 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-259862968", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "20313de5-aba2-4985-9fdc-6bd24a889585"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:21.515888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-ca238087-c0d2-4c1f-b81e-86c3279b6069 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] validate_networks() for [('20313de5-aba2-4985-9fdc-6bd24a889585', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:45:22.262628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7df39867-bf56-4ca9-b2a1-ce61e19296d7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:22.266939 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:45:22.277268 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7df39867-bf56-4ca9-b2a1-ce61e19296d7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9" status: 200 len: 1315 microversion: 2.1 time: 1.142772 Jul 19 22:45:22.281604 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1928/3839] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:21 2022] GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 => generated 1315 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:22.290718 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-add86493-969b-4eb0-96f5-3c7a70981475 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:22.293006 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-add86493-969b-4eb0-96f5-3c7a70981475 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: c56a1af0-7bb0-42ee-8139-fe6c8a6772d4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:22.319080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-add86493-969b-4eb0-96f5-3c7a70981475 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:22.319696 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-add86493-969b-4eb0-96f5-3c7a70981475 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:22.320385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-add86493-969b-4eb0-96f5-3c7a70981475 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:22.320828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-add86493-969b-4eb0-96f5-3c7a70981475 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:23.028247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-add86493-969b-4eb0-96f5-3c7a70981475 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:23.037257 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-add86493-969b-4eb0-96f5-3c7a70981475 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4" status: 200 len: 1309 microversion: 2.1 time: 0.754433 Jul 19 22:45:23.038409 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1929/3840] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:22 2022] GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 => generated 1309 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:23.043670 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-be241d4c-e716-4b60-84f9-548858e66a9d req-bd3a4b77-438c-4460-8089-d3ebd66b320b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c56a1af0-7bb0-42ee-8139-fe6c8a6772d4", "tag": "224bb08e-b075-408c-a321-08e3a3214b21"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:23.053336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-be241d4c-e716-4b60-84f9-548858e66a9d req-bd3a4b77-438c-4460-8089-d3ebd66b320b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:23.054246 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-be241d4c-e716-4b60-84f9-548858e66a9d req-bd3a4b77-438c-4460-8089-d3ebd66b320b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:23.070330 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-be241d4c-e716-4b60-84f9-548858e66a9d req-bd3a4b77-438c-4460-8089-d3ebd66b320b service nova] Creating event network-changed:224bb08e-b075-408c-a321-08e3a3214b21 for instance c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 on n-h1-847009-3 Jul 19 22:45:23.076943 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-be241d4c-e716-4b60-84f9-548858e66a9d req-bd3a4b77-438c-4460-8089-d3ebd66b320b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036788 Jul 19 22:45:23.078805 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1930/3841] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:45:23.084582 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-105ac2d5-947b-4a59-a8e8-f584270cd9dc tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:23.085295 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-105ac2d5-947b-4a59-a8e8-f584270cd9dc tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:23.092313 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-105ac2d5-947b-4a59-a8e8-f584270cd9dc tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:23.092767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-105ac2d5-947b-4a59-a8e8-f584270cd9dc tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:23.093839 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-105ac2d5-947b-4a59-a8e8-f584270cd9dc tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:23.094384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-105ac2d5-947b-4a59-a8e8-f584270cd9dc tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:23.653963 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-105ac2d5-947b-4a59-a8e8-f584270cd9dc tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:23.666096 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-105ac2d5-947b-4a59-a8e8-f584270cd9dc tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1521 microversion: 2.1 time: 0.584851 Jul 19 22:45:23.667881 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1931/3842] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:23 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1521 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:23.684207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-60fefac5-1983-4862-8535-e80f7453a503 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:23.690738 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-60fefac5-1983-4862-8535-e80f7453a503 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:23.713799 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-60fefac5-1983-4862-8535-e80f7453a503 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:23.714374 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-60fefac5-1983-4862-8535-e80f7453a503 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:23.715366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-60fefac5-1983-4862-8535-e80f7453a503 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:23.716599 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-60fefac5-1983-4862-8535-e80f7453a503 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:24.032294 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ca238087-c0d2-4c1f-b81e-86c3279b6069 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:45:24.033146 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ca238087-c0d2-4c1f-b81e-86c3279b6069 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:45:24.033346 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ca238087-c0d2-4c1f-b81e-86c3279b6069 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:45:24.034750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ca238087-c0d2-4c1f-b81e-86c3279b6069 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:45:24.034750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ca238087-c0d2-4c1f-b81e-86c3279b6069 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:45:24.057000 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca238087-c0d2-4c1f-b81e-86c3279b6069 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:24.057927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca238087-c0d2-4c1f-b81e-86c3279b6069 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:24.059248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca238087-c0d2-4c1f-b81e-86c3279b6069 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:24.059943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca238087-c0d2-4c1f-b81e-86c3279b6069 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:24.107721 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-ca238087-c0d2-4c1f-b81e-86c3279b6069 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Getting quotas for project 0b9aab7959b743ff94c2c4ae6763af59. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:45:24.122029 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-60fefac5-1983-4862-8535-e80f7453a503 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:24.124294 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-ca238087-c0d2-4c1f-b81e-86c3279b6069 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Getting quotas for user c09dae6c907d4e7486db30d59b29b0a5 and project 0b9aab7959b743ff94c2c4ae6763af59. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:45:24.134231 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-60fefac5-1983-4862-8535-e80f7453a503 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:24.142767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-60fefac5-1983-4862-8535-e80f7453a503 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:24.144393 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-60fefac5-1983-4862-8535-e80f7453a503 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 0.468491 Jul 19 22:45:24.147247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ca238087-c0d2-4c1f-b81e-86c3279b6069 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:45:24.148366 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1932/3843] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:23 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:45:24.150853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ca238087-c0d2-4c1f-b81e-86c3279b6069 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] [instance: aced12b1-4b92-495f-9a54-9df7e990b05c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:45:24.165230 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-c48d6092-076c-4406-9761-468905ea2dfc req-096dacbe-f162-4b78-9b28-1d2e7c2e2678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d53ca5c-aaa1-44f3-832d-7f2a9a56db39", "name": "network-vif-plugged", "status": "completed", "tag": "98a30d5e-ad65-436d-96ad-23f81ba2c4be"}, {"server_uuid": "7d53ca5c-aaa1-44f3-832d-7f2a9a56db39", "name": "network-vif-plugged", "status": "completed", "tag": "c237ae7f-dc1c-4392-aa4a-f5d505a41de6"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:24.181346 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c48d6092-076c-4406-9761-468905ea2dfc req-096dacbe-f162-4b78-9b28-1d2e7c2e2678 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:24.182464 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c48d6092-076c-4406-9761-468905ea2dfc req-096dacbe-f162-4b78-9b28-1d2e7c2e2678 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:24.198213 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-c48d6092-076c-4406-9761-468905ea2dfc req-096dacbe-f162-4b78-9b28-1d2e7c2e2678 service nova] Creating event network-vif-plugged:98a30d5e-ad65-436d-96ad-23f81ba2c4be for instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 on n-h2-847009-3 Jul 19 22:45:24.199138 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-c48d6092-076c-4406-9761-468905ea2dfc req-096dacbe-f162-4b78-9b28-1d2e7c2e2678 service nova] Creating event network-vif-plugged:c237ae7f-dc1c-4392-aa4a-f5d505a41de6 for instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 on n-h2-847009-3 Jul 19 22:45:24.207515 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-c48d6092-076c-4406-9761-468905ea2dfc req-096dacbe-f162-4b78-9b28-1d2e7c2e2678 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046872 Jul 19 22:45:24.209008 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1933/3844] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:45:24.215599 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-28cbf549-668d-4976-8059-990612c06432 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:24.216667 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-28cbf549-668d-4976-8059-990612c06432 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:24.225247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-28cbf549-668d-4976-8059-990612c06432 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:24.226217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-28cbf549-668d-4976-8059-990612c06432 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:24.227641 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-28cbf549-668d-4976-8059-990612c06432 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:24.228384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-28cbf549-668d-4976-8059-990612c06432 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:24.239078 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:45:24.292135 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ca238087-c0d2-4c1f-b81e-86c3279b6069 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.136565 Jul 19 22:45:24.292846 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1912/3845] 10.222.0.25 () {62 vars in 1187 bytes} [Tue Jul 19 22:45:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3138 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 22:45:24.297917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bc5ad8f4-246e-4c02-b3e7-296ea4cb97db tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:24.298794 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bc5ad8f4-246e-4c02-b3e7-296ea4cb97db tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: c56a1af0-7bb0-42ee-8139-fe6c8a6772d4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:24.321026 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc5ad8f4-246e-4c02-b3e7-296ea4cb97db tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:24.321788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc5ad8f4-246e-4c02-b3e7-296ea4cb97db tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:24.323661 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc5ad8f4-246e-4c02-b3e7-296ea4cb97db tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:24.324463 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bc5ad8f4-246e-4c02-b3e7-296ea4cb97db tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:25.749390 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-28cbf549-668d-4976-8059-990612c06432 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:25.758092 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-28cbf549-668d-4976-8059-990612c06432 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9" status: 200 len: 1315 microversion: 2.1 time: 1.547176 Jul 19 22:45:25.758710 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1934/3846] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:24 2022] GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 => generated 1315 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:25.805874 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ab59a498-7e56-46c0-9d04-17086bac62a0 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:25.806592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ab59a498-7e56-46c0-9d04-17086bac62a0 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] [instance: aced12b1-4b92-495f-9a54-9df7e990b05c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:25.828931 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab59a498-7e56-46c0-9d04-17086bac62a0 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:25.829453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab59a498-7e56-46c0-9d04-17086bac62a0 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:25.831156 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab59a498-7e56-46c0-9d04-17086bac62a0 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:25.837095 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab59a498-7e56-46c0-9d04-17086bac62a0 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:25.986142 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ab59a498-7e56-46c0-9d04-17086bac62a0 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:26.003562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ab59a498-7e56-46c0-9d04-17086bac62a0 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:26.006888 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ab59a498-7e56-46c0-9d04-17086bac62a0 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:26.016452 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ab59a498-7e56-46c0-9d04-17086bac62a0 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] 10.222.0.25 "GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c" status: 200 len: 1310 microversion: 2.21 time: 0.256580 Jul 19 22:45:26.019141 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1935/3847] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:25 2022] GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c => generated 1310 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:45:26.033182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-65b35093-d0da-4905-81ef-4e4b1f8d8f3c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:26.034411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-65b35093-d0da-4905-81ef-4e4b1f8d8f3c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:26.042739 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bc5ad8f4-246e-4c02-b3e7-296ea4cb97db tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:26.049475 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65b35093-d0da-4905-81ef-4e4b1f8d8f3c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:26.050288 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65b35093-d0da-4905-81ef-4e4b1f8d8f3c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:26.053590 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65b35093-d0da-4905-81ef-4e4b1f8d8f3c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:26.054270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65b35093-d0da-4905-81ef-4e4b1f8d8f3c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:26.072840 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bc5ad8f4-246e-4c02-b3e7-296ea4cb97db tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4" status: 200 len: 1309 microversion: 2.1 time: 1.766248 Jul 19 22:45:26.077068 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1913/3848] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:24 2022] GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 => generated 1309 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:26.095586 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-485659f4-c64e-45ce-89fe-fa74a81502f0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:26.096608 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-485659f4-c64e-45ce-89fe-fa74a81502f0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:26.116189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-485659f4-c64e-45ce-89fe-fa74a81502f0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:26.120913 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-485659f4-c64e-45ce-89fe-fa74a81502f0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:26.123319 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-485659f4-c64e-45ce-89fe-fa74a81502f0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:26.124487 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-485659f4-c64e-45ce-89fe-fa74a81502f0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:26.928871 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-65b35093-d0da-4905-81ef-4e4b1f8d8f3c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:26.937052 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-65b35093-d0da-4905-81ef-4e4b1f8d8f3c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1501 microversion: 2.1 time: 0.916700 Jul 19 22:45:26.941075 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1936/3849] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:26 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1501 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:26.964967 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-80a97c0b-377d-4037-971a-d9cd32339de1 req-fb0ad286-5cbc-4ad8-99a2-02a8ccca9f53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d53ca5c-aaa1-44f3-832d-7f2a9a56db39", "name": "network-vif-plugged", "status": "completed", "tag": "30578dff-afdd-4547-842d-9204f90d0883"}, {"server_uuid": "7d53ca5c-aaa1-44f3-832d-7f2a9a56db39", "name": "network-vif-plugged", "status": "completed", "tag": "0a907ea9-840e-4a11-a8f9-aa989d95ed73"}, {"server_uuid": "7d53ca5c-aaa1-44f3-832d-7f2a9a56db39", "name": "network-vif-plugged", "status": "completed", "tag": "27fff587-1a65-4e04-9a00-c3b15f8c23f1"}, {"server_uuid": "7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9", "name": "network-vif-plugged", "status": "completed", "tag": "b9484698-cfca-4fb0-a643-cbdc6e37402e"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:26.991995 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-80a97c0b-377d-4037-971a-d9cd32339de1 req-fb0ad286-5cbc-4ad8-99a2-02a8ccca9f53 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:26.997424 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-80a97c0b-377d-4037-971a-d9cd32339de1 req-fb0ad286-5cbc-4ad8-99a2-02a8ccca9f53 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:27.052720 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-80a97c0b-377d-4037-971a-d9cd32339de1 req-fb0ad286-5cbc-4ad8-99a2-02a8ccca9f53 service nova] Creating event network-vif-plugged:30578dff-afdd-4547-842d-9204f90d0883 for instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 on n-h2-847009-3 Jul 19 22:45:27.053272 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-80a97c0b-377d-4037-971a-d9cd32339de1 req-fb0ad286-5cbc-4ad8-99a2-02a8ccca9f53 service nova] Creating event network-vif-plugged:0a907ea9-840e-4a11-a8f9-aa989d95ed73 for instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 on n-h2-847009-3 Jul 19 22:45:27.053952 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-80a97c0b-377d-4037-971a-d9cd32339de1 req-fb0ad286-5cbc-4ad8-99a2-02a8ccca9f53 service nova] Creating event network-vif-plugged:27fff587-1a65-4e04-9a00-c3b15f8c23f1 for instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 on n-h2-847009-3 Jul 19 22:45:27.054287 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-80a97c0b-377d-4037-971a-d9cd32339de1 req-fb0ad286-5cbc-4ad8-99a2-02a8ccca9f53 service nova] Creating event network-vif-plugged:b9484698-cfca-4fb0-a643-cbdc6e37402e for instance 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 on n-h1-847009-3 Jul 19 22:45:27.080395 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-80a97c0b-377d-4037-971a-d9cd32339de1 req-fb0ad286-5cbc-4ad8-99a2-02a8ccca9f53 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.124444 Jul 19 22:45:27.081601 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1937/3850] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:45:27.089680 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1826de5f-764b-4eb9-9e09-f189479296cf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:27.090585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1826de5f-764b-4eb9-9e09-f189479296cf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:27.100926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-485659f4-c64e-45ce-89fe-fa74a81502f0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:27.111925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1826de5f-764b-4eb9-9e09-f189479296cf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:27.112706 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1826de5f-764b-4eb9-9e09-f189479296cf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:27.113806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1826de5f-764b-4eb9-9e09-f189479296cf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:27.114431 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1826de5f-764b-4eb9-9e09-f189479296cf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:27.135242 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-485659f4-c64e-45ce-89fe-fa74a81502f0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:27.140082 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-485659f4-c64e-45ce-89fe-fa74a81502f0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:27.141643 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-485659f4-c64e-45ce-89fe-fa74a81502f0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 1.063013 Jul 19 22:45:27.142750 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1914/3851] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:26 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:45:27.149718 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f1c2fe7b-1271-4d93-9362-28bb11eda638 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:27.151465 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f1c2fe7b-1271-4d93-9362-28bb11eda638 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:27.162527 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f1c2fe7b-1271-4d93-9362-28bb11eda638 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:27.163460 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f1c2fe7b-1271-4d93-9362-28bb11eda638 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:27.164570 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f1c2fe7b-1271-4d93-9362-28bb11eda638 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:27.165367 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f1c2fe7b-1271-4d93-9362-28bb11eda638 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:27.825617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f1c2fe7b-1271-4d93-9362-28bb11eda638 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:27.836347 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f1c2fe7b-1271-4d93-9362-28bb11eda638 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae" status: 200 len: 1516 microversion: 2.1 time: 0.692157 Jul 19 22:45:27.840602 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1915/3852] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:27 2022] GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae => generated 1516 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:27.859675 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5ba99ef4-938e-455b-9bc6-02dd01b39fdc tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:27.859840 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1826de5f-764b-4eb9-9e09-f189479296cf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:27.872663 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5ba99ef4-938e-455b-9bc6-02dd01b39fdc tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] [instance: aced12b1-4b92-495f-9a54-9df7e990b05c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:27.875862 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1826de5f-764b-4eb9-9e09-f189479296cf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9" status: 200 len: 1315 microversion: 2.1 time: 0.791619 Jul 19 22:45:27.879673 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1938/3853] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:27 2022] GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 => generated 1315 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:27.886768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ba99ef4-938e-455b-9bc6-02dd01b39fdc tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:27.890131 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ba99ef4-938e-455b-9bc6-02dd01b39fdc tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:27.891768 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5885f16d-22f6-4529-90de-d5ff8abdbe8c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:27.891914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ba99ef4-938e-455b-9bc6-02dd01b39fdc tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:27.892707 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5885f16d-22f6-4529-90de-d5ff8abdbe8c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: c56a1af0-7bb0-42ee-8139-fe6c8a6772d4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:27.899523 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ba99ef4-938e-455b-9bc6-02dd01b39fdc tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:27.918466 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5885f16d-22f6-4529-90de-d5ff8abdbe8c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:27.925536 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5885f16d-22f6-4529-90de-d5ff8abdbe8c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:27.929880 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5885f16d-22f6-4529-90de-d5ff8abdbe8c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:27.931071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5885f16d-22f6-4529-90de-d5ff8abdbe8c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:28.194532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5ba99ef4-938e-455b-9bc6-02dd01b39fdc tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:28.215976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5ba99ef4-938e-455b-9bc6-02dd01b39fdc tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:28.217873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5ba99ef4-938e-455b-9bc6-02dd01b39fdc tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:28.219086 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5ba99ef4-938e-455b-9bc6-02dd01b39fdc tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] 10.222.0.25 "GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c" status: 200 len: 1316 microversion: 2.21 time: 0.377138 Jul 19 22:45:28.230384 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1916/3854] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:27 2022] GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c => generated 1316 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:45:28.231784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7d48a6bc-cd04-408e-b4e2-aab6f3f4af4d tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:28.234166 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7d48a6bc-cd04-408e-b4e2-aab6f3f4af4d tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 1fbe2cc9-c09e-45b0-b790-4fed6d55dd5f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:28.250726 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-7d48a6bc-cd04-408e-b4e2-aab6f3f4af4d tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] HTTP exception thrown: Instance 1fbe2cc9-c09e-45b0-b790-4fed6d55dd5f could not be found. Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7d48a6bc-cd04-408e-b4e2-aab6f3f4af4d tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Request method failure captured: Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/1fbe2cc9-c09e-45b0-b790-4fed6d55dd5f/action HTTP/1.1 Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 14 Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zPB9pdZx5bGxAOx1bWrMM0FEhH4uLd_pSCvc_RNVR1Ml3e2RdxqyGOtd-lt2kxygYFNrKmFRc3yVX-y9hoY_QR39GzP2XOyLb00mNIcRNYPp_Z40PO_3EFeEpNqlZOyhEu-fa-kVbsARhW2vxsGD8FHWpMQupoNdZ8KLVFw7a76o8s Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 95469b549ae7425a83e0d93bb8c10860 Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1399962716 Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1399962716 Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 95469b549ae7425a83e0d93bb8c10860 Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1399962716 Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerRescueNegativeTestJSON-1399962716-project Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 5f92608789324ac48fef6ce87a745a07 Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1399962716-project Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: {"rescue": {}} Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 1fbe2cc9-c09e-45b0-b790-4fed6d55dd5f could not be found. Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '1fbe2cc9-c09e-45b0-b790-4fed6d55dd5f', 'body': {'rescue': {}}} Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fbe2cc9-c09e-45b0-b790-4fed6d55dd5f could not be found. Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fbe2cc9-c09e-45b0-b790-4fed6d55dd5f could not be found. Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:28.264579 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:28.274151 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:45:28.274151 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:45:28.274151 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:45:28.274151 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:45:28.274151 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fbe2cc9-c09e-45b0-b790-4fed6d55dd5f could not be found. Jul 19 22:45:28.274151 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:28.274151 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7d48a6bc-cd04-408e-b4e2-aab6f3f4af4d tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Returning 404 to user: Instance 1fbe2cc9-c09e-45b0-b790-4fed6d55dd5f could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:45:28.274151 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7d48a6bc-cd04-408e-b4e2-aab6f3f4af4d tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "POST /compute/v2.1/servers/1fbe2cc9-c09e-45b0-b790-4fed6d55dd5f/action" status: 404 len: 111 microversion: 2.1 time: 0.045143 Jul 19 22:45:28.274151 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1917/3855] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:45:28 2022] POST /compute/v2.1/servers/1fbe2cc9-c09e-45b0-b790-4fed6d55dd5f/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:45:28.279624 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f5fe1145-631f-46a6-a76b-3ec763c43672 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:28.280259 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f5fe1145-631f-46a6-a76b-3ec763c43672 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:28.299076 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f5fe1145-631f-46a6-a76b-3ec763c43672 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:28.299579 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f5fe1145-631f-46a6-a76b-3ec763c43672 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:28.300385 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f5fe1145-631f-46a6-a76b-3ec763c43672 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:28.301367 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f5fe1145-631f-46a6-a76b-3ec763c43672 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:28.551218 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5885f16d-22f6-4529-90de-d5ff8abdbe8c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:28.565539 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5885f16d-22f6-4529-90de-d5ff8abdbe8c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4" status: 200 len: 1309 microversion: 2.1 time: 0.684381 Jul 19 22:45:28.576003 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1939/3856] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:27 2022] GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 => generated 1309 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:28.591567 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-626225b7-6fb8-4291-80c7-c385aaf1c9c5 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:28.592454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-626225b7-6fb8-4291-80c7-c385aaf1c9c5 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:28.600697 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-626225b7-6fb8-4291-80c7-c385aaf1c9c5 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:28.611995 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-626225b7-6fb8-4291-80c7-c385aaf1c9c5 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:28.613235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-626225b7-6fb8-4291-80c7-c385aaf1c9c5 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:28.613868 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-626225b7-6fb8-4291-80c7-c385aaf1c9c5 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:28.802723 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-626225b7-6fb8-4291-80c7-c385aaf1c9c5 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "POST /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae/action" status: 202 len: 0 microversion: 2.1 time: 0.219396 Jul 19 22:45:28.805830 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1940/3857] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:45:28 2022] POST /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:45:28.821622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8ffcff05-157a-4886-9f1f-c3de612905d4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:28.826630 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8ffcff05-157a-4886-9f1f-c3de612905d4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:28.844712 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ffcff05-157a-4886-9f1f-c3de612905d4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:28.846086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ffcff05-157a-4886-9f1f-c3de612905d4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:28.848390 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ffcff05-157a-4886-9f1f-c3de612905d4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:28.849662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ffcff05-157a-4886-9f1f-c3de612905d4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:29.323026 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f5fe1145-631f-46a6-a76b-3ec763c43672 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:29.333704 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f5fe1145-631f-46a6-a76b-3ec763c43672 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:29.349178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f5fe1145-631f-46a6-a76b-3ec763c43672 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:29.350721 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f5fe1145-631f-46a6-a76b-3ec763c43672 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 1.075503 Jul 19 22:45:29.351827 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1918/3858] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:28 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:45:29.356881 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-88b22de2-3943-49df-9a78-bf419af2e173 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:29.357871 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-88b22de2-3943-49df-9a78-bf419af2e173 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:29.374727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88b22de2-3943-49df-9a78-bf419af2e173 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:29.383819 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88b22de2-3943-49df-9a78-bf419af2e173 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:29.384794 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88b22de2-3943-49df-9a78-bf419af2e173 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:29.385321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88b22de2-3943-49df-9a78-bf419af2e173 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:29.605145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8ffcff05-157a-4886-9f1f-c3de612905d4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:29.629890 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8ffcff05-157a-4886-9f1f-c3de612905d4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae" status: 200 len: 1521 microversion: 2.1 time: 0.817069 Jul 19 22:45:29.633263 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1941/3859] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:28 2022] GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae => generated 1521 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:29.643474 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-decc39a6-85e2-4caf-9ee6-e463f8af8b9e tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:29.645628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-decc39a6-85e2-4caf-9ee6-e463f8af8b9e tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] [instance: aced12b1-4b92-495f-9a54-9df7e990b05c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:29.665403 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-decc39a6-85e2-4caf-9ee6-e463f8af8b9e tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:29.666024 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-decc39a6-85e2-4caf-9ee6-e463f8af8b9e tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:29.667692 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-decc39a6-85e2-4caf-9ee6-e463f8af8b9e tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:29.668421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-decc39a6-85e2-4caf-9ee6-e463f8af8b9e tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:30.112701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-88b22de2-3943-49df-9a78-bf419af2e173 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:30.130337 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-88b22de2-3943-49df-9a78-bf419af2e173 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9" status: 200 len: 1502 microversion: 2.1 time: 0.777251 Jul 19 22:45:30.148625 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1919/3860] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:29 2022] GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 => generated 1502 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:30.340639 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-decc39a6-85e2-4caf-9ee6-e463f8af8b9e tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:30.362144 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-decc39a6-85e2-4caf-9ee6-e463f8af8b9e tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:30.373155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-decc39a6-85e2-4caf-9ee6-e463f8af8b9e tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:30.375594 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-decc39a6-85e2-4caf-9ee6-e463f8af8b9e tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] 10.222.0.25 "GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c" status: 200 len: 1358 microversion: 2.21 time: 0.739974 Jul 19 22:45:30.380802 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1942/3861] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:29 2022] GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c => generated 1358 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:45:30.399101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-d7042642-34ac-4564-9182-69b566ed77fb req-ba30d84d-42d6-452f-858c-c48e442d036b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d53ca5c-aaa1-44f3-832d-7f2a9a56db39", "name": "network-vif-plugged", "status": "completed", "tag": "504225f7-9cee-4c36-9a1d-bb80c366dfae"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:30.414088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5113570c-09af-4d89-ae7a-b14940e3a18e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:30.416677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5113570c-09af-4d89-ae7a-b14940e3a18e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: c56a1af0-7bb0-42ee-8139-fe6c8a6772d4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:30.419081 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:45:30.429959 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d7042642-34ac-4564-9182-69b566ed77fb req-ba30d84d-42d6-452f-858c-c48e442d036b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:30.430621 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d7042642-34ac-4564-9182-69b566ed77fb req-ba30d84d-42d6-452f-858c-c48e442d036b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:30.433584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5113570c-09af-4d89-ae7a-b14940e3a18e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:30.434494 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5113570c-09af-4d89-ae7a-b14940e3a18e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:30.435507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5113570c-09af-4d89-ae7a-b14940e3a18e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:30.436045 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5113570c-09af-4d89-ae7a-b14940e3a18e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:30.470104 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-d7042642-34ac-4564-9182-69b566ed77fb req-ba30d84d-42d6-452f-858c-c48e442d036b service nova] Creating event network-vif-plugged:504225f7-9cee-4c36-9a1d-bb80c366dfae for instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 on n-h2-847009-3 Jul 19 22:45:30.479468 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-d7042642-34ac-4564-9182-69b566ed77fb req-ba30d84d-42d6-452f-858c-c48e442d036b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.328355 Jul 19 22:45:30.486465 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1920/3862] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:45:30.493252 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7f362c2f-7822-4dac-9863-98f429f1c266 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:30.494239 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7f362c2f-7822-4dac-9863-98f429f1c266 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:30.503588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7f362c2f-7822-4dac-9863-98f429f1c266 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:30.504462 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7f362c2f-7822-4dac-9863-98f429f1c266 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:30.506139 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7f362c2f-7822-4dac-9863-98f429f1c266 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:30.506766 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7f362c2f-7822-4dac-9863-98f429f1c266 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:31.463650 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.network.security_group_api [None req-7f362c2f-7822-4dac-9863-98f429f1c266 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Removing security group 08ed9780-647e-4333-9a73-56839a1f07ca from port b9484698-cfca-4fb0-a643-cbdc6e37402e Jul 19 22:45:31.570783 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5113570c-09af-4d89-ae7a-b14940e3a18e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:31.581499 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5113570c-09af-4d89-ae7a-b14940e3a18e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4" status: 200 len: 1309 microversion: 2.1 time: 1.199194 Jul 19 22:45:31.593022 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1943/3863] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:30 2022] GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 => generated 1309 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:31.598449 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5428a02f-368f-48b2-84d5-20b590b25a17 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:31.599449 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5428a02f-368f-48b2-84d5-20b590b25a17 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:31.606806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5428a02f-368f-48b2-84d5-20b590b25a17 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:31.607523 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5428a02f-368f-48b2-84d5-20b590b25a17 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:31.608524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5428a02f-368f-48b2-84d5-20b590b25a17 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:31.610165 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5428a02f-368f-48b2-84d5-20b590b25a17 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:32.189547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5428a02f-368f-48b2-84d5-20b590b25a17 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:32.203054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5428a02f-368f-48b2-84d5-20b590b25a17 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:32.213149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5428a02f-368f-48b2-84d5-20b590b25a17 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:32.214678 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5428a02f-368f-48b2-84d5-20b590b25a17 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1879 microversion: 2.42 time: 0.620350 Jul 19 22:45:32.215892 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1944/3864] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:31 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1879 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:45:32.231308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d39e1e15-37cc-4067-8c78-2e7fb053d823 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:32.232217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d39e1e15-37cc-4067-8c78-2e7fb053d823 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:32.248625 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d39e1e15-37cc-4067-8c78-2e7fb053d823 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:32.249083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d39e1e15-37cc-4067-8c78-2e7fb053d823 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:32.250180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d39e1e15-37cc-4067-8c78-2e7fb053d823 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:32.250804 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d39e1e15-37cc-4067-8c78-2e7fb053d823 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:33.058341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d39e1e15-37cc-4067-8c78-2e7fb053d823 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:33.091977 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7f362c2f-7822-4dac-9863-98f429f1c266 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9/action" status: 202 len: 0 microversion: 2.1 time: 2.603403 Jul 19 22:45:33.093085 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1921/3865] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:45:30 2022] POST /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9/action => generated 0 bytes in 2606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:45:33.107601 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d39e1e15-37cc-4067-8c78-2e7fb053d823 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae" status: 200 len: 1501 microversion: 2.1 time: 0.890359 Jul 19 22:45:33.108840 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-aa58346e-a39b-4a05-a6ca-6b3f668316e9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:33.109894 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-aa58346e-a39b-4a05-a6ca-6b3f668316e9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] [instance: aced12b1-4b92-495f-9a54-9df7e990b05c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:33.111589 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1945/3866] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:32 2022] GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae => generated 1501 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:33.117601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-de91e6ad-e8c0-4ec1-9153-d33a125d3d36 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:33.127535 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa58346e-a39b-4a05-a6ca-6b3f668316e9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:33.136208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-de91e6ad-e8c0-4ec1-9153-d33a125d3d36 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: c56a1af0-7bb0-42ee-8139-fe6c8a6772d4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:33.137252 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa58346e-a39b-4a05-a6ca-6b3f668316e9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:33.140859 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa58346e-a39b-4a05-a6ca-6b3f668316e9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:33.141569 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa58346e-a39b-4a05-a6ca-6b3f668316e9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:33.158382 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de91e6ad-e8c0-4ec1-9153-d33a125d3d36 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:33.159197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de91e6ad-e8c0-4ec1-9153-d33a125d3d36 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:33.162716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de91e6ad-e8c0-4ec1-9153-d33a125d3d36 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:33.163405 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de91e6ad-e8c0-4ec1-9153-d33a125d3d36 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:33.209942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:45:34.074246 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-aa58346e-a39b-4a05-a6ca-6b3f668316e9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:34.096148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-de91e6ad-e8c0-4ec1-9153-d33a125d3d36 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:34.104287 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:45:34.122198 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-de91e6ad-e8c0-4ec1-9153-d33a125d3d36 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4" status: 200 len: 1309 microversion: 2.1 time: 1.008732 Jul 19 22:45:34.124394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-aa58346e-a39b-4a05-a6ca-6b3f668316e9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:34.137373 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1946/3867] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:33 2022] GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 => generated 1309 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:34.140709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-aa58346e-a39b-4a05-a6ca-6b3f668316e9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:34.143401 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-aa58346e-a39b-4a05-a6ca-6b3f668316e9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] 10.222.0.25 "GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c" status: 200 len: 1358 microversion: 2.21 time: 1.048347 Jul 19 22:45:34.149233 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1922/3868] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:33 2022] GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c => generated 1358 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:45:34.158499 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-e108e987-fb50-4e38-85ac-87bfe9c4f020 req-f917b4b3-81b9-4ab6-8783-27796e781776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56a1af0-7bb0-42ee-8139-fe6c8a6772d4", "name": "network-vif-plugged", "status": "completed", "tag": "224bb08e-b075-408c-a321-08e3a3214b21"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:34.170765 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-758c0eb6-9dc3-4cc2-a462-247f392148e3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:34.173902 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-758c0eb6-9dc3-4cc2-a462-247f392148e3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:34.183409 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e108e987-fb50-4e38-85ac-87bfe9c4f020 req-f917b4b3-81b9-4ab6-8783-27796e781776 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:34.184133 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e108e987-fb50-4e38-85ac-87bfe9c4f020 req-f917b4b3-81b9-4ab6-8783-27796e781776 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:34.186087 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:45:34.196199 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-758c0eb6-9dc3-4cc2-a462-247f392148e3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:34.197017 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-758c0eb6-9dc3-4cc2-a462-247f392148e3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:34.197989 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-758c0eb6-9dc3-4cc2-a462-247f392148e3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:34.198608 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-758c0eb6-9dc3-4cc2-a462-247f392148e3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:34.203873 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-e108e987-fb50-4e38-85ac-87bfe9c4f020 req-f917b4b3-81b9-4ab6-8783-27796e781776 service nova] Creating event network-vif-plugged:224bb08e-b075-408c-a321-08e3a3214b21 for instance c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 on n-h1-847009-3 Jul 19 22:45:34.222603 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-e108e987-fb50-4e38-85ac-87bfe9c4f020 req-f917b4b3-81b9-4ab6-8783-27796e781776 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082948 Jul 19 22:45:34.223729 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1947/3869] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:45:34.228940 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-04d56b19-92cb-45a2-b411-99a2c3aedd5a req-bbf22461-b865-4261-9838-13441382dd39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9", "tag": "b9484698-cfca-4fb0-a643-cbdc6e37402e"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:34.255041 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-04d56b19-92cb-45a2-b411-99a2c3aedd5a req-bbf22461-b865-4261-9838-13441382dd39 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:34.265285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-04d56b19-92cb-45a2-b411-99a2c3aedd5a req-bbf22461-b865-4261-9838-13441382dd39 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:34.289323 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-04d56b19-92cb-45a2-b411-99a2c3aedd5a req-bbf22461-b865-4261-9838-13441382dd39 service nova] Creating event network-changed:b9484698-cfca-4fb0-a643-cbdc6e37402e for instance 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 on n-h1-847009-3 Jul 19 22:45:34.304997 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-04d56b19-92cb-45a2-b411-99a2c3aedd5a req-bbf22461-b865-4261-9838-13441382dd39 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077788 Jul 19 22:45:34.308973 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1948/3870] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:45:34.321155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e021f0f8-e02f-4a89-87db-db4249080151 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:34.330244 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e021f0f8-e02f-4a89-87db-db4249080151 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:34.352220 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e021f0f8-e02f-4a89-87db-db4249080151 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:34.352851 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e021f0f8-e02f-4a89-87db-db4249080151 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:34.353769 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e021f0f8-e02f-4a89-87db-db4249080151 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:34.354708 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e021f0f8-e02f-4a89-87db-db4249080151 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:34.407959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-e021f0f8-e02f-4a89-87db-db4249080151 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lazy-loading 'flavor' on Instance uuid 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:45:34.449018 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-e021f0f8-e02f-4a89-87db-db4249080151 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] HTTP exception thrown: Cannot 'rescue' instance 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae while it is in vm_state paused Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e021f0f8-e02f-4a89-87db-db4249080151 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Request method failure captured: Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae/action HTTP/1.1 Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 14 Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zPB9pdZx5bGxAOx1bWrMM0FEhH4uLd_pSCvc_RNVR1Ml3e2RdxqyGOtd-lt2kxygYFNrKmFRc3yVX-y9hoY_QR39GzP2XOyLb00mNIcRNYPp_Z40PO_3EFeEpNqlZOyhEu-fa-kVbsARhW2vxsGD8FHWpMQupoNdZ8KLVFw7a76o8s Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 95469b549ae7425a83e0d93bb8c10860 Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1399962716 Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1399962716 Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 95469b549ae7425a83e0d93bb8c10860 Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1399962716 Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerRescueNegativeTestJSON-1399962716-project Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 5f92608789324ac48fef6ce87a745a07 Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1399962716-project Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: {"rescue": {}} Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: exception: Cannot 'rescue' instance 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae while it is in vm_state paused Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '08ecb42e-a6ee-4f1e-976d-33e037bdd6ae', 'body': {'rescue': {}}} Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae in vm_state paused. Cannot rescue while the instance is in this state. Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae while it is in vm_state paused Jul 19 22:45:34.459268 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:34.464467 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:45:34.464467 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:34.464467 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:34.464467 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:45:34.464467 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:45:34.464467 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:45:34.464467 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:45:34.464467 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae while it is in vm_state paused Jul 19 22:45:34.464467 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:34.468876 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e021f0f8-e02f-4a89-87db-db4249080151 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Returning 409 to user: Cannot 'rescue' instance 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae while it is in vm_state paused {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:45:34.470319 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e021f0f8-e02f-4a89-87db-db4249080151 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "POST /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae/action" status: 409 len: 144 microversion: 2.1 time: 0.159323 Jul 19 22:45:34.471357 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1949/3871] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:45:34 2022] POST /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae/action => generated 144 bytes in 161 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:45:34.487158 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1167e868-bf7b-4e87-9a19-663bc23fe83c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:34.488155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1167e868-bf7b-4e87-9a19-663bc23fe83c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:34.501839 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1167e868-bf7b-4e87-9a19-663bc23fe83c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:34.503032 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1167e868-bf7b-4e87-9a19-663bc23fe83c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:34.506706 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1167e868-bf7b-4e87-9a19-663bc23fe83c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:34.507743 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-758c0eb6-9dc3-4cc2-a462-247f392148e3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:34.508501 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1167e868-bf7b-4e87-9a19-663bc23fe83c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:34.518255 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-758c0eb6-9dc3-4cc2-a462-247f392148e3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9" status: 200 len: 1460 microversion: 2.1 time: 0.367184 Jul 19 22:45:34.518857 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1923/3872] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:34 2022] GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 => generated 1460 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:34.534444 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5c97f85a-db15-40da-94a6-c0787f5e96e9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:34.536359 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5c97f85a-db15-40da-94a6-c0787f5e96e9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:34.559709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c97f85a-db15-40da-94a6-c0787f5e96e9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:34.560170 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c97f85a-db15-40da-94a6-c0787f5e96e9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:34.561741 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c97f85a-db15-40da-94a6-c0787f5e96e9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:34.562717 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c97f85a-db15-40da-94a6-c0787f5e96e9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:34.699186 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5c97f85a-db15-40da-94a6-c0787f5e96e9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "POST /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae/action" status: 202 len: 0 microversion: 2.1 time: 0.178083 Jul 19 22:45:34.712531 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1924/3873] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:45:34 2022] POST /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:45:34.734652 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9c82f911-7b61-4f69-aa7f-7832b1e2a84b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:34.736688 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9c82f911-7b61-4f69-aa7f-7832b1e2a84b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:34.756425 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9c82f911-7b61-4f69-aa7f-7832b1e2a84b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:34.756886 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9c82f911-7b61-4f69-aa7f-7832b1e2a84b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:34.757687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9c82f911-7b61-4f69-aa7f-7832b1e2a84b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:34.758135 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9c82f911-7b61-4f69-aa7f-7832b1e2a84b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:35.116422 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1167e868-bf7b-4e87-9a19-663bc23fe83c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:35.146156 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1167e868-bf7b-4e87-9a19-663bc23fe83c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:35.149057 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1167e868-bf7b-4e87-9a19-663bc23fe83c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:35.158215 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1167e868-bf7b-4e87-9a19-663bc23fe83c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 2835 microversion: 2.42 time: 0.681060 Jul 19 22:45:35.173064 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1950/3874] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:34 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 2835 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:45:35.194894 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a8a83015-75d7-4fc4-b6eb-d5464d0f19af tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:35.196826 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a8a83015-75d7-4fc4-b6eb-d5464d0f19af tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:35.217254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a8a83015-75d7-4fc4-b6eb-d5464d0f19af tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:35.220122 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a8a83015-75d7-4fc4-b6eb-d5464d0f19af tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:35.221109 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a8a83015-75d7-4fc4-b6eb-d5464d0f19af tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:35.221555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a8a83015-75d7-4fc4-b6eb-d5464d0f19af tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:35.283297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9c82f911-7b61-4f69-aa7f-7832b1e2a84b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:35.307066 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9c82f911-7b61-4f69-aa7f-7832b1e2a84b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.589639 Jul 19 22:45:35.311863 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1925/3875] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:34 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:35.339495 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6c222493-32bd-43ba-9ae6-28af8e5a9feb tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:35.340559 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6c222493-32bd-43ba-9ae6-28af8e5a9feb tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: c56a1af0-7bb0-42ee-8139-fe6c8a6772d4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:35.347947 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6c222493-32bd-43ba-9ae6-28af8e5a9feb tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:35.348647 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6c222493-32bd-43ba-9ae6-28af8e5a9feb tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:35.349593 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6c222493-32bd-43ba-9ae6-28af8e5a9feb tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:35.350668 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6c222493-32bd-43ba-9ae6-28af8e5a9feb tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:35.632910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6c222493-32bd-43ba-9ae6-28af8e5a9feb tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:35.648248 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6c222493-32bd-43ba-9ae6-28af8e5a9feb tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4" status: 200 len: 1309 microversion: 2.1 time: 0.333730 Jul 19 22:45:35.649086 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1926/3876] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:35 2022] GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 => generated 1309 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:35.656795 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e5f2dff9-5169-42f3-a8df-94500e9aa315 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:35.657434 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e5f2dff9-5169-42f3-a8df-94500e9aa315 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] [instance: aced12b1-4b92-495f-9a54-9df7e990b05c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:35.677581 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5f2dff9-5169-42f3-a8df-94500e9aa315 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:35.678048 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5f2dff9-5169-42f3-a8df-94500e9aa315 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:35.678854 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5f2dff9-5169-42f3-a8df-94500e9aa315 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:35.679336 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5f2dff9-5169-42f3-a8df-94500e9aa315 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:35.743696 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a8a83015-75d7-4fc4-b6eb-d5464d0f19af tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:35.751955 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a8a83015-75d7-4fc4-b6eb-d5464d0f19af tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae" status: 200 len: 1516 microversion: 2.1 time: 0.577395 Jul 19 22:45:35.752724 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1951/3877] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:35 2022] GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae => generated 1516 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:35.766283 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:45:35.784136 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2f42014c-2eb6-4c31-bd44-e731deb8ba93 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:35.785985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2f42014c-2eb6-4c31-bd44-e731deb8ba93 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:35.812859 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f42014c-2eb6-4c31-bd44-e731deb8ba93 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:35.813350 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f42014c-2eb6-4c31-bd44-e731deb8ba93 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:35.814313 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f42014c-2eb6-4c31-bd44-e731deb8ba93 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:35.814805 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f42014c-2eb6-4c31-bd44-e731deb8ba93 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:36.092663 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2f42014c-2eb6-4c31-bd44-e731deb8ba93 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.316160 Jul 19 22:45:36.104129 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1952/3878] 10.222.0.25 () {60 vars in 1315 bytes} [Tue Jul 19 22:45:35 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39/os-interface => generated 1829 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:45:36.114334 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-410364e2-4d23-4eb5-8522-2a59f037947f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:36.114989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-410364e2-4d23-4eb5-8522-2a59f037947f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:36.139739 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-410364e2-4d23-4eb5-8522-2a59f037947f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:36.140591 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-410364e2-4d23-4eb5-8522-2a59f037947f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:36.141890 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-410364e2-4d23-4eb5-8522-2a59f037947f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:36.142722 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-410364e2-4d23-4eb5-8522-2a59f037947f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:36.228862 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e5f2dff9-5169-42f3-a8df-94500e9aa315 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:36.249048 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e5f2dff9-5169-42f3-a8df-94500e9aa315 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:36.251344 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e5f2dff9-5169-42f3-a8df-94500e9aa315 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:36.258822 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e5f2dff9-5169-42f3-a8df-94500e9aa315 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] 10.222.0.25 "GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c" status: 200 len: 1358 microversion: 2.21 time: 0.607110 Jul 19 22:45:36.259526 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1927/3879] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:35 2022] GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c => generated 1358 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:45:36.343923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-17924dae-4368-4597-acc0-f4f17c38d097 req-a31d584e-8182-4e73-bb23-85392e145d79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aced12b1-4b92-495f-9a54-9df7e990b05c", "tag": "0d9ce212-23b2-4a5f-bb65-a0a3ea48b1a9"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:36.372735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-17924dae-4368-4597-acc0-f4f17c38d097 req-a31d584e-8182-4e73-bb23-85392e145d79 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:36.372735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-17924dae-4368-4597-acc0-f4f17c38d097 req-a31d584e-8182-4e73-bb23-85392e145d79 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:36.386511 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-410364e2-4d23-4eb5-8522-2a59f037947f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:36.396738 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-17924dae-4368-4597-acc0-f4f17c38d097 req-a31d584e-8182-4e73-bb23-85392e145d79 service nova] Creating event network-changed:0d9ce212-23b2-4a5f-bb65-a0a3ea48b1a9 for instance aced12b1-4b92-495f-9a54-9df7e990b05c on n-h1-847009-3 Jul 19 22:45:36.399913 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-410364e2-4d23-4eb5-8522-2a59f037947f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.294596 Jul 19 22:45:36.403782 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-17924dae-4368-4597-acc0-f4f17c38d097 req-a31d584e-8182-4e73-bb23-85392e145d79 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065136 Jul 19 22:45:36.405412 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1928/3880] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:45:36.416060 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1953/3881] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:36 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:36.423692 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bcd521e3-756b-4dbd-8cfc-7a779e844550 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:36.425965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bcd521e3-756b-4dbd-8cfc-7a779e844550 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:36.453272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bcd521e3-756b-4dbd-8cfc-7a779e844550 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:36.455641 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bcd521e3-756b-4dbd-8cfc-7a779e844550 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:36.457302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bcd521e3-756b-4dbd-8cfc-7a779e844550 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:36.463811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bcd521e3-756b-4dbd-8cfc-7a779e844550 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:36.669117 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7e336e51-c94d-4f23-8d53-3a7b1313145a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:36.670539 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7e336e51-c94d-4f23-8d53-3a7b1313145a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: c56a1af0-7bb0-42ee-8139-fe6c8a6772d4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:36.709266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e336e51-c94d-4f23-8d53-3a7b1313145a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:36.709883 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e336e51-c94d-4f23-8d53-3a7b1313145a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:36.711823 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e336e51-c94d-4f23-8d53-3a7b1313145a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:36.715404 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e336e51-c94d-4f23-8d53-3a7b1313145a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:37.038022 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bcd521e3-756b-4dbd-8cfc-7a779e844550 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:37.052484 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bcd521e3-756b-4dbd-8cfc-7a779e844550 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.634891 Jul 19 22:45:37.068103 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1929/3882] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:36 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:37.075715 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9b6b7527-a469-4536-9410-72c5c645815a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:37.076549 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9b6b7527-a469-4536-9410-72c5c645815a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:37.084349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b6b7527-a469-4536-9410-72c5c645815a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:37.085089 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b6b7527-a469-4536-9410-72c5c645815a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:37.086069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b6b7527-a469-4536-9410-72c5c645815a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:37.086682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b6b7527-a469-4536-9410-72c5c645815a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:37.200157 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7e336e51-c94d-4f23-8d53-3a7b1313145a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:37.209502 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7e336e51-c94d-4f23-8d53-3a7b1313145a tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4" status: 200 len: 1309 microversion: 2.1 time: 0.547843 Jul 19 22:45:37.215744 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1954/3883] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:36 2022] GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 => generated 1309 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:37.277393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-da8e1c03-cb7a-42e8-89c0-0207fba69c4a tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:37.278172 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-da8e1c03-cb7a-42e8-89c0-0207fba69c4a tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] [instance: aced12b1-4b92-495f-9a54-9df7e990b05c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:37.288906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da8e1c03-cb7a-42e8-89c0-0207fba69c4a tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:37.289374 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da8e1c03-cb7a-42e8-89c0-0207fba69c4a tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:37.290175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da8e1c03-cb7a-42e8-89c0-0207fba69c4a tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:37.290618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da8e1c03-cb7a-42e8-89c0-0207fba69c4a tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:38.267320 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9b6b7527-a469-4536-9410-72c5c645815a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:38.276076 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9b6b7527-a469-4536-9410-72c5c645815a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 1.206491 Jul 19 22:45:38.284607 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1930/3884] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:37 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:38.314945 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cd939861-cb4e-4fb4-97d4-f9be336a6258 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:38.318986 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cd939861-cb4e-4fb4-97d4-f9be336a6258 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: c56a1af0-7bb0-42ee-8139-fe6c8a6772d4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:38.342130 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-da8e1c03-cb7a-42e8-89c0-0207fba69c4a tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:38.364188 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd939861-cb4e-4fb4-97d4-f9be336a6258 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:38.366558 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-da8e1c03-cb7a-42e8-89c0-0207fba69c4a tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:38.369740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd939861-cb4e-4fb4-97d4-f9be336a6258 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:38.372405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd939861-cb4e-4fb4-97d4-f9be336a6258 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:38.376443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd939861-cb4e-4fb4-97d4-f9be336a6258 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:38.391935 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-da8e1c03-cb7a-42e8-89c0-0207fba69c4a tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:38.407831 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-da8e1c03-cb7a-42e8-89c0-0207fba69c4a tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] 10.222.0.25 "GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c" status: 200 len: 1358 microversion: 2.21 time: 1.134490 Jul 19 22:45:38.408545 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1955/3885] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:37 2022] GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c => generated 1358 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:45:38.571080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6e40b94d-d7b3-4137-8a2b-99cc322334ce tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1920122090", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "9e83a825-a2fd-461e-9b4f-f6a6a85fd752"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:38.713088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-6e40b94d-d7b3-4137-8a2b-99cc322334ce tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] validate_networks() for [('9e83a825-a2fd-461e-9b4f-f6a6a85fd752', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:45:39.086928 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cd939861-cb4e-4fb4-97d4-f9be336a6258 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:39.106739 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cd939861-cb4e-4fb4-97d4-f9be336a6258 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4" status: 200 len: 1489 microversion: 2.1 time: 0.801218 Jul 19 22:45:39.108488 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1931/3886] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:38 2022] GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 => generated 1489 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:39.138749 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-599ef31a-12e3-48d3-a3ab-5d1dd336e370 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:39.141002 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-599ef31a-12e3-48d3-a3ab-5d1dd336e370 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:39.152916 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-599ef31a-12e3-48d3-a3ab-5d1dd336e370 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:39.153852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-599ef31a-12e3-48d3-a3ab-5d1dd336e370 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:39.155166 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-599ef31a-12e3-48d3-a3ab-5d1dd336e370 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:39.155857 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-599ef31a-12e3-48d3-a3ab-5d1dd336e370 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:39.228725 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-599ef31a-12e3-48d3-a3ab-5d1dd336e370 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lazy-loading 'flavor' on Instance uuid 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:45:39.435875 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-599ef31a-12e3-48d3-a3ab-5d1dd336e370 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "POST /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae/action" status: 200 len: 32 microversion: 2.1 time: 0.325569 Jul 19 22:45:39.442697 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1932/3887] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:45:39 2022] POST /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae/action => generated 32 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:45:39.456393 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c233c905-34fd-4964-89e3-e9f612a994af tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:39.459054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c233c905-34fd-4964-89e3-e9f612a994af tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: c56a1af0-7bb0-42ee-8139-fe6c8a6772d4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:39.485776 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c233c905-34fd-4964-89e3-e9f612a994af tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:39.486792 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c233c905-34fd-4964-89e3-e9f612a994af tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:39.488563 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c233c905-34fd-4964-89e3-e9f612a994af tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:39.489416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c233c905-34fd-4964-89e3-e9f612a994af tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:39.621479 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c233c905-34fd-4964-89e3-e9f612a994af tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "PUT /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4" status: 200 len: 1084 microversion: 2.1 time: 0.176332 Jul 19 22:45:39.622143 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1933/3888] 10.222.0.25 () {60 vars in 1255 bytes} [Tue Jul 19 22:45:39 2022] PUT /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 => generated 1084 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:39.637456 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fe1bd0a6-355a-4fc0-8fb0-13ec27e767a9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:39.638638 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fe1bd0a6-355a-4fc0-8fb0-13ec27e767a9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] [instance: aced12b1-4b92-495f-9a54-9df7e990b05c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:39.648489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fe1bd0a6-355a-4fc0-8fb0-13ec27e767a9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:39.649268 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fe1bd0a6-355a-4fc0-8fb0-13ec27e767a9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:39.650229 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fe1bd0a6-355a-4fc0-8fb0-13ec27e767a9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:39.650834 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fe1bd0a6-355a-4fc0-8fb0-13ec27e767a9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:40.511296 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fe1bd0a6-355a-4fc0-8fb0-13ec27e767a9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:40.521809 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fe1bd0a6-355a-4fc0-8fb0-13ec27e767a9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:40.523396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fe1bd0a6-355a-4fc0-8fb0-13ec27e767a9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:40.524555 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fe1bd0a6-355a-4fc0-8fb0-13ec27e767a9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] 10.222.0.25 "GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c" status: 200 len: 1358 microversion: 2.21 time: 0.891726 Jul 19 22:45:40.525121 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1934/3889] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:39 2022] GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c => generated 1358 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:45:40.544215 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-40f27e64-4d1b-4c9c-b5e0-280f3593d422 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:40.547203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-40f27e64-4d1b-4c9c-b5e0-280f3593d422 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:40.557776 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-40f27e64-4d1b-4c9c-b5e0-280f3593d422 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:40.559852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-40f27e64-4d1b-4c9c-b5e0-280f3593d422 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:40.561999 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-40f27e64-4d1b-4c9c-b5e0-280f3593d422 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:40.564843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-40f27e64-4d1b-4c9c-b5e0-280f3593d422 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:41.152225 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-6e40b94d-d7b3-4137-8a2b-99cc322334ce tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:45:41.153205 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-6e40b94d-d7b3-4137-8a2b-99cc322334ce tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:45:41.154108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-6e40b94d-d7b3-4137-8a2b-99cc322334ce tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:45:41.154715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-6e40b94d-d7b3-4137-8a2b-99cc322334ce tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:45:41.155739 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-6e40b94d-d7b3-4137-8a2b-99cc322334ce tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:45:41.181597 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e40b94d-d7b3-4137-8a2b-99cc322334ce tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:41.182337 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e40b94d-d7b3-4137-8a2b-99cc322334ce tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:41.183442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e40b94d-d7b3-4137-8a2b-99cc322334ce tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:41.185899 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e40b94d-d7b3-4137-8a2b-99cc322334ce tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:41.242343 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-6e40b94d-d7b3-4137-8a2b-99cc322334ce tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Getting quotas for project 038e4783159e41e3b2cb88df1f8f4a97. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:45:41.254989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-6e40b94d-d7b3-4137-8a2b-99cc322334ce tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Getting quotas for user 1f2613ad65b047e8b9a68907406d1874 and project 038e4783159e41e3b2cb88df1f8f4a97. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:45:41.301753 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6e40b94d-d7b3-4137-8a2b-99cc322334ce tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:45:41.311807 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6e40b94d-d7b3-4137-8a2b-99cc322334ce tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:45:41.385630 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-40f27e64-4d1b-4c9c-b5e0-280f3593d422 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:41.399174 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-40f27e64-4d1b-4c9c-b5e0-280f3593d422 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae" status: 200 len: 1522 microversion: 2.1 time: 0.862201 Jul 19 22:45:41.404141 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1935/3890] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:40 2022] GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae => generated 1522 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:41.413120 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-08612c4c-5007-460f-be17-6a039898c755 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:41.418678 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-08612c4c-5007-460f-be17-6a039898c755 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: c56a1af0-7bb0-42ee-8139-fe6c8a6772d4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:41.433722 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08612c4c-5007-460f-be17-6a039898c755 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:41.434595 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08612c4c-5007-460f-be17-6a039898c755 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:41.435667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08612c4c-5007-460f-be17-6a039898c755 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:41.436641 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08612c4c-5007-460f-be17-6a039898c755 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:41.450537 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6e40b94d-d7b3-4137-8a2b-99cc322334ce tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.894610 Jul 19 22:45:41.451501 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1956/3891] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:45:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:45:41.840387 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b1295089-73b4-41c8-9e0a-fdd9e1845db4 tempest-ServerGroup264TestJSON-1114899540 tempest-ServerGroup264TestJSON-1114899540-project] Action: 'create', calling method: .version_select at 0x7f7a15571f70>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:41.852714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-08612c4c-5007-460f-be17-6a039898c755 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:41.866910 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-08612c4c-5007-460f-be17-6a039898c755 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4" status: 200 len: 1510 microversion: 2.1 time: 0.459838 Jul 19 22:45:41.866910 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1936/3892] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:41 2022] GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 => generated 1510 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:41.888535 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e9b0ce40-2cbd-4f8c-ace6-c8860375a8f1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:41.889159 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e9b0ce40-2cbd-4f8c-ace6-c8860375a8f1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:41.917563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-b1295089-73b4-41c8-9e0a-fdd9e1845db4 tempest-ServerGroup264TestJSON-1114899540 tempest-ServerGroup264TestJSON-1114899540-project] Getting quotas for project 6f1fa77cdf814f98ac73aeee7c6fbb71. Resources: {'server_groups'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:45:41.950623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-b1295089-73b4-41c8-9e0a-fdd9e1845db4 tempest-ServerGroup264TestJSON-1114899540 tempest-ServerGroup264TestJSON-1114899540-project] Getting quotas for user 7123f2a0817744998e1f108a63a93298 and project 6f1fa77cdf814f98ac73aeee7c6fbb71. Resources: {'server_groups'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:45:41.961583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e9b0ce40-2cbd-4f8c-ace6-c8860375a8f1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:41.972522 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e9b0ce40-2cbd-4f8c-ace6-c8860375a8f1 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1215 microversion: 2.1 time: 0.093830 Jul 19 22:45:41.974476 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1937/3893] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:41 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:41.984808 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b4b3779a-c255-4111-b266-472ef3a9ffb9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:41.991046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b4b3779a-c255-4111-b266-472ef3a9ffb9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] [instance: aced12b1-4b92-495f-9a54-9df7e990b05c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:42.002460 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b4b3779a-c255-4111-b266-472ef3a9ffb9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:42.003298 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b4b3779a-c255-4111-b266-472ef3a9ffb9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:42.006566 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b4b3779a-c255-4111-b266-472ef3a9ffb9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:42.007574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b4b3779a-c255-4111-b266-472ef3a9ffb9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:42.088558 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-b1295089-73b4-41c8-9e0a-fdd9e1845db4 tempest-ServerGroup264TestJSON-1114899540 tempest-ServerGroup264TestJSON-1114899540-project] Getting quotas for project 6f1fa77cdf814f98ac73aeee7c6fbb71. Resources: {'server_groups'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:45:42.107040 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-b1295089-73b4-41c8-9e0a-fdd9e1845db4 tempest-ServerGroup264TestJSON-1114899540 tempest-ServerGroup264TestJSON-1114899540-project] Getting quotas for user 7123f2a0817744998e1f108a63a93298 and project 6f1fa77cdf814f98ac73aeee7c6fbb71. Resources: {'server_groups'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:45:42.143029 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b1295089-73b4-41c8-9e0a-fdd9e1845db4 tempest-ServerGroup264TestJSON-1114899540 tempest-ServerGroup264TestJSON-1114899540-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.690330 Jul 19 22:45:42.144441 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1957/3894] 10.222.0.25 () {62 vars in 1213 bytes} [Tue Jul 19 22:45:41 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:45:42.157475 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e56a6fbd-9248-443e-bb8f-55bdda807b5f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:42.160268 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e56a6fbd-9248-443e-bb8f-55bdda807b5f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: c56a1af0-7bb0-42ee-8139-fe6c8a6772d4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:42.175989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e56a6fbd-9248-443e-bb8f-55bdda807b5f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:42.177356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e56a6fbd-9248-443e-bb8f-55bdda807b5f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:42.178652 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e56a6fbd-9248-443e-bb8f-55bdda807b5f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:42.179249 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e56a6fbd-9248-443e-bb8f-55bdda807b5f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:42.305269 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b4b3779a-c255-4111-b266-472ef3a9ffb9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:42.320331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b4b3779a-c255-4111-b266-472ef3a9ffb9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:42.323415 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b4b3779a-c255-4111-b266-472ef3a9ffb9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:42.324963 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b4b3779a-c255-4111-b266-472ef3a9ffb9 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] 10.222.0.25 "GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c" status: 200 len: 1358 microversion: 2.21 time: 0.347835 Jul 19 22:45:42.336556 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1938/3895] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:41 2022] GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c => generated 1358 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:45:42.347047 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-c674bbf4-59bc-405c-b581-85d051d08c93 req-e5a516ed-9fc7-44cc-a485-518101fd3721 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d53ca5c-aaa1-44f3-832d-7f2a9a56db39", "tag": "27fff587-1a65-4e04-9a00-c3b15f8c23f1"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:42.367881 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-c674bbf4-59bc-405c-b581-85d051d08c93 req-e5a516ed-9fc7-44cc-a485-518101fd3721 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:42.370783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-c674bbf4-59bc-405c-b581-85d051d08c93 req-e5a516ed-9fc7-44cc-a485-518101fd3721 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:42.411368 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-c674bbf4-59bc-405c-b581-85d051d08c93 req-e5a516ed-9fc7-44cc-a485-518101fd3721 service nova] Creating event network-changed:27fff587-1a65-4e04-9a00-c3b15f8c23f1 for instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 on n-h2-847009-3 Jul 19 22:45:42.429690 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-c674bbf4-59bc-405c-b581-85d051d08c93 req-e5a516ed-9fc7-44cc-a485-518101fd3721 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094932 Jul 19 22:45:42.430646 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1939/3896] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:45:42.448946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f42de985-f77c-44c9-89db-4e6b13cc4545 tempest-ServerGroup264TestJSON-1114899540 tempest-ServerGroup264TestJSON-1114899540-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:42.478633 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e56a6fbd-9248-443e-bb8f-55bdda807b5f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:42.480941 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f42de985-f77c-44c9-89db-4e6b13cc4545 tempest-ServerGroup264TestJSON-1114899540 tempest-ServerGroup264TestJSON-1114899540-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.045706 Jul 19 22:45:42.482109 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1940/3897] 10.222.0.25 () {60 vars in 1192 bytes} [Tue Jul 19 22:45:42 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:45:42.487073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3b07cf32-0374-40ef-9795-daa18c903dbb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:42.488550 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3b07cf32-0374-40ef-9795-daa18c903dbb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:42.493132 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e56a6fbd-9248-443e-bb8f-55bdda807b5f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4" status: 200 len: 1510 microversion: 2.1 time: 0.342528 Jul 19 22:45:42.494590 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1958/3898] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:42 2022] GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 => generated 1510 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:42.508119 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b07cf32-0374-40ef-9795-daa18c903dbb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:42.508566 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b07cf32-0374-40ef-9795-daa18c903dbb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:42.509598 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b07cf32-0374-40ef-9795-daa18c903dbb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:42.510131 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-289cf682-7f5d-411c-9fe4-b6663bc36b9a tempest-ServerGroup264TestJSON-1114899540 tempest-ServerGroup264TestJSON-1114899540-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:42.510407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b07cf32-0374-40ef-9795-daa18c903dbb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:42.528561 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-289cf682-7f5d-411c-9fe4-b6663bc36b9a tempest-ServerGroup264TestJSON-1114899540 tempest-ServerGroup264TestJSON-1114899540-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/9614f9db-b9ce-49d7-89b8-640258063c4a" status: 200 len: 235 microversion: 2.64 time: 0.031139 Jul 19 22:45:42.538143 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1959/3899] 10.222.0.25 () {60 vars in 1303 bytes} [Tue Jul 19 22:45:42 2022] GET /compute/v2.1/os-server-groups/9614f9db-b9ce-49d7-89b8-640258063c4a => generated 235 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:45:42.560843 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e208034f-febe-4cb3-bcb7-f33fa30ffa5c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:42.561857 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e208034f-febe-4cb3-bcb7-f33fa30ffa5c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: c56a1af0-7bb0-42ee-8139-fe6c8a6772d4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:42.576936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e208034f-febe-4cb3-bcb7-f33fa30ffa5c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:42.577680 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e208034f-febe-4cb3-bcb7-f33fa30ffa5c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:42.578689 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e208034f-febe-4cb3-bcb7-f33fa30ffa5c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:42.582832 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e208034f-febe-4cb3-bcb7-f33fa30ffa5c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:42.647877 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e208034f-febe-4cb3-bcb7-f33fa30ffa5c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: c56a1af0-7bb0-42ee-8139-fe6c8a6772d4] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:45:42.875909 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e208034f-febe-4cb3-bcb7-f33fa30ffa5c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4" status: 204 len: 0 microversion: 2.1 time: 0.331630 Jul 19 22:45:42.876483 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1960/3900] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:45:42 2022] DELETE /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:45:42.905806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-662c8aed-e473-4f2f-9ead-e350cff1ab41 tempest-ServerGroup264TestJSON-1114899540 tempest-ServerGroup264TestJSON-1114899540-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:42.944432 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3b07cf32-0374-40ef-9795-daa18c903dbb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:42.957305 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3b07cf32-0374-40ef-9795-daa18c903dbb tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae" status: 200 len: 1522 microversion: 2.1 time: 0.473972 Jul 19 22:45:42.959258 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1941/3901] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:42 2022] GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae => generated 1522 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:42.965092 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-d6b34ef6-5724-4f5f-b462-9d52c68393f9 req-b5225e9b-312c-4d6e-8209-181a18607cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aced12b1-4b92-495f-9a54-9df7e990b05c", "name": "network-vif-plugged", "status": "completed", "tag": "0d9ce212-23b2-4a5f-bb65-a0a3ea48b1a9"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:42.977146 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d6b34ef6-5724-4f5f-b462-9d52c68393f9 req-b5225e9b-312c-4d6e-8209-181a18607cd5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:42.977930 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d6b34ef6-5724-4f5f-b462-9d52c68393f9 req-b5225e9b-312c-4d6e-8209-181a18607cd5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:42.990104 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-662c8aed-e473-4f2f-9ead-e350cff1ab41 tempest-ServerGroup264TestJSON-1114899540 tempest-ServerGroup264TestJSON-1114899540-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/9614f9db-b9ce-49d7-89b8-640258063c4a" status: 204 len: 0 microversion: 2.64 time: 0.104452 Jul 19 22:45:42.993591 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1961/3902] 10.222.0.25 () {60 vars in 1306 bytes} [Tue Jul 19 22:45:42 2022] DELETE /compute/v2.1/os-server-groups/9614f9db-b9ce-49d7-89b8-640258063c4a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:45:43.006688 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ec559b11-085d-439f-a074-6cf18ebbf803 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:43.007773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ec559b11-085d-439f-a074-6cf18ebbf803 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: c56a1af0-7bb0-42ee-8139-fe6c8a6772d4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:43.019415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec559b11-085d-439f-a074-6cf18ebbf803 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:43.020058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec559b11-085d-439f-a074-6cf18ebbf803 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:43.020866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec559b11-085d-439f-a074-6cf18ebbf803 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:43.021316 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec559b11-085d-439f-a074-6cf18ebbf803 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:43.023220 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-d6b34ef6-5724-4f5f-b462-9d52c68393f9 req-b5225e9b-312c-4d6e-8209-181a18607cd5 service nova] Creating event network-vif-plugged:0d9ce212-23b2-4a5f-bb65-a0a3ea48b1a9 for instance aced12b1-4b92-495f-9a54-9df7e990b05c on n-h1-847009-3 Jul 19 22:45:43.032994 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-d6b34ef6-5724-4f5f-b462-9d52c68393f9 req-b5225e9b-312c-4d6e-8209-181a18607cd5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071876 Jul 19 22:45:43.034224 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1942/3903] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:45:43.044136 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-574ab3cf-2bcf-4ed1-a92a-df096dd1128d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:43.045353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-574ab3cf-2bcf-4ed1-a92a-df096dd1128d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:43.054393 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-574ab3cf-2bcf-4ed1-a92a-df096dd1128d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:43.055297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-574ab3cf-2bcf-4ed1-a92a-df096dd1128d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:43.057145 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-574ab3cf-2bcf-4ed1-a92a-df096dd1128d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:43.057827 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-574ab3cf-2bcf-4ed1-a92a-df096dd1128d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:43.190009 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-574ab3cf-2bcf-4ed1-a92a-df096dd1128d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:43.201214 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-574ab3cf-2bcf-4ed1-a92a-df096dd1128d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1267 microversion: 2.1 time: 0.162375 Jul 19 22:45:43.202737 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1943/3904] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:43 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:43.209769 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c3094832-8fe3-4226-a660-06d71f9a1ea6 tempest-ServerGroup264TestJSON-1114899540 tempest-ServerGroup264TestJSON-1114899540-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:43.217873 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-c3094832-8fe3-4226-a660-06d71f9a1ea6 tempest-ServerGroup264TestJSON-1114899540 tempest-ServerGroup264TestJSON-1114899540-project] HTTP exception thrown: Instance group 9614f9db-b9ce-49d7-89b8-640258063c4a could not be found. Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c3094832-8fe3-4226-a660-06d71f9a1ea6 tempest-ServerGroup264TestJSON-1114899540 tempest-ServerGroup264TestJSON-1114899540-project] Request method failure captured: Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/os-server-groups/9614f9db-b9ce-49d7-89b8-640258063c4a HTTP/1.1 Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zQUiBu6R1VH_8j_aQvQ4RFBJPN0X-rJqG4zTWLGTp1RUuG9pnax6oh_rt2u71J6RUN_wrlie3C37XGu0qNYeB9dyetsYtm3_U8JmcfMmS7UxOAYTSI_M-ZMRBEbmMyeD1nCZ-u-MOD17m1Tpbs-I40IZEYlWP7g-ebLRI_3PkytueY Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: X-Openstack-Nova-Api-Version: 2.64 Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 6f1fa77cdf814f98ac73aeee7c6fbb71 Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerGroup264TestJSON-1114899540 Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6f1fa77cdf814f98ac73aeee7c6fbb71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f1fa77cdf814f98ac73aeee7c6fbb71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6f1fa77cdf814f98ac73aeee7c6fbb71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f1fa77cdf814f98ac73aeee7c6fbb71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerGroup264TestJSON-1114899540 Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 6f1fa77cdf814f98ac73aeee7c6fbb71 Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1114899540 Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerGroup264TestJSON-1114899540-project Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 7123f2a0817744998e1f108a63a93298 Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerGroup264TestJSON-1114899540-project Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance group 9614f9db-b9ce-49d7-89b8-640258063c4a could not be found. Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '9614f9db-b9ce-49d7-89b8-640258063c4a'} Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9614f9db-b9ce-49d7-89b8-640258063c4a could not be found. Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9614f9db-b9ce-49d7-89b8-640258063c4a could not be found. Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:43.224408 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:43.234327 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:45:43.234327 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:45:43.234327 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:45:43.234327 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:45:43.234327 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9614f9db-b9ce-49d7-89b8-640258063c4a could not be found. Jul 19 22:45:43.234327 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:43.234327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c3094832-8fe3-4226-a660-06d71f9a1ea6 tempest-ServerGroup264TestJSON-1114899540 tempest-ServerGroup264TestJSON-1114899540-project] Returning 404 to user: Instance group 9614f9db-b9ce-49d7-89b8-640258063c4a could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:45:43.234327 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c3094832-8fe3-4226-a660-06d71f9a1ea6 tempest-ServerGroup264TestJSON-1114899540 tempest-ServerGroup264TestJSON-1114899540-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/9614f9db-b9ce-49d7-89b8-640258063c4a" status: 404 len: 117 microversion: 2.64 time: 0.021847 Jul 19 22:45:43.234327 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1944/3905] 10.222.0.25 () {60 vars in 1306 bytes} [Tue Jul 19 22:45:43 2022] DELETE /compute/v2.1/os-server-groups/9614f9db-b9ce-49d7-89b8-640258063c4a => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:45:43.344178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2c807135-c51f-45d3-982b-272931cbbda3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:43.345102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2c807135-c51f-45d3-982b-272931cbbda3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] [instance: aced12b1-4b92-495f-9a54-9df7e990b05c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:43.360642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2c807135-c51f-45d3-982b-272931cbbda3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:43.364295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2c807135-c51f-45d3-982b-272931cbbda3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:43.371174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2c807135-c51f-45d3-982b-272931cbbda3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:43.371976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2c807135-c51f-45d3-982b-272931cbbda3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:43.433754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ec559b11-085d-439f-a074-6cf18ebbf803 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:43.451483 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ec559b11-085d-439f-a074-6cf18ebbf803 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4" status: 200 len: 1516 microversion: 2.1 time: 0.456224 Jul 19 22:45:43.453188 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1962/3906] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:42 2022] GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 => generated 1516 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:43.830789 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2c807135-c51f-45d3-982b-272931cbbda3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:43.847041 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2c807135-c51f-45d3-982b-272931cbbda3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:43.849661 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2c807135-c51f-45d3-982b-272931cbbda3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:43.856885 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2c807135-c51f-45d3-982b-272931cbbda3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] 10.222.0.25 "GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c" status: 200 len: 1358 microversion: 2.21 time: 0.511440 Jul 19 22:45:43.858792 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1945/3907] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:43 2022] GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c => generated 1358 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:45:43.981655 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6fee6a8b-5190-4055-a8ce-ea8d8da860a6 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:43.982292 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6fee6a8b-5190-4055-a8ce-ea8d8da860a6 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:43.998430 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6fee6a8b-5190-4055-a8ce-ea8d8da860a6 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:43.998823 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6fee6a8b-5190-4055-a8ce-ea8d8da860a6 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:43.999670 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6fee6a8b-5190-4055-a8ce-ea8d8da860a6 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:44.000124 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6fee6a8b-5190-4055-a8ce-ea8d8da860a6 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:44.224753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-02ca0df8-2da6-40ae-b5cc-90d1c5c32696 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:44.225821 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-02ca0df8-2da6-40ae-b5cc-90d1c5c32696 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:44.254923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-02ca0df8-2da6-40ae-b5cc-90d1c5c32696 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:44.255718 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-02ca0df8-2da6-40ae-b5cc-90d1c5c32696 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:44.260221 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-02ca0df8-2da6-40ae-b5cc-90d1c5c32696 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:44.261009 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-02ca0df8-2da6-40ae-b5cc-90d1c5c32696 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:44.335141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:45:44.922339 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-02ca0df8-2da6-40ae-b5cc-90d1c5c32696 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:44.938414 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-02ca0df8-2da6-40ae-b5cc-90d1c5c32696 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1273 microversion: 2.1 time: 0.720668 Jul 19 22:45:44.943676 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1946/3908] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:44 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1273 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:44.959055 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8f0c6b5a-ebc5-4dab-8307-fcd24e6bcfaf tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:44.959782 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8f0c6b5a-ebc5-4dab-8307-fcd24e6bcfaf tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: c56a1af0-7bb0-42ee-8139-fe6c8a6772d4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:44.969583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f0c6b5a-ebc5-4dab-8307-fcd24e6bcfaf tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:44.970040 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f0c6b5a-ebc5-4dab-8307-fcd24e6bcfaf tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:44.971320 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f0c6b5a-ebc5-4dab-8307-fcd24e6bcfaf tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:44.972261 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f0c6b5a-ebc5-4dab-8307-fcd24e6bcfaf tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:45.492571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6fee6a8b-5190-4055-a8ce-ea8d8da860a6 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:45.508698 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6fee6a8b-5190-4055-a8ce-ea8d8da860a6 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae" status: 200 len: 1522 microversion: 2.1 time: 1.530906 Jul 19 22:45:45.510396 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1963/3909] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:43 2022] GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae => generated 1522 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:45.521699 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1965598a-f2e1-4956-979e-0b8bbda310f3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:45.522604 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1965598a-f2e1-4956-979e-0b8bbda310f3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] [instance: aced12b1-4b92-495f-9a54-9df7e990b05c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:45.531584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1965598a-f2e1-4956-979e-0b8bbda310f3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:45.532330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1965598a-f2e1-4956-979e-0b8bbda310f3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:45.534557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1965598a-f2e1-4956-979e-0b8bbda310f3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:45.536330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1965598a-f2e1-4956-979e-0b8bbda310f3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:45.993344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1965598a-f2e1-4956-979e-0b8bbda310f3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:46.006952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1965598a-f2e1-4956-979e-0b8bbda310f3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:46.008543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1965598a-f2e1-4956-979e-0b8bbda310f3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:46.009661 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1965598a-f2e1-4956-979e-0b8bbda310f3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] 10.222.0.25 "GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c" status: 200 len: 1358 microversion: 2.21 time: 0.493135 Jul 19 22:45:46.010264 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1964/3910] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:45 2022] GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c => generated 1358 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:45:46.022217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fbcd7eea-f0da-4a19-89c5-b0079945ed1d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:46.022844 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fbcd7eea-f0da-4a19-89c5-b0079945ed1d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:46.044723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8f0c6b5a-ebc5-4dab-8307-fcd24e6bcfaf tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:46.045313 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fbcd7eea-f0da-4a19-89c5-b0079945ed1d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:46.045313 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fbcd7eea-f0da-4a19-89c5-b0079945ed1d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:46.046003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fbcd7eea-f0da-4a19-89c5-b0079945ed1d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:46.046460 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fbcd7eea-f0da-4a19-89c5-b0079945ed1d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:46.063642 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8f0c6b5a-ebc5-4dab-8307-fcd24e6bcfaf tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4" status: 200 len: 1516 microversion: 2.1 time: 1.118387 Jul 19 22:45:46.076387 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1947/3911] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:44 2022] GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 => generated 1516 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:46.219679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fbcd7eea-f0da-4a19-89c5-b0079945ed1d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:46.239570 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fbcd7eea-f0da-4a19-89c5-b0079945ed1d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1273 microversion: 2.1 time: 0.226763 Jul 19 22:45:46.241916 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1965/3912] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:46 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1273 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:46.529746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-91f0ece2-3c88-4141-9d27-f9e13d916fc7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:46.530794 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-91f0ece2-3c88-4141-9d27-f9e13d916fc7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:46.538731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-91f0ece2-3c88-4141-9d27-f9e13d916fc7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:46.539218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-91f0ece2-3c88-4141-9d27-f9e13d916fc7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:46.540251 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-91f0ece2-3c88-4141-9d27-f9e13d916fc7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:46.540921 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-91f0ece2-3c88-4141-9d27-f9e13d916fc7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:47.038500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1d13f0f2-d6f4-4b25-94ad-1aa6c34de747 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:47.040824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1d13f0f2-d6f4-4b25-94ad-1aa6c34de747 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] [instance: aced12b1-4b92-495f-9a54-9df7e990b05c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:47.064781 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d13f0f2-d6f4-4b25-94ad-1aa6c34de747 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:47.067396 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d13f0f2-d6f4-4b25-94ad-1aa6c34de747 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:47.068611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d13f0f2-d6f4-4b25-94ad-1aa6c34de747 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:47.069328 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d13f0f2-d6f4-4b25-94ad-1aa6c34de747 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:47.336017 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-91f0ece2-3c88-4141-9d27-f9e13d916fc7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:47.351384 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-91f0ece2-3c88-4141-9d27-f9e13d916fc7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae" status: 200 len: 1522 microversion: 2.1 time: 0.826533 Jul 19 22:45:47.352592 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1948/3913] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:46 2022] GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae => generated 1522 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:45:47.363971 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-acfb43aa-5fc0-47b6-9e8d-75dd8ec30fac tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:47.368619 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-acfb43aa-5fc0-47b6-9e8d-75dd8ec30fac tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: c56a1af0-7bb0-42ee-8139-fe6c8a6772d4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:47.381860 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-acfb43aa-5fc0-47b6-9e8d-75dd8ec30fac tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:47.391620 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-acfb43aa-5fc0-47b6-9e8d-75dd8ec30fac tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:47.392780 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-acfb43aa-5fc0-47b6-9e8d-75dd8ec30fac tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:47.393428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-acfb43aa-5fc0-47b6-9e8d-75dd8ec30fac tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:47.586906 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-acfb43aa-5fc0-47b6-9e8d-75dd8ec30fac tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:47.624278 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-acfb43aa-5fc0-47b6-9e8d-75dd8ec30fac tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4" status: 200 len: 1474 microversion: 2.1 time: 0.267620 Jul 19 22:45:47.638720 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1949/3914] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:47 2022] GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 => generated 1474 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:47.648845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-73bb1cfe-15ff-4557-8798-b7dee08cfc7d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:47.649730 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-73bb1cfe-15ff-4557-8798-b7dee08cfc7d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:47.667148 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-73bb1cfe-15ff-4557-8798-b7dee08cfc7d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:47.671818 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-73bb1cfe-15ff-4557-8798-b7dee08cfc7d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:47.674607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-73bb1cfe-15ff-4557-8798-b7dee08cfc7d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:47.676558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-73bb1cfe-15ff-4557-8798-b7dee08cfc7d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:47.779917 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1d13f0f2-d6f4-4b25-94ad-1aa6c34de747 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:47.786133 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:45:47.807760 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1d13f0f2-d6f4-4b25-94ad-1aa6c34de747 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:47.809589 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1d13f0f2-d6f4-4b25-94ad-1aa6c34de747 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:47.811000 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1d13f0f2-d6f4-4b25-94ad-1aa6c34de747 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] 10.222.0.25 "GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c" status: 200 len: 1551 microversion: 2.21 time: 0.779232 Jul 19 22:45:47.812152 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1966/3915] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:47 2022] GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c => generated 1551 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:45:47.963376 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-63202669-6df3-4dbb-932a-b83ab8c41acd req-1003a1cb-b219-44c0-9f2d-5d5282b1327a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56a1af0-7bb0-42ee-8139-fe6c8a6772d4", "name": "network-vif-deleted", "tag": "224bb08e-b075-408c-a321-08e3a3214b21"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:47.973627 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:45:47.981451 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-63202669-6df3-4dbb-932a-b83ab8c41acd req-1003a1cb-b219-44c0-9f2d-5d5282b1327a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:47.981907 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-63202669-6df3-4dbb-932a-b83ab8c41acd req-1003a1cb-b219-44c0-9f2d-5d5282b1327a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:48.004841 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-63202669-6df3-4dbb-932a-b83ab8c41acd req-1003a1cb-b219-44c0-9f2d-5d5282b1327a service nova] Creating event network-vif-deleted:224bb08e-b075-408c-a321-08e3a3214b21 for instance c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 on n-h1-847009-3 Jul 19 22:45:48.010124 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-63202669-6df3-4dbb-932a-b83ab8c41acd req-1003a1cb-b219-44c0-9f2d-5d5282b1327a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196572 Jul 19 22:45:48.011057 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1967/3916] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:45:48.016304 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-15ea2979-5534-4802-a8be-176ffab2137e tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:48.016895 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-15ea2979-5534-4802-a8be-176ffab2137e tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] [instance: aced12b1-4b92-495f-9a54-9df7e990b05c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:48.033592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-15ea2979-5534-4802-a8be-176ffab2137e tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:48.034324 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-15ea2979-5534-4802-a8be-176ffab2137e tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:48.035577 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-15ea2979-5534-4802-a8be-176ffab2137e tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:48.036261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-15ea2979-5534-4802-a8be-176ffab2137e tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:48.115014 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-15ea2979-5534-4802-a8be-176ffab2137e tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] [instance: aced12b1-4b92-495f-9a54-9df7e990b05c] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:45:48.280728 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-15ea2979-5534-4802-a8be-176ffab2137e tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c" status: 204 len: 0 microversion: 2.21 time: 0.268188 Jul 19 22:45:48.281358 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1968/3917] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 22:45:48 2022] DELETE /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:45:48.296674 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-86f44e14-3660-49a9-8110-a55a3a6ffa01 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:48.303561 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-86f44e14-3660-49a9-8110-a55a3a6ffa01 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] [instance: aced12b1-4b92-495f-9a54-9df7e990b05c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:48.318579 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86f44e14-3660-49a9-8110-a55a3a6ffa01 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:48.319411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86f44e14-3660-49a9-8110-a55a3a6ffa01 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:48.320605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86f44e14-3660-49a9-8110-a55a3a6ffa01 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:48.321228 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86f44e14-3660-49a9-8110-a55a3a6ffa01 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:48.424179 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-73bb1cfe-15ff-4557-8798-b7dee08cfc7d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:48.433344 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-73bb1cfe-15ff-4557-8798-b7dee08cfc7d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1315 microversion: 2.1 time: 0.792708 Jul 19 22:45:48.445692 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1950/3918] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:47 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1315 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:48.455653 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-22cc34e4-d847-451e-88f3-095f496dc841 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:48.457200 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-22cc34e4-d847-451e-88f3-095f496dc841 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:48.468223 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22cc34e4-d847-451e-88f3-095f496dc841 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:48.469013 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22cc34e4-d847-451e-88f3-095f496dc841 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:48.470030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22cc34e4-d847-451e-88f3-095f496dc841 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:48.470667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22cc34e4-d847-451e-88f3-095f496dc841 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:48.915038 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-86f44e14-3660-49a9-8110-a55a3a6ffa01 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:48.948869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-86f44e14-3660-49a9-8110-a55a3a6ffa01 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:48.961830 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-86f44e14-3660-49a9-8110-a55a3a6ffa01 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:48.981498 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-86f44e14-3660-49a9-8110-a55a3a6ffa01 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] 10.222.0.25 "GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c" status: 200 len: 1557 microversion: 2.21 time: 0.687402 Jul 19 22:45:48.983715 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1969/3919] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:48 2022] GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c => generated 1557 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:45:49.006817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-86557f6d-8ab2-42b3-a2a3-323ce43f6f92 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:49.008357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-86557f6d-8ab2-42b3-a2a3-323ce43f6f92 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: c56a1af0-7bb0-42ee-8139-fe6c8a6772d4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:49.021130 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86557f6d-8ab2-42b3-a2a3-323ce43f6f92 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:49.022264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86557f6d-8ab2-42b3-a2a3-323ce43f6f92 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:49.023965 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86557f6d-8ab2-42b3-a2a3-323ce43f6f92 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:49.025031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86557f6d-8ab2-42b3-a2a3-323ce43f6f92 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:49.060984 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-86557f6d-8ab2-42b3-a2a3-323ce43f6f92 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] HTTP exception thrown: Instance c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 could not be found. Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-86557f6d-8ab2-42b3-a2a3-323ce43f6f92 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Request method failure captured: Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 HTTP/1.1 Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zM1CVhkGzrLI27yplqtJpQo-i3-EKMGfRab3BLA-iVFSYzTm_PO2UXoSlqkSOVVu2ip8fmaaUlGTzOcY-1-PKTjTHCVYzWriYi14tgLboJXa9RPch13wobugtzkYLm5uZx9koMts7tA37UlK9MH24L7zFq17JufqAVvZobtx47aYg4 Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersTestJSON-1648920919 Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersTestJSON-1648920919-project Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1db06ac41e9f4fe290e535f703af484d Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersTestJSON-1648920919-project Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 could not be found. Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'c56a1af0-7bb0-42ee-8139-fe6c8a6772d4'} Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 could not be found. Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 could not be found. Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:49.065014 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:49.075817 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:45:49.075817 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:45:49.075817 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:45:49.075817 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:45:49.075817 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 could not be found. Jul 19 22:45:49.075817 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:49.075817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-86557f6d-8ab2-42b3-a2a3-323ce43f6f92 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Returning 404 to user: Instance c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:45:49.075817 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-86557f6d-8ab2-42b3-a2a3-323ce43f6f92 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4" status: 404 len: 111 microversion: 2.1 time: 0.086156 Jul 19 22:45:49.078776 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1970/3920] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:48 2022] GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:45:49.328706 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-22cc34e4-d847-451e-88f3-095f496dc841 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:49.338486 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-22cc34e4-d847-451e-88f3-095f496dc841 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae" status: 200 len: 1522 microversion: 2.1 time: 0.891370 Jul 19 22:45:49.358013 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1951/3921] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:48 2022] GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae => generated 1522 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:49.413125 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ca68341f-5ef8-4537-a64a-750a9e0394ea tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2066351002", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "6119d69d-194a-407a-a78f-64890b6702ed"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:49.455573 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bdfa5882-4dc8-4b60-a41f-df01ac7ffcdb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:49.457713 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bdfa5882-4dc8-4b60-a41f-df01ac7ffcdb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:49.468320 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bdfa5882-4dc8-4b60-a41f-df01ac7ffcdb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:49.469077 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bdfa5882-4dc8-4b60-a41f-df01ac7ffcdb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:49.470146 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bdfa5882-4dc8-4b60-a41f-df01ac7ffcdb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:49.470802 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bdfa5882-4dc8-4b60-a41f-df01ac7ffcdb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:49.524366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-ca68341f-5ef8-4537-a64a-750a9e0394ea tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] validate_networks() for [('6119d69d-194a-407a-a78f-64890b6702ed', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:45:50.437717 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bdfa5882-4dc8-4b60-a41f-df01ac7ffcdb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:50.455822 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bdfa5882-4dc8-4b60-a41f-df01ac7ffcdb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1315 microversion: 2.1 time: 1.007559 Jul 19 22:45:50.468485 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1952/3922] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:49 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1315 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:50.474804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-583cbb35-68e0-4bb5-9f3c-31402ee1c7d5 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:50.475852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-583cbb35-68e0-4bb5-9f3c-31402ee1c7d5 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] [instance: aced12b1-4b92-495f-9a54-9df7e990b05c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:50.483979 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-583cbb35-68e0-4bb5-9f3c-31402ee1c7d5 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:50.485123 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-583cbb35-68e0-4bb5-9f3c-31402ee1c7d5 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:50.486212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-583cbb35-68e0-4bb5-9f3c-31402ee1c7d5 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:50.486958 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-583cbb35-68e0-4bb5-9f3c-31402ee1c7d5 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:51.219513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:45:51.369871 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-583cbb35-68e0-4bb5-9f3c-31402ee1c7d5 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:51.393711 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-583cbb35-68e0-4bb5-9f3c-31402ee1c7d5 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:51.396005 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-583cbb35-68e0-4bb5-9f3c-31402ee1c7d5 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:51.397252 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-583cbb35-68e0-4bb5-9f3c-31402ee1c7d5 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] 10.222.0.25 "GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c" status: 200 len: 1557 microversion: 2.21 time: 0.926840 Jul 19 22:45:51.403259 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1953/3923] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:50 2022] GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c => generated 1557 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:45:51.428916 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-568f8bbc-6c0b-4177-9a53-7c466cf157b8 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:51.433962 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-568f8bbc-6c0b-4177-9a53-7c466cf157b8 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:51.460881 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-568f8bbc-6c0b-4177-9a53-7c466cf157b8 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:51.461502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-568f8bbc-6c0b-4177-9a53-7c466cf157b8 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:51.461807 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-568f8bbc-6c0b-4177-9a53-7c466cf157b8 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:51.462277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-568f8bbc-6c0b-4177-9a53-7c466cf157b8 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:51.967733 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:45:51.978359 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-568f8bbc-6c0b-4177-9a53-7c466cf157b8 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:51.980955 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-ca68341f-5ef8-4537-a64a-750a9e0394ea tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:45:51.981571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-ca68341f-5ef8-4537-a64a-750a9e0394ea tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:45:51.982171 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-ca68341f-5ef8-4537-a64a-750a9e0394ea tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:45:51.982696 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-ca68341f-5ef8-4537-a64a-750a9e0394ea tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:45:51.983413 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-ca68341f-5ef8-4537-a64a-750a9e0394ea tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:45:51.990519 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-568f8bbc-6c0b-4177-9a53-7c466cf157b8 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae" status: 200 len: 1522 microversion: 2.1 time: 0.585518 Jul 19 22:45:51.991478 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1954/3924] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:51 2022] GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae => generated 1522 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:51.999137 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2b1eeed2-f5af-4e12-8430-084aa52b8129 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:52.007602 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2b1eeed2-f5af-4e12-8430-084aa52b8129 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:52.026235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca68341f-5ef8-4537-a64a-750a9e0394ea tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:52.027336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca68341f-5ef8-4537-a64a-750a9e0394ea tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:52.028757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2b1eeed2-f5af-4e12-8430-084aa52b8129 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:52.029109 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca68341f-5ef8-4537-a64a-750a9e0394ea tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:52.029624 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2b1eeed2-f5af-4e12-8430-084aa52b8129 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:52.030689 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca68341f-5ef8-4537-a64a-750a9e0394ea tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:52.031476 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2b1eeed2-f5af-4e12-8430-084aa52b8129 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:52.032258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2b1eeed2-f5af-4e12-8430-084aa52b8129 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:52.083760 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-ca68341f-5ef8-4537-a64a-750a9e0394ea tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Getting quotas for project 9bd4d0caf2f347218af6ffd52f250c59. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:45:52.093941 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-ca68341f-5ef8-4537-a64a-750a9e0394ea tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Getting quotas for user 1db06ac41e9f4fe290e535f703af484d and project 9bd4d0caf2f347218af6ffd52f250c59. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:45:52.122083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ca68341f-5ef8-4537-a64a-750a9e0394ea tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:45:52.126156 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ca68341f-5ef8-4537-a64a-750a9e0394ea tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:45:52.232236 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ca68341f-5ef8-4537-a64a-750a9e0394ea tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.825130 Jul 19 22:45:52.234650 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1971/3925] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:45:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:45:52.245904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-e2547958-1e05-490b-b7e3-92981b0c9b68 req-5be32cdd-532a-476f-b700-602d25062a7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aced12b1-4b92-495f-9a54-9df7e990b05c", "name": "network-vif-deleted", "tag": "0d9ce212-23b2-4a5f-bb65-a0a3ea48b1a9"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:52.305374 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e2547958-1e05-490b-b7e3-92981b0c9b68 req-5be32cdd-532a-476f-b700-602d25062a7f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:52.308485 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e2547958-1e05-490b-b7e3-92981b0c9b68 req-5be32cdd-532a-476f-b700-602d25062a7f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:52.336012 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-e2547958-1e05-490b-b7e3-92981b0c9b68 req-5be32cdd-532a-476f-b700-602d25062a7f service nova] Creating event network-vif-deleted:0d9ce212-23b2-4a5f-bb65-a0a3ea48b1a9 for instance aced12b1-4b92-495f-9a54-9df7e990b05c on n-h1-847009-3 Jul 19 22:45:52.354143 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-e2547958-1e05-490b-b7e3-92981b0c9b68 req-5be32cdd-532a-476f-b700-602d25062a7f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110488 Jul 19 22:45:52.357264 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1972/3926] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:45:52.366773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e2db4c07-8ddb-4bb4-9c72-0a61db891c98 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:52.368884 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e2db4c07-8ddb-4bb4-9c72-0a61db891c98 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:52.496677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e2db4c07-8ddb-4bb4-9c72-0a61db891c98 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:52.531512 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e2db4c07-8ddb-4bb4-9c72-0a61db891c98 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1209 microversion: 2.1 time: 0.172217 Jul 19 22:45:52.544042 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1973/3927] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:52 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1209 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:52.560574 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cc45beec-4398-4c41-8881-65992bc852c7 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:52.562291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cc45beec-4398-4c41-8881-65992bc852c7 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] [instance: aced12b1-4b92-495f-9a54-9df7e990b05c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:52.583650 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc45beec-4398-4c41-8881-65992bc852c7 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:52.586152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc45beec-4398-4c41-8881-65992bc852c7 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:52.587916 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc45beec-4398-4c41-8881-65992bc852c7 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:52.591247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc45beec-4398-4c41-8881-65992bc852c7 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:52.609424 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2b1eeed2-f5af-4e12-8430-084aa52b8129 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:52.620428 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2b1eeed2-f5af-4e12-8430-084aa52b8129 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1315 microversion: 2.1 time: 0.627817 Jul 19 22:45:52.630618 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1955/3928] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:51 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1315 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:52.864262 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cc45beec-4398-4c41-8881-65992bc852c7 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:52.875431 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cc45beec-4398-4c41-8881-65992bc852c7 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:52.876952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cc45beec-4398-4c41-8881-65992bc852c7 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09dae6c907d4e7486db30d59b29b0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9aab7959b743ff94c2c4ae6763af59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:52.878228 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cc45beec-4398-4c41-8881-65992bc852c7 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] 10.222.0.25 "GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c" status: 200 len: 1515 microversion: 2.21 time: 0.333072 Jul 19 22:45:52.891500 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1974/3929] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:52 2022] GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c => generated 1515 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:45:53.007715 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8b3acc0a-4168-4d35-8e94-dbf5b245355e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:53.008625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8b3acc0a-4168-4d35-8e94-dbf5b245355e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:53.028923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b3acc0a-4168-4d35-8e94-dbf5b245355e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:53.033230 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b3acc0a-4168-4d35-8e94-dbf5b245355e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:53.036509 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b3acc0a-4168-4d35-8e94-dbf5b245355e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:53.039477 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b3acc0a-4168-4d35-8e94-dbf5b245355e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:53.557054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6aa50ce1-f715-46fc-806a-5c4f473f0451 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:53.557856 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6aa50ce1-f715-46fc-806a-5c4f473f0451 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:53.580224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6aa50ce1-f715-46fc-806a-5c4f473f0451 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:53.584118 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6aa50ce1-f715-46fc-806a-5c4f473f0451 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:53.585125 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6aa50ce1-f715-46fc-806a-5c4f473f0451 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:53.595700 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6aa50ce1-f715-46fc-806a-5c4f473f0451 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:54.357333 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6aa50ce1-f715-46fc-806a-5c4f473f0451 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:54.370693 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6aa50ce1-f715-46fc-806a-5c4f473f0451 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1261 microversion: 2.1 time: 0.817333 Jul 19 22:45:54.381614 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1975/3930] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:53 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1261 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:45:54.393065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b7b0e75e-0417-4b80-99d9-1b52a358a345 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:54.394281 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b7b0e75e-0417-4b80-99d9-1b52a358a345 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:54.400966 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b7b0e75e-0417-4b80-99d9-1b52a358a345 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:54.401677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b7b0e75e-0417-4b80-99d9-1b52a358a345 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:54.402485 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b7b0e75e-0417-4b80-99d9-1b52a358a345 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:54.402920 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b7b0e75e-0417-4b80-99d9-1b52a358a345 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:54.930396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8b3acc0a-4168-4d35-8e94-dbf5b245355e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:54.940380 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8b3acc0a-4168-4d35-8e94-dbf5b245355e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae" status: 200 len: 1522 microversion: 2.1 time: 1.936736 Jul 19 22:45:54.942458 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1956/3931] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:53 2022] GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae => generated 1522 bytes in 1940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:54.947795 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-55876e70-841e-401b-be14-464cfa94bea8 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:54.948674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-55876e70-841e-401b-be14-464cfa94bea8 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] [instance: aced12b1-4b92-495f-9a54-9df7e990b05c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:54.954720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=91 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:45:54.956617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-55876e70-841e-401b-be14-464cfa94bea8 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:54.957301 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-55876e70-841e-401b-be14-464cfa94bea8 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:54.958352 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-55876e70-841e-401b-be14-464cfa94bea8 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:54.958791 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-55876e70-841e-401b-be14-464cfa94bea8 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:54.977431 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-55876e70-841e-401b-be14-464cfa94bea8 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] HTTP exception thrown: Instance aced12b1-4b92-495f-9a54-9df7e990b05c could not be found. Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-55876e70-841e-401b-be14-464cfa94bea8 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Request method failure captured: Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c HTTP/1.1 Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zQAQZDuBJonqkTNi10cRLehnkn2jgtNo9U7myp9YHvBqvE5z_BAIKxjwNEs42JxCo0WOYUBdVQEC9PIagrL7PyxWnAnfO7VIMVc_zMkhMf0sedT5e16sSk2aHsx5EIaQ78n92eaZzt8xDpUiataqvE034k8uiwduXtrRrG7ZQ8a-Vo Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: X-Openstack-Nova-Api-Version: 2.21 Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 0b9aab7959b743ff94c2c4ae6763af59 Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1783175198 Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0b9aab7959b743ff94c2c4ae6763af59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0b9aab7959b743ff94c2c4ae6763af59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0b9aab7959b743ff94c2c4ae6763af59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0b9aab7959b743ff94c2c4ae6763af59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-InstanceActionsV221TestJSON-1783175198 Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 0b9aab7959b743ff94c2c4ae6763af59 Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1783175198 Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-InstanceActionsV221TestJSON-1783175198-project Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: c09dae6c907d4e7486db30d59b29b0a5 Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-InstanceActionsV221TestJSON-1783175198-project Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance aced12b1-4b92-495f-9a54-9df7e990b05c could not be found. Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'aced12b1-4b92-495f-9a54-9df7e990b05c'} Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aced12b1-4b92-495f-9a54-9df7e990b05c could not be found. Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aced12b1-4b92-495f-9a54-9df7e990b05c could not be found. Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:54.979472 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:45:55.024024 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:55.024024 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:55.024024 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:45:55.024024 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:45:55.024024 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:45:55.024024 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:45:55.024024 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aced12b1-4b92-495f-9a54-9df7e990b05c could not be found. Jul 19 22:45:55.024024 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:45:55.024024 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-55876e70-841e-401b-be14-464cfa94bea8 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Returning 404 to user: Instance aced12b1-4b92-495f-9a54-9df7e990b05c could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:45:55.024024 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-55876e70-841e-401b-be14-464cfa94bea8 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] 10.222.0.25 "GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c" status: 404 len: 111 microversion: 2.21 time: 0.043382 Jul 19 22:45:55.024024 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1957/3932] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:54 2022] GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:45:55.024024 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-b7c1052c-7df6-419b-88dd-0ed6927bc17d req-7fbdaec0-e287-4aa9-b851-1715cdf79a76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78349902-af4b-44e1-a79e-da1d1217b328", "tag": "8ce296ac-f78e-4559-bda4-3615294b6700"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:55.024024 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b7c1052c-7df6-419b-88dd-0ed6927bc17d req-7fbdaec0-e287-4aa9-b851-1715cdf79a76 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:55.024024 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b7c1052c-7df6-419b-88dd-0ed6927bc17d req-7fbdaec0-e287-4aa9-b851-1715cdf79a76 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:55.040798 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-b7c1052c-7df6-419b-88dd-0ed6927bc17d req-7fbdaec0-e287-4aa9-b851-1715cdf79a76 service nova] Creating event network-changed:8ce296ac-f78e-4559-bda4-3615294b6700 for instance 78349902-af4b-44e1-a79e-da1d1217b328 on n-h2-847009-3 Jul 19 22:45:55.046570 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-b7c1052c-7df6-419b-88dd-0ed6927bc17d req-7fbdaec0-e287-4aa9-b851-1715cdf79a76 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057297 Jul 19 22:45:55.047537 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1958/3933] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:45:55.110889 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bb6b1c00-0e61-4d85-87d1-a555dcad069d tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1372159735", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "156deafd-d696-49d1-a2b8-452cb78ca0dd"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:55.177571 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-bb6b1c00-0e61-4d85-87d1-a555dcad069d tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] validate_networks() for [('156deafd-d696-49d1-a2b8-452cb78ca0dd', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:45:55.475553 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b7b0e75e-0417-4b80-99d9-1b52a358a345 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:55.497876 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b7b0e75e-0417-4b80-99d9-1b52a358a345 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1315 microversion: 2.1 time: 1.115008 Jul 19 22:45:55.500452 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1976/3934] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:54 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1315 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:55.516534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e12e6159-d098-4f5b-b655-03d14c469f49 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Calling method '.version_select at 0x7f7a03993e50>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:55.519628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e12e6159-d098-4f5b-b655-03d14c469f49 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] [instance: aced12b1-4b92-495f-9a54-9df7e990b05c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:55.556152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e12e6159-d098-4f5b-b655-03d14c469f49 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:55.556615 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e12e6159-d098-4f5b-b655-03d14c469f49 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:55.557715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e12e6159-d098-4f5b-b655-03d14c469f49 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:55.557876 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e12e6159-d098-4f5b-b655-03d14c469f49 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:55.654261 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e12e6159-d098-4f5b-b655-03d14c469f49 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] 10.222.0.25 "GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.154325 Jul 19 22:45:55.655460 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1977/3935] 10.222.0.25 () {60 vars in 1336 bytes} [Tue Jul 19 22:45:55 2022] GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c/os-instance-actions => generated 611 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:45:55.662657 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4cd3e8c3-7120-449e-af67-c1c65cb8e695 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:55.663674 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4cd3e8c3-7120-449e-af67-c1c65cb8e695 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:55.674817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4cd3e8c3-7120-449e-af67-c1c65cb8e695 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:55.676579 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4cd3e8c3-7120-449e-af67-c1c65cb8e695 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:55.677612 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4cd3e8c3-7120-449e-af67-c1c65cb8e695 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:55.678534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4cd3e8c3-7120-449e-af67-c1c65cb8e695 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:55.871914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4cd3e8c3-7120-449e-af67-c1c65cb8e695 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:55.890897 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4cd3e8c3-7120-449e-af67-c1c65cb8e695 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1267 microversion: 2.1 time: 0.233664 Jul 19 22:45:55.892816 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1978/3936] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:55 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:55.899136 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-99eb5a9b-bcd4-4f22-bb78-b83a4ba86f24 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:55.899963 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-99eb5a9b-bcd4-4f22-bb78-b83a4ba86f24 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] [instance: aced12b1-4b92-495f-9a54-9df7e990b05c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:55.918031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-99eb5a9b-bcd4-4f22-bb78-b83a4ba86f24 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:55.918758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-99eb5a9b-bcd4-4f22-bb78-b83a4ba86f24 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:55.919804 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-99eb5a9b-bcd4-4f22-bb78-b83a4ba86f24 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:55.920388 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-99eb5a9b-bcd4-4f22-bb78-b83a4ba86f24 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:55.938292 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-99eb5a9b-bcd4-4f22-bb78-b83a4ba86f24 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] HTTP exception thrown: Instance aced12b1-4b92-495f-9a54-9df7e990b05c could not be found. Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-99eb5a9b-bcd4-4f22-bb78-b83a4ba86f24 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Request method failure captured: Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c HTTP/1.1 Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zQAQZDuBJonqkTNi10cRLehnkn2jgtNo9U7myp9YHvBqvE5z_BAIKxjwNEs42JxCo0WOYUBdVQEC9PIagrL7PyxWnAnfO7VIMVc_zMkhMf0sedT5e16sSk2aHsx5EIaQ78n92eaZzt8xDpUiataqvE034k8uiwduXtrRrG7ZQ8a-Vo Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: X-Openstack-Nova-Api-Version: 2.21 Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 0b9aab7959b743ff94c2c4ae6763af59 Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1783175198 Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0b9aab7959b743ff94c2c4ae6763af59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0b9aab7959b743ff94c2c4ae6763af59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0b9aab7959b743ff94c2c4ae6763af59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0b9aab7959b743ff94c2c4ae6763af59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-InstanceActionsV221TestJSON-1783175198 Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 0b9aab7959b743ff94c2c4ae6763af59 Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1783175198 Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-InstanceActionsV221TestJSON-1783175198-project Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: c09dae6c907d4e7486db30d59b29b0a5 Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-InstanceActionsV221TestJSON-1783175198-project Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance aced12b1-4b92-495f-9a54-9df7e990b05c could not be found. Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'aced12b1-4b92-495f-9a54-9df7e990b05c'} Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aced12b1-4b92-495f-9a54-9df7e990b05c could not be found. Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:45:55.940291 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:45:55.944902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aced12b1-4b92-495f-9a54-9df7e990b05c could not be found. Jul 19 22:45:55.944902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:55.944902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:45:55.944902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:55.944902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:55.944902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:45:55.944902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:45:55.944902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:45:55.944902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:45:55.944902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aced12b1-4b92-495f-9a54-9df7e990b05c could not be found. Jul 19 22:45:55.944902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:55.948171 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-99eb5a9b-bcd4-4f22-bb78-b83a4ba86f24 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Returning 404 to user: Instance aced12b1-4b92-495f-9a54-9df7e990b05c could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:45:55.949062 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-99eb5a9b-bcd4-4f22-bb78-b83a4ba86f24 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c" status: 404 len: 111 microversion: 2.21 time: 0.054924 Jul 19 22:45:55.949658 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1979/3937] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 22:45:55 2022] DELETE /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:45:55.965108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4087ca6e-417e-4758-bf3f-c7776eb536c3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:55.965977 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4087ca6e-417e-4758-bf3f-c7776eb536c3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] [instance: aced12b1-4b92-495f-9a54-9df7e990b05c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:55.973876 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4087ca6e-417e-4758-bf3f-c7776eb536c3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:55.974413 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4087ca6e-417e-4758-bf3f-c7776eb536c3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:55.975310 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4087ca6e-417e-4758-bf3f-c7776eb536c3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:55.975837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4087ca6e-417e-4758-bf3f-c7776eb536c3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:56.005190 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-4087ca6e-417e-4758-bf3f-c7776eb536c3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] HTTP exception thrown: Instance aced12b1-4b92-495f-9a54-9df7e990b05c could not be found. Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4087ca6e-417e-4758-bf3f-c7776eb536c3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Request method failure captured: Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c HTTP/1.1 Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zQAQZDuBJonqkTNi10cRLehnkn2jgtNo9U7myp9YHvBqvE5z_BAIKxjwNEs42JxCo0WOYUBdVQEC9PIagrL7PyxWnAnfO7VIMVc_zMkhMf0sedT5e16sSk2aHsx5EIaQ78n92eaZzt8xDpUiataqvE034k8uiwduXtrRrG7ZQ8a-Vo Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: X-Openstack-Nova-Api-Version: 2.21 Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 0b9aab7959b743ff94c2c4ae6763af59 Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1783175198 Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0b9aab7959b743ff94c2c4ae6763af59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0b9aab7959b743ff94c2c4ae6763af59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0b9aab7959b743ff94c2c4ae6763af59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0b9aab7959b743ff94c2c4ae6763af59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-InstanceActionsV221TestJSON-1783175198 Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 0b9aab7959b743ff94c2c4ae6763af59 Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1783175198 Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-InstanceActionsV221TestJSON-1783175198-project Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: c09dae6c907d4e7486db30d59b29b0a5 Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-InstanceActionsV221TestJSON-1783175198-project Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance aced12b1-4b92-495f-9a54-9df7e990b05c could not be found. Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'aced12b1-4b92-495f-9a54-9df7e990b05c'} Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aced12b1-4b92-495f-9a54-9df7e990b05c could not be found. Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aced12b1-4b92-495f-9a54-9df7e990b05c could not be found. Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:56.007342 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:45:56.010767 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:56.010767 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:56.010767 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:45:56.010767 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:45:56.010767 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:45:56.010767 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:45:56.010767 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aced12b1-4b92-495f-9a54-9df7e990b05c could not be found. Jul 19 22:45:56.010767 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:56.013055 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4087ca6e-417e-4758-bf3f-c7776eb536c3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] Returning 404 to user: Instance aced12b1-4b92-495f-9a54-9df7e990b05c could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:45:56.016660 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4087ca6e-417e-4758-bf3f-c7776eb536c3 tempest-InstanceActionsV221TestJSON-1783175198 tempest-InstanceActionsV221TestJSON-1783175198-project] 10.222.0.25 "GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c" status: 404 len: 111 microversion: 2.21 time: 0.060413 Jul 19 22:45:56.018263 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1980/3938] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:45:55 2022] GET /compute/v2.1/servers/aced12b1-4b92-495f-9a54-9df7e990b05c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:45:56.029892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-453aa8a4-6819-4e49-9ece-2e9ae4d4d800 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:56.030726 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-453aa8a4-6819-4e49-9ece-2e9ae4d4d800 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:56.055979 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-453aa8a4-6819-4e49-9ece-2e9ae4d4d800 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:56.056513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-453aa8a4-6819-4e49-9ece-2e9ae4d4d800 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:56.057240 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-453aa8a4-6819-4e49-9ece-2e9ae4d4d800 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:56.057683 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-453aa8a4-6819-4e49-9ece-2e9ae4d4d800 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:56.560521 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-453aa8a4-6819-4e49-9ece-2e9ae4d4d800 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:56.569711 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-453aa8a4-6819-4e49-9ece-2e9ae4d4d800 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae" status: 200 len: 1502 microversion: 2.1 time: 0.549446 Jul 19 22:45:56.570933 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1981/3939] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:56 2022] GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae => generated 1502 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:56.578125 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1f7991c1-10f0-406e-87e8-9b463c7970c7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:56.579331 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1f7991c1-10f0-406e-87e8-9b463c7970c7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:56.600074 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1f7991c1-10f0-406e-87e8-9b463c7970c7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:56.600837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1f7991c1-10f0-406e-87e8-9b463c7970c7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:56.603476 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1f7991c1-10f0-406e-87e8-9b463c7970c7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:56.604274 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1f7991c1-10f0-406e-87e8-9b463c7970c7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:58.125666 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-bb6b1c00-0e61-4d85-87d1-a555dcad069d tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:45:58.126257 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-bb6b1c00-0e61-4d85-87d1-a555dcad069d tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:45:58.128118 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-bb6b1c00-0e61-4d85-87d1-a555dcad069d tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:45:58.129181 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-bb6b1c00-0e61-4d85-87d1-a555dcad069d tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:45:58.129671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-bb6b1c00-0e61-4d85-87d1-a555dcad069d tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:45:58.158433 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb6b1c00-0e61-4d85-87d1-a555dcad069d tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:58.159003 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb6b1c00-0e61-4d85-87d1-a555dcad069d tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:58.160602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1f7991c1-10f0-406e-87e8-9b463c7970c7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:58.163823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb6b1c00-0e61-4d85-87d1-a555dcad069d tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:58.164346 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb6b1c00-0e61-4d85-87d1-a555dcad069d tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:58.183269 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1f7991c1-10f0-406e-87e8-9b463c7970c7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1315 microversion: 2.1 time: 1.610621 Jul 19 22:45:58.198542 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1982/3940] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:56 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1315 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:58.204987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aa057fd4-799e-43a9-ae1f-b3f8fde6a5f9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "882f9996-e347-4785-8582-fa7bb82dcc0d"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:58.206708 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-aa057fd4-799e-43a9-ae1f-b3f8fde6a5f9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:58.220472 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-bb6b1c00-0e61-4d85-87d1-a555dcad069d tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Getting quotas for project 30d99d62982b40c8a8ba29137b2e72df. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:45:58.221229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa057fd4-799e-43a9-ae1f-b3f8fde6a5f9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:58.222226 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa057fd4-799e-43a9-ae1f-b3f8fde6a5f9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:58.223688 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa057fd4-799e-43a9-ae1f-b3f8fde6a5f9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:58.224562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa057fd4-799e-43a9-ae1f-b3f8fde6a5f9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:58.240892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-bb6b1c00-0e61-4d85-87d1-a555dcad069d tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Getting quotas for user 4218f795e57244d29c970fb551e1a471 and project 30d99d62982b40c8a8ba29137b2e72df. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:45:58.282409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bb6b1c00-0e61-4d85-87d1-a555dcad069d tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Going to run 3 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:45:58.283809 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-aa057fd4-799e-43a9-ae1f-b3f8fde6a5f9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] HTTP exception thrown: Cannot 'attach_volume' instance 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae while it is in vm_state rescued Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aa057fd4-799e-43a9-ae1f-b3f8fde6a5f9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Request method failure captured: Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae/os-volume_attachments HTTP/1.1 Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 74 Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zPB9pdZx5bGxAOx1bWrMM0FEhH4uLd_pSCvc_RNVR1Ml3e2RdxqyGOtd-lt2kxygYFNrKmFRc3yVX-y9hoY_QR39GzP2XOyLb00mNIcRNYPp_Z40PO_3EFeEpNqlZOyhEu-fa-kVbsARhW2vxsGD8FHWpMQupoNdZ8KLVFw7a76o8s Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 95469b549ae7425a83e0d93bb8c10860 Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1399962716 Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1399962716 Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 95469b549ae7425a83e0d93bb8c10860 Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1399962716 Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerRescueNegativeTestJSON-1399962716-project Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 5f92608789324ac48fef6ce87a745a07 Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1399962716-project Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: {"volumeAttachment": {"volumeId": "882f9996-e347-4785-8582-fa7bb82dcc0d"}} Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: exception: Cannot 'attach_volume' instance 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae while it is in vm_state rescued Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'server_id': '08ecb42e-a6ee-4f1e-976d-33e037bdd6ae', 'body': {'volumeAttachment': {'volumeId': '882f9996-e347-4785-8582-fa7bb82dcc0d'}}} Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 19 22:45:58.286400 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 22:45:58.290893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 22:45:58.290893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 22:45:58.290893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae while it is in vm_state rescued Jul 19 22:45:58.290893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:58.290893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:45:58.290893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:58.290893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:45:58.290893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:45:58.290893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:45:58.290893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:45:58.290893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:45:58.290893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae while it is in vm_state rescued Jul 19 22:45:58.290893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:45:58.292492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bb6b1c00-0e61-4d85-87d1-a555dcad069d tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: 29737cca-d066-4284-9d74-504206263041] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:45:58.293576 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aa057fd4-799e-43a9-ae1f-b3f8fde6a5f9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Returning 409 to user: Cannot 'attach_volume' instance 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae while it is in vm_state rescued {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:45:58.294742 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-aa057fd4-799e-43a9-ae1f-b3f8fde6a5f9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "POST /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.094786 Jul 19 22:45:58.299582 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1983/3941] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 19 22:45:58 2022] POST /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae/os-volume_attachments => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:45:58.307712 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8ca1bf1f-bac1-4991-b8f5-39b65b966799 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:58.308656 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8ca1bf1f-bac1-4991-b8f5-39b65b966799 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:58.318224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ca1bf1f-bac1-4991-b8f5-39b65b966799 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:58.319854 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ca1bf1f-bac1-4991-b8f5-39b65b966799 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:58.321436 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ca1bf1f-bac1-4991-b8f5-39b65b966799 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:58.322180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ca1bf1f-bac1-4991-b8f5-39b65b966799 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:58.356161 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bb6b1c00-0e61-4d85-87d1-a555dcad069d tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: 769cbbd5-9a7b-43ee-bd65-bf62817c4353] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=29737cca-d066-4284-9d74-504206263041,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:45:58.444932 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bb6b1c00-0e61-4d85-87d1-a555dcad069d tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: e0066e47-43b9-49f0-997d-854601201bd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=769cbbd5-9a7b-43ee-bd65-bf62817c4353,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:45:58.598692 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bb6b1c00-0e61-4d85-87d1-a555dcad069d tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.549856 Jul 19 22:45:58.599697 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1959/3942] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:45:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:45:58.627627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b7fcba42-cf6c-44eb-81cd-1517e2b8d44a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:45:58.627879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b7fcba42-cf6c-44eb-81cd-1517e2b8d44a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:58.652262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7fcba42-cf6c-44eb-81cd-1517e2b8d44a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:58.653056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7fcba42-cf6c-44eb-81cd-1517e2b8d44a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:58.654136 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7fcba42-cf6c-44eb-81cd-1517e2b8d44a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:58.655152 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7fcba42-cf6c-44eb-81cd-1517e2b8d44a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:58.862083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8ca1bf1f-bac1-4991-b8f5-39b65b966799 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:58.878623 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8ca1bf1f-bac1-4991-b8f5-39b65b966799 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1309 microversion: 2.1 time: 0.574018 Jul 19 22:45:58.892556 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1984/3943] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:58 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1309 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:58.906577 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-94794dfb-8431-42a4-bbd5-80980d8e0643 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:58.916929 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b7fcba42-cf6c-44eb-81cd-1517e2b8d44a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "POST /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae/action" status: 202 len: 0 microversion: 2.1 time: 0.301874 Jul 19 22:45:58.918861 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-94794dfb-8431-42a4-bbd5-80980d8e0643 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:58.921763 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1960/3944] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:45:58 2022] POST /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:45:58.927307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-94794dfb-8431-42a4-bbd5-80980d8e0643 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Searching by: {'deleted': False, 'project_id': '30d99d62982b40c8a8ba29137b2e72df'} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:45:58.943479 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6b8df253-416c-4e24-a9dd-448700365288 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:58.944496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6b8df253-416c-4e24-a9dd-448700365288 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:58.986773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b8df253-416c-4e24-a9dd-448700365288 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:58.988251 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b8df253-416c-4e24-a9dd-448700365288 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:58.990957 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-94794dfb-8431-42a4-bbd5-80980d8e0643 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:58.991493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-94794dfb-8431-42a4-bbd5-80980d8e0643 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:58.992426 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-94794dfb-8431-42a4-bbd5-80980d8e0643 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:58.992788 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-94794dfb-8431-42a4-bbd5-80980d8e0643 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:58.993693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b8df253-416c-4e24-a9dd-448700365288 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:58.994529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b8df253-416c-4e24-a9dd-448700365288 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:59.055965 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-94794dfb-8431-42a4-bbd5-80980d8e0643 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.153941 Jul 19 22:45:59.057453 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1985/3945] 10.222.0.25 () {58 vars in 1124 bytes} [Tue Jul 19 22:45:58 2022] GET /compute/v2.1/servers => generated 1018 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:45:59.070786 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bb95c19b-ff66-4501-b71e-3bd99b6bcc6e tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:59.072930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bb95c19b-ff66-4501-b71e-3bd99b6bcc6e tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: e0066e47-43b9-49f0-997d-854601201bd7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:59.602269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bb95c19b-ff66-4501-b71e-3bd99b6bcc6e tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:45:59.632138 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bb95c19b-ff66-4501-b71e-3bd99b6bcc6e tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7" status: 200 len: 1223 microversion: 2.1 time: 0.565852 Jul 19 22:45:59.642305 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1986/3946] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:59 2022] GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7 => generated 1223 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:45:59.672671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f7e75cc2-6f20-418d-a6b2-2684c96d16e6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:45:59.673667 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f7e75cc2-6f20-418d-a6b2-2684c96d16e6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:45:59.703053 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f7e75cc2-6f20-418d-a6b2-2684c96d16e6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:59.705032 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f7e75cc2-6f20-418d-a6b2-2684c96d16e6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:45:59.710947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f7e75cc2-6f20-418d-a6b2-2684c96d16e6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:45:59.712473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f7e75cc2-6f20-418d-a6b2-2684c96d16e6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:00.140431 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f7e75cc2-6f20-418d-a6b2-2684c96d16e6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:00.151988 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f7e75cc2-6f20-418d-a6b2-2684c96d16e6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1315 microversion: 2.1 time: 0.504284 Jul 19 22:46:00.157860 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1987/3947] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:59 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1315 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:00.171266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8aa6f681-3cbc-462a-9b48-922d8d4e8d16 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:00.172739 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8aa6f681-3cbc-462a-9b48-922d8d4e8d16 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:00.189119 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8aa6f681-3cbc-462a-9b48-922d8d4e8d16 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:00.194952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8aa6f681-3cbc-462a-9b48-922d8d4e8d16 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:00.199354 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8aa6f681-3cbc-462a-9b48-922d8d4e8d16 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:00.200564 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8aa6f681-3cbc-462a-9b48-922d8d4e8d16 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:00.683892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6b8df253-416c-4e24-a9dd-448700365288 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:00.704515 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6b8df253-416c-4e24-a9dd-448700365288 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae" status: 200 len: 1510 microversion: 2.1 time: 1.776174 Jul 19 22:46:00.705349 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1961/3948] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:45:58 2022] GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae => generated 1510 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:00.720139 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f34a99e4-10ff-4411-a367-bf96e0e769b6 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:00.721296 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f34a99e4-10ff-4411-a367-bf96e0e769b6 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: e0066e47-43b9-49f0-997d-854601201bd7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:00.739245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f34a99e4-10ff-4411-a367-bf96e0e769b6 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:00.744577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f34a99e4-10ff-4411-a367-bf96e0e769b6 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:00.745951 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f34a99e4-10ff-4411-a367-bf96e0e769b6 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:00.746676 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f34a99e4-10ff-4411-a367-bf96e0e769b6 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:01.288139 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f34a99e4-10ff-4411-a367-bf96e0e769b6 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:01.318801 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f34a99e4-10ff-4411-a367-bf96e0e769b6 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7" status: 200 len: 1227 microversion: 2.1 time: 0.612247 Jul 19 22:46:01.322661 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1962/3949] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:00 2022] GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7 => generated 1227 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:01.360783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b2f40064-c683-4103-abf1-7e6cd1b86351 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:01.361918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b2f40064-c683-4103-abf1-7e6cd1b86351 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:01.377529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b2f40064-c683-4103-abf1-7e6cd1b86351 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:01.378638 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b2f40064-c683-4103-abf1-7e6cd1b86351 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:01.379787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b2f40064-c683-4103-abf1-7e6cd1b86351 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:01.380234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b2f40064-c683-4103-abf1-7e6cd1b86351 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:02.304007 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8aa6f681-3cbc-462a-9b48-922d8d4e8d16 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:02.308770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:46:02.336448 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8aa6f681-3cbc-462a-9b48-922d8d4e8d16 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1309 microversion: 2.1 time: 2.173565 Jul 19 22:46:02.340173 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1988/3950] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:00 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1309 bytes in 2181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:02.357205 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-97925343-0d5a-4b20-a8df-2820797c9ad9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:02.357970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-97925343-0d5a-4b20-a8df-2820797c9ad9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:02.372640 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-97925343-0d5a-4b20-a8df-2820797c9ad9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:02.373754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-97925343-0d5a-4b20-a8df-2820797c9ad9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:02.375784 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-97925343-0d5a-4b20-a8df-2820797c9ad9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:02.376675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-97925343-0d5a-4b20-a8df-2820797c9ad9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:03.389055 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b2f40064-c683-4103-abf1-7e6cd1b86351 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:03.428580 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b2f40064-c683-4103-abf1-7e6cd1b86351 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1315 microversion: 2.1 time: 2.087800 Jul 19 22:46:03.432049 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1963/3951] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:01 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1315 bytes in 2109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:03.449504 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7c5b7ea0-98c1-4bfa-9565-bf6af558c533 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:03.450538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7c5b7ea0-98c1-4bfa-9565-bf6af558c533 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: e0066e47-43b9-49f0-997d-854601201bd7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:03.463869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7c5b7ea0-98c1-4bfa-9565-bf6af558c533 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:03.464536 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7c5b7ea0-98c1-4bfa-9565-bf6af558c533 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:03.467160 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7c5b7ea0-98c1-4bfa-9565-bf6af558c533 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:03.467972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7c5b7ea0-98c1-4bfa-9565-bf6af558c533 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:03.477431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:46:03.535331 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-97925343-0d5a-4b20-a8df-2820797c9ad9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:03.543502 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-97925343-0d5a-4b20-a8df-2820797c9ad9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae" status: 200 len: 1510 microversion: 2.1 time: 1.201508 Jul 19 22:46:03.545148 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1989/3952] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:02 2022] GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae => generated 1510 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:03.550763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-f4e2ef05-cc9f-4816-867a-b5a080688996 req-df99ad46-35f0-45a1-8004-7109e032e461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78349902-af4b-44e1-a79e-da1d1217b328", "name": "network-vif-plugged", "status": "completed", "tag": "8ce296ac-f78e-4559-bda4-3615294b6700"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:03.560202 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f4e2ef05-cc9f-4816-867a-b5a080688996 req-df99ad46-35f0-45a1-8004-7109e032e461 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:03.561044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f4e2ef05-cc9f-4816-867a-b5a080688996 req-df99ad46-35f0-45a1-8004-7109e032e461 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:03.576571 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-f4e2ef05-cc9f-4816-867a-b5a080688996 req-df99ad46-35f0-45a1-8004-7109e032e461 service nova] Creating event network-vif-plugged:8ce296ac-f78e-4559-bda4-3615294b6700 for instance 78349902-af4b-44e1-a79e-da1d1217b328 on n-h2-847009-3 Jul 19 22:46:03.582802 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-f4e2ef05-cc9f-4816-867a-b5a080688996 req-df99ad46-35f0-45a1-8004-7109e032e461 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036199 Jul 19 22:46:03.584250 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1990/3953] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:03.592050 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-86d91a1c-4ea4-4a8f-95d6-66d0266eb68c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:03.593555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-86d91a1c-4ea4-4a8f-95d6-66d0266eb68c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:03.605080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86d91a1c-4ea4-4a8f-95d6-66d0266eb68c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:03.606274 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86d91a1c-4ea4-4a8f-95d6-66d0266eb68c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:03.608080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86d91a1c-4ea4-4a8f-95d6-66d0266eb68c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:03.609742 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86d91a1c-4ea4-4a8f-95d6-66d0266eb68c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:03.889075 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7c5b7ea0-98c1-4bfa-9565-bf6af558c533 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:03.901686 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7c5b7ea0-98c1-4bfa-9565-bf6af558c533 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7" status: 200 len: 1281 microversion: 2.1 time: 0.468015 Jul 19 22:46:03.903098 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1964/3954] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:03 2022] GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7 => generated 1281 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:04.454471 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-69868894-257c-44c1-97e7-8b45ff15227b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:04.455130 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-69868894-257c-44c1-97e7-8b45ff15227b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:04.470674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69868894-257c-44c1-97e7-8b45ff15227b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:04.471180 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69868894-257c-44c1-97e7-8b45ff15227b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:04.473467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69868894-257c-44c1-97e7-8b45ff15227b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:04.474667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69868894-257c-44c1-97e7-8b45ff15227b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:04.750980 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-86d91a1c-4ea4-4a8f-95d6-66d0266eb68c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:04.869385 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-86d91a1c-4ea4-4a8f-95d6-66d0266eb68c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1309 microversion: 2.1 time: 1.260379 Jul 19 22:46:04.871606 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1991/3955] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:03 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1309 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:04.906920 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c7aa5cd7-a3cd-4fd2-a246-46cc27e67a59 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:04.907600 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c7aa5cd7-a3cd-4fd2-a246-46cc27e67a59 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:04.929433 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7aa5cd7-a3cd-4fd2-a246-46cc27e67a59 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:04.932408 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7aa5cd7-a3cd-4fd2-a246-46cc27e67a59 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:04.945059 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7aa5cd7-a3cd-4fd2-a246-46cc27e67a59 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:04.950688 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7aa5cd7-a3cd-4fd2-a246-46cc27e67a59 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:05.158913 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-69868894-257c-44c1-97e7-8b45ff15227b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:05.188384 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-69868894-257c-44c1-97e7-8b45ff15227b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1315 microversion: 2.1 time: 0.737510 Jul 19 22:46:05.207503 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1965/3956] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:04 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1315 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:46:05.234783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-41a74d77-aa47-4a75-852c-42d25b4a000d tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:05.234783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-41a74d77-aa47-4a75-852c-42d25b4a000d tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: e0066e47-43b9-49f0-997d-854601201bd7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:05.266259 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41a74d77-aa47-4a75-852c-42d25b4a000d tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:05.270433 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41a74d77-aa47-4a75-852c-42d25b4a000d tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:05.274773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41a74d77-aa47-4a75-852c-42d25b4a000d tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:05.278144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41a74d77-aa47-4a75-852c-42d25b4a000d tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:06.399339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c7aa5cd7-a3cd-4fd2-a246-46cc27e67a59 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:06.424926 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c7aa5cd7-a3cd-4fd2-a246-46cc27e67a59 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae" status: 200 len: 1510 microversion: 2.1 time: 1.550759 Jul 19 22:46:06.437469 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1992/3957] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:04 2022] GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae => generated 1510 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:06.451601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-ceddd3ce-a675-4088-9bb7-87f3b56d6860 req-7eb127b9-b7a1-4afa-92c4-dc23a15a1689 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9eae843-19b8-4300-b28b-cdbfd0039c03", "tag": "94d043ea-312f-4a2f-84a9-a1426a425df2"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:06.475995 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-ceddd3ce-a675-4088-9bb7-87f3b56d6860 req-7eb127b9-b7a1-4afa-92c4-dc23a15a1689 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:06.478046 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-ceddd3ce-a675-4088-9bb7-87f3b56d6860 req-7eb127b9-b7a1-4afa-92c4-dc23a15a1689 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:06.513197 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-ceddd3ce-a675-4088-9bb7-87f3b56d6860 req-7eb127b9-b7a1-4afa-92c4-dc23a15a1689 service nova] Creating event network-changed:94d043ea-312f-4a2f-84a9-a1426a425df2 for instance e9eae843-19b8-4300-b28b-cdbfd0039c03 on n-h1-847009-3 Jul 19 22:46:06.528626 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-ceddd3ce-a675-4088-9bb7-87f3b56d6860 req-7eb127b9-b7a1-4afa-92c4-dc23a15a1689 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085748 Jul 19 22:46:06.531141 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1993/3958] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:06.539188 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-41a74d77-aa47-4a75-852c-42d25b4a000d tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:06.550827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7fdea22c-e3c4-4daf-b01d-5aed6ad08396 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:06.553011 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7fdea22c-e3c4-4daf-b01d-5aed6ad08396 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:06.578880 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7fdea22c-e3c4-4daf-b01d-5aed6ad08396 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:06.583669 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7fdea22c-e3c4-4daf-b01d-5aed6ad08396 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:06.586571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7fdea22c-e3c4-4daf-b01d-5aed6ad08396 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:06.589349 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7fdea22c-e3c4-4daf-b01d-5aed6ad08396 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:06.595629 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-41a74d77-aa47-4a75-852c-42d25b4a000d tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7" status: 200 len: 1323 microversion: 2.1 time: 1.372610 Jul 19 22:46:06.616215 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1966/3959] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:05 2022] GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7 => generated 1323 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:06.643362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-49a83300-b560-473c-b11a-bbc984ff2e90 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:06.648071 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-49a83300-b560-473c-b11a-bbc984ff2e90 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:06.681987 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49a83300-b560-473c-b11a-bbc984ff2e90 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:06.688939 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49a83300-b560-473c-b11a-bbc984ff2e90 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:06.691005 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49a83300-b560-473c-b11a-bbc984ff2e90 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:06.697924 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49a83300-b560-473c-b11a-bbc984ff2e90 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:08.127025 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7fdea22c-e3c4-4daf-b01d-5aed6ad08396 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:08.136294 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7fdea22c-e3c4-4daf-b01d-5aed6ad08396 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1309 microversion: 2.1 time: 1.602647 Jul 19 22:46:08.137925 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1994/3960] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:06 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1309 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:08.146667 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1d16b5e9-21a6-485b-bcca-dc3751e59580 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:08.147958 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1d16b5e9-21a6-485b-bcca-dc3751e59580 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:08.155554 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d16b5e9-21a6-485b-bcca-dc3751e59580 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:08.156007 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d16b5e9-21a6-485b-bcca-dc3751e59580 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:08.156810 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d16b5e9-21a6-485b-bcca-dc3751e59580 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:08.162466 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d16b5e9-21a6-485b-bcca-dc3751e59580 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:08.193401 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:46:08.241068 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-49a83300-b560-473c-b11a-bbc984ff2e90 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:08.251129 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-49a83300-b560-473c-b11a-bbc984ff2e90 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1315 microversion: 2.1 time: 1.632796 Jul 19 22:46:08.252404 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1967/3961] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:06 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1315 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:08.258758 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2664eb9b-2d42-458e-839b-37715f2d3715 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:08.259723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2664eb9b-2d42-458e-839b-37715f2d3715 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: e0066e47-43b9-49f0-997d-854601201bd7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:08.272976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:46:08.289413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2664eb9b-2d42-458e-839b-37715f2d3715 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:08.290069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2664eb9b-2d42-458e-839b-37715f2d3715 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:08.292097 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2664eb9b-2d42-458e-839b-37715f2d3715 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:08.292992 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2664eb9b-2d42-458e-839b-37715f2d3715 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:09.025177 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:46:09.109667 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1d16b5e9-21a6-485b-bcca-dc3751e59580 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:09.144957 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1d16b5e9-21a6-485b-bcca-dc3751e59580 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae" status: 200 len: 1516 microversion: 2.1 time: 0.994930 Jul 19 22:46:09.163646 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1995/3962] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:08 2022] GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae => generated 1516 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:09.169884 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-80b39800-50c5-4f6a-aa36-10fd7defa9b8 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:09.176951 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-80b39800-50c5-4f6a-aa36-10fd7defa9b8 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:09.188202 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-80b39800-50c5-4f6a-aa36-10fd7defa9b8 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:09.189421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-80b39800-50c5-4f6a-aa36-10fd7defa9b8 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:09.190967 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-80b39800-50c5-4f6a-aa36-10fd7defa9b8 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:09.191580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-80b39800-50c5-4f6a-aa36-10fd7defa9b8 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:09.336726 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2664eb9b-2d42-458e-839b-37715f2d3715 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:09.355559 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2664eb9b-2d42-458e-839b-37715f2d3715 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7" status: 200 len: 1323 microversion: 2.1 time: 1.101535 Jul 19 22:46:09.367876 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1968/3963] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:08 2022] GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7 => generated 1323 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:09.384721 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-402115cd-f840-4f28-95f5-c153202218cb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:09.385751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-402115cd-f840-4f28-95f5-c153202218cb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:09.401207 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-402115cd-f840-4f28-95f5-c153202218cb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:09.402051 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-402115cd-f840-4f28-95f5-c153202218cb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:09.405040 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-402115cd-f840-4f28-95f5-c153202218cb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:09.406934 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-402115cd-f840-4f28-95f5-c153202218cb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:09.611381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=24 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:46:10.213177 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-80b39800-50c5-4f6a-aa36-10fd7defa9b8 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:10.222495 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-80b39800-50c5-4f6a-aa36-10fd7defa9b8 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1309 microversion: 2.1 time: 1.057563 Jul 19 22:46:10.223100 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1996/3964] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:09 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1309 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:10.229182 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-402115cd-f840-4f28-95f5-c153202218cb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:10.240091 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-402115cd-f840-4f28-95f5-c153202218cb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1502 microversion: 2.1 time: 0.870712 Jul 19 22:46:10.241145 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1969/3965] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:09 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1502 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:10.259383 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8c8f10b1-ba70-4681-bc26-a4f2542bd0cd tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:10.260164 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8c8f10b1-ba70-4681-bc26-a4f2542bd0cd tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:10.268037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8c8f10b1-ba70-4681-bc26-a4f2542bd0cd tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:10.269521 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8c8f10b1-ba70-4681-bc26-a4f2542bd0cd tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:10.270539 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8c8f10b1-ba70-4681-bc26-a4f2542bd0cd tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:10.271381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8c8f10b1-ba70-4681-bc26-a4f2542bd0cd tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:10.368103 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8c8f10b1-ba70-4681-bc26-a4f2542bd0cd tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328/action" status: 202 len: 0 microversion: 2.1 time: 0.112020 Jul 19 22:46:10.369642 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1997/3966] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:46:10 2022] POST /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:46:10.374426 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bab6be03-c21f-4b17-adb0-984ff8031aa9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:10.377742 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bab6be03-c21f-4b17-adb0-984ff8031aa9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: e0066e47-43b9-49f0-997d-854601201bd7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:10.393959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c088cd7f-68b1-4895-80ee-2d46b5d77548 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:10.394853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bab6be03-c21f-4b17-adb0-984ff8031aa9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:10.395589 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c088cd7f-68b1-4895-80ee-2d46b5d77548 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:10.395885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bab6be03-c21f-4b17-adb0-984ff8031aa9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:10.397330 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bab6be03-c21f-4b17-adb0-984ff8031aa9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:10.398101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bab6be03-c21f-4b17-adb0-984ff8031aa9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:10.408148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c088cd7f-68b1-4895-80ee-2d46b5d77548 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:10.409687 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c088cd7f-68b1-4895-80ee-2d46b5d77548 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:10.411298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c088cd7f-68b1-4895-80ee-2d46b5d77548 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:10.411941 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c088cd7f-68b1-4895-80ee-2d46b5d77548 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:10.932804 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c088cd7f-68b1-4895-80ee-2d46b5d77548 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:10.957046 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c088cd7f-68b1-4895-80ee-2d46b5d77548 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1507 microversion: 2.1 time: 0.568470 Jul 19 22:46:10.958427 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1998/3967] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:10 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1507 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:11.144638 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bab6be03-c21f-4b17-adb0-984ff8031aa9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:11.162702 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bab6be03-c21f-4b17-adb0-984ff8031aa9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7" status: 200 len: 1323 microversion: 2.1 time: 0.793354 Jul 19 22:46:11.175253 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1970/3968] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:10 2022] GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7 => generated 1323 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:11.248350 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-61b4f1ee-e1d9-4ac9-9806-88c9f5c73792 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:11.249872 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-61b4f1ee-e1d9-4ac9-9806-88c9f5c73792 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:11.260533 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-61b4f1ee-e1d9-4ac9-9806-88c9f5c73792 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:11.261211 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-61b4f1ee-e1d9-4ac9-9806-88c9f5c73792 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:11.263003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-61b4f1ee-e1d9-4ac9-9806-88c9f5c73792 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:11.263926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-61b4f1ee-e1d9-4ac9-9806-88c9f5c73792 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:11.962538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bb29a674-6acc-4d65-8a17-77f4f99fefa8 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Action: 'create', calling method: .version_select at 0x7f7a032cc5e0>, body: {"keypair": {"name": "tempest-keypair-367448103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2CJG8r1uhlgXkfvErk8D8HxR66BHSO6qonpC7hxkJVXyn4edSY8B8aardeBe1xcvkgMhn7g/SN4kL65zEiv0mWV38FpUdk4qsDMOzCuiXaErNQBrBMgIXJdzCihdFf/g=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:11.981120 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-bb29a674-6acc-4d65-8a17-77f4f99fefa8 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Getting quotas for project 95469b549ae7425a83e0d93bb8c10860. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:46:11.988289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-bb29a674-6acc-4d65-8a17-77f4f99fefa8 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Getting quotas for user 5f92608789324ac48fef6ce87a745a07 and project 95469b549ae7425a83e0d93bb8c10860. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:46:12.023189 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bb29a674-6acc-4d65-8a17-77f4f99fefa8 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.064289 Jul 19 22:46:12.028026 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1971/3969] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:46:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:12.033557 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5ba885e8-811b-4b67-8c9b-4f3afcac32d9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:12.034739 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5ba885e8-811b-4b67-8c9b-4f3afcac32d9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:12.041705 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-61b4f1ee-e1d9-4ac9-9806-88c9f5c73792 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:12.042464 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ba885e8-811b-4b67-8c9b-4f3afcac32d9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:12.042977 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ba885e8-811b-4b67-8c9b-4f3afcac32d9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:12.043911 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ba885e8-811b-4b67-8c9b-4f3afcac32d9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:12.044254 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ba885e8-811b-4b67-8c9b-4f3afcac32d9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:12.054215 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-61b4f1ee-e1d9-4ac9-9806-88c9f5c73792 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1309 microversion: 2.1 time: 0.817660 Jul 19 22:46:12.055347 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 1999/3970] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:11 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1309 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:12.193278 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c4f5be7d-037d-4059-96da-f1a8559b2383 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:12.193914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c4f5be7d-037d-4059-96da-f1a8559b2383 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: e0066e47-43b9-49f0-997d-854601201bd7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:12.208761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4f5be7d-037d-4059-96da-f1a8559b2383 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:12.209225 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4f5be7d-037d-4059-96da-f1a8559b2383 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:12.210545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4f5be7d-037d-4059-96da-f1a8559b2383 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:12.216171 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4f5be7d-037d-4059-96da-f1a8559b2383 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:12.970128 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5ba885e8-811b-4b67-8c9b-4f3afcac32d9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:12.993555 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5ba885e8-811b-4b67-8c9b-4f3afcac32d9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1487 microversion: 2.1 time: 0.954939 Jul 19 22:46:12.995694 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1972/3971] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:12 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1487 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:13.250249 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-7aabe98c-3798-466d-b409-5fea5a65e0c3 req-ef19d5a9-5b72-4cbb-ac16-f8f08f223135 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0066e47-43b9-49f0-997d-854601201bd7", "tag": "ec3e7b85-ed36-4d1d-bf81-d6db442e631d"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:13.267753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-7aabe98c-3798-466d-b409-5fea5a65e0c3 req-ef19d5a9-5b72-4cbb-ac16-f8f08f223135 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:13.276839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-7aabe98c-3798-466d-b409-5fea5a65e0c3 req-ef19d5a9-5b72-4cbb-ac16-f8f08f223135 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:13.311959 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-7aabe98c-3798-466d-b409-5fea5a65e0c3 req-ef19d5a9-5b72-4cbb-ac16-f8f08f223135 service nova] Creating event network-changed:ec3e7b85-ed36-4d1d-bf81-d6db442e631d for instance e0066e47-43b9-49f0-997d-854601201bd7 on n-h2-847009-3 Jul 19 22:46:13.328598 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-7aabe98c-3798-466d-b409-5fea5a65e0c3 req-ef19d5a9-5b72-4cbb-ac16-f8f08f223135 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.331348 Jul 19 22:46:13.333862 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1973/3972] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:13.341019 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-affd3cdc-7508-42e7-8dc2-9917279a0494 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:13.345889 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-affd3cdc-7508-42e7-8dc2-9917279a0494 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:13.355987 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-affd3cdc-7508-42e7-8dc2-9917279a0494 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:13.356952 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-affd3cdc-7508-42e7-8dc2-9917279a0494 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:13.357992 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-affd3cdc-7508-42e7-8dc2-9917279a0494 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:13.358638 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-affd3cdc-7508-42e7-8dc2-9917279a0494 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:13.402912 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-affd3cdc-7508-42e7-8dc2-9917279a0494 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lazy-loading 'flavor' on Instance uuid 78349902-af4b-44e1-a79e-da1d1217b328 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:46:13.706841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c4f5be7d-037d-4059-96da-f1a8559b2383 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:13.718348 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c4f5be7d-037d-4059-96da-f1a8559b2383 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7" status: 200 len: 1323 microversion: 2.1 time: 1.529924 Jul 19 22:46:13.729002 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2000/3973] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:12 2022] GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7 => generated 1323 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:13.745172 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4709e314-dbb0-4ced-a69d-a6e523b3c425 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:13.745808 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4709e314-dbb0-4ced-a69d-a6e523b3c425 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:13.756499 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4709e314-dbb0-4ced-a69d-a6e523b3c425 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:13.757325 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4709e314-dbb0-4ced-a69d-a6e523b3c425 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:13.758345 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4709e314-dbb0-4ced-a69d-a6e523b3c425 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:13.759003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4709e314-dbb0-4ced-a69d-a6e523b3c425 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:14.149816 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-affd3cdc-7508-42e7-8dc2-9917279a0494 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328/action" status: 202 len: 0 microversion: 2.1 time: 0.814121 Jul 19 22:46:14.154132 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1974/3974] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:46:13 2022] POST /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328/action => generated 0 bytes in 819 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:46:14.170792 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-39e1e46c-15a5-4451-84da-345962f86c31 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:14.171963 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-39e1e46c-15a5-4451-84da-345962f86c31 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:14.184989 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39e1e46c-15a5-4451-84da-345962f86c31 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:14.185627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39e1e46c-15a5-4451-84da-345962f86c31 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:14.187015 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39e1e46c-15a5-4451-84da-345962f86c31 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:14.188163 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39e1e46c-15a5-4451-84da-345962f86c31 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:14.492090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4709e314-dbb0-4ced-a69d-a6e523b3c425 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:14.525836 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4709e314-dbb0-4ced-a69d-a6e523b3c425 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1309 microversion: 2.1 time: 0.791979 Jul 19 22:46:14.547746 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2001/3975] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:13 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1309 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:14.744444 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-13710213-fa3d-4ee6-99dc-01346f5e9c63 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:14.748481 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-13710213-fa3d-4ee6-99dc-01346f5e9c63 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: e0066e47-43b9-49f0-997d-854601201bd7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:14.800745 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-13710213-fa3d-4ee6-99dc-01346f5e9c63 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:14.806729 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-13710213-fa3d-4ee6-99dc-01346f5e9c63 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:14.809412 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-13710213-fa3d-4ee6-99dc-01346f5e9c63 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:14.814851 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-13710213-fa3d-4ee6-99dc-01346f5e9c63 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:15.016906 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-39e1e46c-15a5-4451-84da-345962f86c31 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:15.028455 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-39e1e46c-15a5-4451-84da-345962f86c31 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1493 microversion: 2.1 time: 0.869693 Jul 19 22:46:15.030008 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1975/3976] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:14 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1493 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:46:15.040270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-31f124da-cc15-4940-a1aa-b83e8a6a3c51 req-1a660475-471c-46af-bf20-144563600177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29737cca-d066-4284-9d74-504206263041", "tag": "905cdeb6-53a6-4423-9252-7f6f1a9beff0"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:15.058428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-31f124da-cc15-4940-a1aa-b83e8a6a3c51 req-1a660475-471c-46af-bf20-144563600177 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:15.059635 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-31f124da-cc15-4940-a1aa-b83e8a6a3c51 req-1a660475-471c-46af-bf20-144563600177 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:15.077250 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-31f124da-cc15-4940-a1aa-b83e8a6a3c51 req-1a660475-471c-46af-bf20-144563600177 service nova] Creating event network-changed:905cdeb6-53a6-4423-9252-7f6f1a9beff0 for instance 29737cca-d066-4284-9d74-504206263041 on n-h1-847009-3 Jul 19 22:46:15.085605 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-31f124da-cc15-4940-a1aa-b83e8a6a3c51 req-1a660475-471c-46af-bf20-144563600177 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054087 Jul 19 22:46:15.087574 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1976/3977] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:15.308457 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-13710213-fa3d-4ee6-99dc-01346f5e9c63 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:15.332434 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-13710213-fa3d-4ee6-99dc-01346f5e9c63 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7" status: 200 len: 1323 microversion: 2.1 time: 0.597092 Jul 19 22:46:15.335053 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2002/3978] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:14 2022] GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7 => generated 1323 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:15.556590 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-27ee8ae0-98ba-4729-a77d-f619b6f238c6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:15.557940 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-27ee8ae0-98ba-4729-a77d-f619b6f238c6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:15.580116 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-27ee8ae0-98ba-4729-a77d-f619b6f238c6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:15.581390 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-27ee8ae0-98ba-4729-a77d-f619b6f238c6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:15.582513 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-27ee8ae0-98ba-4729-a77d-f619b6f238c6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:15.583284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-27ee8ae0-98ba-4729-a77d-f619b6f238c6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:15.799198 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-7166e297-5dca-4412-90c0-f8ec0eb3d707 req-40d17355-92ce-4328-beac-4a3812acf2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "769cbbd5-9a7b-43ee-bd65-bf62817c4353", "tag": "3decaa7b-1da5-4f02-8391-bbd7b18f207a"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:15.848663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7166e297-5dca-4412-90c0-f8ec0eb3d707 req-40d17355-92ce-4328-beac-4a3812acf2a4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:15.850799 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7166e297-5dca-4412-90c0-f8ec0eb3d707 req-40d17355-92ce-4328-beac-4a3812acf2a4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:15.874563 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-7166e297-5dca-4412-90c0-f8ec0eb3d707 req-40d17355-92ce-4328-beac-4a3812acf2a4 service nova] Creating event network-changed:3decaa7b-1da5-4f02-8391-bbd7b18f207a for instance 769cbbd5-9a7b-43ee-bd65-bf62817c4353 on n-h1-847009-3 Jul 19 22:46:15.891377 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-7166e297-5dca-4412-90c0-f8ec0eb3d707 req-40d17355-92ce-4328-beac-4a3812acf2a4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102855 Jul 19 22:46:15.895326 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2003/3979] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:16.051238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-07affe27-8c3e-4d46-adca-c88b9eb186e9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:16.052129 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-07affe27-8c3e-4d46-adca-c88b9eb186e9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:16.060618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07affe27-8c3e-4d46-adca-c88b9eb186e9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:16.061569 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07affe27-8c3e-4d46-adca-c88b9eb186e9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:16.063214 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07affe27-8c3e-4d46-adca-c88b9eb186e9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:16.063853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07affe27-8c3e-4d46-adca-c88b9eb186e9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:16.274115 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-27ee8ae0-98ba-4729-a77d-f619b6f238c6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:16.286652 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-27ee8ae0-98ba-4729-a77d-f619b6f238c6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1309 microversion: 2.1 time: 0.734668 Jul 19 22:46:16.300332 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1977/3980] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:15 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1309 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:16.353473 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2aa0c145-be94-492f-9c3a-6d249a83bb18 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:16.354118 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2aa0c145-be94-492f-9c3a-6d249a83bb18 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: e0066e47-43b9-49f0-997d-854601201bd7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:16.361568 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2aa0c145-be94-492f-9c3a-6d249a83bb18 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:16.363211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2aa0c145-be94-492f-9c3a-6d249a83bb18 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:16.364578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2aa0c145-be94-492f-9c3a-6d249a83bb18 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:16.365270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2aa0c145-be94-492f-9c3a-6d249a83bb18 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:16.802666 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-07affe27-8c3e-4d46-adca-c88b9eb186e9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:16.817412 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-07affe27-8c3e-4d46-adca-c88b9eb186e9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1514 microversion: 2.1 time: 0.772542 Jul 19 22:46:16.825322 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2004/3981] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:16 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1514 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:16.837691 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-8995934f-a781-486b-a21f-2170e71b63de req-68294322-3e54-4bf7-bbc3-512854f7cc05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9eae843-19b8-4300-b28b-cdbfd0039c03", "name": "network-vif-plugged", "status": "completed", "tag": "94d043ea-312f-4a2f-84a9-a1426a425df2"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:16.855660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:46:16.889242 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-8995934f-a781-486b-a21f-2170e71b63de req-68294322-3e54-4bf7-bbc3-512854f7cc05 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:16.890197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-8995934f-a781-486b-a21f-2170e71b63de req-68294322-3e54-4bf7-bbc3-512854f7cc05 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:16.957301 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2aa0c145-be94-492f-9c3a-6d249a83bb18 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:16.958220 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-8995934f-a781-486b-a21f-2170e71b63de req-68294322-3e54-4bf7-bbc3-512854f7cc05 service nova] Creating event network-vif-plugged:94d043ea-312f-4a2f-84a9-a1426a425df2 for instance e9eae843-19b8-4300-b28b-cdbfd0039c03 on n-h1-847009-3 Jul 19 22:46:16.970047 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-8995934f-a781-486b-a21f-2170e71b63de req-68294322-3e54-4bf7-bbc3-512854f7cc05 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142853 Jul 19 22:46:16.970688 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2005/3982] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:16.972562 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2aa0c145-be94-492f-9c3a-6d249a83bb18 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7" status: 200 len: 1323 microversion: 2.1 time: 0.622357 Jul 19 22:46:16.975076 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1978/3983] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:16 2022] GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7 => generated 1323 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:17.307215 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8d832943-e05a-48d8-a4de-f5f77ce934f0 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:17.307943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8d832943-e05a-48d8-a4de-f5f77ce934f0 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:17.319952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d832943-e05a-48d8-a4de-f5f77ce934f0 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:17.320428 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d832943-e05a-48d8-a4de-f5f77ce934f0 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:17.321323 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d832943-e05a-48d8-a4de-f5f77ce934f0 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:17.321668 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d832943-e05a-48d8-a4de-f5f77ce934f0 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:17.837917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1a32300f-5149-469f-ae32-93bb00a12167 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:17.838970 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1a32300f-5149-469f-ae32-93bb00a12167 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:17.862091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a32300f-5149-469f-ae32-93bb00a12167 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:17.862891 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a32300f-5149-469f-ae32-93bb00a12167 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:17.864018 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a32300f-5149-469f-ae32-93bb00a12167 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:17.864472 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a32300f-5149-469f-ae32-93bb00a12167 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:18.349581 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8d832943-e05a-48d8-a4de-f5f77ce934f0 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:18.367306 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8d832943-e05a-48d8-a4de-f5f77ce934f0 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1309 microversion: 2.1 time: 1.064232 Jul 19 22:46:18.379498 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2006/3984] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:17 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1309 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:46:18.390608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9ac45d04-06f7-414a-aa5b-eb0b9804d24c tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:18.392072 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9ac45d04-06f7-414a-aa5b-eb0b9804d24c tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: e0066e47-43b9-49f0-997d-854601201bd7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:18.403393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ac45d04-06f7-414a-aa5b-eb0b9804d24c tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:18.404175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ac45d04-06f7-414a-aa5b-eb0b9804d24c tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:18.405661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ac45d04-06f7-414a-aa5b-eb0b9804d24c tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:18.406381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ac45d04-06f7-414a-aa5b-eb0b9804d24c tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:18.452572 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:46:19.494869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9ac45d04-06f7-414a-aa5b-eb0b9804d24c tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:19.504115 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9ac45d04-06f7-414a-aa5b-eb0b9804d24c tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7" status: 200 len: 1323 microversion: 2.1 time: 1.122777 Jul 19 22:46:19.513013 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2007/3985] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:18 2022] GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7 => generated 1323 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:19.519224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-74755771-9459-4eda-9b6d-65770b5c60fe tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-781100216", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77eff502-40d6-4b6e-8d67-74356e21174d"}], "security_groups": [{"name": "tempest-securitygroup--1564284721"}], "key_name": "tempest-keypair-367448103", "user_data": "}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:19.634574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1a32300f-5149-469f-ae32-93bb00a12167 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:19.659807 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1a32300f-5149-469f-ae32-93bb00a12167 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1509 microversion: 2.1 time: 1.824951 Jul 19 22:46:19.668625 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1979/3986] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:17 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1509 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:46:19.676164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-352a85a2-e07c-43ba-9a4a-c2f76f545c06 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:19.676794 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-352a85a2-e07c-43ba-9a4a-c2f76f545c06 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:19.698248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-352a85a2-e07c-43ba-9a4a-c2f76f545c06 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:19.698717 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-352a85a2-e07c-43ba-9a4a-c2f76f545c06 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:19.699555 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-352a85a2-e07c-43ba-9a4a-c2f76f545c06 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:19.700141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-352a85a2-e07c-43ba-9a4a-c2f76f545c06 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:20.305422 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-74755771-9459-4eda-9b6d-65770b5c60fe tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] validate_networks() for [('77eff502-40d6-4b6e-8d67-74356e21174d', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:46:20.586211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-352a85a2-e07c-43ba-9a4a-c2f76f545c06 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:20.598898 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-352a85a2-e07c-43ba-9a4a-c2f76f545c06 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1309 microversion: 2.1 time: 0.929246 Jul 19 22:46:20.600324 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1980/3987] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:19 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1309 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:20.623420 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-14841db2-ffaf-47f4-8502-84890df783d2 req-0a93833d-a790-43fd-b3e4-07a2d277dfc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78349902-af4b-44e1-a79e-da1d1217b328", "name": "network-vif-plugged", "status": "completed", "tag": "8ce296ac-f78e-4559-bda4-3615294b6700"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:20.641849 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-14841db2-ffaf-47f4-8502-84890df783d2 req-0a93833d-a790-43fd-b3e4-07a2d277dfc4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:20.642478 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-14841db2-ffaf-47f4-8502-84890df783d2 req-0a93833d-a790-43fd-b3e4-07a2d277dfc4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:20.654499 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:46:20.657607 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-14841db2-ffaf-47f4-8502-84890df783d2 req-0a93833d-a790-43fd-b3e4-07a2d277dfc4 service nova] Creating event network-vif-plugged:8ce296ac-f78e-4559-bda4-3615294b6700 for instance 78349902-af4b-44e1-a79e-da1d1217b328 on n-h2-847009-3 Jul 19 22:46:20.667827 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-14841db2-ffaf-47f4-8502-84890df783d2 req-0a93833d-a790-43fd-b3e4-07a2d277dfc4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054996 Jul 19 22:46:20.669178 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1981/3988] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:20.681346 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1b0fa087-83c4-4430-ae6a-459e7fd8bbdb tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:20.682388 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1b0fa087-83c4-4430-ae6a-459e7fd8bbdb tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: e0066e47-43b9-49f0-997d-854601201bd7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:20.693244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b0fa087-83c4-4430-ae6a-459e7fd8bbdb tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:20.694067 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b0fa087-83c4-4430-ae6a-459e7fd8bbdb tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:20.696087 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b0fa087-83c4-4430-ae6a-459e7fd8bbdb tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:20.696742 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b0fa087-83c4-4430-ae6a-459e7fd8bbdb tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:21.452099 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1b0fa087-83c4-4430-ae6a-459e7fd8bbdb tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:21.474335 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1b0fa087-83c4-4430-ae6a-459e7fd8bbdb tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7" status: 200 len: 1323 microversion: 2.1 time: 0.803042 Jul 19 22:46:21.485895 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1982/3989] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:20 2022] GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7 => generated 1323 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:21.507553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d6bad013-0677-4db1-bff6-18891bc48f4d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:21.511970 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d6bad013-0677-4db1-bff6-18891bc48f4d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:21.538162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d6bad013-0677-4db1-bff6-18891bc48f4d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:21.538912 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d6bad013-0677-4db1-bff6-18891bc48f4d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:21.539926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d6bad013-0677-4db1-bff6-18891bc48f4d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:21.540507 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d6bad013-0677-4db1-bff6-18891bc48f4d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:21.998401 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=4 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:46:22.670108 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d6bad013-0677-4db1-bff6-18891bc48f4d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:22.702136 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d6bad013-0677-4db1-bff6-18891bc48f4d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1509 microversion: 2.1 time: 1.203208 Jul 19 22:46:22.707005 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1983/3990] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:21 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1509 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:22.724937 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f8e8910d-30e8-4d25-88ae-871fa80d7085 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:22.727696 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f8e8910d-30e8-4d25-88ae-871fa80d7085 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:22.745531 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f8e8910d-30e8-4d25-88ae-871fa80d7085 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:22.746941 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f8e8910d-30e8-4d25-88ae-871fa80d7085 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:22.748079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f8e8910d-30e8-4d25-88ae-871fa80d7085 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:22.749211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f8e8910d-30e8-4d25-88ae-871fa80d7085 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:22.773800 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-74755771-9459-4eda-9b6d-65770b5c60fe tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:46:22.776310 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-74755771-9459-4eda-9b6d-65770b5c60fe tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:46:22.776970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-74755771-9459-4eda-9b6d-65770b5c60fe tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:46:22.777561 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-74755771-9459-4eda-9b6d-65770b5c60fe tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:46:22.779450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-74755771-9459-4eda-9b6d-65770b5c60fe tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:46:22.809242 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-74755771-9459-4eda-9b6d-65770b5c60fe tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:22.812566 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-74755771-9459-4eda-9b6d-65770b5c60fe tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:22.813621 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-74755771-9459-4eda-9b6d-65770b5c60fe tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:22.818454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-74755771-9459-4eda-9b6d-65770b5c60fe tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:22.886972 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-74755771-9459-4eda-9b6d-65770b5c60fe tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Getting quotas for project 95469b549ae7425a83e0d93bb8c10860. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:46:22.895434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-74755771-9459-4eda-9b6d-65770b5c60fe tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Getting quotas for user 5f92608789324ac48fef6ce87a745a07 and project 95469b549ae7425a83e0d93bb8c10860. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:46:22.932092 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-74755771-9459-4eda-9b6d-65770b5c60fe tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:46:22.934811 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-74755771-9459-4eda-9b6d-65770b5c60fe tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:46:23.049851 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-74755771-9459-4eda-9b6d-65770b5c60fe tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.535032 Jul 19 22:46:23.051421 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2008/3991] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:46:19 2022] POST /compute/v2.1/servers => generated 409 bytes in 3538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:46:23.061217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1adf27b3-458e-4149-bfe3-4ceffba94e8b tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:23.062347 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1adf27b3-458e-4149-bfe3-4ceffba94e8b tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: e0066e47-43b9-49f0-997d-854601201bd7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:23.074804 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1adf27b3-458e-4149-bfe3-4ceffba94e8b tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:23.079064 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1adf27b3-458e-4149-bfe3-4ceffba94e8b tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:23.080188 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1adf27b3-458e-4149-bfe3-4ceffba94e8b tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:23.081614 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1adf27b3-458e-4149-bfe3-4ceffba94e8b tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:23.202563 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f8e8910d-30e8-4d25-88ae-871fa80d7085 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:23.215998 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f8e8910d-30e8-4d25-88ae-871fa80d7085 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1490 microversion: 2.1 time: 0.504812 Jul 19 22:46:23.237641 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1984/3992] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:22 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1490 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:23.244057 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-4288df86-1b79-406f-9cf9-5181bc19d2c6 req-e8e4daa3-eb22-46fe-a61b-89501d687e4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29737cca-d066-4284-9d74-504206263041", "name": "network-vif-plugged", "status": "completed", "tag": "905cdeb6-53a6-4423-9252-7f6f1a9beff0"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:23.281274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-4288df86-1b79-406f-9cf9-5181bc19d2c6 req-e8e4daa3-eb22-46fe-a61b-89501d687e4c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:23.282588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-4288df86-1b79-406f-9cf9-5181bc19d2c6 req-e8e4daa3-eb22-46fe-a61b-89501d687e4c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:23.309860 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-4288df86-1b79-406f-9cf9-5181bc19d2c6 req-e8e4daa3-eb22-46fe-a61b-89501d687e4c service nova] Creating event network-vif-plugged:905cdeb6-53a6-4423-9252-7f6f1a9beff0 for instance 29737cca-d066-4284-9d74-504206263041 on n-h1-847009-3 Jul 19 22:46:23.321617 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-4288df86-1b79-406f-9cf9-5181bc19d2c6 req-e8e4daa3-eb22-46fe-a61b-89501d687e4c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080611 Jul 19 22:46:23.324251 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1985/3993] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:23.334928 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8d23a72b-6af1-40f2-9742-8de8ca9c7509 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:23.336208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8d23a72b-6af1-40f2-9742-8de8ca9c7509 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:23.398450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1adf27b3-458e-4149-bfe3-4ceffba94e8b tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:23.429688 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1adf27b3-458e-4149-bfe3-4ceffba94e8b tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7" status: 200 len: 1323 microversion: 2.1 time: 0.374886 Jul 19 22:46:23.431759 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2009/3994] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:23 2022] GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7 => generated 1323 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:23.439436 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a9c05ae6-acea-45d2-bb72-c0c8b1ea120e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1469046488"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:23.449113 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a9c05ae6-acea-45d2-bb72-c0c8b1ea120e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:23.466397 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a9c05ae6-acea-45d2-bb72-c0c8b1ea120e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:23.467230 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a9c05ae6-acea-45d2-bb72-c0c8b1ea120e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:23.468303 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a9c05ae6-acea-45d2-bb72-c0c8b1ea120e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:23.468972 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a9c05ae6-acea-45d2-bb72-c0c8b1ea120e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:23.530864 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8d23a72b-6af1-40f2-9742-8de8ca9c7509 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:23.540553 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8d23a72b-6af1-40f2-9742-8de8ca9c7509 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1244 microversion: 2.1 time: 0.214624 Jul 19 22:46:23.544355 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1986/3995] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:23 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1244 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:23.649070 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a9c05ae6-acea-45d2-bb72-c0c8b1ea120e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "PUT /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1075 microversion: 2.1 time: 0.213270 Jul 19 22:46:23.659863 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2010/3996] 10.222.0.25 () {60 vars in 1255 bytes} [Tue Jul 19 22:46:23 2022] PUT /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1075 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:23.666706 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c61d6d6b-8c84-4fd8-b7d2-0070020d1dd2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:23.667613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c61d6d6b-8c84-4fd8-b7d2-0070020d1dd2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:23.681261 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c61d6d6b-8c84-4fd8-b7d2-0070020d1dd2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:23.681667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c61d6d6b-8c84-4fd8-b7d2-0070020d1dd2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:23.682496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c61d6d6b-8c84-4fd8-b7d2-0070020d1dd2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:23.683024 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c61d6d6b-8c84-4fd8-b7d2-0070020d1dd2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:23.719557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-390bac77-f0d3-4ec4-8fcf-209062b9a0d2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:23.720201 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-390bac77-f0d3-4ec4-8fcf-209062b9a0d2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:23.743303 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-390bac77-f0d3-4ec4-8fcf-209062b9a0d2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:23.743777 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-390bac77-f0d3-4ec4-8fcf-209062b9a0d2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:23.744768 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-390bac77-f0d3-4ec4-8fcf-209062b9a0d2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:23.745558 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-390bac77-f0d3-4ec4-8fcf-209062b9a0d2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:24.029085 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c61d6d6b-8c84-4fd8-b7d2-0070020d1dd2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:24.044008 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c61d6d6b-8c84-4fd8-b7d2-0070020d1dd2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1501 microversion: 2.1 time: 0.382155 Jul 19 22:46:24.045215 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1987/3997] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:23 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1501 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:46:24.062549 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0ab4d348-d3eb-4aeb-81a5-1e158b9f3ff6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:24.070044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-390bac77-f0d3-4ec4-8fcf-209062b9a0d2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:24.072423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0ab4d348-d3eb-4aeb-81a5-1e158b9f3ff6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:24.090588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ab4d348-d3eb-4aeb-81a5-1e158b9f3ff6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:24.092551 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ab4d348-d3eb-4aeb-81a5-1e158b9f3ff6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:24.096870 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-390bac77-f0d3-4ec4-8fcf-209062b9a0d2 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1509 microversion: 2.1 time: 0.379508 Jul 19 22:46:24.097344 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ab4d348-d3eb-4aeb-81a5-1e158b9f3ff6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:24.097704 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2011/3998] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:23 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1509 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:46:24.099192 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ab4d348-d3eb-4aeb-81a5-1e158b9f3ff6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:24.449869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2f262b18-237b-4854-b0d4-3ea4fb99c372 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:24.450719 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2f262b18-237b-4854-b0d4-3ea4fb99c372 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: e0066e47-43b9-49f0-997d-854601201bd7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:24.463126 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f262b18-237b-4854-b0d4-3ea4fb99c372 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:24.463878 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f262b18-237b-4854-b0d4-3ea4fb99c372 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:24.467413 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f262b18-237b-4854-b0d4-3ea4fb99c372 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:24.468055 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f262b18-237b-4854-b0d4-3ea4fb99c372 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:24.546510 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0ab4d348-d3eb-4aeb-81a5-1e158b9f3ff6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:24.577769 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0ab4d348-d3eb-4aeb-81a5-1e158b9f3ff6 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1501 microversion: 2.1 time: 0.518854 Jul 19 22:46:24.589649 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1988/3999] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:24 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1501 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:24.596464 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-296a5dc0-4f16-43b4-bb45-f58e22bb05ac tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:24.599000 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-296a5dc0-4f16-43b4-bb45-f58e22bb05ac tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:24.637082 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-296a5dc0-4f16-43b4-bb45-f58e22bb05ac tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:24.637528 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-296a5dc0-4f16-43b4-bb45-f58e22bb05ac tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:24.647149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-296a5dc0-4f16-43b4-bb45-f58e22bb05ac tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:24.647149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-296a5dc0-4f16-43b4-bb45-f58e22bb05ac tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:24.841787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-296a5dc0-4f16-43b4-bb45-f58e22bb05ac tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:24.871268 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2f262b18-237b-4854-b0d4-3ea4fb99c372 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:24.890029 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-296a5dc0-4f16-43b4-bb45-f58e22bb05ac tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1296 microversion: 2.1 time: 0.303205 Jul 19 22:46:24.895577 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1989/4000] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:24 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1296 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:24.900439 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2f262b18-237b-4854-b0d4-3ea4fb99c372 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7" status: 200 len: 1323 microversion: 2.1 time: 0.454173 Jul 19 22:46:24.915313 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2012/4001] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:24 2022] GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7 => generated 1323 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:24.928926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f1ad7c6b-ea9b-4f40-b72d-8627a983c752 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:24.963614 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:46:24.998377 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f1ad7c6b-ea9b-4f40-b72d-8627a983c752 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:24.999365 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f1ad7c6b-ea9b-4f40-b72d-8627a983c752 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:25.079994 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f1ad7c6b-ea9b-4f40-b72d-8627a983c752 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Going to try to stop instance {{(pid=119337) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 22:46:25.115547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-eac32a28-a4a7-43d8-a6ca-bf4831f4382e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:25.116540 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-eac32a28-a4a7-43d8-a6ca-bf4831f4382e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:25.152651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eac32a28-a4a7-43d8-a6ca-bf4831f4382e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:25.153355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eac32a28-a4a7-43d8-a6ca-bf4831f4382e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:25.159640 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eac32a28-a4a7-43d8-a6ca-bf4831f4382e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:25.160152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eac32a28-a4a7-43d8-a6ca-bf4831f4382e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:25.249443 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f1ad7c6b-ea9b-4f40-b72d-8627a983c752 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "POST /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03/action" status: 202 len: 0 microversion: 2.1 time: 0.347611 Jul 19 22:46:25.253127 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1990/4002] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:46:24 2022] POST /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:46:25.271743 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2e3f9d7a-5ebb-4ff2-b648-3aa8c95ccb55 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:25.272536 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2e3f9d7a-5ebb-4ff2-b648-3aa8c95ccb55 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:25.289060 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e3f9d7a-5ebb-4ff2-b648-3aa8c95ccb55 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:25.289583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e3f9d7a-5ebb-4ff2-b648-3aa8c95ccb55 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:25.290557 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e3f9d7a-5ebb-4ff2-b648-3aa8c95ccb55 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:25.291914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e3f9d7a-5ebb-4ff2-b648-3aa8c95ccb55 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:25.875010 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2e3f9d7a-5ebb-4ff2-b648-3aa8c95ccb55 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:25.883942 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2e3f9d7a-5ebb-4ff2-b648-3aa8c95ccb55 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1511 microversion: 2.1 time: 0.625823 Jul 19 22:46:25.884543 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1991/4003] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:25 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1511 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:25.904585 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-a2ae92b7-f6f3-4aa6-92c2-4b8f80ffa8de req-f11e4ac8-d874-495c-863c-874bc4681f55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0066e47-43b9-49f0-997d-854601201bd7", "name": "network-vif-plugged", "status": "completed", "tag": "ec3e7b85-ed36-4d1d-bf81-d6db442e631d"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:25.969706 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a2ae92b7-f6f3-4aa6-92c2-4b8f80ffa8de req-f11e4ac8-d874-495c-863c-874bc4681f55 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:25.971236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a2ae92b7-f6f3-4aa6-92c2-4b8f80ffa8de req-f11e4ac8-d874-495c-863c-874bc4681f55 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:26.012499 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-a2ae92b7-f6f3-4aa6-92c2-4b8f80ffa8de req-f11e4ac8-d874-495c-863c-874bc4681f55 service nova] Creating event network-vif-plugged:ec3e7b85-ed36-4d1d-bf81-d6db442e631d for instance e0066e47-43b9-49f0-997d-854601201bd7 on n-h2-847009-3 Jul 19 22:46:26.049997 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-a2ae92b7-f6f3-4aa6-92c2-4b8f80ffa8de req-f11e4ac8-d874-495c-863c-874bc4681f55 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163419 Jul 19 22:46:26.050773 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1992/4004] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:26.084787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-007cacbb-5f71-459a-8210-cdc505c9bc26 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:26.088490 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-eac32a28-a4a7-43d8-a6ca-bf4831f4382e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:26.089417 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-007cacbb-5f71-459a-8210-cdc505c9bc26 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:26.105928 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-007cacbb-5f71-459a-8210-cdc505c9bc26 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:26.116583 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-eac32a28-a4a7-43d8-a6ca-bf4831f4382e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1509 microversion: 2.1 time: 1.006304 Jul 19 22:46:26.117573 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2013/4005] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:25 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1509 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:46:26.120221 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-007cacbb-5f71-459a-8210-cdc505c9bc26 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:26.122530 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-13050c6e-2e93-4c84-b5f0-dbb1c52bc83b tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:26.123183 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-13050c6e-2e93-4c84-b5f0-dbb1c52bc83b tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: e0066e47-43b9-49f0-997d-854601201bd7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:26.123917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-007cacbb-5f71-459a-8210-cdc505c9bc26 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:26.124749 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-007cacbb-5f71-459a-8210-cdc505c9bc26 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:26.140366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-13050c6e-2e93-4c84-b5f0-dbb1c52bc83b tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:26.140847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-13050c6e-2e93-4c84-b5f0-dbb1c52bc83b tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:26.141704 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-13050c6e-2e93-4c84-b5f0-dbb1c52bc83b tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:26.142175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-13050c6e-2e93-4c84-b5f0-dbb1c52bc83b tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:26.342791 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-007cacbb-5f71-459a-8210-cdc505c9bc26 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:26.357357 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-007cacbb-5f71-459a-8210-cdc505c9bc26 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1302 microversion: 2.1 time: 0.292819 Jul 19 22:46:26.359683 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1993/4006] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:26 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1302 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:26.688752 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-13050c6e-2e93-4c84-b5f0-dbb1c52bc83b tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:26.709481 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-13050c6e-2e93-4c84-b5f0-dbb1c52bc83b tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7" status: 200 len: 1323 microversion: 2.1 time: 0.590667 Jul 19 22:46:26.710835 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2014/4007] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:26 2022] GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7 => generated 1323 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:26.903998 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2c2f7e92-0ebd-481f-b417-3563925d2b28 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:26.904968 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2c2f7e92-0ebd-481f-b417-3563925d2b28 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:26.920834 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2c2f7e92-0ebd-481f-b417-3563925d2b28 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:26.923743 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2c2f7e92-0ebd-481f-b417-3563925d2b28 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:26.926915 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2c2f7e92-0ebd-481f-b417-3563925d2b28 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:26.930280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2c2f7e92-0ebd-481f-b417-3563925d2b28 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:27.134715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-83eb3a00-e9b8-4d11-97b7-59b705a3436e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:27.135967 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-83eb3a00-e9b8-4d11-97b7-59b705a3436e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:27.145106 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-83eb3a00-e9b8-4d11-97b7-59b705a3436e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:27.145852 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-83eb3a00-e9b8-4d11-97b7-59b705a3436e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:27.146808 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-83eb3a00-e9b8-4d11-97b7-59b705a3436e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:27.147431 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-83eb3a00-e9b8-4d11-97b7-59b705a3436e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:27.543101 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-83eb3a00-e9b8-4d11-97b7-59b705a3436e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:27.562114 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-83eb3a00-e9b8-4d11-97b7-59b705a3436e tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1509 microversion: 2.1 time: 0.430983 Jul 19 22:46:27.563520 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2015/4008] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:27 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1509 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:46:27.570199 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f956aa7b-0010-41ba-b58a-db3dfe16646a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:27.571138 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f956aa7b-0010-41ba-b58a-db3dfe16646a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:27.598266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f956aa7b-0010-41ba-b58a-db3dfe16646a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:27.599532 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f956aa7b-0010-41ba-b58a-db3dfe16646a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:27.601214 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f956aa7b-0010-41ba-b58a-db3dfe16646a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:27.601869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f956aa7b-0010-41ba-b58a-db3dfe16646a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:27.652955 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2c2f7e92-0ebd-481f-b417-3563925d2b28 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:27.672770 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2c2f7e92-0ebd-481f-b417-3563925d2b28 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1511 microversion: 2.1 time: 0.773506 Jul 19 22:46:27.683744 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1994/4009] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:26 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1511 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:46:27.728348 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1b44b6a8-dac4-4642-b51b-7ffd4066e8a9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:27.728998 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1b44b6a8-dac4-4642-b51b-7ffd4066e8a9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: e0066e47-43b9-49f0-997d-854601201bd7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:27.746070 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b44b6a8-dac4-4642-b51b-7ffd4066e8a9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:27.746490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b44b6a8-dac4-4642-b51b-7ffd4066e8a9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:27.747352 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b44b6a8-dac4-4642-b51b-7ffd4066e8a9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:27.747809 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b44b6a8-dac4-4642-b51b-7ffd4066e8a9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:27.781670 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f956aa7b-0010-41ba-b58a-db3dfe16646a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:27.797475 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f956aa7b-0010-41ba-b58a-db3dfe16646a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1302 microversion: 2.1 time: 0.231908 Jul 19 22:46:27.798492 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2016/4010] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:27 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1302 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:28.233669 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-ed775d3a-1550-48ca-af63-ffe4f7290afc req-0c7ad3a8-4f21-452d-9a7c-669a3df54af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "769cbbd5-9a7b-43ee-bd65-bf62817c4353", "name": "network-vif-plugged", "status": "completed", "tag": "3decaa7b-1da5-4f02-8391-bbd7b18f207a"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:28.246306 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-ed775d3a-1550-48ca-af63-ffe4f7290afc req-0c7ad3a8-4f21-452d-9a7c-669a3df54af6 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:28.246762 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-ed775d3a-1550-48ca-af63-ffe4f7290afc req-0c7ad3a8-4f21-452d-9a7c-669a3df54af6 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:28.280720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1b44b6a8-dac4-4642-b51b-7ffd4066e8a9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:28.300485 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1b44b6a8-dac4-4642-b51b-7ffd4066e8a9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7" status: 200 len: 1323 microversion: 2.1 time: 0.575689 Jul 19 22:46:28.309945 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1995/4011] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:27 2022] GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7 => generated 1323 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:46:28.325870 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-ed775d3a-1550-48ca-af63-ffe4f7290afc req-0c7ad3a8-4f21-452d-9a7c-669a3df54af6 service nova] Creating event network-vif-plugged:3decaa7b-1da5-4f02-8391-bbd7b18f207a for instance 769cbbd5-9a7b-43ee-bd65-bf62817c4353 on n-h1-847009-3 Jul 19 22:46:28.353096 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-ed775d3a-1550-48ca-af63-ffe4f7290afc req-0c7ad3a8-4f21-452d-9a7c-669a3df54af6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123325 Jul 19 22:46:28.367406 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2017/4012] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:46:28.584525 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2e3e75f6-b83a-4f8f-b8ba-424466953687 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:28.585154 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2e3e75f6-b83a-4f8f-b8ba-424466953687 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:28.597289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e3e75f6-b83a-4f8f-b8ba-424466953687 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:28.600207 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e3e75f6-b83a-4f8f-b8ba-424466953687 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:28.601331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e3e75f6-b83a-4f8f-b8ba-424466953687 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:28.603713 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e3e75f6-b83a-4f8f-b8ba-424466953687 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:28.692784 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-712c655c-bde0-4901-bc57-9db1e5eb5fa1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:28.693558 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-712c655c-bde0-4901-bc57-9db1e5eb5fa1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:28.720000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-712c655c-bde0-4901-bc57-9db1e5eb5fa1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:28.720365 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-712c655c-bde0-4901-bc57-9db1e5eb5fa1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:28.724050 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-712c655c-bde0-4901-bc57-9db1e5eb5fa1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:28.724572 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-712c655c-bde0-4901-bc57-9db1e5eb5fa1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:29.529930 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2e3e75f6-b83a-4f8f-b8ba-424466953687 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:29.544165 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2e3e75f6-b83a-4f8f-b8ba-424466953687 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1509 microversion: 2.1 time: 0.966864 Jul 19 22:46:29.560230 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1996/4013] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:28 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1509 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:29.574007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5d097197-118e-48c6-a218-d6863754d07a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:29.574458 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-712c655c-bde0-4901-bc57-9db1e5eb5fa1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:29.578524 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5d097197-118e-48c6-a218-d6863754d07a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:29.591599 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5d097197-118e-48c6-a218-d6863754d07a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:29.600775 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5d097197-118e-48c6-a218-d6863754d07a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:29.601773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5d097197-118e-48c6-a218-d6863754d07a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:29.602235 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5d097197-118e-48c6-a218-d6863754d07a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:29.603227 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-712c655c-bde0-4901-bc57-9db1e5eb5fa1 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1511 microversion: 2.1 time: 0.915358 Jul 19 22:46:29.604001 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2018/4014] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:28 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1511 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:29.652841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fc5202eb-39fe-48c9-9e8a-5dcd8b277b71 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:29.653484 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fc5202eb-39fe-48c9-9e8a-5dcd8b277b71 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: e0066e47-43b9-49f0-997d-854601201bd7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:29.688547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc5202eb-39fe-48c9-9e8a-5dcd8b277b71 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:29.689002 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc5202eb-39fe-48c9-9e8a-5dcd8b277b71 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:29.689864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc5202eb-39fe-48c9-9e8a-5dcd8b277b71 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:29.690316 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc5202eb-39fe-48c9-9e8a-5dcd8b277b71 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:30.697771 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5d097197-118e-48c6-a218-d6863754d07a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:30.740336 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5d097197-118e-48c6-a218-d6863754d07a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1370 microversion: 2.1 time: 1.178788 Jul 19 22:46:30.743140 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1997/4015] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:29 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1370 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:30.826582 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fc5202eb-39fe-48c9-9e8a-5dcd8b277b71 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:30.878291 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fc5202eb-39fe-48c9-9e8a-5dcd8b277b71 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7" status: 200 len: 1516 microversion: 2.1 time: 1.249193 Jul 19 22:46:30.891803 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2019/4016] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:29 2022] GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7 => generated 1516 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:30.915887 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-37e52ab7-aaea-4a23-8fab-cc422d858cd9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:30.928253 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-37e52ab7-aaea-4a23-8fab-cc422d858cd9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:30.973155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-37e52ab7-aaea-4a23-8fab-cc422d858cd9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:30.974012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-37e52ab7-aaea-4a23-8fab-cc422d858cd9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:30.975045 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-37e52ab7-aaea-4a23-8fab-cc422d858cd9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:30.977023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-37e52ab7-aaea-4a23-8fab-cc422d858cd9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:31.210756 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c24591b4-e34a-4490-b651-729df08a34fc tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2103032311", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "ce6ac97c-1ce1-46bd-b522-4f0777921e35"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:31.343537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-c24591b4-e34a-4490-b651-729df08a34fc tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] validate_networks() for [('ce6ac97c-1ce1-46bd-b522-4f0777921e35', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:46:32.555862 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-37e52ab7-aaea-4a23-8fab-cc422d858cd9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:32.566527 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-37e52ab7-aaea-4a23-8fab-cc422d858cd9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1509 microversion: 2.1 time: 1.668039 Jul 19 22:46:32.581237 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2020/4017] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:30 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1509 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:32.598075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ac291f88-0840-4a1d-8262-c99ff22412f7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:32.598710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ac291f88-0840-4a1d-8262-c99ff22412f7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:32.637464 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac291f88-0840-4a1d-8262-c99ff22412f7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:32.637859 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac291f88-0840-4a1d-8262-c99ff22412f7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:32.638677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac291f88-0840-4a1d-8262-c99ff22412f7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:32.639205 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac291f88-0840-4a1d-8262-c99ff22412f7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:32.853092 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:46:32.924107 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:46:33.342410 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ac291f88-0840-4a1d-8262-c99ff22412f7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:33.355442 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ac291f88-0840-4a1d-8262-c99ff22412f7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1511 microversion: 2.1 time: 0.772415 Jul 19 22:46:33.357621 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2021/4018] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:32 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1511 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:33.370389 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e18d3821-c668-4dda-b1df-b296746753fa tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:33.371357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e18d3821-c668-4dda-b1df-b296746753fa tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: 769cbbd5-9a7b-43ee-bd65-bf62817c4353] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:33.384950 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e18d3821-c668-4dda-b1df-b296746753fa tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:33.387911 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e18d3821-c668-4dda-b1df-b296746753fa tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:33.389126 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e18d3821-c668-4dda-b1df-b296746753fa tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:33.392402 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e18d3821-c668-4dda-b1df-b296746753fa tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:33.539520 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:46:34.034075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e18d3821-c668-4dda-b1df-b296746753fa tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:34.051234 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e18d3821-c668-4dda-b1df-b296746753fa tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/769cbbd5-9a7b-43ee-bd65-bf62817c4353" status: 200 len: 1516 microversion: 2.1 time: 0.692176 Jul 19 22:46:34.057751 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2022/4019] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:33 2022] GET /compute/v2.1/servers/769cbbd5-9a7b-43ee-bd65-bf62817c4353 => generated 1516 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:34.078196 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5c13c120-4aba-41f0-bfca-0d9b5b4fa458 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:34.083386 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5c13c120-4aba-41f0-bfca-0d9b5b4fa458 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:34.100433 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5c13c120-4aba-41f0-bfca-0d9b5b4fa458 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:34.101314 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5c13c120-4aba-41f0-bfca-0d9b5b4fa458 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:34.103937 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5c13c120-4aba-41f0-bfca-0d9b5b4fa458 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:34.106159 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5c13c120-4aba-41f0-bfca-0d9b5b4fa458 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:34.448583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-c24591b4-e34a-4490-b651-729df08a34fc tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:46:34.449201 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-c24591b4-e34a-4490-b651-729df08a34fc tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:46:34.449849 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-c24591b4-e34a-4490-b651-729df08a34fc tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:46:34.450418 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-c24591b4-e34a-4490-b651-729df08a34fc tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:46:34.450974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-c24591b4-e34a-4490-b651-729df08a34fc tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:46:34.479321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c24591b4-e34a-4490-b651-729df08a34fc tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:34.480310 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c24591b4-e34a-4490-b651-729df08a34fc tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:34.480690 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c24591b4-e34a-4490-b651-729df08a34fc tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:34.481076 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c24591b4-e34a-4490-b651-729df08a34fc tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:34.566756 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-c24591b4-e34a-4490-b651-729df08a34fc tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Getting quotas for project 06f74b40009244fdb9d623395d71f24b. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:46:34.578786 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5c13c120-4aba-41f0-bfca-0d9b5b4fa458 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:34.594095 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5c13c120-4aba-41f0-bfca-0d9b5b4fa458 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1370 microversion: 2.1 time: 0.531023 Jul 19 22:46:34.594532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-c24591b4-e34a-4490-b651-729df08a34fc tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Getting quotas for user 9a5429e8c7ad483abb1d01e6f6cd2689 and project 06f74b40009244fdb9d623395d71f24b. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:46:34.616240 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2023/4020] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:34 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1370 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:34.631854 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c24591b4-e34a-4490-b651-729df08a34fc tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:46:34.634167 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c24591b4-e34a-4490-b651-729df08a34fc tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] [instance: abe8d7c1-3c02-425c-923e-de6f717c334b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:46:34.635281 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-93b7ede1-27f8-4219-ab9b-b9f302ac4731 req-dd5ca5b2-b2b2-4494-86fb-36995db2337b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02571222-3b10-4a0d-8b70-a8202c37f6a7", "tag": "542dbd38-d2d6-470e-be1a-a605a204b40b"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:34.662630 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-93b7ede1-27f8-4219-ab9b-b9f302ac4731 req-dd5ca5b2-b2b2-4494-86fb-36995db2337b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:34.664092 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-93b7ede1-27f8-4219-ab9b-b9f302ac4731 req-dd5ca5b2-b2b2-4494-86fb-36995db2337b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:34.722110 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-93b7ede1-27f8-4219-ab9b-b9f302ac4731 req-dd5ca5b2-b2b2-4494-86fb-36995db2337b service nova] Creating event network-changed:542dbd38-d2d6-470e-be1a-a605a204b40b for instance 02571222-3b10-4a0d-8b70-a8202c37f6a7 on n-h2-847009-3 Jul 19 22:46:34.739435 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-93b7ede1-27f8-4219-ab9b-b9f302ac4731 req-dd5ca5b2-b2b2-4494-86fb-36995db2337b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115734 Jul 19 22:46:34.742138 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2024/4021] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:34.770521 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0ef2a9be-1a3b-4ede-ae11-770df4227985 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:34.773631 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0ef2a9be-1a3b-4ede-ae11-770df4227985 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:34.825495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ef2a9be-1a3b-4ede-ae11-770df4227985 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:34.828616 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ef2a9be-1a3b-4ede-ae11-770df4227985 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:34.829679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ef2a9be-1a3b-4ede-ae11-770df4227985 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:34.836541 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ef2a9be-1a3b-4ede-ae11-770df4227985 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:34.864258 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:46:34.912590 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c24591b4-e34a-4490-b651-729df08a34fc tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.167737 Jul 19 22:46:34.913268 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1998/4022] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:46:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 4169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:46:34.929731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b6467df8-daa8-4085-bf4f-61c860f63f86 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:34.947296 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b6467df8-daa8-4085-bf4f-61c860f63f86 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:34.985961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6467df8-daa8-4085-bf4f-61c860f63f86 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:34.994021 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6467df8-daa8-4085-bf4f-61c860f63f86 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:34.995691 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6467df8-daa8-4085-bf4f-61c860f63f86 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:34.996639 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6467df8-daa8-4085-bf4f-61c860f63f86 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:35.966757 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0ef2a9be-1a3b-4ede-ae11-770df4227985 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:35.983854 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0ef2a9be-1a3b-4ede-ae11-770df4227985 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1509 microversion: 2.1 time: 1.240119 Jul 19 22:46:35.988281 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2025/4023] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:34 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1509 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:36.000460 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a1793135-2b4c-4da4-aeac-b77a3e37e514 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:36.001726 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a1793135-2b4c-4da4-aeac-b77a3e37e514 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: 29737cca-d066-4284-9d74-504206263041] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:36.020626 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1793135-2b4c-4da4-aeac-b77a3e37e514 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:36.025039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1793135-2b4c-4da4-aeac-b77a3e37e514 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:36.027069 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1793135-2b4c-4da4-aeac-b77a3e37e514 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:36.029125 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1793135-2b4c-4da4-aeac-b77a3e37e514 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:36.195708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b6467df8-daa8-4085-bf4f-61c860f63f86 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:36.223642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b6467df8-daa8-4085-bf4f-61c860f63f86 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:36.231354 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b6467df8-daa8-4085-bf4f-61c860f63f86 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:36.237865 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b6467df8-daa8-4085-bf4f-61c860f63f86 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 2954 microversion: 2.42 time: 1.318393 Jul 19 22:46:36.240094 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 1999/4024] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:46:34 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 2954 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:46:36.274682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9ae90f28-6fe9-487d-877a-bc56fbd2ff4c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:36.276508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9ae90f28-6fe9-487d-877a-bc56fbd2ff4c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:36.291905 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ae90f28-6fe9-487d-877a-bc56fbd2ff4c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:36.292356 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ae90f28-6fe9-487d-877a-bc56fbd2ff4c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:36.293437 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ae90f28-6fe9-487d-877a-bc56fbd2ff4c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:36.294460 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ae90f28-6fe9-487d-877a-bc56fbd2ff4c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:36.344505 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:46:37.062987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a1793135-2b4c-4da4-aeac-b77a3e37e514 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:37.082074 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a1793135-2b4c-4da4-aeac-b77a3e37e514 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/29737cca-d066-4284-9d74-504206263041" status: 200 len: 1516 microversion: 2.1 time: 1.092167 Jul 19 22:46:37.090858 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2026/4025] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:35 2022] GET /compute/v2.1/servers/29737cca-d066-4284-9d74-504206263041 => generated 1516 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:37.120415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b4ac8444-2419-4b71-bdaf-716ea7e09190 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:37.155002 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b4ac8444-2419-4b71-bdaf-716ea7e09190 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] [instance: abe8d7c1-3c02-425c-923e-de6f717c334b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:37.167662 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9ae90f28-6fe9-487d-877a-bc56fbd2ff4c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:37.183969 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9ae90f28-6fe9-487d-877a-bc56fbd2ff4c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1511 microversion: 2.1 time: 0.925181 Jul 19 22:46:37.188150 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2000/4026] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:36 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1511 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:37.200661 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b6c96908-3a81-40b5-b8dd-a8891ee0e103 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:37.201254 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b6c96908-3a81-40b5-b8dd-a8891ee0e103 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:37.228042 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6c96908-3a81-40b5-b8dd-a8891ee0e103 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:37.228511 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6c96908-3a81-40b5-b8dd-a8891ee0e103 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:37.229318 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6c96908-3a81-40b5-b8dd-a8891ee0e103 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:37.229764 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6c96908-3a81-40b5-b8dd-a8891ee0e103 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:37.233433 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b4ac8444-2419-4b71-bdaf-716ea7e09190 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:37.235008 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b4ac8444-2419-4b71-bdaf-716ea7e09190 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:37.236660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b4ac8444-2419-4b71-bdaf-716ea7e09190 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:37.237554 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b4ac8444-2419-4b71-bdaf-716ea7e09190 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:37.816837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b4ac8444-2419-4b71-bdaf-716ea7e09190 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5429e8c7ad483abb1d01e6f6cd2689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f74b40009244fdb9d623395d71f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:37.831412 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b4ac8444-2419-4b71-bdaf-716ea7e09190 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] 10.222.0.25 "GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b" status: 200 len: 1276 microversion: 2.1 time: 0.733515 Jul 19 22:46:37.843458 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2027/4027] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:37 2022] GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b => generated 1276 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:37.855502 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f8249068-3414-447e-8319-a8f844678450 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:37.856344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f8249068-3414-447e-8319-a8f844678450 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:37.880930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8249068-3414-447e-8319-a8f844678450 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:37.882345 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8249068-3414-447e-8319-a8f844678450 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:37.883527 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8249068-3414-447e-8319-a8f844678450 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:37.884248 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8249068-3414-447e-8319-a8f844678450 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:37.933691 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b6c96908-3a81-40b5-b8dd-a8891ee0e103 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:37.948522 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b6c96908-3a81-40b5-b8dd-a8891ee0e103 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1370 microversion: 2.1 time: 0.759006 Jul 19 22:46:37.951874 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2001/4028] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:37 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1370 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:37.965712 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ac806f02-5ab9-4798-8103-ee940bbd44de tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:37.971899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ac806f02-5ab9-4798-8103-ee940bbd44de tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:38.002897 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac806f02-5ab9-4798-8103-ee940bbd44de tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:38.003520 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac806f02-5ab9-4798-8103-ee940bbd44de tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:38.004315 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac806f02-5ab9-4798-8103-ee940bbd44de tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:38.011011 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac806f02-5ab9-4798-8103-ee940bbd44de tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:38.376317 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f8249068-3414-447e-8319-a8f844678450 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.530677 Jul 19 22:46:38.380409 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2028/4029] 10.222.0.25 () {60 vars in 1315 bytes} [Tue Jul 19 22:46:37 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39/os-interface => generated 1829 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:46:38.385828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-49bf9c8b-6c53-41d9-aebd-a5dbf6ae5bf2 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:38.388932 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-49bf9c8b-6c53-41d9-aebd-a5dbf6ae5bf2 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: 29737cca-d066-4284-9d74-504206263041] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:38.401721 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49bf9c8b-6c53-41d9-aebd-a5dbf6ae5bf2 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:38.409811 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49bf9c8b-6c53-41d9-aebd-a5dbf6ae5bf2 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:38.411049 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49bf9c8b-6c53-41d9-aebd-a5dbf6ae5bf2 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:38.411663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49bf9c8b-6c53-41d9-aebd-a5dbf6ae5bf2 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:38.468742 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-49bf9c8b-6c53-41d9-aebd-a5dbf6ae5bf2 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: 29737cca-d066-4284-9d74-504206263041] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:46:38.665691 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-49bf9c8b-6c53-41d9-aebd-a5dbf6ae5bf2 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "DELETE /compute/v2.1/servers/29737cca-d066-4284-9d74-504206263041" status: 204 len: 0 microversion: 2.1 time: 0.283684 Jul 19 22:46:38.676983 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2029/4030] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:46:38 2022] DELETE /compute/v2.1/servers/29737cca-d066-4284-9d74-504206263041 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:46:38.690955 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-93ee3f7f-04f2-42a7-9632-1364749345a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:38.691708 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-93ee3f7f-04f2-42a7-9632-1364749345a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:38.716308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93ee3f7f-04f2-42a7-9632-1364749345a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:38.716786 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93ee3f7f-04f2-42a7-9632-1364749345a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:38.717917 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93ee3f7f-04f2-42a7-9632-1364749345a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:38.718048 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93ee3f7f-04f2-42a7-9632-1364749345a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:38.854133 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ac806f02-5ab9-4798-8103-ee940bbd44de tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:38.871567 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ac806f02-5ab9-4798-8103-ee940bbd44de tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1509 microversion: 2.1 time: 0.918372 Jul 19 22:46:38.883241 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2002/4031] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:37 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1509 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:38.944520 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0caecf92-7641-4720-b5af-2c93a944179f tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:38.952375 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0caecf92-7641-4720-b5af-2c93a944179f tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: 29737cca-d066-4284-9d74-504206263041] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:38.994751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0caecf92-7641-4720-b5af-2c93a944179f tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:38.996465 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0caecf92-7641-4720-b5af-2c93a944179f tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:38.998157 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0caecf92-7641-4720-b5af-2c93a944179f tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:38.999358 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0caecf92-7641-4720-b5af-2c93a944179f tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:40.747881 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-93ee3f7f-04f2-42a7-9632-1364749345a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:40.761862 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-93ee3f7f-04f2-42a7-9632-1364749345a5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1511 microversion: 2.1 time: 2.083314 Jul 19 22:46:40.763885 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2030/4032] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:38 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1511 bytes in 2086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:40.770709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9faa8dfe-588e-49aa-981b-9392510107cb tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:40.776664 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9faa8dfe-588e-49aa-981b-9392510107cb tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] [instance: abe8d7c1-3c02-425c-923e-de6f717c334b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:40.789143 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9faa8dfe-588e-49aa-981b-9392510107cb tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:40.793500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9faa8dfe-588e-49aa-981b-9392510107cb tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:40.794581 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9faa8dfe-588e-49aa-981b-9392510107cb tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:40.805019 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9faa8dfe-588e-49aa-981b-9392510107cb tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:40.868145 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0caecf92-7641-4720-b5af-2c93a944179f tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:40.892017 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0caecf92-7641-4720-b5af-2c93a944179f tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/29737cca-d066-4284-9d74-504206263041" status: 200 len: 1522 microversion: 2.1 time: 2.006363 Jul 19 22:46:40.900167 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2003/4033] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:38 2022] GET /compute/v2.1/servers/29737cca-d066-4284-9d74-504206263041 => generated 1522 bytes in 2016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:40.926328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6529b8e8-b04c-4011-96ed-999cdc7b1691 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:40.927220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6529b8e8-b04c-4011-96ed-999cdc7b1691 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:40.934726 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6529b8e8-b04c-4011-96ed-999cdc7b1691 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:40.935544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6529b8e8-b04c-4011-96ed-999cdc7b1691 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:40.936538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6529b8e8-b04c-4011-96ed-999cdc7b1691 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:40.938208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6529b8e8-b04c-4011-96ed-999cdc7b1691 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:41.515084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6529b8e8-b04c-4011-96ed-999cdc7b1691 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:41.527456 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6529b8e8-b04c-4011-96ed-999cdc7b1691 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1370 microversion: 2.1 time: 0.625773 Jul 19 22:46:41.529285 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2004/4034] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:40 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1370 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:41.541808 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-23b54b2d-b17b-490b-ae23-8376572829f9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:41.551975 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-23b54b2d-b17b-490b-ae23-8376572829f9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:41.568338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-23b54b2d-b17b-490b-ae23-8376572829f9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:41.571170 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-23b54b2d-b17b-490b-ae23-8376572829f9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:41.574233 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-23b54b2d-b17b-490b-ae23-8376572829f9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:41.579187 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-23b54b2d-b17b-490b-ae23-8376572829f9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:42.229345 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9faa8dfe-588e-49aa-981b-9392510107cb tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5429e8c7ad483abb1d01e6f6cd2689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f74b40009244fdb9d623395d71f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:42.248122 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9faa8dfe-588e-49aa-981b-9392510107cb tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] 10.222.0.25 "GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b" status: 200 len: 1324 microversion: 2.1 time: 1.482959 Jul 19 22:46:42.258436 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2031/4035] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:40 2022] GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b => generated 1324 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:42.264147 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-00c3e97f-0b49-4554-b26e-9e66ea3b228b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:42.265166 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-00c3e97f-0b49-4554-b26e-9e66ea3b228b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:42.293202 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00c3e97f-0b49-4554-b26e-9e66ea3b228b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:42.293668 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00c3e97f-0b49-4554-b26e-9e66ea3b228b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:42.294478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00c3e97f-0b49-4554-b26e-9e66ea3b228b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:42.295169 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00c3e97f-0b49-4554-b26e-9e66ea3b228b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:42.755037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-00c3e97f-0b49-4554-b26e-9e66ea3b228b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:42.777903 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-00c3e97f-0b49-4554-b26e-9e66ea3b228b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1511 microversion: 2.1 time: 0.517764 Jul 19 22:46:42.792036 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2032/4036] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:42 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1511 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:42.807747 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6a2ff142-2e08-4897-bdcc-10a314f31647 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:42.808912 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6a2ff142-2e08-4897-bdcc-10a314f31647 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: 29737cca-d066-4284-9d74-504206263041] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:42.834584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a2ff142-2e08-4897-bdcc-10a314f31647 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:42.840188 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a2ff142-2e08-4897-bdcc-10a314f31647 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:42.843091 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a2ff142-2e08-4897-bdcc-10a314f31647 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:42.847411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a2ff142-2e08-4897-bdcc-10a314f31647 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:43.065235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6a2ff142-2e08-4897-bdcc-10a314f31647 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:43.081891 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6a2ff142-2e08-4897-bdcc-10a314f31647 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/29737cca-d066-4284-9d74-504206263041" status: 200 len: 1480 microversion: 2.1 time: 0.287718 Jul 19 22:46:43.083052 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2033/4037] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:42 2022] GET /compute/v2.1/servers/29737cca-d066-4284-9d74-504206263041 => generated 1480 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:43.092827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a61035cc-e61f-4e8f-b429-7f59404e2f76 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:43.093778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a61035cc-e61f-4e8f-b429-7f59404e2f76 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:43.107390 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a61035cc-e61f-4e8f-b429-7f59404e2f76 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:43.109921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a61035cc-e61f-4e8f-b429-7f59404e2f76 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:43.116574 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a61035cc-e61f-4e8f-b429-7f59404e2f76 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:43.117041 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a61035cc-e61f-4e8f-b429-7f59404e2f76 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:43.163623 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-23b54b2d-b17b-490b-ae23-8376572829f9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:43.188519 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-23b54b2d-b17b-490b-ae23-8376572829f9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1509 microversion: 2.1 time: 1.657493 Jul 19 22:46:43.200306 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2005/4038] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:41 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1509 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:43.221280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-c1452495-63f5-48e3-90d2-9eb735e93c3c req-08c45644-1ad0-4a4f-9ee9-3119c9ea5a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29737cca-d066-4284-9d74-504206263041", "name": "network-vif-deleted", "tag": "905cdeb6-53a6-4423-9252-7f6f1a9beff0"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:43.252022 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-c1452495-63f5-48e3-90d2-9eb735e93c3c req-08c45644-1ad0-4a4f-9ee9-3119c9ea5a47 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:43.255552 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-c1452495-63f5-48e3-90d2-9eb735e93c3c req-08c45644-1ad0-4a4f-9ee9-3119c9ea5a47 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:43.275492 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-c1452495-63f5-48e3-90d2-9eb735e93c3c req-08c45644-1ad0-4a4f-9ee9-3119c9ea5a47 service nova] Creating event network-vif-deleted:905cdeb6-53a6-4423-9252-7f6f1a9beff0 for instance 29737cca-d066-4284-9d74-504206263041 on n-h1-847009-3 Jul 19 22:46:43.286460 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-c1452495-63f5-48e3-90d2-9eb735e93c3c req-08c45644-1ad0-4a4f-9ee9-3119c9ea5a47 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084689 Jul 19 22:46:43.287905 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2006/4039] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:43.296117 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6f55edca-2f95-4a26-9c8b-37ac3aef5c26 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:43.297137 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6f55edca-2f95-4a26-9c8b-37ac3aef5c26 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] [instance: abe8d7c1-3c02-425c-923e-de6f717c334b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:43.306924 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6f55edca-2f95-4a26-9c8b-37ac3aef5c26 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:43.307643 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6f55edca-2f95-4a26-9c8b-37ac3aef5c26 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:43.308899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6f55edca-2f95-4a26-9c8b-37ac3aef5c26 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:43.309489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6f55edca-2f95-4a26-9c8b-37ac3aef5c26 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:43.841187 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a61035cc-e61f-4e8f-b429-7f59404e2f76 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:43.888827 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a61035cc-e61f-4e8f-b429-7f59404e2f76 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1370 microversion: 2.1 time: 0.801473 Jul 19 22:46:43.889785 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2034/4040] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:43 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1370 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:43.924643 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c46e6f1a-d5e5-4fff-ab31-573410023275 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:43.927275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c46e6f1a-d5e5-4fff-ab31-573410023275 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:43.960077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c46e6f1a-d5e5-4fff-ab31-573410023275 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:43.961236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c46e6f1a-d5e5-4fff-ab31-573410023275 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:43.962911 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c46e6f1a-d5e5-4fff-ab31-573410023275 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:43.966975 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c46e6f1a-d5e5-4fff-ab31-573410023275 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:44.055069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6f55edca-2f95-4a26-9c8b-37ac3aef5c26 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5429e8c7ad483abb1d01e6f6cd2689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f74b40009244fdb9d623395d71f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:44.085276 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6f55edca-2f95-4a26-9c8b-37ac3aef5c26 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] 10.222.0.25 "GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b" status: 200 len: 1324 microversion: 2.1 time: 0.795937 Jul 19 22:46:44.094351 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2007/4041] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:43 2022] GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b => generated 1324 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:44.106053 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6db29b84-e962-4297-86fd-b8473fbcd2ad tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:44.109341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6db29b84-e962-4297-86fd-b8473fbcd2ad tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: 29737cca-d066-4284-9d74-504206263041] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:44.121934 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6db29b84-e962-4297-86fd-b8473fbcd2ad tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:44.122393 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6db29b84-e962-4297-86fd-b8473fbcd2ad tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:44.128667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6db29b84-e962-4297-86fd-b8473fbcd2ad tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:44.129113 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6db29b84-e962-4297-86fd-b8473fbcd2ad tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:44.167794 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-6db29b84-e962-4297-86fd-b8473fbcd2ad tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] HTTP exception thrown: Instance 29737cca-d066-4284-9d74-504206263041 could not be found. Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6db29b84-e962-4297-86fd-b8473fbcd2ad tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Request method failure captured: Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/29737cca-d066-4284-9d74-504206263041 HTTP/1.1 Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zQi8xczqubvqao_uJKyeW0iTVa44EbvI1h3jqV0juD19S7E74zGkDFMlQnIBX0z6dDyD8XzTxVcV2Jw2TpAKDlDjrbMe2s2m57YyOZlEytJ3WX4zPLap4i9W34XVhJIK-Fd3aCDB86bUXt7b9WvEjSnANzyxKdZerjxTmNhv_uPkps Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 30d99d62982b40c8a8ba29137b2e72df Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ListServersNegativeTestJSON-1451554344 Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ListServersNegativeTestJSON-1451554344 Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 30d99d62982b40c8a8ba29137b2e72df Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1451554344 Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ListServersNegativeTestJSON-1451554344-project Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 4218f795e57244d29c970fb551e1a471 Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ListServersNegativeTestJSON-1451554344-project Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 29737cca-d066-4284-9d74-504206263041 could not be found. Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '29737cca-d066-4284-9d74-504206263041'} Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29737cca-d066-4284-9d74-504206263041 could not be found. Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29737cca-d066-4284-9d74-504206263041 could not be found. Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:44.172442 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:44.176918 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:44.176918 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:44.176918 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:44.176918 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:46:44.176918 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:46:44.176918 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29737cca-d066-4284-9d74-504206263041 could not be found. Jul 19 22:46:44.176918 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:44.179680 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6db29b84-e962-4297-86fd-b8473fbcd2ad tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Returning 404 to user: Instance 29737cca-d066-4284-9d74-504206263041 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:46:44.181110 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6db29b84-e962-4297-86fd-b8473fbcd2ad tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/29737cca-d066-4284-9d74-504206263041" status: 404 len: 111 microversion: 2.1 time: 0.085170 Jul 19 22:46:44.186693 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2008/4042] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:44 2022] GET /compute/v2.1/servers/29737cca-d066-4284-9d74-504206263041 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:46:44.192780 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fafe9471-62a1-4ba5-9f07-3306d5d50b00 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:44.199674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fafe9471-62a1-4ba5-9f07-3306d5d50b00 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:44.202111 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fafe9471-62a1-4ba5-9f07-3306d5d50b00 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '30d99d62982b40c8a8ba29137b2e72df'} {{(pid=119337) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:46:44.208403 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fafe9471-62a1-4ba5-9f07-3306d5d50b00 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:44.209582 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fafe9471-62a1-4ba5-9f07-3306d5d50b00 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:44.210613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fafe9471-62a1-4ba5-9f07-3306d5d50b00 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:44.215748 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fafe9471-62a1-4ba5-9f07-3306d5d50b00 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:44.334506 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fafe9471-62a1-4ba5-9f07-3306d5d50b00 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.143850 Jul 19 22:46:44.336424 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2009/4043] 10.222.0.25 () {58 vars in 1229 bytes} [Tue Jul 19 22:46:44 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:46:44.352501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9e4c97ca-2300-4866-bf15-c6ab3570cb77 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:44.353470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9e4c97ca-2300-4866-bf15-c6ab3570cb77 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:44.369053 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9e4c97ca-2300-4866-bf15-c6ab3570cb77 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:44.369716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9e4c97ca-2300-4866-bf15-c6ab3570cb77 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:44.372054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9e4c97ca-2300-4866-bf15-c6ab3570cb77 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:44.373012 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9e4c97ca-2300-4866-bf15-c6ab3570cb77 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:44.620327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:46:44.685012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c46e6f1a-d5e5-4fff-ab31-573410023275 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:44.696281 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c46e6f1a-d5e5-4fff-ab31-573410023275 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1511 microversion: 2.1 time: 0.801662 Jul 19 22:46:44.699211 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2035/4044] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:43 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1511 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:44.711955 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3005124b-c2e2-4ea1-ba0d-36f8033a4496 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3005124b-c2e2-4ea1-ba0d-36f8033a4496 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Request method failure captured: Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zQi8xczqubvqao_uJKyeW0iTVa44EbvI1h3jqV0juD19S7E74zGkDFMlQnIBX0z6dDyD8XzTxVcV2Jw2TpAKDlDjrbMe2s2m57YyOZlEytJ3WX4zPLap4i9W34XVhJIK-Fd3aCDB86bUXt7b9WvEjSnANzyxKdZerjxTmNhv_uPkps Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 30d99d62982b40c8a8ba29137b2e72df Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ListServersNegativeTestJSON-1451554344 Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ListServersNegativeTestJSON-1451554344 Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 30d99d62982b40c8a8ba29137b2e72df Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1451554344 Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ListServersNegativeTestJSON-1451554344-project Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 4218f795e57244d29c970fb551e1a471 Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ListServersNegativeTestJSON-1451554344-project Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: action_args: {} Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 19 22:46:44.720204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:46:44.724306 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:46:44.724306 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:46:44.724306 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:46:44.724306 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 19 22:46:44.724306 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:44.724306 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:44.724306 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:44.724306 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:44.724306 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:44.724306 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:44.724306 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:46:44.724306 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:46:44.724306 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 19 22:46:44.724306 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:44.727049 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3005124b-c2e2-4ea1-ba0d-36f8033a4496 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:46:44.729414 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3005124b-c2e2-4ea1-ba0d-36f8033a4496 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.027523 Jul 19 22:46:44.730624 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2036/4045] 10.222.0.25 () {58 vars in 1181 bytes} [Tue Jul 19 22:46:44 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:46:44.745567 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-84819c17-48dc-4b09-813f-85b545dfc5d0 req-e06367fb-4266-427b-a059-997007990c2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02571222-3b10-4a0d-8b70-a8202c37f6a7", "name": "network-vif-plugged", "status": "completed", "tag": "542dbd38-d2d6-470e-be1a-a605a204b40b"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:44.764378 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-84819c17-48dc-4b09-813f-85b545dfc5d0 req-e06367fb-4266-427b-a059-997007990c2e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:44.766185 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-84819c17-48dc-4b09-813f-85b545dfc5d0 req-e06367fb-4266-427b-a059-997007990c2e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:44.790815 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-84819c17-48dc-4b09-813f-85b545dfc5d0 req-e06367fb-4266-427b-a059-997007990c2e service nova] Creating event network-vif-plugged:542dbd38-d2d6-470e-be1a-a605a204b40b for instance 02571222-3b10-4a0d-8b70-a8202c37f6a7 on n-h2-847009-3 Jul 19 22:46:44.796858 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-84819c17-48dc-4b09-813f-85b545dfc5d0 req-e06367fb-4266-427b-a059-997007990c2e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056344 Jul 19 22:46:44.798265 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2037/4046] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:44.804808 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-85b8879f-32c8-4228-8a89-8cb441b88051 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:44.808445 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-85b8879f-32c8-4228-8a89-8cb441b88051 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:44.809526 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-85b8879f-32c8-4228-8a89-8cb441b88051 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Searching by: {'deleted': False, 'project_id': '30d99d62982b40c8a8ba29137b2e72df'} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:46:44.825221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85b8879f-32c8-4228-8a89-8cb441b88051 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:44.827754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85b8879f-32c8-4228-8a89-8cb441b88051 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:44.832320 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85b8879f-32c8-4228-8a89-8cb441b88051 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:44.833090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85b8879f-32c8-4228-8a89-8cb441b88051 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:44.879717 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.multi_cell_list [None req-85b8879f-32c8-4228-8a89-8cb441b88051 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119338) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:46:44.973259 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-85b8879f-32c8-4228-8a89-8cb441b88051 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.173009 Jul 19 22:46:44.979080 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2038/4047] 10.222.0.25 () {58 vars in 1124 bytes} [Tue Jul 19 22:46:44 2022] GET /compute/v2.1/servers => generated 683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:44.984348 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-73e4c40e-d67a-41d8-8eca-3669eb8c6b08 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:44.985912 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-73e4c40e-d67a-41d8-8eca-3669eb8c6b08 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:44.999537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-73e4c40e-d67a-41d8-8eca-3669eb8c6b08 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:45.000388 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-73e4c40e-d67a-41d8-8eca-3669eb8c6b08 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:45.001470 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-73e4c40e-d67a-41d8-8eca-3669eb8c6b08 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:45.002688 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-73e4c40e-d67a-41d8-8eca-3669eb8c6b08 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:45.063409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9e4c97ca-2300-4866-bf15-c6ab3570cb77 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:45.073345 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9e4c97ca-2300-4866-bf15-c6ab3570cb77 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1509 microversion: 2.1 time: 0.735189 Jul 19 22:46:45.084709 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2010/4048] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:44 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1509 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:45.097571 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-041896db-65ea-466f-9993-aa2ca4c19982 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:45.114634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-041896db-65ea-466f-9993-aa2ca4c19982 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:45.115567 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.compute.servers [None req-041896db-65ea-466f-9993-aa2ca4c19982 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Removing options 'limit' from query {{(pid=119337) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 19 22:46:45.117065 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-041896db-65ea-466f-9993-aa2ca4c19982 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Searching by: {'deleted': False, 'project_id': '30d99d62982b40c8a8ba29137b2e72df'} {{(pid=119337) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:46:45.142332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-041896db-65ea-466f-9993-aa2ca4c19982 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:45.143443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-041896db-65ea-466f-9993-aa2ca4c19982 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:45.146746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-041896db-65ea-466f-9993-aa2ca4c19982 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:45.148984 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-041896db-65ea-466f-9993-aa2ca4c19982 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:45.232084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.multi_cell_list [None req-041896db-65ea-466f-9993-aa2ca4c19982 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=119337) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:46:45.329659 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-041896db-65ea-466f-9993-aa2ca4c19982 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.242208 Jul 19 22:46:45.331185 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2011/4049] 10.222.0.25 () {58 vars in 1143 bytes} [Tue Jul 19 22:46:45 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:45.336791 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0ce0064e-b532-4bdb-8f09-3c761bff6e68 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:45.337593 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0ce0064e-b532-4bdb-8f09-3c761bff6e68 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] [instance: abe8d7c1-3c02-425c-923e-de6f717c334b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:45.345263 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ce0064e-b532-4bdb-8f09-3c761bff6e68 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:45.346746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ce0064e-b532-4bdb-8f09-3c761bff6e68 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:45.347758 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ce0064e-b532-4bdb-8f09-3c761bff6e68 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:45.348382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ce0064e-b532-4bdb-8f09-3c761bff6e68 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:45.432978 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-73e4c40e-d67a-41d8-8eca-3669eb8c6b08 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:45.442168 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-73e4c40e-d67a-41d8-8eca-3669eb8c6b08 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1370 microversion: 2.1 time: 0.461856 Jul 19 22:46:45.443129 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2039/4050] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:44 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1370 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:45.864789 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0ce0064e-b532-4bdb-8f09-3c761bff6e68 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5429e8c7ad483abb1d01e6f6cd2689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f74b40009244fdb9d623395d71f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:45.873647 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0ce0064e-b532-4bdb-8f09-3c761bff6e68 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] 10.222.0.25 "GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b" status: 200 len: 1324 microversion: 2.1 time: 0.541040 Jul 19 22:46:45.879707 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2012/4051] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:45 2022] GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b => generated 1324 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:45.897160 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5df3d741-8f44-4bc2-b464-d697ec60622c tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5df3d741-8f44-4bc2-b464-d697ec60622c tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Request method failure captured: Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zQi8xczqubvqao_uJKyeW0iTVa44EbvI1h3jqV0juD19S7E74zGkDFMlQnIBX0z6dDyD8XzTxVcV2Jw2TpAKDlDjrbMe2s2m57YyOZlEytJ3WX4zPLap4i9W34XVhJIK-Fd3aCDB86bUXt7b9WvEjSnANzyxKdZerjxTmNhv_uPkps Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 30d99d62982b40c8a8ba29137b2e72df Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ListServersNegativeTestJSON-1451554344 Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ListServersNegativeTestJSON-1451554344 Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 30d99d62982b40c8a8ba29137b2e72df Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1451554344 Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ListServersNegativeTestJSON-1451554344-project Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 4218f795e57244d29c970fb551e1a471 Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ListServersNegativeTestJSON-1451554344-project Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: action_args: {} Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi '-1' Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 19 22:46:45.911687 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 19 22:46:45.916667 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:46:45.916667 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:46:45.916667 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:46:45.916667 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:46:45.916667 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 19 22:46:45.916667 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:45.916667 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:45.916667 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:45.916667 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:45.916667 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:45.916667 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:45.916667 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:46:45.916667 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:46:45.916667 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 19 22:46:45.916667 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:45.916667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5df3d741-8f44-4bc2-b464-d697ec60622c tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:46:45.916667 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5df3d741-8f44-4bc2-b464-d697ec60622c tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.033097 Jul 19 22:46:45.920512 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2013/4052] 10.222.0.25 () {58 vars in 1141 bytes} [Tue Jul 19 22:46:45 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:46:45.931773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-730dbdea-bf1f-4beb-83f3-badae3b16e54 req-0244298e-99ed-4720-a2f0-69aba71499db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abe8d7c1-3c02-425c-923e-de6f717c334b", "tag": "f8c55fe7-7b1c-4bfc-9c03-5a3922412f71"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:45.957382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-730dbdea-bf1f-4beb-83f3-badae3b16e54 req-0244298e-99ed-4720-a2f0-69aba71499db service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:45.961686 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-730dbdea-bf1f-4beb-83f3-badae3b16e54 req-0244298e-99ed-4720-a2f0-69aba71499db service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:45.966247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d4e377a2-4072-4995-bbbf-2a22ab62ce50 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Action: 'create', calling method: .version_select at 0x7f7a0379fee0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1568844223", "policies": ["affinity"]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:45.973458 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-730dbdea-bf1f-4beb-83f3-badae3b16e54 req-0244298e-99ed-4720-a2f0-69aba71499db service nova] Creating event network-changed:f8c55fe7-7b1c-4bfc-9c03-5a3922412f71 for instance abe8d7c1-3c02-425c-923e-de6f717c334b on n-h1-847009-3 Jul 19 22:46:45.978933 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-730dbdea-bf1f-4beb-83f3-badae3b16e54 req-0244298e-99ed-4720-a2f0-69aba71499db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057025 Jul 19 22:46:45.979543 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2014/4053] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:45.986951 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-94adb6b7-d154-4f19-bab8-a3a8ac3d5186 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:45.989108 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-94adb6b7-d154-4f19-bab8-a3a8ac3d5186 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:45.997475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-94adb6b7-d154-4f19-bab8-a3a8ac3d5186 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:45.999229 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-94adb6b7-d154-4f19-bab8-a3a8ac3d5186 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:46.000296 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-94adb6b7-d154-4f19-bab8-a3a8ac3d5186 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:46.000960 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-94adb6b7-d154-4f19-bab8-a3a8ac3d5186 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:46.018932 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-d4e377a2-4072-4995-bbbf-2a22ab62ce50 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Getting quotas for project f62ad52e3deb4d7482fc20872c931353. Resources: {'server_groups'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:46:46.038754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-d4e377a2-4072-4995-bbbf-2a22ab62ce50 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Getting quotas for user 7b72ae39f30344a2a40a3388882c2db4 and project f62ad52e3deb4d7482fc20872c931353. Resources: {'server_groups'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:46:46.076910 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:46:46.119976 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-d4e377a2-4072-4995-bbbf-2a22ab62ce50 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Getting quotas for project f62ad52e3deb4d7482fc20872c931353. Resources: {'server_groups'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:46:46.141831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-d4e377a2-4072-4995-bbbf-2a22ab62ce50 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Getting quotas for user 7b72ae39f30344a2a40a3388882c2db4 and project f62ad52e3deb4d7482fc20872c931353. Resources: {'server_groups'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:46:46.186587 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d4e377a2-4072-4995-bbbf-2a22ab62ce50 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.741569 Jul 19 22:46:46.198867 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2040/4054] 10.222.0.25 () {60 vars in 1173 bytes} [Tue Jul 19 22:46:45 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:46.208086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f645e403-ed34-4286-b824-575b76c2b15f tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f645e403-ed34-4286-b824-575b76c2b15f tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Request method failure captured: Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zQi8xczqubvqao_uJKyeW0iTVa44EbvI1h3jqV0juD19S7E74zGkDFMlQnIBX0z6dDyD8XzTxVcV2Jw2TpAKDlDjrbMe2s2m57YyOZlEytJ3WX4zPLap4i9W34XVhJIK-Fd3aCDB86bUXt7b9WvEjSnANzyxKdZerjxTmNhv_uPkps Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 30d99d62982b40c8a8ba29137b2e72df Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ListServersNegativeTestJSON-1451554344 Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ListServersNegativeTestJSON-1451554344 Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 30d99d62982b40c8a8ba29137b2e72df Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1451554344 Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ListServersNegativeTestJSON-1451554344-project Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 4218f795e57244d29c970fb551e1a471 Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ListServersNegativeTestJSON-1451554344-project Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: action_args: {} Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi 'testing' Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 19 22:46:46.223946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 19 22:46:46.235926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:46:46.235926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:46:46.235926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:46:46.235926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:46:46.235926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 19 22:46:46.235926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:46.235926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:46.235926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:46.235926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:46.235926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:46.235926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:46.235926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:46:46.235926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:46:46.235926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 19 22:46:46.235926 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:46.243848 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f645e403-ed34-4286-b824-575b76c2b15f tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:46:46.243848 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f645e403-ed34-4286-b824-575b76c2b15f tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.040191 Jul 19 22:46:46.247468 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2041/4055] 10.222.0.25 () {58 vars in 1151 bytes} [Tue Jul 19 22:46:46 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:46:46.263869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ee322a83-e01a-4496-a40c-c97af5855a90 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:46.265374 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ee322a83-e01a-4496-a40c-c97af5855a90 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:46.281523 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee322a83-e01a-4496-a40c-c97af5855a90 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:46.282557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee322a83-e01a-4496-a40c-c97af5855a90 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:46.284760 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee322a83-e01a-4496-a40c-c97af5855a90 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:46.285776 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee322a83-e01a-4496-a40c-c97af5855a90 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:46.525920 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-94adb6b7-d154-4f19-bab8-a3a8ac3d5186 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:46.540371 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-94adb6b7-d154-4f19-bab8-a3a8ac3d5186 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1511 microversion: 2.1 time: 0.559298 Jul 19 22:46:46.546643 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2015/4056] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:45 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1511 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:46.557326 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5e81bf48-544f-4821-9d6e-b4c02d8ee9e9 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Action: 'create', calling method: .version_select at 0x7f7a032978b0>, body: {"server_group": {"name": "tempest-server-group-922893134", "policies": ["affinity"]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:46.606165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-5e81bf48-544f-4821-9d6e-b4c02d8ee9e9 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Getting quotas for project f62ad52e3deb4d7482fc20872c931353. Resources: {'server_groups'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:46:46.613437 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-5e81bf48-544f-4821-9d6e-b4c02d8ee9e9 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Getting quotas for user 7b72ae39f30344a2a40a3388882c2db4 and project f62ad52e3deb4d7482fc20872c931353. Resources: {'server_groups'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:46:46.694242 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ee322a83-e01a-4496-a40c-c97af5855a90 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:46.696529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-5e81bf48-544f-4821-9d6e-b4c02d8ee9e9 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Getting quotas for project f62ad52e3deb4d7482fc20872c931353. Resources: {'server_groups'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:46:46.710615 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-5e81bf48-544f-4821-9d6e-b4c02d8ee9e9 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Getting quotas for user 7b72ae39f30344a2a40a3388882c2db4 and project f62ad52e3deb4d7482fc20872c931353. Resources: {'server_groups'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:46:46.723287 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ee322a83-e01a-4496-a40c-c97af5855a90 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1509 microversion: 2.1 time: 0.466143 Jul 19 22:46:46.728316 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2042/4057] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:46 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1509 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:46.741306 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5e81bf48-544f-4821-9d6e-b4c02d8ee9e9 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.192180 Jul 19 22:46:46.742715 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2016/4058] 10.222.0.25 () {60 vars in 1172 bytes} [Tue Jul 19 22:46:46 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:46.748550 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ef3a4484-d794-4433-8962-6b0865a8e368 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:46.750054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ef3a4484-d794-4433-8962-6b0865a8e368 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:46.754973 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-df1c336e-2b2d-47a2-815c-6618e6d69142 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:46.757780 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ef3a4484-d794-4433-8962-6b0865a8e368 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:46.758567 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ef3a4484-d794-4433-8962-6b0865a8e368 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:46.759543 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ef3a4484-d794-4433-8962-6b0865a8e368 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:46.760126 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ef3a4484-d794-4433-8962-6b0865a8e368 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:46.809149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-df1c336e-2b2d-47a2-815c-6618e6d69142 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:46.810483 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-df1c336e-2b2d-47a2-815c-6618e6d69142 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '30d99d62982b40c8a8ba29137b2e72df'} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:46:46.840258 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.compute.servers [None req-df1c336e-2b2d-47a2-815c-6618e6d69142 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Flavor 'non_existing_flavor' could not be found {{(pid=119338) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jul 19 22:46:46.843005 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-df1c336e-2b2d-47a2-815c-6618e6d69142 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.112520 Jul 19 22:46:46.844770 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2043/4059] 10.222.0.25 () {58 vars in 1177 bytes} [Tue Jul 19 22:46:46 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:46:46.864675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bac7c09a-dd79-4e8c-bac6-98ecaa43a0ea tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Action: 'create', calling method: .version_select at 0x7f7a1014a3a0>, body: {"server_group": {"name": "tempest-server-group-922893134", "policies": ["affinity"]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:46.935103 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-bac7c09a-dd79-4e8c-bac6-98ecaa43a0ea tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Getting quotas for project f62ad52e3deb4d7482fc20872c931353. Resources: {'server_groups'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:46:46.963364 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-bac7c09a-dd79-4e8c-bac6-98ecaa43a0ea tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Getting quotas for user 7b72ae39f30344a2a40a3388882c2db4 and project f62ad52e3deb4d7482fc20872c931353. Resources: {'server_groups'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:46:47.066304 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ef3a4484-d794-4433-8962-6b0865a8e368 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:47.097545 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ef3a4484-d794-4433-8962-6b0865a8e368 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1370 microversion: 2.1 time: 0.350037 Jul 19 22:46:47.112646 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2017/4060] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:46 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1370 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:47.129585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-bac7c09a-dd79-4e8c-bac6-98ecaa43a0ea tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Getting quotas for project f62ad52e3deb4d7482fc20872c931353. Resources: {'server_groups'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:46:47.130391 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2dfa919f-e695-4001-8d70-618a4ae6ee86 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:47.133724 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2dfa919f-e695-4001-8d70-618a4ae6ee86 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:47.134527 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2dfa919f-e695-4001-8d70-618a4ae6ee86 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '30d99d62982b40c8a8ba29137b2e72df'} {{(pid=119337) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:46:47.153400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2dfa919f-e695-4001-8d70-618a4ae6ee86 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:47.154247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2dfa919f-e695-4001-8d70-618a4ae6ee86 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:47.155593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-bac7c09a-dd79-4e8c-bac6-98ecaa43a0ea tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Getting quotas for user 7b72ae39f30344a2a40a3388882c2db4 and project f62ad52e3deb4d7482fc20872c931353. Resources: {'server_groups'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:46:47.157084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2dfa919f-e695-4001-8d70-618a4ae6ee86 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:47.158614 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2dfa919f-e695-4001-8d70-618a4ae6ee86 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:47.205863 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bac7c09a-dd79-4e8c-bac6-98ecaa43a0ea tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.357893 Jul 19 22:46:47.210508 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2044/4061] 10.222.0.25 () {60 vars in 1172 bytes} [Tue Jul 19 22:46:46 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:47.221531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8c6f79ae-49c6-4308-862a-f2bf891e6414 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:47.232574 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8c6f79ae-49c6-4308-862a-f2bf891e6414 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] [instance: abe8d7c1-3c02-425c-923e-de6f717c334b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:47.248202 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8c6f79ae-49c6-4308-862a-f2bf891e6414 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:47.262055 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8c6f79ae-49c6-4308-862a-f2bf891e6414 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:47.263969 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8c6f79ae-49c6-4308-862a-f2bf891e6414 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:47.264968 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8c6f79ae-49c6-4308-862a-f2bf891e6414 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:47.275382 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2dfa919f-e695-4001-8d70-618a4ae6ee86 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.159937 Jul 19 22:46:47.279151 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2018/4062] 10.222.0.25 () {58 vars in 1173 bytes} [Tue Jul 19 22:46:47 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:46:47.292128 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3d33b6d4-0853-43e4-bd73-2a1575cbfda8 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:47.323955 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:46:47.332401 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3d33b6d4-0853-43e4-bd73-2a1575cbfda8 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/10fb1a16-1b7d-4fbd-91c1-de9e3a1f39b2" status: 204 len: 0 microversion: 2.1 time: 0.054304 Jul 19 22:46:47.337790 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2019/4063] 10.222.0.25 () {58 vars in 1265 bytes} [Tue Jul 19 22:46:47 2022] DELETE /compute/v2.1/os-server-groups/10fb1a16-1b7d-4fbd-91c1-de9e3a1f39b2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:46:47.343656 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d8e01a1b-6584-4a35-8558-f2714ba8b837 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:47.350743 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d8e01a1b-6584-4a35-8558-f2714ba8b837 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:47.352098 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d8e01a1b-6584-4a35-8558-f2714ba8b837 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '30d99d62982b40c8a8ba29137b2e72df'} {{(pid=119337) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:46:47.359753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d8e01a1b-6584-4a35-8558-f2714ba8b837 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:47.360348 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d8e01a1b-6584-4a35-8558-f2714ba8b837 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:47.367373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d8e01a1b-6584-4a35-8558-f2714ba8b837 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:47.367373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d8e01a1b-6584-4a35-8558-f2714ba8b837 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:47.465829 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d8e01a1b-6584-4a35-8558-f2714ba8b837 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.130999 Jul 19 22:46:47.466745 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2020/4064] 10.222.0.25 () {58 vars in 1183 bytes} [Tue Jul 19 22:46:47 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:46:47.483397 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ccafaef6-ad8b-4008-81aa-77fd8f415bd6 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:47.505960 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ccafaef6-ad8b-4008-81aa-77fd8f415bd6 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.037429 Jul 19 22:46:47.515485 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2021/4065] 10.222.0.25 () {58 vars in 1151 bytes} [Tue Jul 19 22:46:47 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:47.516327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5d804e4e-2f5d-48b5-8941-8c75fb825740 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:47.520618 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5d804e4e-2f5d-48b5-8941-8c75fb825740 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:47.521668 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5d804e4e-2f5d-48b5-8941-8c75fb825740 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Searching by: {'deleted': False, 'project_id': '30d99d62982b40c8a8ba29137b2e72df'} {{(pid=119337) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:46:47.527791 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5d804e4e-2f5d-48b5-8941-8c75fb825740 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:47.528745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5d804e4e-2f5d-48b5-8941-8c75fb825740 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:47.529294 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5d804e4e-2f5d-48b5-8941-8c75fb825740 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:47.529962 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5d804e4e-2f5d-48b5-8941-8c75fb825740 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:47.574723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.multi_cell_list [None req-5d804e4e-2f5d-48b5-8941-8c75fb825740 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119337) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:46:47.656835 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5d804e4e-2f5d-48b5-8941-8c75fb825740 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:47.666353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5d804e4e-2f5d-48b5-8941-8c75fb825740 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:47.666809 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5d804e4e-2f5d-48b5-8941-8c75fb825740 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:47.669589 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8c6f79ae-49c6-4308-862a-f2bf891e6414 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5429e8c7ad483abb1d01e6f6cd2689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f74b40009244fdb9d623395d71f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:47.681050 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:46:47.724673 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8c6f79ae-49c6-4308-862a-f2bf891e6414 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] 10.222.0.25 "GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b" status: 200 len: 1324 microversion: 2.1 time: 0.512282 Jul 19 22:46:47.734798 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2045/4066] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:47 2022] GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b => generated 1324 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:47.747849 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-686eb2a7-c96a-4b11-995a-cdf130ddb62e tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:47.795257 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-686eb2a7-c96a-4b11-995a-cdf130ddb62e tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/08ab3824-5659-4a56-ad29-4bac9c946039" status: 204 len: 0 microversion: 2.1 time: 0.058004 Jul 19 22:46:47.801225 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2046/4067] 10.222.0.25 () {58 vars in 1265 bytes} [Tue Jul 19 22:46:47 2022] DELETE /compute/v2.1/os-server-groups/08ab3824-5659-4a56-ad29-4bac9c946039 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:46:47.819767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0ddcb3ca-4653-4934-8289-cc94b80ebdf8 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:47.821859 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0ddcb3ca-4653-4934-8289-cc94b80ebdf8 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:47.829789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ddcb3ca-4653-4934-8289-cc94b80ebdf8 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:47.831610 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ddcb3ca-4653-4934-8289-cc94b80ebdf8 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:47.833780 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ddcb3ca-4653-4934-8289-cc94b80ebdf8 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:47.835095 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ddcb3ca-4653-4934-8289-cc94b80ebdf8 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:48.034487 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5d804e4e-2f5d-48b5-8941-8c75fb825740 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.521523 Jul 19 22:46:48.035340 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2022/4068] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:46:47 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:48.051460 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e3442668-a515-41c6-a8d7-456b9e299535 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:48.052375 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e3442668-a515-41c6-a8d7-456b9e299535 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:48.067394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3442668-a515-41c6-a8d7-456b9e299535 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:48.068000 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3442668-a515-41c6-a8d7-456b9e299535 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:48.068972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3442668-a515-41c6-a8d7-456b9e299535 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:48.070876 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3442668-a515-41c6-a8d7-456b9e299535 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:48.614002 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0ddcb3ca-4653-4934-8289-cc94b80ebdf8 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:48.632804 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0ddcb3ca-4653-4934-8289-cc94b80ebdf8 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1511 microversion: 2.1 time: 0.829972 Jul 19 22:46:48.636828 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2047/4069] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:47 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1511 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:48.641759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-328f05b5-e297-48ac-b6ca-544a02b9e606 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:48.662930 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-328f05b5-e297-48ac-b6ca-544a02b9e606 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.024859 Jul 19 22:46:48.670250 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2048/4070] 10.222.0.25 () {58 vars in 1151 bytes} [Tue Jul 19 22:46:48 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:48.676602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-30bab692-361a-49c9-8bd3-1a0301c56684 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:48.681120 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-30bab692-361a-49c9-8bd3-1a0301c56684 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:48.682291 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-30bab692-361a-49c9-8bd3-1a0301c56684 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.010846 Jul 19 22:46:48.682971 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2049/4071] 10.222.0.25 () {58 vars in 1177 bytes} [Tue Jul 19 22:46:48 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:46:48.690375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3cf432d8-5ceb-42f7-bed0-daf619185346 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:48.691396 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3cf432d8-5ceb-42f7-bed0-daf619185346 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:48.703487 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3cf432d8-5ceb-42f7-bed0-daf619185346 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:48.704210 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3cf432d8-5ceb-42f7-bed0-daf619185346 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:48.706165 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3cf432d8-5ceb-42f7-bed0-daf619185346 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:48.707245 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3cf432d8-5ceb-42f7-bed0-daf619185346 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:48.776989 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e3442668-a515-41c6-a8d7-456b9e299535 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:48.787317 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e3442668-a515-41c6-a8d7-456b9e299535 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1506 microversion: 2.1 time: 0.750645 Jul 19 22:46:48.808009 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2023/4072] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:48 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1506 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:48.813546 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-db5fd2e7-3d8f-4edc-a8ae-e3c8edb8d97b tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Action: 'create', calling method: .version_select at 0x7f7a10609790>, body: {"server_group": {"name": "tempest-server-group-1882164648", "policies": ["affinity"]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:48.834186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-db5fd2e7-3d8f-4edc-a8ae-e3c8edb8d97b tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Getting quotas for project f62ad52e3deb4d7482fc20872c931353. Resources: {'server_groups'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:46:48.840997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-db5fd2e7-3d8f-4edc-a8ae-e3c8edb8d97b tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Getting quotas for user 7b72ae39f30344a2a40a3388882c2db4 and project f62ad52e3deb4d7482fc20872c931353. Resources: {'server_groups'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:46:48.891079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-db5fd2e7-3d8f-4edc-a8ae-e3c8edb8d97b tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Getting quotas for project f62ad52e3deb4d7482fc20872c931353. Resources: {'server_groups'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:46:48.899477 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-db5fd2e7-3d8f-4edc-a8ae-e3c8edb8d97b tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Getting quotas for user 7b72ae39f30344a2a40a3388882c2db4 and project f62ad52e3deb4d7482fc20872c931353. Resources: {'server_groups'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:46:48.919929 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-db5fd2e7-3d8f-4edc-a8ae-e3c8edb8d97b tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.110446 Jul 19 22:46:48.925634 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2024/4073] 10.222.0.25 () {60 vars in 1172 bytes} [Tue Jul 19 22:46:48 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:48.926642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-633656e4-4b5a-439a-8d7a-32172f0de645 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:48.930733 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-633656e4-4b5a-439a-8d7a-32172f0de645 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:48.931488 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-633656e4-4b5a-439a-8d7a-32172f0de645 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Searching by: {'deleted': False, 'project_id': '30d99d62982b40c8a8ba29137b2e72df'} {{(pid=119337) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 22:46:48.938303 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-633656e4-4b5a-439a-8d7a-32172f0de645 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:48.938788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-633656e4-4b5a-439a-8d7a-32172f0de645 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:48.940416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-633656e4-4b5a-439a-8d7a-32172f0de645 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:48.940863 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-633656e4-4b5a-439a-8d7a-32172f0de645 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:48.960214 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:46:48.975311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.multi_cell_list [None req-633656e4-4b5a-439a-8d7a-32172f0de645 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119337) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 22:46:49.017751 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-633656e4-4b5a-439a-8d7a-32172f0de645 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.095551 Jul 19 22:46:49.019368 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2025/4074] 10.222.0.25 () {58 vars in 1124 bytes} [Tue Jul 19 22:46:48 2022] GET /compute/v2.1/servers => generated 683 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:49.026458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5475d449-39aa-47ef-9873-98e89aabc1ef tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:49.027082 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5475d449-39aa-47ef-9873-98e89aabc1ef tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] [instance: abe8d7c1-3c02-425c-923e-de6f717c334b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:49.035571 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5475d449-39aa-47ef-9873-98e89aabc1ef tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:49.036285 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5475d449-39aa-47ef-9873-98e89aabc1ef tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:49.037229 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5475d449-39aa-47ef-9873-98e89aabc1ef tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:49.037813 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5475d449-39aa-47ef-9873-98e89aabc1ef tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:49.062751 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3cf432d8-5ceb-42f7-bed0-daf619185346 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:49.078728 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3cf432d8-5ceb-42f7-bed0-daf619185346 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1564 microversion: 2.1 time: 0.390509 Jul 19 22:46:49.079424 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2050/4075] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:48 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1564 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:49.084354 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cbc98d25-1d4e-4524-b1cb-fd8cb0a3d5af tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:49.121766 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cbc98d25-1d4e-4524-b1cb-fd8cb0a3d5af tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/1c53d360-5357-497b-9038-e23faa2beb51" status: 204 len: 0 microversion: 2.1 time: 0.040980 Jul 19 22:46:49.123380 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2051/4076] 10.222.0.25 () {58 vars in 1265 bytes} [Tue Jul 19 22:46:49 2022] DELETE /compute/v2.1/os-server-groups/1c53d360-5357-497b-9038-e23faa2beb51 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:46:49.129945 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9be7059b-44ab-4174-b926-b3242d083bf5 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:49.131552 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9be7059b-44ab-4174-b926-b3242d083bf5 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: 29737cca-d066-4284-9d74-504206263041] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:49.138452 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9be7059b-44ab-4174-b926-b3242d083bf5 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:49.138902 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9be7059b-44ab-4174-b926-b3242d083bf5 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:49.139911 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9be7059b-44ab-4174-b926-b3242d083bf5 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:49.140522 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9be7059b-44ab-4174-b926-b3242d083bf5 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:49.170167 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-9be7059b-44ab-4174-b926-b3242d083bf5 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] HTTP exception thrown: Instance 29737cca-d066-4284-9d74-504206263041 could not be found. Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9be7059b-44ab-4174-b926-b3242d083bf5 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Request method failure captured: Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/29737cca-d066-4284-9d74-504206263041 HTTP/1.1 Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zQi8xczqubvqao_uJKyeW0iTVa44EbvI1h3jqV0juD19S7E74zGkDFMlQnIBX0z6dDyD8XzTxVcV2Jw2TpAKDlDjrbMe2s2m57YyOZlEytJ3WX4zPLap4i9W34XVhJIK-Fd3aCDB86bUXt7b9WvEjSnANzyxKdZerjxTmNhv_uPkps Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 30d99d62982b40c8a8ba29137b2e72df Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ListServersNegativeTestJSON-1451554344 Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ListServersNegativeTestJSON-1451554344 Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 30d99d62982b40c8a8ba29137b2e72df Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1451554344 Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ListServersNegativeTestJSON-1451554344-project Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 4218f795e57244d29c970fb551e1a471 Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ListServersNegativeTestJSON-1451554344-project Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 29737cca-d066-4284-9d74-504206263041 could not be found. Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '29737cca-d066-4284-9d74-504206263041'} Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29737cca-d066-4284-9d74-504206263041 could not be found. Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:46:49.171684 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:46:49.179622 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29737cca-d066-4284-9d74-504206263041 could not be found. Jul 19 22:46:49.179622 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:49.179622 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:49.179622 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:49.179622 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:49.179622 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:49.179622 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:49.179622 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:46:49.179622 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:46:49.179622 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29737cca-d066-4284-9d74-504206263041 could not be found. Jul 19 22:46:49.179622 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:49.179622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9be7059b-44ab-4174-b926-b3242d083bf5 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Returning 404 to user: Instance 29737cca-d066-4284-9d74-504206263041 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:46:49.179622 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9be7059b-44ab-4174-b926-b3242d083bf5 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "DELETE /compute/v2.1/servers/29737cca-d066-4284-9d74-504206263041" status: 404 len: 111 microversion: 2.1 time: 0.048474 Jul 19 22:46:49.179622 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2052/4077] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:46:49 2022] DELETE /compute/v2.1/servers/29737cca-d066-4284-9d74-504206263041 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:46:49.182613 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b6e2a3a0-5cfa-4f4d-a1bb-41623100cc5e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:49.183144 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b6e2a3a0-5cfa-4f4d-a1bb-41623100cc5e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:49.190419 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b6e2a3a0-5cfa-4f4d-a1bb-41623100cc5e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:49.190873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b6e2a3a0-5cfa-4f4d-a1bb-41623100cc5e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:49.191721 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b6e2a3a0-5cfa-4f4d-a1bb-41623100cc5e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:49.192170 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b6e2a3a0-5cfa-4f4d-a1bb-41623100cc5e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:49.384901 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b6e2a3a0-5cfa-4f4d-a1bb-41623100cc5e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.206167 Jul 19 22:46:49.386436 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2053/4078] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 19 22:46:49 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-interface => generated 285 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:49.391349 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f855c5d1-f896-4bcf-a755-001eaa44d00c tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:49.412622 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f855c5d1-f896-4bcf-a755-001eaa44d00c tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.024579 Jul 19 22:46:49.416967 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5475d449-39aa-47ef-9873-98e89aabc1ef tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5429e8c7ad483abb1d01e6f6cd2689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f74b40009244fdb9d623395d71f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:49.434184 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2054/4079] 10.222.0.25 () {58 vars in 1151 bytes} [Tue Jul 19 22:46:49 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:49.441669 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5475d449-39aa-47ef-9873-98e89aabc1ef tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] 10.222.0.25 "GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b" status: 200 len: 1324 microversion: 2.1 time: 0.421202 Jul 19 22:46:49.442559 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2026/4080] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:49 2022] GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b => generated 1324 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:49.446850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-96ca17bf-ddc8-49fc-945a-1d9fa742d66a tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:49.451816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-96ca17bf-ddc8-49fc-945a-1d9fa742d66a tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: 769cbbd5-9a7b-43ee-bd65-bf62817c4353] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:49.461755 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2badba7f-f895-4f9a-907b-65c47a1a82b1 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Action: 'create', calling method: .version_select at 0x7f7a032ccc10>, body: {"server_group": {"name": "tempest-server-group-127395430", "policies": ["anti-affinity"]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:49.465503 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96ca17bf-ddc8-49fc-945a-1d9fa742d66a tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:49.465971 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96ca17bf-ddc8-49fc-945a-1d9fa742d66a tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:49.466775 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96ca17bf-ddc8-49fc-945a-1d9fa742d66a tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:49.467352 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96ca17bf-ddc8-49fc-945a-1d9fa742d66a tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:49.489423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-2badba7f-f895-4f9a-907b-65c47a1a82b1 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Getting quotas for project f62ad52e3deb4d7482fc20872c931353. Resources: {'server_groups'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:46:49.497668 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-96ca17bf-ddc8-49fc-945a-1d9fa742d66a tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: 769cbbd5-9a7b-43ee-bd65-bf62817c4353] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:46:49.497857 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-2badba7f-f895-4f9a-907b-65c47a1a82b1 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Getting quotas for user 7b72ae39f30344a2a40a3388882c2db4 and project f62ad52e3deb4d7482fc20872c931353. Resources: {'server_groups'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:46:49.603203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-2badba7f-f895-4f9a-907b-65c47a1a82b1 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Getting quotas for project f62ad52e3deb4d7482fc20872c931353. Resources: {'server_groups'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:46:49.612652 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-2badba7f-f895-4f9a-907b-65c47a1a82b1 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Getting quotas for user 7b72ae39f30344a2a40a3388882c2db4 and project f62ad52e3deb4d7482fc20872c931353. Resources: {'server_groups'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:46:49.632897 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-96ca17bf-ddc8-49fc-945a-1d9fa742d66a tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "DELETE /compute/v2.1/servers/769cbbd5-9a7b-43ee-bd65-bf62817c4353" status: 204 len: 0 microversion: 2.1 time: 0.196247 Jul 19 22:46:49.634386 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2055/4081] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:46:49 2022] DELETE /compute/v2.1/servers/769cbbd5-9a7b-43ee-bd65-bf62817c4353 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:46:49.636752 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2badba7f-f895-4f9a-907b-65c47a1a82b1 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.191983 Jul 19 22:46:49.639627 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2027/4082] 10.222.0.25 () {60 vars in 1172 bytes} [Tue Jul 19 22:46:49 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:49.650164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-36d97fb0-6584-4792-9eb3-0b472dcbb623 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:49.651679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4c7feba6-a78e-4458-ad56-65cbc9c03458 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:49.652293 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4c7feba6-a78e-4458-ad56-65cbc9c03458 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: e0066e47-43b9-49f0-997d-854601201bd7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:49.665506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4c7feba6-a78e-4458-ad56-65cbc9c03458 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:49.672979 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4c7feba6-a78e-4458-ad56-65cbc9c03458 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:49.674629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4c7feba6-a78e-4458-ad56-65cbc9c03458 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:49.675092 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4c7feba6-a78e-4458-ad56-65cbc9c03458 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:49.693868 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-36d97fb0-6584-4792-9eb3-0b472dcbb623 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/eccdafd6-e0b8-4cc9-8d26-c1bebd681c4a" status: 204 len: 0 microversion: 2.1 time: 0.049281 Jul 19 22:46:49.695603 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2028/4083] 10.222.0.25 () {58 vars in 1265 bytes} [Tue Jul 19 22:46:49 2022] DELETE /compute/v2.1/os-server-groups/eccdafd6-e0b8-4cc9-8d26-c1bebd681c4a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:46:49.703900 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-22cbbbe6-4114-4c21-a640-431064819e1d tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:49.705605 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-22cbbbe6-4114-4c21-a640-431064819e1d tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:49.714040 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22cbbbe6-4114-4c21-a640-431064819e1d tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:49.715256 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22cbbbe6-4114-4c21-a640-431064819e1d tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:49.716334 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22cbbbe6-4114-4c21-a640-431064819e1d tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:49.716928 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22cbbbe6-4114-4c21-a640-431064819e1d tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:49.726996 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4c7feba6-a78e-4458-ad56-65cbc9c03458 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: e0066e47-43b9-49f0-997d-854601201bd7] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:46:49.874400 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4c7feba6-a78e-4458-ad56-65cbc9c03458 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7" status: 204 len: 0 microversion: 2.1 time: 0.235084 Jul 19 22:46:49.875553 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2056/4084] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:46:49 2022] DELETE /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:46:49.883319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8bc603a6-6557-49a8-841e-1a00ccb5f66a tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:49.897653 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8bc603a6-6557-49a8-841e-1a00ccb5f66a tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.019860 Jul 19 22:46:49.898581 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2057/4085] 10.222.0.25 () {58 vars in 1151 bytes} [Tue Jul 19 22:46:49 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:50.129392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-22cbbbe6-4114-4c21-a640-431064819e1d tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:50.152510 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-22cbbbe6-4114-4c21-a640-431064819e1d tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1511 microversion: 2.1 time: 0.450782 Jul 19 22:46:50.155442 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2029/4086] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:49 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1511 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:50.165049 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-537a3425-03b6-4036-b6cd-463196f79db9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:50.186654 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-537a3425-03b6-4036-b6cd-463196f79db9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: 29737cca-d066-4284-9d74-504206263041] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:50.209255 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-537a3425-03b6-4036-b6cd-463196f79db9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:50.214253 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-537a3425-03b6-4036-b6cd-463196f79db9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:50.233791 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-537a3425-03b6-4036-b6cd-463196f79db9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:50.234274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-537a3425-03b6-4036-b6cd-463196f79db9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:50.252434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8400f13b-f912-41b0-ab13-d915fe29b112 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:50.254031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8400f13b-f912-41b0-ab13-d915fe29b112 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:50.262653 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-537a3425-03b6-4036-b6cd-463196f79db9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] HTTP exception thrown: Instance 29737cca-d066-4284-9d74-504206263041 could not be found. Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-537a3425-03b6-4036-b6cd-463196f79db9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Request method failure captured: Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/29737cca-d066-4284-9d74-504206263041 HTTP/1.1 Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zQi8xczqubvqao_uJKyeW0iTVa44EbvI1h3jqV0juD19S7E74zGkDFMlQnIBX0z6dDyD8XzTxVcV2Jw2TpAKDlDjrbMe2s2m57YyOZlEytJ3WX4zPLap4i9W34XVhJIK-Fd3aCDB86bUXt7b9WvEjSnANzyxKdZerjxTmNhv_uPkps Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 30d99d62982b40c8a8ba29137b2e72df Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ListServersNegativeTestJSON-1451554344 Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ListServersNegativeTestJSON-1451554344 Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 30d99d62982b40c8a8ba29137b2e72df Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1451554344 Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ListServersNegativeTestJSON-1451554344-project Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 4218f795e57244d29c970fb551e1a471 Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ListServersNegativeTestJSON-1451554344-project Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 29737cca-d066-4284-9d74-504206263041 could not be found. Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '29737cca-d066-4284-9d74-504206263041'} Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29737cca-d066-4284-9d74-504206263041 could not be found. Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29737cca-d066-4284-9d74-504206263041 could not be found. Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:50.266868 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:50.271495 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:50.271495 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:50.271495 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:50.271495 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:46:50.271495 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:46:50.271495 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29737cca-d066-4284-9d74-504206263041 could not be found. Jul 19 22:46:50.271495 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:50.272377 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8400f13b-f912-41b0-ab13-d915fe29b112 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:50.272510 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-537a3425-03b6-4036-b6cd-463196f79db9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Returning 404 to user: Instance 29737cca-d066-4284-9d74-504206263041 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:46:50.272635 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8400f13b-f912-41b0-ab13-d915fe29b112 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:50.272635 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8400f13b-f912-41b0-ab13-d915fe29b112 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:50.272857 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-537a3425-03b6-4036-b6cd-463196f79db9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/29737cca-d066-4284-9d74-504206263041" status: 404 len: 111 microversion: 2.1 time: 0.111439 Jul 19 22:46:50.272989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8400f13b-f912-41b0-ab13-d915fe29b112 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:50.273771 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2030/4087] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:50 2022] GET /compute/v2.1/servers/29737cca-d066-4284-9d74-504206263041 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:46:50.280562 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3554ce7b-785f-4a20-bc9a-2aa4e96fde8d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-299920824", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "09a48519-e7ea-4a73-be1f-045af1ec2495"}]}, "os:scheduler_hints": {"group": "b40214b1-d211-4937-8f90-71f3c505ba6b"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:50.374073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-3554ce7b-785f-4a20-bc9a-2aa4e96fde8d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] validate_networks() for [('09a48519-e7ea-4a73-be1f-045af1ec2495', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:46:50.678166 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8400f13b-f912-41b0-ab13-d915fe29b112 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:50.688232 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8400f13b-f912-41b0-ab13-d915fe29b112 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1506 microversion: 2.1 time: 0.788512 Jul 19 22:46:50.689306 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2058/4088] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:49 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1506 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:50.695954 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-ec7bf844-fd35-4c8b-a66d-a1be2d4008d7 req-3d5901fa-9953-43ff-aa6c-2177c1aca778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78349902-af4b-44e1-a79e-da1d1217b328", "name": "network-vif-unplugged", "status": "completed", "tag": "8ce296ac-f78e-4559-bda4-3615294b6700"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:50.708534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-ec7bf844-fd35-4c8b-a66d-a1be2d4008d7 req-3d5901fa-9953-43ff-aa6c-2177c1aca778 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:50.709372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-ec7bf844-fd35-4c8b-a66d-a1be2d4008d7 req-3d5901fa-9953-43ff-aa6c-2177c1aca778 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:50.726776 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-ec7bf844-fd35-4c8b-a66d-a1be2d4008d7 req-3d5901fa-9953-43ff-aa6c-2177c1aca778 service nova] Creating event network-vif-unplugged:8ce296ac-f78e-4559-bda4-3615294b6700 for instance 78349902-af4b-44e1-a79e-da1d1217b328 on n-h2-847009-3 Jul 19 22:46:50.733905 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-ec7bf844-fd35-4c8b-a66d-a1be2d4008d7 req-3d5901fa-9953-43ff-aa6c-2177c1aca778 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041320 Jul 19 22:46:50.733905 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2059/4089] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:50.742478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d8ded231-000d-4900-acae-d8da79401bb9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:50.743936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d8ded231-000d-4900-acae-d8da79401bb9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: 769cbbd5-9a7b-43ee-bd65-bf62817c4353] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:50.749388 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=88,nova_api:DELETE=6,nova_api:UPDATE=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:46:50.758280 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d8ded231-000d-4900-acae-d8da79401bb9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:50.759976 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d8ded231-000d-4900-acae-d8da79401bb9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:50.761454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d8ded231-000d-4900-acae-d8da79401bb9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:50.762380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d8ded231-000d-4900-acae-d8da79401bb9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:51.051881 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d8ded231-000d-4900-acae-d8da79401bb9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:51.061506 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d8ded231-000d-4900-acae-d8da79401bb9 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/769cbbd5-9a7b-43ee-bd65-bf62817c4353" status: 200 len: 1522 microversion: 2.1 time: 0.327139 Jul 19 22:46:51.062205 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2060/4090] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:50 2022] GET /compute/v2.1/servers/769cbbd5-9a7b-43ee-bd65-bf62817c4353 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:51.078059 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-67b7a431-1513-40e8-bf00-8cb306bbee2d tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:51.078952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-67b7a431-1513-40e8-bf00-8cb306bbee2d tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] [instance: abe8d7c1-3c02-425c-923e-de6f717c334b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:51.086959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67b7a431-1513-40e8-bf00-8cb306bbee2d tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:51.087512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67b7a431-1513-40e8-bf00-8cb306bbee2d tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:51.088355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67b7a431-1513-40e8-bf00-8cb306bbee2d tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:51.089146 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67b7a431-1513-40e8-bf00-8cb306bbee2d tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:51.250583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-3554ce7b-785f-4a20-bc9a-2aa4e96fde8d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:46:51.251165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-3554ce7b-785f-4a20-bc9a-2aa4e96fde8d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:46:51.252447 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-3554ce7b-785f-4a20-bc9a-2aa4e96fde8d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:46:51.252886 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-3554ce7b-785f-4a20-bc9a-2aa4e96fde8d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:46:51.253395 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-3554ce7b-785f-4a20-bc9a-2aa4e96fde8d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:46:51.275243 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3554ce7b-785f-4a20-bc9a-2aa4e96fde8d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:51.275979 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3554ce7b-785f-4a20-bc9a-2aa4e96fde8d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:51.277006 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3554ce7b-785f-4a20-bc9a-2aa4e96fde8d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:51.277632 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3554ce7b-785f-4a20-bc9a-2aa4e96fde8d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:51.320181 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-3554ce7b-785f-4a20-bc9a-2aa4e96fde8d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Getting quotas for project f62ad52e3deb4d7482fc20872c931353. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:46:51.336728 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-3554ce7b-785f-4a20-bc9a-2aa4e96fde8d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Getting quotas for user 7b72ae39f30344a2a40a3388882c2db4 and project f62ad52e3deb4d7482fc20872c931353. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:46:51.375166 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3554ce7b-785f-4a20-bc9a-2aa4e96fde8d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:46:51.380961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3554ce7b-785f-4a20-bc9a-2aa4e96fde8d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] [instance: f3d5b823-3f04-4366-b744-8c2fd88a23ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:46:51.405061 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-67b7a431-1513-40e8-bf00-8cb306bbee2d tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5429e8c7ad483abb1d01e6f6cd2689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f74b40009244fdb9d623395d71f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:51.429997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:46:51.437233 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-67b7a431-1513-40e8-bf00-8cb306bbee2d tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] 10.222.0.25 "GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b" status: 200 len: 1324 microversion: 2.1 time: 0.361148 Jul 19 22:46:51.440710 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2061/4091] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:51 2022] GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b => generated 1324 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:51.458835 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-569a86f8-4b9e-4fd1-8703-cd9178879be5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:51.459893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-569a86f8-4b9e-4fd1-8703-cd9178879be5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:51.460303 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-3554ce7b-785f-4a20-bc9a-2aa4e96fde8d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119337) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 19 22:46:51.475832 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-569a86f8-4b9e-4fd1-8703-cd9178879be5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:51.476670 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-569a86f8-4b9e-4fd1-8703-cd9178879be5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:51.478400 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-569a86f8-4b9e-4fd1-8703-cd9178879be5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:51.478980 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-569a86f8-4b9e-4fd1-8703-cd9178879be5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:51.514966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-3554ce7b-785f-4a20-bc9a-2aa4e96fde8d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Getting quotas for project f62ad52e3deb4d7482fc20872c931353. Resources: {'server_group_members'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:46:51.524877 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-3554ce7b-785f-4a20-bc9a-2aa4e96fde8d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Getting quotas for user 7b72ae39f30344a2a40a3388882c2db4 and project f62ad52e3deb4d7482fc20872c931353. Resources: {'server_group_members'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:46:51.603844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-3554ce7b-785f-4a20-bc9a-2aa4e96fde8d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Getting quotas for project f62ad52e3deb4d7482fc20872c931353. Resources: {'server_group_members'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:46:51.616710 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-3554ce7b-785f-4a20-bc9a-2aa4e96fde8d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Getting quotas for user 7b72ae39f30344a2a40a3388882c2db4 and project f62ad52e3deb4d7482fc20872c931353. Resources: {'server_group_members'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:46:51.687703 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3554ce7b-785f-4a20-bc9a-2aa4e96fde8d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.411085 Jul 19 22:46:51.690609 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2031/4092] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:46:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:46:51.698519 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-f85bfa4b-7758-4e01-bfcb-4ae1bd275e1e req-6b4c4031-56ad-4481-8063-12fb2757de0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02571222-3b10-4a0d-8b70-a8202c37f6a7", "tag": "542dbd38-d2d6-470e-be1a-a605a204b40b"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:51.724648 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-f85bfa4b-7758-4e01-bfcb-4ae1bd275e1e req-6b4c4031-56ad-4481-8063-12fb2757de0e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:51.725282 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-f85bfa4b-7758-4e01-bfcb-4ae1bd275e1e req-6b4c4031-56ad-4481-8063-12fb2757de0e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:51.754502 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-f85bfa4b-7758-4e01-bfcb-4ae1bd275e1e req-6b4c4031-56ad-4481-8063-12fb2757de0e service nova] Creating event network-changed:542dbd38-d2d6-470e-be1a-a605a204b40b for instance 02571222-3b10-4a0d-8b70-a8202c37f6a7 on n-h2-847009-3 Jul 19 22:46:51.785369 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-f85bfa4b-7758-4e01-bfcb-4ae1bd275e1e req-6b4c4031-56ad-4481-8063-12fb2757de0e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089238 Jul 19 22:46:51.787334 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2032/4093] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:51.793795 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e80b190c-22fc-4023-9732-08c7a5b467fc tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:51.795043 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e80b190c-22fc-4023-9732-08c7a5b467fc tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] [instance: f3d5b823-3f04-4366-b744-8c2fd88a23ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:51.925134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e80b190c-22fc-4023-9732-08c7a5b467fc tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b72ae39f30344a2a40a3388882c2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ad52e3deb4d7482fc20872c931353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:51.941161 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e80b190c-22fc-4023-9732-08c7a5b467fc tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca" status: 200 len: 1212 microversion: 2.1 time: 0.151396 Jul 19 22:46:51.950439 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2033/4094] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:51 2022] GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca => generated 1212 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:51.957922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-93cdaefb-3d2b-44f6-8705-1c629342a1a8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:51.958560 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-93cdaefb-3d2b-44f6-8705-1c629342a1a8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:51.966791 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-93cdaefb-3d2b-44f6-8705-1c629342a1a8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:51.966791 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-93cdaefb-3d2b-44f6-8705-1c629342a1a8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:51.967069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-93cdaefb-3d2b-44f6-8705-1c629342a1a8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:51.967460 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-93cdaefb-3d2b-44f6-8705-1c629342a1a8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:52.007959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-569a86f8-4b9e-4fd1-8703-cd9178879be5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:52.023603 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-569a86f8-4b9e-4fd1-8703-cd9178879be5 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1511 microversion: 2.1 time: 0.580558 Jul 19 22:46:52.024220 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2062/4095] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:51 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1511 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:52.081564 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3f7ee057-f51a-4bad-99e4-a74932e37784 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:52.082509 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3f7ee057-f51a-4bad-99e4-a74932e37784 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: 769cbbd5-9a7b-43ee-bd65-bf62817c4353] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:52.090080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3f7ee057-f51a-4bad-99e4-a74932e37784 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:52.090660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3f7ee057-f51a-4bad-99e4-a74932e37784 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:52.091657 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3f7ee057-f51a-4bad-99e4-a74932e37784 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:52.092332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3f7ee057-f51a-4bad-99e4-a74932e37784 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:52.594285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3f7ee057-f51a-4bad-99e4-a74932e37784 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:52.610466 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3f7ee057-f51a-4bad-99e4-a74932e37784 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/769cbbd5-9a7b-43ee-bd65-bf62817c4353" status: 200 len: 1480 microversion: 2.1 time: 0.534281 Jul 19 22:46:52.617413 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2063/4096] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:52 2022] GET /compute/v2.1/servers/769cbbd5-9a7b-43ee-bd65-bf62817c4353 => generated 1480 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:46:52.633022 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-caa3ce1c-dfb8-42af-a7ee-86c61a9f3856 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:52.635078 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-caa3ce1c-dfb8-42af-a7ee-86c61a9f3856 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] [instance: abe8d7c1-3c02-425c-923e-de6f717c334b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:52.651656 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-caa3ce1c-dfb8-42af-a7ee-86c61a9f3856 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:52.652392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-caa3ce1c-dfb8-42af-a7ee-86c61a9f3856 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:52.653400 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-caa3ce1c-dfb8-42af-a7ee-86c61a9f3856 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:52.655726 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-caa3ce1c-dfb8-42af-a7ee-86c61a9f3856 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:52.730928 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-93cdaefb-3d2b-44f6-8705-1c629342a1a8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:52.743270 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-93cdaefb-3d2b-44f6-8705-1c629342a1a8 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1506 microversion: 2.1 time: 0.791525 Jul 19 22:46:52.744692 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2034/4097] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:51 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1506 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:52.771197 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-63ee8018-584e-490c-b2de-7ac4e370fb6e req-e5205368-c130-47c7-abf5-0ba642d5a322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "769cbbd5-9a7b-43ee-bd65-bf62817c4353", "name": "network-vif-deleted", "tag": "3decaa7b-1da5-4f02-8391-bbd7b18f207a"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:52.805498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-63ee8018-584e-490c-b2de-7ac4e370fb6e req-e5205368-c130-47c7-abf5-0ba642d5a322 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:52.806277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-63ee8018-584e-490c-b2de-7ac4e370fb6e req-e5205368-c130-47c7-abf5-0ba642d5a322 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:52.832805 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-63ee8018-584e-490c-b2de-7ac4e370fb6e req-e5205368-c130-47c7-abf5-0ba642d5a322 service nova] Creating event network-vif-deleted:3decaa7b-1da5-4f02-8391-bbd7b18f207a for instance 769cbbd5-9a7b-43ee-bd65-bf62817c4353 on n-h1-847009-3 Jul 19 22:46:52.842743 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-63ee8018-584e-490c-b2de-7ac4e370fb6e req-e5205368-c130-47c7-abf5-0ba642d5a322 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094198 Jul 19 22:46:52.844233 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2035/4098] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:52.888885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-1d7d7f65-9866-453e-ad8a-5d9bc21c18f3 req-86b56ed7-5e98-4ad5-8232-acb31fd40e08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe8d7c1-3c02-425c-923e-de6f717c334b", "name": "network-vif-plugged", "status": "completed", "tag": "f8c55fe7-7b1c-4bfc-9c03-5a3922412f71"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:52.912377 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1d7d7f65-9866-453e-ad8a-5d9bc21c18f3 req-86b56ed7-5e98-4ad5-8232-acb31fd40e08 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:52.912749 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1d7d7f65-9866-453e-ad8a-5d9bc21c18f3 req-86b56ed7-5e98-4ad5-8232-acb31fd40e08 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:52.941981 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-1d7d7f65-9866-453e-ad8a-5d9bc21c18f3 req-86b56ed7-5e98-4ad5-8232-acb31fd40e08 service nova] Creating event network-vif-plugged:f8c55fe7-7b1c-4bfc-9c03-5a3922412f71 for instance abe8d7c1-3c02-425c-923e-de6f717c334b on n-h1-847009-3 Jul 19 22:46:52.953863 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-1d7d7f65-9866-453e-ad8a-5d9bc21c18f3 req-86b56ed7-5e98-4ad5-8232-acb31fd40e08 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076579 Jul 19 22:46:52.957046 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2036/4099] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:52.968093 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-be06c8f3-e44e-4b1e-8c0f-ec1e7ce26337 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:52.969070 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-be06c8f3-e44e-4b1e-8c0f-ec1e7ce26337 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] [instance: f3d5b823-3f04-4366-b744-8c2fd88a23ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:52.977956 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be06c8f3-e44e-4b1e-8c0f-ec1e7ce26337 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:52.977956 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be06c8f3-e44e-4b1e-8c0f-ec1e7ce26337 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:52.978500 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be06c8f3-e44e-4b1e-8c0f-ec1e7ce26337 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:52.979961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be06c8f3-e44e-4b1e-8c0f-ec1e7ce26337 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:53.103288 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-be06c8f3-e44e-4b1e-8c0f-ec1e7ce26337 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b72ae39f30344a2a40a3388882c2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ad52e3deb4d7482fc20872c931353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:53.115309 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-be06c8f3-e44e-4b1e-8c0f-ec1e7ce26337 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca" status: 200 len: 1216 microversion: 2.1 time: 0.156562 Jul 19 22:46:53.116462 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2037/4100] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:52 2022] GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca => generated 1216 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:53.121353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-756459ac-22bf-481d-9375-2ff8be1a5d3e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:53.121974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-756459ac-22bf-481d-9375-2ff8be1a5d3e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:53.129150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-756459ac-22bf-481d-9375-2ff8be1a5d3e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:53.129603 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-756459ac-22bf-481d-9375-2ff8be1a5d3e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:53.130383 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-756459ac-22bf-481d-9375-2ff8be1a5d3e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:53.130823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-756459ac-22bf-481d-9375-2ff8be1a5d3e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:53.184740 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-caa3ce1c-dfb8-42af-a7ee-86c61a9f3856 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5429e8c7ad483abb1d01e6f6cd2689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f74b40009244fdb9d623395d71f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:53.194154 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-caa3ce1c-dfb8-42af-a7ee-86c61a9f3856 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] 10.222.0.25 "GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b" status: 200 len: 1324 microversion: 2.1 time: 0.574877 Jul 19 22:46:53.204600 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2064/4101] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:52 2022] GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b => generated 1324 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:53.536117 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-756459ac-22bf-481d-9375-2ff8be1a5d3e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:53.548852 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-756459ac-22bf-481d-9375-2ff8be1a5d3e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1511 microversion: 2.1 time: 0.431030 Jul 19 22:46:53.550017 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2038/4102] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:53 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1511 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:53.640725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d3352c8c-fd3f-45fb-891c-2ec69f4e5f89 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:53.645755 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d3352c8c-fd3f-45fb-891c-2ec69f4e5f89 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: 769cbbd5-9a7b-43ee-bd65-bf62817c4353] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:53.652727 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3352c8c-fd3f-45fb-891c-2ec69f4e5f89 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:53.653180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3352c8c-fd3f-45fb-891c-2ec69f4e5f89 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:53.653965 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3352c8c-fd3f-45fb-891c-2ec69f4e5f89 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:53.654415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3352c8c-fd3f-45fb-891c-2ec69f4e5f89 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:53.685328 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-d3352c8c-fd3f-45fb-891c-2ec69f4e5f89 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] HTTP exception thrown: Instance 769cbbd5-9a7b-43ee-bd65-bf62817c4353 could not be found. Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d3352c8c-fd3f-45fb-891c-2ec69f4e5f89 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Request method failure captured: Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/769cbbd5-9a7b-43ee-bd65-bf62817c4353 HTTP/1.1 Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zQi8xczqubvqao_uJKyeW0iTVa44EbvI1h3jqV0juD19S7E74zGkDFMlQnIBX0z6dDyD8XzTxVcV2Jw2TpAKDlDjrbMe2s2m57YyOZlEytJ3WX4zPLap4i9W34XVhJIK-Fd3aCDB86bUXt7b9WvEjSnANzyxKdZerjxTmNhv_uPkps Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 30d99d62982b40c8a8ba29137b2e72df Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ListServersNegativeTestJSON-1451554344 Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ListServersNegativeTestJSON-1451554344 Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 30d99d62982b40c8a8ba29137b2e72df Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1451554344 Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ListServersNegativeTestJSON-1451554344-project Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 4218f795e57244d29c970fb551e1a471 Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ListServersNegativeTestJSON-1451554344-project Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 769cbbd5-9a7b-43ee-bd65-bf62817c4353 could not be found. Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '769cbbd5-9a7b-43ee-bd65-bf62817c4353'} Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 769cbbd5-9a7b-43ee-bd65-bf62817c4353 could not be found. Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 769cbbd5-9a7b-43ee-bd65-bf62817c4353 could not be found. Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:53.687428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:53.691901 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:53.691901 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:53.691901 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:53.691901 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:46:53.691901 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:46:53.691901 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 769cbbd5-9a7b-43ee-bd65-bf62817c4353 could not be found. Jul 19 22:46:53.691901 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:53.693479 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d3352c8c-fd3f-45fb-891c-2ec69f4e5f89 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Returning 404 to user: Instance 769cbbd5-9a7b-43ee-bd65-bf62817c4353 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:46:53.694506 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d3352c8c-fd3f-45fb-891c-2ec69f4e5f89 tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/769cbbd5-9a7b-43ee-bd65-bf62817c4353" status: 404 len: 111 microversion: 2.1 time: 0.064536 Jul 19 22:46:53.698769 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2065/4103] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:53 2022] GET /compute/v2.1/servers/769cbbd5-9a7b-43ee-bd65-bf62817c4353 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:46:53.707281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cf027fac-d14a-4cb8-84b4-a6ff120c9e6e tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:53.708261 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cf027fac-d14a-4cb8-84b4-a6ff120c9e6e tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: e0066e47-43b9-49f0-997d-854601201bd7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:53.729017 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cf027fac-d14a-4cb8-84b4-a6ff120c9e6e tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:53.729487 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cf027fac-d14a-4cb8-84b4-a6ff120c9e6e tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:53.732268 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cf027fac-d14a-4cb8-84b4-a6ff120c9e6e tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:53.733000 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cf027fac-d14a-4cb8-84b4-a6ff120c9e6e tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:53.763745 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-91f7db13-8ac9-4e04-b22b-08c39940a63d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:53.764652 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-91f7db13-8ac9-4e04-b22b-08c39940a63d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:53.778194 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91f7db13-8ac9-4e04-b22b-08c39940a63d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:53.783717 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91f7db13-8ac9-4e04-b22b-08c39940a63d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:53.784894 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91f7db13-8ac9-4e04-b22b-08c39940a63d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:53.785488 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91f7db13-8ac9-4e04-b22b-08c39940a63d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:53.898364 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cf027fac-d14a-4cb8-84b4-a6ff120c9e6e tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4218f795e57244d29c970fb551e1a471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d99d62982b40c8a8ba29137b2e72df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:53.914742 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cf027fac-d14a-4cb8-84b4-a6ff120c9e6e tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7" status: 200 len: 1480 microversion: 2.1 time: 0.214276 Jul 19 22:46:53.915841 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2039/4104] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:53 2022] GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7 => generated 1480 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:54.130924 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-91f7db13-8ac9-4e04-b22b-08c39940a63d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:54.134955 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ab30525f-0333-4154-a7b1-8b14506972d6 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:54.136263 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ab30525f-0333-4154-a7b1-8b14506972d6 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] [instance: f3d5b823-3f04-4366-b744-8c2fd88a23ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:54.142678 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-91f7db13-8ac9-4e04-b22b-08c39940a63d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 200 len: 1449 microversion: 2.1 time: 0.384138 Jul 19 22:46:54.154228 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2066/4105] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:53 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 1449 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:54.156756 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab30525f-0333-4154-a7b1-8b14506972d6 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:54.157219 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab30525f-0333-4154-a7b1-8b14506972d6 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:54.159412 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab30525f-0333-4154-a7b1-8b14506972d6 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:54.160122 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab30525f-0333-4154-a7b1-8b14506972d6 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:54.169432 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f0a59060-f3b8-4792-b038-1b88d410471f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:54.170327 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f0a59060-f3b8-4792-b038-1b88d410471f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:54.187853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f0a59060-f3b8-4792-b038-1b88d410471f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:54.187853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f0a59060-f3b8-4792-b038-1b88d410471f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:54.187853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f0a59060-f3b8-4792-b038-1b88d410471f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:54.187853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f0a59060-f3b8-4792-b038-1b88d410471f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:54.206210 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:46:54.310558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ab30525f-0333-4154-a7b1-8b14506972d6 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b72ae39f30344a2a40a3388882c2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ad52e3deb4d7482fc20872c931353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:54.319637 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ab30525f-0333-4154-a7b1-8b14506972d6 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca" status: 200 len: 1272 microversion: 2.1 time: 0.190634 Jul 19 22:46:54.320649 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2040/4106] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:54 2022] GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca => generated 1272 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:46:54.325836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3835da88-d06a-41f3-8935-93321b5ad9ca tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:54.326462 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3835da88-d06a-41f3-8935-93321b5ad9ca tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] [instance: abe8d7c1-3c02-425c-923e-de6f717c334b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:54.334807 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3835da88-d06a-41f3-8935-93321b5ad9ca tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:54.335647 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3835da88-d06a-41f3-8935-93321b5ad9ca tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:54.336089 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3835da88-d06a-41f3-8935-93321b5ad9ca tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:54.336530 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3835da88-d06a-41f3-8935-93321b5ad9ca tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:54.519067 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f0a59060-f3b8-4792-b038-1b88d410471f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:54.530813 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f0a59060-f3b8-4792-b038-1b88d410471f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.372982 Jul 19 22:46:54.532912 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2067/4107] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:54 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:54.578021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6771fe87-dfa0-4b73-891b-2f534e948925 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:54.590491 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6771fe87-dfa0-4b73-891b-2f534e948925 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:54.612853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6771fe87-dfa0-4b73-891b-2f534e948925 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:54.615348 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6771fe87-dfa0-4b73-891b-2f534e948925 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:54.632678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6771fe87-dfa0-4b73-891b-2f534e948925 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:54.640741 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6771fe87-dfa0-4b73-891b-2f534e948925 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:54.746627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3835da88-d06a-41f3-8935-93321b5ad9ca tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5429e8c7ad483abb1d01e6f6cd2689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f74b40009244fdb9d623395d71f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:54.755145 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3835da88-d06a-41f3-8935-93321b5ad9ca tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] 10.222.0.25 "GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b" status: 200 len: 1324 microversion: 2.1 time: 0.433198 Jul 19 22:46:54.758985 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2041/4108] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:54 2022] GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b => generated 1324 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:54.787942 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-83649bf7-5548-4ffc-85a3-9f9e3ab8b8bd tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:54.788795 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-83649bf7-5548-4ffc-85a3-9f9e3ab8b8bd tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:54.795244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-83649bf7-5548-4ffc-85a3-9f9e3ab8b8bd tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:54.803389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-83649bf7-5548-4ffc-85a3-9f9e3ab8b8bd tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:54.804946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-83649bf7-5548-4ffc-85a3-9f9e3ab8b8bd tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:54.805540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-83649bf7-5548-4ffc-85a3-9f9e3ab8b8bd tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:54.842411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:46:55.145063 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6771fe87-dfa0-4b73-891b-2f534e948925 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:55.153005 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6771fe87-dfa0-4b73-891b-2f534e948925 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.596985 Jul 19 22:46:55.153604 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2068/4109] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:54 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:55.158543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-b3517768-b18a-42c6-80f0-12059e728150 req-1dc53cfe-bd94-4b55-bf3c-6991c51b9838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0066e47-43b9-49f0-997d-854601201bd7", "name": "network-vif-deleted", "tag": "ec3e7b85-ed36-4d1d-bf81-d6db442e631d"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:55.167559 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b3517768-b18a-42c6-80f0-12059e728150 req-1dc53cfe-bd94-4b55-bf3c-6991c51b9838 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:55.168019 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b3517768-b18a-42c6-80f0-12059e728150 req-1dc53cfe-bd94-4b55-bf3c-6991c51b9838 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:55.181059 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-b3517768-b18a-42c6-80f0-12059e728150 req-1dc53cfe-bd94-4b55-bf3c-6991c51b9838 service nova] Creating event network-vif-deleted:ec3e7b85-ed36-4d1d-bf81-d6db442e631d for instance e0066e47-43b9-49f0-997d-854601201bd7 on n-h2-847009-3 Jul 19 22:46:55.185992 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-b3517768-b18a-42c6-80f0-12059e728150 req-1dc53cfe-bd94-4b55-bf3c-6991c51b9838 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031157 Jul 19 22:46:55.186610 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2069/4110] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:46:55.192766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-baf8d769-7e09-4180-8684-c66becedd84a tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:55.193555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-baf8d769-7e09-4180-8684-c66becedd84a tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] [instance: e0066e47-43b9-49f0-997d-854601201bd7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:55.199896 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-baf8d769-7e09-4180-8684-c66becedd84a tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:55.200363 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-baf8d769-7e09-4180-8684-c66becedd84a tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:55.201149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-baf8d769-7e09-4180-8684-c66becedd84a tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:55.201596 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-baf8d769-7e09-4180-8684-c66becedd84a tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:55.215896 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-baf8d769-7e09-4180-8684-c66becedd84a tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] HTTP exception thrown: Instance e0066e47-43b9-49f0-997d-854601201bd7 could not be found. Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-baf8d769-7e09-4180-8684-c66becedd84a tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Request method failure captured: Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7 HTTP/1.1 Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zQi8xczqubvqao_uJKyeW0iTVa44EbvI1h3jqV0juD19S7E74zGkDFMlQnIBX0z6dDyD8XzTxVcV2Jw2TpAKDlDjrbMe2s2m57YyOZlEytJ3WX4zPLap4i9W34XVhJIK-Fd3aCDB86bUXt7b9WvEjSnANzyxKdZerjxTmNhv_uPkps Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 30d99d62982b40c8a8ba29137b2e72df Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ListServersNegativeTestJSON-1451554344 Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30d99d62982b40c8a8ba29137b2e72df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ListServersNegativeTestJSON-1451554344 Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 30d99d62982b40c8a8ba29137b2e72df Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1451554344 Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ListServersNegativeTestJSON-1451554344-project Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 4218f795e57244d29c970fb551e1a471 Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ListServersNegativeTestJSON-1451554344-project Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance e0066e47-43b9-49f0-997d-854601201bd7 could not be found. Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'e0066e47-43b9-49f0-997d-854601201bd7'} Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0066e47-43b9-49f0-997d-854601201bd7 could not be found. Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0066e47-43b9-49f0-997d-854601201bd7 could not be found. Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:55.217635 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:55.221856 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:55.221856 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:55.221856 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:55.221856 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:46:55.221856 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:46:55.221856 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0066e47-43b9-49f0-997d-854601201bd7 could not be found. Jul 19 22:46:55.221856 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:55.221856 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-baf8d769-7e09-4180-8684-c66becedd84a tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] Returning 404 to user: Instance e0066e47-43b9-49f0-997d-854601201bd7 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:46:55.221856 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-baf8d769-7e09-4180-8684-c66becedd84a tempest-ListServersNegativeTestJSON-1451554344 tempest-ListServersNegativeTestJSON-1451554344-project] 10.222.0.25 "GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7" status: 404 len: 111 microversion: 2.1 time: 0.031343 Jul 19 22:46:55.221856 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2070/4111] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:55 2022] GET /compute/v2.1/servers/e0066e47-43b9-49f0-997d-854601201bd7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:46:55.226317 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c97380f1-6e9d-470d-b233-ad3185203912 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:55.227012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c97380f1-6e9d-470d-b233-ad3185203912 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:55.233465 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c97380f1-6e9d-470d-b233-ad3185203912 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:55.234152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c97380f1-6e9d-470d-b233-ad3185203912 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:55.234958 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c97380f1-6e9d-470d-b233-ad3185203912 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:55.235432 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c97380f1-6e9d-470d-b233-ad3185203912 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:55.264460 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-83649bf7-5548-4ffc-85a3-9f9e3ab8b8bd tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:55.289355 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-83649bf7-5548-4ffc-85a3-9f9e3ab8b8bd tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1511 microversion: 2.1 time: 0.511209 Jul 19 22:46:55.290085 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2042/4112] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:54 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1511 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:55.342218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-544fb242-9021-4811-bfb0-21a48a9bb458 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:55.342745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-544fb242-9021-4811-bfb0-21a48a9bb458 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] [instance: f3d5b823-3f04-4366-b744-8c2fd88a23ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:55.353091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-544fb242-9021-4811-bfb0-21a48a9bb458 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:55.353547 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-544fb242-9021-4811-bfb0-21a48a9bb458 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:55.354610 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-544fb242-9021-4811-bfb0-21a48a9bb458 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:55.355587 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-544fb242-9021-4811-bfb0-21a48a9bb458 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:55.457491 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-544fb242-9021-4811-bfb0-21a48a9bb458 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b72ae39f30344a2a40a3388882c2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ad52e3deb4d7482fc20872c931353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:55.467546 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-544fb242-9021-4811-bfb0-21a48a9bb458 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca" status: 200 len: 1270 microversion: 2.1 time: 0.131674 Jul 19 22:46:55.468341 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2043/4113] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:55 2022] GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca => generated 1270 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:55.498803 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c97380f1-6e9d-470d-b233-ad3185203912 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:55.508116 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c97380f1-6e9d-470d-b233-ad3185203912 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.286848 Jul 19 22:46:55.520564 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2071/4114] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:55 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:55.526854 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9ccc005a-264a-4e5c-a7ac-f472f9adeeca tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:55.527807 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9ccc005a-264a-4e5c-a7ac-f472f9adeeca tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:55.535231 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ccc005a-264a-4e5c-a7ac-f472f9adeeca tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:55.535694 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ccc005a-264a-4e5c-a7ac-f472f9adeeca tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:55.536498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ccc005a-264a-4e5c-a7ac-f472f9adeeca tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:55.536937 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ccc005a-264a-4e5c-a7ac-f472f9adeeca tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:55.784425 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1b4f39a4-3293-4250-81d6-c9679e4415ff tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:55.785498 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1b4f39a4-3293-4250-81d6-c9679e4415ff tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] [instance: abe8d7c1-3c02-425c-923e-de6f717c334b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:55.797505 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b4f39a4-3293-4250-81d6-c9679e4415ff tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:55.799032 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b4f39a4-3293-4250-81d6-c9679e4415ff tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:55.800250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b4f39a4-3293-4250-81d6-c9679e4415ff tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:55.800250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b4f39a4-3293-4250-81d6-c9679e4415ff tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:56.176930 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9ccc005a-264a-4e5c-a7ac-f472f9adeeca tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:56.187872 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9ccc005a-264a-4e5c-a7ac-f472f9adeeca tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.665056 Jul 19 22:46:56.188872 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2044/4115] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:55 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:56.209245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c646a649-e9eb-418b-be17-77e577847c5f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:56.214034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c646a649-e9eb-418b-be17-77e577847c5f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:56.214517 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c646a649-e9eb-418b-be17-77e577847c5f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:56.246627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c646a649-e9eb-418b-be17-77e577847c5f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Going to try to stop instance {{(pid=119337) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 22:46:56.246865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1b4f39a4-3293-4250-81d6-c9679e4415ff tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5429e8c7ad483abb1d01e6f6cd2689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f74b40009244fdb9d623395d71f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:56.263576 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1b4f39a4-3293-4250-81d6-c9679e4415ff tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] 10.222.0.25 "GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b" status: 200 len: 1521 microversion: 2.1 time: 0.490101 Jul 19 22:46:56.264647 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2072/4116] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:55 2022] GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b => generated 1521 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:46:56.307543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4b6d56e3-3652-46f8-9faa-a182169e1281 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:56.308752 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4b6d56e3-3652-46f8-9faa-a182169e1281 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:56.317125 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c646a649-e9eb-418b-be17-77e577847c5f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action" status: 202 len: 0 microversion: 2.1 time: 0.112948 Jul 19 22:46:56.318527 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b6d56e3-3652-46f8-9faa-a182169e1281 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:56.319143 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b6d56e3-3652-46f8-9faa-a182169e1281 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:56.320162 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b6d56e3-3652-46f8-9faa-a182169e1281 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:56.325500 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2045/4117] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:46:56 2022] POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:46:56.332113 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b6d56e3-3652-46f8-9faa-a182169e1281 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:56.332828 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dc603f53-3087-4b5f-af69-231460e0847c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:56.333836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dc603f53-3087-4b5f-af69-231460e0847c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:56.347059 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dc603f53-3087-4b5f-af69-231460e0847c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:56.348137 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dc603f53-3087-4b5f-af69-231460e0847c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:56.349341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dc603f53-3087-4b5f-af69-231460e0847c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:56.349727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dc603f53-3087-4b5f-af69-231460e0847c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:56.752237 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dc603f53-3087-4b5f-af69-231460e0847c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:56.755326 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:46:56.760671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4b6d56e3-3652-46f8-9faa-a182169e1281 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:56.764259 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dc603f53-3087-4b5f-af69-231460e0847c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1678 microversion: 2.1 time: 0.436836 Jul 19 22:46:56.765692 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2046/4118] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:56 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1678 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:56.783988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-af824005-ae06-49f7-94e5-1af6d833b90e tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-38493599", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "ce6ac97c-1ce1-46bd-b522-4f0777921e35"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-af824005-ae06-49f7-94e5-1af6d833b90e tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Request method failure captured: Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 241 Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zRGtPDxjO9WzYWfxz6nxU6LibsSBeb5YTcMgWQR8vTSybmI-ep-62Ss9KG8qtY4UXvi9TDV1WbxFwDYv6R7Ph8HuQW70S-zXyW_DrRwxO3i-lN7qWlLu320xTm_OmRNYLwHUqblrj80-kcBBNh7VaIxLzHGIbXlzq8nyYFzjs3DwT4 Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 06f74b40009244fdb9d623395d71f24b Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-407692543 Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_06f74b40009244fdb9d623395d71f24b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06f74b40009244fdb9d623395d71f24b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/06f74b40009244fdb9d623395d71f24b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06f74b40009244fdb9d623395d71f24b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-407692543 Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 06f74b40009244fdb9d623395d71f24b Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-407692543 Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerMetadataNegativeTestJSON-407692543-project Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 9a5429e8c7ad483abb1d01e6f6cd2689 Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-407692543-project Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-38493599", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "ce6ac97c-1ce1-46bd-b522-4f0777921e35"}]}} Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-38493599', 'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'ce6ac97c-1ce1-46bd-b522-4f0777921e35'}]}}} Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:46:56.789157 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:46:56.793063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:46:56.793063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:46:56.793063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:46:56.793063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:46:56.793063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:46:56.793063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:46:56.793063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:46:56.793063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:56.793063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:56.793063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:56.793063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:56.793063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:56.793063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:56.793063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:46:56.793063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:46:56.793063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:46:56.793063 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:56.796019 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-af824005-ae06-49f7-94e5-1af6d833b90e tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:46:56.796999 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-af824005-ae06-49f7-94e5-1af6d833b90e tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.029465 Jul 19 22:46:56.797755 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4b6d56e3-3652-46f8-9faa-a182169e1281 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1488 microversion: 2.1 time: 0.494747 Jul 19 22:46:56.799632 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2047/4119] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:46:56 2022] POST /compute/v2.1/servers => generated 175 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:46:56.808779 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2b942c58-71c3-4901-b144-a0b8ed3fb15f tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:56.811632 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2b942c58-71c3-4901-b144-a0b8ed3fb15f tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] [instance: f3d5b823-3f04-4366-b744-8c2fd88a23ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:56.815464 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2073/4120] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:56 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1488 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:46:56.822271 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-53fc36e0-846c-4753-b1e1-3778397d4001 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:56.822770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-53fc36e0-846c-4753-b1e1-3778397d4001 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] [instance: 9c088657-c3db-4084-890f-d8d6f85cff2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:56.828381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2b942c58-71c3-4901-b144-a0b8ed3fb15f tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:56.829075 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2b942c58-71c3-4901-b144-a0b8ed3fb15f tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:56.829200 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-53fc36e0-846c-4753-b1e1-3778397d4001 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] HTTP exception thrown: Instance 9c088657-c3db-4084-890f-d8d6f85cff2b could not be found. Jul 19 22:46:56.831550 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2b942c58-71c3-4901-b144-a0b8ed3fb15f tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:56.832036 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2b942c58-71c3-4901-b144-a0b8ed3fb15f tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-53fc36e0-846c-4753-b1e1-3778397d4001 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Request method failure captured: Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/9c088657-c3db-4084-890f-d8d6f85cff2b/metadata HTTP/1.1 Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zRGtPDxjO9WzYWfxz6nxU6LibsSBeb5YTcMgWQR8vTSybmI-ep-62Ss9KG8qtY4UXvi9TDV1WbxFwDYv6R7Ph8HuQW70S-zXyW_DrRwxO3i-lN7qWlLu320xTm_OmRNYLwHUqblrj80-kcBBNh7VaIxLzHGIbXlzq8nyYFzjs3DwT4 Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 06f74b40009244fdb9d623395d71f24b Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-407692543 Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_06f74b40009244fdb9d623395d71f24b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06f74b40009244fdb9d623395d71f24b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/06f74b40009244fdb9d623395d71f24b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06f74b40009244fdb9d623395d71f24b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-407692543 Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 06f74b40009244fdb9d623395d71f24b Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-407692543 Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerMetadataNegativeTestJSON-407692543-project Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 9a5429e8c7ad483abb1d01e6f6cd2689 Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-407692543-project Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 9c088657-c3db-4084-890f-d8d6f85cff2b could not be found. Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'server_id': '9c088657-c3db-4084-890f-d8d6f85cff2b'} Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c088657-c3db-4084-890f-d8d6f85cff2b could not be found. Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c088657-c3db-4084-890f-d8d6f85cff2b could not be found. Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:56.834425 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:56.840922 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:46:56.840922 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:46:56.840922 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c088657-c3db-4084-890f-d8d6f85cff2b could not be found. Jul 19 22:46:56.840922 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:56.840922 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-53fc36e0-846c-4753-b1e1-3778397d4001 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Returning 404 to user: Instance 9c088657-c3db-4084-890f-d8d6f85cff2b could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:46:56.841433 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-53fc36e0-846c-4753-b1e1-3778397d4001 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] 10.222.0.25 "GET /compute/v2.1/servers/9c088657-c3db-4084-890f-d8d6f85cff2b/metadata" status: 404 len: 111 microversion: 2.1 time: 0.023810 Jul 19 22:46:56.852226 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2074/4121] 10.222.0.25 () {58 vars in 1262 bytes} [Tue Jul 19 22:46:56 2022] GET /compute/v2.1/servers/9c088657-c3db-4084-890f-d8d6f85cff2b/metadata => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:46:56.866570 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f44cd072-07d0-4edf-98c8-657c60363ae0 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-82846407"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:56.878893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f44cd072-07d0-4edf-98c8-657c60363ae0 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:56.889451 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f44cd072-07d0-4edf-98c8-657c60363ae0 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:56.894582 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f44cd072-07d0-4edf-98c8-657c60363ae0 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:56.900215 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f44cd072-07d0-4edf-98c8-657c60363ae0 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:56.901816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f44cd072-07d0-4edf-98c8-657c60363ae0 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:57.004252 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f44cd072-07d0-4edf-98c8-657c60363ae0 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "PUT /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1059 microversion: 2.1 time: 0.150791 Jul 19 22:46:57.015363 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2075/4122] 10.222.0.25 () {60 vars in 1255 bytes} [Tue Jul 19 22:46:56 2022] PUT /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1059 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:57.022318 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-311ec30e-7eb3-4623-9d31-80e48e412e1f tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-613158022", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ce6ac97c-1ce1-46bd-b522-4f0777921e35"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-311ec30e-7eb3-4623-9d31-80e48e412e1f tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Request method failure captured: Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 498 Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zRGtPDxjO9WzYWfxz6nxU6LibsSBeb5YTcMgWQR8vTSybmI-ep-62Ss9KG8qtY4UXvi9TDV1WbxFwDYv6R7Ph8HuQW70S-zXyW_DrRwxO3i-lN7qWlLu320xTm_OmRNYLwHUqblrj80-kcBBNh7VaIxLzHGIbXlzq8nyYFzjs3DwT4 Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 06f74b40009244fdb9d623395d71f24b Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-407692543 Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_06f74b40009244fdb9d623395d71f24b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06f74b40009244fdb9d623395d71f24b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/06f74b40009244fdb9d623395d71f24b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06f74b40009244fdb9d623395d71f24b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-407692543 Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 06f74b40009244fdb9d623395d71f24b Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-407692543 Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerMetadataNegativeTestJSON-407692543-project Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 9a5429e8c7ad483abb1d01e6f6cd2689 Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-407692543-project Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-613158022", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ce6ac97c-1ce1-46bd-b522-4f0777921e35"}]}} Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-613158022', 'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'ce6ac97c-1ce1-46bd-b522-4f0777921e35'}]}}} Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 19 22:46:57.027958 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-311ec30e-7eb3-4623-9d31-80e48e412e1f tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:46:57.031010 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-311ec30e-7eb3-4623-9d31-80e48e412e1f tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.013766 Jul 19 22:46:57.041633 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2076/4123] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:46:57 2022] POST /compute/v2.1/servers => generated 687 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:46:57.046812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a374350e-6dca-4ad5-947a-ba9970326fea tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:57.047468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a374350e-6dca-4ad5-947a-ba9970326fea tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:57.056031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a374350e-6dca-4ad5-947a-ba9970326fea tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:57.056493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a374350e-6dca-4ad5-947a-ba9970326fea tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:57.057289 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a374350e-6dca-4ad5-947a-ba9970326fea tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:57.057732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a374350e-6dca-4ad5-947a-ba9970326fea tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:57.176166 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=16 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:46:57.357608 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2b942c58-71c3-4901-b144-a0b8ed3fb15f tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b72ae39f30344a2a40a3388882c2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ad52e3deb4d7482fc20872c931353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:57.371665 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2b942c58-71c3-4901-b144-a0b8ed3fb15f tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca" status: 200 len: 1312 microversion: 2.1 time: 0.570704 Jul 19 22:46:57.372363 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2048/4124] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:56 2022] GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca => generated 1312 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:57.379388 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9e8c2cff-d62c-461f-9f87-b6d40cf8cde3 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-896350341", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ce6ac97c-1ce1-46bd-b522-4f0777921e35"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9e8c2cff-d62c-461f-9f87-b6d40cf8cde3 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Request method failure captured: Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 499 Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zRGtPDxjO9WzYWfxz6nxU6LibsSBeb5YTcMgWQR8vTSybmI-ep-62Ss9KG8qtY4UXvi9TDV1WbxFwDYv6R7Ph8HuQW70S-zXyW_DrRwxO3i-lN7qWlLu320xTm_OmRNYLwHUqblrj80-kcBBNh7VaIxLzHGIbXlzq8nyYFzjs3DwT4 Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 06f74b40009244fdb9d623395d71f24b Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-407692543 Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_06f74b40009244fdb9d623395d71f24b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06f74b40009244fdb9d623395d71f24b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/06f74b40009244fdb9d623395d71f24b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06f74b40009244fdb9d623395d71f24b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-407692543 Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 06f74b40009244fdb9d623395d71f24b Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-407692543 Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerMetadataNegativeTestJSON-407692543-project Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 9a5429e8c7ad483abb1d01e6f6cd2689 Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-407692543-project Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-896350341", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ce6ac97c-1ce1-46bd-b522-4f0777921e35"}]}} Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-896350341', 'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'ce6ac97c-1ce1-46bd-b522-4f0777921e35'}]}}} Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 19 22:46:57.382661 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:46:57.385395 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.388746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9e8c2cff-d62c-461f-9f87-b6d40cf8cde3 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:46:57.389871 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9e8c2cff-d62c-461f-9f87-b6d40cf8cde3 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.016223 Jul 19 22:46:57.390460 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2049/4125] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:46:57 2022] POST /compute/v2.1/servers => generated 689 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:46:57.451437 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-98dec66a-163c-4ae6-91c4-13cb7c003171 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-769781525", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ce6ac97c-1ce1-46bd-b522-4f0777921e35"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-98dec66a-163c-4ae6-91c4-13cb7c003171 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Request method failure captured: Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 753 Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zRGtPDxjO9WzYWfxz6nxU6LibsSBeb5YTcMgWQR8vTSybmI-ep-62Ss9KG8qtY4UXvi9TDV1WbxFwDYv6R7Ph8HuQW70S-zXyW_DrRwxO3i-lN7qWlLu320xTm_OmRNYLwHUqblrj80-kcBBNh7VaIxLzHGIbXlzq8nyYFzjs3DwT4 Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 06f74b40009244fdb9d623395d71f24b Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-407692543 Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_06f74b40009244fdb9d623395d71f24b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06f74b40009244fdb9d623395d71f24b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/06f74b40009244fdb9d623395d71f24b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06f74b40009244fdb9d623395d71f24b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-407692543 Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 06f74b40009244fdb9d623395d71f24b Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-407692543 Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerMetadataNegativeTestJSON-407692543-project Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 9a5429e8c7ad483abb1d01e6f6cd2689 Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-407692543-project Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-769781525", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ce6ac97c-1ce1-46bd-b522-4f0777921e35"}]}} Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-769781525', 'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'ce6ac97c-1ce1-46bd-b522-4f0777921e35'}]}}} Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:46:57.455334 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:46:57.457469 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:46:57.460390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:46:57.460390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.461295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-98dec66a-163c-4ae6-91c4-13cb7c003171 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:46:57.462301 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-98dec66a-163c-4ae6-91c4-13cb7c003171 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.015779 Jul 19 22:46:57.463391 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2050/4126] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:46:57 2022] POST /compute/v2.1/servers => generated 1197 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 19 22:46:57.496758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a374350e-6dca-4ad5-947a-ba9970326fea tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:57.507529 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a374350e-6dca-4ad5-947a-ba9970326fea tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1486 microversion: 2.1 time: 0.464303 Jul 19 22:46:57.509335 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2077/4127] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:57 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1486 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:57.526412 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7a294516-e76d-4df1-8e49-19e4171df67b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:57.527099 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7a294516-e76d-4df1-8e49-19e4171df67b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:57.528789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-307995be-5546-450c-8d12-e29b62a20d96 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1054865368", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ce6ac97c-1ce1-46bd-b522-4f0777921e35"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-307995be-5546-450c-8d12-e29b62a20d96 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Request method failure captured: Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 1266 Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zRGtPDxjO9WzYWfxz6nxU6LibsSBeb5YTcMgWQR8vTSybmI-ep-62Ss9KG8qtY4UXvi9TDV1WbxFwDYv6R7Ph8HuQW70S-zXyW_DrRwxO3i-lN7qWlLu320xTm_OmRNYLwHUqblrj80-kcBBNh7VaIxLzHGIbXlzq8nyYFzjs3DwT4 Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 06f74b40009244fdb9d623395d71f24b Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-407692543 Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_06f74b40009244fdb9d623395d71f24b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06f74b40009244fdb9d623395d71f24b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/06f74b40009244fdb9d623395d71f24b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06f74b40009244fdb9d623395d71f24b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-407692543 Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 06f74b40009244fdb9d623395d71f24b Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-407692543 Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerMetadataNegativeTestJSON-407692543-project Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 9a5429e8c7ad483abb1d01e6f6cd2689 Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-407692543-project Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1054865368", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ce6ac97c-1ce1-46bd-b522-4f0777921e35"}]}} Jul 19 22:46:57.532074 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:46:57.534039 n-d-847009-3 devstack@n-api.service[119338]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:46:57.534039 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1054865368', 'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'ce6ac97c-1ce1-46bd-b522-4f0777921e35'}]}}} Jul 19 22:46:57.534039 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:46:57.534039 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:57.534039 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:46:57.534039 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:46:57.534039 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:46:57.534039 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:46:57.534039 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:46:57.534039 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.534039 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 19 22:46:57.534039 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 19 22:46:57.534039 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 19 22:46:57.534039 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 19 22:46:57.534039 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 19 22:46:57.534039 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.534039 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:46:57.535385 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:46:57.537292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 19 22:46:57.537292 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.539145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-307995be-5546-450c-8d12-e29b62a20d96 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:46:57.540261 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-307995be-5546-450c-8d12-e29b62a20d96 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.015811 Jul 19 22:46:57.540642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a294516-e76d-4df1-8e49-19e4171df67b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:57.541623 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2078/4128] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Jul 19 22:46:57 2022] POST /compute/v2.1/servers => generated 2221 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 19 22:46:57.547143 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a294516-e76d-4df1-8e49-19e4171df67b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:57.548882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a294516-e76d-4df1-8e49-19e4171df67b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:57.550358 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a294516-e76d-4df1-8e49-19e4171df67b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:57.554589 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a61f06cd-a5ca-481e-9308-f04d08abcd18 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:57.555557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a61f06cd-a5ca-481e-9308-f04d08abcd18 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] [instance: 28ef2fd5-6867-48b3-a541-449b401529b5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:57.563013 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-a61f06cd-a5ca-481e-9308-f04d08abcd18 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] HTTP exception thrown: Instance 28ef2fd5-6867-48b3-a541-449b401529b5 could not be found. Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a61f06cd-a5ca-481e-9308-f04d08abcd18 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Request method failure captured: Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/28ef2fd5-6867-48b3-a541-449b401529b5/metadata/test2 HTTP/1.1 Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zRGtPDxjO9WzYWfxz6nxU6LibsSBeb5YTcMgWQR8vTSybmI-ep-62Ss9KG8qtY4UXvi9TDV1WbxFwDYv6R7Ph8HuQW70S-zXyW_DrRwxO3i-lN7qWlLu320xTm_OmRNYLwHUqblrj80-kcBBNh7VaIxLzHGIbXlzq8nyYFzjs3DwT4 Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 06f74b40009244fdb9d623395d71f24b Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-407692543 Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_06f74b40009244fdb9d623395d71f24b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06f74b40009244fdb9d623395d71f24b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/06f74b40009244fdb9d623395d71f24b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06f74b40009244fdb9d623395d71f24b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-407692543 Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 06f74b40009244fdb9d623395d71f24b Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-407692543 Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerMetadataNegativeTestJSON-407692543-project Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 9a5429e8c7ad483abb1d01e6f6cd2689 Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-407692543-project Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 28ef2fd5-6867-48b3-a541-449b401529b5 could not be found. Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'server_id': '28ef2fd5-6867-48b3-a541-449b401529b5', 'id': 'test2'} Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28ef2fd5-6867-48b3-a541-449b401529b5 could not be found. Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28ef2fd5-6867-48b3-a541-449b401529b5 could not be found. Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:46:57.565443 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:46:57.569539 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:46:57.569539 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:46:57.569539 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28ef2fd5-6867-48b3-a541-449b401529b5 could not be found. Jul 19 22:46:57.569539 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:46:57.571370 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a61f06cd-a5ca-481e-9308-f04d08abcd18 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Returning 404 to user: Instance 28ef2fd5-6867-48b3-a541-449b401529b5 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:46:57.572505 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a61f06cd-a5ca-481e-9308-f04d08abcd18 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] 10.222.0.25 "GET /compute/v2.1/servers/28ef2fd5-6867-48b3-a541-449b401529b5/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.023827 Jul 19 22:46:57.573665 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2079/4129] 10.222.0.25 () {58 vars in 1280 bytes} [Tue Jul 19 22:46:57 2022] GET /compute/v2.1/servers/28ef2fd5-6867-48b3-a541-449b401529b5/metadata/test2 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:46:57.593446 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-38eb2154-26f0-4bd9-90ae-fa49d84003a2 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:57.594262 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-38eb2154-26f0-4bd9-90ae-fa49d84003a2 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] [instance: abe8d7c1-3c02-425c-923e-de6f717c334b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:57.602288 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-38eb2154-26f0-4bd9-90ae-fa49d84003a2 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:57.603136 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-38eb2154-26f0-4bd9-90ae-fa49d84003a2 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:57.604179 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-38eb2154-26f0-4bd9-90ae-fa49d84003a2 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:57.604929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-38eb2154-26f0-4bd9-90ae-fa49d84003a2 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:57.634440 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-38eb2154-26f0-4bd9-90ae-fa49d84003a2 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] [instance: abe8d7c1-3c02-425c-923e-de6f717c334b] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:46:57.755201 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-38eb2154-26f0-4bd9-90ae-fa49d84003a2 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] 10.222.0.25 "DELETE /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b" status: 204 len: 0 microversion: 2.1 time: 0.166922 Jul 19 22:46:57.756445 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2080/4130] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:46:57 2022] DELETE /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:46:57.771522 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9d256510-d167-48da-9600-8ea76827fdde tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:57.772629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9d256510-d167-48da-9600-8ea76827fdde tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] [instance: abe8d7c1-3c02-425c-923e-de6f717c334b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:57.790198 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d256510-d167-48da-9600-8ea76827fdde tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:57.790925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d256510-d167-48da-9600-8ea76827fdde tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:57.792125 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d256510-d167-48da-9600-8ea76827fdde tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:57.793018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d256510-d167-48da-9600-8ea76827fdde tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:58.225525 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7a294516-e76d-4df1-8e49-19e4171df67b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:58.237842 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7a294516-e76d-4df1-8e49-19e4171df67b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1486 microversion: 2.1 time: 0.716493 Jul 19 22:46:58.243440 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2051/4131] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:57 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1486 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:58.251404 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a5c2c71b-3db2-4ce7-af0b-e4f693863b00 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:58.252958 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a5c2c71b-3db2-4ce7-af0b-e4f693863b00 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:58.270249 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5c2c71b-3db2-4ce7-af0b-e4f693863b00 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:58.271864 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5c2c71b-3db2-4ce7-af0b-e4f693863b00 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:58.272897 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5c2c71b-3db2-4ce7-af0b-e4f693863b00 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:58.273552 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5c2c71b-3db2-4ce7-af0b-e4f693863b00 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:58.412000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9d256510-d167-48da-9600-8ea76827fdde tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5429e8c7ad483abb1d01e6f6cd2689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f74b40009244fdb9d623395d71f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:58.422178 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9d256510-d167-48da-9600-8ea76827fdde tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] 10.222.0.25 "GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b" status: 200 len: 1527 microversion: 2.1 time: 0.657486 Jul 19 22:46:58.426325 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2081/4132] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:57 2022] GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b => generated 1527 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:58.439579 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-68b88c18-ca58-4fb7-9544-ae471a4e11e4 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:58.440475 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-68b88c18-ca58-4fb7-9544-ae471a4e11e4 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:58.448039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-68b88c18-ca58-4fb7-9544-ae471a4e11e4 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:58.448909 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-68b88c18-ca58-4fb7-9544-ae471a4e11e4 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:58.450254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-68b88c18-ca58-4fb7-9544-ae471a4e11e4 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:58.450942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-68b88c18-ca58-4fb7-9544-ae471a4e11e4 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:58.515708 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-68b88c18-ca58-4fb7-9544-ae471a4e11e4 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:46:58.644346 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-68b88c18-ca58-4fb7-9544-ae471a4e11e4 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 204 len: 0 microversion: 2.1 time: 0.215636 Jul 19 22:46:58.646664 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2082/4133] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:46:58 2022] DELETE /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:46:58.662228 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7db8d2ba-6578-428a-8a4c-a6ff9fc52b23 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:58.663180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7db8d2ba-6578-428a-8a4c-a6ff9fc52b23 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] [instance: f3d5b823-3f04-4366-b744-8c2fd88a23ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:58.673746 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7db8d2ba-6578-428a-8a4c-a6ff9fc52b23 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:58.678911 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7db8d2ba-6578-428a-8a4c-a6ff9fc52b23 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:58.679942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7db8d2ba-6578-428a-8a4c-a6ff9fc52b23 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:58.681117 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7db8d2ba-6578-428a-8a4c-a6ff9fc52b23 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:58.882671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a5c2c71b-3db2-4ce7-af0b-e4f693863b00 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:58.895331 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a5c2c71b-3db2-4ce7-af0b-e4f693863b00 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1678 microversion: 2.1 time: 0.650169 Jul 19 22:46:58.901020 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2052/4134] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:58 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1678 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:59.133254 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5db19d39-9de4-459b-8b10-b2b5c05d8c23 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:59.133907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5db19d39-9de4-459b-8b10-b2b5c05d8c23 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:59.142830 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7db8d2ba-6578-428a-8a4c-a6ff9fc52b23 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b72ae39f30344a2a40a3388882c2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ad52e3deb4d7482fc20872c931353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:59.146369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5db19d39-9de4-459b-8b10-b2b5c05d8c23 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:59.146924 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5db19d39-9de4-459b-8b10-b2b5c05d8c23 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:59.148236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5db19d39-9de4-459b-8b10-b2b5c05d8c23 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:59.148902 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5db19d39-9de4-459b-8b10-b2b5c05d8c23 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:59.155234 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7db8d2ba-6578-428a-8a4c-a6ff9fc52b23 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca" status: 200 len: 1312 microversion: 2.1 time: 0.506191 Jul 19 22:46:59.157186 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2083/4135] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:58 2022] GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca => generated 1312 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:59.406185 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-1fc9c352-10c6-4d2d-8152-d5eb267d753b req-e613eaff-d9bd-4aa7-a59c-470e6d716a77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3d5b823-3f04-4366-b744-8c2fd88a23ca", "tag": "42ae2352-bed7-4e5c-8d1f-20248093c4f7"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:46:59.416748 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-1fc9c352-10c6-4d2d-8152-d5eb267d753b req-e613eaff-d9bd-4aa7-a59c-470e6d716a77 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:59.417198 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-1fc9c352-10c6-4d2d-8152-d5eb267d753b req-e613eaff-d9bd-4aa7-a59c-470e6d716a77 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:59.443267 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-1fc9c352-10c6-4d2d-8152-d5eb267d753b req-e613eaff-d9bd-4aa7-a59c-470e6d716a77 service nova] Creating event network-changed:42ae2352-bed7-4e5c-8d1f-20248093c4f7 for instance f3d5b823-3f04-4366-b744-8c2fd88a23ca on n-h1-847009-3 Jul 19 22:46:59.448409 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-1fc9c352-10c6-4d2d-8152-d5eb267d753b req-e613eaff-d9bd-4aa7-a59c-470e6d716a77 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046151 Jul 19 22:46:59.449002 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2084/4136] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:46:59.454315 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4973b438-f796-4204-b245-f90e276384cc tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:59.455097 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4973b438-f796-4204-b245-f90e276384cc tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] [instance: abe8d7c1-3c02-425c-923e-de6f717c334b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:59.462624 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4973b438-f796-4204-b245-f90e276384cc tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:59.463048 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4973b438-f796-4204-b245-f90e276384cc tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:59.464079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4973b438-f796-4204-b245-f90e276384cc tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:59.464508 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4973b438-f796-4204-b245-f90e276384cc tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:59.606052 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5db19d39-9de4-459b-8b10-b2b5c05d8c23 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:59.626113 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5db19d39-9de4-459b-8b10-b2b5c05d8c23 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1492 microversion: 2.1 time: 0.723811 Jul 19 22:46:59.628042 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2053/4137] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:58 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1492 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:59.777229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4973b438-f796-4204-b245-f90e276384cc tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5429e8c7ad483abb1d01e6f6cd2689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f74b40009244fdb9d623395d71f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:46:59.789575 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4973b438-f796-4204-b245-f90e276384cc tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] 10.222.0.25 "GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b" status: 200 len: 1527 microversion: 2.1 time: 0.338255 Jul 19 22:46:59.801028 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2085/4138] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:59 2022] GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b => generated 1527 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:46:59.918550 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-087e1b41-f1a9-423a-b12a-36ebee4ad38b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:46:59.919889 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-087e1b41-f1a9-423a-b12a-36ebee4ad38b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:46:59.926447 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-087e1b41-f1a9-423a-b12a-36ebee4ad38b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:59.927197 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-087e1b41-f1a9-423a-b12a-36ebee4ad38b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:46:59.927976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-087e1b41-f1a9-423a-b12a-36ebee4ad38b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:46:59.928412 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-087e1b41-f1a9-423a-b12a-36ebee4ad38b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:00.160709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-087e1b41-f1a9-423a-b12a-36ebee4ad38b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:00.173754 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-087e1b41-f1a9-423a-b12a-36ebee4ad38b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1678 microversion: 2.1 time: 0.258390 Jul 19 22:47:00.174030 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a1018959-9a95-4776-8f8f-57fec2fc800b tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:00.174431 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a1018959-9a95-4776-8f8f-57fec2fc800b tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] [instance: f3d5b823-3f04-4366-b744-8c2fd88a23ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:00.179369 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2054/4139] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:46:59 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1678 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:00.188145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1018959-9a95-4776-8f8f-57fec2fc800b tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:00.188744 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1018959-9a95-4776-8f8f-57fec2fc800b tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:00.190644 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1018959-9a95-4776-8f8f-57fec2fc800b tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:00.191436 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1018959-9a95-4776-8f8f-57fec2fc800b tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:00.221430 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:47:00.649502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-37dba0c4-7fea-4752-9960-fb33e2ca8db2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:00.650610 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-37dba0c4-7fea-4752-9960-fb33e2ca8db2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:00.657514 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37dba0c4-7fea-4752-9960-fb33e2ca8db2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:00.658498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37dba0c4-7fea-4752-9960-fb33e2ca8db2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:00.659667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37dba0c4-7fea-4752-9960-fb33e2ca8db2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:00.660356 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37dba0c4-7fea-4752-9960-fb33e2ca8db2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:00.691320 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a1018959-9a95-4776-8f8f-57fec2fc800b tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b72ae39f30344a2a40a3388882c2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ad52e3deb4d7482fc20872c931353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:00.706324 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a1018959-9a95-4776-8f8f-57fec2fc800b tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca" status: 200 len: 1312 microversion: 2.1 time: 0.536262 Jul 19 22:47:00.707587 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2086/4140] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:00 2022] GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca => generated 1312 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:47:00.809978 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-07a65546-3c58-496b-88ec-62848888a04d tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:00.811484 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-07a65546-3c58-496b-88ec-62848888a04d tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] [instance: abe8d7c1-3c02-425c-923e-de6f717c334b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:00.819199 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07a65546-3c58-496b-88ec-62848888a04d tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:00.820019 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07a65546-3c58-496b-88ec-62848888a04d tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:00.821266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07a65546-3c58-496b-88ec-62848888a04d tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:00.822060 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07a65546-3c58-496b-88ec-62848888a04d tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:01.290885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=16 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:47:01.913982 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-37dba0c4-7fea-4752-9960-fb33e2ca8db2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:01.924723 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-37dba0c4-7fea-4752-9960-fb33e2ca8db2 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1492 microversion: 2.1 time: 1.279001 Jul 19 22:47:01.925479 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2055/4141] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:00 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1492 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:47:01.931184 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-543ec7fc-0df3-43e2-83a2-99a0bd25d8c7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:01.932096 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-543ec7fc-0df3-43e2-83a2-99a0bd25d8c7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:01.935343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=42 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:47:01.942125 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-543ec7fc-0df3-43e2-83a2-99a0bd25d8c7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:01.942891 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-543ec7fc-0df3-43e2-83a2-99a0bd25d8c7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:01.943996 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-543ec7fc-0df3-43e2-83a2-99a0bd25d8c7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:01.944428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-543ec7fc-0df3-43e2-83a2-99a0bd25d8c7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:01.952265 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-07a65546-3c58-496b-88ec-62848888a04d tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5429e8c7ad483abb1d01e6f6cd2689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f74b40009244fdb9d623395d71f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:01.964017 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-07a65546-3c58-496b-88ec-62848888a04d tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] 10.222.0.25 "GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b" status: 200 len: 1527 microversion: 2.1 time: 1.158806 Jul 19 22:47:01.964857 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2087/4142] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:00 2022] GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b => generated 1527 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:01.983507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-a133b666-9102-415f-8ba1-17e8015a91d1 req-3ae8e838-8930-4e72-9924-2ff333ae4f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe8d7c1-3c02-425c-923e-de6f717c334b", "name": "network-vif-deleted", "tag": "f8c55fe7-7b1c-4bfc-9c03-5a3922412f71"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:47:01.997703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-a133b666-9102-415f-8ba1-17e8015a91d1 req-3ae8e838-8930-4e72-9924-2ff333ae4f11 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:01.998152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-a133b666-9102-415f-8ba1-17e8015a91d1 req-3ae8e838-8930-4e72-9924-2ff333ae4f11 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:02.013999 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-a133b666-9102-415f-8ba1-17e8015a91d1 req-3ae8e838-8930-4e72-9924-2ff333ae4f11 service nova] Creating event network-vif-deleted:f8c55fe7-7b1c-4bfc-9c03-5a3922412f71 for instance abe8d7c1-3c02-425c-923e-de6f717c334b on n-h1-847009-3 Jul 19 22:47:02.022155 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-a133b666-9102-415f-8ba1-17e8015a91d1 req-3ae8e838-8930-4e72-9924-2ff333ae4f11 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044829 Jul 19 22:47:02.023512 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2088/4143] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:47:02.031415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bccc57fa-c819-4ae5-8b7b-52298494e483 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:02.032870 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bccc57fa-c819-4ae5-8b7b-52298494e483 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] [instance: f3d5b823-3f04-4366-b744-8c2fd88a23ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:02.040279 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bccc57fa-c819-4ae5-8b7b-52298494e483 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:02.040985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bccc57fa-c819-4ae5-8b7b-52298494e483 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:02.042285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bccc57fa-c819-4ae5-8b7b-52298494e483 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:02.042520 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bccc57fa-c819-4ae5-8b7b-52298494e483 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:02.309169 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-543ec7fc-0df3-43e2-83a2-99a0bd25d8c7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:02.325305 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-543ec7fc-0df3-43e2-83a2-99a0bd25d8c7 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1678 microversion: 2.1 time: 0.397422 Jul 19 22:47:02.326320 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2056/4144] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:01 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1678 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:02.454816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bccc57fa-c819-4ae5-8b7b-52298494e483 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b72ae39f30344a2a40a3388882c2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ad52e3deb4d7482fc20872c931353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:02.465883 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bccc57fa-c819-4ae5-8b7b-52298494e483 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca" status: 200 len: 1312 microversion: 2.1 time: 0.438793 Jul 19 22:47:02.466498 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2089/4145] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:02 2022] GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca => generated 1312 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:02.639980 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-a634fffb-2359-44f7-b97c-5f9d8164ac77 req-66c5158b-a6f0-4a20-975a-ecef7eb3203a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9eae843-19b8-4300-b28b-cdbfd0039c03", "name": "network-vif-deleted", "tag": "94d043ea-312f-4a2f-84a9-a1426a425df2"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:47:02.668256 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a634fffb-2359-44f7-b97c-5f9d8164ac77 req-66c5158b-a6f0-4a20-975a-ecef7eb3203a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:02.668987 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a634fffb-2359-44f7-b97c-5f9d8164ac77 req-66c5158b-a6f0-4a20-975a-ecef7eb3203a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:02.711386 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-a634fffb-2359-44f7-b97c-5f9d8164ac77 req-66c5158b-a6f0-4a20-975a-ecef7eb3203a service nova] Creating event network-vif-deleted:94d043ea-312f-4a2f-84a9-a1426a425df2 for instance e9eae843-19b8-4300-b28b-cdbfd0039c03 on n-h1-847009-3 Jul 19 22:47:02.723667 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-a634fffb-2359-44f7-b97c-5f9d8164ac77 req-66c5158b-a6f0-4a20-975a-ecef7eb3203a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088987 Jul 19 22:47:02.728128 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2057/4146] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:47:02.956635 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-efc3a647-05b1-42c4-a76a-4a0c52975d4c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:02.958781 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-efc3a647-05b1-42c4-a76a-4a0c52975d4c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:02.965584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-efc3a647-05b1-42c4-a76a-4a0c52975d4c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:02.966336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-efc3a647-05b1-42c4-a76a-4a0c52975d4c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:02.967356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-efc3a647-05b1-42c4-a76a-4a0c52975d4c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:02.967806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-efc3a647-05b1-42c4-a76a-4a0c52975d4c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:02.984148 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e54f26b8-46ea-41b4-8042-bc6be284b472 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:02.985613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e54f26b8-46ea-41b4-8042-bc6be284b472 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] [instance: abe8d7c1-3c02-425c-923e-de6f717c334b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:02.997536 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e54f26b8-46ea-41b4-8042-bc6be284b472 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:02.998607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e54f26b8-46ea-41b4-8042-bc6be284b472 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:03.000316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e54f26b8-46ea-41b4-8042-bc6be284b472 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:03.000911 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e54f26b8-46ea-41b4-8042-bc6be284b472 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:03.023264 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-e54f26b8-46ea-41b4-8042-bc6be284b472 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] HTTP exception thrown: Instance abe8d7c1-3c02-425c-923e-de6f717c334b could not be found. Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e54f26b8-46ea-41b4-8042-bc6be284b472 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Request method failure captured: Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b HTTP/1.1 Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zRGtPDxjO9WzYWfxz6nxU6LibsSBeb5YTcMgWQR8vTSybmI-ep-62Ss9KG8qtY4UXvi9TDV1WbxFwDYv6R7Ph8HuQW70S-zXyW_DrRwxO3i-lN7qWlLu320xTm_OmRNYLwHUqblrj80-kcBBNh7VaIxLzHGIbXlzq8nyYFzjs3DwT4 Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 06f74b40009244fdb9d623395d71f24b Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-407692543 Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_06f74b40009244fdb9d623395d71f24b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06f74b40009244fdb9d623395d71f24b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/06f74b40009244fdb9d623395d71f24b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06f74b40009244fdb9d623395d71f24b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-407692543 Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 06f74b40009244fdb9d623395d71f24b Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-407692543 Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerMetadataNegativeTestJSON-407692543-project Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 9a5429e8c7ad483abb1d01e6f6cd2689 Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-407692543-project Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance abe8d7c1-3c02-425c-923e-de6f717c334b could not be found. Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'abe8d7c1-3c02-425c-923e-de6f717c334b'} Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abe8d7c1-3c02-425c-923e-de6f717c334b could not be found. Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abe8d7c1-3c02-425c-923e-de6f717c334b could not be found. Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:03.025306 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:03.029618 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:03.029618 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:03.029618 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:03.029618 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:03.029618 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:03.029618 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:03.029618 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abe8d7c1-3c02-425c-923e-de6f717c334b could not be found. Jul 19 22:47:03.029618 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:03.029618 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e54f26b8-46ea-41b4-8042-bc6be284b472 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] Returning 404 to user: Instance abe8d7c1-3c02-425c-923e-de6f717c334b could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:03.029618 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e54f26b8-46ea-41b4-8042-bc6be284b472 tempest-ServerMetadataNegativeTestJSON-407692543 tempest-ServerMetadataNegativeTestJSON-407692543-project] 10.222.0.25 "GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b" status: 404 len: 111 microversion: 2.1 time: 0.049907 Jul 19 22:47:03.035669 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2058/4147] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:02 2022] GET /compute/v2.1/servers/abe8d7c1-3c02-425c-923e-de6f717c334b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:47:03.060175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-efc3a647-05b1-42c4-a76a-4a0c52975d4c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:03.060958 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-efc3a647-05b1-42c4-a76a-4a0c52975d4c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:03.062186 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-efc3a647-05b1-42c4-a76a-4a0c52975d4c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lazy-loading 'fault' on Instance uuid e9eae843-19b8-4300-b28b-cdbfd0039c03 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:47:03.143188 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-efc3a647-05b1-42c4-a76a-4a0c52975d4c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:03.169102 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-efc3a647-05b1-42c4-a76a-4a0c52975d4c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 200 len: 1308 microversion: 2.1 time: 0.222787 Jul 19 22:47:03.180143 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2090/4148] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:02 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 1308 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:03.344864 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bdb71a65-4c84-49b6-ba5a-c6eb12c0efe4 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:03.346046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bdb71a65-4c84-49b6-ba5a-c6eb12c0efe4 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:03.362632 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bdb71a65-4c84-49b6-ba5a-c6eb12c0efe4 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:03.363282 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bdb71a65-4c84-49b6-ba5a-c6eb12c0efe4 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:03.365045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bdb71a65-4c84-49b6-ba5a-c6eb12c0efe4 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:03.366590 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bdb71a65-4c84-49b6-ba5a-c6eb12c0efe4 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:03.488978 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0c0f3196-0f85-4acd-889b-2c47d403d30d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:03.489777 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0c0f3196-0f85-4acd-889b-2c47d403d30d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] [instance: f3d5b823-3f04-4366-b744-8c2fd88a23ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:03.501006 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c0f3196-0f85-4acd-889b-2c47d403d30d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:03.501777 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c0f3196-0f85-4acd-889b-2c47d403d30d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:03.502787 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c0f3196-0f85-4acd-889b-2c47d403d30d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:03.503526 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c0f3196-0f85-4acd-889b-2c47d403d30d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:03.761864 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bdb71a65-4c84-49b6-ba5a-c6eb12c0efe4 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:03.774737 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bdb71a65-4c84-49b6-ba5a-c6eb12c0efe4 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1678 microversion: 2.1 time: 0.435007 Jul 19 22:47:03.794177 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2059/4149] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:03 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1678 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:03.844850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0c0f3196-0f85-4acd-889b-2c47d403d30d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b72ae39f30344a2a40a3388882c2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ad52e3deb4d7482fc20872c931353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:03.869833 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0c0f3196-0f85-4acd-889b-2c47d403d30d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca" status: 200 len: 1312 microversion: 2.1 time: 0.388989 Jul 19 22:47:03.892633 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2091/4150] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:03 2022] GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca => generated 1312 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:47:04.193590 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-946ab86f-8d3e-4d44-aaa9-9ffbbf19358c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:04.194294 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-946ab86f-8d3e-4d44-aaa9-9ffbbf19358c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:04.202231 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-946ab86f-8d3e-4d44-aaa9-9ffbbf19358c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.202914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-946ab86f-8d3e-4d44-aaa9-9ffbbf19358c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:04.204336 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-946ab86f-8d3e-4d44-aaa9-9ffbbf19358c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.205703 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-946ab86f-8d3e-4d44-aaa9-9ffbbf19358c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:04.227962 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-946ab86f-8d3e-4d44-aaa9-9ffbbf19358c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] HTTP exception thrown: Instance e9eae843-19b8-4300-b28b-cdbfd0039c03 could not be found. Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-946ab86f-8d3e-4d44-aaa9-9ffbbf19358c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Request method failure captured: Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 HTTP/1.1 Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zM1CVhkGzrLI27yplqtJpQo-i3-EKMGfRab3BLA-iVFSYzTm_PO2UXoSlqkSOVVu2ip8fmaaUlGTzOcY-1-PKTjTHCVYzWriYi14tgLboJXa9RPch13wobugtzkYLm5uZx9koMts7tA37UlK9MH24L7zFq17JufqAVvZobtx47aYg4 Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1db06ac41e9f4fe290e535f703af484d Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance e9eae843-19b8-4300-b28b-cdbfd0039c03 could not be found. Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'e9eae843-19b8-4300-b28b-cdbfd0039c03'} Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9eae843-19b8-4300-b28b-cdbfd0039c03 could not be found. Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9eae843-19b8-4300-b28b-cdbfd0039c03 could not be found. Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.231073 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.241435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:04.241435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:04.241435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:04.241435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:04.241435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9eae843-19b8-4300-b28b-cdbfd0039c03 could not be found. Jul 19 22:47:04.241435 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.241435 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-946ab86f-8d3e-4d44-aaa9-9ffbbf19358c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Returning 404 to user: Instance e9eae843-19b8-4300-b28b-cdbfd0039c03 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:04.241435 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-946ab86f-8d3e-4d44-aaa9-9ffbbf19358c tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 404 len: 111 microversion: 2.1 time: 0.047975 Jul 19 22:47:04.241435 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2060/4151] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:04 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:47:04.261031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bbe79428-b491-4df3-b7ae-20543bab4a03 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:04.262043 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bbe79428-b491-4df3-b7ae-20543bab4a03 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:04.295859 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bbe79428-b491-4df3-b7ae-20543bab4a03 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.296320 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bbe79428-b491-4df3-b7ae-20543bab4a03 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:04.297807 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bbe79428-b491-4df3-b7ae-20543bab4a03 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.298136 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bbe79428-b491-4df3-b7ae-20543bab4a03 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:04.320376 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-bbe79428-b491-4df3-b7ae-20543bab4a03 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] HTTP exception thrown: Instance e9eae843-19b8-4300-b28b-cdbfd0039c03 could not be found. Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bbe79428-b491-4df3-b7ae-20543bab4a03 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Request method failure captured: Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 HTTP/1.1 Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zM1CVhkGzrLI27yplqtJpQo-i3-EKMGfRab3BLA-iVFSYzTm_PO2UXoSlqkSOVVu2ip8fmaaUlGTzOcY-1-PKTjTHCVYzWriYi14tgLboJXa9RPch13wobugtzkYLm5uZx9koMts7tA37UlK9MH24L7zFq17JufqAVvZobtx47aYg4 Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1db06ac41e9f4fe290e535f703af484d Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance e9eae843-19b8-4300-b28b-cdbfd0039c03 could not be found. Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'e9eae843-19b8-4300-b28b-cdbfd0039c03'} Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9eae843-19b8-4300-b28b-cdbfd0039c03 could not be found. Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:04.322285 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9eae843-19b8-4300-b28b-cdbfd0039c03 could not be found. Jul 19 22:47:04.325904 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.325904 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:04.325904 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.325904 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.325904 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:04.325904 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:04.325904 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:04.325904 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:04.325904 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9eae843-19b8-4300-b28b-cdbfd0039c03 could not be found. Jul 19 22:47:04.325904 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.325904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bbe79428-b491-4df3-b7ae-20543bab4a03 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Returning 404 to user: Instance e9eae843-19b8-4300-b28b-cdbfd0039c03 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:04.325904 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bbe79428-b491-4df3-b7ae-20543bab4a03 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 404 len: 111 microversion: 2.1 time: 0.077170 Jul 19 22:47:04.327684 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2092/4152] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:47:04 2022] DELETE /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:47:04.334255 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-00ce7b82-25eb-4f17-955d-0ce898d4e91b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:04.334878 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-00ce7b82-25eb-4f17-955d-0ce898d4e91b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: e9eae843-19b8-4300-b28b-cdbfd0039c03] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:04.349719 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-00ce7b82-25eb-4f17-955d-0ce898d4e91b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.350448 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-00ce7b82-25eb-4f17-955d-0ce898d4e91b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:04.351037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-00ce7b82-25eb-4f17-955d-0ce898d4e91b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.351503 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-00ce7b82-25eb-4f17-955d-0ce898d4e91b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:04.372330 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-00ce7b82-25eb-4f17-955d-0ce898d4e91b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] HTTP exception thrown: Instance e9eae843-19b8-4300-b28b-cdbfd0039c03 could not be found. Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-00ce7b82-25eb-4f17-955d-0ce898d4e91b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Request method failure captured: Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 HTTP/1.1 Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zM1CVhkGzrLI27yplqtJpQo-i3-EKMGfRab3BLA-iVFSYzTm_PO2UXoSlqkSOVVu2ip8fmaaUlGTzOcY-1-PKTjTHCVYzWriYi14tgLboJXa9RPch13wobugtzkYLm5uZx9koMts7tA37UlK9MH24L7zFq17JufqAVvZobtx47aYg4 Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1db06ac41e9f4fe290e535f703af484d Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance e9eae843-19b8-4300-b28b-cdbfd0039c03 could not be found. Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'e9eae843-19b8-4300-b28b-cdbfd0039c03'} Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9eae843-19b8-4300-b28b-cdbfd0039c03 could not be found. Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9eae843-19b8-4300-b28b-cdbfd0039c03 could not be found. Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.374264 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.378656 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:04.378656 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:04.378656 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:04.378656 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:04.378656 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9eae843-19b8-4300-b28b-cdbfd0039c03 could not be found. Jul 19 22:47:04.378656 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.380512 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-00ce7b82-25eb-4f17-955d-0ce898d4e91b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Returning 404 to user: Instance e9eae843-19b8-4300-b28b-cdbfd0039c03 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:04.381600 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-00ce7b82-25eb-4f17-955d-0ce898d4e91b tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03" status: 404 len: 111 microversion: 2.1 time: 0.053120 Jul 19 22:47:04.382700 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2061/4153] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:04 2022] GET /compute/v2.1/servers/e9eae843-19b8-4300-b28b-cdbfd0039c03 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:47:04.390891 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d15afb52-4d5d-4345-a552-255b17e5b36f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:04.391432 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d15afb52-4d5d-4345-a552-255b17e5b36f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: c56a1af0-7bb0-42ee-8139-fe6c8a6772d4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:04.408854 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d15afb52-4d5d-4345-a552-255b17e5b36f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.409332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d15afb52-4d5d-4345-a552-255b17e5b36f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:04.410227 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d15afb52-4d5d-4345-a552-255b17e5b36f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.410789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d15afb52-4d5d-4345-a552-255b17e5b36f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-d15afb52-4d5d-4345-a552-255b17e5b36f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] HTTP exception thrown: Instance c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 could not be found. Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d15afb52-4d5d-4345-a552-255b17e5b36f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Request method failure captured: Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 HTTP/1.1 Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zM1CVhkGzrLI27yplqtJpQo-i3-EKMGfRab3BLA-iVFSYzTm_PO2UXoSlqkSOVVu2ip8fmaaUlGTzOcY-1-PKTjTHCVYzWriYi14tgLboJXa9RPch13wobugtzkYLm5uZx9koMts7tA37UlK9MH24L7zFq17JufqAVvZobtx47aYg4 Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1db06ac41e9f4fe290e535f703af484d Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 could not be found. Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'c56a1af0-7bb0-42ee-8139-fe6c8a6772d4'} Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 could not be found. Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:47:04.436067 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:47:04.439697 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:47:04.439697 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:04.439697 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 could not be found. Jul 19 22:47:04.439697 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.439697 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:04.439697 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.439697 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.439697 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:04.439697 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:04.439697 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:04.439697 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:04.439697 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 could not be found. Jul 19 22:47:04.439697 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.439697 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d15afb52-4d5d-4345-a552-255b17e5b36f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Returning 404 to user: Instance c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:04.439697 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d15afb52-4d5d-4345-a552-255b17e5b36f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4" status: 404 len: 111 microversion: 2.1 time: 0.050036 Jul 19 22:47:04.444556 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2093/4154] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:47:04 2022] DELETE /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:47:04.464408 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-74fc9aa3-128d-46f4-8607-8d05901d304f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:04.465117 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-74fc9aa3-128d-46f4-8607-8d05901d304f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: c56a1af0-7bb0-42ee-8139-fe6c8a6772d4] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:04.473090 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74fc9aa3-128d-46f4-8607-8d05901d304f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.473855 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74fc9aa3-128d-46f4-8607-8d05901d304f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:04.474633 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74fc9aa3-128d-46f4-8607-8d05901d304f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.475276 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74fc9aa3-128d-46f4-8607-8d05901d304f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:04.494190 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-74fc9aa3-128d-46f4-8607-8d05901d304f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] HTTP exception thrown: Instance c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 could not be found. Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-74fc9aa3-128d-46f4-8607-8d05901d304f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Request method failure captured: Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 HTTP/1.1 Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zM1CVhkGzrLI27yplqtJpQo-i3-EKMGfRab3BLA-iVFSYzTm_PO2UXoSlqkSOVVu2ip8fmaaUlGTzOcY-1-PKTjTHCVYzWriYi14tgLboJXa9RPch13wobugtzkYLm5uZx9koMts7tA37UlK9MH24L7zFq17JufqAVvZobtx47aYg4 Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1db06ac41e9f4fe290e535f703af484d Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 could not be found. Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'c56a1af0-7bb0-42ee-8139-fe6c8a6772d4'} Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 could not be found. Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 could not be found. Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.496173 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.499620 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:04.499620 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:04.499620 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:04.499620 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:04.499620 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 could not be found. Jul 19 22:47:04.499620 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.502203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-74fc9aa3-128d-46f4-8607-8d05901d304f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Returning 404 to user: Instance c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:04.504021 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-74fc9aa3-128d-46f4-8607-8d05901d304f tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4" status: 404 len: 111 microversion: 2.1 time: 0.059111 Jul 19 22:47:04.504824 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2062/4155] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:04 2022] GET /compute/v2.1/servers/c56a1af0-7bb0-42ee-8139-fe6c8a6772d4 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:47:04.524018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-20ae0609-2870-4875-bd9f-9274f8a40239 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:04.525086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-20ae0609-2870-4875-bd9f-9274f8a40239 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 617aa88b-23a3-4d6f-bf46-dd8c78af517f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:04.540301 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-20ae0609-2870-4875-bd9f-9274f8a40239 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.541127 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-20ae0609-2870-4875-bd9f-9274f8a40239 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:04.543552 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-20ae0609-2870-4875-bd9f-9274f8a40239 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.544671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-20ae0609-2870-4875-bd9f-9274f8a40239 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:04.585987 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-20ae0609-2870-4875-bd9f-9274f8a40239 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] HTTP exception thrown: Instance 617aa88b-23a3-4d6f-bf46-dd8c78af517f could not be found. Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-20ae0609-2870-4875-bd9f-9274f8a40239 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Request method failure captured: Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f HTTP/1.1 Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zM1CVhkGzrLI27yplqtJpQo-i3-EKMGfRab3BLA-iVFSYzTm_PO2UXoSlqkSOVVu2ip8fmaaUlGTzOcY-1-PKTjTHCVYzWriYi14tgLboJXa9RPch13wobugtzkYLm5uZx9koMts7tA37UlK9MH24L7zFq17JufqAVvZobtx47aYg4 Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1db06ac41e9f4fe290e535f703af484d Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 617aa88b-23a3-4d6f-bf46-dd8c78af517f could not be found. Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '617aa88b-23a3-4d6f-bf46-dd8c78af517f'} Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 617aa88b-23a3-4d6f-bf46-dd8c78af517f could not be found. Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:04.589647 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 617aa88b-23a3-4d6f-bf46-dd8c78af517f could not be found. Jul 19 22:47:04.597736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.597736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:04.597736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.597736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.597736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:04.597736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:04.597736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:04.597736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:04.597736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 617aa88b-23a3-4d6f-bf46-dd8c78af517f could not be found. Jul 19 22:47:04.597736 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.603731 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-20ae0609-2870-4875-bd9f-9274f8a40239 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Returning 404 to user: Instance 617aa88b-23a3-4d6f-bf46-dd8c78af517f could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:04.605793 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-20ae0609-2870-4875-bd9f-9274f8a40239 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "DELETE /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f" status: 404 len: 111 microversion: 2.1 time: 0.092077 Jul 19 22:47:04.612036 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2094/4156] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:47:04 2022] DELETE /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:47:04.618814 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-73007544-9ca4-4105-808d-b5d353a9bf17 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:04.619797 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-73007544-9ca4-4105-808d-b5d353a9bf17 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 617aa88b-23a3-4d6f-bf46-dd8c78af517f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:04.633284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-73007544-9ca4-4105-808d-b5d353a9bf17 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.633746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-73007544-9ca4-4105-808d-b5d353a9bf17 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:04.634535 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-73007544-9ca4-4105-808d-b5d353a9bf17 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.635342 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-73007544-9ca4-4105-808d-b5d353a9bf17 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:04.651881 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-73007544-9ca4-4105-808d-b5d353a9bf17 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] HTTP exception thrown: Instance 617aa88b-23a3-4d6f-bf46-dd8c78af517f could not be found. Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-73007544-9ca4-4105-808d-b5d353a9bf17 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Request method failure captured: Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f HTTP/1.1 Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zM1CVhkGzrLI27yplqtJpQo-i3-EKMGfRab3BLA-iVFSYzTm_PO2UXoSlqkSOVVu2ip8fmaaUlGTzOcY-1-PKTjTHCVYzWriYi14tgLboJXa9RPch13wobugtzkYLm5uZx9koMts7tA37UlK9MH24L7zFq17JufqAVvZobtx47aYg4 Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1db06ac41e9f4fe290e535f703af484d Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 617aa88b-23a3-4d6f-bf46-dd8c78af517f could not be found. Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '617aa88b-23a3-4d6f-bf46-dd8c78af517f'} Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 617aa88b-23a3-4d6f-bf46-dd8c78af517f could not be found. Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 617aa88b-23a3-4d6f-bf46-dd8c78af517f could not be found. Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.654076 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.660392 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:04.660392 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:04.660392 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:04.660392 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:04.660392 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 617aa88b-23a3-4d6f-bf46-dd8c78af517f could not be found. Jul 19 22:47:04.660392 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.660392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-73007544-9ca4-4105-808d-b5d353a9bf17 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Returning 404 to user: Instance 617aa88b-23a3-4d6f-bf46-dd8c78af517f could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:04.660392 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-73007544-9ca4-4105-808d-b5d353a9bf17 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f" status: 404 len: 111 microversion: 2.1 time: 0.042054 Jul 19 22:47:04.660392 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2063/4157] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:04 2022] GET /compute/v2.1/servers/617aa88b-23a3-4d6f-bf46-dd8c78af517f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:47:04.666264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1b66b2cb-ac0a-439d-aa92-04a2cdf74415 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:04.666761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1b66b2cb-ac0a-439d-aa92-04a2cdf74415 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 452a29c5-c034-4f02-827f-95ffb5bfffbb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:04.674380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b66b2cb-ac0a-439d-aa92-04a2cdf74415 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.674947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b66b2cb-ac0a-439d-aa92-04a2cdf74415 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:04.675815 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b66b2cb-ac0a-439d-aa92-04a2cdf74415 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.676254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b66b2cb-ac0a-439d-aa92-04a2cdf74415 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:04.692922 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-1b66b2cb-ac0a-439d-aa92-04a2cdf74415 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] HTTP exception thrown: Instance 452a29c5-c034-4f02-827f-95ffb5bfffbb could not be found. Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1b66b2cb-ac0a-439d-aa92-04a2cdf74415 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Request method failure captured: Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb HTTP/1.1 Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zM1CVhkGzrLI27yplqtJpQo-i3-EKMGfRab3BLA-iVFSYzTm_PO2UXoSlqkSOVVu2ip8fmaaUlGTzOcY-1-PKTjTHCVYzWriYi14tgLboJXa9RPch13wobugtzkYLm5uZx9koMts7tA37UlK9MH24L7zFq17JufqAVvZobtx47aYg4 Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1db06ac41e9f4fe290e535f703af484d Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 452a29c5-c034-4f02-827f-95ffb5bfffbb could not be found. Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '452a29c5-c034-4f02-827f-95ffb5bfffbb'} Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 452a29c5-c034-4f02-827f-95ffb5bfffbb could not be found. Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:04.695151 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 452a29c5-c034-4f02-827f-95ffb5bfffbb could not be found. Jul 19 22:47:04.698435 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.698435 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:04.698435 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.698435 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.698435 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:04.698435 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:04.698435 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:04.698435 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:04.698435 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 452a29c5-c034-4f02-827f-95ffb5bfffbb could not be found. Jul 19 22:47:04.698435 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.700524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1b66b2cb-ac0a-439d-aa92-04a2cdf74415 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Returning 404 to user: Instance 452a29c5-c034-4f02-827f-95ffb5bfffbb could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:04.701612 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1b66b2cb-ac0a-439d-aa92-04a2cdf74415 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "DELETE /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb" status: 404 len: 111 microversion: 2.1 time: 0.039838 Jul 19 22:47:04.702187 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2095/4158] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:47:04 2022] DELETE /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:47:04.710769 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2e64e40d-c28d-4827-b871-eebed8dbfb70 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:04.711529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2e64e40d-c28d-4827-b871-eebed8dbfb70 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 452a29c5-c034-4f02-827f-95ffb5bfffbb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:04.718498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e64e40d-c28d-4827-b871-eebed8dbfb70 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.719693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e64e40d-c28d-4827-b871-eebed8dbfb70 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:04.721290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e64e40d-c28d-4827-b871-eebed8dbfb70 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.722075 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e64e40d-c28d-4827-b871-eebed8dbfb70 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:04.739431 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-2e64e40d-c28d-4827-b871-eebed8dbfb70 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] HTTP exception thrown: Instance 452a29c5-c034-4f02-827f-95ffb5bfffbb could not be found. Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2e64e40d-c28d-4827-b871-eebed8dbfb70 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Request method failure captured: Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb HTTP/1.1 Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zM1CVhkGzrLI27yplqtJpQo-i3-EKMGfRab3BLA-iVFSYzTm_PO2UXoSlqkSOVVu2ip8fmaaUlGTzOcY-1-PKTjTHCVYzWriYi14tgLboJXa9RPch13wobugtzkYLm5uZx9koMts7tA37UlK9MH24L7zFq17JufqAVvZobtx47aYg4 Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1db06ac41e9f4fe290e535f703af484d Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 452a29c5-c034-4f02-827f-95ffb5bfffbb could not be found. Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '452a29c5-c034-4f02-827f-95ffb5bfffbb'} Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 452a29c5-c034-4f02-827f-95ffb5bfffbb could not be found. Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 452a29c5-c034-4f02-827f-95ffb5bfffbb could not be found. Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.740972 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.745176 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:04.745176 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:04.745176 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:04.745176 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:04.745176 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 452a29c5-c034-4f02-827f-95ffb5bfffbb could not be found. Jul 19 22:47:04.745176 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.745176 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2e64e40d-c28d-4827-b871-eebed8dbfb70 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Returning 404 to user: Instance 452a29c5-c034-4f02-827f-95ffb5bfffbb could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:04.745176 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2e64e40d-c28d-4827-b871-eebed8dbfb70 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb" status: 404 len: 111 microversion: 2.1 time: 0.036071 Jul 19 22:47:04.745176 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2064/4159] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:04 2022] GET /compute/v2.1/servers/452a29c5-c034-4f02-827f-95ffb5bfffbb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:47:04.752714 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-273925e1-d401-46f3-a8d0-d4414dfaaeef tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:04.753218 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-273925e1-d401-46f3-a8d0-d4414dfaaeef tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:04.759542 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-273925e1-d401-46f3-a8d0-d4414dfaaeef tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.760559 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-273925e1-d401-46f3-a8d0-d4414dfaaeef tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:04.761716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-273925e1-d401-46f3-a8d0-d4414dfaaeef tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.762160 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-273925e1-d401-46f3-a8d0-d4414dfaaeef tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:04.777448 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-273925e1-d401-46f3-a8d0-d4414dfaaeef tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] HTTP exception thrown: Instance 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b could not be found. Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-273925e1-d401-46f3-a8d0-d4414dfaaeef tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Request method failure captured: Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b HTTP/1.1 Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zM1CVhkGzrLI27yplqtJpQo-i3-EKMGfRab3BLA-iVFSYzTm_PO2UXoSlqkSOVVu2ip8fmaaUlGTzOcY-1-PKTjTHCVYzWriYi14tgLboJXa9RPch13wobugtzkYLm5uZx9koMts7tA37UlK9MH24L7zFq17JufqAVvZobtx47aYg4 Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1db06ac41e9f4fe290e535f703af484d Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b could not be found. Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '9ea50d87-53d3-4f21-a4f0-8cd68de4df2b'} Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b could not be found. Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:04.779330 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b could not be found. Jul 19 22:47:04.782654 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.782654 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:04.782654 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.782654 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.782654 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:04.782654 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:04.782654 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:04.782654 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:04.782654 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b could not be found. Jul 19 22:47:04.782654 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.785251 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-273925e1-d401-46f3-a8d0-d4414dfaaeef tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Returning 404 to user: Instance 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:04.786319 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-273925e1-d401-46f3-a8d0-d4414dfaaeef tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b" status: 404 len: 111 microversion: 2.1 time: 0.038692 Jul 19 22:47:04.787437 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2096/4160] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:47:04 2022] DELETE /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:47:04.796092 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a3dae041-2d5a-4585-9f8f-6f671dc009e7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:04.797063 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a3dae041-2d5a-4585-9f8f-6f671dc009e7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:04.804489 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3dae041-2d5a-4585-9f8f-6f671dc009e7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.805500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3dae041-2d5a-4585-9f8f-6f671dc009e7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:04.807098 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3dae041-2d5a-4585-9f8f-6f671dc009e7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.807847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3dae041-2d5a-4585-9f8f-6f671dc009e7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:04.814714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-11e72473-09d3-4e55-b64c-40ed64caaf6c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:04.820691 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-11e72473-09d3-4e55-b64c-40ed64caaf6c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:04.835836 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-a3dae041-2d5a-4585-9f8f-6f671dc009e7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] HTTP exception thrown: Instance 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b could not be found. Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a3dae041-2d5a-4585-9f8f-6f671dc009e7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Request method failure captured: Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b HTTP/1.1 Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zM1CVhkGzrLI27yplqtJpQo-i3-EKMGfRab3BLA-iVFSYzTm_PO2UXoSlqkSOVVu2ip8fmaaUlGTzOcY-1-PKTjTHCVYzWriYi14tgLboJXa9RPch13wobugtzkYLm5uZx9koMts7tA37UlK9MH24L7zFq17JufqAVvZobtx47aYg4 Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1db06ac41e9f4fe290e535f703af484d Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b could not be found. Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '9ea50d87-53d3-4f21-a4f0-8cd68de4df2b'} Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b could not be found. Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b could not be found. Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.837479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.841657 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:04.841657 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:04.841657 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:04.841657 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:04.841657 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b could not be found. Jul 19 22:47:04.841657 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.842788 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a3dae041-2d5a-4585-9f8f-6f671dc009e7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Returning 404 to user: Instance 9ea50d87-53d3-4f21-a4f0-8cd68de4df2b could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:04.843866 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a3dae041-2d5a-4585-9f8f-6f671dc009e7 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b" status: 404 len: 111 microversion: 2.1 time: 0.052757 Jul 19 22:47:04.845217 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2097/4161] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:04 2022] GET /compute/v2.1/servers/9ea50d87-53d3-4f21-a4f0-8cd68de4df2b => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:47:04.852756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b57fedbc-a50d-4ace-9e92-06fadd8fb948 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:04.853349 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b57fedbc-a50d-4ace-9e92-06fadd8fb948 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: d8568c5f-c480-48e5-85b2-7bae9f2ed0ab] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:04.859905 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-11e72473-09d3-4e55-b64c-40ed64caaf6c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.860459 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-11e72473-09d3-4e55-b64c-40ed64caaf6c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:04.861616 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b57fedbc-a50d-4ace-9e92-06fadd8fb948 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.862332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b57fedbc-a50d-4ace-9e92-06fadd8fb948 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:04.862953 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-11e72473-09d3-4e55-b64c-40ed64caaf6c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.863558 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b57fedbc-a50d-4ace-9e92-06fadd8fb948 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.864188 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b57fedbc-a50d-4ace-9e92-06fadd8fb948 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:04.864296 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-11e72473-09d3-4e55-b64c-40ed64caaf6c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:04.883527 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-b57fedbc-a50d-4ace-9e92-06fadd8fb948 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] HTTP exception thrown: Instance d8568c5f-c480-48e5-85b2-7bae9f2ed0ab could not be found. Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b57fedbc-a50d-4ace-9e92-06fadd8fb948 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Request method failure captured: Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab HTTP/1.1 Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zM1CVhkGzrLI27yplqtJpQo-i3-EKMGfRab3BLA-iVFSYzTm_PO2UXoSlqkSOVVu2ip8fmaaUlGTzOcY-1-PKTjTHCVYzWriYi14tgLboJXa9RPch13wobugtzkYLm5uZx9koMts7tA37UlK9MH24L7zFq17JufqAVvZobtx47aYg4 Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1db06ac41e9f4fe290e535f703af484d Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance d8568c5f-c480-48e5-85b2-7bae9f2ed0ab could not be found. Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'd8568c5f-c480-48e5-85b2-7bae9f2ed0ab'} Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8568c5f-c480-48e5-85b2-7bae9f2ed0ab could not be found. Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:04.885482 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8568c5f-c480-48e5-85b2-7bae9f2ed0ab could not be found. Jul 19 22:47:04.889751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.889751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:04.889751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.889751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:04.889751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:04.889751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:04.889751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:04.889751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:04.889751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8568c5f-c480-48e5-85b2-7bae9f2ed0ab could not be found. Jul 19 22:47:04.889751 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:04.889751 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b57fedbc-a50d-4ace-9e92-06fadd8fb948 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Returning 404 to user: Instance d8568c5f-c480-48e5-85b2-7bae9f2ed0ab could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:04.889751 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b57fedbc-a50d-4ace-9e92-06fadd8fb948 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab" status: 404 len: 111 microversion: 2.1 time: 0.039597 Jul 19 22:47:04.894963 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2098/4162] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:47:04 2022] DELETE /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:47:04.900108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3284e229-b3bd-4279-b517-ccf1293cfb49 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:04.901258 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3284e229-b3bd-4279-b517-ccf1293cfb49 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] [instance: f3d5b823-3f04-4366-b744-8c2fd88a23ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:04.911781 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3284e229-b3bd-4279-b517-ccf1293cfb49 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.912966 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3284e229-b3bd-4279-b517-ccf1293cfb49 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:04.915419 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3284e229-b3bd-4279-b517-ccf1293cfb49 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:04.916284 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3284e229-b3bd-4279-b517-ccf1293cfb49 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:05.334113 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-11e72473-09d3-4e55-b64c-40ed64caaf6c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:05.345918 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-11e72473-09d3-4e55-b64c-40ed64caaf6c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1678 microversion: 2.1 time: 0.552740 Jul 19 22:47:05.346357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3284e229-b3bd-4279-b517-ccf1293cfb49 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b72ae39f30344a2a40a3388882c2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ad52e3deb4d7482fc20872c931353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:05.363679 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2065/4163] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:04 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1678 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:05.365138 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3284e229-b3bd-4279-b517-ccf1293cfb49 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca" status: 200 len: 1312 microversion: 2.1 time: 0.468903 Jul 19 22:47:05.366399 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2099/4164] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:04 2022] GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca => generated 1312 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:05.379667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-10b4adfa-cd48-4701-b5ee-0ee82bf88386 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:05.380434 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-10b4adfa-cd48-4701-b5ee-0ee82bf88386 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: d8568c5f-c480-48e5-85b2-7bae9f2ed0ab] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:05.394470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-10b4adfa-cd48-4701-b5ee-0ee82bf88386 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:05.395245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-10b4adfa-cd48-4701-b5ee-0ee82bf88386 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:05.396194 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-10b4adfa-cd48-4701-b5ee-0ee82bf88386 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:05.396936 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-10b4adfa-cd48-4701-b5ee-0ee82bf88386 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:05.428522 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-10b4adfa-cd48-4701-b5ee-0ee82bf88386 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] HTTP exception thrown: Instance d8568c5f-c480-48e5-85b2-7bae9f2ed0ab could not be found. Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-10b4adfa-cd48-4701-b5ee-0ee82bf88386 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Request method failure captured: Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab HTTP/1.1 Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zM1CVhkGzrLI27yplqtJpQo-i3-EKMGfRab3BLA-iVFSYzTm_PO2UXoSlqkSOVVu2ip8fmaaUlGTzOcY-1-PKTjTHCVYzWriYi14tgLboJXa9RPch13wobugtzkYLm5uZx9koMts7tA37UlK9MH24L7zFq17JufqAVvZobtx47aYg4 Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersTestJSON-1648920919 Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1db06ac41e9f4fe290e535f703af484d Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance d8568c5f-c480-48e5-85b2-7bae9f2ed0ab could not be found. Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'd8568c5f-c480-48e5-85b2-7bae9f2ed0ab'} Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8568c5f-c480-48e5-85b2-7bae9f2ed0ab could not be found. Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8568c5f-c480-48e5-85b2-7bae9f2ed0ab could not be found. Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:05.445364 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:05.449122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:05.449122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:05.449122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:05.449122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:05.449122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8568c5f-c480-48e5-85b2-7bae9f2ed0ab could not be found. Jul 19 22:47:05.449122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:05.449122 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-10b4adfa-cd48-4701-b5ee-0ee82bf88386 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Returning 404 to user: Instance d8568c5f-c480-48e5-85b2-7bae9f2ed0ab could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:05.449122 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-10b4adfa-cd48-4701-b5ee-0ee82bf88386 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab" status: 404 len: 111 microversion: 2.1 time: 0.080756 Jul 19 22:47:05.449967 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2066/4165] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:05 2022] GET /compute/v2.1/servers/d8568c5f-c480-48e5-85b2-7bae9f2ed0ab => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:47:05.467735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9db8c0a5-23e2-4dc8-94a4-9d7227af80ee tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:05.475615 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9db8c0a5-23e2-4dc8-94a4-9d7227af80ee tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 9ef498d1-49a5-4b22-8c82-7de25860efcf] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:05.483630 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-9db8c0a5-23e2-4dc8-94a4-9d7227af80ee tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] HTTP exception thrown: Instance 9ef498d1-49a5-4b22-8c82-7de25860efcf could not be found. Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9db8c0a5-23e2-4dc8-94a4-9d7227af80ee tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Request method failure captured: Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/9ef498d1-49a5-4b22-8c82-7de25860efcf HTTP/1.1 Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zM1CVhkGzrLI27yplqtJpQo-i3-EKMGfRab3BLA-iVFSYzTm_PO2UXoSlqkSOVVu2ip8fmaaUlGTzOcY-1-PKTjTHCVYzWriYi14tgLboJXa9RPch13wobugtzkYLm5uZx9koMts7tA37UlK9MH24L7zFq17JufqAVvZobtx47aYg4 Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersTestJSON-1648920919 Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1db06ac41e9f4fe290e535f703af484d Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 9ef498d1-49a5-4b22-8c82-7de25860efcf could not be found. Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '9ef498d1-49a5-4b22-8c82-7de25860efcf'} Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ef498d1-49a5-4b22-8c82-7de25860efcf could not be found. Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ef498d1-49a5-4b22-8c82-7de25860efcf could not be found. Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:05.489155 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:05.493512 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:05.493512 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:05.493512 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:05.493512 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:05.493512 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:05.493512 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ef498d1-49a5-4b22-8c82-7de25860efcf could not be found. Jul 19 22:47:05.493512 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:05.495573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9db8c0a5-23e2-4dc8-94a4-9d7227af80ee tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Returning 404 to user: Instance 9ef498d1-49a5-4b22-8c82-7de25860efcf could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:05.496700 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9db8c0a5-23e2-4dc8-94a4-9d7227af80ee tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9ef498d1-49a5-4b22-8c82-7de25860efcf" status: 404 len: 111 microversion: 2.1 time: 0.040423 Jul 19 22:47:05.498146 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2100/4166] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:47:05 2022] DELETE /compute/v2.1/servers/9ef498d1-49a5-4b22-8c82-7de25860efcf => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:47:05.510938 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-22a380e2-d2e6-4794-8ae4-b81c18944211 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:05.511970 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-22a380e2-d2e6-4794-8ae4-b81c18944211 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 9ef498d1-49a5-4b22-8c82-7de25860efcf] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:05.522126 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-22a380e2-d2e6-4794-8ae4-b81c18944211 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] HTTP exception thrown: Instance 9ef498d1-49a5-4b22-8c82-7de25860efcf could not be found. Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-22a380e2-d2e6-4794-8ae4-b81c18944211 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Request method failure captured: Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/9ef498d1-49a5-4b22-8c82-7de25860efcf HTTP/1.1 Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zM1CVhkGzrLI27yplqtJpQo-i3-EKMGfRab3BLA-iVFSYzTm_PO2UXoSlqkSOVVu2ip8fmaaUlGTzOcY-1-PKTjTHCVYzWriYi14tgLboJXa9RPch13wobugtzkYLm5uZx9koMts7tA37UlK9MH24L7zFq17JufqAVvZobtx47aYg4 Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersTestJSON-1648920919 Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1db06ac41e9f4fe290e535f703af484d Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 9ef498d1-49a5-4b22-8c82-7de25860efcf could not be found. Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '9ef498d1-49a5-4b22-8c82-7de25860efcf'} Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ef498d1-49a5-4b22-8c82-7de25860efcf could not be found. Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ef498d1-49a5-4b22-8c82-7de25860efcf could not be found. Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:05.524263 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:05.529337 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:05.529337 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:05.529337 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ef498d1-49a5-4b22-8c82-7de25860efcf could not be found. Jul 19 22:47:05.529337 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:05.532354 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-22a380e2-d2e6-4794-8ae4-b81c18944211 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Returning 404 to user: Instance 9ef498d1-49a5-4b22-8c82-7de25860efcf could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:05.534294 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-22a380e2-d2e6-4794-8ae4-b81c18944211 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/9ef498d1-49a5-4b22-8c82-7de25860efcf" status: 404 len: 111 microversion: 2.1 time: 0.029022 Jul 19 22:47:05.535723 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2067/4167] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:05 2022] GET /compute/v2.1/servers/9ef498d1-49a5-4b22-8c82-7de25860efcf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:47:05.545846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9b997d88-b98a-4a61-8341-b5e92dba2f5e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:05.547002 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9b997d88-b98a-4a61-8341-b5e92dba2f5e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:05.556849 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b997d88-b98a-4a61-8341-b5e92dba2f5e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:05.557629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b997d88-b98a-4a61-8341-b5e92dba2f5e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:05.558371 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b997d88-b98a-4a61-8341-b5e92dba2f5e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:05.558820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b997d88-b98a-4a61-8341-b5e92dba2f5e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:05.592330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9b997d88-b98a-4a61-8341-b5e92dba2f5e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:47:05.713802 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9b997d88-b98a-4a61-8341-b5e92dba2f5e tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "DELETE /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5" status: 204 len: 0 microversion: 2.1 time: 0.173299 Jul 19 22:47:05.715194 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2101/4168] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:47:05 2022] DELETE /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:47:05.724601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-14322ff6-8289-493f-b13e-0e74af72aabe tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:05.725281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-14322ff6-8289-493f-b13e-0e74af72aabe tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:05.739909 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14322ff6-8289-493f-b13e-0e74af72aabe tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:05.740713 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14322ff6-8289-493f-b13e-0e74af72aabe tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:05.741737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14322ff6-8289-493f-b13e-0e74af72aabe tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:05.742399 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14322ff6-8289-493f-b13e-0e74af72aabe tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:06.107853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-14322ff6-8289-493f-b13e-0e74af72aabe tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:06.124924 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-14322ff6-8289-493f-b13e-0e74af72aabe tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5" status: 200 len: 1479 microversion: 2.1 time: 0.403510 Jul 19 22:47:06.129436 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2068/4169] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:05 2022] GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 => generated 1479 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:06.370329 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-da19895b-c906-4ca8-8a65-184de2b19753 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:06.376475 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-da19895b-c906-4ca8-8a65-184de2b19753 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:06.383363 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0870130a-8de3-4ff3-8f03-97beaf7a6e3b tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:06.383989 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0870130a-8de3-4ff3-8f03-97beaf7a6e3b tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] [instance: f3d5b823-3f04-4366-b744-8c2fd88a23ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:06.387010 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:47:06.395488 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da19895b-c906-4ca8-8a65-184de2b19753 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:06.398721 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da19895b-c906-4ca8-8a65-184de2b19753 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:06.401243 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da19895b-c906-4ca8-8a65-184de2b19753 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:06.402750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0870130a-8de3-4ff3-8f03-97beaf7a6e3b tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:06.403242 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0870130a-8de3-4ff3-8f03-97beaf7a6e3b tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:06.404215 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0870130a-8de3-4ff3-8f03-97beaf7a6e3b tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:06.404823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0870130a-8de3-4ff3-8f03-97beaf7a6e3b tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:06.405556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da19895b-c906-4ca8-8a65-184de2b19753 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:06.731714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0870130a-8de3-4ff3-8f03-97beaf7a6e3b tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b72ae39f30344a2a40a3388882c2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ad52e3deb4d7482fc20872c931353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:06.743919 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0870130a-8de3-4ff3-8f03-97beaf7a6e3b tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca" status: 200 len: 1312 microversion: 2.1 time: 0.361755 Jul 19 22:47:06.757147 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2069/4170] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:06 2022] GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca => generated 1312 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:06.870055 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-da19895b-c906-4ca8-8a65-184de2b19753 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:06.896215 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-da19895b-c906-4ca8-8a65-184de2b19753 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1678 microversion: 2.1 time: 0.528310 Jul 19 22:47:06.899131 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2102/4171] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:06 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1678 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:07.146052 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eb289e7e-1a8d-4fb2-8005-cf1b62597609 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:07.146848 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eb289e7e-1a8d-4fb2-8005-cf1b62597609 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:07.154742 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=98 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:47:07.159498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb289e7e-1a8d-4fb2-8005-cf1b62597609 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:07.160013 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb289e7e-1a8d-4fb2-8005-cf1b62597609 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:07.160852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb289e7e-1a8d-4fb2-8005-cf1b62597609 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:07.161295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb289e7e-1a8d-4fb2-8005-cf1b62597609 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:07.724034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-eb289e7e-1a8d-4fb2-8005-cf1b62597609 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:07.749160 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eb289e7e-1a8d-4fb2-8005-cf1b62597609 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5" status: 200 len: 1479 microversion: 2.1 time: 0.607943 Jul 19 22:47:07.750769 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2070/4172] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:07 2022] GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 => generated 1479 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:07.767962 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-db499cb7-2d49-41e1-8daa-4e1ec057fc7d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:07.770169 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-db499cb7-2d49-41e1-8daa-4e1ec057fc7d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] [instance: f3d5b823-3f04-4366-b744-8c2fd88a23ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:07.797847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-db499cb7-2d49-41e1-8daa-4e1ec057fc7d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:07.802193 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-db499cb7-2d49-41e1-8daa-4e1ec057fc7d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:07.804596 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-db499cb7-2d49-41e1-8daa-4e1ec057fc7d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:07.806858 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-db499cb7-2d49-41e1-8daa-4e1ec057fc7d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:07.927965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1dc4aa39-d8d1-4bfa-a55e-40ae4cd59a3b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:07.929013 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1dc4aa39-d8d1-4bfa-a55e-40ae4cd59a3b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:07.945405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1dc4aa39-d8d1-4bfa-a55e-40ae4cd59a3b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:07.954050 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1dc4aa39-d8d1-4bfa-a55e-40ae4cd59a3b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:07.955745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1dc4aa39-d8d1-4bfa-a55e-40ae4cd59a3b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:07.958453 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1dc4aa39-d8d1-4bfa-a55e-40ae4cd59a3b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:08.355369 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-db499cb7-2d49-41e1-8daa-4e1ec057fc7d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b72ae39f30344a2a40a3388882c2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ad52e3deb4d7482fc20872c931353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:08.367764 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-db499cb7-2d49-41e1-8daa-4e1ec057fc7d tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca" status: 200 len: 1312 microversion: 2.1 time: 0.607483 Jul 19 22:47:08.379312 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2103/4173] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:07 2022] GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca => generated 1312 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:08.391968 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-73328213-1e8b-471b-bd99-f765252c6184 req-eeb1e1c8-a378-41dd-8ef8-e0c0e9495ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3d5b823-3f04-4366-b744-8c2fd88a23ca", "name": "network-vif-plugged", "status": "completed", "tag": "42ae2352-bed7-4e5c-8d1f-20248093c4f7"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:47:08.417570 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-73328213-1e8b-471b-bd99-f765252c6184 req-eeb1e1c8-a378-41dd-8ef8-e0c0e9495ad8 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:08.418424 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-73328213-1e8b-471b-bd99-f765252c6184 req-eeb1e1c8-a378-41dd-8ef8-e0c0e9495ad8 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:08.438096 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-73328213-1e8b-471b-bd99-f765252c6184 req-eeb1e1c8-a378-41dd-8ef8-e0c0e9495ad8 service nova] Creating event network-vif-plugged:42ae2352-bed7-4e5c-8d1f-20248093c4f7 for instance f3d5b823-3f04-4366-b744-8c2fd88a23ca on n-h1-847009-3 Jul 19 22:47:08.445127 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-73328213-1e8b-471b-bd99-f765252c6184 req-eeb1e1c8-a378-41dd-8ef8-e0c0e9495ad8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063838 Jul 19 22:47:08.459425 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2104/4174] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:47:08.540072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1dc4aa39-d8d1-4bfa-a55e-40ae4cd59a3b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:08.554869 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1dc4aa39-d8d1-4bfa-a55e-40ae4cd59a3b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1655 microversion: 2.1 time: 0.640563 Jul 19 22:47:08.556059 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2071/4175] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:07 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1655 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:47:08.574411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bdac7b04-9c21-448d-b1f2-2fcb5369a817 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:47:08.585164 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bdac7b04-9c21-448d-b1f2-2fcb5369a817 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:08.586025 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bdac7b04-9c21-448d-b1f2-2fcb5369a817 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:08.640586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bdac7b04-9c21-448d-b1f2-2fcb5369a817 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Going to try to start instance {{(pid=119338) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 22:47:08.739408 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bdac7b04-9c21-448d-b1f2-2fcb5369a817 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action" status: 202 len: 0 microversion: 2.1 time: 0.169950 Jul 19 22:47:08.740939 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2105/4176] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:47:08 2022] POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:47:08.750719 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ebd9c626-fd08-44ca-a2f7-6b70c0d724f6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:08.753332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ebd9c626-fd08-44ca-a2f7-6b70c0d724f6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:08.765001 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ebd9c626-fd08-44ca-a2f7-6b70c0d724f6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:08.766120 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ebd9c626-fd08-44ca-a2f7-6b70c0d724f6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:08.769435 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ebd9c626-fd08-44ca-a2f7-6b70c0d724f6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:08.770457 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ebd9c626-fd08-44ca-a2f7-6b70c0d724f6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:08.787408 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-29dc9c9e-2fa7-4761-815d-d6c506d55241 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:08.788184 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-29dc9c9e-2fa7-4761-815d-d6c506d55241 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:08.802070 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29dc9c9e-2fa7-4761-815d-d6c506d55241 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:08.802550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29dc9c9e-2fa7-4761-815d-d6c506d55241 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:08.804694 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29dc9c9e-2fa7-4761-815d-d6c506d55241 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:08.806406 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29dc9c9e-2fa7-4761-815d-d6c506d55241 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:09.326478 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ebd9c626-fd08-44ca-a2f7-6b70c0d724f6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:09.329145 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:47:09.348604 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ebd9c626-fd08-44ca-a2f7-6b70c0d724f6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1664 microversion: 2.1 time: 0.603964 Jul 19 22:47:09.359194 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2072/4177] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:08 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1664 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:09.389097 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f448a37a-935d-44e0-a8e5-415e5fed0634 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:09.389707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f448a37a-935d-44e0-a8e5-415e5fed0634 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] [instance: f3d5b823-3f04-4366-b744-8c2fd88a23ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:09.397706 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f448a37a-935d-44e0-a8e5-415e5fed0634 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:09.398405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f448a37a-935d-44e0-a8e5-415e5fed0634 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:09.399429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f448a37a-935d-44e0-a8e5-415e5fed0634 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:09.400079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f448a37a-935d-44e0-a8e5-415e5fed0634 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:09.731824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-29dc9c9e-2fa7-4761-815d-d6c506d55241 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db06ac41e9f4fe290e535f703af484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd4d0caf2f347218af6ffd52f250c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:09.758526 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:47:09.763255 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-29dc9c9e-2fa7-4761-815d-d6c506d55241 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5" status: 200 len: 1479 microversion: 2.1 time: 0.987595 Jul 19 22:47:09.764138 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2106/4178] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:08 2022] GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 => generated 1479 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:09.954915 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-2d0941ea-d869-4cdc-8b58-f1b5bf069561 req-288633a8-eaa5-4cea-8853-5675a7976b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "507f8fdc-8dd3-4fb8-81d8-43c0782f48a5", "name": "network-vif-deleted", "tag": "904ca1d5-eed3-4af9-8d7e-809aad699209"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:47:09.981432 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-2d0941ea-d869-4cdc-8b58-f1b5bf069561 req-288633a8-eaa5-4cea-8853-5675a7976b67 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:09.981793 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-2d0941ea-d869-4cdc-8b58-f1b5bf069561 req-288633a8-eaa5-4cea-8853-5675a7976b67 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:10.028046 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-2d0941ea-d869-4cdc-8b58-f1b5bf069561 req-288633a8-eaa5-4cea-8853-5675a7976b67 service nova] Creating event network-vif-deleted:904ca1d5-eed3-4af9-8d7e-809aad699209 for instance 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 on n-h2-847009-3 Jul 19 22:47:10.045860 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-2d0941ea-d869-4cdc-8b58-f1b5bf069561 req-288633a8-eaa5-4cea-8853-5675a7976b67 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095289 Jul 19 22:47:10.045860 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2107/4179] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:47:10.085950 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f448a37a-935d-44e0-a8e5-415e5fed0634 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b72ae39f30344a2a40a3388882c2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ad52e3deb4d7482fc20872c931353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:10.096759 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f448a37a-935d-44e0-a8e5-415e5fed0634 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca" status: 200 len: 1312 microversion: 2.1 time: 0.711584 Jul 19 22:47:10.098135 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2073/4180] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:09 2022] GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca => generated 1312 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:47:10.381472 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8df1c16b-26b5-4509-ad03-141f903d94c0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:10.387828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8df1c16b-26b5-4509-ad03-141f903d94c0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:10.398308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8df1c16b-26b5-4509-ad03-141f903d94c0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:10.400850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8df1c16b-26b5-4509-ad03-141f903d94c0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:10.401852 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8df1c16b-26b5-4509-ad03-141f903d94c0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:10.402456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8df1c16b-26b5-4509-ad03-141f903d94c0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:10.783489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2720b07b-9398-494b-80f0-d5126dabdb80 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:10.784677 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2720b07b-9398-494b-80f0-d5126dabdb80 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] [instance: 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:10.797393 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2720b07b-9398-494b-80f0-d5126dabdb80 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:10.798110 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2720b07b-9398-494b-80f0-d5126dabdb80 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:10.799494 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2720b07b-9398-494b-80f0-d5126dabdb80 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:10.801516 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2720b07b-9398-494b-80f0-d5126dabdb80 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:10.844668 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-2720b07b-9398-494b-80f0-d5126dabdb80 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] HTTP exception thrown: Instance 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 could not be found. Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2720b07b-9398-494b-80f0-d5126dabdb80 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Request method failure captured: Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 HTTP/1.1 Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zM1CVhkGzrLI27yplqtJpQo-i3-EKMGfRab3BLA-iVFSYzTm_PO2UXoSlqkSOVVu2ip8fmaaUlGTzOcY-1-PKTjTHCVYzWriYi14tgLboJXa9RPch13wobugtzkYLm5uZx9koMts7tA37UlK9MH24L7zFq17JufqAVvZobtx47aYg4 Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9bd4d0caf2f347218af6ffd52f250c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersTestJSON-1648920919 Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 9bd4d0caf2f347218af6ffd52f250c59 Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersTestJSON-1648920919 Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1db06ac41e9f4fe290e535f703af484d Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersTestJSON-1648920919-project Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 could not be found. Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '507f8fdc-8dd3-4fb8-81d8-43c0782f48a5'} Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 could not be found. Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 could not be found. Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:10.847681 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:10.851833 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:10.851833 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:10.851833 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:10.851833 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:10.851833 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 could not be found. Jul 19 22:47:10.851833 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:10.857301 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2720b07b-9398-494b-80f0-d5126dabdb80 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] Returning 404 to user: Instance 507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:10.858498 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2720b07b-9398-494b-80f0-d5126dabdb80 tempest-ServersTestJSON-1648920919 tempest-ServersTestJSON-1648920919-project] 10.222.0.25 "GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5" status: 404 len: 111 microversion: 2.1 time: 0.080944 Jul 19 22:47:10.859840 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2074/4181] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:10 2022] GET /compute/v2.1/servers/507f8fdc-8dd3-4fb8-81d8-43c0782f48a5 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:47:10.969075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8df1c16b-26b5-4509-ad03-141f903d94c0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:10.981120 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8df1c16b-26b5-4509-ad03-141f903d94c0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1664 microversion: 2.1 time: 0.613942 Jul 19 22:47:10.986616 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2108/4182] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:10 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1664 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:11.127935 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e7327ea0-2ba0-41b5-8f8b-eead0a56932c tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:11.128673 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e7327ea0-2ba0-41b5-8f8b-eead0a56932c tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] [instance: f3d5b823-3f04-4366-b744-8c2fd88a23ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:11.135158 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e7327ea0-2ba0-41b5-8f8b-eead0a56932c tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:11.135881 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e7327ea0-2ba0-41b5-8f8b-eead0a56932c tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:11.136803 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e7327ea0-2ba0-41b5-8f8b-eead0a56932c tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:11.137389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e7327ea0-2ba0-41b5-8f8b-eead0a56932c tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:11.469389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e7327ea0-2ba0-41b5-8f8b-eead0a56932c tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b72ae39f30344a2a40a3388882c2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ad52e3deb4d7482fc20872c931353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:11.478478 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e7327ea0-2ba0-41b5-8f8b-eead0a56932c tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca" status: 200 len: 1497 microversion: 2.1 time: 0.360852 Jul 19 22:47:11.491651 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2075/4183] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:11 2022] GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca => generated 1497 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:11.498449 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-77602eee-2174-4579-8065-0d5eef4889d0 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:11.523329 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.compute.server_groups [None req-77602eee-2174-4579-8065-0d5eef4889d0 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Querying cell c9ec50c5-1e53-4d76-a6eb-599548551fc7(cell1) for 1 instances {{(pid=119338) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 19 22:47:11.525085 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-77602eee-2174-4579-8065-0d5eef4889d0 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:11.525961 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-77602eee-2174-4579-8065-0d5eef4889d0 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:11.609409 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-77602eee-2174-4579-8065-0d5eef4889d0 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/b40214b1-d211-4937-8f90-71f3c505ba6b" status: 200 len: 222 microversion: 2.1 time: 0.115719 Jul 19 22:47:11.611648 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2109/4184] 10.222.0.25 () {58 vars in 1262 bytes} [Tue Jul 19 22:47:11 2022] GET /compute/v2.1/os-server-groups/b40214b1-d211-4937-8f90-71f3c505ba6b => generated 222 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:47:11.622480 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-19be246f-d45f-4336-9925-5596a42dfab0 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:11.623234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-19be246f-d45f-4336-9925-5596a42dfab0 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] [instance: f3d5b823-3f04-4366-b744-8c2fd88a23ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:11.647945 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-19be246f-d45f-4336-9925-5596a42dfab0 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:11.648674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-19be246f-d45f-4336-9925-5596a42dfab0 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:11.650955 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-19be246f-d45f-4336-9925-5596a42dfab0 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:11.652212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-19be246f-d45f-4336-9925-5596a42dfab0 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:11.691081 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-19be246f-d45f-4336-9925-5596a42dfab0 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] [instance: f3d5b823-3f04-4366-b744-8c2fd88a23ca] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:47:11.890541 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-19be246f-d45f-4336-9925-5596a42dfab0 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca" status: 204 len: 0 microversion: 2.1 time: 0.272161 Jul 19 22:47:11.891499 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2076/4185] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:47:11 2022] DELETE /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:47:11.903501 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e5b3b66d-b60b-45a0-a4c5-6708cd380d87 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:11.904233 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e5b3b66d-b60b-45a0-a4c5-6708cd380d87 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] [instance: f3d5b823-3f04-4366-b744-8c2fd88a23ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:11.920288 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e5b3b66d-b60b-45a0-a4c5-6708cd380d87 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:11.921392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e5b3b66d-b60b-45a0-a4c5-6708cd380d87 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:11.928068 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e5b3b66d-b60b-45a0-a4c5-6708cd380d87 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:11.928953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e5b3b66d-b60b-45a0-a4c5-6708cd380d87 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:12.005884 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0ad78d7d-100c-49dc-ab5c-560a06288e30 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:12.006713 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0ad78d7d-100c-49dc-ab5c-560a06288e30 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:12.030139 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ad78d7d-100c-49dc-ab5c-560a06288e30 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:12.030990 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ad78d7d-100c-49dc-ab5c-560a06288e30 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:12.032371 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ad78d7d-100c-49dc-ab5c-560a06288e30 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:12.040436 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ad78d7d-100c-49dc-ab5c-560a06288e30 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:12.431347 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e5b3b66d-b60b-45a0-a4c5-6708cd380d87 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b72ae39f30344a2a40a3388882c2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ad52e3deb4d7482fc20872c931353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:12.445462 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e5b3b66d-b60b-45a0-a4c5-6708cd380d87 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca" status: 200 len: 1503 microversion: 2.1 time: 0.548758 Jul 19 22:47:12.446262 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2110/4186] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:11 2022] GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca => generated 1503 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:12.456108 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0ad78d7d-100c-49dc-ab5c-560a06288e30 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:12.479207 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0ad78d7d-100c-49dc-ab5c-560a06288e30 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.479230 Jul 19 22:47:12.480181 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2077/4187] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:11 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:12.497832 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dfa6c725-bfef-4cfa-b5e6-62c975c38eec tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:12.498569 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dfa6c725-bfef-4cfa-b5e6-62c975c38eec tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:12.518562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfa6c725-bfef-4cfa-b5e6-62c975c38eec tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:12.519023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfa6c725-bfef-4cfa-b5e6-62c975c38eec tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:12.520024 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfa6c725-bfef-4cfa-b5e6-62c975c38eec tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:12.520661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfa6c725-bfef-4cfa-b5e6-62c975c38eec tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:12.826597 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dfa6c725-bfef-4cfa-b5e6-62c975c38eec tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:12.842486 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dfa6c725-bfef-4cfa-b5e6-62c975c38eec tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.345362 Jul 19 22:47:12.845990 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2111/4188] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:12 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:12.872902 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-972785eb-a989-44b9-a823-39ed4bdccd50 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:12.873934 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-972785eb-a989-44b9-a823-39ed4bdccd50 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:12.896437 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-972785eb-a989-44b9-a823-39ed4bdccd50 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:12.898156 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-972785eb-a989-44b9-a823-39ed4bdccd50 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:12.902799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-972785eb-a989-44b9-a823-39ed4bdccd50 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:12.903588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-972785eb-a989-44b9-a823-39ed4bdccd50 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:13.190005 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-972785eb-a989-44b9-a823-39ed4bdccd50 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:13.202934 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-972785eb-a989-44b9-a823-39ed4bdccd50 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.336525 Jul 19 22:47:13.217867 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2078/4189] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:12 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:13.224429 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7852aa4b-a254-4fbb-bb7b-de0b07a763e3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:13.226766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7852aa4b-a254-4fbb-bb7b-de0b07a763e3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:13.242845 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7852aa4b-a254-4fbb-bb7b-de0b07a763e3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:13.243994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7852aa4b-a254-4fbb-bb7b-de0b07a763e3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:13.246753 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7852aa4b-a254-4fbb-bb7b-de0b07a763e3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:13.249269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7852aa4b-a254-4fbb-bb7b-de0b07a763e3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:13.465460 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7cb53683-775d-4d16-9278-db5e88048af3 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:13.466324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7cb53683-775d-4d16-9278-db5e88048af3 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] [instance: f3d5b823-3f04-4366-b744-8c2fd88a23ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:13.480813 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7cb53683-775d-4d16-9278-db5e88048af3 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:13.481546 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7cb53683-775d-4d16-9278-db5e88048af3 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:13.482631 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7cb53683-775d-4d16-9278-db5e88048af3 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:13.487868 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7cb53683-775d-4d16-9278-db5e88048af3 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:13.968219 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7852aa4b-a254-4fbb-bb7b-de0b07a763e3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:13.980876 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7852aa4b-a254-4fbb-bb7b-de0b07a763e3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.763936 Jul 19 22:47:13.981767 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2112/4190] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:13 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:14.021938 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3e77250f-cc60-4476-a92f-1d244144a886 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:14.025123 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3e77250f-cc60-4476-a92f-1d244144a886 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:14.060898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e77250f-cc60-4476-a92f-1d244144a886 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:14.063743 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e77250f-cc60-4476-a92f-1d244144a886 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:14.068611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e77250f-cc60-4476-a92f-1d244144a886 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:14.070585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e77250f-cc60-4476-a92f-1d244144a886 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:14.182621 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7cb53683-775d-4d16-9278-db5e88048af3 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b72ae39f30344a2a40a3388882c2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ad52e3deb4d7482fc20872c931353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:14.262694 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7cb53683-775d-4d16-9278-db5e88048af3 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca" status: 200 len: 1503 microversion: 2.1 time: 0.799369 Jul 19 22:47:14.265322 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2079/4191] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:13 2022] GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca => generated 1503 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:47:14.867408 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3e77250f-cc60-4476-a92f-1d244144a886 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:14.887705 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3e77250f-cc60-4476-a92f-1d244144a886 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.878160 Jul 19 22:47:14.894689 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2113/4192] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:14 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:14.926225 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8e991ffe-20a0-480e-844e-2ba12eee90ad tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:47:14.935467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8e991ffe-20a0-480e-844e-2ba12eee90ad tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:14.943101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8e991ffe-20a0-480e-844e-2ba12eee90ad tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:14.943983 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8e991ffe-20a0-480e-844e-2ba12eee90ad tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:14.947146 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8e991ffe-20a0-480e-844e-2ba12eee90ad tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:14.947708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8e991ffe-20a0-480e-844e-2ba12eee90ad tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:14.968467 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-cfa6ef4c-0c20-42be-b80b-6a7168281674 req-55c97d6f-961b-452a-9ba7-5c848d456a72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3d5b823-3f04-4366-b744-8c2fd88a23ca", "name": "network-vif-deleted", "tag": "42ae2352-bed7-4e5c-8d1f-20248093c4f7"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:47:14.994614 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-cfa6ef4c-0c20-42be-b80b-6a7168281674 req-55c97d6f-961b-452a-9ba7-5c848d456a72 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:14.995148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-cfa6ef4c-0c20-42be-b80b-6a7168281674 req-55c97d6f-961b-452a-9ba7-5c848d456a72 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:15.030514 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-cfa6ef4c-0c20-42be-b80b-6a7168281674 req-55c97d6f-961b-452a-9ba7-5c848d456a72 service nova] Creating event network-vif-deleted:42ae2352-bed7-4e5c-8d1f-20248093c4f7 for instance f3d5b823-3f04-4366-b744-8c2fd88a23ca on n-h1-847009-3 Jul 19 22:47:15.034554 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-8e991ffe-20a0-480e-844e-2ba12eee90ad tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lazy-loading 'flavor' on Instance uuid b9ae7d22-3925-465a-9507-250b670ecc77 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:47:15.046978 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-cfa6ef4c-0c20-42be-b80b-6a7168281674 req-55c97d6f-961b-452a-9ba7-5c848d456a72 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083557 Jul 19 22:47:15.052213 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2114/4193] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:47:15.183076 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8e991ffe-20a0-480e-844e-2ba12eee90ad tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action" status: 202 len: 0 microversion: 2.1 time: 0.268537 Jul 19 22:47:15.190501 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2080/4194] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:47:14 2022] POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:47:15.195819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-15efc911-749c-4f63-84c3-7ed27c52025c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:15.196735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-15efc911-749c-4f63-84c3-7ed27c52025c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:15.209169 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-15efc911-749c-4f63-84c3-7ed27c52025c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:15.209970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-15efc911-749c-4f63-84c3-7ed27c52025c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:15.212380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-15efc911-749c-4f63-84c3-7ed27c52025c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:15.222664 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-15efc911-749c-4f63-84c3-7ed27c52025c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:15.302576 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b4e55047-bb9a-43b3-bac0-4e244349c594 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:15.304802 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b4e55047-bb9a-43b3-bac0-4e244349c594 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] [instance: f3d5b823-3f04-4366-b744-8c2fd88a23ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:15.331929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b4e55047-bb9a-43b3-bac0-4e244349c594 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:15.333552 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b4e55047-bb9a-43b3-bac0-4e244349c594 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:15.337549 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b4e55047-bb9a-43b3-bac0-4e244349c594 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:15.339252 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b4e55047-bb9a-43b3-bac0-4e244349c594 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:15.427045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b4e55047-bb9a-43b3-bac0-4e244349c594 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:15.428171 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b4e55047-bb9a-43b3-bac0-4e244349c594 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:15.429063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-b4e55047-bb9a-43b3-bac0-4e244349c594 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lazy-loading 'fault' on Instance uuid f3d5b823-3f04-4366-b744-8c2fd88a23ca {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:47:15.590407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b4e55047-bb9a-43b3-bac0-4e244349c594 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b72ae39f30344a2a40a3388882c2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ad52e3deb4d7482fc20872c931353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:15.610258 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b4e55047-bb9a-43b3-bac0-4e244349c594 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca" status: 200 len: 1302 microversion: 2.1 time: 0.321287 Jul 19 22:47:15.613135 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-15efc911-749c-4f63-84c3-7ed27c52025c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:15.618098 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2081/4195] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:15 2022] GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca => generated 1302 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:15.637419 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-15efc911-749c-4f63-84c3-7ed27c52025c tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1676 microversion: 2.1 time: 0.445686 Jul 19 22:47:15.640015 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2115/4196] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:15 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1676 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:47:16.641137 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bd7b00da-c973-4805-b580-2cc59912691a tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:16.648560 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bd7b00da-c973-4805-b580-2cc59912691a tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] [instance: f3d5b823-3f04-4366-b744-8c2fd88a23ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:16.665395 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bd7b00da-c973-4805-b580-2cc59912691a tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:16.669000 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bd7b00da-c973-4805-b580-2cc59912691a tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:16.673484 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e1f1c71b-6988-4896-8580-2903de0e1d66 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:16.675398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e1f1c71b-6988-4896-8580-2903de0e1d66 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:16.679829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bd7b00da-c973-4805-b580-2cc59912691a tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:16.680439 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bd7b00da-c973-4805-b580-2cc59912691a tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:16.704915 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1f1c71b-6988-4896-8580-2903de0e1d66 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:16.706855 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1f1c71b-6988-4896-8580-2903de0e1d66 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:16.708553 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1f1c71b-6988-4896-8580-2903de0e1d66 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:16.709382 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1f1c71b-6988-4896-8580-2903de0e1d66 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:16.745658 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-bd7b00da-c973-4805-b580-2cc59912691a tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] HTTP exception thrown: Instance f3d5b823-3f04-4366-b744-8c2fd88a23ca could not be found. Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bd7b00da-c973-4805-b580-2cc59912691a tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Request method failure captured: Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca HTTP/1.1 Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zRVOBTY04MiM-0KsEXS4Xs9WfWW-JW_8KREy77pKv-bVNyffb3J_BiXCq6T57Wr8P9NtDnF5IVSCCf4rzHtWXrgU-QV2PQQrVWeSSTyagwfQ5kmhO1-cy3qIA2Hck74p_0UiYcRosA8g_MULSK3Gm7tdcsPS-A3HISCdRtAh8iEGcI Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: f62ad52e3deb4d7482fc20872c931353 Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerGroupTestJSON-1450325391 Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerGroupTestJSON-1450325391 Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: f62ad52e3deb4d7482fc20872c931353 Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerGroupTestJSON-1450325391 Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerGroupTestJSON-1450325391-project Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 7b72ae39f30344a2a40a3388882c2db4 Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerGroupTestJSON-1450325391-project Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance f3d5b823-3f04-4366-b744-8c2fd88a23ca could not be found. Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'f3d5b823-3f04-4366-b744-8c2fd88a23ca'} Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3d5b823-3f04-4366-b744-8c2fd88a23ca could not be found. Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3d5b823-3f04-4366-b744-8c2fd88a23ca could not be found. Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:16.748927 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:16.754070 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:16.754070 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:16.754070 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:16.754070 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:16.754070 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:16.754070 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3d5b823-3f04-4366-b744-8c2fd88a23ca could not be found. Jul 19 22:47:16.754070 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:16.758536 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bd7b00da-c973-4805-b580-2cc59912691a tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Returning 404 to user: Instance f3d5b823-3f04-4366-b744-8c2fd88a23ca could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:16.763560 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bd7b00da-c973-4805-b580-2cc59912691a tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca" status: 404 len: 111 microversion: 2.1 time: 0.129837 Jul 19 22:47:16.769758 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2082/4197] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:16 2022] GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:47:17.074645 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6bca1f80-47b5-4b9d-aa87-d3c1499b2ea6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1248524571", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "711438ef-9562-4879-b7e2-ec9cf463e48f"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:47:17.166295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-6bca1f80-47b5-4b9d-aa87-d3c1499b2ea6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] validate_networks() for [('711438ef-9562-4879-b7e2-ec9cf463e48f', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:47:17.310898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e1f1c71b-6988-4896-8580-2903de0e1d66 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:17.324278 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e1f1c71b-6988-4896-8580-2903de0e1d66 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1659 microversion: 2.1 time: 0.660218 Jul 19 22:47:17.325856 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2116/4198] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:16 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1659 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:17.354953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-75e30de4-0cf0-442e-a6d1-0cdf8308ecbc tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:17.397503 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.compute.server_groups [None req-75e30de4-0cf0-442e-a6d1-0cdf8308ecbc tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Querying cell c9ec50c5-1e53-4d76-a6eb-599548551fc7(cell1) for 1 instances {{(pid=119338) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 19 22:47:17.399954 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75e30de4-0cf0-442e-a6d1-0cdf8308ecbc tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:17.400722 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75e30de4-0cf0-442e-a6d1-0cdf8308ecbc tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:17.432216 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-75e30de4-0cf0-442e-a6d1-0cdf8308ecbc tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.095778 Jul 19 22:47:17.441952 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2117/4199] 10.222.0.25 () {58 vars in 1151 bytes} [Tue Jul 19 22:47:17 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:47:17.447614 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-44eb75d7-2162-4639-94f9-97adf1bc1cf3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:47:17.448195 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-44eb75d7-2162-4639-94f9-97adf1bc1cf3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:17.457738 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44eb75d7-2162-4639-94f9-97adf1bc1cf3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:17.458172 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44eb75d7-2162-4639-94f9-97adf1bc1cf3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:17.460608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44eb75d7-2162-4639-94f9-97adf1bc1cf3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:17.461309 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44eb75d7-2162-4639-94f9-97adf1bc1cf3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:17.584135 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-44eb75d7-2162-4639-94f9-97adf1bc1cf3 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action" status: 202 len: 0 microversion: 2.1 time: 0.140056 Jul 19 22:47:17.589487 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2118/4200] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:47:17 2022] POST /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:47:17.597323 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-449c9eed-16ce-4fa4-ba4f-4d57d8fa81ca tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:17.627456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.compute.server_groups [None req-449c9eed-16ce-4fa4-ba4f-4d57d8fa81ca tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Querying cell c9ec50c5-1e53-4d76-a6eb-599548551fc7(cell1) for 1 instances {{(pid=119338) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 19 22:47:17.628686 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-449c9eed-16ce-4fa4-ba4f-4d57d8fa81ca tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:17.629380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-449c9eed-16ce-4fa4-ba4f-4d57d8fa81ca tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:17.645653 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-449c9eed-16ce-4fa4-ba4f-4d57d8fa81ca tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/b40214b1-d211-4937-8f90-71f3c505ba6b" status: 200 len: 184 microversion: 2.1 time: 0.054346 Jul 19 22:47:17.654224 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2119/4201] 10.222.0.25 () {58 vars in 1262 bytes} [Tue Jul 19 22:47:17 2022] GET /compute/v2.1/os-server-groups/b40214b1-d211-4937-8f90-71f3c505ba6b => generated 184 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:47:17.660410 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a912df09-cf50-46bd-9dec-d00d72235763 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:17.661176 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a912df09-cf50-46bd-9dec-d00d72235763 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:17.668853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a912df09-cf50-46bd-9dec-d00d72235763 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:17.669385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a912df09-cf50-46bd-9dec-d00d72235763 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:17.670350 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a912df09-cf50-46bd-9dec-d00d72235763 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:17.670798 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a912df09-cf50-46bd-9dec-d00d72235763 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:18.771384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a912df09-cf50-46bd-9dec-d00d72235763 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:18.789739 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a912df09-cf50-46bd-9dec-d00d72235763 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1665 microversion: 2.1 time: 1.133566 Jul 19 22:47:18.791163 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2120/4202] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:17 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1665 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:18.806229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4fe35b71-d40e-4fb7-9e23-b19c34512059 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:18.806966 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4fe35b71-d40e-4fb7-9e23-b19c34512059 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] [instance: f3d5b823-3f04-4366-b744-8c2fd88a23ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:18.815745 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4fe35b71-d40e-4fb7-9e23-b19c34512059 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:18.816665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4fe35b71-d40e-4fb7-9e23-b19c34512059 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:18.817892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4fe35b71-d40e-4fb7-9e23-b19c34512059 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:18.818645 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4fe35b71-d40e-4fb7-9e23-b19c34512059 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:18.842364 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-4fe35b71-d40e-4fb7-9e23-b19c34512059 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] HTTP exception thrown: Instance f3d5b823-3f04-4366-b744-8c2fd88a23ca could not be found. Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4fe35b71-d40e-4fb7-9e23-b19c34512059 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Request method failure captured: Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca HTTP/1.1 Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zRVOBTY04MiM-0KsEXS4Xs9WfWW-JW_8KREy77pKv-bVNyffb3J_BiXCq6T57Wr8P9NtDnF5IVSCCf4rzHtWXrgU-QV2PQQrVWeSSTyagwfQ5kmhO1-cy3qIA2Hck74p_0UiYcRosA8g_MULSK3Gm7tdcsPS-A3HISCdRtAh8iEGcI Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: f62ad52e3deb4d7482fc20872c931353 Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerGroupTestJSON-1450325391 Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerGroupTestJSON-1450325391 Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: f62ad52e3deb4d7482fc20872c931353 Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerGroupTestJSON-1450325391 Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerGroupTestJSON-1450325391-project Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 7b72ae39f30344a2a40a3388882c2db4 Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerGroupTestJSON-1450325391-project Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance f3d5b823-3f04-4366-b744-8c2fd88a23ca could not be found. Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'f3d5b823-3f04-4366-b744-8c2fd88a23ca'} Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3d5b823-3f04-4366-b744-8c2fd88a23ca could not be found. Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:47:18.845287 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:18.848859 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3d5b823-3f04-4366-b744-8c2fd88a23ca could not be found. Jul 19 22:47:18.848859 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:18.848859 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:18.848859 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:18.848859 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:18.848859 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:18.848859 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:18.848859 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:18.848859 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:18.848859 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3d5b823-3f04-4366-b744-8c2fd88a23ca could not be found. Jul 19 22:47:18.848859 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:18.851602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4fe35b71-d40e-4fb7-9e23-b19c34512059 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Returning 404 to user: Instance f3d5b823-3f04-4366-b744-8c2fd88a23ca could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:18.852690 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4fe35b71-d40e-4fb7-9e23-b19c34512059 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca" status: 404 len: 111 microversion: 2.1 time: 0.059735 Jul 19 22:47:18.853629 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2121/4203] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:47:18 2022] DELETE /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:47:18.865183 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8a546de5-61e9-48ce-9651-dc6475d42450 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:18.867946 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8a546de5-61e9-48ce-9651-dc6475d42450 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] [instance: f3d5b823-3f04-4366-b744-8c2fd88a23ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:18.878574 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8a546de5-61e9-48ce-9651-dc6475d42450 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:18.879239 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8a546de5-61e9-48ce-9651-dc6475d42450 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:18.880572 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8a546de5-61e9-48ce-9651-dc6475d42450 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:18.881471 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8a546de5-61e9-48ce-9651-dc6475d42450 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:18.900810 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-8a546de5-61e9-48ce-9651-dc6475d42450 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] HTTP exception thrown: Instance f3d5b823-3f04-4366-b744-8c2fd88a23ca could not be found. Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8a546de5-61e9-48ce-9651-dc6475d42450 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Request method failure captured: Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca HTTP/1.1 Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zRVOBTY04MiM-0KsEXS4Xs9WfWW-JW_8KREy77pKv-bVNyffb3J_BiXCq6T57Wr8P9NtDnF5IVSCCf4rzHtWXrgU-QV2PQQrVWeSSTyagwfQ5kmhO1-cy3qIA2Hck74p_0UiYcRosA8g_MULSK3Gm7tdcsPS-A3HISCdRtAh8iEGcI Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: f62ad52e3deb4d7482fc20872c931353 Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerGroupTestJSON-1450325391 Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerGroupTestJSON-1450325391 Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: f62ad52e3deb4d7482fc20872c931353 Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerGroupTestJSON-1450325391 Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerGroupTestJSON-1450325391-project Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 7b72ae39f30344a2a40a3388882c2db4 Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerGroupTestJSON-1450325391-project Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance f3d5b823-3f04-4366-b744-8c2fd88a23ca could not be found. Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'f3d5b823-3f04-4366-b744-8c2fd88a23ca'} Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3d5b823-3f04-4366-b744-8c2fd88a23ca could not be found. Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3d5b823-3f04-4366-b744-8c2fd88a23ca could not be found. Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:18.902921 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:18.906322 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:18.906322 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:18.906322 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:18.906322 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:18.906322 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:18.906322 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3d5b823-3f04-4366-b744-8c2fd88a23ca could not be found. Jul 19 22:47:18.906322 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:18.906322 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8a546de5-61e9-48ce-9651-dc6475d42450 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Returning 404 to user: Instance f3d5b823-3f04-4366-b744-8c2fd88a23ca could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:18.906322 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8a546de5-61e9-48ce-9651-dc6475d42450 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca" status: 404 len: 111 microversion: 2.1 time: 0.044188 Jul 19 22:47:18.909789 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2122/4204] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:18 2022] GET /compute/v2.1/servers/f3d5b823-3f04-4366-b744-8c2fd88a23ca => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:47:18.915584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5464a7c0-90ce-43b2-bef9-ff3ab395673a tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:18.923589 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-5464a7c0-90ce-43b2-bef9-ff3ab395673a tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] HTTP exception thrown: Instance group eccdafd6-e0b8-4cc9-8d26-c1bebd681c4a could not be found. Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5464a7c0-90ce-43b2-bef9-ff3ab395673a tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Request method failure captured: Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/os-server-groups/eccdafd6-e0b8-4cc9-8d26-c1bebd681c4a HTTP/1.1 Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zRVOBTY04MiM-0KsEXS4Xs9WfWW-JW_8KREy77pKv-bVNyffb3J_BiXCq6T57Wr8P9NtDnF5IVSCCf4rzHtWXrgU-QV2PQQrVWeSSTyagwfQ5kmhO1-cy3qIA2Hck74p_0UiYcRosA8g_MULSK3Gm7tdcsPS-A3HISCdRtAh8iEGcI Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: f62ad52e3deb4d7482fc20872c931353 Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerGroupTestJSON-1450325391 Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerGroupTestJSON-1450325391 Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: f62ad52e3deb4d7482fc20872c931353 Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerGroupTestJSON-1450325391 Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerGroupTestJSON-1450325391-project Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 7b72ae39f30344a2a40a3388882c2db4 Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerGroupTestJSON-1450325391-project Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance group eccdafd6-e0b8-4cc9-8d26-c1bebd681c4a could not be found. Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'eccdafd6-e0b8-4cc9-8d26-c1bebd681c4a'} Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group eccdafd6-e0b8-4cc9-8d26-c1bebd681c4a could not be found. Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group eccdafd6-e0b8-4cc9-8d26-c1bebd681c4a could not be found. Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:18.926804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:18.930513 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:18.930513 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:18.930513 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:18.930513 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:18.930513 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group eccdafd6-e0b8-4cc9-8d26-c1bebd681c4a could not be found. Jul 19 22:47:18.930513 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:18.930513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5464a7c0-90ce-43b2-bef9-ff3ab395673a tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Returning 404 to user: Instance group eccdafd6-e0b8-4cc9-8d26-c1bebd681c4a could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:18.930513 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5464a7c0-90ce-43b2-bef9-ff3ab395673a tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/eccdafd6-e0b8-4cc9-8d26-c1bebd681c4a" status: 404 len: 117 microversion: 2.1 time: 0.017360 Jul 19 22:47:18.934253 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2123/4205] 10.222.0.25 () {58 vars in 1265 bytes} [Tue Jul 19 22:47:18 2022] DELETE /compute/v2.1/os-server-groups/eccdafd6-e0b8-4cc9-8d26-c1bebd681c4a => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:47:18.942746 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6257b737-9610-46fb-b96e-40bc3af25ebd tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:18.953729 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-6257b737-9610-46fb-b96e-40bc3af25ebd tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] HTTP exception thrown: Instance group 1c53d360-5357-497b-9038-e23faa2beb51 could not be found. Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6257b737-9610-46fb-b96e-40bc3af25ebd tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Request method failure captured: Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/os-server-groups/1c53d360-5357-497b-9038-e23faa2beb51 HTTP/1.1 Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zRVOBTY04MiM-0KsEXS4Xs9WfWW-JW_8KREy77pKv-bVNyffb3J_BiXCq6T57Wr8P9NtDnF5IVSCCf4rzHtWXrgU-QV2PQQrVWeSSTyagwfQ5kmhO1-cy3qIA2Hck74p_0UiYcRosA8g_MULSK3Gm7tdcsPS-A3HISCdRtAh8iEGcI Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: f62ad52e3deb4d7482fc20872c931353 Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerGroupTestJSON-1450325391 Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerGroupTestJSON-1450325391 Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: f62ad52e3deb4d7482fc20872c931353 Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerGroupTestJSON-1450325391 Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerGroupTestJSON-1450325391-project Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 7b72ae39f30344a2a40a3388882c2db4 Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerGroupTestJSON-1450325391-project Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance group 1c53d360-5357-497b-9038-e23faa2beb51 could not be found. Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '1c53d360-5357-497b-9038-e23faa2beb51'} Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1c53d360-5357-497b-9038-e23faa2beb51 could not be found. Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1c53d360-5357-497b-9038-e23faa2beb51 could not be found. Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:18.962047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:18.968660 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:18.968660 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:18.968660 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:18.968660 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:18.968660 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1c53d360-5357-497b-9038-e23faa2beb51 could not be found. Jul 19 22:47:18.968660 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:18.968660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6257b737-9610-46fb-b96e-40bc3af25ebd tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Returning 404 to user: Instance group 1c53d360-5357-497b-9038-e23faa2beb51 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:18.968660 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6257b737-9610-46fb-b96e-40bc3af25ebd tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/1c53d360-5357-497b-9038-e23faa2beb51" status: 404 len: 117 microversion: 2.1 time: 0.022140 Jul 19 22:47:18.968660 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2124/4206] 10.222.0.25 () {58 vars in 1265 bytes} [Tue Jul 19 22:47:18 2022] DELETE /compute/v2.1/os-server-groups/1c53d360-5357-497b-9038-e23faa2beb51 => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:47:18.972344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b57e172b-94bd-4dbb-bb52-d6a61ce5e6b7 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:18.979421 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-b57e172b-94bd-4dbb-bb52-d6a61ce5e6b7 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] HTTP exception thrown: Instance group 08ab3824-5659-4a56-ad29-4bac9c946039 could not be found. Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b57e172b-94bd-4dbb-bb52-d6a61ce5e6b7 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Request method failure captured: Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/os-server-groups/08ab3824-5659-4a56-ad29-4bac9c946039 HTTP/1.1 Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zRVOBTY04MiM-0KsEXS4Xs9WfWW-JW_8KREy77pKv-bVNyffb3J_BiXCq6T57Wr8P9NtDnF5IVSCCf4rzHtWXrgU-QV2PQQrVWeSSTyagwfQ5kmhO1-cy3qIA2Hck74p_0UiYcRosA8g_MULSK3Gm7tdcsPS-A3HISCdRtAh8iEGcI Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: f62ad52e3deb4d7482fc20872c931353 Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerGroupTestJSON-1450325391 Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerGroupTestJSON-1450325391 Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: f62ad52e3deb4d7482fc20872c931353 Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerGroupTestJSON-1450325391 Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerGroupTestJSON-1450325391-project Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 7b72ae39f30344a2a40a3388882c2db4 Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerGroupTestJSON-1450325391-project Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance group 08ab3824-5659-4a56-ad29-4bac9c946039 could not be found. Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '08ab3824-5659-4a56-ad29-4bac9c946039'} Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 08ab3824-5659-4a56-ad29-4bac9c946039 could not be found. Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 08ab3824-5659-4a56-ad29-4bac9c946039 could not be found. Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:18.981024 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:18.989213 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:18.989213 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:18.989213 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:18.989213 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:18.989213 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 08ab3824-5659-4a56-ad29-4bac9c946039 could not be found. Jul 19 22:47:18.989213 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:18.989213 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b57e172b-94bd-4dbb-bb52-d6a61ce5e6b7 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Returning 404 to user: Instance group 08ab3824-5659-4a56-ad29-4bac9c946039 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:18.989213 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b57e172b-94bd-4dbb-bb52-d6a61ce5e6b7 tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/08ab3824-5659-4a56-ad29-4bac9c946039" status: 404 len: 117 microversion: 2.1 time: 0.019385 Jul 19 22:47:18.990618 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2125/4207] 10.222.0.25 () {58 vars in 1265 bytes} [Tue Jul 19 22:47:18 2022] DELETE /compute/v2.1/os-server-groups/08ab3824-5659-4a56-ad29-4bac9c946039 => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:47:18.995559 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-76425305-ce4e-4a9c-9026-ab487d90784b tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:19.002840 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-76425305-ce4e-4a9c-9026-ab487d90784b tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] HTTP exception thrown: Instance group 10fb1a16-1b7d-4fbd-91c1-de9e3a1f39b2 could not be found. Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-76425305-ce4e-4a9c-9026-ab487d90784b tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Request method failure captured: Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/os-server-groups/10fb1a16-1b7d-4fbd-91c1-de9e3a1f39b2 HTTP/1.1 Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zRVOBTY04MiM-0KsEXS4Xs9WfWW-JW_8KREy77pKv-bVNyffb3J_BiXCq6T57Wr8P9NtDnF5IVSCCf4rzHtWXrgU-QV2PQQrVWeSSTyagwfQ5kmhO1-cy3qIA2Hck74p_0UiYcRosA8g_MULSK3Gm7tdcsPS-A3HISCdRtAh8iEGcI Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: f62ad52e3deb4d7482fc20872c931353 Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerGroupTestJSON-1450325391 Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f62ad52e3deb4d7482fc20872c931353"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerGroupTestJSON-1450325391 Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: f62ad52e3deb4d7482fc20872c931353 Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerGroupTestJSON-1450325391 Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerGroupTestJSON-1450325391-project Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 7b72ae39f30344a2a40a3388882c2db4 Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerGroupTestJSON-1450325391-project Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance group 10fb1a16-1b7d-4fbd-91c1-de9e3a1f39b2 could not be found. Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '10fb1a16-1b7d-4fbd-91c1-de9e3a1f39b2'} Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 10fb1a16-1b7d-4fbd-91c1-de9e3a1f39b2 could not be found. Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 10fb1a16-1b7d-4fbd-91c1-de9e3a1f39b2 could not be found. Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:19.004558 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:19.008018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:19.008018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:19.008018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:19.008018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:19.008018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 10fb1a16-1b7d-4fbd-91c1-de9e3a1f39b2 could not be found. Jul 19 22:47:19.008018 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:19.009783 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-76425305-ce4e-4a9c-9026-ab487d90784b tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Returning 404 to user: Instance group 10fb1a16-1b7d-4fbd-91c1-de9e3a1f39b2 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:19.011059 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-76425305-ce4e-4a9c-9026-ab487d90784b tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/10fb1a16-1b7d-4fbd-91c1-de9e3a1f39b2" status: 404 len: 117 microversion: 2.1 time: 0.019547 Jul 19 22:47:19.015068 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2126/4208] 10.222.0.25 () {58 vars in 1265 bytes} [Tue Jul 19 22:47:18 2022] DELETE /compute/v2.1/os-server-groups/10fb1a16-1b7d-4fbd-91c1-de9e3a1f39b2 => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:47:19.020617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1c9bb7c3-a594-4d42-98ec-f1610e490f9e tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:19.059759 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1c9bb7c3-a594-4d42-98ec-f1610e490f9e tempest-ServerGroupTestJSON-1450325391 tempest-ServerGroupTestJSON-1450325391-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/b40214b1-d211-4937-8f90-71f3c505ba6b" status: 204 len: 0 microversion: 2.1 time: 0.041140 Jul 19 22:47:19.060945 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2127/4209] 10.222.0.25 () {58 vars in 1265 bytes} [Tue Jul 19 22:47:19 2022] DELETE /compute/v2.1/os-server-groups/b40214b1-d211-4937-8f90-71f3c505ba6b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:47:19.416929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-6bca1f80-47b5-4b9d-aa87-d3c1499b2ea6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:47:19.417415 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-6bca1f80-47b5-4b9d-aa87-d3c1499b2ea6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:47:19.419976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-6bca1f80-47b5-4b9d-aa87-d3c1499b2ea6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:47:19.419976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-6bca1f80-47b5-4b9d-aa87-d3c1499b2ea6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:47:19.429440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-6bca1f80-47b5-4b9d-aa87-d3c1499b2ea6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:47:19.456081 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6bca1f80-47b5-4b9d-aa87-d3c1499b2ea6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:19.456541 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6bca1f80-47b5-4b9d-aa87-d3c1499b2ea6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:19.457354 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6bca1f80-47b5-4b9d-aa87-d3c1499b2ea6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:19.457795 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6bca1f80-47b5-4b9d-aa87-d3c1499b2ea6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:19.491339 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-6bca1f80-47b5-4b9d-aa87-d3c1499b2ea6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Getting quotas for project 08a2933535544cdca4932622d038d8f6. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:47:19.497989 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-6bca1f80-47b5-4b9d-aa87-d3c1499b2ea6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Getting quotas for user 1c827b931a0f497cbd847695315d378d and project 08a2933535544cdca4932622d038d8f6. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:47:19.530196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6bca1f80-47b5-4b9d-aa87-d3c1499b2ea6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:47:19.533697 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6bca1f80-47b5-4b9d-aa87-d3c1499b2ea6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:47:19.594545 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6bca1f80-47b5-4b9d-aa87-d3c1499b2ea6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.802348 Jul 19 22:47:19.595911 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2083/4210] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:47:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:47:19.608132 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-49b8c8df-b485-4c64-8ffb-99bd425f805b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:19.608959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-49b8c8df-b485-4c64-8ffb-99bd425f805b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:19.809216 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1e77f809-409b-454d-91ae-fa0cb1e14443 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:19.809929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1e77f809-409b-454d-91ae-fa0cb1e14443 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:19.832284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e77f809-409b-454d-91ae-fa0cb1e14443 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:19.834355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e77f809-409b-454d-91ae-fa0cb1e14443 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:19.835843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e77f809-409b-454d-91ae-fa0cb1e14443 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:19.839486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e77f809-409b-454d-91ae-fa0cb1e14443 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:19.873670 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-49b8c8df-b485-4c64-8ffb-99bd425f805b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:19.898998 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-49b8c8df-b485-4c64-8ffb-99bd425f805b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1217 microversion: 2.1 time: 0.295131 Jul 19 22:47:19.915694 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2128/4211] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:19 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1217 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:20.602540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1e77f809-409b-454d-91ae-fa0cb1e14443 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:20.617472 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1e77f809-409b-454d-91ae-fa0cb1e14443 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1665 microversion: 2.1 time: 0.813115 Jul 19 22:47:20.618071 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2084/4212] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:19 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1665 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:47:20.919931 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-54ed9c05-4d32-40e4-8f87-efabd9cccf7e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:20.920540 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-54ed9c05-4d32-40e4-8f87-efabd9cccf7e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:20.937369 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54ed9c05-4d32-40e4-8f87-efabd9cccf7e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:20.937960 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54ed9c05-4d32-40e4-8f87-efabd9cccf7e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:20.939346 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54ed9c05-4d32-40e4-8f87-efabd9cccf7e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:20.939865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54ed9c05-4d32-40e4-8f87-efabd9cccf7e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:21.126696 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-54ed9c05-4d32-40e4-8f87-efabd9cccf7e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:21.140718 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-54ed9c05-4d32-40e4-8f87-efabd9cccf7e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1221 microversion: 2.1 time: 0.224724 Jul 19 22:47:21.143442 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2129/4213] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:20 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1221 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:21.638029 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e4b49328-2453-42ff-9df2-e98d9ba208ac tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:21.638715 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e4b49328-2453-42ff-9df2-e98d9ba208ac tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:21.649213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e4b49328-2453-42ff-9df2-e98d9ba208ac tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:21.652688 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e4b49328-2453-42ff-9df2-e98d9ba208ac tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:21.653797 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e4b49328-2453-42ff-9df2-e98d9ba208ac tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:21.657880 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e4b49328-2453-42ff-9df2-e98d9ba208ac tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:22.166046 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-20458d70-558f-439f-8d62-735c11a43087 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:22.167587 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-20458d70-558f-439f-8d62-735c11a43087 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:22.175967 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-20458d70-558f-439f-8d62-735c11a43087 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:22.176673 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-20458d70-558f-439f-8d62-735c11a43087 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:22.177821 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-20458d70-558f-439f-8d62-735c11a43087 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:22.178550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-20458d70-558f-439f-8d62-735c11a43087 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:22.278326 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e4b49328-2453-42ff-9df2-e98d9ba208ac tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:22.296842 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e4b49328-2453-42ff-9df2-e98d9ba208ac tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.659324 Jul 19 22:47:22.300661 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2085/4214] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:21 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:22.323594 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ddebeb06-aab3-4e2a-b6ef-cd73cfe13d04 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:22.325030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ddebeb06-aab3-4e2a-b6ef-cd73cfe13d04 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:22.337138 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ddebeb06-aab3-4e2a-b6ef-cd73cfe13d04 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:22.341097 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ddebeb06-aab3-4e2a-b6ef-cd73cfe13d04 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:22.343703 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ddebeb06-aab3-4e2a-b6ef-cd73cfe13d04 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:22.346770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ddebeb06-aab3-4e2a-b6ef-cd73cfe13d04 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:22.358645 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-20458d70-558f-439f-8d62-735c11a43087 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:22.403804 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-20458d70-558f-439f-8d62-735c11a43087 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1275 microversion: 2.1 time: 0.242708 Jul 19 22:47:22.408460 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2130/4215] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:22 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1275 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:22.762850 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ddebeb06-aab3-4e2a-b6ef-cd73cfe13d04 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:22.806226 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ddebeb06-aab3-4e2a-b6ef-cd73cfe13d04 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1668 microversion: 2.1 time: 0.487463 Jul 19 22:47:22.807965 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2086/4216] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:22 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1668 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:22.831268 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a86db01f-b5c8-446b-855c-d9fb09b2dcd9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:22.832767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a86db01f-b5c8-446b-855c-d9fb09b2dcd9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:22.862260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a86db01f-b5c8-446b-855c-d9fb09b2dcd9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:22.865028 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a86db01f-b5c8-446b-855c-d9fb09b2dcd9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:22.867009 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a86db01f-b5c8-446b-855c-d9fb09b2dcd9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:22.869526 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a86db01f-b5c8-446b-855c-d9fb09b2dcd9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:22.911593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a86db01f-b5c8-446b-855c-d9fb09b2dcd9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:47:22.919463 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.compute.api [None req-a86db01f-b5c8-446b-855c-d9fb09b2dcd9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Working on deleting snapshot 29175f41-7db2-44d2-a2b4-c425fb206d76 from shelved instance... Jul 19 22:47:23.425698 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7ce22ffb-178f-4dce-9a43-504fef184680 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:23.426598 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7ce22ffb-178f-4dce-9a43-504fef184680 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:23.459779 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7ce22ffb-178f-4dce-9a43-504fef184680 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:23.460258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7ce22ffb-178f-4dce-9a43-504fef184680 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:23.461728 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7ce22ffb-178f-4dce-9a43-504fef184680 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:23.462448 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7ce22ffb-178f-4dce-9a43-504fef184680 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:23.647948 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7ce22ffb-178f-4dce-9a43-504fef184680 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:23.673682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:47:23.715413 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7ce22ffb-178f-4dce-9a43-504fef184680 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1275 microversion: 2.1 time: 0.297211 Jul 19 22:47:23.725747 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2087/4217] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:23 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1275 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:47:24.192565 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:47:24.211391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a86db01f-b5c8-446b-855c-d9fb09b2dcd9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Doing local delete in cell c9ec50c5-1e53-4d76-a6eb-599548551fc7(cell1) {{(pid=119338) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 19 22:47:24.212454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a86db01f-b5c8-446b-855c-d9fb09b2dcd9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:24.213249 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a86db01f-b5c8-446b-855c-d9fb09b2dcd9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:24.213830 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.compute.api [None req-a86db01f-b5c8-446b-855c-d9fb09b2dcd9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 19 22:47:24.218690 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-a86db01f-b5c8-446b-855c-d9fb09b2dcd9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] deallocate_for_instance() {{(pid=119338) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 19 22:47:24.733983 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4e07f2b2-156f-4135-8911-18634c780eb9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:24.734616 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4e07f2b2-156f-4135-8911-18634c780eb9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:24.754970 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4e07f2b2-156f-4135-8911-18634c780eb9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:24.757893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4e07f2b2-156f-4135-8911-18634c780eb9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:24.763245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4e07f2b2-156f-4135-8911-18634c780eb9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:24.764350 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4e07f2b2-156f-4135-8911-18634c780eb9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:25.598602 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4e07f2b2-156f-4135-8911-18634c780eb9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:25.608329 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4e07f2b2-156f-4135-8911-18634c780eb9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1317 microversion: 2.1 time: 0.878531 Jul 19 22:47:25.622507 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2088/4218] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:24 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1317 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:25.970495 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8a0e1c29-b327-4e27-890d-5ad7a71a9573 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1315897686", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": "none"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:47:26.073902 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-8a0e1c29-b327-4e27-890d-5ad7a71a9573 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:47:26.075319 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-8a0e1c29-b327-4e27-890d-5ad7a71a9573 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:47:26.075962 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-8a0e1c29-b327-4e27-890d-5ad7a71a9573 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:47:26.076531 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-8a0e1c29-b327-4e27-890d-5ad7a71a9573 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:47:26.077108 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-8a0e1c29-b327-4e27-890d-5ad7a71a9573 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:47:26.091037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a0e1c29-b327-4e27-890d-5ad7a71a9573 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:26.091832 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a0e1c29-b327-4e27-890d-5ad7a71a9573 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:26.094167 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a0e1c29-b327-4e27-890d-5ad7a71a9573 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:26.099413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a0e1c29-b327-4e27-890d-5ad7a71a9573 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:26.142303 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-8a0e1c29-b327-4e27-890d-5ad7a71a9573 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Getting quotas for project 1f3ae82c052344b4ad5027df166bc045. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:47:26.163896 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-8a0e1c29-b327-4e27-890d-5ad7a71a9573 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Getting quotas for user 51b35f7f096843ce9e69f9946c1fdf7a and project 1f3ae82c052344b4ad5027df166bc045. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:47:26.200135 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8a0e1c29-b327-4e27-890d-5ad7a71a9573 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:47:26.203325 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8a0e1c29-b327-4e27-890d-5ad7a71a9573 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:47:26.313217 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8a0e1c29-b327-4e27-890d-5ad7a71a9573 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.689447 Jul 19 22:47:26.315823 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2089/4219] 10.222.0.25 () {62 vars in 1187 bytes} [Tue Jul 19 22:47:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 22:47:26.333295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b0ead5c7-a349-44ad-b92e-ef2b549714a5 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:26.334267 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b0ead5c7-a349-44ad-b92e-ef2b549714a5 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:26.574761 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b0ead5c7-a349-44ad-b92e-ef2b549714a5 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:26.586115 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b0ead5c7-a349-44ad-b92e-ef2b549714a5 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:26.588209 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b0ead5c7-a349-44ad-b92e-ef2b549714a5 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:26.592292 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b0ead5c7-a349-44ad-b92e-ef2b549714a5 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1278 microversion: 2.57 time: 0.265942 Jul 19 22:47:26.597901 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2090/4220] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:26 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1278 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:26.631343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-aba7da5d-3ba9-4687-b38e-da3da9b290e8 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:26.632410 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-aba7da5d-3ba9-4687-b38e-da3da9b290e8 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:26.642859 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-a86db01f-b5c8-446b-855c-d9fb09b2dcd9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Updating instance_info_cache with network_info: [] {{(pid=119338) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 22:47:26.653115 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aba7da5d-3ba9-4687-b38e-da3da9b290e8 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:26.656585 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aba7da5d-3ba9-4687-b38e-da3da9b290e8 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:26.658340 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aba7da5d-3ba9-4687-b38e-da3da9b290e8 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:26.660759 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aba7da5d-3ba9-4687-b38e-da3da9b290e8 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:27.007835 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a86db01f-b5c8-446b-855c-d9fb09b2dcd9 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "DELETE /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 204 len: 0 microversion: 2.1 time: 4.185281 Jul 19 22:47:27.009085 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2131/4221] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:47:22 2022] DELETE /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 0 bytes in 4188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:47:27.016358 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-a20c5b88-a659-4c9f-8f0f-e9e1fb9c405d req-af29008c-dacb-447c-9cf8-8d9b426451a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78349902-af4b-44e1-a79e-da1d1217b328", "name": "network-vif-deleted", "tag": "8ce296ac-f78e-4559-bda4-3615294b6700"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:47:27.037553 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-a20c5b88-a659-4c9f-8f0f-e9e1fb9c405d req-af29008c-dacb-447c-9cf8-8d9b426451a4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:27.038258 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-a20c5b88-a659-4c9f-8f0f-e9e1fb9c405d req-af29008c-dacb-447c-9cf8-8d9b426451a4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:27.061555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.compute.server_external_events [req-a20c5b88-a659-4c9f-8f0f-e9e1fb9c405d req-af29008c-dacb-447c-9cf8-8d9b426451a4 service nova] Unable to find a host for instance 78349902-af4b-44e1-a79e-da1d1217b328. Dropping event network-vif-deleted {{(pid=119338) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 19 22:47:27.065354 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-a20c5b88-a659-4c9f-8f0f-e9e1fb9c405d req-af29008c-dacb-447c-9cf8-8d9b426451a4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.054943 Jul 19 22:47:27.069558 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2132/4222] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 60 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 19 22:47:27.078558 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8581aa31-ca05-4545-9a6e-d72aa8c0c11b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:27.080035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8581aa31-ca05-4545-9a6e-d72aa8c0c11b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 78349902-af4b-44e1-a79e-da1d1217b328] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:27.104902 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8581aa31-ca05-4545-9a6e-d72aa8c0c11b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:27.106067 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8581aa31-ca05-4545-9a6e-d72aa8c0c11b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:27.107670 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8581aa31-ca05-4545-9a6e-d72aa8c0c11b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:27.108716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8581aa31-ca05-4545-9a6e-d72aa8c0c11b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:27.141871 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-8581aa31-ca05-4545-9a6e-d72aa8c0c11b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] HTTP exception thrown: Instance 78349902-af4b-44e1-a79e-da1d1217b328 could not be found. Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8581aa31-ca05-4545-9a6e-d72aa8c0c11b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Request method failure captured: Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 HTTP/1.1 Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zH_7tuIYMYFMfF-dNsTqgLOBouujgTx1g47lvb5iq5eveGanI52PRfRNIt8J7p9YtbR2-UcbK9_91u9n4LJtsBL7XHFFF4JD0Ndl-oibDwWUv87SVm5nTpiYOOZL55LCz9q329mnnDxSfKms2aIJ75_j7RvsBiNNB6M3Nswlz42WAY Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 038e4783159e41e3b2cb88df1f8f4a97 Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerActionsTestJSON-1967329631 Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_038e4783159e41e3b2cb88df1f8f4a97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/038e4783159e41e3b2cb88df1f8f4a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/038e4783159e41e3b2cb88df1f8f4a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/038e4783159e41e3b2cb88df1f8f4a97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerActionsTestJSON-1967329631 Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 038e4783159e41e3b2cb88df1f8f4a97 Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerActionsTestJSON-1967329631 Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerActionsTestJSON-1967329631-project Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1f2613ad65b047e8b9a68907406d1874 Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerActionsTestJSON-1967329631-project Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 78349902-af4b-44e1-a79e-da1d1217b328 could not be found. Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '78349902-af4b-44e1-a79e-da1d1217b328'} Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78349902-af4b-44e1-a79e-da1d1217b328 could not be found. Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78349902-af4b-44e1-a79e-da1d1217b328 could not be found. Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:27.144353 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:27.149047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:27.149047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:27.149047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:27.149047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:27.149047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:27.149047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78349902-af4b-44e1-a79e-da1d1217b328 could not be found. Jul 19 22:47:27.149047 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:27.151002 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8581aa31-ca05-4545-9a6e-d72aa8c0c11b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Returning 404 to user: Instance 78349902-af4b-44e1-a79e-da1d1217b328 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:27.152074 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8581aa31-ca05-4545-9a6e-d72aa8c0c11b tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328" status: 404 len: 111 microversion: 2.1 time: 0.081302 Jul 19 22:47:27.153195 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2133/4223] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:27 2022] GET /compute/v2.1/servers/78349902-af4b-44e1-a79e-da1d1217b328 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:47:27.165494 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e9caaff2-3dae-4b21-8324-31f08ea8dec6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:27.167250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e9caaff2-3dae-4b21-8324-31f08ea8dec6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:27.182236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9caaff2-3dae-4b21-8324-31f08ea8dec6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:27.184012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9caaff2-3dae-4b21-8324-31f08ea8dec6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:27.185948 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9caaff2-3dae-4b21-8324-31f08ea8dec6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:27.188051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9caaff2-3dae-4b21-8324-31f08ea8dec6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:27.256675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e9caaff2-3dae-4b21-8324-31f08ea8dec6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:47:27.354895 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-aba7da5d-3ba9-4687-b38e-da3da9b290e8 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:27.391374 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-aba7da5d-3ba9-4687-b38e-da3da9b290e8 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1317 microversion: 2.1 time: 0.762302 Jul 19 22:47:27.399148 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2091/4224] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:26 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1317 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:27.498392 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e9caaff2-3dae-4b21-8324-31f08ea8dec6 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9" status: 204 len: 0 microversion: 2.1 time: 0.334794 Jul 19 22:47:27.500905 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2134/4225] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:47:27 2022] DELETE /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:47:27.510201 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a93ffa6d-7bf6-4b33-9454-c6eb8f501157 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:27.511403 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a93ffa6d-7bf6-4b33-9454-c6eb8f501157 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:27.524713 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a93ffa6d-7bf6-4b33-9454-c6eb8f501157 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:27.528256 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a93ffa6d-7bf6-4b33-9454-c6eb8f501157 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:27.534161 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a93ffa6d-7bf6-4b33-9454-c6eb8f501157 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:27.535314 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a93ffa6d-7bf6-4b33-9454-c6eb8f501157 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:27.623041 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-00ae7234-3eae-4180-8e90-67c95ade0f45 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:27.624335 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-00ae7234-3eae-4180-8e90-67c95ade0f45 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:27.633321 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00ae7234-3eae-4180-8e90-67c95ade0f45 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:27.634072 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00ae7234-3eae-4180-8e90-67c95ade0f45 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:27.638039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00ae7234-3eae-4180-8e90-67c95ade0f45 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:27.638642 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00ae7234-3eae-4180-8e90-67c95ade0f45 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:27.777252 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a93ffa6d-7bf6-4b33-9454-c6eb8f501157 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:27.794224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-00ae7234-3eae-4180-8e90-67c95ade0f45 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:27.808138 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a93ffa6d-7bf6-4b33-9454-c6eb8f501157 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9" status: 200 len: 1466 microversion: 2.1 time: 0.302657 Jul 19 22:47:27.812022 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-00ae7234-3eae-4180-8e90-67c95ade0f45 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:27.814058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-00ae7234-3eae-4180-8e90-67c95ade0f45 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:27.815460 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2092/4226] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:27 2022] GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 => generated 1466 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:27.821281 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-00ae7234-3eae-4180-8e90-67c95ade0f45 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1274 microversion: 2.57 time: 0.202951 Jul 19 22:47:27.821966 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2135/4227] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:27 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1274 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:28.419386 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bead751d-025b-44b7-b404-0824c636d08b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:28.420997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bead751d-025b-44b7-b404-0824c636d08b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:28.448378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bead751d-025b-44b7-b404-0824c636d08b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:28.449131 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bead751d-025b-44b7-b404-0824c636d08b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:28.450805 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bead751d-025b-44b7-b404-0824c636d08b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:28.453540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bead751d-025b-44b7-b404-0824c636d08b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:28.801339 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bead751d-025b-44b7-b404-0824c636d08b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:28.810715 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bead751d-025b-44b7-b404-0824c636d08b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1317 microversion: 2.1 time: 0.399016 Jul 19 22:47:28.838954 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a7ab7707-be00-4f2a-8225-8e0e7ab62f7f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:28.850511 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a7ab7707-be00-4f2a-8225-8e0e7ab62f7f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:28.852425 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2093/4228] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:28 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1317 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:28.861907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-57310547-8374-4c4c-9265-170410744670 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:28.868888 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a7ab7707-be00-4f2a-8225-8e0e7ab62f7f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:28.869956 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-57310547-8374-4c4c-9265-170410744670 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:28.870463 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a7ab7707-be00-4f2a-8225-8e0e7ab62f7f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:28.872699 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a7ab7707-be00-4f2a-8225-8e0e7ab62f7f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:28.875634 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a7ab7707-be00-4f2a-8225-8e0e7ab62f7f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:28.884088 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57310547-8374-4c4c-9265-170410744670 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:28.886765 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57310547-8374-4c4c-9265-170410744670 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:28.888159 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57310547-8374-4c4c-9265-170410744670 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:28.899291 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57310547-8374-4c4c-9265-170410744670 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:29.347953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a7ab7707-be00-4f2a-8225-8e0e7ab62f7f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:29.369783 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a7ab7707-be00-4f2a-8225-8e0e7ab62f7f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9" status: 200 len: 1466 microversion: 2.1 time: 0.536401 Jul 19 22:47:29.370803 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2136/4229] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:28 2022] GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 => generated 1466 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:29.385681 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-8ae52353-e206-4d1c-94d9-e9e26bb02942 req-fa2940d6-f15c-4ef6-8d09-be8ac713908a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb0d2fe2-80ea-4fc2-a157-f7341877997c", "tag": "2cb0e711-7270-4e34-9663-e6877d3106eb"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:47:29.389770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-57310547-8374-4c4c-9265-170410744670 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:29.422501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-57310547-8374-4c4c-9265-170410744670 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:29.426248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-57310547-8374-4c4c-9265-170410744670 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:29.428301 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-57310547-8374-4c4c-9265-170410744670 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1336 microversion: 2.57 time: 0.572129 Jul 19 22:47:29.442412 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2094/4230] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:28 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1336 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:29.448707 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-8ae52353-e206-4d1c-94d9-e9e26bb02942 req-fa2940d6-f15c-4ef6-8d09-be8ac713908a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:29.449818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-8ae52353-e206-4d1c-94d9-e9e26bb02942 req-fa2940d6-f15c-4ef6-8d09-be8ac713908a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:29.498715 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-8ae52353-e206-4d1c-94d9-e9e26bb02942 req-fa2940d6-f15c-4ef6-8d09-be8ac713908a service nova] Creating event network-changed:2cb0e711-7270-4e34-9663-e6877d3106eb for instance fb0d2fe2-80ea-4fc2-a157-f7341877997c on n-h1-847009-3 Jul 19 22:47:29.518096 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-8ae52353-e206-4d1c-94d9-e9e26bb02942 req-fa2940d6-f15c-4ef6-8d09-be8ac713908a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144356 Jul 19 22:47:29.523326 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2137/4231] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:47:29.841640 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-875d65ca-aeaa-4f9c-ba26-1665c3c60911 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:29.842214 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-875d65ca-aeaa-4f9c-ba26-1665c3c60911 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:29.862516 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-875d65ca-aeaa-4f9c-ba26-1665c3c60911 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:29.862965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-875d65ca-aeaa-4f9c-ba26-1665c3c60911 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:29.869044 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-875d65ca-aeaa-4f9c-ba26-1665c3c60911 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:29.872098 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-875d65ca-aeaa-4f9c-ba26-1665c3c60911 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:30.370960 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-875d65ca-aeaa-4f9c-ba26-1665c3c60911 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:30.384569 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-875d65ca-aeaa-4f9c-ba26-1665c3c60911 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1317 microversion: 2.1 time: 0.546903 Jul 19 22:47:30.399545 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2095/4232] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:29 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1317 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:30.401904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d3e7805d-b3c4-415b-9959-02cb8e5461ec tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:30.403789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d3e7805d-b3c4-415b-9959-02cb8e5461ec tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:30.411942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:47:30.419017 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:47:30.436942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3e7805d-b3c4-415b-9959-02cb8e5461ec tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:30.437584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3e7805d-b3c4-415b-9959-02cb8e5461ec tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:30.439816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3e7805d-b3c4-415b-9959-02cb8e5461ec tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:30.440651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3e7805d-b3c4-415b-9959-02cb8e5461ec tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:30.459988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6e347242-0e8f-4dae-a49b-03f4ba43303a tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:30.466304 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6e347242-0e8f-4dae-a49b-03f4ba43303a tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:30.487064 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e347242-0e8f-4dae-a49b-03f4ba43303a tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:30.487632 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e347242-0e8f-4dae-a49b-03f4ba43303a tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:30.488489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e347242-0e8f-4dae-a49b-03f4ba43303a tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:30.488939 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e347242-0e8f-4dae-a49b-03f4ba43303a tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:30.654766 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6e347242-0e8f-4dae-a49b-03f4ba43303a tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:30.671652 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6e347242-0e8f-4dae-a49b-03f4ba43303a tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:30.683737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6e347242-0e8f-4dae-a49b-03f4ba43303a tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:30.685559 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6e347242-0e8f-4dae-a49b-03f4ba43303a tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1336 microversion: 2.57 time: 0.233603 Jul 19 22:47:30.695750 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2096/4233] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:30 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1336 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:30.818315 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d3e7805d-b3c4-415b-9959-02cb8e5461ec tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:30.863006 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d3e7805d-b3c4-415b-9959-02cb8e5461ec tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9" status: 200 len: 1466 microversion: 2.1 time: 0.476599 Jul 19 22:47:30.863940 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2138/4234] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:30 2022] GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 => generated 1466 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:31.408172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a6c18624-ea99-44bc-a78b-29f64e4debd7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:31.409218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a6c18624-ea99-44bc-a78b-29f64e4debd7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:31.424959 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6c18624-ea99-44bc-a78b-29f64e4debd7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:31.427584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6c18624-ea99-44bc-a78b-29f64e4debd7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:31.428606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6c18624-ea99-44bc-a78b-29f64e4debd7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:31.434649 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6c18624-ea99-44bc-a78b-29f64e4debd7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:31.605552 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-57126c8f-f3dd-43a4-94ac-f37887d3296f req-d1e2448b-8587-4b98-91d5-cf56468728f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9", "name": "network-vif-deleted", "tag": "b9484698-cfca-4fb0-a643-cbdc6e37402e"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:47:31.617931 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-57126c8f-f3dd-43a4-94ac-f37887d3296f req-d1e2448b-8587-4b98-91d5-cf56468728f3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:31.623910 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-57126c8f-f3dd-43a4-94ac-f37887d3296f req-d1e2448b-8587-4b98-91d5-cf56468728f3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:31.676828 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-57126c8f-f3dd-43a4-94ac-f37887d3296f req-d1e2448b-8587-4b98-91d5-cf56468728f3 service nova] Creating event network-vif-deleted:b9484698-cfca-4fb0-a643-cbdc6e37402e for instance 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 on n-h1-847009-3 Jul 19 22:47:31.697630 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-57126c8f-f3dd-43a4-94ac-f37887d3296f req-d1e2448b-8587-4b98-91d5-cf56468728f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086910 Jul 19 22:47:31.699699 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2139/4235] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:47:31.773709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a6c18624-ea99-44bc-a78b-29f64e4debd7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:31.789678 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a6c18624-ea99-44bc-a78b-29f64e4debd7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1317 microversion: 2.1 time: 0.385741 Jul 19 22:47:31.790545 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2097/4236] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:31 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1317 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:31.822719 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0d208ff3-5de6-4c79-8779-fa815ef5fe62 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:31.842576 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0d208ff3-5de6-4c79-8779-fa815ef5fe62 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:31.870267 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d208ff3-5de6-4c79-8779-fa815ef5fe62 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:31.870955 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d208ff3-5de6-4c79-8779-fa815ef5fe62 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:31.872183 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d208ff3-5de6-4c79-8779-fa815ef5fe62 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:31.872866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d208ff3-5de6-4c79-8779-fa815ef5fe62 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:31.973847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d817a84a-9a6e-4074-b60e-08e52b42b084 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1892702774", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "d3aa3aba-81c6-4b05-979c-36307de65294"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:47:32.101678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-d817a84a-9a6e-4074-b60e-08e52b42b084 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] validate_networks() for [('d3aa3aba-81c6-4b05-979c-36307de65294', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:47:32.153275 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0d208ff3-5de6-4c79-8779-fa815ef5fe62 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:32.180843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0d208ff3-5de6-4c79-8779-fa815ef5fe62 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:32.187091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0d208ff3-5de6-4c79-8779-fa815ef5fe62 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:32.191662 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0d208ff3-5de6-4c79-8779-fa815ef5fe62 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1336 microversion: 2.57 time: 0.384651 Jul 19 22:47:32.208106 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2098/4237] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:31 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1336 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:32.214584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4131879a-0861-4e04-b335-21805bcf10ae tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:32.216159 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4131879a-0861-4e04-b335-21805bcf10ae tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:32.237370 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4131879a-0861-4e04-b335-21805bcf10ae tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:32.239914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4131879a-0861-4e04-b335-21805bcf10ae tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:32.243225 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4131879a-0861-4e04-b335-21805bcf10ae tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:32.246369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4131879a-0861-4e04-b335-21805bcf10ae tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:32.358760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4131879a-0861-4e04-b335-21805bcf10ae tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:32.359258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4131879a-0861-4e04-b335-21805bcf10ae tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:32.366226 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-4131879a-0861-4e04-b335-21805bcf10ae tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lazy-loading 'fault' on Instance uuid 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:47:32.507471 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4131879a-0861-4e04-b335-21805bcf10ae tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:32.554880 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4131879a-0861-4e04-b335-21805bcf10ae tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9" status: 200 len: 1305 microversion: 2.1 time: 0.341123 Jul 19 22:47:32.559320 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2099/4238] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:32 2022] GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 => generated 1305 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:32.817219 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b29ecc87-dc20-4b99-8e9f-c94b039482c6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:32.818929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b29ecc87-dc20-4b99-8e9f-c94b039482c6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:32.831682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:47:32.850606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b29ecc87-dc20-4b99-8e9f-c94b039482c6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:32.854213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b29ecc87-dc20-4b99-8e9f-c94b039482c6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:32.855728 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b29ecc87-dc20-4b99-8e9f-c94b039482c6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:32.858172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b29ecc87-dc20-4b99-8e9f-c94b039482c6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:33.658264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b29ecc87-dc20-4b99-8e9f-c94b039482c6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:33.676079 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b29ecc87-dc20-4b99-8e9f-c94b039482c6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1317 microversion: 2.1 time: 0.866036 Jul 19 22:47:33.676848 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2100/4239] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:32 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1317 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:47:33.697867 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8f0c28ef-26c3-4e14-9b28-2f7109e72b18 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:33.698984 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8f0c28ef-26c3-4e14-9b28-2f7109e72b18 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:33.748254 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f0c28ef-26c3-4e14-9b28-2f7109e72b18 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:33.749305 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f0c28ef-26c3-4e14-9b28-2f7109e72b18 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:33.751659 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f0c28ef-26c3-4e14-9b28-2f7109e72b18 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:33.758424 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f0c28ef-26c3-4e14-9b28-2f7109e72b18 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:34.303444 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-d817a84a-9a6e-4074-b60e-08e52b42b084 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:47:34.304478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-d817a84a-9a6e-4074-b60e-08e52b42b084 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:47:34.305434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-d817a84a-9a6e-4074-b60e-08e52b42b084 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:47:34.306260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-d817a84a-9a6e-4074-b60e-08e52b42b084 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:47:34.307125 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-d817a84a-9a6e-4074-b60e-08e52b42b084 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:47:34.347959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d817a84a-9a6e-4074-b60e-08e52b42b084 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:34.347959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d817a84a-9a6e-4074-b60e-08e52b42b084 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:34.349389 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d817a84a-9a6e-4074-b60e-08e52b42b084 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:34.354239 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d817a84a-9a6e-4074-b60e-08e52b42b084 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:34.417129 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-d817a84a-9a6e-4074-b60e-08e52b42b084 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Getting quotas for project a14d82cb4d8a4c1084c5f43d954d83f1. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:47:34.431373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-d817a84a-9a6e-4074-b60e-08e52b42b084 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Getting quotas for user 5cce459ab0f14f39b806ab2fb8e90f83 and project a14d82cb4d8a4c1084c5f43d954d83f1. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:47:34.464560 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d817a84a-9a6e-4074-b60e-08e52b42b084 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:47:34.470102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d817a84a-9a6e-4074-b60e-08e52b42b084 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:47:34.539248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8f0c28ef-26c3-4e14-9b28-2f7109e72b18 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:34.565984 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8f0c28ef-26c3-4e14-9b28-2f7109e72b18 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:34.567510 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8f0c28ef-26c3-4e14-9b28-2f7109e72b18 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:34.569784 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8f0c28ef-26c3-4e14-9b28-2f7109e72b18 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1357 microversion: 2.57 time: 0.878698 Jul 19 22:47:34.599743 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2101/4240] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:33 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1357 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:34.605789 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2e211a5c-8602-4808-8fb9-139fbeaab661 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:34.606388 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2e211a5c-8602-4808-8fb9-139fbeaab661 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:34.615717 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d817a84a-9a6e-4074-b60e-08e52b42b084 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.911460 Jul 19 22:47:34.624024 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2140/4241] 10.222.0.25 () {62 vars in 1187 bytes} [Tue Jul 19 22:47:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2917 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 22:47:34.624344 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e211a5c-8602-4808-8fb9-139fbeaab661 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:34.624344 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e211a5c-8602-4808-8fb9-139fbeaab661 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:34.624344 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e211a5c-8602-4808-8fb9-139fbeaab661 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:34.624344 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e211a5c-8602-4808-8fb9-139fbeaab661 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:34.625175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fe121e7a-18b2-4914-861d-519f75463602 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b84e7a73-ea9c-473a-b09b-26aad15f7870"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:47:34.630036 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fe121e7a-18b2-4914-861d-519f75463602 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:34.648926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe121e7a-18b2-4914-861d-519f75463602 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:34.649389 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe121e7a-18b2-4914-861d-519f75463602 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:34.650178 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe121e7a-18b2-4914-861d-519f75463602 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:34.650626 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe121e7a-18b2-4914-861d-519f75463602 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:34.678925 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-2e211a5c-8602-4808-8fb9-139fbeaab661 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] HTTP exception thrown: Instance 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 could not be found. Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2e211a5c-8602-4808-8fb9-139fbeaab661 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Request method failure captured: Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 HTTP/1.1 Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zH_7tuIYMYFMfF-dNsTqgLOBouujgTx1g47lvb5iq5eveGanI52PRfRNIt8J7p9YtbR2-UcbK9_91u9n4LJtsBL7XHFFF4JD0Ndl-oibDwWUv87SVm5nTpiYOOZL55LCz9q329mnnDxSfKms2aIJ75_j7RvsBiNNB6M3Nswlz42WAY Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 038e4783159e41e3b2cb88df1f8f4a97 Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerActionsTestJSON-1967329631 Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_038e4783159e41e3b2cb88df1f8f4a97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/038e4783159e41e3b2cb88df1f8f4a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/038e4783159e41e3b2cb88df1f8f4a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/038e4783159e41e3b2cb88df1f8f4a97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerActionsTestJSON-1967329631 Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 038e4783159e41e3b2cb88df1f8f4a97 Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerActionsTestJSON-1967329631 Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerActionsTestJSON-1967329631-project Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1f2613ad65b047e8b9a68907406d1874 Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerActionsTestJSON-1967329631-project Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 could not be found. Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9'} Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 could not be found. Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 could not be found. Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:34.682090 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:34.691700 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:34.691700 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:34.691700 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:34.691700 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:34.691700 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:34.691700 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 could not be found. Jul 19 22:47:34.691700 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:34.691700 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2e211a5c-8602-4808-8fb9-139fbeaab661 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Returning 404 to user: Instance 7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:34.691700 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2e211a5c-8602-4808-8fb9-139fbeaab661 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9" status: 404 len: 111 microversion: 2.1 time: 0.087353 Jul 19 22:47:34.691700 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2102/4242] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:34 2022] GET /compute/v2.1/servers/7d0fef7b-cbc1-49ad-a40c-ff331ab06cd9 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:47:34.702127 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-21b60019-e924-4bd4-99e5-49fb6f97e5c7 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:47:34.704088 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-21b60019-e924-4bd4-99e5-49fb6f97e5c7 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:34.725516 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-21b60019-e924-4bd4-99e5-49fb6f97e5c7 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:34.725516 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-21b60019-e924-4bd4-99e5-49fb6f97e5c7 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:34.726387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-21b60019-e924-4bd4-99e5-49fb6f97e5c7 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:34.726739 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-21b60019-e924-4bd4-99e5-49fb6f97e5c7 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:34.942985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-21b60019-e924-4bd4-99e5-49fb6f97e5c7 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:47:34.943620 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-21b60019-e924-4bd4-99e5-49fb6f97e5c7 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:47:34.944137 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-21b60019-e924-4bd4-99e5-49fb6f97e5c7 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:47:34.944550 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-21b60019-e924-4bd4-99e5-49fb6f97e5c7 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:47:34.944992 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-21b60019-e924-4bd4-99e5-49fb6f97e5c7 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:47:35.062869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-21b60019-e924-4bd4-99e5-49fb6f97e5c7 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:35.071616 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-21b60019-e924-4bd4-99e5-49fb6f97e5c7 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:35.073373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-21b60019-e924-4bd4-99e5-49fb6f97e5c7 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:35.074585 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-21b60019-e924-4bd4-99e5-49fb6f97e5c7 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:35.075309 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-21b60019-e924-4bd4-99e5-49fb6f97e5c7 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:35.129470 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-21b60019-e924-4bd4-99e5-49fb6f97e5c7 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "POST /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419/action" status: 202 len: 1138 microversion: 2.57 time: 0.438019 Jul 19 22:47:35.144459 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2103/4243] 10.222.0.25 () {62 vars in 1319 bytes} [Tue Jul 19 22:47:34 2022] POST /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419/action => generated 1138 bytes in 453 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 19 22:47:35.150251 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5700db7e-d2a2-4a00-a90f-da6413c3a393 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:35.151100 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5700db7e-d2a2-4a00-a90f-da6413c3a393 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:35.242788 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fe121e7a-18b2-4914-861d-519f75463602 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "POST /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.622921 Jul 19 22:47:35.244512 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2141/4244] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 19 22:47:34 2022] POST /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments => generated 194 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:47:35.281491 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0b284eb8-7e67-42b1-9dfc-334a9045b371 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:35.286765 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0b284eb8-7e67-42b1-9dfc-334a9045b371 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:35.293771 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5700db7e-d2a2-4a00-a90f-da6413c3a393 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:35.306752 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b284eb8-7e67-42b1-9dfc-334a9045b371 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:35.315046 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b284eb8-7e67-42b1-9dfc-334a9045b371 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:35.316098 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b284eb8-7e67-42b1-9dfc-334a9045b371 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:35.316586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b284eb8-7e67-42b1-9dfc-334a9045b371 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:35.338795 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5700db7e-d2a2-4a00-a90f-da6413c3a393 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:35.346558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5700db7e-d2a2-4a00-a90f-da6413c3a393 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:35.358955 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5700db7e-d2a2-4a00-a90f-da6413c3a393 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75" status: 200 len: 1262 microversion: 2.26 time: 0.213042 Jul 19 22:47:35.359603 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2104/4245] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:35 2022] GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75 => generated 1262 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:35.375270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8c7d1945-c0c0-4200-8ebd-e837f4f22216 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:35.376474 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8c7d1945-c0c0-4200-8ebd-e837f4f22216 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:35.388086 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c7d1945-c0c0-4200-8ebd-e837f4f22216 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:35.388549 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c7d1945-c0c0-4200-8ebd-e837f4f22216 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:35.389339 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c7d1945-c0c0-4200-8ebd-e837f4f22216 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:35.389779 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c7d1945-c0c0-4200-8ebd-e837f4f22216 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:35.429919 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:47:35.459993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8c7d1945-c0c0-4200-8ebd-e837f4f22216 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:47:35.711302 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8c7d1945-c0c0-4200-8ebd-e837f4f22216 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "DELETE /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3" status: 204 len: 0 microversion: 2.1 time: 0.345238 Jul 19 22:47:35.712989 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2105/4246] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:47:35 2022] DELETE /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:47:35.784156 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0b284eb8-7e67-42b1-9dfc-334a9045b371 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:35.804946 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0b284eb8-7e67-42b1-9dfc-334a9045b371 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1317 microversion: 2.1 time: 0.558229 Jul 19 22:47:35.806107 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2142/4247] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:35 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1317 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:35.812709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6a6b8835-7d18-4061-8df2-8ee9f360f264 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:35.814208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6a6b8835-7d18-4061-8df2-8ee9f360f264 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:35.856428 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a6b8835-7d18-4061-8df2-8ee9f360f264 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:35.863193 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a6b8835-7d18-4061-8df2-8ee9f360f264 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:35.866677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a6b8835-7d18-4061-8df2-8ee9f360f264 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:35.867821 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6a6b8835-7d18-4061-8df2-8ee9f360f264 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:35.937373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=18,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:47:36.065187 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6a6b8835-7d18-4061-8df2-8ee9f360f264 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:36.094444 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6a6b8835-7d18-4061-8df2-8ee9f360f264 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:36.096512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6a6b8835-7d18-4061-8df2-8ee9f360f264 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:36.099405 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6a6b8835-7d18-4061-8df2-8ee9f360f264 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.292068 Jul 19 22:47:36.100176 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2143/4248] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:35 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:36.105868 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7402a644-739a-4db2-83f9-9238ed13a778 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:36.106691 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7402a644-739a-4db2-83f9-9238ed13a778 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:36.117826 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=4 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:47:36.122620 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7402a644-739a-4db2-83f9-9238ed13a778 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:36.126671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7402a644-739a-4db2-83f9-9238ed13a778 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:36.128087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7402a644-739a-4db2-83f9-9238ed13a778 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:36.128784 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7402a644-739a-4db2-83f9-9238ed13a778 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:36.187182 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2e132161-f33d-44c0-a1c4-5b6e3aa0692f tempest-ExtensionsTest-1144343301 tempest-ExtensionsTest-1144343301-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:36.189352 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2e132161-f33d-44c0-a1c4-5b6e3aa0692f tempest-ExtensionsTest-1144343301 tempest-ExtensionsTest-1144343301-project] 10.222.0.25 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.473355 Jul 19 22:47:36.190230 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2106/4249] 10.222.0.25 () {58 vars in 1169 bytes} [Tue Jul 19 22:47:35 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:47:36.199468 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dd9fb09e-d70a-4ae9-a286-2dae1766ea15 tempest-ExtensionsTest-1144343301 tempest-ExtensionsTest-1144343301-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:36.202093 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dd9fb09e-d70a-4ae9-a286-2dae1766ea15 tempest-ExtensionsTest-1144343301 tempest-ExtensionsTest-1144343301-project] 10.222.0.25 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006821 Jul 19 22:47:36.203313 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2107/4250] 10.222.0.25 () {58 vars in 1133 bytes} [Tue Jul 19 22:47:36 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 22:47:36.397598 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b562ff76-6542-458a-9201-d62c7c3cbfdb tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:36.402285 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b562ff76-6542-458a-9201-d62c7c3cbfdb tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:36.428732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b562ff76-6542-458a-9201-d62c7c3cbfdb tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:36.429193 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b562ff76-6542-458a-9201-d62c7c3cbfdb tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:36.430629 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b562ff76-6542-458a-9201-d62c7c3cbfdb tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:36.431330 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b562ff76-6542-458a-9201-d62c7c3cbfdb tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:37.200965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b562ff76-6542-458a-9201-d62c7c3cbfdb tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:37.232055 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b562ff76-6542-458a-9201-d62c7c3cbfdb tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:37.235869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b562ff76-6542-458a-9201-d62c7c3cbfdb tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:37.237508 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b562ff76-6542-458a-9201-d62c7c3cbfdb tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75" status: 200 len: 1258 microversion: 2.26 time: 0.850454 Jul 19 22:47:37.257874 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2108/4251] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:36 2022] GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75 => generated 1258 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:47:37.274627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c3c45a97-5a05-4828-9c25-422dced0e854 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:37.276260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c3c45a97-5a05-4828-9c25-422dced0e854 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:37.285685 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c3c45a97-5a05-4828-9c25-422dced0e854 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:37.304905 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c3c45a97-5a05-4828-9c25-422dced0e854 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:37.309125 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c3c45a97-5a05-4828-9c25-422dced0e854 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:37.310773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c3c45a97-5a05-4828-9c25-422dced0e854 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:37.824677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7402a644-739a-4db2-83f9-9238ed13a778 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:37.836806 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7402a644-739a-4db2-83f9-9238ed13a778 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3" status: 200 len: 1508 microversion: 2.1 time: 1.732975 Jul 19 22:47:37.839503 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2144/4252] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:36 2022] GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3 => generated 1508 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:37.850069 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d5f88e52-cd09-4e39-9c65-9ec5fbe0a423 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:37.850909 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d5f88e52-cd09-4e39-9c65-9ec5fbe0a423 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:37.874930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5f88e52-cd09-4e39-9c65-9ec5fbe0a423 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:37.875432 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5f88e52-cd09-4e39-9c65-9ec5fbe0a423 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:37.876446 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5f88e52-cd09-4e39-9c65-9ec5fbe0a423 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:37.876957 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5f88e52-cd09-4e39-9c65-9ec5fbe0a423 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:38.129375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d5f88e52-cd09-4e39-9c65-9ec5fbe0a423 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:38.168064 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d5f88e52-cd09-4e39-9c65-9ec5fbe0a423 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:38.176276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d5f88e52-cd09-4e39-9c65-9ec5fbe0a423 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:38.179329 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c3c45a97-5a05-4828-9c25-422dced0e854 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:38.180305 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d5f88e52-cd09-4e39-9c65-9ec5fbe0a423 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.333178 Jul 19 22:47:38.198990 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2145/4253] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:37 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:38.201848 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c3c45a97-5a05-4828-9c25-422dced0e854 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1317 microversion: 2.1 time: 0.942521 Jul 19 22:47:38.203553 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2109/4254] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:37 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1317 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:38.279417 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d6137bc2-6d4d-4683-8c60-bbae1a874c0f tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:38.284047 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d6137bc2-6d4d-4683-8c60-bbae1a874c0f tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:38.305881 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d6137bc2-6d4d-4683-8c60-bbae1a874c0f tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:38.310656 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d6137bc2-6d4d-4683-8c60-bbae1a874c0f tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:38.312718 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d6137bc2-6d4d-4683-8c60-bbae1a874c0f tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:38.316178 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d6137bc2-6d4d-4683-8c60-bbae1a874c0f tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:38.458550 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-dc9b9afc-ecc6-43d8-b072-cf69018f3749 req-bdfc8377-ae16-4efd-a902-219e61e628ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb0d2fe2-80ea-4fc2-a157-f7341877997c", "name": "network-vif-plugged", "status": "completed", "tag": "2cb0e711-7270-4e34-9663-e6877d3106eb"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:47:38.479601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-dc9b9afc-ecc6-43d8-b072-cf69018f3749 req-bdfc8377-ae16-4efd-a902-219e61e628ff service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:38.480820 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-dc9b9afc-ecc6-43d8-b072-cf69018f3749 req-bdfc8377-ae16-4efd-a902-219e61e628ff service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:38.512917 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-dc9b9afc-ecc6-43d8-b072-cf69018f3749 req-bdfc8377-ae16-4efd-a902-219e61e628ff service nova] Creating event network-vif-plugged:2cb0e711-7270-4e34-9663-e6877d3106eb for instance fb0d2fe2-80ea-4fc2-a157-f7341877997c on n-h1-847009-3 Jul 19 22:47:38.524583 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-dc9b9afc-ecc6-43d8-b072-cf69018f3749 req-bdfc8377-ae16-4efd-a902-219e61e628ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070527 Jul 19 22:47:38.529500 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2110/4255] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:47:38.557977 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d6137bc2-6d4d-4683-8c60-bbae1a874c0f tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:38.572565 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d6137bc2-6d4d-4683-8c60-bbae1a874c0f tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:38.577216 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d6137bc2-6d4d-4683-8c60-bbae1a874c0f tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:38.582385 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d6137bc2-6d4d-4683-8c60-bbae1a874c0f tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75" status: 200 len: 1320 microversion: 2.26 time: 0.311679 Jul 19 22:47:38.597930 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2146/4256] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:38 2022] GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75 => generated 1320 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:38.874630 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fca8832b-05d4-4e41-82d6-4c83e011e7d0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:38.875932 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fca8832b-05d4-4e41-82d6-4c83e011e7d0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:38.909667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fca8832b-05d4-4e41-82d6-4c83e011e7d0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:38.910301 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fca8832b-05d4-4e41-82d6-4c83e011e7d0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:38.911260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fca8832b-05d4-4e41-82d6-4c83e011e7d0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:38.911718 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fca8832b-05d4-4e41-82d6-4c83e011e7d0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:39.029167 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-8a2e52d1-2486-463d-87a4-d9c6e01ae890 req-bac3a6ce-31e5-4858-9522-7900e3560bac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "087dbc3c-3e5c-4c33-87fc-978e640ae6e3", "name": "network-vif-deleted", "tag": "47dba747-0185-4742-98ce-83e9e59ded78"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:47:39.049261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-8a2e52d1-2486-463d-87a4-d9c6e01ae890 req-bac3a6ce-31e5-4858-9522-7900e3560bac service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:39.049704 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-8a2e52d1-2486-463d-87a4-d9c6e01ae890 req-bac3a6ce-31e5-4858-9522-7900e3560bac service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:39.075548 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fca8832b-05d4-4e41-82d6-4c83e011e7d0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:39.096678 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-8a2e52d1-2486-463d-87a4-d9c6e01ae890 req-bac3a6ce-31e5-4858-9522-7900e3560bac service nova] Creating event network-vif-deleted:47dba747-0185-4742-98ce-83e9e59ded78 for instance 087dbc3c-3e5c-4c33-87fc-978e640ae6e3 on n-h1-847009-3 Jul 19 22:47:39.104489 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fca8832b-05d4-4e41-82d6-4c83e011e7d0 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3" status: 200 len: 1466 microversion: 2.1 time: 0.244111 Jul 19 22:47:39.111301 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-8a2e52d1-2486-463d-87a4-d9c6e01ae890 req-bac3a6ce-31e5-4858-9522-7900e3560bac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085758 Jul 19 22:47:39.113143 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2147/4257] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:47:39.131739 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2111/4258] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:38 2022] GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3 => generated 1466 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:39.218441 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3aea26d1-5baa-4882-bbe8-dd755700875e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:39.220023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3aea26d1-5baa-4882-bbe8-dd755700875e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:39.244156 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6762497a-30df-4280-8673-f6dd3012b8b7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:39.246286 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6762497a-30df-4280-8673-f6dd3012b8b7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:39.254673 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3aea26d1-5baa-4882-bbe8-dd755700875e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:39.256183 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3aea26d1-5baa-4882-bbe8-dd755700875e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:39.259813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3aea26d1-5baa-4882-bbe8-dd755700875e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:39.262916 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3aea26d1-5baa-4882-bbe8-dd755700875e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:39.285935 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6762497a-30df-4280-8673-f6dd3012b8b7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:39.286413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6762497a-30df-4280-8673-f6dd3012b8b7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:39.289011 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6762497a-30df-4280-8673-f6dd3012b8b7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:39.289484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6762497a-30df-4280-8673-f6dd3012b8b7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:39.433461 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3aea26d1-5baa-4882-bbe8-dd755700875e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:39.457608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3aea26d1-5baa-4882-bbe8-dd755700875e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:39.459471 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3aea26d1-5baa-4882-bbe8-dd755700875e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:39.465059 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3aea26d1-5baa-4882-bbe8-dd755700875e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.251177 Jul 19 22:47:39.465991 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2148/4259] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:39 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:39.606812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5f27106d-5b35-4b70-8e22-cc10288988f4 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:39.607665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5f27106d-5b35-4b70-8e22-cc10288988f4 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:39.622551 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5f27106d-5b35-4b70-8e22-cc10288988f4 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:39.623092 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5f27106d-5b35-4b70-8e22-cc10288988f4 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:39.627281 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5f27106d-5b35-4b70-8e22-cc10288988f4 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:39.627998 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5f27106d-5b35-4b70-8e22-cc10288988f4 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:39.712430 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6762497a-30df-4280-8673-f6dd3012b8b7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:39.728959 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6762497a-30df-4280-8673-f6dd3012b8b7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1317 microversion: 2.1 time: 0.497958 Jul 19 22:47:39.729728 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2112/4260] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:39 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1317 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:39.795530 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5f27106d-5b35-4b70-8e22-cc10288988f4 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:39.813682 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5f27106d-5b35-4b70-8e22-cc10288988f4 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:39.815929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5f27106d-5b35-4b70-8e22-cc10288988f4 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:39.817865 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5f27106d-5b35-4b70-8e22-cc10288988f4 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75" status: 200 len: 1320 microversion: 2.26 time: 0.216149 Jul 19 22:47:39.832524 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2149/4261] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:39 2022] GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75 => generated 1320 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:47:40.158216 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5a4d16ce-67a8-4e54-a4ac-188358ba4cfb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:40.159466 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5a4d16ce-67a8-4e54-a4ac-188358ba4cfb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:40.187333 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a4d16ce-67a8-4e54-a4ac-188358ba4cfb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:40.189872 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a4d16ce-67a8-4e54-a4ac-188358ba4cfb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:40.199944 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a4d16ce-67a8-4e54-a4ac-188358ba4cfb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:40.201311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a4d16ce-67a8-4e54-a4ac-188358ba4cfb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:40.351543 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a4d16ce-67a8-4e54-a4ac-188358ba4cfb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:40.358523 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a4d16ce-67a8-4e54-a4ac-188358ba4cfb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:40.359684 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-5a4d16ce-67a8-4e54-a4ac-188358ba4cfb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lazy-loading 'fault' on Instance uuid 087dbc3c-3e5c-4c33-87fc-978e640ae6e3 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:47:40.490525 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-87e7c09c-2939-40eb-a3c4-218b49141a78 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:40.491421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-87e7c09c-2939-40eb-a3c4-218b49141a78 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:40.506385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87e7c09c-2939-40eb-a3c4-218b49141a78 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:40.509026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87e7c09c-2939-40eb-a3c4-218b49141a78 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:40.515359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87e7c09c-2939-40eb-a3c4-218b49141a78 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:40.516891 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87e7c09c-2939-40eb-a3c4-218b49141a78 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:40.623922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5a4d16ce-67a8-4e54-a4ac-188358ba4cfb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:40.647347 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5a4d16ce-67a8-4e54-a4ac-188358ba4cfb tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3" status: 200 len: 1305 microversion: 2.1 time: 0.494259 Jul 19 22:47:40.650462 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2113/4262] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:40 2022] GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3 => generated 1305 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:40.755223 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8461a304-d7d6-42c2-a4f1-956b41bbe5b2 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:40.756009 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8461a304-d7d6-42c2-a4f1-956b41bbe5b2 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:40.773398 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8461a304-d7d6-42c2-a4f1-956b41bbe5b2 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:40.777598 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8461a304-d7d6-42c2-a4f1-956b41bbe5b2 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:40.779198 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8461a304-d7d6-42c2-a4f1-956b41bbe5b2 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:40.781490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8461a304-d7d6-42c2-a4f1-956b41bbe5b2 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:40.968939 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-87e7c09c-2939-40eb-a3c4-218b49141a78 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:40.979477 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-87e7c09c-2939-40eb-a3c4-218b49141a78 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:40.981832 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-87e7c09c-2939-40eb-a3c4-218b49141a78 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:40.983545 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-87e7c09c-2939-40eb-a3c4-218b49141a78 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.497359 Jul 19 22:47:40.984726 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2150/4263] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:40 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:40.990113 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b851cb4c-baef-4041-9f3b-6bffb0ef9b54 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:40.991213 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b851cb4c-baef-4041-9f3b-6bffb0ef9b54 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:40.998266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b851cb4c-baef-4041-9f3b-6bffb0ef9b54 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:40.999399 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b851cb4c-baef-4041-9f3b-6bffb0ef9b54 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:41.000178 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b851cb4c-baef-4041-9f3b-6bffb0ef9b54 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:41.004901 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b851cb4c-baef-4041-9f3b-6bffb0ef9b54 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:41.390507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b851cb4c-baef-4041-9f3b-6bffb0ef9b54 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:41.392194 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8461a304-d7d6-42c2-a4f1-956b41bbe5b2 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:41.402076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b851cb4c-baef-4041-9f3b-6bffb0ef9b54 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:41.409681 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b851cb4c-baef-4041-9f3b-6bffb0ef9b54 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:41.412390 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8461a304-d7d6-42c2-a4f1-956b41bbe5b2 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.662818 Jul 19 22:47:41.413231 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b851cb4c-baef-4041-9f3b-6bffb0ef9b54 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75" status: 200 len: 1362 microversion: 2.26 time: 0.425713 Jul 19 22:47:41.415340 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2114/4264] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:40 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:47:41.426208 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2151/4265] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:40 2022] GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75 => generated 1362 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:41.674900 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8b04a2f4-a56d-4bdd-9192-d73761b1e986 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1519030037", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "711438ef-9562-4879-b7e2-ec9cf463e48f"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:47:41.679463 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d63876de-a95b-406e-910e-4997874fbf6f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:41.682231 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d63876de-a95b-406e-910e-4997874fbf6f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 087dbc3c-3e5c-4c33-87fc-978e640ae6e3] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:41.693057 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d63876de-a95b-406e-910e-4997874fbf6f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:41.694072 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d63876de-a95b-406e-910e-4997874fbf6f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:41.695294 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d63876de-a95b-406e-910e-4997874fbf6f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:41.695978 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d63876de-a95b-406e-910e-4997874fbf6f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:41.755617 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-d63876de-a95b-406e-910e-4997874fbf6f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] HTTP exception thrown: Instance 087dbc3c-3e5c-4c33-87fc-978e640ae6e3 could not be found. Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d63876de-a95b-406e-910e-4997874fbf6f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Request method failure captured: Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3 HTTP/1.1 Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zH_7tuIYMYFMfF-dNsTqgLOBouujgTx1g47lvb5iq5eveGanI52PRfRNIt8J7p9YtbR2-UcbK9_91u9n4LJtsBL7XHFFF4JD0Ndl-oibDwWUv87SVm5nTpiYOOZL55LCz9q329mnnDxSfKms2aIJ75_j7RvsBiNNB6M3Nswlz42WAY Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 038e4783159e41e3b2cb88df1f8f4a97 Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerActionsTestJSON-1967329631 Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_038e4783159e41e3b2cb88df1f8f4a97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/038e4783159e41e3b2cb88df1f8f4a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/038e4783159e41e3b2cb88df1f8f4a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/038e4783159e41e3b2cb88df1f8f4a97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerActionsTestJSON-1967329631 Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 038e4783159e41e3b2cb88df1f8f4a97 Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerActionsTestJSON-1967329631 Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerActionsTestJSON-1967329631-project Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1f2613ad65b047e8b9a68907406d1874 Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerActionsTestJSON-1967329631-project Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 087dbc3c-3e5c-4c33-87fc-978e640ae6e3 could not be found. Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '087dbc3c-3e5c-4c33-87fc-978e640ae6e3'} Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 087dbc3c-3e5c-4c33-87fc-978e640ae6e3 could not be found. Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 087dbc3c-3e5c-4c33-87fc-978e640ae6e3 could not be found. Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:41.760233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:41.764874 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:41.764874 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:41.764874 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:41.764874 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:41.764874 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:41.764874 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 087dbc3c-3e5c-4c33-87fc-978e640ae6e3 could not be found. Jul 19 22:47:41.764874 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:41.767751 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d63876de-a95b-406e-910e-4997874fbf6f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Returning 404 to user: Instance 087dbc3c-3e5c-4c33-87fc-978e640ae6e3 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:41.768948 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d63876de-a95b-406e-910e-4997874fbf6f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3" status: 404 len: 111 microversion: 2.1 time: 0.106586 Jul 19 22:47:41.773205 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2152/4266] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:41 2022] GET /compute/v2.1/servers/087dbc3c-3e5c-4c33-87fc-978e640ae6e3 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:47:41.796794 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3bb174e4-0922-4169-a858-1b59d5f18513 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:41.798079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3bb174e4-0922-4169-a858-1b59d5f18513 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:41.832030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-8b04a2f4-a56d-4bdd-9192-d73761b1e986 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] validate_networks() for [('711438ef-9562-4879-b7e2-ec9cf463e48f', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:47:41.842222 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3bb174e4-0922-4169-a858-1b59d5f18513 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:41.843148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3bb174e4-0922-4169-a858-1b59d5f18513 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:41.846988 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3bb174e4-0922-4169-a858-1b59d5f18513 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:41.847860 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3bb174e4-0922-4169-a858-1b59d5f18513 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:41.956952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3bb174e4-0922-4169-a858-1b59d5f18513 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:47:42.193388 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3bb174e4-0922-4169-a858-1b59d5f18513 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "DELETE /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 204 len: 0 microversion: 2.1 time: 0.400064 Jul 19 22:47:42.194812 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2153/4267] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:47:41 2022] DELETE /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:47:42.206442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-bd9cdc5f-66e3-4b23-8e75-ba22b70068a7 req-d6d60b4e-2b06-41b2-8746-b2bcd51d87dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c6695cc-7ed6-4ea1-8638-614e9892be75", "tag": "46e23ba4-562d-4256-a087-db5befb3b61b"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:47:42.224622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-bd9cdc5f-66e3-4b23-8e75-ba22b70068a7 req-d6d60b4e-2b06-41b2-8746-b2bcd51d87dd service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:42.225962 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-bd9cdc5f-66e3-4b23-8e75-ba22b70068a7 req-d6d60b4e-2b06-41b2-8746-b2bcd51d87dd service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:42.268833 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-bd9cdc5f-66e3-4b23-8e75-ba22b70068a7 req-d6d60b4e-2b06-41b2-8746-b2bcd51d87dd service nova] Creating event network-changed:46e23ba4-562d-4256-a087-db5befb3b61b for instance 5c6695cc-7ed6-4ea1-8638-614e9892be75 on n-h1-847009-3 Jul 19 22:47:42.280841 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-bd9cdc5f-66e3-4b23-8e75-ba22b70068a7 req-d6d60b4e-2b06-41b2-8746-b2bcd51d87dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083256 Jul 19 22:47:42.282964 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2154/4268] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:47:42.291659 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c158e7db-f622-4db4-bda6-e68df8cf6dd6 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:42.293387 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c158e7db-f622-4db4-bda6-e68df8cf6dd6 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:42.302271 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c158e7db-f622-4db4-bda6-e68df8cf6dd6 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:42.303725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c158e7db-f622-4db4-bda6-e68df8cf6dd6 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:42.305235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c158e7db-f622-4db4-bda6-e68df8cf6dd6 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:42.306452 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c158e7db-f622-4db4-bda6-e68df8cf6dd6 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:42.446822 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c158e7db-f622-4db4-bda6-e68df8cf6dd6 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:42.462929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c158e7db-f622-4db4-bda6-e68df8cf6dd6 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:42.487984 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c158e7db-f622-4db4-bda6-e68df8cf6dd6 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:42.491234 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c158e7db-f622-4db4-bda6-e68df8cf6dd6 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.205747 Jul 19 22:47:42.503162 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2155/4269] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:42 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:42.504596 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a89cd1c8-68a1-4c81-b608-7e3b73afb726 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:42.505234 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a89cd1c8-68a1-4c81-b608-7e3b73afb726 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:42.528178 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a89cd1c8-68a1-4c81-b608-7e3b73afb726 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:42.530674 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a89cd1c8-68a1-4c81-b608-7e3b73afb726 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:42.534505 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a89cd1c8-68a1-4c81-b608-7e3b73afb726 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:42.535949 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a89cd1c8-68a1-4c81-b608-7e3b73afb726 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:43.182819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a89cd1c8-68a1-4c81-b608-7e3b73afb726 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:43.192006 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a89cd1c8-68a1-4c81-b608-7e3b73afb726 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1495 microversion: 2.1 time: 0.695375 Jul 19 22:47:43.193186 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2156/4270] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:42 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1495 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:43.198334 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1974cf06-41d9-448c-bb85-03e3ab0daedc tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:43.199272 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1974cf06-41d9-448c-bb85-03e3ab0daedc tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:43.212918 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1974cf06-41d9-448c-bb85-03e3ab0daedc tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:43.214819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1974cf06-41d9-448c-bb85-03e3ab0daedc tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:43.215871 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1974cf06-41d9-448c-bb85-03e3ab0daedc tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:43.216551 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1974cf06-41d9-448c-bb85-03e3ab0daedc tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:43.548687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-8b04a2f4-a56d-4bdd-9192-d73761b1e986 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:47:43.549681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-8b04a2f4-a56d-4bdd-9192-d73761b1e986 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:47:43.550490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-8b04a2f4-a56d-4bdd-9192-d73761b1e986 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:47:43.551042 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-8b04a2f4-a56d-4bdd-9192-d73761b1e986 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:47:43.551623 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-8b04a2f4-a56d-4bdd-9192-d73761b1e986 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:47:43.562011 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=17 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:47:43.583561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b04a2f4-a56d-4bdd-9192-d73761b1e986 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:43.584144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b04a2f4-a56d-4bdd-9192-d73761b1e986 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:43.585054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b04a2f4-a56d-4bdd-9192-d73761b1e986 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:43.585499 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b04a2f4-a56d-4bdd-9192-d73761b1e986 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:43.624610 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-8b04a2f4-a56d-4bdd-9192-d73761b1e986 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Getting quotas for project 08a2933535544cdca4932622d038d8f6. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:47:43.627543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1974cf06-41d9-448c-bb85-03e3ab0daedc tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:43.632755 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-8b04a2f4-a56d-4bdd-9192-d73761b1e986 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Getting quotas for user 1c827b931a0f497cbd847695315d378d and project 08a2933535544cdca4932622d038d8f6. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:47:43.638808 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1974cf06-41d9-448c-bb85-03e3ab0daedc tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:43.640793 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1974cf06-41d9-448c-bb85-03e3ab0daedc tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:43.646076 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1974cf06-41d9-448c-bb85-03e3ab0daedc tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75" status: 200 len: 1362 microversion: 2.26 time: 0.451652 Jul 19 22:47:43.649053 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2157/4271] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:43 2022] GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75 => generated 1362 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:43.662980 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c36a0abf-365c-4c23-96ef-11aa75d7c011 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:43.663887 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c36a0abf-365c-4c23-96ef-11aa75d7c011 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:43.666567 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8b04a2f4-a56d-4bdd-9192-d73761b1e986 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:47:43.670712 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8b04a2f4-a56d-4bdd-9192-d73761b1e986 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:47:43.682701 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c36a0abf-365c-4c23-96ef-11aa75d7c011 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:43.683168 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c36a0abf-365c-4c23-96ef-11aa75d7c011 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:43.684146 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c36a0abf-365c-4c23-96ef-11aa75d7c011 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:43.684734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c36a0abf-365c-4c23-96ef-11aa75d7c011 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:43.736449 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8b04a2f4-a56d-4bdd-9192-d73761b1e986 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.077983 Jul 19 22:47:43.738114 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2115/4272] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:47:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:47:43.758521 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5329abac-a79b-47d9-afe9-7341ade21799 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:43.759615 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5329abac-a79b-47d9-afe9-7341ade21799 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:44.373249 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:47:44.408553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5329abac-a79b-47d9-afe9-7341ade21799 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:44.411397 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c36a0abf-365c-4c23-96ef-11aa75d7c011 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:44.418923 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5329abac-a79b-47d9-afe9-7341ade21799 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680" status: 200 len: 1217 microversion: 2.1 time: 0.671020 Jul 19 22:47:44.420449 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2116/4273] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:43 2022] GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 => generated 1217 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:44.428079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dccfbb9e-9ddb-4e7f-86f9-95ca0bd101df tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:44.428977 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dccfbb9e-9ddb-4e7f-86f9-95ca0bd101df tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:44.433930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c36a0abf-365c-4c23-96ef-11aa75d7c011 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:44.441674 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c36a0abf-365c-4c23-96ef-11aa75d7c011 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:44.442742 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dccfbb9e-9ddb-4e7f-86f9-95ca0bd101df tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:44.444305 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dccfbb9e-9ddb-4e7f-86f9-95ca0bd101df tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:44.445294 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c36a0abf-365c-4c23-96ef-11aa75d7c011 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.794932 Jul 19 22:47:44.445922 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2158/4274] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:43 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:44.447807 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dccfbb9e-9ddb-4e7f-86f9-95ca0bd101df tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:44.449012 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dccfbb9e-9ddb-4e7f-86f9-95ca0bd101df tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:44.673770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d788af27-3dfa-460a-b90b-d1fae369003b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:44.674402 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d788af27-3dfa-460a-b90b-d1fae369003b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:44.676406 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:47:44.686039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d788af27-3dfa-460a-b90b-d1fae369003b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:44.686503 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d788af27-3dfa-460a-b90b-d1fae369003b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:44.697009 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d788af27-3dfa-460a-b90b-d1fae369003b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:44.698105 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d788af27-3dfa-460a-b90b-d1fae369003b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:44.861173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dccfbb9e-9ddb-4e7f-86f9-95ca0bd101df tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:44.869622 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dccfbb9e-9ddb-4e7f-86f9-95ca0bd101df tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1495 microversion: 2.1 time: 0.447540 Jul 19 22:47:44.870656 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2117/4275] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:44 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1495 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:45.168110 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-45a8caad-cd3f-4af3-bae7-95e000b64226 req-6c7c6f64-2465-4fd6-b847-9435398ab35d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "946bac4e-860b-4803-bb7c-bf7e9c8bd421", "name": "network-vif-deleted", "tag": "7d347f88-5e47-4a16-a516-39b82c71196a"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:47:45.182429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-45a8caad-cd3f-4af3-bae7-95e000b64226 req-6c7c6f64-2465-4fd6-b847-9435398ab35d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:45.183918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-45a8caad-cd3f-4af3-bae7-95e000b64226 req-6c7c6f64-2465-4fd6-b847-9435398ab35d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:45.209429 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-45a8caad-cd3f-4af3-bae7-95e000b64226 req-6c7c6f64-2465-4fd6-b847-9435398ab35d service nova] Creating event network-vif-deleted:7d347f88-5e47-4a16-a516-39b82c71196a for instance 946bac4e-860b-4803-bb7c-bf7e9c8bd421 on n-h2-847009-3 Jul 19 22:47:45.216601 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-45a8caad-cd3f-4af3-bae7-95e000b64226 req-6c7c6f64-2465-4fd6-b847-9435398ab35d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052563 Jul 19 22:47:45.217994 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2118/4276] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:47:45.378361 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d788af27-3dfa-460a-b90b-d1fae369003b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:45.397575 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d788af27-3dfa-460a-b90b-d1fae369003b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:45.399141 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d788af27-3dfa-460a-b90b-d1fae369003b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:45.400545 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d788af27-3dfa-460a-b90b-d1fae369003b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75" status: 200 len: 1362 microversion: 2.26 time: 0.737548 Jul 19 22:47:45.401344 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2159/4277] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:44 2022] GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75 => generated 1362 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:45.440964 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8a62db42-5d5c-48f8-9615-b2ddd84383d1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:45.466267 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-66a7d259-17d1-4dee-95ad-bbcaf169cdaa tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:45.467146 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8a62db42-5d5c-48f8-9615-b2ddd84383d1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:45.467627 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-66a7d259-17d1-4dee-95ad-bbcaf169cdaa tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:45.480929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66a7d259-17d1-4dee-95ad-bbcaf169cdaa tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:45.481465 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66a7d259-17d1-4dee-95ad-bbcaf169cdaa tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:45.482359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66a7d259-17d1-4dee-95ad-bbcaf169cdaa tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:45.482807 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66a7d259-17d1-4dee-95ad-bbcaf169cdaa tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:45.488973 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a62db42-5d5c-48f8-9615-b2ddd84383d1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:45.489807 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a62db42-5d5c-48f8-9615-b2ddd84383d1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:45.494899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a62db42-5d5c-48f8-9615-b2ddd84383d1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:45.496060 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a62db42-5d5c-48f8-9615-b2ddd84383d1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:45.534495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:47:45.798977 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8a62db42-5d5c-48f8-9615-b2ddd84383d1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:45.803681 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-66a7d259-17d1-4dee-95ad-bbcaf169cdaa tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:45.811082 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8a62db42-5d5c-48f8-9615-b2ddd84383d1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680" status: 200 len: 1269 microversion: 2.1 time: 0.374770 Jul 19 22:47:45.820190 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2119/4278] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:45 2022] GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 => generated 1269 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:47:45.837784 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-66a7d259-17d1-4dee-95ad-bbcaf169cdaa tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:45.841813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-66a7d259-17d1-4dee-95ad-bbcaf169cdaa tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:45.843914 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-66a7d259-17d1-4dee-95ad-bbcaf169cdaa tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.383033 Jul 19 22:47:45.848569 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2160/4279] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:45 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:45.890076 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2fe931b8-162d-4648-b00c-2c7ce9272c87 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:45.891455 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2fe931b8-162d-4648-b00c-2c7ce9272c87 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:45.898687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fe931b8-162d-4648-b00c-2c7ce9272c87 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:45.899166 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fe931b8-162d-4648-b00c-2c7ce9272c87 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:45.900157 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fe931b8-162d-4648-b00c-2c7ce9272c87 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:45.900787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fe931b8-162d-4648-b00c-2c7ce9272c87 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:45.959394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fe931b8-162d-4648-b00c-2c7ce9272c87 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:45.960353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fe931b8-162d-4648-b00c-2c7ce9272c87 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:45.961080 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-2fe931b8-162d-4648-b00c-2c7ce9272c87 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lazy-loading 'fault' on Instance uuid 946bac4e-860b-4803-bb7c-bf7e9c8bd421 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:47:46.121134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2fe931b8-162d-4648-b00c-2c7ce9272c87 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:46.133217 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2fe931b8-162d-4648-b00c-2c7ce9272c87 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 200 len: 1304 microversion: 2.1 time: 0.248509 Jul 19 22:47:46.144353 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2120/4280] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:45 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 1304 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:46.437149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4430e323-b294-4e2a-a6ef-0aa652ae17c2 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:46.438545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4430e323-b294-4e2a-a6ef-0aa652ae17c2 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:46.468210 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4430e323-b294-4e2a-a6ef-0aa652ae17c2 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:46.468934 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4430e323-b294-4e2a-a6ef-0aa652ae17c2 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:46.477623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4430e323-b294-4e2a-a6ef-0aa652ae17c2 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:46.478213 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4430e323-b294-4e2a-a6ef-0aa652ae17c2 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:46.831570 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6afcd1ac-084c-4e80-b15b-b5b9e4bfe1ec tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:46.832329 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6afcd1ac-084c-4e80-b15b-b5b9e4bfe1ec tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:46.848411 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6afcd1ac-084c-4e80-b15b-b5b9e4bfe1ec tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:46.850974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6afcd1ac-084c-4e80-b15b-b5b9e4bfe1ec tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:46.852038 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6afcd1ac-084c-4e80-b15b-b5b9e4bfe1ec tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:46.853760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6afcd1ac-084c-4e80-b15b-b5b9e4bfe1ec tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:46.916908 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4430e323-b294-4e2a-a6ef-0aa652ae17c2 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:46.939001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4430e323-b294-4e2a-a6ef-0aa652ae17c2 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:46.945840 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4430e323-b294-4e2a-a6ef-0aa652ae17c2 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:46.947151 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4430e323-b294-4e2a-a6ef-0aa652ae17c2 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75" status: 200 len: 1362 microversion: 2.26 time: 0.528895 Jul 19 22:47:46.961732 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2161/4281] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:46 2022] GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75 => generated 1362 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:46.961732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0f9177cb-ccd5-4dde-a01f-5b3174db014e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:46.961732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0f9177cb-ccd5-4dde-a01f-5b3174db014e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:46.971889 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0f9177cb-ccd5-4dde-a01f-5b3174db014e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:46.972355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0f9177cb-ccd5-4dde-a01f-5b3174db014e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:46.973195 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0f9177cb-ccd5-4dde-a01f-5b3174db014e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:46.973619 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0f9177cb-ccd5-4dde-a01f-5b3174db014e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:47.076236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6afcd1ac-084c-4e80-b15b-b5b9e4bfe1ec tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:47.087774 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6afcd1ac-084c-4e80-b15b-b5b9e4bfe1ec tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680" status: 200 len: 1275 microversion: 2.1 time: 0.261235 Jul 19 22:47:47.088465 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2121/4282] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:46 2022] GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 => generated 1275 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:47:47.157515 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4704fb0a-8de0-434c-9551-8ba06e99e0af tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:47.158891 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4704fb0a-8de0-434c-9551-8ba06e99e0af tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: 946bac4e-860b-4803-bb7c-bf7e9c8bd421] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:47.191568 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4704fb0a-8de0-434c-9551-8ba06e99e0af tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:47.193205 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4704fb0a-8de0-434c-9551-8ba06e99e0af tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:47.197844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4704fb0a-8de0-434c-9551-8ba06e99e0af tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:47.200774 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4704fb0a-8de0-434c-9551-8ba06e99e0af tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:47.252429 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0f9177cb-ccd5-4dde-a01f-5b3174db014e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:47.255386 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-4704fb0a-8de0-434c-9551-8ba06e99e0af tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] HTTP exception thrown: Instance 946bac4e-860b-4803-bb7c-bf7e9c8bd421 could not be found. Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4704fb0a-8de0-434c-9551-8ba06e99e0af tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Request method failure captured: Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 HTTP/1.1 Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zH_7tuIYMYFMfF-dNsTqgLOBouujgTx1g47lvb5iq5eveGanI52PRfRNIt8J7p9YtbR2-UcbK9_91u9n4LJtsBL7XHFFF4JD0Ndl-oibDwWUv87SVm5nTpiYOOZL55LCz9q329mnnDxSfKms2aIJ75_j7RvsBiNNB6M3Nswlz42WAY Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 038e4783159e41e3b2cb88df1f8f4a97 Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerActionsTestJSON-1967329631 Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_038e4783159e41e3b2cb88df1f8f4a97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/038e4783159e41e3b2cb88df1f8f4a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/038e4783159e41e3b2cb88df1f8f4a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/038e4783159e41e3b2cb88df1f8f4a97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerActionsTestJSON-1967329631 Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 038e4783159e41e3b2cb88df1f8f4a97 Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerActionsTestJSON-1967329631 Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerActionsTestJSON-1967329631-project Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1f2613ad65b047e8b9a68907406d1874 Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerActionsTestJSON-1967329631-project Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 946bac4e-860b-4803-bb7c-bf7e9c8bd421 could not be found. Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '946bac4e-860b-4803-bb7c-bf7e9c8bd421'} Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 946bac4e-860b-4803-bb7c-bf7e9c8bd421 could not be found. Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 946bac4e-860b-4803-bb7c-bf7e9c8bd421 could not be found. Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:47.259798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:47.263663 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:47.263663 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:47.263663 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:47.263663 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:47.263663 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:47.263663 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 946bac4e-860b-4803-bb7c-bf7e9c8bd421 could not be found. Jul 19 22:47:47.263663 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:47:47.263663 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4704fb0a-8de0-434c-9551-8ba06e99e0af tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Returning 404 to user: Instance 946bac4e-860b-4803-bb7c-bf7e9c8bd421 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:47.264911 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4704fb0a-8de0-434c-9551-8ba06e99e0af tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421" status: 404 len: 111 microversion: 2.1 time: 0.113662 Jul 19 22:47:47.267081 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2122/4283] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:47 2022] GET /compute/v2.1/servers/946bac4e-860b-4803-bb7c-bf7e9c8bd421 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:47:47.272387 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0f9177cb-ccd5-4dde-a01f-5b3174db014e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:47.276981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-585f5707-5594-4ee8-897f-d0de6989706f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:47.277377 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0f9177cb-ccd5-4dde-a01f-5b3174db014e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:47.277714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-585f5707-5594-4ee8-897f-d0de6989706f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:47.280673 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0f9177cb-ccd5-4dde-a01f-5b3174db014e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.331317 Jul 19 22:47:47.287170 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2162/4284] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:46 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:47.293331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-585f5707-5594-4ee8-897f-d0de6989706f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:47.293883 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-585f5707-5594-4ee8-897f-d0de6989706f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:47.294751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-585f5707-5594-4ee8-897f-d0de6989706f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:47.295674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-585f5707-5594-4ee8-897f-d0de6989706f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:47.372176 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-585f5707-5594-4ee8-897f-d0de6989706f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:47:47.503345 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:47:47.609236 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-585f5707-5594-4ee8-897f-d0de6989706f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 204 len: 0 microversion: 2.1 time: 0.337964 Jul 19 22:47:47.610814 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2123/4285] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:47:47 2022] DELETE /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:47:47.621826 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dbe4f361-c13f-46f6-8a9b-ab92b9e1d96a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:47.622566 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dbe4f361-c13f-46f6-8a9b-ab92b9e1d96a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:47.638668 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dbe4f361-c13f-46f6-8a9b-ab92b9e1d96a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:47.644902 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dbe4f361-c13f-46f6-8a9b-ab92b9e1d96a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:47.646771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dbe4f361-c13f-46f6-8a9b-ab92b9e1d96a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:47.650987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dbe4f361-c13f-46f6-8a9b-ab92b9e1d96a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:47.973202 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1d5fc975-78d6-4d8c-bd22-dca7eb52ab6c tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:47.975255 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1d5fc975-78d6-4d8c-bd22-dca7eb52ab6c tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:47.997555 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d5fc975-78d6-4d8c-bd22-dca7eb52ab6c tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:48.001407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d5fc975-78d6-4d8c-bd22-dca7eb52ab6c tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:48.004061 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d5fc975-78d6-4d8c-bd22-dca7eb52ab6c tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:48.004790 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d5fc975-78d6-4d8c-bd22-dca7eb52ab6c tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:48.203451 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dbe4f361-c13f-46f6-8a9b-ab92b9e1d96a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:48.246375 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dbe4f361-c13f-46f6-8a9b-ab92b9e1d96a tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1674 microversion: 2.1 time: 0.629318 Jul 19 22:47:48.259485 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2163/4286] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:47 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1674 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:48.260647 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4dba752f-5003-43a9-b3bf-bca0f09aaa40 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:48.261572 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4dba752f-5003-43a9-b3bf-bca0f09aaa40 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:48.286681 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4dba752f-5003-43a9-b3bf-bca0f09aaa40 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:48.289213 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4dba752f-5003-43a9-b3bf-bca0f09aaa40 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:48.293716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4dba752f-5003-43a9-b3bf-bca0f09aaa40 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:48.294421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4dba752f-5003-43a9-b3bf-bca0f09aaa40 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:48.374782 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1d5fc975-78d6-4d8c-bd22-dca7eb52ab6c tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:48.391719 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1d5fc975-78d6-4d8c-bd22-dca7eb52ab6c tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:48.393993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1d5fc975-78d6-4d8c-bd22-dca7eb52ab6c tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:48.395683 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1d5fc975-78d6-4d8c-bd22-dca7eb52ab6c tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75" status: 200 len: 1362 microversion: 2.26 time: 0.430121 Jul 19 22:47:48.407705 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2124/4287] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:47 2022] GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75 => generated 1362 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:48.413418 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7307dddc-b51e-4e9b-b54c-53c9dad8715e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:48.414395 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7307dddc-b51e-4e9b-b54c-53c9dad8715e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:48.423091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7307dddc-b51e-4e9b-b54c-53c9dad8715e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:48.423905 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7307dddc-b51e-4e9b-b54c-53c9dad8715e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:48.425081 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7307dddc-b51e-4e9b-b54c-53c9dad8715e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:48.425800 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7307dddc-b51e-4e9b-b54c-53c9dad8715e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:48.733149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7307dddc-b51e-4e9b-b54c-53c9dad8715e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:48.769390 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7307dddc-b51e-4e9b-b54c-53c9dad8715e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:48.774532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7307dddc-b51e-4e9b-b54c-53c9dad8715e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:48.777719 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7307dddc-b51e-4e9b-b54c-53c9dad8715e tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.368272 Jul 19 22:47:48.780157 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2125/4288] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:48 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:48.815785 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-0f803326-fb03-46da-8e6c-50950960ac57 req-08a7c170-5f52-4bae-bc55-4ada542e6ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c6695cc-7ed6-4ea1-8638-614e9892be75", "name": "network-vif-plugged", "status": "completed", "tag": "46e23ba4-562d-4256-a087-db5befb3b61b"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:47:48.848895 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-0f803326-fb03-46da-8e6c-50950960ac57 req-08a7c170-5f52-4bae-bc55-4ada542e6ec0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:48.849337 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-0f803326-fb03-46da-8e6c-50950960ac57 req-08a7c170-5f52-4bae-bc55-4ada542e6ec0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:48.912332 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-0f803326-fb03-46da-8e6c-50950960ac57 req-08a7c170-5f52-4bae-bc55-4ada542e6ec0 service nova] Creating event network-vif-plugged:46e23ba4-562d-4256-a087-db5befb3b61b for instance 5c6695cc-7ed6-4ea1-8638-614e9892be75 on n-h1-847009-3 Jul 19 22:47:48.931760 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-0f803326-fb03-46da-8e6c-50950960ac57 req-08a7c170-5f52-4bae-bc55-4ada542e6ec0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131210 Jul 19 22:47:48.931760 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2126/4289] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:47:49.018446 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4dba752f-5003-43a9-b3bf-bca0f09aaa40 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:49.035612 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4dba752f-5003-43a9-b3bf-bca0f09aaa40 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680" status: 200 len: 1317 microversion: 2.1 time: 0.784524 Jul 19 22:47:49.051910 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2164/4290] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:48 2022] GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 => generated 1317 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:49.276457 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-02a68191-94b1-4bba-88fe-6b6a4b55e15f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:49.277968 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-02a68191-94b1-4bba-88fe-6b6a4b55e15f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:49.288901 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-02a68191-94b1-4bba-88fe-6b6a4b55e15f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:49.289756 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-02a68191-94b1-4bba-88fe-6b6a4b55e15f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:49.293756 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-02a68191-94b1-4bba-88fe-6b6a4b55e15f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:49.294627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-02a68191-94b1-4bba-88fe-6b6a4b55e15f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:49.427027 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-17f4c3fe-cd4b-4bba-93f9-aaa1fb4c5b87 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:49.428989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-17f4c3fe-cd4b-4bba-93f9-aaa1fb4c5b87 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:49.440718 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-17f4c3fe-cd4b-4bba-93f9-aaa1fb4c5b87 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:49.441721 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-17f4c3fe-cd4b-4bba-93f9-aaa1fb4c5b87 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:49.443074 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-17f4c3fe-cd4b-4bba-93f9-aaa1fb4c5b87 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:49.444090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-17f4c3fe-cd4b-4bba-93f9-aaa1fb4c5b87 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:49.812143 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-02a68191-94b1-4bba-88fe-6b6a4b55e15f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:49.848758 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-02a68191-94b1-4bba-88fe-6b6a4b55e15f tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1674 microversion: 2.1 time: 0.576247 Jul 19 22:47:49.851474 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2127/4291] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:49 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1674 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:49.873208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-55fbc5de-2056-4ec2-8fac-f2c2b1c6232b req-b2b27b86-a6fd-49de-bfd0-50ae9c4b88bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680", "tag": "54ea3c14-691f-48cd-b768-0d1a603975a2"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:47:49.911289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-55fbc5de-2056-4ec2-8fac-f2c2b1c6232b req-b2b27b86-a6fd-49de-bfd0-50ae9c4b88bd service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:49.912089 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-55fbc5de-2056-4ec2-8fac-f2c2b1c6232b req-b2b27b86-a6fd-49de-bfd0-50ae9c4b88bd service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:49.937341 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-55fbc5de-2056-4ec2-8fac-f2c2b1c6232b req-b2b27b86-a6fd-49de-bfd0-50ae9c4b88bd service nova] Creating event network-changed:54ea3c14-691f-48cd-b768-0d1a603975a2 for instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 on n-h2-847009-3 Jul 19 22:47:49.945307 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-55fbc5de-2056-4ec2-8fac-f2c2b1c6232b req-b2b27b86-a6fd-49de-bfd0-50ae9c4b88bd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092100 Jul 19 22:47:49.949099 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2128/4292] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:47:49.965234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dbacc7f2-8338-454a-a115-590b7aff5999 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:49.965234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dbacc7f2-8338-454a-a115-590b7aff5999 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:49.982943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dbacc7f2-8338-454a-a115-590b7aff5999 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:49.983492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dbacc7f2-8338-454a-a115-590b7aff5999 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:49.984368 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dbacc7f2-8338-454a-a115-590b7aff5999 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:49.985374 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dbacc7f2-8338-454a-a115-590b7aff5999 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:50.063346 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-17f4c3fe-cd4b-4bba-93f9-aaa1fb4c5b87 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:50.080156 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-17f4c3fe-cd4b-4bba-93f9-aaa1fb4c5b87 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:50.082215 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-17f4c3fe-cd4b-4bba-93f9-aaa1fb4c5b87 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:50.084097 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-17f4c3fe-cd4b-4bba-93f9-aaa1fb4c5b87 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75" status: 200 len: 1362 microversion: 2.26 time: 0.668396 Jul 19 22:47:50.085956 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2165/4293] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:49 2022] GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75 => generated 1362 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:47:50.107096 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6e217ff5-d78b-4936-945b-14e5445c52f9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:50.112158 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6e217ff5-d78b-4936-945b-14e5445c52f9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:50.143006 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e217ff5-d78b-4936-945b-14e5445c52f9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:50.143953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e217ff5-d78b-4936-945b-14e5445c52f9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:50.145063 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e217ff5-d78b-4936-945b-14e5445c52f9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:50.145965 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e217ff5-d78b-4936-945b-14e5445c52f9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:50.206148 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dbacc7f2-8338-454a-a115-590b7aff5999 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:50.229044 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dbacc7f2-8338-454a-a115-590b7aff5999 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:50.233961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dbacc7f2-8338-454a-a115-590b7aff5999 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:50.236900 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dbacc7f2-8338-454a-a115-590b7aff5999 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.285972 Jul 19 22:47:50.242605 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2129/4294] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:49 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:50.446817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6e217ff5-d78b-4936-945b-14e5445c52f9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:50.461999 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6e217ff5-d78b-4936-945b-14e5445c52f9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680" status: 200 len: 1317 microversion: 2.1 time: 0.372000 Jul 19 22:47:50.463408 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2166/4295] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:50 2022] GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:50.869361 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-de786c89-ae39-4149-861b-62d6b5fb06ba tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:50.870186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-de786c89-ae39-4149-861b-62d6b5fb06ba tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:50.885771 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de786c89-ae39-4149-861b-62d6b5fb06ba tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:50.886416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de786c89-ae39-4149-861b-62d6b5fb06ba tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:50.887425 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de786c89-ae39-4149-861b-62d6b5fb06ba tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:50.887986 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de786c89-ae39-4149-861b-62d6b5fb06ba tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:51.105926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d71a5b65-2546-437b-b031-b2e5314b8fe5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:51.106549 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d71a5b65-2546-437b-b031-b2e5314b8fe5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:51.120764 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d71a5b65-2546-437b-b031-b2e5314b8fe5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:51.122995 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d71a5b65-2546-437b-b031-b2e5314b8fe5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:51.124660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d71a5b65-2546-437b-b031-b2e5314b8fe5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:51.129982 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d71a5b65-2546-437b-b031-b2e5314b8fe5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:51.351925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-de786c89-ae39-4149-861b-62d6b5fb06ba tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:51.367637 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-de786c89-ae39-4149-861b-62d6b5fb06ba tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1674 microversion: 2.1 time: 0.500221 Jul 19 22:47:51.378770 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2130/4296] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:50 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1674 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:47:51.384374 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e4ff3dd0-a10d-4ff9-9a10-2ff1c7ef083c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:51.385191 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e4ff3dd0-a10d-4ff9-9a10-2ff1c7ef083c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:51.393171 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e4ff3dd0-a10d-4ff9-9a10-2ff1c7ef083c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:51.393940 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e4ff3dd0-a10d-4ff9-9a10-2ff1c7ef083c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:51.394973 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e4ff3dd0-a10d-4ff9-9a10-2ff1c7ef083c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:51.395721 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e4ff3dd0-a10d-4ff9-9a10-2ff1c7ef083c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:51.525689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e4ff3dd0-a10d-4ff9-9a10-2ff1c7ef083c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:51.556116 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e4ff3dd0-a10d-4ff9-9a10-2ff1c7ef083c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:51.560628 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e4ff3dd0-a10d-4ff9-9a10-2ff1c7ef083c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:51.569703 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e4ff3dd0-a10d-4ff9-9a10-2ff1c7ef083c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.186796 Jul 19 22:47:51.570854 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2131/4297] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:51 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:51.589069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-749c6c31-179e-4986-be6d-bc031ac463ab tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:51.595494 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-749c6c31-179e-4986-be6d-bc031ac463ab tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:51.602420 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-749c6c31-179e-4986-be6d-bc031ac463ab tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:51.603952 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-749c6c31-179e-4986-be6d-bc031ac463ab tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:51.605205 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-749c6c31-179e-4986-be6d-bc031ac463ab tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:51.608290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-749c6c31-179e-4986-be6d-bc031ac463ab tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:51.617618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d71a5b65-2546-437b-b031-b2e5314b8fe5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:51.655919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d71a5b65-2546-437b-b031-b2e5314b8fe5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:51.674169 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d71a5b65-2546-437b-b031-b2e5314b8fe5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:51.676850 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d71a5b65-2546-437b-b031-b2e5314b8fe5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75" status: 200 len: 1546 microversion: 2.26 time: 0.575599 Jul 19 22:47:51.692518 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2167/4298] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:51 2022] GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75 => generated 1546 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:47:51.723580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c04f47b5-42fa-4791-bb64-8988470cd89b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '.version_select at 0x7f7a0313e310>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:51.767666 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c04f47b5-42fa-4791-bb64-8988470cd89b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:51.768903 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c04f47b5-42fa-4791-bb64-8988470cd89b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:51.770062 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c04f47b5-42fa-4791-bb64-8988470cd89b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:51.779153 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c04f47b5-42fa-4791-bb64-8988470cd89b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:51.780565 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c04f47b5-42fa-4791-bb64-8988470cd89b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:51.783147 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c04f47b5-42fa-4791-bb64-8988470cd89b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:51.784190 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c04f47b5-42fa-4791-bb64-8988470cd89b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:51.865597 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c04f47b5-42fa-4791-bb64-8988470cd89b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:51.867875 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c04f47b5-42fa-4791-bb64-8988470cd89b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:51.927729 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c04f47b5-42fa-4791-bb64-8988470cd89b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:51.931497 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c04f47b5-42fa-4791-bb64-8988470cd89b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:52.003038 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-c04f47b5-42fa-4791-bb64-8988470cd89b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lazy-loading 'flavor' on Instance uuid 5c6695cc-7ed6-4ea1-8638-614e9892be75 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:47:52.038912 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c04f47b5-42fa-4791-bb64-8988470cd89b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "PUT /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags/tempest-tag-682483715" status: 201 len: 0 microversion: 2.26 time: 0.327836 Jul 19 22:47:52.046512 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2168/4299] 10.222.0.25 () {62 vars in 1376 bytes} [Tue Jul 19 22:47:51 2022] PUT /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags/tempest-tag-682483715 => generated 0 bytes in 337 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 19 22:47:52.059853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-811f3332-fcff-4827-9d16-af8f5c655631 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '.version_select at 0x7f7a0311fdc0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:52.074947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-811f3332-fcff-4827-9d16-af8f5c655631 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:52.075851 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-811f3332-fcff-4827-9d16-af8f5c655631 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:52.088691 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-811f3332-fcff-4827-9d16-af8f5c655631 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags/tempest-tag-682483715" status: 204 len: 0 microversion: 2.26 time: 0.037394 Jul 19 22:47:52.093374 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2169/4300] 10.222.0.25 () {60 vars in 1357 bytes} [Tue Jul 19 22:47:52 2022] GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags/tempest-tag-682483715 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:47:52.100303 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-352f14c9-722c-4708-87e1-fd86c2dd7669 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:47:52.102224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-352f14c9-722c-4708-87e1-fd86c2dd7669 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:52.110404 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-749c6c31-179e-4986-be6d-bc031ac463ab tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:52.115978 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-352f14c9-722c-4708-87e1-fd86c2dd7669 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:52.116591 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-352f14c9-722c-4708-87e1-fd86c2dd7669 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:52.117306 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-352f14c9-722c-4708-87e1-fd86c2dd7669 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:52.117759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-352f14c9-722c-4708-87e1-fd86c2dd7669 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:52.123423 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-749c6c31-179e-4986-be6d-bc031ac463ab tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680" status: 200 len: 1317 microversion: 2.1 time: 0.547933 Jul 19 22:47:52.124030 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2132/4301] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:51 2022] GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 => generated 1317 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:52.157590 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c5b4ec88-e7b8-429c-a7cf-bf96866ef9f5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '.version_select at 0x7f7a030c7820>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:52.165605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-352f14c9-722c-4708-87e1-fd86c2dd7669 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lazy-loading 'flavor' on Instance uuid 02571222-3b10-4a0d-8b70-a8202c37f6a7 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:47:52.169784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:47:52.178588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5b4ec88-e7b8-429c-a7cf-bf96866ef9f5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:52.183873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5b4ec88-e7b8-429c-a7cf-bf96866ef9f5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:52.184729 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c5b4ec88-e7b8-429c-a7cf-bf96866ef9f5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:52.197206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5b4ec88-e7b8-429c-a7cf-bf96866ef9f5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:52.202045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5b4ec88-e7b8-429c-a7cf-bf96866ef9f5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:52.216671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5b4ec88-e7b8-429c-a7cf-bf96866ef9f5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:52.217005 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5b4ec88-e7b8-429c-a7cf-bf96866ef9f5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:52.303770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5b4ec88-e7b8-429c-a7cf-bf96866ef9f5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:52.304212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5b4ec88-e7b8-429c-a7cf-bf96866ef9f5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:52.347886 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-c5b4ec88-e7b8-429c-a7cf-bf96866ef9f5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lazy-loading 'flavor' on Instance uuid 5c6695cc-7ed6-4ea1-8638-614e9892be75 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:47:52.383475 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c5b4ec88-e7b8-429c-a7cf-bf96866ef9f5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags" status: 204 len: 0 microversion: 2.26 time: 0.240946 Jul 19 22:47:52.384657 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2133/4302] 10.222.0.25 () {60 vars in 1294 bytes} [Tue Jul 19 22:47:52 2022] DELETE /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:47:52.400568 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-e4609b6f-7ec0-4dad-898e-6333b57776f0 req-05d28242-6fee-47ff-aea2-694babcef9f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9ae7d22-3925-465a-9507-250b670ecc77", "name": "network-vif-deleted", "tag": "3196bd8c-6a69-4858-81a6-622d724377b1"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:47:52.400720 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-352f14c9-722c-4708-87e1-fd86c2dd7669 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "POST /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/action" status: 200 len: 32 microversion: 2.1 time: 0.304764 Jul 19 22:47:52.401326 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2170/4303] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:47:52 2022] POST /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/action => generated 32 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:47:52.410214 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-531ca0ef-5ec9-4ecd-8b4c-a0e6966893bf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:52.416188 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-531ca0ef-5ec9-4ecd-8b4c-a0e6966893bf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:52.426171 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-531ca0ef-5ec9-4ecd-8b4c-a0e6966893bf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:52.426631 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-531ca0ef-5ec9-4ecd-8b4c-a0e6966893bf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:52.427509 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-531ca0ef-5ec9-4ecd-8b4c-a0e6966893bf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:52.427958 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-531ca0ef-5ec9-4ecd-8b4c-a0e6966893bf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:52.429899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e4609b6f-7ec0-4dad-898e-6333b57776f0 req-05d28242-6fee-47ff-aea2-694babcef9f9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:52.430364 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e4609b6f-7ec0-4dad-898e-6333b57776f0 req-05d28242-6fee-47ff-aea2-694babcef9f9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:52.459716 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-e4609b6f-7ec0-4dad-898e-6333b57776f0 req-05d28242-6fee-47ff-aea2-694babcef9f9 service nova] Creating event network-vif-deleted:3196bd8c-6a69-4858-81a6-622d724377b1 for instance b9ae7d22-3925-465a-9507-250b670ecc77 on n-h2-847009-3 Jul 19 22:47:52.477747 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-e4609b6f-7ec0-4dad-898e-6333b57776f0 req-05d28242-6fee-47ff-aea2-694babcef9f9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088046 Jul 19 22:47:52.478984 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2134/4304] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:47:52.498995 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-785f5f92-0626-4eed-a9b1-ffbf311da245 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '.version_select at 0x7f7a030c7280>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:52.514670 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-785f5f92-0626-4eed-a9b1-ffbf311da245 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:52.529710 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-785f5f92-0626-4eed-a9b1-ffbf311da245 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:52.548007 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-531ca0ef-5ec9-4ecd-8b4c-a0e6966893bf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:52.555481 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-785f5f92-0626-4eed-a9b1-ffbf311da245 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags" status: 200 len: 12 microversion: 2.26 time: 0.073264 Jul 19 22:47:52.558210 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-531ca0ef-5ec9-4ecd-8b4c-a0e6966893bf tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1607 microversion: 2.1 time: 0.154284 Jul 19 22:47:52.559624 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2171/4305] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:52 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1607 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:52.566742 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cb147618-4380-43ec-8dc1-db12061fcd42 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:52.567644 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cb147618-4380-43ec-8dc1-db12061fcd42 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:52.576359 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2135/4306] 10.222.0.25 () {60 vars in 1291 bytes} [Tue Jul 19 22:47:52 2022] GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags => generated 12 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:52.581203 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cb147618-4380-43ec-8dc1-db12061fcd42 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:52.581958 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cb147618-4380-43ec-8dc1-db12061fcd42 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:52.582952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cb147618-4380-43ec-8dc1-db12061fcd42 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:52.583582 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cb147618-4380-43ec-8dc1-db12061fcd42 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:52.586063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-591c7b7e-51ae-4a16-9a66-d7bb47edecd5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '.version_select at 0x7f7a032ae0d0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:52.619000 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-591c7b7e-51ae-4a16-9a66-d7bb47edecd5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:52.619492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-591c7b7e-51ae-4a16-9a66-d7bb47edecd5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:52.620120 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-591c7b7e-51ae-4a16-9a66-d7bb47edecd5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:52.629197 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-591c7b7e-51ae-4a16-9a66-d7bb47edecd5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:52.629663 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-591c7b7e-51ae-4a16-9a66-d7bb47edecd5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:52.630468 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-591c7b7e-51ae-4a16-9a66-d7bb47edecd5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:52.630914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-591c7b7e-51ae-4a16-9a66-d7bb47edecd5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:52.676473 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-591c7b7e-51ae-4a16-9a66-d7bb47edecd5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:52.676958 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-591c7b7e-51ae-4a16-9a66-d7bb47edecd5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:52.689513 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-591c7b7e-51ae-4a16-9a66-d7bb47edecd5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:52.689969 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-591c7b7e-51ae-4a16-9a66-d7bb47edecd5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:52.729270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-591c7b7e-51ae-4a16-9a66-d7bb47edecd5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lazy-loading 'flavor' on Instance uuid 5c6695cc-7ed6-4ea1-8638-614e9892be75 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:47:52.754018 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-591c7b7e-51ae-4a16-9a66-d7bb47edecd5 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "PUT /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags/tempest-tag-136217134" status: 201 len: 0 microversion: 2.26 time: 0.175548 Jul 19 22:47:52.761442 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2136/4307] 10.222.0.25 () {62 vars in 1376 bytes} [Tue Jul 19 22:47:52 2022] PUT /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags/tempest-tag-136217134 => generated 0 bytes in 177 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Jul 19 22:47:52.766285 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b3b1c654-d1c5-4d54-b632-5b38be861a71 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:52.766823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b3b1c654-d1c5-4d54-b632-5b38be861a71 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:52.774409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b3b1c654-d1c5-4d54-b632-5b38be861a71 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:52.774876 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b3b1c654-d1c5-4d54-b632-5b38be861a71 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:52.775712 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b3b1c654-d1c5-4d54-b632-5b38be861a71 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:52.776160 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b3b1c654-d1c5-4d54-b632-5b38be861a71 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:52.856757 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cb147618-4380-43ec-8dc1-db12061fcd42 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:52.873017 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cb147618-4380-43ec-8dc1-db12061fcd42 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1734 microversion: 2.1 time: 0.312060 Jul 19 22:47:52.873930 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2172/4308] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:52 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1734 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:52.887519 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-13efda6b-d5d1-46f7-b68d-fb6f2b7217e2 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '.version_select at 0x7f7a0312aaf0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:52.896357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-13efda6b-d5d1-46f7-b68d-fb6f2b7217e2 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:52.896826 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-13efda6b-d5d1-46f7-b68d-fb6f2b7217e2 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:52.926383 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-13efda6b-d5d1-46f7-b68d-fb6f2b7217e2 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags" status: 200 len: 35 microversion: 2.26 time: 0.051344 Jul 19 22:47:52.927356 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2173/4309] 10.222.0.25 () {60 vars in 1291 bytes} [Tue Jul 19 22:47:52 2022] GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags => generated 35 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:52.931152 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b3b1c654-d1c5-4d54-b632-5b38be861a71 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:52.942157 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-89fda6c6-7e7d-4a25-a69c-717e3cf4a035 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '.version_select at 0x7f7a03119ca0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:52.947649 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b3b1c654-d1c5-4d54-b632-5b38be861a71 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:52.951853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b3b1c654-d1c5-4d54-b632-5b38be861a71 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:52.954843 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b3b1c654-d1c5-4d54-b632-5b38be861a71 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.198380 Jul 19 22:47:52.956658 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2137/4310] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:52 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:52.963151 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-89fda6c6-7e7d-4a25-a69c-717e3cf4a035 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:52.964804 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-89fda6c6-7e7d-4a25-a69c-717e3cf4a035 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:52.965516 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-89fda6c6-7e7d-4a25-a69c-717e3cf4a035 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:52.978539 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-89fda6c6-7e7d-4a25-a69c-717e3cf4a035 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:52.981733 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-89fda6c6-7e7d-4a25-a69c-717e3cf4a035 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:52.985325 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-89fda6c6-7e7d-4a25-a69c-717e3cf4a035 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:52.986488 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-89fda6c6-7e7d-4a25-a69c-717e3cf4a035 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:52.995412 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:UPDATE=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:47:53.024205 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-89fda6c6-7e7d-4a25-a69c-717e3cf4a035 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:53.024686 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-89fda6c6-7e7d-4a25-a69c-717e3cf4a035 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:53.083165 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-89fda6c6-7e7d-4a25-a69c-717e3cf4a035 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lazy-loading 'flavor' on Instance uuid 5c6695cc-7ed6-4ea1-8638-614e9892be75 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:47:53.117276 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-89fda6c6-7e7d-4a25-a69c-717e3cf4a035 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags/tempest-tag-136217134" status: 204 len: 0 microversion: 2.26 time: 0.181057 Jul 19 22:47:53.122436 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2174/4311] 10.222.0.25 () {60 vars in 1360 bytes} [Tue Jul 19 22:47:52 2022] DELETE /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags/tempest-tag-136217134 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:47:53.138329 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-107dc54d-4311-439c-95ae-e781f779deb6 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '.version_select at 0x7f7a0308f5e0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:53.141776 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0e4d2728-2ccb-431d-b478-8022b5f4ad46 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:53.142568 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0e4d2728-2ccb-431d-b478-8022b5f4ad46 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:53.152347 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-107dc54d-4311-439c-95ae-e781f779deb6 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:53.153949 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-107dc54d-4311-439c-95ae-e781f779deb6 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:53.164754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0e4d2728-2ccb-431d-b478-8022b5f4ad46 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:53.165227 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0e4d2728-2ccb-431d-b478-8022b5f4ad46 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:53.166028 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0e4d2728-2ccb-431d-b478-8022b5f4ad46 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:53.166462 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0e4d2728-2ccb-431d-b478-8022b5f4ad46 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:53.176006 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-107dc54d-4311-439c-95ae-e781f779deb6 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags" status: 200 len: 12 microversion: 2.26 time: 0.048052 Jul 19 22:47:53.178164 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2138/4312] 10.222.0.25 () {60 vars in 1291 bytes} [Tue Jul 19 22:47:53 2022] GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags => generated 12 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:53.194672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-37da8989-4ed2-4367-b462-a61f30aa0192 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '.version_select at 0x7f7a03297040>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:53.219481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37da8989-4ed2-4367-b462-a61f30aa0192 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:53.224898 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37da8989-4ed2-4367-b462-a61f30aa0192 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:53.226175 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-37da8989-4ed2-4367-b462-a61f30aa0192 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:53.257106 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37da8989-4ed2-4367-b462-a61f30aa0192 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:53.260417 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37da8989-4ed2-4367-b462-a61f30aa0192 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:53.262644 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37da8989-4ed2-4367-b462-a61f30aa0192 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:53.264997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37da8989-4ed2-4367-b462-a61f30aa0192 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:53.315016 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37da8989-4ed2-4367-b462-a61f30aa0192 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:53.316186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37da8989-4ed2-4367-b462-a61f30aa0192 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:53.338484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-37da8989-4ed2-4367-b462-a61f30aa0192 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lazy-loading 'flavor' on Instance uuid 5c6695cc-7ed6-4ea1-8638-614e9892be75 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:47:53.364946 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-37da8989-4ed2-4367-b462-a61f30aa0192 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags" status: 204 len: 0 microversion: 2.26 time: 0.176131 Jul 19 22:47:53.366699 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2139/4313] 10.222.0.25 () {60 vars in 1294 bytes} [Tue Jul 19 22:47:53 2022] DELETE /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 19 22:47:53.393337 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8f95f1f3-fab0-47c0-a6ae-e297eb787981 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '.version_select at 0x7f7a030c70d0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:53.416847 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f95f1f3-fab0-47c0-a6ae-e297eb787981 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:53.418032 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f95f1f3-fab0-47c0-a6ae-e297eb787981 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:53.419816 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8f95f1f3-fab0-47c0-a6ae-e297eb787981 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:53.434175 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f95f1f3-fab0-47c0-a6ae-e297eb787981 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:53.439057 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f95f1f3-fab0-47c0-a6ae-e297eb787981 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:53.440171 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f95f1f3-fab0-47c0-a6ae-e297eb787981 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:53.441029 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f95f1f3-fab0-47c0-a6ae-e297eb787981 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:53.487208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=94,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:47:53.496710 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f95f1f3-fab0-47c0-a6ae-e297eb787981 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:53.497424 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f95f1f3-fab0-47c0-a6ae-e297eb787981 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:53.511670 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f95f1f3-fab0-47c0-a6ae-e297eb787981 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:53.512231 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f95f1f3-fab0-47c0-a6ae-e297eb787981 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:53.570550 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-8f95f1f3-fab0-47c0-a6ae-e297eb787981 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lazy-loading 'flavor' on Instance uuid 5c6695cc-7ed6-4ea1-8638-614e9892be75 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:47:53.609371 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:47:53.658629 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8f95f1f3-fab0-47c0-a6ae-e297eb787981 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "PUT /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags/tempest-tag-1998014912" status: 201 len: 0 microversion: 2.26 time: 0.273497 Jul 19 22:47:53.664369 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2140/4314] 10.222.0.25 () {62 vars in 1379 bytes} [Tue Jul 19 22:47:53 2022] PUT /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags/tempest-tag-1998014912 => generated 0 bytes in 293 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Jul 19 22:47:53.683558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7986fdbc-342e-4ccf-a3df-d60b3629f66d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:53.688515 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7986fdbc-342e-4ccf-a3df-d60b3629f66d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:53.706260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7986fdbc-342e-4ccf-a3df-d60b3629f66d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:53.706740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7986fdbc-342e-4ccf-a3df-d60b3629f66d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:53.709245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7986fdbc-342e-4ccf-a3df-d60b3629f66d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:53.709245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7986fdbc-342e-4ccf-a3df-d60b3629f66d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:53.718071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0e4d2728-2ccb-431d-b478-8022b5f4ad46 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:53.743012 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0e4d2728-2ccb-431d-b478-8022b5f4ad46 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680" status: 200 len: 1317 microversion: 2.1 time: 0.605722 Jul 19 22:47:53.754614 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2175/4315] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:53 2022] GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 => generated 1317 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:53.768229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6ef2e3e7-d45c-4a17-a51e-6ac253f63226 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '.version_select at 0x7f7a031bc040>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:53.785764 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:47:53.826877 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ef2e3e7-d45c-4a17-a51e-6ac253f63226 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:53.840411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ef2e3e7-d45c-4a17-a51e-6ac253f63226 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:53.840970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6ef2e3e7-d45c-4a17-a51e-6ac253f63226 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:53.857921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ef2e3e7-d45c-4a17-a51e-6ac253f63226 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:53.861918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7986fdbc-342e-4ccf-a3df-d60b3629f66d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:53.862439 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7986fdbc-342e-4ccf-a3df-d60b3629f66d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:53.862975 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-7986fdbc-342e-4ccf-a3df-d60b3629f66d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lazy-loading 'fault' on Instance uuid b9ae7d22-3925-465a-9507-250b670ecc77 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:47:53.875064 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ef2e3e7-d45c-4a17-a51e-6ac253f63226 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:53.880907 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ef2e3e7-d45c-4a17-a51e-6ac253f63226 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:53.881654 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ef2e3e7-d45c-4a17-a51e-6ac253f63226 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:53.976706 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ef2e3e7-d45c-4a17-a51e-6ac253f63226 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:53.978196 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ef2e3e7-d45c-4a17-a51e-6ac253f63226 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:54.018991 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ef2e3e7-d45c-4a17-a51e-6ac253f63226 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:54.019733 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ef2e3e7-d45c-4a17-a51e-6ac253f63226 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:54.073189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7986fdbc-342e-4ccf-a3df-d60b3629f66d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2613ad65b047e8b9a68907406d1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038e4783159e41e3b2cb88df1f8f4a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:54.083015 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7986fdbc-342e-4ccf-a3df-d60b3629f66d tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 200 len: 1328 microversion: 2.1 time: 0.416992 Jul 19 22:47:54.084752 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2141/4316] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:53 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 1328 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:54.107483 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-6ef2e3e7-d45c-4a17-a51e-6ac253f63226 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lazy-loading 'flavor' on Instance uuid 5c6695cc-7ed6-4ea1-8638-614e9892be75 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:47:54.119727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-af72e3c8-f2cd-4114-9912-f3cb7ca23706 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:54.120369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-af72e3c8-f2cd-4114-9912-f3cb7ca23706 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:54.138227 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af72e3c8-f2cd-4114-9912-f3cb7ca23706 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:54.144153 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af72e3c8-f2cd-4114-9912-f3cb7ca23706 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:54.145716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af72e3c8-f2cd-4114-9912-f3cb7ca23706 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:54.146180 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af72e3c8-f2cd-4114-9912-f3cb7ca23706 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:54.160932 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6ef2e3e7-d45c-4a17-a51e-6ac253f63226 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "PUT /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags/tempest-tag-1936763563" status: 201 len: 0 microversion: 2.26 time: 0.404907 Jul 19 22:47:54.170906 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2176/4317] 10.222.0.25 () {62 vars in 1379 bytes} [Tue Jul 19 22:47:53 2022] PUT /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags/tempest-tag-1936763563 => generated 0 bytes in 415 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 19 22:47:54.185248 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2dae086c-d437-452f-99ed-a8df14c02a81 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:54.187198 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2dae086c-d437-452f-99ed-a8df14c02a81 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:54.206730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2dae086c-d437-452f-99ed-a8df14c02a81 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:54.207822 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2dae086c-d437-452f-99ed-a8df14c02a81 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:54.209310 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2dae086c-d437-452f-99ed-a8df14c02a81 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:54.211044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2dae086c-d437-452f-99ed-a8df14c02a81 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:54.414265 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=7 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:47:54.767801 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2dae086c-d437-452f-99ed-a8df14c02a81 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:54.788766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2dae086c-d437-452f-99ed-a8df14c02a81 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:54.792101 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2dae086c-d437-452f-99ed-a8df14c02a81 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:54.798352 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2dae086c-d437-452f-99ed-a8df14c02a81 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.625826 Jul 19 22:47:54.798976 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2177/4318] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:54 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:54.833092 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6f7b41fd-6519-4e75-863e-e54b47b2fc48 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '.version_select at 0x7f7a0313e940>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:54.868505 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f7b41fd-6519-4e75-863e-e54b47b2fc48 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:54.868505 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f7b41fd-6519-4e75-863e-e54b47b2fc48 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:54.870152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6f7b41fd-6519-4e75-863e-e54b47b2fc48 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:54.889566 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f7b41fd-6519-4e75-863e-e54b47b2fc48 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:54.890036 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f7b41fd-6519-4e75-863e-e54b47b2fc48 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:54.895444 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f7b41fd-6519-4e75-863e-e54b47b2fc48 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:54.897183 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f7b41fd-6519-4e75-863e-e54b47b2fc48 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:54.923700 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-af72e3c8-f2cd-4114-9912-f3cb7ca23706 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:54.939276 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-af72e3c8-f2cd-4114-9912-f3cb7ca23706 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1734 microversion: 2.1 time: 0.838891 Jul 19 22:47:54.949680 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2142/4319] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:54 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1734 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:54.959180 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bab06e7e-ffa5-41ba-8a9e-d9f87e9066bd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:54.960529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bab06e7e-ffa5-41ba-8a9e-d9f87e9066bd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:54.973330 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bab06e7e-ffa5-41ba-8a9e-d9f87e9066bd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:54.977820 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bab06e7e-ffa5-41ba-8a9e-d9f87e9066bd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:54.977820 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bab06e7e-ffa5-41ba-8a9e-d9f87e9066bd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:54.977820 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bab06e7e-ffa5-41ba-8a9e-d9f87e9066bd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:54.986850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f7b41fd-6519-4e75-863e-e54b47b2fc48 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:54.987830 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f7b41fd-6519-4e75-863e-e54b47b2fc48 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:55.027248 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-6f7b41fd-6519-4e75-863e-e54b47b2fc48 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lazy-loading 'flavor' on Instance uuid 5c6695cc-7ed6-4ea1-8638-614e9892be75 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:47:55.060547 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6f7b41fd-6519-4e75-863e-e54b47b2fc48 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags" status: 204 len: 0 microversion: 2.26 time: 0.254700 Jul 19 22:47:55.063495 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2178/4320] 10.222.0.25 () {60 vars in 1294 bytes} [Tue Jul 19 22:47:54 2022] DELETE /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:47:55.074527 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-188abc3c-a11d-45a1-be9c-837279c008fa tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '.version_select at 0x7f7a0319ba60>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:55.095444 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-188abc3c-a11d-45a1-be9c-837279c008fa tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:55.095920 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-188abc3c-a11d-45a1-be9c-837279c008fa tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:55.121587 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-188abc3c-a11d-45a1-be9c-837279c008fa tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags" status: 200 len: 12 microversion: 2.26 time: 0.050153 Jul 19 22:47:55.123945 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2179/4321] 10.222.0.25 () {60 vars in 1291 bytes} [Tue Jul 19 22:47:55 2022] GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags => generated 12 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:47:55.139056 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8664416f-f7ba-4eb3-953f-279469e5186b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '.version_select at 0x7f7a0313e790>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:55.175465 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8664416f-f7ba-4eb3-953f-279469e5186b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:55.176043 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8664416f-f7ba-4eb3-953f-279469e5186b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:55.176508 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8664416f-f7ba-4eb3-953f-279469e5186b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:55.199911 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8664416f-f7ba-4eb3-953f-279469e5186b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:55.200908 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8664416f-f7ba-4eb3-953f-279469e5186b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:55.206391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8664416f-f7ba-4eb3-953f-279469e5186b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:55.207158 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8664416f-f7ba-4eb3-953f-279469e5186b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:55.247532 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8664416f-f7ba-4eb3-953f-279469e5186b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:55.248232 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8664416f-f7ba-4eb3-953f-279469e5186b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:55.262013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-8664416f-f7ba-4eb3-953f-279469e5186b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lazy-loading 'flavor' on Instance uuid 5c6695cc-7ed6-4ea1-8638-614e9892be75 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:47:55.286369 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8664416f-f7ba-4eb3-953f-279469e5186b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags" status: 204 len: 0 microversion: 2.26 time: 0.151451 Jul 19 22:47:55.295088 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2180/4322] 10.222.0.25 () {60 vars in 1294 bytes} [Tue Jul 19 22:47:55 2022] DELETE /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:47:55.302837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-62fa90b2-c202-45f4-9acc-c984bbed38e5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:55.303813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-62fa90b2-c202-45f4-9acc-c984bbed38e5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] [instance: b9ae7d22-3925-465a-9507-250b670ecc77] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:55.314181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62fa90b2-c202-45f4-9acc-c984bbed38e5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:55.315197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62fa90b2-c202-45f4-9acc-c984bbed38e5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:55.316195 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62fa90b2-c202-45f4-9acc-c984bbed38e5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:55.316833 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62fa90b2-c202-45f4-9acc-c984bbed38e5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:55.338068 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-62fa90b2-c202-45f4-9acc-c984bbed38e5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] HTTP exception thrown: Instance b9ae7d22-3925-465a-9507-250b670ecc77 could not be found. Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-62fa90b2-c202-45f4-9acc-c984bbed38e5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Request method failure captured: Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 HTTP/1.1 Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zH_7tuIYMYFMfF-dNsTqgLOBouujgTx1g47lvb5iq5eveGanI52PRfRNIt8J7p9YtbR2-UcbK9_91u9n4LJtsBL7XHFFF4JD0Ndl-oibDwWUv87SVm5nTpiYOOZL55LCz9q329mnnDxSfKms2aIJ75_j7RvsBiNNB6M3Nswlz42WAY Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 038e4783159e41e3b2cb88df1f8f4a97 Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerActionsTestJSON-1967329631 Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_038e4783159e41e3b2cb88df1f8f4a97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/038e4783159e41e3b2cb88df1f8f4a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/038e4783159e41e3b2cb88df1f8f4a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/038e4783159e41e3b2cb88df1f8f4a97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerActionsTestJSON-1967329631 Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 038e4783159e41e3b2cb88df1f8f4a97 Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerActionsTestJSON-1967329631 Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerActionsTestJSON-1967329631-project Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1f2613ad65b047e8b9a68907406d1874 Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerActionsTestJSON-1967329631-project Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance b9ae7d22-3925-465a-9507-250b670ecc77 could not be found. Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'b9ae7d22-3925-465a-9507-250b670ecc77'} Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9ae7d22-3925-465a-9507-250b670ecc77 could not be found. Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9ae7d22-3925-465a-9507-250b670ecc77 could not be found. Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:47:55.341743 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:55.348619 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:47:55.348619 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:47:55.348619 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:47:55.348619 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:47:55.348619 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:47:55.348619 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9ae7d22-3925-465a-9507-250b670ecc77 could not be found. Jul 19 22:47:55.348619 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:47:55.351321 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-62fa90b2-c202-45f4-9acc-c984bbed38e5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Returning 404 to user: Instance b9ae7d22-3925-465a-9507-250b670ecc77 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:47:55.352441 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-62fa90b2-c202-45f4-9acc-c984bbed38e5 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77" status: 404 len: 111 microversion: 2.1 time: 0.055783 Jul 19 22:47:55.353539 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2181/4323] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:55 2022] GET /compute/v2.1/servers/b9ae7d22-3925-465a-9507-250b670ecc77 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:47:55.360388 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c08fcb7d-d63b-4001-ac4d-8a56c87dc9da tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '.version_select at 0x7f7a0327d310>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:55.373552 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c08fcb7d-d63b-4001-ac4d-8a56c87dc9da tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:55.374261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c08fcb7d-d63b-4001-ac4d-8a56c87dc9da tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:55.374985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c08fcb7d-d63b-4001-ac4d-8a56c87dc9da tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:55.402308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c08fcb7d-d63b-4001-ac4d-8a56c87dc9da tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:55.405107 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c08fcb7d-d63b-4001-ac4d-8a56c87dc9da tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:55.409054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c08fcb7d-d63b-4001-ac4d-8a56c87dc9da tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:55.409890 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c08fcb7d-d63b-4001-ac4d-8a56c87dc9da tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:55.444034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bab06e7e-ffa5-41ba-8a9e-d9f87e9066bd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:55.454616 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bab06e7e-ffa5-41ba-8a9e-d9f87e9066bd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680" status: 200 len: 1317 microversion: 2.1 time: 0.503538 Jul 19 22:47:55.457007 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2143/4324] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:54 2022] GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 => generated 1317 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:55.462490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-027d3cbb-7410-449d-8117-65a67474e289 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] Calling method '.version_select at 0x7f7a032cc700>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:55.491312 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-027d3cbb-7410-449d-8117-65a67474e289 tempest-ServerActionsTestJSON-1967329631 tempest-ServerActionsTestJSON-1967329631-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054002135" status: 202 len: 0 microversion: 2.1 time: 0.029104 Jul 19 22:47:55.492705 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2144/4325] 10.222.0.25 () {58 vars in 1220 bytes} [Tue Jul 19 22:47:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054002135 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:47:55.516516 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c08fcb7d-d63b-4001-ac4d-8a56c87dc9da tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:55.524100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c08fcb7d-d63b-4001-ac4d-8a56c87dc9da tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:55.545556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c08fcb7d-d63b-4001-ac4d-8a56c87dc9da tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:55.547761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c08fcb7d-d63b-4001-ac4d-8a56c87dc9da tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:55.598070 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-c08fcb7d-d63b-4001-ac4d-8a56c87dc9da tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lazy-loading 'flavor' on Instance uuid 5c6695cc-7ed6-4ea1-8638-614e9892be75 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:47:55.634289 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c08fcb7d-d63b-4001-ac4d-8a56c87dc9da tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "PUT /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags/tempest-tag-1553786258" status: 201 len: 0 microversion: 2.26 time: 0.278806 Jul 19 22:47:55.642885 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2182/4326] 10.222.0.25 () {62 vars in 1379 bytes} [Tue Jul 19 22:47:55 2022] PUT /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags/tempest-tag-1553786258 => generated 0 bytes in 288 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 19 22:47:55.647731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e8d79220-c75f-4078-84c9-d5c5eb2f1da6 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '.version_select at 0x7f7a032970d0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:55.667233 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e8d79220-c75f-4078-84c9-d5c5eb2f1da6 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:55.667688 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e8d79220-c75f-4078-84c9-d5c5eb2f1da6 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:55.668467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e8d79220-c75f-4078-84c9-d5c5eb2f1da6 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:55.704413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e8d79220-c75f-4078-84c9-d5c5eb2f1da6 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:55.710333 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e8d79220-c75f-4078-84c9-d5c5eb2f1da6 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:55.712824 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e8d79220-c75f-4078-84c9-d5c5eb2f1da6 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:55.713588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e8d79220-c75f-4078-84c9-d5c5eb2f1da6 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:55.785930 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e8d79220-c75f-4078-84c9-d5c5eb2f1da6 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:55.787528 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e8d79220-c75f-4078-84c9-d5c5eb2f1da6 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:55.800910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e8d79220-c75f-4078-84c9-d5c5eb2f1da6 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:55.801489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e8d79220-c75f-4078-84c9-d5c5eb2f1da6 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:55.830450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2e6e9459-2f60-4bd6-ba38-86a24cbf58b3 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:55.831240 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2e6e9459-2f60-4bd6-ba38-86a24cbf58b3 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:55.849157 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2e6e9459-2f60-4bd6-ba38-86a24cbf58b3 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:55.850092 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2e6e9459-2f60-4bd6-ba38-86a24cbf58b3 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:55.851161 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2e6e9459-2f60-4bd6-ba38-86a24cbf58b3 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:55.851810 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2e6e9459-2f60-4bd6-ba38-86a24cbf58b3 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:55.904955 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-e8d79220-c75f-4078-84c9-d5c5eb2f1da6 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lazy-loading 'flavor' on Instance uuid 5c6695cc-7ed6-4ea1-8638-614e9892be75 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:47:55.962609 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e8d79220-c75f-4078-84c9-d5c5eb2f1da6 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "PUT /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags/tempest-tag-1840600766" status: 201 len: 0 microversion: 2.26 time: 0.317173 Jul 19 22:47:55.963841 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2145/4327] 10.222.0.25 () {62 vars in 1379 bytes} [Tue Jul 19 22:47:55 2022] PUT /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags/tempest-tag-1840600766 => generated 0 bytes in 321 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 19 22:47:55.982243 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f824874e-6fb8-4bb7-8a04-61ae64034cbf tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:55.983384 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f824874e-6fb8-4bb7-8a04-61ae64034cbf tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:55.994748 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f824874e-6fb8-4bb7-8a04-61ae64034cbf tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:55.995629 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f824874e-6fb8-4bb7-8a04-61ae64034cbf tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:55.996986 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f824874e-6fb8-4bb7-8a04-61ae64034cbf tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:55.997760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f824874e-6fb8-4bb7-8a04-61ae64034cbf tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:56.043814 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2e6e9459-2f60-4bd6-ba38-86a24cbf58b3 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:56.066172 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2e6e9459-2f60-4bd6-ba38-86a24cbf58b3 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:56.070617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2e6e9459-2f60-4bd6-ba38-86a24cbf58b3 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:56.073879 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2e6e9459-2f60-4bd6-ba38-86a24cbf58b3 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.250538 Jul 19 22:47:56.075721 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2183/4328] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:55 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:56.086500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-71421d7b-468a-42a7-b454-eced8ca5bf7f tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Action: 'update_all', calling method: .version_select at 0x7f7a0319ba60>, body: {"tags": ["tempest-tag-1411300839", "tempest-tag-944888499"]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:47:56.106165 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71421d7b-468a-42a7-b454-eced8ca5bf7f tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:56.111875 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71421d7b-468a-42a7-b454-eced8ca5bf7f tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:56.112650 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-71421d7b-468a-42a7-b454-eced8ca5bf7f tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:56.130741 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71421d7b-468a-42a7-b454-eced8ca5bf7f tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:56.132360 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71421d7b-468a-42a7-b454-eced8ca5bf7f tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:56.136970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71421d7b-468a-42a7-b454-eced8ca5bf7f tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:56.138543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71421d7b-468a-42a7-b454-eced8ca5bf7f tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:56.218235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71421d7b-468a-42a7-b454-eced8ca5bf7f tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:56.220516 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71421d7b-468a-42a7-b454-eced8ca5bf7f tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:56.288894 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-71421d7b-468a-42a7-b454-eced8ca5bf7f tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lazy-loading 'flavor' on Instance uuid 5c6695cc-7ed6-4ea1-8638-614e9892be75 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:47:56.323859 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-71421d7b-468a-42a7-b454-eced8ca5bf7f tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "PUT /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags" status: 200 len: 61 microversion: 2.26 time: 0.239022 Jul 19 22:47:56.324913 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2184/4329] 10.222.0.25 () {62 vars in 1311 bytes} [Tue Jul 19 22:47:56 2022] PUT /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags => generated 61 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:56.341930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d9814214-f165-4a40-a1e3-b8321ee73b27 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '.version_select at 0x7f7a0311f670>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:56.358457 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d9814214-f165-4a40-a1e3-b8321ee73b27 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:56.359222 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d9814214-f165-4a40-a1e3-b8321ee73b27 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:56.367692 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f824874e-6fb8-4bb7-8a04-61ae64034cbf tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:56.371354 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=89,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:47:56.377938 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d9814214-f165-4a40-a1e3-b8321ee73b27 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags" status: 200 len: 61 microversion: 2.26 time: 0.041103 Jul 19 22:47:56.379700 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2185/4330] 10.222.0.25 () {60 vars in 1291 bytes} [Tue Jul 19 22:47:56 2022] GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags => generated 61 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:47:56.382609 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f824874e-6fb8-4bb7-8a04-61ae64034cbf tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1734 microversion: 2.1 time: 0.417210 Jul 19 22:47:56.391146 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2146/4331] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:55 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1734 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:56.397534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0a839d82-9daa-49a3-8dbc-f045d8a4e5ec tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '.version_select at 0x7f7a0313e310>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:56.416180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a839d82-9daa-49a3-8dbc-f045d8a4e5ec tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:56.417704 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a839d82-9daa-49a3-8dbc-f045d8a4e5ec tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:56.418376 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0a839d82-9daa-49a3-8dbc-f045d8a4e5ec tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:56.427218 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a839d82-9daa-49a3-8dbc-f045d8a4e5ec tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:56.428077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a839d82-9daa-49a3-8dbc-f045d8a4e5ec tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:56.428650 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a839d82-9daa-49a3-8dbc-f045d8a4e5ec tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:56.429129 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a839d82-9daa-49a3-8dbc-f045d8a4e5ec tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:56.461721 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a839d82-9daa-49a3-8dbc-f045d8a4e5ec tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:56.462181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a839d82-9daa-49a3-8dbc-f045d8a4e5ec tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:56.474389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ff7d1797-63a8-4a8b-b636-840b3b9ba948 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:56.475020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ff7d1797-63a8-4a8b-b636-840b3b9ba948 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:56.485177 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ff7d1797-63a8-4a8b-b636-840b3b9ba948 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:56.486155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ff7d1797-63a8-4a8b-b636-840b3b9ba948 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:56.487187 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ff7d1797-63a8-4a8b-b636-840b3b9ba948 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:56.487816 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ff7d1797-63a8-4a8b-b636-840b3b9ba948 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:56.494048 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-0a839d82-9daa-49a3-8dbc-f045d8a4e5ec tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lazy-loading 'flavor' on Instance uuid 5c6695cc-7ed6-4ea1-8638-614e9892be75 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:47:56.530684 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0a839d82-9daa-49a3-8dbc-f045d8a4e5ec tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags" status: 204 len: 0 microversion: 2.26 time: 0.142060 Jul 19 22:47:56.531874 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2186/4332] 10.222.0.25 () {60 vars in 1294 bytes} [Tue Jul 19 22:47:56 2022] DELETE /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75/tags => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:47:56.546602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4d263b4f-6d36-4f53-881b-cf397e40c6d6 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:56.547206 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4d263b4f-6d36-4f53-881b-cf397e40c6d6 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:56.554467 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d263b4f-6d36-4f53-881b-cf397e40c6d6 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:56.554913 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d263b4f-6d36-4f53-881b-cf397e40c6d6 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:56.555898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d263b4f-6d36-4f53-881b-cf397e40c6d6 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:56.556363 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d263b4f-6d36-4f53-881b-cf397e40c6d6 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:56.639595 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4d263b4f-6d36-4f53-881b-cf397e40c6d6 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:47:56.779836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ff7d1797-63a8-4a8b-b636-840b3b9ba948 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:56.792895 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ff7d1797-63a8-4a8b-b636-840b3b9ba948 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680" status: 200 len: 1317 microversion: 2.1 time: 0.322536 Jul 19 22:47:56.794757 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2147/4333] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:56 2022] GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:56.811508 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4d263b4f-6d36-4f53-881b-cf397e40c6d6 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75" status: 204 len: 0 microversion: 2.26 time: 0.268907 Jul 19 22:47:56.812327 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2187/4334] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 22:47:56 2022] DELETE /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:47:56.831651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d0044e5e-930c-4b1b-a965-1446f664dcb4 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:56.832457 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d0044e5e-930c-4b1b-a965-1446f664dcb4 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:56.840238 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0044e5e-930c-4b1b-a965-1446f664dcb4 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:56.841124 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0044e5e-930c-4b1b-a965-1446f664dcb4 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:56.842149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0044e5e-930c-4b1b-a965-1446f664dcb4 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:56.842981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0044e5e-930c-4b1b-a965-1446f664dcb4 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:57.119461 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6ff2498c-45b6-4398-8cb3-307c8f2cd809 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:57.122064 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6ff2498c-45b6-4398-8cb3-307c8f2cd809 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:57.132619 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d0044e5e-930c-4b1b-a965-1446f664dcb4 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:57.134960 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ff2498c-45b6-4398-8cb3-307c8f2cd809 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:57.135456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ff2498c-45b6-4398-8cb3-307c8f2cd809 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:57.136415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ff2498c-45b6-4398-8cb3-307c8f2cd809 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:57.136869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ff2498c-45b6-4398-8cb3-307c8f2cd809 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:57.149353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d0044e5e-930c-4b1b-a965-1446f664dcb4 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:57.155728 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d0044e5e-930c-4b1b-a965-1446f664dcb4 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:57.169337 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d0044e5e-930c-4b1b-a965-1446f664dcb4 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75" status: 200 len: 1552 microversion: 2.26 time: 0.342024 Jul 19 22:47:57.176495 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2148/4335] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:56 2022] GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75 => generated 1552 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:57.200814 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-1aa1f8b5-f306-4c96-b61f-b78343f76054 req-f21e0d86-cde4-48e3-8ee2-6531cdec1dbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680", "name": "network-vif-plugged", "status": "completed", "tag": "54ea3c14-691f-48cd-b768-0d1a603975a2"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:47:57.234390 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1aa1f8b5-f306-4c96-b61f-b78343f76054 req-f21e0d86-cde4-48e3-8ee2-6531cdec1dbf service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:57.235404 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1aa1f8b5-f306-4c96-b61f-b78343f76054 req-f21e0d86-cde4-48e3-8ee2-6531cdec1dbf service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:57.279942 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-1aa1f8b5-f306-4c96-b61f-b78343f76054 req-f21e0d86-cde4-48e3-8ee2-6531cdec1dbf service nova] Creating event network-vif-plugged:54ea3c14-691f-48cd-b768-0d1a603975a2 for instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 on n-h2-847009-3 Jul 19 22:47:57.291486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6ff2498c-45b6-4398-8cb3-307c8f2cd809 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:57.293666 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-1aa1f8b5-f306-4c96-b61f-b78343f76054 req-f21e0d86-cde4-48e3-8ee2-6531cdec1dbf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114075 Jul 19 22:47:57.298011 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2149/4336] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:47:57.307741 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6ff2498c-45b6-4398-8cb3-307c8f2cd809 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:57.309763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6ff2498c-45b6-4398-8cb3-307c8f2cd809 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:57.314115 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6ff2498c-45b6-4398-8cb3-307c8f2cd809 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.206042 Jul 19 22:47:57.314710 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2188/4337] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:57 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:47:57.408888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c1a4d9a3-d958-4a7c-8580-aebb232ec92b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:57.409959 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c1a4d9a3-d958-4a7c-8580-aebb232ec92b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:57.430135 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c1a4d9a3-d958-4a7c-8580-aebb232ec92b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:57.434686 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c1a4d9a3-d958-4a7c-8580-aebb232ec92b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:57.436153 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c1a4d9a3-d958-4a7c-8580-aebb232ec92b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:57.437208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c1a4d9a3-d958-4a7c-8580-aebb232ec92b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:57.673846 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c1a4d9a3-d958-4a7c-8580-aebb232ec92b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:57.683905 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c1a4d9a3-d958-4a7c-8580-aebb232ec92b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1734 microversion: 2.1 time: 0.279755 Jul 19 22:47:57.684508 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2150/4338] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:57 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1734 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:57.822341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3b07870c-ba04-493e-904c-39b2530b4372 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:57.822964 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3b07870c-ba04-493e-904c-39b2530b4372 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:57.841034 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b07870c-ba04-493e-904c-39b2530b4372 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:57.841491 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b07870c-ba04-493e-904c-39b2530b4372 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:57.842276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b07870c-ba04-493e-904c-39b2530b4372 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:57.842708 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b07870c-ba04-493e-904c-39b2530b4372 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:58.066304 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3b07870c-ba04-493e-904c-39b2530b4372 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:58.079729 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3b07870c-ba04-493e-904c-39b2530b4372 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680" status: 200 len: 1317 microversion: 2.1 time: 0.270262 Jul 19 22:47:58.096150 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2189/4339] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:57 2022] GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:58.224933 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ded54a69-3c36-4c34-b9ad-98a7a3fb49ad tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:58.226134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ded54a69-3c36-4c34-b9ad-98a7a3fb49ad tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:58.240837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ded54a69-3c36-4c34-b9ad-98a7a3fb49ad tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:58.240837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ded54a69-3c36-4c34-b9ad-98a7a3fb49ad tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:58.241498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ded54a69-3c36-4c34-b9ad-98a7a3fb49ad tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:58.242081 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ded54a69-3c36-4c34-b9ad-98a7a3fb49ad tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:58.337327 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-65e3f3e1-ab7c-4b4d-996f-e1036804f60c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:58.338142 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-65e3f3e1-ab7c-4b4d-996f-e1036804f60c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:58.347176 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65e3f3e1-ab7c-4b4d-996f-e1036804f60c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:58.347992 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65e3f3e1-ab7c-4b4d-996f-e1036804f60c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:58.349106 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65e3f3e1-ab7c-4b4d-996f-e1036804f60c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:58.349667 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65e3f3e1-ab7c-4b4d-996f-e1036804f60c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:58.616664 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-65e3f3e1-ab7c-4b4d-996f-e1036804f60c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:58.661359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-65e3f3e1-ab7c-4b4d-996f-e1036804f60c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:58.680921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-65e3f3e1-ab7c-4b4d-996f-e1036804f60c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:58.682193 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-65e3f3e1-ab7c-4b4d-996f-e1036804f60c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.352582 Jul 19 22:47:58.691215 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2190/4340] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:58 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:58.722633 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6e890faa-d1c1-43d8-80b8-b21839b8731e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:58.727400 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6e890faa-d1c1-43d8-80b8-b21839b8731e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:58.742054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e890faa-d1c1-43d8-80b8-b21839b8731e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:58.752303 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e890faa-d1c1-43d8-80b8-b21839b8731e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:58.763361 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e890faa-d1c1-43d8-80b8-b21839b8731e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:58.764752 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6e890faa-d1c1-43d8-80b8-b21839b8731e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:58.866908 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ded54a69-3c36-4c34-b9ad-98a7a3fb49ad tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:58.882985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ded54a69-3c36-4c34-b9ad-98a7a3fb49ad tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:58.884817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ded54a69-3c36-4c34-b9ad-98a7a3fb49ad tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:58.886289 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ded54a69-3c36-4c34-b9ad-98a7a3fb49ad tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75" status: 200 len: 1552 microversion: 2.26 time: 0.683527 Jul 19 22:47:58.888212 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2151/4341] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:58 2022] GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75 => generated 1552 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:47:59.113180 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e9fff583-eae0-4169-9feb-4e29b11a93b6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:59.114207 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e9fff583-eae0-4169-9feb-4e29b11a93b6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:59.138801 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e9fff583-eae0-4169-9feb-4e29b11a93b6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:59.145552 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e9fff583-eae0-4169-9feb-4e29b11a93b6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:59.155918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e9fff583-eae0-4169-9feb-4e29b11a93b6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:59.167199 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e9fff583-eae0-4169-9feb-4e29b11a93b6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:59.240002 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6e890faa-d1c1-43d8-80b8-b21839b8731e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:59.262207 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6e890faa-d1c1-43d8-80b8-b21839b8731e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1734 microversion: 2.1 time: 0.552353 Jul 19 22:47:59.273641 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2191/4342] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:58 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1734 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:59.463689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e9fff583-eae0-4169-9feb-4e29b11a93b6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:47:59.474091 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e9fff583-eae0-4169-9feb-4e29b11a93b6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680" status: 200 len: 1505 microversion: 2.1 time: 0.370906 Jul 19 22:47:59.474986 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2152/4343] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:59 2022] GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 => generated 1505 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:47:59.502404 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9870eb6d-beac-4bde-8599-9ff3d444c017 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:59.504174 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9870eb6d-beac-4bde-8599-9ff3d444c017 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:59.517020 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9870eb6d-beac-4bde-8599-9ff3d444c017 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:59.517464 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9870eb6d-beac-4bde-8599-9ff3d444c017 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:59.523120 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9870eb6d-beac-4bde-8599-9ff3d444c017 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:59.524113 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9870eb6d-beac-4bde-8599-9ff3d444c017 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:59.556691 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9870eb6d-beac-4bde-8599-9ff3d444c017 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:47:59.728291 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-80db5dab-1cbd-4e74-ba3d-e82d9766ee97 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:59.729546 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-80db5dab-1cbd-4e74-ba3d-e82d9766ee97 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:59.754028 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-80db5dab-1cbd-4e74-ba3d-e82d9766ee97 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:59.757044 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-80db5dab-1cbd-4e74-ba3d-e82d9766ee97 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:59.759510 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-80db5dab-1cbd-4e74-ba3d-e82d9766ee97 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:59.760228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-80db5dab-1cbd-4e74-ba3d-e82d9766ee97 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:59.802853 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9870eb6d-beac-4bde-8599-9ff3d444c017 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680" status: 204 len: 0 microversion: 2.1 time: 0.301777 Jul 19 22:47:59.811777 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2192/4344] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:47:59 2022] DELETE /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:47:59.825148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c89ee3f4-b7ed-48ca-941d-7f20b55b51ab tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:47:59.826175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c89ee3f4-b7ed-48ca-941d-7f20b55b51ab tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:47:59.860251 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c89ee3f4-b7ed-48ca-941d-7f20b55b51ab tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:59.862870 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c89ee3f4-b7ed-48ca-941d-7f20b55b51ab tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:59.877654 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c89ee3f4-b7ed-48ca-941d-7f20b55b51ab tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:47:59.878408 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c89ee3f4-b7ed-48ca-941d-7f20b55b51ab tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:47:59.990627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-80db5dab-1cbd-4e74-ba3d-e82d9766ee97 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:00.004442 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-80db5dab-1cbd-4e74-ba3d-e82d9766ee97 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:00.012725 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-80db5dab-1cbd-4e74-ba3d-e82d9766ee97 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:00.013242 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-80db5dab-1cbd-4e74-ba3d-e82d9766ee97 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.302100 Jul 19 22:48:00.013913 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2153/4345] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:47:59 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:00.038977 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1b11b5a0-d8dc-4de6-88f7-a545ec9ae95a tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:00.043877 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1b11b5a0-d8dc-4de6-88f7-a545ec9ae95a tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:00.067070 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b11b5a0-d8dc-4de6-88f7-a545ec9ae95a tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:00.069244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b11b5a0-d8dc-4de6-88f7-a545ec9ae95a tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:00.070080 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b11b5a0-d8dc-4de6-88f7-a545ec9ae95a tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:00.070522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b11b5a0-d8dc-4de6-88f7-a545ec9ae95a tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:00.382238 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1b11b5a0-d8dc-4de6-88f7-a545ec9ae95a tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:00.387997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:48:00.441214 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1b11b5a0-d8dc-4de6-88f7-a545ec9ae95a tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:00.443565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1b11b5a0-d8dc-4de6-88f7-a545ec9ae95a tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:00.444858 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1b11b5a0-d8dc-4de6-88f7-a545ec9ae95a tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75" status: 200 len: 1510 microversion: 2.26 time: 0.428572 Jul 19 22:48:00.458627 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2154/4346] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:00 2022] GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75 => generated 1510 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:00.470302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-926b9eb0-2cd4-4289-aab3-3066dd98dd4b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:00.470945 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-926b9eb0-2cd4-4289-aab3-3066dd98dd4b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:00.517527 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-926b9eb0-2cd4-4289-aab3-3066dd98dd4b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:00.525498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-926b9eb0-2cd4-4289-aab3-3066dd98dd4b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:00.527007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-926b9eb0-2cd4-4289-aab3-3066dd98dd4b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:00.530477 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-926b9eb0-2cd4-4289-aab3-3066dd98dd4b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:00.642355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c89ee3f4-b7ed-48ca-941d-7f20b55b51ab tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:00.655984 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c89ee3f4-b7ed-48ca-941d-7f20b55b51ab tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680" status: 200 len: 1511 microversion: 2.1 time: 0.838397 Jul 19 22:48:00.667303 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2193/4347] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:47:59 2022] GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 => generated 1511 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:48:00.699255 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-0f7aef2b-41fe-4d8c-8406-9760d77d70b5 req-36de44dc-5f84-4870-916b-8cabac43d8d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c6695cc-7ed6-4ea1-8638-614e9892be75", "name": "network-vif-deleted", "tag": "46e23ba4-562d-4256-a087-db5befb3b61b"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:00.741093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0f7aef2b-41fe-4d8c-8406-9760d77d70b5 req-36de44dc-5f84-4870-916b-8cabac43d8d0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:00.743205 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0f7aef2b-41fe-4d8c-8406-9760d77d70b5 req-36de44dc-5f84-4870-916b-8cabac43d8d0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:00.792277 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-0f7aef2b-41fe-4d8c-8406-9760d77d70b5 req-36de44dc-5f84-4870-916b-8cabac43d8d0 service nova] Creating event network-vif-deleted:46e23ba4-562d-4256-a087-db5befb3b61b for instance 5c6695cc-7ed6-4ea1-8638-614e9892be75 on n-h1-847009-3 Jul 19 22:48:00.819536 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-0f7aef2b-41fe-4d8c-8406-9760d77d70b5 req-36de44dc-5f84-4870-916b-8cabac43d8d0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145386 Jul 19 22:48:00.822374 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2194/4348] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:48:00.842811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-926b9eb0-2cd4-4289-aab3-3066dd98dd4b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:00.855208 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-926b9eb0-2cd4-4289-aab3-3066dd98dd4b tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1734 microversion: 2.1 time: 0.395323 Jul 19 22:48:00.856587 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2155/4349] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:00 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1734 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:01.047264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d366e169-6791-4f0f-a2bd-68bdbb6096e1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:01.047995 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d366e169-6791-4f0f-a2bd-68bdbb6096e1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:01.066245 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d366e169-6791-4f0f-a2bd-68bdbb6096e1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:01.066986 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d366e169-6791-4f0f-a2bd-68bdbb6096e1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:01.067824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d366e169-6791-4f0f-a2bd-68bdbb6096e1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:01.071055 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d366e169-6791-4f0f-a2bd-68bdbb6096e1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:01.303767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d366e169-6791-4f0f-a2bd-68bdbb6096e1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:01.329364 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d366e169-6791-4f0f-a2bd-68bdbb6096e1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:01.332584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d366e169-6791-4f0f-a2bd-68bdbb6096e1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:01.337838 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d366e169-6791-4f0f-a2bd-68bdbb6096e1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.295199 Jul 19 22:48:01.339507 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2195/4350] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:01 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:01.470926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-29d85d56-1927-4b72-8e4b-ef373a3c568b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:01.472799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-29d85d56-1927-4b72-8e4b-ef373a3c568b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:01.514035 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-29d85d56-1927-4b72-8e4b-ef373a3c568b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:01.517098 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-29d85d56-1927-4b72-8e4b-ef373a3c568b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:01.523170 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-29d85d56-1927-4b72-8e4b-ef373a3c568b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:01.526808 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-29d85d56-1927-4b72-8e4b-ef373a3c568b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:01.675466 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-26e07452-430f-45bb-b34f-e08442b2c789 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:01.676256 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-26e07452-430f-45bb-b34f-e08442b2c789 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:01.697023 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-29d85d56-1927-4b72-8e4b-ef373a3c568b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:01.697817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-29d85d56-1927-4b72-8e4b-ef373a3c568b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:01.698859 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-29d85d56-1927-4b72-8e4b-ef373a3c568b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lazy-loading 'fault' on Instance uuid 5c6695cc-7ed6-4ea1-8638-614e9892be75 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:48:01.706846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-26e07452-430f-45bb-b34f-e08442b2c789 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:01.712395 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-26e07452-430f-45bb-b34f-e08442b2c789 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:01.714890 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-26e07452-430f-45bb-b34f-e08442b2c789 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:01.717680 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-26e07452-430f-45bb-b34f-e08442b2c789 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:01.970935 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-29d85d56-1927-4b72-8e4b-ef373a3c568b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:01.989529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-29d85d56-1927-4b72-8e4b-ef373a3c568b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:01.993611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-29d85d56-1927-4b72-8e4b-ef373a3c568b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cce459ab0f14f39b806ab2fb8e90f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14d82cb4d8a4c1084c5f43d954d83f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:01.995723 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-29d85d56-1927-4b72-8e4b-ef373a3c568b tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75" status: 200 len: 1352 microversion: 2.26 time: 0.532268 Jul 19 22:48:02.011952 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2156/4351] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:01 2022] GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75 => generated 1352 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:02.022116 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fb8f8de5-3aba-470d-9fcb-0c79dbc0ee9c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:02.023363 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fb8f8de5-3aba-470d-9fcb-0c79dbc0ee9c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:02.040192 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fb8f8de5-3aba-470d-9fcb-0c79dbc0ee9c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:02.043255 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fb8f8de5-3aba-470d-9fcb-0c79dbc0ee9c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:02.045478 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fb8f8de5-3aba-470d-9fcb-0c79dbc0ee9c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:02.047687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fb8f8de5-3aba-470d-9fcb-0c79dbc0ee9c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:02.357961 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-26e07452-430f-45bb-b34f-e08442b2c789 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:02.374817 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-26e07452-430f-45bb-b34f-e08442b2c789 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680" status: 200 len: 1511 microversion: 2.1 time: 0.703996 Jul 19 22:48:02.377029 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2196/4352] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:01 2022] GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 => generated 1511 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:02.382558 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4fdec7f4-f8d4-4dee-b392-af73b4cc7263 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:02.386269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4fdec7f4-f8d4-4dee-b392-af73b4cc7263 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:02.401495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4fdec7f4-f8d4-4dee-b392-af73b4cc7263 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:02.404720 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4fdec7f4-f8d4-4dee-b392-af73b4cc7263 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:02.405694 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4fdec7f4-f8d4-4dee-b392-af73b4cc7263 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:02.406316 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4fdec7f4-f8d4-4dee-b392-af73b4cc7263 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:02.589912 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4fdec7f4-f8d4-4dee-b392-af73b4cc7263 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:02.597722 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fb8f8de5-3aba-470d-9fcb-0c79dbc0ee9c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:02.612726 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4fdec7f4-f8d4-4dee-b392-af73b4cc7263 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:02.614320 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fb8f8de5-3aba-470d-9fcb-0c79dbc0ee9c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1734 microversion: 2.1 time: 0.600685 Jul 19 22:48:02.616536 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4fdec7f4-f8d4-4dee-b392-af73b4cc7263 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:02.631197 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2157/4353] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:02 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1734 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:02.635630 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4fdec7f4-f8d4-4dee-b392-af73b4cc7263 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.255250 Jul 19 22:48:02.639363 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2197/4354] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:02 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:02.929050 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-59c10802-d1af-454e-8848-bc51c55f6c14 req-0ddc3413-8060-4639-adf7-6b83e2247a72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680", "name": "network-vif-deleted", "tag": "54ea3c14-691f-48cd-b768-0d1a603975a2"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:02.950460 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-59c10802-d1af-454e-8848-bc51c55f6c14 req-0ddc3413-8060-4639-adf7-6b83e2247a72 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:02.951018 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-59c10802-d1af-454e-8848-bc51c55f6c14 req-0ddc3413-8060-4639-adf7-6b83e2247a72 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:02.992644 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-59c10802-d1af-454e-8848-bc51c55f6c14 req-0ddc3413-8060-4639-adf7-6b83e2247a72 service nova] Creating event network-vif-deleted:54ea3c14-691f-48cd-b768-0d1a603975a2 for instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 on n-h2-847009-3 Jul 19 22:48:03.016669 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-edbd9e63-2eb2-41a4-8ef6-2651d73b0ce7 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:03.019425 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-edbd9e63-2eb2-41a4-8ef6-2651d73b0ce7 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] [instance: 5c6695cc-7ed6-4ea1-8638-614e9892be75] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:03.034012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-edbd9e63-2eb2-41a4-8ef6-2651d73b0ce7 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:03.038156 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-59c10802-d1af-454e-8848-bc51c55f6c14 req-0ddc3413-8060-4639-adf7-6b83e2247a72 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113069 Jul 19 22:48:03.041855 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2158/4355] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:48:03.045803 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-edbd9e63-2eb2-41a4-8ef6-2651d73b0ce7 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:03.051647 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-edbd9e63-2eb2-41a4-8ef6-2651d73b0ce7 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:03.052262 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-edbd9e63-2eb2-41a4-8ef6-2651d73b0ce7 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:03.090478 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-edbd9e63-2eb2-41a4-8ef6-2651d73b0ce7 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] HTTP exception thrown: Instance 5c6695cc-7ed6-4ea1-8638-614e9892be75 could not be found. Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-edbd9e63-2eb2-41a4-8ef6-2651d73b0ce7 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Request method failure captured: Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75 HTTP/1.1 Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zSDDNqwzQCx95fZE7eA8mwHPrHdLOP2_Z0eRUNrslWWnsw6-RiWeMp5XjOGLQR2mG609Jr8cQvdl-HrwFCuBEqwRZfm86ArdCGA6eOSSmCJmSgGr_Nrkg3aVTPD2YxehFTLavKMigUiLY6z6bpOoYMMEwZzO56hHY95ty73W5y2f3E Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: X-Openstack-Nova-Api-Version: 2.26 Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a14d82cb4d8a4c1084c5f43d954d83f1 Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerTagsTestJSON-1494127044 Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a14d82cb4d8a4c1084c5f43d954d83f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a14d82cb4d8a4c1084c5f43d954d83f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a14d82cb4d8a4c1084c5f43d954d83f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a14d82cb4d8a4c1084c5f43d954d83f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerTagsTestJSON-1494127044 Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a14d82cb4d8a4c1084c5f43d954d83f1 Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerTagsTestJSON-1494127044 Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerTagsTestJSON-1494127044-project Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 5cce459ab0f14f39b806ab2fb8e90f83 Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerTagsTestJSON-1494127044-project Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 5c6695cc-7ed6-4ea1-8638-614e9892be75 could not be found. Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '5c6695cc-7ed6-4ea1-8638-614e9892be75'} Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c6695cc-7ed6-4ea1-8638-614e9892be75 could not be found. Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c6695cc-7ed6-4ea1-8638-614e9892be75 could not be found. Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:03.093185 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:03.097108 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:03.097108 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:03.097108 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:03.097108 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:03.097108 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:03.097108 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c6695cc-7ed6-4ea1-8638-614e9892be75 could not be found. Jul 19 22:48:03.097108 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:03.099278 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-edbd9e63-2eb2-41a4-8ef6-2651d73b0ce7 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] Returning 404 to user: Instance 5c6695cc-7ed6-4ea1-8638-614e9892be75 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:03.102880 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-edbd9e63-2eb2-41a4-8ef6-2651d73b0ce7 tempest-ServerTagsTestJSON-1494127044 tempest-ServerTagsTestJSON-1494127044-project] 10.222.0.25 "GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75" status: 404 len: 111 microversion: 2.26 time: 0.088891 Jul 19 22:48:03.103857 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2198/4356] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:03 2022] GET /compute/v2.1/servers/5c6695cc-7ed6-4ea1-8638-614e9892be75 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 19 22:48:03.396282 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f991b6ae-c0fc-47f0-b142-44119d83069c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:03.397127 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f991b6ae-c0fc-47f0-b142-44119d83069c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:03.416929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f991b6ae-c0fc-47f0-b142-44119d83069c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:03.417948 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f991b6ae-c0fc-47f0-b142-44119d83069c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:03.420551 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f991b6ae-c0fc-47f0-b142-44119d83069c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:03.423171 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f991b6ae-c0fc-47f0-b142-44119d83069c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:03.486003 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f991b6ae-c0fc-47f0-b142-44119d83069c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:03.488740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f991b6ae-c0fc-47f0-b142-44119d83069c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:03.489528 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-f991b6ae-c0fc-47f0-b142-44119d83069c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lazy-loading 'fault' on Instance uuid 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:48:03.652878 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-615ce630-84d3-4258-a369-8bf2e9051b82 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:03.655537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-615ce630-84d3-4258-a369-8bf2e9051b82 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:03.676778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-615ce630-84d3-4258-a369-8bf2e9051b82 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:03.677926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-615ce630-84d3-4258-a369-8bf2e9051b82 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:03.679058 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f991b6ae-c0fc-47f0-b142-44119d83069c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:03.680634 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-615ce630-84d3-4258-a369-8bf2e9051b82 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:03.681748 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-615ce630-84d3-4258-a369-8bf2e9051b82 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:03.691924 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f991b6ae-c0fc-47f0-b142-44119d83069c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680" status: 200 len: 1307 microversion: 2.1 time: 0.301201 Jul 19 22:48:03.693902 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2159/4357] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:03 2022] GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 => generated 1307 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:03.707363 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-de4e580e-23fb-4a39-b62b-e569e2133ba7 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:03.708266 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-de4e580e-23fb-4a39-b62b-e569e2133ba7 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:03.717035 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de4e580e-23fb-4a39-b62b-e569e2133ba7 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:03.717975 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de4e580e-23fb-4a39-b62b-e569e2133ba7 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:03.719651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de4e580e-23fb-4a39-b62b-e569e2133ba7 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:03.720753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de4e580e-23fb-4a39-b62b-e569e2133ba7 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:03.911225 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-de4e580e-23fb-4a39-b62b-e569e2133ba7 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:03.925808 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-de4e580e-23fb-4a39-b62b-e569e2133ba7 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:03.928475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-de4e580e-23fb-4a39-b62b-e569e2133ba7 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:03.932802 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-de4e580e-23fb-4a39-b62b-e569e2133ba7 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.237591 Jul 19 22:48:03.933559 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2160/4358] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:03 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:04.037313 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-615ce630-84d3-4258-a369-8bf2e9051b82 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:04.054032 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-615ce630-84d3-4258-a369-8bf2e9051b82 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1734 microversion: 2.1 time: 0.406943 Jul 19 22:48:04.055467 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2199/4359] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:03 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1734 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:04.714377 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ca77caef-bcef-48ae-ae23-17219aab6941 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:04.715245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ca77caef-bcef-48ae-ae23-17219aab6941 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:04.730132 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca77caef-bcef-48ae-ae23-17219aab6941 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:04.732700 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca77caef-bcef-48ae-ae23-17219aab6941 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:04.738095 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca77caef-bcef-48ae-ae23-17219aab6941 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:04.738831 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca77caef-bcef-48ae-ae23-17219aab6941 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:04.773231 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-ca77caef-bcef-48ae-ae23-17219aab6941 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ca77caef-bcef-48ae-ae23-17219aab6941 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 HTTP/1.1 Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680'} Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:04.792447 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:04.796648 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:04.796648 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:04.796648 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:04.796648 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:04.796648 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:04.796648 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. Jul 19 22:48:04.796648 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:04.796648 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ca77caef-bcef-48ae-ae23-17219aab6941 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 404 to user: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:04.796648 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ca77caef-bcef-48ae-ae23-17219aab6941 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680" status: 404 len: 111 microversion: 2.1 time: 0.087597 Jul 19 22:48:04.803140 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2161/4360] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:04 2022] GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:48:04.814875 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c642e66a-3113-4559-ba7d-0583c8879fe9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:04.814875 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c642e66a-3113-4559-ba7d-0583c8879fe9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:04.833435 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c642e66a-3113-4559-ba7d-0583c8879fe9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:04.834363 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c642e66a-3113-4559-ba7d-0583c8879fe9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:04.836185 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c642e66a-3113-4559-ba7d-0583c8879fe9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:04.837172 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c642e66a-3113-4559-ba7d-0583c8879fe9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:04.846865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=1,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:48:04.960354 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7d59cd6d-2b3e-4cf7-b5c9-d515e35e18f1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:04.961309 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7d59cd6d-2b3e-4cf7-b5c9-d515e35e18f1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:04.981988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d59cd6d-2b3e-4cf7-b5c9-d515e35e18f1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:04.982456 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d59cd6d-2b3e-4cf7-b5c9-d515e35e18f1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:04.983304 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d59cd6d-2b3e-4cf7-b5c9-d515e35e18f1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:04.983760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d59cd6d-2b3e-4cf7-b5c9-d515e35e18f1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:05.164588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7d59cd6d-2b3e-4cf7-b5c9-d515e35e18f1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:05.182607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7d59cd6d-2b3e-4cf7-b5c9-d515e35e18f1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:05.185653 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7d59cd6d-2b3e-4cf7-b5c9-d515e35e18f1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:05.187940 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7d59cd6d-2b3e-4cf7-b5c9-d515e35e18f1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.234963 Jul 19 22:48:05.200218 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2162/4361] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:04 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:48:05.214039 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6d6d4d06-1a4c-48e9-a856-0a327615de27 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:05.214917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6d6d4d06-1a4c-48e9-a856-0a327615de27 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:05.222400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d6d4d06-1a4c-48e9-a856-0a327615de27 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:05.223139 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d6d4d06-1a4c-48e9-a856-0a327615de27 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:05.224126 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d6d4d06-1a4c-48e9-a856-0a327615de27 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:05.224793 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d6d4d06-1a4c-48e9-a856-0a327615de27 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:05.234514 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c642e66a-3113-4559-ba7d-0583c8879fe9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:05.256485 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c642e66a-3113-4559-ba7d-0583c8879fe9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.450388 Jul 19 22:48:05.259466 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2200/4362] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:04 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:05.537913 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ca164bf5-033a-4caa-980f-9fa0e9036408 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "711438ef-9562-4879-b7e2-ec9cf463e48f"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ca164bf5-033a-4caa-980f-9fa0e9036408 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 163 Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: {"server": {"name": 12345, "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "711438ef-9562-4879-b7e2-ec9cf463e48f"}]}} Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691', 'flavorRef': '452', 'networks': [{'uuid': '711438ef-9562-4879-b7e2-ec9cf463e48f'}]}}} Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi 12345 Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:48:05.541456 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:48:05.545866 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:48:05.545866 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 19 22:48:05.545866 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:05.545866 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:05.545866 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:05.545866 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:05.545866 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:05.545866 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:05.545866 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:48:05.545866 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:48:05.545866 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 19 22:48:05.545866 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:05.545866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ca164bf5-033a-4caa-980f-9fa0e9036408 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:05.550185 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ca164bf5-033a-4caa-980f-9fa0e9036408 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.009561 Jul 19 22:48:05.551613 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2201/4363] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:48:05 2022] POST /compute/v2.1/servers => generated 127 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:48:05.570509 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-38656f8d-395f-4d01-af44-7691d3142daa tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:05.571679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-38656f8d-395f-4d01-af44-7691d3142daa tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:05.573456 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6d6d4d06-1a4c-48e9-a856-0a327615de27 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:05.585389 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-38656f8d-395f-4d01-af44-7691d3142daa tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:05.587723 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6d6d4d06-1a4c-48e9-a856-0a327615de27 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1734 microversion: 2.1 time: 0.385789 Jul 19 22:48:05.588426 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-38656f8d-395f-4d01-af44-7691d3142daa tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:05.589605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-38656f8d-395f-4d01-af44-7691d3142daa tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:05.591956 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-38656f8d-395f-4d01-af44-7691d3142daa tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:05.601562 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2163/4364] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:05 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1734 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:05.866164 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-38656f8d-395f-4d01-af44-7691d3142daa tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:05.877402 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-38656f8d-395f-4d01-af44-7691d3142daa tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.320844 Jul 19 22:48:05.881227 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2202/4365] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:05 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:05.900289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4a38569b-dd57-470f-81f5-f96d90132621 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:05.901614 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4a38569b-dd57-470f-81f5-f96d90132621 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:05.913073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4a38569b-dd57-470f-81f5-f96d90132621 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:05.913822 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4a38569b-dd57-470f-81f5-f96d90132621 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:05.914759 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4a38569b-dd57-470f-81f5-f96d90132621 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:05.915829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4a38569b-dd57-470f-81f5-f96d90132621 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:06.185079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4a38569b-dd57-470f-81f5-f96d90132621 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:06.202468 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4a38569b-dd57-470f-81f5-f96d90132621 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.306816 Jul 19 22:48:06.216441 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2164/4366] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:05 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:06.239869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0696865f-f4b3-4aef-a161-5970fbb603bf tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:06.240952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0696865f-f4b3-4aef-a161-5970fbb603bf tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:06.265100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0696865f-f4b3-4aef-a161-5970fbb603bf tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:06.270611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0696865f-f4b3-4aef-a161-5970fbb603bf tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:06.272374 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0696865f-f4b3-4aef-a161-5970fbb603bf tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:06.275718 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0696865f-f4b3-4aef-a161-5970fbb603bf tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:06.455695 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0696865f-f4b3-4aef-a161-5970fbb603bf tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:06.474862 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0696865f-f4b3-4aef-a161-5970fbb603bf tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:06.480937 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0696865f-f4b3-4aef-a161-5970fbb603bf tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:06.482372 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0696865f-f4b3-4aef-a161-5970fbb603bf tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.267939 Jul 19 22:48:06.485564 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2203/4367] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:06 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:06.610449 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0017fa78-b027-450a-8cd9-fc67e1fa2953 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:06.611394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0017fa78-b027-450a-8cd9-fc67e1fa2953 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:06.629342 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0017fa78-b027-450a-8cd9-fc67e1fa2953 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:06.630160 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0017fa78-b027-450a-8cd9-fc67e1fa2953 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:06.634415 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0017fa78-b027-450a-8cd9-fc67e1fa2953 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:06.635173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0017fa78-b027-450a-8cd9-fc67e1fa2953 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:06.946666 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0017fa78-b027-450a-8cd9-fc67e1fa2953 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:06.961232 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0017fa78-b027-450a-8cd9-fc67e1fa2953 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1734 microversion: 2.1 time: 0.356519 Jul 19 22:48:06.962402 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2165/4368] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:06 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1734 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:07.501549 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-99587b08-15db-4a16-bbfb-01aff8e3cee8 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:07.502228 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-99587b08-15db-4a16-bbfb-01aff8e3cee8 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:07.520030 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-99587b08-15db-4a16-bbfb-01aff8e3cee8 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:07.520710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-99587b08-15db-4a16-bbfb-01aff8e3cee8 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:07.523832 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-99587b08-15db-4a16-bbfb-01aff8e3cee8 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:07.525185 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-99587b08-15db-4a16-bbfb-01aff8e3cee8 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:07.676657 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-99587b08-15db-4a16-bbfb-01aff8e3cee8 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:07.687241 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-99587b08-15db-4a16-bbfb-01aff8e3cee8 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:07.691875 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-99587b08-15db-4a16-bbfb-01aff8e3cee8 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:07.693881 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-99587b08-15db-4a16-bbfb-01aff8e3cee8 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.197160 Jul 19 22:48:07.695019 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2204/4369] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:07 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:07.980367 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cd466e10-6bbf-4f70-bd84-7edca7216a09 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:07.980768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cd466e10-6bbf-4f70-bd84-7edca7216a09 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:08.006811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd466e10-6bbf-4f70-bd84-7edca7216a09 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:08.007544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd466e10-6bbf-4f70-bd84-7edca7216a09 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:08.008466 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd466e10-6bbf-4f70-bd84-7edca7216a09 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:08.015240 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd466e10-6bbf-4f70-bd84-7edca7216a09 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:08.667980 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cd466e10-6bbf-4f70-bd84-7edca7216a09 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:08.680492 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cd466e10-6bbf-4f70-bd84-7edca7216a09 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1734 microversion: 2.1 time: 0.704884 Jul 19 22:48:08.681951 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2166/4370] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:07 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1734 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:08.713921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-42d4544c-878b-44f7-8f99-f3767925a46c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:08.715128 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-42d4544c-878b-44f7-8f99-f3767925a46c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:08.725274 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-42d4544c-878b-44f7-8f99-f3767925a46c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:08.728848 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-42d4544c-878b-44f7-8f99-f3767925a46c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:08.736926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-42d4544c-878b-44f7-8f99-f3767925a46c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:08.737384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-42d4544c-878b-44f7-8f99-f3767925a46c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:08.889264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-42d4544c-878b-44f7-8f99-f3767925a46c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:08.899969 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-42d4544c-878b-44f7-8f99-f3767925a46c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:08.903196 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-42d4544c-878b-44f7-8f99-f3767925a46c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:08.914676 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-42d4544c-878b-44f7-8f99-f3767925a46c tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.204852 Jul 19 22:48:08.915306 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2205/4371] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:08 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:09.537915 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5d8ae424-2b00-445e-8886-aa466d89a1d6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1021647253", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "20391c9c-0f0d-4f66-9464-92dbeb225fff", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "711438ef-9562-4879-b7e2-ec9cf463e48f"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:09.643998 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-5d8ae424-2b00-445e-8886-aa466d89a1d6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Block Device 20391c9c-0f0d-4f66-9464-92dbeb225fff is not bootable. Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5d8ae424-2b00-445e-8886-aa466d89a1d6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 358 Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1021647253", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "20391c9c-0f0d-4f66-9464-92dbeb225fff", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "711438ef-9562-4879-b7e2-ec9cf463e48f"}]}} Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: exception: Block Device 20391c9c-0f0d-4f66-9464-92dbeb225fff is not bootable. Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1021647253', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '20391c9c-0f0d-4f66-9464-92dbeb225fff'}], 'networks': [{'uuid': '711438ef-9562-4879-b7e2-ec9cf463e48f'}]}}} Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 20391c9c-0f0d-4f66-9464-92dbeb225fff is not bootable. Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:09.656850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:09.663553 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:09.663553 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:09.663553 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:09.663553 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 22:48:09.663553 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 19 22:48:09.663553 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 19 22:48:09.663553 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 20391c9c-0f0d-4f66-9464-92dbeb225fff is not bootable. Jul 19 22:48:09.663553 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:09.663553 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:09.663553 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:09.663553 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:09.663553 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:09.663553 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:09.663553 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:09.663553 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:09.663553 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 20391c9c-0f0d-4f66-9464-92dbeb225fff is not bootable. Jul 19 22:48:09.663553 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:09.663553 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5d8ae424-2b00-445e-8886-aa466d89a1d6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 400 to user: Block Device 20391c9c-0f0d-4f66-9464-92dbeb225fff is not bootable. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:09.663553 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5d8ae424-2b00-445e-8886-aa466d89a1d6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.124416 Jul 19 22:48:09.663553 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2206/4372] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:48:09 2022] POST /compute/v2.1/servers => generated 110 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:48:09.678395 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0822f957-16e4-48b2-9c65-f0d8603b2661 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:09.679296 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0822f957-16e4-48b2-9c65-f0d8603b2661 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:09.712220 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0822f957-16e4-48b2-9c65-f0d8603b2661 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:09.712933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0822f957-16e4-48b2-9c65-f0d8603b2661 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:09.715354 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0822f957-16e4-48b2-9c65-f0d8603b2661 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:09.715948 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0822f957-16e4-48b2-9c65-f0d8603b2661 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:09.728071 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4665eef2-2023-49a9-b938-9f4f245c6ecb tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1263259659", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": "none"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:09.840140 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4665eef2-2023-49a9-b938-9f4f245c6ecb tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:48:09.845419 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4665eef2-2023-49a9-b938-9f4f245c6ecb tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:48:09.846392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4665eef2-2023-49a9-b938-9f4f245c6ecb tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:48:09.846817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4665eef2-2023-49a9-b938-9f4f245c6ecb tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:48:09.847274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4665eef2-2023-49a9-b938-9f4f245c6ecb tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:48:09.888192 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4665eef2-2023-49a9-b938-9f4f245c6ecb tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:09.890198 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4665eef2-2023-49a9-b938-9f4f245c6ecb tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:09.892996 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4665eef2-2023-49a9-b938-9f4f245c6ecb tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:09.893670 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4665eef2-2023-49a9-b938-9f4f245c6ecb tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:09.951687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-4665eef2-2023-49a9-b938-9f4f245c6ecb tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Getting quotas for project 6b53bf79b55c40f0b183944abf80677b. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:48:09.958835 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-4665eef2-2023-49a9-b938-9f4f245c6ecb tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Getting quotas for user fa5428f5fb9e422482db37a51806d383 and project 6b53bf79b55c40f0b183944abf80677b. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:48:09.996663 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4665eef2-2023-49a9-b938-9f4f245c6ecb tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:48:10.005373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4665eef2-2023-49a9-b938-9f4f245c6ecb tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] [instance: 21d12720-8896-4587-8ec7-1fd0fb5a0c6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:48:10.052429 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0822f957-16e4-48b2-9c65-f0d8603b2661 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:10.065018 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0822f957-16e4-48b2-9c65-f0d8603b2661 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.400162 Jul 19 22:48:10.095660 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:48:10.100466 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2207/4373] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:09 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:10.105951 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-144f4d53-711c-4a4d-a3d6-6ddb7a7b7b76 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:10.106579 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-144f4d53-711c-4a4d-a3d6-6ddb7a7b7b76 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:10.129521 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-144f4d53-711c-4a4d-a3d6-6ddb7a7b7b76 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:10.130499 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-144f4d53-711c-4a4d-a3d6-6ddb7a7b7b76 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:10.131698 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-144f4d53-711c-4a4d-a3d6-6ddb7a7b7b76 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:10.134153 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-144f4d53-711c-4a4d-a3d6-6ddb7a7b7b76 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:10.142620 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4665eef2-2023-49a9-b938-9f4f245c6ecb tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.686648 Jul 19 22:48:10.153589 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2167/4374] 10.222.0.25 () {62 vars in 1187 bytes} [Tue Jul 19 22:48:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 22:48:10.166415 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2d96ee6b-dcd3-4fe2-ad7c-0ce343f5943b tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:10.168034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2d96ee6b-dcd3-4fe2-ad7c-0ce343f5943b tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:10.195037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2d96ee6b-dcd3-4fe2-ad7c-0ce343f5943b tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:10.196822 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2d96ee6b-dcd3-4fe2-ad7c-0ce343f5943b tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:10.205880 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2d96ee6b-dcd3-4fe2-ad7c-0ce343f5943b tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:10.206634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2d96ee6b-dcd3-4fe2-ad7c-0ce343f5943b tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:10.536814 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2d96ee6b-dcd3-4fe2-ad7c-0ce343f5943b tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:10.551531 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2d96ee6b-dcd3-4fe2-ad7c-0ce343f5943b tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:10.555934 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2d96ee6b-dcd3-4fe2-ad7c-0ce343f5943b tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:10.560273 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2d96ee6b-dcd3-4fe2-ad7c-0ce343f5943b tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.402270 Jul 19 22:48:10.560883 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2168/4375] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:10 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:10.572868 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a79499dd-435a-4c9e-8c61-851983e08e52 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:10.574880 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a79499dd-435a-4c9e-8c61-851983e08e52 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:10.590750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a79499dd-435a-4c9e-8c61-851983e08e52 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:10.595123 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a79499dd-435a-4c9e-8c61-851983e08e52 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:10.599171 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a79499dd-435a-4c9e-8c61-851983e08e52 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:10.601392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a79499dd-435a-4c9e-8c61-851983e08e52 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:10.612364 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-144f4d53-711c-4a4d-a3d6-6ddb7a7b7b76 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:10.626170 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-144f4d53-711c-4a4d-a3d6-6ddb7a7b7b76 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1734 microversion: 2.1 time: 0.524301 Jul 19 22:48:10.626806 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2208/4376] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:10 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1734 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:10.634833 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-746aee97-72ca-4208-8af7-7d81741c412a tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:10.635484 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-746aee97-72ca-4208-8af7-7d81741c412a tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] [instance: 21d12720-8896-4587-8ec7-1fd0fb5a0c6a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:10.878091 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-746aee97-72ca-4208-8af7-7d81741c412a tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5428f5fb9e422482db37a51806d383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53bf79b55c40f0b183944abf80677b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:10.896540 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-746aee97-72ca-4208-8af7-7d81741c412a tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa5428f5fb9e422482db37a51806d383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53bf79b55c40f0b183944abf80677b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:10.904850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-746aee97-72ca-4208-8af7-7d81741c412a tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa5428f5fb9e422482db37a51806d383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53bf79b55c40f0b183944abf80677b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:10.911015 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-746aee97-72ca-4208-8af7-7d81741c412a tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] 10.222.0.25 "GET /compute/v2.1/servers/21d12720-8896-4587-8ec7-1fd0fb5a0c6a" status: 200 len: 1281 microversion: 2.47 time: 0.277509 Jul 19 22:48:10.916101 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2209/4377] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:10 2022] GET /compute/v2.1/servers/21d12720-8896-4587-8ec7-1fd0fb5a0c6a => generated 1281 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:11.069905 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a79499dd-435a-4c9e-8c61-851983e08e52 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:11.084659 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a79499dd-435a-4c9e-8c61-851983e08e52 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.519859 Jul 19 22:48:11.099096 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2169/4378] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:10 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:11.580895 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-12d5ee1e-cfbb-4dbb-8bcc-f230a0f2b9b4 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:11.582863 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-12d5ee1e-cfbb-4dbb-8bcc-f230a0f2b9b4 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:11.594209 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-12d5ee1e-cfbb-4dbb-8bcc-f230a0f2b9b4 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:11.607329 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-12d5ee1e-cfbb-4dbb-8bcc-f230a0f2b9b4 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:11.607329 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-12d5ee1e-cfbb-4dbb-8bcc-f230a0f2b9b4 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:11.607329 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-12d5ee1e-cfbb-4dbb-8bcc-f230a0f2b9b4 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:11.646119 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bfe8ae74-17fb-449e-acc8-4a06d7766d62 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:11.646838 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bfe8ae74-17fb-449e-acc8-4a06d7766d62 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:11.662409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bfe8ae74-17fb-449e-acc8-4a06d7766d62 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:11.662991 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bfe8ae74-17fb-449e-acc8-4a06d7766d62 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:11.664014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bfe8ae74-17fb-449e-acc8-4a06d7766d62 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:11.664890 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bfe8ae74-17fb-449e-acc8-4a06d7766d62 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:12.794802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-12d5ee1e-cfbb-4dbb-8bcc-f230a0f2b9b4 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:12.818807 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-12d5ee1e-cfbb-4dbb-8bcc-f230a0f2b9b4 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:12.818807 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-12d5ee1e-cfbb-4dbb-8bcc-f230a0f2b9b4 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:12.821634 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-12d5ee1e-cfbb-4dbb-8bcc-f230a0f2b9b4 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 1.244733 Jul 19 22:48:12.824100 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2210/4379] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:11 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:12.837257 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-255e75c1-5617-4909-ac76-71f3291e2469 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:12.838654 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-255e75c1-5617-4909-ac76-71f3291e2469 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] [instance: 21d12720-8896-4587-8ec7-1fd0fb5a0c6a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:12.859850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-255e75c1-5617-4909-ac76-71f3291e2469 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:12.861103 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-255e75c1-5617-4909-ac76-71f3291e2469 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:12.862139 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-255e75c1-5617-4909-ac76-71f3291e2469 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:12.866375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-255e75c1-5617-4909-ac76-71f3291e2469 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:13.006436 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-255e75c1-5617-4909-ac76-71f3291e2469 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5428f5fb9e422482db37a51806d383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53bf79b55c40f0b183944abf80677b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:13.024261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-255e75c1-5617-4909-ac76-71f3291e2469 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa5428f5fb9e422482db37a51806d383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53bf79b55c40f0b183944abf80677b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:13.026028 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-255e75c1-5617-4909-ac76-71f3291e2469 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa5428f5fb9e422482db37a51806d383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53bf79b55c40f0b183944abf80677b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:13.027602 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-255e75c1-5617-4909-ac76-71f3291e2469 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] 10.222.0.25 "GET /compute/v2.1/servers/21d12720-8896-4587-8ec7-1fd0fb5a0c6a" status: 200 len: 1339 microversion: 2.47 time: 0.200667 Jul 19 22:48:13.028316 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2211/4380] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:12 2022] GET /compute/v2.1/servers/21d12720-8896-4587-8ec7-1fd0fb5a0c6a => generated 1339 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:13.119533 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bfe8ae74-17fb-449e-acc8-4a06d7766d62 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:13.134235 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bfe8ae74-17fb-449e-acc8-4a06d7766d62 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1734 microversion: 2.1 time: 1.493766 Jul 19 22:48:13.136372 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2170/4381] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:11 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1734 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:13.842092 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1b071af7-08c2-4b8a-886e-52e162d82c31 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:13.842817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1b071af7-08c2-4b8a-886e-52e162d82c31 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:13.856144 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b071af7-08c2-4b8a-886e-52e162d82c31 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:13.856618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b071af7-08c2-4b8a-886e-52e162d82c31 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:13.857445 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b071af7-08c2-4b8a-886e-52e162d82c31 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:13.857877 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b071af7-08c2-4b8a-886e-52e162d82c31 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:13.966294 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1b071af7-08c2-4b8a-886e-52e162d82c31 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:13.974884 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1b071af7-08c2-4b8a-886e-52e162d82c31 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:13.976653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1b071af7-08c2-4b8a-886e-52e162d82c31 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:13.978325 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1b071af7-08c2-4b8a-886e-52e162d82c31 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.140243 Jul 19 22:48:13.991158 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2212/4382] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:13 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:14.048145 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7a9c7a21-5f5b-4285-806c-940517127b65 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:14.048815 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7a9c7a21-5f5b-4285-806c-940517127b65 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] [instance: 21d12720-8896-4587-8ec7-1fd0fb5a0c6a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:14.064368 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a9c7a21-5f5b-4285-806c-940517127b65 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:14.065114 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a9c7a21-5f5b-4285-806c-940517127b65 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:14.066159 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a9c7a21-5f5b-4285-806c-940517127b65 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:14.067262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a9c7a21-5f5b-4285-806c-940517127b65 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:14.154217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-586f8ec4-9247-4116-a4b3-cdda157195ed tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:14.155301 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-586f8ec4-9247-4116-a4b3-cdda157195ed tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:14.174802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-586f8ec4-9247-4116-a4b3-cdda157195ed tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:14.175638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-586f8ec4-9247-4116-a4b3-cdda157195ed tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:14.176803 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-586f8ec4-9247-4116-a4b3-cdda157195ed tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:14.177672 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-586f8ec4-9247-4116-a4b3-cdda157195ed tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:14.198652 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7a9c7a21-5f5b-4285-806c-940517127b65 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5428f5fb9e422482db37a51806d383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53bf79b55c40f0b183944abf80677b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:14.212178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7a9c7a21-5f5b-4285-806c-940517127b65 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa5428f5fb9e422482db37a51806d383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53bf79b55c40f0b183944abf80677b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:14.214233 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7a9c7a21-5f5b-4285-806c-940517127b65 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa5428f5fb9e422482db37a51806d383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53bf79b55c40f0b183944abf80677b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:14.216763 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7a9c7a21-5f5b-4285-806c-940517127b65 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] 10.222.0.25 "GET /compute/v2.1/servers/21d12720-8896-4587-8ec7-1fd0fb5a0c6a" status: 200 len: 1339 microversion: 2.47 time: 0.173289 Jul 19 22:48:14.217340 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2171/4383] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:14 2022] GET /compute/v2.1/servers/21d12720-8896-4587-8ec7-1fd0fb5a0c6a => generated 1339 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:14.379357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-586f8ec4-9247-4116-a4b3-cdda157195ed tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:14.390186 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-586f8ec4-9247-4116-a4b3-cdda157195ed tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1734 microversion: 2.1 time: 0.240198 Jul 19 22:48:14.392639 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2213/4384] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:14 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1734 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:48:14.398506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0cb93b4a-b9f9-4499-b44e-70d7b960d979 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1709620988", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "destination_type": "local"}, {"source_type": "volume", "uuid": "ac66e0b3-50ca-402d-8fde-c7637e9adb45", "destination_type": "invalid"}], "networks": [{"uuid": "711438ef-9562-4879-b7e2-ec9cf463e48f"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0cb93b4a-b9f9-4499-b44e-70d7b960d979 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 495 Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1709620988", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "destination_type": "local"}, {"source_type": "volume", "uuid": "ac66e0b3-50ca-402d-8fde-c7637e9adb45", "destination_type": "invalid"}], "networks": [{"uuid": "711438ef-9562-4879-b7e2-ec9cf463e48f"}]}} Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1709620988', 'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'ac66e0b3-50ca-402d-8fde-c7637e9adb45', 'destination_type': 'invalid'}], 'networks': [{'uuid': '711438ef-9562-4879-b7e2-ec9cf463e48f'}]}}} Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi 'invalid' Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:14.402495 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:14.406424 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:14.406424 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:14.406424 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:48:14.406424 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:48:14.406424 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:48:14.406424 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:48:14.406424 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:48:14.406424 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:48:14.406424 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 19 22:48:14.406424 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:14.406424 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:14.406424 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:14.406424 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:14.406424 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:14.406424 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:14.406424 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:48:14.406424 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:48:14.406424 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 19 22:48:14.406424 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:14.410447 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0cb93b4a-b9f9-4499-b44e-70d7b960d979 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:14.411767 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0cb93b4a-b9f9-4499-b44e-70d7b960d979 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.017574 Jul 19 22:48:14.412483 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2214/4385] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:48:14 2022] POST /compute/v2.1/servers => generated 155 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:48:14.422321 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d37e6cdc-8175-4802-b8da-0bef501e8542 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:14.423211 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d37e6cdc-8175-4802-b8da-0bef501e8542 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:14.430477 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:48:14.433042 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d37e6cdc-8175-4802-b8da-0bef501e8542 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:14.433867 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d37e6cdc-8175-4802-b8da-0bef501e8542 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:14.435396 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d37e6cdc-8175-4802-b8da-0bef501e8542 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:14.436209 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d37e6cdc-8175-4802-b8da-0bef501e8542 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:14.442590 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a991f5d2-adf8-4c45-ba92-4469ede664b0 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Action: 'create', calling method: .version_select at 0x7f7a032ccb80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-93501148"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:14.611824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d37e6cdc-8175-4802-b8da-0bef501e8542 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:14.619585 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d37e6cdc-8175-4802-b8da-0bef501e8542 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.202574 Jul 19 22:48:14.627374 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2215/4386] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:14 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:48:14.644663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-93793fc7-419c-4970-ab38-30f836752a08 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:14.645337 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-93793fc7-419c-4970-ab38-30f836752a08 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:14.658107 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93793fc7-419c-4970-ab38-30f836752a08 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:14.658732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93793fc7-419c-4970-ab38-30f836752a08 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:14.660205 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93793fc7-419c-4970-ab38-30f836752a08 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:14.660661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93793fc7-419c-4970-ab38-30f836752a08 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:14.910500 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a991f5d2-adf8-4c45-ba92-4469ede664b0 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.673643 Jul 19 22:48:14.911430 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2172/4387] 10.222.0.25 () {60 vars in 1154 bytes} [Tue Jul 19 22:48:14 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 676 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 19 22:48:14.920753 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-93793fc7-419c-4970-ab38-30f836752a08 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:14.923785 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-da7cc813-9403-4cde-af7e-df735df90f57 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Calling method '.version_select at 0x7f7a03339af0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:14.931743 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-93793fc7-419c-4970-ab38-30f836752a08 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.294490 Jul 19 22:48:14.932355 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2216/4388] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:14 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:15.000965 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0e9f0233-ad7d-4ade-be2f-9d264acba6cf tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:15.004236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0e9f0233-ad7d-4ade-be2f-9d264acba6cf tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:15.020586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0e9f0233-ad7d-4ade-be2f-9d264acba6cf tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:15.025414 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0e9f0233-ad7d-4ade-be2f-9d264acba6cf tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:15.027509 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0e9f0233-ad7d-4ade-be2f-9d264acba6cf tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:15.029925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0e9f0233-ad7d-4ade-be2f-9d264acba6cf tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:15.063607 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-da7cc813-9403-4cde-af7e-df735df90f57 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3a45690a-abfd-44c4-ac77-564c0aac49a1" status: 200 len: 343 microversion: 2.1 time: 0.144637 Jul 19 22:48:15.064790 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2173/4389] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 19 22:48:14 2022] GET /compute/v2.1/os-volumes/3a45690a-abfd-44c4-ac77-564c0aac49a1 => generated 343 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:48:15.151548 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0e9f0233-ad7d-4ade-be2f-9d264acba6cf tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:15.162721 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0e9f0233-ad7d-4ade-be2f-9d264acba6cf tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:15.164894 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0e9f0233-ad7d-4ade-be2f-9d264acba6cf tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:15.166248 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0e9f0233-ad7d-4ade-be2f-9d264acba6cf tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.171265 Jul 19 22:48:15.167641 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2217/4390] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:14 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:15.201831 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8ef0adf7-8c31-46b9-bf5c-1c6d9893ce0f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-538211086", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "711438ef-9562-4879-b7e2-ec9cf463e48f"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8ef0adf7-8c31-46b9-bf5c-1c6d9893ce0f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 491 Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-538211086", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "711438ef-9562-4879-b7e2-ec9cf463e48f"}]}} Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-538211086', 'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '711438ef-9562-4879-b7e2-ec9cf463e48f'}]}}} Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 19 22:48:15.204888 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8ef0adf7-8c31-46b9-bf5c-1c6d9893ce0f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8ef0adf7-8c31-46b9-bf5c-1c6d9893ce0f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.009032 Jul 19 22:48:15.208032 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2174/4391] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:48:15 2022] POST /compute/v2.1/servers => generated 624 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:48:15.216426 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-887e5d3c-d917-459c-8476-e4e0e8918355 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:15.217037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-887e5d3c-d917-459c-8476-e4e0e8918355 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:15.227548 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-887e5d3c-d917-459c-8476-e4e0e8918355 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:15.229359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-887e5d3c-d917-459c-8476-e4e0e8918355 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:15.230568 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-887e5d3c-d917-459c-8476-e4e0e8918355 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:15.232236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-887e5d3c-d917-459c-8476-e4e0e8918355 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:15.236369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e3eef83f-693c-4e61-885d-e365c2298653 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:15.237005 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e3eef83f-693c-4e61-885d-e365c2298653 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] [instance: 21d12720-8896-4587-8ec7-1fd0fb5a0c6a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:15.244105 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3eef83f-693c-4e61-885d-e365c2298653 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:15.244793 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3eef83f-693c-4e61-885d-e365c2298653 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:15.245814 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3eef83f-693c-4e61-885d-e365c2298653 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:15.246265 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e3eef83f-693c-4e61-885d-e365c2298653 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:15.424113 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e3eef83f-693c-4e61-885d-e365c2298653 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5428f5fb9e422482db37a51806d383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53bf79b55c40f0b183944abf80677b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:15.427613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:48:15.433256 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e3eef83f-693c-4e61-885d-e365c2298653 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa5428f5fb9e422482db37a51806d383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53bf79b55c40f0b183944abf80677b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:15.434843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e3eef83f-693c-4e61-885d-e365c2298653 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa5428f5fb9e422482db37a51806d383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53bf79b55c40f0b183944abf80677b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:15.436140 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e3eef83f-693c-4e61-885d-e365c2298653 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] 10.222.0.25 "GET /compute/v2.1/servers/21d12720-8896-4587-8ec7-1fd0fb5a0c6a" status: 200 len: 1360 microversion: 2.47 time: 0.204078 Jul 19 22:48:15.436714 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2175/4392] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:15 2022] GET /compute/v2.1/servers/21d12720-8896-4587-8ec7-1fd0fb5a0c6a => generated 1360 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:15.457298 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9e9ef546-3afe-47da-a9dc-e0d53b0790ef tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:15.457949 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9e9ef546-3afe-47da-a9dc-e0d53b0790ef tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:15.478479 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9e9ef546-3afe-47da-a9dc-e0d53b0790ef tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:15.479230 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9e9ef546-3afe-47da-a9dc-e0d53b0790ef tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:15.480214 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9e9ef546-3afe-47da-a9dc-e0d53b0790ef tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:15.481227 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9e9ef546-3afe-47da-a9dc-e0d53b0790ef tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:15.508828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-887e5d3c-d917-459c-8476-e4e0e8918355 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:15.530779 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-887e5d3c-d917-459c-8476-e4e0e8918355 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.318469 Jul 19 22:48:15.532473 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2218/4393] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:15 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:15.547634 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c4fb5878-141b-49eb-9f69-10348a409f53 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1831960236"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:15.551501 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c4fb5878-141b-49eb-9f69-10348a409f53 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] [instance: 21d12720-8896-4587-8ec7-1fd0fb5a0c6a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:15.577366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4fb5878-141b-49eb-9f69-10348a409f53 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:15.577935 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4fb5878-141b-49eb-9f69-10348a409f53 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:15.580716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4fb5878-141b-49eb-9f69-10348a409f53 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:15.581784 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4fb5878-141b-49eb-9f69-10348a409f53 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:15.801244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9e9ef546-3afe-47da-a9dc-e0d53b0790ef tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:15.816055 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9e9ef546-3afe-47da-a9dc-e0d53b0790ef tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1734 microversion: 2.1 time: 0.378054 Jul 19 22:48:15.816653 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2176/4394] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:15 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1734 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:15.831355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-98fcd4d2-a2bc-42c7-8b67-3611bac36215 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:15.832497 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-98fcd4d2-a2bc-42c7-8b67-3611bac36215 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:15.839957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-98fcd4d2-a2bc-42c7-8b67-3611bac36215 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:15.840873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-98fcd4d2-a2bc-42c7-8b67-3611bac36215 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:15.842763 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-98fcd4d2-a2bc-42c7-8b67-3611bac36215 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:15.845945 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-98fcd4d2-a2bc-42c7-8b67-3611bac36215 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:16.118915 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:48:16.186204 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c4fb5878-141b-49eb-9f69-10348a409f53 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] 10.222.0.25 "POST /compute/v2.1/servers/21d12720-8896-4587-8ec7-1fd0fb5a0c6a/action" status: 202 len: 52 microversion: 2.47 time: 0.652180 Jul 19 22:48:16.190088 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2219/4395] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Jul 19 22:48:15 2022] POST /compute/v2.1/servers/21d12720-8896-4587-8ec7-1fd0fb5a0c6a/action => generated 52 bytes in 657 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jul 19 22:48:16.208437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-37c1d15e-8dae-4154-8ce4-5e7cc88e2467 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Calling method '.version_select at 0x7f7a03131040>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:16.294866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-98fcd4d2-a2bc-42c7-8b67-3611bac36215 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:16.307983 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-37c1d15e-8dae-4154-8ce4-5e7cc88e2467 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3a45690a-abfd-44c4-ac77-564c0aac49a1" status: 200 len: 343 microversion: 2.1 time: 0.115096 Jul 19 22:48:16.310450 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-98fcd4d2-a2bc-42c7-8b67-3611bac36215 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.489272 Jul 19 22:48:16.311652 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2177/4396] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:15 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:16.319151 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2220/4397] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 19 22:48:16 2022] GET /compute/v2.1/os-volumes/3a45690a-abfd-44c4-ac77-564c0aac49a1 => generated 343 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:48:16.331959 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c14ccd1b-4124-44ee-a20e-29ea0a24c74f tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:16.332684 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a7b81b0a-ae27-4eda-9213-1b04ecac0204 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:16.333144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c14ccd1b-4124-44ee-a20e-29ea0a24c74f tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:16.334630 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a7b81b0a-ae27-4eda-9213-1b04ecac0204 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] [instance: 21d12720-8896-4587-8ec7-1fd0fb5a0c6a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:16.347080 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c14ccd1b-4124-44ee-a20e-29ea0a24c74f tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:16.349342 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c14ccd1b-4124-44ee-a20e-29ea0a24c74f tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:16.352997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c14ccd1b-4124-44ee-a20e-29ea0a24c74f tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:16.353648 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c14ccd1b-4124-44ee-a20e-29ea0a24c74f tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:16.361489 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a7b81b0a-ae27-4eda-9213-1b04ecac0204 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:16.362262 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a7b81b0a-ae27-4eda-9213-1b04ecac0204 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:16.364074 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a7b81b0a-ae27-4eda-9213-1b04ecac0204 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:16.364662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a7b81b0a-ae27-4eda-9213-1b04ecac0204 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:16.446007 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a7b81b0a-ae27-4eda-9213-1b04ecac0204 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] [instance: 21d12720-8896-4587-8ec7-1fd0fb5a0c6a] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:48:16.499132 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c14ccd1b-4124-44ee-a20e-29ea0a24c74f tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:16.512238 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c14ccd1b-4124-44ee-a20e-29ea0a24c74f tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:16.514465 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c14ccd1b-4124-44ee-a20e-29ea0a24c74f tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:16.516818 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c14ccd1b-4124-44ee-a20e-29ea0a24c74f tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.202215 Jul 19 22:48:16.527886 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2178/4398] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:16 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:16.540392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-27767a7c-48ee-4c0e-b2ec-1b8a4b188d1f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "711438ef-9562-4879-b7e2-ec9cf463e48f"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-27767a7c-48ee-4c0e-b2ec-1b8a4b188d1f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 416 Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "711438ef-9562-4879-b7e2-ec9cf463e48f"}]}} Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691', 'flavorRef': '452', 'networks': [{'uuid': '711438ef-9562-4879-b7e2-ec9cf463e48f'}]}}} Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:16.545062 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-27767a7c-48ee-4c0e-b2ec-1b8a4b188d1f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-27767a7c-48ee-4c0e-b2ec-1b8a4b188d1f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.016196 Jul 19 22:48:16.550374 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2179/4399] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:48:16 2022] POST /compute/v2.1/servers => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:48:16.558096 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1461cc54-27cd-43f8-b9cb-f7e6ce0ae0a7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:16.559702 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1461cc54-27cd-43f8-b9cb-f7e6ce0ae0a7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:16.567497 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1461cc54-27cd-43f8-b9cb-f7e6ce0ae0a7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:16.567937 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1461cc54-27cd-43f8-b9cb-f7e6ce0ae0a7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:16.569422 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1461cc54-27cd-43f8-b9cb-f7e6ce0ae0a7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:16.570086 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1461cc54-27cd-43f8-b9cb-f7e6ce0ae0a7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:16.591904 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a7b81b0a-ae27-4eda-9213-1b04ecac0204 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] 10.222.0.25 "DELETE /compute/v2.1/servers/21d12720-8896-4587-8ec7-1fd0fb5a0c6a" status: 204 len: 0 microversion: 2.47 time: 0.270894 Jul 19 22:48:16.592900 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2221/4400] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 22:48:16 2022] DELETE /compute/v2.1/servers/21d12720-8896-4587-8ec7-1fd0fb5a0c6a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:48:16.606009 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ee8661b4-cba4-4aa3-8203-75234d808550 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:16.607262 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ee8661b4-cba4-4aa3-8203-75234d808550 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] [instance: 21d12720-8896-4587-8ec7-1fd0fb5a0c6a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:16.619147 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee8661b4-cba4-4aa3-8203-75234d808550 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:16.619574 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee8661b4-cba4-4aa3-8203-75234d808550 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:16.620887 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee8661b4-cba4-4aa3-8203-75234d808550 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:16.621332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee8661b4-cba4-4aa3-8203-75234d808550 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:16.766561 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ee8661b4-cba4-4aa3-8203-75234d808550 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5428f5fb9e422482db37a51806d383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53bf79b55c40f0b183944abf80677b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:16.780065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ee8661b4-cba4-4aa3-8203-75234d808550 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa5428f5fb9e422482db37a51806d383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53bf79b55c40f0b183944abf80677b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:16.784546 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ee8661b4-cba4-4aa3-8203-75234d808550 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa5428f5fb9e422482db37a51806d383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53bf79b55c40f0b183944abf80677b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:16.786016 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ee8661b4-cba4-4aa3-8203-75234d808550 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] 10.222.0.25 "GET /compute/v2.1/servers/21d12720-8896-4587-8ec7-1fd0fb5a0c6a" status: 200 len: 1366 microversion: 2.47 time: 0.187922 Jul 19 22:48:16.787390 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2222/4401] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:16 2022] GET /compute/v2.1/servers/21d12720-8896-4587-8ec7-1fd0fb5a0c6a => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:48:16.841556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-901cad83-f43a-4dd1-ae33-77ebb12d8b08 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:16.842473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-901cad83-f43a-4dd1-ae33-77ebb12d8b08 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:16.850961 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-901cad83-f43a-4dd1-ae33-77ebb12d8b08 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:16.851489 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-901cad83-f43a-4dd1-ae33-77ebb12d8b08 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:16.852422 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-901cad83-f43a-4dd1-ae33-77ebb12d8b08 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:16.853032 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-901cad83-f43a-4dd1-ae33-77ebb12d8b08 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:16.987988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1461cc54-27cd-43f8-b9cb-f7e6ce0ae0a7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:16.996499 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1461cc54-27cd-43f8-b9cb-f7e6ce0ae0a7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.442347 Jul 19 22:48:16.997292 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2180/4402] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:16 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:48:17.016647 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eb7afdb6-5225-46d7-8cd9-5583038d46de tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:17.017568 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eb7afdb6-5225-46d7-8cd9-5583038d46de tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:17.024180 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb7afdb6-5225-46d7-8cd9-5583038d46de tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:17.024640 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb7afdb6-5225-46d7-8cd9-5583038d46de tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:17.027887 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb7afdb6-5225-46d7-8cd9-5583038d46de tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:17.027887 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb7afdb6-5225-46d7-8cd9-5583038d46de tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:17.189673 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-901cad83-f43a-4dd1-ae33-77ebb12d8b08 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:17.205199 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-901cad83-f43a-4dd1-ae33-77ebb12d8b08 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1734 microversion: 2.1 time: 0.366237 Jul 19 22:48:17.205833 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2223/4403] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:16 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1734 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:17.235965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-eb7afdb6-5225-46d7-8cd9-5583038d46de tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:17.244258 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eb7afdb6-5225-46d7-8cd9-5583038d46de tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.232086 Jul 19 22:48:17.244857 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2181/4404] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:17 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:48:17.326963 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0d2a3c00-420a-4822-9bde-dd9b61f213b6 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Calling method '.version_select at 0x7f7a03079a60>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:17.391917 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0d2a3c00-420a-4822-9bde-dd9b61f213b6 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3a45690a-abfd-44c4-ac77-564c0aac49a1" status: 200 len: 344 microversion: 2.1 time: 0.069374 Jul 19 22:48:17.392645 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2224/4405] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 19 22:48:17 2022] GET /compute/v2.1/os-volumes/3a45690a-abfd-44c4-ac77-564c0aac49a1 => generated 344 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:48:17.405704 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d53f0842-3290-4c21-bb7b-02eeb48ae824 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Action: 'create', calling method: .version_select at 0x7f7a03e885e0>, body: {"snapshot": {"volume_id": "3a45690a-abfd-44c4-ac77-564c0aac49a1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1377728140"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:17.419467 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-62d9e629-0442-4de6-b06d-c1a5e3e519e0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2032504203", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": -1, "networks": [{"uuid": "711438ef-9562-4879-b7e2-ec9cf463e48f"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:17.441241 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-62d9e629-0442-4de6-b06d-c1a5e3e519e0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Flavor -1 could not be found. Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-62d9e629-0442-4de6-b06d-c1a5e3e519e0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 206 Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2032504203", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": -1, "networks": [{"uuid": "711438ef-9562-4879-b7e2-ec9cf463e48f"}]}} Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: exception: Flavor -1 could not be found. Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2032504203', 'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691', 'flavorRef': -1, 'networks': [{'uuid': '711438ef-9562-4879-b7e2-ec9cf463e48f'}]}}} Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:17.444653 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:17.453604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:17.453604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:17.453604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:17.453604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:17.453604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 22:48:17.453604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 19 22:48:17.453604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 19 22:48:17.453604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 19 22:48:17.453604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:17.453604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:17.453604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:17.453604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:17.453604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:17.453604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:17.453604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:17.453604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:17.453604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 19 22:48:17.453604 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:17.453604 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-62d9e629-0442-4de6-b06d-c1a5e3e519e0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:17.453604 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-62d9e629-0442-4de6-b06d-c1a5e3e519e0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.031738 Jul 19 22:48:17.453604 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2225/4406] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:48:17 2022] POST /compute/v2.1/servers => generated 73 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 19 22:48:17.458141 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cedee566-14a6-4cb4-9346-4d16e445b6ed tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:17.458770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cedee566-14a6-4cb4-9346-4d16e445b6ed tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:17.466298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cedee566-14a6-4cb4-9346-4d16e445b6ed tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:17.466759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cedee566-14a6-4cb4-9346-4d16e445b6ed tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:17.467577 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cedee566-14a6-4cb4-9346-4d16e445b6ed tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:17.468020 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cedee566-14a6-4cb4-9346-4d16e445b6ed tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:17.630860 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cedee566-14a6-4cb4-9346-4d16e445b6ed tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:17.639188 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cedee566-14a6-4cb4-9346-4d16e445b6ed tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.187531 Jul 19 22:48:17.640490 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2226/4407] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:17 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:17.659563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c0e1285a-ff03-4914-88bb-bd99ffee5bec tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:17.660613 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c0e1285a-ff03-4914-88bb-bd99ffee5bec tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:17.668068 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0e1285a-ff03-4914-88bb-bd99ffee5bec tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:17.668965 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0e1285a-ff03-4914-88bb-bd99ffee5bec tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:17.670242 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0e1285a-ff03-4914-88bb-bd99ffee5bec tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:17.670990 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0e1285a-ff03-4914-88bb-bd99ffee5bec tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:17.681242 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d53f0842-3290-4c21-bb7b-02eeb48ae824 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.279356 Jul 19 22:48:17.681850 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2182/4408] 10.222.0.25 () {60 vars in 1161 bytes} [Tue Jul 19 22:48:17 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:48:17.692562 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8cfa2935-f3df-487c-9ceb-05b168dfe3d3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:17.693202 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8cfa2935-f3df-487c-9ceb-05b168dfe3d3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:17.719199 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8cfa2935-f3df-487c-9ceb-05b168dfe3d3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:17.719687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8cfa2935-f3df-487c-9ceb-05b168dfe3d3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:17.720551 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8cfa2935-f3df-487c-9ceb-05b168dfe3d3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:17.727695 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8cfa2935-f3df-487c-9ceb-05b168dfe3d3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:17.796030 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c0e1285a-ff03-4914-88bb-bd99ffee5bec tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:17.811103 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c0e1285a-ff03-4914-88bb-bd99ffee5bec tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:17.813520 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c0e1285a-ff03-4914-88bb-bd99ffee5bec tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:17.821999 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c0e1285a-ff03-4914-88bb-bd99ffee5bec tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1366 microversion: 2.57 time: 0.180040 Jul 19 22:48:17.822839 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2227/4409] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:17 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:17.839759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5d073323-0909-433b-bc4b-3b39159bec17 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Calling method '.version_select at 0x7f7a03058040>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:17.928617 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5d073323-0909-433b-bc4b-3b39159bec17 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/9b24795c-0d88-4633-b901-7335297e7d0b" status: 200 len: 287 microversion: 2.1 time: 0.104487 Jul 19 22:48:17.929197 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2228/4410] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 19 22:48:17 2022] GET /compute/v2.1/os-snapshots/9b24795c-0d88-4633-b901-7335297e7d0b => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:48:17.935097 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-05b2cc38-ec68-4616-84bd-f537c380ca05 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:17.936124 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-05b2cc38-ec68-4616-84bd-f537c380ca05 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] [instance: 21d12720-8896-4587-8ec7-1fd0fb5a0c6a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:17.949499 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-05b2cc38-ec68-4616-84bd-f537c380ca05 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:17.950021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-05b2cc38-ec68-4616-84bd-f537c380ca05 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:17.951166 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-05b2cc38-ec68-4616-84bd-f537c380ca05 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:17.951832 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-05b2cc38-ec68-4616-84bd-f537c380ca05 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:18.085753 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-05b2cc38-ec68-4616-84bd-f537c380ca05 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5428f5fb9e422482db37a51806d383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53bf79b55c40f0b183944abf80677b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:18.098100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-05b2cc38-ec68-4616-84bd-f537c380ca05 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa5428f5fb9e422482db37a51806d383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53bf79b55c40f0b183944abf80677b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:18.100087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-05b2cc38-ec68-4616-84bd-f537c380ca05 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa5428f5fb9e422482db37a51806d383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53bf79b55c40f0b183944abf80677b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:18.101673 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-05b2cc38-ec68-4616-84bd-f537c380ca05 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] 10.222.0.25 "GET /compute/v2.1/servers/21d12720-8896-4587-8ec7-1fd0fb5a0c6a" status: 200 len: 1366 microversion: 2.47 time: 0.170742 Jul 19 22:48:18.102743 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2229/4411] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:17 2022] GET /compute/v2.1/servers/21d12720-8896-4587-8ec7-1fd0fb5a0c6a => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:18.112551 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8cfa2935-f3df-487c-9ceb-05b168dfe3d3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:18.119043 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1933cca2-d6d6-4e6e-b404-7e6702e0affd tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Calling method '.version_select at 0x7f7a030625e0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:18.126608 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8cfa2935-f3df-487c-9ceb-05b168dfe3d3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.438238 Jul 19 22:48:18.143670 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2183/4412] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:17 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:18.195012 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1933cca2-d6d6-4e6e-b404-7e6702e0affd tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.090326 Jul 19 22:48:18.196047 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2230/4413] 10.222.0.25 () {58 vars in 1139 bytes} [Tue Jul 19 22:48:18 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:48:18.209381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-48c5d283-06e8-496e-9f80-bf4a859f64fb tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Calling method '.version_select at 0x7f7a10822e50>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:18.223193 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-48f61724-2b85-4684-895f-217261eb5b2c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:18.223817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-48f61724-2b85-4684-895f-217261eb5b2c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:18.232020 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48f61724-2b85-4684-895f-217261eb5b2c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:18.232571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48f61724-2b85-4684-895f-217261eb5b2c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:18.233789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48f61724-2b85-4684-895f-217261eb5b2c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:18.235694 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48f61724-2b85-4684-895f-217261eb5b2c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:18.303506 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-48c5d283-06e8-496e-9f80-bf4a859f64fb tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/9b24795c-0d88-4633-b901-7335297e7d0b" status: 200 len: 287 microversion: 2.1 time: 0.101062 Jul 19 22:48:18.308498 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2184/4414] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 19 22:48:18 2022] GET /compute/v2.1/os-snapshots/9b24795c-0d88-4633-b901-7335297e7d0b => generated 287 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:48:18.345407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-04076e8c-4b65-4aa2-96d8-bf12f2848ced tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1128069575", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "711438ef-9562-4879-b7e2-ec9cf463e48f"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-04076e8c-4b65-4aa2-96d8-bf12f2848ced tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 173 Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1128069575", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "711438ef-9562-4879-b7e2-ec9cf463e48f"}]}} Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1128069575', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '711438ef-9562-4879-b7e2-ec9cf463e48f'}]}}} Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi -1 Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:48:18.348250 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:48:18.355645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:48:18.355645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:48:18.355645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 19 22:48:18.355645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:18.355645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:18.355645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:18.355645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:18.355645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:18.355645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:18.355645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:48:18.355645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:48:18.355645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 19 22:48:18.355645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:18.355645 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-04076e8c-4b65-4aa2-96d8-bf12f2848ced tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:18.355645 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-04076e8c-4b65-4aa2-96d8-bf12f2848ced tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.009502 Jul 19 22:48:18.357569 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2185/4415] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:48:18 2022] POST /compute/v2.1/servers => generated 145 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 22:48:18.385714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eafc7bfa-2a93-4c91-a510-5f3d8932c386 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:18.388020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eafc7bfa-2a93-4c91-a510-5f3d8932c386 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:18.398494 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eafc7bfa-2a93-4c91-a510-5f3d8932c386 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:18.399988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eafc7bfa-2a93-4c91-a510-5f3d8932c386 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:18.409741 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eafc7bfa-2a93-4c91-a510-5f3d8932c386 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:18.410655 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eafc7bfa-2a93-4c91-a510-5f3d8932c386 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:18.740609 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-48f61724-2b85-4684-895f-217261eb5b2c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:18.759222 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-48f61724-2b85-4684-895f-217261eb5b2c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1734 microversion: 2.1 time: 0.537909 Jul 19 22:48:18.759222 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2231/4416] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:18 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1734 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:48:18.815740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-eafc7bfa-2a93-4c91-a510-5f3d8932c386 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:18.825457 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eafc7bfa-2a93-4c91-a510-5f3d8932c386 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.467775 Jul 19 22:48:18.839002 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2186/4417] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:18 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:18.844800 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dfa51a57-9b82-4558-9b1b-e82f5a5686ae tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:18.845498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dfa51a57-9b82-4558-9b1b-e82f5a5686ae tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:18.846035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-985f8fd7-1936-4254-9e87-1e4028695814 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:18.846756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-985f8fd7-1936-4254-9e87-1e4028695814 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:18.853296 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dfa51a57-9b82-4558-9b1b-e82f5a5686ae tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:18.854168 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dfa51a57-9b82-4558-9b1b-e82f5a5686ae tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:18.855337 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dfa51a57-9b82-4558-9b1b-e82f5a5686ae tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:18.855937 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dfa51a57-9b82-4558-9b1b-e82f5a5686ae tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:18.868593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-985f8fd7-1936-4254-9e87-1e4028695814 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:18.869288 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-985f8fd7-1936-4254-9e87-1e4028695814 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:18.872537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-985f8fd7-1936-4254-9e87-1e4028695814 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:18.875195 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-985f8fd7-1936-4254-9e87-1e4028695814 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:18.996055 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-985f8fd7-1936-4254-9e87-1e4028695814 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:19.005757 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-985f8fd7-1936-4254-9e87-1e4028695814 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:19.014093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-985f8fd7-1936-4254-9e87-1e4028695814 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:19.016010 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-985f8fd7-1936-4254-9e87-1e4028695814 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1372 microversion: 2.57 time: 0.175716 Jul 19 22:48:19.027498 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2232/4418] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:18 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1372 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:19.127042 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b7c3390b-80bd-468c-8ae8-314f210e2e82 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:19.129162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dfa51a57-9b82-4558-9b1b-e82f5a5686ae tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:19.133668 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b7c3390b-80bd-468c-8ae8-314f210e2e82 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] [instance: 21d12720-8896-4587-8ec7-1fd0fb5a0c6a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:19.146011 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dfa51a57-9b82-4558-9b1b-e82f5a5686ae tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.304543 Jul 19 22:48:19.147791 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2187/4419] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:18 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:19.149002 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b7c3390b-80bd-468c-8ae8-314f210e2e82 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:19.149684 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b7c3390b-80bd-468c-8ae8-314f210e2e82 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:19.150686 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b7c3390b-80bd-468c-8ae8-314f210e2e82 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:19.151499 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b7c3390b-80bd-468c-8ae8-314f210e2e82 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:19.301270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b7c3390b-80bd-468c-8ae8-314f210e2e82 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5428f5fb9e422482db37a51806d383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53bf79b55c40f0b183944abf80677b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:19.308686 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8d127d2c-4cc5-44ee-8ee7-7ad23095b27a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-892001959", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:19.313674 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-8d127d2c-4cc5-44ee-8ee7-7ad23095b27a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8d127d2c-4cc5-44ee-8ee7-7ad23095b27a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 215 Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-892001959", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-892001959', 'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:19.316670 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:19.321149 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:19.321149 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:19.321149 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:19.321149 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:19.321149 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:19.321149 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 19 22:48:19.321149 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:19.322439 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b7c3390b-80bd-468c-8ae8-314f210e2e82 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa5428f5fb9e422482db37a51806d383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53bf79b55c40f0b183944abf80677b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:19.322439 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b7c3390b-80bd-468c-8ae8-314f210e2e82 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa5428f5fb9e422482db37a51806d383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53bf79b55c40f0b183944abf80677b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:19.322439 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b7c3390b-80bd-468c-8ae8-314f210e2e82 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] 10.222.0.25 "GET /compute/v2.1/servers/21d12720-8896-4587-8ec7-1fd0fb5a0c6a" status: 200 len: 1366 microversion: 2.47 time: 0.201601 Jul 19 22:48:19.324542 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8d127d2c-4cc5-44ee-8ee7-7ad23095b27a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:19.325722 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8d127d2c-4cc5-44ee-8ee7-7ad23095b27a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.022667 Jul 19 22:48:19.326931 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2188/4420] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:48:19 2022] POST /compute/v2.1/servers => generated 123 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 22:48:19.334017 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ef3c5118-b704-4f38-9335-072b76ead376 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Calling method '.version_select at 0x7f7a032cc0d0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:19.339639 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2233/4421] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:19 2022] GET /compute/v2.1/servers/21d12720-8896-4587-8ec7-1fd0fb5a0c6a => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:19.353067 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e296db3d-8457-4e60-85f4-2c81d2548731 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:19.356822 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e296db3d-8457-4e60-85f4-2c81d2548731 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:19.381072 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ef3c5118-b704-4f38-9335-072b76ead376 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/9b24795c-0d88-4633-b901-7335297e7d0b" status: 200 len: 287 microversion: 2.1 time: 0.051719 Jul 19 22:48:19.386061 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2189/4422] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 19 22:48:19 2022] GET /compute/v2.1/os-snapshots/9b24795c-0d88-4633-b901-7335297e7d0b => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:48:19.388514 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e296db3d-8457-4e60-85f4-2c81d2548731 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:19.388974 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e296db3d-8457-4e60-85f4-2c81d2548731 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:19.391134 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e296db3d-8457-4e60-85f4-2c81d2548731 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:19.393192 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e296db3d-8457-4e60-85f4-2c81d2548731 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:19.668555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e296db3d-8457-4e60-85f4-2c81d2548731 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:19.681827 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e296db3d-8457-4e60-85f4-2c81d2548731 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.341054 Jul 19 22:48:19.683143 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2234/4423] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:19 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:19.704026 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-110860dd-0d76-4e08-8baf-affccfa5cf5a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:19.704657 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-110860dd-0d76-4e08-8baf-affccfa5cf5a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:19.732341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-110860dd-0d76-4e08-8baf-affccfa5cf5a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:19.733190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-110860dd-0d76-4e08-8baf-affccfa5cf5a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:19.734494 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-110860dd-0d76-4e08-8baf-affccfa5cf5a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:19.735379 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-110860dd-0d76-4e08-8baf-affccfa5cf5a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:19.779638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cf10656b-a57e-43fa-b3b2-9d8bdac2a9b4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:19.801879 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cf10656b-a57e-43fa-b3b2-9d8bdac2a9b4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:19.820950 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf10656b-a57e-43fa-b3b2-9d8bdac2a9b4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:19.821416 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf10656b-a57e-43fa-b3b2-9d8bdac2a9b4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:19.822212 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf10656b-a57e-43fa-b3b2-9d8bdac2a9b4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:19.822656 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf10656b-a57e-43fa-b3b2-9d8bdac2a9b4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:19.921085 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:48:19.977407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:48:20.145478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cf10656b-a57e-43fa-b3b2-9d8bdac2a9b4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:20.157824 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cf10656b-a57e-43fa-b3b2-9d8bdac2a9b4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1734 microversion: 2.1 time: 0.385089 Jul 19 22:48:20.158716 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2235/4424] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:19 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1734 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:20.165965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-110860dd-0d76-4e08-8baf-affccfa5cf5a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:20.174687 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-83a5624a-dc61-424e-9e9a-adcf92acd71f tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:20.175827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-83a5624a-dc61-424e-9e9a-adcf92acd71f tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:20.177590 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-110860dd-0d76-4e08-8baf-affccfa5cf5a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.480870 Jul 19 22:48:20.178309 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2190/4425] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:19 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:20.184628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-83a5624a-dc61-424e-9e9a-adcf92acd71f tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:20.185209 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-83a5624a-dc61-424e-9e9a-adcf92acd71f tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:20.186018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-83a5624a-dc61-424e-9e9a-adcf92acd71f tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:20.186585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-83a5624a-dc61-424e-9e9a-adcf92acd71f tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:20.279291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-83a5624a-dc61-424e-9e9a-adcf92acd71f tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:20.290990 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-83a5624a-dc61-424e-9e9a-adcf92acd71f tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:20.292752 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-83a5624a-dc61-424e-9e9a-adcf92acd71f tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:20.294657 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-83a5624a-dc61-424e-9e9a-adcf92acd71f tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1372 microversion: 2.57 time: 0.134300 Jul 19 22:48:20.295489 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2236/4426] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:20 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1372 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:20.340059 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5812da22-b49b-4546-9753-c31b3efe1c76 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1629453494", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "key_name": "tempest-key-1000445751", "networks": [{"uuid": "711438ef-9562-4879-b7e2-ec9cf463e48f"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:20.363332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-18ca0e6f-9025-4678-a169-730b6ab0b4e7 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:20.364493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-18ca0e6f-9025-4678-a169-730b6ab0b4e7 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] [instance: 21d12720-8896-4587-8ec7-1fd0fb5a0c6a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:20.377853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-18ca0e6f-9025-4678-a169-730b6ab0b4e7 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:20.378608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-18ca0e6f-9025-4678-a169-730b6ab0b4e7 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:20.379913 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-18ca0e6f-9025-4678-a169-730b6ab0b4e7 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:20.380638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-18ca0e6f-9025-4678-a169-730b6ab0b4e7 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:20.398928 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-5812da22-b49b-4546-9753-c31b3efe1c76 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] validate_networks() for [('711438ef-9562-4879-b7e2-ec9cf463e48f', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:48:20.413470 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-18ca0e6f-9025-4678-a169-730b6ab0b4e7 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] HTTP exception thrown: Instance 21d12720-8896-4587-8ec7-1fd0fb5a0c6a could not be found. Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-18ca0e6f-9025-4678-a169-730b6ab0b4e7 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Request method failure captured: Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/21d12720-8896-4587-8ec7-1fd0fb5a0c6a HTTP/1.1 Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zSpEBDeqfIrflYdJmR2GvEjdq8Q8qj21RG_X1b7_NZKflN8HpdCwVT7R1v7Nh_Sq4L3pfVvKehC49nfUmo_XbmaWS3SRCTjOM3Yu39BcbFZ7q52yNS6P_yTPYiHqikdUIAilR56EipvjqMNbw9E-Hw4o5yGGM7TPGS_LUF2KQrxUiY Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: X-Openstack-Nova-Api-Version: 2.47 Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 6b53bf79b55c40f0b183944abf80677b Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersAaction247Test-321495252 Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6b53bf79b55c40f0b183944abf80677b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b53bf79b55c40f0b183944abf80677b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6b53bf79b55c40f0b183944abf80677b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b53bf79b55c40f0b183944abf80677b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersAaction247Test-321495252 Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 6b53bf79b55c40f0b183944abf80677b Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersAaction247Test-321495252 Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersAaction247Test-321495252-project Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: fa5428f5fb9e422482db37a51806d383 Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersAaction247Test-321495252-project Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 21d12720-8896-4587-8ec7-1fd0fb5a0c6a could not be found. Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '21d12720-8896-4587-8ec7-1fd0fb5a0c6a'} Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21d12720-8896-4587-8ec7-1fd0fb5a0c6a could not be found. Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21d12720-8896-4587-8ec7-1fd0fb5a0c6a could not be found. Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:20.415853 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:20.420492 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:20.420492 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:20.420492 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:20.420492 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:20.420492 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:20.420492 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21d12720-8896-4587-8ec7-1fd0fb5a0c6a could not be found. Jul 19 22:48:20.420492 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:20.423546 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-18ca0e6f-9025-4678-a169-730b6ab0b4e7 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] Returning 404 to user: Instance 21d12720-8896-4587-8ec7-1fd0fb5a0c6a could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:20.425135 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-18ca0e6f-9025-4678-a169-730b6ab0b4e7 tempest-ServersAaction247Test-321495252 tempest-ServersAaction247Test-321495252-project] 10.222.0.25 "GET /compute/v2.1/servers/21d12720-8896-4587-8ec7-1fd0fb5a0c6a" status: 404 len: 111 microversion: 2.47 time: 0.069849 Jul 19 22:48:20.426967 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2237/4427] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:20 2022] GET /compute/v2.1/servers/21d12720-8896-4587-8ec7-1fd0fb5a0c6a => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 19 22:48:20.432326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-db948935-9007-45fe-b42c-0499ce491551 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Calling method '.version_select at 0x7f7a030578b0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:20.494691 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-db948935-9007-45fe-b42c-0499ce491551 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/9b24795c-0d88-4633-b901-7335297e7d0b" status: 200 len: 288 microversion: 2.1 time: 0.066244 Jul 19 22:48:20.495396 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2238/4428] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 19 22:48:20 2022] GET /compute/v2.1/os-snapshots/9b24795c-0d88-4633-b901-7335297e7d0b => generated 288 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:48:20.511481 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c3a34b01-0754-43e1-9dd4-0183e19864cb tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Calling method '.version_select at 0x7f7a030ce160>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:20.654268 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c3a34b01-0754-43e1-9dd4-0183e19864cb tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/9b24795c-0d88-4633-b901-7335297e7d0b" status: 202 len: 0 microversion: 2.1 time: 0.150712 Jul 19 22:48:20.654977 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2239/4429] 10.222.0.25 () {58 vars in 1253 bytes} [Tue Jul 19 22:48:20 2022] DELETE /compute/v2.1/os-snapshots/9b24795c-0d88-4633-b901-7335297e7d0b => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:48:20.666666 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bf77c080-1df6-4776-a010-63b7e126ac0f tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Calling method '.version_select at 0x7f7a030b20d0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:20.725081 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bf77c080-1df6-4776-a010-63b7e126ac0f tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/9b24795c-0d88-4633-b901-7335297e7d0b" status: 200 len: 287 microversion: 2.1 time: 0.063644 Jul 19 22:48:20.726351 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2240/4430] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 19 22:48:20 2022] GET /compute/v2.1/os-snapshots/9b24795c-0d88-4633-b901-7335297e7d0b => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:48:20.760443 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-5812da22-b49b-4546-9753-c31b3efe1c76 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Invalid key_name provided. Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5812da22-b49b-4546-9753-c31b3efe1c76 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 247 Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1629453494", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "key_name": "tempest-key-1000445751", "networks": [{"uuid": "711438ef-9562-4879-b7e2-ec9cf463e48f"}]}} Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid key_name provided. Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1629453494', 'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691', 'flavorRef': '452', 'key_name': 'tempest-key-1000445751', 'networks': [{'uuid': '711438ef-9562-4879-b7e2-ec9cf463e48f'}]}}} Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1000445751 not found for user 1c827b931a0f497cbd847695315d378d Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:20.763553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5812da22-b49b-4546-9753-c31b3efe1c76 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 400 to user: Invalid key_name provided. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5812da22-b49b-4546-9753-c31b3efe1c76 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.430080 Jul 19 22:48:20.767994 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2191/4431] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:48:20 2022] POST /compute/v2.1/servers => generated 70 bytes in 431 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 19 22:48:20.783988 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9dd5ae42-9410-479c-a0c8-95f9f150a1d5 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:20.794435 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9dd5ae42-9410-479c-a0c8-95f9f150a1d5 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:20.803698 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9dd5ae42-9410-479c-a0c8-95f9f150a1d5 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:20.804309 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9dd5ae42-9410-479c-a0c8-95f9f150a1d5 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:20.805421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9dd5ae42-9410-479c-a0c8-95f9f150a1d5 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:20.806008 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9dd5ae42-9410-479c-a0c8-95f9f150a1d5 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:20.889955 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:48:20.998765 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9dd5ae42-9410-479c-a0c8-95f9f150a1d5 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:21.008960 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9dd5ae42-9410-479c-a0c8-95f9f150a1d5 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.237252 Jul 19 22:48:21.025281 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2241/4432] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:20 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:21.028044 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-76ce675a-626b-4477-812e-c47493373ba1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:21.028674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-76ce675a-626b-4477-812e-c47493373ba1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:21.035465 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-76ce675a-626b-4477-812e-c47493373ba1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:21.035942 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-76ce675a-626b-4477-812e-c47493373ba1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:21.036707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-76ce675a-626b-4477-812e-c47493373ba1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:21.044623 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-76ce675a-626b-4477-812e-c47493373ba1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:21.175176 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b9210897-d342-4532-81fc-775c15473402 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:21.175916 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b9210897-d342-4532-81fc-775c15473402 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:21.186002 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b9210897-d342-4532-81fc-775c15473402 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:21.186448 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b9210897-d342-4532-81fc-775c15473402 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:21.189237 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b9210897-d342-4532-81fc-775c15473402 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:21.190591 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b9210897-d342-4532-81fc-775c15473402 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:21.340529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-76ce675a-626b-4477-812e-c47493373ba1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:21.392501 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-76ce675a-626b-4477-812e-c47493373ba1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.369238 Jul 19 22:48:21.396550 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2192/4433] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:21 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:21.403781 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0d002876-51aa-459a-9a60-2df1d6e292a5 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:21.404420 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0d002876-51aa-459a-9a60-2df1d6e292a5 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:21.420304 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d002876-51aa-459a-9a60-2df1d6e292a5 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:21.421043 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d002876-51aa-459a-9a60-2df1d6e292a5 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:21.422198 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d002876-51aa-459a-9a60-2df1d6e292a5 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:21.422876 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d002876-51aa-459a-9a60-2df1d6e292a5 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:21.461267 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b9210897-d342-4532-81fc-775c15473402 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:21.490202 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b9210897-d342-4532-81fc-775c15473402 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1714 microversion: 2.1 time: 0.310182 Jul 19 22:48:21.491168 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2242/4434] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:21 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1714 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:21.607526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0d002876-51aa-459a-9a60-2df1d6e292a5 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:21.633958 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0d002876-51aa-459a-9a60-2df1d6e292a5 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:21.638820 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0d002876-51aa-459a-9a60-2df1d6e292a5 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:21.642478 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0d002876-51aa-459a-9a60-2df1d6e292a5 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1372 microversion: 2.57 time: 0.242504 Jul 19 22:48:21.643137 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2193/4435] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:21 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1372 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:21.670657 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e898ede1-c0d6-49fb-902a-780fe8a4dfe4 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-748895335", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "711438ef-9562-4879-b7e2-ec9cf463e48f"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:21.742812 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3ea10547-0272-4296-808b-f78233d26dbc tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Calling method '.version_select at 0x7f7a0332a160>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:21.832197 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3ea10547-0272-4296-808b-f78233d26dbc tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/9b24795c-0d88-4633-b901-7335297e7d0b" status: 200 len: 287 microversion: 2.1 time: 0.097304 Jul 19 22:48:21.837848 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2194/4436] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 19 22:48:21 2022] GET /compute/v2.1/os-snapshots/9b24795c-0d88-4633-b901-7335297e7d0b => generated 287 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:48:21.848720 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.security_group_api [None req-e898ede1-c0d6-49fb-902a-780fe8a4dfe4 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Neutron security group does_not_exist not found {{(pid=119338) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 19 22:48:21.849629 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-e898ede1-c0d6-49fb-902a-780fe8a4dfe4 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e898ede1-c0d6-49fb-902a-780fe8a4dfe4 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 257 Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-748895335", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "711438ef-9562-4879-b7e2-ec9cf463e48f"}]}} Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-748895335', 'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '711438ef-9562-4879-b7e2-ec9cf463e48f'}]}}} Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 19 22:48:21.863562 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:21.867804 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e898ede1-c0d6-49fb-902a-780fe8a4dfe4 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:21.871978 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e898ede1-c0d6-49fb-902a-780fe8a4dfe4 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.198614 Jul 19 22:48:21.871978 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2243/4437] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:48:21 2022] POST /compute/v2.1/servers => generated 106 bytes in 200 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:48:21.874226 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a7c5243e-a22c-4f85-9d18-77f7dcd6ac1c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:21.875803 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a7c5243e-a22c-4f85-9d18-77f7dcd6ac1c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:21.889368 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2bf4837c-8e01-4081-a6ea-16a3cf5ac9d4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:21.889933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2bf4837c-8e01-4081-a6ea-16a3cf5ac9d4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:21.893008 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a7c5243e-a22c-4f85-9d18-77f7dcd6ac1c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:21.894212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a7c5243e-a22c-4f85-9d18-77f7dcd6ac1c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:21.897503 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a7c5243e-a22c-4f85-9d18-77f7dcd6ac1c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:21.898264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a7c5243e-a22c-4f85-9d18-77f7dcd6ac1c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:21.908511 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2bf4837c-8e01-4081-a6ea-16a3cf5ac9d4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:21.908968 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2bf4837c-8e01-4081-a6ea-16a3cf5ac9d4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:21.914159 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2bf4837c-8e01-4081-a6ea-16a3cf5ac9d4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:21.915183 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2bf4837c-8e01-4081-a6ea-16a3cf5ac9d4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:21.922898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:48:22.203371 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a7c5243e-a22c-4f85-9d18-77f7dcd6ac1c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:22.228943 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a7c5243e-a22c-4f85-9d18-77f7dcd6ac1c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.358162 Jul 19 22:48:22.229904 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2195/4438] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:21 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:22.260667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-da0bf154-8014-452c-98c9-7488b5941907 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:22.265290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-da0bf154-8014-452c-98c9-7488b5941907 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:22.306701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-da0bf154-8014-452c-98c9-7488b5941907 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:22.310499 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-da0bf154-8014-452c-98c9-7488b5941907 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:22.317312 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-da0bf154-8014-452c-98c9-7488b5941907 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:22.318412 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-da0bf154-8014-452c-98c9-7488b5941907 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:22.563302 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-2bf4837c-8e01-4081-a6ea-16a3cf5ac9d4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] HTTP exception thrown: Cannot 'detach_volume' instance 02571222-3b10-4a0d-8b70-a8202c37f6a7 while it is in vm_state rescued Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2bf4837c-8e01-4081-a6ea-16a3cf5ac9d4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Request method failure captured: Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments/b84e7a73-ea9c-473a-b09b-26aad15f7870 HTTP/1.1 Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zPB9pdZx5bGxAOx1bWrMM0FEhH4uLd_pSCvc_RNVR1Ml3e2RdxqyGOtd-lt2kxygYFNrKmFRc3yVX-y9hoY_QR39GzP2XOyLb00mNIcRNYPp_Z40PO_3EFeEpNqlZOyhEu-fa-kVbsARhW2vxsGD8FHWpMQupoNdZ8KLVFw7a76o8s Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 95469b549ae7425a83e0d93bb8c10860 Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1399962716 Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1399962716 Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 95469b549ae7425a83e0d93bb8c10860 Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1399962716 Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerRescueNegativeTestJSON-1399962716-project Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 5f92608789324ac48fef6ce87a745a07 Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1399962716-project Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: exception: Cannot 'detach_volume' instance 02571222-3b10-4a0d-8b70-a8202c37f6a7 while it is in vm_state rescued Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'server_id': '02571222-3b10-4a0d-8b70-a8202c37f6a7', 'id': 'b84e7a73-ea9c-473a-b09b-26aad15f7870'} Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 02571222-3b10-4a0d-8b70-a8202c37f6a7 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 02571222-3b10-4a0d-8b70-a8202c37f6a7 while it is in vm_state rescued Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:22.576303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:22.580264 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:22.580264 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:22.580264 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:22.580264 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:22.580264 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 02571222-3b10-4a0d-8b70-a8202c37f6a7 while it is in vm_state rescued Jul 19 22:48:22.580264 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:22.580264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2bf4837c-8e01-4081-a6ea-16a3cf5ac9d4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Returning 409 to user: Cannot 'detach_volume' instance 02571222-3b10-4a0d-8b70-a8202c37f6a7 while it is in vm_state rescued {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:22.580264 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2bf4837c-8e01-4081-a6ea-16a3cf5ac9d4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "DELETE /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments/b84e7a73-ea9c-473a-b09b-26aad15f7870" status: 409 len: 152 microversion: 2.1 time: 0.694515 Jul 19 22:48:22.581402 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2244/4439] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 19 22:48:21 2022] DELETE /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments/b84e7a73-ea9c-473a-b09b-26aad15f7870 => generated 152 bytes in 697 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 19 22:48:22.585850 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-da0bf154-8014-452c-98c9-7488b5941907 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:22.595201 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7bbfd5f8-afdf-4724-a319-0aadfc18f8c5 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:22.595749 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-da0bf154-8014-452c-98c9-7488b5941907 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.350512 Jul 19 22:48:22.596088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7bbfd5f8-afdf-4724-a319-0aadfc18f8c5 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:22.609303 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2196/4440] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:22 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:22.615006 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e2c74192-78a9-436a-b92b-8c878154bf94 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:22.615753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e2c74192-78a9-436a-b92b-8c878154bf94 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 4d3fdb6b-66f5-43d9-8544-d535d48c5c8a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:22.618788 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bbfd5f8-afdf-4724-a319-0aadfc18f8c5 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:22.620262 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bbfd5f8-afdf-4724-a319-0aadfc18f8c5 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:22.621828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bbfd5f8-afdf-4724-a319-0aadfc18f8c5 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:22.626383 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bbfd5f8-afdf-4724-a319-0aadfc18f8c5 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:22.630333 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-e2c74192-78a9-436a-b92b-8c878154bf94 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Instance 4d3fdb6b-66f5-43d9-8544-d535d48c5c8a could not be found. Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e2c74192-78a9-436a-b92b-8c878154bf94 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/servers/4d3fdb6b-66f5-43d9-8544-d535d48c5c8a HTTP/1.1 Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 4d3fdb6b-66f5-43d9-8544-d535d48c5c8a could not be found. Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '4d3fdb6b-66f5-43d9-8544-d535d48c5c8a'} Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d3fdb6b-66f5-43d9-8544-d535d48c5c8a could not be found. Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d3fdb6b-66f5-43d9-8544-d535d48c5c8a could not be found. Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:22.632150 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:22.636798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:22.636798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:22.636798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:22.636798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:22.636798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:22.636798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d3fdb6b-66f5-43d9-8544-d535d48c5c8a could not be found. Jul 19 22:48:22.636798 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:22.638514 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e2c74192-78a9-436a-b92b-8c878154bf94 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 404 to user: Instance 4d3fdb6b-66f5-43d9-8544-d535d48c5c8a could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:22.640871 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e2c74192-78a9-436a-b92b-8c878154bf94 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4d3fdb6b-66f5-43d9-8544-d535d48c5c8a" status: 404 len: 111 microversion: 2.1 time: 0.028542 Jul 19 22:48:22.645244 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2197/4441] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:48:22 2022] DELETE /compute/v2.1/servers/4d3fdb6b-66f5-43d9-8544-d535d48c5c8a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:48:22.650456 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-320b4e76-2db0-410b-bba7-b109b0f7cbbd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:22.651626 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-320b4e76-2db0-410b-bba7-b109b0f7cbbd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:22.661637 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-320b4e76-2db0-410b-bba7-b109b0f7cbbd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:22.662430 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-320b4e76-2db0-410b-bba7-b109b0f7cbbd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:22.663460 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-320b4e76-2db0-410b-bba7-b109b0f7cbbd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:22.664441 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-320b4e76-2db0-410b-bba7-b109b0f7cbbd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:22.819531 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7bbfd5f8-afdf-4724-a319-0aadfc18f8c5 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "POST /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/action" status: 202 len: 0 microversion: 2.1 time: 0.230113 Jul 19 22:48:22.827150 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2245/4442] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:48:22 2022] POST /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 22:48:22.834302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-65adb11e-e7b2-4efe-9cbe-f9b85c5438d8 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:22.835635 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-65adb11e-e7b2-4efe-9cbe-f9b85c5438d8 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:22.847937 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65adb11e-e7b2-4efe-9cbe-f9b85c5438d8 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:22.848623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65adb11e-e7b2-4efe-9cbe-f9b85c5438d8 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:22.849620 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65adb11e-e7b2-4efe-9cbe-f9b85c5438d8 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:22.850418 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65adb11e-e7b2-4efe-9cbe-f9b85c5438d8 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:22.964817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-65adb11e-e7b2-4efe-9cbe-f9b85c5438d8 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:22.981567 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-65adb11e-e7b2-4efe-9cbe-f9b85c5438d8 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:22.989977 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-65adb11e-e7b2-4efe-9cbe-f9b85c5438d8 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:22.990599 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-320b4e76-2db0-410b-bba7-b109b0f7cbbd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:22.995818 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-65adb11e-e7b2-4efe-9cbe-f9b85c5438d8 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1357 microversion: 2.57 time: 0.162948 Jul 19 22:48:22.998834 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2246/4443] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:22 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:23.001426 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-320b4e76-2db0-410b-bba7-b109b0f7cbbd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.354803 Jul 19 22:48:23.002486 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2198/4444] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:22 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:23.011730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2eaa8d00-65b0-472e-a8fa-16a4d240845c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:23.012594 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2eaa8d00-65b0-472e-a8fa-16a4d240845c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:23.014215 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d0a73eb2-36af-4ff4-a0c4-1da573114f29 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Calling method '.version_select at 0x7f7a03d26160>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:23.034007 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2eaa8d00-65b0-472e-a8fa-16a4d240845c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:23.035319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2eaa8d00-65b0-472e-a8fa-16a4d240845c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:23.049095 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2eaa8d00-65b0-472e-a8fa-16a4d240845c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:23.052065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2eaa8d00-65b0-472e-a8fa-16a4d240845c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:23.081035 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d0a73eb2-36af-4ff4-a0c4-1da573114f29 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/9b24795c-0d88-4633-b901-7335297e7d0b" status: 200 len: 287 microversion: 2.1 time: 0.076904 Jul 19 22:48:23.082356 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2199/4445] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 19 22:48:23 2022] GET /compute/v2.1/os-snapshots/9b24795c-0d88-4633-b901-7335297e7d0b => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:48:23.087059 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8a529a9d-5222-4ded-8b05-57da7f8a65aa tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:23.087825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8a529a9d-5222-4ded-8b05-57da7f8a65aa tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:23.104653 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a529a9d-5222-4ded-8b05-57da7f8a65aa tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:23.106298 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a529a9d-5222-4ded-8b05-57da7f8a65aa tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:23.108428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a529a9d-5222-4ded-8b05-57da7f8a65aa tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:23.110952 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a529a9d-5222-4ded-8b05-57da7f8a65aa tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:23.384782 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8a529a9d-5222-4ded-8b05-57da7f8a65aa tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:23.396798 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8a529a9d-5222-4ded-8b05-57da7f8a65aa tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.313272 Jul 19 22:48:23.397392 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2200/4446] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:23 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:23.404286 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2eaa8d00-65b0-472e-a8fa-16a4d240845c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:23.419037 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2eaa8d00-65b0-472e-a8fa-16a4d240845c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1722 microversion: 2.1 time: 0.414431 Jul 19 22:48:23.420473 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-defd6bf9-8dd9-454a-bee0-ccb1a8e6e59d tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:23.420871 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2247/4447] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:22 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1722 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:23.423953 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-defd6bf9-8dd9-454a-bee0-ccb1a8e6e59d tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:23.433178 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a01d0e90-810e-4c9b-9add-f69d77e414da tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:23.434146 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a01d0e90-810e-4c9b-9add-f69d77e414da tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Failed to fetch instance by id 9223372036854775808 {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 19 22:48:23.436465 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-defd6bf9-8dd9-454a-bee0-ccb1a8e6e59d tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:23.437444 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-defd6bf9-8dd9-454a-bee0-ccb1a8e6e59d tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:23.438265 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-defd6bf9-8dd9-454a-bee0-ccb1a8e6e59d tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:23.438792 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-a01d0e90-810e-4c9b-9add-f69d77e414da tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a01d0e90-810e-4c9b-9add-f69d77e414da tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 9223372036854775808 could not be found. Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '9223372036854775808'} Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:23.440552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:23.444612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:23.444612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:23.444612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 19 22:48:23.444612 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:23.444612 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a01d0e90-810e-4c9b-9add-f69d77e414da tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:23.444612 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a01d0e90-810e-4c9b-9add-f69d77e414da tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.019675 Jul 19 22:48:23.444962 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-defd6bf9-8dd9-454a-bee0-ccb1a8e6e59d tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:23.445561 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2248/4448] 10.222.0.25 () {58 vars in 1187 bytes} [Tue Jul 19 22:48:23 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:48:23.461040 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-550f707d-0aaf-40f5-b732-3ee802750302 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:23.461672 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-550f707d-0aaf-40f5-b732-3ee802750302 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:23.477527 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-550f707d-0aaf-40f5-b732-3ee802750302 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:23.477993 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-550f707d-0aaf-40f5-b732-3ee802750302 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:23.478778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-550f707d-0aaf-40f5-b732-3ee802750302 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:23.483223 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-550f707d-0aaf-40f5-b732-3ee802750302 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:23.504413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-defd6bf9-8dd9-454a-bee0-ccb1a8e6e59d tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:48:23.543682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:48:23.632461 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-defd6bf9-8dd9-454a-bee0-ccb1a8e6e59d tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 204 len: 0 microversion: 2.57 time: 0.233661 Jul 19 22:48:23.634171 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2201/4449] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 22:48:23 2022] DELETE /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:48:23.650302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6f0f2c7e-d7fa-4bc7-bc89-9d06569a23bc tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:23.652901 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6f0f2c7e-d7fa-4bc7-bc89-9d06569a23bc tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:23.669745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6f0f2c7e-d7fa-4bc7-bc89-9d06569a23bc tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:23.674147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6f0f2c7e-d7fa-4bc7-bc89-9d06569a23bc tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:23.675642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6f0f2c7e-d7fa-4bc7-bc89-9d06569a23bc tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:23.678034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6f0f2c7e-d7fa-4bc7-bc89-9d06569a23bc tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:23.811281 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-550f707d-0aaf-40f5-b732-3ee802750302 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:23.821356 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-550f707d-0aaf-40f5-b732-3ee802750302 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.371166 Jul 19 22:48:23.825372 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2249/4450] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:23 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:23.848601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0c491547-cf00-4237-abeb-f5a0dde4d3b8 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:23.850941 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0c491547-cf00-4237-abeb-f5a0dde4d3b8 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:23.861130 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c491547-cf00-4237-abeb-f5a0dde4d3b8 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:23.861873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c491547-cf00-4237-abeb-f5a0dde4d3b8 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:23.862845 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c491547-cf00-4237-abeb-f5a0dde4d3b8 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:23.863454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c491547-cf00-4237-abeb-f5a0dde4d3b8 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:23.867884 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6f0f2c7e-d7fa-4bc7-bc89-9d06569a23bc tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:23.877291 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6f0f2c7e-d7fa-4bc7-bc89-9d06569a23bc tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:23.890603 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6f0f2c7e-d7fa-4bc7-bc89-9d06569a23bc tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:23.897200 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6f0f2c7e-d7fa-4bc7-bc89-9d06569a23bc tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1363 microversion: 2.57 time: 0.258122 Jul 19 22:48:23.900323 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2202/4451] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:23 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:24.098779 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9855dd6a-06b1-49d1-a036-f1dbb2a379b1 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Calling method '.version_select at 0x7f7a10349820>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:24.126399 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0c491547-cf00-4237-abeb-f5a0dde4d3b8 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:24.157028 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0c491547-cf00-4237-abeb-f5a0dde4d3b8 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.312519 Jul 19 22:48:24.158340 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2250/4452] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:23 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:24.174219 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-9855dd6a-06b1-49d1-a036-f1dbb2a379b1 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] HTTP exception thrown: Snapshot 9b24795c-0d88-4633-b901-7335297e7d0b could not be found. Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9855dd6a-06b1-49d1-a036-f1dbb2a379b1 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Request method failure captured: Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/os-snapshots/9b24795c-0d88-4633-b901-7335297e7d0b HTTP/1.1 Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zSuhn8xX-mmd8PrNDbEB1tuB3DlbIWGrW5EqyrtQTFMdLUgrah5KtU3z7Luvo3pzUlxqd6OzJnmM71zuBJXmNeUBUZ1b1AUAnSqpNv991FIjf1FGLtLDRDmwjMdznS-hx285NsinSTxoJLxhnMCaZ037_aY1KqHwn9BaH2ax4TG_ZU Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: a12c5856c0f94eb7b7a160b7fe981147 Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-609181030 Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a12c5856c0f94eb7b7a160b7fe981147"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a12c5856c0f94eb7b7a160b7fe981147"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a12c5856c0f94eb7b7a160b7fe981147"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a12c5856c0f94eb7b7a160b7fe981147"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-VolumesSnapshotsTestJSON-609181030 Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: a12c5856c0f94eb7b7a160b7fe981147 Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-609181030 Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-VolumesSnapshotsTestJSON-609181030-project Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: f41fa79d20404ed58b8c77277e987700 Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-VolumesSnapshotsTestJSON-609181030-project Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: exception: Snapshot 9b24795c-0d88-4633-b901-7335297e7d0b could not be found. Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '9b24795c-0d88-4633-b901-7335297e7d0b'} Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9b24795c-0d88-4633-b901-7335297e7d0b could not be found. (HTTP 404) (Request-ID: req-a836177c-070f-414b-94cf-f54e8ccead4c) Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 22:48:24.182742 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9b24795c-0d88-4633-b901-7335297e7d0b could not be found. Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9b24795c-0d88-4633-b901-7335297e7d0b could not be found. Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9b24795c-0d88-4633-b901-7335297e7d0b could not be found. Jul 19 22:48:24.186320 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:24.193687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9855dd6a-06b1-49d1-a036-f1dbb2a379b1 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Returning 404 to user: Snapshot 9b24795c-0d88-4633-b901-7335297e7d0b could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:24.196030 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9855dd6a-06b1-49d1-a036-f1dbb2a379b1 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/9b24795c-0d88-4633-b901-7335297e7d0b" status: 404 len: 111 microversion: 2.1 time: 0.103513 Jul 19 22:48:24.196030 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2203/4453] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 19 22:48:24 2022] GET /compute/v2.1/os-snapshots/9b24795c-0d88-4633-b901-7335297e7d0b => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:48:24.204784 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ef342345-2aba-4007-9dfc-1ad9911b807a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:24.206409 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ef342345-2aba-4007-9dfc-1ad9911b807a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Failed to fetch instance by id -1 {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 19 22:48:24.209718 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-ef342345-2aba-4007-9dfc-1ad9911b807a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Instance -1 could not be found. Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ef342345-2aba-4007-9dfc-1ad9911b807a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance -1 could not be found. Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '-1'} Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:24.211427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:24.219545 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:24.219545 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:24.219545 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 19 22:48:24.219545 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:24.228757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9a7389c6-47b5-4189-96f3-6bd99047a292 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Calling method '.version_select at 0x7f7a032cce50>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:24.236999 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ef342345-2aba-4007-9dfc-1ad9911b807a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 404 to user: Instance -1 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:24.240106 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ef342345-2aba-4007-9dfc-1ad9911b807a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.063909 Jul 19 22:48:24.242212 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2251/4454] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:48:24 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:48:24.253050 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-048933dc-a720-48ff-b495-f1291d11a3f2 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:24.254441 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-048933dc-a720-48ff-b495-f1291d11a3f2 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:24.270648 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-048933dc-a720-48ff-b495-f1291d11a3f2 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:24.279325 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-048933dc-a720-48ff-b495-f1291d11a3f2 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:24.285746 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-048933dc-a720-48ff-b495-f1291d11a3f2 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:24.286624 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-048933dc-a720-48ff-b495-f1291d11a3f2 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:24.399637 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9a7389c6-47b5-4189-96f3-6bd99047a292 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/3a45690a-abfd-44c4-ac77-564c0aac49a1" status: 202 len: 0 microversion: 2.1 time: 0.195329 Jul 19 22:48:24.404938 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2204/4455] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 19 22:48:24 2022] DELETE /compute/v2.1/os-volumes/3a45690a-abfd-44c4-ac77-564c0aac49a1 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:48:24.414090 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d6427abb-5a05-40e9-8655-3421aa89df5c tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Calling method '.version_select at 0x7f7a107055e0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:24.545165 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d6427abb-5a05-40e9-8655-3421aa89df5c tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3a45690a-abfd-44c4-ac77-564c0aac49a1" status: 200 len: 343 microversion: 2.1 time: 0.131433 Jul 19 22:48:24.549908 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2205/4456] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 19 22:48:24 2022] GET /compute/v2.1/os-volumes/3a45690a-abfd-44c4-ac77-564c0aac49a1 => generated 343 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:48:24.571318 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f800e60f-e8b9-432a-925a-cdc0336c7132 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:24.589523 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f800e60f-e8b9-432a-925a-cdc0336c7132 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:24.645980 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f800e60f-e8b9-432a-925a-cdc0336c7132 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:24.646827 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f800e60f-e8b9-432a-925a-cdc0336c7132 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:24.650461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f800e60f-e8b9-432a-925a-cdc0336c7132 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:24.654191 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f800e60f-e8b9-432a-925a-cdc0336c7132 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:24.821893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-048933dc-a720-48ff-b495-f1291d11a3f2 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:24.831767 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-048933dc-a720-48ff-b495-f1291d11a3f2 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.585847 Jul 19 22:48:24.837429 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2252/4457] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:24 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:24.858444 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fc970353-6b79-46af-9038-169f8de4ed18 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:24.860435 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fc970353-6b79-46af-9038-169f8de4ed18 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:24.868939 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc970353-6b79-46af-9038-169f8de4ed18 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:24.870243 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc970353-6b79-46af-9038-169f8de4ed18 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:24.871562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc970353-6b79-46af-9038-169f8de4ed18 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:24.872355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc970353-6b79-46af-9038-169f8de4ed18 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:25.195018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fc970353-6b79-46af-9038-169f8de4ed18 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:25.213430 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f800e60f-e8b9-432a-925a-cdc0336c7132 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:25.221573 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fc970353-6b79-46af-9038-169f8de4ed18 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.353933 Jul 19 22:48:25.224676 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2253/4458] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:24 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:25.228083 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f800e60f-e8b9-432a-925a-cdc0336c7132 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1722 microversion: 2.1 time: 0.673801 Jul 19 22:48:25.232987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a58f4217-cb31-495a-9f3e-fc52b0294ae1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:25.234465 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2206/4459] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:24 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1722 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:25.236134 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a58f4217-cb31-495a-9f3e-fc52b0294ae1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:25.246644 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ef45995b-9964-4480-9bf2-50f4e316994e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:25.248002 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ef45995b-9964-4480-9bf2-50f4e316994e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: e9d90269-8b09-4a89-9044-6409668e1b4a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:25.260223 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a58f4217-cb31-495a-9f3e-fc52b0294ae1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:25.261239 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a58f4217-cb31-495a-9f3e-fc52b0294ae1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:25.262524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a58f4217-cb31-495a-9f3e-fc52b0294ae1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:25.266815 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a58f4217-cb31-495a-9f3e-fc52b0294ae1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:25.271826 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-ef45995b-9964-4480-9bf2-50f4e316994e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Instance e9d90269-8b09-4a89-9044-6409668e1b4a could not be found. Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ef45995b-9964-4480-9bf2-50f4e316994e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/e9d90269-8b09-4a89-9044-6409668e1b4a/action HTTP/1.1 Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 19 Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: {"forceDelete": {}} Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance e9d90269-8b09-4a89-9044-6409668e1b4a could not be found. Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'e9d90269-8b09-4a89-9044-6409668e1b4a', 'body': {'forceDelete': {}}} Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9d90269-8b09-4a89-9044-6409668e1b4a could not be found. Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9d90269-8b09-4a89-9044-6409668e1b4a could not be found. Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:25.282859 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:25.286647 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:25.286647 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:25.286647 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9d90269-8b09-4a89-9044-6409668e1b4a could not be found. Jul 19 22:48:25.286647 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:25.286647 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ef45995b-9964-4480-9bf2-50f4e316994e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 404 to user: Instance e9d90269-8b09-4a89-9044-6409668e1b4a could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:25.286647 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ef45995b-9964-4480-9bf2-50f4e316994e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers/e9d90269-8b09-4a89-9044-6409668e1b4a/action" status: 404 len: 111 microversion: 2.1 time: 0.047654 Jul 19 22:48:25.287012 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2207/4460] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:48:25 2022] POST /compute/v2.1/servers/e9d90269-8b09-4a89-9044-6409668e1b4a/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:48:25.300018 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a0437a19-246b-4855-8412-51c6a58fd816 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:25.301635 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a0437a19-246b-4855-8412-51c6a58fd816 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:25.324537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0437a19-246b-4855-8412-51c6a58fd816 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:25.325354 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0437a19-246b-4855-8412-51c6a58fd816 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:25.326509 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0437a19-246b-4855-8412-51c6a58fd816 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:25.328210 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0437a19-246b-4855-8412-51c6a58fd816 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:25.428019 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a58f4217-cb31-495a-9f3e-fc52b0294ae1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:25.445621 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a58f4217-cb31-495a-9f3e-fc52b0294ae1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:25.449860 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a58f4217-cb31-495a-9f3e-fc52b0294ae1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:25.455428 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a58f4217-cb31-495a-9f3e-fc52b0294ae1 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1363 microversion: 2.57 time: 0.229163 Jul 19 22:48:25.458795 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2254/4461] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:25 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:25.566224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0e2964df-bd22-4ad4-b18a-33339ca1321c tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Calling method '.version_select at 0x7f7a030ce940>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:25.657131 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a0437a19-246b-4855-8412-51c6a58fd816 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:25.673125 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a0437a19-246b-4855-8412-51c6a58fd816 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.380916 Jul 19 22:48:25.684733 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2208/4462] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:25 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:48:25.707219 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5a3af75e-0f89-44b9-ab6c-94eff3934ae6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:25.708051 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5a3af75e-0f89-44b9-ab6c-94eff3934ae6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:25.721852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a3af75e-0f89-44b9-ab6c-94eff3934ae6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:25.722331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a3af75e-0f89-44b9-ab6c-94eff3934ae6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:25.723127 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a3af75e-0f89-44b9-ab6c-94eff3934ae6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:25.723576 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a3af75e-0f89-44b9-ab6c-94eff3934ae6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:25.740011 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0e2964df-bd22-4ad4-b18a-33339ca1321c tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3a45690a-abfd-44c4-ac77-564c0aac49a1" status: 200 len: 343 microversion: 2.1 time: 0.178495 Jul 19 22:48:25.745665 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2255/4463] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 19 22:48:25 2022] GET /compute/v2.1/os-volumes/3a45690a-abfd-44c4-ac77-564c0aac49a1 => generated 343 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:48:26.017600 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5a3af75e-0f89-44b9-ab6c-94eff3934ae6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:26.027959 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5a3af75e-0f89-44b9-ab6c-94eff3934ae6 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.325835 Jul 19 22:48:26.029641 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2209/4464] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:25 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:48:26.051549 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-eddc3ee9-6e9c-4548-86d3-945739270c21 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:26.052625 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-eddc3ee9-6e9c-4548-86d3-945739270c21 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 4f8f53cc-eaf2-47b9-8714-3b03a8e05976] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:26.068781 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-eddc3ee9-6e9c-4548-86d3-945739270c21 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Instance 4f8f53cc-eaf2-47b9-8714-3b03a8e05976 could not be found. Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-eddc3ee9-6e9c-4548-86d3-945739270c21 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers/4f8f53cc-eaf2-47b9-8714-3b03a8e05976/action HTTP/1.1 Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 39 Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: {"os-getConsoleOutput": {"length": 10}} Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 4f8f53cc-eaf2-47b9-8714-3b03a8e05976 could not be found. Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '4f8f53cc-eaf2-47b9-8714-3b03a8e05976', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f8f53cc-eaf2-47b9-8714-3b03a8e05976 could not be found. Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f8f53cc-eaf2-47b9-8714-3b03a8e05976 could not be found. Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:26.080833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:26.085228 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:26.085228 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:26.085228 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:26.085228 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:26.085228 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f8f53cc-eaf2-47b9-8714-3b03a8e05976 could not be found. Jul 19 22:48:26.085228 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:26.085228 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-eddc3ee9-6e9c-4548-86d3-945739270c21 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 404 to user: Instance 4f8f53cc-eaf2-47b9-8714-3b03a8e05976 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:26.085228 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-eddc3ee9-6e9c-4548-86d3-945739270c21 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers/4f8f53cc-eaf2-47b9-8714-3b03a8e05976/action" status: 404 len: 111 microversion: 2.1 time: 0.038098 Jul 19 22:48:26.092180 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ee8fa523-e3c5-4703-b498-14a45407bc3c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:26.092807 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ee8fa523-e3c5-4703-b498-14a45407bc3c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:26.100224 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2256/4465] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:48:26 2022] POST /compute/v2.1/servers/4f8f53cc-eaf2-47b9-8714-3b03a8e05976/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:48:26.105372 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ee8fa523-e3c5-4703-b498-14a45407bc3c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:26.106933 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ee8fa523-e3c5-4703-b498-14a45407bc3c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:26.110810 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ee8fa523-e3c5-4703-b498-14a45407bc3c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:26.111316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ee8fa523-e3c5-4703-b498-14a45407bc3c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:26.257914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b2613933-d2b4-4383-90ea-a1654f85c71d tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:26.258772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b2613933-d2b4-4383-90ea-a1654f85c71d tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:26.271068 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b2613933-d2b4-4383-90ea-a1654f85c71d tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:26.272653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b2613933-d2b4-4383-90ea-a1654f85c71d tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:26.275631 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b2613933-d2b4-4383-90ea-a1654f85c71d tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:26.276812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b2613933-d2b4-4383-90ea-a1654f85c71d tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:26.366690 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ee8fa523-e3c5-4703-b498-14a45407bc3c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:26.381172 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ee8fa523-e3c5-4703-b498-14a45407bc3c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.293235 Jul 19 22:48:26.381802 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2210/4466] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:26 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:48:26.405443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c81d0aef-7be9-4511-b351-ccea68735d52 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:26.414938 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c81d0aef-7be9-4511-b351-ccea68735d52 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:26.440089 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c81d0aef-7be9-4511-b351-ccea68735d52 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:26.440553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c81d0aef-7be9-4511-b351-ccea68735d52 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:26.441362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c81d0aef-7be9-4511-b351-ccea68735d52 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:26.441811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c81d0aef-7be9-4511-b351-ccea68735d52 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:26.730359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b2613933-d2b4-4383-90ea-a1654f85c71d tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:26.752518 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b2613933-d2b4-4383-90ea-a1654f85c71d tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1722 microversion: 2.1 time: 0.498320 Jul 19 22:48:26.767036 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2257/4467] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:26 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1722 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:26.786831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3575269f-cfca-409d-8484-10f604ca2747 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:26.794238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3575269f-cfca-409d-8484-10f604ca2747 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:26.820515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3575269f-cfca-409d-8484-10f604ca2747 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:26.822649 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3575269f-cfca-409d-8484-10f604ca2747 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:26.823633 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3575269f-cfca-409d-8484-10f604ca2747 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:26.825481 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3575269f-cfca-409d-8484-10f604ca2747 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:26.988459 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c81d0aef-7be9-4511-b351-ccea68735d52 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:27.008606 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c81d0aef-7be9-4511-b351-ccea68735d52 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.607635 Jul 19 22:48:27.021651 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2211/4468] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:26 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:27.031336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3575269f-cfca-409d-8484-10f604ca2747 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:27.034644 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5c853819-c490-4343-bdef-2573792c7255 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Calling method '.version_select at 0x7f7a03efb670>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:27.057691 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3575269f-cfca-409d-8484-10f604ca2747 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:27.066689 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3575269f-cfca-409d-8484-10f604ca2747 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51b35f7f096843ce9e69f9946c1fdf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3ae82c052344b4ad5027df166bc045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:27.069587 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3575269f-cfca-409d-8484-10f604ca2747 tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 200 len: 1363 microversion: 2.57 time: 0.301157 Jul 19 22:48:27.070921 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2258/4469] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:26 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 1363 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:27.087928 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-81725044-98c5-447f-9628-c7db7354a771 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:27.087928 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-81725044-98c5-447f-9628-c7db7354a771 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: f3f651e9-9cb8-48ba-85e9-207499ef99a5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:27.112721 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-81725044-98c5-447f-9628-c7db7354a771 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Instance f3f651e9-9cb8-48ba-85e9-207499ef99a5 could not be found. Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-81725044-98c5-447f-9628-c7db7354a771 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/f3f651e9-9cb8-48ba-85e9-207499ef99a5 HTTP/1.1 Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance f3f651e9-9cb8-48ba-85e9-207499ef99a5 could not be found. Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'f3f651e9-9cb8-48ba-85e9-207499ef99a5'} Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3f651e9-9cb8-48ba-85e9-207499ef99a5 could not be found. Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3f651e9-9cb8-48ba-85e9-207499ef99a5 could not be found. Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:27.121749 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:27.126215 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:27.126215 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:27.126215 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:27.126215 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3f651e9-9cb8-48ba-85e9-207499ef99a5 could not be found. Jul 19 22:48:27.126215 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:27.127648 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-81725044-98c5-447f-9628-c7db7354a771 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 404 to user: Instance f3f651e9-9cb8-48ba-85e9-207499ef99a5 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:27.128525 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-81725044-98c5-447f-9628-c7db7354a771 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/f3f651e9-9cb8-48ba-85e9-207499ef99a5" status: 404 len: 111 microversion: 2.1 time: 0.049510 Jul 19 22:48:27.132309 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2259/4470] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:27 2022] GET /compute/v2.1/servers/f3f651e9-9cb8-48ba-85e9-207499ef99a5 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:48:27.138011 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5c853819-c490-4343-bdef-2573792c7255 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3a45690a-abfd-44c4-ac77-564c0aac49a1" status: 200 len: 343 microversion: 2.1 time: 0.114395 Jul 19 22:48:27.144095 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2212/4471] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 19 22:48:27 2022] GET /compute/v2.1/os-volumes/3a45690a-abfd-44c4-ac77-564c0aac49a1 => generated 343 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:48:27.148366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-70650651-59d6-4c87-b9e2-7bb26087695d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:27.153409 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-70650651-59d6-4c87-b9e2-7bb26087695d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:27.183670 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-70650651-59d6-4c87-b9e2-7bb26087695d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:27.187843 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-70650651-59d6-4c87-b9e2-7bb26087695d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:27.189006 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-70650651-59d6-4c87-b9e2-7bb26087695d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:27.193258 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-70650651-59d6-4c87-b9e2-7bb26087695d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:27.437647 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-70650651-59d6-4c87-b9e2-7bb26087695d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:27.449900 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-70650651-59d6-4c87-b9e2-7bb26087695d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.314725 Jul 19 22:48:27.453234 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2260/4472] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:27 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:27.475690 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1f328595-b907-4946-adcd-7cb0b581cdda tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:27.476527 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1f328595-b907-4946-adcd-7cb0b581cdda tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:27.496520 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1f328595-b907-4946-adcd-7cb0b581cdda tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:27.503392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1f328595-b907-4946-adcd-7cb0b581cdda tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:27.506103 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1f328595-b907-4946-adcd-7cb0b581cdda tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:27.507857 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1f328595-b907-4946-adcd-7cb0b581cdda tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:27.793593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4299092c-496c-4a75-9b06-6c652ee6c930 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:27.793753 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4299092c-496c-4a75-9b06-6c652ee6c930 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:27.802162 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4299092c-496c-4a75-9b06-6c652ee6c930 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:27.806674 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4299092c-496c-4a75-9b06-6c652ee6c930 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:27.808428 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4299092c-496c-4a75-9b06-6c652ee6c930 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:27.809140 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4299092c-496c-4a75-9b06-6c652ee6c930 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:27.885499 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1f328595-b907-4946-adcd-7cb0b581cdda tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:27.902760 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1f328595-b907-4946-adcd-7cb0b581cdda tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.430462 Jul 19 22:48:27.917825 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2213/4473] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:27 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:28.090336 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-786ece7a-b279-4821-8e51-831f619bbaff tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:28.091617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-786ece7a-b279-4821-8e51-831f619bbaff tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] [instance: c7f2dff9-639b-49da-9fed-714958d36419] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:28.116852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-786ece7a-b279-4821-8e51-831f619bbaff tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:28.131599 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-786ece7a-b279-4821-8e51-831f619bbaff tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:28.132693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-786ece7a-b279-4821-8e51-831f619bbaff tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:28.133164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-786ece7a-b279-4821-8e51-831f619bbaff tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:28.189013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4299092c-496c-4a75-9b06-6c652ee6c930 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:28.192435 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-786ece7a-b279-4821-8e51-831f619bbaff tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] HTTP exception thrown: Instance c7f2dff9-639b-49da-9fed-714958d36419 could not be found. Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-786ece7a-b279-4821-8e51-831f619bbaff tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Request method failure captured: Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 HTTP/1.1 Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zR8x0q34aZl16aG8WpSz958okyNFIQoKTNn58Rj4PI6zhJkhKq9hiW8blGY7TnWEFkopIzEx4KO4cC7EBthGTVA2tMmlBd_mNU3RXwDqB20K9kP7hsvOzTvfyDE4rmg8xaaPoUI3U0Qolg58-LVCVmK7_e06LRK158Gf2P1L2qJe3c Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: X-Openstack-Nova-Api-Version: 2.57 Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 1f3ae82c052344b4ad5027df166bc045 Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerShowV257Test-678577685 Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1f3ae82c052344b4ad5027df166bc045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f3ae82c052344b4ad5027df166bc045"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1f3ae82c052344b4ad5027df166bc045"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f3ae82c052344b4ad5027df166bc045"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerShowV257Test-678577685 Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 1f3ae82c052344b4ad5027df166bc045 Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerShowV257Test-678577685 Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerShowV257Test-678577685-project Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 51b35f7f096843ce9e69f9946c1fdf7a Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerShowV257Test-678577685-project Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance c7f2dff9-639b-49da-9fed-714958d36419 could not be found. Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'c7f2dff9-639b-49da-9fed-714958d36419'} Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7f2dff9-639b-49da-9fed-714958d36419 could not be found. Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7f2dff9-639b-49da-9fed-714958d36419 could not be found. Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:28.194881 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:28.200738 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:28.200738 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:28.200738 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:28.200738 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:28.200738 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:28.200738 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7f2dff9-639b-49da-9fed-714958d36419 could not be found. Jul 19 22:48:28.200738 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:28.202094 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4299092c-496c-4a75-9b06-6c652ee6c930 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1728 microversion: 2.1 time: 0.409286 Jul 19 22:48:28.202094 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2261/4474] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:27 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1728 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:48:28.206859 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-786ece7a-b279-4821-8e51-831f619bbaff tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] Returning 404 to user: Instance c7f2dff9-639b-49da-9fed-714958d36419 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:28.208172 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-786ece7a-b279-4821-8e51-831f619bbaff tempest-ServerShowV257Test-678577685 tempest-ServerShowV257Test-678577685-project] 10.222.0.25 "GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419" status: 404 len: 111 microversion: 2.57 time: 0.122357 Jul 19 22:48:28.209299 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2214/4475] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:28 2022] GET /compute/v2.1/servers/c7f2dff9-639b-49da-9fed-714958d36419 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:48:28.217878 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-55caf969-df42-41ad-a5d8-d838393ca08e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1514730324", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "711438ef-9562-4879-b7e2-ec9cf463e48f"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-55caf969-df42-41ad-a5d8-d838393ca08e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 238 Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1514730324", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "711438ef-9562-4879-b7e2-ec9cf463e48f"}]}} Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1514730324', 'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '711438ef-9562-4879-b7e2-ec9cf463e48f'}]}}} Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:48:28.221970 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:48:28.226011 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:48:28.226011 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:48:28.226011 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 19 22:48:28.226011 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:28.226011 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:28.226011 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:28.226011 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:28.226011 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:28.226011 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:28.226011 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:48:28.226011 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:48:28.226011 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 19 22:48:28.226011 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:28.227371 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-62f5da49-40fe-434a-b49b-6de80aeb0afe tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Calling method '.version_select at 0x7f7a0313e280>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:28.229607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-55caf969-df42-41ad-a5d8-d838393ca08e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:28.230806 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-55caf969-df42-41ad-a5d8-d838393ca08e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.019373 Jul 19 22:48:28.231620 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2215/4476] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:48:28 2022] POST /compute/v2.1/servers => generated 139 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:48:28.239848 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e19c19cf-d352-487f-a05b-1964313cf9e7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:28.243349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e19c19cf-d352-487f-a05b-1964313cf9e7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:28.253718 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e19c19cf-d352-487f-a05b-1964313cf9e7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:28.254266 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e19c19cf-d352-487f-a05b-1964313cf9e7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:28.255371 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e19c19cf-d352-487f-a05b-1964313cf9e7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:28.256010 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e19c19cf-d352-487f-a05b-1964313cf9e7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:28.388453 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-62f5da49-40fe-434a-b49b-6de80aeb0afe tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3a45690a-abfd-44c4-ac77-564c0aac49a1" status: 200 len: 343 microversion: 2.1 time: 0.185522 Jul 19 22:48:28.395184 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2262/4477] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 19 22:48:28 2022] GET /compute/v2.1/os-volumes/3a45690a-abfd-44c4-ac77-564c0aac49a1 => generated 343 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:48:28.400172 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ec9ee300-7b5a-44c9-9935-f3201c6d1707 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:28.402113 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ec9ee300-7b5a-44c9-9935-f3201c6d1707 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:28.413611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec9ee300-7b5a-44c9-9935-f3201c6d1707 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:28.414763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec9ee300-7b5a-44c9-9935-f3201c6d1707 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:28.416313 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec9ee300-7b5a-44c9-9935-f3201c6d1707 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:28.425714 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec9ee300-7b5a-44c9-9935-f3201c6d1707 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:28.591048 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e19c19cf-d352-487f-a05b-1964313cf9e7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.358017 Jul 19 22:48:28.596259 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2216/4478] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 19 22:48:28 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-interface => generated 285 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:48:29.041083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ec9ee300-7b5a-44c9-9935-f3201c6d1707 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:29.053691 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ec9ee300-7b5a-44c9-9935-f3201c6d1707 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.657055 Jul 19 22:48:29.054569 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2263/4479] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:28 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:29.074694 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eb077f8e-d576-462e-a976-fd27bb691d2b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:29.075170 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eb077f8e-d576-462e-a976-fd27bb691d2b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:29.087961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb077f8e-d576-462e-a976-fd27bb691d2b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:29.090242 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb077f8e-d576-462e-a976-fd27bb691d2b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:29.091525 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb077f8e-d576-462e-a976-fd27bb691d2b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:29.093122 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb077f8e-d576-462e-a976-fd27bb691d2b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:29.402069 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-18774842-45ea-41fa-9b71-8d1396fc9455 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Calling method '.version_select at 0x7f7a03058550>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:29.413050 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-eb077f8e-d576-462e-a976-fd27bb691d2b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:29.421562 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eb077f8e-d576-462e-a976-fd27bb691d2b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.350767 Jul 19 22:48:29.422153 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2217/4480] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:29 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:29.466893 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-18774842-45ea-41fa-9b71-8d1396fc9455 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] HTTP exception thrown: Volume 3a45690a-abfd-44c4-ac77-564c0aac49a1 could not be found. Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-18774842-45ea-41fa-9b71-8d1396fc9455 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Request method failure captured: Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/os-volumes/3a45690a-abfd-44c4-ac77-564c0aac49a1 HTTP/1.1 Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zSuhn8xX-mmd8PrNDbEB1tuB3DlbIWGrW5EqyrtQTFMdLUgrah5KtU3z7Luvo3pzUlxqd6OzJnmM71zuBJXmNeUBUZ1b1AUAnSqpNv991FIjf1FGLtLDRDmwjMdznS-hx285NsinSTxoJLxhnMCaZ037_aY1KqHwn9BaH2ax4TG_ZU Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a12c5856c0f94eb7b7a160b7fe981147 Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-609181030 Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a12c5856c0f94eb7b7a160b7fe981147"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a12c5856c0f94eb7b7a160b7fe981147"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a12c5856c0f94eb7b7a160b7fe981147"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a12c5856c0f94eb7b7a160b7fe981147"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-VolumesSnapshotsTestJSON-609181030 Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a12c5856c0f94eb7b7a160b7fe981147 Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-609181030 Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-VolumesSnapshotsTestJSON-609181030-project Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: f41fa79d20404ed58b8c77277e987700 Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-VolumesSnapshotsTestJSON-609181030-project Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: exception: Volume 3a45690a-abfd-44c4-ac77-564c0aac49a1 could not be found. Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '3a45690a-abfd-44c4-ac77-564c0aac49a1'} Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3a45690a-abfd-44c4-ac77-564c0aac49a1 could not be found. (HTTP 404) (Request-ID: req-493e230e-105c-4f8b-8d7a-ddb3e0ab1cf4) Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 22:48:29.470690 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3a45690a-abfd-44c4-ac77-564c0aac49a1 could not be found. Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3a45690a-abfd-44c4-ac77-564c0aac49a1 could not be found. Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3a45690a-abfd-44c4-ac77-564c0aac49a1 could not be found. Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-18774842-45ea-41fa-9b71-8d1396fc9455 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Returning 404 to user: Volume 3a45690a-abfd-44c4-ac77-564c0aac49a1 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-18774842-45ea-41fa-9b71-8d1396fc9455 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3a45690a-abfd-44c4-ac77-564c0aac49a1" status: 404 len: 109 microversion: 2.1 time: 0.074156 Jul 19 22:48:29.474572 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2264/4481] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 19 22:48:29 2022] GET /compute/v2.1/os-volumes/3a45690a-abfd-44c4-ac77-564c0aac49a1 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:48:29.482602 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cf6e633f-869b-46dc-b147-744bf0ab1d23 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Calling method '.version_select at 0x7f7a032c3a60>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:29.540668 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-cf6e633f-869b-46dc-b147-744bf0ab1d23 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] HTTP exception thrown: Volume 3a45690a-abfd-44c4-ac77-564c0aac49a1 could not be found. Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cf6e633f-869b-46dc-b147-744bf0ab1d23 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Request method failure captured: Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/os-volumes/3a45690a-abfd-44c4-ac77-564c0aac49a1 HTTP/1.1 Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zSuhn8xX-mmd8PrNDbEB1tuB3DlbIWGrW5EqyrtQTFMdLUgrah5KtU3z7Luvo3pzUlxqd6OzJnmM71zuBJXmNeUBUZ1b1AUAnSqpNv991FIjf1FGLtLDRDmwjMdznS-hx285NsinSTxoJLxhnMCaZ037_aY1KqHwn9BaH2ax4TG_ZU Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: a12c5856c0f94eb7b7a160b7fe981147 Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-609181030 Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a12c5856c0f94eb7b7a160b7fe981147"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a12c5856c0f94eb7b7a160b7fe981147"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a12c5856c0f94eb7b7a160b7fe981147"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a12c5856c0f94eb7b7a160b7fe981147"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-VolumesSnapshotsTestJSON-609181030 Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: a12c5856c0f94eb7b7a160b7fe981147 Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-609181030 Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-VolumesSnapshotsTestJSON-609181030-project Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: f41fa79d20404ed58b8c77277e987700 Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-VolumesSnapshotsTestJSON-609181030-project Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: exception: Volume 3a45690a-abfd-44c4-ac77-564c0aac49a1 could not be found. Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '3a45690a-abfd-44c4-ac77-564c0aac49a1'} Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3a45690a-abfd-44c4-ac77-564c0aac49a1 could not be found. (HTTP 404) (Request-ID: req-e3dc1f2a-05c7-4444-9980-e23e69ee234b) Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 22:48:29.542864 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3a45690a-abfd-44c4-ac77-564c0aac49a1 could not be found. Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3a45690a-abfd-44c4-ac77-564c0aac49a1 could not be found. Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3a45690a-abfd-44c4-ac77-564c0aac49a1 could not be found. Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cf6e633f-869b-46dc-b147-744bf0ab1d23 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Returning 404 to user: Volume 3a45690a-abfd-44c4-ac77-564c0aac49a1 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cf6e633f-869b-46dc-b147-744bf0ab1d23 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/3a45690a-abfd-44c4-ac77-564c0aac49a1" status: 404 len: 109 microversion: 2.1 time: 0.065968 Jul 19 22:48:29.546728 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2218/4482] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 19 22:48:29 2022] DELETE /compute/v2.1/os-volumes/3a45690a-abfd-44c4-ac77-564c0aac49a1 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:48:29.556606 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c5d6fc06-1765-4a34-8200-443e2db0ddd0 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Calling method '.version_select at 0x7f7a03057430>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:29.615267 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-c5d6fc06-1765-4a34-8200-443e2db0ddd0 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] HTTP exception thrown: Volume 3a45690a-abfd-44c4-ac77-564c0aac49a1 could not be found. Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c5d6fc06-1765-4a34-8200-443e2db0ddd0 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Request method failure captured: Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/os-volumes/3a45690a-abfd-44c4-ac77-564c0aac49a1 HTTP/1.1 Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zSuhn8xX-mmd8PrNDbEB1tuB3DlbIWGrW5EqyrtQTFMdLUgrah5KtU3z7Luvo3pzUlxqd6OzJnmM71zuBJXmNeUBUZ1b1AUAnSqpNv991FIjf1FGLtLDRDmwjMdznS-hx285NsinSTxoJLxhnMCaZ037_aY1KqHwn9BaH2ax4TG_ZU Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a12c5856c0f94eb7b7a160b7fe981147 Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-609181030 Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a12c5856c0f94eb7b7a160b7fe981147"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a12c5856c0f94eb7b7a160b7fe981147"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a12c5856c0f94eb7b7a160b7fe981147"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a12c5856c0f94eb7b7a160b7fe981147"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-VolumesSnapshotsTestJSON-609181030 Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a12c5856c0f94eb7b7a160b7fe981147 Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-609181030 Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-VolumesSnapshotsTestJSON-609181030-project Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: f41fa79d20404ed58b8c77277e987700 Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-VolumesSnapshotsTestJSON-609181030-project Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: method: Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: exception: Volume 3a45690a-abfd-44c4-ac77-564c0aac49a1 could not be found. Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '3a45690a-abfd-44c4-ac77-564c0aac49a1'} Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3a45690a-abfd-44c4-ac77-564c0aac49a1 could not be found. (HTTP 404) (Request-ID: req-990055f9-bffe-40dc-993a-7af6068660d5) Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 22:48:29.617580 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3a45690a-abfd-44c4-ac77-564c0aac49a1 could not be found. Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3a45690a-abfd-44c4-ac77-564c0aac49a1 could not be found. Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3a45690a-abfd-44c4-ac77-564c0aac49a1 could not be found. Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c5d6fc06-1765-4a34-8200-443e2db0ddd0 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] Returning 404 to user: Volume 3a45690a-abfd-44c4-ac77-564c0aac49a1 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:29.621160 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c5d6fc06-1765-4a34-8200-443e2db0ddd0 tempest-VolumesSnapshotsTestJSON-609181030 tempest-VolumesSnapshotsTestJSON-609181030-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3a45690a-abfd-44c4-ac77-564c0aac49a1" status: 404 len: 109 microversion: 2.1 time: 0.068967 Jul 19 22:48:29.624739 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2265/4483] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 19 22:48:29 2022] GET /compute/v2.1/os-volumes/3a45690a-abfd-44c4-ac77-564c0aac49a1 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:48:29.859022 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d72021c8-0b5b-41d1-868d-b5e0e7f0efad tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-13101815", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "711438ef-9562-4879-b7e2-ec9cf463e48f"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d72021c8-0b5b-41d1-868d-b5e0e7f0efad tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 233 Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-13101815", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "711438ef-9562-4879-b7e2-ec9cf463e48f"}]}} Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-13101815', 'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '711438ef-9562-4879-b7e2-ec9cf463e48f'}]}}} Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:29.865192 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:29.869531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:29.869531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:29.869531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:29.869531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:29.869531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:48:29.869531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:48:29.869531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:48:29.869531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:48:29.869531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:48:29.869531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:48:29.869531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 19 22:48:29.869531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.869531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:29.869531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.869531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:29.869531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:29.869531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:29.869531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:48:29.869531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:48:29.869531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 19 22:48:29.869531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:29.869531 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d72021c8-0b5b-41d1-868d-b5e0e7f0efad tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:29.884889 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d72021c8-0b5b-41d1-868d-b5e0e7f0efad tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.031135 Jul 19 22:48:29.891970 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2219/4484] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:48:29 2022] POST /compute/v2.1/servers => generated 133 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:48:29.899340 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cc356301-b076-4256-82c9-176416b72a64 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:29.899994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cc356301-b076-4256-82c9-176416b72a64 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:29.909843 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc356301-b076-4256-82c9-176416b72a64 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:29.911772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc356301-b076-4256-82c9-176416b72a64 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:29.912764 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc356301-b076-4256-82c9-176416b72a64 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:29.924415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc356301-b076-4256-82c9-176416b72a64 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:30.395332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cc356301-b076-4256-82c9-176416b72a64 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:30.429998 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cc356301-b076-4256-82c9-176416b72a64 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.520486 Jul 19 22:48:30.443637 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2266/4485] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:29 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:30.458036 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7f8a8378-4e7d-485b-ac79-56542270450c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:30.458673 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7f8a8378-4e7d-485b-ac79-56542270450c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:30.477832 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7f8a8378-4e7d-485b-ac79-56542270450c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:30.478326 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7f8a8378-4e7d-485b-ac79-56542270450c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:30.482735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7f8a8378-4e7d-485b-ac79-56542270450c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:30.490222 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7f8a8378-4e7d-485b-ac79-56542270450c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:31.113503 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7f8a8378-4e7d-485b-ac79-56542270450c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:31.128135 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7f8a8378-4e7d-485b-ac79-56542270450c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.679947 Jul 19 22:48:31.134134 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2220/4486] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:30 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:31.152740 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4939c3fa-4874-4b13-acdd-1229d2a7e5ce tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:31.153296 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4939c3fa-4874-4b13-acdd-1229d2a7e5ce tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: aa34edd4-982b-4675-bbf2-25e9017f8f7c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:31.169076 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-4939c3fa-4874-4b13-acdd-1229d2a7e5ce tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Instance aa34edd4-982b-4675-bbf2-25e9017f8f7c could not be found. Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4939c3fa-4874-4b13-acdd-1229d2a7e5ce tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers/aa34edd4-982b-4675-bbf2-25e9017f8f7c/action HTTP/1.1 Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 13 Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: {"pause": {}} Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance aa34edd4-982b-4675-bbf2-25e9017f8f7c could not be found. Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'aa34edd4-982b-4675-bbf2-25e9017f8f7c', 'body': {'pause': {}}} Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa34edd4-982b-4675-bbf2-25e9017f8f7c could not be found. Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa34edd4-982b-4675-bbf2-25e9017f8f7c could not be found. Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:31.184016 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:31.188198 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:31.188198 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:31.188198 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa34edd4-982b-4675-bbf2-25e9017f8f7c could not be found. Jul 19 22:48:31.188198 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:31.189124 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4939c3fa-4874-4b13-acdd-1229d2a7e5ce tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 404 to user: Instance aa34edd4-982b-4675-bbf2-25e9017f8f7c could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:31.190085 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4939c3fa-4874-4b13-acdd-1229d2a7e5ce tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers/aa34edd4-982b-4675-bbf2-25e9017f8f7c/action" status: 404 len: 111 microversion: 2.1 time: 0.041596 Jul 19 22:48:31.199813 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-25cf4d33-2bd3-48f1-970a-028954e64ed3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:31.200405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-25cf4d33-2bd3-48f1-970a-028954e64ed3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:31.207486 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2267/4487] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:48:31 2022] POST /compute/v2.1/servers/aa34edd4-982b-4675-bbf2-25e9017f8f7c/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:48:31.223892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-25cf4d33-2bd3-48f1-970a-028954e64ed3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:31.223892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-25cf4d33-2bd3-48f1-970a-028954e64ed3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:31.223892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-25cf4d33-2bd3-48f1-970a-028954e64ed3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:31.227362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-25cf4d33-2bd3-48f1-970a-028954e64ed3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:32.243676 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-25cf4d33-2bd3-48f1-970a-028954e64ed3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:32.256870 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-25cf4d33-2bd3-48f1-970a-028954e64ed3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 1.059278 Jul 19 22:48:32.277045 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2221/4488] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:31 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:48:32.278209 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2072cbae-2fc8-407c-9c2e-404021ea9105 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:32.278837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2072cbae-2fc8-407c-9c2e-404021ea9105 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:32.294141 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2072cbae-2fc8-407c-9c2e-404021ea9105 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:32.294602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2072cbae-2fc8-407c-9c2e-404021ea9105 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:32.295420 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2072cbae-2fc8-407c-9c2e-404021ea9105 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:32.295862 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2072cbae-2fc8-407c-9c2e-404021ea9105 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:32.750382 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2072cbae-2fc8-407c-9c2e-404021ea9105 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:32.753333 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:48:32.769028 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2072cbae-2fc8-407c-9c2e-404021ea9105 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.495495 Jul 19 22:48:32.775478 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2268/4489] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:32 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:48:32.792645 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-95049d73-a0bb-45a8-9a63-ff9ee1c35072 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:32.793176 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-95049d73-a0bb-45a8-9a63-ff9ee1c35072 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:32.807478 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-95049d73-a0bb-45a8-9a63-ff9ee1c35072 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:32.816786 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-95049d73-a0bb-45a8-9a63-ff9ee1c35072 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:32.817973 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-95049d73-a0bb-45a8-9a63-ff9ee1c35072 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:32.818541 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-95049d73-a0bb-45a8-9a63-ff9ee1c35072 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:33.052656 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-95049d73-a0bb-45a8-9a63-ff9ee1c35072 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action" status: 202 len: 0 microversion: 2.1 time: 0.263146 Jul 19 22:48:33.055201 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2222/4490] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:48:32 2022] POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:48:33.077744 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ba146169-4e86-436b-8019-c7489c00c415 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:33.078270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ba146169-4e86-436b-8019-c7489c00c415 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:33.105681 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba146169-4e86-436b-8019-c7489c00c415 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:33.106148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba146169-4e86-436b-8019-c7489c00c415 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:33.113106 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba146169-4e86-436b-8019-c7489c00c415 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:33.113579 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba146169-4e86-436b-8019-c7489c00c415 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:33.539899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-f571c190-ba5c-4506-9c9c-d4ff0eea4321 req-bc53b37b-642f-48a8-ac26-1b57040c826d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02571222-3b10-4a0d-8b70-a8202c37f6a7", "tag": "542dbd38-d2d6-470e-be1a-a605a204b40b"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:33.576151 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-f571c190-ba5c-4506-9c9c-d4ff0eea4321 req-bc53b37b-642f-48a8-ac26-1b57040c826d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:33.576893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-f571c190-ba5c-4506-9c9c-d4ff0eea4321 req-bc53b37b-642f-48a8-ac26-1b57040c826d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:33.628205 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-f571c190-ba5c-4506-9c9c-d4ff0eea4321 req-bc53b37b-642f-48a8-ac26-1b57040c826d service nova] Creating event network-changed:542dbd38-d2d6-470e-be1a-a605a204b40b for instance 02571222-3b10-4a0d-8b70-a8202c37f6a7 on n-h2-847009-3 Jul 19 22:48:33.644099 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-f571c190-ba5c-4506-9c9c-d4ff0eea4321 req-bc53b37b-642f-48a8-ac26-1b57040c826d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110402 Jul 19 22:48:33.646734 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2223/4491] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:48:33.916152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ba146169-4e86-436b-8019-c7489c00c415 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:33.929711 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ba146169-4e86-436b-8019-c7489c00c415 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1510 microversion: 2.1 time: 0.865240 Jul 19 22:48:33.930975 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2269/4492] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:33 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1510 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:34.948466 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1e30e6c2-93b6-4ad5-8c9a-c8979c64f251 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:34.949197 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1e30e6c2-93b6-4ad5-8c9a-c8979c64f251 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:34.962402 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e30e6c2-93b6-4ad5-8c9a-c8979c64f251 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:34.968792 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e30e6c2-93b6-4ad5-8c9a-c8979c64f251 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:34.970312 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e30e6c2-93b6-4ad5-8c9a-c8979c64f251 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:34.970925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e30e6c2-93b6-4ad5-8c9a-c8979c64f251 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:35.622159 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1e30e6c2-93b6-4ad5-8c9a-c8979c64f251 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:35.632795 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1e30e6c2-93b6-4ad5-8c9a-c8979c64f251 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1490 microversion: 2.1 time: 0.688684 Jul 19 22:48:35.636533 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2224/4493] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:34 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1490 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:35.655537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2bca01e2-02f3-4dd9-95e2-4c5a6b96739a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:35.658341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2bca01e2-02f3-4dd9-95e2-4c5a6b96739a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:35.675550 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-84cea7a0-53fe-4972-9f64-c6d8bce29d33 req-fe844052-ded3-40c1-ac6f-c0d66fce8dba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02571222-3b10-4a0d-8b70-a8202c37f6a7", "tag": "542dbd38-d2d6-470e-be1a-a605a204b40b"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:35.704405 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2bca01e2-02f3-4dd9-95e2-4c5a6b96739a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:35.705207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2bca01e2-02f3-4dd9-95e2-4c5a6b96739a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:35.706261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2bca01e2-02f3-4dd9-95e2-4c5a6b96739a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:35.706948 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2bca01e2-02f3-4dd9-95e2-4c5a6b96739a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:35.711062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-84cea7a0-53fe-4972-9f64-c6d8bce29d33 req-fe844052-ded3-40c1-ac6f-c0d66fce8dba service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:35.714033 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-84cea7a0-53fe-4972-9f64-c6d8bce29d33 req-fe844052-ded3-40c1-ac6f-c0d66fce8dba service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:35.740325 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-2bca01e2-02f3-4dd9-95e2-4c5a6b96739a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Cannot 'pause' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state paused Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2bca01e2-02f3-4dd9-95e2-4c5a6b96739a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action HTTP/1.1 Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 13 Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: {"pause": {}} Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: exception: Cannot 'pause' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state paused Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'fb0d2fe2-80ea-4fc2-a157-f7341877997c', 'body': {'pause': {}}} Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fb0d2fe2-80ea-4fc2-a157-f7341877997c in vm_state paused. Cannot pause while the instance is in this state. Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state paused Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:35.743876 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:35.747738 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:35.747738 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:35.747738 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:35.747738 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state paused Jul 19 22:48:35.747738 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:35.748043 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-84cea7a0-53fe-4972-9f64-c6d8bce29d33 req-fe844052-ded3-40c1-ac6f-c0d66fce8dba service nova] Creating event network-changed:542dbd38-d2d6-470e-be1a-a605a204b40b for instance 02571222-3b10-4a0d-8b70-a8202c37f6a7 on n-h2-847009-3 Jul 19 22:48:35.752847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2bca01e2-02f3-4dd9-95e2-4c5a6b96739a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 409 to user: Cannot 'pause' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state paused {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:35.754147 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2bca01e2-02f3-4dd9-95e2-4c5a6b96739a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action" status: 409 len: 143 microversion: 2.1 time: 0.104560 Jul 19 22:48:35.755158 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2270/4494] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:48:35 2022] POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action => generated 143 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 19 22:48:35.762403 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-84cea7a0-53fe-4972-9f64-c6d8bce29d33 req-fe844052-ded3-40c1-ac6f-c0d66fce8dba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090829 Jul 19 22:48:35.766333 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2225/4495] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:48:35.822616 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4ceb88bf-9d6b-4099-8402-1ecfd82a9817 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:35.824993 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4ceb88bf-9d6b-4099-8402-1ecfd82a9817 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:35.856226 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ceb88bf-9d6b-4099-8402-1ecfd82a9817 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:35.856711 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ceb88bf-9d6b-4099-8402-1ecfd82a9817 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:35.860481 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ceb88bf-9d6b-4099-8402-1ecfd82a9817 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:35.861870 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ceb88bf-9d6b-4099-8402-1ecfd82a9817 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:36.031168 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4ceb88bf-9d6b-4099-8402-1ecfd82a9817 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action" status: 202 len: 0 microversion: 2.1 time: 0.266233 Jul 19 22:48:36.031902 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2271/4496] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:48:35 2022] POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:48:36.043313 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-840446f5-7dca-4bfc-a89c-452e4abae9f9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:36.044342 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-840446f5-7dca-4bfc-a89c-452e4abae9f9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:36.066093 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-840446f5-7dca-4bfc-a89c-452e4abae9f9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:36.067007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-840446f5-7dca-4bfc-a89c-452e4abae9f9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:36.068114 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-840446f5-7dca-4bfc-a89c-452e4abae9f9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:36.069352 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-840446f5-7dca-4bfc-a89c-452e4abae9f9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:36.755568 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-840446f5-7dca-4bfc-a89c-452e4abae9f9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:36.759700 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:48:36.776530 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-840446f5-7dca-4bfc-a89c-452e4abae9f9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1497 microversion: 2.1 time: 0.739436 Jul 19 22:48:36.777147 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2226/4497] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:36 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1497 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:37.331471 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-58c4dce4-ca4c-423c-86c0-67eff5dc9d45 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1831148896", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "c186aba6-3ead-44be-b98a-c50d246a1c44"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:37.439809 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-58c4dce4-ca4c-423c-86c0-67eff5dc9d45 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] validate_networks() for [('c186aba6-3ead-44be-b98a-c50d246a1c44', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:48:37.794972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4f775737-310d-46af-869b-6fae6112a1dd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:37.795544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4f775737-310d-46af-869b-6fae6112a1dd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:37.829938 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f775737-310d-46af-869b-6fae6112a1dd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:37.830399 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f775737-310d-46af-869b-6fae6112a1dd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:37.836018 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f775737-310d-46af-869b-6fae6112a1dd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:37.836842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f775737-310d-46af-869b-6fae6112a1dd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:38.211510 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4f775737-310d-46af-869b-6fae6112a1dd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:38.219979 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4f775737-310d-46af-869b-6fae6112a1dd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.429927 Jul 19 22:48:38.220576 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2227/4498] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:37 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:38.252360 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3a1fba38-7d4b-4a67-bccc-e58fa722c4b9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:38.253797 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3a1fba38-7d4b-4a67-bccc-e58fa722c4b9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:38.270665 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3a1fba38-7d4b-4a67-bccc-e58fa722c4b9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:38.276584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3a1fba38-7d4b-4a67-bccc-e58fa722c4b9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:38.294493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3a1fba38-7d4b-4a67-bccc-e58fa722c4b9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:38.296694 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3a1fba38-7d4b-4a67-bccc-e58fa722c4b9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:39.056891 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3a1fba38-7d4b-4a67-bccc-e58fa722c4b9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:39.070647 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3a1fba38-7d4b-4a67-bccc-e58fa722c4b9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.829293 Jul 19 22:48:39.072340 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2228/4499] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:38 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:39.089074 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-62267e91-26bf-41af-84bf-67a9ba6b3cac tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:39.090326 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-62267e91-26bf-41af-84bf-67a9ba6b3cac tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:39.098737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62267e91-26bf-41af-84bf-67a9ba6b3cac tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:39.099625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62267e91-26bf-41af-84bf-67a9ba6b3cac tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:39.100789 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62267e91-26bf-41af-84bf-67a9ba6b3cac tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:39.101503 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62267e91-26bf-41af-84bf-67a9ba6b3cac tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:39.118282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-58c4dce4-ca4c-423c-86c0-67eff5dc9d45 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:48:39.119198 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-58c4dce4-ca4c-423c-86c0-67eff5dc9d45 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:48:39.119198 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-58c4dce4-ca4c-423c-86c0-67eff5dc9d45 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:48:39.120037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-58c4dce4-ca4c-423c-86c0-67eff5dc9d45 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:48:39.120037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-58c4dce4-ca4c-423c-86c0-67eff5dc9d45 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:48:39.141959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58c4dce4-ca4c-423c-86c0-67eff5dc9d45 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:39.142578 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58c4dce4-ca4c-423c-86c0-67eff5dc9d45 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:39.153249 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58c4dce4-ca4c-423c-86c0-67eff5dc9d45 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:39.153474 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-62267e91-26bf-41af-84bf-67a9ba6b3cac tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. Jul 19 22:48:39.153935 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58c4dce4-ca4c-423c-86c0-67eff5dc9d45 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-62267e91-26bf-41af-84bf-67a9ba6b3cac tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680/action HTTP/1.1 Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 28 Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: {"reboot": {"type": "SOFT"}} Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680', 'body': {'reboot': {'type': 'SOFT'}}} Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:48:39.158122 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:48:39.162833 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. Jul 19 22:48:39.162833 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:39.162833 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:39.162833 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:39.162833 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:39.162833 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:39.162833 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:39.162833 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:39.162833 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:39.162833 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. Jul 19 22:48:39.162833 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:39.169689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-62267e91-26bf-41af-84bf-67a9ba6b3cac tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 404 to user: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:39.171888 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-62267e91-26bf-41af-84bf-67a9ba6b3cac tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680/action" status: 404 len: 111 microversion: 2.1 time: 0.087322 Jul 19 22:48:39.174325 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2229/4500] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:48:39 2022] POST /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680/action => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:48:39.184282 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8c9c856e-fc2d-4df5-acca-474396679984 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:39.188437 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8c9c856e-fc2d-4df5-acca-474396679984 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:39.207188 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c9c856e-fc2d-4df5-acca-474396679984 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:39.208188 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-58c4dce4-ca4c-423c-86c0-67eff5dc9d45 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Getting quotas for project decfb15dcb6e48b98a8b0af680411661. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:48:39.208912 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c9c856e-fc2d-4df5-acca-474396679984 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:39.210865 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c9c856e-fc2d-4df5-acca-474396679984 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:39.211813 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c9c856e-fc2d-4df5-acca-474396679984 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:39.233927 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:48:39.254865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-58c4dce4-ca4c-423c-86c0-67eff5dc9d45 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Getting quotas for user 58106973ce5e4662a447f203d8a35585 and project decfb15dcb6e48b98a8b0af680411661. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:48:39.318141 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-58c4dce4-ca4c-423c-86c0-67eff5dc9d45 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:48:39.321449 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-58c4dce4-ca4c-423c-86c0-67eff5dc9d45 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] [instance: 0e8df505-6004-4176-b4ee-27414ef1a6e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:48:39.382620 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-58c4dce4-ca4c-423c-86c0-67eff5dc9d45 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.654630 Jul 19 22:48:39.383770 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2272/4501] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:48:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:48:39.395083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e41d880b-d73c-49e7-8cad-ecc0127e1c9b tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:39.395879 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e41d880b-d73c-49e7-8cad-ecc0127e1c9b tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] [instance: 0e8df505-6004-4176-b4ee-27414ef1a6e9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:39.524562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e41d880b-d73c-49e7-8cad-ecc0127e1c9b tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58106973ce5e4662a447f203d8a35585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decfb15dcb6e48b98a8b0af680411661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:39.535752 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e41d880b-d73c-49e7-8cad-ecc0127e1c9b tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9" status: 200 len: 1216 microversion: 2.1 time: 0.145805 Jul 19 22:48:39.552413 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2273/4502] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:39 2022] GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9 => generated 1216 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:48:39.607259 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8c9c856e-fc2d-4df5-acca-474396679984 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:39.662330 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8c9c856e-fc2d-4df5-acca-474396679984 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.480840 Jul 19 22:48:39.664263 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2230/4503] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:39 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:39.680672 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fc0946b7-c42c-492c-a8d1-e77ac7b2cdd5 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:39.681596 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fc0946b7-c42c-492c-a8d1-e77ac7b2cdd5 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:39.693390 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc0946b7-c42c-492c-a8d1-e77ac7b2cdd5 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:39.694103 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc0946b7-c42c-492c-a8d1-e77ac7b2cdd5 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:39.695259 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc0946b7-c42c-492c-a8d1-e77ac7b2cdd5 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:39.696014 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc0946b7-c42c-492c-a8d1-e77ac7b2cdd5 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:40.036244 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fc0946b7-c42c-492c-a8d1-e77ac7b2cdd5 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:40.050244 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fc0946b7-c42c-492c-a8d1-e77ac7b2cdd5 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.374454 Jul 19 22:48:40.051752 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2274/4504] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:39 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:40.071857 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-192fe75a-5c39-4760-96d7-9312f844d56c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:40.074161 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-192fe75a-5c39-4760-96d7-9312f844d56c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 93f3af99-8f48-4203-ad2a-a0d6ce87c99f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:40.081929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:48:40.083864 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-192fe75a-5c39-4760-96d7-9312f844d56c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Instance 93f3af99-8f48-4203-ad2a-a0d6ce87c99f could not be found. Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-192fe75a-5c39-4760-96d7-9312f844d56c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/93f3af99-8f48-4203-ad2a-a0d6ce87c99f/action HTTP/1.1 Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 28 Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: {"reboot": {"type": "SOFT"}} Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 93f3af99-8f48-4203-ad2a-a0d6ce87c99f could not be found. Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '93f3af99-8f48-4203-ad2a-a0d6ce87c99f', 'body': {'reboot': {'type': 'SOFT'}}} Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93f3af99-8f48-4203-ad2a-a0d6ce87c99f could not be found. Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93f3af99-8f48-4203-ad2a-a0d6ce87c99f could not be found. Jul 19 22:48:40.102196 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:40.106668 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:40.106668 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:40.106668 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:40.106668 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:40.106668 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:40.106668 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:40.106668 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:40.106668 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93f3af99-8f48-4203-ad2a-a0d6ce87c99f could not be found. Jul 19 22:48:40.106668 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:40.112442 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-192fe75a-5c39-4760-96d7-9312f844d56c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 404 to user: Instance 93f3af99-8f48-4203-ad2a-a0d6ce87c99f could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:40.113347 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-192fe75a-5c39-4760-96d7-9312f844d56c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers/93f3af99-8f48-4203-ad2a-a0d6ce87c99f/action" status: 404 len: 111 microversion: 2.1 time: 0.049890 Jul 19 22:48:40.124239 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-94223bc3-9184-4a78-8796-016125772439 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:40.124890 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-94223bc3-9184-4a78-8796-016125772439 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:40.129929 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2231/4505] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:48:40 2022] POST /compute/v2.1/servers/93f3af99-8f48-4203-ad2a-a0d6ce87c99f/action => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:48:40.141408 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-94223bc3-9184-4a78-8796-016125772439 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:40.144809 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-94223bc3-9184-4a78-8796-016125772439 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:40.148789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-94223bc3-9184-4a78-8796-016125772439 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:40.149527 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-94223bc3-9184-4a78-8796-016125772439 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:40.568408 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8b8c8336-af2e-4c7a-aea7-1e2821aeb551 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:40.569115 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8b8c8336-af2e-4c7a-aea7-1e2821aeb551 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] [instance: 0e8df505-6004-4176-b4ee-27414ef1a6e9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:40.596744 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b8c8336-af2e-4c7a-aea7-1e2821aeb551 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:40.597836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b8c8336-af2e-4c7a-aea7-1e2821aeb551 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:40.600377 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b8c8336-af2e-4c7a-aea7-1e2821aeb551 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:40.603087 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b8c8336-af2e-4c7a-aea7-1e2821aeb551 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:40.659076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-94223bc3-9184-4a78-8796-016125772439 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:40.676947 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-94223bc3-9184-4a78-8796-016125772439 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.557248 Jul 19 22:48:40.693126 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2275/4506] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:40 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:40.709142 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a19fb63b-63b5-48fd-bcd7-021381a1ee11 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:40.710023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a19fb63b-63b5-48fd-bcd7-021381a1ee11 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:40.727455 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a19fb63b-63b5-48fd-bcd7-021381a1ee11 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:40.732448 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a19fb63b-63b5-48fd-bcd7-021381a1ee11 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:40.733896 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a19fb63b-63b5-48fd-bcd7-021381a1ee11 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:40.734594 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a19fb63b-63b5-48fd-bcd7-021381a1ee11 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:40.883061 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8b8c8336-af2e-4c7a-aea7-1e2821aeb551 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58106973ce5e4662a447f203d8a35585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decfb15dcb6e48b98a8b0af680411661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:40.897713 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8b8c8336-af2e-4c7a-aea7-1e2821aeb551 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9" status: 200 len: 1220 microversion: 2.1 time: 0.342589 Jul 19 22:48:40.901107 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2232/4507] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:40 2022] GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9 => generated 1220 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:41.314667 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a19fb63b-63b5-48fd-bcd7-021381a1ee11 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:41.332462 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a19fb63b-63b5-48fd-bcd7-021381a1ee11 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.634079 Jul 19 22:48:41.336973 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2276/4508] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:40 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:41.353327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6444982c-b3d9-43e2-8447-2d913a955393 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:41.356420 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6444982c-b3d9-43e2-8447-2d913a955393 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:41.367874 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6444982c-b3d9-43e2-8447-2d913a955393 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:41.369119 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6444982c-b3d9-43e2-8447-2d913a955393 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:41.370148 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6444982c-b3d9-43e2-8447-2d913a955393 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:41.371031 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6444982c-b3d9-43e2-8447-2d913a955393 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:41.406218 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-6444982c-b3d9-43e2-8447-2d913a955393 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6444982c-b3d9-43e2-8447-2d913a955393 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680/action HTTP/1.1 Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 65 Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: {"rebuild": {"imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691"}} Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680', 'body': {'rebuild': {'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691'}}} Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 19 22:48:41.409237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 19 22:48:41.413069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 19 22:48:41.413069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:48:41.413069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:48:41.413069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:48:41.413069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:48:41.413069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. Jul 19 22:48:41.413069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:41.413069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:41.413069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:41.413069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:41.413069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:41.413069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:41.413069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:41.413069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:41.413069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. Jul 19 22:48:41.413069 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:41.417296 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6444982c-b3d9-43e2-8447-2d913a955393 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 404 to user: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:41.418990 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6444982c-b3d9-43e2-8447-2d913a955393 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680/action" status: 404 len: 111 microversion: 2.1 time: 0.070836 Jul 19 22:48:41.424193 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2233/4509] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:48:41 2022] POST /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680/action => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:48:41.429507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e18c32ff-cbf4-4981-8431-62ba25977348 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:41.430359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e18c32ff-cbf4-4981-8431-62ba25977348 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:41.444732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e18c32ff-cbf4-4981-8431-62ba25977348 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:41.445529 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e18c32ff-cbf4-4981-8431-62ba25977348 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:41.448661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e18c32ff-cbf4-4981-8431-62ba25977348 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:41.451767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e18c32ff-cbf4-4981-8431-62ba25977348 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:41.918466 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ae007f57-49b6-41e1-bcc5-1c651366c3bc tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:41.919164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ae007f57-49b6-41e1-bcc5-1c651366c3bc tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] [instance: 0e8df505-6004-4176-b4ee-27414ef1a6e9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:41.936081 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae007f57-49b6-41e1-bcc5-1c651366c3bc tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:41.936682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae007f57-49b6-41e1-bcc5-1c651366c3bc tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:41.943827 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae007f57-49b6-41e1-bcc5-1c651366c3bc tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:41.946842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae007f57-49b6-41e1-bcc5-1c651366c3bc tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:43.294881 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e18c32ff-cbf4-4981-8431-62ba25977348 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:43.314608 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e18c32ff-cbf4-4981-8431-62ba25977348 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 1.889396 Jul 19 22:48:43.326307 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2277/4510] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:41 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 1902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:43.460780 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ae007f57-49b6-41e1-bcc5-1c651366c3bc tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58106973ce5e4662a447f203d8a35585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decfb15dcb6e48b98a8b0af680411661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:43.476360 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ae007f57-49b6-41e1-bcc5-1c651366c3bc tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9" status: 200 len: 1274 microversion: 2.1 time: 1.557852 Jul 19 22:48:43.480720 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2234/4511] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:41 2022] GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9 => generated 1274 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:48:43.509090 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0cb7c244-51bd-4aef-8809-d8d0ef6f763d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:43.527356 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0cb7c244-51bd-4aef-8809-d8d0ef6f763d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:43.569174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0cb7c244-51bd-4aef-8809-d8d0ef6f763d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:43.574588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0cb7c244-51bd-4aef-8809-d8d0ef6f763d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:43.583342 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0cb7c244-51bd-4aef-8809-d8d0ef6f763d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:43.590859 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0cb7c244-51bd-4aef-8809-d8d0ef6f763d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:43.971828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4d7b9d46-56d4-4729-a931-dedec1f3303e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:43.972270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4d7b9d46-56d4-4729-a931-dedec1f3303e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:43.994520 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d7b9d46-56d4-4729-a931-dedec1f3303e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:43.994984 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d7b9d46-56d4-4729-a931-dedec1f3303e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:44.002766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d7b9d46-56d4-4729-a931-dedec1f3303e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:44.006894 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d7b9d46-56d4-4729-a931-dedec1f3303e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:44.086200 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4d7b9d46-56d4-4729-a931-dedec1f3303e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:48:44.095648 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0cb7c244-51bd-4aef-8809-d8d0ef6f763d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:44.107716 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0cb7c244-51bd-4aef-8809-d8d0ef6f763d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.612207 Jul 19 22:48:44.123818 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2235/4512] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:43 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:44.137337 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-20b247ce-7fe1-41c9-a463-3a906e795c04 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:44.152956 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-20b247ce-7fe1-41c9-a463-3a906e795c04 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 11b86e49-6a3a-4d9a-8b00-da43fd7f54a1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:44.167643 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-20b247ce-7fe1-41c9-a463-3a906e795c04 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Instance 11b86e49-6a3a-4d9a-8b00-da43fd7f54a1 could not be found. Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-20b247ce-7fe1-41c9-a463-3a906e795c04 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/11b86e49-6a3a-4d9a-8b00-da43fd7f54a1/action HTTP/1.1 Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 65 Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: {"rebuild": {"imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691"}} Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 11b86e49-6a3a-4d9a-8b00-da43fd7f54a1 could not be found. Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '11b86e49-6a3a-4d9a-8b00-da43fd7f54a1', 'body': {'rebuild': {'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691'}}} Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11b86e49-6a3a-4d9a-8b00-da43fd7f54a1 could not be found. Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 19 22:48:44.175837 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:48:44.180267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:48:44.180267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:48:44.180267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:48:44.180267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11b86e49-6a3a-4d9a-8b00-da43fd7f54a1 could not be found. Jul 19 22:48:44.180267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:44.180267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:44.180267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:44.180267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:44.180267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:44.180267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:44.180267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:44.180267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:44.180267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11b86e49-6a3a-4d9a-8b00-da43fd7f54a1 could not be found. Jul 19 22:48:44.180267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:44.185031 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-20b247ce-7fe1-41c9-a463-3a906e795c04 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 404 to user: Instance 11b86e49-6a3a-4d9a-8b00-da43fd7f54a1 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:44.186107 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-20b247ce-7fe1-41c9-a463-3a906e795c04 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers/11b86e49-6a3a-4d9a-8b00-da43fd7f54a1/action" status: 404 len: 111 microversion: 2.1 time: 0.060331 Jul 19 22:48:44.189404 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2236/4513] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:48:44 2022] POST /compute/v2.1/servers/11b86e49-6a3a-4d9a-8b00-da43fd7f54a1/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:48:44.209426 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0a191f93-f634-48ce-a36f-5f53c91d560d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:44.212620 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0a191f93-f634-48ce-a36f-5f53c91d560d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:44.261888 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4d7b9d46-56d4-4729-a931-dedec1f3303e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 204 len: 0 microversion: 2.42 time: 0.933064 Jul 19 22:48:44.263388 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2278/4514] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 22:48:43 2022] DELETE /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 0 bytes in 936 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:48:44.267596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a191f93-f634-48ce-a36f-5f53c91d560d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:44.269642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a191f93-f634-48ce-a36f-5f53c91d560d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:44.270622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a191f93-f634-48ce-a36f-5f53c91d560d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:44.273905 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a191f93-f634-48ce-a36f-5f53c91d560d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:44.279970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b5810529-c6f5-430c-9984-b960e6096467 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:44.281966 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b5810529-c6f5-430c-9984-b960e6096467 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:44.306973 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b5810529-c6f5-430c-9984-b960e6096467 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:44.307707 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b5810529-c6f5-430c-9984-b960e6096467 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:44.310547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b5810529-c6f5-430c-9984-b960e6096467 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:44.313905 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b5810529-c6f5-430c-9984-b960e6096467 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:44.726082 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0a191f93-f634-48ce-a36f-5f53c91d560d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:44.738773 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0a191f93-f634-48ce-a36f-5f53c91d560d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.544172 Jul 19 22:48:44.739424 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2237/4515] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:44 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:44.763949 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c78f51e8-5cff-4aa1-9b04-2e1e4cc56cec tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:44.765493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c78f51e8-5cff-4aa1-9b04-2e1e4cc56cec tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] [instance: 0e8df505-6004-4176-b4ee-27414ef1a6e9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:44.783200 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c78f51e8-5cff-4aa1-9b04-2e1e4cc56cec tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:44.783935 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c78f51e8-5cff-4aa1-9b04-2e1e4cc56cec tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:44.788390 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c78f51e8-5cff-4aa1-9b04-2e1e4cc56cec tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:44.789312 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c78f51e8-5cff-4aa1-9b04-2e1e4cc56cec tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:45.002735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c78f51e8-5cff-4aa1-9b04-2e1e4cc56cec tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58106973ce5e4662a447f203d8a35585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decfb15dcb6e48b98a8b0af680411661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:45.018379 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c78f51e8-5cff-4aa1-9b04-2e1e4cc56cec tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9" status: 200 len: 1274 microversion: 2.1 time: 0.264446 Jul 19 22:48:45.019580 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2238/4516] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:44 2022] GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9 => generated 1274 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:45.034931 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-05417655-3fe8-4bde-b80f-3c61995cdc0f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:45.035596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-05417655-3fe8-4bde-b80f-3c61995cdc0f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:45.055316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05417655-3fe8-4bde-b80f-3c61995cdc0f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:45.055873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05417655-3fe8-4bde-b80f-3c61995cdc0f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:45.056714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05417655-3fe8-4bde-b80f-3c61995cdc0f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:45.057158 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05417655-3fe8-4bde-b80f-3c61995cdc0f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:45.219573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b5810529-c6f5-430c-9984-b960e6096467 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:45.241977 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b5810529-c6f5-430c-9984-b960e6096467 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:45.246863 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b5810529-c6f5-430c-9984-b960e6096467 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:45.252190 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b5810529-c6f5-430c-9984-b960e6096467 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 2960 microversion: 2.42 time: 0.980693 Jul 19 22:48:45.254157 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2279/4517] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:44 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 2960 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:45.494889 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-05417655-3fe8-4bde-b80f-3c61995cdc0f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:45.503307 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-05417655-3fe8-4bde-b80f-3c61995cdc0f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.482540 Jul 19 22:48:45.504244 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2239/4518] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:45 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:45.547709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-44aa96bb-e3df-4de5-9da0-d1d10e628e0b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:45.548916 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-44aa96bb-e3df-4de5-9da0-d1d10e628e0b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 7b4ae6c9-549f-4802-9b41-4743e31890d3] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:45.565339 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-44aa96bb-e3df-4de5-9da0-d1d10e628e0b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Instance 7b4ae6c9-549f-4802-9b41-4743e31890d3 could not be found. Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-44aa96bb-e3df-4de5-9da0-d1d10e628e0b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers/7b4ae6c9-549f-4802-9b41-4743e31890d3/action HTTP/1.1 Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 15 Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: {"restore": {}} Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 7b4ae6c9-549f-4802-9b41-4743e31890d3 could not be found. Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '7b4ae6c9-549f-4802-9b41-4743e31890d3', 'body': {'restore': {}}} Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b4ae6c9-549f-4802-9b41-4743e31890d3 could not be found. Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b4ae6c9-549f-4802-9b41-4743e31890d3 could not be found. Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:45.579692 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:45.586026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:45.586026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:45.586026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b4ae6c9-549f-4802-9b41-4743e31890d3 could not be found. Jul 19 22:48:45.586026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:45.586026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-44aa96bb-e3df-4de5-9da0-d1d10e628e0b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 404 to user: Instance 7b4ae6c9-549f-4802-9b41-4743e31890d3 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:45.586026 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-44aa96bb-e3df-4de5-9da0-d1d10e628e0b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers/7b4ae6c9-549f-4802-9b41-4743e31890d3/action" status: 404 len: 111 microversion: 2.1 time: 0.063052 Jul 19 22:48:45.586026 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2280/4519] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:48:45 2022] POST /compute/v2.1/servers/7b4ae6c9-549f-4802-9b41-4743e31890d3/action => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:48:45.601018 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c850b2ca-c9ec-4fa5-ab3e-3ffe6fc74804 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:45.602100 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c850b2ca-c9ec-4fa5-ab3e-3ffe6fc74804 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:45.637923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c850b2ca-c9ec-4fa5-ab3e-3ffe6fc74804 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:45.641385 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c850b2ca-c9ec-4fa5-ab3e-3ffe6fc74804 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:45.642948 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c850b2ca-c9ec-4fa5-ab3e-3ffe6fc74804 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:45.643839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c850b2ca-c9ec-4fa5-ab3e-3ffe6fc74804 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:46.037715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-06ece35e-7529-4899-b4dc-0f966f8e0d25 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:46.038606 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-06ece35e-7529-4899-b4dc-0f966f8e0d25 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] [instance: 0e8df505-6004-4176-b4ee-27414ef1a6e9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:46.055081 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-06ece35e-7529-4899-b4dc-0f966f8e0d25 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:46.055796 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-06ece35e-7529-4899-b4dc-0f966f8e0d25 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:46.057514 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-06ece35e-7529-4899-b4dc-0f966f8e0d25 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:46.063673 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c850b2ca-c9ec-4fa5-ab3e-3ffe6fc74804 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:46.065351 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-06ece35e-7529-4899-b4dc-0f966f8e0d25 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:46.084921 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c850b2ca-c9ec-4fa5-ab3e-3ffe6fc74804 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.495361 Jul 19 22:48:46.085532 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2240/4520] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:45 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:46.106454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-abd1c8a2-f084-4a2c-8cc1-ded0735116eb tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:46.107363 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-abd1c8a2-f084-4a2c-8cc1-ded0735116eb tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:46.119439 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-abd1c8a2-f084-4a2c-8cc1-ded0735116eb tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:46.120218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-abd1c8a2-f084-4a2c-8cc1-ded0735116eb tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:46.121645 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-abd1c8a2-f084-4a2c-8cc1-ded0735116eb tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:46.122322 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-abd1c8a2-f084-4a2c-8cc1-ded0735116eb tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:47.195864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-06ece35e-7529-4899-b4dc-0f966f8e0d25 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58106973ce5e4662a447f203d8a35585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decfb15dcb6e48b98a8b0af680411661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:47.208318 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-06ece35e-7529-4899-b4dc-0f966f8e0d25 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9" status: 200 len: 1316 microversion: 2.1 time: 1.175923 Jul 19 22:48:47.219216 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2281/4521] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:46 2022] GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9 => generated 1316 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:48:47.226714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-abd1c8a2-f084-4a2c-8cc1-ded0735116eb tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:47.228330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e21a47bd-d0a5-445a-9825-7497c356976b tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:47.228976 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e21a47bd-d0a5-445a-9825-7497c356976b tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:47.238404 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e21a47bd-d0a5-445a-9825-7497c356976b tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:47.239148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e21a47bd-d0a5-445a-9825-7497c356976b tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:47.240226 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e21a47bd-d0a5-445a-9825-7497c356976b tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:47.240825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e21a47bd-d0a5-445a-9825-7497c356976b tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:47.245813 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-abd1c8a2-f084-4a2c-8cc1-ded0735116eb tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 1.143888 Jul 19 22:48:47.268121 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2241/4522] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:46 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:47.291775 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6da3b7ec-5d26-468b-bbbc-c3304d63ca9c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:47.300176 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6da3b7ec-5d26-468b-bbbc-c3304d63ca9c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:47.323845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6da3b7ec-5d26-468b-bbbc-c3304d63ca9c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:47.325226 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6da3b7ec-5d26-468b-bbbc-c3304d63ca9c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:47.330742 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6da3b7ec-5d26-468b-bbbc-c3304d63ca9c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:47.335565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6da3b7ec-5d26-468b-bbbc-c3304d63ca9c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:47.387357 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-6da3b7ec-5d26-468b-bbbc-c3304d63ca9c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Cannot 'restore' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state active Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6da3b7ec-5d26-468b-bbbc-c3304d63ca9c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action HTTP/1.1 Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 15 Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: {"restore": {}} Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: exception: Cannot 'restore' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state active Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'fb0d2fe2-80ea-4fc2-a157-f7341877997c', 'body': {'restore': {}}} Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fb0d2fe2-80ea-4fc2-a157-f7341877997c in vm_state active. Cannot restore while the instance is in this state. Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state active Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:47.391209 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:47.396413 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:47.396413 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:47.396413 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:47.396413 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state active Jul 19 22:48:47.396413 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:47.398408 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6da3b7ec-5d26-468b-bbbc-c3304d63ca9c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 409 to user: Cannot 'restore' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state active {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:47.403162 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6da3b7ec-5d26-468b-bbbc-c3304d63ca9c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action" status: 409 len: 145 microversion: 2.1 time: 0.120098 Jul 19 22:48:47.406087 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2242/4523] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:48:47 2022] POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action => generated 145 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:48:47.419750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cc6a62cc-0294-43e9-9a4a-5c65082c2844 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:47.425075 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cc6a62cc-0294-43e9-9a4a-5c65082c2844 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:47.447686 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc6a62cc-0294-43e9-9a4a-5c65082c2844 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:47.449429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc6a62cc-0294-43e9-9a4a-5c65082c2844 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:47.451956 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc6a62cc-0294-43e9-9a4a-5c65082c2844 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:47.452637 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc6a62cc-0294-43e9-9a4a-5c65082c2844 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:47.965161 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cc6a62cc-0294-43e9-9a4a-5c65082c2844 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:47.984491 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cc6a62cc-0294-43e9-9a4a-5c65082c2844 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.564872 Jul 19 22:48:47.998096 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2243/4524] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:47 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:48.010017 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-33ebb5a7-dbcf-4b60-b6a8-d8b563729f95 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:48.011610 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-33ebb5a7-dbcf-4b60-b6a8-d8b563729f95 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:48.026871 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-33ebb5a7-dbcf-4b60-b6a8-d8b563729f95 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:48.029016 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-33ebb5a7-dbcf-4b60-b6a8-d8b563729f95 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:48.032507 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-33ebb5a7-dbcf-4b60-b6a8-d8b563729f95 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:48.033999 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-33ebb5a7-dbcf-4b60-b6a8-d8b563729f95 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:48.179393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e21a47bd-d0a5-445a-9825-7497c356976b tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:48.214010 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e21a47bd-d0a5-445a-9825-7497c356976b tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:48.220500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e21a47bd-d0a5-445a-9825-7497c356976b tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:48.223034 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e21a47bd-d0a5-445a-9825-7497c356976b tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 2960 microversion: 2.42 time: 1.002574 Jul 19 22:48:48.238202 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2282/4525] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:47 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 2960 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:48.254072 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9a60fc15-8080-4747-89c5-59f7be6253ff tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:48.255161 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9a60fc15-8080-4747-89c5-59f7be6253ff tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] [instance: 0e8df505-6004-4176-b4ee-27414ef1a6e9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:48.271182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a60fc15-8080-4747-89c5-59f7be6253ff tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:48.271182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a60fc15-8080-4747-89c5-59f7be6253ff tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:48.271601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a60fc15-8080-4747-89c5-59f7be6253ff tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:48.272074 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a60fc15-8080-4747-89c5-59f7be6253ff tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:48.754428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-33ebb5a7-dbcf-4b60-b6a8-d8b563729f95 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:48.771730 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-33ebb5a7-dbcf-4b60-b6a8-d8b563729f95 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.770715 Jul 19 22:48:48.783634 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2244/4526] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:47 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:48.791176 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b2b2fd04-60c7-4c79-8646-5b50c3b01e23 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:48.792022 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b2b2fd04-60c7-4c79-8646-5b50c3b01e23 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 0ba5b466-0f84-42d7-9a1b-3351d0b15aac] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:48.804246 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-b2b2fd04-60c7-4c79-8646-5b50c3b01e23 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Instance 0ba5b466-0f84-42d7-9a1b-3351d0b15aac could not be found. Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b2b2fd04-60c7-4c79-8646-5b50c3b01e23 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/0ba5b466-0f84-42d7-9a1b-3351d0b15aac/action HTTP/1.1 Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 14 Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: {"resume": {}} Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 0ba5b466-0f84-42d7-9a1b-3351d0b15aac could not be found. Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '0ba5b466-0f84-42d7-9a1b-3351d0b15aac', 'body': {'resume': {}}} Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ba5b466-0f84-42d7-9a1b-3351d0b15aac could not be found. Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ba5b466-0f84-42d7-9a1b-3351d0b15aac could not be found. Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:48.812554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:48.816537 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:48.816537 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:48.816537 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ba5b466-0f84-42d7-9a1b-3351d0b15aac could not be found. Jul 19 22:48:48.816537 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:48:48.818944 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b2b2fd04-60c7-4c79-8646-5b50c3b01e23 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 404 to user: Instance 0ba5b466-0f84-42d7-9a1b-3351d0b15aac could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:48.820198 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b2b2fd04-60c7-4c79-8646-5b50c3b01e23 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers/0ba5b466-0f84-42d7-9a1b-3351d0b15aac/action" status: 404 len: 111 microversion: 2.1 time: 0.033257 Jul 19 22:48:48.825346 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2245/4527] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:48:48 2022] POST /compute/v2.1/servers/0ba5b466-0f84-42d7-9a1b-3351d0b15aac/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:48:48.837421 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-45c20e9a-8ffe-4c11-8860-51f1bcef1a32 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:48.838045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-45c20e9a-8ffe-4c11-8860-51f1bcef1a32 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:48.854735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45c20e9a-8ffe-4c11-8860-51f1bcef1a32 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:48.855645 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45c20e9a-8ffe-4c11-8860-51f1bcef1a32 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:48.859483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45c20e9a-8ffe-4c11-8860-51f1bcef1a32 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:48.860218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45c20e9a-8ffe-4c11-8860-51f1bcef1a32 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:48.908709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9a60fc15-8080-4747-89c5-59f7be6253ff tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58106973ce5e4662a447f203d8a35585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decfb15dcb6e48b98a8b0af680411661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:48.929618 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9a60fc15-8080-4747-89c5-59f7be6253ff tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9" status: 200 len: 1316 microversion: 2.1 time: 0.686692 Jul 19 22:48:48.943737 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2283/4528] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:48 2022] GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9 => generated 1316 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:49.248621 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-79794e79-7fb3-459a-ad67-7454743960e1 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:49.250031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-79794e79-7fb3-459a-ad67-7454743960e1 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:49.260657 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:48:49.262439 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79794e79-7fb3-459a-ad67-7454743960e1 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:49.266736 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79794e79-7fb3-459a-ad67-7454743960e1 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:49.269514 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79794e79-7fb3-459a-ad67-7454743960e1 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:49.271527 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79794e79-7fb3-459a-ad67-7454743960e1 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:49.529653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=8 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:48:49.947928 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-45c20e9a-8ffe-4c11-8860-51f1bcef1a32 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:49.966327 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-45c20e9a-8ffe-4c11-8860-51f1bcef1a32 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 1.139179 Jul 19 22:48:49.971877 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2246/4529] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:48 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:49.991615 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-885050dd-cc10-41e8-9766-d8fd75d7a02a tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:49.992288 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-885050dd-cc10-41e8-9766-d8fd75d7a02a tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] [instance: 0e8df505-6004-4176-b4ee-27414ef1a6e9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:50.015569 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-885050dd-cc10-41e8-9766-d8fd75d7a02a tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:50.016029 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-885050dd-cc10-41e8-9766-d8fd75d7a02a tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:50.019006 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-885050dd-cc10-41e8-9766-d8fd75d7a02a tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:50.019490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-885050dd-cc10-41e8-9766-d8fd75d7a02a tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:51.273888 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-79794e79-7fb3-459a-ad67-7454743960e1 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:51.295065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-79794e79-7fb3-459a-ad67-7454743960e1 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:51.297657 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-79794e79-7fb3-459a-ad67-7454743960e1 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:51.299032 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-79794e79-7fb3-459a-ad67-7454743960e1 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 2960 microversion: 2.42 time: 2.055554 Jul 19 22:48:51.308574 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2284/4530] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:49 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 2960 bytes in 2065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:51.342682 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-600c05eb-824b-40de-8e38-a18a4a006748 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:51.350998 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-600c05eb-824b-40de-8e38-a18a4a006748 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:51.358825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-600c05eb-824b-40de-8e38-a18a4a006748 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:51.359542 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-600c05eb-824b-40de-8e38-a18a4a006748 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:51.361347 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-600c05eb-824b-40de-8e38-a18a4a006748 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:51.361961 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-600c05eb-824b-40de-8e38-a18a4a006748 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:51.995894 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-885050dd-cc10-41e8-9766-d8fd75d7a02a tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58106973ce5e4662a447f203d8a35585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decfb15dcb6e48b98a8b0af680411661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:52.008590 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-885050dd-cc10-41e8-9766-d8fd75d7a02a tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9" status: 200 len: 1316 microversion: 2.1 time: 2.033926 Jul 19 22:48:52.015899 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2247/4531] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:49 2022] GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9 => generated 1316 bytes in 2043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:52.020992 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-169cf0b5-a5bd-4a9a-ac5a-b913f27847b6 req-301acc98-2423-47a6-bf5d-c1fe5590d2c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d53ca5c-aaa1-44f3-832d-7f2a9a56db39", "name": "network-vif-unplugged", "status": "completed", "tag": "aaebb168-a0dc-4323-91f4-47daf8a94255"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:52.061752 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-169cf0b5-a5bd-4a9a-ac5a-b913f27847b6 req-301acc98-2423-47a6-bf5d-c1fe5590d2c7 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:52.067777 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-169cf0b5-a5bd-4a9a-ac5a-b913f27847b6 req-301acc98-2423-47a6-bf5d-c1fe5590d2c7 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:52.072956 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:48:52.092439 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-169cf0b5-a5bd-4a9a-ac5a-b913f27847b6 req-301acc98-2423-47a6-bf5d-c1fe5590d2c7 service nova] Creating event network-vif-unplugged:aaebb168-a0dc-4323-91f4-47daf8a94255 for instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 on n-h2-847009-3 Jul 19 22:48:52.115325 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-169cf0b5-a5bd-4a9a-ac5a-b913f27847b6 req-301acc98-2423-47a6-bf5d-c1fe5590d2c7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094685 Jul 19 22:48:52.116320 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2248/4532] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:48:52.192301 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-bae06797-3eb9-41d2-aa17-487aafd41e5b req-aa76f3c0-1165-4e98-ae2a-cd232365ee0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e8df505-6004-4176-b4ee-27414ef1a6e9", "tag": "08115cfd-c038-46b8-ad6f-fd85d0bafc6e"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:52.228007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-bae06797-3eb9-41d2-aa17-487aafd41e5b req-aa76f3c0-1165-4e98-ae2a-cd232365ee0b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:52.228406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-bae06797-3eb9-41d2-aa17-487aafd41e5b req-aa76f3c0-1165-4e98-ae2a-cd232365ee0b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:52.283586 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-bae06797-3eb9-41d2-aa17-487aafd41e5b req-aa76f3c0-1165-4e98-ae2a-cd232365ee0b service nova] Creating event network-changed:08115cfd-c038-46b8-ad6f-fd85d0bafc6e for instance 0e8df505-6004-4176-b4ee-27414ef1a6e9 on n-h1-847009-3 Jul 19 22:48:52.301114 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-bae06797-3eb9-41d2-aa17-487aafd41e5b req-aa76f3c0-1165-4e98-ae2a-cd232365ee0b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117316 Jul 19 22:48:52.303419 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2249/4533] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:48:52.331734 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-679a891c-f09e-4760-b46d-e90d5c0f0319 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:52.333246 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-679a891c-f09e-4760-b46d-e90d5c0f0319 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:52.353174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-679a891c-f09e-4760-b46d-e90d5c0f0319 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:52.353732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-679a891c-f09e-4760-b46d-e90d5c0f0319 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:52.355342 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-679a891c-f09e-4760-b46d-e90d5c0f0319 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:52.357022 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-679a891c-f09e-4760-b46d-e90d5c0f0319 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:52.601486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-600c05eb-824b-40de-8e38-a18a4a006748 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:52.604597 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:48:52.612940 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-600c05eb-824b-40de-8e38-a18a4a006748 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 1.303185 Jul 19 22:48:52.627857 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2285/4534] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:51 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:52.658199 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aa70ebed-305c-4764-bc9d-c2f31a12f358 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:52.659514 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-aa70ebed-305c-4764-bc9d-c2f31a12f358 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:52.674203 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa70ebed-305c-4764-bc9d-c2f31a12f358 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:52.677876 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa70ebed-305c-4764-bc9d-c2f31a12f358 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:52.679763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa70ebed-305c-4764-bc9d-c2f31a12f358 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:52.683662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa70ebed-305c-4764-bc9d-c2f31a12f358 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:52.735016 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-aa70ebed-305c-4764-bc9d-c2f31a12f358 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Cannot 'resume' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state active Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aa70ebed-305c-4764-bc9d-c2f31a12f358 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action HTTP/1.1 Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 14 Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: {"resume": {}} Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: exception: Cannot 'resume' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state active Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'fb0d2fe2-80ea-4fc2-a157-f7341877997c', 'body': {'resume': {}}} Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fb0d2fe2-80ea-4fc2-a157-f7341877997c in vm_state active. Cannot resume while the instance is in this state. Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state active Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:52.739487 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:52.744824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:52.744824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:52.744824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:52.744824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state active Jul 19 22:48:52.744824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:52.751560 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aa70ebed-305c-4764-bc9d-c2f31a12f358 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 409 to user: Cannot 'resume' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state active {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:52.752893 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-aa70ebed-305c-4764-bc9d-c2f31a12f358 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action" status: 409 len: 144 microversion: 2.1 time: 0.111765 Jul 19 22:48:52.753344 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2286/4535] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:48:52 2022] POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action => generated 144 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:48:52.801366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aff8049d-4416-42f3-a4df-b666a9504aac tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:52.802360 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-aff8049d-4416-42f3-a4df-b666a9504aac tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:52.810204 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aff8049d-4416-42f3-a4df-b666a9504aac tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:52.810814 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aff8049d-4416-42f3-a4df-b666a9504aac tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:52.811825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aff8049d-4416-42f3-a4df-b666a9504aac tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:52.812396 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aff8049d-4416-42f3-a4df-b666a9504aac tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:53.135003 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-679a891c-f09e-4760-b46d-e90d5c0f0319 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:53.159292 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-679a891c-f09e-4760-b46d-e90d5c0f0319 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:53.168470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-679a891c-f09e-4760-b46d-e90d5c0f0319 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:53.170129 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-679a891c-f09e-4760-b46d-e90d5c0f0319 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 2939 microversion: 2.42 time: 0.849433 Jul 19 22:48:53.171764 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2250/4536] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:52 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 2939 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:48:53.176577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1257e508-41e3-49ef-94dc-194d14097fa5 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:53.180906 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1257e508-41e3-49ef-94dc-194d14097fa5 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] [instance: 0e8df505-6004-4176-b4ee-27414ef1a6e9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:53.201320 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1257e508-41e3-49ef-94dc-194d14097fa5 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:53.201781 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1257e508-41e3-49ef-94dc-194d14097fa5 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:53.202628 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1257e508-41e3-49ef-94dc-194d14097fa5 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:53.203067 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1257e508-41e3-49ef-94dc-194d14097fa5 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:53.313948 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-aff8049d-4416-42f3-a4df-b666a9504aac tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:53.324997 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-aff8049d-4416-42f3-a4df-b666a9504aac tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.566698 Jul 19 22:48:53.326323 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2287/4537] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:52 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:53.349225 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b35ccaf1-de85-4e0d-ac6e-8b154b144106 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:53.350255 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b35ccaf1-de85-4e0d-ac6e-8b154b144106 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:53.364341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b35ccaf1-de85-4e0d-ac6e-8b154b144106 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:53.364686 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b35ccaf1-de85-4e0d-ac6e-8b154b144106 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:53.365706 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b35ccaf1-de85-4e0d-ac6e-8b154b144106 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:53.366358 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b35ccaf1-de85-4e0d-ac6e-8b154b144106 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:53.671029 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1257e508-41e3-49ef-94dc-194d14097fa5 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58106973ce5e4662a447f203d8a35585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decfb15dcb6e48b98a8b0af680411661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:53.680531 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1257e508-41e3-49ef-94dc-194d14097fa5 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9" status: 200 len: 1316 microversion: 2.1 time: 0.507585 Jul 19 22:48:53.688421 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2251/4538] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:53 2022] GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9 => generated 1316 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:53.797304 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b35ccaf1-de85-4e0d-ac6e-8b154b144106 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:53.821765 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b35ccaf1-de85-4e0d-ac6e-8b154b144106 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.477912 Jul 19 22:48:53.822816 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2288/4539] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:53 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:48:54.194287 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ecd9b219-63ce-40e7-b47b-d8c60367cece tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:54.196679 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ecd9b219-63ce-40e7-b47b-d8c60367cece tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:54.213091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ecd9b219-63ce-40e7-b47b-d8c60367cece tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:54.214159 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ecd9b219-63ce-40e7-b47b-d8c60367cece tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:54.215915 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ecd9b219-63ce-40e7-b47b-d8c60367cece tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:54.218904 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ecd9b219-63ce-40e7-b47b-d8c60367cece tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:54.231190 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6a32b78b-39c9-4557-a14a-c2390a49b69d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "711438ef-9562-4879-b7e2-ec9cf463e48f"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6a32b78b-39c9-4557-a14a-c2390a49b69d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 160 Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: {"server": {"name": "", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "711438ef-9562-4879-b7e2-ec9cf463e48f"}]}} Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'body': {'server': {'name': '', 'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691', 'flavorRef': '452', 'networks': [{'uuid': '711438ef-9562-4879-b7e2-ec9cf463e48f'}]}}} Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi '' Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:48:54.235844 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:48:54.239664 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:48:54.239664 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 19 22:48:54.239664 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:54.239664 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:54.239664 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:54.239664 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:54.239664 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:54.239664 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:54.239664 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:48:54.239664 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:48:54.239664 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 19 22:48:54.239664 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:54.249272 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6a32b78b-39c9-4557-a14a-c2390a49b69d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:54.251501 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6a32b78b-39c9-4557-a14a-c2390a49b69d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.024258 Jul 19 22:48:54.253770 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2289/4540] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:48:54 2022] POST /compute/v2.1/servers => generated 108 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 22:48:54.261695 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-85d05c8f-0e0c-435e-8261-97aac914e121 req-3f3cece4-c382-4b4b-885b-8f80155856ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d53ca5c-aaa1-44f3-832d-7f2a9a56db39", "name": "network-vif-unplugged", "status": "completed", "tag": "98a30d5e-ad65-436d-96ad-23f81ba2c4be"}, {"server_uuid": "7d53ca5c-aaa1-44f3-832d-7f2a9a56db39", "name": "network-vif-unplugged", "status": "completed", "tag": "30578dff-afdd-4547-842d-9204f90d0883"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:54.306853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-85d05c8f-0e0c-435e-8261-97aac914e121 req-3f3cece4-c382-4b4b-885b-8f80155856ac service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:54.312641 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-85d05c8f-0e0c-435e-8261-97aac914e121 req-3f3cece4-c382-4b4b-885b-8f80155856ac service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:54.354732 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-85d05c8f-0e0c-435e-8261-97aac914e121 req-3f3cece4-c382-4b4b-885b-8f80155856ac service nova] Creating event network-vif-unplugged:98a30d5e-ad65-436d-96ad-23f81ba2c4be for instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 on n-h2-847009-3 Jul 19 22:48:54.355542 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-85d05c8f-0e0c-435e-8261-97aac914e121 req-3f3cece4-c382-4b4b-885b-8f80155856ac service nova] Creating event network-vif-unplugged:30578dff-afdd-4547-842d-9204f90d0883 for instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 on n-h2-847009-3 Jul 19 22:48:54.362403 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-85d05c8f-0e0c-435e-8261-97aac914e121 req-3f3cece4-c382-4b4b-885b-8f80155856ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.107148 Jul 19 22:48:54.363395 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2290/4541] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:48:54.375956 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-63d8fadc-fa73-435f-9e64-298699a23b18 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:54.377349 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-63d8fadc-fa73-435f-9e64-298699a23b18 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:54.385881 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-63d8fadc-fa73-435f-9e64-298699a23b18 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:54.388353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-63d8fadc-fa73-435f-9e64-298699a23b18 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:54.390285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-63d8fadc-fa73-435f-9e64-298699a23b18 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:54.400641 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-63d8fadc-fa73-435f-9e64-298699a23b18 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:55.294616 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ecd9b219-63ce-40e7-b47b-d8c60367cece tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:55.319531 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ecd9b219-63ce-40e7-b47b-d8c60367cece tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:55.321228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ecd9b219-63ce-40e7-b47b-d8c60367cece tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:55.322576 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ecd9b219-63ce-40e7-b47b-d8c60367cece tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 2918 microversion: 2.42 time: 1.135966 Jul 19 22:48:55.323508 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2252/4542] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:54 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 2918 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:55.328830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-63f74c9c-48fc-4635-8b34-bda6de16df46 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:55.329454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-63f74c9c-48fc-4635-8b34-bda6de16df46 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] [instance: 0e8df505-6004-4176-b4ee-27414ef1a6e9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:55.361172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63f74c9c-48fc-4635-8b34-bda6de16df46 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:55.361635 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63f74c9c-48fc-4635-8b34-bda6de16df46 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:55.362428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63f74c9c-48fc-4635-8b34-bda6de16df46 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:55.362868 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63f74c9c-48fc-4635-8b34-bda6de16df46 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:55.605108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-63d8fadc-fa73-435f-9e64-298699a23b18 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:55.614356 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-63d8fadc-fa73-435f-9e64-298699a23b18 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 1.249305 Jul 19 22:48:55.632373 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2291/4543] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:54 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:55.644542 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-5e75f9c3-6cba-4556-b6ce-200f51b07999 req-48b8c292-0e02-4d7a-bdae-96c673ab64d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d53ca5c-aaa1-44f3-832d-7f2a9a56db39", "name": "network-vif-deleted", "tag": "30578dff-afdd-4547-842d-9204f90d0883"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:55.684260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5e75f9c3-6cba-4556-b6ce-200f51b07999 req-48b8c292-0e02-4d7a-bdae-96c673ab64d1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:55.685064 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5e75f9c3-6cba-4556-b6ce-200f51b07999 req-48b8c292-0e02-4d7a-bdae-96c673ab64d1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:55.724513 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-5e75f9c3-6cba-4556-b6ce-200f51b07999 req-48b8c292-0e02-4d7a-bdae-96c673ab64d1 service nova] Creating event network-vif-deleted:30578dff-afdd-4547-842d-9204f90d0883 for instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 on n-h2-847009-3 Jul 19 22:48:55.741184 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-5e75f9c3-6cba-4556-b6ce-200f51b07999 req-48b8c292-0e02-4d7a-bdae-96c673ab64d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102865 Jul 19 22:48:55.743203 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2292/4544] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:48:55.753109 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aa55472b-2f44-4b19-a46c-a35ae9895ec0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:55.753889 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-aa55472b-2f44-4b19-a46c-a35ae9895ec0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:55.764361 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa55472b-2f44-4b19-a46c-a35ae9895ec0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:55.765549 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa55472b-2f44-4b19-a46c-a35ae9895ec0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:55.766447 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa55472b-2f44-4b19-a46c-a35ae9895ec0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:55.767285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa55472b-2f44-4b19-a46c-a35ae9895ec0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:56.108665 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-63f74c9c-48fc-4635-8b34-bda6de16df46 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58106973ce5e4662a447f203d8a35585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decfb15dcb6e48b98a8b0af680411661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:56.129507 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-63f74c9c-48fc-4635-8b34-bda6de16df46 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9" status: 200 len: 1316 microversion: 2.1 time: 0.804881 Jul 19 22:48:56.136070 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2253/4545] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:55 2022] GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9 => generated 1316 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:56.352717 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f20654d0-60d4-49ac-b509-958ac78072e0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:56.354681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f20654d0-60d4-49ac-b509-958ac78072e0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:56.362208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-aa55472b-2f44-4b19-a46c-a35ae9895ec0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:56.382643 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f20654d0-60d4-49ac-b509-958ac78072e0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:56.383103 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-aa55472b-2f44-4b19-a46c-a35ae9895ec0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.636675 Jul 19 22:48:56.384138 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2293/4546] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:55 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:56.384693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f20654d0-60d4-49ac-b509-958ac78072e0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:56.385933 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f20654d0-60d4-49ac-b509-958ac78072e0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:56.386685 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f20654d0-60d4-49ac-b509-958ac78072e0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:56.404663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d3fa259a-0947-40a1-a83b-5674bfb0966b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:56.408076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d3fa259a-0947-40a1-a83b-5674bfb0966b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: a44abdef-8e20-4806-b830-631403ab34a2] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:56.444580 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-d3fa259a-0947-40a1-a83b-5674bfb0966b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Instance a44abdef-8e20-4806-b830-631403ab34a2 could not be found. Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d3fa259a-0947-40a1-a83b-5674bfb0966b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers/a44abdef-8e20-4806-b830-631403ab34a2/action HTTP/1.1 Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 14 Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: {"shelve": {}} Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance a44abdef-8e20-4806-b830-631403ab34a2 could not be found. Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'a44abdef-8e20-4806-b830-631403ab34a2', 'body': {'shelve': {}}} Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a44abdef-8e20-4806-b830-631403ab34a2 could not be found. Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a44abdef-8e20-4806-b830-631403ab34a2 could not be found. Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:48:56.451298 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:48:56.461210 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:48:56.461210 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:48:56.461210 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a44abdef-8e20-4806-b830-631403ab34a2 could not be found. Jul 19 22:48:56.461210 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:48:56.461210 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d3fa259a-0947-40a1-a83b-5674bfb0966b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 404 to user: Instance a44abdef-8e20-4806-b830-631403ab34a2 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:48:56.461210 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d3fa259a-0947-40a1-a83b-5674bfb0966b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers/a44abdef-8e20-4806-b830-631403ab34a2/action" status: 404 len: 111 microversion: 2.1 time: 0.055534 Jul 19 22:48:56.461210 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2294/4547] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:48:56 2022] POST /compute/v2.1/servers/a44abdef-8e20-4806-b830-631403ab34a2/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:48:56.466067 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-c566885b-7e23-4cdf-a7cf-499c06a90cfb req-234ddbed-5c5d-4fca-a622-df68da05b158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d53ca5c-aaa1-44f3-832d-7f2a9a56db39", "name": "network-vif-unplugged", "status": "completed", "tag": "0a907ea9-840e-4a11-a8f9-aa989d95ed73"}, {"server_uuid": "7d53ca5c-aaa1-44f3-832d-7f2a9a56db39", "name": "network-vif-unplugged", "status": "completed", "tag": "27fff587-1a65-4e04-9a00-c3b15f8c23f1"}, {"server_uuid": "7d53ca5c-aaa1-44f3-832d-7f2a9a56db39", "name": "network-vif-unplugged", "status": "completed", "tag": "504225f7-9cee-4c36-9a1d-bb80c366dfae"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:56.501498 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c566885b-7e23-4cdf-a7cf-499c06a90cfb req-234ddbed-5c5d-4fca-a622-df68da05b158 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:56.501948 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c566885b-7e23-4cdf-a7cf-499c06a90cfb req-234ddbed-5c5d-4fca-a622-df68da05b158 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:56.517472 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-c566885b-7e23-4cdf-a7cf-499c06a90cfb req-234ddbed-5c5d-4fca-a622-df68da05b158 service nova] Creating event network-vif-unplugged:0a907ea9-840e-4a11-a8f9-aa989d95ed73 for instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 on n-h2-847009-3 Jul 19 22:48:56.518094 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-c566885b-7e23-4cdf-a7cf-499c06a90cfb req-234ddbed-5c5d-4fca-a622-df68da05b158 service nova] Creating event network-vif-unplugged:27fff587-1a65-4e04-9a00-c3b15f8c23f1 for instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 on n-h2-847009-3 Jul 19 22:48:56.518614 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-c566885b-7e23-4cdf-a7cf-499c06a90cfb req-234ddbed-5c5d-4fca-a622-df68da05b158 service nova] Creating event network-vif-unplugged:504225f7-9cee-4c36-9a1d-bb80c366dfae for instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 on n-h2-847009-3 Jul 19 22:48:56.527437 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-c566885b-7e23-4cdf-a7cf-499c06a90cfb req-234ddbed-5c5d-4fca-a622-df68da05b158 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.067866 Jul 19 22:48:56.528117 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2295/4548] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:48:56.536831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-13d8c0ed-c9bd-4e2b-9fe7-4f9edd59d272 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:56.537916 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-13d8c0ed-c9bd-4e2b-9fe7-4f9edd59d272 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:56.546363 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-13d8c0ed-c9bd-4e2b-9fe7-4f9edd59d272 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:56.546920 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-13d8c0ed-c9bd-4e2b-9fe7-4f9edd59d272 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:56.547866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-13d8c0ed-c9bd-4e2b-9fe7-4f9edd59d272 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:56.548675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-13d8c0ed-c9bd-4e2b-9fe7-4f9edd59d272 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:57.893934 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-13d8c0ed-c9bd-4e2b-9fe7-4f9edd59d272 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:57.910557 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-13d8c0ed-c9bd-4e2b-9fe7-4f9edd59d272 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 1.377993 Jul 19 22:48:57.914568 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2296/4549] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:56 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:57.928191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-35a58993-55a7-4eed-b114-d66f30460c77 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:57.933074 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-35a58993-55a7-4eed-b114-d66f30460c77 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] [instance: 0e8df505-6004-4176-b4ee-27414ef1a6e9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:57.947754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35a58993-55a7-4eed-b114-d66f30460c77 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:57.949243 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35a58993-55a7-4eed-b114-d66f30460c77 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:57.955363 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35a58993-55a7-4eed-b114-d66f30460c77 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:57.957747 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35a58993-55a7-4eed-b114-d66f30460c77 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:57.972588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f20654d0-60d4-49ac-b509-958ac78072e0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:58.007256 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f20654d0-60d4-49ac-b509-958ac78072e0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:58.018104 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f20654d0-60d4-49ac-b509-958ac78072e0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:58.024252 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f20654d0-60d4-49ac-b509-958ac78072e0 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 2757 microversion: 2.42 time: 1.672946 Jul 19 22:48:58.041741 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2254/4550] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:56 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 2757 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:48:58.059455 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f1c2748e-4d7b-4a2d-a845-ba28b20249c7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:58.060269 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f1c2748e-4d7b-4a2d-a845-ba28b20249c7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:58.085215 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f1c2748e-4d7b-4a2d-a845-ba28b20249c7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:58.088618 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f1c2748e-4d7b-4a2d-a845-ba28b20249c7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:58.092217 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f1c2748e-4d7b-4a2d-a845-ba28b20249c7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:58.093437 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f1c2748e-4d7b-4a2d-a845-ba28b20249c7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:59.010106 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f1c2748e-4d7b-4a2d-a845-ba28b20249c7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:59.021661 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f1c2748e-4d7b-4a2d-a845-ba28b20249c7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.977776 Jul 19 22:48:59.028704 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2255/4551] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:58 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:59.046408 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-764566b1-2406-483d-8f25-6fe4f1fa023b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:48:59.048265 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-764566b1-2406-483d-8f25-6fe4f1fa023b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:59.058495 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-764566b1-2406-483d-8f25-6fe4f1fa023b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:59.063474 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-764566b1-2406-483d-8f25-6fe4f1fa023b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:59.064718 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-764566b1-2406-483d-8f25-6fe4f1fa023b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:59.066778 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-764566b1-2406-483d-8f25-6fe4f1fa023b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:59.143866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-764566b1-2406-483d-8f25-6fe4f1fa023b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lazy-loading 'flavor' on Instance uuid fb0d2fe2-80ea-4fc2-a157-f7341877997c {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:48:59.449454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-35a58993-55a7-4eed-b114-d66f30460c77 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58106973ce5e4662a447f203d8a35585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decfb15dcb6e48b98a8b0af680411661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:48:59.498025 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-35a58993-55a7-4eed-b114-d66f30460c77 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9" status: 200 len: 1316 microversion: 2.1 time: 1.580591 Jul 19 22:48:59.498994 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2297/4552] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:48:57 2022] GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9 => generated 1316 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:48:59.521226 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f2d3a4de-50b2-45c2-ba1b-76db83064a71 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:48:59.523641 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f2d3a4de-50b2-45c2-ba1b-76db83064a71 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:48:59.535551 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f2d3a4de-50b2-45c2-ba1b-76db83064a71 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:59.538297 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f2d3a4de-50b2-45c2-ba1b-76db83064a71 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:59.540517 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f2d3a4de-50b2-45c2-ba1b-76db83064a71 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:48:59.542123 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f2d3a4de-50b2-45c2-ba1b-76db83064a71 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:48:59.946374 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-764566b1-2406-483d-8f25-6fe4f1fa023b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action" status: 202 len: 0 microversion: 2.1 time: 0.905729 Jul 19 22:48:59.948555 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2256/4553] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:48:59 2022] POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action => generated 0 bytes in 909 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 22:48:59.964375 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-67b44646-0e91-4aee-96ae-d82b1814a5f3 req-c0da3100-f45c-4128-81f0-0a0792ffa9a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8df505-6004-4176-b4ee-27414ef1a6e9", "name": "network-vif-plugged", "status": "completed", "tag": "08115cfd-c038-46b8-ad6f-fd85d0bafc6e"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:49:00.026629 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-67b44646-0e91-4aee-96ae-d82b1814a5f3 req-c0da3100-f45c-4128-81f0-0a0792ffa9a2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:00.027284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-67b44646-0e91-4aee-96ae-d82b1814a5f3 req-c0da3100-f45c-4128-81f0-0a0792ffa9a2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:00.069872 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-67b44646-0e91-4aee-96ae-d82b1814a5f3 req-c0da3100-f45c-4128-81f0-0a0792ffa9a2 service nova] Creating event network-vif-plugged:08115cfd-c038-46b8-ad6f-fd85d0bafc6e for instance 0e8df505-6004-4176-b4ee-27414ef1a6e9 on n-h1-847009-3 Jul 19 22:49:00.086296 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-67b44646-0e91-4aee-96ae-d82b1814a5f3 req-c0da3100-f45c-4128-81f0-0a0792ffa9a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135673 Jul 19 22:49:00.090333 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2257/4554] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:49:00.110852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-60d7c305-3a82-48a3-b100-662a41a473fa tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:00.111752 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f2d3a4de-50b2-45c2-ba1b-76db83064a71 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:00.112721 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-60d7c305-3a82-48a3-b100-662a41a473fa tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:00.127212 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f2d3a4de-50b2-45c2-ba1b-76db83064a71 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:00.140788 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f2d3a4de-50b2-45c2-ba1b-76db83064a71 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:00.143250 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f2d3a4de-50b2-45c2-ba1b-76db83064a71 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 2710 microversion: 2.42 time: 0.640443 Jul 19 22:49:00.147476 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60d7c305-3a82-48a3-b100-662a41a473fa tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:00.149478 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60d7c305-3a82-48a3-b100-662a41a473fa tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:00.150348 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60d7c305-3a82-48a3-b100-662a41a473fa tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:00.150795 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60d7c305-3a82-48a3-b100-662a41a473fa tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:00.159517 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2298/4555] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:48:59 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 2710 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:49:00.167053 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-0f059375-cbfd-402c-98ec-48b3e4ff8970 req-74dea218-773f-4386-9125-4b56996915d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d53ca5c-aaa1-44f3-832d-7f2a9a56db39", "name": "network-vif-deleted", "tag": "27fff587-1a65-4e04-9a00-c3b15f8c23f1"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:49:00.178182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0f059375-cbfd-402c-98ec-48b3e4ff8970 req-74dea218-773f-4386-9125-4b56996915d6 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:00.179666 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0f059375-cbfd-402c-98ec-48b3e4ff8970 req-74dea218-773f-4386-9125-4b56996915d6 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:00.205999 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-0f059375-cbfd-402c-98ec-48b3e4ff8970 req-74dea218-773f-4386-9125-4b56996915d6 service nova] Creating event network-vif-deleted:27fff587-1a65-4e04-9a00-c3b15f8c23f1 for instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 on n-h2-847009-3 Jul 19 22:49:00.229832 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-0f059375-cbfd-402c-98ec-48b3e4ff8970 req-74dea218-773f-4386-9125-4b56996915d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068218 Jul 19 22:49:00.235320 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2299/4556] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:49:00.521014 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e919d23c-f89e-4f28-917c-95bb3b481323 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:00.523191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e919d23c-f89e-4f28-917c-95bb3b481323 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] [instance: 0e8df505-6004-4176-b4ee-27414ef1a6e9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:00.550048 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e919d23c-f89e-4f28-917c-95bb3b481323 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:00.550959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e919d23c-f89e-4f28-917c-95bb3b481323 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:00.554329 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e919d23c-f89e-4f28-917c-95bb3b481323 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:00.555246 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e919d23c-f89e-4f28-917c-95bb3b481323 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:00.958096 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-60d7c305-3a82-48a3-b100-662a41a473fa tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:00.971682 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-60d7c305-3a82-48a3-b100-662a41a473fa tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1511 microversion: 2.1 time: 0.878968 Jul 19 22:49:00.973544 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2258/4557] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:00 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1511 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:01.166560 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-176874fd-54c5-4a02-8b8e-1fc484a2faf7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:01.167329 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-176874fd-54c5-4a02-8b8e-1fc484a2faf7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:01.178103 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e919d23c-f89e-4f28-917c-95bb3b481323 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58106973ce5e4662a447f203d8a35585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decfb15dcb6e48b98a8b0af680411661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:01.182799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-176874fd-54c5-4a02-8b8e-1fc484a2faf7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:01.183291 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-176874fd-54c5-4a02-8b8e-1fc484a2faf7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:01.184073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-176874fd-54c5-4a02-8b8e-1fc484a2faf7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:01.184500 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-176874fd-54c5-4a02-8b8e-1fc484a2faf7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:01.189281 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e919d23c-f89e-4f28-917c-95bb3b481323 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9" status: 200 len: 1316 microversion: 2.1 time: 0.674928 Jul 19 22:49:01.192018 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2300/4558] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:00 2022] GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9 => generated 1316 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:01.621678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-51d79e72-869a-4c7d-a7ee-6c28dfc9264c tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-675146630", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "8c90880b-13b1-4e7f-a9e6-a66ffaff6382"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:49:01.633000 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-176874fd-54c5-4a02-8b8e-1fc484a2faf7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:01.654395 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-176874fd-54c5-4a02-8b8e-1fc484a2faf7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:01.664070 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-176874fd-54c5-4a02-8b8e-1fc484a2faf7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:01.672392 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-176874fd-54c5-4a02-8b8e-1fc484a2faf7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 2418 microversion: 2.42 time: 0.509982 Jul 19 22:49:01.675727 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2259/4559] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:01 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 2418 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:49:01.770007 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-51d79e72-869a-4c7d-a7ee-6c28dfc9264c tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] validate_networks() for [('8c90880b-13b1-4e7f-a9e6-a66ffaff6382', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:49:02.003172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2a62c998-c0da-4a64-9111-f70a72665668 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:02.003172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2a62c998-c0da-4a64-9111-f70a72665668 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:02.011028 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2a62c998-c0da-4a64-9111-f70a72665668 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:02.011544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2a62c998-c0da-4a64-9111-f70a72665668 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:02.012325 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2a62c998-c0da-4a64-9111-f70a72665668 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:02.021523 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2a62c998-c0da-4a64-9111-f70a72665668 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:02.871646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2a62c998-c0da-4a64-9111-f70a72665668 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:02.882571 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2a62c998-c0da-4a64-9111-f70a72665668 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1511 microversion: 2.1 time: 0.891019 Jul 19 22:49:02.883206 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2260/4560] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:01 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1511 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:49:02.894618 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-36191760-e278-4a92-a5d3-ffdcc4f97e19 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:02.895279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-36191760-e278-4a92-a5d3-ffdcc4f97e19 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] [instance: 0e8df505-6004-4176-b4ee-27414ef1a6e9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:02.910673 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36191760-e278-4a92-a5d3-ffdcc4f97e19 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:02.911155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36191760-e278-4a92-a5d3-ffdcc4f97e19 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:02.913182 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36191760-e278-4a92-a5d3-ffdcc4f97e19 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:02.913616 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36191760-e278-4a92-a5d3-ffdcc4f97e19 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:03.835427 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-36191760-e278-4a92-a5d3-ffdcc4f97e19 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58106973ce5e4662a447f203d8a35585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decfb15dcb6e48b98a8b0af680411661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:03.869940 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-36191760-e278-4a92-a5d3-ffdcc4f97e19 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9" status: 200 len: 1503 microversion: 2.1 time: 0.985634 Jul 19 22:49:03.871588 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2261/4561] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:02 2022] GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9 => generated 1503 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:03.892852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-000eb10e-1ad4-44ff-93b1-00048b1f0601 req-a3d99c57-b7d7-4808-b172-3f62d037db00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d53ca5c-aaa1-44f3-832d-7f2a9a56db39", "name": "network-vif-deleted", "tag": "504225f7-9cee-4c36-9a1d-bb80c366dfae"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:49:03.906629 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-000eb10e-1ad4-44ff-93b1-00048b1f0601 req-a3d99c57-b7d7-4808-b172-3f62d037db00 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:03.907489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-000eb10e-1ad4-44ff-93b1-00048b1f0601 req-a3d99c57-b7d7-4808-b172-3f62d037db00 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:03.963760 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-000eb10e-1ad4-44ff-93b1-00048b1f0601 req-a3d99c57-b7d7-4808-b172-3f62d037db00 service nova] Creating event network-vif-deleted:504225f7-9cee-4c36-9a1d-bb80c366dfae for instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 on n-h2-847009-3 Jul 19 22:49:03.978997 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-51d79e72-869a-4c7d-a7ee-6c28dfc9264c tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:49:03.981965 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-51d79e72-869a-4c7d-a7ee-6c28dfc9264c tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:49:03.983473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-51d79e72-869a-4c7d-a7ee-6c28dfc9264c tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:49:03.984592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-51d79e72-869a-4c7d-a7ee-6c28dfc9264c tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:49:03.985730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-51d79e72-869a-4c7d-a7ee-6c28dfc9264c tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:49:04.012462 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-000eb10e-1ad4-44ff-93b1-00048b1f0601 req-a3d99c57-b7d7-4808-b172-3f62d037db00 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106296 Jul 19 22:49:04.017199 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51d79e72-869a-4c7d-a7ee-6c28dfc9264c tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:04.017788 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51d79e72-869a-4c7d-a7ee-6c28dfc9264c tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:04.019464 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2262/4562] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:49:04.020236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51d79e72-869a-4c7d-a7ee-6c28dfc9264c tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:04.022326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51d79e72-869a-4c7d-a7ee-6c28dfc9264c tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:04.041231 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-de3d46a8-8db4-40b5-9679-1c5111f6e01e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:04.041962 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-de3d46a8-8db4-40b5-9679-1c5111f6e01e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:04.058397 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-51d79e72-869a-4c7d-a7ee-6c28dfc9264c tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Getting quotas for project 94ad9eb9badc4c3d9bab2543e1972b0a. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:49:04.067278 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-51d79e72-869a-4c7d-a7ee-6c28dfc9264c tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Getting quotas for user 823427b572044adaa2766653cd2e9e92 and project 94ad9eb9badc4c3d9bab2543e1972b0a. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:49:04.081789 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de3d46a8-8db4-40b5-9679-1c5111f6e01e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:04.082247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de3d46a8-8db4-40b5-9679-1c5111f6e01e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:04.083037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de3d46a8-8db4-40b5-9679-1c5111f6e01e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:04.083513 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de3d46a8-8db4-40b5-9679-1c5111f6e01e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:04.086223 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-51d79e72-869a-4c7d-a7ee-6c28dfc9264c tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:49:04.089110 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-51d79e72-869a-4c7d-a7ee-6c28dfc9264c tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] [instance: d770734f-85d5-4f04-9582-b0c2d46396c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:49:04.198210 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-51d79e72-869a-4c7d-a7ee-6c28dfc9264c tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.845603 Jul 19 22:49:04.207777 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2301/4563] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:49:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 22:49:04.216724 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-99a17e04-7b75-42fc-897e-d7cd9f9995fb tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:04.219049 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-99a17e04-7b75-42fc-897e-d7cd9f9995fb tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] [instance: 0e8df505-6004-4176-b4ee-27414ef1a6e9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:04.241790 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-99a17e04-7b75-42fc-897e-d7cd9f9995fb tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:04.242486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-99a17e04-7b75-42fc-897e-d7cd9f9995fb tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:04.245589 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-99a17e04-7b75-42fc-897e-d7cd9f9995fb tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:04.249417 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-99a17e04-7b75-42fc-897e-d7cd9f9995fb tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:04.447677 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-99a17e04-7b75-42fc-897e-d7cd9f9995fb tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.237745 Jul 19 22:49:04.450760 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2302/4564] 10.222.0.25 () {58 vars in 1295 bytes} [Tue Jul 19 22:49:04 2022] DELETE /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9/os-server-password => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:49:04.467082 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-24855a09-dfcc-4420-9ec5-88f6e984a04d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:04.468925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-24855a09-dfcc-4420-9ec5-88f6e984a04d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:04.488155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24855a09-dfcc-4420-9ec5-88f6e984a04d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:04.491070 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24855a09-dfcc-4420-9ec5-88f6e984a04d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:04.494036 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24855a09-dfcc-4420-9ec5-88f6e984a04d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:04.494837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24855a09-dfcc-4420-9ec5-88f6e984a04d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:04.836049 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-de3d46a8-8db4-40b5-9679-1c5111f6e01e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:04.877684 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-de3d46a8-8db4-40b5-9679-1c5111f6e01e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:04.882814 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-de3d46a8-8db4-40b5-9679-1c5111f6e01e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:04.887421 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-de3d46a8-8db4-40b5-9679-1c5111f6e01e tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 2167 microversion: 2.42 time: 0.866450 Jul 19 22:49:04.890282 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2263/4565] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:04 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 2167 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:49:04.898132 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-86f17000-69ec-4dd5-a612-46fd1acefa47 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:04.905579 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-86f17000-69ec-4dd5-a612-46fd1acefa47 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] [instance: d770734f-85d5-4f04-9582-b0c2d46396c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:05.043261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-24855a09-dfcc-4420-9ec5-88f6e984a04d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:05.064005 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-24855a09-dfcc-4420-9ec5-88f6e984a04d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1511 microversion: 2.1 time: 0.611288 Jul 19 22:49:05.066734 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-86f17000-69ec-4dd5-a612-46fd1acefa47 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823427b572044adaa2766653cd2e9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ad9eb9badc4c3d9bab2543e1972b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:05.074743 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2303/4566] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:04 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1511 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:05.075501 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-86f17000-69ec-4dd5-a612-46fd1acefa47 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] 10.222.0.25 "GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1" status: 200 len: 1227 microversion: 2.1 time: 0.183059 Jul 19 22:49:05.081158 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2264/4567] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:04 2022] GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1 => generated 1227 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:05.098907 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e922207c-a23e-4dfd-a7d6-1986bd0479c8 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:05.101595 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e922207c-a23e-4dfd-a7d6-1986bd0479c8 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] [instance: 0e8df505-6004-4176-b4ee-27414ef1a6e9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:05.112914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e922207c-a23e-4dfd-a7d6-1986bd0479c8 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:05.131082 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e922207c-a23e-4dfd-a7d6-1986bd0479c8 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:05.132976 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e922207c-a23e-4dfd-a7d6-1986bd0479c8 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:05.134476 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e922207c-a23e-4dfd-a7d6-1986bd0479c8 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:05.240840 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e922207c-a23e-4dfd-a7d6-1986bd0479c8 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.158722 Jul 19 22:49:05.241545 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2304/4568] 10.222.0.25 () {58 vars in 1292 bytes} [Tue Jul 19 22:49:05 2022] GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9/os-server-password => generated 16 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:49:05.255102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-214de141-d150-4bd0-a839-07b763a62ab1 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:05.256502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-214de141-d150-4bd0-a839-07b763a62ab1 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] [instance: 0e8df505-6004-4176-b4ee-27414ef1a6e9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:05.278493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-214de141-d150-4bd0-a839-07b763a62ab1 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:05.282339 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-214de141-d150-4bd0-a839-07b763a62ab1 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:05.284388 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-214de141-d150-4bd0-a839-07b763a62ab1 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:05.286220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-214de141-d150-4bd0-a839-07b763a62ab1 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:05.347223 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-214de141-d150-4bd0-a839-07b763a62ab1 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] [instance: 0e8df505-6004-4176-b4ee-27414ef1a6e9] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:49:05.434259 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:49:05.533909 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-214de141-d150-4bd0-a839-07b763a62ab1 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9" status: 204 len: 0 microversion: 2.1 time: 0.285437 Jul 19 22:49:05.535013 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2265/4569] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:49:05 2022] DELETE /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:49:05.543649 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bc05cc84-f388-44db-94ee-1900e398479d tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:05.544471 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bc05cc84-f388-44db-94ee-1900e398479d tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] [instance: 0e8df505-6004-4176-b4ee-27414ef1a6e9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:05.565511 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bc05cc84-f388-44db-94ee-1900e398479d tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:05.571761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bc05cc84-f388-44db-94ee-1900e398479d tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:05.571761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bc05cc84-f388-44db-94ee-1900e398479d tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:05.582773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bc05cc84-f388-44db-94ee-1900e398479d tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:05.910842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-73d2053b-9890-40cb-8c7d-515ff08c15e7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:05.911611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-73d2053b-9890-40cb-8c7d-515ff08c15e7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:05.932657 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-73d2053b-9890-40cb-8c7d-515ff08c15e7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:05.933383 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-73d2053b-9890-40cb-8c7d-515ff08c15e7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:05.934267 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-73d2053b-9890-40cb-8c7d-515ff08c15e7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:05.934723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-73d2053b-9890-40cb-8c7d-515ff08c15e7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:05.985993 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bc05cc84-f388-44db-94ee-1900e398479d tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58106973ce5e4662a447f203d8a35585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decfb15dcb6e48b98a8b0af680411661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:05.994194 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bc05cc84-f388-44db-94ee-1900e398479d tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9" status: 200 len: 1509 microversion: 2.1 time: 0.454856 Jul 19 22:49:05.994789 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2305/4570] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:05 2022] GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9 => generated 1509 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:06.019434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-21f6ee27-c565-492d-8bef-18c900345202 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:06.020366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-21f6ee27-c565-492d-8bef-18c900345202 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:06.026924 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-21f6ee27-c565-492d-8bef-18c900345202 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:06.027668 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-21f6ee27-c565-492d-8bef-18c900345202 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:06.028875 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-21f6ee27-c565-492d-8bef-18c900345202 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:06.029496 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-21f6ee27-c565-492d-8bef-18c900345202 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:06.103247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-73d2053b-9890-40cb-8c7d-515ff08c15e7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:06.114009 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-73d2053b-9890-40cb-8c7d-515ff08c15e7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:06.117005 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-73d2053b-9890-40cb-8c7d-515ff08c15e7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:06.118310 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-73d2053b-9890-40cb-8c7d-515ff08c15e7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1604 microversion: 2.42 time: 0.212639 Jul 19 22:49:06.119704 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2266/4571] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:05 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1604 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:49:06.126014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-d88b4990-999c-463f-9c0d-099ecebb882c req-abb488b3-3a08-43dd-bd23-b9ddc78cfe07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d53ca5c-aaa1-44f3-832d-7f2a9a56db39", "name": "network-vif-deleted", "tag": "98a30d5e-ad65-436d-96ad-23f81ba2c4be"}, {"server_uuid": "7d53ca5c-aaa1-44f3-832d-7f2a9a56db39", "name": "network-vif-deleted", "tag": "0a907ea9-840e-4a11-a8f9-aa989d95ed73"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:49:06.135686 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d88b4990-999c-463f-9c0d-099ecebb882c req-abb488b3-3a08-43dd-bd23-b9ddc78cfe07 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:06.136462 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d88b4990-999c-463f-9c0d-099ecebb882c req-abb488b3-3a08-43dd-bd23-b9ddc78cfe07 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:06.150875 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-d88b4990-999c-463f-9c0d-099ecebb882c req-abb488b3-3a08-43dd-bd23-b9ddc78cfe07 service nova] Creating event network-vif-deleted:98a30d5e-ad65-436d-96ad-23f81ba2c4be for instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 on n-h2-847009-3 Jul 19 22:49:06.151768 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-d88b4990-999c-463f-9c0d-099ecebb882c req-abb488b3-3a08-43dd-bd23-b9ddc78cfe07 service nova] Creating event network-vif-deleted:0a907ea9-840e-4a11-a8f9-aa989d95ed73 for instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 on n-h2-847009-3 Jul 19 22:49:06.158347 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-d88b4990-999c-463f-9c0d-099ecebb882c req-abb488b3-3a08-43dd-bd23-b9ddc78cfe07 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037081 Jul 19 22:49:06.163983 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2267/4572] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:49:06.170136 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9b47bec7-e7ea-44a0-9c52-166054934859 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:06.171741 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9b47bec7-e7ea-44a0-9c52-166054934859 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:06.180510 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b47bec7-e7ea-44a0-9c52-166054934859 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:06.181266 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b47bec7-e7ea-44a0-9c52-166054934859 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:06.182640 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b47bec7-e7ea-44a0-9c52-166054934859 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:06.183379 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b47bec7-e7ea-44a0-9c52-166054934859 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:06.229434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-21f6ee27-c565-492d-8bef-18c900345202 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lazy-loading 'services' on Instance uuid 02571222-3b10-4a0d-8b70-a8202c37f6a7 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:49:06.264669 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:49:06.408011 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-21f6ee27-c565-492d-8bef-18c900345202 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "DELETE /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments/b84e7a73-ea9c-473a-b09b-26aad15f7870" status: 202 len: 0 microversion: 2.1 time: 0.392457 Jul 19 22:49:06.408619 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2306/4573] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 19 22:49:06 2022] DELETE /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments/b84e7a73-ea9c-473a-b09b-26aad15f7870 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:49:06.418417 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-07989b81-a4fd-4f05-86b5-b9b7d4a8a960 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:06.434191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-07989b81-a4fd-4f05-86b5-b9b7d4a8a960 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] [instance: d770734f-85d5-4f04-9582-b0c2d46396c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:06.442224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07989b81-a4fd-4f05-86b5-b9b7d4a8a960 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:06.443172 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07989b81-a4fd-4f05-86b5-b9b7d4a8a960 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:06.444951 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07989b81-a4fd-4f05-86b5-b9b7d4a8a960 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:06.450708 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07989b81-a4fd-4f05-86b5-b9b7d4a8a960 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:06.519509 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9b47bec7-e7ea-44a0-9c52-166054934859 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:06.529443 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9b47bec7-e7ea-44a0-9c52-166054934859 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1511 microversion: 2.1 time: 0.363875 Jul 19 22:49:06.530849 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2268/4574] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:06 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1511 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:06.536430 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-653a12fd-8414-4a94-a0f1-8a3b7a2b22a7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:06.537855 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-653a12fd-8414-4a94-a0f1-8a3b7a2b22a7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:06.556203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-653a12fd-8414-4a94-a0f1-8a3b7a2b22a7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:06.557099 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-653a12fd-8414-4a94-a0f1-8a3b7a2b22a7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:06.558166 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-653a12fd-8414-4a94-a0f1-8a3b7a2b22a7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:06.559825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-653a12fd-8414-4a94-a0f1-8a3b7a2b22a7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:06.658958 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-07989b81-a4fd-4f05-86b5-b9b7d4a8a960 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823427b572044adaa2766653cd2e9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ad9eb9badc4c3d9bab2543e1972b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:06.670141 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-07989b81-a4fd-4f05-86b5-b9b7d4a8a960 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] 10.222.0.25 "GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1" status: 200 len: 1231 microversion: 2.1 time: 0.255962 Jul 19 22:49:06.679220 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2307/4575] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:06 2022] GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1 => generated 1231 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:06.685160 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-653a12fd-8414-4a94-a0f1-8a3b7a2b22a7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152671 Jul 19 22:49:06.685936 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2269/4576] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:49:06 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:49:07.016076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-07127b00-611f-4b33-8e41-c2ac52a89416 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:07.017706 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-07127b00-611f-4b33-8e41-c2ac52a89416 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] [instance: 0e8df505-6004-4176-b4ee-27414ef1a6e9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:07.041368 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:49:07.049769 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07127b00-611f-4b33-8e41-c2ac52a89416 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:07.050463 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07127b00-611f-4b33-8e41-c2ac52a89416 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:07.051453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07127b00-611f-4b33-8e41-c2ac52a89416 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:07.051981 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07127b00-611f-4b33-8e41-c2ac52a89416 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:07.138007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ff745a5a-7e28-4dad-9f01-d1394a342991 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:07.138730 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ff745a5a-7e28-4dad-9f01-d1394a342991 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:07.155398 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ff745a5a-7e28-4dad-9f01-d1394a342991 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:07.156109 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ff745a5a-7e28-4dad-9f01-d1394a342991 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:07.157006 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ff745a5a-7e28-4dad-9f01-d1394a342991 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:07.157487 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ff745a5a-7e28-4dad-9f01-d1394a342991 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:07.357460 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ff745a5a-7e28-4dad-9f01-d1394a342991 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:07.387330 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ff745a5a-7e28-4dad-9f01-d1394a342991 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:07.390655 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ff745a5a-7e28-4dad-9f01-d1394a342991 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:07.395038 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ff745a5a-7e28-4dad-9f01-d1394a342991 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1604 microversion: 2.42 time: 0.260984 Jul 19 22:49:07.397505 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2270/4577] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:07 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1604 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:49:07.453987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-07127b00-611f-4b33-8e41-c2ac52a89416 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58106973ce5e4662a447f203d8a35585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decfb15dcb6e48b98a8b0af680411661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:07.468925 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-07127b00-611f-4b33-8e41-c2ac52a89416 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9" status: 200 len: 1509 microversion: 2.1 time: 0.459384 Jul 19 22:49:07.470357 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2308/4578] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:07 2022] GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9 => generated 1509 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:07.547593 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d5ddb8dc-9258-4008-8b5d-7932207a84a3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:07.548230 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d5ddb8dc-9258-4008-8b5d-7932207a84a3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:07.567754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5ddb8dc-9258-4008-8b5d-7932207a84a3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:07.568116 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5ddb8dc-9258-4008-8b5d-7932207a84a3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:07.569396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5ddb8dc-9258-4008-8b5d-7932207a84a3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:07.569519 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5ddb8dc-9258-4008-8b5d-7932207a84a3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:07.700550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-478d40cc-ac47-4fc2-9598-2904b1557054 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:07.702137 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-478d40cc-ac47-4fc2-9598-2904b1557054 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] [instance: d770734f-85d5-4f04-9582-b0c2d46396c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:07.725828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-478d40cc-ac47-4fc2-9598-2904b1557054 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:07.727313 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-478d40cc-ac47-4fc2-9598-2904b1557054 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:07.732986 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-478d40cc-ac47-4fc2-9598-2904b1557054 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:07.734156 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-478d40cc-ac47-4fc2-9598-2904b1557054 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:07.991024 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-478d40cc-ac47-4fc2-9598-2904b1557054 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823427b572044adaa2766653cd2e9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ad9eb9badc4c3d9bab2543e1972b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:08.027938 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-478d40cc-ac47-4fc2-9598-2904b1557054 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] 10.222.0.25 "GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1" status: 200 len: 1279 microversion: 2.1 time: 0.334664 Jul 19 22:49:08.030863 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2309/4579] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:07 2022] GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1 => generated 1279 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:08.049353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5c07ef88-c3d9-4200-b9d6-4654e430dcd2 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:08.052322 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5c07ef88-c3d9-4200-b9d6-4654e430dcd2 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:08.068607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5c07ef88-c3d9-4200-b9d6-4654e430dcd2 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:08.069741 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5c07ef88-c3d9-4200-b9d6-4654e430dcd2 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:08.072518 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5c07ef88-c3d9-4200-b9d6-4654e430dcd2 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:08.073611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5c07ef88-c3d9-4200-b9d6-4654e430dcd2 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:08.135592 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5c07ef88-c3d9-4200-b9d6-4654e430dcd2 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099801 Jul 19 22:49:08.137051 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2310/4580] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:49:08 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:49:08.423019 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-433c530e-214f-4a48-b7b3-e2dd08a0e084 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:08.426160 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-433c530e-214f-4a48-b7b3-e2dd08a0e084 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:08.440166 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-433c530e-214f-4a48-b7b3-e2dd08a0e084 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:08.442882 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-433c530e-214f-4a48-b7b3-e2dd08a0e084 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:08.443844 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-433c530e-214f-4a48-b7b3-e2dd08a0e084 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:08.448194 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-433c530e-214f-4a48-b7b3-e2dd08a0e084 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:08.547600 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d5ddb8dc-9258-4008-8b5d-7932207a84a3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:08.557966 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d5ddb8dc-9258-4008-8b5d-7932207a84a3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1511 microversion: 2.1 time: 1.014433 Jul 19 22:49:08.571035 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2271/4581] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:07 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1511 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:08.576719 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8165fc63-2d70-4bcd-aeac-f9321e310b0e tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:08.578102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8165fc63-2d70-4bcd-aeac-f9321e310b0e tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] [instance: 0e8df505-6004-4176-b4ee-27414ef1a6e9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:08.586031 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8165fc63-2d70-4bcd-aeac-f9321e310b0e tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:08.586799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8165fc63-2d70-4bcd-aeac-f9321e310b0e tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:08.587811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8165fc63-2d70-4bcd-aeac-f9321e310b0e tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:08.588439 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8165fc63-2d70-4bcd-aeac-f9321e310b0e tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:08.602186 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-433c530e-214f-4a48-b7b3-e2dd08a0e084 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:08.617031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-433c530e-214f-4a48-b7b3-e2dd08a0e084 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:08.618550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-433c530e-214f-4a48-b7b3-e2dd08a0e084 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:08.619798 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-433c530e-214f-4a48-b7b3-e2dd08a0e084 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1604 microversion: 2.42 time: 0.205250 Jul 19 22:49:08.620595 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2311/4582] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:08 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1604 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:49:08.895754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8165fc63-2d70-4bcd-aeac-f9321e310b0e tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58106973ce5e4662a447f203d8a35585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decfb15dcb6e48b98a8b0af680411661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:08.943940 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8165fc63-2d70-4bcd-aeac-f9321e310b0e tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9" status: 200 len: 1509 microversion: 2.1 time: 0.371392 Jul 19 22:49:08.944558 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2272/4583] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:08 2022] GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9 => generated 1509 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:09.052962 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9f528db7-2479-4c53-b111-1bcd9cd8ab05 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:09.053933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9f528db7-2479-4c53-b111-1bcd9cd8ab05 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] [instance: d770734f-85d5-4f04-9582-b0c2d46396c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:09.064177 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9f528db7-2479-4c53-b111-1bcd9cd8ab05 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:09.065041 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9f528db7-2479-4c53-b111-1bcd9cd8ab05 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:09.066135 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9f528db7-2479-4c53-b111-1bcd9cd8ab05 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:09.066948 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9f528db7-2479-4c53-b111-1bcd9cd8ab05 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:09.147827 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b135ca67-c4c8-4a79-9413-99b6464d00c5 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:09.149388 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b135ca67-c4c8-4a79-9413-99b6464d00c5 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:09.156615 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b135ca67-c4c8-4a79-9413-99b6464d00c5 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:09.157527 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b135ca67-c4c8-4a79-9413-99b6464d00c5 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:09.158209 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b135ca67-c4c8-4a79-9413-99b6464d00c5 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:09.158876 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b135ca67-c4c8-4a79-9413-99b6464d00c5 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:09.190467 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9f528db7-2479-4c53-b111-1bcd9cd8ab05 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823427b572044adaa2766653cd2e9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ad9eb9badc4c3d9bab2543e1972b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:09.203652 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9f528db7-2479-4c53-b111-1bcd9cd8ab05 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] 10.222.0.25 "GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1" status: 200 len: 1285 microversion: 2.1 time: 0.152972 Jul 19 22:49:09.205922 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2312/4584] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:09 2022] GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1 => generated 1285 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:09.229144 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b135ca67-c4c8-4a79-9413-99b6464d00c5 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085232 Jul 19 22:49:09.230476 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2273/4585] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:49:09 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:49:09.252404 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-6424712e-72b0-4e18-bde3-1cb86c6780e9 req-8aa78d55-45e9-4df6-96d5-4a245960767b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8df505-6004-4176-b4ee-27414ef1a6e9", "name": "network-vif-deleted", "tag": "08115cfd-c038-46b8-ad6f-fd85d0bafc6e"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:49:09.293421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-6424712e-72b0-4e18-bde3-1cb86c6780e9 req-8aa78d55-45e9-4df6-96d5-4a245960767b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:09.294531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-6424712e-72b0-4e18-bde3-1cb86c6780e9 req-8aa78d55-45e9-4df6-96d5-4a245960767b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:09.318361 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-6424712e-72b0-4e18-bde3-1cb86c6780e9 req-8aa78d55-45e9-4df6-96d5-4a245960767b service nova] Creating event network-vif-deleted:08115cfd-c038-46b8-ad6f-fd85d0bafc6e for instance 0e8df505-6004-4176-b4ee-27414ef1a6e9 on n-h1-847009-3 Jul 19 22:49:09.332861 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-6424712e-72b0-4e18-bde3-1cb86c6780e9 req-8aa78d55-45e9-4df6-96d5-4a245960767b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087121 Jul 19 22:49:09.334845 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2313/4586] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:49:09.578439 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8f37291e-20b9-4fb9-b63a-f884c9096cec tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:09.579380 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8f37291e-20b9-4fb9-b63a-f884c9096cec tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:09.590009 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f37291e-20b9-4fb9-b63a-f884c9096cec tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:09.593135 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f37291e-20b9-4fb9-b63a-f884c9096cec tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:09.594042 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f37291e-20b9-4fb9-b63a-f884c9096cec tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:09.597800 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f37291e-20b9-4fb9-b63a-f884c9096cec tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:09.639520 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-636b975a-e446-4c94-adfe-0b89e04154f6 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:09.640740 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-636b975a-e446-4c94-adfe-0b89e04154f6 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:09.648465 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-636b975a-e446-4c94-adfe-0b89e04154f6 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:09.649028 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-636b975a-e446-4c94-adfe-0b89e04154f6 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:09.649994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-636b975a-e446-4c94-adfe-0b89e04154f6 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:09.650538 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-636b975a-e446-4c94-adfe-0b89e04154f6 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:09.789146 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-636b975a-e446-4c94-adfe-0b89e04154f6 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:09.807081 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-636b975a-e446-4c94-adfe-0b89e04154f6 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:09.808777 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-636b975a-e446-4c94-adfe-0b89e04154f6 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:09.811508 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-636b975a-e446-4c94-adfe-0b89e04154f6 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1604 microversion: 2.42 time: 0.176148 Jul 19 22:49:09.824001 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2314/4587] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:09 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1604 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:49:09.922248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8f37291e-20b9-4fb9-b63a-f884c9096cec tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:09.941495 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8f37291e-20b9-4fb9-b63a-f884c9096cec tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1511 microversion: 2.1 time: 0.367577 Jul 19 22:49:09.962202 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2274/4588] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:09 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1511 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:09.968904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1ed983fe-9a67-4471-b2e0-89516d2991a4 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:09.969564 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1ed983fe-9a67-4471-b2e0-89516d2991a4 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] [instance: 0e8df505-6004-4176-b4ee-27414ef1a6e9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:09.993652 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1ed983fe-9a67-4471-b2e0-89516d2991a4 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:09.998988 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1ed983fe-9a67-4471-b2e0-89516d2991a4 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:10.001001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1ed983fe-9a67-4471-b2e0-89516d2991a4 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:10.001677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1ed983fe-9a67-4471-b2e0-89516d2991a4 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:10.070622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1ed983fe-9a67-4471-b2e0-89516d2991a4 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:10.071419 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1ed983fe-9a67-4471-b2e0-89516d2991a4 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:10.072440 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-1ed983fe-9a67-4471-b2e0-89516d2991a4 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lazy-loading 'fault' on Instance uuid 0e8df505-6004-4176-b4ee-27414ef1a6e9 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:49:10.152529 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1ed983fe-9a67-4471-b2e0-89516d2991a4 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58106973ce5e4662a447f203d8a35585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decfb15dcb6e48b98a8b0af680411661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:10.162849 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1ed983fe-9a67-4471-b2e0-89516d2991a4 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9" status: 200 len: 1306 microversion: 2.1 time: 0.204874 Jul 19 22:49:10.164761 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2315/4589] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:09 2022] GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9 => generated 1306 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:10.222578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a9bfee4d-fe15-48e0-929f-a72e25084277 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:10.223484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a9bfee4d-fe15-48e0-929f-a72e25084277 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] [instance: d770734f-85d5-4f04-9582-b0c2d46396c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:10.235956 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9bfee4d-fe15-48e0-929f-a72e25084277 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:10.236630 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9bfee4d-fe15-48e0-929f-a72e25084277 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:10.243242 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1ba92466-462c-4eef-9a52-2d31a93e8d27 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:10.244218 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1ba92466-462c-4eef-9a52-2d31a93e8d27 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:10.248741 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9bfee4d-fe15-48e0-929f-a72e25084277 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:10.249318 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9bfee4d-fe15-48e0-929f-a72e25084277 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:10.269038 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1ba92466-462c-4eef-9a52-2d31a93e8d27 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:10.271918 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1ba92466-462c-4eef-9a52-2d31a93e8d27 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:10.272746 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1ba92466-462c-4eef-9a52-2d31a93e8d27 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:10.273379 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1ba92466-462c-4eef-9a52-2d31a93e8d27 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:10.358968 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1ba92466-462c-4eef-9a52-2d31a93e8d27 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116207 Jul 19 22:49:10.363938 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2316/4590] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:49:10 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:49:10.495461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a9bfee4d-fe15-48e0-929f-a72e25084277 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823427b572044adaa2766653cd2e9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ad9eb9badc4c3d9bab2543e1972b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:10.506010 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a9bfee4d-fe15-48e0-929f-a72e25084277 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] 10.222.0.25 "GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1" status: 200 len: 1327 microversion: 2.1 time: 0.287511 Jul 19 22:49:10.512354 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2275/4591] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:10 2022] GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1 => generated 1327 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:10.830178 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-16640368-e306-43aa-bcf8-a960ad25adbe tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:10.830771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-16640368-e306-43aa-bcf8-a960ad25adbe tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:10.847019 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16640368-e306-43aa-bcf8-a960ad25adbe tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:10.847504 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16640368-e306-43aa-bcf8-a960ad25adbe tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:10.848590 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16640368-e306-43aa-bcf8-a960ad25adbe tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:10.849182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16640368-e306-43aa-bcf8-a960ad25adbe tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:10.960135 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9d7c016e-6f73-4630-b78b-7d01d72f4bee tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:10.961744 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9d7c016e-6f73-4630-b78b-7d01d72f4bee tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:10.967241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:49:10.975477 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d7c016e-6f73-4630-b78b-7d01d72f4bee tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:10.979615 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d7c016e-6f73-4630-b78b-7d01d72f4bee tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:10.980700 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d7c016e-6f73-4630-b78b-7d01d72f4bee tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:10.982189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d7c016e-6f73-4630-b78b-7d01d72f4bee tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:11.047539 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-16640368-e306-43aa-bcf8-a960ad25adbe tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:11.069276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-16640368-e306-43aa-bcf8-a960ad25adbe tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:11.077341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-16640368-e306-43aa-bcf8-a960ad25adbe tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:11.078872 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-16640368-e306-43aa-bcf8-a960ad25adbe tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1604 microversion: 2.42 time: 0.252961 Jul 19 22:49:11.080664 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2317/4592] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:10 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1604 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:49:11.181165 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6f75640b-157b-4d07-8d54-385537ec7230 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:11.181714 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6f75640b-157b-4d07-8d54-385537ec7230 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] [instance: 0e8df505-6004-4176-b4ee-27414ef1a6e9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:11.197310 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f75640b-157b-4d07-8d54-385537ec7230 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:11.197786 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f75640b-157b-4d07-8d54-385537ec7230 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:11.198617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f75640b-157b-4d07-8d54-385537ec7230 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:11.199038 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f75640b-157b-4d07-8d54-385537ec7230 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:11.228142 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-6f75640b-157b-4d07-8d54-385537ec7230 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] HTTP exception thrown: Instance 0e8df505-6004-4176-b4ee-27414ef1a6e9 could not be found. Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6f75640b-157b-4d07-8d54-385537ec7230 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Request method failure captured: Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9 HTTP/1.1 Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zTEns3BZoBlPP4in9O_JCNj4a_NQ_IeyLz_SIjNoqeTPSazoSjrL5gQf6lUAEmU3PuZHsA9f6RnEdyNN0VOh7-hSfpKMJYZBEjQOCaxPX-hCmz4YZjvD2XFRFoZfTB4meuKsbPu-6sxdG4aWdyFipwDYOQiBALzvJ0hPYia_VWfR9c Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: decfb15dcb6e48b98a8b0af680411661 Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerPasswordTestJSON-1556450133 Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_decfb15dcb6e48b98a8b0af680411661"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/decfb15dcb6e48b98a8b0af680411661"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/decfb15dcb6e48b98a8b0af680411661"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/decfb15dcb6e48b98a8b0af680411661"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerPasswordTestJSON-1556450133 Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: decfb15dcb6e48b98a8b0af680411661 Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1556450133 Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerPasswordTestJSON-1556450133-project Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 58106973ce5e4662a447f203d8a35585 Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerPasswordTestJSON-1556450133-project Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 0e8df505-6004-4176-b4ee-27414ef1a6e9 could not be found. Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '0e8df505-6004-4176-b4ee-27414ef1a6e9'} Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e8df505-6004-4176-b4ee-27414ef1a6e9 could not be found. Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e8df505-6004-4176-b4ee-27414ef1a6e9 could not be found. Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:49:11.229893 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:11.234152 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:11.234152 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:49:11.234152 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:49:11.234152 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:49:11.234152 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:49:11.234152 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e8df505-6004-4176-b4ee-27414ef1a6e9 could not be found. Jul 19 22:49:11.234152 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:11.234152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6f75640b-157b-4d07-8d54-385537ec7230 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] Returning 404 to user: Instance 0e8df505-6004-4176-b4ee-27414ef1a6e9 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:49:11.236687 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6f75640b-157b-4d07-8d54-385537ec7230 tempest-ServerPasswordTestJSON-1556450133 tempest-ServerPasswordTestJSON-1556450133-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9" status: 404 len: 111 microversion: 2.1 time: 0.059090 Jul 19 22:49:11.251489 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2318/4593] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:11 2022] GET /compute/v2.1/servers/0e8df505-6004-4176-b4ee-27414ef1a6e9 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:49:11.341563 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9d7c016e-6f73-4630-b78b-7d01d72f4bee tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:11.354509 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9d7c016e-6f73-4630-b78b-7d01d72f4bee tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1511 microversion: 2.1 time: 0.399626 Jul 19 22:49:11.365078 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-c7389f6d-b465-415a-9ab4-a780c88441a2 req-e1d30ad5-c0ec-466a-a7db-2b6826f663b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d770734f-85d5-4f04-9582-b0c2d46396c1", "tag": "ebc2e9fa-1332-4587-be5b-43685e09f75a"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:49:11.372204 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2276/4594] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:10 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1511 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:49:11.380035 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4585afc1-5a83-4889-9125-0541530a2de7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:11.381124 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c7389f6d-b465-415a-9ab4-a780c88441a2 req-e1d30ad5-c0ec-466a-a7db-2b6826f663b4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:11.381584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c7389f6d-b465-415a-9ab4-a780c88441a2 req-e1d30ad5-c0ec-466a-a7db-2b6826f663b4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:11.381955 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4585afc1-5a83-4889-9125-0541530a2de7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:11.390396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4585afc1-5a83-4889-9125-0541530a2de7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:11.391834 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4585afc1-5a83-4889-9125-0541530a2de7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:11.392853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4585afc1-5a83-4889-9125-0541530a2de7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:11.393507 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4585afc1-5a83-4889-9125-0541530a2de7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:11.420501 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-c7389f6d-b465-415a-9ab4-a780c88441a2 req-e1d30ad5-c0ec-466a-a7db-2b6826f663b4 service nova] Creating event network-changed:ebc2e9fa-1332-4587-be5b-43685e09f75a for instance d770734f-85d5-4f04-9582-b0c2d46396c1 on n-h1-847009-3 Jul 19 22:49:11.426928 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-c7389f6d-b465-415a-9ab4-a780c88441a2 req-e1d30ad5-c0ec-466a-a7db-2b6826f663b4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073849 Jul 19 22:49:11.427579 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2319/4595] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:49:11.457003 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4585afc1-5a83-4889-9125-0541530a2de7 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082768 Jul 19 22:49:11.461791 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2277/4596] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:49:11 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:49:11.525179 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-892df5f4-2a44-43f0-9cff-061fbe8f5685 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:11.526119 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-892df5f4-2a44-43f0-9cff-061fbe8f5685 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] [instance: d770734f-85d5-4f04-9582-b0c2d46396c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:11.533416 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-892df5f4-2a44-43f0-9cff-061fbe8f5685 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:11.533887 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-892df5f4-2a44-43f0-9cff-061fbe8f5685 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:11.534747 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-892df5f4-2a44-43f0-9cff-061fbe8f5685 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:11.544989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-892df5f4-2a44-43f0-9cff-061fbe8f5685 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:11.894184 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-892df5f4-2a44-43f0-9cff-061fbe8f5685 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823427b572044adaa2766653cd2e9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ad9eb9badc4c3d9bab2543e1972b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:11.906464 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-892df5f4-2a44-43f0-9cff-061fbe8f5685 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] 10.222.0.25 "GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1" status: 200 len: 1327 microversion: 2.1 time: 0.385795 Jul 19 22:49:11.921602 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2320/4597] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:11 2022] GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1 => generated 1327 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:12.100046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-90285503-80e8-436b-bd7a-7177d1b83cf1 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:12.101088 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-90285503-80e8-436b-bd7a-7177d1b83cf1 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:12.108966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-90285503-80e8-436b-bd7a-7177d1b83cf1 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:12.109525 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-90285503-80e8-436b-bd7a-7177d1b83cf1 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:12.110822 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-90285503-80e8-436b-bd7a-7177d1b83cf1 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:12.111539 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-90285503-80e8-436b-bd7a-7177d1b83cf1 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:12.220942 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-90285503-80e8-436b-bd7a-7177d1b83cf1 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:12.237914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-90285503-80e8-436b-bd7a-7177d1b83cf1 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:12.243294 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-90285503-80e8-436b-bd7a-7177d1b83cf1 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:12.247379 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-90285503-80e8-436b-bd7a-7177d1b83cf1 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1604 microversion: 2.42 time: 0.152667 Jul 19 22:49:12.249036 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2278/4598] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:12 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1604 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:49:12.375038 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-357ff4ef-7b31-4e48-8c86-5973e559398b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:12.375505 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-357ff4ef-7b31-4e48-8c86-5973e559398b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:12.404093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-357ff4ef-7b31-4e48-8c86-5973e559398b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:12.405327 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-357ff4ef-7b31-4e48-8c86-5973e559398b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:12.408084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-357ff4ef-7b31-4e48-8c86-5973e559398b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:12.408716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-357ff4ef-7b31-4e48-8c86-5973e559398b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:12.469939 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ab105a66-54e5-4553-9262-fc0b53f7c529 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:12.471359 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ab105a66-54e5-4553-9262-fc0b53f7c529 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:12.495852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab105a66-54e5-4553-9262-fc0b53f7c529 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:12.496301 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab105a66-54e5-4553-9262-fc0b53f7c529 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:12.497089 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab105a66-54e5-4553-9262-fc0b53f7c529 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:12.497526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab105a66-54e5-4553-9262-fc0b53f7c529 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:12.565561 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ab105a66-54e5-4553-9262-fc0b53f7c529 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100587 Jul 19 22:49:12.577325 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2279/4599] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:49:12 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:49:12.628032 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-357ff4ef-7b31-4e48-8c86-5973e559398b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:12.638693 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-357ff4ef-7b31-4e48-8c86-5973e559398b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1511 microversion: 2.1 time: 0.270231 Jul 19 22:49:12.641464 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2321/4600] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:12 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1511 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:12.926540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eef99776-0bad-4add-a3cb-98e48e39df9f tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:12.927191 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eef99776-0bad-4add-a3cb-98e48e39df9f tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] [instance: d770734f-85d5-4f04-9582-b0c2d46396c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:12.937698 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eef99776-0bad-4add-a3cb-98e48e39df9f tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:12.938156 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eef99776-0bad-4add-a3cb-98e48e39df9f tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:12.941782 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eef99776-0bad-4add-a3cb-98e48e39df9f tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:12.948107 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eef99776-0bad-4add-a3cb-98e48e39df9f tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:13.225046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-eef99776-0bad-4add-a3cb-98e48e39df9f tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823427b572044adaa2766653cd2e9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ad9eb9badc4c3d9bab2543e1972b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:13.239046 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eef99776-0bad-4add-a3cb-98e48e39df9f tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] 10.222.0.25 "GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1" status: 200 len: 1327 microversion: 2.1 time: 0.316287 Jul 19 22:49:13.242798 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2280/4601] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:12 2022] GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1 => generated 1327 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:13.267937 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ad29c526-b32b-4e3a-9b63-8cb6520af1b5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:13.268758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ad29c526-b32b-4e3a-9b63-8cb6520af1b5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:13.276062 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad29c526-b32b-4e3a-9b63-8cb6520af1b5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:13.280217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad29c526-b32b-4e3a-9b63-8cb6520af1b5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:13.283675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad29c526-b32b-4e3a-9b63-8cb6520af1b5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:13.284221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad29c526-b32b-4e3a-9b63-8cb6520af1b5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:13.394363 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ad29c526-b32b-4e3a-9b63-8cb6520af1b5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:13.407934 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ad29c526-b32b-4e3a-9b63-8cb6520af1b5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:13.414428 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ad29c526-b32b-4e3a-9b63-8cb6520af1b5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:13.419537 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ad29c526-b32b-4e3a-9b63-8cb6520af1b5 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1604 microversion: 2.42 time: 0.156015 Jul 19 22:49:13.422400 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2322/4602] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:13 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1604 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:49:13.588025 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ecf618de-44c8-4b9a-a0de-f0a7c4c2644a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:13.589488 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ecf618de-44c8-4b9a-a0de-f0a7c4c2644a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:13.600580 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ecf618de-44c8-4b9a-a0de-f0a7c4c2644a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:13.603858 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ecf618de-44c8-4b9a-a0de-f0a7c4c2644a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:13.604876 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ecf618de-44c8-4b9a-a0de-f0a7c4c2644a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:13.605889 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ecf618de-44c8-4b9a-a0de-f0a7c4c2644a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:13.657770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2a0b8a0f-7222-46b0-84e5-2e257ac75264 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:13.658452 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2a0b8a0f-7222-46b0-84e5-2e257ac75264 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:13.672256 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2a0b8a0f-7222-46b0-84e5-2e257ac75264 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:13.673003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2a0b8a0f-7222-46b0-84e5-2e257ac75264 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:13.673885 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2a0b8a0f-7222-46b0-84e5-2e257ac75264 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:13.675016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2a0b8a0f-7222-46b0-84e5-2e257ac75264 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:13.679707 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ecf618de-44c8-4b9a-a0de-f0a7c4c2644a tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095888 Jul 19 22:49:13.681737 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2281/4603] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:49:13 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:49:14.041891 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:49:14.077627 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:49:14.234434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2a0b8a0f-7222-46b0-84e5-2e257ac75264 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:14.243698 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2a0b8a0f-7222-46b0-84e5-2e257ac75264 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1511 microversion: 2.1 time: 0.590468 Jul 19 22:49:14.244170 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2323/4604] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:13 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1511 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:49:14.260494 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-844244af-0fa3-4fde-992a-c55667dfed6c tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:14.261123 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-844244af-0fa3-4fde-992a-c55667dfed6c tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] [instance: d770734f-85d5-4f04-9582-b0c2d46396c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:14.275301 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-844244af-0fa3-4fde-992a-c55667dfed6c tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:14.277902 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-844244af-0fa3-4fde-992a-c55667dfed6c tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:14.278981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-844244af-0fa3-4fde-992a-c55667dfed6c tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:14.281651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-844244af-0fa3-4fde-992a-c55667dfed6c tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:14.289976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:49:14.441393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-85dba8c7-263f-4655-a7ad-df0a5ed9131c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:14.442012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-85dba8c7-263f-4655-a7ad-df0a5ed9131c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:14.463937 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85dba8c7-263f-4655-a7ad-df0a5ed9131c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:14.464414 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85dba8c7-263f-4655-a7ad-df0a5ed9131c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:14.465374 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85dba8c7-263f-4655-a7ad-df0a5ed9131c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:14.465830 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85dba8c7-263f-4655-a7ad-df0a5ed9131c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:14.628044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-85dba8c7-263f-4655-a7ad-df0a5ed9131c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:14.631345 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:49:14.667758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-85dba8c7-263f-4655-a7ad-df0a5ed9131c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:14.672388 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-85dba8c7-263f-4655-a7ad-df0a5ed9131c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:14.677522 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-85dba8c7-263f-4655-a7ad-df0a5ed9131c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1604 microversion: 2.42 time: 0.240381 Jul 19 22:49:14.678277 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2324/4605] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:14 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1604 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:49:14.688310 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-844244af-0fa3-4fde-992a-c55667dfed6c tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823427b572044adaa2766653cd2e9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ad9eb9badc4c3d9bab2543e1972b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:14.693384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e7361db0-00d9-44ef-a46e-1234f7353b81 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:14.695499 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e7361db0-00d9-44ef-a46e-1234f7353b81 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:14.700785 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-844244af-0fa3-4fde-992a-c55667dfed6c tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] 10.222.0.25 "GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1" status: 200 len: 1327 microversion: 2.1 time: 0.444280 Jul 19 22:49:14.701905 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2282/4606] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:14 2022] GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1 => generated 1327 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:14.713391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e7361db0-00d9-44ef-a46e-1234f7353b81 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:14.714329 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e7361db0-00d9-44ef-a46e-1234f7353b81 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:14.715658 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e7361db0-00d9-44ef-a46e-1234f7353b81 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:14.716213 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e7361db0-00d9-44ef-a46e-1234f7353b81 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:14.801502 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e7361db0-00d9-44ef-a46e-1234f7353b81 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112663 Jul 19 22:49:14.807318 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2325/4607] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:49:14 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:49:15.264749 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9b32da40-4f48-4652-a256-3bccc0dafd50 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:15.266055 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9b32da40-4f48-4652-a256-3bccc0dafd50 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:15.280660 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:49:15.287380 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b32da40-4f48-4652-a256-3bccc0dafd50 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:15.287843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b32da40-4f48-4652-a256-3bccc0dafd50 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:15.297634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b32da40-4f48-4652-a256-3bccc0dafd50 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:15.298313 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b32da40-4f48-4652-a256-3bccc0dafd50 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:15.698810 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-43662b41-0b3e-49fd-81d0-efa422f0b417 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:15.699467 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-43662b41-0b3e-49fd-81d0-efa422f0b417 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:15.715971 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43662b41-0b3e-49fd-81d0-efa422f0b417 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:15.717062 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43662b41-0b3e-49fd-81d0-efa422f0b417 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:15.718650 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43662b41-0b3e-49fd-81d0-efa422f0b417 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:15.720816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43662b41-0b3e-49fd-81d0-efa422f0b417 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:15.780429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9b32da40-4f48-4652-a256-3bccc0dafd50 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:15.801307 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9b32da40-4f48-4652-a256-3bccc0dafd50 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1511 microversion: 2.1 time: 0.543193 Jul 19 22:49:15.801943 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2283/4608] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:15 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1511 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:15.806801 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2f2dd960-9844-4257-9790-08d295387741 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:15.807464 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2f2dd960-9844-4257-9790-08d295387741 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] [instance: d770734f-85d5-4f04-9582-b0c2d46396c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:15.828023 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2f2dd960-9844-4257-9790-08d295387741 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:15.828477 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2f2dd960-9844-4257-9790-08d295387741 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:15.829796 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2f2dd960-9844-4257-9790-08d295387741 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:15.830409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2f2dd960-9844-4257-9790-08d295387741 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:15.856411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-43662b41-0b3e-49fd-81d0-efa422f0b417 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:15.875616 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-43662b41-0b3e-49fd-81d0-efa422f0b417 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:15.877767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-43662b41-0b3e-49fd-81d0-efa422f0b417 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:15.879268 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-43662b41-0b3e-49fd-81d0-efa422f0b417 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1604 microversion: 2.42 time: 0.185224 Jul 19 22:49:15.891472 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2326/4609] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:15 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1604 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:49:15.897206 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dbcc8344-7cf6-45ec-8841-59d9ffc494a9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:15.898156 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dbcc8344-7cf6-45ec-8841-59d9ffc494a9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:15.923377 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dbcc8344-7cf6-45ec-8841-59d9ffc494a9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:15.927590 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dbcc8344-7cf6-45ec-8841-59d9ffc494a9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:15.928447 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dbcc8344-7cf6-45ec-8841-59d9ffc494a9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:15.930207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dbcc8344-7cf6-45ec-8841-59d9ffc494a9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:16.006332 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dbcc8344-7cf6-45ec-8841-59d9ffc494a9 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113674 Jul 19 22:49:16.026222 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2327/4610] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:49:15 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:49:16.211739 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2f2dd960-9844-4257-9790-08d295387741 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823427b572044adaa2766653cd2e9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ad9eb9badc4c3d9bab2543e1972b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:16.225228 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2f2dd960-9844-4257-9790-08d295387741 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] 10.222.0.25 "GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1" status: 200 len: 1327 microversion: 2.1 time: 0.421690 Jul 19 22:49:16.237520 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2284/4611] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:15 2022] GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1 => generated 1327 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:16.821530 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-31e6e625-3b95-469b-b5c6-9623eca36bab tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:16.823648 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-31e6e625-3b95-469b-b5c6-9623eca36bab tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:16.834480 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31e6e625-3b95-469b-b5c6-9623eca36bab tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:16.836558 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31e6e625-3b95-469b-b5c6-9623eca36bab tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:16.837839 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31e6e625-3b95-469b-b5c6-9623eca36bab tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:16.838731 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31e6e625-3b95-469b-b5c6-9623eca36bab tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:16.902613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e664f1e5-3737-4bb5-8e31-3a4555ba3aa7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:16.905998 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e664f1e5-3737-4bb5-8e31-3a4555ba3aa7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:16.966276 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e664f1e5-3737-4bb5-8e31-3a4555ba3aa7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:16.970483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e664f1e5-3737-4bb5-8e31-3a4555ba3aa7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:16.973636 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e664f1e5-3737-4bb5-8e31-3a4555ba3aa7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:16.976862 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e664f1e5-3737-4bb5-8e31-3a4555ba3aa7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:17.181598 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-31e6e625-3b95-469b-b5c6-9623eca36bab tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:17.190998 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-31e6e625-3b95-469b-b5c6-9623eca36bab tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1532 microversion: 2.1 time: 0.375987 Jul 19 22:49:17.196586 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2328/4612] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:16 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1532 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:17.200775 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e664f1e5-3737-4bb5-8e31-3a4555ba3aa7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:17.210917 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9fc9c24f-fa7e-49fe-b7e4-aee67ea13818 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:17.214559 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9fc9c24f-fa7e-49fe-b7e4-aee67ea13818 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:17.229847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9fc9c24f-fa7e-49fe-b7e4-aee67ea13818 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:17.230563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9fc9c24f-fa7e-49fe-b7e4-aee67ea13818 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:17.231280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e664f1e5-3737-4bb5-8e31-3a4555ba3aa7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:17.233046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e664f1e5-3737-4bb5-8e31-3a4555ba3aa7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:17.234748 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e664f1e5-3737-4bb5-8e31-3a4555ba3aa7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1604 microversion: 2.42 time: 0.340094 Jul 19 22:49:17.236940 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9fc9c24f-fa7e-49fe-b7e4-aee67ea13818 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:17.239565 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9fc9c24f-fa7e-49fe-b7e4-aee67ea13818 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:17.246712 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2285/4613] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:16 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1604 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:49:17.252604 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0e947350-019e-41d4-b7bd-0bfa27f41c73 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:17.253577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0e947350-019e-41d4-b7bd-0bfa27f41c73 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] [instance: d770734f-85d5-4f04-9582-b0c2d46396c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:17.260896 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0e947350-019e-41d4-b7bd-0bfa27f41c73 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:17.261615 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0e947350-019e-41d4-b7bd-0bfa27f41c73 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:17.262753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0e947350-019e-41d4-b7bd-0bfa27f41c73 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:17.263862 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0e947350-019e-41d4-b7bd-0bfa27f41c73 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:17.325354 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9fc9c24f-fa7e-49fe-b7e4-aee67ea13818 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127221 Jul 19 22:49:17.332373 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2329/4614] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:49:17 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:49:17.443874 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0e947350-019e-41d4-b7bd-0bfa27f41c73 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823427b572044adaa2766653cd2e9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ad9eb9badc4c3d9bab2543e1972b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:17.458109 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0e947350-019e-41d4-b7bd-0bfa27f41c73 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] 10.222.0.25 "GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1" status: 200 len: 1327 microversion: 2.1 time: 0.209812 Jul 19 22:49:17.458958 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2286/4615] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:17 2022] GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1 => generated 1327 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:18.115879 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-5ad4f405-c752-470a-9f29-9bd0d6ab6fb1 req-a3b48cb1-7eaf-4787-8d40-be7c621ce9e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d770734f-85d5-4f04-9582-b0c2d46396c1", "name": "network-vif-plugged", "status": "completed", "tag": "ebc2e9fa-1332-4587-be5b-43685e09f75a"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:49:18.130354 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5ad4f405-c752-470a-9f29-9bd0d6ab6fb1 req-a3b48cb1-7eaf-4787-8d40-be7c621ce9e4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:18.135782 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5ad4f405-c752-470a-9f29-9bd0d6ab6fb1 req-a3b48cb1-7eaf-4787-8d40-be7c621ce9e4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:18.159285 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-5ad4f405-c752-470a-9f29-9bd0d6ab6fb1 req-a3b48cb1-7eaf-4787-8d40-be7c621ce9e4 service nova] Creating event network-vif-plugged:ebc2e9fa-1332-4587-be5b-43685e09f75a for instance d770734f-85d5-4f04-9582-b0c2d46396c1 on n-h1-847009-3 Jul 19 22:49:18.176935 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-5ad4f405-c752-470a-9f29-9bd0d6ab6fb1 req-a3b48cb1-7eaf-4787-8d40-be7c621ce9e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064987 Jul 19 22:49:18.178600 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2330/4616] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:49:18.211807 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-76fe8bfa-5ceb-44ec-955a-137077254d4b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:18.213187 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-76fe8bfa-5ceb-44ec-955a-137077254d4b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:18.244865 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-76fe8bfa-5ceb-44ec-955a-137077254d4b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:18.246757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-76fe8bfa-5ceb-44ec-955a-137077254d4b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:18.252083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-76fe8bfa-5ceb-44ec-955a-137077254d4b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:18.252968 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-76fe8bfa-5ceb-44ec-955a-137077254d4b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:18.256432 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7222d865-a541-4766-84a8-7c441330a68a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:18.257470 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7222d865-a541-4766-84a8-7c441330a68a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:18.268647 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7222d865-a541-4766-84a8-7c441330a68a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:18.269580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7222d865-a541-4766-84a8-7c441330a68a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:18.270624 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7222d865-a541-4766-84a8-7c441330a68a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:18.271444 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7222d865-a541-4766-84a8-7c441330a68a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:18.452574 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7222d865-a541-4766-84a8-7c441330a68a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:18.465317 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7222d865-a541-4766-84a8-7c441330a68a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:18.470359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7222d865-a541-4766-84a8-7c441330a68a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:18.477481 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7222d865-a541-4766-84a8-7c441330a68a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1604 microversion: 2.42 time: 0.225499 Jul 19 22:49:18.478333 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2331/4617] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:18 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1604 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:49:18.489219 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d7e3d1f6-c51c-49b1-9986-7c33580529cd tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:18.492352 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d7e3d1f6-c51c-49b1-9986-7c33580529cd tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:18.510778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7e3d1f6-c51c-49b1-9986-7c33580529cd tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:18.511525 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7e3d1f6-c51c-49b1-9986-7c33580529cd tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:18.512692 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7e3d1f6-c51c-49b1-9986-7c33580529cd tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:18.517725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7e3d1f6-c51c-49b1-9986-7c33580529cd tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:18.582687 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d7e3d1f6-c51c-49b1-9986-7c33580529cd tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103043 Jul 19 22:49:18.594199 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2332/4618] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:49:18 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:49:18.602416 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a59e24e7-dcda-4de0-8eac-bcacf57f26a9 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:18.603455 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a59e24e7-dcda-4de0-8eac-bcacf57f26a9 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] [instance: d770734f-85d5-4f04-9582-b0c2d46396c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:18.614793 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a59e24e7-dcda-4de0-8eac-bcacf57f26a9 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:18.615523 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a59e24e7-dcda-4de0-8eac-bcacf57f26a9 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:18.616342 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a59e24e7-dcda-4de0-8eac-bcacf57f26a9 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:18.616804 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a59e24e7-dcda-4de0-8eac-bcacf57f26a9 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:18.775729 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-76fe8bfa-5ceb-44ec-955a-137077254d4b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:18.786683 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-76fe8bfa-5ceb-44ec-955a-137077254d4b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1527 microversion: 2.1 time: 0.579334 Jul 19 22:49:18.787300 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2287/4619] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:18 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1527 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:18.831016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a59e24e7-dcda-4de0-8eac-bcacf57f26a9 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823427b572044adaa2766653cd2e9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ad9eb9badc4c3d9bab2543e1972b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:18.840035 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a59e24e7-dcda-4de0-8eac-bcacf57f26a9 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] 10.222.0.25 "GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1" status: 200 len: 1327 microversion: 2.1 time: 0.244423 Jul 19 22:49:18.841191 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2333/4620] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:18 2022] GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1 => generated 1327 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:19.496706 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-55cc8ee5-922c-42a5-b7ee-92544ffe6ed2 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:19.497327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-55cc8ee5-922c-42a5-b7ee-92544ffe6ed2 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:19.507539 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-55cc8ee5-922c-42a5-b7ee-92544ffe6ed2 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:19.516931 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-55cc8ee5-922c-42a5-b7ee-92544ffe6ed2 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:19.520084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-55cc8ee5-922c-42a5-b7ee-92544ffe6ed2 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:19.520535 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-55cc8ee5-922c-42a5-b7ee-92544ffe6ed2 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:19.714019 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-55cc8ee5-922c-42a5-b7ee-92544ffe6ed2 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:19.725209 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-55cc8ee5-922c-42a5-b7ee-92544ffe6ed2 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:19.726965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-55cc8ee5-922c-42a5-b7ee-92544ffe6ed2 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:19.728592 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-55cc8ee5-922c-42a5-b7ee-92544ffe6ed2 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1604 microversion: 2.42 time: 0.236098 Jul 19 22:49:19.734380 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2288/4621] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:19 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1604 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:49:19.804455 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f75988c0-cfc2-4a39-b56c-3386c722ed06 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:19.805367 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f75988c0-cfc2-4a39-b56c-3386c722ed06 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:19.815641 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f75988c0-cfc2-4a39-b56c-3386c722ed06 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:19.817627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f75988c0-cfc2-4a39-b56c-3386c722ed06 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:19.818623 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f75988c0-cfc2-4a39-b56c-3386c722ed06 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:19.823133 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f75988c0-cfc2-4a39-b56c-3386c722ed06 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:20.103487 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f75988c0-cfc2-4a39-b56c-3386c722ed06 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:20.112698 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f75988c0-cfc2-4a39-b56c-3386c722ed06 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1527 microversion: 2.1 time: 0.312418 Jul 19 22:49:20.116724 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2289/4622] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:19 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1527 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:20.128086 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-37e78ee4-71b4-4413-bb31-8f2d1a99c8f6 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:20.129087 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-37e78ee4-71b4-4413-bb31-8f2d1a99c8f6 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] [instance: d770734f-85d5-4f04-9582-b0c2d46396c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:20.146433 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37e78ee4-71b4-4413-bb31-8f2d1a99c8f6 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:20.147787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37e78ee4-71b4-4413-bb31-8f2d1a99c8f6 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:20.150934 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37e78ee4-71b4-4413-bb31-8f2d1a99c8f6 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:20.152508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37e78ee4-71b4-4413-bb31-8f2d1a99c8f6 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:20.414183 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-37e78ee4-71b4-4413-bb31-8f2d1a99c8f6 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823427b572044adaa2766653cd2e9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ad9eb9badc4c3d9bab2543e1972b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:20.427900 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-37e78ee4-71b4-4413-bb31-8f2d1a99c8f6 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] 10.222.0.25 "GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1" status: 200 len: 1327 microversion: 2.1 time: 0.309714 Jul 19 22:49:20.429091 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2290/4623] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:20 2022] GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1 => generated 1327 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:20.434778 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-fb9d543a-9aab-49a1-9661-0c03f5861166 req-d6c56633-4994-42e5-8670-c22c95edd8ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb0d2fe2-80ea-4fc2-a157-f7341877997c", "name": "network-vif-plugged", "status": "completed", "tag": "2cb0e711-7270-4e34-9663-e6877d3106eb"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:49:20.442922 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-31445c19-5e47-44e7-af38-d31a4d44d423 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:20.444051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-31445c19-5e47-44e7-af38-d31a4d44d423 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:20.457655 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-fb9d543a-9aab-49a1-9661-0c03f5861166 req-d6c56633-4994-42e5-8670-c22c95edd8ab service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:20.458351 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-fb9d543a-9aab-49a1-9661-0c03f5861166 req-d6c56633-4994-42e5-8670-c22c95edd8ab service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:20.465370 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31445c19-5e47-44e7-af38-d31a4d44d423 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:20.469939 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31445c19-5e47-44e7-af38-d31a4d44d423 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:20.475463 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31445c19-5e47-44e7-af38-d31a4d44d423 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:20.476225 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31445c19-5e47-44e7-af38-d31a4d44d423 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:20.495941 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-fb9d543a-9aab-49a1-9661-0c03f5861166 req-d6c56633-4994-42e5-8670-c22c95edd8ab service nova] Creating event network-vif-plugged:2cb0e711-7270-4e34-9663-e6877d3106eb for instance fb0d2fe2-80ea-4fc2-a157-f7341877997c on n-h1-847009-3 Jul 19 22:49:20.511888 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-fb9d543a-9aab-49a1-9661-0c03f5861166 req-d6c56633-4994-42e5-8670-c22c95edd8ab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080446 Jul 19 22:49:20.519436 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2291/4624] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:49:20.557751 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-31445c19-5e47-44e7-af38-d31a4d44d423 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.955947 Jul 19 22:49:20.564112 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2334/4625] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:49:19 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7/os-volume_attachments => generated 25 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:49:20.689425 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-24a130c4-d569-484e-a9aa-bd0d2612e7e1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:49:20.690657 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-24a130c4-d569-484e-a9aa-bd0d2612e7e1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:20.705335 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-24a130c4-d569-484e-a9aa-bd0d2612e7e1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:20.709750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-24a130c4-d569-484e-a9aa-bd0d2612e7e1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:20.713050 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-24a130c4-d569-484e-a9aa-bd0d2612e7e1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:20.713577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-24a130c4-d569-484e-a9aa-bd0d2612e7e1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:20.754370 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3a1b6deb-91d6-4257-a962-d4d46157158c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:20.755365 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3a1b6deb-91d6-4257-a962-d4d46157158c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:20.772543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a1b6deb-91d6-4257-a962-d4d46157158c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:20.773819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a1b6deb-91d6-4257-a962-d4d46157158c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:20.776437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a1b6deb-91d6-4257-a962-d4d46157158c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:20.777889 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a1b6deb-91d6-4257-a962-d4d46157158c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:20.825950 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-24a130c4-d569-484e-a9aa-bd0d2612e7e1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] HTTP exception thrown: Cannot 'reboot' instance 77e3dc73-fee1-4b35-8506-9acfc60bc789 while it is in vm_state rescued Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-24a130c4-d569-484e-a9aa-bd0d2612e7e1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Request method failure captured: Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789/action HTTP/1.1 Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 28 Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zPB9pdZx5bGxAOx1bWrMM0FEhH4uLd_pSCvc_RNVR1Ml3e2RdxqyGOtd-lt2kxygYFNrKmFRc3yVX-y9hoY_QR39GzP2XOyLb00mNIcRNYPp_Z40PO_3EFeEpNqlZOyhEu-fa-kVbsARhW2vxsGD8FHWpMQupoNdZ8KLVFw7a76o8s Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 95469b549ae7425a83e0d93bb8c10860 Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1399962716 Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1399962716 Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 95469b549ae7425a83e0d93bb8c10860 Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1399962716 Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerRescueNegativeTestJSON-1399962716-project Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 5f92608789324ac48fef6ce87a745a07 Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1399962716-project Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: {"reboot": {"type": "HARD"}} Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: exception: Cannot 'reboot' instance 77e3dc73-fee1-4b35-8506-9acfc60bc789 while it is in vm_state rescued Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '77e3dc73-fee1-4b35-8506-9acfc60bc789', 'body': {'reboot': {'type': 'HARD'}}} Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 77e3dc73-fee1-4b35-8506-9acfc60bc789 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 22:49:20.837714 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 22:49:20.842935 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 77e3dc73-fee1-4b35-8506-9acfc60bc789 while it is in vm_state rescued Jul 19 22:49:20.842935 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:49:20.842935 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:49:20.842935 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:49:20.842935 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:20.842935 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:49:20.842935 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:49:20.842935 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:49:20.842935 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:49:20.842935 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 77e3dc73-fee1-4b35-8506-9acfc60bc789 while it is in vm_state rescued Jul 19 22:49:20.842935 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:49:20.842935 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-24a130c4-d569-484e-a9aa-bd0d2612e7e1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Returning 409 to user: Cannot 'reboot' instance 77e3dc73-fee1-4b35-8506-9acfc60bc789 while it is in vm_state rescued {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:49:20.850262 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-24a130c4-d569-484e-a9aa-bd0d2612e7e1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "POST /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789/action" status: 409 len: 145 microversion: 2.1 time: 0.164133 Jul 19 22:49:20.857185 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2292/4626] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:49:20 2022] POST /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789/action => generated 145 bytes in 172 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 19 22:49:20.882392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5394e15e-d872-4774-8140-0476d9e1e56c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:49:20.895694 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5394e15e-d872-4774-8140-0476d9e1e56c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:20.923253 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5394e15e-d872-4774-8140-0476d9e1e56c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:20.923713 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5394e15e-d872-4774-8140-0476d9e1e56c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:20.924511 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5394e15e-d872-4774-8140-0476d9e1e56c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:20.924954 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5394e15e-d872-4774-8140-0476d9e1e56c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:20.961659 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3a1b6deb-91d6-4257-a962-d4d46157158c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:20.984352 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3a1b6deb-91d6-4257-a962-d4d46157158c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:20.991910 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3a1b6deb-91d6-4257-a962-d4d46157158c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:20.993420 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3a1b6deb-91d6-4257-a962-d4d46157158c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1604 microversion: 2.42 time: 0.246028 Jul 19 22:49:20.994309 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-5394e15e-d872-4774-8140-0476d9e1e56c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] HTTP exception thrown: Cannot 'rebuild' instance 77e3dc73-fee1-4b35-8506-9acfc60bc789 while it is in vm_state rescued Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5394e15e-d872-4774-8140-0476d9e1e56c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Request method failure captured: Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789/action HTTP/1.1 Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 65 Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zPB9pdZx5bGxAOx1bWrMM0FEhH4uLd_pSCvc_RNVR1Ml3e2RdxqyGOtd-lt2kxygYFNrKmFRc3yVX-y9hoY_QR39GzP2XOyLb00mNIcRNYPp_Z40PO_3EFeEpNqlZOyhEu-fa-kVbsARhW2vxsGD8FHWpMQupoNdZ8KLVFw7a76o8s Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 95469b549ae7425a83e0d93bb8c10860 Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1399962716 Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1399962716 Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 95469b549ae7425a83e0d93bb8c10860 Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1399962716 Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerRescueNegativeTestJSON-1399962716-project Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 5f92608789324ac48fef6ce87a745a07 Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1399962716-project Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: {"rebuild": {"imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691"}} Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: exception: Cannot 'rebuild' instance 77e3dc73-fee1-4b35-8506-9acfc60bc789 while it is in vm_state rescued Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '77e3dc73-fee1-4b35-8506-9acfc60bc789', 'body': {'rebuild': {'imageRef': '3a7659a5-b1a8-4e19-8bfc-eda9874ee691'}}} Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 77e3dc73-fee1-4b35-8506-9acfc60bc789 in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:49:21.003285 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:49:21.006984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:49:21.006984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 19 22:49:21.006984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jul 19 22:49:21.006984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 22:49:21.006984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 22:49:21.006984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 22:49:21.006984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 77e3dc73-fee1-4b35-8506-9acfc60bc789 while it is in vm_state rescued Jul 19 22:49:21.006984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:49:21.006984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:49:21.006984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:49:21.006984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:21.006984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:49:21.006984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:49:21.006984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:49:21.006984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:49:21.006984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 77e3dc73-fee1-4b35-8506-9acfc60bc789 while it is in vm_state rescued Jul 19 22:49:21.006984 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:49:21.010396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5394e15e-d872-4774-8140-0476d9e1e56c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Returning 409 to user: Cannot 'rebuild' instance 77e3dc73-fee1-4b35-8506-9acfc60bc789 while it is in vm_state rescued {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:49:21.011486 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2335/4627] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:20 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1604 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:49:21.016432 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5394e15e-d872-4774-8140-0476d9e1e56c tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "POST /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789/action" status: 409 len: 146 microversion: 2.1 time: 0.151034 Jul 19 22:49:21.022775 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2293/4628] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:49:20 2022] POST /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789/action => generated 146 bytes in 159 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:49:21.028801 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bddb0301-f1cc-430e-bec0-9f99c38afc44 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:21.040711 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bddb0301-f1cc-430e-bec0-9f99c38afc44 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:21.063559 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bddb0301-f1cc-430e-bec0-9f99c38afc44 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:21.072899 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bddb0301-f1cc-430e-bec0-9f99c38afc44 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:21.074290 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bddb0301-f1cc-430e-bec0-9f99c38afc44 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:21.074917 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bddb0301-f1cc-430e-bec0-9f99c38afc44 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:21.133699 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dec1794d-e4df-4bf2-885f-5239f8cf2f36 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:21.134606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dec1794d-e4df-4bf2-885f-5239f8cf2f36 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:21.148359 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dec1794d-e4df-4bf2-885f-5239f8cf2f36 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:21.151579 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dec1794d-e4df-4bf2-885f-5239f8cf2f36 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:21.153828 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dec1794d-e4df-4bf2-885f-5239f8cf2f36 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:21.155817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dec1794d-e4df-4bf2-885f-5239f8cf2f36 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:21.197923 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bddb0301-f1cc-430e-bec0-9f99c38afc44 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:49:21.402872 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bddb0301-f1cc-430e-bec0-9f99c38afc44 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "DELETE /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 204 len: 0 microversion: 2.1 time: 0.377292 Jul 19 22:49:21.404383 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2336/4629] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:49:21 2022] DELETE /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:49:21.426824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4b4411e1-3185-42cc-af1d-26270a7a692f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:21.429209 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4b4411e1-3185-42cc-af1d-26270a7a692f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:21.437869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b4411e1-3185-42cc-af1d-26270a7a692f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:21.438644 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b4411e1-3185-42cc-af1d-26270a7a692f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:21.439693 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b4411e1-3185-42cc-af1d-26270a7a692f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:21.440664 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b4411e1-3185-42cc-af1d-26270a7a692f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:21.623817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dec1794d-e4df-4bf2-885f-5239f8cf2f36 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:21.634295 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dec1794d-e4df-4bf2-885f-5239f8cf2f36 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1527 microversion: 2.1 time: 0.504399 Jul 19 22:49:21.640652 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2294/4630] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:21 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1527 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:49:21.650008 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b8738d1a-df3c-473c-9cd8-6151afccd8ab tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:21.656217 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b8738d1a-df3c-473c-9cd8-6151afccd8ab tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] [instance: d770734f-85d5-4f04-9582-b0c2d46396c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:21.671278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8738d1a-df3c-473c-9cd8-6151afccd8ab tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:21.673091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8738d1a-df3c-473c-9cd8-6151afccd8ab tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:21.675539 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8738d1a-df3c-473c-9cd8-6151afccd8ab tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:21.677552 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8738d1a-df3c-473c-9cd8-6151afccd8ab tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:21.764911 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4b4411e1-3185-42cc-af1d-26270a7a692f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:21.786331 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4b4411e1-3185-42cc-af1d-26270a7a692f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1688 microversion: 2.1 time: 0.372206 Jul 19 22:49:21.787333 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2337/4631] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:21 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1688 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:22.017861 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ea96b0ed-fd93-49ba-9f05-c7aaaaabdd59 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:22.018489 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ea96b0ed-fd93-49ba-9f05-c7aaaaabdd59 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:22.027310 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea96b0ed-fd93-49ba-9f05-c7aaaaabdd59 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:22.028654 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea96b0ed-fd93-49ba-9f05-c7aaaaabdd59 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:22.029735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea96b0ed-fd93-49ba-9f05-c7aaaaabdd59 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:22.030367 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea96b0ed-fd93-49ba-9f05-c7aaaaabdd59 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:22.428830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b8738d1a-df3c-473c-9cd8-6151afccd8ab tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823427b572044adaa2766653cd2e9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ad9eb9badc4c3d9bab2543e1972b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:22.441721 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b8738d1a-df3c-473c-9cd8-6151afccd8ab tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] 10.222.0.25 "GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1" status: 200 len: 1527 microversion: 2.1 time: 0.797925 Jul 19 22:49:22.442568 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2295/4632] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:21 2022] GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1 => generated 1527 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:22.460702 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d014ce3f-7105-4b8a-b8de-fa4c5dc361b8 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:22.462013 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d014ce3f-7105-4b8a-b8de-fa4c5dc361b8 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] [instance: d770734f-85d5-4f04-9582-b0c2d46396c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:22.472979 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d014ce3f-7105-4b8a-b8de-fa4c5dc361b8 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:22.474821 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d014ce3f-7105-4b8a-b8de-fa4c5dc361b8 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:22.477043 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d014ce3f-7105-4b8a-b8de-fa4c5dc361b8 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:22.480192 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d014ce3f-7105-4b8a-b8de-fa4c5dc361b8 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:22.510306 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ea96b0ed-fd93-49ba-9f05-c7aaaaabdd59 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:22.524878 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ea96b0ed-fd93-49ba-9f05-c7aaaaabdd59 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:22.540745 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ea96b0ed-fd93-49ba-9f05-c7aaaaabdd59 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:22.550517 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ea96b0ed-fd93-49ba-9f05-c7aaaaabdd59 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1604 microversion: 2.42 time: 0.536355 Jul 19 22:49:22.556724 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2338/4633] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:22 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1604 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:49:22.659017 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0c631461-5be7-4798-b111-46b0ea7b218c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:22.660326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0c631461-5be7-4798-b111-46b0ea7b218c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:22.680410 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c631461-5be7-4798-b111-46b0ea7b218c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:22.683576 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c631461-5be7-4798-b111-46b0ea7b218c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:22.684634 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c631461-5be7-4798-b111-46b0ea7b218c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:22.685108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0c631461-5be7-4798-b111-46b0ea7b218c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:22.939922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d014ce3f-7105-4b8a-b8de-fa4c5dc361b8 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823427b572044adaa2766653cd2e9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ad9eb9badc4c3d9bab2543e1972b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:22.953659 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d014ce3f-7105-4b8a-b8de-fa4c5dc361b8 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] 10.222.0.25 "GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1" status: 200 len: 1527 microversion: 2.1 time: 0.496968 Jul 19 22:49:22.954273 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2296/4634] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:22 2022] GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1 => generated 1527 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:49:22.994531 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3dbb2f07-a6c4-4715-bf27-503ffab86ebd tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:22.995802 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3dbb2f07-a6c4-4715-bf27-503ffab86ebd tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:23.008856 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3dbb2f07-a6c4-4715-bf27-503ffab86ebd tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:23.010295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3dbb2f07-a6c4-4715-bf27-503ffab86ebd tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:23.011354 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3dbb2f07-a6c4-4715-bf27-503ffab86ebd tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:23.012759 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3dbb2f07-a6c4-4715-bf27-503ffab86ebd tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:23.307727 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0c631461-5be7-4798-b111-46b0ea7b218c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:23.324037 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0c631461-5be7-4798-b111-46b0ea7b218c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1527 microversion: 2.1 time: 0.670220 Jul 19 22:49:23.328841 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2339/4635] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:22 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1527 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:23.342676 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3dbb2f07-a6c4-4715-bf27-503ffab86ebd tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:23.370374 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3dbb2f07-a6c4-4715-bf27-503ffab86ebd tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1688 microversion: 2.1 time: 0.400661 Jul 19 22:49:23.374890 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2297/4636] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:22 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1688 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:23.577727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-58b4f6d4-0773-4151-abf2-2b6eab4f699c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:23.578660 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-58b4f6d4-0773-4151-abf2-2b6eab4f699c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:23.597073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58b4f6d4-0773-4151-abf2-2b6eab4f699c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:23.601981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58b4f6d4-0773-4151-abf2-2b6eab4f699c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:23.603396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58b4f6d4-0773-4151-abf2-2b6eab4f699c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:23.605960 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58b4f6d4-0773-4151-abf2-2b6eab4f699c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:23.764361 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-58b4f6d4-0773-4151-abf2-2b6eab4f699c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:23.789609 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-58b4f6d4-0773-4151-abf2-2b6eab4f699c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:23.796689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-58b4f6d4-0773-4151-abf2-2b6eab4f699c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:23.800223 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-58b4f6d4-0773-4151-abf2-2b6eab4f699c tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1604 microversion: 2.42 time: 0.229938 Jul 19 22:49:23.803993 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2298/4637] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:23 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1604 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:49:24.068480 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-db00770f-21a0-4285-856d-953da4c3001b tempest-ServersNegativeTestMultiTenantJSON-591878090 tempest-ServersNegativeTestMultiTenantJSON-591878090-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:24.069486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-db00770f-21a0-4285-856d-953da4c3001b tempest-ServersNegativeTestMultiTenantJSON-591878090 tempest-ServersNegativeTestMultiTenantJSON-591878090-project] [instance: d770734f-85d5-4f04-9582-b0c2d46396c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:24.086129 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-db00770f-21a0-4285-856d-953da4c3001b tempest-ServersNegativeTestMultiTenantJSON-591878090 tempest-ServersNegativeTestMultiTenantJSON-591878090-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:24.088192 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-db00770f-21a0-4285-856d-953da4c3001b tempest-ServersNegativeTestMultiTenantJSON-591878090 tempest-ServersNegativeTestMultiTenantJSON-591878090-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:24.091033 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-db00770f-21a0-4285-856d-953da4c3001b tempest-ServersNegativeTestMultiTenantJSON-591878090 tempest-ServersNegativeTestMultiTenantJSON-591878090-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:24.094751 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-db00770f-21a0-4285-856d-953da4c3001b tempest-ServersNegativeTestMultiTenantJSON-591878090 tempest-ServersNegativeTestMultiTenantJSON-591878090-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:24.151607 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-db00770f-21a0-4285-856d-953da4c3001b tempest-ServersNegativeTestMultiTenantJSON-591878090 tempest-ServersNegativeTestMultiTenantJSON-591878090-project] HTTP exception thrown: Instance d770734f-85d5-4f04-9582-b0c2d46396c1 could not be found. Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-db00770f-21a0-4285-856d-953da4c3001b tempest-ServersNegativeTestMultiTenantJSON-591878090 tempest-ServersNegativeTestMultiTenantJSON-591878090-project] Request method failure captured: Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1 HTTP/1.1 Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zTcaMt664xHIFG8ZEcVIGK5lgx85FWX5a7QQjRK2auAPq_oI0BpyALrvBa8iuNjjSB-jud6IfrHw2oxyGHe3WPVkntGJ2-muSWRC4xaruWTK_BQQlQXOIhXpzXGFiZrr4LKo-unfa1CKyVchdX4zFG040mJ5B4oz2_fC5QkQR9eT7g Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 88e425f8f4694b72b710d1533261baa0 Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-591878090 Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_88e425f8f4694b72b710d1533261baa0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/88e425f8f4694b72b710d1533261baa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/88e425f8f4694b72b710d1533261baa0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/88e425f8f4694b72b710d1533261baa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-591878090 Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 88e425f8f4694b72b710d1533261baa0 Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-591878090 Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersNegativeTestMultiTenantJSON-591878090-project Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: da504fe6c9824067869053c7a04d7adc Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-591878090-project Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance d770734f-85d5-4f04-9582-b0c2d46396c1 could not be found. Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'd770734f-85d5-4f04-9582-b0c2d46396c1'} Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d770734f-85d5-4f04-9582-b0c2d46396c1 could not be found. Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:49:24.161138 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:49:24.165226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d770734f-85d5-4f04-9582-b0c2d46396c1 could not be found. Jul 19 22:49:24.165226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:24.165226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:49:24.165226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:24.165226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:24.165226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:49:24.165226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:49:24.165226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:49:24.165226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:49:24.165226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d770734f-85d5-4f04-9582-b0c2d46396c1 could not be found. Jul 19 22:49:24.165226 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:24.166313 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-db00770f-21a0-4285-856d-953da4c3001b tempest-ServersNegativeTestMultiTenantJSON-591878090 tempest-ServersNegativeTestMultiTenantJSON-591878090-project] Returning 404 to user: Instance d770734f-85d5-4f04-9582-b0c2d46396c1 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:49:24.170900 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-db00770f-21a0-4285-856d-953da4c3001b tempest-ServersNegativeTestMultiTenantJSON-591878090 tempest-ServersNegativeTestMultiTenantJSON-591878090-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1" status: 404 len: 111 microversion: 2.1 time: 0.835558 Jul 19 22:49:24.177383 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2340/4638] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:49:23 2022] DELETE /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1 => generated 111 bytes in 847 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:49:24.182112 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-243f7585-e1c7-47b2-868b-24ec0c93ebc1 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:24.182815 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-243f7585-e1c7-47b2-868b-24ec0c93ebc1 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] [instance: d770734f-85d5-4f04-9582-b0c2d46396c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:24.208621 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-243f7585-e1c7-47b2-868b-24ec0c93ebc1 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:24.210403 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-243f7585-e1c7-47b2-868b-24ec0c93ebc1 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:24.214009 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-243f7585-e1c7-47b2-868b-24ec0c93ebc1 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:24.215548 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-243f7585-e1c7-47b2-868b-24ec0c93ebc1 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:24.355335 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3a81d990-dc60-4900-81e5-e831d8fdeb5a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:24.358804 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3a81d990-dc60-4900-81e5-e831d8fdeb5a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:24.381316 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a81d990-dc60-4900-81e5-e831d8fdeb5a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:24.385860 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a81d990-dc60-4900-81e5-e831d8fdeb5a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:24.387292 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a81d990-dc60-4900-81e5-e831d8fdeb5a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:24.389232 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a81d990-dc60-4900-81e5-e831d8fdeb5a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:24.409386 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:49:25.016114 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-243f7585-e1c7-47b2-868b-24ec0c93ebc1 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823427b572044adaa2766653cd2e9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ad9eb9badc4c3d9bab2543e1972b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:25.032954 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-243f7585-e1c7-47b2-868b-24ec0c93ebc1 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] 10.222.0.25 "GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1" status: 200 len: 1527 microversion: 2.1 time: 0.855282 Jul 19 22:49:25.053539 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2299/4639] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:24 2022] GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1 => generated 1527 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:49:25.067308 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a6a348d6-cac1-4598-b10d-bc522e44716e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:25.068824 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a6a348d6-cac1-4598-b10d-bc522e44716e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:25.082398 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6a348d6-cac1-4598-b10d-bc522e44716e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:25.085791 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6a348d6-cac1-4598-b10d-bc522e44716e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:25.087735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6a348d6-cac1-4598-b10d-bc522e44716e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:25.088788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6a348d6-cac1-4598-b10d-bc522e44716e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:25.098362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:49:25.113059 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3a81d990-dc60-4900-81e5-e831d8fdeb5a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:25.137744 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3a81d990-dc60-4900-81e5-e831d8fdeb5a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1527 microversion: 2.1 time: 0.797230 Jul 19 22:49:25.144129 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2341/4640] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:24 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1527 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:25.162687 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-84a549d9-f662-42c4-912e-4582e35a4e27 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:25.164857 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-84a549d9-f662-42c4-912e-4582e35a4e27 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:25.186247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-84a549d9-f662-42c4-912e-4582e35a4e27 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:25.186919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-84a549d9-f662-42c4-912e-4582e35a4e27 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:25.187778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-84a549d9-f662-42c4-912e-4582e35a4e27 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:25.188230 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-84a549d9-f662-42c4-912e-4582e35a4e27 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:25.564609 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-84a549d9-f662-42c4-912e-4582e35a4e27 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:25.583748 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-84a549d9-f662-42c4-912e-4582e35a4e27 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:25.589695 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-84a549d9-f662-42c4-912e-4582e35a4e27 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:25.593933 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-84a549d9-f662-42c4-912e-4582e35a4e27 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1604 microversion: 2.42 time: 0.448602 Jul 19 22:49:25.597763 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2342/4641] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:25 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1604 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:49:25.612474 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5fcb4532-3d1c-4fba-a108-3084aed8085e tempest-ServersNegativeTestMultiTenantJSON-591878090 tempest-ServersNegativeTestMultiTenantJSON-591878090-project] Action: 'update', calling method: >, body: {"server": {"name": "d770734f-85d5-4f04-9582-b0c2d46396c1_new"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:49:25.628283 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5fcb4532-3d1c-4fba-a108-3084aed8085e tempest-ServersNegativeTestMultiTenantJSON-591878090 tempest-ServersNegativeTestMultiTenantJSON-591878090-project] [instance: d770734f-85d5-4f04-9582-b0c2d46396c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:25.658255 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5fcb4532-3d1c-4fba-a108-3084aed8085e tempest-ServersNegativeTestMultiTenantJSON-591878090 tempest-ServersNegativeTestMultiTenantJSON-591878090-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:25.660676 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5fcb4532-3d1c-4fba-a108-3084aed8085e tempest-ServersNegativeTestMultiTenantJSON-591878090 tempest-ServersNegativeTestMultiTenantJSON-591878090-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:25.661649 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5fcb4532-3d1c-4fba-a108-3084aed8085e tempest-ServersNegativeTestMultiTenantJSON-591878090 tempest-ServersNegativeTestMultiTenantJSON-591878090-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:25.663369 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5fcb4532-3d1c-4fba-a108-3084aed8085e tempest-ServersNegativeTestMultiTenantJSON-591878090 tempest-ServersNegativeTestMultiTenantJSON-591878090-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:25.698724 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-5fcb4532-3d1c-4fba-a108-3084aed8085e tempest-ServersNegativeTestMultiTenantJSON-591878090 tempest-ServersNegativeTestMultiTenantJSON-591878090-project] HTTP exception thrown: Instance d770734f-85d5-4f04-9582-b0c2d46396c1 could not be found. Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5fcb4532-3d1c-4fba-a108-3084aed8085e tempest-ServersNegativeTestMultiTenantJSON-591878090 tempest-ServersNegativeTestMultiTenantJSON-591878090-project] Request method failure captured: Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: request: PUT /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1 HTTP/1.1 Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 64 Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zTcaMt664xHIFG8ZEcVIGK5lgx85FWX5a7QQjRK2auAPq_oI0BpyALrvBa8iuNjjSB-jud6IfrHw2oxyGHe3WPVkntGJ2-muSWRC4xaruWTK_BQQlQXOIhXpzXGFiZrr4LKo-unfa1CKyVchdX4zFG040mJ5B4oz2_fC5QkQR9eT7g Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 88e425f8f4694b72b710d1533261baa0 Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-591878090 Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_88e425f8f4694b72b710d1533261baa0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/88e425f8f4694b72b710d1533261baa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/88e425f8f4694b72b710d1533261baa0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/88e425f8f4694b72b710d1533261baa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-591878090 Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 88e425f8f4694b72b710d1533261baa0 Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-591878090 Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersNegativeTestMultiTenantJSON-591878090-project Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: da504fe6c9824067869053c7a04d7adc Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-591878090-project Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: {"server": {"name": "d770734f-85d5-4f04-9582-b0c2d46396c1_new"}} Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance d770734f-85d5-4f04-9582-b0c2d46396c1 could not be found. Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'd770734f-85d5-4f04-9582-b0c2d46396c1', 'body': {'server': {'name': 'd770734f-85d5-4f04-9582-b0c2d46396c1_new'}}} Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d770734f-85d5-4f04-9582-b0c2d46396c1 could not be found. Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 19 22:49:25.706303 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 19 22:49:25.710392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 19 22:49:25.710392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:49:25.710392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:49:25.710392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:49:25.710392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:49:25.710392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d770734f-85d5-4f04-9582-b0c2d46396c1 could not be found. Jul 19 22:49:25.710392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:25.710392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:49:25.710392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:25.710392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:25.710392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:49:25.710392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:49:25.710392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:49:25.710392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:49:25.710392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d770734f-85d5-4f04-9582-b0c2d46396c1 could not be found. Jul 19 22:49:25.710392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:25.710392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5fcb4532-3d1c-4fba-a108-3084aed8085e tempest-ServersNegativeTestMultiTenantJSON-591878090 tempest-ServersNegativeTestMultiTenantJSON-591878090-project] Returning 404 to user: Instance d770734f-85d5-4f04-9582-b0c2d46396c1 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:49:25.710392 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5fcb4532-3d1c-4fba-a108-3084aed8085e tempest-ServersNegativeTestMultiTenantJSON-591878090 tempest-ServersNegativeTestMultiTenantJSON-591878090-project] 10.222.0.25 "PUT /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1" status: 404 len: 111 microversion: 2.1 time: 0.109977 Jul 19 22:49:25.721635 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2343/4642] 10.222.0.25 () {60 vars in 1255 bytes} [Tue Jul 19 22:49:25 2022] PUT /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:49:25.732289 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2c2356d0-2798-4cb1-94b6-9fc40c3b8d2d tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:25.734515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2c2356d0-2798-4cb1-94b6-9fc40c3b8d2d tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] [instance: d770734f-85d5-4f04-9582-b0c2d46396c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:25.751661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c2356d0-2798-4cb1-94b6-9fc40c3b8d2d tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:25.752122 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c2356d0-2798-4cb1-94b6-9fc40c3b8d2d tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:25.752939 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c2356d0-2798-4cb1-94b6-9fc40c3b8d2d tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:25.755011 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c2356d0-2798-4cb1-94b6-9fc40c3b8d2d tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:25.819469 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2c2356d0-2798-4cb1-94b6-9fc40c3b8d2d tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] [instance: d770734f-85d5-4f04-9582-b0c2d46396c1] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:49:25.873846 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a6a348d6-cac1-4598-b10d-bc522e44716e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:25.887594 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a6a348d6-cac1-4598-b10d-bc522e44716e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1688 microversion: 2.1 time: 0.832093 Jul 19 22:49:25.903193 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2300/4643] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:25 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1688 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:26.073477 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2c2356d0-2798-4cb1-94b6-9fc40c3b8d2d tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1" status: 204 len: 0 microversion: 2.1 time: 0.350061 Jul 19 22:49:26.074486 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2344/4644] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:49:25 2022] DELETE /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:49:26.083082 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-533e0ee8-f269-426a-8ccd-5e59a00c3eb2 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:26.083958 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-533e0ee8-f269-426a-8ccd-5e59a00c3eb2 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] [instance: d770734f-85d5-4f04-9582-b0c2d46396c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:26.102403 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-533e0ee8-f269-426a-8ccd-5e59a00c3eb2 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:26.103244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-533e0ee8-f269-426a-8ccd-5e59a00c3eb2 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:26.105567 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-533e0ee8-f269-426a-8ccd-5e59a00c3eb2 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:26.108515 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-533e0ee8-f269-426a-8ccd-5e59a00c3eb2 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:26.160160 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d5cc074b-d4e2-4786-8c5f-95a93dc187bd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:26.161208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d5cc074b-d4e2-4786-8c5f-95a93dc187bd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:26.176651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5cc074b-d4e2-4786-8c5f-95a93dc187bd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:26.177721 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5cc074b-d4e2-4786-8c5f-95a93dc187bd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:26.180802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5cc074b-d4e2-4786-8c5f-95a93dc187bd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:26.181510 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5cc074b-d4e2-4786-8c5f-95a93dc187bd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:27.073916 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-533e0ee8-f269-426a-8ccd-5e59a00c3eb2 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823427b572044adaa2766653cd2e9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ad9eb9badc4c3d9bab2543e1972b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:27.082225 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-533e0ee8-f269-426a-8ccd-5e59a00c3eb2 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] 10.222.0.25 "GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1" status: 200 len: 1533 microversion: 2.1 time: 1.003352 Jul 19 22:49:27.096332 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2301/4645] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:26 2022] GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1 => generated 1533 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:27.101747 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a343be6f-c875-4ad5-80a5-1987fcbe6cb6 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:27.109726 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d5cc074b-d4e2-4786-8c5f-95a93dc187bd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:27.111755 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a343be6f-c875-4ad5-80a5-1987fcbe6cb6 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:27.125502 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d5cc074b-d4e2-4786-8c5f-95a93dc187bd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1527 microversion: 2.1 time: 0.972713 Jul 19 22:49:27.131973 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a343be6f-c875-4ad5-80a5-1987fcbe6cb6 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:27.135953 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2345/4646] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:26 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1527 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:27.140952 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a343be6f-c875-4ad5-80a5-1987fcbe6cb6 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:27.141795 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a343be6f-c875-4ad5-80a5-1987fcbe6cb6 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:27.146231 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c5cea6d4-83ef-401f-8e88-1870746ee94f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:27.147266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c5cea6d4-83ef-401f-8e88-1870746ee94f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:27.148562 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a343be6f-c875-4ad5-80a5-1987fcbe6cb6 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:27.159054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c5cea6d4-83ef-401f-8e88-1870746ee94f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:27.160015 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c5cea6d4-83ef-401f-8e88-1870746ee94f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:27.161240 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c5cea6d4-83ef-401f-8e88-1870746ee94f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:27.162177 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c5cea6d4-83ef-401f-8e88-1870746ee94f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:28.043102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a343be6f-c875-4ad5-80a5-1987fcbe6cb6 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:28.070392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a343be6f-c875-4ad5-80a5-1987fcbe6cb6 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:28.080059 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a343be6f-c875-4ad5-80a5-1987fcbe6cb6 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:28.086330 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a343be6f-c875-4ad5-80a5-1987fcbe6cb6 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1604 microversion: 2.42 time: 0.986534 Jul 19 22:49:28.088645 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2302/4647] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:27 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1604 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:49:28.103546 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-874e1574-7485-4607-9902-66997e061dc8 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:28.105484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-874e1574-7485-4607-9902-66997e061dc8 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] [instance: d770734f-85d5-4f04-9582-b0c2d46396c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:28.126045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-874e1574-7485-4607-9902-66997e061dc8 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:28.129702 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-874e1574-7485-4607-9902-66997e061dc8 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:28.135046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-874e1574-7485-4607-9902-66997e061dc8 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:28.137715 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-874e1574-7485-4607-9902-66997e061dc8 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:29.219773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c5cea6d4-83ef-401f-8e88-1870746ee94f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:29.236790 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c5cea6d4-83ef-401f-8e88-1870746ee94f tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1688 microversion: 2.1 time: 2.094923 Jul 19 22:49:29.249669 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2346/4648] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:27 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1688 bytes in 2111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:29.261495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f764c062-9802-41fe-9c88-18dca2f55369 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:29.263521 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f764c062-9802-41fe-9c88-18dca2f55369 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:29.282846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f764c062-9802-41fe-9c88-18dca2f55369 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:29.284706 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f764c062-9802-41fe-9c88-18dca2f55369 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:29.288481 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f764c062-9802-41fe-9c88-18dca2f55369 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:29.289437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f764c062-9802-41fe-9c88-18dca2f55369 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:29.671917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-874e1574-7485-4607-9902-66997e061dc8 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823427b572044adaa2766653cd2e9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ad9eb9badc4c3d9bab2543e1972b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:29.682836 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-874e1574-7485-4607-9902-66997e061dc8 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] 10.222.0.25 "GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1" status: 200 len: 1533 microversion: 2.1 time: 1.587036 Jul 19 22:49:29.689106 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2303/4649] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:28 2022] GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1 => generated 1533 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:29.697322 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0a0b558b-44e0-4491-93eb-882606f8be4d tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:29.698149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0a0b558b-44e0-4491-93eb-882606f8be4d tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:29.709381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a0b558b-44e0-4491-93eb-882606f8be4d tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:29.711166 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a0b558b-44e0-4491-93eb-882606f8be4d tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:29.712119 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a0b558b-44e0-4491-93eb-882606f8be4d tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:29.712841 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a0b558b-44e0-4491-93eb-882606f8be4d tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:29.974354 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0a0b558b-44e0-4491-93eb-882606f8be4d tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:29.996935 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0a0b558b-44e0-4491-93eb-882606f8be4d tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:30.002030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0a0b558b-44e0-4491-93eb-882606f8be4d tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:30.006554 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0a0b558b-44e0-4491-93eb-882606f8be4d tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1604 microversion: 2.42 time: 0.316194 Jul 19 22:49:30.008416 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2304/4650] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:29 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1604 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:49:30.255406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8b8552f9-c731-4ced-8626-a5e2f8951d72 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:30.256040 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8b8552f9-c731-4ced-8626-a5e2f8951d72 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:30.269478 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b8552f9-c731-4ced-8626-a5e2f8951d72 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:30.269940 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b8552f9-c731-4ced-8626-a5e2f8951d72 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:30.270767 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b8552f9-c731-4ced-8626-a5e2f8951d72 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:30.271238 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b8552f9-c731-4ced-8626-a5e2f8951d72 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:30.370861 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f764c062-9802-41fe-9c88-18dca2f55369 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:30.391437 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f764c062-9802-41fe-9c88-18dca2f55369 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1527 microversion: 2.1 time: 1.131588 Jul 19 22:49:30.392091 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2347/4651] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:29 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1527 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:30.627138 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-1275f623-b1fc-4786-8cf5-31e1564d658d req-32559d9d-c192-44a1-9edd-4516b0f761e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02571222-3b10-4a0d-8b70-a8202c37f6a7", "name": "network-vif-deleted", "tag": "542dbd38-d2d6-470e-be1a-a605a204b40b"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:49:30.643142 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-1275f623-b1fc-4786-8cf5-31e1564d658d req-32559d9d-c192-44a1-9edd-4516b0f761e2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:30.648458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8b8552f9-c731-4ced-8626-a5e2f8951d72 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:30.657595 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8b8552f9-c731-4ced-8626-a5e2f8951d72 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 200 len: 1620 microversion: 2.1 time: 0.406378 Jul 19 22:49:30.664705 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2305/4652] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:30 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 1620 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:49:30.666816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-1275f623-b1fc-4786-8cf5-31e1564d658d req-32559d9d-c192-44a1-9edd-4516b0f761e2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:30.703623 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0c003e8a-5c96-4514-9540-67b33dd2037b tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:30.704872 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0c003e8a-5c96-4514-9540-67b33dd2037b tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] [instance: d770734f-85d5-4f04-9582-b0c2d46396c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:30.731731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c003e8a-5c96-4514-9540-67b33dd2037b tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:30.733363 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-1275f623-b1fc-4786-8cf5-31e1564d658d req-32559d9d-c192-44a1-9edd-4516b0f761e2 service nova] Creating event network-vif-deleted:542dbd38-d2d6-470e-be1a-a605a204b40b for instance 02571222-3b10-4a0d-8b70-a8202c37f6a7 on n-h2-847009-3 Jul 19 22:49:30.740532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c003e8a-5c96-4514-9540-67b33dd2037b tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:30.743917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c003e8a-5c96-4514-9540-67b33dd2037b tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:30.744584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c003e8a-5c96-4514-9540-67b33dd2037b tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:30.760622 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-1275f623-b1fc-4786-8cf5-31e1564d658d req-32559d9d-c192-44a1-9edd-4516b0f761e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142254 Jul 19 22:49:30.766519 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2348/4653] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 19 22:49:31.032075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-96f332bc-0671-4d14-a899-eceea9da4f3d tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:31.033202 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-96f332bc-0671-4d14-a899-eceea9da4f3d tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:31.050105 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96f332bc-0671-4d14-a899-eceea9da4f3d tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:31.050984 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96f332bc-0671-4d14-a899-eceea9da4f3d tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:31.052037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96f332bc-0671-4d14-a899-eceea9da4f3d tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:31.063914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96f332bc-0671-4d14-a899-eceea9da4f3d tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:31.553525 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-96f332bc-0671-4d14-a899-eceea9da4f3d tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:31.569372 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0c003e8a-5c96-4514-9540-67b33dd2037b tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823427b572044adaa2766653cd2e9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ad9eb9badc4c3d9bab2543e1972b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:31.582964 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0c003e8a-5c96-4514-9540-67b33dd2037b tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] 10.222.0.25 "GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1" status: 200 len: 1491 microversion: 2.1 time: 0.885986 Jul 19 22:49:31.587685 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-96f332bc-0671-4d14-a899-eceea9da4f3d tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:31.588066 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2306/4654] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:30 2022] GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1 => generated 1491 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:49:31.593224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-96f332bc-0671-4d14-a899-eceea9da4f3d tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:31.607798 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-96f332bc-0671-4d14-a899-eceea9da4f3d tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1604 microversion: 2.42 time: 0.581203 Jul 19 22:49:31.629650 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2349/4655] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:31 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1604 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:49:31.630472 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-42511b3a-585a-4ab1-972b-fb27f1bd8d53 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:31.636271 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-42511b3a-585a-4ab1-972b-fb27f1bd8d53 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:31.666249 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42511b3a-585a-4ab1-972b-fb27f1bd8d53 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:31.670996 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42511b3a-585a-4ab1-972b-fb27f1bd8d53 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:31.672097 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42511b3a-585a-4ab1-972b-fb27f1bd8d53 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:31.680901 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-64946c0c-a6c9-40f7-9aac-2d6233b280d1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:31.681841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-64946c0c-a6c9-40f7-9aac-2d6233b280d1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 02571222-3b10-4a0d-8b70-a8202c37f6a7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:31.692226 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-64946c0c-a6c9-40f7-9aac-2d6233b280d1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:31.693124 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42511b3a-585a-4ab1-972b-fb27f1bd8d53 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:31.703889 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-64946c0c-a6c9-40f7-9aac-2d6233b280d1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:31.708441 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-64946c0c-a6c9-40f7-9aac-2d6233b280d1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:31.709159 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-64946c0c-a6c9-40f7-9aac-2d6233b280d1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:31.772364 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-64946c0c-a6c9-40f7-9aac-2d6233b280d1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] HTTP exception thrown: Instance 02571222-3b10-4a0d-8b70-a8202c37f6a7 could not be found. Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-64946c0c-a6c9-40f7-9aac-2d6233b280d1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Request method failure captured: Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 HTTP/1.1 Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zPB9pdZx5bGxAOx1bWrMM0FEhH4uLd_pSCvc_RNVR1Ml3e2RdxqyGOtd-lt2kxygYFNrKmFRc3yVX-y9hoY_QR39GzP2XOyLb00mNIcRNYPp_Z40PO_3EFeEpNqlZOyhEu-fa-kVbsARhW2vxsGD8FHWpMQupoNdZ8KLVFw7a76o8s Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 95469b549ae7425a83e0d93bb8c10860 Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1399962716 Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1399962716 Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 95469b549ae7425a83e0d93bb8c10860 Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1399962716 Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerRescueNegativeTestJSON-1399962716-project Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 5f92608789324ac48fef6ce87a745a07 Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1399962716-project Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 02571222-3b10-4a0d-8b70-a8202c37f6a7 could not be found. Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '02571222-3b10-4a0d-8b70-a8202c37f6a7'} Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02571222-3b10-4a0d-8b70-a8202c37f6a7 could not be found. Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02571222-3b10-4a0d-8b70-a8202c37f6a7 could not be found. Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:31.790403 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:49:31.795859 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:31.795859 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:31.795859 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:49:31.795859 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:49:31.795859 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:49:31.795859 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:49:31.795859 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02571222-3b10-4a0d-8b70-a8202c37f6a7 could not be found. Jul 19 22:49:31.795859 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:31.800758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-64946c0c-a6c9-40f7-9aac-2d6233b280d1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Returning 404 to user: Instance 02571222-3b10-4a0d-8b70-a8202c37f6a7 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:49:31.801898 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-64946c0c-a6c9-40f7-9aac-2d6233b280d1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7" status: 404 len: 111 microversion: 2.1 time: 0.124795 Jul 19 22:49:31.802657 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2350/4656] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:31 2022] GET /compute/v2.1/servers/02571222-3b10-4a0d-8b70-a8202c37f6a7 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:49:31.819180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-12a0f2a8-acb8-4848-99cc-393c02f034f2 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '.version_select at 0x7f7a031c5790>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:31.853562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:49:31.885026 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-12a0f2a8-acb8-4848-99cc-393c02f034f2 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-367448103" status: 202 len: 0 microversion: 2.1 time: 0.075685 Jul 19 22:49:31.885887 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2351/4657] 10.222.0.25 () {58 vars in 1217 bytes} [Tue Jul 19 22:49:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-367448103 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:49:32.172166 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-42511b3a-585a-4ab1-972b-fb27f1bd8d53 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:32.195661 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-42511b3a-585a-4ab1-972b-fb27f1bd8d53 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1527 microversion: 2.1 time: 0.602145 Jul 19 22:49:32.217682 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2307/4658] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:31 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1527 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:32.606992 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2c022a33-dd01-4ab8-93ed-383d47f4d3f0 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:32.609152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2c022a33-dd01-4ab8-93ed-383d47f4d3f0 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] [instance: d770734f-85d5-4f04-9582-b0c2d46396c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:32.641343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3bf63f63-5bca-441d-a7bf-bad4393b6927 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:32.642176 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3bf63f63-5bca-441d-a7bf-bad4393b6927 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:32.658728 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c022a33-dd01-4ab8-93ed-383d47f4d3f0 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:32.659216 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c022a33-dd01-4ab8-93ed-383d47f4d3f0 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:32.660019 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c022a33-dd01-4ab8-93ed-383d47f4d3f0 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:32.665260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3bf63f63-5bca-441d-a7bf-bad4393b6927 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:32.668743 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3bf63f63-5bca-441d-a7bf-bad4393b6927 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:32.670006 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c022a33-dd01-4ab8-93ed-383d47f4d3f0 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:32.676767 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3bf63f63-5bca-441d-a7bf-bad4393b6927 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:32.678411 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3bf63f63-5bca-441d-a7bf-bad4393b6927 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:32.730759 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-2c022a33-dd01-4ab8-93ed-383d47f4d3f0 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] HTTP exception thrown: Instance d770734f-85d5-4f04-9582-b0c2d46396c1 could not be found. Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2c022a33-dd01-4ab8-93ed-383d47f4d3f0 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Request method failure captured: Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1 HTTP/1.1 Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zTPX2pwc3sX71C5YnmBulXL0I8YIZBv_XVSngoQURHilfHjp6hsGJeHfhItJ84XArqtyRU0AP-6-JkmbKKOm8shZyFrVAMfsGeap7aZELfI9Y_uci0GnQMyPZYjkGr43S5tuOXfa57yt0ecadCNuL0OC2_2qd2p1pQdI8wYZC6LlKc Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 94ad9eb9badc4c3d9bab2543e1972b0a Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1102540803 Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94ad9eb9badc4c3d9bab2543e1972b0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94ad9eb9badc4c3d9bab2543e1972b0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94ad9eb9badc4c3d9bab2543e1972b0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94ad9eb9badc4c3d9bab2543e1972b0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1102540803 Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 94ad9eb9badc4c3d9bab2543e1972b0a Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1102540803 Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1102540803-project Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 823427b572044adaa2766653cd2e9e92 Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1102540803-project Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance d770734f-85d5-4f04-9582-b0c2d46396c1 could not be found. Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'd770734f-85d5-4f04-9582-b0c2d46396c1'} Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d770734f-85d5-4f04-9582-b0c2d46396c1 could not be found. Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d770734f-85d5-4f04-9582-b0c2d46396c1 could not be found. Jul 19 22:49:32.736164 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:32.740713 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:49:32.740713 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:32.740713 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:32.740713 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:49:32.740713 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:49:32.740713 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:49:32.740713 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:49:32.740713 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d770734f-85d5-4f04-9582-b0c2d46396c1 could not be found. Jul 19 22:49:32.740713 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:32.740713 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2c022a33-dd01-4ab8-93ed-383d47f4d3f0 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] Returning 404 to user: Instance d770734f-85d5-4f04-9582-b0c2d46396c1 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:49:32.740713 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2c022a33-dd01-4ab8-93ed-383d47f4d3f0 tempest-ServersNegativeTestMultiTenantJSON-1102540803 tempest-ServersNegativeTestMultiTenantJSON-1102540803-project] 10.222.0.25 "GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1" status: 404 len: 111 microversion: 2.1 time: 0.138124 Jul 19 22:49:32.744824 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2352/4659] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:32 2022] GET /compute/v2.1/servers/d770734f-85d5-4f04-9582-b0c2d46396c1 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:49:33.048844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3bf63f63-5bca-441d-a7bf-bad4393b6927 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:33.067428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3bf63f63-5bca-441d-a7bf-bad4393b6927 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:33.075572 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3bf63f63-5bca-441d-a7bf-bad4393b6927 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:33.077765 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3bf63f63-5bca-441d-a7bf-bad4393b6927 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1604 microversion: 2.42 time: 0.442784 Jul 19 22:49:33.082038 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2308/4660] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:32 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1604 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:49:33.160282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-5c0f41a3-615e-4525-9ba9-246d38722014 req-85ea0dc2-34d4-48fe-b775-39e5eb244902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d770734f-85d5-4f04-9582-b0c2d46396c1", "name": "network-vif-deleted", "tag": "ebc2e9fa-1332-4587-be5b-43685e09f75a"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:49:33.180795 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5c0f41a3-615e-4525-9ba9-246d38722014 req-85ea0dc2-34d4-48fe-b775-39e5eb244902 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:33.186534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5c0f41a3-615e-4525-9ba9-246d38722014 req-85ea0dc2-34d4-48fe-b775-39e5eb244902 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:33.236950 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8e7bce2b-e22f-4596-bcea-2e315bcb0bb1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:33.237568 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8e7bce2b-e22f-4596-bcea-2e315bcb0bb1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:33.259408 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8e7bce2b-e22f-4596-bcea-2e315bcb0bb1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:33.262808 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-5c0f41a3-615e-4525-9ba9-246d38722014 req-85ea0dc2-34d4-48fe-b775-39e5eb244902 service nova] Creating event network-vif-deleted:ebc2e9fa-1332-4587-be5b-43685e09f75a for instance d770734f-85d5-4f04-9582-b0c2d46396c1 on n-h1-847009-3 Jul 19 22:49:33.269194 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8e7bce2b-e22f-4596-bcea-2e315bcb0bb1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:33.270175 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8e7bce2b-e22f-4596-bcea-2e315bcb0bb1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:33.270629 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8e7bce2b-e22f-4596-bcea-2e315bcb0bb1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:33.287761 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-5c0f41a3-615e-4525-9ba9-246d38722014 req-85ea0dc2-34d4-48fe-b775-39e5eb244902 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128333 Jul 19 22:49:33.290601 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2353/4661] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:49:33.773377 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8e7bce2b-e22f-4596-bcea-2e315bcb0bb1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:33.789570 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8e7bce2b-e22f-4596-bcea-2e315bcb0bb1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1527 microversion: 2.1 time: 0.559460 Jul 19 22:49:33.796092 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2309/4662] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:33 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1527 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:34.102688 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e514f80d-67e0-4e15-930f-cdeb7f54afbf tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:34.103424 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e514f80d-67e0-4e15-930f-cdeb7f54afbf tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:34.126384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e514f80d-67e0-4e15-930f-cdeb7f54afbf tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:34.129406 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e514f80d-67e0-4e15-930f-cdeb7f54afbf tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:34.136078 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e514f80d-67e0-4e15-930f-cdeb7f54afbf tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:34.136779 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e514f80d-67e0-4e15-930f-cdeb7f54afbf tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:34.811464 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5883adf7-d5ea-47c6-93aa-1f40b894f52a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:34.813726 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5883adf7-d5ea-47c6-93aa-1f40b894f52a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:34.825407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5883adf7-d5ea-47c6-93aa-1f40b894f52a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:34.846266 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5883adf7-d5ea-47c6-93aa-1f40b894f52a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:34.847593 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5883adf7-d5ea-47c6-93aa-1f40b894f52a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:34.849138 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5883adf7-d5ea-47c6-93aa-1f40b894f52a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:34.905754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e514f80d-67e0-4e15-930f-cdeb7f54afbf tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:34.934605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e514f80d-67e0-4e15-930f-cdeb7f54afbf tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:34.939084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e514f80d-67e0-4e15-930f-cdeb7f54afbf tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:34.943347 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e514f80d-67e0-4e15-930f-cdeb7f54afbf tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1604 microversion: 2.42 time: 0.845051 Jul 19 22:49:34.944232 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2354/4663] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:34 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1604 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:49:35.250379 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5883adf7-d5ea-47c6-93aa-1f40b894f52a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:35.267628 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5883adf7-d5ea-47c6-93aa-1f40b894f52a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1527 microversion: 2.1 time: 0.461446 Jul 19 22:49:35.271184 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2310/4664] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:34 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1527 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:49:35.966503 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6fa6eaf0-abef-4d64-a748-13dd0db9dbc7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:35.967865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6fa6eaf0-abef-4d64-a748-13dd0db9dbc7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:36.001820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6fa6eaf0-abef-4d64-a748-13dd0db9dbc7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:36.002299 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6fa6eaf0-abef-4d64-a748-13dd0db9dbc7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:36.018926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6fa6eaf0-abef-4d64-a748-13dd0db9dbc7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:36.019536 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6fa6eaf0-abef-4d64-a748-13dd0db9dbc7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:36.291722 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8986b486-97c7-4fd8-8b13-b8f0c2fc88e0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:36.292347 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8986b486-97c7-4fd8-8b13-b8f0c2fc88e0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:36.306580 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8986b486-97c7-4fd8-8b13-b8f0c2fc88e0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:36.307035 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8986b486-97c7-4fd8-8b13-b8f0c2fc88e0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:36.310441 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8986b486-97c7-4fd8-8b13-b8f0c2fc88e0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:36.311471 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8986b486-97c7-4fd8-8b13-b8f0c2fc88e0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:36.356087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6fa6eaf0-abef-4d64-a748-13dd0db9dbc7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:36.380518 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6fa6eaf0-abef-4d64-a748-13dd0db9dbc7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:36.384606 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6fa6eaf0-abef-4d64-a748-13dd0db9dbc7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:36.400242 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6fa6eaf0-abef-4d64-a748-13dd0db9dbc7 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1604 microversion: 2.42 time: 0.426188 Jul 19 22:49:36.400975 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2355/4665] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:35 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1604 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:49:37.067936 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8986b486-97c7-4fd8-8b13-b8f0c2fc88e0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:37.084459 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8986b486-97c7-4fd8-8b13-b8f0c2fc88e0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1527 microversion: 2.1 time: 0.796499 Jul 19 22:49:37.095333 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2311/4666] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:36 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1527 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:37.112688 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-17a7fa48-aca8-436e-aac0-d6a14187e400 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1564533099", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:49:37.401766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-17a7fa48-aca8-436e-aac0-d6a14187e400 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] validate_networks() for [('0b4cb801-0215-490d-ae19-70ff1ab2ac04', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:49:37.422222 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f2a20198-4f4d-4f6f-8c7b-919ba78bb87a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:37.423144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f2a20198-4f4d-4f6f-8c7b-919ba78bb87a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:37.460217 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f2a20198-4f4d-4f6f-8c7b-919ba78bb87a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:37.460680 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f2a20198-4f4d-4f6f-8c7b-919ba78bb87a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:37.461477 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f2a20198-4f4d-4f6f-8c7b-919ba78bb87a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:37.465105 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f2a20198-4f4d-4f6f-8c7b-919ba78bb87a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:37.933047 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f2a20198-4f4d-4f6f-8c7b-919ba78bb87a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:37.954381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f2a20198-4f4d-4f6f-8c7b-919ba78bb87a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:37.967951 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f2a20198-4f4d-4f6f-8c7b-919ba78bb87a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:37.969550 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f2a20198-4f4d-4f6f-8c7b-919ba78bb87a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1604 microversion: 2.42 time: 0.553287 Jul 19 22:49:37.979358 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2312/4667] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:37 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1604 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:49:38.105361 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b097c407-f654-4052-ab8a-900a9a063ca7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:38.106510 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b097c407-f654-4052-ab8a-900a9a063ca7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:38.140919 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b097c407-f654-4052-ab8a-900a9a063ca7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:38.141375 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b097c407-f654-4052-ab8a-900a9a063ca7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:38.142169 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b097c407-f654-4052-ab8a-900a9a063ca7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:38.142611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b097c407-f654-4052-ab8a-900a9a063ca7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:39.159773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b097c407-f654-4052-ab8a-900a9a063ca7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:39.177009 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b097c407-f654-4052-ab8a-900a9a063ca7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1527 microversion: 2.1 time: 1.077729 Jul 19 22:49:39.179442 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2313/4668] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:38 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1527 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:49:39.195184 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b8f6d4d1-f5ba-4a21-b604-ae3701bef71a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:39.202158 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b8f6d4d1-f5ba-4a21-b604-ae3701bef71a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:39.218159 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8f6d4d1-f5ba-4a21-b604-ae3701bef71a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:39.220030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8f6d4d1-f5ba-4a21-b604-ae3701bef71a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:39.227140 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8f6d4d1-f5ba-4a21-b604-ae3701bef71a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:39.227839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8f6d4d1-f5ba-4a21-b604-ae3701bef71a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:39.564869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b8f6d4d1-f5ba-4a21-b604-ae3701bef71a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:39.581278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b8f6d4d1-f5ba-4a21-b604-ae3701bef71a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:39.583344 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b8f6d4d1-f5ba-4a21-b604-ae3701bef71a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:39.586953 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b8f6d4d1-f5ba-4a21-b604-ae3701bef71a tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1604 microversion: 2.42 time: 0.404369 Jul 19 22:49:39.589970 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2314/4669] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:39 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1604 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:49:39.723639 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-17a7fa48-aca8-436e-aac0-d6a14187e400 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:49:39.724162 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-17a7fa48-aca8-436e-aac0-d6a14187e400 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:49:39.724544 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-17a7fa48-aca8-436e-aac0-d6a14187e400 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:49:39.725324 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-17a7fa48-aca8-436e-aac0-d6a14187e400 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:49:39.725929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-17a7fa48-aca8-436e-aac0-d6a14187e400 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:49:39.749004 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-17a7fa48-aca8-436e-aac0-d6a14187e400 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:39.749793 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-17a7fa48-aca8-436e-aac0-d6a14187e400 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:39.753260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-17a7fa48-aca8-436e-aac0-d6a14187e400 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:39.754058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-17a7fa48-aca8-436e-aac0-d6a14187e400 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:39.804729 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-17a7fa48-aca8-436e-aac0-d6a14187e400 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Getting quotas for project 9974b621c2d64212bc970c2fa98f77af. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:49:39.823937 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-17a7fa48-aca8-436e-aac0-d6a14187e400 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Getting quotas for user 04c4089d759f44d789fa274a98671215 and project 9974b621c2d64212bc970c2fa98f77af. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:49:39.851241 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-17a7fa48-aca8-436e-aac0-d6a14187e400 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:49:39.856497 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-17a7fa48-aca8-436e-aac0-d6a14187e400 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:49:40.096315 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-17a7fa48-aca8-436e-aac0-d6a14187e400 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.290754 Jul 19 22:49:40.108743 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2356/4670] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:49:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 3305 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:49:40.138430 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ab6255f4-1292-4d11-b291-d48336157a8c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:40.142643 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ab6255f4-1292-4d11-b291-d48336157a8c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:40.210691 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-76a0d665-bc76-4931-b411-27f3fbd9ddb5 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:40.219770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-76a0d665-bc76-4931-b411-27f3fbd9ddb5 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:40.256509 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-76a0d665-bc76-4931-b411-27f3fbd9ddb5 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:40.257337 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-76a0d665-bc76-4931-b411-27f3fbd9ddb5 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:40.270351 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-76a0d665-bc76-4931-b411-27f3fbd9ddb5 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:40.273805 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-76a0d665-bc76-4931-b411-27f3fbd9ddb5 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:41.129270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ab6255f4-1292-4d11-b291-d48336157a8c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c4089d759f44d789fa274a98671215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9974b621c2d64212bc970c2fa98f77af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:41.149149 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ab6255f4-1292-4d11-b291-d48336157a8c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 200 len: 1223 microversion: 2.1 time: 1.030322 Jul 19 22:49:41.162369 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2315/4671] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:40 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 1223 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:41.169667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f42d9535-82eb-4e7b-9919-fc5ee1e5a798 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:41.207073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f42d9535-82eb-4e7b-9919-fc5ee1e5a798 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:41.234300 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=82 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:49:41.256749 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f42d9535-82eb-4e7b-9919-fc5ee1e5a798 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:41.261079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f42d9535-82eb-4e7b-9919-fc5ee1e5a798 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:41.262817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f42d9535-82eb-4e7b-9919-fc5ee1e5a798 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:41.264665 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f42d9535-82eb-4e7b-9919-fc5ee1e5a798 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:41.472837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-76a0d665-bc76-4931-b411-27f3fbd9ddb5 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:41.491288 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-76a0d665-bc76-4931-b411-27f3fbd9ddb5 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1527 microversion: 2.1 time: 1.295150 Jul 19 22:49:41.498286 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2357/4672] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:40 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1527 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:41.644481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f42d9535-82eb-4e7b-9919-fc5ee1e5a798 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:41.672976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f42d9535-82eb-4e7b-9919-fc5ee1e5a798 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:41.681174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f42d9535-82eb-4e7b-9919-fc5ee1e5a798 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:41.686402 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f42d9535-82eb-4e7b-9919-fc5ee1e5a798 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1604 microversion: 2.42 time: 0.522478 Jul 19 22:49:41.687740 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2316/4673] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:41 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1604 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:49:42.174938 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8fce96ea-4154-4d9b-94a5-cf784fa0c610 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:42.176146 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8fce96ea-4154-4d9b-94a5-cf784fa0c610 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:42.198741 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8fce96ea-4154-4d9b-94a5-cf784fa0c610 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:42.205722 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8fce96ea-4154-4d9b-94a5-cf784fa0c610 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:42.209352 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8fce96ea-4154-4d9b-94a5-cf784fa0c610 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:42.210143 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8fce96ea-4154-4d9b-94a5-cf784fa0c610 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:42.514750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-110a2226-b58a-41f4-850d-3a627d1b2bea tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:42.515420 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-110a2226-b58a-41f4-850d-3a627d1b2bea tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:42.541200 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-110a2226-b58a-41f4-850d-3a627d1b2bea tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:42.547608 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-110a2226-b58a-41f4-850d-3a627d1b2bea tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:42.548677 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-110a2226-b58a-41f4-850d-3a627d1b2bea tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:42.557875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-110a2226-b58a-41f4-850d-3a627d1b2bea tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:42.705134 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8fce96ea-4154-4d9b-94a5-cf784fa0c610 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c4089d759f44d789fa274a98671215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9974b621c2d64212bc970c2fa98f77af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:42.719797 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8fce96ea-4154-4d9b-94a5-cf784fa0c610 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 200 len: 1275 microversion: 2.1 time: 0.550822 Jul 19 22:49:42.725841 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2358/4674] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:42 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 1275 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:42.732778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6160d1c2-e46e-4557-bdb7-ff5235e5c4b9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:42.741717 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6160d1c2-e46e-4557-bdb7-ff5235e5c4b9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:42.769859 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6160d1c2-e46e-4557-bdb7-ff5235e5c4b9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:42.770800 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6160d1c2-e46e-4557-bdb7-ff5235e5c4b9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:42.786858 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6160d1c2-e46e-4557-bdb7-ff5235e5c4b9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:42.787646 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6160d1c2-e46e-4557-bdb7-ff5235e5c4b9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:43.132288 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6160d1c2-e46e-4557-bdb7-ff5235e5c4b9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:43.153665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6160d1c2-e46e-4557-bdb7-ff5235e5c4b9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:43.162261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6160d1c2-e46e-4557-bdb7-ff5235e5c4b9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ce594215247f28c0311dd73ac4b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a791e36c385948f2b2a879b95fa6b209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:43.171089 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6160d1c2-e46e-4557-bdb7-ff5235e5c4b9 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 200 len: 1604 microversion: 2.42 time: 0.434901 Jul 19 22:49:43.189116 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2359/4675] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:42 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 1604 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:49:43.743919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e0e53fc4-1618-4ee0-abfd-c907d31720db tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:43.745200 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e0e53fc4-1618-4ee0-abfd-c907d31720db tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:43.777431 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e0e53fc4-1618-4ee0-abfd-c907d31720db tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:43.783950 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e0e53fc4-1618-4ee0-abfd-c907d31720db tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:43.786989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e0e53fc4-1618-4ee0-abfd-c907d31720db tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:43.792005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e0e53fc4-1618-4ee0-abfd-c907d31720db tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:44.882337 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e0e53fc4-1618-4ee0-abfd-c907d31720db tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c4089d759f44d789fa274a98671215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9974b621c2d64212bc970c2fa98f77af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:44.909253 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e0e53fc4-1618-4ee0-abfd-c907d31720db tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 200 len: 1281 microversion: 2.1 time: 1.169814 Jul 19 22:49:44.916768 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2360/4676] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:43 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 1281 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:49:44.948306 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8a682c48-87a6-4b4d-a8a9-d86ba47561fb tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:44.955463 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8a682c48-87a6-4b4d-a8a9-d86ba47561fb tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:44.973321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-110a2226-b58a-41f4-850d-3a627d1b2bea tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:44.985144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:49:45.007064 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-110a2226-b58a-41f4-850d-3a627d1b2bea tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1527 microversion: 2.1 time: 2.496991 Jul 19 22:49:45.011057 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2317/4677] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:42 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1527 bytes in 2502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:45.013818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8a682c48-87a6-4b4d-a8a9-d86ba47561fb tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:45.018893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8a682c48-87a6-4b4d-a8a9-d86ba47561fb tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:45.020978 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8a682c48-87a6-4b4d-a8a9-d86ba47561fb tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:45.023000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8a682c48-87a6-4b4d-a8a9-d86ba47561fb tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:45.032877 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:49:45.064165 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-8a682c48-87a6-4b4d-a8a9-d86ba47561fb tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] HTTP exception thrown: Instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 could not be found. Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8a682c48-87a6-4b4d-a8a9-d86ba47561fb tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Request method failure captured: Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 HTTP/1.1 Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zM_2_mlIK3G2YaRmZ8zxA3y4G_eEuh4-ECyPp_cT_RptRnINJc_h9bALQNzjR7I9FxKV5aTusKo-GlG2MDTnJEtC2t3uwENVGz4-WDpxDIy_mGX69o8NOQ8worUOhgGwUy7cobe0e0DUHVoYIcba2NEKvh1V0a1Br6NqxClghbF6Yw Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: X-Openstack-Nova-Api-Version: 2.42 Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a791e36c385948f2b2a879b95fa6b209 Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-32566828 Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a791e36c385948f2b2a879b95fa6b209"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a791e36c385948f2b2a879b95fa6b209"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a791e36c385948f2b2a879b95fa6b209"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a791e36c385948f2b2a879b95fa6b209"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TaggedBootDevicesTest_v242-32566828 Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a791e36c385948f2b2a879b95fa6b209 Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-32566828 Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TaggedBootDevicesTest_v242-32566828-project Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 424ce594215247f28c0311dd73ac4b17 Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TaggedBootDevicesTest_v242-32566828-project Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 could not be found. Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '7d53ca5c-aaa1-44f3-832d-7f2a9a56db39'} Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 could not be found. Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 could not be found. Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:45.067352 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:49:45.071451 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:45.071451 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:45.071451 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:49:45.071451 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:49:45.071451 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:49:45.071451 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:49:45.071451 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 could not be found. Jul 19 22:49:45.071451 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:45.074172 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8a682c48-87a6-4b4d-a8a9-d86ba47561fb tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Returning 404 to user: Instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:49:45.075071 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8a682c48-87a6-4b4d-a8a9-d86ba47561fb tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 404 len: 111 microversion: 2.42 time: 0.155774 Jul 19 22:49:45.075742 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2361/4678] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:44 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:49:45.088222 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cd956e8c-5849-4f9b-9602-d7734d497684 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '.version_select at 0x7f7a107c0790>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:45.152286 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cd956e8c-5849-4f9b-9602-d7734d497684 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1763800021" status: 204 len: 0 microversion: 2.42 time: 0.070574 Jul 19 22:49:45.157098 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2318/4679] 10.222.0.25 () {60 vars in 1261 bytes} [Tue Jul 19 22:49:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1763800021 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:49:45.940078 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-73791167-c054-48f7-b135-5283c63dbcc4 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:45.940790 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-73791167-c054-48f7-b135-5283c63dbcc4 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:45.957660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-73791167-c054-48f7-b135-5283c63dbcc4 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:45.960170 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-73791167-c054-48f7-b135-5283c63dbcc4 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:45.962098 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-73791167-c054-48f7-b135-5283c63dbcc4 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:45.963596 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-73791167-c054-48f7-b135-5283c63dbcc4 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:46.030950 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-db517067-39d0-41d7-8039-cd591b1eb920 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:46.032213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-db517067-39d0-41d7-8039-cd591b1eb920 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:46.068636 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db517067-39d0-41d7-8039-cd591b1eb920 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:46.073041 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db517067-39d0-41d7-8039-cd591b1eb920 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:46.080327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db517067-39d0-41d7-8039-cd591b1eb920 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:46.081259 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db517067-39d0-41d7-8039-cd591b1eb920 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:46.605078 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-73791167-c054-48f7-b135-5283c63dbcc4 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c4089d759f44d789fa274a98671215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9974b621c2d64212bc970c2fa98f77af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:46.619661 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-73791167-c054-48f7-b135-5283c63dbcc4 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 200 len: 1281 microversion: 2.1 time: 0.689502 Jul 19 22:49:46.623479 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2362/4680] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:45 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 1281 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:47.134523 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-db517067-39d0-41d7-8039-cd591b1eb920 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:47.149330 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-db517067-39d0-41d7-8039-cd591b1eb920 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1527 microversion: 2.1 time: 1.124915 Jul 19 22:49:47.172826 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2319/4681] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:46 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1527 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:49:47.638873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bf1e16c4-fe34-4c3c-95bb-d7741663ca3c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:47.639658 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bf1e16c4-fe34-4c3c-95bb-d7741663ca3c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:47.655148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bf1e16c4-fe34-4c3c-95bb-d7741663ca3c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:47.657004 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bf1e16c4-fe34-4c3c-95bb-d7741663ca3c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:47.658618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bf1e16c4-fe34-4c3c-95bb-d7741663ca3c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:47.660125 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bf1e16c4-fe34-4c3c-95bb-d7741663ca3c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:48.179852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-67f2c8e1-9b86-432f-8ae1-d5aad4b0912b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:48.180494 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-67f2c8e1-9b86-432f-8ae1-d5aad4b0912b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:48.199010 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67f2c8e1-9b86-432f-8ae1-d5aad4b0912b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:48.199817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67f2c8e1-9b86-432f-8ae1-d5aad4b0912b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:48.200556 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67f2c8e1-9b86-432f-8ae1-d5aad4b0912b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:48.216515 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67f2c8e1-9b86-432f-8ae1-d5aad4b0912b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:48.519599 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bf1e16c4-fe34-4c3c-95bb-d7741663ca3c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c4089d759f44d789fa274a98671215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9974b621c2d64212bc970c2fa98f77af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:48.531945 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bf1e16c4-fe34-4c3c-95bb-d7741663ca3c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 200 len: 1323 microversion: 2.1 time: 0.897527 Jul 19 22:49:48.532906 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2363/4682] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:47 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 1323 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:49.549366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-414454b2-db99-440c-a06d-27b30649aa18 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:49.550711 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-414454b2-db99-440c-a06d-27b30649aa18 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:49.561994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-414454b2-db99-440c-a06d-27b30649aa18 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:49.565963 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-414454b2-db99-440c-a06d-27b30649aa18 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:49.568556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-414454b2-db99-440c-a06d-27b30649aa18 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:49.570065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-414454b2-db99-440c-a06d-27b30649aa18 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:49.782376 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:49:49.839864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:49:50.255280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-67f2c8e1-9b86-432f-8ae1-d5aad4b0912b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:50.268900 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-67f2c8e1-9b86-432f-8ae1-d5aad4b0912b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1527 microversion: 2.1 time: 2.092961 Jul 19 22:49:50.282985 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2320/4683] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:48 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1527 bytes in 2106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:50.393282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-414454b2-db99-440c-a06d-27b30649aa18 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c4089d759f44d789fa274a98671215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9974b621c2d64212bc970c2fa98f77af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:50.403376 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-414454b2-db99-440c-a06d-27b30649aa18 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 200 len: 1323 microversion: 2.1 time: 0.857963 Jul 19 22:49:50.405501 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2364/4684] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:49 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 1323 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:49:51.038310 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-6eebf568-426c-4259-9b2c-0845e3ab9792 req-f1ba9b0b-de54-46c0-9873-9bfbaa287ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecd77461-3bd1-4bc6-92b3-9d76ded15b13", "tag": "a788699a-cc1a-4989-a394-3914a32e6884"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:49:51.081593 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-6eebf568-426c-4259-9b2c-0845e3ab9792 req-f1ba9b0b-de54-46c0-9873-9bfbaa287ed2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:51.085710 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-6eebf568-426c-4259-9b2c-0845e3ab9792 req-f1ba9b0b-de54-46c0-9873-9bfbaa287ed2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:51.117375 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-6eebf568-426c-4259-9b2c-0845e3ab9792 req-f1ba9b0b-de54-46c0-9873-9bfbaa287ed2 service nova] Creating event network-changed:a788699a-cc1a-4989-a394-3914a32e6884 for instance ecd77461-3bd1-4bc6-92b3-9d76ded15b13 on n-h1-847009-3 Jul 19 22:49:51.130401 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-6eebf568-426c-4259-9b2c-0845e3ab9792 req-f1ba9b0b-de54-46c0-9873-9bfbaa287ed2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097668 Jul 19 22:49:51.131559 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2321/4685] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:49:51.286882 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-82fff99a-6acc-4392-b568-3bd04fd13071 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:51.287665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-82fff99a-6acc-4392-b568-3bd04fd13071 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:51.302358 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-82fff99a-6acc-4392-b568-3bd04fd13071 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:51.302813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-82fff99a-6acc-4392-b568-3bd04fd13071 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:51.316334 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-82fff99a-6acc-4392-b568-3bd04fd13071 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:51.317185 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-82fff99a-6acc-4392-b568-3bd04fd13071 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:51.419744 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:49:51.425571 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-05340c7a-e1ab-4969-b73d-5122c40d8acd tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:51.426551 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-05340c7a-e1ab-4969-b73d-5122c40d8acd tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:51.439684 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05340c7a-e1ab-4969-b73d-5122c40d8acd tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:51.441213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05340c7a-e1ab-4969-b73d-5122c40d8acd tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:51.442482 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05340c7a-e1ab-4969-b73d-5122c40d8acd tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:51.443193 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05340c7a-e1ab-4969-b73d-5122c40d8acd tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:52.990801 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-05340c7a-e1ab-4969-b73d-5122c40d8acd tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c4089d759f44d789fa274a98671215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9974b621c2d64212bc970c2fa98f77af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:53.019534 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-05340c7a-e1ab-4969-b73d-5122c40d8acd tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 200 len: 1323 microversion: 2.1 time: 1.600664 Jul 19 22:49:53.028786 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2322/4686] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:51 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 1323 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:53.077270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-82fff99a-6acc-4392-b568-3bd04fd13071 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:53.089206 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-82fff99a-6acc-4392-b568-3bd04fd13071 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1527 microversion: 2.1 time: 1.806698 Jul 19 22:49:53.095532 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2365/4687] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:51 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1527 bytes in 1813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:54.044835 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6b03a767-b1a5-4ef3-b5cb-b9b6aa66ace1 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:54.045730 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6b03a767-b1a5-4ef3-b5cb-b9b6aa66ace1 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:54.066951 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b03a767-b1a5-4ef3-b5cb-b9b6aa66ace1 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:54.069869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b03a767-b1a5-4ef3-b5cb-b9b6aa66ace1 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:54.074900 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b03a767-b1a5-4ef3-b5cb-b9b6aa66ace1 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:54.078250 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b03a767-b1a5-4ef3-b5cb-b9b6aa66ace1 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:54.107456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-09bb172d-0301-4ab3-a7f2-cc6456a64395 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:54.108260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-09bb172d-0301-4ab3-a7f2-cc6456a64395 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:54.120869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-09bb172d-0301-4ab3-a7f2-cc6456a64395 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:54.124315 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-09bb172d-0301-4ab3-a7f2-cc6456a64395 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:54.125696 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-09bb172d-0301-4ab3-a7f2-cc6456a64395 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:54.126300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-09bb172d-0301-4ab3-a7f2-cc6456a64395 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:54.881984 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-09bb172d-0301-4ab3-a7f2-cc6456a64395 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:54.890206 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-09bb172d-0301-4ab3-a7f2-cc6456a64395 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1509 microversion: 2.1 time: 0.787602 Jul 19 22:49:54.890799 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2366/4688] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:54 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1509 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:49:55.086377 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6b03a767-b1a5-4ef3-b5cb-b9b6aa66ace1 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c4089d759f44d789fa274a98671215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9974b621c2d64212bc970c2fa98f77af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:55.098630 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6b03a767-b1a5-4ef3-b5cb-b9b6aa66ace1 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 200 len: 1323 microversion: 2.1 time: 1.058746 Jul 19 22:49:55.102020 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2323/4689] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:54 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 1323 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:55.335094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-04fc84b6-43be-4329-be91-d99cb5da4f4e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:55.335814 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-04fc84b6-43be-4329-be91-d99cb5da4f4e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:55.369082 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04fc84b6-43be-4329-be91-d99cb5da4f4e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:55.369612 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04fc84b6-43be-4329-be91-d99cb5da4f4e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:55.370463 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04fc84b6-43be-4329-be91-d99cb5da4f4e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:55.370908 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04fc84b6-43be-4329-be91-d99cb5da4f4e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:55.453720 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-04fc84b6-43be-4329-be91-d99cb5da4f4e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:49:55.478705 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-604e804b-a4bf-444d-9001-04ac74a3d475 req-c2839051-fd39-4a24-bef6-39658134847a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb0d2fe2-80ea-4fc2-a157-f7341877997c", "name": "network-vif-unplugged", "status": "completed", "tag": "2cb0e711-7270-4e34-9663-e6877d3106eb"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:49:55.492572 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-604e804b-a4bf-444d-9001-04ac74a3d475 req-c2839051-fd39-4a24-bef6-39658134847a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:55.493975 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-604e804b-a4bf-444d-9001-04ac74a3d475 req-c2839051-fd39-4a24-bef6-39658134847a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:55.524081 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-604e804b-a4bf-444d-9001-04ac74a3d475 req-c2839051-fd39-4a24-bef6-39658134847a service nova] Creating event network-vif-unplugged:2cb0e711-7270-4e34-9663-e6877d3106eb for instance fb0d2fe2-80ea-4fc2-a157-f7341877997c on n-h1-847009-3 Jul 19 22:49:55.551588 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-604e804b-a4bf-444d-9001-04ac74a3d475 req-c2839051-fd39-4a24-bef6-39658134847a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059861 Jul 19 22:49:55.552537 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2324/4690] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:49:55.617954 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-04fc84b6-43be-4329-be91-d99cb5da4f4e tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "DELETE /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 204 len: 0 microversion: 2.1 time: 0.286648 Jul 19 22:49:55.619558 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2367/4691] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:49:55 2022] DELETE /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:49:55.629023 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-98b9a4c9-c8d3-452b-837b-92e6dd806125 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:55.629986 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-98b9a4c9-c8d3-452b-837b-92e6dd806125 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:55.642382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-98b9a4c9-c8d3-452b-837b-92e6dd806125 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:55.645481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-98b9a4c9-c8d3-452b-837b-92e6dd806125 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:55.648196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-98b9a4c9-c8d3-452b-837b-92e6dd806125 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:55.648953 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-98b9a4c9-c8d3-452b-837b-92e6dd806125 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:55.907191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8d388938-8623-4fc1-b151-aafe6f44551a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:55.907950 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8d388938-8623-4fc1-b151-aafe6f44551a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:55.925180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d388938-8623-4fc1-b151-aafe6f44551a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:55.925643 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d388938-8623-4fc1-b151-aafe6f44551a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:55.926460 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d388938-8623-4fc1-b151-aafe6f44551a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:55.926979 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d388938-8623-4fc1-b151-aafe6f44551a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:56.462403 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-98b9a4c9-c8d3-452b-837b-92e6dd806125 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:56.476249 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-98b9a4c9-c8d3-452b-837b-92e6dd806125 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1507 microversion: 2.1 time: 0.852165 Jul 19 22:49:56.477932 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2325/4692] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:55 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1507 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:49:56.487088 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d20b668b-6944-4110-a1a9-bfd83335b512 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:56.492676 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d20b668b-6944-4110-a1a9-bfd83335b512 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:56.506668 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d20b668b-6944-4110-a1a9-bfd83335b512 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:56.509747 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d20b668b-6944-4110-a1a9-bfd83335b512 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:56.513746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d20b668b-6944-4110-a1a9-bfd83335b512 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:56.514521 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d20b668b-6944-4110-a1a9-bfd83335b512 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:56.708007 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8d388938-8623-4fc1-b151-aafe6f44551a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:56.718675 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8d388938-8623-4fc1-b151-aafe6f44551a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1509 microversion: 2.1 time: 0.815711 Jul 19 22:49:56.719961 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2368/4693] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:55 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1509 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:49:57.493982 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-66375d1e-ec8f-43d0-857e-9abe6ae25b40 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:57.494954 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-66375d1e-ec8f-43d0-857e-9abe6ae25b40 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:57.505637 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66375d1e-ec8f-43d0-857e-9abe6ae25b40 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:57.511848 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66375d1e-ec8f-43d0-857e-9abe6ae25b40 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:57.513658 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66375d1e-ec8f-43d0-857e-9abe6ae25b40 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:57.519809 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66375d1e-ec8f-43d0-857e-9abe6ae25b40 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:58.394483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d20b668b-6944-4110-a1a9-bfd83335b512 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c4089d759f44d789fa274a98671215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9974b621c2d64212bc970c2fa98f77af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:58.408293 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d20b668b-6944-4110-a1a9-bfd83335b512 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 200 len: 1323 microversion: 2.1 time: 1.928919 Jul 19 22:49:58.409388 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2326/4694] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:56 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 1323 bytes in 1930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:58.417269 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6375c411-8c3c-4f10-b0c5-6cbf6abe9671 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:58.424790 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-66375d1e-ec8f-43d0-857e-9abe6ae25b40 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:58.429130 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6375c411-8c3c-4f10-b0c5-6cbf6abe9671 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:58.434639 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-66375d1e-ec8f-43d0-857e-9abe6ae25b40 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1507 microversion: 2.1 time: 0.944608 Jul 19 22:49:58.437913 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2369/4695] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:57 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1507 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:58.443858 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6375c411-8c3c-4f10-b0c5-6cbf6abe9671 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:58.444524 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6375c411-8c3c-4f10-b0c5-6cbf6abe9671 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:58.445625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6375c411-8c3c-4f10-b0c5-6cbf6abe9671 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:58.446297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6375c411-8c3c-4f10-b0c5-6cbf6abe9671 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:58.451333 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1220398b-034e-4a67-b2d9-64f44774a0c3 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:58.457662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1220398b-034e-4a67-b2d9-64f44774a0c3 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:58.479297 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1220398b-034e-4a67-b2d9-64f44774a0c3 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:58.479795 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1220398b-034e-4a67-b2d9-64f44774a0c3 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:58.480646 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1220398b-034e-4a67-b2d9-64f44774a0c3 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:58.482088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1220398b-034e-4a67-b2d9-64f44774a0c3 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:58.517176 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-1220398b-034e-4a67-b2d9-64f44774a0c3 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] HTTP exception thrown: Instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 could not be found. Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1220398b-034e-4a67-b2d9-64f44774a0c3 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Request method failure captured: Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 HTTP/1.1 Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zM_2_mlIK3G2YaRmZ8zxA3y4G_eEuh4-ECyPp_cT_RptRnINJc_h9bALQNzjR7I9FxKV5aTusKo-GlG2MDTnJEtC2t3uwENVGz4-WDpxDIy_mGX69o8NOQ8worUOhgGwUy7cobe0e0DUHVoYIcba2NEKvh1V0a1Br6NqxClghbF6Yw Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: X-Openstack-Nova-Api-Version: 2.42 Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a791e36c385948f2b2a879b95fa6b209 Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-32566828 Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a791e36c385948f2b2a879b95fa6b209"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a791e36c385948f2b2a879b95fa6b209"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a791e36c385948f2b2a879b95fa6b209"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a791e36c385948f2b2a879b95fa6b209"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TaggedBootDevicesTest_v242-32566828 Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a791e36c385948f2b2a879b95fa6b209 Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-32566828 Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TaggedBootDevicesTest_v242-32566828-project Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 424ce594215247f28c0311dd73ac4b17 Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TaggedBootDevicesTest_v242-32566828-project Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 could not be found. Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '7d53ca5c-aaa1-44f3-832d-7f2a9a56db39'} Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 could not be found. Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:49:58.518773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:49:58.529531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 could not be found. Jul 19 22:49:58.529531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:58.529531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:49:58.529531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:58.529531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:58.529531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:49:58.529531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:49:58.529531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:49:58.529531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:49:58.529531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 could not be found. Jul 19 22:49:58.529531 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:58.529531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1220398b-034e-4a67-b2d9-64f44774a0c3 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Returning 404 to user: Instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:49:58.529531 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1220398b-034e-4a67-b2d9-64f44774a0c3 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 404 len: 111 microversion: 2.42 time: 0.080936 Jul 19 22:49:58.529531 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2370/4696] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 22:49:58 2022] DELETE /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:49:58.534270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-25c65467-fa19-4fe2-82e0-b877302b9a83 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:58.534900 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-25c65467-fa19-4fe2-82e0-b877302b9a83 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] [instance: 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:58.551628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-25c65467-fa19-4fe2-82e0-b877302b9a83 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:58.552086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-25c65467-fa19-4fe2-82e0-b877302b9a83 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:58.552877 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-25c65467-fa19-4fe2-82e0-b877302b9a83 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:58.555203 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-25c65467-fa19-4fe2-82e0-b877302b9a83 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:58.590692 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-25c65467-fa19-4fe2-82e0-b877302b9a83 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] HTTP exception thrown: Instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 could not be found. Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-25c65467-fa19-4fe2-82e0-b877302b9a83 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Request method failure captured: Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 HTTP/1.1 Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zM_2_mlIK3G2YaRmZ8zxA3y4G_eEuh4-ECyPp_cT_RptRnINJc_h9bALQNzjR7I9FxKV5aTusKo-GlG2MDTnJEtC2t3uwENVGz4-WDpxDIy_mGX69o8NOQ8worUOhgGwUy7cobe0e0DUHVoYIcba2NEKvh1V0a1Br6NqxClghbF6Yw Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: X-Openstack-Nova-Api-Version: 2.42 Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a791e36c385948f2b2a879b95fa6b209 Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-32566828 Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a791e36c385948f2b2a879b95fa6b209"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a791e36c385948f2b2a879b95fa6b209"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a791e36c385948f2b2a879b95fa6b209"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a791e36c385948f2b2a879b95fa6b209"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TaggedBootDevicesTest_v242-32566828 Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a791e36c385948f2b2a879b95fa6b209 Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-32566828 Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TaggedBootDevicesTest_v242-32566828-project Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 424ce594215247f28c0311dd73ac4b17 Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TaggedBootDevicesTest_v242-32566828-project Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 could not be found. Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '7d53ca5c-aaa1-44f3-832d-7f2a9a56db39'} Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 could not be found. Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 could not be found. Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:58.594841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:49:58.598949 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:58.598949 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:49:58.598949 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:49:58.598949 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:49:58.598949 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:49:58.598949 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:49:58.598949 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 could not be found. Jul 19 22:49:58.598949 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:49:58.602109 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-25c65467-fa19-4fe2-82e0-b877302b9a83 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] Returning 404 to user: Instance 7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:49:58.608319 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-25c65467-fa19-4fe2-82e0-b877302b9a83 tempest-TaggedBootDevicesTest_v242-32566828 tempest-TaggedBootDevicesTest_v242-32566828-project] 10.222.0.25 "GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39" status: 404 len: 111 microversion: 2.42 time: 0.081133 Jul 19 22:49:58.611237 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2371/4697] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:49:58 2022] GET /compute/v2.1/servers/7d53ca5c-aaa1-44f3-832d-7f2a9a56db39 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:49:59.204355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6375c411-8c3c-4f10-b0c5-6cbf6abe9671 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:49:59.236066 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6375c411-8c3c-4f10-b0c5-6cbf6abe9671 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1452 microversion: 2.1 time: 0.806072 Jul 19 22:49:59.241743 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2327/4698] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:58 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1452 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:49:59.258274 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-06568af2-2402-460a-b969-2900dc4a5572 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:59.259077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-06568af2-2402-460a-b969-2900dc4a5572 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:59.271606 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-06568af2-2402-460a-b969-2900dc4a5572 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:59.272074 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-06568af2-2402-460a-b969-2900dc4a5572 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:59.272873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-06568af2-2402-460a-b969-2900dc4a5572 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:59.273320 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-06568af2-2402-460a-b969-2900dc4a5572 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:59.427905 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0bdae137-1786-4671-8750-96f670b1ee45 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:49:59.428779 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0bdae137-1786-4671-8750-96f670b1ee45 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:49:59.443637 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0bdae137-1786-4671-8750-96f670b1ee45 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:59.445015 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0bdae137-1786-4671-8750-96f670b1ee45 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:49:59.447210 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0bdae137-1786-4671-8750-96f670b1ee45 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:49:59.450110 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0bdae137-1786-4671-8750-96f670b1ee45 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:00.196550 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0bdae137-1786-4671-8750-96f670b1ee45 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c4089d759f44d789fa274a98671215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9974b621c2d64212bc970c2fa98f77af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:00.198962 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-06568af2-2402-460a-b969-2900dc4a5572 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:00.216999 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-06568af2-2402-460a-b969-2900dc4a5572 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1452 microversion: 2.1 time: 0.961911 Jul 19 22:50:00.217601 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2372/4699] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:59 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1452 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:00.226411 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0bdae137-1786-4671-8750-96f670b1ee45 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 200 len: 1323 microversion: 2.1 time: 0.803971 Jul 19 22:50:00.227641 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2328/4700] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:49:59 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 1323 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:00.243308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1a5e25e3-3987-4692-b305-26f1f614ebc6 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:00.243942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1a5e25e3-3987-4692-b305-26f1f614ebc6 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:00.252543 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-9ef35c65-3f92-47a8-a57d-bdc36aec4577 req-111c016c-00d2-43fa-9c1f-0b3fdcd9dff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecd77461-3bd1-4bc6-92b3-9d76ded15b13", "name": "network-vif-plugged", "status": "completed", "tag": "a788699a-cc1a-4989-a394-3914a32e6884"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:00.271826 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a5e25e3-3987-4692-b305-26f1f614ebc6 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:00.272195 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a5e25e3-3987-4692-b305-26f1f614ebc6 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:00.272987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a5e25e3-3987-4692-b305-26f1f614ebc6 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:00.275883 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-9ef35c65-3f92-47a8-a57d-bdc36aec4577 req-111c016c-00d2-43fa-9c1f-0b3fdcd9dff5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:00.276563 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-9ef35c65-3f92-47a8-a57d-bdc36aec4577 req-111c016c-00d2-43fa-9c1f-0b3fdcd9dff5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:00.279993 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a5e25e3-3987-4692-b305-26f1f614ebc6 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:00.325734 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-9ef35c65-3f92-47a8-a57d-bdc36aec4577 req-111c016c-00d2-43fa-9c1f-0b3fdcd9dff5 service nova] Creating event network-vif-plugged:a788699a-cc1a-4989-a394-3914a32e6884 for instance ecd77461-3bd1-4bc6-92b3-9d76ded15b13 on n-h1-847009-3 Jul 19 22:50:00.347056 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-9ef35c65-3f92-47a8-a57d-bdc36aec4577 req-111c016c-00d2-43fa-9c1f-0b3fdcd9dff5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115267 Jul 19 22:50:00.353591 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2329/4701] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:50:00.621840 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1a5e25e3-3987-4692-b305-26f1f614ebc6 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:00.633972 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1a5e25e3-3987-4692-b305-26f1f614ebc6 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 200 len: 1465 microversion: 2.1 time: 0.413020 Jul 19 22:50:00.642479 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2373/4702] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:00 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 1465 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:00.671875 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c96ada70-5fe9-4e29-8dd3-4b2eeb10f879 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:00.672430 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c96ada70-5fe9-4e29-8dd3-4b2eeb10f879 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:00.726537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c96ada70-5fe9-4e29-8dd3-4b2eeb10f879 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:00.727016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c96ada70-5fe9-4e29-8dd3-4b2eeb10f879 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:00.727858 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c96ada70-5fe9-4e29-8dd3-4b2eeb10f879 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:00.744561 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c96ada70-5fe9-4e29-8dd3-4b2eeb10f879 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:00.893689 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-c96ada70-5fe9-4e29-8dd3-4b2eeb10f879 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lazy-loading 'flavor' on Instance uuid fb0d2fe2-80ea-4fc2-a157-f7341877997c {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:50:00.898899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4bab0ca5-066a-4d79-86b1-15d70e45fd6b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1380849263 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1380849263-project-admin] Calling method '.version_select at 0x7f7a107c2670>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:00.900697 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:50:00.900697 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:50:00.902508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4bab0ca5-066a-4d79-86b1-15d70e45fd6b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1380849263 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1380849263-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:00.905383 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4bab0ca5-066a-4d79-86b1-15d70e45fd6b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1380849263 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1380849263-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:00.947361 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-c96ada70-5fe9-4e29-8dd3-4b2eeb10f879 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Cannot 'shelve' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state shelved_offloaded Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c96ada70-5fe9-4e29-8dd3-4b2eeb10f879 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action HTTP/1.1 Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 14 Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: {"shelve": {}} Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: exception: Cannot 'shelve' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state shelved_offloaded Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'fb0d2fe2-80ea-4fc2-a157-f7341877997c', 'body': {'shelve': {}}} Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fb0d2fe2-80ea-4fc2-a157-f7341877997c in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 19 22:50:00.949068 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 22:50:00.954255 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 22:50:00.954255 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 22:50:00.954255 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state shelved_offloaded Jul 19 22:50:00.954255 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:50:00.954255 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:50:00.954255 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:50:00.954255 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:00.954255 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:50:00.954255 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:50:00.954255 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:50:00.954255 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:50:00.954255 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state shelved_offloaded Jul 19 22:50:00.954255 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:50:00.954255 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c96ada70-5fe9-4e29-8dd3-4b2eeb10f879 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 409 to user: Cannot 'shelve' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state shelved_offloaded {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:50:00.958163 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c96ada70-5fe9-4e29-8dd3-4b2eeb10f879 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action" status: 409 len: 155 microversion: 2.1 time: 0.314476 Jul 19 22:50:00.958803 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2374/4703] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:50:00 2022] POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action => generated 155 bytes in 316 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:50:00.962917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4bab0ca5-066a-4d79-86b1-15d70e45fd6b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1380849263 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1380849263-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:00.963441 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4bab0ca5-066a-4d79-86b1-15d70e45fd6b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1380849263 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1380849263-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:00.982741 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-286b3773-938d-4969-91b0-cdbff5abee9d req-57eb0990-a52a-447a-8ef7-705e68c50b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77e3dc73-fee1-4b35-8506-9acfc60bc789", "name": "network-vif-deleted", "tag": "617c6e0e-4424-4a36-8c61-7159e4a929a2"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:01.013059 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-286b3773-938d-4969-91b0-cdbff5abee9d req-57eb0990-a52a-447a-8ef7-705e68c50b66 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:01.013512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-286b3773-938d-4969-91b0-cdbff5abee9d req-57eb0990-a52a-447a-8ef7-705e68c50b66 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:01.018396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4bab0ca5-066a-4d79-86b1-15d70e45fd6b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1380849263 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1380849263-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:01.018858 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4bab0ca5-066a-4d79-86b1-15d70e45fd6b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1380849263 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1380849263-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:01.035555 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4bab0ca5-066a-4d79-86b1-15d70e45fd6b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1380849263 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1380849263-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.680310 Jul 19 22:50:01.036182 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2330/4704] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:50:00 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:50:01.046371 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-deaf212c-9327-4934-8d28-9c0b0619418d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:01.053114 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-286b3773-938d-4969-91b0-cdbff5abee9d req-57eb0990-a52a-447a-8ef7-705e68c50b66 service nova] Creating event network-vif-deleted:617c6e0e-4424-4a36-8c61-7159e4a929a2 for instance 77e3dc73-fee1-4b35-8506-9acfc60bc789 on n-h2-847009-3 Jul 19 22:50:01.062925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-deaf212c-9327-4934-8d28-9c0b0619418d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:01.066772 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-286b3773-938d-4969-91b0-cdbff5abee9d req-57eb0990-a52a-447a-8ef7-705e68c50b66 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094290 Jul 19 22:50:01.071211 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2375/4705] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:50:01.083585 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-deaf212c-9327-4934-8d28-9c0b0619418d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:01.084049 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-deaf212c-9327-4934-8d28-9c0b0619418d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:01.084853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-deaf212c-9327-4934-8d28-9c0b0619418d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:01.085297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-deaf212c-9327-4934-8d28-9c0b0619418d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:01.245900 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2f4747ac-6d23-4d82-8fca-d7c869da0eaa tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:01.246629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2f4747ac-6d23-4d82-8fca-d7c869da0eaa tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:01.257475 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f4747ac-6d23-4d82-8fca-d7c869da0eaa tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:01.257932 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f4747ac-6d23-4d82-8fca-d7c869da0eaa tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:01.259996 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f4747ac-6d23-4d82-8fca-d7c869da0eaa tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:01.266475 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f4747ac-6d23-4d82-8fca-d7c869da0eaa tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:01.426216 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-deaf212c-9327-4934-8d28-9c0b0619418d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action" status: 202 len: 0 microversion: 2.1 time: 0.388881 Jul 19 22:50:01.430187 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2331/4706] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:50:01 2022] POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:50:01.435681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-65649fa4-291c-4313-97af-5ae30a9b047c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:01.442259 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-65649fa4-291c-4313-97af-5ae30a9b047c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:01.463844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65649fa4-291c-4313-97af-5ae30a9b047c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:01.464587 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65649fa4-291c-4313-97af-5ae30a9b047c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:01.465552 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65649fa4-291c-4313-97af-5ae30a9b047c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:01.466779 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65649fa4-291c-4313-97af-5ae30a9b047c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:02.738421 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-65649fa4-291c-4313-97af-5ae30a9b047c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:02.748473 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-65649fa4-291c-4313-97af-5ae30a9b047c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1460 microversion: 2.1 time: 1.315955 Jul 19 22:50:02.750222 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2332/4707] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:01 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1460 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:02.755835 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e5292621-f520-495c-91b5-118420e40ea4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:02.756847 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e5292621-f520-495c-91b5-118420e40ea4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 77e3dc73-fee1-4b35-8506-9acfc60bc789] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:02.767086 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5292621-f520-495c-91b5-118420e40ea4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:02.767915 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5292621-f520-495c-91b5-118420e40ea4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:02.769148 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5292621-f520-495c-91b5-118420e40ea4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:02.769866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5292621-f520-495c-91b5-118420e40ea4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:02.792486 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-e5292621-f520-495c-91b5-118420e40ea4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] HTTP exception thrown: Instance 77e3dc73-fee1-4b35-8506-9acfc60bc789 could not be found. Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e5292621-f520-495c-91b5-118420e40ea4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Request method failure captured: Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 HTTP/1.1 Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zPB9pdZx5bGxAOx1bWrMM0FEhH4uLd_pSCvc_RNVR1Ml3e2RdxqyGOtd-lt2kxygYFNrKmFRc3yVX-y9hoY_QR39GzP2XOyLb00mNIcRNYPp_Z40PO_3EFeEpNqlZOyhEu-fa-kVbsARhW2vxsGD8FHWpMQupoNdZ8KLVFw7a76o8s Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 95469b549ae7425a83e0d93bb8c10860 Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1399962716 Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1399962716 Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 95469b549ae7425a83e0d93bb8c10860 Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1399962716 Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerRescueNegativeTestJSON-1399962716-project Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 5f92608789324ac48fef6ce87a745a07 Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1399962716-project Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 77e3dc73-fee1-4b35-8506-9acfc60bc789 could not be found. Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '77e3dc73-fee1-4b35-8506-9acfc60bc789'} Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77e3dc73-fee1-4b35-8506-9acfc60bc789 could not be found. Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77e3dc73-fee1-4b35-8506-9acfc60bc789 could not be found. Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:02.794318 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:50:02.799918 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:02.799918 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:02.799918 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:50:02.799918 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:50:02.799918 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:50:02.799918 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:50:02.799918 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77e3dc73-fee1-4b35-8506-9acfc60bc789 could not be found. Jul 19 22:50:02.799918 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:02.799918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e5292621-f520-495c-91b5-118420e40ea4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Returning 404 to user: Instance 77e3dc73-fee1-4b35-8506-9acfc60bc789 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:50:02.799918 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e5292621-f520-495c-91b5-118420e40ea4 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789" status: 404 len: 111 microversion: 2.1 time: 0.044401 Jul 19 22:50:02.802545 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2333/4708] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:02 2022] GET /compute/v2.1/servers/77e3dc73-fee1-4b35-8506-9acfc60bc789 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:50:02.805802 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cdff32b3-ddde-4fa3-bbd2-173b96cc63f3 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:02.806369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cdff32b3-ddde-4fa3-bbd2-173b96cc63f3 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:02.817750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cdff32b3-ddde-4fa3-bbd2-173b96cc63f3 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:02.818635 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cdff32b3-ddde-4fa3-bbd2-173b96cc63f3 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:02.819276 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cdff32b3-ddde-4fa3-bbd2-173b96cc63f3 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:02.819732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cdff32b3-ddde-4fa3-bbd2-173b96cc63f3 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:02.891525 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cdff32b3-ddde-4fa3-bbd2-173b96cc63f3 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:50:02.996675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2f4747ac-6d23-4d82-8fca-d7c869da0eaa tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c4089d759f44d789fa274a98671215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9974b621c2d64212bc970c2fa98f77af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:03.005055 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2f4747ac-6d23-4d82-8fca-d7c869da0eaa tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 200 len: 1323 microversion: 2.1 time: 1.763926 Jul 19 22:50:03.019227 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2376/4709] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:01 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 1323 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:03.079161 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cdff32b3-ddde-4fa3-bbd2-173b96cc63f3 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "DELETE /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae" status: 204 len: 0 microversion: 2.1 time: 0.277498 Jul 19 22:50:03.084335 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2334/4710] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:50:02 2022] DELETE /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:50:03.093844 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b17ef526-ff59-49c7-9a30-5c1f83fcd820 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:03.094478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b17ef526-ff59-49c7-9a30-5c1f83fcd820 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:03.106029 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:50:03.108815 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b17ef526-ff59-49c7-9a30-5c1f83fcd820 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:03.111663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b17ef526-ff59-49c7-9a30-5c1f83fcd820 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:03.112603 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b17ef526-ff59-49c7-9a30-5c1f83fcd820 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:03.113064 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b17ef526-ff59-49c7-9a30-5c1f83fcd820 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:03.495560 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b17ef526-ff59-49c7-9a30-5c1f83fcd820 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:03.507986 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b17ef526-ff59-49c7-9a30-5c1f83fcd820 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae" status: 200 len: 1522 microversion: 2.1 time: 0.419403 Jul 19 22:50:03.508802 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2377/4711] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:03 2022] GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:03.767435 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9ad8f8ea-7deb-44e7-b2e2-7d0652663ff1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:03.768177 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9ad8f8ea-7deb-44e7-b2e2-7d0652663ff1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:03.788653 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ad8f8ea-7deb-44e7-b2e2-7d0652663ff1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:03.790141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ad8f8ea-7deb-44e7-b2e2-7d0652663ff1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:03.791878 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ad8f8ea-7deb-44e7-b2e2-7d0652663ff1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:03.793287 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ad8f8ea-7deb-44e7-b2e2-7d0652663ff1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:03.865176 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:50:04.024777 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ea1a8ca1-20b7-47a9-ac1f-bcad8514873d tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:04.026190 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ea1a8ca1-20b7-47a9-ac1f-bcad8514873d tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:04.039552 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea1a8ca1-20b7-47a9-ac1f-bcad8514873d tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:04.043235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea1a8ca1-20b7-47a9-ac1f-bcad8514873d tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:04.044256 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea1a8ca1-20b7-47a9-ac1f-bcad8514873d tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:04.044818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea1a8ca1-20b7-47a9-ac1f-bcad8514873d tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:04.383975 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9ad8f8ea-7deb-44e7-b2e2-7d0652663ff1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:04.393645 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9ad8f8ea-7deb-44e7-b2e2-7d0652663ff1 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1518 microversion: 2.1 time: 0.631468 Jul 19 22:50:04.394247 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2335/4712] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:03 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1518 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:04.525846 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-af58fbfb-7f57-43bd-b75c-579ef30fc183 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:04.526475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-af58fbfb-7f57-43bd-b75c-579ef30fc183 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:04.534404 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af58fbfb-7f57-43bd-b75c-579ef30fc183 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:04.534862 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af58fbfb-7f57-43bd-b75c-579ef30fc183 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:04.537659 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af58fbfb-7f57-43bd-b75c-579ef30fc183 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:04.542295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af58fbfb-7f57-43bd-b75c-579ef30fc183 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:04.890088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ea1a8ca1-20b7-47a9-ac1f-bcad8514873d tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c4089d759f44d789fa274a98671215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9974b621c2d64212bc970c2fa98f77af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:04.892339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:50:04.900144 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ea1a8ca1-20b7-47a9-ac1f-bcad8514873d tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 200 len: 1517 microversion: 2.1 time: 0.881847 Jul 19 22:50:04.907492 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2378/4713] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:04 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 1517 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:50:04.923576 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1f60c13b-2b43-443d-9e59-98ffd0a1932c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:04.924745 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1f60c13b-2b43-443d-9e59-98ffd0a1932c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:04.952271 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1f60c13b-2b43-443d-9e59-98ffd0a1932c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:04.952974 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1f60c13b-2b43-443d-9e59-98ffd0a1932c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:04.953587 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1f60c13b-2b43-443d-9e59-98ffd0a1932c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:04.954041 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1f60c13b-2b43-443d-9e59-98ffd0a1932c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:05.035173 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-1f60c13b-2b43-443d-9e59-98ffd0a1932c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lazy-loading 'flavor' on Instance uuid ecd77461-3bd1-4bc6-92b3-9d76ded15b13 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:50:05.232684 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1f60c13b-2b43-443d-9e59-98ffd0a1932c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "POST /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13/action" status: 200 len: 32 microversion: 2.1 time: 0.315559 Jul 19 22:50:05.233776 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2379/4714] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:50:04 2022] POST /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13/action => generated 32 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:50:05.243612 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e2576416-3834-4a87-a914-a908f6eec787 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:05.251087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e2576416-3834-4a87-a914-a908f6eec787 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:05.273787 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2576416-3834-4a87-a914-a908f6eec787 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:05.279747 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2576416-3834-4a87-a914-a908f6eec787 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:05.281367 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2576416-3834-4a87-a914-a908f6eec787 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:05.286571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2576416-3834-4a87-a914-a908f6eec787 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:05.342796 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-af58fbfb-7f57-43bd-b75c-579ef30fc183 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:05.355586 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-af58fbfb-7f57-43bd-b75c-579ef30fc183 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae" status: 200 len: 1522 microversion: 2.1 time: 0.833456 Jul 19 22:50:05.357276 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2336/4715] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:04 2022] GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae => generated 1522 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:50:05.418605 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5392b68f-5a7f-4a58-ae22-c542a1fc165e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:05.433497 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5392b68f-5a7f-4a58-ae22-c542a1fc165e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:05.453378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5392b68f-5a7f-4a58-ae22-c542a1fc165e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:05.460550 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5392b68f-5a7f-4a58-ae22-c542a1fc165e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:05.461729 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5392b68f-5a7f-4a58-ae22-c542a1fc165e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:05.462548 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5392b68f-5a7f-4a58-ae22-c542a1fc165e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:06.469358 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5392b68f-5a7f-4a58-ae22-c542a1fc165e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:06.483407 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5392b68f-5a7f-4a58-ae22-c542a1fc165e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1518 microversion: 2.1 time: 1.067886 Jul 19 22:50:06.485166 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2337/4716] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:05 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1518 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:06.501364 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3e728094-b0ad-457b-8997-70f7bcd018a1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:06.504023 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3e728094-b0ad-457b-8997-70f7bcd018a1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:06.530927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e728094-b0ad-457b-8997-70f7bcd018a1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:06.534786 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e728094-b0ad-457b-8997-70f7bcd018a1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:06.537063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e728094-b0ad-457b-8997-70f7bcd018a1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:06.539242 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e728094-b0ad-457b-8997-70f7bcd018a1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:07.128036 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e2576416-3834-4a87-a914-a908f6eec787 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c4089d759f44d789fa274a98671215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9974b621c2d64212bc970c2fa98f77af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:07.152689 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e2576416-3834-4a87-a914-a908f6eec787 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 200 len: 1523 microversion: 2.1 time: 1.910241 Jul 19 22:50:07.163580 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2380/4717] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:05 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 1523 bytes in 1925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:50:07.475327 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2c32dea3-5b4a-490c-bad6-c2a4e43f71c1 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Action: 'create', calling method: .version_select at 0x7f7a039c4af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-487307538", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvZAGEh209ID2YoTEP5t0tVbBTDxxtf59q9eUhPaKTMTtZ76FLeDMhpYAtKe+uTLTbNJMgs0Z15Ch15wECssMnoO3E/OowqhfKvX0q6at7U1Cp1IM+7dKQ0pWmVSc0ihA=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:07.513549 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-2c32dea3-5b4a-490c-bad6-c2a4e43f71c1 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Getting quotas for project 4b56c5370d5846f8a8c1535c127c0e12. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:50:07.533424 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-2c32dea3-5b4a-490c-bad6-c2a4e43f71c1 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Getting quotas for user dcfdbbdf932b43b38725f60dadc738c9 and project 4b56c5370d5846f8a8c1535c127c0e12. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:50:07.629853 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2c32dea3-5b4a-490c-bad6-c2a4e43f71c1 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.462313 Jul 19 22:50:07.632697 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2381/4718] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:50:07 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:50:07.645355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-341e92ec-6e6c-41e6-9662-b617e07ee729 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:07.645898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-341e92ec-6e6c-41e6-9662-b617e07ee729 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:07.654864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-341e92ec-6e6c-41e6-9662-b617e07ee729 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:07.655624 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-341e92ec-6e6c-41e6-9662-b617e07ee729 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:07.656846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-341e92ec-6e6c-41e6-9662-b617e07ee729 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:07.657502 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-341e92ec-6e6c-41e6-9662-b617e07ee729 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:08.157212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3e728094-b0ad-457b-8997-70f7bcd018a1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:08.180367 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3e728094-b0ad-457b-8997-70f7bcd018a1 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae" status: 200 len: 1522 microversion: 2.1 time: 1.692762 Jul 19 22:50:08.183012 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2338/4719] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:06 2022] GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae => generated 1522 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:08.196255 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-52d63b31-4483-4730-ab54-b4558ea40686 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:08.198672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-52d63b31-4483-4730-ab54-b4558ea40686 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:08.236487 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52d63b31-4483-4730-ab54-b4558ea40686 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:08.237406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52d63b31-4483-4730-ab54-b4558ea40686 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:08.238429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52d63b31-4483-4730-ab54-b4558ea40686 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:08.239848 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52d63b31-4483-4730-ab54-b4558ea40686 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:08.787443 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-341e92ec-6e6c-41e6-9662-b617e07ee729 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:08.806084 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-341e92ec-6e6c-41e6-9662-b617e07ee729 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1518 microversion: 2.1 time: 1.169280 Jul 19 22:50:08.808131 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2382/4720] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:07 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1518 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:08.832300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-7d929e85-ff91-414d-a487-f491ef05f41c req-3a8f355e-5867-49e6-a090-e5b16923dd9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb0d2fe2-80ea-4fc2-a157-f7341877997c", "tag": "2cb0e711-7270-4e34-9663-e6877d3106eb"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:08.851190 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7d929e85-ff91-414d-a487-f491ef05f41c req-3a8f355e-5867-49e6-a090-e5b16923dd9d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:08.851909 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7d929e85-ff91-414d-a487-f491ef05f41c req-3a8f355e-5867-49e6-a090-e5b16923dd9d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:08.869298 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-7d929e85-ff91-414d-a487-f491ef05f41c req-3a8f355e-5867-49e6-a090-e5b16923dd9d service nova] Creating event network-changed:2cb0e711-7270-4e34-9663-e6877d3106eb for instance fb0d2fe2-80ea-4fc2-a157-f7341877997c on n-h2-847009-3 Jul 19 22:50:08.905482 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-7d929e85-ff91-414d-a487-f491ef05f41c req-3a8f355e-5867-49e6-a090-e5b16923dd9d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095801 Jul 19 22:50:08.906119 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2383/4721] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:50:09.198352 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f218c50a-4a09-4422-96b9-822d64e331b3 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:09.199073 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f218c50a-4a09-4422-96b9-822d64e331b3 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:09.216010 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f218c50a-4a09-4422-96b9-822d64e331b3 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:09.216470 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f218c50a-4a09-4422-96b9-822d64e331b3 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:09.217199 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-52d63b31-4483-4730-ab54-b4558ea40686 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c4089d759f44d789fa274a98671215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9974b621c2d64212bc970c2fa98f77af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:09.217734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f218c50a-4a09-4422-96b9-822d64e331b3 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:09.217734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f218c50a-4a09-4422-96b9-822d64e331b3 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:09.232091 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-52d63b31-4483-4730-ab54-b4558ea40686 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 200 len: 1523 microversion: 2.1 time: 1.044975 Jul 19 22:50:09.232091 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2339/4722] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:08 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 1523 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:09.594501 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f218c50a-4a09-4422-96b9-822d64e331b3 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92608789324ac48fef6ce87a745a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95469b549ae7425a83e0d93bb8c10860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:09.603979 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f218c50a-4a09-4422-96b9-822d64e331b3 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae" status: 200 len: 1480 microversion: 2.1 time: 0.409194 Jul 19 22:50:09.615160 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2384/4723] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:09 2022] GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae => generated 1480 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:50:09.824766 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0171e094-230d-4e36-9b45-0edc105348a0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:09.825681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0171e094-230d-4e36-9b45-0edc105348a0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:09.850315 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0171e094-230d-4e36-9b45-0edc105348a0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:09.850795 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0171e094-230d-4e36-9b45-0edc105348a0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:09.851646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0171e094-230d-4e36-9b45-0edc105348a0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:09.852098 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0171e094-230d-4e36-9b45-0edc105348a0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:10.250160 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f9a78d4d-2af4-412c-b58e-2f86ed5f2a93 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:10.251389 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f9a78d4d-2af4-412c-b58e-2f86ed5f2a93 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:10.265101 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9a78d4d-2af4-412c-b58e-2f86ed5f2a93 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:10.271778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9a78d4d-2af4-412c-b58e-2f86ed5f2a93 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:10.272965 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9a78d4d-2af4-412c-b58e-2f86ed5f2a93 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:10.273648 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9a78d4d-2af4-412c-b58e-2f86ed5f2a93 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:10.932504 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0171e094-230d-4e36-9b45-0edc105348a0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:10.950995 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0171e094-230d-4e36-9b45-0edc105348a0 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1518 microversion: 2.1 time: 1.129251 Jul 19 22:50:10.960967 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2340/4724] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:09 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1518 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:10.966906 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-30b4f92a-158e-4efb-95b3-30786332b050 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:10.983784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-30b4f92a-158e-4efb-95b3-30786332b050 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] [instance: 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:11.010848 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-30b4f92a-158e-4efb-95b3-30786332b050 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:11.014972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-30b4f92a-158e-4efb-95b3-30786332b050 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:11.017740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-30b4f92a-158e-4efb-95b3-30786332b050 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:11.018212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-30b4f92a-158e-4efb-95b3-30786332b050 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:11.048144 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f9a78d4d-2af4-412c-b58e-2f86ed5f2a93 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c4089d759f44d789fa274a98671215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9974b621c2d64212bc970c2fa98f77af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:11.065678 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f9a78d4d-2af4-412c-b58e-2f86ed5f2a93 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 200 len: 1523 microversion: 2.1 time: 0.820160 Jul 19 22:50:11.072466 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2385/4725] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:10 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 1523 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:50:11.094370 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-85b98fa9-4a41-41d2-8ee9-d59ec066a247 req-6e436818-c66e-4447-9792-aeea89e65dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08ecb42e-a6ee-4f1e-976d-33e037bdd6ae", "name": "network-vif-deleted", "tag": "9e44a163-a1b2-4e28-873d-16feff0d0415"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:11.108878 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-30b4f92a-158e-4efb-95b3-30786332b050 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] HTTP exception thrown: Instance 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae could not be found. Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-30b4f92a-158e-4efb-95b3-30786332b050 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Request method failure captured: Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae HTTP/1.1 Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zPB9pdZx5bGxAOx1bWrMM0FEhH4uLd_pSCvc_RNVR1Ml3e2RdxqyGOtd-lt2kxygYFNrKmFRc3yVX-y9hoY_QR39GzP2XOyLb00mNIcRNYPp_Z40PO_3EFeEpNqlZOyhEu-fa-kVbsARhW2vxsGD8FHWpMQupoNdZ8KLVFw7a76o8s Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 95469b549ae7425a83e0d93bb8c10860 Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1399962716 Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95469b549ae7425a83e0d93bb8c10860"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1399962716 Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 95469b549ae7425a83e0d93bb8c10860 Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1399962716 Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerRescueNegativeTestJSON-1399962716-project Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 5f92608789324ac48fef6ce87a745a07 Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1399962716-project Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae could not be found. Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '08ecb42e-a6ee-4f1e-976d-33e037bdd6ae'} Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae could not be found. Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae could not be found. Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:11.116789 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:50:11.121537 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:11.121537 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:11.121537 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:50:11.121537 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:50:11.121537 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:50:11.121537 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:50:11.121537 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae could not be found. Jul 19 22:50:11.121537 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:11.121537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-30b4f92a-158e-4efb-95b3-30786332b050 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] Returning 404 to user: Instance 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:50:11.127658 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-30b4f92a-158e-4efb-95b3-30786332b050 tempest-ServerRescueNegativeTestJSON-1399962716 tempest-ServerRescueNegativeTestJSON-1399962716-project] 10.222.0.25 "GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae" status: 404 len: 111 microversion: 2.1 time: 0.167746 Jul 19 22:50:11.134688 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2341/4726] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:10 2022] GET /compute/v2.1/servers/08ecb42e-a6ee-4f1e-976d-33e037bdd6ae => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:50:11.135988 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-85b98fa9-4a41-41d2-8ee9-d59ec066a247 req-6e436818-c66e-4447-9792-aeea89e65dff service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:11.142923 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-85b98fa9-4a41-41d2-8ee9-d59ec066a247 req-6e436818-c66e-4447-9792-aeea89e65dff service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:11.179821 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-85b98fa9-4a41-41d2-8ee9-d59ec066a247 req-6e436818-c66e-4447-9792-aeea89e65dff service nova] Creating event network-vif-deleted:9e44a163-a1b2-4e28-873d-16feff0d0415 for instance 08ecb42e-a6ee-4f1e-976d-33e037bdd6ae on n-h1-847009-3 Jul 19 22:50:11.192981 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-85b98fa9-4a41-41d2-8ee9-d59ec066a247 req-6e436818-c66e-4447-9792-aeea89e65dff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117172 Jul 19 22:50:11.198361 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2386/4727] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:50:11.970527 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3e80b45a-6794-4c4c-a5ab-65b92dbef809 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:11.971358 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3e80b45a-6794-4c4c-a5ab-65b92dbef809 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:11.985152 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:50:11.990392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e80b45a-6794-4c4c-a5ab-65b92dbef809 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:11.990890 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e80b45a-6794-4c4c-a5ab-65b92dbef809 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:11.993560 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e80b45a-6794-4c4c-a5ab-65b92dbef809 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:11.994019 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e80b45a-6794-4c4c-a5ab-65b92dbef809 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:12.091737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a35c5418-f288-41f2-93f7-3159fcf64c79 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:12.093225 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a35c5418-f288-41f2-93f7-3159fcf64c79 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:12.111803 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a35c5418-f288-41f2-93f7-3159fcf64c79 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:12.112654 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a35c5418-f288-41f2-93f7-3159fcf64c79 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:12.113765 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a35c5418-f288-41f2-93f7-3159fcf64c79 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:12.115863 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a35c5418-f288-41f2-93f7-3159fcf64c79 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:12.897328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3e80b45a-6794-4c4c-a5ab-65b92dbef809 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:12.918501 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3e80b45a-6794-4c4c-a5ab-65b92dbef809 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1518 microversion: 2.1 time: 0.945680 Jul 19 22:50:12.920003 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2342/4728] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:11 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1518 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:13.842314 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a35c5418-f288-41f2-93f7-3159fcf64c79 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c4089d759f44d789fa274a98671215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9974b621c2d64212bc970c2fa98f77af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:13.852792 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a35c5418-f288-41f2-93f7-3159fcf64c79 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 200 len: 1523 microversion: 2.1 time: 1.766947 Jul 19 22:50:13.854436 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2387/4729] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:12 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 1523 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:13.942682 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-717b7dab-be33-4a60-bc9a-00f00421fe5a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:13.943827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-717b7dab-be33-4a60-bc9a-00f00421fe5a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:13.971384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-717b7dab-be33-4a60-bc9a-00f00421fe5a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:13.972097 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-717b7dab-be33-4a60-bc9a-00f00421fe5a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:13.976585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-717b7dab-be33-4a60-bc9a-00f00421fe5a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:13.983910 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-717b7dab-be33-4a60-bc9a-00f00421fe5a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:14.154993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-65db62c3-6053-4508-8905-02c00de8b2fa tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] Action: 'create', calling method: .version_select at 0x7f7a108b5d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1279875666", "metadata": {"Type": "work"}}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-65db62c3-6053-4508-8905-02c00de8b2fa tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] Request method failure captured: Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 122 Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zUlQNPDrZw3qzPT4uAta62BEXmCZXoQvqRlxqwdTpMJ_gd4mlf4H2iTr84kAjXcczv6DDSJkmxbOWWEwbL10j5WamQ8nzfkAjHI27U_1CB8GZVSQofym-Y4bn9u3F5s1GsEHnRQGPDhnknN-v_VizRKwmA0nt-ogv9uQ50HJHj00PY Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 7102650c6d1a48f28caf866145912f33 Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-VolumesNegativeTest-1997545879 Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7102650c6d1a48f28caf866145912f33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7102650c6d1a48f28caf866145912f33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7102650c6d1a48f28caf866145912f33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7102650c6d1a48f28caf866145912f33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-VolumesNegativeTest-1997545879 Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 7102650c6d1a48f28caf866145912f33 Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-VolumesNegativeTest-1997545879 Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-VolumesNegativeTest-1997545879-project Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 860dc9b5fab44f6cbb307b5bf33378f8 Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-VolumesNegativeTest-1997545879-project Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1279875666", "metadata": {"Type": "work"}}} Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1279875666', 'metadata': {'Type': 'work'}}}} Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi '#$%' Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:50:14.158415 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:50:14.163380 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 19 22:50:14.163380 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.163380 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:50:14.163380 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.163380 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:14.163380 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:50:14.163380 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:50:14.163380 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:50:14.163380 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:50:14.163380 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 19 22:50:14.163380 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.163380 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-65db62c3-6053-4508-8905-02c00de8b2fa tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:50:14.163380 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-65db62c3-6053-4508-8905-02c00de8b2fa tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.373410 Jul 19 22:50:14.166605 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2343/4730] 10.222.0.25 () {60 vars in 1155 bytes} [Tue Jul 19 22:50:13 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 379 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:50:14.178833 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3f875946-ddf2-4488-bff8-9728dc5290af tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] Action: 'create', calling method: .version_select at 0x7f7a106cf280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-285527025", "metadata": {"Type": "work"}}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3f875946-ddf2-4488-bff8-9728dc5290af tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] Request method failure captured: Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 119 Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zUlQNPDrZw3qzPT4uAta62BEXmCZXoQvqRlxqwdTpMJ_gd4mlf4H2iTr84kAjXcczv6DDSJkmxbOWWEwbL10j5WamQ8nzfkAjHI27U_1CB8GZVSQofym-Y4bn9u3F5s1GsEHnRQGPDhnknN-v_VizRKwmA0nt-ogv9uQ50HJHj00PY Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 7102650c6d1a48f28caf866145912f33 Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-VolumesNegativeTest-1997545879 Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7102650c6d1a48f28caf866145912f33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7102650c6d1a48f28caf866145912f33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7102650c6d1a48f28caf866145912f33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7102650c6d1a48f28caf866145912f33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-VolumesNegativeTest-1997545879 Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 7102650c6d1a48f28caf866145912f33 Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-VolumesNegativeTest-1997545879 Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-VolumesNegativeTest-1997545879-project Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 860dc9b5fab44f6cbb307b5bf33378f8 Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-VolumesNegativeTest-1997545879-project Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-285527025", "metadata": {"Type": "work"}}} Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-285527025', 'metadata': {'Type': 'work'}}}} Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi '0' Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:50:14.192236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:50:14.198000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 19 22:50:14.198000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.198000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:50:14.198000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.198000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:14.198000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:50:14.198000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:50:14.198000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:50:14.198000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:50:14.198000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 19 22:50:14.198000 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.198000 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3f875946-ddf2-4488-bff8-9728dc5290af tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:50:14.198000 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3f875946-ddf2-4488-bff8-9728dc5290af tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.024011 Jul 19 22:50:14.205779 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2344/4731] 10.222.0.25 () {60 vars in 1155 bytes} [Tue Jul 19 22:50:14 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:50:14.222381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9ff93608-7b2a-4c8c-886e-724002d12409 tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] Action: 'create', calling method: .version_select at 0x7f7a10717ca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1636052195", "metadata": {"Type": "work"}}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9ff93608-7b2a-4c8c-886e-724002d12409 tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] Request method failure captured: Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 119 Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zUlQNPDrZw3qzPT4uAta62BEXmCZXoQvqRlxqwdTpMJ_gd4mlf4H2iTr84kAjXcczv6DDSJkmxbOWWEwbL10j5WamQ8nzfkAjHI27U_1CB8GZVSQofym-Y4bn9u3F5s1GsEHnRQGPDhnknN-v_VizRKwmA0nt-ogv9uQ50HJHj00PY Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 7102650c6d1a48f28caf866145912f33 Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-VolumesNegativeTest-1997545879 Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7102650c6d1a48f28caf866145912f33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7102650c6d1a48f28caf866145912f33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7102650c6d1a48f28caf866145912f33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7102650c6d1a48f28caf866145912f33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-VolumesNegativeTest-1997545879 Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 7102650c6d1a48f28caf866145912f33 Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-VolumesNegativeTest-1997545879 Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-VolumesNegativeTest-1997545879-project Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 860dc9b5fab44f6cbb307b5bf33378f8 Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-VolumesNegativeTest-1997545879-project Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1636052195", "metadata": {"Type": "work"}}} Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1636052195', 'metadata': {'Type': 'work'}}}} Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi '' Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:50:14.238424 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:50:14.243375 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 19 22:50:14.243375 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.243375 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:50:14.243375 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.243375 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:14.243375 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:50:14.243375 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:50:14.243375 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:50:14.243375 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:50:14.243375 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 19 22:50:14.243375 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.244252 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9ff93608-7b2a-4c8c-886e-724002d12409 tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:50:14.244570 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9ff93608-7b2a-4c8c-886e-724002d12409 tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.034399 Jul 19 22:50:14.247402 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2345/4732] 10.222.0.25 () {60 vars in 1155 bytes} [Tue Jul 19 22:50:14 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:50:14.260354 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-99fd3f78-1f00-4420-87de-db9ed78e7c50 tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] Calling method '.version_select at 0x7f7a03f25670>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:14.323981 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-99fd3f78-1f00-4420-87de-db9ed78e7c50 tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] HTTP exception thrown: Volume tempest-invalid-1628153858 could not be found. Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-99fd3f78-1f00-4420-87de-db9ed78e7c50 tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] Request method failure captured: Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1628153858 HTTP/1.1 Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zUlQNPDrZw3qzPT4uAta62BEXmCZXoQvqRlxqwdTpMJ_gd4mlf4H2iTr84kAjXcczv6DDSJkmxbOWWEwbL10j5WamQ8nzfkAjHI27U_1CB8GZVSQofym-Y4bn9u3F5s1GsEHnRQGPDhnknN-v_VizRKwmA0nt-ogv9uQ50HJHj00PY Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 7102650c6d1a48f28caf866145912f33 Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-VolumesNegativeTest-1997545879 Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7102650c6d1a48f28caf866145912f33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7102650c6d1a48f28caf866145912f33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7102650c6d1a48f28caf866145912f33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7102650c6d1a48f28caf866145912f33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-VolumesNegativeTest-1997545879 Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 7102650c6d1a48f28caf866145912f33 Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-VolumesNegativeTest-1997545879 Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-VolumesNegativeTest-1997545879-project Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 860dc9b5fab44f6cbb307b5bf33378f8 Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-VolumesNegativeTest-1997545879-project Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: exception: Volume tempest-invalid-1628153858 could not be found. Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'tempest-invalid-1628153858'} Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1628153858 could not be found. (HTTP 404) (Request-ID: req-4d1f044f-3ad3-4dc3-b77c-3a523f3c7769) Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 22:50:14.327406 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1628153858 could not be found. Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1628153858 could not be found. Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1628153858 could not be found. Jul 19 22:50:14.332099 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.336582 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-99fd3f78-1f00-4420-87de-db9ed78e7c50 tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] Returning 404 to user: Volume tempest-invalid-1628153858 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:50:14.337259 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-99fd3f78-1f00-4420-87de-db9ed78e7c50 tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1628153858" status: 404 len: 99 microversion: 2.1 time: 0.086654 Jul 19 22:50:14.338310 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2346/4733] 10.222.0.25 () {58 vars in 1217 bytes} [Tue Jul 19 22:50:14 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1628153858 => generated 99 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:50:14.348730 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a39a382e-7548-4de6-9711-db8b09f5d75e tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004197 Jul 19 22:50:14.351040 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2347/4734] 10.222.0.25 () {58 vars in 1139 bytes} [Tue Jul 19 22:50:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 19 22:50:14.370175 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c50f9901-c4b3-4db8-90f0-40e0360dbf8f tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015523 Jul 19 22:50:14.371613 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2348/4735] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 19 22:50:14 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 19 22:50:14.380542 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-31b49e2a-bff0-4ddf-8436-4b7e8f79d5b0 tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] Calling method '.version_select at 0x7f7a108a5790>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:14.437295 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-31b49e2a-bff0-4ddf-8436-4b7e8f79d5b0 tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] HTTP exception thrown: Volume 90a09e24-88e8-4fa9-981d-b1cf57a2d713 could not be found. Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-31b49e2a-bff0-4ddf-8436-4b7e8f79d5b0 tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] Request method failure captured: Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/os-volumes/90a09e24-88e8-4fa9-981d-b1cf57a2d713 HTTP/1.1 Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zUlQNPDrZw3qzPT4uAta62BEXmCZXoQvqRlxqwdTpMJ_gd4mlf4H2iTr84kAjXcczv6DDSJkmxbOWWEwbL10j5WamQ8nzfkAjHI27U_1CB8GZVSQofym-Y4bn9u3F5s1GsEHnRQGPDhnknN-v_VizRKwmA0nt-ogv9uQ50HJHj00PY Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 7102650c6d1a48f28caf866145912f33 Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-VolumesNegativeTest-1997545879 Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7102650c6d1a48f28caf866145912f33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7102650c6d1a48f28caf866145912f33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7102650c6d1a48f28caf866145912f33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7102650c6d1a48f28caf866145912f33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-VolumesNegativeTest-1997545879 Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 7102650c6d1a48f28caf866145912f33 Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-VolumesNegativeTest-1997545879 Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-VolumesNegativeTest-1997545879-project Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 860dc9b5fab44f6cbb307b5bf33378f8 Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-VolumesNegativeTest-1997545879-project Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: exception: Volume 90a09e24-88e8-4fa9-981d-b1cf57a2d713 could not be found. Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '90a09e24-88e8-4fa9-981d-b1cf57a2d713'} Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 90a09e24-88e8-4fa9-981d-b1cf57a2d713 could not be found. (HTTP 404) (Request-ID: req-7139b3f1-770d-4045-841a-b7a2eedf763e) Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 22:50:14.439642 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 90a09e24-88e8-4fa9-981d-b1cf57a2d713 could not be found. Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 90a09e24-88e8-4fa9-981d-b1cf57a2d713 could not be found. Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 90a09e24-88e8-4fa9-981d-b1cf57a2d713 could not be found. Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-31b49e2a-bff0-4ddf-8436-4b7e8f79d5b0 tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] Returning 404 to user: Volume 90a09e24-88e8-4fa9-981d-b1cf57a2d713 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-31b49e2a-bff0-4ddf-8436-4b7e8f79d5b0 tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/90a09e24-88e8-4fa9-981d-b1cf57a2d713" status: 404 len: 109 microversion: 2.1 time: 0.064603 Jul 19 22:50:14.450584 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2349/4736] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 19 22:50:14 2022] DELETE /compute/v2.1/os-volumes/90a09e24-88e8-4fa9-981d-b1cf57a2d713 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:50:14.475264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5a84b5db-7c98-4427-8fa9-8b9fadb47199 tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] Calling method '.version_select at 0x7f7a03e784c0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:14.526078 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-5a84b5db-7c98-4427-8fa9-8b9fadb47199 tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] HTTP exception thrown: Volume 41a78876-894c-4855-94c3-8f6062094d24 could not be found. Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5a84b5db-7c98-4427-8fa9-8b9fadb47199 tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] Request method failure captured: Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/os-volumes/41a78876-894c-4855-94c3-8f6062094d24 HTTP/1.1 Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zUlQNPDrZw3qzPT4uAta62BEXmCZXoQvqRlxqwdTpMJ_gd4mlf4H2iTr84kAjXcczv6DDSJkmxbOWWEwbL10j5WamQ8nzfkAjHI27U_1CB8GZVSQofym-Y4bn9u3F5s1GsEHnRQGPDhnknN-v_VizRKwmA0nt-ogv9uQ50HJHj00PY Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 7102650c6d1a48f28caf866145912f33 Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-VolumesNegativeTest-1997545879 Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7102650c6d1a48f28caf866145912f33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7102650c6d1a48f28caf866145912f33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7102650c6d1a48f28caf866145912f33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7102650c6d1a48f28caf866145912f33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-VolumesNegativeTest-1997545879 Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 7102650c6d1a48f28caf866145912f33 Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-VolumesNegativeTest-1997545879 Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-VolumesNegativeTest-1997545879-project Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 860dc9b5fab44f6cbb307b5bf33378f8 Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-VolumesNegativeTest-1997545879-project Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: method: Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: exception: Volume 41a78876-894c-4855-94c3-8f6062094d24 could not be found. Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '41a78876-894c-4855-94c3-8f6062094d24'} Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 41a78876-894c-4855-94c3-8f6062094d24 could not be found. (HTTP 404) (Request-ID: req-cd0f4e6c-997b-41d8-89a0-9082d5cf7f90) Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 22:50:14.528702 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 41a78876-894c-4855-94c3-8f6062094d24 could not be found. Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 41a78876-894c-4855-94c3-8f6062094d24 could not be found. Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 41a78876-894c-4855-94c3-8f6062094d24 could not be found. Jul 19 22:50:14.533379 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:14.538566 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5a84b5db-7c98-4427-8fa9-8b9fadb47199 tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] Returning 404 to user: Volume 41a78876-894c-4855-94c3-8f6062094d24 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:50:14.538566 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5a84b5db-7c98-4427-8fa9-8b9fadb47199 tempest-VolumesNegativeTest-1997545879 tempest-VolumesNegativeTest-1997545879-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/41a78876-894c-4855-94c3-8f6062094d24" status: 404 len: 109 microversion: 2.1 time: 0.076477 Jul 19 22:50:14.538566 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2350/4737] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 19 22:50:14 2022] GET /compute/v2.1/os-volumes/41a78876-894c-4855-94c3-8f6062094d24 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:50:14.873761 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-aa61b171-9101-4a39-9059-cbc03b70b5e9 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:14.874610 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-aa61b171-9101-4a39-9059-cbc03b70b5e9 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:14.906873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa61b171-9101-4a39-9059-cbc03b70b5e9 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:14.910072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa61b171-9101-4a39-9059-cbc03b70b5e9 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:14.914191 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa61b171-9101-4a39-9059-cbc03b70b5e9 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:14.914835 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa61b171-9101-4a39-9059-cbc03b70b5e9 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:15.354837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-717b7dab-be33-4a60-bc9a-00f00421fe5a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:15.372326 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-717b7dab-be33-4a60-bc9a-00f00421fe5a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1518 microversion: 2.1 time: 1.432400 Jul 19 22:50:15.375271 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2388/4738] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:13 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1518 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:50:15.589286 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-aa61b171-9101-4a39-9059-cbc03b70b5e9 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c4089d759f44d789fa274a98671215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9974b621c2d64212bc970c2fa98f77af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:15.601488 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-aa61b171-9101-4a39-9059-cbc03b70b5e9 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 200 len: 1523 microversion: 2.1 time: 0.733678 Jul 19 22:50:15.607555 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2351/4739] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:14 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 1523 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:50:16.391662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c4e00d7a-7f02-43ce-acee-05a0c2e0a917 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:16.392291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c4e00d7a-7f02-43ce-acee-05a0c2e0a917 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:16.404735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4e00d7a-7f02-43ce-acee-05a0c2e0a917 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:16.405457 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4e00d7a-7f02-43ce-acee-05a0c2e0a917 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:16.406402 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4e00d7a-7f02-43ce-acee-05a0c2e0a917 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:16.406892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4e00d7a-7f02-43ce-acee-05a0c2e0a917 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:16.624813 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-050eef1f-84a1-4088-a13e-158d36ddd0c6 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:16.625382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-050eef1f-84a1-4088-a13e-158d36ddd0c6 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:16.648279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-050eef1f-84a1-4088-a13e-158d36ddd0c6 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:16.648796 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-050eef1f-84a1-4088-a13e-158d36ddd0c6 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:16.649654 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-050eef1f-84a1-4088-a13e-158d36ddd0c6 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:16.650104 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-050eef1f-84a1-4088-a13e-158d36ddd0c6 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:17.472236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c4e00d7a-7f02-43ce-acee-05a0c2e0a917 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:17.489921 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c4e00d7a-7f02-43ce-acee-05a0c2e0a917 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1518 microversion: 2.1 time: 1.104170 Jul 19 22:50:17.503518 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2389/4740] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:16 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1518 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:17.522302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-050eef1f-84a1-4088-a13e-158d36ddd0c6 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c4089d759f44d789fa274a98671215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9974b621c2d64212bc970c2fa98f77af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:17.537291 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-050eef1f-84a1-4088-a13e-158d36ddd0c6 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 200 len: 1523 microversion: 2.1 time: 0.916508 Jul 19 22:50:17.543675 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2352/4741] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:16 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 1523 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:18.507399 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0439c1a9-9bb4-44fb-bd22-b8b6bdcb630e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:18.508031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0439c1a9-9bb4-44fb-bd22-b8b6bdcb630e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:18.510090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:50:18.533807 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0439c1a9-9bb4-44fb-bd22-b8b6bdcb630e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:18.534275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0439c1a9-9bb4-44fb-bd22-b8b6bdcb630e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:18.535143 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0439c1a9-9bb4-44fb-bd22-b8b6bdcb630e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:18.535566 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0439c1a9-9bb4-44fb-bd22-b8b6bdcb630e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:18.556770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eedbde25-d070-4197-8e97-f2731cc1f491 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:18.557473 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eedbde25-d070-4197-8e97-f2731cc1f491 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:18.579750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eedbde25-d070-4197-8e97-f2731cc1f491 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:18.580210 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eedbde25-d070-4197-8e97-f2731cc1f491 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:18.628202 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eedbde25-d070-4197-8e97-f2731cc1f491 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:18.628667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eedbde25-d070-4197-8e97-f2731cc1f491 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:20.070402 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0439c1a9-9bb4-44fb-bd22-b8b6bdcb630e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:20.078650 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0439c1a9-9bb4-44fb-bd22-b8b6bdcb630e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1518 microversion: 2.1 time: 1.575087 Jul 19 22:50:20.079264 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2390/4742] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:18 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1518 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:20.140511 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-eedbde25-d070-4197-8e97-f2731cc1f491 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c4089d759f44d789fa274a98671215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9974b621c2d64212bc970c2fa98f77af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:20.156324 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eedbde25-d070-4197-8e97-f2731cc1f491 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 200 len: 1523 microversion: 2.1 time: 1.605043 Jul 19 22:50:20.160844 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2353/4743] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:18 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 1523 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:50:21.098988 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ca9f95b0-13a3-420d-a704-d4977af669f9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:21.099688 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ca9f95b0-13a3-420d-a704-d4977af669f9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:21.151010 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca9f95b0-13a3-420d-a704-d4977af669f9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:21.155754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca9f95b0-13a3-420d-a704-d4977af669f9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:21.160992 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca9f95b0-13a3-420d-a704-d4977af669f9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:21.168808 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca9f95b0-13a3-420d-a704-d4977af669f9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:21.182111 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-19690c7a-9e60-4ad5-b7a9-c9f30bed144a tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:21.182862 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-19690c7a-9e60-4ad5-b7a9-c9f30bed144a tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:21.203496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-19690c7a-9e60-4ad5-b7a9-c9f30bed144a tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:21.204324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-19690c7a-9e60-4ad5-b7a9-c9f30bed144a tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:21.209288 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-19690c7a-9e60-4ad5-b7a9-c9f30bed144a tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:21.211649 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-19690c7a-9e60-4ad5-b7a9-c9f30bed144a tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:22.725908 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ca9f95b0-13a3-420d-a704-d4977af669f9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:22.743835 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ca9f95b0-13a3-420d-a704-d4977af669f9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1518 microversion: 2.1 time: 1.650971 Jul 19 22:50:22.747320 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2391/4744] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:21 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1518 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:22.829046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-19690c7a-9e60-4ad5-b7a9-c9f30bed144a tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c4089d759f44d789fa274a98671215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9974b621c2d64212bc970c2fa98f77af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:22.839641 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-19690c7a-9e60-4ad5-b7a9-c9f30bed144a tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 200 len: 1523 microversion: 2.1 time: 1.664950 Jul 19 22:50:22.864432 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2354/4745] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:21 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 1523 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:23.778967 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f6560ee9-0ba1-4592-a758-f3babbb8a5f7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:23.783985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f6560ee9-0ba1-4592-a758-f3babbb8a5f7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:23.861808 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2a9c8bcd-e013-45fd-9667-f751cb8f3e12 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:23.862449 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2a9c8bcd-e013-45fd-9667-f751cb8f3e12 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:23.873367 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f6560ee9-0ba1-4592-a758-f3babbb8a5f7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:23.876383 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2a9c8bcd-e013-45fd-9667-f751cb8f3e12 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:23.876850 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2a9c8bcd-e013-45fd-9667-f751cb8f3e12 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:23.881923 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f6560ee9-0ba1-4592-a758-f3babbb8a5f7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:23.885564 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2a9c8bcd-e013-45fd-9667-f751cb8f3e12 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:23.886438 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f6560ee9-0ba1-4592-a758-f3babbb8a5f7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:23.887505 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f6560ee9-0ba1-4592-a758-f3babbb8a5f7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:23.894430 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2a9c8bcd-e013-45fd-9667-f751cb8f3e12 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:24.935310 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f6560ee9-0ba1-4592-a758-f3babbb8a5f7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:24.954505 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f6560ee9-0ba1-4592-a758-f3babbb8a5f7 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1518 microversion: 2.1 time: 1.193830 Jul 19 22:50:24.956578 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2392/4746] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:23 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1518 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:25.034443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2a9c8bcd-e013-45fd-9667-f751cb8f3e12 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c4089d759f44d789fa274a98671215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9974b621c2d64212bc970c2fa98f77af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:25.044384 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2a9c8bcd-e013-45fd-9667-f751cb8f3e12 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 200 len: 1523 microversion: 2.1 time: 1.188868 Jul 19 22:50:25.051463 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2355/4747] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:23 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 1523 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:50:25.973392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dcdb4a51-6fef-4c10-a184-0fe644051242 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:25.974018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dcdb4a51-6fef-4c10-a184-0fe644051242 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:25.985801 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dcdb4a51-6fef-4c10-a184-0fe644051242 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:25.986519 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dcdb4a51-6fef-4c10-a184-0fe644051242 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:25.994170 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dcdb4a51-6fef-4c10-a184-0fe644051242 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:25.996287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dcdb4a51-6fef-4c10-a184-0fe644051242 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:26.068752 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3aeed71b-f33d-4cff-84c7-480fae771076 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:26.070017 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3aeed71b-f33d-4cff-84c7-480fae771076 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:26.081535 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3aeed71b-f33d-4cff-84c7-480fae771076 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:26.086717 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3aeed71b-f33d-4cff-84c7-480fae771076 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:26.088469 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3aeed71b-f33d-4cff-84c7-480fae771076 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:26.089125 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3aeed71b-f33d-4cff-84c7-480fae771076 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:27.030901 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3aeed71b-f33d-4cff-84c7-480fae771076 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c4089d759f44d789fa274a98671215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9974b621c2d64212bc970c2fa98f77af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:27.045509 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3aeed71b-f33d-4cff-84c7-480fae771076 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 200 len: 1523 microversion: 2.1 time: 0.979249 Jul 19 22:50:27.048585 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2356/4748] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:26 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 1523 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:28.074367 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6b70264d-dd39-49fc-a663-5e67fc2e59db tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:28.082134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6b70264d-dd39-49fc-a663-5e67fc2e59db tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:28.094220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b70264d-dd39-49fc-a663-5e67fc2e59db tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:28.096466 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b70264d-dd39-49fc-a663-5e67fc2e59db tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:28.097563 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b70264d-dd39-49fc-a663-5e67fc2e59db tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:28.098183 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b70264d-dd39-49fc-a663-5e67fc2e59db tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:28.303320 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dcdb4a51-6fef-4c10-a184-0fe644051242 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:28.315805 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dcdb4a51-6fef-4c10-a184-0fe644051242 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1518 microversion: 2.1 time: 2.346156 Jul 19 22:50:28.316428 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2393/4749] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:25 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1518 bytes in 2348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:29.341826 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1075b50e-ccc5-457a-8567-4d099d17895d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:29.342866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1075b50e-ccc5-457a-8567-4d099d17895d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:29.366134 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1075b50e-ccc5-457a-8567-4d099d17895d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:29.366796 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1075b50e-ccc5-457a-8567-4d099d17895d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:29.370794 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1075b50e-ccc5-457a-8567-4d099d17895d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:29.373606 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1075b50e-ccc5-457a-8567-4d099d17895d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:29.407374 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6b70264d-dd39-49fc-a663-5e67fc2e59db tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c4089d759f44d789fa274a98671215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9974b621c2d64212bc970c2fa98f77af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:29.432168 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6b70264d-dd39-49fc-a663-5e67fc2e59db tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 200 len: 1523 microversion: 2.1 time: 1.361663 Jul 19 22:50:29.433097 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2357/4750] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:28 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 1523 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:30.058473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1075b50e-ccc5-457a-8567-4d099d17895d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:30.069942 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1075b50e-ccc5-457a-8567-4d099d17895d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1518 microversion: 2.1 time: 0.733885 Jul 19 22:50:30.079501 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2394/4751] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:29 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1518 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:50:30.455540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0d8ed1b7-a6c7-4a87-8f30-5fe4d143091c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:30.461141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0d8ed1b7-a6c7-4a87-8f30-5fe4d143091c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:30.488569 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d8ed1b7-a6c7-4a87-8f30-5fe4d143091c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:30.489035 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d8ed1b7-a6c7-4a87-8f30-5fe4d143091c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:30.491909 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d8ed1b7-a6c7-4a87-8f30-5fe4d143091c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:30.493308 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d8ed1b7-a6c7-4a87-8f30-5fe4d143091c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:30.624090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1075b50e-ccc5-457a-8567-4d099d17895d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:30.624970 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1075b50e-ccc5-457a-8567-4d099d17895d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001441 Jul 19 22:50:30.625313 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2395/4752] 10.222.0.25 () {56 vars in 885 bytes} [Tue Jul 19 22:50:30 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 19 22:50:30.909913 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0d8ed1b7-a6c7-4a87-8f30-5fe4d143091c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c4089d759f44d789fa274a98671215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9974b621c2d64212bc970c2fa98f77af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:30.919519 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0d8ed1b7-a6c7-4a87-8f30-5fe4d143091c tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 200 len: 1503 microversion: 2.1 time: 0.470008 Jul 19 22:50:30.920186 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2358/4753] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:30 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 1503 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:30.938694 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-33697081-a27e-4455-bbec-10ce2f03cce7 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Action: 'create', calling method: .version_select at 0x7f7a03869dc0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-934737463", "description": "tempest-description-1967338366"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:31.096415 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4f8974c4-db7e-4a94-9a63-840390738336 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:31.097144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4f8974c4-db7e-4a94-9a63-840390738336 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:31.114487 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f8974c4-db7e-4a94-9a63-840390738336 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:31.116039 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f8974c4-db7e-4a94-9a63-840390738336 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:31.122852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f8974c4-db7e-4a94-9a63-840390738336 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:31.125033 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f8974c4-db7e-4a94-9a63-840390738336 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:31.804533 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4f8974c4-db7e-4a94-9a63-840390738336 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:31.817773 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4f8974c4-db7e-4a94-9a63-840390738336 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1518 microversion: 2.1 time: 0.725483 Jul 19 22:50:31.818633 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-33697081-a27e-4455-bbec-10ce2f03cce7 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.884670 Jul 19 22:50:31.820099 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2396/4754] 10.222.0.25 () {60 vars in 1179 bytes} [Tue Jul 19 22:50:30 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:50:31.830226 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2359/4755] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:31 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1518 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:50:31.832934 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4f4ab7ec-9ecd-4db7-92cd-4139d31f39ee tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-934737463"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:31.833495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4f4ab7ec-9ecd-4db7-92cd-4139d31f39ee tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:31.858479 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f4ab7ec-9ecd-4db7-92cd-4139d31f39ee tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:31.862784 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f4ab7ec-9ecd-4db7-92cd-4139d31f39ee tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:31.863976 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f4ab7ec-9ecd-4db7-92cd-4139d31f39ee tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:31.872053 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f4ab7ec-9ecd-4db7-92cd-4139d31f39ee tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:32.357276 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.network.security_group_api [None req-4f4ab7ec-9ecd-4db7-92cd-4139d31f39ee tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Adding security group cacd7621-c298-4e9b-9ceb-5d5cb4774fa7 to port a788699a-cc1a-4989-a394-3914a32e6884 Jul 19 22:50:32.805787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-cfcf80ec-5538-43e7-8201-5f2889c1ffa1 req-f96d7b5f-f0eb-4c22-a254-cbe9a89fd22e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb0d2fe2-80ea-4fc2-a157-f7341877997c", "name": "network-vif-plugged", "status": "completed", "tag": "2cb0e711-7270-4e34-9663-e6877d3106eb"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:32.822726 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-cfcf80ec-5538-43e7-8201-5f2889c1ffa1 req-f96d7b5f-f0eb-4c22-a254-cbe9a89fd22e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:32.823218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-cfcf80ec-5538-43e7-8201-5f2889c1ffa1 req-f96d7b5f-f0eb-4c22-a254-cbe9a89fd22e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:32.880566 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-cfcf80ec-5538-43e7-8201-5f2889c1ffa1 req-f96d7b5f-f0eb-4c22-a254-cbe9a89fd22e service nova] Creating event network-vif-plugged:2cb0e711-7270-4e34-9663-e6877d3106eb for instance fb0d2fe2-80ea-4fc2-a157-f7341877997c on n-h2-847009-3 Jul 19 22:50:32.900121 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-cfcf80ec-5538-43e7-8201-5f2889c1ffa1 req-f96d7b5f-f0eb-4c22-a254-cbe9a89fd22e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.623991 Jul 19 22:50:32.903030 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2360/4756] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:50:32.944942 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d0c6d3e3-3b8a-439d-b3c2-40a517a8316a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:32.945679 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d0c6d3e3-3b8a-439d-b3c2-40a517a8316a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:32.979155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0c6d3e3-3b8a-439d-b3c2-40a517a8316a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:32.979590 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0c6d3e3-3b8a-439d-b3c2-40a517a8316a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:32.980406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0c6d3e3-3b8a-439d-b3c2-40a517a8316a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:32.980921 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0c6d3e3-3b8a-439d-b3c2-40a517a8316a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:33.090409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:50:33.401875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d0c6d3e3-3b8a-439d-b3c2-40a517a8316a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:33.412725 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4f4ab7ec-9ecd-4db7-92cd-4139d31f39ee tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "POST /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13/action" status: 202 len: 0 microversion: 2.1 time: 1.585455 Jul 19 22:50:33.413681 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2397/4757] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:50:31 2022] POST /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13/action => generated 0 bytes in 1587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:50:33.422577 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e27187a0-c94c-464c-aa53-7c45363b585e tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-934737463"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:33.423147 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e27187a0-c94c-464c-aa53-7c45363b585e tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:33.425037 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d0c6d3e3-3b8a-439d-b3c2-40a517a8316a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1518 microversion: 2.1 time: 0.517610 Jul 19 22:50:33.426609 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2361/4758] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:32 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1518 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:33.435891 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-6e72ef0d-469f-40e4-abca-5843dd517e8b req-0c7d05cf-d2c5-4f06-8971-8b5a233480d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecd77461-3bd1-4bc6-92b3-9d76ded15b13", "tag": "a788699a-cc1a-4989-a394-3914a32e6884"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:33.438500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:50:33.440143 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e27187a0-c94c-464c-aa53-7c45363b585e tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:33.448671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e27187a0-c94c-464c-aa53-7c45363b585e tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:33.452302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-6e72ef0d-469f-40e4-abca-5843dd517e8b req-0c7d05cf-d2c5-4f06-8971-8b5a233480d2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:33.453291 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-6e72ef0d-469f-40e4-abca-5843dd517e8b req-0c7d05cf-d2c5-4f06-8971-8b5a233480d2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:33.459387 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e27187a0-c94c-464c-aa53-7c45363b585e tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:33.460223 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e27187a0-c94c-464c-aa53-7c45363b585e tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:33.473064 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-6e72ef0d-469f-40e4-abca-5843dd517e8b req-0c7d05cf-d2c5-4f06-8971-8b5a233480d2 service nova] Creating event network-changed:a788699a-cc1a-4989-a394-3914a32e6884 for instance ecd77461-3bd1-4bc6-92b3-9d76ded15b13 on n-h1-847009-3 Jul 19 22:50:33.483550 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-6e72ef0d-469f-40e4-abca-5843dd517e8b req-0c7d05cf-d2c5-4f06-8971-8b5a233480d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053407 Jul 19 22:50:33.485578 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2362/4759] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:50:33.513873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:50:33.842754 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.network.security_group_api [None req-e27187a0-c94c-464c-aa53-7c45363b585e tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Removing security group cacd7621-c298-4e9b-9ceb-5d5cb4774fa7 from port a788699a-cc1a-4989-a394-3914a32e6884 Jul 19 22:50:34.452845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3d63edfd-88c0-4b45-afe3-e75b6eb19c79 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:34.455844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3d63edfd-88c0-4b45-afe3-e75b6eb19c79 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:34.506028 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d63edfd-88c0-4b45-afe3-e75b6eb19c79 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:34.506501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d63edfd-88c0-4b45-afe3-e75b6eb19c79 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:34.507810 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d63edfd-88c0-4b45-afe3-e75b6eb19c79 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:34.508236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d63edfd-88c0-4b45-afe3-e75b6eb19c79 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:35.233237 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3d63edfd-88c0-4b45-afe3-e75b6eb19c79 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:35.241466 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3d63edfd-88c0-4b45-afe3-e75b6eb19c79 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1518 microversion: 2.1 time: 0.800022 Jul 19 22:50:35.242054 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2363/4760] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:34 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1518 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:35.256166 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-630c885f-a616-4e0f-8935-5e61f3b23e9f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1154899693", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "3ec11ea2-1f86-4f7b-917e-6b72eecb486e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-487307538", "security_groups": [{"name": "tempest-secgroup-smoke-1789167949"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:35.703903 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-630c885f-a616-4e0f-8935-5e61f3b23e9f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] validate_networks() for [('3ec11ea2-1f86-4f7b-917e-6b72eecb486e', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:50:36.439172 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e27187a0-c94c-464c-aa53-7c45363b585e tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "POST /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13/action" status: 202 len: 0 microversion: 2.1 time: 3.021555 Jul 19 22:50:36.440496 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2398/4761] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:50:33 2022] POST /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13/action => generated 0 bytes in 3023 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:50:36.446772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ee373ee0-3cd7-4a22-85da-6acf30725919 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:36.448146 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ee373ee0-3cd7-4a22-85da-6acf30725919 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:36.468434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee373ee0-3cd7-4a22-85da-6acf30725919 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:36.469278 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee373ee0-3cd7-4a22-85da-6acf30725919 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:36.472046 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee373ee0-3cd7-4a22-85da-6acf30725919 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:36.473662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee373ee0-3cd7-4a22-85da-6acf30725919 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:37.289181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ee373ee0-3cd7-4a22-85da-6acf30725919 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:37.298286 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ee373ee0-3cd7-4a22-85da-6acf30725919 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1518 microversion: 2.1 time: 0.856247 Jul 19 22:50:37.307775 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2399/4762] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:36 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1518 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:37.312841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b8f817bc-1163-4d3c-9679-fd31610f8561 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Action: 'create', calling method: .version_select at 0x7f7a03869280>, body: {"pool": null} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:38.297204 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-630c885f-a616-4e0f-8935-5e61f3b23e9f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:50:38.298230 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-630c885f-a616-4e0f-8935-5e61f3b23e9f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:50:38.298865 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-630c885f-a616-4e0f-8935-5e61f3b23e9f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:50:38.299958 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-630c885f-a616-4e0f-8935-5e61f3b23e9f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:50:38.300903 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-630c885f-a616-4e0f-8935-5e61f3b23e9f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:50:38.319709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-630c885f-a616-4e0f-8935-5e61f3b23e9f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:38.320815 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-630c885f-a616-4e0f-8935-5e61f3b23e9f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:38.323407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-630c885f-a616-4e0f-8935-5e61f3b23e9f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:38.325248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-630c885f-a616-4e0f-8935-5e61f3b23e9f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:38.357906 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-630c885f-a616-4e0f-8935-5e61f3b23e9f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Getting quotas for project 4b56c5370d5846f8a8c1535c127c0e12. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:50:38.367004 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-630c885f-a616-4e0f-8935-5e61f3b23e9f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Getting quotas for user dcfdbbdf932b43b38725f60dadc738c9 and project 4b56c5370d5846f8a8c1535c127c0e12. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:50:38.391194 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-630c885f-a616-4e0f-8935-5e61f3b23e9f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:50:38.396247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-630c885f-a616-4e0f-8935-5e61f3b23e9f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:50:38.505879 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-630c885f-a616-4e0f-8935-5e61f3b23e9f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.253428 Jul 19 22:50:38.507997 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2364/4763] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:50:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 3256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:50:38.970125 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dceb9500-76ca-4185-b6d1-809ce75f8a5e tempest-QuotasTestJSON-726706186 tempest-QuotasTestJSON-726706186-project] Calling method '.version_select at 0x7f7a10444d30>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:39.334309 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dceb9500-76ca-4185-b6d1-809ce75f8a5e tempest-QuotasTestJSON-726706186 tempest-QuotasTestJSON-726706186-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/e6472af4a1f54cae8f7c6b8ac7d98c73/defaults" status: 200 len: 371 microversion: 2.1 time: 0.824826 Jul 19 22:50:39.336531 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2365/4764] 10.222.0.25 () {58 vars in 1268 bytes} [Tue Jul 19 22:50:38 2022] GET /compute/v2.1/os-quota-sets/e6472af4a1f54cae8f7c6b8ac7d98c73/defaults => generated 371 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:50:39.342334 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-a6835a20-515d-4b07-9949-acacc3cb4fe1 req-0f3542df-9ffa-42c0-b480-4c9503d8b714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecd77461-3bd1-4bc6-92b3-9d76ded15b13", "tag": "a788699a-cc1a-4989-a394-3914a32e6884"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:39.373746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a6835a20-515d-4b07-9949-acacc3cb4fe1 req-0f3542df-9ffa-42c0-b480-4c9503d8b714 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:39.374199 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a6835a20-515d-4b07-9949-acacc3cb4fe1 req-0f3542df-9ffa-42c0-b480-4c9503d8b714 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:39.406081 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-a6835a20-515d-4b07-9949-acacc3cb4fe1 req-0f3542df-9ffa-42c0-b480-4c9503d8b714 service nova] Creating event network-changed:a788699a-cc1a-4989-a394-3914a32e6884 for instance ecd77461-3bd1-4bc6-92b3-9d76ded15b13 on n-h1-847009-3 Jul 19 22:50:39.413608 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-a6835a20-515d-4b07-9949-acacc3cb4fe1 req-0f3542df-9ffa-42c0-b480-4c9503d8b714 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075653 Jul 19 22:50:39.414770 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2366/4765] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:50:39.430526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ac1bbb27-a104-4ec5-bba5-2b089f5ad8ed tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:39.436925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ac1bbb27-a104-4ec5-bba5-2b089f5ad8ed tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:39.452144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac1bbb27-a104-4ec5-bba5-2b089f5ad8ed tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:39.454236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac1bbb27-a104-4ec5-bba5-2b089f5ad8ed tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:39.455305 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac1bbb27-a104-4ec5-bba5-2b089f5ad8ed tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:39.457742 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac1bbb27-a104-4ec5-bba5-2b089f5ad8ed tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:39.961365 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ac1bbb27-a104-4ec5-bba5-2b089f5ad8ed tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:39.979304 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ac1bbb27-a104-4ec5-bba5-2b089f5ad8ed tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.554217 Jul 19 22:50:39.982714 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2367/4766] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:39 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:40.003100 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-934421d3-ebcd-44db-9e13-d235d39d2212 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:40.005620 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-934421d3-ebcd-44db-9e13-d235d39d2212 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:40.032694 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-934421d3-ebcd-44db-9e13-d235d39d2212 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:40.033263 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-934421d3-ebcd-44db-9e13-d235d39d2212 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:40.041978 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-934421d3-ebcd-44db-9e13-d235d39d2212 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:40.049150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-934421d3-ebcd-44db-9e13-d235d39d2212 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:40.255580 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-934421d3-ebcd-44db-9e13-d235d39d2212 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:40.268290 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-934421d3-ebcd-44db-9e13-d235d39d2212 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1318 microversion: 2.1 time: 0.282814 Jul 19 22:50:40.276561 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2368/4767] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:39 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:40.300201 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1383072d-89a1-48d8-bc2a-25ed764357d3 tempest-QuotasTestJSON-726706186 tempest-QuotasTestJSON-726706186-project] Calling method '.version_select at 0x7f7a032cc0d0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:40.724815 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1383072d-89a1-48d8-bc2a-25ed764357d3 tempest-QuotasTestJSON-726706186 tempest-QuotasTestJSON-726706186-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/e6472af4a1f54cae8f7c6b8ac7d98c73" status: 200 len: 371 microversion: 2.1 time: 0.444887 Jul 19 22:50:40.726199 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2369/4768] 10.222.0.25 () {58 vars in 1241 bytes} [Tue Jul 19 22:50:40 2022] GET /compute/v2.1/os-quota-sets/e6472af4a1f54cae8f7c6b8ac7d98c73 => generated 371 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:50:40.738943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7921930a-c291-4e02-b677-d759118a3a35 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:40.740309 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7921930a-c291-4e02-b677-d759118a3a35 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:40.754330 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7921930a-c291-4e02-b677-d759118a3a35 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:40.755495 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7921930a-c291-4e02-b677-d759118a3a35 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:40.757279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7921930a-c291-4e02-b677-d759118a3a35 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:40.758951 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7921930a-c291-4e02-b677-d759118a3a35 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:41.314721 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7921930a-c291-4e02-b677-d759118a3a35 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:41.331656 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7921930a-c291-4e02-b677-d759118a3a35 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.602361 Jul 19 22:50:41.332929 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2370/4769] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:40 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:41.341266 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-43d624d8-587d-456b-9e41-55cc48b4c3a1 tempest-QuotasTestJSON-726706186 tempest-QuotasTestJSON-726706186-project] Calling method '.version_select at 0x7f7a032c3f70>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:41.607671 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b8f817bc-1163-4d3c-9679-fd31610f8561 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.298265 Jul 19 22:50:41.608604 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2400/4770] 10.222.0.25 () {60 vars in 1169 bytes} [Tue Jul 19 22:50:37 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:50:41.613270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-65f7f827-370d-49ae-8f13-c4061117c287 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:41.613907 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-65f7f827-370d-49ae-8f13-c4061117c287 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:41.631323 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65f7f827-370d-49ae-8f13-c4061117c287 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:41.631780 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65f7f827-370d-49ae-8f13-c4061117c287 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:41.635752 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65f7f827-370d-49ae-8f13-c4061117c287 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:41.636625 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65f7f827-370d-49ae-8f13-c4061117c287 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:41.783719 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-43d624d8-587d-456b-9e41-55cc48b4c3a1 tempest-QuotasTestJSON-726706186 tempest-QuotasTestJSON-726706186-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/e6472af4a1f54cae8f7c6b8ac7d98c73/defaults" status: 200 len: 371 microversion: 2.1 time: 0.449059 Jul 19 22:50:41.785029 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2371/4771] 10.222.0.25 () {58 vars in 1268 bytes} [Tue Jul 19 22:50:41 2022] GET /compute/v2.1/os-quota-sets/e6472af4a1f54cae8f7c6b8ac7d98c73/defaults => generated 371 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:50:41.797128 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e0d61c1e-030e-4cc4-b832-7c610308e691 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:41.801486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e0d61c1e-030e-4cc4-b832-7c610308e691 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:41.822740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0d61c1e-030e-4cc4-b832-7c610308e691 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:41.823431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0d61c1e-030e-4cc4-b832-7c610308e691 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:41.826446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0d61c1e-030e-4cc4-b832-7c610308e691 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:41.827101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0d61c1e-030e-4cc4-b832-7c610308e691 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:41.857444 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-65f7f827-370d-49ae-8f13-c4061117c287 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:41.890449 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-65f7f827-370d-49ae-8f13-c4061117c287 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1324 microversion: 2.1 time: 0.281123 Jul 19 22:50:41.895818 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2401/4772] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:41 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1324 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:41.903888 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c7a6e7ad-c3c0-4d89-92c8-d6e29b0c1b54 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.93"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:41.905486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c7a6e7ad-c3c0-4d89-92c8-d6e29b0c1b54 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:41.943378 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7a6e7ad-c3c0-4d89-92c8-d6e29b0c1b54 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:41.943925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7a6e7ad-c3c0-4d89-92c8-d6e29b0c1b54 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:41.946214 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7a6e7ad-c3c0-4d89-92c8-d6e29b0c1b54 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:41.946667 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7a6e7ad-c3c0-4d89-92c8-d6e29b0c1b54 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:42.030218 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7a6e7ad-c3c0-4d89-92c8-d6e29b0c1b54 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Acquired lock "refresh_cache-ecd77461-3bd1-4bc6-92b3-9d76ded15b13" {{(pid=119338) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 22:50:42.920298 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e0d61c1e-030e-4cc4-b832-7c610308e691 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:42.934639 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e0d61c1e-030e-4cc4-b832-7c610308e691 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 1.146959 Jul 19 22:50:42.944639 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2372/4773] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:41 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:42.958732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-58afe1f7-7077-4d04-b1db-f05b2280953e tempest-QuotasTestJSON-726706186 tempest-QuotasTestJSON-726706186-project] Calling method '.version_select at 0x7f7a10805ee0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:43.576519 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:50:43.607624 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-58afe1f7-7077-4d04-b1db-f05b2280953e tempest-QuotasTestJSON-726706186 tempest-QuotasTestJSON-726706186-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/e6472af4a1f54cae8f7c6b8ac7d98c73" status: 200 len: 371 microversion: 2.1 time: 0.660813 Jul 19 22:50:43.616589 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2373/4774] 10.222.0.25 () {58 vars in 1241 bytes} [Tue Jul 19 22:50:42 2022] GET /compute/v2.1/os-quota-sets/e6472af4a1f54cae8f7c6b8ac7d98c73 => generated 371 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:50:43.623044 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e93d6e88-ace3-48b5-9823-27c8baafe26b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:43.626351 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e93d6e88-ace3-48b5-9823-27c8baafe26b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:43.644062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e93d6e88-ace3-48b5-9823-27c8baafe26b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:43.645555 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e93d6e88-ace3-48b5-9823-27c8baafe26b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:43.650558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e93d6e88-ace3-48b5-9823-27c8baafe26b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:43.650558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e93d6e88-ace3-48b5-9823-27c8baafe26b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:44.573922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e93d6e88-ace3-48b5-9823-27c8baafe26b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:44.585272 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e93d6e88-ace3-48b5-9823-27c8baafe26b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1392 microversion: 2.1 time: 0.965204 Jul 19 22:50:44.587351 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2374/4775] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:43 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1392 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:44.597509 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6411452d-7850-4395-892d-14d366db53d3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:44.621593 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-6411452d-7850-4395-892d-14d366db53d3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Instance 6a7cfa96-c304-42d8-9166-cf65c108edc9 has no mapping to a cell. Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6411452d-7850-4395-892d-14d366db53d3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/6a7cfa96-c304-42d8-9166-cf65c108edc9/action HTTP/1.1 Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 15 Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: {"os-stop": {}} Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 6a7cfa96-c304-42d8-9166-cf65c108edc9 has no mapping to a cell. Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '6a7cfa96-c304-42d8-9166-cf65c108edc9', 'body': {'os-stop': {}}} Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 6a7cfa96-c304-42d8-9166-cf65c108edc9 has no mapping to a cell. Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:50:44.633112 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a7cfa96-c304-42d8-9166-cf65c108edc9 has no mapping to a cell. Jul 19 22:50:44.638428 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:44.638428 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:50:44.638428 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:44.638428 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:44.638428 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:50:44.638428 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:50:44.638428 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:50:44.638428 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:50:44.638428 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a7cfa96-c304-42d8-9166-cf65c108edc9 has no mapping to a cell. Jul 19 22:50:44.638428 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:44.638428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6411452d-7850-4395-892d-14d366db53d3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 404 to user: Instance 6a7cfa96-c304-42d8-9166-cf65c108edc9 has no mapping to a cell. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:50:44.638428 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6411452d-7850-4395-892d-14d366db53d3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers/6a7cfa96-c304-42d8-9166-cf65c108edc9/action" status: 404 len: 117 microversion: 2.1 time: 0.046131 Jul 19 22:50:44.640774 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2375/4776] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:50:44 2022] POST /compute/v2.1/servers/6a7cfa96-c304-42d8-9166-cf65c108edc9/action => generated 117 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:50:44.654869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-89d50b45-21c7-423c-8a7f-3536112cb70f tempest-QuotasTestJSON-726706186 tempest-QuotasTestJSON-726706186-project] Calling method '.version_select at 0x7f7a104efb80>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:45.181744 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-89d50b45-21c7-423c-8a7f-3536112cb70f tempest-QuotasTestJSON-726706186 tempest-QuotasTestJSON-726706186-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/e6472af4a1f54cae8f7c6b8ac7d98c73?user_id=17286e6b599e4137acd5ec1f7d877300" status: 200 len: 371 microversion: 2.1 time: 0.539153 Jul 19 22:50:45.182355 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2376/4777] 10.222.0.25 () {58 vars in 1322 bytes} [Tue Jul 19 22:50:44 2022] GET /compute/v2.1/os-quota-sets/e6472af4a1f54cae8f7c6b8ac7d98c73?user_id=17286e6b599e4137acd5ec1f7d877300 => generated 371 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:50:45.205140 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-af942c60-7ff6-48f1-8cd1-58e04794a924 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:45.207042 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-af942c60-7ff6-48f1-8cd1-58e04794a924 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:45.219621 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af942c60-7ff6-48f1-8cd1-58e04794a924 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:45.232862 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af942c60-7ff6-48f1-8cd1-58e04794a924 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:45.236914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af942c60-7ff6-48f1-8cd1-58e04794a924 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:45.241772 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af942c60-7ff6-48f1-8cd1-58e04794a924 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:46.138304 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-af942c60-7ff6-48f1-8cd1-58e04794a924 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:46.150059 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-af942c60-7ff6-48f1-8cd1-58e04794a924 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.953942 Jul 19 22:50:46.150887 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2377/4778] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:45 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:46.178554 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b2e623aa-2ef8-4957-a402-a34638402e06 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:46.179594 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b2e623aa-2ef8-4957-a402-a34638402e06 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:46.196677 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b2e623aa-2ef8-4957-a402-a34638402e06 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:46.197952 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b2e623aa-2ef8-4957-a402-a34638402e06 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:46.200703 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b2e623aa-2ef8-4957-a402-a34638402e06 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:46.201237 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b2e623aa-2ef8-4957-a402-a34638402e06 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:46.725854 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b2e623aa-2ef8-4957-a402-a34638402e06 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:46.737353 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b2e623aa-2ef8-4957-a402-a34638402e06 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1392 microversion: 2.1 time: 0.571045 Jul 19 22:50:46.747277 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2378/4779] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:46 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1392 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:46.751988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-12b0ea81-6cb2-413b-89be-97de645885db tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:46.752547 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-12b0ea81-6cb2-413b-89be-97de645885db tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:46.769333 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12b0ea81-6cb2-413b-89be-97de645885db tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:46.769796 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12b0ea81-6cb2-413b-89be-97de645885db tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:46.770601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12b0ea81-6cb2-413b-89be-97de645885db tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:46.771044 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12b0ea81-6cb2-413b-89be-97de645885db tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:47.402101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-12b0ea81-6cb2-413b-89be-97de645885db tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:47.415924 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-12b0ea81-6cb2-413b-89be-97de645885db tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.671477 Jul 19 22:50:47.428279 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2379/4780] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:46 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:47.433914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-52cde94f-8642-47ca-8c11-10f8c11e6a16 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:47.435321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-52cde94f-8642-47ca-8c11-10f8c11e6a16 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 52fbec09-f17c-4d1c-b6b5-8d208cc22b70] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:47.443021 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-52cde94f-8642-47ca-8c11-10f8c11e6a16 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Instance 52fbec09-f17c-4d1c-b6b5-8d208cc22b70 could not be found. Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-52cde94f-8642-47ca-8c11-10f8c11e6a16 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/52fbec09-f17c-4d1c-b6b5-8d208cc22b70/action HTTP/1.1 Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 15 Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: {"suspend": {}} Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 52fbec09-f17c-4d1c-b6b5-8d208cc22b70 could not be found. Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '52fbec09-f17c-4d1c-b6b5-8d208cc22b70', 'body': {'suspend': {}}} Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52fbec09-f17c-4d1c-b6b5-8d208cc22b70 could not be found. Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52fbec09-f17c-4d1c-b6b5-8d208cc22b70 could not be found. Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:50:47.444810 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:50:47.448802 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:50:47.448802 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:50:47.448802 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52fbec09-f17c-4d1c-b6b5-8d208cc22b70 could not be found. Jul 19 22:50:47.448802 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:47.452169 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-52cde94f-8642-47ca-8c11-10f8c11e6a16 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 404 to user: Instance 52fbec09-f17c-4d1c-b6b5-8d208cc22b70 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:50:47.453998 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-52cde94f-8642-47ca-8c11-10f8c11e6a16 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers/52fbec09-f17c-4d1c-b6b5-8d208cc22b70/action" status: 404 len: 111 microversion: 2.1 time: 0.024357 Jul 19 22:50:47.454972 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2380/4781] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:50:47 2022] POST /compute/v2.1/servers/52fbec09-f17c-4d1c-b6b5-8d208cc22b70/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:50:47.470799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eaaf64fb-531f-4731-9e1f-38890ae55394 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:47.472606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eaaf64fb-531f-4731-9e1f-38890ae55394 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:47.489075 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eaaf64fb-531f-4731-9e1f-38890ae55394 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:47.489817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eaaf64fb-531f-4731-9e1f-38890ae55394 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:47.493234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eaaf64fb-531f-4731-9e1f-38890ae55394 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:47.493972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eaaf64fb-531f-4731-9e1f-38890ae55394 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:47.881073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-eaaf64fb-531f-4731-9e1f-38890ae55394 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:47.914541 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eaaf64fb-531f-4731-9e1f-38890ae55394 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.449245 Jul 19 22:50:47.943258 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2381/4782] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:47 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:50:47.958982 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2bdce815-1d43-423c-8efa-14bd65688551 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:47.960762 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2bdce815-1d43-423c-8efa-14bd65688551 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:47.982543 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bdce815-1d43-423c-8efa-14bd65688551 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:47.983015 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bdce815-1d43-423c-8efa-14bd65688551 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:47.983883 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bdce815-1d43-423c-8efa-14bd65688551 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:47.984335 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bdce815-1d43-423c-8efa-14bd65688551 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:48.346916 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:50:48.833415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-c7a6e7ad-c3c0-4d89-92c8-d6e29b0c1b54 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Building network info cache for instance {{(pid=119338) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 22:50:49.388566 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2bdce815-1d43-423c-8efa-14bd65688551 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:49.406807 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2bdce815-1d43-423c-8efa-14bd65688551 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1392 microversion: 2.1 time: 1.460227 Jul 19 22:50:49.407895 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2382/4783] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:47 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1392 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:49.661702 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-1ec15eac-9725-4108-9c43-8ad38485e96d req-b848ccb7-1907-4c38-93f7-7def99466959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c1ba16-fff7-480d-9af7-731cc40f338b", "tag": "98a6d1ad-0bbd-48ee-9c7c-81eec448b034"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:49.684850 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1ec15eac-9725-4108-9c43-8ad38485e96d req-b848ccb7-1907-4c38-93f7-7def99466959 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:49.686406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1ec15eac-9725-4108-9c43-8ad38485e96d req-b848ccb7-1907-4c38-93f7-7def99466959 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:49.720714 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-1ec15eac-9725-4108-9c43-8ad38485e96d req-b848ccb7-1907-4c38-93f7-7def99466959 service nova] Creating event network-changed:98a6d1ad-0bbd-48ee-9c7c-81eec448b034 for instance d4c1ba16-fff7-480d-9af7-731cc40f338b on n-h2-847009-3 Jul 19 22:50:49.728350 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-1ec15eac-9725-4108-9c43-8ad38485e96d req-b848ccb7-1907-4c38-93f7-7def99466959 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.317488 Jul 19 22:50:49.729509 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2383/4784] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:50:49.739206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-35426736-0709-4ecc-9256-f6e0142e3576 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:49.740139 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-35426736-0709-4ecc-9256-f6e0142e3576 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:49.750881 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-35426736-0709-4ecc-9256-f6e0142e3576 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:49.751785 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-35426736-0709-4ecc-9256-f6e0142e3576 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:49.753175 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-35426736-0709-4ecc-9256-f6e0142e3576 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:49.754354 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-35426736-0709-4ecc-9256-f6e0142e3576 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:50.680179 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-35426736-0709-4ecc-9256-f6e0142e3576 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:50.700921 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-35426736-0709-4ecc-9256-f6e0142e3576 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.969646 Jul 19 22:50:50.702698 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2384/4785] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:49 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:50.706792 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-35426736-0709-4ecc-9256-f6e0142e3576 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:50.708912 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-35426736-0709-4ecc-9256-f6e0142e3576 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002258 Jul 19 22:50:50.712836 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2385/4786] 10.222.0.25 () {56 vars in 885 bytes} [Tue Jul 19 22:50:50 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 19 22:50:50.729033 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0ab7ece4-c2d6-496a-87d2-1b6291a02368 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:50.730776 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0ab7ece4-c2d6-496a-87d2-1b6291a02368 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:50.748264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ab7ece4-c2d6-496a-87d2-1b6291a02368 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:50.749005 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ab7ece4-c2d6-496a-87d2-1b6291a02368 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:50.750475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ab7ece4-c2d6-496a-87d2-1b6291a02368 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:50.751271 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ab7ece4-c2d6-496a-87d2-1b6291a02368 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:51.418646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0ab7ece4-c2d6-496a-87d2-1b6291a02368 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:51.429858 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0ab7ece4-c2d6-496a-87d2-1b6291a02368 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1392 microversion: 2.1 time: 0.709197 Jul 19 22:50:51.431658 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2386/4787] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:50 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1392 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:51.443583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fda3a31b-3bcb-462e-ad27-d23b749f1ae3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:51.443583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fda3a31b-3bcb-462e-ad27-d23b749f1ae3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:51.456003 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fda3a31b-3bcb-462e-ad27-d23b749f1ae3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:51.456467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fda3a31b-3bcb-462e-ad27-d23b749f1ae3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:51.457267 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fda3a31b-3bcb-462e-ad27-d23b749f1ae3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:51.457734 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fda3a31b-3bcb-462e-ad27-d23b749f1ae3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:51.520771 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-fda3a31b-3bcb-462e-ad27-d23b749f1ae3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lazy-loading 'flavor' on Instance uuid fb0d2fe2-80ea-4fc2-a157-f7341877997c {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:50:51.608355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:50:51.677949 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fda3a31b-3bcb-462e-ad27-d23b749f1ae3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action" status: 202 len: 0 microversion: 2.1 time: 0.244847 Jul 19 22:50:51.680294 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2387/4788] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:50:51 2022] POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:50:51.688530 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fda3a31b-3bcb-462e-ad27-d23b749f1ae3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:51.690675 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fda3a31b-3bcb-462e-ad27-d23b749f1ae3 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.008057 Jul 19 22:50:51.707959 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2388/4789] 10.222.0.25 () {54 vars in 1034 bytes} [Tue Jul 19 22:50:51 2022] GET /compute/v2/ => generated 379 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jul 19 22:50:51.728305 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-36b9a778-f898-4723-9131-baa315ee4400 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:51.729247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-36b9a778-f898-4723-9131-baa315ee4400 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:51.758258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36b9a778-f898-4723-9131-baa315ee4400 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:51.758736 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36b9a778-f898-4723-9131-baa315ee4400 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:51.759945 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36b9a778-f898-4723-9131-baa315ee4400 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:51.760523 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36b9a778-f898-4723-9131-baa315ee4400 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:51.936660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=7 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:50:52.644440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-36b9a778-f898-4723-9131-baa315ee4400 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:52.655947 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-36b9a778-f898-4723-9131-baa315ee4400 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1513 microversion: 2.1 time: 0.939141 Jul 19 22:50:52.666091 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2389/4790] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:51 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1513 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:52.691737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-36b9a778-f898-4723-9131-baa315ee4400 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:52.696277 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-36b9a778-f898-4723-9131-baa315ee4400 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.004040 Jul 19 22:50:52.697896 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2390/4791] 10.222.0.25 () {54 vars in 1040 bytes} [Tue Jul 19 22:50:52 2022] GET /compute/v2.1/ => generated 388 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:50:52.715861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-09de943d-4ca9-47fb-bfd1-9e731a991e9d req-9353075e-ff49-4b42-9aa5-78938f817358 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecd77461-3bd1-4bc6-92b3-9d76ded15b13", "tag": "a788699a-cc1a-4989-a394-3914a32e6884"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:52.746646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-09de943d-4ca9-47fb-bfd1-9e731a991e9d req-9353075e-ff49-4b42-9aa5-78938f817358 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:52.748208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-09de943d-4ca9-47fb-bfd1-9e731a991e9d req-9353075e-ff49-4b42-9aa5-78938f817358 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:52.779397 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-09de943d-4ca9-47fb-bfd1-9e731a991e9d req-9353075e-ff49-4b42-9aa5-78938f817358 service nova] Creating event network-changed:a788699a-cc1a-4989-a394-3914a32e6884 for instance ecd77461-3bd1-4bc6-92b3-9d76ded15b13 on n-h1-847009-3 Jul 19 22:50:52.790020 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-09de943d-4ca9-47fb-bfd1-9e731a991e9d req-9353075e-ff49-4b42-9aa5-78938f817358 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089694 Jul 19 22:50:52.794296 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2391/4792] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:50:52.813683 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-670eabbe-ce7a-475a-9d7a-3f41a14067b2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:52.816142 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-670eabbe-ce7a-475a-9d7a-3f41a14067b2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:52.831064 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-670eabbe-ce7a-475a-9d7a-3f41a14067b2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:52.833607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-670eabbe-ce7a-475a-9d7a-3f41a14067b2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:52.836553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-670eabbe-ce7a-475a-9d7a-3f41a14067b2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:52.837757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-670eabbe-ce7a-475a-9d7a-3f41a14067b2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:52.896532 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-c7a6e7ad-c3c0-4d89-92c8-d6e29b0c1b54 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Updating instance_info_cache with network_info: [{"id": "a788699a-cc1a-4989-a394-3914a32e6884", "address": "fa:16:3e:91:5d:d7", "network": {"id": "0b4cb801-0215-490d-ae19-70ff1ab2ac04", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-108714672-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9974b621c2d64212bc970c2fa98f77af", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa788699a-cc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119338) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 22:50:52.928765 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7a6e7ad-c3c0-4d89-92c8-d6e29b0c1b54 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Releasing lock "refresh_cache-ecd77461-3bd1-4bc6-92b3-9d76ded15b13" {{(pid=119338) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 22:50:52.930020 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c7a6e7ad-c3c0-4d89-92c8-d6e29b0c1b54 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "POST /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13/action" status: 202 len: 0 microversion: 2.1 time: 11.032784 Jul 19 22:50:52.935536 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2402/4793] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:50:41 2022] POST /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13/action => generated 0 bytes in 11034 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 19 22:50:52.935536 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c7a6e7ad-c3c0-4d89-92c8-d6e29b0c1b54 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:52.935536 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c7a6e7ad-c3c0-4d89-92c8-d6e29b0c1b54 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001359 Jul 19 22:50:52.935536 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2403/4794] 10.222.0.25 () {56 vars in 885 bytes} [Tue Jul 19 22:50:52 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 19 22:50:52.952786 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-79636f11-7d12-4c89-8a04-ad9d1a8465a7 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.93"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:53.440314 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-79636f11-7d12-4c89-8a04-ad9d1a8465a7 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:53.444275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79636f11-7d12-4c89-8a04-ad9d1a8465a7 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:53.444747 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79636f11-7d12-4c89-8a04-ad9d1a8465a7 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:53.445524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79636f11-7d12-4c89-8a04-ad9d1a8465a7 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:53.445965 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79636f11-7d12-4c89-8a04-ad9d1a8465a7 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:53.522526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-670eabbe-ce7a-475a-9d7a-3f41a14067b2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:53.544187 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-670eabbe-ce7a-475a-9d7a-3f41a14067b2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1392 microversion: 2.1 time: 0.740011 Jul 19 22:50:53.554237 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2392/4795] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:52 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1392 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:53.696863 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3951831b-cc7c-43d5-bb99-14d833ed0155 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:53.697758 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3951831b-cc7c-43d5-bb99-14d833ed0155 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:53.709901 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3951831b-cc7c-43d5-bb99-14d833ed0155 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:53.710369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3951831b-cc7c-43d5-bb99-14d833ed0155 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:53.711218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3951831b-cc7c-43d5-bb99-14d833ed0155 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:53.711671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3951831b-cc7c-43d5-bb99-14d833ed0155 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:54.524934 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3951831b-cc7c-43d5-bb99-14d833ed0155 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:54.537485 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3951831b-cc7c-43d5-bb99-14d833ed0155 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1496 microversion: 2.1 time: 0.845562 Jul 19 22:50:54.551640 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2393/4796] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:53 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1496 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:50:54.560485 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2bdfc211-814e-4752-875e-3adda92b062f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:54.561803 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2bdfc211-814e-4752-875e-3adda92b062f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:54.586588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bdfc211-814e-4752-875e-3adda92b062f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:54.587732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bdfc211-814e-4752-875e-3adda92b062f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:54.588772 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bdfc211-814e-4752-875e-3adda92b062f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:54.589349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bdfc211-814e-4752-875e-3adda92b062f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:54.624203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-2bdfc211-814e-4752-875e-3adda92b062f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lazy-loading 'flavor' on Instance uuid fb0d2fe2-80ea-4fc2-a157-f7341877997c {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:50:54.640887 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-2bdfc211-814e-4752-875e-3adda92b062f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Cannot 'suspend' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state suspended Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2bdfc211-814e-4752-875e-3adda92b062f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action HTTP/1.1 Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 15 Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: {"suspend": {}} Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: exception: Cannot 'suspend' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state suspended Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'fb0d2fe2-80ea-4fc2-a157-f7341877997c', 'body': {'suspend': {}}} Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fb0d2fe2-80ea-4fc2-a157-f7341877997c in vm_state suspended. Cannot suspend while the instance is in this state. Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 19 22:50:54.643330 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 22:50:54.648784 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 22:50:54.648784 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 22:50:54.648784 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state suspended Jul 19 22:50:54.648784 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:54.648784 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:50:54.648784 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:54.648784 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:50:54.648784 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:50:54.648784 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:50:54.648784 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:50:54.648784 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:50:54.648784 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state suspended Jul 19 22:50:54.648784 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:50:54.653651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2bdfc211-814e-4752-875e-3adda92b062f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 409 to user: Cannot 'suspend' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state suspended {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:50:54.654985 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2bdfc211-814e-4752-875e-3adda92b062f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action" status: 409 len: 148 microversion: 2.1 time: 0.102116 Jul 19 22:50:54.659323 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2394/4797] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:50:54 2022] POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action => generated 148 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:50:54.665486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e6ab742e-446f-47ab-a283-edb4a1b3d324 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:54.666403 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e6ab742e-446f-47ab-a283-edb4a1b3d324 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:54.674573 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6ab742e-446f-47ab-a283-edb4a1b3d324 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:54.675444 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6ab742e-446f-47ab-a283-edb4a1b3d324 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:54.676615 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6ab742e-446f-47ab-a283-edb4a1b3d324 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:54.678114 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6ab742e-446f-47ab-a283-edb4a1b3d324 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:55.172755 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=14 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:50:55.257088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79636f11-7d12-4c89-8a04-ad9d1a8465a7 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Acquired lock "refresh_cache-ecd77461-3bd1-4bc6-92b3-9d76ded15b13" {{(pid=119338) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 22:50:55.900971 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e6ab742e-446f-47ab-a283-edb4a1b3d324 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:55.914350 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e6ab742e-446f-47ab-a283-edb4a1b3d324 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1392 microversion: 2.1 time: 1.253466 Jul 19 22:50:55.914935 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2395/4798] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:54 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1392 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:55.932001 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3986a1fc-81d2-4ffb-bc08-2fa5004becca tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:55.932947 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3986a1fc-81d2-4ffb-bc08-2fa5004becca tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:55.940129 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3986a1fc-81d2-4ffb-bc08-2fa5004becca tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:55.940842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3986a1fc-81d2-4ffb-bc08-2fa5004becca tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:55.942332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3986a1fc-81d2-4ffb-bc08-2fa5004becca tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:55.942947 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3986a1fc-81d2-4ffb-bc08-2fa5004becca tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:56.158896 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3986a1fc-81d2-4ffb-bc08-2fa5004becca tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action" status: 202 len: 0 microversion: 2.1 time: 0.231536 Jul 19 22:50:56.160839 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2396/4799] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:50:55 2022] POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:50:56.173582 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f57839d4-edc1-47e0-965d-1f21e74d01a9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:56.175260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f57839d4-edc1-47e0-965d-1f21e74d01a9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:56.187158 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f57839d4-edc1-47e0-965d-1f21e74d01a9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:56.188290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f57839d4-edc1-47e0-965d-1f21e74d01a9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:56.189321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f57839d4-edc1-47e0-965d-1f21e74d01a9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:56.189966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f57839d4-edc1-47e0-965d-1f21e74d01a9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:57.650410 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f57839d4-edc1-47e0-965d-1f21e74d01a9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:57.680976 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f57839d4-edc1-47e0-965d-1f21e74d01a9 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1502 microversion: 2.1 time: 1.514317 Jul 19 22:50:57.684282 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2397/4800] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:56 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1502 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:50:57.705883 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0c825d4e-23a8-4aaf-b5d5-20dccbcee010 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:57.716543 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0c825d4e-23a8-4aaf-b5d5-20dccbcee010 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:57.740201 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c825d4e-23a8-4aaf-b5d5-20dccbcee010 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:57.742322 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c825d4e-23a8-4aaf-b5d5-20dccbcee010 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:57.744750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c825d4e-23a8-4aaf-b5d5-20dccbcee010 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:57.752489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c825d4e-23a8-4aaf-b5d5-20dccbcee010 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:58.665573 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0c825d4e-23a8-4aaf-b5d5-20dccbcee010 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:50:58.680998 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0c825d4e-23a8-4aaf-b5d5-20dccbcee010 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1392 microversion: 2.1 time: 0.991910 Jul 19 22:50:58.681860 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2398/4801] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:57 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1392 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:50:58.690248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-95ca9085-ffc9-4028-99fe-e542d4da1430 req-41d60a21-ae86-4fc2-9688-de02b6bf54cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4c1ba16-fff7-480d-9af7-731cc40f338b", "name": "network-vif-plugged", "status": "completed", "tag": "98a6d1ad-0bbd-48ee-9c7c-81eec448b034"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:50:58.710693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-95ca9085-ffc9-4028-99fe-e542d4da1430 req-41d60a21-ae86-4fc2-9688-de02b6bf54cd service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:58.715600 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-95ca9085-ffc9-4028-99fe-e542d4da1430 req-41d60a21-ae86-4fc2-9688-de02b6bf54cd service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:58.716440 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-79636f11-7d12-4c89-8a04-ad9d1a8465a7 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Building network info cache for instance {{(pid=119338) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 19 22:50:58.740090 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-95ca9085-ffc9-4028-99fe-e542d4da1430 req-41d60a21-ae86-4fc2-9688-de02b6bf54cd service nova] Creating event network-vif-plugged:98a6d1ad-0bbd-48ee-9c7c-81eec448b034 for instance d4c1ba16-fff7-480d-9af7-731cc40f338b on n-h2-847009-3 Jul 19 22:50:58.752320 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-95ca9085-ffc9-4028-99fe-e542d4da1430 req-41d60a21-ae86-4fc2-9688-de02b6bf54cd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067740 Jul 19 22:50:58.756717 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2399/4802] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:50:58.771226 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8da8704e-8599-4ce0-9c38-1562849d339f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:50:58.772275 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8da8704e-8599-4ce0-9c38-1562849d339f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:50:58.784930 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8da8704e-8599-4ce0-9c38-1562849d339f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:58.785784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8da8704e-8599-4ce0-9c38-1562849d339f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:50:58.788050 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8da8704e-8599-4ce0-9c38-1562849d339f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:50:58.791830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8da8704e-8599-4ce0-9c38-1562849d339f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:00.142135 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8da8704e-8599-4ce0-9c38-1562849d339f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:00.157088 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8da8704e-8599-4ce0-9c38-1562849d339f tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1502 microversion: 2.1 time: 1.398884 Jul 19 22:51:00.162750 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2400/4803] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:50:58 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1502 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:00.168248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-c9118f62-6f26-4289-b4f1-495eaeaa5ae6 req-5800bcf6-a77a-4248-86c6-694b7d94f720 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecd77461-3bd1-4bc6-92b3-9d76ded15b13", "tag": "a788699a-cc1a-4989-a394-3914a32e6884"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:51:00.204643 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-c9118f62-6f26-4289-b4f1-495eaeaa5ae6 req-5800bcf6-a77a-4248-86c6-694b7d94f720 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:00.206267 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-c9118f62-6f26-4289-b4f1-495eaeaa5ae6 req-5800bcf6-a77a-4248-86c6-694b7d94f720 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:00.239330 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-c9118f62-6f26-4289-b4f1-495eaeaa5ae6 req-5800bcf6-a77a-4248-86c6-694b7d94f720 service nova] Creating event network-changed:a788699a-cc1a-4989-a394-3914a32e6884 for instance ecd77461-3bd1-4bc6-92b3-9d76ded15b13 on n-h1-847009-3 Jul 19 22:51:00.268306 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-c9118f62-6f26-4289-b4f1-495eaeaa5ae6 req-5800bcf6-a77a-4248-86c6-694b7d94f720 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103830 Jul 19 22:51:00.269224 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2401/4804] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:51:00.284867 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ef7412da-cce7-483b-a3aa-b7d24d960e48 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:00.288160 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ef7412da-cce7-483b-a3aa-b7d24d960e48 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:00.345516 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ef7412da-cce7-483b-a3aa-b7d24d960e48 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:00.354147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ef7412da-cce7-483b-a3aa-b7d24d960e48 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:00.355723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ef7412da-cce7-483b-a3aa-b7d24d960e48 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:00.356432 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ef7412da-cce7-483b-a3aa-b7d24d960e48 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:01.921761 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ef7412da-cce7-483b-a3aa-b7d24d960e48 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:01.941066 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ef7412da-cce7-483b-a3aa-b7d24d960e48 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1392 microversion: 2.1 time: 1.668255 Jul 19 22:51:01.952571 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2402/4805] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:00 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1392 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:01.957776 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-32f13755-7f9e-4de2-931d-6cbcaabc1ffd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:01.958418 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-32f13755-7f9e-4de2-931d-6cbcaabc1ffd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:01.972308 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32f13755-7f9e-4de2-931d-6cbcaabc1ffd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:01.972774 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32f13755-7f9e-4de2-931d-6cbcaabc1ffd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:01.973576 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32f13755-7f9e-4de2-931d-6cbcaabc1ffd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:01.978012 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32f13755-7f9e-4de2-931d-6cbcaabc1ffd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:03.150949 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-79636f11-7d12-4c89-8a04-ad9d1a8465a7 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Updating instance_info_cache with network_info: [{"id": "a788699a-cc1a-4989-a394-3914a32e6884", "address": "fa:16:3e:91:5d:d7", "network": {"id": "0b4cb801-0215-490d-ae19-70ff1ab2ac04", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-108714672-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9974b621c2d64212bc970c2fa98f77af", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa788699a-cc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119338) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 22:51:03.191587 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-32f13755-7f9e-4de2-931d-6cbcaabc1ffd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:03.192109 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79636f11-7d12-4c89-8a04-ad9d1a8465a7 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Releasing lock "refresh_cache-ecd77461-3bd1-4bc6-92b3-9d76ded15b13" {{(pid=119338) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 22:51:03.198870 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-79636f11-7d12-4c89-8a04-ad9d1a8465a7 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "POST /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13/action" status: 202 len: 0 microversion: 2.1 time: 10.256500 Jul 19 22:51:03.204184 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-32f13755-7f9e-4de2-931d-6cbcaabc1ffd tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 1.256854 Jul 19 22:51:03.205660 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2403/4806] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:01 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:03.224323 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2404/4807] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:50:52 2022] POST /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13/action => generated 0 bytes in 10281 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Jul 19 22:51:03.233515 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3606a9ab-261a-440e-8674-e4756d89c680 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:03.234511 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3606a9ab-261a-440e-8674-e4756d89c680 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:03.248016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1bfb7669-99b0-4b3d-8287-4806da8d49ca tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '.version_select at 0x7f7a03780d30>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:03.284717 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3606a9ab-261a-440e-8674-e4756d89c680 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:03.285325 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3606a9ab-261a-440e-8674-e4756d89c680 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:03.286231 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3606a9ab-261a-440e-8674-e4756d89c680 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:03.287847 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3606a9ab-261a-440e-8674-e4756d89c680 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:03.444680 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:51:04.200946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3606a9ab-261a-440e-8674-e4756d89c680 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:04.267129 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3606a9ab-261a-440e-8674-e4756d89c680 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1564 microversion: 2.1 time: 1.058088 Jul 19 22:51:04.274335 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2404/4808] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:03 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1564 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:04.301405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-815f09e8-3f72-4722-9920-8e1ebacb702b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:04.302747 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-815f09e8-3f72-4722-9920-8e1ebacb702b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:04.327498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-815f09e8-3f72-4722-9920-8e1ebacb702b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:04.327962 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-815f09e8-3f72-4722-9920-8e1ebacb702b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:04.328765 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-815f09e8-3f72-4722-9920-8e1ebacb702b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:04.329203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-815f09e8-3f72-4722-9920-8e1ebacb702b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:05.771038 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-815f09e8-3f72-4722-9920-8e1ebacb702b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:05.791896 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-815f09e8-3f72-4722-9920-8e1ebacb702b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 1.512399 Jul 19 22:51:05.799974 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2405/4809] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:04 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:05.808850 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5a99d8e2-b67c-4b38-8aba-6b47f9d6d498 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:05.811964 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5a99d8e2-b67c-4b38-8aba-6b47f9d6d498 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:05.828023 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a99d8e2-b67c-4b38-8aba-6b47f9d6d498 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:05.828508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a99d8e2-b67c-4b38-8aba-6b47f9d6d498 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:05.829582 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a99d8e2-b67c-4b38-8aba-6b47f9d6d498 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:05.830286 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a99d8e2-b67c-4b38-8aba-6b47f9d6d498 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:06.234773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5a99d8e2-b67c-4b38-8aba-6b47f9d6d498 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:06.246897 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:51:06.259775 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5a99d8e2-b67c-4b38-8aba-6b47f9d6d498 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1564 microversion: 2.1 time: 0.458053 Jul 19 22:51:06.261843 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2406/4810] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:05 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1564 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:06.266776 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5a99d8e2-b67c-4b38-8aba-6b47f9d6d498 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:06.267781 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5a99d8e2-b67c-4b38-8aba-6b47f9d6d498 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002665 Jul 19 22:51:06.268118 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2407/4811] 10.222.0.25 () {56 vars in 885 bytes} [Tue Jul 19 22:51:06 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 19 22:51:06.286656 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1b623705-76ec-4c73-8641-eef4403098ac tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:51:06.289108 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1b623705-76ec-4c73-8641-eef4403098ac tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: b96fb29b-c26d-48fe-b884-f4477f3c2a04] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:06.305661 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-1b623705-76ec-4c73-8641-eef4403098ac tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Instance b96fb29b-c26d-48fe-b884-f4477f3c2a04 could not be found. Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1b623705-76ec-4c73-8641-eef4403098ac tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/b96fb29b-c26d-48fe-b884-f4477f3c2a04/action HTTP/1.1 Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 15 Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: {"unpause": {}} Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance b96fb29b-c26d-48fe-b884-f4477f3c2a04 could not be found. Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'b96fb29b-c26d-48fe-b884-f4477f3c2a04', 'body': {'unpause': {}}} Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b96fb29b-c26d-48fe-b884-f4477f3c2a04 could not be found. Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b96fb29b-c26d-48fe-b884-f4477f3c2a04 could not be found. Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:51:06.312904 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:51:06.318144 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:51:06.318144 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:51:06.318144 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b96fb29b-c26d-48fe-b884-f4477f3c2a04 could not be found. Jul 19 22:51:06.318144 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:06.319903 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1b623705-76ec-4c73-8641-eef4403098ac tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 404 to user: Instance b96fb29b-c26d-48fe-b884-f4477f3c2a04 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:51:06.321806 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1b623705-76ec-4c73-8641-eef4403098ac tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers/b96fb29b-c26d-48fe-b884-f4477f3c2a04/action" status: 404 len: 111 microversion: 2.1 time: 0.049233 Jul 19 22:51:06.323786 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2408/4812] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:51:06 2022] POST /compute/v2.1/servers/b96fb29b-c26d-48fe-b884-f4477f3c2a04/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:51:06.340258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-103a280d-ef08-4ab4-b00a-7a3c93a36b2c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:06.341413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-103a280d-ef08-4ab4-b00a-7a3c93a36b2c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:06.359989 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-103a280d-ef08-4ab4-b00a-7a3c93a36b2c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:06.361979 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-103a280d-ef08-4ab4-b00a-7a3c93a36b2c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:06.364605 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-103a280d-ef08-4ab4-b00a-7a3c93a36b2c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:06.365839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-103a280d-ef08-4ab4-b00a-7a3c93a36b2c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:07.527465 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-103a280d-ef08-4ab4-b00a-7a3c93a36b2c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:07.539277 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-103a280d-ef08-4ab4-b00a-7a3c93a36b2c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 1.209026 Jul 19 22:51:07.544760 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2409/4813] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:06 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:51:07.568988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a16476cb-dc47-4f05-acbf-8c2d02f3c5de tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:07.569759 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a16476cb-dc47-4f05-acbf-8c2d02f3c5de tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:07.579732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a16476cb-dc47-4f05-acbf-8c2d02f3c5de tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:07.580212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a16476cb-dc47-4f05-acbf-8c2d02f3c5de tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:07.581021 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a16476cb-dc47-4f05-acbf-8c2d02f3c5de tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:07.581462 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a16476cb-dc47-4f05-acbf-8c2d02f3c5de tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:08.283598 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a16476cb-dc47-4f05-acbf-8c2d02f3c5de tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:08.297575 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a16476cb-dc47-4f05-acbf-8c2d02f3c5de tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.732540 Jul 19 22:51:08.300161 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2410/4814] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:07 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:08.323983 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3db87c8e-d2eb-41e7-839f-d329446ccb93 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:51:08.324967 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3db87c8e-d2eb-41e7-839f-d329446ccb93 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:08.332437 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3db87c8e-d2eb-41e7-839f-d329446ccb93 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:08.333098 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3db87c8e-d2eb-41e7-839f-d329446ccb93 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:08.334072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3db87c8e-d2eb-41e7-839f-d329446ccb93 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:08.334668 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3db87c8e-d2eb-41e7-839f-d329446ccb93 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:08.402314 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-3db87c8e-d2eb-41e7-839f-d329446ccb93 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Cannot 'unpause' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state active Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3db87c8e-d2eb-41e7-839f-d329446ccb93 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action HTTP/1.1 Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 15 Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: {"unpause": {}} Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: exception: Cannot 'unpause' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state active Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'fb0d2fe2-80ea-4fc2-a157-f7341877997c', 'body': {'unpause': {}}} Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fb0d2fe2-80ea-4fc2-a157-f7341877997c in vm_state active. Cannot unpause while the instance is in this state. Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state active Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:08.410438 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:51:08.414459 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:51:08.414459 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:51:08.414459 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:51:08.414459 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state active Jul 19 22:51:08.414459 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:08.416493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3db87c8e-d2eb-41e7-839f-d329446ccb93 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 409 to user: Cannot 'unpause' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state active {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:51:08.418402 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3db87c8e-d2eb-41e7-839f-d329446ccb93 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action" status: 409 len: 145 microversion: 2.1 time: 0.099644 Jul 19 22:51:08.419629 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2411/4815] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:51:08 2022] POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action => generated 145 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:51:08.436004 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-117ea288-40a4-4a82-8741-289ff044ac3d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:08.443176 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-117ea288-40a4-4a82-8741-289ff044ac3d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:08.456985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-117ea288-40a4-4a82-8741-289ff044ac3d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:08.457827 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-117ea288-40a4-4a82-8741-289ff044ac3d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:08.459162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-117ea288-40a4-4a82-8741-289ff044ac3d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:08.459829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-117ea288-40a4-4a82-8741-289ff044ac3d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:08.483885 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1bfb7669-99b0-4b3d-8287-4806da8d49ca tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/daf284c1-6569-4d63-8ddd-4561ea02886a" status: 202 len: 0 microversion: 2.1 time: 5.257653 Jul 19 22:51:08.484682 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2405/4816] 10.222.0.25 () {58 vars in 1262 bytes} [Tue Jul 19 22:51:03 2022] DELETE /compute/v2.1/os-floating-ips/daf284c1-6569-4d63-8ddd-4561ea02886a => generated 0 bytes in 5259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:51:08.497962 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5b8eb944-53d3-4325-a955-d67f7235d1a4 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '.version_select at 0x7f7a0377f430>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:08.905862 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-117ea288-40a4-4a82-8741-289ff044ac3d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:08.923972 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-117ea288-40a4-4a82-8741-289ff044ac3d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.497594 Jul 19 22:51:08.924502 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2412/4817] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:08 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:08.953375 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-46d54b74-9067-4ecb-80a6-e79494d4be84 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:08.954011 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-46d54b74-9067-4ecb-80a6-e79494d4be84 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:08.966409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46d54b74-9067-4ecb-80a6-e79494d4be84 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:08.970123 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46d54b74-9067-4ecb-80a6-e79494d4be84 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:08.971257 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46d54b74-9067-4ecb-80a6-e79494d4be84 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:08.971864 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46d54b74-9067-4ecb-80a6-e79494d4be84 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:09.818358 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-46d54b74-9067-4ecb-80a6-e79494d4be84 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:09.828865 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-46d54b74-9067-4ecb-80a6-e79494d4be84 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.880027 Jul 19 22:51:09.843079 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2413/4818] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:08 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:09.853049 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b5821d06-3fd2-4c6d-9436-7cd1edc19b7e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:51:09.854461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b5821d06-3fd2-4c6d-9436-7cd1edc19b7e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 2c0fd1b9-df33-46a3-9dd3-849ddc74152e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:09.866190 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-b5821d06-3fd2-4c6d-9436-7cd1edc19b7e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Instance 2c0fd1b9-df33-46a3-9dd3-849ddc74152e could not be found. Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b5821d06-3fd2-4c6d-9436-7cd1edc19b7e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/2c0fd1b9-df33-46a3-9dd3-849ddc74152e/action HTTP/1.1 Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 18 Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: {"unshelve": null} Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 2c0fd1b9-df33-46a3-9dd3-849ddc74152e could not be found. Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '2c0fd1b9-df33-46a3-9dd3-849ddc74152e', 'body': {'unshelve': None}} Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c0fd1b9-df33-46a3-9dd3-849ddc74152e could not be found. Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c0fd1b9-df33-46a3-9dd3-849ddc74152e could not be found. Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:09.869693 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:51:09.881743 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:51:09.881743 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:51:09.881743 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:51:09.881743 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c0fd1b9-df33-46a3-9dd3-849ddc74152e could not be found. Jul 19 22:51:09.881743 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:09.886848 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b5821d06-3fd2-4c6d-9436-7cd1edc19b7e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 404 to user: Instance 2c0fd1b9-df33-46a3-9dd3-849ddc74152e could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:51:09.888804 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b5821d06-3fd2-4c6d-9436-7cd1edc19b7e tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers/2c0fd1b9-df33-46a3-9dd3-849ddc74152e/action" status: 404 len: 111 microversion: 2.1 time: 0.043265 Jul 19 22:51:09.895982 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5b8eb944-53d3-4325-a955-d67f7235d1a4 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/cacd7621-c298-4e9b-9ceb-5d5cb4774fa7" status: 202 len: 0 microversion: 2.1 time: 1.404500 Jul 19 22:51:09.896749 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2414/4819] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:51:09 2022] POST /compute/v2.1/servers/2c0fd1b9-df33-46a3-9dd3-849ddc74152e/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:51:09.899656 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2406/4820] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 22:51:08 2022] DELETE /compute/v2.1/os-security-groups/cacd7621-c298-4e9b-9ceb-5d5cb4774fa7 => generated 0 bytes in 1409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 22:51:09.905404 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aea8e793-a9de-4745-8580-6ca0f5bc4294 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:09.905915 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-aea8e793-a9de-4745-8580-6ca0f5bc4294 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:09.907555 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-caeff3c3-c4b2-415c-838b-fbcb4e85e68a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:09.909423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-caeff3c3-c4b2-415c-838b-fbcb4e85e68a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:09.940284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-caeff3c3-c4b2-415c-838b-fbcb4e85e68a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:09.941174 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aea8e793-a9de-4745-8580-6ca0f5bc4294 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:09.941638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aea8e793-a9de-4745-8580-6ca0f5bc4294 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:09.942504 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aea8e793-a9de-4745-8580-6ca0f5bc4294 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:09.942801 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-caeff3c3-c4b2-415c-838b-fbcb4e85e68a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:09.942999 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aea8e793-a9de-4745-8580-6ca0f5bc4294 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:09.944050 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-caeff3c3-c4b2-415c-838b-fbcb4e85e68a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:09.944722 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-caeff3c3-c4b2-415c-838b-fbcb4e85e68a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:09.994225 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=32,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:51:10.002208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-aea8e793-a9de-4745-8580-6ca0f5bc4294 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:51:10.154224 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-aea8e793-a9de-4745-8580-6ca0f5bc4294 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 204 len: 0 microversion: 2.1 time: 0.253017 Jul 19 22:51:10.155587 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2407/4821] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:51:09 2022] DELETE /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:51:10.174847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2a29b21c-67ac-4932-bab1-90ab0f14d264 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:10.177084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2a29b21c-67ac-4932-bab1-90ab0f14d264 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:10.194291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2a29b21c-67ac-4932-bab1-90ab0f14d264 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:10.196086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2a29b21c-67ac-4932-bab1-90ab0f14d264 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:10.197153 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2a29b21c-67ac-4932-bab1-90ab0f14d264 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:10.199873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2a29b21c-67ac-4932-bab1-90ab0f14d264 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:10.449032 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-caeff3c3-c4b2-415c-838b-fbcb4e85e68a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:10.459005 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-caeff3c3-c4b2-415c-838b-fbcb4e85e68a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.560436 Jul 19 22:51:10.464605 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2415/4822] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:09 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:10.492907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0bdd7584-29ae-4114-a7d6-23ca376a7632 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:10.493899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0bdd7584-29ae-4114-a7d6-23ca376a7632 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:10.506959 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0bdd7584-29ae-4114-a7d6-23ca376a7632 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:10.511164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0bdd7584-29ae-4114-a7d6-23ca376a7632 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:10.512614 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0bdd7584-29ae-4114-a7d6-23ca376a7632 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:10.513292 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0bdd7584-29ae-4114-a7d6-23ca376a7632 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:11.356316 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2a29b21c-67ac-4932-bab1-90ab0f14d264 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c4089d759f44d789fa274a98671215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9974b621c2d64212bc970c2fa98f77af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:11.369008 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2a29b21c-67ac-4932-bab1-90ab0f14d264 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 200 len: 1509 microversion: 2.1 time: 1.208542 Jul 19 22:51:11.370022 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2408/4823] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:10 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 1509 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:11.541529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0bdd7584-29ae-4114-a7d6-23ca376a7632 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:11.553329 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0bdd7584-29ae-4114-a7d6-23ca376a7632 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 1.064691 Jul 19 22:51:11.553926 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2416/4824] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:10 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:51:11.571875 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2c3e63aa-a25f-488e-859c-e7fa2a79062a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:51:11.572651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2c3e63aa-a25f-488e-859c-e7fa2a79062a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:11.585792 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c3e63aa-a25f-488e-859c-e7fa2a79062a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:11.586813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c3e63aa-a25f-488e-859c-e7fa2a79062a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:11.592833 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c3e63aa-a25f-488e-859c-e7fa2a79062a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:11.593465 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c3e63aa-a25f-488e-859c-e7fa2a79062a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:11.679280 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-2c3e63aa-a25f-488e-859c-e7fa2a79062a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Cannot 'unshelve' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state active Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2c3e63aa-a25f-488e-859c-e7fa2a79062a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action HTTP/1.1 Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 18 Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: {"unshelve": null} Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: exception: Cannot 'unshelve' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state active Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'fb0d2fe2-80ea-4fc2-a157-f7341877997c', 'body': {'unshelve': None}} Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fb0d2fe2-80ea-4fc2-a157-f7341877997c in vm_state active. Cannot unshelve while the instance is in this state. Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state active Jul 19 22:51:11.681026 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:51:11.687483 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:51:11.687483 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:51:11.687483 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:11.687483 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:51:11.687483 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:51:11.687483 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:51:11.687483 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:51:11.687483 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state active Jul 19 22:51:11.687483 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:51:11.687483 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2c3e63aa-a25f-488e-859c-e7fa2a79062a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 409 to user: Cannot 'unshelve' instance fb0d2fe2-80ea-4fc2-a157-f7341877997c while it is in vm_state active {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:51:11.687483 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2c3e63aa-a25f-488e-859c-e7fa2a79062a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action" status: 409 len: 146 microversion: 2.1 time: 0.115944 Jul 19 22:51:11.687483 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2409/4825] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:51:11 2022] POST /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c/action => generated 146 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 22:51:11.691460 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0c0d3f64-a61a-4c66-93bd-86e82499c572 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:11.692091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0c0d3f64-a61a-4c66-93bd-86e82499c572 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:11.708392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c0d3f64-a61a-4c66-93bd-86e82499c572 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:11.709120 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c0d3f64-a61a-4c66-93bd-86e82499c572 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:11.710311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c0d3f64-a61a-4c66-93bd-86e82499c572 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:11.710916 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c0d3f64-a61a-4c66-93bd-86e82499c572 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:12.063274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0c0d3f64-a61a-4c66-93bd-86e82499c572 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:12.072826 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0c0d3f64-a61a-4c66-93bd-86e82499c572 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.385326 Jul 19 22:51:12.074389 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2417/4826] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:11 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:12.099918 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b1078320-82d7-4171-8f16-d2d358bc733c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:12.100473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b1078320-82d7-4171-8f16-d2d358bc733c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:12.113399 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b1078320-82d7-4171-8f16-d2d358bc733c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:12.114160 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b1078320-82d7-4171-8f16-d2d358bc733c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:12.115171 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b1078320-82d7-4171-8f16-d2d358bc733c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:12.115915 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b1078320-82d7-4171-8f16-d2d358bc733c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:12.386805 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-508d912c-573c-4504-bf8e-3e4a2ed267d6 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:12.388133 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-508d912c-573c-4504-bf8e-3e4a2ed267d6 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:12.395949 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-508d912c-573c-4504-bf8e-3e4a2ed267d6 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:12.396803 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-508d912c-573c-4504-bf8e-3e4a2ed267d6 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:12.397820 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-508d912c-573c-4504-bf8e-3e4a2ed267d6 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:12.398604 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-508d912c-573c-4504-bf8e-3e4a2ed267d6 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:12.562628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b1078320-82d7-4171-8f16-d2d358bc733c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:12.599892 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b1078320-82d7-4171-8f16-d2d358bc733c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.505371 Jul 19 22:51:12.600503 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2410/4827] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:12 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:12.617240 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-03268d5b-ee28-4397-9802-9039598a402d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1982018453_updated"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:51:12.618625 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-03268d5b-ee28-4397-9802-9039598a402d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: c565a96d-99b2-413d-b2a3-93aa18a8e5e4] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:12.634302 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-03268d5b-ee28-4397-9802-9039598a402d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Instance c565a96d-99b2-413d-b2a3-93aa18a8e5e4 could not be found. Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-03268d5b-ee28-4397-9802-9039598a402d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: request: PUT /compute/v2.1/servers/c565a96d-99b2-413d-b2a3-93aa18a8e5e4 HTTP/1.1 Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 81 Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1982018453_updated"}} Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance c565a96d-99b2-413d-b2a3-93aa18a8e5e4 could not be found. Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'c565a96d-99b2-413d-b2a3-93aa18a8e5e4', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1982018453_updated'}}} Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c565a96d-99b2-413d-b2a3-93aa18a8e5e4 could not be found. Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 19 22:51:12.638526 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:51:12.643392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:51:12.643392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:51:12.643392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:51:12.643392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c565a96d-99b2-413d-b2a3-93aa18a8e5e4 could not be found. Jul 19 22:51:12.643392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:51:12.643392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:51:12.643392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:51:12.643392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:12.643392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:51:12.643392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:51:12.643392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:51:12.643392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:51:12.643392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c565a96d-99b2-413d-b2a3-93aa18a8e5e4 could not be found. Jul 19 22:51:12.643392 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:51:12.643392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-03268d5b-ee28-4397-9802-9039598a402d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 404 to user: Instance c565a96d-99b2-413d-b2a3-93aa18a8e5e4 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:51:12.643392 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-03268d5b-ee28-4397-9802-9039598a402d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "PUT /compute/v2.1/servers/c565a96d-99b2-413d-b2a3-93aa18a8e5e4" status: 404 len: 111 microversion: 2.1 time: 0.026585 Jul 19 22:51:12.644693 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2411/4828] 10.222.0.25 () {60 vars in 1255 bytes} [Tue Jul 19 22:51:12 2022] PUT /compute/v2.1/servers/c565a96d-99b2-413d-b2a3-93aa18a8e5e4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:51:12.648593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c20b621c-7c3a-42ef-8086-8fd1b9464f82 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:12.649216 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c20b621c-7c3a-42ef-8086-8fd1b9464f82 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:12.656958 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c20b621c-7c3a-42ef-8086-8fd1b9464f82 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:12.657661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c20b621c-7c3a-42ef-8086-8fd1b9464f82 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:12.658602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c20b621c-7c3a-42ef-8086-8fd1b9464f82 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:12.659962 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c20b621c-7c3a-42ef-8086-8fd1b9464f82 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:12.992972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-508d912c-573c-4504-bf8e-3e4a2ed267d6 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c4089d759f44d789fa274a98671215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9974b621c2d64212bc970c2fa98f77af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:13.010530 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-508d912c-573c-4504-bf8e-3e4a2ed267d6 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 200 len: 1509 microversion: 2.1 time: 0.626124 Jul 19 22:51:13.013363 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2418/4829] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:12 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 1509 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:51:13.159396 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c20b621c-7c3a-42ef-8086-8fd1b9464f82 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:13.173723 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c20b621c-7c3a-42ef-8086-8fd1b9464f82 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.528845 Jul 19 22:51:13.187981 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2412/4830] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:12 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:51:13.196643 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-13b5f7b5-8037-4d62-9e6b-2fc503b8e6bc tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:13.197289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-13b5f7b5-8037-4d62-9e6b-2fc503b8e6bc tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:13.214833 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13b5f7b5-8037-4d62-9e6b-2fc503b8e6bc tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:13.215641 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13b5f7b5-8037-4d62-9e6b-2fc503b8e6bc tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:13.218204 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13b5f7b5-8037-4d62-9e6b-2fc503b8e6bc tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:13.219025 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13b5f7b5-8037-4d62-9e6b-2fc503b8e6bc tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:13.749540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-13b5f7b5-8037-4d62-9e6b-2fc503b8e6bc tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:13.788668 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-13b5f7b5-8037-4d62-9e6b-2fc503b8e6bc tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.599620 Jul 19 22:51:13.804275 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2419/4831] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:13 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:51:13.815306 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-09c2516a-b117-420b-bb63-241ddef3b108 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-09c2516a-b117-420b-bb63-241ddef3b108 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: request: PUT /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c HTTP/1.1 Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 280 Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'fb0d2fe2-80ea-4fc2-a157-f7341877997c', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:13.818841 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:51:13.822895 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:51:13.822895 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:51:13.822895 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:51:13.822895 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:51:13.822895 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:51:13.822895 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:51:13.822895 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:51:13.822895 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:51:13.822895 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:51:13.822895 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:51:13.822895 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:51:13.822895 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:51:13.822895 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:51:13.822895 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 22:51:13.822895 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:51:13.822895 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:51:13.822895 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:51:13.822895 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:13.822895 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:51:13.822895 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:51:13.822895 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:51:13.822895 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:51:13.822895 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 22:51:13.822895 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:51:13.826735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-09c2516a-b117-420b-bb63-241ddef3b108 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:51:13.828532 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-09c2516a-b117-420b-bb63-241ddef3b108 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "PUT /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 400 len: 619 microversion: 2.1 time: 0.019674 Jul 19 22:51:13.837981 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2413/4832] 10.222.0.25 () {60 vars in 1256 bytes} [Tue Jul 19 22:51:13 2022] PUT /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 619 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 22:51:13.842283 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b7227742-7051-4d52-bd65-a7c973a62886 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:13.871276 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b7227742-7051-4d52-bd65-a7c973a62886 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:13.905171 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=92 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:51:13.912386 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7227742-7051-4d52-bd65-a7c973a62886 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:13.913470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7227742-7051-4d52-bd65-a7c973a62886 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:13.918686 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7227742-7051-4d52-bd65-a7c973a62886 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:13.921092 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7227742-7051-4d52-bd65-a7c973a62886 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:14.033032 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7232580c-9804-4a15-a7c6-f6ca10851778 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:14.033677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7232580c-9804-4a15-a7c6-f6ca10851778 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:14.084642 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7232580c-9804-4a15-a7c6-f6ca10851778 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:14.085133 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7232580c-9804-4a15-a7c6-f6ca10851778 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:14.094967 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7232580c-9804-4a15-a7c6-f6ca10851778 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:14.095588 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7232580c-9804-4a15-a7c6-f6ca10851778 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:14.396232 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7232580c-9804-4a15-a7c6-f6ca10851778 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c4089d759f44d789fa274a98671215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9974b621c2d64212bc970c2fa98f77af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:14.420251 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7232580c-9804-4a15-a7c6-f6ca10851778 tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 200 len: 1467 microversion: 2.1 time: 0.392450 Jul 19 22:51:14.421205 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2414/4833] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:14 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 1467 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:14.571433 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-5f4a05e2-7238-4cc6-b1b2-37bd9f654d86 req-9105ba07-b368-4831-a528-529954cf0295 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecd77461-3bd1-4bc6-92b3-9d76ded15b13", "name": "network-vif-deleted", "tag": "a788699a-cc1a-4989-a394-3914a32e6884"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:51:14.590954 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5f4a05e2-7238-4cc6-b1b2-37bd9f654d86 req-9105ba07-b368-4831-a528-529954cf0295 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:14.593813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5f4a05e2-7238-4cc6-b1b2-37bd9f654d86 req-9105ba07-b368-4831-a528-529954cf0295 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:14.639380 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-5f4a05e2-7238-4cc6-b1b2-37bd9f654d86 req-9105ba07-b368-4831-a528-529954cf0295 service nova] Creating event network-vif-deleted:a788699a-cc1a-4989-a394-3914a32e6884 for instance ecd77461-3bd1-4bc6-92b3-9d76ded15b13 on n-h1-847009-3 Jul 19 22:51:14.653517 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-5f4a05e2-7238-4cc6-b1b2-37bd9f654d86 req-9105ba07-b368-4831-a528-529954cf0295 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087855 Jul 19 22:51:14.654187 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2415/4834] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:51:14.686962 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b7227742-7051-4d52-bd65-a7c973a62886 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:14.712070 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b7227742-7051-4d52-bd65-a7c973a62886 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.876955 Jul 19 22:51:14.713443 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2420/4835] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:13 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:14.744962 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-919994a0-10f4-4f5a-965c-03d354b98a57 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:14.748757 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-919994a0-10f4-4f5a-965c-03d354b98a57 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:14.769120 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-919994a0-10f4-4f5a-965c-03d354b98a57 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:14.770053 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-919994a0-10f4-4f5a-965c-03d354b98a57 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:14.774004 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-919994a0-10f4-4f5a-965c-03d354b98a57 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:14.774641 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-919994a0-10f4-4f5a-965c-03d354b98a57 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:15.039052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-919994a0-10f4-4f5a-965c-03d354b98a57 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:15.052833 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-919994a0-10f4-4f5a-965c-03d354b98a57 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.322934 Jul 19 22:51:15.069854 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2416/4836] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:14 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:15.079938 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-08d57d43-420b-455d-b2c8-4b618f4d6d9d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-08d57d43-420b-455d-b2c8-4b618f4d6d9d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: request: PUT /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c HTTP/1.1 Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 24 Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: {"server": {"name": ""}} Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'fb0d2fe2-80ea-4fc2-a157-f7341877997c', 'body': {'server': {'name': ''}}} Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise error Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi '' Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 22:51:15.083644 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 19 22:51:15.088022 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:15.088022 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:51:15.088022 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:15.088022 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:15.088022 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:51:15.088022 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:51:15.088022 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 22:51:15.088022 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 22:51:15.088022 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 19 22:51:15.088022 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:15.094383 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-08d57d43-420b-455d-b2c8-4b618f4d6d9d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:51:15.099516 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-08d57d43-420b-455d-b2c8-4b618f4d6d9d tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "PUT /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 400 len: 108 microversion: 2.1 time: 0.026522 Jul 19 22:51:15.106033 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2421/4837] 10.222.0.25 () {60 vars in 1255 bytes} [Tue Jul 19 22:51:15 2022] PUT /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 108 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 22:51:15.109759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d7dbcea6-154a-4f6f-ad25-4577add6a16a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:15.110483 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d7dbcea6-154a-4f6f-ad25-4577add6a16a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:15.122740 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7dbcea6-154a-4f6f-ad25-4577add6a16a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:15.123556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7dbcea6-154a-4f6f-ad25-4577add6a16a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:15.124820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7dbcea6-154a-4f6f-ad25-4577add6a16a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:15.125259 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7dbcea6-154a-4f6f-ad25-4577add6a16a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:15.440646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9ddfed27-db21-4d5d-88b7-f0762098a9fb tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:15.441749 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9ddfed27-db21-4d5d-88b7-f0762098a9fb tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] [instance: ecd77461-3bd1-4bc6-92b3-9d76ded15b13] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:15.463885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ddfed27-db21-4d5d-88b7-f0762098a9fb tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:15.464909 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ddfed27-db21-4d5d-88b7-f0762098a9fb tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:15.465740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ddfed27-db21-4d5d-88b7-f0762098a9fb tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:15.466193 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ddfed27-db21-4d5d-88b7-f0762098a9fb tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:15.515431 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-9ddfed27-db21-4d5d-88b7-f0762098a9fb tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] HTTP exception thrown: Instance ecd77461-3bd1-4bc6-92b3-9d76ded15b13 could not be found. Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9ddfed27-db21-4d5d-88b7-f0762098a9fb tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Request method failure captured: Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 HTTP/1.1 Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zUAx5TvrrCVitJWaEnTsBC-piJHC5-v6jwMi0LY9XducXwJ2tuOlKf-AgdUa_pk7PSobn2GmBVXBc6cVrKB3qsi45T9-wk85msPhFAdD2xmZztwelEMy-_53urR5ZDPEjkp8zK12jOohrLIaX6OsahF1m9sWz1Ep1bALpF-8dS6Mhk Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 9974b621c2d64212bc970c2fa98f77af Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-92504267 Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9974b621c2d64212bc970c2fa98f77af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9974b621c2d64212bc970c2fa98f77af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9974b621c2d64212bc970c2fa98f77af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9974b621c2d64212bc970c2fa98f77af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-92504267 Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 9974b621c2d64212bc970c2fa98f77af Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-92504267 Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerRescueTestJSONUnderV235-92504267-project Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 04c4089d759f44d789fa274a98671215 Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-92504267-project Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance ecd77461-3bd1-4bc6-92b3-9d76ded15b13 could not be found. Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'ecd77461-3bd1-4bc6-92b3-9d76ded15b13'} Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecd77461-3bd1-4bc6-92b3-9d76ded15b13 could not be found. Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecd77461-3bd1-4bc6-92b3-9d76ded15b13 could not be found. Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:51:15.517098 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:15.522103 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:15.522103 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:51:15.522103 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:51:15.522103 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:51:15.522103 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:51:15.522103 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecd77461-3bd1-4bc6-92b3-9d76ded15b13 could not be found. Jul 19 22:51:15.522103 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:15.522103 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9ddfed27-db21-4d5d-88b7-f0762098a9fb tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] Returning 404 to user: Instance ecd77461-3bd1-4bc6-92b3-9d76ded15b13 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:51:15.522103 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9ddfed27-db21-4d5d-88b7-f0762098a9fb tempest-ServerRescueTestJSONUnderV235-92504267 tempest-ServerRescueTestJSONUnderV235-92504267-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13" status: 404 len: 111 microversion: 2.1 time: 0.084229 Jul 19 22:51:15.526953 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2422/4838] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:15 2022] GET /compute/v2.1/servers/ecd77461-3bd1-4bc6-92b3-9d76ded15b13 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:51:15.675279 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d7dbcea6-154a-4f6f-ad25-4577add6a16a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:15.691263 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d7dbcea6-154a-4f6f-ad25-4577add6a16a tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1505 microversion: 2.1 time: 0.580798 Jul 19 22:51:15.694280 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2417/4839] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:15 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1505 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:20.882017 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4a5e1284-749a-4b3f-aae2-ee65846e985f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:20.882957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4a5e1284-749a-4b3f-aae2-ee65846e985f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:20.906484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4a5e1284-749a-4b3f-aae2-ee65846e985f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:20.907582 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4a5e1284-749a-4b3f-aae2-ee65846e985f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:20.908690 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4a5e1284-749a-4b3f-aae2-ee65846e985f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:20.909365 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4a5e1284-749a-4b3f-aae2-ee65846e985f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:21.457420 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-d77566c5-6e84-4adc-90b1-33da5852ff5a req-45e3bba3-a793-4e09-b9f5-3d224210a973 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c1ba16-fff7-480d-9af7-731cc40f338b", "tag": "98a6d1ad-0bbd-48ee-9c7c-81eec448b034"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:51:21.479371 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d77566c5-6e84-4adc-90b1-33da5852ff5a req-45e3bba3-a793-4e09-b9f5-3d224210a973 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:21.480257 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d77566c5-6e84-4adc-90b1-33da5852ff5a req-45e3bba3-a793-4e09-b9f5-3d224210a973 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:21.534137 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-d77566c5-6e84-4adc-90b1-33da5852ff5a req-45e3bba3-a793-4e09-b9f5-3d224210a973 service nova] Creating event network-changed:98a6d1ad-0bbd-48ee-9c7c-81eec448b034 for instance d4c1ba16-fff7-480d-9af7-731cc40f338b on n-h2-847009-3 Jul 19 22:51:21.543689 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-d77566c5-6e84-4adc-90b1-33da5852ff5a req-45e3bba3-a793-4e09-b9f5-3d224210a973 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.598610 Jul 19 22:51:21.544737 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2418/4840] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:51:22.510387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4a5e1284-749a-4b3f-aae2-ee65846e985f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:22.531954 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4a5e1284-749a-4b3f-aae2-ee65846e985f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1564 microversion: 2.1 time: 1.655114 Jul 19 22:51:22.541219 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2423/4841] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:20 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1564 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:25.054377 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-51599d76-0973-4c9f-987c-9dda453c212b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:25.054974 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-51599d76-0973-4c9f-987c-9dda453c212b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:25.065085 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51599d76-0973-4c9f-987c-9dda453c212b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:25.065529 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51599d76-0973-4c9f-987c-9dda453c212b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:25.066316 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51599d76-0973-4c9f-987c-9dda453c212b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:25.066754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51599d76-0973-4c9f-987c-9dda453c212b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:25.116516 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-51599d76-0973-4c9f-987c-9dda453c212b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-51599d76-0973-4c9f-987c-9dda453c212b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 HTTP/1.1 Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680'} Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:51:25.118246 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:51:25.122597 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. Jul 19 22:51:25.122597 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:51:25.122597 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:51:25.122597 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:51:25.122597 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:25.122597 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:51:25.122597 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:51:25.122597 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:51:25.122597 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:51:25.122597 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. Jul 19 22:51:25.122597 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:51:25.122597 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-51599d76-0973-4c9f-987c-9dda453c212b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 404 to user: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:51:25.122597 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-51599d76-0973-4c9f-987c-9dda453c212b tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680" status: 404 len: 111 microversion: 2.1 time: 0.070740 Jul 19 22:51:25.129961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c5bacf0f-6ba4-4c8c-9d59-6d8a4893e646 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:25.130574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c5bacf0f-6ba4-4c8c-9d59-6d8a4893e646 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:25.143904 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2419/4842] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:51:25 2022] DELETE /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:51:25.146435 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5bacf0f-6ba4-4c8c-9d59-6d8a4893e646 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:25.146889 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5bacf0f-6ba4-4c8c-9d59-6d8a4893e646 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:25.159593 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5bacf0f-6ba4-4c8c-9d59-6d8a4893e646 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:25.160145 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c5bacf0f-6ba4-4c8c-9d59-6d8a4893e646 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:25.196991 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-c5bacf0f-6ba4-4c8c-9d59-6d8a4893e646 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c5bacf0f-6ba4-4c8c-9d59-6d8a4893e646 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 HTTP/1.1 Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680'} Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:51:25.199190 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:25.205336 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:25.205336 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:51:25.205336 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:51:25.205336 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:51:25.205336 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:51:25.205336 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. Jul 19 22:51:25.205336 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:25.205336 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c5bacf0f-6ba4-4c8c-9d59-6d8a4893e646 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 404 to user: Instance 7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:51:25.205336 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c5bacf0f-6ba4-4c8c-9d59-6d8a4893e646 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680" status: 404 len: 111 microversion: 2.1 time: 0.074654 Jul 19 22:51:25.205336 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2424/4843] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:25 2022] GET /compute/v2.1/servers/7e0836f6-cb1e-4c5d-a0a5-a5c6ee6d3680 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:51:25.220120 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a1c459f5-faad-4d03-9b30-a93d22edb11c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:25.220627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a1c459f5-faad-4d03-9b30-a93d22edb11c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:25.226970 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a1c459f5-faad-4d03-9b30-a93d22edb11c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:25.227459 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a1c459f5-faad-4d03-9b30-a93d22edb11c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:25.228244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a1c459f5-faad-4d03-9b30-a93d22edb11c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:25.228679 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a1c459f5-faad-4d03-9b30-a93d22edb11c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:25.281912 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a1c459f5-faad-4d03-9b30-a93d22edb11c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:51:25.483671 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a1c459f5-faad-4d03-9b30-a93d22edb11c tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 204 len: 0 microversion: 2.1 time: 0.263883 Jul 19 22:51:25.485732 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2425/4844] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:51:25 2022] DELETE /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:51:25.498966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c0eb97ef-ae12-443e-b703-95d455f385c8 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:25.514688 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c0eb97ef-ae12-443e-b703-95d455f385c8 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:25.540297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c0eb97ef-ae12-443e-b703-95d455f385c8 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:25.544944 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c0eb97ef-ae12-443e-b703-95d455f385c8 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:25.546043 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c0eb97ef-ae12-443e-b703-95d455f385c8 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:25.546663 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c0eb97ef-ae12-443e-b703-95d455f385c8 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:26.107468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a1618ebf-ca62-4fe0-bcc3-729dad971188 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Action: 'create', calling method: .version_select at 0x7f7a03a529d0>, body: {"keypair": {"name": "tempest-keypair-957729495", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5MElA27cD8vXH7y98DAYwiWgcyPlWPouUdBnV9B75M/DDQStumExQQxKLOGAc6+daM8xeCxnGQy82A0xoNKtDd5wq4E3qft1+pB3K8KIYzYmXEXV5TTR6AsS6P2OLG0Q=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:51:26.146387 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-a1618ebf-ca62-4fe0-bcc3-729dad971188 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Getting quotas for project e3b759a0bda64e3c9df38b624d4145b6. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:51:26.169506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-a1618ebf-ca62-4fe0-bcc3-729dad971188 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Getting quotas for user c3929e62eb4345f8a69fec37ba7c195f and project e3b759a0bda64e3c9df38b624d4145b6. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:51:26.253736 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a1618ebf-ca62-4fe0-bcc3-729dad971188 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.104770 Jul 19 22:51:26.257917 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2420/4845] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:51:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:51:26.483470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c0eb97ef-ae12-443e-b703-95d455f385c8 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:26.500791 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c0eb97ef-ae12-443e-b703-95d455f385c8 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1511 microversion: 2.1 time: 1.010105 Jul 19 22:51:26.507180 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2426/4846] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:25 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1511 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:27.524840 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-06ca7abd-d162-442d-8c2b-9f37fa4ca203 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:27.525484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-06ca7abd-d162-442d-8c2b-9f37fa4ca203 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:27.552774 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-06ca7abd-d162-442d-8c2b-9f37fa4ca203 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:27.553383 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-06ca7abd-d162-442d-8c2b-9f37fa4ca203 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:27.554466 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-06ca7abd-d162-442d-8c2b-9f37fa4ca203 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:27.554960 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-06ca7abd-d162-442d-8c2b-9f37fa4ca203 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:27.630290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:51:28.021352 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2c069c8f-d060-4c33-9641-2a98160cb494 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1332661084", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": "none"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:51:28.124602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-2c069c8f-d060-4c33-9641-2a98160cb494 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:51:28.125469 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-2c069c8f-d060-4c33-9641-2a98160cb494 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:51:28.126194 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-2c069c8f-d060-4c33-9641-2a98160cb494 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:51:28.126837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-2c069c8f-d060-4c33-9641-2a98160cb494 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:51:28.127529 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-2c069c8f-d060-4c33-9641-2a98160cb494 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:51:28.165008 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c069c8f-d060-4c33-9641-2a98160cb494 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:28.171375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c069c8f-d060-4c33-9641-2a98160cb494 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:28.174559 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c069c8f-d060-4c33-9641-2a98160cb494 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:28.175090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c069c8f-d060-4c33-9641-2a98160cb494 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:28.262771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-2c069c8f-d060-4c33-9641-2a98160cb494 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Getting quotas for project abf7f55a82eb498697a913f46e190db4. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:51:28.274288 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-2c069c8f-d060-4c33-9641-2a98160cb494 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Getting quotas for user 048594c6bd0348abb192c7b05e823ca7 and project abf7f55a82eb498697a913f46e190db4. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:51:28.320718 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2c069c8f-d060-4c33-9641-2a98160cb494 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:51:28.330129 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2c069c8f-d060-4c33-9641-2a98160cb494 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:51:28.360303 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-06ca7abd-d162-442d-8c2b-9f37fa4ca203 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:28.383352 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-06ca7abd-d162-442d-8c2b-9f37fa4ca203 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1511 microversion: 2.1 time: 0.863023 Jul 19 22:51:28.384118 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2427/4847] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:27 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1511 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:28.432053 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2c069c8f-d060-4c33-9641-2a98160cb494 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 1.128641 Jul 19 22:51:28.434846 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2421/4848] 10.222.0.25 () {62 vars in 1187 bytes} [Tue Jul 19 22:51:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 22:51:28.446622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3104a49c-5e8f-4309-a29f-221a35f325be tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:28.447627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3104a49c-5e8f-4309-a29f-221a35f325be tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:28.673633 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3104a49c-5e8f-4309-a29f-221a35f325be tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:28.690518 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3104a49c-5e8f-4309-a29f-221a35f325be tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:28.693604 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3104a49c-5e8f-4309-a29f-221a35f325be tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:28.703688 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3104a49c-5e8f-4309-a29f-221a35f325be tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1278 microversion: 2.54 time: 0.261832 Jul 19 22:51:28.709812 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2428/4849] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:51:28 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1278 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:51:29.407379 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0b9db73f-da7e-4f71-ad71-d0b134f89a84 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:29.408228 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0b9db73f-da7e-4f71-ad71-d0b134f89a84 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:29.425986 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b9db73f-da7e-4f71-ad71-d0b134f89a84 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:29.426895 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b9db73f-da7e-4f71-ad71-d0b134f89a84 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:29.428035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b9db73f-da7e-4f71-ad71-d0b134f89a84 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:29.428756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b9db73f-da7e-4f71-ad71-d0b134f89a84 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:29.731745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6d42d669-8ad5-41de-b585-3dfd8b4d3a0b tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:29.732386 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6d42d669-8ad5-41de-b585-3dfd8b4d3a0b tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:29.755537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d42d669-8ad5-41de-b585-3dfd8b4d3a0b tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:29.755814 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d42d669-8ad5-41de-b585-3dfd8b4d3a0b tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:29.756552 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d42d669-8ad5-41de-b585-3dfd8b4d3a0b tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:29.757009 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d42d669-8ad5-41de-b585-3dfd8b4d3a0b tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:29.996458 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0b9db73f-da7e-4f71-ad71-d0b134f89a84 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c827b931a0f497cbd847695315d378d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a2933535544cdca4932622d038d8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:30.007770 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0b9db73f-da7e-4f71-ad71-d0b134f89a84 tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 200 len: 1511 microversion: 2.1 time: 0.604555 Jul 19 22:51:30.012998 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2422/4850] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:29 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 1511 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:30.024886 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-6ee7c834-1bca-4676-aa7b-394e500e1440 req-431d792c-141f-4e04-84f7-b15a212211b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb0d2fe2-80ea-4fc2-a157-f7341877997c", "name": "network-vif-deleted", "tag": "2cb0e711-7270-4e34-9663-e6877d3106eb"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:51:30.035400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6d42d669-8ad5-41de-b585-3dfd8b4d3a0b tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:30.053727 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-6ee7c834-1bca-4676-aa7b-394e500e1440 req-431d792c-141f-4e04-84f7-b15a212211b2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:30.054771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-6ee7c834-1bca-4676-aa7b-394e500e1440 req-431d792c-141f-4e04-84f7-b15a212211b2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:30.059596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6d42d669-8ad5-41de-b585-3dfd8b4d3a0b tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:30.067804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6d42d669-8ad5-41de-b585-3dfd8b4d3a0b tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:30.072500 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6d42d669-8ad5-41de-b585-3dfd8b4d3a0b tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1282 microversion: 2.54 time: 0.345984 Jul 19 22:51:30.077163 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2429/4851] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:51:29 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1282 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:51:30.084950 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-6ee7c834-1bca-4676-aa7b-394e500e1440 req-431d792c-141f-4e04-84f7-b15a212211b2 service nova] Creating event network-vif-deleted:2cb0e711-7270-4e34-9663-e6877d3106eb for instance fb0d2fe2-80ea-4fc2-a157-f7341877997c on n-h2-847009-3 Jul 19 22:51:30.097201 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-6ee7c834-1bca-4676-aa7b-394e500e1440 req-431d792c-141f-4e04-84f7-b15a212211b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081991 Jul 19 22:51:30.101654 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2423/4852] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:51:31.031238 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f98b897b-3199-4d20-a0ad-1dbfb1be5cda tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:31.032041 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f98b897b-3199-4d20-a0ad-1dbfb1be5cda tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] [instance: fb0d2fe2-80ea-4fc2-a157-f7341877997c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:31.069754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f98b897b-3199-4d20-a0ad-1dbfb1be5cda tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:31.072464 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f98b897b-3199-4d20-a0ad-1dbfb1be5cda tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:31.078050 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f98b897b-3199-4d20-a0ad-1dbfb1be5cda tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:31.080318 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f98b897b-3199-4d20-a0ad-1dbfb1be5cda tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:31.114739 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-02f87a5c-1877-42dc-89de-a6b5ce27dc86 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:31.115533 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-02f87a5c-1877-42dc-89de-a6b5ce27dc86 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:31.130146 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-f98b897b-3199-4d20-a0ad-1dbfb1be5cda tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] HTTP exception thrown: Instance fb0d2fe2-80ea-4fc2-a157-f7341877997c could not be found. Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f98b897b-3199-4d20-a0ad-1dbfb1be5cda tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Request method failure captured: Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c HTTP/1.1 Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zR0pmn-IYN2j83gDjdBLXCCpN6GW9XWTg6xYRLyFrLyoXoBxQGzRx8SbPpFu81US9yMloj5MuNT2XZuawapf08-lnXwX2lCRAMAaBOtMIntlyl0rQEQb3rb6e-auHvfL_kI3z8LPfljy6SQsOWdTl5-WuCckEUL1vs6eMxxFa1K_0U Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a2933535544cdca4932622d038d8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a2933535544cdca4932622d038d8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a2933535544cdca4932622d038d8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 08a2933535544cdca4932622d038d8f6 Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-98013104 Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1c827b931a0f497cbd847695315d378d Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-98013104-project Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance fb0d2fe2-80ea-4fc2-a157-f7341877997c could not be found. Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'fb0d2fe2-80ea-4fc2-a157-f7341877997c'} Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb0d2fe2-80ea-4fc2-a157-f7341877997c could not be found. Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb0d2fe2-80ea-4fc2-a157-f7341877997c could not be found. Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:51:31.135036 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:31.140954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:51:31.140954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:51:31.140954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:51:31.140954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:51:31.140954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:51:31.140954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb0d2fe2-80ea-4fc2-a157-f7341877997c could not be found. Jul 19 22:51:31.140954 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:51:31.140954 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f98b897b-3199-4d20-a0ad-1dbfb1be5cda tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] Returning 404 to user: Instance fb0d2fe2-80ea-4fc2-a157-f7341877997c could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:51:31.141592 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f98b897b-3199-4d20-a0ad-1dbfb1be5cda tempest-ServersNegativeTestJSON-98013104 tempest-ServersNegativeTestJSON-98013104-project] 10.222.0.25 "GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c" status: 404 len: 111 microversion: 2.1 time: 0.116851 Jul 19 22:51:31.142502 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02f87a5c-1877-42dc-89de-a6b5ce27dc86 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:31.142502 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02f87a5c-1877-42dc-89de-a6b5ce27dc86 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:31.145308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02f87a5c-1877-42dc-89de-a6b5ce27dc86 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:31.145763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02f87a5c-1877-42dc-89de-a6b5ce27dc86 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:31.148451 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2430/4853] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:31 2022] GET /compute/v2.1/servers/fb0d2fe2-80ea-4fc2-a157-f7341877997c => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:51:31.329679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-02f87a5c-1877-42dc-89de-a6b5ce27dc86 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:31.340919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-02f87a5c-1877-42dc-89de-a6b5ce27dc86 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:31.342901 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-02f87a5c-1877-42dc-89de-a6b5ce27dc86 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:31.344136 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-02f87a5c-1877-42dc-89de-a6b5ce27dc86 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1336 microversion: 2.54 time: 0.252506 Jul 19 22:51:31.344726 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2424/4854] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:51:31 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1336 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:51:32.364817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7b30c436-62b3-46f7-9177-e8dae37c6216 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:32.369009 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7b30c436-62b3-46f7-9177-e8dae37c6216 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:32.385369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7b30c436-62b3-46f7-9177-e8dae37c6216 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:32.386438 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7b30c436-62b3-46f7-9177-e8dae37c6216 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:32.387551 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7b30c436-62b3-46f7-9177-e8dae37c6216 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:32.388272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7b30c436-62b3-46f7-9177-e8dae37c6216 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:32.490534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-61709a73-3719-4c1b-ae5f-a2bd8824bf31 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-778079112", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d10914df-2da2-4f58-98fa-60d9a22bab41"}], "security_groups": [{"name": "tempest-securitygroup--74977840"}], "key_name": "tempest-keypair-957729495", "user_data": "}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:51:32.599886 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7b30c436-62b3-46f7-9177-e8dae37c6216 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:32.619434 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7b30c436-62b3-46f7-9177-e8dae37c6216 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:32.622310 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7b30c436-62b3-46f7-9177-e8dae37c6216 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:32.633264 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7b30c436-62b3-46f7-9177-e8dae37c6216 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1336 microversion: 2.54 time: 0.267843 Jul 19 22:51:32.634758 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2431/4855] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:51:32 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1336 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:51:32.772709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-61709a73-3719-4c1b-ae5f-a2bd8824bf31 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] validate_networks() for [('d10914df-2da2-4f58-98fa-60d9a22bab41', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:51:33.654794 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-45870721-5e4b-44ee-ad39-20b581e3221e tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:33.655583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-45870721-5e4b-44ee-ad39-20b581e3221e tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:33.669183 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45870721-5e4b-44ee-ad39-20b581e3221e tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:33.670548 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45870721-5e4b-44ee-ad39-20b581e3221e tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:33.673373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45870721-5e4b-44ee-ad39-20b581e3221e tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:33.676352 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45870721-5e4b-44ee-ad39-20b581e3221e tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:33.848310 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-45870721-5e4b-44ee-ad39-20b581e3221e tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:33.862757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-45870721-5e4b-44ee-ad39-20b581e3221e tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:33.864474 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-45870721-5e4b-44ee-ad39-20b581e3221e tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:33.868796 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-45870721-5e4b-44ee-ad39-20b581e3221e tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1357 microversion: 2.54 time: 0.219316 Jul 19 22:51:33.872959 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2432/4856] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:51:33 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1357 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:51:33.898804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6c7160c6-3e9d-4ab0-b385-89570560f3de tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Action: 'create', calling method: .version_select at 0x7f7a03f9f310>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-339803662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNm7AAwWGRpi1YwMupTxdVBCT5KMwsCkSrAbVwScK/Vl94SB/Jf3w00k4uZGvHadDasrKC7YnANFnzVgu2K7RQ2C9MGCirFXR8wIU9hmlIznx9X34vDWpGVSJ/Uk/YfzPg=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:51:33.915356 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-6c7160c6-3e9d-4ab0-b385-89570560f3de tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Getting quotas for project abf7f55a82eb498697a913f46e190db4. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:51:33.922264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-6c7160c6-3e9d-4ab0-b385-89570560f3de tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Getting quotas for user 048594c6bd0348abb192c7b05e823ca7 and project abf7f55a82eb498697a913f46e190db4. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:51:33.960204 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6c7160c6-3e9d-4ab0-b385-89570560f3de tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.068504 Jul 19 22:51:33.962707 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2433/4857] 10.222.0.25 () {62 vars in 1199 bytes} [Tue Jul 19 22:51:33 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 72 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 22:51:33.976756 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0922090a-97ac-4d3d-8790-6aed27f00a2a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-339803662", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:51:33.981879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0922090a-97ac-4d3d-8790-6aed27f00a2a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:34.001009 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0922090a-97ac-4d3d-8790-6aed27f00a2a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:34.001780 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0922090a-97ac-4d3d-8790-6aed27f00a2a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:34.002799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0922090a-97ac-4d3d-8790-6aed27f00a2a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:34.006694 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0922090a-97ac-4d3d-8790-6aed27f00a2a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:34.095137 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-61709a73-3719-4c1b-ae5f-a2bd8824bf31 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:51:34.095767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-61709a73-3719-4c1b-ae5f-a2bd8824bf31 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:51:34.096748 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-61709a73-3719-4c1b-ae5f-a2bd8824bf31 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:51:34.097167 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-61709a73-3719-4c1b-ae5f-a2bd8824bf31 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:51:34.098907 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-61709a73-3719-4c1b-ae5f-a2bd8824bf31 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:51:34.102312 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:51:34.145014 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-61709a73-3719-4c1b-ae5f-a2bd8824bf31 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:34.146553 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-61709a73-3719-4c1b-ae5f-a2bd8824bf31 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:34.147492 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-61709a73-3719-4c1b-ae5f-a2bd8824bf31 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:34.150492 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-61709a73-3719-4c1b-ae5f-a2bd8824bf31 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:34.238929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-61709a73-3719-4c1b-ae5f-a2bd8824bf31 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Getting quotas for project e3b759a0bda64e3c9df38b624d4145b6. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:51:34.246768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-0922090a-97ac-4d3d-8790-6aed27f00a2a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:51:34.249426 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-0922090a-97ac-4d3d-8790-6aed27f00a2a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:51:34.250519 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-0922090a-97ac-4d3d-8790-6aed27f00a2a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:51:34.250987 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-0922090a-97ac-4d3d-8790-6aed27f00a2a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:51:34.251442 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-0922090a-97ac-4d3d-8790-6aed27f00a2a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:51:34.257637 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-61709a73-3719-4c1b-ae5f-a2bd8824bf31 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Getting quotas for user c3929e62eb4345f8a69fec37ba7c195f and project e3b759a0bda64e3c9df38b624d4145b6. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:51:34.306792 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-61709a73-3719-4c1b-ae5f-a2bd8824bf31 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:51:34.319852 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-61709a73-3719-4c1b-ae5f-a2bd8824bf31 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:51:34.423657 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-61709a73-3719-4c1b-ae5f-a2bd8824bf31 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.935060 Jul 19 22:51:34.432334 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2425/4858] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:51:32 2022] POST /compute/v2.1/servers => generated 400 bytes in 1942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 22:51:34.454899 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-04c19020-52be-404e-9d60-5901ab31b036 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:51:34.466045 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-04c19020-52be-404e-9d60-5901ab31b036 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:34.486983 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04c19020-52be-404e-9d60-5901ab31b036 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:34.489282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04c19020-52be-404e-9d60-5901ab31b036 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:34.490550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04c19020-52be-404e-9d60-5901ab31b036 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:34.492485 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04c19020-52be-404e-9d60-5901ab31b036 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:34.509152 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0922090a-97ac-4d3d-8790-6aed27f00a2a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:34.543454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0922090a-97ac-4d3d-8790-6aed27f00a2a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:34.544035 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0922090a-97ac-4d3d-8790-6aed27f00a2a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:34.544889 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0922090a-97ac-4d3d-8790-6aed27f00a2a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:34.545337 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0922090a-97ac-4d3d-8790-6aed27f00a2a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:34.591259 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-04c19020-52be-404e-9d60-5901ab31b036 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "POST /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b/action" status: 200 len: 24551 microversion: 2.1 time: 0.162107 Jul 19 22:51:34.593134 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2426/4859] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:51:34 2022] POST /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b/action => generated 24551 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:51:34.607555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8c32bc14-a8d5-4f4c-8091-acbbac0ce475 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:34.609547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8c32bc14-a8d5-4f4c-8091-acbbac0ce475 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:34.631584 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0922090a-97ac-4d3d-8790-6aed27f00a2a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "POST /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca/action" status: 202 len: 1139 microversion: 2.54 time: 0.658946 Jul 19 22:51:34.633815 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2434/4860] 10.222.0.25 () {62 vars in 1319 bytes} [Tue Jul 19 22:51:33 2022] POST /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca/action => generated 1139 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 19 22:51:34.658677 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3ebd4d71-e2ca-4cf3-8116-db295b72f1b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:34.661790 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3ebd4d71-e2ca-4cf3-8116-db295b72f1b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:34.683099 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ebd4d71-e2ca-4cf3-8116-db295b72f1b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:34.690051 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ebd4d71-e2ca-4cf3-8116-db295b72f1b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:34.691470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ebd4d71-e2ca-4cf3-8116-db295b72f1b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:34.696234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ebd4d71-e2ca-4cf3-8116-db295b72f1b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:34.974124 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8c32bc14-a8d5-4f4c-8091-acbbac0ce475 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:34.986694 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8c32bc14-a8d5-4f4c-8091-acbbac0ce475 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0" status: 200 len: 1240 microversion: 2.1 time: 0.389401 Jul 19 22:51:34.989798 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2427/4861] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:34 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0 => generated 1240 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:35.075052 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3ebd4d71-e2ca-4cf3-8116-db295b72f1b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:35.092590 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3ebd4d71-e2ca-4cf3-8116-db295b72f1b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:35.103308 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3ebd4d71-e2ca-4cf3-8116-db295b72f1b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:35.108673 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3ebd4d71-e2ca-4cf3-8116-db295b72f1b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1408 microversion: 2.54 time: 0.463110 Jul 19 22:51:35.113916 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2435/4862] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:51:34 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1408 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:51:36.005873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-637ca377-57be-4a4d-b542-93be7a4aec3c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:36.006734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-637ca377-57be-4a4d-b542-93be7a4aec3c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:36.028063 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-637ca377-57be-4a4d-b542-93be7a4aec3c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:36.028786 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-637ca377-57be-4a4d-b542-93be7a4aec3c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:36.030258 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-637ca377-57be-4a4d-b542-93be7a4aec3c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:36.031459 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-637ca377-57be-4a4d-b542-93be7a4aec3c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:36.130545 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1e2e55b4-ad4c-48db-8e47-5a8bdd921351 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:36.131305 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1e2e55b4-ad4c-48db-8e47-5a8bdd921351 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:36.140156 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e2e55b4-ad4c-48db-8e47-5a8bdd921351 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:36.152002 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e2e55b4-ad4c-48db-8e47-5a8bdd921351 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:36.153143 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e2e55b4-ad4c-48db-8e47-5a8bdd921351 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:36.156244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e2e55b4-ad4c-48db-8e47-5a8bdd921351 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:36.175267 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-637ca377-57be-4a4d-b542-93be7a4aec3c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:36.183698 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-637ca377-57be-4a4d-b542-93be7a4aec3c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0" status: 200 len: 1292 microversion: 2.1 time: 0.182429 Jul 19 22:51:36.185017 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2428/4863] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:35 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0 => generated 1292 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:36.257960 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1e2e55b4-ad4c-48db-8e47-5a8bdd921351 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:36.270683 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1e2e55b4-ad4c-48db-8e47-5a8bdd921351 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:36.274587 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1e2e55b4-ad4c-48db-8e47-5a8bdd921351 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:36.276158 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1e2e55b4-ad4c-48db-8e47-5a8bdd921351 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1408 microversion: 2.54 time: 0.149822 Jul 19 22:51:36.289025 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2436/4864] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:51:36 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:51:37.206371 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1894b042-12b7-4406-87e5-1885a917bb7e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:37.207375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1894b042-12b7-4406-87e5-1885a917bb7e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:37.224130 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1894b042-12b7-4406-87e5-1885a917bb7e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:37.225124 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1894b042-12b7-4406-87e5-1885a917bb7e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:37.228195 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1894b042-12b7-4406-87e5-1885a917bb7e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:37.230769 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1894b042-12b7-4406-87e5-1885a917bb7e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:37.302154 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-13525818-49ff-423c-bfa3-131ce23ce69a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:37.303284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-13525818-49ff-423c-bfa3-131ce23ce69a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:37.332403 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13525818-49ff-423c-bfa3-131ce23ce69a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:37.335789 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13525818-49ff-423c-bfa3-131ce23ce69a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:37.337190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13525818-49ff-423c-bfa3-131ce23ce69a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:37.339947 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13525818-49ff-423c-bfa3-131ce23ce69a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:37.633785 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1894b042-12b7-4406-87e5-1885a917bb7e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:37.649039 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1894b042-12b7-4406-87e5-1885a917bb7e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0" status: 200 len: 1298 microversion: 2.1 time: 0.448161 Jul 19 22:51:37.649832 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2429/4865] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:37 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0 => generated 1298 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:51:38.368220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-13525818-49ff-423c-bfa3-131ce23ce69a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:38.388281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-13525818-49ff-423c-bfa3-131ce23ce69a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:38.397286 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-13525818-49ff-423c-bfa3-131ce23ce69a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:38.403672 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-13525818-49ff-423c-bfa3-131ce23ce69a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1408 microversion: 2.54 time: 1.105641 Jul 19 22:51:38.404553 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2437/4866] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:51:37 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1408 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:51:38.669866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dadead57-503d-4ad5-ba81-125331f733fd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:38.670570 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dadead57-503d-4ad5-ba81-125331f733fd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:38.694968 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dadead57-503d-4ad5-ba81-125331f733fd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:38.695500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dadead57-503d-4ad5-ba81-125331f733fd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:38.696353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dadead57-503d-4ad5-ba81-125331f733fd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:38.696892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dadead57-503d-4ad5-ba81-125331f733fd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:39.264022 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dadead57-503d-4ad5-ba81-125331f733fd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:39.272881 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:51:39.304684 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dadead57-503d-4ad5-ba81-125331f733fd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0" status: 200 len: 1364 microversion: 2.1 time: 0.640233 Jul 19 22:51:39.323907 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2430/4867] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:38 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0 => generated 1364 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:39.424277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-66f6a0a4-0d35-4d59-ab5b-f28ce1daa72a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:39.424907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-66f6a0a4-0d35-4d59-ab5b-f28ce1daa72a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:39.458712 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-66f6a0a4-0d35-4d59-ab5b-f28ce1daa72a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:39.461858 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-66f6a0a4-0d35-4d59-ab5b-f28ce1daa72a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:39.463052 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-66f6a0a4-0d35-4d59-ab5b-f28ce1daa72a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:39.466020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-66f6a0a4-0d35-4d59-ab5b-f28ce1daa72a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:39.706289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-66f6a0a4-0d35-4d59-ab5b-f28ce1daa72a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:39.717455 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-66f6a0a4-0d35-4d59-ab5b-f28ce1daa72a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:39.719003 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-66f6a0a4-0d35-4d59-ab5b-f28ce1daa72a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:39.729000 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-66f6a0a4-0d35-4d59-ab5b-f28ce1daa72a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1408 microversion: 2.54 time: 0.308838 Jul 19 22:51:39.730835 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2438/4868] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:51:39 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1408 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:51:40.321894 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-850a1b26-077a-4081-96d7-763d4fc696f0 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:40.322613 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-850a1b26-077a-4081-96d7-763d4fc696f0 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:40.347511 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-850a1b26-077a-4081-96d7-763d4fc696f0 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:40.347973 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-850a1b26-077a-4081-96d7-763d4fc696f0 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:40.348772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-850a1b26-077a-4081-96d7-763d4fc696f0 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:40.349214 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-850a1b26-077a-4081-96d7-763d4fc696f0 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:40.677341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-850a1b26-077a-4081-96d7-763d4fc696f0 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:40.686602 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-850a1b26-077a-4081-96d7-763d4fc696f0 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0" status: 200 len: 1364 microversion: 2.1 time: 0.368638 Jul 19 22:51:40.692202 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2431/4869] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:40 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0 => generated 1364 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:40.750388 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-83f98892-957d-4a75-8fbd-c84da3f6580a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:40.751598 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-83f98892-957d-4a75-8fbd-c84da3f6580a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:40.765802 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-83f98892-957d-4a75-8fbd-c84da3f6580a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:40.768082 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-83f98892-957d-4a75-8fbd-c84da3f6580a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:40.769286 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-83f98892-957d-4a75-8fbd-c84da3f6580a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:40.771524 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-83f98892-957d-4a75-8fbd-c84da3f6580a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:40.857913 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-e7f05140-8df6-4380-a493-e90e0b43c38d req-8ab5c4ab-81d1-4b55-90a7-94ef67562bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9abb6a36-c31b-445c-a137-5fb74eb368b0", "tag": "ef30cd4a-04ef-46eb-b574-da106e2cb77a"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:51:40.880414 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e7f05140-8df6-4380-a493-e90e0b43c38d req-8ab5c4ab-81d1-4b55-90a7-94ef67562bc0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:40.883047 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e7f05140-8df6-4380-a493-e90e0b43c38d req-8ab5c4ab-81d1-4b55-90a7-94ef67562bc0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:40.912650 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-e7f05140-8df6-4380-a493-e90e0b43c38d req-8ab5c4ab-81d1-4b55-90a7-94ef67562bc0 service nova] Creating event network-changed:ef30cd4a-04ef-46eb-b574-da106e2cb77a for instance 9abb6a36-c31b-445c-a137-5fb74eb368b0 on n-h2-847009-3 Jul 19 22:51:40.928397 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-e7f05140-8df6-4380-a493-e90e0b43c38d req-8ab5c4ab-81d1-4b55-90a7-94ef67562bc0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070668 Jul 19 22:51:40.929434 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2432/4870] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:51:40.994185 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-83f98892-957d-4a75-8fbd-c84da3f6580a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:41.004682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-83f98892-957d-4a75-8fbd-c84da3f6580a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:41.009718 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-83f98892-957d-4a75-8fbd-c84da3f6580a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:41.015037 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-83f98892-957d-4a75-8fbd-c84da3f6580a tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1408 microversion: 2.54 time: 0.269819 Jul 19 22:51:41.016410 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2439/4871] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:51:40 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1408 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:51:41.717405 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ec18f360-3cbb-4b68-a7b3-1df44bee4b1d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:41.718290 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ec18f360-3cbb-4b68-a7b3-1df44bee4b1d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:41.731555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec18f360-3cbb-4b68-a7b3-1df44bee4b1d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:41.732200 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec18f360-3cbb-4b68-a7b3-1df44bee4b1d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:41.742887 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec18f360-3cbb-4b68-a7b3-1df44bee4b1d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:41.745934 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ec18f360-3cbb-4b68-a7b3-1df44bee4b1d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:42.036540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0f3c17ff-3850-4943-9b94-ef951db4f02c tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:42.037224 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0f3c17ff-3850-4943-9b94-ef951db4f02c tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:42.058392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0f3c17ff-3850-4943-9b94-ef951db4f02c tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:42.060543 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0f3c17ff-3850-4943-9b94-ef951db4f02c tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:42.061507 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0f3c17ff-3850-4943-9b94-ef951db4f02c tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:42.061957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0f3c17ff-3850-4943-9b94-ef951db4f02c tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:42.859514 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0f3c17ff-3850-4943-9b94-ef951db4f02c tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:42.876729 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0f3c17ff-3850-4943-9b94-ef951db4f02c tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:42.878355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0f3c17ff-3850-4943-9b94-ef951db4f02c tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:42.880268 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0f3c17ff-3850-4943-9b94-ef951db4f02c tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1408 microversion: 2.54 time: 0.848433 Jul 19 22:51:42.881202 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2440/4872] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:51:42 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1408 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:51:42.890599 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ec18f360-3cbb-4b68-a7b3-1df44bee4b1d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:42.904011 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ec18f360-3cbb-4b68-a7b3-1df44bee4b1d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0" status: 200 len: 1364 microversion: 2.1 time: 1.195557 Jul 19 22:51:42.923473 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2433/4873] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:41 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0 => generated 1364 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:43.905447 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c03d3fa9-573e-4573-b992-1c1488998230 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:43.906888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c03d3fa9-573e-4573-b992-1c1488998230 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:43.929812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6ba731c5-444e-44fa-b028-82f26774c010 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:43.933325 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6ba731c5-444e-44fa-b028-82f26774c010 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:43.937489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c03d3fa9-573e-4573-b992-1c1488998230 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:43.937961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c03d3fa9-573e-4573-b992-1c1488998230 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:43.938887 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c03d3fa9-573e-4573-b992-1c1488998230 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:43.939240 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c03d3fa9-573e-4573-b992-1c1488998230 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:43.939768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:51:43.948704 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ba731c5-444e-44fa-b028-82f26774c010 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:43.949883 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ba731c5-444e-44fa-b028-82f26774c010 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:43.951402 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ba731c5-444e-44fa-b028-82f26774c010 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:43.952952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ba731c5-444e-44fa-b028-82f26774c010 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:44.182947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:51:44.185185 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c03d3fa9-573e-4573-b992-1c1488998230 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:44.201847 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c03d3fa9-573e-4573-b992-1c1488998230 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:44.213238 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c03d3fa9-573e-4573-b992-1c1488998230 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:44.215731 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c03d3fa9-573e-4573-b992-1c1488998230 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1408 microversion: 2.54 time: 0.318892 Jul 19 22:51:44.219057 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2441/4874] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:51:43 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1408 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:51:44.520802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6ba731c5-444e-44fa-b028-82f26774c010 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:44.529411 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6ba731c5-444e-44fa-b028-82f26774c010 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0" status: 200 len: 1364 microversion: 2.1 time: 0.610043 Jul 19 22:51:44.533312 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2434/4875] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:43 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0 => generated 1364 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:45.244925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-41d6945e-5cc4-4b29-a66f-16b4107c63c6 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:45.247676 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-41d6945e-5cc4-4b29-a66f-16b4107c63c6 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:45.255318 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:51:45.258110 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41d6945e-5cc4-4b29-a66f-16b4107c63c6 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:45.258776 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41d6945e-5cc4-4b29-a66f-16b4107c63c6 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:45.259822 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41d6945e-5cc4-4b29-a66f-16b4107c63c6 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:45.260557 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41d6945e-5cc4-4b29-a66f-16b4107c63c6 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:45.369028 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-41d6945e-5cc4-4b29-a66f-16b4107c63c6 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:45.387522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-41d6945e-5cc4-4b29-a66f-16b4107c63c6 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:45.390598 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-41d6945e-5cc4-4b29-a66f-16b4107c63c6 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:45.395093 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-41d6945e-5cc4-4b29-a66f-16b4107c63c6 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1408 microversion: 2.54 time: 0.155962 Jul 19 22:51:45.396859 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2442/4876] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:51:45 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:51:45.546585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4d690055-d474-4c3b-8580-8ebfc519df88 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:45.547235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4d690055-d474-4c3b-8580-8ebfc519df88 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:45.558049 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=18 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:51:45.582865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d690055-d474-4c3b-8580-8ebfc519df88 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:45.584863 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d690055-d474-4c3b-8580-8ebfc519df88 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:45.589931 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d690055-d474-4c3b-8580-8ebfc519df88 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:45.592336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d690055-d474-4c3b-8580-8ebfc519df88 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:45.682738 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-348066a6-462c-4d82-b441-c6ae3ae57e48 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:45.684212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-348066a6-462c-4d82-b441-c6ae3ae57e48 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:45.695873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-348066a6-462c-4d82-b441-c6ae3ae57e48 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:45.696618 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-348066a6-462c-4d82-b441-c6ae3ae57e48 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:45.699408 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-348066a6-462c-4d82-b441-c6ae3ae57e48 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:45.701751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-348066a6-462c-4d82-b441-c6ae3ae57e48 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:46.150360 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4d690055-d474-4c3b-8580-8ebfc519df88 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:46.171581 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4d690055-d474-4c3b-8580-8ebfc519df88 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0" status: 200 len: 1364 microversion: 2.1 time: 0.627009 Jul 19 22:51:46.180887 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2435/4877] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:45 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0 => generated 1364 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:46.426929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7fe13f91-f473-4567-95c6-eb34b7fad6ae tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:46.427932 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7fe13f91-f473-4567-95c6-eb34b7fad6ae tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:46.440811 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7fe13f91-f473-4567-95c6-eb34b7fad6ae tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:46.441712 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7fe13f91-f473-4567-95c6-eb34b7fad6ae tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:46.443145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7fe13f91-f473-4567-95c6-eb34b7fad6ae tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:46.445291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7fe13f91-f473-4567-95c6-eb34b7fad6ae tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:46.599146 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7fe13f91-f473-4567-95c6-eb34b7fad6ae tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:46.628610 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-348066a6-462c-4d82-b441-c6ae3ae57e48 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1834 microversion: 2.1 time: 0.951611 Jul 19 22:51:46.630381 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2443/4878] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:45 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1834 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:46.630688 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7fe13f91-f473-4567-95c6-eb34b7fad6ae tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:46.633957 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7fe13f91-f473-4567-95c6-eb34b7fad6ae tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:46.636283 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7fe13f91-f473-4567-95c6-eb34b7fad6ae tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1408 microversion: 2.54 time: 0.223162 Jul 19 22:51:46.637552 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2436/4879] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:51:46 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1408 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:51:46.656119 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3b8870fe-6a98-497f-a900-063d84c3c3ad tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:46.656871 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3b8870fe-6a98-497f-a900-063d84c3c3ad tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:46.666201 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b8870fe-6a98-497f-a900-063d84c3c3ad tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:46.666739 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b8870fe-6a98-497f-a900-063d84c3c3ad tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:46.667602 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b8870fe-6a98-497f-a900-063d84c3c3ad tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:46.668164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b8870fe-6a98-497f-a900-063d84c3c3ad tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:46.713030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:51:47.087155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3b8870fe-6a98-497f-a900-063d84c3c3ad tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:47.139757 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3b8870fe-6a98-497f-a900-063d84c3c3ad tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1683 microversion: 2.1 time: 0.488637 Jul 19 22:51:47.141805 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2444/4880] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:46 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1683 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:51:47.189208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5df58a37-aa83-47a6-9541-19ef18c336dd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:47.189946 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5df58a37-aa83-47a6-9541-19ef18c336dd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:47.202477 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5df58a37-aa83-47a6-9541-19ef18c336dd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:47.203039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5df58a37-aa83-47a6-9541-19ef18c336dd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:47.204432 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5df58a37-aa83-47a6-9541-19ef18c336dd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:47.209254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5df58a37-aa83-47a6-9541-19ef18c336dd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:47.488521 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c429d540-dec1-4647-85b9-b1f51c58a3d5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:51:47.489527 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c429d540-dec1-4647-85b9-b1f51c58a3d5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:47.503920 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c429d540-dec1-4647-85b9-b1f51c58a3d5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:47.504476 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c429d540-dec1-4647-85b9-b1f51c58a3d5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:47.505365 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c429d540-dec1-4647-85b9-b1f51c58a3d5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:47.505879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c429d540-dec1-4647-85b9-b1f51c58a3d5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:47.618106 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c429d540-dec1-4647-85b9-b1f51c58a3d5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "POST /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b/action" status: 200 len: 32617 microversion: 2.1 time: 0.133979 Jul 19 22:51:47.619783 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2445/4881] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:51:47 2022] POST /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b/action => generated 32617 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:51:47.660144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a51873a5-29e5-4056-bd4f-787c119ba801 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:47.660880 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a51873a5-29e5-4056-bd4f-787c119ba801 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:47.688957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a51873a5-29e5-4056-bd4f-787c119ba801 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:47.689505 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a51873a5-29e5-4056-bd4f-787c119ba801 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:47.690338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a51873a5-29e5-4056-bd4f-787c119ba801 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:47.690784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a51873a5-29e5-4056-bd4f-787c119ba801 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:47.775407 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5df58a37-aa83-47a6-9541-19ef18c336dd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:47.787029 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5df58a37-aa83-47a6-9541-19ef18c336dd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0" status: 200 len: 1364 microversion: 2.1 time: 0.599794 Jul 19 22:51:47.813460 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2437/4882] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:47 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0 => generated 1364 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:47.826220 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0b057e1e-de30-4c32-8712-fe31a83a3ec1 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:51:47.827088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0b057e1e-de30-4c32-8712-fe31a83a3ec1 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:47.927199 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b057e1e-de30-4c32-8712-fe31a83a3ec1 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:47.931392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b057e1e-de30-4c32-8712-fe31a83a3ec1 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:47.934924 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b057e1e-de30-4c32-8712-fe31a83a3ec1 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:47.936373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b057e1e-de30-4c32-8712-fe31a83a3ec1 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:47.975845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a51873a5-29e5-4056-bd4f-787c119ba801 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:47.992064 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a51873a5-29e5-4056-bd4f-787c119ba801 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:47.999078 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a51873a5-29e5-4056-bd4f-787c119ba801 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:48.007540 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a51873a5-29e5-4056-bd4f-787c119ba801 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1408 microversion: 2.54 time: 0.353003 Jul 19 22:51:48.008165 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2446/4883] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:51:47 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1408 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:51:48.168043 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0b057e1e-de30-4c32-8712-fe31a83a3ec1 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd648d35ad2544e69904cc3059170e34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96548038e0144d998b7b8b98145e00db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:48.168686 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0b057e1e-de30-4c32-8712-fe31a83a3ec1 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] flavor_id is None. Assuming migration. {{(pid=119338) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 19 22:51:48.172141 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0b057e1e-de30-4c32-8712-fe31a83a3ec1 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119338) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 22:51:48.658069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-449266f2-97aa-49a2-947a-fe74450286a9 tempest-VolumesTestJSON-1838870701 tempest-VolumesTestJSON-1838870701-project] Calling method '.version_select at 0x7f7a03d26dc0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:48.830616 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-449266f2-97aa-49a2-947a-fe74450286a9 tempest-VolumesTestJSON-1838870701 tempest-VolumesTestJSON-1838870701-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/2bdc93fe-2b4c-47b1-8205-069bafc44926" status: 200 len: 351 microversion: 2.1 time: 0.179046 Jul 19 22:51:48.839044 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2447/4884] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 19 22:51:48 2022] GET /compute/v2.1/os-volumes/2bdc93fe-2b4c-47b1-8205-069bafc44926 => generated 351 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:51:48.850741 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-db005dc3-3f94-43bf-9b58-088af3a9260b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:48.851181 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-db005dc3-3f94-43bf-9b58-088af3a9260b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:48.871857 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db005dc3-3f94-43bf-9b58-088af3a9260b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:48.880371 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db005dc3-3f94-43bf-9b58-088af3a9260b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:48.881358 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db005dc3-3f94-43bf-9b58-088af3a9260b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:48.882327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db005dc3-3f94-43bf-9b58-088af3a9260b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:49.566143 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0b057e1e-de30-4c32-8712-fe31a83a3ec1 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b/action" status: 202 len: 0 microversion: 2.1 time: 1.750151 Jul 19 22:51:49.569945 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2438/4885] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:51:47 2022] POST /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b/action => generated 0 bytes in 1752 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:51:49.594040 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-afbab441-7132-479f-af70-0ece0dba4014 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:49.594880 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-afbab441-7132-479f-af70-0ece0dba4014 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:49.627394 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-afbab441-7132-479f-af70-0ece0dba4014 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:49.627930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-afbab441-7132-479f-af70-0ece0dba4014 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:49.628737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-afbab441-7132-479f-af70-0ece0dba4014 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:49.629177 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-afbab441-7132-479f-af70-0ece0dba4014 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:49.838863 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-db005dc3-3f94-43bf-9b58-088af3a9260b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:49.847186 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-db005dc3-3f94-43bf-9b58-088af3a9260b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0" status: 200 len: 1364 microversion: 2.1 time: 1.012711 Jul 19 22:51:49.847738 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2448/4886] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:48 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0 => generated 1364 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:49.870683 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-afbab441-7132-479f-af70-0ece0dba4014 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:49.873765 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-d9deade3-f5f1-47e1-b9d9-35f7c8b6a8fc req-98812fbb-8ef5-4b5d-881b-0dea92a6ed07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9abb6a36-c31b-445c-a137-5fb74eb368b0", "name": "network-vif-plugged", "status": "completed", "tag": "ef30cd4a-04ef-46eb-b574-da106e2cb77a"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:51:49.880090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-afbab441-7132-479f-af70-0ece0dba4014 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:49.881759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-afbab441-7132-479f-af70-0ece0dba4014 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:49.890535 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-afbab441-7132-479f-af70-0ece0dba4014 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1408 microversion: 2.54 time: 0.313815 Jul 19 22:51:49.894347 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2439/4887] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:51:49 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1408 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:51:49.899662 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d9deade3-f5f1-47e1-b9d9-35f7c8b6a8fc req-98812fbb-8ef5-4b5d-881b-0dea92a6ed07 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:49.900367 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d9deade3-f5f1-47e1-b9d9-35f7c8b6a8fc req-98812fbb-8ef5-4b5d-881b-0dea92a6ed07 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:49.905470 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-add370b5-507e-40e4-b7bc-e67c87298d79 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:49.913016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-add370b5-507e-40e4-b7bc-e67c87298d79 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:49.932792 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-add370b5-507e-40e4-b7bc-e67c87298d79 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:49.935497 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-d9deade3-f5f1-47e1-b9d9-35f7c8b6a8fc req-98812fbb-8ef5-4b5d-881b-0dea92a6ed07 service nova] Creating event network-vif-plugged:ef30cd4a-04ef-46eb-b574-da106e2cb77a for instance 9abb6a36-c31b-445c-a137-5fb74eb368b0 on n-h2-847009-3 Jul 19 22:51:49.941385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-add370b5-507e-40e4-b7bc-e67c87298d79 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:49.942415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-add370b5-507e-40e4-b7bc-e67c87298d79 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:49.942978 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-add370b5-507e-40e4-b7bc-e67c87298d79 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:49.957436 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-d9deade3-f5f1-47e1-b9d9-35f7c8b6a8fc req-98812fbb-8ef5-4b5d-881b-0dea92a6ed07 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092796 Jul 19 22:51:49.959478 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2449/4888] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:51:50.866481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ea268e05-6e1b-4c4b-9965-e7137a4a581c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:50.867414 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ea268e05-6e1b-4c4b-9965-e7137a4a581c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:50.888440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea268e05-6e1b-4c4b-9965-e7137a4a581c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:50.891039 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea268e05-6e1b-4c4b-9965-e7137a4a581c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:50.893060 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea268e05-6e1b-4c4b-9965-e7137a4a581c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:50.893684 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea268e05-6e1b-4c4b-9965-e7137a4a581c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:50.931844 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-add370b5-507e-40e4-b7bc-e67c87298d79 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:50.958000 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-add370b5-507e-40e4-b7bc-e67c87298d79 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1692 microversion: 2.1 time: 1.062336 Jul 19 22:51:50.959959 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2440/4889] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:49 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1692 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:50.982559 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8647bafd-f85d-4c34-b413-ba1386ec7523 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:50.985317 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8647bafd-f85d-4c34-b413-ba1386ec7523 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:51.017113 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8647bafd-f85d-4c34-b413-ba1386ec7523 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:51.019823 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8647bafd-f85d-4c34-b413-ba1386ec7523 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:51.022466 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8647bafd-f85d-4c34-b413-ba1386ec7523 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:51.024806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8647bafd-f85d-4c34-b413-ba1386ec7523 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:51.163018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8647bafd-f85d-4c34-b413-ba1386ec7523 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:51.171903 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8647bafd-f85d-4c34-b413-ba1386ec7523 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:51.173450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8647bafd-f85d-4c34-b413-ba1386ec7523 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:51.174683 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8647bafd-f85d-4c34-b413-ba1386ec7523 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1408 microversion: 2.54 time: 0.213567 Jul 19 22:51:51.180993 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2441/4890] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:51:50 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:51:51.309689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ea268e05-6e1b-4c4b-9965-e7137a4a581c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:51.317545 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ea268e05-6e1b-4c4b-9965-e7137a4a581c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0" status: 200 len: 1364 microversion: 2.1 time: 0.456740 Jul 19 22:51:51.328125 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2450/4891] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:50 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0 => generated 1364 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:51.702771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5e5e01ca-e077-43ff-8e2f-5637bf9fdc97 tempest-VolumesTestJSON-1838870701 tempest-VolumesTestJSON-1838870701-project] Calling method '.version_select at 0x7f7a0377fd30>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:51.793437 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5e5e01ca-e077-43ff-8e2f-5637bf9fdc97 tempest-VolumesTestJSON-1838870701 tempest-VolumesTestJSON-1838870701-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/afa3d3e3-ef4a-42e1-888e-d593e3fd24c3" status: 200 len: 351 microversion: 2.1 time: 0.096581 Jul 19 22:51:51.811019 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2442/4892] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 19 22:51:51 2022] GET /compute/v2.1/os-volumes/afa3d3e3-ef4a-42e1-888e-d593e3fd24c3 => generated 351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:51:51.976451 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2ba203fc-75a0-4d24-bfb7-9d6a00ee5315 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:51.977848 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2ba203fc-75a0-4d24-bfb7-9d6a00ee5315 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:51.992674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2ba203fc-75a0-4d24-bfb7-9d6a00ee5315 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:51.993185 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2ba203fc-75a0-4d24-bfb7-9d6a00ee5315 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:51.994033 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2ba203fc-75a0-4d24-bfb7-9d6a00ee5315 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:51.995007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2ba203fc-75a0-4d24-bfb7-9d6a00ee5315 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:52.204122 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b2723a7c-9c65-43d9-8b8f-40c73ac12b1d tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:52.204942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b2723a7c-9c65-43d9-8b8f-40c73ac12b1d tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:52.255412 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b2723a7c-9c65-43d9-8b8f-40c73ac12b1d tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:52.260576 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b2723a7c-9c65-43d9-8b8f-40c73ac12b1d tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:52.269034 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b2723a7c-9c65-43d9-8b8f-40c73ac12b1d tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:52.269587 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b2723a7c-9c65-43d9-8b8f-40c73ac12b1d tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:52.386329 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2ba203fc-75a0-4d24-bfb7-9d6a00ee5315 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:52.404349 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2ba203fc-75a0-4d24-bfb7-9d6a00ee5315 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1692 microversion: 2.1 time: 0.431884 Jul 19 22:51:52.406985 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2451/4893] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:51 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1692 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:52.428185 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-46216f30-dca9-4f2c-8c63-82f08029a8dc tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:52.429107 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-46216f30-dca9-4f2c-8c63-82f08029a8dc tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:52.455965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46216f30-dca9-4f2c-8c63-82f08029a8dc tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:52.457666 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46216f30-dca9-4f2c-8c63-82f08029a8dc tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:52.460943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46216f30-dca9-4f2c-8c63-82f08029a8dc tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:52.464124 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46216f30-dca9-4f2c-8c63-82f08029a8dc tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:52.511709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b2723a7c-9c65-43d9-8b8f-40c73ac12b1d tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:52.531680 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b2723a7c-9c65-43d9-8b8f-40c73ac12b1d tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:52.533537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b2723a7c-9c65-43d9-8b8f-40c73ac12b1d tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:52.534824 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b2723a7c-9c65-43d9-8b8f-40c73ac12b1d tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1408 microversion: 2.54 time: 0.337882 Jul 19 22:51:52.541317 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2443/4894] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:51:52 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1408 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:51:52.845039 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-46216f30-dca9-4f2c-8c63-82f08029a8dc tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:52.858056 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-46216f30-dca9-4f2c-8c63-82f08029a8dc tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0" status: 200 len: 1364 microversion: 2.1 time: 0.449699 Jul 19 22:51:52.860129 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2452/4895] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:52 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0 => generated 1364 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:53.426129 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a30557f1-85a0-4f8d-a525-ca1b4f15cb3f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:53.427429 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a30557f1-85a0-4f8d-a525-ca1b4f15cb3f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:53.440004 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a30557f1-85a0-4f8d-a525-ca1b4f15cb3f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:53.448143 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a30557f1-85a0-4f8d-a525-ca1b4f15cb3f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:53.449220 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a30557f1-85a0-4f8d-a525-ca1b4f15cb3f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:53.460356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a30557f1-85a0-4f8d-a525-ca1b4f15cb3f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:53.554033 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c376c97d-23d0-4c59-adae-db8de7d850b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:53.554663 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c376c97d-23d0-4c59-adae-db8de7d850b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:53.569559 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c376c97d-23d0-4c59-adae-db8de7d850b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:53.570006 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c376c97d-23d0-4c59-adae-db8de7d850b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:53.570791 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c376c97d-23d0-4c59-adae-db8de7d850b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:53.571270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c376c97d-23d0-4c59-adae-db8de7d850b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:53.872256 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c376c97d-23d0-4c59-adae-db8de7d850b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:53.887791 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c376c97d-23d0-4c59-adae-db8de7d850b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:53.890876 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c376c97d-23d0-4c59-adae-db8de7d850b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:53.895904 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c376c97d-23d0-4c59-adae-db8de7d850b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1408 microversion: 2.54 time: 0.342353 Jul 19 22:51:53.901424 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2453/4896] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:51:53 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1408 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:51:53.917484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d092033a-6c2b-4679-b697-468291659add tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:53.921211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d092033a-6c2b-4679-b697-468291659add tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:53.951254 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d092033a-6c2b-4679-b697-468291659add tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:53.953401 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d092033a-6c2b-4679-b697-468291659add tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:53.954427 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d092033a-6c2b-4679-b697-468291659add tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:53.955624 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d092033a-6c2b-4679-b697-468291659add tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:54.175422 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a30557f1-85a0-4f8d-a525-ca1b4f15cb3f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:54.194275 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a30557f1-85a0-4f8d-a525-ca1b4f15cb3f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1692 microversion: 2.1 time: 0.772528 Jul 19 22:51:54.196580 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2444/4897] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:53 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1692 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:54.651992 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d092033a-6c2b-4679-b697-468291659add tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:54.671145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a4407aae-ef66-4625-a289-a6eefb4a177d tempest-VolumesTestJSON-1838870701 tempest-VolumesTestJSON-1838870701-project] Calling method '.version_select at 0x7f7a03fce430>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:54.678986 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d092033a-6c2b-4679-b697-468291659add tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0" status: 200 len: 1553 microversion: 2.1 time: 0.775426 Jul 19 22:51:54.681403 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2454/4898] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:53 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0 => generated 1553 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:54.711025 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c62c37b9-d4e9-46be-ba6b-8e9e6e58f122 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:54.711786 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c62c37b9-d4e9-46be-ba6b-8e9e6e58f122 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:54.736032 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c62c37b9-d4e9-46be-ba6b-8e9e6e58f122 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:54.736978 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c62c37b9-d4e9-46be-ba6b-8e9e6e58f122 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:54.742328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c62c37b9-d4e9-46be-ba6b-8e9e6e58f122 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:54.743194 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c62c37b9-d4e9-46be-ba6b-8e9e6e58f122 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:54.760832 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a4407aae-ef66-4625-a289-a6eefb4a177d tempest-VolumesTestJSON-1838870701 tempest-VolumesTestJSON-1838870701-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/6c1ee1e9-e70e-431d-ab5d-679cd9fff962" status: 200 len: 351 microversion: 2.1 time: 0.100778 Jul 19 22:51:54.768488 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2445/4899] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 19 22:51:54 2022] GET /compute/v2.1/os-volumes/6c1ee1e9-e70e-431d-ab5d-679cd9fff962 => generated 351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:51:54.773937 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-12e148ee-8100-4c31-b07d-d2a4ca910b01 tempest-VolumesTestJSON-1838870701 tempest-VolumesTestJSON-1838870701-project] Calling method '.version_select at 0x7f7a031c50d0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:54.906557 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-12e148ee-8100-4c31-b07d-d2a4ca910b01 tempest-VolumesTestJSON-1838870701 tempest-VolumesTestJSON-1838870701-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.136806 Jul 19 22:51:54.907451 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2446/4900] 10.222.0.25 () {58 vars in 1133 bytes} [Tue Jul 19 22:51:54 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:54.926990 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f0281bfc-02f9-4ca6-848d-c85cef6d7b32 tempest-VolumesTestJSON-1838870701 tempest-VolumesTestJSON-1838870701-project] Calling method '.version_select at 0x7f7a0377faf0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:55.030803 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c62c37b9-d4e9-46be-ba6b-8e9e6e58f122 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.333136 Jul 19 22:51:55.032970 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2455/4901] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 19 22:51:54 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-interface => generated 284 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:51:55.039032 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0b0ceb7f-799a-4a6a-a4b9-a433b4f70812 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:55.039951 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0b0ceb7f-799a-4a6a-a4b9-a433b4f70812 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:55.057951 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0b0ceb7f-799a-4a6a-a4b9-a433b4f70812 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:55.058523 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0b0ceb7f-799a-4a6a-a4b9-a433b4f70812 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:55.063933 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0b0ceb7f-799a-4a6a-a4b9-a433b4f70812 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:55.065402 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0b0ceb7f-799a-4a6a-a4b9-a433b4f70812 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:55.154516 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f0281bfc-02f9-4ca6-848d-c85cef6d7b32 tempest-VolumesTestJSON-1838870701 tempest-VolumesTestJSON-1838870701-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.238587 Jul 19 22:51:55.155504 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2447/4902] 10.222.0.25 () {58 vars in 1148 bytes} [Tue Jul 19 22:51:54 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:51:55.168540 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-618d022b-1371-4437-bce8-b3b40538bc34 tempest-VolumesTestJSON-1838870701 tempest-VolumesTestJSON-1838870701-project] Calling method '.version_select at 0x7f7a03fe5550>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:55.348398 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0b0ceb7f-799a-4a6a-a4b9-a433b4f70812 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:55.359058 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0b0ceb7f-799a-4a6a-a4b9-a433b4f70812 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:55.366325 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0b0ceb7f-799a-4a6a-a4b9-a433b4f70812 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:55.370958 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0b0ceb7f-799a-4a6a-a4b9-a433b4f70812 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1408 microversion: 2.54 time: 0.336466 Jul 19 22:51:55.375008 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2456/4903] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:51:55 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1408 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:51:55.385782 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-255a0a12-c96a-43a8-bb21-a56d0386800a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:55.386857 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-255a0a12-c96a-43a8-bb21-a56d0386800a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:55.403234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-255a0a12-c96a-43a8-bb21-a56d0386800a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:55.405170 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-255a0a12-c96a-43a8-bb21-a56d0386800a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:55.407197 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-255a0a12-c96a-43a8-bb21-a56d0386800a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:55.409737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-255a0a12-c96a-43a8-bb21-a56d0386800a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:55.429777 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-618d022b-1371-4437-bce8-b3b40538bc34 tempest-VolumesTestJSON-1838870701 tempest-VolumesTestJSON-1838870701-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.265408 Jul 19 22:51:55.430395 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2448/4904] 10.222.0.25 () {58 vars in 1133 bytes} [Tue Jul 19 22:51:55 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:51:55.443498 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-66a93940-0202-4548-af2b-8b696640d98d tempest-VolumesTestJSON-1838870701 tempest-VolumesTestJSON-1838870701-project] Calling method '.version_select at 0x7f7a15571160>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:55.763407 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-66a93940-0202-4548-af2b-8b696640d98d tempest-VolumesTestJSON-1838870701 tempest-VolumesTestJSON-1838870701-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.324327 Jul 19 22:51:55.765145 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2449/4905] 10.222.0.25 () {58 vars in 1166 bytes} [Tue Jul 19 22:51:55 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:51:55.779086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f18e69f9-8551-45cf-b46e-10d9c7a52038 tempest-VolumesTestJSON-1838870701 tempest-VolumesTestJSON-1838870701-project] Calling method '.version_select at 0x7f7a03fe51f0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:56.028851 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f18e69f9-8551-45cf-b46e-10d9c7a52038 tempest-VolumesTestJSON-1838870701 tempest-VolumesTestJSON-1838870701-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.254661 Jul 19 22:51:56.029627 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2450/4906] 10.222.0.25 () {58 vars in 1169 bytes} [Tue Jul 19 22:51:55 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:51:56.043434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7de8dba8-d577-439d-8780-2975b41aab83 tempest-VolumesTestJSON-1838870701 tempest-VolumesTestJSON-1838870701-project] Calling method '.version_select at 0x7f7a0377fe50>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:56.241505 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7de8dba8-d577-439d-8780-2975b41aab83 tempest-VolumesTestJSON-1838870701 tempest-VolumesTestJSON-1838870701-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.202515 Jul 19 22:51:56.242348 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2451/4907] 10.222.0.25 () {58 vars in 1154 bytes} [Tue Jul 19 22:51:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:56.254590 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5bea8fe9-08b6-4be3-abba-bd5adc5218a8 tempest-VolumesTestJSON-1838870701 tempest-VolumesTestJSON-1838870701-project] Calling method '.version_select at 0x7f7a03231820>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:56.460102 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5bea8fe9-08b6-4be3-abba-bd5adc5218a8 tempest-VolumesTestJSON-1838870701 tempest-VolumesTestJSON-1838870701-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.210137 Jul 19 22:51:56.460993 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2452/4908] 10.222.0.25 () {58 vars in 1187 bytes} [Tue Jul 19 22:51:56 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:51:56.471269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ab2942c7-7cae-48e2-8a4c-5a46db5e92c5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:56.472933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ab2942c7-7cae-48e2-8a4c-5a46db5e92c5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:56.490876 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab2942c7-7cae-48e2-8a4c-5a46db5e92c5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:56.491475 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab2942c7-7cae-48e2-8a4c-5a46db5e92c5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:56.492393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab2942c7-7cae-48e2-8a4c-5a46db5e92c5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:56.493091 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab2942c7-7cae-48e2-8a4c-5a46db5e92c5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:56.594504 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-255a0a12-c96a-43a8-bb21-a56d0386800a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:56.607218 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-255a0a12-c96a-43a8-bb21-a56d0386800a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1697 microversion: 2.1 time: 1.230581 Jul 19 22:51:56.618064 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2457/4909] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:55 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1697 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:56.618603 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6d0e0d40-69dd-4fcd-b1df-1bffadfe8e42 tempest-VolumesTestJSON-1838870701 tempest-VolumesTestJSON-1838870701-project] Calling method '.version_select at 0x7f7a15613ca0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:56.693941 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ab2942c7-7cae-48e2-8a4c-5a46db5e92c5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:56.711055 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ab2942c7-7cae-48e2-8a4c-5a46db5e92c5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:56.717744 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ab2942c7-7cae-48e2-8a4c-5a46db5e92c5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:56.718988 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ab2942c7-7cae-48e2-8a4c-5a46db5e92c5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1408 microversion: 2.54 time: 0.256808 Jul 19 22:51:56.719632 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2453/4910] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:51:56 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1408 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:51:56.842535 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6d0e0d40-69dd-4fcd-b1df-1bffadfe8e42 tempest-VolumesTestJSON-1838870701 tempest-VolumesTestJSON-1838870701-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.228883 Jul 19 22:51:56.843796 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2458/4911] 10.222.0.25 () {58 vars in 1154 bytes} [Tue Jul 19 22:51:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:57.635790 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3781a305-aa2c-4086-aeb6-91a117fc48ee tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:57.636642 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3781a305-aa2c-4086-aeb6-91a117fc48ee tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:57.662095 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3781a305-aa2c-4086-aeb6-91a117fc48ee tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:57.664328 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3781a305-aa2c-4086-aeb6-91a117fc48ee tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:57.666036 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3781a305-aa2c-4086-aeb6-91a117fc48ee tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:57.666829 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3781a305-aa2c-4086-aeb6-91a117fc48ee tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:57.739868 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-326199ef-ae80-4263-bf7c-fd01a3ba137b tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:57.741086 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-326199ef-ae80-4263-bf7c-fd01a3ba137b tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:57.762215 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-326199ef-ae80-4263-bf7c-fd01a3ba137b tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:57.763068 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-326199ef-ae80-4263-bf7c-fd01a3ba137b tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:57.766174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-326199ef-ae80-4263-bf7c-fd01a3ba137b tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:57.768585 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-326199ef-ae80-4263-bf7c-fd01a3ba137b tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:58.203185 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-326199ef-ae80-4263-bf7c-fd01a3ba137b tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:58.220333 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-326199ef-ae80-4263-bf7c-fd01a3ba137b tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:58.221868 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-326199ef-ae80-4263-bf7c-fd01a3ba137b tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:58.223093 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-326199ef-ae80-4263-bf7c-fd01a3ba137b tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1408 microversion: 2.54 time: 0.488570 Jul 19 22:51:58.223729 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2459/4912] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:51:57 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1408 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:51:58.350873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3781a305-aa2c-4086-aeb6-91a117fc48ee tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:58.366796 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3781a305-aa2c-4086-aeb6-91a117fc48ee tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1697 microversion: 2.1 time: 0.745023 Jul 19 22:51:58.378175 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2454/4913] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:57 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1697 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:51:58.473319 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-cc6dcfa8-7879-4321-ad0f-3fc436bbdbaf req-9d94eab6-9efe-4089-8070-a36003f94a78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9abb6a36-c31b-445c-a137-5fb74eb368b0", "tag": "ef30cd4a-04ef-46eb-b574-da106e2cb77a"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:51:58.489307 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-cc6dcfa8-7879-4321-ad0f-3fc436bbdbaf req-9d94eab6-9efe-4089-8070-a36003f94a78 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:58.489765 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-cc6dcfa8-7879-4321-ad0f-3fc436bbdbaf req-9d94eab6-9efe-4089-8070-a36003f94a78 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:58.536329 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-cc6dcfa8-7879-4321-ad0f-3fc436bbdbaf req-9d94eab6-9efe-4089-8070-a36003f94a78 service nova] Creating event network-changed:ef30cd4a-04ef-46eb-b574-da106e2cb77a for instance 9abb6a36-c31b-445c-a137-5fb74eb368b0 on n-h2-847009-3 Jul 19 22:51:58.543001 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-cc6dcfa8-7879-4321-ad0f-3fc436bbdbaf req-9d94eab6-9efe-4089-8070-a36003f94a78 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072884 Jul 19 22:51:58.545515 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2460/4914] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:51:59.243576 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-81bcc90c-5bab-4da5-8898-089a83dac541 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:59.244770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-81bcc90c-5bab-4da5-8898-089a83dac541 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:59.261003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81bcc90c-5bab-4da5-8898-089a83dac541 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:59.261894 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81bcc90c-5bab-4da5-8898-089a83dac541 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:59.263068 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81bcc90c-5bab-4da5-8898-089a83dac541 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:59.263788 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81bcc90c-5bab-4da5-8898-089a83dac541 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:59.295511 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:51:59.388051 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-93d3bbc9-9578-452f-ad23-daf60121faef tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:51:59.388778 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-93d3bbc9-9578-452f-ad23-daf60121faef tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:51:59.410988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-93d3bbc9-9578-452f-ad23-daf60121faef tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:59.412885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-93d3bbc9-9578-452f-ad23-daf60121faef tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:59.413851 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-93d3bbc9-9578-452f-ad23-daf60121faef tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:51:59.415751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-93d3bbc9-9578-452f-ad23-daf60121faef tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:51:59.436994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-81bcc90c-5bab-4da5-8898-089a83dac541 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:59.482051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-81bcc90c-5bab-4da5-8898-089a83dac541 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:59.511885 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-81bcc90c-5bab-4da5-8898-089a83dac541 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:59.521519 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-81bcc90c-5bab-4da5-8898-089a83dac541 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1408 microversion: 2.54 time: 0.276008 Jul 19 22:51:59.524409 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2455/4915] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:51:59 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1408 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:51:59.863295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-93d3bbc9-9578-452f-ad23-daf60121faef tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:51:59.877868 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-93d3bbc9-9578-452f-ad23-daf60121faef tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1697 microversion: 2.1 time: 0.494672 Jul 19 22:51:59.891198 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2461/4916] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:51:59 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1697 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:52:00.570388 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8659aa96-df67-4aea-9b04-0913e06ad51f tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:00.577834 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8659aa96-df67-4aea-9b04-0913e06ad51f tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:00.609911 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8659aa96-df67-4aea-9b04-0913e06ad51f tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:00.611350 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8659aa96-df67-4aea-9b04-0913e06ad51f tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:00.612735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8659aa96-df67-4aea-9b04-0913e06ad51f tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:00.613384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8659aa96-df67-4aea-9b04-0913e06ad51f tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:00.892553 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8659aa96-df67-4aea-9b04-0913e06ad51f tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:00.900075 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c731b07e-b785-44a1-bca3-134ed6c2254a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:00.900942 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c731b07e-b785-44a1-bca3-134ed6c2254a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:00.910089 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8659aa96-df67-4aea-9b04-0913e06ad51f tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:00.912805 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8659aa96-df67-4aea-9b04-0913e06ad51f tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:00.919947 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8659aa96-df67-4aea-9b04-0913e06ad51f tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1408 microversion: 2.54 time: 0.380802 Jul 19 22:52:00.925703 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2456/4917] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:52:00 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1408 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:52:00.942807 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c731b07e-b785-44a1-bca3-134ed6c2254a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:00.950932 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c731b07e-b785-44a1-bca3-134ed6c2254a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:00.954055 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c731b07e-b785-44a1-bca3-134ed6c2254a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:00.955828 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c731b07e-b785-44a1-bca3-134ed6c2254a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:01.548852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c731b07e-b785-44a1-bca3-134ed6c2254a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:01.562159 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c731b07e-b785-44a1-bca3-134ed6c2254a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1697 microversion: 2.1 time: 0.666134 Jul 19 22:52:01.572645 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2462/4918] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:52:00 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1697 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:52:01.948514 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cfef090d-7668-4c97-a1e8-cec9fae85bab tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:01.949366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cfef090d-7668-4c97-a1e8-cec9fae85bab tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:01.969627 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cfef090d-7668-4c97-a1e8-cec9fae85bab tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:01.970254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cfef090d-7668-4c97-a1e8-cec9fae85bab tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:01.974605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cfef090d-7668-4c97-a1e8-cec9fae85bab tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:01.975209 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cfef090d-7668-4c97-a1e8-cec9fae85bab tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:02.140682 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cfef090d-7668-4c97-a1e8-cec9fae85bab tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:02.165434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cfef090d-7668-4c97-a1e8-cec9fae85bab tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:02.170759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cfef090d-7668-4c97-a1e8-cec9fae85bab tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:02.174401 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cfef090d-7668-4c97-a1e8-cec9fae85bab tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1408 microversion: 2.54 time: 0.232513 Jul 19 22:52:02.180087 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2457/4919] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:52:01 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:52:02.587462 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f8b209c2-e61f-415b-bbad-a050d298f55a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:02.594813 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f8b209c2-e61f-415b-bbad-a050d298f55a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:02.624812 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f8b209c2-e61f-415b-bbad-a050d298f55a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:02.628291 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f8b209c2-e61f-415b-bbad-a050d298f55a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:02.629355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f8b209c2-e61f-415b-bbad-a050d298f55a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:02.633293 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f8b209c2-e61f-415b-bbad-a050d298f55a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:03.201655 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6112553b-a16e-4c28-b6fc-7dcabb5a8210 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:03.203084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6112553b-a16e-4c28-b6fc-7dcabb5a8210 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:03.224504 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6112553b-a16e-4c28-b6fc-7dcabb5a8210 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:03.227375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6112553b-a16e-4c28-b6fc-7dcabb5a8210 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:03.228968 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6112553b-a16e-4c28-b6fc-7dcabb5a8210 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:03.230042 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6112553b-a16e-4c28-b6fc-7dcabb5a8210 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:03.460399 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6112553b-a16e-4c28-b6fc-7dcabb5a8210 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:03.490784 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6112553b-a16e-4c28-b6fc-7dcabb5a8210 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:03.492757 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6112553b-a16e-4c28-b6fc-7dcabb5a8210 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:03.500854 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6112553b-a16e-4c28-b6fc-7dcabb5a8210 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1408 microversion: 2.54 time: 0.298346 Jul 19 22:52:03.502634 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2458/4920] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:52:03 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1408 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:52:03.737045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f8b209c2-e61f-415b-bbad-a050d298f55a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:03.756054 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f8b209c2-e61f-415b-bbad-a050d298f55a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1697 microversion: 2.1 time: 1.177317 Jul 19 22:52:03.759934 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2463/4921] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:52:02 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1697 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:52:04.522378 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c2812f0d-d172-4092-897e-981f61fe88fc tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:04.523269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c2812f0d-d172-4092-897e-981f61fe88fc tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:04.543398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:52:04.559727 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c2812f0d-d172-4092-897e-981f61fe88fc tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:04.560282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c2812f0d-d172-4092-897e-981f61fe88fc tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:04.561088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c2812f0d-d172-4092-897e-981f61fe88fc tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:04.561534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c2812f0d-d172-4092-897e-981f61fe88fc tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:04.823367 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c2812f0d-d172-4092-897e-981f61fe88fc tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:04.828529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2fe3eebd-eb94-4286-85be-9128b89c5a66 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:04.836101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2fe3eebd-eb94-4286-85be-9128b89c5a66 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:04.891068 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fe3eebd-eb94-4286-85be-9128b89c5a66 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:04.894524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c2812f0d-d172-4092-897e-981f61fe88fc tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:04.895932 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fe3eebd-eb94-4286-85be-9128b89c5a66 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:04.902649 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c2812f0d-d172-4092-897e-981f61fe88fc tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:04.904620 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fe3eebd-eb94-4286-85be-9128b89c5a66 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:04.905647 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fe3eebd-eb94-4286-85be-9128b89c5a66 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:04.911475 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c2812f0d-d172-4092-897e-981f61fe88fc tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1408 microversion: 2.54 time: 0.394379 Jul 19 22:52:04.921221 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2459/4922] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:52:04 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1408 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:52:05.308387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2fe3eebd-eb94-4286-85be-9128b89c5a66 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:05.330407 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2fe3eebd-eb94-4286-85be-9128b89c5a66 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1697 microversion: 2.1 time: 0.559700 Jul 19 22:52:05.332536 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2464/4923] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:52:04 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1697 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:52:05.946172 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cfd4e908-b1d3-4025-b14d-96ea05dc83ea tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:05.947268 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cfd4e908-b1d3-4025-b14d-96ea05dc83ea tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:05.978588 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cfd4e908-b1d3-4025-b14d-96ea05dc83ea tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:05.979069 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cfd4e908-b1d3-4025-b14d-96ea05dc83ea tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:05.981238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cfd4e908-b1d3-4025-b14d-96ea05dc83ea tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:05.984881 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cfd4e908-b1d3-4025-b14d-96ea05dc83ea tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:06.159566 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cfd4e908-b1d3-4025-b14d-96ea05dc83ea tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:06.187355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cfd4e908-b1d3-4025-b14d-96ea05dc83ea tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:06.189129 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cfd4e908-b1d3-4025-b14d-96ea05dc83ea tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:06.192309 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cfd4e908-b1d3-4025-b14d-96ea05dc83ea tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1408 microversion: 2.54 time: 0.255438 Jul 19 22:52:06.208623 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2460/4924] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:52:05 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1408 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:52:06.352234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2fa93e2f-5603-45f3-a433-22ad507bf733 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:06.373911 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2fa93e2f-5603-45f3-a433-22ad507bf733 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:06.396774 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fa93e2f-5603-45f3-a433-22ad507bf733 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:06.397236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fa93e2f-5603-45f3-a433-22ad507bf733 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:06.406502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fa93e2f-5603-45f3-a433-22ad507bf733 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:06.406958 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fa93e2f-5603-45f3-a433-22ad507bf733 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:06.431927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:52:07.229289 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d5399b6c-12d5-4074-af08-aef648f2a3ba tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:07.229981 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d5399b6c-12d5-4074-af08-aef648f2a3ba tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:07.241481 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5399b6c-12d5-4074-af08-aef648f2a3ba tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:07.243486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5399b6c-12d5-4074-af08-aef648f2a3ba tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:07.245836 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5399b6c-12d5-4074-af08-aef648f2a3ba tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:07.246653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5399b6c-12d5-4074-af08-aef648f2a3ba tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:07.419332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2fa93e2f-5603-45f3-a433-22ad507bf733 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:07.431131 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2fa93e2f-5603-45f3-a433-22ad507bf733 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1697 microversion: 2.1 time: 1.086177 Jul 19 22:52:07.440315 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2465/4925] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:52:06 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1697 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:52:07.529459 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d5399b6c-12d5-4074-af08-aef648f2a3ba tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:07.554768 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d5399b6c-12d5-4074-af08-aef648f2a3ba tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:07.560781 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d5399b6c-12d5-4074-af08-aef648f2a3ba tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:07.567550 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d5399b6c-12d5-4074-af08-aef648f2a3ba tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1414 microversion: 2.54 time: 0.356691 Jul 19 22:52:07.568666 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2461/4926] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:52:07 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1414 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:52:08.457497 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3e4276a3-ca2d-44f0-9380-38bb9f29ea69 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:08.459777 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3e4276a3-ca2d-44f0-9380-38bb9f29ea69 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:08.476243 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e4276a3-ca2d-44f0-9380-38bb9f29ea69 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:08.477069 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e4276a3-ca2d-44f0-9380-38bb9f29ea69 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:08.484254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e4276a3-ca2d-44f0-9380-38bb9f29ea69 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:08.484922 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e4276a3-ca2d-44f0-9380-38bb9f29ea69 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:08.970138 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2b1e0dfa-8c1a-414d-b186-f3f40af1bba7 tempest-PortsAdminExtendedAttrsTestJSON-2007388991 tempest-PortsAdminExtendedAttrsTestJSON-2007388991-project-admin] Calling method '.version_select at 0x7f7a03e55ca0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:08.971880 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:52:08.971880 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:52:08.979322 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2b1e0dfa-8c1a-414d-b186-f3f40af1bba7 tempest-PortsAdminExtendedAttrsTestJSON-2007388991 tempest-PortsAdminExtendedAttrsTestJSON-2007388991-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:08.979994 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2b1e0dfa-8c1a-414d-b186-f3f40af1bba7 tempest-PortsAdminExtendedAttrsTestJSON-2007388991 tempest-PortsAdminExtendedAttrsTestJSON-2007388991-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:08.992069 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3e4276a3-ca2d-44f0-9380-38bb9f29ea69 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:09.018279 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3e4276a3-ca2d-44f0-9380-38bb9f29ea69 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1697 microversion: 2.1 time: 0.564946 Jul 19 22:52:09.037939 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2b1e0dfa-8c1a-414d-b186-f3f40af1bba7 tempest-PortsAdminExtendedAttrsTestJSON-2007388991 tempest-PortsAdminExtendedAttrsTestJSON-2007388991-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:09.039485 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2b1e0dfa-8c1a-414d-b186-f3f40af1bba7 tempest-PortsAdminExtendedAttrsTestJSON-2007388991 tempest-PortsAdminExtendedAttrsTestJSON-2007388991-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:09.041905 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2462/4927] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:52:08 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1697 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:52:09.065551 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5d7d2471-1a93-465f-94ff-ce6b7cbb869d tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:09.066991 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5d7d2471-1a93-465f-94ff-ce6b7cbb869d tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:09.084585 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2b1e0dfa-8c1a-414d-b186-f3f40af1bba7 tempest-PortsAdminExtendedAttrsTestJSON-2007388991 tempest-PortsAdminExtendedAttrsTestJSON-2007388991-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:09.086504 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2b1e0dfa-8c1a-414d-b186-f3f40af1bba7 tempest-PortsAdminExtendedAttrsTestJSON-2007388991 tempest-PortsAdminExtendedAttrsTestJSON-2007388991-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:09.096660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d7d2471-1a93-465f-94ff-ce6b7cbb869d tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:09.098169 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d7d2471-1a93-465f-94ff-ce6b7cbb869d tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:09.101039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d7d2471-1a93-465f-94ff-ce6b7cbb869d tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:09.109847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d7d2471-1a93-465f-94ff-ce6b7cbb869d tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:09.110640 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2b1e0dfa-8c1a-414d-b186-f3f40af1bba7 tempest-PortsAdminExtendedAttrsTestJSON-2007388991 tempest-PortsAdminExtendedAttrsTestJSON-2007388991-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.903485 Jul 19 22:52:09.124625 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2466/4928] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 22:52:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:52:09.374267 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5d7d2471-1a93-465f-94ff-ce6b7cbb869d tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:09.390548 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5d7d2471-1a93-465f-94ff-ce6b7cbb869d tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:09.397201 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5d7d2471-1a93-465f-94ff-ce6b7cbb869d tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:09.403396 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5d7d2471-1a93-465f-94ff-ce6b7cbb869d tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1414 microversion: 2.54 time: 0.357752 Jul 19 22:52:09.408115 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2463/4929] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:52:09 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1414 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:52:10.048810 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a8bac5d2-a25b-445d-9f10-8429e5ef7666 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:10.050091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a8bac5d2-a25b-445d-9f10-8429e5ef7666 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:10.092084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a8bac5d2-a25b-445d-9f10-8429e5ef7666 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:10.092646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a8bac5d2-a25b-445d-9f10-8429e5ef7666 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:10.093489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a8bac5d2-a25b-445d-9f10-8429e5ef7666 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:10.093927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a8bac5d2-a25b-445d-9f10-8429e5ef7666 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:10.442367 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bf34c3fa-b283-4c68-b16f-c2d6035eb107 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:10.443215 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bf34c3fa-b283-4c68-b16f-c2d6035eb107 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:10.469675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bf34c3fa-b283-4c68-b16f-c2d6035eb107 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:10.473581 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bf34c3fa-b283-4c68-b16f-c2d6035eb107 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:10.476942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bf34c3fa-b283-4c68-b16f-c2d6035eb107 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:10.478341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bf34c3fa-b283-4c68-b16f-c2d6035eb107 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:10.703373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bf34c3fa-b283-4c68-b16f-c2d6035eb107 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:10.713874 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bf34c3fa-b283-4c68-b16f-c2d6035eb107 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:10.717679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bf34c3fa-b283-4c68-b16f-c2d6035eb107 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:10.724112 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bf34c3fa-b283-4c68-b16f-c2d6035eb107 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1399 microversion: 2.54 time: 0.284227 Jul 19 22:52:10.727639 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2464/4930] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:52:10 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1399 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:52:10.736481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a8bac5d2-a25b-445d-9f10-8429e5ef7666 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:10.753498 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4645e370-b125-4231-aef2-56d26cd8041e tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '.version_select at 0x7f7a037edc10>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:10.766360 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a8bac5d2-a25b-445d-9f10-8429e5ef7666 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1697 microversion: 2.1 time: 0.721244 Jul 19 22:52:10.767736 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2467/4931] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:52:10 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1697 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:52:10.823021 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4645e370-b125-4231-aef2-56d26cd8041e tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-339803662" status: 204 len: 0 microversion: 2.54 time: 0.075389 Jul 19 22:52:10.823772 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2465/4932] 10.222.0.25 () {60 vars in 1315 bytes} [Tue Jul 19 22:52:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-339803662 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:52:10.844526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-db6ab86b-5dad-42fb-a146-96430a7c5eb0 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:10.845256 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-db6ab86b-5dad-42fb-a146-96430a7c5eb0 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:10.872812 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db6ab86b-5dad-42fb-a146-96430a7c5eb0 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:10.874007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db6ab86b-5dad-42fb-a146-96430a7c5eb0 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:10.875922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db6ab86b-5dad-42fb-a146-96430a7c5eb0 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:10.878131 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db6ab86b-5dad-42fb-a146-96430a7c5eb0 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:10.959307 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-db6ab86b-5dad-42fb-a146-96430a7c5eb0 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:52:11.180234 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-db6ab86b-5dad-42fb-a146-96430a7c5eb0 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "DELETE /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 204 len: 0 microversion: 2.54 time: 0.339451 Jul 19 22:52:11.182967 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2468/4933] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 22:52:10 2022] DELETE /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:52:11.193374 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4469b3ea-dd89-497a-8257-5cae3b2166b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:11.194139 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4469b3ea-dd89-497a-8257-5cae3b2166b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:11.224204 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4469b3ea-dd89-497a-8257-5cae3b2166b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:11.224968 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4469b3ea-dd89-497a-8257-5cae3b2166b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:11.226001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4469b3ea-dd89-497a-8257-5cae3b2166b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:11.227097 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4469b3ea-dd89-497a-8257-5cae3b2166b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:11.472753 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4469b3ea-dd89-497a-8257-5cae3b2166b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:11.482322 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4469b3ea-dd89-497a-8257-5cae3b2166b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:11.483899 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4469b3ea-dd89-497a-8257-5cae3b2166b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:11.491092 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4469b3ea-dd89-497a-8257-5cae3b2166b5 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1405 microversion: 2.54 time: 0.304071 Jul 19 22:52:11.502870 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2466/4934] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:52:11 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1405 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:52:11.787035 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6898f4f2-4080-4bbd-b993-b923e295b8a7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:11.788760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6898f4f2-4080-4bbd-b993-b923e295b8a7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:11.849985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6898f4f2-4080-4bbd-b993-b923e295b8a7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:11.851836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6898f4f2-4080-4bbd-b993-b923e295b8a7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:11.854846 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6898f4f2-4080-4bbd-b993-b923e295b8a7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:11.857254 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6898f4f2-4080-4bbd-b993-b923e295b8a7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:12.511453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f0ef6544-40db-49b9-8945-1559171215a2 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:12.512831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f0ef6544-40db-49b9-8945-1559171215a2 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:12.527314 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f0ef6544-40db-49b9-8945-1559171215a2 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:12.528155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f0ef6544-40db-49b9-8945-1559171215a2 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:12.531906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f0ef6544-40db-49b9-8945-1559171215a2 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:12.532714 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f0ef6544-40db-49b9-8945-1559171215a2 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:12.975547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f0ef6544-40db-49b9-8945-1559171215a2 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:12.988037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f0ef6544-40db-49b9-8945-1559171215a2 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:12.997237 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f0ef6544-40db-49b9-8945-1559171215a2 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:12.998794 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f0ef6544-40db-49b9-8945-1559171215a2 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1405 microversion: 2.54 time: 0.492203 Jul 19 22:52:13.004369 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2467/4935] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:52:12 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1405 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:52:13.225406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6898f4f2-4080-4bbd-b993-b923e295b8a7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:13.237232 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6898f4f2-4080-4bbd-b993-b923e295b8a7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1697 microversion: 2.1 time: 1.455441 Jul 19 22:52:13.241099 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2469/4936] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:52:11 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1697 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:52:14.031929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bbc43949-f3e4-4998-a7f8-b5076fe0be02 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:14.033595 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bbc43949-f3e4-4998-a7f8-b5076fe0be02 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:14.052584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bbc43949-f3e4-4998-a7f8-b5076fe0be02 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:14.053689 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bbc43949-f3e4-4998-a7f8-b5076fe0be02 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:14.055010 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bbc43949-f3e4-4998-a7f8-b5076fe0be02 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:14.057039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bbc43949-f3e4-4998-a7f8-b5076fe0be02 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:14.247102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bbc43949-f3e4-4998-a7f8-b5076fe0be02 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:14.258726 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-daec4a81-5187-400d-9c70-d1a77a1a0ab9 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:14.266106 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-daec4a81-5187-400d-9c70-d1a77a1a0ab9 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:14.311016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bbc43949-f3e4-4998-a7f8-b5076fe0be02 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:14.311784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-daec4a81-5187-400d-9c70-d1a77a1a0ab9 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:14.312628 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-daec4a81-5187-400d-9c70-d1a77a1a0ab9 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:14.315083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bbc43949-f3e4-4998-a7f8-b5076fe0be02 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048594c6bd0348abb192c7b05e823ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf7f55a82eb498697a913f46e190db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:14.319204 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-daec4a81-5187-400d-9c70-d1a77a1a0ab9 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:14.325927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-daec4a81-5187-400d-9c70-d1a77a1a0ab9 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:14.328779 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bbc43949-f3e4-4998-a7f8-b5076fe0be02 tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 200 len: 1405 microversion: 2.54 time: 0.304617 Jul 19 22:52:14.329606 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2468/4937] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:52:14 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 1405 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:52:14.847856 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-daec4a81-5187-400d-9c70-d1a77a1a0ab9 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:14.897944 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-daec4a81-5187-400d-9c70-d1a77a1a0ab9 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1696 microversion: 2.1 time: 0.642120 Jul 19 22:52:14.898953 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2470/4938] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:52:14 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1696 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:52:15.348829 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cece1f18-ba83-437f-886f-df8038c321aa tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:15.349592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cece1f18-ba83-437f-886f-df8038c321aa tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] [instance: 894b1e3a-da1c-4ad1-93bb-89eb626251ca] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:15.363961 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cece1f18-ba83-437f-886f-df8038c321aa tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:15.379826 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cece1f18-ba83-437f-886f-df8038c321aa tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:15.382256 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cece1f18-ba83-437f-886f-df8038c321aa tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:15.384230 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cece1f18-ba83-437f-886f-df8038c321aa tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:15.418474 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-cece1f18-ba83-437f-886f-df8038c321aa tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] HTTP exception thrown: Instance 894b1e3a-da1c-4ad1-93bb-89eb626251ca could not be found. Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cece1f18-ba83-437f-886f-df8038c321aa tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Request method failure captured: Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca HTTP/1.1 Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zVuojLwyIvpuDTISyETGIGzUp7kYovDD_7e7W2X-sbkE3rhjZRR2agLjbMrwt26Bc212g0bM7qi6kRw0qrGC3RITyWdoNJKDOzbJFWQcZh7iO7SHBJng2wPAAgtFINC2Inzeg2CtCu9Xt3lhb1_u1GvrzAmawhlsQQcgSk3cPAebKE Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: X-Openstack-Nova-Api-Version: 2.54 Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: abf7f55a82eb498697a913f46e190db4 Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerShowV254Test-287762306 Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_abf7f55a82eb498697a913f46e190db4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/abf7f55a82eb498697a913f46e190db4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/abf7f55a82eb498697a913f46e190db4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/abf7f55a82eb498697a913f46e190db4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerShowV254Test-287762306 Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: abf7f55a82eb498697a913f46e190db4 Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerShowV254Test-287762306 Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerShowV254Test-287762306-project Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 048594c6bd0348abb192c7b05e823ca7 Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerShowV254Test-287762306-project Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 894b1e3a-da1c-4ad1-93bb-89eb626251ca could not be found. Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '894b1e3a-da1c-4ad1-93bb-89eb626251ca'} Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 894b1e3a-da1c-4ad1-93bb-89eb626251ca could not be found. Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 894b1e3a-da1c-4ad1-93bb-89eb626251ca could not be found. Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:52:15.423360 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:52:15.428745 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:52:15.428745 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:52:15.428745 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:52:15.428745 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:52:15.428745 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:52:15.428745 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 894b1e3a-da1c-4ad1-93bb-89eb626251ca could not be found. Jul 19 22:52:15.428745 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:52:15.428745 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cece1f18-ba83-437f-886f-df8038c321aa tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] Returning 404 to user: Instance 894b1e3a-da1c-4ad1-93bb-89eb626251ca could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:52:15.431850 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cece1f18-ba83-437f-886f-df8038c321aa tempest-ServerShowV254Test-287762306 tempest-ServerShowV254Test-287762306-project] 10.222.0.25 "GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca" status: 404 len: 111 microversion: 2.54 time: 0.081968 Jul 19 22:52:15.432503 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2469/4939] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:52:15 2022] GET /compute/v2.1/servers/894b1e3a-da1c-4ad1-93bb-89eb626251ca => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:52:15.638139 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-9f640c44-4183-451f-8a4a-58c6e79ca4bf req-b562980b-dacd-4393-a454-88f727109216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4c1ba16-fff7-480d-9af7-731cc40f338b", "name": "network-vif-unplugged", "status": "completed", "tag": "98a6d1ad-0bbd-48ee-9c7c-81eec448b034"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:52:15.648149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:52:15.661815 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-9f640c44-4183-451f-8a4a-58c6e79ca4bf req-b562980b-dacd-4393-a454-88f727109216 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:15.662728 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-9f640c44-4183-451f-8a4a-58c6e79ca4bf req-b562980b-dacd-4393-a454-88f727109216 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:15.702334 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-9f640c44-4183-451f-8a4a-58c6e79ca4bf req-b562980b-dacd-4393-a454-88f727109216 service nova] Creating event network-vif-unplugged:98a6d1ad-0bbd-48ee-9c7c-81eec448b034 for instance d4c1ba16-fff7-480d-9af7-731cc40f338b on n-h1-847009-3 Jul 19 22:52:15.722517 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [req-9f640c44-4183-451f-8a4a-58c6e79ca4bf req-b562980b-dacd-4393-a454-88f727109216 service nova] Instance d4c1ba16-fff7-480d-9af7-731cc40f338b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119337) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 22:52:15.755703 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-9f640c44-4183-451f-8a4a-58c6e79ca4bf req-b562980b-dacd-4393-a454-88f727109216 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122350 Jul 19 22:52:15.756996 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2471/4940] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:52:15.917451 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e28d36c1-b29c-4d77-9eb4-ecabeddb5102 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:15.918082 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e28d36c1-b29c-4d77-9eb4-ecabeddb5102 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:15.932265 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e28d36c1-b29c-4d77-9eb4-ecabeddb5102 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:15.932607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e28d36c1-b29c-4d77-9eb4-ecabeddb5102 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:15.943563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e28d36c1-b29c-4d77-9eb4-ecabeddb5102 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:15.944022 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e28d36c1-b29c-4d77-9eb4-ecabeddb5102 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:16.830100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e28d36c1-b29c-4d77-9eb4-ecabeddb5102 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:16.848968 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e28d36c1-b29c-4d77-9eb4-ecabeddb5102 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1696 microversion: 2.1 time: 0.926615 Jul 19 22:52:16.850421 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2470/4941] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:52:15 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1696 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:52:17.870680 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8dd7874f-13b9-4064-a993-73e87d17a515 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:17.876450 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8dd7874f-13b9-4064-a993-73e87d17a515 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:17.902433 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8dd7874f-13b9-4064-a993-73e87d17a515 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:17.902997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8dd7874f-13b9-4064-a993-73e87d17a515 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:17.911172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8dd7874f-13b9-4064-a993-73e87d17a515 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:17.913598 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8dd7874f-13b9-4064-a993-73e87d17a515 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:18.312371 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-1ebb7004-53f5-4a32-887a-d5efccf72d1c req-72dcf0ac-bef1-4108-b639-e00336cf4fef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c1ba16-fff7-480d-9af7-731cc40f338b", "tag": "98a6d1ad-0bbd-48ee-9c7c-81eec448b034"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:52:18.331679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-1ebb7004-53f5-4a32-887a-d5efccf72d1c req-72dcf0ac-bef1-4108-b639-e00336cf4fef service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:18.332229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-1ebb7004-53f5-4a32-887a-d5efccf72d1c req-72dcf0ac-bef1-4108-b639-e00336cf4fef service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:18.348691 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-1ebb7004-53f5-4a32-887a-d5efccf72d1c req-72dcf0ac-bef1-4108-b639-e00336cf4fef service nova] Creating event network-changed:98a6d1ad-0bbd-48ee-9c7c-81eec448b034 for instance d4c1ba16-fff7-480d-9af7-731cc40f338b on n-h1-847009-3 Jul 19 22:52:18.356999 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [req-1ebb7004-53f5-4a32-887a-d5efccf72d1c req-72dcf0ac-bef1-4108-b639-e00336cf4fef service nova] Instance d4c1ba16-fff7-480d-9af7-731cc40f338b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119338) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 22:52:18.376921 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-1ebb7004-53f5-4a32-887a-d5efccf72d1c req-72dcf0ac-bef1-4108-b639-e00336cf4fef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067978 Jul 19 22:52:18.377939 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2471/4942] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:52:18.524234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8dd7874f-13b9-4064-a993-73e87d17a515 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:18.547044 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8dd7874f-13b9-4064-a993-73e87d17a515 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1696 microversion: 2.1 time: 0.682173 Jul 19 22:52:18.554868 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2472/4943] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:52:17 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1696 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:52:19.576018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-703986de-6551-43e0-aeb2-ee5b0b42d9c8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:19.576786 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-703986de-6551-43e0-aeb2-ee5b0b42d9c8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:19.597326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-703986de-6551-43e0-aeb2-ee5b0b42d9c8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:19.598730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-703986de-6551-43e0-aeb2-ee5b0b42d9c8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:19.599845 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-703986de-6551-43e0-aeb2-ee5b0b42d9c8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:19.600501 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-703986de-6551-43e0-aeb2-ee5b0b42d9c8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:20.049585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-703986de-6551-43e0-aeb2-ee5b0b42d9c8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:20.063032 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-703986de-6551-43e0-aeb2-ee5b0b42d9c8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1696 microversion: 2.1 time: 0.491127 Jul 19 22:52:20.065986 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2472/4944] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:52:19 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1696 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:52:21.088524 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3ed51da8-826d-4b28-bde7-23cf95980039 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:21.091027 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3ed51da8-826d-4b28-bde7-23cf95980039 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:21.119143 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ed51da8-826d-4b28-bde7-23cf95980039 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:21.121995 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ed51da8-826d-4b28-bde7-23cf95980039 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:21.125885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ed51da8-826d-4b28-bde7-23cf95980039 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:21.127748 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ed51da8-826d-4b28-bde7-23cf95980039 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:21.607896 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3ed51da8-826d-4b28-bde7-23cf95980039 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:21.644177 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3ed51da8-826d-4b28-bde7-23cf95980039 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1694 microversion: 2.1 time: 0.558551 Jul 19 22:52:21.648900 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2473/4945] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:52:21 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1694 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:52:22.672427 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4f0377da-c8b6-4c47-8342-470e68b8f2fb tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:22.673875 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4f0377da-c8b6-4c47-8342-470e68b8f2fb tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:22.691959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f0377da-c8b6-4c47-8342-470e68b8f2fb tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:22.693950 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f0377da-c8b6-4c47-8342-470e68b8f2fb tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:22.696286 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f0377da-c8b6-4c47-8342-470e68b8f2fb tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:22.698032 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f0377da-c8b6-4c47-8342-470e68b8f2fb tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:23.413432 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4f0377da-c8b6-4c47-8342-470e68b8f2fb tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:23.424420 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4f0377da-c8b6-4c47-8342-470e68b8f2fb tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1691 microversion: 2.1 time: 0.762069 Jul 19 22:52:23.425024 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2473/4946] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:52:22 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1691 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:52:23.443516 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f1aea93e-cf74-4592-8a30-eaec8dbf9673 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:52:23.444863 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f1aea93e-cf74-4592-8a30-eaec8dbf9673 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:23.460790 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f1aea93e-cf74-4592-8a30-eaec8dbf9673 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:23.464242 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f1aea93e-cf74-4592-8a30-eaec8dbf9673 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:23.466269 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f1aea93e-cf74-4592-8a30-eaec8dbf9673 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:23.467677 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f1aea93e-cf74-4592-8a30-eaec8dbf9673 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:23.600239 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f1aea93e-cf74-4592-8a30-eaec8dbf9673 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "POST /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b/action" status: 204 len: 0 microversion: 2.1 time: 0.162034 Jul 19 22:52:23.601137 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2474/4947] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:52:23 2022] POST /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b/action => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:52:23.614110 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4ae610fd-6d30-4e01-bdff-5aed58936e8b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:23.616097 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4ae610fd-6d30-4e01-bdff-5aed58936e8b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:23.636375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ae610fd-6d30-4e01-bdff-5aed58936e8b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:23.636847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ae610fd-6d30-4e01-bdff-5aed58936e8b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:23.647617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ae610fd-6d30-4e01-bdff-5aed58936e8b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:23.651687 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ae610fd-6d30-4e01-bdff-5aed58936e8b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:23.679496 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:52:24.221543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4ae610fd-6d30-4e01-bdff-5aed58936e8b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:24.238142 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4ae610fd-6d30-4e01-bdff-5aed58936e8b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1691 microversion: 2.1 time: 0.628433 Jul 19 22:52:24.239400 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2474/4948] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:52:23 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1691 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:52:24.423927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f54cd153-7ca3-4b66-b971-31dd4d7d4b21 tempest-ComputeTenantNetworksTest-557375054 tempest-ComputeTenantNetworksTest-557375054-project] Calling method '.version_select at 0x7f7a109a2ee0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:25.258286 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9a295761-100e-4bfa-b4ba-ecfc2ff31ad7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:25.260055 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9a295761-100e-4bfa-b4ba-ecfc2ff31ad7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:25.283042 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a295761-100e-4bfa-b4ba-ecfc2ff31ad7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:25.283836 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a295761-100e-4bfa-b4ba-ecfc2ff31ad7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:25.284912 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a295761-100e-4bfa-b4ba-ecfc2ff31ad7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:25.285398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a295761-100e-4bfa-b4ba-ecfc2ff31ad7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:25.394690 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f54cd153-7ca3-4b66-b971-31dd4d7d4b21 tempest-ComputeTenantNetworksTest-557375054 tempest-ComputeTenantNetworksTest-557375054-project] 10.222.0.25 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.648677 Jul 19 22:52:25.395326 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2475/4949] 10.222.0.25 () {58 vars in 1157 bytes} [Tue Jul 19 22:52:23 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:52:25.417094 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cca72320-c75f-43e5-a831-80a992deffe8 tempest-ComputeTenantNetworksTest-557375054 tempest-ComputeTenantNetworksTest-557375054-project] Calling method '.version_select at 0x7f7a03d435e0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:26.428412 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cca72320-c75f-43e5-a831-80a992deffe8 tempest-ComputeTenantNetworksTest-557375054 tempest-ComputeTenantNetworksTest-557375054-project] 10.222.0.25 "GET /compute/v2.1/os-tenant-networks/1d28f375-519d-4f30-8805-8c2b3702665a" status: 200 len: 140 microversion: 2.1 time: 1.023144 Jul 19 22:52:26.429369 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2476/4950] 10.222.0.25 () {58 vars in 1268 bytes} [Tue Jul 19 22:52:25 2022] GET /compute/v2.1/os-tenant-networks/1d28f375-519d-4f30-8805-8c2b3702665a => generated 140 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:52:26.511929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9a295761-100e-4bfa-b4ba-ecfc2ff31ad7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:26.527278 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9a295761-100e-4bfa-b4ba-ecfc2ff31ad7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1691 microversion: 2.1 time: 1.274372 Jul 19 22:52:26.530955 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2475/4951] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:52:25 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1691 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:52:27.551603 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-74fb3a01-ef7b-4244-bc07-041f82d89839 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:27.552361 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-74fb3a01-ef7b-4244-bc07-041f82d89839 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:27.568612 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74fb3a01-ef7b-4244-bc07-041f82d89839 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:27.569354 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74fb3a01-ef7b-4244-bc07-041f82d89839 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:27.570168 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74fb3a01-ef7b-4244-bc07-041f82d89839 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:27.570610 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74fb3a01-ef7b-4244-bc07-041f82d89839 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:28.429241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-74fb3a01-ef7b-4244-bc07-041f82d89839 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:28.439991 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-74fb3a01-ef7b-4244-bc07-041f82d89839 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1691 microversion: 2.1 time: 0.893791 Jul 19 22:52:28.444063 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2477/4952] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:52:27 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1691 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:52:29.470201 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7384cd68-d30d-4338-b05d-d5586264ab15 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:29.472293 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7384cd68-d30d-4338-b05d-d5586264ab15 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:29.491796 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7384cd68-d30d-4338-b05d-d5586264ab15 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:29.492306 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7384cd68-d30d-4338-b05d-d5586264ab15 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:29.493153 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7384cd68-d30d-4338-b05d-d5586264ab15 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:29.495658 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7384cd68-d30d-4338-b05d-d5586264ab15 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:30.585491 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7384cd68-d30d-4338-b05d-d5586264ab15 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:52:30.610154 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7384cd68-d30d-4338-b05d-d5586264ab15 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1683 microversion: 2.1 time: 1.155256 Jul 19 22:52:30.624471 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2476/4953] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:52:29 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1683 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:52:31.601034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-77133205-049a-487b-a13e-03cbe515677e req-8fc703d7-0e6b-4be1-89d4-5a6ac5613ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4c1ba16-fff7-480d-9af7-731cc40f338b", "name": "network-vif-plugged", "status": "completed", "tag": "98a6d1ad-0bbd-48ee-9c7c-81eec448b034"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:52:31.619994 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-77133205-049a-487b-a13e-03cbe515677e req-8fc703d7-0e6b-4be1-89d4-5a6ac5613ee8 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:31.620446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-77133205-049a-487b-a13e-03cbe515677e req-8fc703d7-0e6b-4be1-89d4-5a6ac5613ee8 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:31.660578 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-77133205-049a-487b-a13e-03cbe515677e req-8fc703d7-0e6b-4be1-89d4-5a6ac5613ee8 service nova] Creating event network-vif-plugged:98a6d1ad-0bbd-48ee-9c7c-81eec448b034 for instance d4c1ba16-fff7-480d-9af7-731cc40f338b on n-h1-847009-3 Jul 19 22:52:31.675840 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-77133205-049a-487b-a13e-03cbe515677e req-8fc703d7-0e6b-4be1-89d4-5a6ac5613ee8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081578 Jul 19 22:52:31.678663 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2478/4954] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:52:33.547662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8a6ec509-9d43-4262-82a5-dbf1cda252c8 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:33.548123 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8a6ec509-9d43-4262-82a5-dbf1cda252c8 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:33.559705 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8a6ec509-9d43-4262-82a5-dbf1cda252c8 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:33.560171 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8a6ec509-9d43-4262-82a5-dbf1cda252c8 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:33.560953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8a6ec509-9d43-4262-82a5-dbf1cda252c8 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:33.561408 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8a6ec509-9d43-4262-82a5-dbf1cda252c8 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:33.632226 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8a6ec509-9d43-4262-82a5-dbf1cda252c8 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/ips" status: 200 len: 149 microversion: 2.1 time: 0.088567 Jul 19 22:52:33.646348 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2477/4955] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 19 22:52:33 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/ips => generated 149 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:52:37.798623 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f5acda1b-664d-4b75-9a93-4ba535d274f1 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2227fd74-8a48-46f7-93e4-c8505fb87650"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:52:37.800805 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f5acda1b-664d-4b75-9a93-4ba535d274f1 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:37.836070 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f5acda1b-664d-4b75-9a93-4ba535d274f1 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:37.836539 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f5acda1b-664d-4b75-9a93-4ba535d274f1 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:37.837829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f5acda1b-664d-4b75-9a93-4ba535d274f1 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:37.838370 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f5acda1b-664d-4b75-9a93-4ba535d274f1 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:37.855041 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:52:38.486448 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f5acda1b-664d-4b75-9a93-4ba535d274f1 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "POST /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.694022 Jul 19 22:52:38.492024 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2479/4956] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 19 22:52:37 2022] POST /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-volume_attachments => generated 194 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:52:49.735571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:52:49.737490 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=21 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:52:50.364271 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0a243226-ee4f-4cbd-b564-cf507403c7c1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Action: 'create', calling method: .version_select at 0x7f7a10415dc0>, body: {"keypair": {"name": "tempest-keypair-2134206595", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaZ5TPu3WIFkmhCUN6DGck9PziaoeQVT52gcrSVRArwPNKswUMrvt4eLVwIEINFd52w6xA7JqL3d4swh99JDj9jHRRHsng23a0j+HjJwTp+InO/Y/Ehqp4u8IqkzXKzCw=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:52:50.391481 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-0a243226-ee4f-4cbd-b564-cf507403c7c1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Getting quotas for project f262a7d579e84c07aef4fff8e5eda67e. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:52:50.403515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-0a243226-ee4f-4cbd-b564-cf507403c7c1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Getting quotas for user 1f187e783d5247bfb54c5d27bab4f048 and project f262a7d579e84c07aef4fff8e5eda67e. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:52:50.453076 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0a243226-ee4f-4cbd-b564-cf507403c7c1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.729686 Jul 19 22:52:50.460381 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2478/4957] 10.222.0.25 () {62 vars in 1199 bytes} [Tue Jul 19 22:52:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 738 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 22:52:51.151427 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=13 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:52:51.152336 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:52:51.159855 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5a03bc59-2191-43ec-bd96-69352df9d934 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:52:51.164575 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5a03bc59-2191-43ec-bd96-69352df9d934 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:51.198766 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a03bc59-2191-43ec-bd96-69352df9d934 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:51.199488 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a03bc59-2191-43ec-bd96-69352df9d934 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:51.201636 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a03bc59-2191-43ec-bd96-69352df9d934 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:51.202950 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a03bc59-2191-43ec-bd96-69352df9d934 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:51.325473 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5a03bc59-2191-43ec-bd96-69352df9d934 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "POST /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b/action" status: 200 len: 24579 microversion: 2.1 time: 0.176633 Jul 19 22:52:51.332122 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2480/4958] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:52:51 2022] POST /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b/action => generated 24579 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:52:54.816269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-df864438-7c11-44e2-a912-c53283bf8bf6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Action: 'create', calling method: .version_select at 0x7f7a03fe5430>, body: {"keypair": {"name": "tempest-keypair-1669638682", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6MfOm7QgWy6joxSuIQda+rIk3leGQ1sU6MwMc7rQ56QkqO6Y6/MsAapZymUdnEpL8V4Ta7yqqz+zz5OwxcejLFfubeMLdIzPcVN16rNOAR/6LFRbipfseAo0OOsVS5lQ=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:52:54.878960 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-df864438-7c11-44e2-a912-c53283bf8bf6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Getting quotas for project e3b759a0bda64e3c9df38b624d4145b6. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:52:54.895098 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-df864438-7c11-44e2-a912-c53283bf8bf6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Getting quotas for user c3929e62eb4345f8a69fec37ba7c195f and project e3b759a0bda64e3c9df38b624d4145b6. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:52:54.952147 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-df864438-7c11-44e2-a912-c53283bf8bf6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.142401 Jul 19 22:52:54.953304 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2479/4959] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:52:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:52:57.791928 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eb194052-2c23-404d-a18c-b5158d23b82a tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:52:57.793676 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eb194052-2c23-404d-a18c-b5158d23b82a tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:52:57.823269 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb194052-2c23-404d-a18c-b5158d23b82a tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:57.824716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb194052-2c23-404d-a18c-b5158d23b82a tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:57.828917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb194052-2c23-404d-a18c-b5158d23b82a tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:52:57.838836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb194052-2c23-404d-a18c-b5158d23b82a tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:52:58.117016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6cfe187a-0184-4234-bd2c-d6d1673b6a38 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-155888705", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93c1ea45-39d4-4067-9284-38fc63c2a005"}], "security_groups": [{"name": "tempest-securitygroup--1200522311"}], "key_name": "tempest-keypair-2134206595", "user_data": "}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:52:58.482893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-6cfe187a-0184-4234-bd2c-d6d1673b6a38 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] validate_networks() for [('93c1ea45-39d4-4067-9284-38fc63c2a005', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:52:58.534041 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eb194052-2c23-404d-a18c-b5158d23b82a tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1834 microversion: 2.1 time: 0.745376 Jul 19 22:52:58.535546 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2481/4960] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:52:57 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1834 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:53:02.981165 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-6cfe187a-0184-4234-bd2c-d6d1673b6a38 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:53:02.982371 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-6cfe187a-0184-4234-bd2c-d6d1673b6a38 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:53:02.983034 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-6cfe187a-0184-4234-bd2c-d6d1673b6a38 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:53:02.984108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-6cfe187a-0184-4234-bd2c-d6d1673b6a38 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:53:02.984108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-6cfe187a-0184-4234-bd2c-d6d1673b6a38 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:53:03.017842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6cfe187a-0184-4234-bd2c-d6d1673b6a38 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:03.019475 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6cfe187a-0184-4234-bd2c-d6d1673b6a38 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:03.021956 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6cfe187a-0184-4234-bd2c-d6d1673b6a38 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:03.024450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6cfe187a-0184-4234-bd2c-d6d1673b6a38 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:03.098293 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-6cfe187a-0184-4234-bd2c-d6d1673b6a38 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Getting quotas for project f262a7d579e84c07aef4fff8e5eda67e. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:53:03.109665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-6cfe187a-0184-4234-bd2c-d6d1673b6a38 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Getting quotas for user 1f187e783d5247bfb54c5d27bab4f048 and project f262a7d579e84c07aef4fff8e5eda67e. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:53:03.157384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6cfe187a-0184-4234-bd2c-d6d1673b6a38 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:53:03.166400 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6cfe187a-0184-4234-bd2c-d6d1673b6a38 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:53:03.281889 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6cfe187a-0184-4234-bd2c-d6d1673b6a38 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.168135 Jul 19 22:53:03.288609 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2480/4961] 10.222.0.25 () {62 vars in 1187 bytes} [Tue Jul 19 22:52:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 5178 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 22:53:03.294397 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7ede0c63-ef57-49c3-be3f-437e2d35bedb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:03.295023 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7ede0c63-ef57-49c3-be3f-437e2d35bedb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:04.602398 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7ede0c63-ef57-49c3-be3f-437e2d35bedb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:04.618490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7ede0c63-ef57-49c3-be3f-437e2d35bedb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:04.627014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7ede0c63-ef57-49c3-be3f-437e2d35bedb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:04.630661 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7ede0c63-ef57-49c3-be3f-437e2d35bedb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1281 microversion: 2.20 time: 1.339315 Jul 19 22:53:04.632574 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2482/4962] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:53:03 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1281 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:53:05.503686 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dfae8d75-e170-44ef-affd-25b88d13ae29 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-683969584", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d10914df-2da2-4f58-98fa-60d9a22bab41"}], "security_groups": [{"name": "tempest-securitygroup--376925943"}], "key_name": "tempest-keypair-1669638682", "user_data": "}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:53:05.654265 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d770a580-667f-40c7-9f9d-99c57299adeb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:05.654859 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d770a580-667f-40c7-9f9d-99c57299adeb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:05.663920 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d770a580-667f-40c7-9f9d-99c57299adeb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:05.665035 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d770a580-667f-40c7-9f9d-99c57299adeb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:05.666311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d770a580-667f-40c7-9f9d-99c57299adeb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:05.666789 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d770a580-667f-40c7-9f9d-99c57299adeb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:05.936405 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-dfae8d75-e170-44ef-affd-25b88d13ae29 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] validate_networks() for [('d10914df-2da2-4f58-98fa-60d9a22bab41', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:53:06.052837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d770a580-667f-40c7-9f9d-99c57299adeb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:06.066654 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d770a580-667f-40c7-9f9d-99c57299adeb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:06.069753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d770a580-667f-40c7-9f9d-99c57299adeb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:06.072547 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d770a580-667f-40c7-9f9d-99c57299adeb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1333 microversion: 2.20 time: 0.421491 Jul 19 22:53:06.074707 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2483/4963] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:53:05 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1333 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:53:06.080666 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-43ca0a45-d626-46db-8de5-e4188d33415f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:06.096381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-43ca0a45-d626-46db-8de5-e4188d33415f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:06.128910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-43ca0a45-d626-46db-8de5-e4188d33415f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:06.135720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-43ca0a45-d626-46db-8de5-e4188d33415f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:06.140099 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-43ca0a45-d626-46db-8de5-e4188d33415f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:06.143005 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-43ca0a45-d626-46db-8de5-e4188d33415f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:06.242183 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-43ca0a45-d626-46db-8de5-e4188d33415f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:53:06.472705 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-43ca0a45-d626-46db-8de5-e4188d33415f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 204 len: 0 microversion: 2.1 time: 0.396394 Jul 19 22:53:06.473494 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2484/4964] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:53:06 2022] DELETE /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:53:06.496305 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-d1e9655b-30fd-4b3e-b1bd-c1b1c60b2704 req-69314ee3-ea62-406d-bab9-d65f832c92c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c1ba16-fff7-480d-9af7-731cc40f338b", "tag": "98a6d1ad-0bbd-48ee-9c7c-81eec448b034"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:53:06.522126 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d1e9655b-30fd-4b3e-b1bd-c1b1c60b2704 req-69314ee3-ea62-406d-bab9-d65f832c92c9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:06.525486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d1e9655b-30fd-4b3e-b1bd-c1b1c60b2704 req-69314ee3-ea62-406d-bab9-d65f832c92c9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:06.565604 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-d1e9655b-30fd-4b3e-b1bd-c1b1c60b2704 req-69314ee3-ea62-406d-bab9-d65f832c92c9 service nova] Creating event network-changed:98a6d1ad-0bbd-48ee-9c7c-81eec448b034 for instance d4c1ba16-fff7-480d-9af7-731cc40f338b on n-h1-847009-3 Jul 19 22:53:06.578998 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-d1e9655b-30fd-4b3e-b1bd-c1b1c60b2704 req-69314ee3-ea62-406d-bab9-d65f832c92c9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104301 Jul 19 22:53:06.583222 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2485/4965] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:53:06.596237 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3ab71071-067a-44b9-a53e-5e7dc50e9160 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:06.598622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3ab71071-067a-44b9-a53e-5e7dc50e9160 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:06.614363 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ab71071-067a-44b9-a53e-5e7dc50e9160 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:06.623295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ab71071-067a-44b9-a53e-5e7dc50e9160 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:06.624538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ab71071-067a-44b9-a53e-5e7dc50e9160 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:06.625100 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ab71071-067a-44b9-a53e-5e7dc50e9160 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:07.094528 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3ab71071-067a-44b9-a53e-5e7dc50e9160 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:07.108707 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3ab71071-067a-44b9-a53e-5e7dc50e9160 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1689 microversion: 2.1 time: 0.523894 Jul 19 22:53:07.115307 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2486/4966] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:53:06 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1689 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:53:07.129061 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-13a1836e-ee44-4393-befc-b211c5aef62f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:07.129994 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-13a1836e-ee44-4393-befc-b211c5aef62f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:07.155277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13a1836e-ee44-4393-befc-b211c5aef62f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:07.156616 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13a1836e-ee44-4393-befc-b211c5aef62f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:07.158878 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13a1836e-ee44-4393-befc-b211c5aef62f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:07.159440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13a1836e-ee44-4393-befc-b211c5aef62f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:07.338649 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-dfae8d75-e170-44ef-affd-25b88d13ae29 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:53:07.340759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-dfae8d75-e170-44ef-affd-25b88d13ae29 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:53:07.342550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-dfae8d75-e170-44ef-affd-25b88d13ae29 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:53:07.343284 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-dfae8d75-e170-44ef-affd-25b88d13ae29 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:53:07.344181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-dfae8d75-e170-44ef-affd-25b88d13ae29 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:53:07.379528 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfae8d75-e170-44ef-affd-25b88d13ae29 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:07.380990 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfae8d75-e170-44ef-affd-25b88d13ae29 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:07.383276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfae8d75-e170-44ef-affd-25b88d13ae29 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:07.386111 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfae8d75-e170-44ef-affd-25b88d13ae29 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:07.397121 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-13a1836e-ee44-4393-befc-b211c5aef62f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:07.412215 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-13a1836e-ee44-4393-befc-b211c5aef62f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:07.414096 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-13a1836e-ee44-4393-befc-b211c5aef62f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:07.416726 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-13a1836e-ee44-4393-befc-b211c5aef62f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1339 microversion: 2.20 time: 0.299892 Jul 19 22:53:07.421570 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2487/4967] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:53:07 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1339 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:53:07.458208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-dfae8d75-e170-44ef-affd-25b88d13ae29 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Getting quotas for project e3b759a0bda64e3c9df38b624d4145b6. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:53:07.471789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-dfae8d75-e170-44ef-affd-25b88d13ae29 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Getting quotas for user c3929e62eb4345f8a69fec37ba7c195f and project e3b759a0bda64e3c9df38b624d4145b6. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:53:07.516098 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dfae8d75-e170-44ef-affd-25b88d13ae29 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:53:07.521004 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dfae8d75-e170-44ef-affd-25b88d13ae29 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9cb08864-7c20-44cc-9f73-87f0da61e0aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:53:07.667462 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dfae8d75-e170-44ef-affd-25b88d13ae29 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.166183 Jul 19 22:53:07.674479 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2481/4968] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:53:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 2177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:53:07.682107 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a4c2e697-764e-430e-beab-9968eb04d832 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:07.684273 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a4c2e697-764e-430e-beab-9968eb04d832 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9cb08864-7c20-44cc-9f73-87f0da61e0aa] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:08.133163 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a189cf5a-9d5f-44fc-ba42-4e14a0445cd8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:08.134021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a189cf5a-9d5f-44fc-ba42-4e14a0445cd8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:08.146702 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a189cf5a-9d5f-44fc-ba42-4e14a0445cd8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:08.151601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a189cf5a-9d5f-44fc-ba42-4e14a0445cd8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:08.156550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a189cf5a-9d5f-44fc-ba42-4e14a0445cd8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:08.156550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a189cf5a-9d5f-44fc-ba42-4e14a0445cd8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:08.897612 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a4c2e697-764e-430e-beab-9968eb04d832 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:08.929880 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a4c2e697-764e-430e-beab-9968eb04d832 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa" status: 200 len: 1241 microversion: 2.1 time: 1.254087 Jul 19 22:53:08.934172 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2488/4969] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:53:07 2022] GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa => generated 1241 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:53:08.949460 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-13b2eadb-f164-4741-8a47-639385590171 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:08.951035 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-13b2eadb-f164-4741-8a47-639385590171 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:08.964992 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13b2eadb-f164-4741-8a47-639385590171 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:08.965858 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13b2eadb-f164-4741-8a47-639385590171 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:08.968356 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13b2eadb-f164-4741-8a47-639385590171 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:08.968853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13b2eadb-f164-4741-8a47-639385590171 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:09.469754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-13b2eadb-f164-4741-8a47-639385590171 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:09.496533 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-13b2eadb-f164-4741-8a47-639385590171 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:09.500909 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-13b2eadb-f164-4741-8a47-639385590171 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:09.504060 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-13b2eadb-f164-4741-8a47-639385590171 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1339 microversion: 2.20 time: 0.562986 Jul 19 22:53:09.518446 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2489/4970] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:53:08 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1339 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:53:09.528426 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-222f571d-3603-4bf9-8173-ce3c5a256685 req-4155e981-a7fa-4809-9dee-a48fcddaf5ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4c1ba16-fff7-480d-9af7-731cc40f338b", "name": "network-vif-deleted", "tag": "98a6d1ad-0bbd-48ee-9c7c-81eec448b034"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:53:09.551675 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-222f571d-3603-4bf9-8173-ce3c5a256685 req-4155e981-a7fa-4809-9dee-a48fcddaf5ae service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:09.552135 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-222f571d-3603-4bf9-8173-ce3c5a256685 req-4155e981-a7fa-4809-9dee-a48fcddaf5ae service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:09.579361 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-222f571d-3603-4bf9-8173-ce3c5a256685 req-4155e981-a7fa-4809-9dee-a48fcddaf5ae service nova] Creating event network-vif-deleted:98a6d1ad-0bbd-48ee-9c7c-81eec448b034 for instance d4c1ba16-fff7-480d-9af7-731cc40f338b on n-h1-847009-3 Jul 19 22:53:09.594894 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-222f571d-3603-4bf9-8173-ce3c5a256685 req-4155e981-a7fa-4809-9dee-a48fcddaf5ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069940 Jul 19 22:53:09.595591 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2490/4971] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:53:09.616238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a189cf5a-9d5f-44fc-ba42-4e14a0445cd8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:09.651033 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a189cf5a-9d5f-44fc-ba42-4e14a0445cd8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 200 len: 1689 microversion: 2.1 time: 1.521222 Jul 19 22:53:09.651989 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2482/4972] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:53:08 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 1689 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:53:09.955726 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-18922ace-f130-4f81-a429-45da8efed663 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:09.967852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-18922ace-f130-4f81-a429-45da8efed663 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9cb08864-7c20-44cc-9f73-87f0da61e0aa] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:10.004675 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-18922ace-f130-4f81-a429-45da8efed663 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:10.005381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-18922ace-f130-4f81-a429-45da8efed663 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:10.006997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-18922ace-f130-4f81-a429-45da8efed663 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:10.009023 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-18922ace-f130-4f81-a429-45da8efed663 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:10.360973 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-18922ace-f130-4f81-a429-45da8efed663 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:10.377023 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-18922ace-f130-4f81-a429-45da8efed663 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa" status: 200 len: 1293 microversion: 2.1 time: 0.422342 Jul 19 22:53:10.378426 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2491/4973] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:53:09 2022] GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa => generated 1293 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:53:10.522629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-488ed737-7c96-4781-a979-25376ecb59c8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:10.524374 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-488ed737-7c96-4781-a979-25376ecb59c8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:10.546687 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-488ed737-7c96-4781-a979-25376ecb59c8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:10.547475 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-488ed737-7c96-4781-a979-25376ecb59c8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:10.549535 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-488ed737-7c96-4781-a979-25376ecb59c8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:10.552619 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-488ed737-7c96-4781-a979-25376ecb59c8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:10.671824 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-43036d9e-f6d1-4736-9e26-fa5b28976047 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:10.672493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-43036d9e-f6d1-4736-9e26-fa5b28976047 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: d4c1ba16-fff7-480d-9af7-731cc40f338b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:10.686151 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-43036d9e-f6d1-4736-9e26-fa5b28976047 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:10.686672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-43036d9e-f6d1-4736-9e26-fa5b28976047 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:10.687641 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-43036d9e-f6d1-4736-9e26-fa5b28976047 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:10.688109 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-43036d9e-f6d1-4736-9e26-fa5b28976047 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:10.739023 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-43036d9e-f6d1-4736-9e26-fa5b28976047 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] HTTP exception thrown: Instance d4c1ba16-fff7-480d-9af7-731cc40f338b could not be found. Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-43036d9e-f6d1-4736-9e26-fa5b28976047 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Request method failure captured: Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b HTTP/1.1 Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zUdF3dTnB0MnLNSU90xG3Mpx7x6_lVTVWk_kalEUBRonF6TVdUymuHFpNlc_2myDjPcJPfG0PGHn_BgqvSGWVp3Gv6a0lkSSx5re0O2646fcLC_MOcllI85X5Gsa3U5ByfiHlS7DUHyk3xHJ5Y4v938fzhiDGHEEqMMUHs8ls1DEl4 Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 4b56c5370d5846f8a8c1535c127c0e12 Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1194986010 Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b56c5370d5846f8a8c1535c127c0e12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b56c5370d5846f8a8c1535c127c0e12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b56c5370d5846f8a8c1535c127c0e12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b56c5370d5846f8a8c1535c127c0e12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1194986010 Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 4b56c5370d5846f8a8c1535c127c0e12 Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1194986010 Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-TestNetworkAdvancedServerOps-1194986010-project Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: dcfdbbdf932b43b38725f60dadc738c9 Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1194986010-project Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance d4c1ba16-fff7-480d-9af7-731cc40f338b could not be found. Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'd4c1ba16-fff7-480d-9af7-731cc40f338b'} Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4c1ba16-fff7-480d-9af7-731cc40f338b could not be found. Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4c1ba16-fff7-480d-9af7-731cc40f338b could not be found. Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:53:10.740914 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:53:10.746645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:53:10.746645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:53:10.746645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:53:10.746645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:53:10.746645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:53:10.746645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:53:10.746645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4c1ba16-fff7-480d-9af7-731cc40f338b could not be found. Jul 19 22:53:10.746645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:53:10.749572 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-488ed737-7c96-4781-a979-25376ecb59c8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:10.750451 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-43036d9e-f6d1-4736-9e26-fa5b28976047 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Returning 404 to user: Instance d4c1ba16-fff7-480d-9af7-731cc40f338b could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:53:10.753692 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-43036d9e-f6d1-4736-9e26-fa5b28976047 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b" status: 404 len: 111 microversion: 2.1 time: 0.087112 Jul 19 22:53:10.755758 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2492/4974] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:53:10 2022] GET /compute/v2.1/servers/d4c1ba16-fff7-480d-9af7-731cc40f338b => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:53:10.770787 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-488ed737-7c96-4781-a979-25376ecb59c8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:10.772697 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-488ed737-7c96-4781-a979-25376ecb59c8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:10.776193 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-488ed737-7c96-4781-a979-25376ecb59c8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1339 microversion: 2.20 time: 0.255948 Jul 19 22:53:10.792102 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2483/4975] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:53:10 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1339 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:53:11.397549 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6266a673-b3f4-47e3-b2c0-b9ab867fafb3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:11.411812 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6266a673-b3f4-47e3-b2c0-b9ab867fafb3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9cb08864-7c20-44cc-9f73-87f0da61e0aa] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:11.432122 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6266a673-b3f4-47e3-b2c0-b9ab867fafb3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:11.435006 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6266a673-b3f4-47e3-b2c0-b9ab867fafb3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:11.438116 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6266a673-b3f4-47e3-b2c0-b9ab867fafb3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:11.441627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6266a673-b3f4-47e3-b2c0-b9ab867fafb3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:11.638221 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6266a673-b3f4-47e3-b2c0-b9ab867fafb3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:11.650335 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6266a673-b3f4-47e3-b2c0-b9ab867fafb3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa" status: 200 len: 1299 microversion: 2.1 time: 0.257824 Jul 19 22:53:11.650933 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2493/4976] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:53:11 2022] GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa => generated 1299 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:53:11.797946 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8f9c8208-19b6-4a89-be9b-b318703169be tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:11.799361 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8f9c8208-19b6-4a89-be9b-b318703169be tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:11.811786 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8f9c8208-19b6-4a89-be9b-b318703169be tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:11.813269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8f9c8208-19b6-4a89-be9b-b318703169be tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:11.814303 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8f9c8208-19b6-4a89-be9b-b318703169be tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:11.815315 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8f9c8208-19b6-4a89-be9b-b318703169be tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:12.663273 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8f9c8208-19b6-4a89-be9b-b318703169be tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:12.668800 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3c2a2cc3-f810-4af3-bc5e-3b79b93ef07a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:12.669312 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3c2a2cc3-f810-4af3-bc5e-3b79b93ef07a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9cb08864-7c20-44cc-9f73-87f0da61e0aa] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:12.672873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8f9c8208-19b6-4a89-be9b-b318703169be tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:12.683163 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c2a2cc3-f810-4af3-bc5e-3b79b93ef07a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:12.685132 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c2a2cc3-f810-4af3-bc5e-3b79b93ef07a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:12.685661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8f9c8208-19b6-4a89-be9b-b318703169be tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:12.687176 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c2a2cc3-f810-4af3-bc5e-3b79b93ef07a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:12.687327 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8f9c8208-19b6-4a89-be9b-b318703169be tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1407 microversion: 2.20 time: 0.895272 Jul 19 22:53:12.688417 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2484/4977] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:53:11 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1407 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:53:12.689505 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c2a2cc3-f810-4af3-bc5e-3b79b93ef07a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:12.930387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3c2a2cc3-f810-4af3-bc5e-3b79b93ef07a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:12.943444 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3c2a2cc3-f810-4af3-bc5e-3b79b93ef07a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa" status: 200 len: 1299 microversion: 2.1 time: 0.279470 Jul 19 22:53:12.944864 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2494/4978] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:53:12 2022] GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa => generated 1299 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:53:13.706886 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ca659492-b544-4978-ba6b-d973ca2be1f6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:13.707689 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ca659492-b544-4978-ba6b-d973ca2be1f6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:13.720049 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca659492-b544-4978-ba6b-d973ca2be1f6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:13.720899 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca659492-b544-4978-ba6b-d973ca2be1f6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:13.723095 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca659492-b544-4978-ba6b-d973ca2be1f6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:13.723767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca659492-b544-4978-ba6b-d973ca2be1f6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:13.962289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f232c938-1812-4fd1-8ca7-f24412388df5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:13.962922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f232c938-1812-4fd1-8ca7-f24412388df5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9cb08864-7c20-44cc-9f73-87f0da61e0aa] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:13.976075 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f232c938-1812-4fd1-8ca7-f24412388df5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:13.978547 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f232c938-1812-4fd1-8ca7-f24412388df5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:13.979716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f232c938-1812-4fd1-8ca7-f24412388df5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:13.985154 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f232c938-1812-4fd1-8ca7-f24412388df5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:14.377855 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ca659492-b544-4978-ba6b-d973ca2be1f6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:14.389537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ca659492-b544-4978-ba6b-d973ca2be1f6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:14.401325 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ca659492-b544-4978-ba6b-d973ca2be1f6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:14.402809 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ca659492-b544-4978-ba6b-d973ca2be1f6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1407 microversion: 2.20 time: 0.700901 Jul 19 22:53:14.403932 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2485/4979] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:53:13 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1407 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:53:14.947536 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f232c938-1812-4fd1-8ca7-f24412388df5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:14.961462 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f232c938-1812-4fd1-8ca7-f24412388df5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa" status: 200 len: 1366 microversion: 2.1 time: 1.002805 Jul 19 22:53:14.966252 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2495/4980] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:53:13 2022] GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa => generated 1366 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:53:15.425173 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-778209de-2231-4cc7-b686-906a9b3a6f8b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:15.426904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-778209de-2231-4cc7-b686-906a9b3a6f8b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:15.455058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-778209de-2231-4cc7-b686-906a9b3a6f8b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:15.456233 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-778209de-2231-4cc7-b686-906a9b3a6f8b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:15.457373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-778209de-2231-4cc7-b686-906a9b3a6f8b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:15.458464 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-778209de-2231-4cc7-b686-906a9b3a6f8b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:15.982507 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b5cc55d9-c6ad-4e1b-9d2b-601ba6942248 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:15.983155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b5cc55d9-c6ad-4e1b-9d2b-601ba6942248 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9cb08864-7c20-44cc-9f73-87f0da61e0aa] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:16.004368 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b5cc55d9-c6ad-4e1b-9d2b-601ba6942248 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:16.004814 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b5cc55d9-c6ad-4e1b-9d2b-601ba6942248 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:16.005788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b5cc55d9-c6ad-4e1b-9d2b-601ba6942248 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:16.006229 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b5cc55d9-c6ad-4e1b-9d2b-601ba6942248 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:17.432770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:53:17.494480 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=20 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:53:17.738431 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-778209de-2231-4cc7-b686-906a9b3a6f8b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:17.759367 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-778209de-2231-4cc7-b686-906a9b3a6f8b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:17.771418 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-778209de-2231-4cc7-b686-906a9b3a6f8b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:17.775669 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-778209de-2231-4cc7-b686-906a9b3a6f8b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1407 microversion: 2.20 time: 2.356374 Jul 19 22:53:17.788509 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2486/4981] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:53:15 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1407 bytes in 2371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:53:17.808656 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-f6d83242-0832-4355-96eb-41f836c9e3e5 req-ff551728-9961-4b70-8e32-c98cdfc212da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d98192d-dabe-4541-b7c6-c057e4269d64", "tag": "06c1d4f8-d555-478d-9923-73caa8771882"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:53:17.837682 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f6d83242-0832-4355-96eb-41f836c9e3e5 req-ff551728-9961-4b70-8e32-c98cdfc212da service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:17.838438 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f6d83242-0832-4355-96eb-41f836c9e3e5 req-ff551728-9961-4b70-8e32-c98cdfc212da service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:17.864676 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-f6d83242-0832-4355-96eb-41f836c9e3e5 req-ff551728-9961-4b70-8e32-c98cdfc212da service nova] Creating event network-changed:06c1d4f8-d555-478d-9923-73caa8771882 for instance 4d98192d-dabe-4541-b7c6-c057e4269d64 on n-h1-847009-3 Jul 19 22:53:17.890636 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-f6d83242-0832-4355-96eb-41f836c9e3e5 req-ff551728-9961-4b70-8e32-c98cdfc212da service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099068 Jul 19 22:53:17.892221 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2487/4982] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:53:17.900627 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-3cdb0f34-7769-44a2-86de-417989fd5942 req-e5cc0800-b00f-4aa4-a6e0-2693cb9094c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cb08864-7c20-44cc-9f73-87f0da61e0aa", "tag": "3476ca29-7018-4113-b6b0-fbcfe6959346"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:53:17.928476 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-3cdb0f34-7769-44a2-86de-417989fd5942 req-e5cc0800-b00f-4aa4-a6e0-2693cb9094c2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:17.931557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-3cdb0f34-7769-44a2-86de-417989fd5942 req-e5cc0800-b00f-4aa4-a6e0-2693cb9094c2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:17.958441 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-3cdb0f34-7769-44a2-86de-417989fd5942 req-e5cc0800-b00f-4aa4-a6e0-2693cb9094c2 service nova] Creating event network-changed:3476ca29-7018-4113-b6b0-fbcfe6959346 for instance 9cb08864-7c20-44cc-9f73-87f0da61e0aa on n-h2-847009-3 Jul 19 22:53:17.969956 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-3cdb0f34-7769-44a2-86de-417989fd5942 req-e5cc0800-b00f-4aa4-a6e0-2693cb9094c2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074408 Jul 19 22:53:17.972625 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2488/4983] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:53:18.276493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b5cc55d9-c6ad-4e1b-9d2b-601ba6942248 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:18.289773 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b5cc55d9-c6ad-4e1b-9d2b-601ba6942248 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa" status: 200 len: 1366 microversion: 2.1 time: 2.310030 Jul 19 22:53:18.291616 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2496/4984] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:53:15 2022] GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa => generated 1366 bytes in 2314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:53:18.817425 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fd718007-771c-441e-8578-cad68ee03483 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:18.818156 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fd718007-771c-441e-8578-cad68ee03483 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:18.841038 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd718007-771c-441e-8578-cad68ee03483 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:18.844534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd718007-771c-441e-8578-cad68ee03483 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:18.847679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd718007-771c-441e-8578-cad68ee03483 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:18.850622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd718007-771c-441e-8578-cad68ee03483 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:19.308132 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d7d6173e-82a2-4981-afd0-7d33387b7f59 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:19.308823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d7d6173e-82a2-4981-afd0-7d33387b7f59 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9cb08864-7c20-44cc-9f73-87f0da61e0aa] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:19.315127 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=4 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:53:19.320743 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d7d6173e-82a2-4981-afd0-7d33387b7f59 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:19.323101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d7d6173e-82a2-4981-afd0-7d33387b7f59 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:19.325010 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d7d6173e-82a2-4981-afd0-7d33387b7f59 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:19.330269 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d7d6173e-82a2-4981-afd0-7d33387b7f59 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:20.560975 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fd718007-771c-441e-8578-cad68ee03483 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:20.578586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fd718007-771c-441e-8578-cad68ee03483 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:20.585796 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fd718007-771c-441e-8578-cad68ee03483 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:20.590733 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fd718007-771c-441e-8578-cad68ee03483 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1407 microversion: 2.20 time: 1.787009 Jul 19 22:53:20.595927 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2489/4985] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:53:18 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1407 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:53:20.858878 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d7d6173e-82a2-4981-afd0-7d33387b7f59 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:20.878561 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d7d6173e-82a2-4981-afd0-7d33387b7f59 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa" status: 200 len: 1366 microversion: 2.1 time: 1.564070 Jul 19 22:53:20.879673 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2497/4986] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:53:19 2022] GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa => generated 1366 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:53:21.616829 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1013fd3e-b2de-4909-a16a-74829c1b04bf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:21.619035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1013fd3e-b2de-4909-a16a-74829c1b04bf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:21.623726 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=8 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:53:21.658483 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1013fd3e-b2de-4909-a16a-74829c1b04bf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:21.660072 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1013fd3e-b2de-4909-a16a-74829c1b04bf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:21.661613 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1013fd3e-b2de-4909-a16a-74829c1b04bf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:21.662474 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1013fd3e-b2de-4909-a16a-74829c1b04bf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:21.898677 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b7973a39-5718-4b0b-a586-cd9267247b14 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:21.900056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b7973a39-5718-4b0b-a586-cd9267247b14 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9cb08864-7c20-44cc-9f73-87f0da61e0aa] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:21.916694 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:53:21.923327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7973a39-5718-4b0b-a586-cd9267247b14 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:21.925739 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7973a39-5718-4b0b-a586-cd9267247b14 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:21.927623 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7973a39-5718-4b0b-a586-cd9267247b14 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:21.930732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7973a39-5718-4b0b-a586-cd9267247b14 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:21.960778 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:53:22.291482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1013fd3e-b2de-4909-a16a-74829c1b04bf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:22.315897 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1013fd3e-b2de-4909-a16a-74829c1b04bf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:22.323768 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1013fd3e-b2de-4909-a16a-74829c1b04bf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:22.327639 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1013fd3e-b2de-4909-a16a-74829c1b04bf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1407 microversion: 2.20 time: 0.716031 Jul 19 22:53:22.329701 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2490/4987] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:53:21 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1407 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:53:22.550421 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b7973a39-5718-4b0b-a586-cd9267247b14 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:22.564826 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b7973a39-5718-4b0b-a586-cd9267247b14 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa" status: 200 len: 1366 microversion: 2.1 time: 0.672423 Jul 19 22:53:22.566118 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2498/4988] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:53:21 2022] GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa => generated 1366 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:53:23.348341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-082fda0d-a859-42c0-b016-088158c4a9ac tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:23.349116 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-082fda0d-a859-42c0-b016-088158c4a9ac tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:23.362020 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-082fda0d-a859-42c0-b016-088158c4a9ac tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:23.366300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-082fda0d-a859-42c0-b016-088158c4a9ac tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:23.368036 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-082fda0d-a859-42c0-b016-088158c4a9ac tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:23.373468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-082fda0d-a859-42c0-b016-088158c4a9ac tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:23.583088 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f5fad609-548b-44ad-97a6-34e084460fa9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:23.584445 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f5fad609-548b-44ad-97a6-34e084460fa9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9cb08864-7c20-44cc-9f73-87f0da61e0aa] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:23.598969 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f5fad609-548b-44ad-97a6-34e084460fa9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:23.599607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f5fad609-548b-44ad-97a6-34e084460fa9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:23.600458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f5fad609-548b-44ad-97a6-34e084460fa9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:23.600916 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f5fad609-548b-44ad-97a6-34e084460fa9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:24.653580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-082fda0d-a859-42c0-b016-088158c4a9ac tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:24.674993 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-082fda0d-a859-42c0-b016-088158c4a9ac tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:24.682951 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-082fda0d-a859-42c0-b016-088158c4a9ac tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:24.686161 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-082fda0d-a859-42c0-b016-088158c4a9ac tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1407 microversion: 2.20 time: 1.341394 Jul 19 22:53:24.689835 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2491/4989] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:53:23 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1407 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:53:24.988846 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f5fad609-548b-44ad-97a6-34e084460fa9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:24.999454 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f5fad609-548b-44ad-97a6-34e084460fa9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa" status: 200 len: 1366 microversion: 2.1 time: 1.420349 Jul 19 22:53:25.012646 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2499/4990] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:53:23 2022] GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa => generated 1366 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:53:25.709045 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2349effb-b7dc-45ec-a2d5-641f0a1cd56e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:25.709666 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2349effb-b7dc-45ec-a2d5-641f0a1cd56e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:25.734047 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2349effb-b7dc-45ec-a2d5-641f0a1cd56e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:25.741183 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2349effb-b7dc-45ec-a2d5-641f0a1cd56e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:25.745672 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2349effb-b7dc-45ec-a2d5-641f0a1cd56e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:25.746342 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2349effb-b7dc-45ec-a2d5-641f0a1cd56e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:26.017633 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d15773f8-c500-45ad-b124-d4f147742fa7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:26.018259 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d15773f8-c500-45ad-b124-d4f147742fa7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9cb08864-7c20-44cc-9f73-87f0da61e0aa] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:26.033943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d15773f8-c500-45ad-b124-d4f147742fa7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:26.034815 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d15773f8-c500-45ad-b124-d4f147742fa7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:26.036106 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d15773f8-c500-45ad-b124-d4f147742fa7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:26.036777 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d15773f8-c500-45ad-b124-d4f147742fa7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:26.360929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d15773f8-c500-45ad-b124-d4f147742fa7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:26.369994 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d15773f8-c500-45ad-b124-d4f147742fa7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa" status: 200 len: 1366 microversion: 2.1 time: 0.356143 Jul 19 22:53:26.370588 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2500/4991] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:53:26 2022] GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa => generated 1366 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:53:26.378887 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2349effb-b7dc-45ec-a2d5-641f0a1cd56e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:26.403000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2349effb-b7dc-45ec-a2d5-641f0a1cd56e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:26.407574 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2349effb-b7dc-45ec-a2d5-641f0a1cd56e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:26.409050 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2349effb-b7dc-45ec-a2d5-641f0a1cd56e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1407 microversion: 2.20 time: 0.704695 Jul 19 22:53:26.417337 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2492/4992] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:53:25 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1407 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:53:27.374800 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-6951715d-9799-4e15-9002-9ed07385ba0d req-dac61ccc-533b-4e6b-9c5c-8bf96f95e6df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d98192d-dabe-4541-b7c6-c057e4269d64", "name": "network-vif-plugged", "status": "completed", "tag": "06c1d4f8-d555-478d-9923-73caa8771882"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:53:27.400705 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-089515db-23d5-416e-883e-1f6e7166a0d7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:27.401860 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-6951715d-9799-4e15-9002-9ed07385ba0d req-dac61ccc-533b-4e6b-9c5c-8bf96f95e6df service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:27.402313 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-6951715d-9799-4e15-9002-9ed07385ba0d req-dac61ccc-533b-4e6b-9c5c-8bf96f95e6df service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:27.404494 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-089515db-23d5-416e-883e-1f6e7166a0d7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9cb08864-7c20-44cc-9f73-87f0da61e0aa] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:27.422185 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-089515db-23d5-416e-883e-1f6e7166a0d7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:27.425005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-089515db-23d5-416e-883e-1f6e7166a0d7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:27.427656 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-089515db-23d5-416e-883e-1f6e7166a0d7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:27.430718 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-089515db-23d5-416e-883e-1f6e7166a0d7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:27.444594 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-6951715d-9799-4e15-9002-9ed07385ba0d req-dac61ccc-533b-4e6b-9c5c-8bf96f95e6df service nova] Creating event network-vif-plugged:06c1d4f8-d555-478d-9923-73caa8771882 for instance 4d98192d-dabe-4541-b7c6-c057e4269d64 on n-h1-847009-3 Jul 19 22:53:27.456876 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-6951715d-9799-4e15-9002-9ed07385ba0d req-dac61ccc-533b-4e6b-9c5c-8bf96f95e6df service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087724 Jul 19 22:53:27.459487 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2501/4993] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:53:27.472532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-24ffad14-cfe9-4d5d-a76f-a78d925d3c98 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:27.476103 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-24ffad14-cfe9-4d5d-a76f-a78d925d3c98 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:27.493153 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-24ffad14-cfe9-4d5d-a76f-a78d925d3c98 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:27.495249 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-24ffad14-cfe9-4d5d-a76f-a78d925d3c98 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:27.496337 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-24ffad14-cfe9-4d5d-a76f-a78d925d3c98 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:27.502157 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-24ffad14-cfe9-4d5d-a76f-a78d925d3c98 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:28.232121 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-089515db-23d5-416e-883e-1f6e7166a0d7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:28.238589 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-24ffad14-cfe9-4d5d-a76f-a78d925d3c98 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:28.240782 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-089515db-23d5-416e-883e-1f6e7166a0d7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa" status: 200 len: 1366 microversion: 2.1 time: 0.857180 Jul 19 22:53:28.246733 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2493/4994] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:53:27 2022] GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa => generated 1366 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:53:28.248241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-24ffad14-cfe9-4d5d-a76f-a78d925d3c98 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:28.249757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-24ffad14-cfe9-4d5d-a76f-a78d925d3c98 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:28.250887 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-24ffad14-cfe9-4d5d-a76f-a78d925d3c98 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1407 microversion: 2.20 time: 0.790021 Jul 19 22:53:28.259158 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2502/4995] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:53:27 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1407 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:53:28.261136 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-efccdbed-9bff-4210-8748-e337b0439b87 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '.version_select at 0x7f7a031c5e50>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:28.320926 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-efccdbed-9bff-4210-8748-e337b0439b87 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-487307538" status: 202 len: 0 microversion: 2.1 time: 0.072402 Jul 19 22:53:28.322198 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2494/4996] 10.222.0.25 () {58 vars in 1280 bytes} [Tue Jul 19 22:53:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-487307538 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:53:28.355873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-035b628f-f13e-405a-b218-84f0ba902567 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Action: 'create', calling method: .version_select at 0x7f7a103f7670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1495931574", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGEaDcVbjqAifnTk0v7yrTHtMwGW+xQBGFfXe5Uu4bcIxptYM5H7jh8sEmccn/y4GtoKyh6YaOusObY5yc0VJKMMoxWe/gu8F7z79qR1CGDyBOXVfM22yNDmDcbz4a3bw=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:53:28.395468 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-035b628f-f13e-405a-b218-84f0ba902567 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Getting quotas for project 4b56c5370d5846f8a8c1535c127c0e12. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:53:28.402857 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-035b628f-f13e-405a-b218-84f0ba902567 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Getting quotas for user dcfdbbdf932b43b38725f60dadc738c9 and project 4b56c5370d5846f8a8c1535c127c0e12. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:53:28.476167 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-035b628f-f13e-405a-b218-84f0ba902567 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.124096 Jul 19 22:53:28.477535 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2503/4997] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:53:28 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:53:29.260314 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-522a4eeb-05d6-46b1-9a32-a93bf6280ec3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:29.261703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-522a4eeb-05d6-46b1-9a32-a93bf6280ec3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9cb08864-7c20-44cc-9f73-87f0da61e0aa] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:29.279982 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-16aff05c-556c-4380-9c06-68f5aa7b4097 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:29.281052 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-16aff05c-556c-4380-9c06-68f5aa7b4097 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:29.306611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-522a4eeb-05d6-46b1-9a32-a93bf6280ec3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:29.309190 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-522a4eeb-05d6-46b1-9a32-a93bf6280ec3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:29.310410 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-522a4eeb-05d6-46b1-9a32-a93bf6280ec3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:29.312993 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-522a4eeb-05d6-46b1-9a32-a93bf6280ec3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:29.313987 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-16aff05c-556c-4380-9c06-68f5aa7b4097 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:29.314763 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-16aff05c-556c-4380-9c06-68f5aa7b4097 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:29.319979 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-16aff05c-556c-4380-9c06-68f5aa7b4097 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:29.325759 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-16aff05c-556c-4380-9c06-68f5aa7b4097 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:30.503423 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-522a4eeb-05d6-46b1-9a32-a93bf6280ec3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:30.505882 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=73 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:53:30.513380 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-522a4eeb-05d6-46b1-9a32-a93bf6280ec3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa" status: 200 len: 1366 microversion: 2.1 time: 1.258893 Jul 19 22:53:30.518958 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2495/4998] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:53:29 2022] GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa => generated 1366 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:53:30.530345 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-f644b755-f952-46da-aa06-da282f81147f req-ef305917-1fa9-4f8f-966e-bb87a3af2408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cb08864-7c20-44cc-9f73-87f0da61e0aa", "name": "network-vif-plugged", "status": "completed", "tag": "3476ca29-7018-4113-b6b0-fbcfe6959346"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:53:30.557975 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f644b755-f952-46da-aa06-da282f81147f req-ef305917-1fa9-4f8f-966e-bb87a3af2408 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:30.558675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f644b755-f952-46da-aa06-da282f81147f req-ef305917-1fa9-4f8f-966e-bb87a3af2408 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:30.560164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-16aff05c-556c-4380-9c06-68f5aa7b4097 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:30.578040 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-16aff05c-556c-4380-9c06-68f5aa7b4097 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:30.581499 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-f644b755-f952-46da-aa06-da282f81147f req-ef305917-1fa9-4f8f-966e-bb87a3af2408 service nova] Creating event network-vif-plugged:3476ca29-7018-4113-b6b0-fbcfe6959346 for instance 9cb08864-7c20-44cc-9f73-87f0da61e0aa on n-h2-847009-3 Jul 19 22:53:30.581870 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-16aff05c-556c-4380-9c06-68f5aa7b4097 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:30.588239 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-16aff05c-556c-4380-9c06-68f5aa7b4097 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1407 microversion: 2.20 time: 1.313339 Jul 19 22:53:30.589459 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2504/4999] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:53:29 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1407 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:53:30.595795 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-f644b755-f952-46da-aa06-da282f81147f req-ef305917-1fa9-4f8f-966e-bb87a3af2408 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073684 Jul 19 22:53:30.596959 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2496/5000] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:53:31.536228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ec3ed85b-ab01-4c85-a9fc-3d324bbb738c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:31.537165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ec3ed85b-ab01-4c85-a9fc-3d324bbb738c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9cb08864-7c20-44cc-9f73-87f0da61e0aa] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:31.545120 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ec3ed85b-ab01-4c85-a9fc-3d324bbb738c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:31.545994 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ec3ed85b-ab01-4c85-a9fc-3d324bbb738c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:31.547246 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ec3ed85b-ab01-4c85-a9fc-3d324bbb738c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:31.547907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ec3ed85b-ab01-4c85-a9fc-3d324bbb738c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:31.614970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1d17f2b1-04aa-42b0-a0ea-f583182802bc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:31.618319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1d17f2b1-04aa-42b0-a0ea-f583182802bc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:31.626526 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d17f2b1-04aa-42b0-a0ea-f583182802bc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:31.627490 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d17f2b1-04aa-42b0-a0ea-f583182802bc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:31.628954 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d17f2b1-04aa-42b0-a0ea-f583182802bc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:31.629695 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d17f2b1-04aa-42b0-a0ea-f583182802bc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:31.984174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ec3ed85b-ab01-4c85-a9fc-3d324bbb738c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:31.995376 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ec3ed85b-ab01-4c85-a9fc-3d324bbb738c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa" status: 200 len: 1366 microversion: 2.1 time: 0.463378 Jul 19 22:53:31.996784 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2505/5001] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:53:31 2022] GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa => generated 1366 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:53:32.233881 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1d17f2b1-04aa-42b0-a0ea-f583182802bc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:32.277919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1d17f2b1-04aa-42b0-a0ea-f583182802bc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:32.294561 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1d17f2b1-04aa-42b0-a0ea-f583182802bc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:32.296740 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1d17f2b1-04aa-42b0-a0ea-f583182802bc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1598 microversion: 2.20 time: 0.693202 Jul 19 22:53:32.297829 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2497/5002] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:53:31 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1598 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:53:32.334309 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c2f7b07d-3ddf-44b5-a981-2645eba28319 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:32.335251 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c2f7b07d-3ddf-44b5-a981-2645eba28319 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:32.347595 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c2f7b07d-3ddf-44b5-a981-2645eba28319 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:32.348409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c2f7b07d-3ddf-44b5-a981-2645eba28319 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:32.349895 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c2f7b07d-3ddf-44b5-a981-2645eba28319 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:32.350705 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c2f7b07d-3ddf-44b5-a981-2645eba28319 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:32.540399 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c2f7b07d-3ddf-44b5-a981-2645eba28319 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.214923 Jul 19 22:53:32.541133 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2506/5003] 10.222.0.25 () {60 vars in 1315 bytes} [Tue Jul 19 22:53:32 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/os-interface => generated 284 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:53:33.014461 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bb23ebef-e501-4e98-8e45-16f224e8bfa7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:33.015285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bb23ebef-e501-4e98-8e45-16f224e8bfa7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9cb08864-7c20-44cc-9f73-87f0da61e0aa] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:33.027886 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bb23ebef-e501-4e98-8e45-16f224e8bfa7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:33.032423 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bb23ebef-e501-4e98-8e45-16f224e8bfa7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:33.035342 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bb23ebef-e501-4e98-8e45-16f224e8bfa7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:33.036440 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bb23ebef-e501-4e98-8e45-16f224e8bfa7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:33.796259 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bb23ebef-e501-4e98-8e45-16f224e8bfa7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:33.807056 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bb23ebef-e501-4e98-8e45-16f224e8bfa7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa" status: 200 len: 1555 microversion: 2.1 time: 0.797820 Jul 19 22:53:33.813727 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2498/5004] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:53:33 2022] GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa => generated 1555 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:53:33.832805 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5d46dd15-7d6f-4b03-97e8-791ec0660657 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:33.834814 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5d46dd15-7d6f-4b03-97e8-791ec0660657 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9cb08864-7c20-44cc-9f73-87f0da61e0aa] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:33.845099 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5d46dd15-7d6f-4b03-97e8-791ec0660657 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:33.850348 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5d46dd15-7d6f-4b03-97e8-791ec0660657 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:33.851609 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5d46dd15-7d6f-4b03-97e8-791ec0660657 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:33.852381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5d46dd15-7d6f-4b03-97e8-791ec0660657 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:34.528415 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5d46dd15-7d6f-4b03-97e8-791ec0660657 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.698410 Jul 19 22:53:34.530845 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2507/5005] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 19 22:53:33 2022] GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa/os-interface => generated 284 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:53:36.568160 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-14883dd8-78f2-44ff-8e70-a79464570de6 req-1e47d2cb-d5b2-4dcd-a0c6-ea37e1cb6343 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d98192d-dabe-4541-b7c6-c057e4269d64", "tag": "06c1d4f8-d555-478d-9923-73caa8771882"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:53:36.606372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-14883dd8-78f2-44ff-8e70-a79464570de6 req-1e47d2cb-d5b2-4dcd-a0c6-ea37e1cb6343 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:36.606831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-14883dd8-78f2-44ff-8e70-a79464570de6 req-1e47d2cb-d5b2-4dcd-a0c6-ea37e1cb6343 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:36.696696 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-14883dd8-78f2-44ff-8e70-a79464570de6 req-1e47d2cb-d5b2-4dcd-a0c6-ea37e1cb6343 service nova] Creating event network-changed:06c1d4f8-d555-478d-9923-73caa8771882 for instance 4d98192d-dabe-4541-b7c6-c057e4269d64 on n-h1-847009-3 Jul 19 22:53:36.721137 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-14883dd8-78f2-44ff-8e70-a79464570de6 req-1e47d2cb-d5b2-4dcd-a0c6-ea37e1cb6343 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155684 Jul 19 22:53:36.722547 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2499/5006] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:53:39.528121 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=4 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:53:39.533937 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-401b43a7-d26c-407c-adba-0e9e5db4cb8c req-6af1b504-db04-4791-bf3e-074091d2a491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cb08864-7c20-44cc-9f73-87f0da61e0aa", "tag": "3476ca29-7018-4113-b6b0-fbcfe6959346"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:53:39.557125 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-401b43a7-d26c-407c-adba-0e9e5db4cb8c req-6af1b504-db04-4791-bf3e-074091d2a491 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:39.565875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-401b43a7-d26c-407c-adba-0e9e5db4cb8c req-6af1b504-db04-4791-bf3e-074091d2a491 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:39.595302 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-401b43a7-d26c-407c-adba-0e9e5db4cb8c req-6af1b504-db04-4791-bf3e-074091d2a491 service nova] Creating event network-changed:3476ca29-7018-4113-b6b0-fbcfe6959346 for instance 9cb08864-7c20-44cc-9f73-87f0da61e0aa on n-h2-847009-3 Jul 19 22:53:39.607471 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-401b43a7-d26c-407c-adba-0e9e5db4cb8c req-6af1b504-db04-4791-bf3e-074091d2a491 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081640 Jul 19 22:53:39.608951 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2508/5007] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:53:54.549289 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:53:54.550222 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=17 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:53:54.557879 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9d5abd10-10c6-469f-b985-4ed20686b4e6 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-393794688", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "efcd9438-e930-43c2-8b9a-73bcf5d6a6c5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1495931574", "security_groups": [{"name": "tempest-secgroup-smoke-1322278064"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:53:54.855083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-9d5abd10-10c6-469f-b985-4ed20686b4e6 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] validate_networks() for [('efcd9438-e930-43c2-8b9a-73bcf5d6a6c5', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:53:56.703971 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-9d5abd10-10c6-469f-b985-4ed20686b4e6 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:53:56.704553 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-9d5abd10-10c6-469f-b985-4ed20686b4e6 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:53:56.704745 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-9d5abd10-10c6-469f-b985-4ed20686b4e6 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:53:56.705456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-9d5abd10-10c6-469f-b985-4ed20686b4e6 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:53:56.706108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-9d5abd10-10c6-469f-b985-4ed20686b4e6 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:53:56.734290 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d5abd10-10c6-469f-b985-4ed20686b4e6 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:56.735909 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d5abd10-10c6-469f-b985-4ed20686b4e6 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:56.740311 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d5abd10-10c6-469f-b985-4ed20686b4e6 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:56.742833 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d5abd10-10c6-469f-b985-4ed20686b4e6 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:56.823390 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-9d5abd10-10c6-469f-b985-4ed20686b4e6 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Getting quotas for project 4b56c5370d5846f8a8c1535c127c0e12. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:53:56.839526 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-9d5abd10-10c6-469f-b985-4ed20686b4e6 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Getting quotas for user dcfdbbdf932b43b38725f60dadc738c9 and project 4b56c5370d5846f8a8c1535c127c0e12. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:53:56.872493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9d5abd10-10c6-469f-b985-4ed20686b4e6 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:53:56.876792 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9d5abd10-10c6-469f-b985-4ed20686b4e6 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:53:56.989965 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9d5abd10-10c6-469f-b985-4ed20686b4e6 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.442707 Jul 19 22:53:56.990636 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2500/5008] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:53:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 2444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:53:57.002859 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:53:57.004723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=47 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:53:57.023044 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d728cbb7-b19c-4f4c-b4e5-1dbf6192935a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:57.023799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d728cbb7-b19c-4f4c-b4e5-1dbf6192935a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:57.159540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d728cbb7-b19c-4f4c-b4e5-1dbf6192935a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:57.174278 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d728cbb7-b19c-4f4c-b4e5-1dbf6192935a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1266 microversion: 2.1 time: 0.172109 Jul 19 22:53:57.175235 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2509/5009] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:53:56 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:53:58.195624 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8e3757d2-7726-49b2-9040-ef421349e1d3 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:58.197133 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8e3757d2-7726-49b2-9040-ef421349e1d3 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:58.226843 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8e3757d2-7726-49b2-9040-ef421349e1d3 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:58.232176 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8e3757d2-7726-49b2-9040-ef421349e1d3 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:58.234030 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8e3757d2-7726-49b2-9040-ef421349e1d3 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:58.234685 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8e3757d2-7726-49b2-9040-ef421349e1d3 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:58.364008 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8e3757d2-7726-49b2-9040-ef421349e1d3 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:58.390150 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8e3757d2-7726-49b2-9040-ef421349e1d3 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1262 microversion: 2.1 time: 0.201133 Jul 19 22:53:58.393237 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2501/5010] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:53:58 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1262 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:53:59.409833 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-45fad381-c27f-4bda-a005-c98e1460f4d2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:53:59.411369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-45fad381-c27f-4bda-a005-c98e1460f4d2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:53:59.441549 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45fad381-c27f-4bda-a005-c98e1460f4d2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:59.442140 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45fad381-c27f-4bda-a005-c98e1460f4d2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:59.443274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45fad381-c27f-4bda-a005-c98e1460f4d2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:53:59.443899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45fad381-c27f-4bda-a005-c98e1460f4d2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:53:59.595068 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-45fad381-c27f-4bda-a005-c98e1460f4d2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:53:59.607035 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-45fad381-c27f-4bda-a005-c98e1460f4d2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1324 microversion: 2.1 time: 0.202230 Jul 19 22:53:59.609189 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2510/5011] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:53:59 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1324 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:54:00.627373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e7ec592a-e414-4712-af55-953f9081ce08 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:00.628374 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e7ec592a-e414-4712-af55-953f9081ce08 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:00.639442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e7ec592a-e414-4712-af55-953f9081ce08 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:00.641389 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e7ec592a-e414-4712-af55-953f9081ce08 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:00.643134 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e7ec592a-e414-4712-af55-953f9081ce08 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:00.652019 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e7ec592a-e414-4712-af55-953f9081ce08 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:00.839952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e7ec592a-e414-4712-af55-953f9081ce08 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:00.854469 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e7ec592a-e414-4712-af55-953f9081ce08 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1324 microversion: 2.1 time: 0.232159 Jul 19 22:54:00.865364 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2502/5012] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:54:00 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1324 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:54:01.878142 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-031dec66-9036-4301-a2d2-b33ac233cfb2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:01.878806 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-031dec66-9036-4301-a2d2-b33ac233cfb2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:01.890054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-031dec66-9036-4301-a2d2-b33ac233cfb2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:01.890561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-031dec66-9036-4301-a2d2-b33ac233cfb2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:01.905871 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-031dec66-9036-4301-a2d2-b33ac233cfb2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:01.906765 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-031dec66-9036-4301-a2d2-b33ac233cfb2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:02.867952 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-031dec66-9036-4301-a2d2-b33ac233cfb2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:02.881714 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-031dec66-9036-4301-a2d2-b33ac233cfb2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1392 microversion: 2.1 time: 1.010020 Jul 19 22:54:02.888066 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2511/5013] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:54:01 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1392 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:54:03.908359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4fa7cc29-d1cc-4eb4-a4d7-e60cb9a52961 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:03.909080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4fa7cc29-d1cc-4eb4-a4d7-e60cb9a52961 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:03.928893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4fa7cc29-d1cc-4eb4-a4d7-e60cb9a52961 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:03.929476 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4fa7cc29-d1cc-4eb4-a4d7-e60cb9a52961 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:03.930380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4fa7cc29-d1cc-4eb4-a4d7-e60cb9a52961 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:03.931086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4fa7cc29-d1cc-4eb4-a4d7-e60cb9a52961 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:04.395231 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4fa7cc29-d1cc-4eb4-a4d7-e60cb9a52961 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:04.409785 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4fa7cc29-d1cc-4eb4-a4d7-e60cb9a52961 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1392 microversion: 2.1 time: 0.507458 Jul 19 22:54:04.425974 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2503/5014] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:54:03 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1392 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:54:05.433286 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9c04f80f-9145-45e2-8800-61d492e5032a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:05.434042 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9c04f80f-9145-45e2-8800-61d492e5032a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:05.448793 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9c04f80f-9145-45e2-8800-61d492e5032a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:05.450660 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9c04f80f-9145-45e2-8800-61d492e5032a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:05.453890 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9c04f80f-9145-45e2-8800-61d492e5032a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:05.456517 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9c04f80f-9145-45e2-8800-61d492e5032a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:06.089566 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9c04f80f-9145-45e2-8800-61d492e5032a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:06.107026 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9c04f80f-9145-45e2-8800-61d492e5032a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1392 microversion: 2.1 time: 0.678408 Jul 19 22:54:06.108631 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2512/5015] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:54:05 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1392 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:54:06.249081 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-d201c9e9-6af1-43dc-9cb5-c154c362d993 req-666dff25-6d6a-45a2-8450-fe834315566a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b91701f7-5826-4b0e-acb3-790d11b216c7", "tag": "d8cc3438-9336-4995-b930-8e1b14219550"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:54:06.266798 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d201c9e9-6af1-43dc-9cb5-c154c362d993 req-666dff25-6d6a-45a2-8450-fe834315566a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:06.270823 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d201c9e9-6af1-43dc-9cb5-c154c362d993 req-666dff25-6d6a-45a2-8450-fe834315566a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:06.299550 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-d201c9e9-6af1-43dc-9cb5-c154c362d993 req-666dff25-6d6a-45a2-8450-fe834315566a service nova] Creating event network-changed:d8cc3438-9336-4995-b930-8e1b14219550 for instance b91701f7-5826-4b0e-acb3-790d11b216c7 on n-h1-847009-3 Jul 19 22:54:06.308421 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-d201c9e9-6af1-43dc-9cb5-c154c362d993 req-666dff25-6d6a-45a2-8450-fe834315566a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062834 Jul 19 22:54:06.309563 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2504/5016] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:54:07.136668 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f9506bdb-d40d-4a88-8df7-ed29c38ff543 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:07.137973 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f9506bdb-d40d-4a88-8df7-ed29c38ff543 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:07.157973 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f9506bdb-d40d-4a88-8df7-ed29c38ff543 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:07.159072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f9506bdb-d40d-4a88-8df7-ed29c38ff543 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:07.163567 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f9506bdb-d40d-4a88-8df7-ed29c38ff543 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:07.166057 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f9506bdb-d40d-4a88-8df7-ed29c38ff543 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:07.173779 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:54:08.477777 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f9506bdb-d40d-4a88-8df7-ed29c38ff543 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:08.485685 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f9506bdb-d40d-4a88-8df7-ed29c38ff543 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1392 microversion: 2.1 time: 1.354779 Jul 19 22:54:08.495437 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2513/5017] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:54:07 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1392 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:54:09.504282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:54:09.505067 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:54:09.512547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-58a71c76-e339-4b3a-93b3-b74563832148 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:09.513282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-58a71c76-e339-4b3a-93b3-b74563832148 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:09.542126 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58a71c76-e339-4b3a-93b3-b74563832148 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:09.546257 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58a71c76-e339-4b3a-93b3-b74563832148 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:09.551782 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58a71c76-e339-4b3a-93b3-b74563832148 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:09.561792 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58a71c76-e339-4b3a-93b3-b74563832148 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:09.923563 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1a6ab8f6-989e-42e1-b4a2-64e7a9175aee tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:09.924373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1a6ab8f6-989e-42e1-b4a2-64e7a9175aee tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:09.957965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a6ab8f6-989e-42e1-b4a2-64e7a9175aee tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:09.958580 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a6ab8f6-989e-42e1-b4a2-64e7a9175aee tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:09.960968 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a6ab8f6-989e-42e1-b4a2-64e7a9175aee tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:09.961502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a6ab8f6-989e-42e1-b4a2-64e7a9175aee tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:10.049796 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1a6ab8f6-989e-42e1-b4a2-64e7a9175aee tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/ips" status: 200 len: 150 microversion: 2.20 time: 0.127996 Jul 19 22:54:10.054422 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2514/5018] 10.222.0.25 () {60 vars in 1288 bytes} [Tue Jul 19 22:54:09 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/ips => generated 150 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:54:10.198631 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-58a71c76-e339-4b3a-93b3-b74563832148 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:10.208514 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-58a71c76-e339-4b3a-93b3-b74563832148 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1392 microversion: 2.1 time: 0.705147 Jul 19 22:54:10.212206 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2505/5019] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:54:09 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1392 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:54:11.230771 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cf5acf15-51c0-483e-92f7-921172d00db8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:11.232108 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cf5acf15-51c0-483e-92f7-921172d00db8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:11.251972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cf5acf15-51c0-483e-92f7-921172d00db8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:11.253608 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cf5acf15-51c0-483e-92f7-921172d00db8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:11.256104 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cf5acf15-51c0-483e-92f7-921172d00db8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:11.259083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cf5acf15-51c0-483e-92f7-921172d00db8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:12.045312 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cf5acf15-51c0-483e-92f7-921172d00db8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:12.057310 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cf5acf15-51c0-483e-92f7-921172d00db8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1392 microversion: 2.1 time: 0.832338 Jul 19 22:54:12.060131 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2515/5020] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:54:11 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1392 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:54:13.076668 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3f083851-5327-4e7f-90e5-a30ea1c939d7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:13.077481 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3f083851-5327-4e7f-90e5-a30ea1c939d7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:13.090850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3f083851-5327-4e7f-90e5-a30ea1c939d7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:13.092783 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3f083851-5327-4e7f-90e5-a30ea1c939d7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:13.094430 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3f083851-5327-4e7f-90e5-a30ea1c939d7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:13.096412 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3f083851-5327-4e7f-90e5-a30ea1c939d7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:13.316086 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1acf66da-ae83-4f7c-b0a3-2245612bd0e6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:13.317260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1acf66da-ae83-4f7c-b0a3-2245612bd0e6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9cb08864-7c20-44cc-9f73-87f0da61e0aa] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:13.346744 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1acf66da-ae83-4f7c-b0a3-2245612bd0e6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:13.347617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1acf66da-ae83-4f7c-b0a3-2245612bd0e6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:13.348705 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1acf66da-ae83-4f7c-b0a3-2245612bd0e6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:13.349358 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1acf66da-ae83-4f7c-b0a3-2245612bd0e6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:13.426752 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1acf66da-ae83-4f7c-b0a3-2245612bd0e6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa/ips" status: 200 len: 148 microversion: 2.1 time: 0.123955 Jul 19 22:54:13.449089 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2516/5021] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 19 22:54:13 2022] GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa/ips => generated 148 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:54:13.461102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3f083851-5327-4e7f-90e5-a30ea1c939d7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:13.469395 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3f083851-5327-4e7f-90e5-a30ea1c939d7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1392 microversion: 2.1 time: 0.396785 Jul 19 22:54:13.471720 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2506/5022] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:54:13 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1392 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:54:13.476448 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-978c1ceb-5f14-4bec-93db-d110bf7149fe tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2227fd74-8a48-46f7-93e4-c8505fb87650"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:54:13.477738 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-978c1ceb-5f14-4bec-93db-d110bf7149fe tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9cb08864-7c20-44cc-9f73-87f0da61e0aa] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:13.490552 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-978c1ceb-5f14-4bec-93db-d110bf7149fe tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:13.492894 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-978c1ceb-5f14-4bec-93db-d110bf7149fe tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:13.497607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-978c1ceb-5f14-4bec-93db-d110bf7149fe tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:13.498583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-978c1ceb-5f14-4bec-93db-d110bf7149fe tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:13.652638 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-978c1ceb-5f14-4bec-93db-d110bf7149fe tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] HTTP exception thrown: Invalid volume: volume 2227fd74-8a48-46f7-93e4-c8505fb87650 is already attached to instances: 9abb6a36-c31b-445c-a137-5fb74eb368b0 Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-978c1ceb-5f14-4bec-93db-d110bf7149fe tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Request method failure captured: Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa/os-volume_attachments HTTP/1.1 Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 74 Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zVsSOX-O7ggDcH00KLmZx8wOtg3S3Su8gJRQI2lYa4BxC-OxvaOKnPb2I4UGxeYv7AyyS8e-HsUydLYlXpELI3RwSo4aU8bY9u8sE-NNAsyuAsZv_PYlNBhbG0F8quyfyoOYST6GA8Fbv-UJaQmRhd0xcvaUwo2b-fKMEkbL-YV9Cg Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: c3929e62eb4345f8a69fec37ba7c195f Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: {"volumeAttachment": {"volumeId": "2227fd74-8a48-46f7-93e4-c8505fb87650"}} Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid volume: volume 2227fd74-8a48-46f7-93e4-c8505fb87650 is already attached to instances: 9abb6a36-c31b-445c-a137-5fb74eb368b0 Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'server_id': '9cb08864-7c20-44cc-9f73-87f0da61e0aa', 'body': {'volumeAttachment': {'volumeId': '2227fd74-8a48-46f7-93e4-c8505fb87650'}}} Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2227fd74-8a48-46f7-93e4-c8505fb87650 is already attached to instances: 9abb6a36-c31b-445c-a137-5fb74eb368b0 Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:54:13.656015 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:54:13.662370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:54:13.662370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:54:13.662370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 19 22:54:13.662370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 22:54:13.662370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2227fd74-8a48-46f7-93e4-c8505fb87650 is already attached to instances: 9abb6a36-c31b-445c-a137-5fb74eb368b0 Jul 19 22:54:13.662370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:54:13.662370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:54:13.662370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:54:13.662370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:54:13.662370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:54:13.662370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:54:13.662370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:54:13.662370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:54:13.662370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2227fd74-8a48-46f7-93e4-c8505fb87650 is already attached to instances: 9abb6a36-c31b-445c-a137-5fb74eb368b0 Jul 19 22:54:13.662370 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:54:13.662370 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-978c1ceb-5f14-4bec-93db-d110bf7149fe tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Returning 400 to user: Invalid volume: volume 2227fd74-8a48-46f7-93e4-c8505fb87650 is already attached to instances: 9abb6a36-c31b-445c-a137-5fb74eb368b0 {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:54:13.664950 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-978c1ceb-5f14-4bec-93db-d110bf7149fe tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "POST /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.211567 Jul 19 22:54:13.664950 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2517/5023] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 19 22:54:13 2022] POST /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa/os-volume_attachments => generated 174 bytes in 214 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:54:13.673351 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-59f74630-2992-452b-9e24-5c3aa3df9040 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:13.673935 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-59f74630-2992-452b-9e24-5c3aa3df9040 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9cb08864-7c20-44cc-9f73-87f0da61e0aa] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:13.683912 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-59f74630-2992-452b-9e24-5c3aa3df9040 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:13.684489 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-59f74630-2992-452b-9e24-5c3aa3df9040 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:13.685474 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-59f74630-2992-452b-9e24-5c3aa3df9040 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:13.686311 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-59f74630-2992-452b-9e24-5c3aa3df9040 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:13.717929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-59f74630-2992-452b-9e24-5c3aa3df9040 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9cb08864-7c20-44cc-9f73-87f0da61e0aa] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:54:13.808763 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-46ded72f-9cb0-42b0-8252-297396fce7c9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:54:13.809325 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-46ded72f-9cb0-42b0-8252-297396fce7c9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:13.833553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46ded72f-9cb0-42b0-8252-297396fce7c9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:13.834231 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46ded72f-9cb0-42b0-8252-297396fce7c9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:13.835321 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-59f74630-2992-452b-9e24-5c3aa3df9040 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa" status: 204 len: 0 microversion: 2.1 time: 0.165610 Jul 19 22:54:13.835941 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46ded72f-9cb0-42b0-8252-297396fce7c9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:13.837688 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46ded72f-9cb0-42b0-8252-297396fce7c9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:13.841331 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2507/5024] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:54:13 2022] DELETE /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:54:13.856364 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0b7154cd-2e31-4471-952f-d39b84367fb9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:13.858699 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0b7154cd-2e31-4471-952f-d39b84367fb9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9cb08864-7c20-44cc-9f73-87f0da61e0aa] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:13.868592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b7154cd-2e31-4471-952f-d39b84367fb9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:13.869072 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b7154cd-2e31-4471-952f-d39b84367fb9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:13.870141 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b7154cd-2e31-4471-952f-d39b84367fb9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:13.870791 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0b7154cd-2e31-4471-952f-d39b84367fb9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:13.887568 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-46ded72f-9cb0-42b0-8252-297396fce7c9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lazy-loading 'flavor' on Instance uuid 4d98192d-dabe-4541-b7c6-c057e4269d64 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:54:14.103847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0b7154cd-2e31-4471-952f-d39b84367fb9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:14.133903 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0b7154cd-2e31-4471-952f-d39b84367fb9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa" status: 200 len: 1679 microversion: 2.1 time: 0.277672 Jul 19 22:54:14.135027 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2508/5025] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:54:13 2022] GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa => generated 1679 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:54:14.424163 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-46ded72f-9cb0-42b0-8252-297396fce7c9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "POST /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/action" status: 202 len: 0 microversion: 2.20 time: 0.617736 Jul 19 22:54:14.425961 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2518/5026] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Jul 19 22:54:13 2022] POST /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/action => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:54:14.436950 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-60a411d7-e269-4a02-84f3-c6e3d15407c0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:14.437614 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-60a411d7-e269-4a02-84f3-c6e3d15407c0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:14.450054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-60a411d7-e269-4a02-84f3-c6e3d15407c0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:14.451310 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-60a411d7-e269-4a02-84f3-c6e3d15407c0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:14.452900 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-60a411d7-e269-4a02-84f3-c6e3d15407c0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:14.453889 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-60a411d7-e269-4a02-84f3-c6e3d15407c0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:14.507962 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2ce61efc-f087-4c5c-b5ae-1c0c8cbad7d0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:14.509411 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2ce61efc-f087-4c5c-b5ae-1c0c8cbad7d0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:14.546539 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2ce61efc-f087-4c5c-b5ae-1c0c8cbad7d0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:14.547071 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2ce61efc-f087-4c5c-b5ae-1c0c8cbad7d0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:14.547932 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2ce61efc-f087-4c5c-b5ae-1c0c8cbad7d0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:14.550920 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2ce61efc-f087-4c5c-b5ae-1c0c8cbad7d0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:14.841282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-60a411d7-e269-4a02-84f3-c6e3d15407c0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:14.854946 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-60a411d7-e269-4a02-84f3-c6e3d15407c0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:14.869423 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-60a411d7-e269-4a02-84f3-c6e3d15407c0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:14.870714 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-60a411d7-e269-4a02-84f3-c6e3d15407c0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1722 microversion: 2.20 time: 0.438421 Jul 19 22:54:14.882295 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2509/5027] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:54:14 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1722 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:54:15.075965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2ce61efc-f087-4c5c-b5ae-1c0c8cbad7d0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:15.098324 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2ce61efc-f087-4c5c-b5ae-1c0c8cbad7d0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1392 microversion: 2.1 time: 0.612970 Jul 19 22:54:15.101749 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2519/5028] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:54:14 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1392 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:54:15.153104 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a060a0c6-9be2-4b5d-9534-5497939d5c7a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:15.154040 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a060a0c6-9be2-4b5d-9534-5497939d5c7a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9cb08864-7c20-44cc-9f73-87f0da61e0aa] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:15.170486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a060a0c6-9be2-4b5d-9534-5497939d5c7a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:15.171022 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a060a0c6-9be2-4b5d-9534-5497939d5c7a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:15.172020 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a060a0c6-9be2-4b5d-9534-5497939d5c7a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:15.172374 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a060a0c6-9be2-4b5d-9534-5497939d5c7a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:15.196942 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-3601de3b-21b1-447f-8481-329cb19ed018 req-276bc23b-4543-41aa-aea1-00db88d70838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b91701f7-5826-4b0e-acb3-790d11b216c7", "name": "network-vif-plugged", "status": "completed", "tag": "d8cc3438-9336-4995-b930-8e1b14219550"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:54:15.219040 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-3601de3b-21b1-447f-8481-329cb19ed018 req-276bc23b-4543-41aa-aea1-00db88d70838 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:15.219799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-3601de3b-21b1-447f-8481-329cb19ed018 req-276bc23b-4543-41aa-aea1-00db88d70838 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:15.266979 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-3601de3b-21b1-447f-8481-329cb19ed018 req-276bc23b-4543-41aa-aea1-00db88d70838 service nova] Creating event network-vif-plugged:d8cc3438-9336-4995-b930-8e1b14219550 for instance b91701f7-5826-4b0e-acb3-790d11b216c7 on n-h1-847009-3 Jul 19 22:54:15.290497 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-3601de3b-21b1-447f-8481-329cb19ed018 req-276bc23b-4543-41aa-aea1-00db88d70838 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097914 Jul 19 22:54:15.298452 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2520/5029] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:54:15.846171 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a060a0c6-9be2-4b5d-9534-5497939d5c7a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:15.854636 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a060a0c6-9be2-4b5d-9534-5497939d5c7a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa" status: 200 len: 1679 microversion: 2.1 time: 0.705364 Jul 19 22:54:15.869977 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2510/5030] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:54:15 2022] GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa => generated 1679 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:54:15.891332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cc750683-54dd-4240-92dc-7121aff3e092 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:15.893279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cc750683-54dd-4240-92dc-7121aff3e092 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:15.914716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc750683-54dd-4240-92dc-7121aff3e092 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:15.915689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc750683-54dd-4240-92dc-7121aff3e092 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:15.917007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc750683-54dd-4240-92dc-7121aff3e092 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:15.917708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc750683-54dd-4240-92dc-7121aff3e092 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:16.119780 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8de5cae2-10de-4672-b0c1-0b057034824c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:16.120803 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8de5cae2-10de-4672-b0c1-0b057034824c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:16.132869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8de5cae2-10de-4672-b0c1-0b057034824c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:16.133917 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8de5cae2-10de-4672-b0c1-0b057034824c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:16.134982 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8de5cae2-10de-4672-b0c1-0b057034824c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:16.138097 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8de5cae2-10de-4672-b0c1-0b057034824c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:16.261380 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cc750683-54dd-4240-92dc-7121aff3e092 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:16.278145 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cc750683-54dd-4240-92dc-7121aff3e092 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:16.283805 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cc750683-54dd-4240-92dc-7121aff3e092 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:16.290039 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cc750683-54dd-4240-92dc-7121aff3e092 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1722 microversion: 2.20 time: 0.399024 Jul 19 22:54:16.291596 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2521/5031] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:54:15 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1722 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:54:16.550517 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8de5cae2-10de-4672-b0c1-0b057034824c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:16.576900 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8de5cae2-10de-4672-b0c1-0b057034824c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1392 microversion: 2.1 time: 0.462012 Jul 19 22:54:16.577539 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2511/5032] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:54:16 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1392 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:54:16.899786 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-da3d7ecc-4703-48d8-a062-13dfae511324 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:16.905129 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-da3d7ecc-4703-48d8-a062-13dfae511324 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9cb08864-7c20-44cc-9f73-87f0da61e0aa] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:16.938233 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-da3d7ecc-4703-48d8-a062-13dfae511324 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:16.939458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-da3d7ecc-4703-48d8-a062-13dfae511324 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:16.940417 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-da3d7ecc-4703-48d8-a062-13dfae511324 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:16.940979 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-da3d7ecc-4703-48d8-a062-13dfae511324 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:17.310904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3a03e068-23d1-40f5-be1c-d0866334c0a9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:17.311873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3a03e068-23d1-40f5-be1c-d0866334c0a9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:17.337604 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a03e068-23d1-40f5-be1c-d0866334c0a9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:17.339018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a03e068-23d1-40f5-be1c-d0866334c0a9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:17.341271 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a03e068-23d1-40f5-be1c-d0866334c0a9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:17.342344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a03e068-23d1-40f5-be1c-d0866334c0a9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:17.421597 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-da3d7ecc-4703-48d8-a062-13dfae511324 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:17.434876 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-da3d7ecc-4703-48d8-a062-13dfae511324 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa" status: 200 len: 1679 microversion: 2.1 time: 0.560985 Jul 19 22:54:17.435499 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2522/5033] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:54:16 2022] GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa => generated 1679 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:54:17.595769 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a18bbd13-9ab0-4fe0-818e-eef817d5b76d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:17.596844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a18bbd13-9ab0-4fe0-818e-eef817d5b76d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:17.627836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a18bbd13-9ab0-4fe0-818e-eef817d5b76d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:17.634774 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a18bbd13-9ab0-4fe0-818e-eef817d5b76d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:17.637418 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a18bbd13-9ab0-4fe0-818e-eef817d5b76d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:17.638205 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a18bbd13-9ab0-4fe0-818e-eef817d5b76d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:17.874087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3a03e068-23d1-40f5-be1c-d0866334c0a9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:17.906782 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3a03e068-23d1-40f5-be1c-d0866334c0a9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:17.911071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3a03e068-23d1-40f5-be1c-d0866334c0a9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:17.916972 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3a03e068-23d1-40f5-be1c-d0866334c0a9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1722 microversion: 2.20 time: 0.610377 Jul 19 22:54:17.920222 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2512/5034] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:54:17 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1722 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:54:18.455238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4891eb4b-59fc-4607-bff2-38d09543b1bb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:18.456644 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4891eb4b-59fc-4607-bff2-38d09543b1bb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9cb08864-7c20-44cc-9f73-87f0da61e0aa] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:18.482725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4891eb4b-59fc-4607-bff2-38d09543b1bb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:18.486214 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4891eb4b-59fc-4607-bff2-38d09543b1bb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:18.487284 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4891eb4b-59fc-4607-bff2-38d09543b1bb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:18.495495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4891eb4b-59fc-4607-bff2-38d09543b1bb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:19.730685 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4891eb4b-59fc-4607-bff2-38d09543b1bb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:19.747898 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4891eb4b-59fc-4607-bff2-38d09543b1bb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa" status: 200 len: 1612 microversion: 2.1 time: 1.298268 Jul 19 22:54:19.751739 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2513/5035] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:54:18 2022] GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa => generated 1612 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:54:19.768615 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-8b627440-9085-4fc1-abd6-eca107cdbc95 req-5bdd01f1-86e3-4ec1-b739-7d5d5655a668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cb08864-7c20-44cc-9f73-87f0da61e0aa", "name": "network-vif-deleted", "tag": "3476ca29-7018-4113-b6b0-fbcfe6959346"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:54:19.823783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a18bbd13-9ab0-4fe0-818e-eef817d5b76d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:19.841527 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a18bbd13-9ab0-4fe0-818e-eef817d5b76d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1564 microversion: 2.1 time: 2.247767 Jul 19 22:54:19.842395 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2523/5036] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:54:17 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1564 bytes in 2253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:54:19.853755 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-8b627440-9085-4fc1-abd6-eca107cdbc95 req-5bdd01f1-86e3-4ec1-b739-7d5d5655a668 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:19.854207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-8b627440-9085-4fc1-abd6-eca107cdbc95 req-5bdd01f1-86e3-4ec1-b739-7d5d5655a668 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:19.855482 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-90df06ec-f004-4460-a025-c00add7b323e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:19.858162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-90df06ec-f004-4460-a025-c00add7b323e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:19.876395 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-90df06ec-f004-4460-a025-c00add7b323e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:19.885850 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-90df06ec-f004-4460-a025-c00add7b323e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:19.888599 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-90df06ec-f004-4460-a025-c00add7b323e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:19.889220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-90df06ec-f004-4460-a025-c00add7b323e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:19.896009 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-8b627440-9085-4fc1-abd6-eca107cdbc95 req-5bdd01f1-86e3-4ec1-b739-7d5d5655a668 service nova] Creating event network-vif-deleted:3476ca29-7018-4113-b6b0-fbcfe6959346 for instance 9cb08864-7c20-44cc-9f73-87f0da61e0aa on n-h2-847009-3 Jul 19 22:54:19.924396 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-8b627440-9085-4fc1-abd6-eca107cdbc95 req-5bdd01f1-86e3-4ec1-b739-7d5d5655a668 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169758 Jul 19 22:54:19.929676 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2514/5037] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:54:19.942112 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-74859e9e-1484-4882-88e2-8db24f59af5e tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:19.951179 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-74859e9e-1484-4882-88e2-8db24f59af5e tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:19.982403 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-74859e9e-1484-4882-88e2-8db24f59af5e tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:19.988802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-74859e9e-1484-4882-88e2-8db24f59af5e tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:19.991011 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-74859e9e-1484-4882-88e2-8db24f59af5e tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:19.994634 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-74859e9e-1484-4882-88e2-8db24f59af5e tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:20.957982 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-74859e9e-1484-4882-88e2-8db24f59af5e tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:20.968571 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-74859e9e-1484-4882-88e2-8db24f59af5e tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1564 microversion: 2.1 time: 1.037207 Jul 19 22:54:20.981931 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-90df06ec-f004-4460-a025-c00add7b323e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:20.988291 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2515/5038] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:54:19 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1564 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:54:21.007058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2c895934-d4dc-4180-9986-fe54121ee1c5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:21.008218 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2c895934-d4dc-4180-9986-fe54121ee1c5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9cb08864-7c20-44cc-9f73-87f0da61e0aa] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:21.008959 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-90df06ec-f004-4460-a025-c00add7b323e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:21.018154 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-90df06ec-f004-4460-a025-c00add7b323e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:21.019416 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-90df06ec-f004-4460-a025-c00add7b323e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1722 microversion: 2.20 time: 1.175401 Jul 19 22:54:21.019990 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2524/5039] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:54:19 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1722 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:54:21.028247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c895934-d4dc-4180-9986-fe54121ee1c5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:21.029013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c895934-d4dc-4180-9986-fe54121ee1c5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:21.030054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c895934-d4dc-4180-9986-fe54121ee1c5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:21.030715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c895934-d4dc-4180-9986-fe54121ee1c5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:21.069758 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-2c895934-d4dc-4180-9986-fe54121ee1c5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] HTTP exception thrown: Instance 9cb08864-7c20-44cc-9f73-87f0da61e0aa could not be found. Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2c895934-d4dc-4180-9986-fe54121ee1c5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Request method failure captured: Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa HTTP/1.1 Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zVsSOX-O7ggDcH00KLmZx8wOtg3S3Su8gJRQI2lYa4BxC-OxvaOKnPb2I4UGxeYv7AyyS8e-HsUydLYlXpELI3RwSo4aU8bY9u8sE-NNAsyuAsZv_PYlNBhbG0F8quyfyoOYST6GA8Fbv-UJaQmRhd0xcvaUwo2b-fKMEkbL-YV9Cg Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: c3929e62eb4345f8a69fec37ba7c195f Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 9cb08864-7c20-44cc-9f73-87f0da61e0aa could not be found. Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '9cb08864-7c20-44cc-9f73-87f0da61e0aa'} Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cb08864-7c20-44cc-9f73-87f0da61e0aa could not be found. Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cb08864-7c20-44cc-9f73-87f0da61e0aa could not be found. Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:54:21.072116 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:54:21.077565 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:54:21.077565 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:54:21.077565 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:54:21.077565 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:54:21.077565 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:54:21.077565 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cb08864-7c20-44cc-9f73-87f0da61e0aa could not be found. Jul 19 22:54:21.077565 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:54:21.080114 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2c895934-d4dc-4180-9986-fe54121ee1c5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Returning 404 to user: Instance 9cb08864-7c20-44cc-9f73-87f0da61e0aa could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:54:21.081224 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2c895934-d4dc-4180-9986-fe54121ee1c5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa" status: 404 len: 111 microversion: 2.1 time: 0.091562 Jul 19 22:54:21.082333 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2516/5040] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:54:20 2022] GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:54:21.091009 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5465ad7e-2394-499c-87e3-23ab8bce6b9f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '.version_select at 0x7f7a030a9ee0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:21.144441 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5465ad7e-2394-499c-87e3-23ab8bce6b9f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1669638682" status: 202 len: 0 microversion: 2.1 time: 0.057037 Jul 19 22:54:21.146100 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2525/5041] 10.222.0.25 () {58 vars in 1220 bytes} [Tue Jul 19 22:54:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1669638682 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:54:22.040605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-908eb792-eb11-4c9b-be00-4617a18a173f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:22.041224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-908eb792-eb11-4c9b-be00-4617a18a173f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:22.057792 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-908eb792-eb11-4c9b-be00-4617a18a173f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:22.058257 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-908eb792-eb11-4c9b-be00-4617a18a173f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:22.059587 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-908eb792-eb11-4c9b-be00-4617a18a173f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:22.060029 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-908eb792-eb11-4c9b-be00-4617a18a173f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:22.176131 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:54:23.259213 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-908eb792-eb11-4c9b-be00-4617a18a173f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:23.267976 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-908eb792-eb11-4c9b-be00-4617a18a173f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:23.273981 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-908eb792-eb11-4c9b-be00-4617a18a173f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:23.278756 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-908eb792-eb11-4c9b-be00-4617a18a173f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1722 microversion: 2.20 time: 1.242643 Jul 19 22:54:23.299813 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2517/5042] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:54:22 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1722 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:54:24.306953 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6659436e-3778-4dcc-9ae8-01276cef435d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:24.307736 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6659436e-3778-4dcc-9ae8-01276cef435d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:24.332400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6659436e-3778-4dcc-9ae8-01276cef435d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:24.332960 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6659436e-3778-4dcc-9ae8-01276cef435d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:24.346469 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6659436e-3778-4dcc-9ae8-01276cef435d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:24.347737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6659436e-3778-4dcc-9ae8-01276cef435d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:24.416642 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c8c58863-13e7-4cf6-8362-ed390ef795c0 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:24.420803 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c8c58863-13e7-4cf6-8362-ed390ef795c0 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:24.427046 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8c58863-13e7-4cf6-8362-ed390ef795c0 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:24.427753 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8c58863-13e7-4cf6-8362-ed390ef795c0 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:24.429277 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8c58863-13e7-4cf6-8362-ed390ef795c0 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:24.429904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8c58863-13e7-4cf6-8362-ed390ef795c0 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:24.668086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-c8c58863-13e7-4cf6-8362-ed390ef795c0 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lazy-loading 'services' on Instance uuid 9abb6a36-c31b-445c-a137-5fb74eb368b0 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:54:24.849012 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c8c58863-13e7-4cf6-8362-ed390ef795c0 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-volume_attachments/2227fd74-8a48-46f7-93e4-c8505fb87650" status: 202 len: 0 microversion: 2.1 time: 0.437589 Jul 19 22:54:24.853256 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2518/5043] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 19 22:54:24 2022] DELETE /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-volume_attachments/2227fd74-8a48-46f7-93e4-c8505fb87650 => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:54:24.895741 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e6b593df-d8b7-4890-89d6-9974319f8db5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:24.911248 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e6b593df-d8b7-4890-89d6-9974319f8db5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:24.931075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:54:24.933415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e6b593df-d8b7-4890-89d6-9974319f8db5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:24.934080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e6b593df-d8b7-4890-89d6-9974319f8db5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:24.938023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e6b593df-d8b7-4890-89d6-9974319f8db5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:24.938733 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e6b593df-d8b7-4890-89d6-9974319f8db5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:24.981543 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6659436e-3778-4dcc-9ae8-01276cef435d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:24.986546 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:54:24.998741 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6659436e-3778-4dcc-9ae8-01276cef435d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:25.022434 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6659436e-3778-4dcc-9ae8-01276cef435d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:25.032747 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6659436e-3778-4dcc-9ae8-01276cef435d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1722 microversion: 2.20 time: 0.730879 Jul 19 22:54:25.034034 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2526/5044] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:54:24 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1722 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:54:25.065878 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e6b593df-d8b7-4890-89d6-9974319f8db5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.211095 Jul 19 22:54:25.066879 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2519/5045] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:54:24 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:54:26.064032 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0ae6efd6-3b14-4262-8e10-d6686d0bccf0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:26.064032 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0ae6efd6-3b14-4262-8e10-d6686d0bccf0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:26.078086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-de9802ee-64fe-4263-b10e-5afb3d67ddfd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:26.079039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-de9802ee-64fe-4263-b10e-5afb3d67ddfd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:26.099793 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de9802ee-64fe-4263-b10e-5afb3d67ddfd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:26.100292 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de9802ee-64fe-4263-b10e-5afb3d67ddfd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:26.101932 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de9802ee-64fe-4263-b10e-5afb3d67ddfd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:26.102214 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de9802ee-64fe-4263-b10e-5afb3d67ddfd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:26.105497 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ae6efd6-3b14-4262-8e10-d6686d0bccf0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:26.106053 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ae6efd6-3b14-4262-8e10-d6686d0bccf0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:26.121500 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ae6efd6-3b14-4262-8e10-d6686d0bccf0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:26.122013 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ae6efd6-3b14-4262-8e10-d6686d0bccf0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:26.283820 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-de9802ee-64fe-4263-b10e-5afb3d67ddfd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.206877 Jul 19 22:54:26.289363 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2520/5046] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:54:26 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-volume_attachments => generated 197 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:54:26.830869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0ae6efd6-3b14-4262-8e10-d6686d0bccf0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:26.841026 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0ae6efd6-3b14-4262-8e10-d6686d0bccf0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:26.859033 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0ae6efd6-3b14-4262-8e10-d6686d0bccf0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:26.860640 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0ae6efd6-3b14-4262-8e10-d6686d0bccf0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1722 microversion: 2.20 time: 0.811799 Jul 19 22:54:26.861645 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2527/5047] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:54:26 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1722 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:54:27.298076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-37991ea8-1d6e-4065-8252-8160ff7aec11 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:27.300153 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-37991ea8-1d6e-4065-8252-8160ff7aec11 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:27.327308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-37991ea8-1d6e-4065-8252-8160ff7aec11 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:27.330061 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-37991ea8-1d6e-4065-8252-8160ff7aec11 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:27.335720 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-37991ea8-1d6e-4065-8252-8160ff7aec11 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:27.339442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-37991ea8-1d6e-4065-8252-8160ff7aec11 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:27.489144 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-37991ea8-1d6e-4065-8252-8160ff7aec11 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.194978 Jul 19 22:54:27.490186 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2521/5048] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:54:27 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:54:27.627601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1484385f-a8b3-415c-b4ef-f1965859761f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:27.629232 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1484385f-a8b3-415c-b4ef-f1965859761f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:27.647935 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-542279f2-c56c-41e2-9953-48b24f5ddd90 req-4c3bf0fd-6203-49e1-b7c0-f3fb262da374 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b91701f7-5826-4b0e-acb3-790d11b216c7", "tag": "d8cc3438-9336-4995-b930-8e1b14219550"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:54:27.661692 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:54:27.666672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1484385f-a8b3-415c-b4ef-f1965859761f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:27.667161 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1484385f-a8b3-415c-b4ef-f1965859761f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:27.673517 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-542279f2-c56c-41e2-9953-48b24f5ddd90 req-4c3bf0fd-6203-49e1-b7c0-f3fb262da374 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:27.673968 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-542279f2-c56c-41e2-9953-48b24f5ddd90 req-4c3bf0fd-6203-49e1-b7c0-f3fb262da374 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:27.675172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1484385f-a8b3-415c-b4ef-f1965859761f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:27.676226 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1484385f-a8b3-415c-b4ef-f1965859761f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:27.714571 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-542279f2-c56c-41e2-9953-48b24f5ddd90 req-4c3bf0fd-6203-49e1-b7c0-f3fb262da374 service nova] Creating event network-changed:d8cc3438-9336-4995-b930-8e1b14219550 for instance b91701f7-5826-4b0e-acb3-790d11b216c7 on n-h1-847009-3 Jul 19 22:54:27.736978 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-542279f2-c56c-41e2-9953-48b24f5ddd90 req-4c3bf0fd-6203-49e1-b7c0-f3fb262da374 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094056 Jul 19 22:54:27.748706 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2522/5049] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:54:27.881596 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d81b2ceb-7810-4e3d-9539-593688acd6a7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:27.883656 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d81b2ceb-7810-4e3d-9539-593688acd6a7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:27.901323 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d81b2ceb-7810-4e3d-9539-593688acd6a7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:27.904063 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d81b2ceb-7810-4e3d-9539-593688acd6a7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:27.905698 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d81b2ceb-7810-4e3d-9539-593688acd6a7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:27.909933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d81b2ceb-7810-4e3d-9539-593688acd6a7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:28.257881 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1484385f-a8b3-415c-b4ef-f1965859761f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:28.291524 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1484385f-a8b3-415c-b4ef-f1965859761f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1564 microversion: 2.1 time: 0.666052 Jul 19 22:54:28.294213 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2528/5050] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:54:27 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1564 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:54:28.503011 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-69b01279-5779-4dcd-a43a-bb6b5bcb6685 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:28.504256 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-69b01279-5779-4dcd-a43a-bb6b5bcb6685 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:28.516431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69b01279-5779-4dcd-a43a-bb6b5bcb6685 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:28.517189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69b01279-5779-4dcd-a43a-bb6b5bcb6685 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:28.520009 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69b01279-5779-4dcd-a43a-bb6b5bcb6685 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:28.520644 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69b01279-5779-4dcd-a43a-bb6b5bcb6685 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:28.592865 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-69b01279-5779-4dcd-a43a-bb6b5bcb6685 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094508 Jul 19 22:54:28.594152 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2529/5051] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:54:28 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:54:28.660132 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d81b2ceb-7810-4e3d-9539-593688acd6a7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:28.672288 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d81b2ceb-7810-4e3d-9539-593688acd6a7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:28.681029 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d81b2ceb-7810-4e3d-9539-593688acd6a7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:28.682587 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d81b2ceb-7810-4e3d-9539-593688acd6a7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1722 microversion: 2.20 time: 0.806611 Jul 19 22:54:28.688150 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2523/5052] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:54:27 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1722 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:54:29.605470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7bbd2c53-251f-42b7-812d-db350dd695b0 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:29.606579 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7bbd2c53-251f-42b7-812d-db350dd695b0 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:29.629817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7bbd2c53-251f-42b7-812d-db350dd695b0 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:29.629995 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7bbd2c53-251f-42b7-812d-db350dd695b0 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:29.631044 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7bbd2c53-251f-42b7-812d-db350dd695b0 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:29.634647 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7bbd2c53-251f-42b7-812d-db350dd695b0 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:29.707863 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e2f1688e-3445-4ce0-82e3-97ce3c8c9223 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:29.709416 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e2f1688e-3445-4ce0-82e3-97ce3c8c9223 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:29.712942 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7bbd2c53-251f-42b7-812d-db350dd695b0 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109910 Jul 19 22:54:29.716942 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2530/5053] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:54:29 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:54:29.754052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2f1688e-3445-4ce0-82e3-97ce3c8c9223 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:29.758156 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2f1688e-3445-4ce0-82e3-97ce3c8c9223 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:29.760049 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2f1688e-3445-4ce0-82e3-97ce3c8c9223 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:29.761542 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2f1688e-3445-4ce0-82e3-97ce3c8c9223 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:30.295443 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e2f1688e-3445-4ce0-82e3-97ce3c8c9223 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:30.306390 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e2f1688e-3445-4ce0-82e3-97ce3c8c9223 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:30.308127 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e2f1688e-3445-4ce0-82e3-97ce3c8c9223 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:30.309648 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e2f1688e-3445-4ce0-82e3-97ce3c8c9223 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1722 microversion: 2.20 time: 0.607214 Jul 19 22:54:30.310754 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2524/5054] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:54:29 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1722 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:54:30.725093 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5b70072f-7a62-4952-bbf3-39c1f7a75c0f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:30.726788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5b70072f-7a62-4952-bbf3-39c1f7a75c0f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:30.748644 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b70072f-7a62-4952-bbf3-39c1f7a75c0f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:30.752481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b70072f-7a62-4952-bbf3-39c1f7a75c0f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:30.754784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b70072f-7a62-4952-bbf3-39c1f7a75c0f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:30.760064 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b70072f-7a62-4952-bbf3-39c1f7a75c0f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:30.907586 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5b70072f-7a62-4952-bbf3-39c1f7a75c0f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.186924 Jul 19 22:54:30.916783 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2531/5055] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:54:30 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:54:31.330266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-64924dbf-9790-4751-94ed-1141f40d71eb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:31.330894 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-64924dbf-9790-4751-94ed-1141f40d71eb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:31.363923 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-64924dbf-9790-4751-94ed-1141f40d71eb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:31.364914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-64924dbf-9790-4751-94ed-1141f40d71eb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:31.366074 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-64924dbf-9790-4751-94ed-1141f40d71eb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:31.367182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-64924dbf-9790-4751-94ed-1141f40d71eb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:31.919994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-64924dbf-9790-4751-94ed-1141f40d71eb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:31.921643 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6b959322-0c3e-4e3f-9101-6d3d0179a5f3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:31.922882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6b959322-0c3e-4e3f-9101-6d3d0179a5f3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:31.936412 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b959322-0c3e-4e3f-9101-6d3d0179a5f3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:31.937094 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b959322-0c3e-4e3f-9101-6d3d0179a5f3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:31.938119 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b959322-0c3e-4e3f-9101-6d3d0179a5f3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:31.938732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b959322-0c3e-4e3f-9101-6d3d0179a5f3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:31.939796 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-64924dbf-9790-4751-94ed-1141f40d71eb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:31.947832 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-64924dbf-9790-4751-94ed-1141f40d71eb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:31.950773 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-64924dbf-9790-4751-94ed-1141f40d71eb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1743 microversion: 2.20 time: 0.624608 Jul 19 22:54:31.954363 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2525/5056] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:54:31 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1743 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:54:32.048580 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6b959322-0c3e-4e3f-9101-6d3d0179a5f3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128356 Jul 19 22:54:32.049837 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2532/5057] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:54:31 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:54:32.970802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a3cd200c-ee51-4714-a04b-79d5ad2f7cb1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:32.972247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a3cd200c-ee51-4714-a04b-79d5ad2f7cb1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:32.994066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3cd200c-ee51-4714-a04b-79d5ad2f7cb1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:32.994995 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3cd200c-ee51-4714-a04b-79d5ad2f7cb1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:32.997372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3cd200c-ee51-4714-a04b-79d5ad2f7cb1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:32.998741 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3cd200c-ee51-4714-a04b-79d5ad2f7cb1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:33.073465 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-28205d46-1fa5-4f84-8a37-b13ee19cebb5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:33.075190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-28205d46-1fa5-4f84-8a37-b13ee19cebb5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:33.105769 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28205d46-1fa5-4f84-8a37-b13ee19cebb5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:33.109210 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28205d46-1fa5-4f84-8a37-b13ee19cebb5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:33.110817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28205d46-1fa5-4f84-8a37-b13ee19cebb5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:33.120561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28205d46-1fa5-4f84-8a37-b13ee19cebb5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:33.263412 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-28205d46-1fa5-4f84-8a37-b13ee19cebb5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.205173 Jul 19 22:54:33.269563 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2533/5058] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:54:33 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:54:33.310929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-1e96d353-8cef-4ea0-a10f-a6dc2715a5e9 req-f72fe713-4680-4334-8372-47224b10ec21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d98192d-dabe-4541-b7c6-c057e4269d64", "name": "network-vif-plugged", "status": "completed", "tag": "06c1d4f8-d555-478d-9923-73caa8771882"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:54:33.330552 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1e96d353-8cef-4ea0-a10f-a6dc2715a5e9 req-f72fe713-4680-4334-8372-47224b10ec21 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:33.331043 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1e96d353-8cef-4ea0-a10f-a6dc2715a5e9 req-f72fe713-4680-4334-8372-47224b10ec21 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:33.366880 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-1e96d353-8cef-4ea0-a10f-a6dc2715a5e9 req-f72fe713-4680-4334-8372-47224b10ec21 service nova] Creating event network-vif-plugged:06c1d4f8-d555-478d-9923-73caa8771882 for instance 4d98192d-dabe-4541-b7c6-c057e4269d64 on n-h1-847009-3 Jul 19 22:54:33.382830 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-1e96d353-8cef-4ea0-a10f-a6dc2715a5e9 req-f72fe713-4680-4334-8372-47224b10ec21 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077271 Jul 19 22:54:33.388931 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2534/5059] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:54:34.280390 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6974b3b6-e218-404e-8202-dcba9d7cda11 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:34.281433 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6974b3b6-e218-404e-8202-dcba9d7cda11 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:34.293606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6974b3b6-e218-404e-8202-dcba9d7cda11 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:34.294053 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6974b3b6-e218-404e-8202-dcba9d7cda11 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:34.294833 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6974b3b6-e218-404e-8202-dcba9d7cda11 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:34.295300 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6974b3b6-e218-404e-8202-dcba9d7cda11 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:34.414442 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6974b3b6-e218-404e-8202-dcba9d7cda11 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138265 Jul 19 22:54:34.418763 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2535/5060] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:54:34 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:54:34.523954 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a3cd200c-ee51-4714-a04b-79d5ad2f7cb1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:34.533225 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a3cd200c-ee51-4714-a04b-79d5ad2f7cb1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:34.534767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a3cd200c-ee51-4714-a04b-79d5ad2f7cb1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:34.536057 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a3cd200c-ee51-4714-a04b-79d5ad2f7cb1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1738 microversion: 2.20 time: 1.569051 Jul 19 22:54:34.554071 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2526/5061] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:54:32 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1738 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:54:35.430497 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5cd91379-441d-4d90-896f-b8decfaea932 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:35.431844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5cd91379-441d-4d90-896f-b8decfaea932 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:35.464802 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5cd91379-441d-4d90-896f-b8decfaea932 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:35.465285 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5cd91379-441d-4d90-896f-b8decfaea932 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:35.472456 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5cd91379-441d-4d90-896f-b8decfaea932 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:35.476326 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5cd91379-441d-4d90-896f-b8decfaea932 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:35.559219 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d04cc743-86c3-4ff5-926c-9f7b567c102b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:35.560658 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d04cc743-86c3-4ff5-926c-9f7b567c102b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:35.586051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d04cc743-86c3-4ff5-926c-9f7b567c102b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:35.587876 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d04cc743-86c3-4ff5-926c-9f7b567c102b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:35.590752 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d04cc743-86c3-4ff5-926c-9f7b567c102b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:35.593238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d04cc743-86c3-4ff5-926c-9f7b567c102b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:35.613514 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5cd91379-441d-4d90-896f-b8decfaea932 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.189656 Jul 19 22:54:35.622243 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2536/5062] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:54:35 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:54:36.217608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d04cc743-86c3-4ff5-926c-9f7b567c102b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:36.245275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d04cc743-86c3-4ff5-926c-9f7b567c102b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:36.249221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d04cc743-86c3-4ff5-926c-9f7b567c102b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:36.252363 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d04cc743-86c3-4ff5-926c-9f7b567c102b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1738 microversion: 2.20 time: 0.699089 Jul 19 22:54:36.253835 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2527/5063] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:54:35 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1738 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:54:36.626352 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fcde4763-238d-4142-a558-00abf5173d6b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:36.628301 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fcde4763-238d-4142-a558-00abf5173d6b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:36.646049 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fcde4763-238d-4142-a558-00abf5173d6b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:36.647262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fcde4763-238d-4142-a558-00abf5173d6b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:36.648242 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fcde4763-238d-4142-a558-00abf5173d6b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:36.648855 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fcde4763-238d-4142-a558-00abf5173d6b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:36.730210 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fcde4763-238d-4142-a558-00abf5173d6b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.108145 Jul 19 22:54:36.739748 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2537/5064] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:54:36 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0/os-volume_attachments => generated 25 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:54:36.937458 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9ce26a2c-685b-45bb-982d-f37ade129023 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:36.938716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9ce26a2c-685b-45bb-982d-f37ade129023 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:36.956629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ce26a2c-685b-45bb-982d-f37ade129023 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:36.958833 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ce26a2c-685b-45bb-982d-f37ade129023 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:36.963346 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ce26a2c-685b-45bb-982d-f37ade129023 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:36.965703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ce26a2c-685b-45bb-982d-f37ade129023 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:37.030257 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9ce26a2c-685b-45bb-982d-f37ade129023 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:54:37.274631 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4c541402-61ab-4fcc-ba52-3a255848c77a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:37.275662 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4c541402-61ab-4fcc-ba52-3a255848c77a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:37.284402 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9ce26a2c-685b-45bb-982d-f37ade129023 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0" status: 204 len: 0 microversion: 2.1 time: 0.350518 Jul 19 22:54:37.285693 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2528/5065] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:54:36 2022] DELETE /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:54:37.301122 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-54b14bc0-cb04-44fb-8227-cacc62b60a65 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:37.301613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c541402-61ab-4fcc-ba52-3a255848c77a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:37.302457 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c541402-61ab-4fcc-ba52-3a255848c77a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:37.314167 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c541402-61ab-4fcc-ba52-3a255848c77a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:37.314677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-54b14bc0-cb04-44fb-8227-cacc62b60a65 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:37.315023 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c541402-61ab-4fcc-ba52-3a255848c77a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:37.338958 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54b14bc0-cb04-44fb-8227-cacc62b60a65 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:37.341332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54b14bc0-cb04-44fb-8227-cacc62b60a65 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:37.345104 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54b14bc0-cb04-44fb-8227-cacc62b60a65 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:37.346816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54b14bc0-cb04-44fb-8227-cacc62b60a65 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:38.403714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4c541402-61ab-4fcc-ba52-3a255848c77a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:38.419596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4c541402-61ab-4fcc-ba52-3a255848c77a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:38.421448 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4c541402-61ab-4fcc-ba52-3a255848c77a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:38.422682 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4c541402-61ab-4fcc-ba52-3a255848c77a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1738 microversion: 2.20 time: 1.154428 Jul 19 22:54:38.423307 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2538/5066] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:54:37 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1738 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:54:38.442806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-54b14bc0-cb04-44fb-8227-cacc62b60a65 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:38.463558 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-54b14bc0-cb04-44fb-8227-cacc62b60a65 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0" status: 200 len: 1678 microversion: 2.1 time: 1.164703 Jul 19 22:54:38.466809 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2529/5067] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:54:37 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0 => generated 1678 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:54:39.441622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0dfeb8df-56ee-4ca3-bad9-8c822e992142 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:39.442237 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0dfeb8df-56ee-4ca3-bad9-8c822e992142 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:39.451070 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0dfeb8df-56ee-4ca3-bad9-8c822e992142 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:39.470986 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0dfeb8df-56ee-4ca3-bad9-8c822e992142 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:39.471877 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0dfeb8df-56ee-4ca3-bad9-8c822e992142 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:39.472326 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0dfeb8df-56ee-4ca3-bad9-8c822e992142 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:39.483649 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3245fe56-9d61-4662-8be9-89b8160773ee tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:39.485195 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3245fe56-9d61-4662-8be9-89b8160773ee tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:39.508376 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3245fe56-9d61-4662-8be9-89b8160773ee tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:39.515495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3245fe56-9d61-4662-8be9-89b8160773ee tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:39.517207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3245fe56-9d61-4662-8be9-89b8160773ee tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:39.523451 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3245fe56-9d61-4662-8be9-89b8160773ee tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:40.975219 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3245fe56-9d61-4662-8be9-89b8160773ee tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:40.977309 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0dfeb8df-56ee-4ca3-bad9-8c822e992142 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:40.989512 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0dfeb8df-56ee-4ca3-bad9-8c822e992142 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:40.998473 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0dfeb8df-56ee-4ca3-bad9-8c822e992142 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:40.999223 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3245fe56-9d61-4662-8be9-89b8160773ee tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0" status: 200 len: 1678 microversion: 2.1 time: 1.519276 Jul 19 22:54:41.004462 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2530/5068] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:54:39 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0 => generated 1678 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:54:41.009442 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0dfeb8df-56ee-4ca3-bad9-8c822e992142 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1738 microversion: 2.20 time: 1.567733 Jul 19 22:54:41.013067 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2539/5069] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:54:39 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1738 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:54:42.022939 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5045b850-5b38-4dfe-9bf8-fabfce671ef4 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:42.024223 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5045b850-5b38-4dfe-9bf8-fabfce671ef4 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:42.034027 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a0cdeb47-6f1c-4183-acd2-ae45cf8a3487 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:42.039865 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a0cdeb47-6f1c-4183-acd2-ae45cf8a3487 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:42.057141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0cdeb47-6f1c-4183-acd2-ae45cf8a3487 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:42.057604 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0cdeb47-6f1c-4183-acd2-ae45cf8a3487 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:42.058397 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0cdeb47-6f1c-4183-acd2-ae45cf8a3487 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:42.058835 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0cdeb47-6f1c-4183-acd2-ae45cf8a3487 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:42.067645 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5045b850-5b38-4dfe-9bf8-fabfce671ef4 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:42.071766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5045b850-5b38-4dfe-9bf8-fabfce671ef4 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:42.072966 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5045b850-5b38-4dfe-9bf8-fabfce671ef4 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:42.075352 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5045b850-5b38-4dfe-9bf8-fabfce671ef4 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:42.886275 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a0cdeb47-6f1c-4183-acd2-ae45cf8a3487 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:42.901038 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a0cdeb47-6f1c-4183-acd2-ae45cf8a3487 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:42.904620 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a0cdeb47-6f1c-4183-acd2-ae45cf8a3487 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:42.922911 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a0cdeb47-6f1c-4183-acd2-ae45cf8a3487 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1738 microversion: 2.20 time: 0.892631 Jul 19 22:54:42.930239 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2540/5070] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:54:42 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1738 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:54:43.009924 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5045b850-5b38-4dfe-9bf8-fabfce671ef4 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:43.022166 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5045b850-5b38-4dfe-9bf8-fabfce671ef4 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0" status: 200 len: 1678 microversion: 2.1 time: 1.004004 Jul 19 22:54:43.031218 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2531/5071] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:54:42 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0 => generated 1678 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:54:43.858196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-f19cacf7-39e5-4aa6-aece-8358d8d64641 req-10c6527e-2bd6-43bc-9c69-d548997cab95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9abb6a36-c31b-445c-a137-5fb74eb368b0", "name": "network-vif-unplugged", "status": "completed", "tag": "ef30cd4a-04ef-46eb-b574-da106e2cb77a"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:54:43.885029 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-f19cacf7-39e5-4aa6-aece-8358d8d64641 req-10c6527e-2bd6-43bc-9c69-d548997cab95 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:43.887821 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-f19cacf7-39e5-4aa6-aece-8358d8d64641 req-10c6527e-2bd6-43bc-9c69-d548997cab95 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:43.948937 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ab2fe125-5c7c-4218-8655-51d607952b33 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:43.949567 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ab2fe125-5c7c-4218-8655-51d607952b33 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:43.957104 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-f19cacf7-39e5-4aa6-aece-8358d8d64641 req-10c6527e-2bd6-43bc-9c69-d548997cab95 service nova] Creating event network-vif-unplugged:ef30cd4a-04ef-46eb-b574-da106e2cb77a for instance 9abb6a36-c31b-445c-a137-5fb74eb368b0 on n-h2-847009-3 Jul 19 22:54:43.987595 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-f19cacf7-39e5-4aa6-aece-8358d8d64641 req-10c6527e-2bd6-43bc-9c69-d548997cab95 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138021 Jul 19 22:54:43.991025 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab2fe125-5c7c-4218-8655-51d607952b33 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:43.992987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab2fe125-5c7c-4218-8655-51d607952b33 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:43.993650 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2541/5072] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:54:43.997946 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab2fe125-5c7c-4218-8655-51d607952b33 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:43.998842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab2fe125-5c7c-4218-8655-51d607952b33 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:44.059281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-aec38f84-93cc-4696-a9f1-b5eb1110df6f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:44.060344 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-aec38f84-93cc-4696-a9f1-b5eb1110df6f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:44.080805 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aec38f84-93cc-4696-a9f1-b5eb1110df6f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:44.083934 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aec38f84-93cc-4696-a9f1-b5eb1110df6f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:44.085708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aec38f84-93cc-4696-a9f1-b5eb1110df6f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:44.088703 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aec38f84-93cc-4696-a9f1-b5eb1110df6f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:44.120506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:54:44.571695 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-aec38f84-93cc-4696-a9f1-b5eb1110df6f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:44.579758 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-aec38f84-93cc-4696-a9f1-b5eb1110df6f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0" status: 200 len: 1612 microversion: 2.1 time: 0.538018 Jul 19 22:54:44.596960 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2542/5073] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:54:44 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0 => generated 1612 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:54:45.070546 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ab2fe125-5c7c-4218-8655-51d607952b33 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:45.088054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ab2fe125-5c7c-4218-8655-51d607952b33 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:45.095446 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ab2fe125-5c7c-4218-8655-51d607952b33 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:45.096941 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ab2fe125-5c7c-4218-8655-51d607952b33 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1738 microversion: 2.20 time: 1.154968 Jul 19 22:54:45.107819 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2532/5074] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:54:43 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1738 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:54:45.350072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d798c70c-d6d0-4b82-9ed3-113d66e02297 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:54:45.352220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d798c70c-d6d0-4b82-9ed3-113d66e02297 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:45.372301 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d798c70c-d6d0-4b82-9ed3-113d66e02297 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:45.387884 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d798c70c-d6d0-4b82-9ed3-113d66e02297 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:45.397750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d798c70c-d6d0-4b82-9ed3-113d66e02297 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:45.398597 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d798c70c-d6d0-4b82-9ed3-113d66e02297 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:45.506295 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d798c70c-d6d0-4b82-9ed3-113d66e02297 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "POST /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7/action" status: 200 len: 24554 microversion: 2.1 time: 0.160535 Jul 19 22:54:45.508537 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2543/5075] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:54:45 2022] POST /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7/action => generated 24554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:54:45.602829 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-75a6b338-6f06-4827-8299-9ef76cce015f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:45.605922 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-75a6b338-6f06-4827-8299-9ef76cce015f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:45.622127 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75a6b338-6f06-4827-8299-9ef76cce015f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:45.626904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75a6b338-6f06-4827-8299-9ef76cce015f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:45.632230 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75a6b338-6f06-4827-8299-9ef76cce015f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:45.633003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75a6b338-6f06-4827-8299-9ef76cce015f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:45.847775 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-75a6b338-6f06-4827-8299-9ef76cce015f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:45.866489 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-75a6b338-6f06-4827-8299-9ef76cce015f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0" status: 200 len: 1612 microversion: 2.1 time: 0.263465 Jul 19 22:54:45.869138 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2533/5076] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:54:45 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0 => generated 1612 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:54:46.117241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ae6ea0cb-213e-4eef-b359-a913570bd23d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:46.118038 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ae6ea0cb-213e-4eef-b359-a913570bd23d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:46.133031 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae6ea0cb-213e-4eef-b359-a913570bd23d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:46.136682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae6ea0cb-213e-4eef-b359-a913570bd23d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:46.138627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae6ea0cb-213e-4eef-b359-a913570bd23d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:46.139094 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae6ea0cb-213e-4eef-b359-a913570bd23d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:46.551015 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ae6ea0cb-213e-4eef-b359-a913570bd23d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:46.583647 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ae6ea0cb-213e-4eef-b359-a913570bd23d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:46.589013 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ae6ea0cb-213e-4eef-b359-a913570bd23d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:46.593846 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ae6ea0cb-213e-4eef-b359-a913570bd23d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1738 microversion: 2.20 time: 0.480206 Jul 19 22:54:46.608047 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2544/5077] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:54:46 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1738 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:54:46.650645 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-efad9116-4eb9-4b71-8f48-68007fde65d1 req-2868113b-616e-4147-b561-bc62bdd713c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9abb6a36-c31b-445c-a137-5fb74eb368b0", "name": "network-vif-deleted", "tag": "ef30cd4a-04ef-46eb-b574-da106e2cb77a"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:54:46.700864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-efad9116-4eb9-4b71-8f48-68007fde65d1 req-2868113b-616e-4147-b561-bc62bdd713c9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:46.703927 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-efad9116-4eb9-4b71-8f48-68007fde65d1 req-2868113b-616e-4147-b561-bc62bdd713c9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:46.757026 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-efad9116-4eb9-4b71-8f48-68007fde65d1 req-2868113b-616e-4147-b561-bc62bdd713c9 service nova] Creating event network-vif-deleted:ef30cd4a-04ef-46eb-b574-da106e2cb77a for instance 9abb6a36-c31b-445c-a137-5fb74eb368b0 on n-h2-847009-3 Jul 19 22:54:46.800559 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-efad9116-4eb9-4b71-8f48-68007fde65d1 req-2868113b-616e-4147-b561-bc62bdd713c9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171005 Jul 19 22:54:46.804348 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2534/5078] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:54:46.884984 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-142e5c95-3232-4190-ad4c-1ffcd7422e74 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:46.886988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-142e5c95-3232-4190-ad4c-1ffcd7422e74 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:46.904381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-142e5c95-3232-4190-ad4c-1ffcd7422e74 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:46.905339 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-142e5c95-3232-4190-ad4c-1ffcd7422e74 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:46.907852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-142e5c95-3232-4190-ad4c-1ffcd7422e74 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:46.909707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-142e5c95-3232-4190-ad4c-1ffcd7422e74 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:46.923903 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:54:46.999522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-142e5c95-3232-4190-ad4c-1ffcd7422e74 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:47.001636 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-142e5c95-3232-4190-ad4c-1ffcd7422e74 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:47.003005 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-142e5c95-3232-4190-ad4c-1ffcd7422e74 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lazy-loading 'fault' on Instance uuid 9abb6a36-c31b-445c-a137-5fb74eb368b0 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:54:47.461659 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-142e5c95-3232-4190-ad4c-1ffcd7422e74 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:47.481152 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-142e5c95-3232-4190-ad4c-1ffcd7422e74 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0" status: 200 len: 1330 microversion: 2.1 time: 0.595701 Jul 19 22:54:47.481820 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2545/5079] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:54:46 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0 => generated 1330 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:54:47.613713 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-56677240-5769-45dd-8e42-f11e5a3a6268 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:47.614421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-56677240-5769-45dd-8e42-f11e5a3a6268 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:47.626072 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56677240-5769-45dd-8e42-f11e5a3a6268 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:47.626531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56677240-5769-45dd-8e42-f11e5a3a6268 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:47.627409 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56677240-5769-45dd-8e42-f11e5a3a6268 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:47.638914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56677240-5769-45dd-8e42-f11e5a3a6268 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:48.039387 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-56677240-5769-45dd-8e42-f11e5a3a6268 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:48.054982 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-56677240-5769-45dd-8e42-f11e5a3a6268 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:48.057409 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-56677240-5769-45dd-8e42-f11e5a3a6268 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:48.063568 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-56677240-5769-45dd-8e42-f11e5a3a6268 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1738 microversion: 2.20 time: 0.449770 Jul 19 22:54:48.076111 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2535/5080] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:54:47 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1738 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:54:48.499463 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-000d9fb8-68e2-4121-906d-8e1fcd783a55 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:48.500080 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-000d9fb8-68e2-4121-906d-8e1fcd783a55 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:48.514067 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-000d9fb8-68e2-4121-906d-8e1fcd783a55 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:48.514739 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-000d9fb8-68e2-4121-906d-8e1fcd783a55 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:48.515921 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-000d9fb8-68e2-4121-906d-8e1fcd783a55 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:48.518702 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-000d9fb8-68e2-4121-906d-8e1fcd783a55 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:48.549050 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-000d9fb8-68e2-4121-906d-8e1fcd783a55 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] HTTP exception thrown: Instance 9abb6a36-c31b-445c-a137-5fb74eb368b0 could not be found. Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-000d9fb8-68e2-4121-906d-8e1fcd783a55 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Request method failure captured: Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0 HTTP/1.1 Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zVsSOX-O7ggDcH00KLmZx8wOtg3S3Su8gJRQI2lYa4BxC-OxvaOKnPb2I4UGxeYv7AyyS8e-HsUydLYlXpELI3RwSo4aU8bY9u8sE-NNAsyuAsZv_PYlNBhbG0F8quyfyoOYST6GA8Fbv-UJaQmRhd0xcvaUwo2b-fKMEkbL-YV9Cg Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: c3929e62eb4345f8a69fec37ba7c195f Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 9abb6a36-c31b-445c-a137-5fb74eb368b0 could not be found. Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '9abb6a36-c31b-445c-a137-5fb74eb368b0'} Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9abb6a36-c31b-445c-a137-5fb74eb368b0 could not be found. Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:54:48.551012 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:54:48.638182 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:54:48.638182 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:54:48.638182 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:54:48.638182 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:54:48.638182 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:54:48.638182 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9abb6a36-c31b-445c-a137-5fb74eb368b0 could not be found. Jul 19 22:54:48.638182 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:54:48.638182 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-000d9fb8-68e2-4121-906d-8e1fcd783a55 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Returning 404 to user: Instance 9abb6a36-c31b-445c-a137-5fb74eb368b0 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:54:48.638182 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-000d9fb8-68e2-4121-906d-8e1fcd783a55 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0" status: 404 len: 111 microversion: 2.1 time: 0.072133 Jul 19 22:54:48.638182 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2546/5081] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:54:48 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:54:48.641183 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3067b053-8a01-4fc1-a447-8967b95364e8 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '.version_select at 0x7f7a10553430>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:48.641183 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3067b053-8a01-4fc1-a447-8967b95364e8 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-957729495" status: 202 len: 0 microversion: 2.1 time: 0.055052 Jul 19 22:54:48.641183 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2536/5082] 10.222.0.25 () {58 vars in 1217 bytes} [Tue Jul 19 22:54:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-957729495 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:54:49.090434 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f49d116d-2f49-457e-8163-2c573cc2be84 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:49.092095 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f49d116d-2f49-457e-8163-2c573cc2be84 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:49.127768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f49d116d-2f49-457e-8163-2c573cc2be84 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:49.128230 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f49d116d-2f49-457e-8163-2c573cc2be84 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:49.133985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f49d116d-2f49-457e-8163-2c573cc2be84 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:49.155037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f49d116d-2f49-457e-8163-2c573cc2be84 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:51.015051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fbf09fe3-941b-4df2-9d57-5d844be1b5e6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Action: 'create', calling method: .version_select at 0x7f7a103b3ee0>, body: {"keypair": {"name": "tempest-keypair-982002736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDhzUD/6IP39V472HBLGkgKOSKvf6SMtfbbYACOSL0l712pAETv80lb3rL57oRpZyYL0RhpM362u5gbEP+seRSAPMBB+LVbvIkd+PZnWkUGJ8u2iN3VGVBYx8Je6q/05A=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:54:51.036678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-fbf09fe3-941b-4df2-9d57-5d844be1b5e6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Getting quotas for project e3b759a0bda64e3c9df38b624d4145b6. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:54:51.044729 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-fbf09fe3-941b-4df2-9d57-5d844be1b5e6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Getting quotas for user c3929e62eb4345f8a69fec37ba7c195f and project e3b759a0bda64e3c9df38b624d4145b6. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:54:51.109852 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fbf09fe3-941b-4df2-9d57-5d844be1b5e6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.099690 Jul 19 22:54:51.111993 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2537/5083] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:54:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:54:51.220464 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f49d116d-2f49-457e-8163-2c573cc2be84 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:51.262105 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f49d116d-2f49-457e-8163-2c573cc2be84 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:51.286032 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f49d116d-2f49-457e-8163-2c573cc2be84 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:51.310625 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f49d116d-2f49-457e-8163-2c573cc2be84 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1738 microversion: 2.20 time: 2.221870 Jul 19 22:54:51.316001 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2547/5084] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:54:49 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1738 bytes in 2232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:54:52.332182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aaa402fd-027c-467f-b384-5b1d476605c6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:52.333388 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-aaa402fd-027c-467f-b384-5b1d476605c6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:52.365769 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aaa402fd-027c-467f-b384-5b1d476605c6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:52.367286 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aaa402fd-027c-467f-b384-5b1d476605c6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:52.374394 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aaa402fd-027c-467f-b384-5b1d476605c6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:52.375249 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aaa402fd-027c-467f-b384-5b1d476605c6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:52.928490 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-aaa402fd-027c-467f-b384-5b1d476605c6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:52.948918 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-aaa402fd-027c-467f-b384-5b1d476605c6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:52.951206 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-aaa402fd-027c-467f-b384-5b1d476605c6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:52.952473 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-aaa402fd-027c-467f-b384-5b1d476605c6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1738 microversion: 2.20 time: 0.626608 Jul 19 22:54:52.966083 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2538/5085] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:54:52 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1738 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:54:53.971854 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b5df42a7-4071-424f-8f8e-d23de660fb53 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:53.973171 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b5df42a7-4071-424f-8f8e-d23de660fb53 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:53.985324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b5df42a7-4071-424f-8f8e-d23de660fb53 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:53.989375 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b5df42a7-4071-424f-8f8e-d23de660fb53 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:53.995884 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b5df42a7-4071-424f-8f8e-d23de660fb53 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:53.999831 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b5df42a7-4071-424f-8f8e-d23de660fb53 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:55.387789 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b5df42a7-4071-424f-8f8e-d23de660fb53 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:55.399398 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b5df42a7-4071-424f-8f8e-d23de660fb53 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:55.403859 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b5df42a7-4071-424f-8f8e-d23de660fb53 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:55.406388 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b5df42a7-4071-424f-8f8e-d23de660fb53 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1738 microversion: 2.20 time: 1.438539 Jul 19 22:54:55.420784 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2548/5086] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:54:53 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1738 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:54:56.427089 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-696053c6-9ae7-4a5c-855a-fe684020f46e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:56.429445 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-696053c6-9ae7-4a5c-855a-fe684020f46e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:56.442734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:54:56.447333 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-696053c6-9ae7-4a5c-855a-fe684020f46e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:56.449945 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-696053c6-9ae7-4a5c-855a-fe684020f46e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:56.452249 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-696053c6-9ae7-4a5c-855a-fe684020f46e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:56.455811 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-696053c6-9ae7-4a5c-855a-fe684020f46e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:56.494041 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0b04aa08-50cd-43cb-9a5a-0aaf0487998a tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:56.502775 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0b04aa08-50cd-43cb-9a5a-0aaf0487998a tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:56.537891 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0b04aa08-50cd-43cb-9a5a-0aaf0487998a tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:56.544167 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0b04aa08-50cd-43cb-9a5a-0aaf0487998a tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:56.546465 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0b04aa08-50cd-43cb-9a5a-0aaf0487998a tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:56.551772 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0b04aa08-50cd-43cb-9a5a-0aaf0487998a tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:57.096392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-696053c6-9ae7-4a5c-855a-fe684020f46e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:57.117221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-696053c6-9ae7-4a5c-855a-fe684020f46e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:57.119859 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-696053c6-9ae7-4a5c-855a-fe684020f46e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:57.124798 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-696053c6-9ae7-4a5c-855a-fe684020f46e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1738 microversion: 2.20 time: 0.701422 Jul 19 22:54:57.125616 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2539/5087] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:54:56 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1738 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:54:57.984913 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-33b005a7-f36f-4d59-bd1d-3d04f23cb388 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1491696250", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d10914df-2da2-4f58-98fa-60d9a22bab41"}], "security_groups": [{"name": "tempest-securitygroup--1070135645"}], "key_name": "tempest-keypair-982002736", "user_data": "}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:54:58.107520 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0b04aa08-50cd-43cb-9a5a-0aaf0487998a tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1834 microversion: 2.1 time: 1.621801 Jul 19 22:54:58.129880 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2549/5088] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:54:56 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1834 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:54:58.156655 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-502a96ec-3d1e-46e8-abd4-c8aecd427b47 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:58.169180 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-502a96ec-3d1e-46e8-abd4-c8aecd427b47 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:58.199568 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=46 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:54:58.202171 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-502a96ec-3d1e-46e8-abd4-c8aecd427b47 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:58.202966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-502a96ec-3d1e-46e8-abd4-c8aecd427b47 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:58.204304 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-502a96ec-3d1e-46e8-abd4-c8aecd427b47 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:58.205922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-502a96ec-3d1e-46e8-abd4-c8aecd427b47 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:58.610835 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-33b005a7-f36f-4d59-bd1d-3d04f23cb388 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] validate_networks() for [('d10914df-2da2-4f58-98fa-60d9a22bab41', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:54:58.767541 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-502a96ec-3d1e-46e8-abd4-c8aecd427b47 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:54:58.777260 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-502a96ec-3d1e-46e8-abd4-c8aecd427b47 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1683 microversion: 2.1 time: 0.645652 Jul 19 22:54:58.783898 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2550/5089] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:54:58 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1683 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:54:58.795621 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b12e9c76-f745-411a-b60d-7e0bcc85410d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:54:58.805413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b12e9c76-f745-411a-b60d-7e0bcc85410d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:54:58.820855 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b12e9c76-f745-411a-b60d-7e0bcc85410d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:58.821315 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b12e9c76-f745-411a-b60d-7e0bcc85410d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:54:58.822100 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b12e9c76-f745-411a-b60d-7e0bcc85410d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:54:58.823631 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b12e9c76-f745-411a-b60d-7e0bcc85410d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:00.271733 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b12e9c76-f745-411a-b60d-7e0bcc85410d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:00.290923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b12e9c76-f745-411a-b60d-7e0bcc85410d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:00.304981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b12e9c76-f745-411a-b60d-7e0bcc85410d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:00.311702 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b12e9c76-f745-411a-b60d-7e0bcc85410d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1738 microversion: 2.20 time: 1.519822 Jul 19 22:55:00.315794 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2551/5090] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:54:58 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1738 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:55:00.334497 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8d1f5f6c-b46e-4e2d-86a9-7edc06b1c6a5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:55:00.342015 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8d1f5f6c-b46e-4e2d-86a9-7edc06b1c6a5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:00.362842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8d1f5f6c-b46e-4e2d-86a9-7edc06b1c6a5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:00.366844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8d1f5f6c-b46e-4e2d-86a9-7edc06b1c6a5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:00.367861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8d1f5f6c-b46e-4e2d-86a9-7edc06b1c6a5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:00.370164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8d1f5f6c-b46e-4e2d-86a9-7edc06b1c6a5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:00.466264 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8d1f5f6c-b46e-4e2d-86a9-7edc06b1c6a5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "POST /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7/action" status: 200 len: 32629 microversion: 2.1 time: 0.144703 Jul 19 22:55:00.467900 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2552/5091] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:55:00 2022] POST /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7/action => generated 32629 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:55:00.627341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eff7a3a6-1fc6-4ca5-87fb-ef2db1b1e7fd tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:55:00.628503 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eff7a3a6-1fc6-4ca5-87fb-ef2db1b1e7fd tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:00.646918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eff7a3a6-1fc6-4ca5-87fb-ef2db1b1e7fd tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:00.648815 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eff7a3a6-1fc6-4ca5-87fb-ef2db1b1e7fd tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:00.652084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eff7a3a6-1fc6-4ca5-87fb-ef2db1b1e7fd tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:00.652806 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eff7a3a6-1fc6-4ca5-87fb-ef2db1b1e7fd tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:01.024946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-eff7a3a6-1fc6-4ca5-87fb-ef2db1b1e7fd tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd648d35ad2544e69904cc3059170e34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96548038e0144d998b7b8b98145e00db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:01.025811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eff7a3a6-1fc6-4ca5-87fb-ef2db1b1e7fd tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] flavor_id is None. Assuming migration. {{(pid=119337) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 19 22:55:01.026757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eff7a3a6-1fc6-4ca5-87fb-ef2db1b1e7fd tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119337) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 22:55:01.075243 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:55:01.649734 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eff7a3a6-1fc6-4ca5-87fb-ef2db1b1e7fd tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7/action" status: 202 len: 0 microversion: 2.1 time: 1.025939 Jul 19 22:55:01.656588 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2553/5092] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:55:00 2022] POST /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7/action => generated 0 bytes in 1035 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:55:01.670661 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4c570d12-f5c9-48f7-9277-778fca57e385 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:01.671782 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4c570d12-f5c9-48f7-9277-778fca57e385 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:01.720645 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c570d12-f5c9-48f7-9277-778fca57e385 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:01.721226 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c570d12-f5c9-48f7-9277-778fca57e385 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:01.723308 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c570d12-f5c9-48f7-9277-778fca57e385 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:01.725405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c570d12-f5c9-48f7-9277-778fca57e385 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:01.906601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-33b005a7-f36f-4d59-bd1d-3d04f23cb388 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:55:01.907038 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-33b005a7-f36f-4d59-bd1d-3d04f23cb388 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:55:01.907858 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-33b005a7-f36f-4d59-bd1d-3d04f23cb388 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:55:01.908430 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-33b005a7-f36f-4d59-bd1d-3d04f23cb388 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:55:01.909023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-33b005a7-f36f-4d59-bd1d-3d04f23cb388 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:55:01.938128 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-33b005a7-f36f-4d59-bd1d-3d04f23cb388 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:01.944644 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-33b005a7-f36f-4d59-bd1d-3d04f23cb388 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:01.945835 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-33b005a7-f36f-4d59-bd1d-3d04f23cb388 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:01.946456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-33b005a7-f36f-4d59-bd1d-3d04f23cb388 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:02.029015 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-33b005a7-f36f-4d59-bd1d-3d04f23cb388 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Getting quotas for project e3b759a0bda64e3c9df38b624d4145b6. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:55:02.050616 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-33b005a7-f36f-4d59-bd1d-3d04f23cb388 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Getting quotas for user c3929e62eb4345f8a69fec37ba7c195f and project e3b759a0bda64e3c9df38b624d4145b6. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:55:02.125066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-33b005a7-f36f-4d59-bd1d-3d04f23cb388 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:55:02.127521 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-33b005a7-f36f-4d59-bd1d-3d04f23cb388 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:55:02.281888 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-33b005a7-f36f-4d59-bd1d-3d04f23cb388 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.304332 Jul 19 22:55:02.283546 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2540/5093] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:54:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 4306 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:55:02.312392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d2e3dc7f-cbe0-4d61-9fa8-dad3c4f9e420 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:02.313608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d2e3dc7f-cbe0-4d61-9fa8-dad3c4f9e420 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:02.335846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2e3dc7f-cbe0-4d61-9fa8-dad3c4f9e420 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:02.336545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2e3dc7f-cbe0-4d61-9fa8-dad3c4f9e420 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:02.349333 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2e3dc7f-cbe0-4d61-9fa8-dad3c4f9e420 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:02.350181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2e3dc7f-cbe0-4d61-9fa8-dad3c4f9e420 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:02.627396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4c570d12-f5c9-48f7-9277-778fca57e385 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:02.637771 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4c570d12-f5c9-48f7-9277-778fca57e385 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:02.650108 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4c570d12-f5c9-48f7-9277-778fca57e385 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:02.654155 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4c570d12-f5c9-48f7-9277-778fca57e385 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1738 microversion: 2.20 time: 0.995737 Jul 19 22:55:02.658471 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2554/5094] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:01 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1738 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:55:02.671983 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-40de8d38-3014-42c1-ba86-3990305119aa tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:02.675964 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-40de8d38-3014-42c1-ba86-3990305119aa tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:04.221499 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-40de8d38-3014-42c1-ba86-3990305119aa tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:04.234101 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-40de8d38-3014-42c1-ba86-3990305119aa tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb" status: 200 len: 1241 microversion: 2.1 time: 1.573764 Jul 19 22:55:04.246877 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2555/5095] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:02 2022] GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb => generated 1241 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:04.258350 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8a774a65-8c48-442c-b5d5-b2e7956fab55 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:04.261419 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8a774a65-8c48-442c-b5d5-b2e7956fab55 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:04.277091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a774a65-8c48-442c-b5d5-b2e7956fab55 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:04.277986 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a774a65-8c48-442c-b5d5-b2e7956fab55 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:04.279406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a774a65-8c48-442c-b5d5-b2e7956fab55 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:04.280164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a774a65-8c48-442c-b5d5-b2e7956fab55 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:04.846416 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d2e3dc7f-cbe0-4d61-9fa8-dad3c4f9e420 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:04.878686 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d2e3dc7f-cbe0-4d61-9fa8-dad3c4f9e420 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1692 microversion: 2.1 time: 2.588236 Jul 19 22:55:04.883215 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2541/5096] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:02 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1692 bytes in 2600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:05.214377 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-4fc5d277-b176-43bf-9a20-712ea2b0790e req-a88b7cb3-5d1f-470a-94b5-3307a50afe1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d98192d-dabe-4541-b7c6-c057e4269d64", "name": "network-vif-unplugged", "status": "completed", "tag": "06c1d4f8-d555-478d-9923-73caa8771882"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:55:05.278653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-4fc5d277-b176-43bf-9a20-712ea2b0790e req-a88b7cb3-5d1f-470a-94b5-3307a50afe1f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:05.279660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-4fc5d277-b176-43bf-9a20-712ea2b0790e req-a88b7cb3-5d1f-470a-94b5-3307a50afe1f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:05.360996 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-4fc5d277-b176-43bf-9a20-712ea2b0790e req-a88b7cb3-5d1f-470a-94b5-3307a50afe1f service nova] Creating event network-vif-unplugged:06c1d4f8-d555-478d-9923-73caa8771882 for instance 4d98192d-dabe-4541-b7c6-c057e4269d64 on n-h1-847009-3 Jul 19 22:55:05.372046 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-4fc5d277-b176-43bf-9a20-712ea2b0790e req-a88b7cb3-5d1f-470a-94b5-3307a50afe1f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.166825 Jul 19 22:55:05.374473 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2542/5097] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:55:05.391594 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0cc6357b-bc02-420c-ab9b-c61c8b134d91 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:05.394565 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0cc6357b-bc02-420c-ab9b-c61c8b134d91 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:05.412789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cc6357b-bc02-420c-ab9b-c61c8b134d91 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:05.414729 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cc6357b-bc02-420c-ab9b-c61c8b134d91 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:05.415817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cc6357b-bc02-420c-ab9b-c61c8b134d91 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:05.420042 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cc6357b-bc02-420c-ab9b-c61c8b134d91 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:05.665881 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8a774a65-8c48-442c-b5d5-b2e7956fab55 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:05.679911 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8a774a65-8c48-442c-b5d5-b2e7956fab55 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:05.684956 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8a774a65-8c48-442c-b5d5-b2e7956fab55 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:05.687755 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8a774a65-8c48-442c-b5d5-b2e7956fab55 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1720 microversion: 2.20 time: 1.438438 Jul 19 22:55:05.688544 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2556/5098] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:04 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1720 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:55:05.761887 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0cc6357b-bc02-420c-ab9b-c61c8b134d91 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:05.775566 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0cc6357b-bc02-420c-ab9b-c61c8b134d91 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb" status: 200 len: 1299 microversion: 2.1 time: 0.394129 Jul 19 22:55:05.778753 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2543/5099] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:05 2022] GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb => generated 1299 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:05.903170 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b79fa75e-953c-44b2-9bf1-f15ab86d300b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:05.903953 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b79fa75e-953c-44b2-9bf1-f15ab86d300b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:05.916330 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b79fa75e-953c-44b2-9bf1-f15ab86d300b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:05.917578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b79fa75e-953c-44b2-9bf1-f15ab86d300b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:05.920368 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b79fa75e-953c-44b2-9bf1-f15ab86d300b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:05.921934 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b79fa75e-953c-44b2-9bf1-f15ab86d300b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:06.720925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fdc62450-5c85-449e-8e2d-75ac43cf4ebf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:06.724242 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fdc62450-5c85-449e-8e2d-75ac43cf4ebf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:06.734835 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fdc62450-5c85-449e-8e2d-75ac43cf4ebf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:06.735576 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fdc62450-5c85-449e-8e2d-75ac43cf4ebf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:06.736517 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fdc62450-5c85-449e-8e2d-75ac43cf4ebf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:06.737100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fdc62450-5c85-449e-8e2d-75ac43cf4ebf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:06.796793 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b79fa75e-953c-44b2-9bf1-f15ab86d300b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:06.812358 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b79fa75e-953c-44b2-9bf1-f15ab86d300b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1692 microversion: 2.1 time: 0.912633 Jul 19 22:55:06.826949 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2557/5100] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:05 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1692 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:06.843243 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-937f4d33-ef1b-412f-b6dc-f4a3d5bf9ced tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:06.845102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-937f4d33-ef1b-412f-b6dc-f4a3d5bf9ced tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:06.852547 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-937f4d33-ef1b-412f-b6dc-f4a3d5bf9ced tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:06.853251 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-937f4d33-ef1b-412f-b6dc-f4a3d5bf9ced tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:06.854188 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-937f4d33-ef1b-412f-b6dc-f4a3d5bf9ced tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:06.854769 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-937f4d33-ef1b-412f-b6dc-f4a3d5bf9ced tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:07.043705 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-937f4d33-ef1b-412f-b6dc-f4a3d5bf9ced tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:07.055048 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-937f4d33-ef1b-412f-b6dc-f4a3d5bf9ced tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb" status: 200 len: 1299 microversion: 2.1 time: 0.226594 Jul 19 22:55:07.056398 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2558/5101] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:06 2022] GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb => generated 1299 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:07.518968 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fdc62450-5c85-449e-8e2d-75ac43cf4ebf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:07.531652 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fdc62450-5c85-449e-8e2d-75ac43cf4ebf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:07.533441 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fdc62450-5c85-449e-8e2d-75ac43cf4ebf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:07.534649 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fdc62450-5c85-449e-8e2d-75ac43cf4ebf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1720 microversion: 2.20 time: 0.832632 Jul 19 22:55:07.535592 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2544/5102] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:06 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1720 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:55:08.073307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7b1baa44-abc6-45a3-8b69-3563a5547e80 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:08.074873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7b1baa44-abc6-45a3-8b69-3563a5547e80 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:08.102691 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b1baa44-abc6-45a3-8b69-3563a5547e80 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:08.105789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b1baa44-abc6-45a3-8b69-3563a5547e80 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:08.107901 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b1baa44-abc6-45a3-8b69-3563a5547e80 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:08.110818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b1baa44-abc6-45a3-8b69-3563a5547e80 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:08.167667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cb8eff48-1ceb-4049-b3ee-bdf9dc3387ac tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:08.169307 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cb8eff48-1ceb-4049-b3ee-bdf9dc3387ac tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:08.196980 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cb8eff48-1ceb-4049-b3ee-bdf9dc3387ac tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:08.200658 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cb8eff48-1ceb-4049-b3ee-bdf9dc3387ac tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:08.202929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cb8eff48-1ceb-4049-b3ee-bdf9dc3387ac tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:08.203415 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cb8eff48-1ceb-4049-b3ee-bdf9dc3387ac tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:08.722896 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7b1baa44-abc6-45a3-8b69-3563a5547e80 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:08.734592 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7b1baa44-abc6-45a3-8b69-3563a5547e80 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb" status: 200 len: 1367 microversion: 2.1 time: 0.665125 Jul 19 22:55:08.737556 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2545/5103] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:08 2022] GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb => generated 1367 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:55:08.748207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4dff8a13-ac88-4834-8044-ccec1b5b9508 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:08.748930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4dff8a13-ac88-4834-8044-ccec1b5b9508 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:08.800943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cb8eff48-1ceb-4049-b3ee-bdf9dc3387ac tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:08.808213 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4dff8a13-ac88-4834-8044-ccec1b5b9508 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:08.810056 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4dff8a13-ac88-4834-8044-ccec1b5b9508 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:08.812646 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4dff8a13-ac88-4834-8044-ccec1b5b9508 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:08.818000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4dff8a13-ac88-4834-8044-ccec1b5b9508 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:08.820823 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cb8eff48-1ceb-4049-b3ee-bdf9dc3387ac tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1692 microversion: 2.1 time: 0.991768 Jul 19 22:55:08.822425 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2559/5104] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:07 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1692 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:09.334834 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4dff8a13-ac88-4834-8044-ccec1b5b9508 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:09.346765 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4dff8a13-ac88-4834-8044-ccec1b5b9508 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:09.354890 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4dff8a13-ac88-4834-8044-ccec1b5b9508 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:09.357160 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4dff8a13-ac88-4834-8044-ccec1b5b9508 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1723 microversion: 2.20 time: 0.618013 Jul 19 22:55:09.385301 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-93ef59f8-71c6-41e0-8c23-f0d996eb4dc8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4560f4e-44b8-4084-a542-e3298d9de035"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:55:09.388469 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-93ef59f8-71c6-41e0-8c23-f0d996eb4dc8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:09.394615 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2546/5105] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:08 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1723 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:55:09.408540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-93ef59f8-71c6-41e0-8c23-f0d996eb4dc8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:09.409165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-93ef59f8-71c6-41e0-8c23-f0d996eb4dc8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:09.411138 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-93ef59f8-71c6-41e0-8c23-f0d996eb4dc8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:09.413496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-93ef59f8-71c6-41e0-8c23-f0d996eb4dc8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:09.537573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-5be6a22d-0e03-4a82-90b4-338bf32cc7c9 req-3964731e-21a0-49fb-807b-1743b51e4af5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2998191-f80d-4a79-97d8-3c32a55cc5bb", "tag": "908289fb-1032-458b-8e1f-4aa7e1f74bc1"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:55:09.557546 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5be6a22d-0e03-4a82-90b4-338bf32cc7c9 req-3964731e-21a0-49fb-807b-1743b51e4af5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:09.557994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5be6a22d-0e03-4a82-90b4-338bf32cc7c9 req-3964731e-21a0-49fb-807b-1743b51e4af5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:09.617636 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-5be6a22d-0e03-4a82-90b4-338bf32cc7c9 req-3964731e-21a0-49fb-807b-1743b51e4af5 service nova] Creating event network-changed:908289fb-1032-458b-8e1f-4aa7e1f74bc1 for instance e2998191-f80d-4a79-97d8-3c32a55cc5bb on n-h2-847009-3 Jul 19 22:55:09.640735 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-5be6a22d-0e03-4a82-90b4-338bf32cc7c9 req-3964731e-21a0-49fb-807b-1743b51e4af5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105675 Jul 19 22:55:09.644185 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2547/5106] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:55:09.758149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5d740869-0344-4f78-af64-acb562f5cbd9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:09.758865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5d740869-0344-4f78-af64-acb562f5cbd9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:09.781352 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d740869-0344-4f78-af64-acb562f5cbd9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:09.781826 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d740869-0344-4f78-af64-acb562f5cbd9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:09.782604 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d740869-0344-4f78-af64-acb562f5cbd9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:09.783044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d740869-0344-4f78-af64-acb562f5cbd9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:10.031370 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:55:10.291701 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-93ef59f8-71c6-41e0-8c23-f0d996eb4dc8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "POST /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.916074 Jul 19 22:55:10.294581 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2560/5107] 10.222.0.25 () {62 vars in 1363 bytes} [Tue Jul 19 22:55:09 2022] POST /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/os-volume_attachments => generated 188 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:55:10.326144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c9a1096a-4aef-4bd0-a870-ff9726a6d754 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:10.326770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c9a1096a-4aef-4bd0-a870-ff9726a6d754 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:10.351270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c9a1096a-4aef-4bd0-a870-ff9726a6d754 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:10.351778 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c9a1096a-4aef-4bd0-a870-ff9726a6d754 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:10.358540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c9a1096a-4aef-4bd0-a870-ff9726a6d754 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:10.360230 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c9a1096a-4aef-4bd0-a870-ff9726a6d754 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:10.659003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5d740869-0344-4f78-af64-acb562f5cbd9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:10.669340 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5d740869-0344-4f78-af64-acb562f5cbd9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb" status: 200 len: 1367 microversion: 2.1 time: 0.920208 Jul 19 22:55:10.683336 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2548/5108] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:09 2022] GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb => generated 1367 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:10.700201 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3e94caea-5170-4166-b453-5ffac419d697 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:55:10.700886 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3e94caea-5170-4166-b453-5ffac419d697 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:10.724677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e94caea-5170-4166-b453-5ffac419d697 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:10.725310 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e94caea-5170-4166-b453-5ffac419d697 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:10.726340 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e94caea-5170-4166-b453-5ffac419d697 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:10.727298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e94caea-5170-4166-b453-5ffac419d697 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:10.913544 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3e94caea-5170-4166-b453-5ffac419d697 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "POST /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/action" status: 202 len: 0 microversion: 2.20 time: 0.227279 Jul 19 22:55:10.914938 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2549/5109] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Jul 19 22:55:10 2022] POST /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:55:10.931236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-eb751d30-d8da-42f9-8cb9-2678d2c810ba tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:10.933472 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-eb751d30-d8da-42f9-8cb9-2678d2c810ba tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:10.952317 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eb751d30-d8da-42f9-8cb9-2678d2c810ba tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:10.952779 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eb751d30-d8da-42f9-8cb9-2678d2c810ba tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:10.953746 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eb751d30-d8da-42f9-8cb9-2678d2c810ba tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:10.955679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eb751d30-d8da-42f9-8cb9-2678d2c810ba tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:11.503982 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-eb751d30-d8da-42f9-8cb9-2678d2c810ba tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:11.525054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-eb751d30-d8da-42f9-8cb9-2678d2c810ba tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:11.533967 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-eb751d30-d8da-42f9-8cb9-2678d2c810ba tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:11.536953 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-eb751d30-d8da-42f9-8cb9-2678d2c810ba tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1749 microversion: 2.20 time: 0.616910 Jul 19 22:55:11.543023 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2550/5110] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:10 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1749 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:55:11.627303 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c9a1096a-4aef-4bd0-a870-ff9726a6d754 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:11.676425 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c9a1096a-4aef-4bd0-a870-ff9726a6d754 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1692 microversion: 2.1 time: 1.379030 Jul 19 22:55:11.678083 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2561/5111] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:10 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1692 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:11.695586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-006746a6-2b99-4699-b88e-1c77da94dfa2 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:11.696302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-006746a6-2b99-4699-b88e-1c77da94dfa2 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:11.702779 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-006746a6-2b99-4699-b88e-1c77da94dfa2 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:11.707682 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-006746a6-2b99-4699-b88e-1c77da94dfa2 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:11.708671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-006746a6-2b99-4699-b88e-1c77da94dfa2 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:11.709556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-006746a6-2b99-4699-b88e-1c77da94dfa2 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:11.983657 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:55:12.104968 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:55:12.210098 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-006746a6-2b99-4699-b88e-1c77da94dfa2 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:12.223248 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-006746a6-2b99-4699-b88e-1c77da94dfa2 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb" status: 200 len: 1367 microversion: 2.1 time: 0.541195 Jul 19 22:55:12.225574 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2551/5112] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:11 2022] GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb => generated 1367 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:12.569811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2687cc35-ce23-4397-a677-d77020d2538a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:12.570970 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2687cc35-ce23-4397-a677-d77020d2538a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:12.589495 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2687cc35-ce23-4397-a677-d77020d2538a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:12.590758 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2687cc35-ce23-4397-a677-d77020d2538a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:12.602983 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2687cc35-ce23-4397-a677-d77020d2538a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:12.608956 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2687cc35-ce23-4397-a677-d77020d2538a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:12.698430 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-903ac5ab-1757-4671-8427-b7e81fbbb678 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:12.699242 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-903ac5ab-1757-4671-8427-b7e81fbbb678 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:12.712536 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-903ac5ab-1757-4671-8427-b7e81fbbb678 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:12.715487 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-903ac5ab-1757-4671-8427-b7e81fbbb678 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:12.720443 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-903ac5ab-1757-4671-8427-b7e81fbbb678 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:12.720976 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-903ac5ab-1757-4671-8427-b7e81fbbb678 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:13.482156 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2687cc35-ce23-4397-a677-d77020d2538a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:13.496715 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2687cc35-ce23-4397-a677-d77020d2538a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:13.498579 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2687cc35-ce23-4397-a677-d77020d2538a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:13.500852 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2687cc35-ce23-4397-a677-d77020d2538a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1749 microversion: 2.20 time: 0.941911 Jul 19 22:55:13.526407 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2562/5113] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:12 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1749 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:55:13.535891 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6d1f9d91-5696-43e2-bb17-6de383474218 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:13.537752 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6d1f9d91-5696-43e2-bb17-6de383474218 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:13.557324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d1f9d91-5696-43e2-bb17-6de383474218 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:13.558543 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d1f9d91-5696-43e2-bb17-6de383474218 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:13.559708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d1f9d91-5696-43e2-bb17-6de383474218 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:13.560357 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d1f9d91-5696-43e2-bb17-6de383474218 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:13.824763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-903ac5ab-1757-4671-8427-b7e81fbbb678 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:13.830439 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:55:13.843175 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-903ac5ab-1757-4671-8427-b7e81fbbb678 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1697 microversion: 2.1 time: 1.148891 Jul 19 22:55:13.848050 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2552/5114] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:12 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1697 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:14.234260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:55:14.497644 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6d1f9d91-5696-43e2-bb17-6de383474218 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:14.508155 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6d1f9d91-5696-43e2-bb17-6de383474218 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb" status: 200 len: 1367 microversion: 2.1 time: 0.979845 Jul 19 22:55:14.508767 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2563/5115] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:13 2022] GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb => generated 1367 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:14.522413 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-864780db-6dc4-40f6-84c8-f3ad38f24a20 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:14.524910 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-864780db-6dc4-40f6-84c8-f3ad38f24a20 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:14.538932 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-864780db-6dc4-40f6-84c8-f3ad38f24a20 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:14.539433 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-864780db-6dc4-40f6-84c8-f3ad38f24a20 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:14.544086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-864780db-6dc4-40f6-84c8-f3ad38f24a20 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:14.544651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-864780db-6dc4-40f6-84c8-f3ad38f24a20 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:14.865762 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3af6bd8b-9636-4277-807a-98b029fbb6cd tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:14.866446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3af6bd8b-9636-4277-807a-98b029fbb6cd tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:14.877140 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3af6bd8b-9636-4277-807a-98b029fbb6cd tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:14.877605 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3af6bd8b-9636-4277-807a-98b029fbb6cd tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:14.878393 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3af6bd8b-9636-4277-807a-98b029fbb6cd tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:14.884565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3af6bd8b-9636-4277-807a-98b029fbb6cd tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:15.615057 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-864780db-6dc4-40f6-84c8-f3ad38f24a20 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:15.652398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-864780db-6dc4-40f6-84c8-f3ad38f24a20 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:15.668690 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-864780db-6dc4-40f6-84c8-f3ad38f24a20 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:15.670437 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-864780db-6dc4-40f6-84c8-f3ad38f24a20 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1751 microversion: 2.20 time: 1.153145 Jul 19 22:55:15.685180 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2553/5116] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:14 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1751 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:55:15.691633 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-759f2dd4-0bf7-43a1-b287-e6c6157db2eb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:15.692557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-759f2dd4-0bf7-43a1-b287-e6c6157db2eb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:15.702904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-759f2dd4-0bf7-43a1-b287-e6c6157db2eb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:15.706511 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-759f2dd4-0bf7-43a1-b287-e6c6157db2eb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:15.709975 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-759f2dd4-0bf7-43a1-b287-e6c6157db2eb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:15.711399 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-759f2dd4-0bf7-43a1-b287-e6c6157db2eb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:16.559080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-759f2dd4-0bf7-43a1-b287-e6c6157db2eb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:16.573673 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-759f2dd4-0bf7-43a1-b287-e6c6157db2eb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb" status: 200 len: 1367 microversion: 2.1 time: 0.886533 Jul 19 22:55:16.576685 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2554/5117] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:15 2022] GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb => generated 1367 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:16.602727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3af6bd8b-9636-4277-807a-98b029fbb6cd tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:16.620167 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3af6bd8b-9636-4277-807a-98b029fbb6cd tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1697 microversion: 2.1 time: 1.759475 Jul 19 22:55:16.620794 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2564/5118] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:14 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1697 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:55:16.693021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ca3d645b-c437-4a58-819e-dc0f9acd6521 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:16.694005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ca3d645b-c437-4a58-819e-dc0f9acd6521 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:16.713048 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca3d645b-c437-4a58-819e-dc0f9acd6521 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:16.714398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca3d645b-c437-4a58-819e-dc0f9acd6521 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:16.719040 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca3d645b-c437-4a58-819e-dc0f9acd6521 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:16.720587 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca3d645b-c437-4a58-819e-dc0f9acd6521 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:17.594088 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-53a2c6f6-3e51-401f-bfa5-6cd1a904a7cb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:17.595414 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-53a2c6f6-3e51-401f-bfa5-6cd1a904a7cb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:17.612381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-53a2c6f6-3e51-401f-bfa5-6cd1a904a7cb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:17.613234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-53a2c6f6-3e51-401f-bfa5-6cd1a904a7cb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:17.613873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-53a2c6f6-3e51-401f-bfa5-6cd1a904a7cb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:17.614504 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-53a2c6f6-3e51-401f-bfa5-6cd1a904a7cb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:17.702643 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ca3d645b-c437-4a58-819e-dc0f9acd6521 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:17.721892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ca3d645b-c437-4a58-819e-dc0f9acd6521 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:17.723569 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ca3d645b-c437-4a58-819e-dc0f9acd6521 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:17.725485 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ca3d645b-c437-4a58-819e-dc0f9acd6521 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1751 microversion: 2.20 time: 1.038616 Jul 19 22:55:17.727005 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2555/5119] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:16 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1751 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:55:17.732775 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f8e61164-92ea-4320-a087-e991377cd15b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:17.739300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f8e61164-92ea-4320-a087-e991377cd15b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:17.757669 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8e61164-92ea-4320-a087-e991377cd15b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:17.758532 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8e61164-92ea-4320-a087-e991377cd15b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:17.761387 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8e61164-92ea-4320-a087-e991377cd15b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:17.761998 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f8e61164-92ea-4320-a087-e991377cd15b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:19.015874 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f8e61164-92ea-4320-a087-e991377cd15b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:19.026156 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f8e61164-92ea-4320-a087-e991377cd15b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1697 microversion: 2.1 time: 1.296865 Jul 19 22:55:19.027799 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2556/5120] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:17 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1697 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:19.069836 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ff7df9df-fbdc-490b-b5da-8636eef37cff tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:19.071143 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ff7df9df-fbdc-490b-b5da-8636eef37cff tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:19.097962 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ff7df9df-fbdc-490b-b5da-8636eef37cff tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:19.103533 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ff7df9df-fbdc-490b-b5da-8636eef37cff tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:19.105409 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ff7df9df-fbdc-490b-b5da-8636eef37cff tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:19.108302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ff7df9df-fbdc-490b-b5da-8636eef37cff tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:19.430079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-53a2c6f6-3e51-401f-bfa5-6cd1a904a7cb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:19.472208 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-53a2c6f6-3e51-401f-bfa5-6cd1a904a7cb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb" status: 200 len: 1367 microversion: 2.1 time: 1.882998 Jul 19 22:55:19.477113 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2565/5121] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:17 2022] GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb => generated 1367 bytes in 1888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:19.702017 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ff7df9df-fbdc-490b-b5da-8636eef37cff tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:19.716340 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ff7df9df-fbdc-490b-b5da-8636eef37cff tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:19.722917 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ff7df9df-fbdc-490b-b5da-8636eef37cff tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:19.725749 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ff7df9df-fbdc-490b-b5da-8636eef37cff tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1751 microversion: 2.20 time: 0.685302 Jul 19 22:55:19.732663 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2557/5122] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:19 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1751 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:55:20.039700 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-7da5f04c-6f4d-485d-bfac-196d6619385a req-2597f156-a59d-41ec-acad-c654b8aa87a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2998191-f80d-4a79-97d8-3c32a55cc5bb", "name": "network-vif-plugged", "status": "completed", "tag": "908289fb-1032-458b-8e1f-4aa7e1f74bc1"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:55:20.045848 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8c8717e1-99a3-4b45-9d1c-12f77aa34c72 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:20.046543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8c8717e1-99a3-4b45-9d1c-12f77aa34c72 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:20.064959 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-7da5f04c-6f4d-485d-bfac-196d6619385a req-2597f156-a59d-41ec-acad-c654b8aa87a0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:20.067732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8c8717e1-99a3-4b45-9d1c-12f77aa34c72 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:20.068138 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-7da5f04c-6f4d-485d-bfac-196d6619385a req-2597f156-a59d-41ec-acad-c654b8aa87a0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:20.075073 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8c8717e1-99a3-4b45-9d1c-12f77aa34c72 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:20.076341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8c8717e1-99a3-4b45-9d1c-12f77aa34c72 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:20.085008 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8c8717e1-99a3-4b45-9d1c-12f77aa34c72 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:20.118256 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-7da5f04c-6f4d-485d-bfac-196d6619385a req-2597f156-a59d-41ec-acad-c654b8aa87a0 service nova] Creating event network-vif-plugged:908289fb-1032-458b-8e1f-4aa7e1f74bc1 for instance e2998191-f80d-4a79-97d8-3c32a55cc5bb on n-h2-847009-3 Jul 19 22:55:20.132413 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-7da5f04c-6f4d-485d-bfac-196d6619385a req-2597f156-a59d-41ec-acad-c654b8aa87a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096121 Jul 19 22:55:20.133426 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2566/5123] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:55:20.496252 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f5bb4cfd-082f-41fc-b37d-0846713251a7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:20.497925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f5bb4cfd-082f-41fc-b37d-0846713251a7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:20.535002 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f5bb4cfd-082f-41fc-b37d-0846713251a7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:20.535752 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f5bb4cfd-082f-41fc-b37d-0846713251a7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:20.539751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f5bb4cfd-082f-41fc-b37d-0846713251a7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:20.540483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f5bb4cfd-082f-41fc-b37d-0846713251a7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:21.809355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8c8717e1-99a3-4b45-9d1c-12f77aa34c72 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:21.831869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f5bb4cfd-082f-41fc-b37d-0846713251a7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:21.841998 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8c8717e1-99a3-4b45-9d1c-12f77aa34c72 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1697 microversion: 2.1 time: 1.798798 Jul 19 22:55:21.842925 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2558/5124] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:20 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1697 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:21.850785 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f5bb4cfd-082f-41fc-b37d-0846713251a7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb" status: 200 len: 1367 microversion: 2.1 time: 1.361152 Jul 19 22:55:21.866615 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cce059c1-42ee-4bc9-bfc1-595a6323a62f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:21.868994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cce059c1-42ee-4bc9-bfc1-595a6323a62f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:21.870159 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2567/5125] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:20 2022] GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb => generated 1367 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:21.885249 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cce059c1-42ee-4bc9-bfc1-595a6323a62f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:21.888362 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cce059c1-42ee-4bc9-bfc1-595a6323a62f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:21.894137 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cce059c1-42ee-4bc9-bfc1-595a6323a62f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:21.895824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cce059c1-42ee-4bc9-bfc1-595a6323a62f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:22.366093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cce059c1-42ee-4bc9-bfc1-595a6323a62f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:22.381540 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cce059c1-42ee-4bc9-bfc1-595a6323a62f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:22.383345 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cce059c1-42ee-4bc9-bfc1-595a6323a62f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:22.391322 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cce059c1-42ee-4bc9-bfc1-595a6323a62f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1751 microversion: 2.20 time: 0.545700 Jul 19 22:55:22.394255 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2559/5126] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:21 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1751 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:55:22.860750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-73b1af89-7189-4162-8b30-fb437ead7e4b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:22.862701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-73b1af89-7189-4162-8b30-fb437ead7e4b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:22.868394 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fa2f95cd-6e7b-4656-93a2-353d87962551 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:22.869030 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fa2f95cd-6e7b-4656-93a2-353d87962551 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:22.897814 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-73b1af89-7189-4162-8b30-fb437ead7e4b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:22.904841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa2f95cd-6e7b-4656-93a2-353d87962551 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:22.906314 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-73b1af89-7189-4162-8b30-fb437ead7e4b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:22.907700 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa2f95cd-6e7b-4656-93a2-353d87962551 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:22.910758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa2f95cd-6e7b-4656-93a2-353d87962551 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:22.911873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa2f95cd-6e7b-4656-93a2-353d87962551 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:22.914742 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-73b1af89-7189-4162-8b30-fb437ead7e4b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:22.916826 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-73b1af89-7189-4162-8b30-fb437ead7e4b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:23.386538 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fa2f95cd-6e7b-4656-93a2-353d87962551 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:23.396336 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fa2f95cd-6e7b-4656-93a2-353d87962551 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb" status: 200 len: 1557 microversion: 2.1 time: 0.531901 Jul 19 22:55:23.402779 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2560/5127] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:22 2022] GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb => generated 1557 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:23.413159 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-36bc3627-3dab-475d-872b-32fb676d1b28 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:23.414095 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-36bc3627-3dab-475d-872b-32fb676d1b28 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:23.428974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-73b1af89-7189-4162-8b30-fb437ead7e4b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:23.439415 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-73b1af89-7189-4162-8b30-fb437ead7e4b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1697 microversion: 2.1 time: 0.583420 Jul 19 22:55:23.441086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-36bc3627-3dab-475d-872b-32fb676d1b28 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:23.441768 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-36bc3627-3dab-475d-872b-32fb676d1b28 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:23.443966 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-36bc3627-3dab-475d-872b-32fb676d1b28 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:23.445041 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2568/5128] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:22 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1697 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:23.445753 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-36bc3627-3dab-475d-872b-32fb676d1b28 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:23.454699 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-851929f7-3719-4ba0-a08f-faa435ab3b95 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:23.462806 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-851929f7-3719-4ba0-a08f-faa435ab3b95 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:23.475215 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-851929f7-3719-4ba0-a08f-faa435ab3b95 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:23.478549 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-851929f7-3719-4ba0-a08f-faa435ab3b95 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:23.479888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-851929f7-3719-4ba0-a08f-faa435ab3b95 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:23.480582 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-851929f7-3719-4ba0-a08f-faa435ab3b95 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:23.699006 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-851929f7-3719-4ba0-a08f-faa435ab3b95 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.251897 Jul 19 22:55:23.699837 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2569/5129] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 19 22:55:23 2022] GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb/os-interface => generated 285 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:55:23.901372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-36bc3627-3dab-475d-872b-32fb676d1b28 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:23.914343 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-36bc3627-3dab-475d-872b-32fb676d1b28 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:23.923691 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-36bc3627-3dab-475d-872b-32fb676d1b28 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:23.931320 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-36bc3627-3dab-475d-872b-32fb676d1b28 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1751 microversion: 2.20 time: 0.522550 Jul 19 22:55:23.932180 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2561/5130] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:23 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1751 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:55:24.463707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-811b14cf-549d-490c-a9a2-75f2a8fd231d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:24.464482 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-811b14cf-549d-490c-a9a2-75f2a8fd231d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:24.488746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-811b14cf-549d-490c-a9a2-75f2a8fd231d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:24.493155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-811b14cf-549d-490c-a9a2-75f2a8fd231d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:24.496169 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-811b14cf-549d-490c-a9a2-75f2a8fd231d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:24.498815 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-811b14cf-549d-490c-a9a2-75f2a8fd231d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:24.950737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d7fa418d-ffb5-48db-b1b3-af6947726c81 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:24.952145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d7fa418d-ffb5-48db-b1b3-af6947726c81 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:24.967036 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7fa418d-ffb5-48db-b1b3-af6947726c81 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:24.968182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7fa418d-ffb5-48db-b1b3-af6947726c81 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:24.970036 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7fa418d-ffb5-48db-b1b3-af6947726c81 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:24.972330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7fa418d-ffb5-48db-b1b3-af6947726c81 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:26.043489 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d7fa418d-ffb5-48db-b1b3-af6947726c81 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:26.056791 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d7fa418d-ffb5-48db-b1b3-af6947726c81 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:26.069828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d7fa418d-ffb5-48db-b1b3-af6947726c81 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:26.071157 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d7fa418d-ffb5-48db-b1b3-af6947726c81 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1751 microversion: 2.20 time: 1.124726 Jul 19 22:55:26.075907 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2562/5131] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:24 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1751 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:55:26.171734 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-811b14cf-549d-490c-a9a2-75f2a8fd231d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:26.185217 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-811b14cf-549d-490c-a9a2-75f2a8fd231d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1697 microversion: 2.1 time: 1.725579 Jul 19 22:55:26.200495 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2570/5132] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:24 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1697 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:27.090509 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0af6504e-4844-4525-a4b3-0327b952ef68 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:27.091377 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0af6504e-4844-4525-a4b3-0327b952ef68 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:27.105481 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:55:27.107996 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0af6504e-4844-4525-a4b3-0327b952ef68 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:27.109517 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0af6504e-4844-4525-a4b3-0327b952ef68 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:27.111353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0af6504e-4844-4525-a4b3-0327b952ef68 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:27.111957 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0af6504e-4844-4525-a4b3-0327b952ef68 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:27.208210 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-272467e4-4704-48af-b7e3-54a427bc442c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:27.209485 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-272467e4-4704-48af-b7e3-54a427bc442c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:27.218914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-272467e4-4704-48af-b7e3-54a427bc442c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:27.221072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-272467e4-4704-48af-b7e3-54a427bc442c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:27.222455 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-272467e4-4704-48af-b7e3-54a427bc442c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:27.223055 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-272467e4-4704-48af-b7e3-54a427bc442c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:27.793347 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0af6504e-4844-4525-a4b3-0327b952ef68 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:27.816511 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0af6504e-4844-4525-a4b3-0327b952ef68 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:27.819316 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0af6504e-4844-4525-a4b3-0327b952ef68 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:27.821214 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0af6504e-4844-4525-a4b3-0327b952ef68 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1807 microversion: 2.20 time: 0.734802 Jul 19 22:55:27.824359 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2563/5133] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:27 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1807 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:55:27.992496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-272467e4-4704-48af-b7e3-54a427bc442c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:28.003911 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-272467e4-4704-48af-b7e3-54a427bc442c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1697 microversion: 2.1 time: 0.797342 Jul 19 22:55:28.009612 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2571/5134] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:27 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1697 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:28.429106 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-c89c2e3d-028b-4f98-9ff1-4fd060a40029 req-dae2348f-74fa-4837-bd39-520426383b11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2998191-f80d-4a79-97d8-3c32a55cc5bb", "tag": "908289fb-1032-458b-8e1f-4aa7e1f74bc1"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:55:28.450812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c89c2e3d-028b-4f98-9ff1-4fd060a40029 req-dae2348f-74fa-4837-bd39-520426383b11 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:28.459938 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c89c2e3d-028b-4f98-9ff1-4fd060a40029 req-dae2348f-74fa-4837-bd39-520426383b11 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:28.494393 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-c89c2e3d-028b-4f98-9ff1-4fd060a40029 req-dae2348f-74fa-4837-bd39-520426383b11 service nova] Creating event network-changed:908289fb-1032-458b-8e1f-4aa7e1f74bc1 for instance e2998191-f80d-4a79-97d8-3c32a55cc5bb on n-h2-847009-3 Jul 19 22:55:28.511132 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-c89c2e3d-028b-4f98-9ff1-4fd060a40029 req-dae2348f-74fa-4837-bd39-520426383b11 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086493 Jul 19 22:55:28.531832 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2564/5135] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:55:28.846079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ff1ca821-01de-4b35-9f2f-41a6dbc4ad3b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:28.847382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ff1ca821-01de-4b35-9f2f-41a6dbc4ad3b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:28.862273 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=48 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:55:28.870324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ff1ca821-01de-4b35-9f2f-41a6dbc4ad3b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:28.871694 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ff1ca821-01de-4b35-9f2f-41a6dbc4ad3b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:28.873665 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ff1ca821-01de-4b35-9f2f-41a6dbc4ad3b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:28.876624 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ff1ca821-01de-4b35-9f2f-41a6dbc4ad3b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:29.028563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2fb1e1a3-9bc2-45ce-9ca4-c5e5d7747c11 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:29.029198 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2fb1e1a3-9bc2-45ce-9ca4-c5e5d7747c11 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:29.042856 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2fb1e1a3-9bc2-45ce-9ca4-c5e5d7747c11 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:29.045240 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2fb1e1a3-9bc2-45ce-9ca4-c5e5d7747c11 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:29.047338 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2fb1e1a3-9bc2-45ce-9ca4-c5e5d7747c11 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:29.047820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2fb1e1a3-9bc2-45ce-9ca4-c5e5d7747c11 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:30.501919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2fb1e1a3-9bc2-45ce-9ca4-c5e5d7747c11 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:30.528942 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2fb1e1a3-9bc2-45ce-9ca4-c5e5d7747c11 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1697 microversion: 2.1 time: 1.505614 Jul 19 22:55:30.529916 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2565/5136] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:29 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1697 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:31.128845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ff1ca821-01de-4b35-9f2f-41a6dbc4ad3b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:31.149517 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ff1ca821-01de-4b35-9f2f-41a6dbc4ad3b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:31.149517 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ff1ca821-01de-4b35-9f2f-41a6dbc4ad3b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:31.149517 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ff1ca821-01de-4b35-9f2f-41a6dbc4ad3b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1807 microversion: 2.20 time: 2.308853 Jul 19 22:55:31.156566 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2572/5137] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:28 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1807 bytes in 2316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:55:31.553551 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-13d178d7-da2f-40ca-a29b-e48dae5a40b0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:31.554471 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-13d178d7-da2f-40ca-a29b-e48dae5a40b0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:31.564330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-13d178d7-da2f-40ca-a29b-e48dae5a40b0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:31.564809 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-13d178d7-da2f-40ca-a29b-e48dae5a40b0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:31.565606 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-13d178d7-da2f-40ca-a29b-e48dae5a40b0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:31.566064 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-13d178d7-da2f-40ca-a29b-e48dae5a40b0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:32.170046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a0a80ebf-ee8f-460b-b292-61a6341cb55b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:32.170665 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a0a80ebf-ee8f-460b-b292-61a6341cb55b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:32.186051 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0a80ebf-ee8f-460b-b292-61a6341cb55b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:32.190545 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0a80ebf-ee8f-460b-b292-61a6341cb55b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:32.193158 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0a80ebf-ee8f-460b-b292-61a6341cb55b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:32.193849 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0a80ebf-ee8f-460b-b292-61a6341cb55b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:32.584485 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-13d178d7-da2f-40ca-a29b-e48dae5a40b0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:32.600575 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-13d178d7-da2f-40ca-a29b-e48dae5a40b0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1697 microversion: 2.1 time: 1.051811 Jul 19 22:55:32.601729 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2566/5138] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:31 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1697 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:33.054714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a0a80ebf-ee8f-460b-b292-61a6341cb55b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:33.076908 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a0a80ebf-ee8f-460b-b292-61a6341cb55b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:33.089795 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a0a80ebf-ee8f-460b-b292-61a6341cb55b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:33.094715 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a0a80ebf-ee8f-460b-b292-61a6341cb55b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1807 microversion: 2.20 time: 0.926667 Jul 19 22:55:33.099517 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2573/5139] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:32 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1807 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:55:33.623555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b054aee4-1dad-4f0f-a6bf-5d4fb0a840ad tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:33.625825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b054aee4-1dad-4f0f-a6bf-5d4fb0a840ad tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:33.672922 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b054aee4-1dad-4f0f-a6bf-5d4fb0a840ad tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:33.673338 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b054aee4-1dad-4f0f-a6bf-5d4fb0a840ad tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:33.674187 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b054aee4-1dad-4f0f-a6bf-5d4fb0a840ad tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:33.674647 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b054aee4-1dad-4f0f-a6bf-5d4fb0a840ad tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:34.117776 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b77c3795-f39c-4e0f-ab78-5b95eada2ddc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:34.119470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b77c3795-f39c-4e0f-ab78-5b95eada2ddc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:34.179788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b77c3795-f39c-4e0f-ab78-5b95eada2ddc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:34.184392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b77c3795-f39c-4e0f-ab78-5b95eada2ddc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:34.189122 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b77c3795-f39c-4e0f-ab78-5b95eada2ddc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:34.189926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b77c3795-f39c-4e0f-ab78-5b95eada2ddc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:35.047953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b054aee4-1dad-4f0f-a6bf-5d4fb0a840ad tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:35.078089 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b054aee4-1dad-4f0f-a6bf-5d4fb0a840ad tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1697 microversion: 2.1 time: 1.460637 Jul 19 22:55:35.085543 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2567/5140] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:33 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1697 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:35.214020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b77c3795-f39c-4e0f-ab78-5b95eada2ddc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:35.269001 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b77c3795-f39c-4e0f-ab78-5b95eada2ddc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:35.274560 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b77c3795-f39c-4e0f-ab78-5b95eada2ddc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:35.282363 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b77c3795-f39c-4e0f-ab78-5b95eada2ddc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1807 microversion: 2.20 time: 1.167737 Jul 19 22:55:35.288426 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2574/5141] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:34 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1807 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:55:36.104127 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1ba44135-b3a6-468a-b966-4586304592df tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:36.104892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1ba44135-b3a6-468a-b966-4586304592df tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:36.122782 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1ba44135-b3a6-468a-b966-4586304592df tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:36.123271 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1ba44135-b3a6-468a-b966-4586304592df tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:36.124082 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1ba44135-b3a6-468a-b966-4586304592df tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:36.124592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1ba44135-b3a6-468a-b966-4586304592df tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:36.326124 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e6fd1c0e-301b-4b59-b939-1b1cff3f6f29 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:36.327521 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e6fd1c0e-301b-4b59-b939-1b1cff3f6f29 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:36.339800 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6fd1c0e-301b-4b59-b939-1b1cff3f6f29 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:36.346278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6fd1c0e-301b-4b59-b939-1b1cff3f6f29 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:36.352272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6fd1c0e-301b-4b59-b939-1b1cff3f6f29 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:36.357030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6fd1c0e-301b-4b59-b939-1b1cff3f6f29 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:37.234120 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e6fd1c0e-301b-4b59-b939-1b1cff3f6f29 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:37.250544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e6fd1c0e-301b-4b59-b939-1b1cff3f6f29 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:37.258448 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e6fd1c0e-301b-4b59-b939-1b1cff3f6f29 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:37.268771 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e6fd1c0e-301b-4b59-b939-1b1cff3f6f29 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1807 microversion: 2.20 time: 0.946578 Jul 19 22:55:37.275970 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2575/5142] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:36 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1807 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:55:37.286180 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-073939db-c291-4330-87a7-87d11a42de8a req-5da23f27-7c53-483e-8210-a21e0133e810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b91701f7-5826-4b0e-acb3-790d11b216c7", "name": "network-vif-unplugged", "status": "completed", "tag": "d8cc3438-9336-4995-b930-8e1b14219550"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:55:37.317340 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-073939db-c291-4330-87a7-87d11a42de8a req-5da23f27-7c53-483e-8210-a21e0133e810 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:37.322013 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-073939db-c291-4330-87a7-87d11a42de8a req-5da23f27-7c53-483e-8210-a21e0133e810 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:37.360838 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-073939db-c291-4330-87a7-87d11a42de8a req-5da23f27-7c53-483e-8210-a21e0133e810 service nova] Creating event network-vif-unplugged:d8cc3438-9336-4995-b930-8e1b14219550 for instance b91701f7-5826-4b0e-acb3-790d11b216c7 on n-h2-847009-3 Jul 19 22:55:37.387043 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [req-073939db-c291-4330-87a7-87d11a42de8a req-5da23f27-7c53-483e-8210-a21e0133e810 service nova] Instance b91701f7-5826-4b0e-acb3-790d11b216c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119337) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 22:55:37.456273 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-073939db-c291-4330-87a7-87d11a42de8a req-5da23f27-7c53-483e-8210-a21e0133e810 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.178484 Jul 19 22:55:37.456886 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2576/5143] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:55:38.294759 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1fc4883d-68b9-40e1-8074-dae92a9eb2cc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:38.295569 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1fc4883d-68b9-40e1-8074-dae92a9eb2cc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:38.313173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1fc4883d-68b9-40e1-8074-dae92a9eb2cc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:38.313692 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1fc4883d-68b9-40e1-8074-dae92a9eb2cc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:38.314846 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1fc4883d-68b9-40e1-8074-dae92a9eb2cc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:38.320023 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1fc4883d-68b9-40e1-8074-dae92a9eb2cc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:38.333597 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=95,nova_cell1:UPDATE=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:55:38.398417 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1ba44135-b3a6-468a-b966-4586304592df tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:38.422081 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1ba44135-b3a6-468a-b966-4586304592df tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1696 microversion: 2.1 time: 2.320547 Jul 19 22:55:38.433540 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2568/5144] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:36 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1696 bytes in 2334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:39.002920 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1fc4883d-68b9-40e1-8074-dae92a9eb2cc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:39.058964 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1fc4883d-68b9-40e1-8074-dae92a9eb2cc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:39.065886 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1fc4883d-68b9-40e1-8074-dae92a9eb2cc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:39.075193 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1fc4883d-68b9-40e1-8074-dae92a9eb2cc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1807 microversion: 2.20 time: 0.783868 Jul 19 22:55:39.101884 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2577/5145] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:38 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1807 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:55:39.452575 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e83f6bc8-0afe-49bb-aded-bbb36e2a8e7a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:39.453323 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e83f6bc8-0afe-49bb-aded-bbb36e2a8e7a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:39.466827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e83f6bc8-0afe-49bb-aded-bbb36e2a8e7a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:39.467486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e83f6bc8-0afe-49bb-aded-bbb36e2a8e7a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:39.484315 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e83f6bc8-0afe-49bb-aded-bbb36e2a8e7a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:39.484781 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e83f6bc8-0afe-49bb-aded-bbb36e2a8e7a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:40.108302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5f2f26fd-95f4-4971-8bf7-7d9cfe7b941f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:40.109084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5f2f26fd-95f4-4971-8bf7-7d9cfe7b941f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:40.121193 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5f2f26fd-95f4-4971-8bf7-7d9cfe7b941f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:40.128221 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5f2f26fd-95f4-4971-8bf7-7d9cfe7b941f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:40.132195 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5f2f26fd-95f4-4971-8bf7-7d9cfe7b941f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:40.137704 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5f2f26fd-95f4-4971-8bf7-7d9cfe7b941f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:41.215392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e83f6bc8-0afe-49bb-aded-bbb36e2a8e7a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:41.228120 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5f2f26fd-95f4-4971-8bf7-7d9cfe7b941f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:41.229839 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e83f6bc8-0afe-49bb-aded-bbb36e2a8e7a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1696 microversion: 2.1 time: 1.781629 Jul 19 22:55:41.233262 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2569/5146] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:39 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1696 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:41.245214 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5f2f26fd-95f4-4971-8bf7-7d9cfe7b941f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:41.248278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5f2f26fd-95f4-4971-8bf7-7d9cfe7b941f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:41.251511 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5f2f26fd-95f4-4971-8bf7-7d9cfe7b941f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1807 microversion: 2.20 time: 1.148031 Jul 19 22:55:41.257536 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2578/5147] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:40 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1807 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:55:41.272503 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-5198e4c1-9d47-4ecc-91bf-b5e1a4152c8f req-bca3b137-c3a6-4edc-9666-89bf025fade5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b91701f7-5826-4b0e-acb3-790d11b216c7", "tag": "d8cc3438-9336-4995-b930-8e1b14219550"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:55:41.293109 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5198e4c1-9d47-4ecc-91bf-b5e1a4152c8f req-bca3b137-c3a6-4edc-9666-89bf025fade5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:41.293935 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5198e4c1-9d47-4ecc-91bf-b5e1a4152c8f req-bca3b137-c3a6-4edc-9666-89bf025fade5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:41.303484 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:55:41.334868 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-5198e4c1-9d47-4ecc-91bf-b5e1a4152c8f req-bca3b137-c3a6-4edc-9666-89bf025fade5 service nova] Creating event network-changed:d8cc3438-9336-4995-b930-8e1b14219550 for instance b91701f7-5826-4b0e-acb3-790d11b216c7 on n-h2-847009-3 Jul 19 22:55:41.346326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [req-5198e4c1-9d47-4ecc-91bf-b5e1a4152c8f req-bca3b137-c3a6-4edc-9666-89bf025fade5 service nova] Instance b91701f7-5826-4b0e-acb3-790d11b216c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119338) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 22:55:41.377047 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-5198e4c1-9d47-4ecc-91bf-b5e1a4152c8f req-bca3b137-c3a6-4edc-9666-89bf025fade5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141621 Jul 19 22:55:41.383700 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2570/5148] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:55:42.253887 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4eb88bc6-08fe-4bda-a052-62ef5880a7bd tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:42.254651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4eb88bc6-08fe-4bda-a052-62ef5880a7bd tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:42.274925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dce29c31-4d96-475e-8cbb-1e1180b7e4c0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:42.275815 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dce29c31-4d96-475e-8cbb-1e1180b7e4c0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:42.279246 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4eb88bc6-08fe-4bda-a052-62ef5880a7bd tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:42.279719 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4eb88bc6-08fe-4bda-a052-62ef5880a7bd tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:42.285132 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4eb88bc6-08fe-4bda-a052-62ef5880a7bd tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:42.286127 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4eb88bc6-08fe-4bda-a052-62ef5880a7bd tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:42.293419 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dce29c31-4d96-475e-8cbb-1e1180b7e4c0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:42.293883 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dce29c31-4d96-475e-8cbb-1e1180b7e4c0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:42.294771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dce29c31-4d96-475e-8cbb-1e1180b7e4c0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:42.295158 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dce29c31-4d96-475e-8cbb-1e1180b7e4c0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:43.846231 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dce29c31-4d96-475e-8cbb-1e1180b7e4c0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:43.872387 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dce29c31-4d96-475e-8cbb-1e1180b7e4c0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:43.884785 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dce29c31-4d96-475e-8cbb-1e1180b7e4c0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:43.886794 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dce29c31-4d96-475e-8cbb-1e1180b7e4c0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1807 microversion: 2.20 time: 1.618214 Jul 19 22:55:43.891296 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2571/5149] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:42 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1807 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:55:44.050508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4eb88bc6-08fe-4bda-a052-62ef5880a7bd tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:44.061298 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4eb88bc6-08fe-4bda-a052-62ef5880a7bd tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1694 microversion: 2.1 time: 1.815298 Jul 19 22:55:44.067669 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2579/5150] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:42 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1694 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:44.924224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0cc92d4c-c82a-436b-909b-1e3553cc69ec tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:44.925172 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0cc92d4c-c82a-436b-909b-1e3553cc69ec tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:44.952954 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cc92d4c-c82a-436b-909b-1e3553cc69ec tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:44.958355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cc92d4c-c82a-436b-909b-1e3553cc69ec tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:44.960437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cc92d4c-c82a-436b-909b-1e3553cc69ec tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:44.965543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cc92d4c-c82a-436b-909b-1e3553cc69ec tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:45.092269 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9691f544-6976-4585-a3cb-ec6c865d5d04 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:45.093064 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9691f544-6976-4585-a3cb-ec6c865d5d04 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:45.126532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9691f544-6976-4585-a3cb-ec6c865d5d04 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:45.129986 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9691f544-6976-4585-a3cb-ec6c865d5d04 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:45.134197 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9691f544-6976-4585-a3cb-ec6c865d5d04 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:45.137579 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9691f544-6976-4585-a3cb-ec6c865d5d04 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:46.500254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0cc92d4c-c82a-436b-909b-1e3553cc69ec tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:46.543054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0cc92d4c-c82a-436b-909b-1e3553cc69ec tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:46.543054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0cc92d4c-c82a-436b-909b-1e3553cc69ec tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:46.567743 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0cc92d4c-c82a-436b-909b-1e3553cc69ec tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1807 microversion: 2.20 time: 1.646642 Jul 19 22:55:46.572258 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2572/5151] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:44 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1807 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:55:46.838486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9691f544-6976-4585-a3cb-ec6c865d5d04 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:46.864599 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9691f544-6976-4585-a3cb-ec6c865d5d04 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1691 microversion: 2.1 time: 1.771789 Jul 19 22:55:46.881157 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2580/5152] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:45 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1691 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:46.885149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7071b9b6-ed42-449a-98e4-e9a7311541f1 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:55:46.885707 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7071b9b6-ed42-449a-98e4-e9a7311541f1 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:46.917569 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7071b9b6-ed42-449a-98e4-e9a7311541f1 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:46.918130 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7071b9b6-ed42-449a-98e4-e9a7311541f1 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:46.919205 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7071b9b6-ed42-449a-98e4-e9a7311541f1 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:46.929222 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7071b9b6-ed42-449a-98e4-e9a7311541f1 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:47.222668 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7071b9b6-ed42-449a-98e4-e9a7311541f1 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "POST /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7/action" status: 202 len: 0 microversion: 2.1 time: 0.340376 Jul 19 22:55:47.225244 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2573/5153] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:55:46 2022] POST /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:55:47.237070 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b6c3bba4-45b2-47f1-aa31-a9406c24abea tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:47.238661 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b6c3bba4-45b2-47f1-aa31-a9406c24abea tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:47.253265 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6c3bba4-45b2-47f1-aa31-a9406c24abea tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:47.263488 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6c3bba4-45b2-47f1-aa31-a9406c24abea tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:47.264897 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6c3bba4-45b2-47f1-aa31-a9406c24abea tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:47.265623 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6c3bba4-45b2-47f1-aa31-a9406c24abea tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:47.593207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e2e329f6-fca8-43c5-b3d1-0579d1961777 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:47.594392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e2e329f6-fca8-43c5-b3d1-0579d1961777 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:47.630089 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2e329f6-fca8-43c5-b3d1-0579d1961777 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:47.634737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2e329f6-fca8-43c5-b3d1-0579d1961777 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:47.636248 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2e329f6-fca8-43c5-b3d1-0579d1961777 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:47.636726 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2e329f6-fca8-43c5-b3d1-0579d1961777 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:47.763446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b6c3bba4-45b2-47f1-aa31-a9406c24abea tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:47.782724 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b6c3bba4-45b2-47f1-aa31-a9406c24abea tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1690 microversion: 2.1 time: 0.548967 Jul 19 22:55:47.783687 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2581/5154] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:47 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1690 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:48.163006 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e2e329f6-fca8-43c5-b3d1-0579d1961777 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:48.186575 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e2e329f6-fca8-43c5-b3d1-0579d1961777 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:48.194594 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e2e329f6-fca8-43c5-b3d1-0579d1961777 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:48.202557 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e2e329f6-fca8-43c5-b3d1-0579d1961777 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1807 microversion: 2.20 time: 0.610762 Jul 19 22:55:48.204759 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2574/5155] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:47 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1807 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:55:48.802516 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-208c300a-3b14-4427-8a77-ba241fafc5d8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:48.803058 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-208c300a-3b14-4427-8a77-ba241fafc5d8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:48.810591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-208c300a-3b14-4427-8a77-ba241fafc5d8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:48.811346 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-208c300a-3b14-4427-8a77-ba241fafc5d8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:48.815160 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-208c300a-3b14-4427-8a77-ba241fafc5d8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:48.816425 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-208c300a-3b14-4427-8a77-ba241fafc5d8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:49.223639 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d310ac03-3ce2-4002-97ae-2c6c2ccd73fc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:49.224269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d310ac03-3ce2-4002-97ae-2c6c2ccd73fc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:49.240837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d310ac03-3ce2-4002-97ae-2c6c2ccd73fc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:49.241225 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d310ac03-3ce2-4002-97ae-2c6c2ccd73fc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:49.242029 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d310ac03-3ce2-4002-97ae-2c6c2ccd73fc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:49.247513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d310ac03-3ce2-4002-97ae-2c6c2ccd73fc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:50.337980 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d310ac03-3ce2-4002-97ae-2c6c2ccd73fc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:50.346248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-208c300a-3b14-4427-8a77-ba241fafc5d8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:50.354775 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d310ac03-3ce2-4002-97ae-2c6c2ccd73fc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:50.357665 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-208c300a-3b14-4427-8a77-ba241fafc5d8 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1690 microversion: 2.1 time: 1.560595 Jul 19 22:55:50.359776 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d310ac03-3ce2-4002-97ae-2c6c2ccd73fc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:50.371464 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d310ac03-3ce2-4002-97ae-2c6c2ccd73fc tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1807 microversion: 2.20 time: 1.144578 Jul 19 22:55:50.372141 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2575/5156] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:49 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1807 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:55:50.381075 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2582/5157] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:48 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1690 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:50.767850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-debe903b-6763-4e8a-ad6d-6b34deaeab6c req-68ddfa36-3368-4bf2-8d3c-f6a9bf796531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b91701f7-5826-4b0e-acb3-790d11b216c7", "name": "network-vif-plugged", "status": "completed", "tag": "d8cc3438-9336-4995-b930-8e1b14219550"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:55:50.789971 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-debe903b-6763-4e8a-ad6d-6b34deaeab6c req-68ddfa36-3368-4bf2-8d3c-f6a9bf796531 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:50.790894 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-debe903b-6763-4e8a-ad6d-6b34deaeab6c req-68ddfa36-3368-4bf2-8d3c-f6a9bf796531 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:50.831607 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-debe903b-6763-4e8a-ad6d-6b34deaeab6c req-68ddfa36-3368-4bf2-8d3c-f6a9bf796531 service nova] Creating event network-vif-plugged:d8cc3438-9336-4995-b930-8e1b14219550 for instance b91701f7-5826-4b0e-acb3-790d11b216c7 on n-h2-847009-3 Jul 19 22:55:50.847828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [req-debe903b-6763-4e8a-ad6d-6b34deaeab6c req-68ddfa36-3368-4bf2-8d3c-f6a9bf796531 service nova] Instance b91701f7-5826-4b0e-acb3-790d11b216c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119338) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 22:55:50.890890 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-debe903b-6763-4e8a-ad6d-6b34deaeab6c req-68ddfa36-3368-4bf2-8d3c-f6a9bf796531 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.504102 Jul 19 22:55:50.893264 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2576/5158] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:55:51.395702 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-81202b41-e5e0-41aa-8340-8b5fdd3cb25e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:51.396986 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-253d304d-79f3-4ebd-977d-381b77bbd834 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:51.397902 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-81202b41-e5e0-41aa-8340-8b5fdd3cb25e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:51.400497 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-253d304d-79f3-4ebd-977d-381b77bbd834 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:51.443541 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81202b41-e5e0-41aa-8340-8b5fdd3cb25e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:51.444227 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-253d304d-79f3-4ebd-977d-381b77bbd834 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:51.445455 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81202b41-e5e0-41aa-8340-8b5fdd3cb25e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:51.449324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-253d304d-79f3-4ebd-977d-381b77bbd834 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:51.454993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-253d304d-79f3-4ebd-977d-381b77bbd834 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:51.455452 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81202b41-e5e0-41aa-8340-8b5fdd3cb25e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:51.456090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81202b41-e5e0-41aa-8340-8b5fdd3cb25e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:51.456956 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-253d304d-79f3-4ebd-977d-381b77bbd834 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:52.270863 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-81202b41-e5e0-41aa-8340-8b5fdd3cb25e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:52.280197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-81202b41-e5e0-41aa-8340-8b5fdd3cb25e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:52.298800 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-81202b41-e5e0-41aa-8340-8b5fdd3cb25e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:52.300152 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-81202b41-e5e0-41aa-8340-8b5fdd3cb25e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1807 microversion: 2.20 time: 0.912772 Jul 19 22:55:52.315674 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2577/5159] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:51 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1807 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:55:52.372766 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-253d304d-79f3-4ebd-977d-381b77bbd834 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:52.382796 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-253d304d-79f3-4ebd-977d-381b77bbd834 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1690 microversion: 2.1 time: 0.999371 Jul 19 22:55:52.384182 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2583/5160] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:51 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1690 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:53.318725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b824fac1-9423-40ad-8af5-2cbcb61362ec tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:53.319389 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b824fac1-9423-40ad-8af5-2cbcb61362ec tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:53.338418 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b824fac1-9423-40ad-8af5-2cbcb61362ec tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:53.339092 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b824fac1-9423-40ad-8af5-2cbcb61362ec tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:53.340245 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b824fac1-9423-40ad-8af5-2cbcb61362ec tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:53.340904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b824fac1-9423-40ad-8af5-2cbcb61362ec tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:53.402298 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b5c94592-22bd-4f6b-8b85-a948fe075470 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:53.403706 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b5c94592-22bd-4f6b-8b85-a948fe075470 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:53.431099 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b5c94592-22bd-4f6b-8b85-a948fe075470 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:53.432580 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b5c94592-22bd-4f6b-8b85-a948fe075470 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:53.433626 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b5c94592-22bd-4f6b-8b85-a948fe075470 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:53.437174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b5c94592-22bd-4f6b-8b85-a948fe075470 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:54.202213 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b824fac1-9423-40ad-8af5-2cbcb61362ec tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:54.227732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b824fac1-9423-40ad-8af5-2cbcb61362ec tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:54.238204 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b824fac1-9423-40ad-8af5-2cbcb61362ec tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:54.247840 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b824fac1-9423-40ad-8af5-2cbcb61362ec tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1807 microversion: 2.20 time: 0.931641 Jul 19 22:55:54.248611 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2578/5161] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:53 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1807 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:55:54.440739 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b5c94592-22bd-4f6b-8b85-a948fe075470 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:54.455163 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b5c94592-22bd-4f6b-8b85-a948fe075470 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1690 microversion: 2.1 time: 1.056774 Jul 19 22:55:54.460878 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2584/5162] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:53 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1690 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:55:55.270989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b225322a-9c58-4344-a76c-dc00a84218f5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:55.273106 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b225322a-9c58-4344-a76c-dc00a84218f5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:55.291306 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b225322a-9c58-4344-a76c-dc00a84218f5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:55.292149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b225322a-9c58-4344-a76c-dc00a84218f5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:55.293792 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b225322a-9c58-4344-a76c-dc00a84218f5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:55.299313 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b225322a-9c58-4344-a76c-dc00a84218f5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:55.479165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ed52d0f2-f4f2-4e0e-90bd-737772a9fa53 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:55.480845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ed52d0f2-f4f2-4e0e-90bd-737772a9fa53 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:55.502138 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ed52d0f2-f4f2-4e0e-90bd-737772a9fa53 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:55.503365 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ed52d0f2-f4f2-4e0e-90bd-737772a9fa53 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:55.505608 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ed52d0f2-f4f2-4e0e-90bd-737772a9fa53 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:55.506997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ed52d0f2-f4f2-4e0e-90bd-737772a9fa53 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:56.117033 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ed52d0f2-f4f2-4e0e-90bd-737772a9fa53 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:56.146240 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b225322a-9c58-4344-a76c-dc00a84218f5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:56.171821 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ed52d0f2-f4f2-4e0e-90bd-737772a9fa53 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1690 microversion: 2.1 time: 0.695213 Jul 19 22:55:56.174608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b225322a-9c58-4344-a76c-dc00a84218f5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:56.176412 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2585/5163] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:55 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1690 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:56.181286 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b225322a-9c58-4344-a76c-dc00a84218f5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:56.184211 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b225322a-9c58-4344-a76c-dc00a84218f5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1807 microversion: 2.20 time: 0.919626 Jul 19 22:55:56.187921 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2579/5164] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:55 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1807 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:55:57.192077 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-79c7af82-8b90-4654-b9ca-0da09b6ecd88 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:57.198926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-79c7af82-8b90-4654-b9ca-0da09b6ecd88 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:57.206778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d91fd406-1ab3-4c90-a210-1e5f0f2a1765 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:57.208244 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d91fd406-1ab3-4c90-a210-1e5f0f2a1765 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:57.232579 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-79c7af82-8b90-4654-b9ca-0da09b6ecd88 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:57.236196 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=38 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:55:57.243939 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-79c7af82-8b90-4654-b9ca-0da09b6ecd88 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:57.246380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d91fd406-1ab3-4c90-a210-1e5f0f2a1765 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:57.248278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-79c7af82-8b90-4654-b9ca-0da09b6ecd88 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:57.250332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d91fd406-1ab3-4c90-a210-1e5f0f2a1765 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:57.251179 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-79c7af82-8b90-4654-b9ca-0da09b6ecd88 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:57.252294 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d91fd406-1ab3-4c90-a210-1e5f0f2a1765 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:57.256274 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d91fd406-1ab3-4c90-a210-1e5f0f2a1765 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:57.911844 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d91fd406-1ab3-4c90-a210-1e5f0f2a1765 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:57.933194 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d91fd406-1ab3-4c90-a210-1e5f0f2a1765 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:57.939877 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d91fd406-1ab3-4c90-a210-1e5f0f2a1765 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:57.941444 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d91fd406-1ab3-4c90-a210-1e5f0f2a1765 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1807 microversion: 2.20 time: 0.739390 Jul 19 22:55:57.942427 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2580/5165] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:57 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1807 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:55:58.187890 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-79c7af82-8b90-4654-b9ca-0da09b6ecd88 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:58.205741 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-79c7af82-8b90-4654-b9ca-0da09b6ecd88 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1690 microversion: 2.1 time: 1.017243 Jul 19 22:55:58.210290 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2586/5166] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:57 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1690 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:58.596751 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-58b879d3-70b5-4ff7-9d81-79497dda5eda req-30fa9e26-cd78-4f75-9b97-3d0bb9a5af3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b91701f7-5826-4b0e-acb3-790d11b216c7", "name": "network-vif-unplugged", "status": "completed", "tag": "d8cc3438-9336-4995-b930-8e1b14219550"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:55:58.631000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-58b879d3-70b5-4ff7-9d81-79497dda5eda req-30fa9e26-cd78-4f75-9b97-3d0bb9a5af3c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:58.636621 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-58b879d3-70b5-4ff7-9d81-79497dda5eda req-30fa9e26-cd78-4f75-9b97-3d0bb9a5af3c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:58.683530 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-58b879d3-70b5-4ff7-9d81-79497dda5eda req-30fa9e26-cd78-4f75-9b97-3d0bb9a5af3c service nova] Creating event network-vif-unplugged:d8cc3438-9336-4995-b930-8e1b14219550 for instance b91701f7-5826-4b0e-acb3-790d11b216c7 on n-h1-847009-3 Jul 19 22:55:58.706808 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [req-58b879d3-70b5-4ff7-9d81-79497dda5eda req-30fa9e26-cd78-4f75-9b97-3d0bb9a5af3c service nova] Instance b91701f7-5826-4b0e-acb3-790d11b216c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119338) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 22:55:58.743924 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-58b879d3-70b5-4ff7-9d81-79497dda5eda req-30fa9e26-cd78-4f75-9b97-3d0bb9a5af3c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.494182 Jul 19 22:55:58.750601 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2581/5167] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:55:58.962175 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5169375f-f847-4784-90e2-3a945458bc69 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:58.962818 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5169375f-f847-4784-90e2-3a945458bc69 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:58.972469 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=30 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:55:58.987301 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5169375f-f847-4784-90e2-3a945458bc69 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:58.987756 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5169375f-f847-4784-90e2-3a945458bc69 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:58.992584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5169375f-f847-4784-90e2-3a945458bc69 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:58.993061 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5169375f-f847-4784-90e2-3a945458bc69 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:59.228682 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-667f217e-c276-49a3-b295-c3122560ae9f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:55:59.229596 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-667f217e-c276-49a3-b295-c3122560ae9f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:55:59.259252 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-667f217e-c276-49a3-b295-c3122560ae9f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:59.259918 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-667f217e-c276-49a3-b295-c3122560ae9f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:59.261179 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-667f217e-c276-49a3-b295-c3122560ae9f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:59.261993 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-667f217e-c276-49a3-b295-c3122560ae9f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:59.837650 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-667f217e-c276-49a3-b295-c3122560ae9f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:59.858821 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-667f217e-c276-49a3-b295-c3122560ae9f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1690 microversion: 2.1 time: 0.631133 Jul 19 22:55:59.860775 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2582/5168] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:55:59 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1690 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:55:59.874057 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-b51e5ff9-9174-413a-8125-27d247000adc req-004268ad-9afe-46f6-b269-08f62a8f5528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d98192d-dabe-4541-b7c6-c057e4269d64", "name": "network-vif-plugged", "status": "completed", "tag": "06c1d4f8-d555-478d-9923-73caa8771882"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:55:59.877913 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5169375f-f847-4784-90e2-3a945458bc69 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:59.890109 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5169375f-f847-4784-90e2-3a945458bc69 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:59.899764 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5169375f-f847-4784-90e2-3a945458bc69 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:55:59.902791 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5169375f-f847-4784-90e2-3a945458bc69 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1807 microversion: 2.20 time: 0.945072 Jul 19 22:55:59.903455 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2587/5169] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:55:58 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1807 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:55:59.915927 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b51e5ff9-9174-413a-8125-27d247000adc req-004268ad-9afe-46f6-b269-08f62a8f5528 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:55:59.916850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b51e5ff9-9174-413a-8125-27d247000adc req-004268ad-9afe-46f6-b269-08f62a8f5528 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:55:59.963041 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-b51e5ff9-9174-413a-8125-27d247000adc req-004268ad-9afe-46f6-b269-08f62a8f5528 service nova] Creating event network-vif-plugged:06c1d4f8-d555-478d-9923-73caa8771882 for instance 4d98192d-dabe-4541-b7c6-c057e4269d64 on n-h1-847009-3 Jul 19 22:55:59.976523 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-b51e5ff9-9174-413a-8125-27d247000adc req-004268ad-9afe-46f6-b269-08f62a8f5528 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109213 Jul 19 22:55:59.979028 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2583/5170] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:56:00.870921 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-e7fec786-57b2-46e6-8746-8dad575f0171 req-5137e59b-386c-4275-be5c-b64449a610e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b91701f7-5826-4b0e-acb3-790d11b216c7", "tag": "d8cc3438-9336-4995-b930-8e1b14219550"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:56:00.878393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d236c8b9-f49e-4e3f-8f7e-8e10cad6286b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:00.880353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d236c8b9-f49e-4e3f-8f7e-8e10cad6286b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:00.906540 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d236c8b9-f49e-4e3f-8f7e-8e10cad6286b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:00.911010 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d236c8b9-f49e-4e3f-8f7e-8e10cad6286b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:00.913735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d236c8b9-f49e-4e3f-8f7e-8e10cad6286b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:00.915560 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d236c8b9-f49e-4e3f-8f7e-8e10cad6286b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:00.916458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e7fec786-57b2-46e6-8746-8dad575f0171 req-5137e59b-386c-4275-be5c-b64449a610e0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:00.917705 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e7fec786-57b2-46e6-8746-8dad575f0171 req-5137e59b-386c-4275-be5c-b64449a610e0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:00.993413 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-e7fec786-57b2-46e6-8746-8dad575f0171 req-5137e59b-386c-4275-be5c-b64449a610e0 service nova] Creating event network-changed:d8cc3438-9336-4995-b930-8e1b14219550 for instance b91701f7-5826-4b0e-acb3-790d11b216c7 on n-h1-847009-3 Jul 19 22:56:01.017157 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [req-e7fec786-57b2-46e6-8746-8dad575f0171 req-5137e59b-386c-4275-be5c-b64449a610e0 service nova] Instance b91701f7-5826-4b0e-acb3-790d11b216c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119337) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 22:56:01.035359 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-e7fec786-57b2-46e6-8746-8dad575f0171 req-5137e59b-386c-4275-be5c-b64449a610e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168715 Jul 19 22:56:01.037192 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2588/5171] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:56:01.043967 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-99d62f6f-3aed-4fc2-bfff-33bcc1545b19 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:01.045126 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-99d62f6f-3aed-4fc2-bfff-33bcc1545b19 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:01.054389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99d62f6f-3aed-4fc2-bfff-33bcc1545b19 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:01.055711 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99d62f6f-3aed-4fc2-bfff-33bcc1545b19 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:01.057165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99d62f6f-3aed-4fc2-bfff-33bcc1545b19 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:01.057886 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99d62f6f-3aed-4fc2-bfff-33bcc1545b19 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:02.042170 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d236c8b9-f49e-4e3f-8f7e-8e10cad6286b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:02.088322 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d236c8b9-f49e-4e3f-8f7e-8e10cad6286b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1690 microversion: 2.1 time: 1.211220 Jul 19 22:56:02.094402 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2584/5172] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:56:00 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1690 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:56:02.109862 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-99d62f6f-3aed-4fc2-bfff-33bcc1545b19 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:02.130911 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-99d62f6f-3aed-4fc2-bfff-33bcc1545b19 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:02.132675 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-99d62f6f-3aed-4fc2-bfff-33bcc1545b19 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:02.134123 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-99d62f6f-3aed-4fc2-bfff-33bcc1545b19 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1807 microversion: 2.20 time: 1.094719 Jul 19 22:56:02.137582 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2589/5173] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:56:01 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1807 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:56:03.111366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7f7aefa2-d85f-4d25-8613-4bc2b08a8bff tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:03.112158 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7f7aefa2-d85f-4d25-8613-4bc2b08a8bff tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:03.140249 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7f7aefa2-d85f-4d25-8613-4bc2b08a8bff tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:03.140750 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7f7aefa2-d85f-4d25-8613-4bc2b08a8bff tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:03.141591 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7f7aefa2-d85f-4d25-8613-4bc2b08a8bff tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:03.142034 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7f7aefa2-d85f-4d25-8613-4bc2b08a8bff tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:03.159892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9bd80a6a-9c88-40c1-b191-a260d9979bbf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:03.164095 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9bd80a6a-9c88-40c1-b191-a260d9979bbf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:03.178735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9bd80a6a-9c88-40c1-b191-a260d9979bbf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:03.190132 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9bd80a6a-9c88-40c1-b191-a260d9979bbf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:03.191277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9bd80a6a-9c88-40c1-b191-a260d9979bbf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:03.192513 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9bd80a6a-9c88-40c1-b191-a260d9979bbf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:04.015234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9bd80a6a-9c88-40c1-b191-a260d9979bbf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:04.025005 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9bd80a6a-9c88-40c1-b191-a260d9979bbf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:04.032424 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9bd80a6a-9c88-40c1-b191-a260d9979bbf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:04.034195 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9bd80a6a-9c88-40c1-b191-a260d9979bbf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1807 microversion: 2.20 time: 0.879191 Jul 19 22:56:04.039300 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2590/5174] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:56:03 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1807 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:56:04.046649 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7f7aefa2-d85f-4d25-8613-4bc2b08a8bff tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:04.057679 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f3c4711a-5d9b-48af-8885-6679115f2ccf tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:04.058370 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f3c4711a-5d9b-48af-8885-6679115f2ccf tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:04.069635 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7f7aefa2-d85f-4d25-8613-4bc2b08a8bff tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1690 microversion: 2.1 time: 0.962250 Jul 19 22:56:04.070244 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2585/5175] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:56:03 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1690 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:56:04.084364 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3c4711a-5d9b-48af-8885-6679115f2ccf tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:04.085941 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3c4711a-5d9b-48af-8885-6679115f2ccf tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:04.086936 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3c4711a-5d9b-48af-8885-6679115f2ccf tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:04.087573 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3c4711a-5d9b-48af-8885-6679115f2ccf tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:04.123343 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f3c4711a-5d9b-48af-8885-6679115f2ccf tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb/ips" status: 200 len: 148 microversion: 2.1 time: 0.082591 Jul 19 22:56:04.133632 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2591/5176] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 19 22:56:04 2022] GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb/ips => generated 148 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:56:05.068115 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-088a266d-9ce7-45b5-9feb-a22808c2da5e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:05.068854 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-088a266d-9ce7-45b5-9feb-a22808c2da5e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:05.088679 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3efec28d-9064-4485-b3a2-1630c8dfa160 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:05.089366 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3efec28d-9064-4485-b3a2-1630c8dfa160 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:05.095841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-088a266d-9ce7-45b5-9feb-a22808c2da5e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:05.100595 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-088a266d-9ce7-45b5-9feb-a22808c2da5e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:05.101474 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-088a266d-9ce7-45b5-9feb-a22808c2da5e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:05.101926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-088a266d-9ce7-45b5-9feb-a22808c2da5e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:05.106428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3efec28d-9064-4485-b3a2-1630c8dfa160 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:05.106891 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3efec28d-9064-4485-b3a2-1630c8dfa160 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:05.124607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3efec28d-9064-4485-b3a2-1630c8dfa160 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:05.125595 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3efec28d-9064-4485-b3a2-1630c8dfa160 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:06.444401 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3efec28d-9064-4485-b3a2-1630c8dfa160 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:06.461147 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3efec28d-9064-4485-b3a2-1630c8dfa160 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1690 microversion: 2.1 time: 1.376879 Jul 19 22:56:06.479562 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2592/5177] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:56:05 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1690 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:56:06.569274 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-088a266d-9ce7-45b5-9feb-a22808c2da5e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:06.572037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:56:06.594344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-088a266d-9ce7-45b5-9feb-a22808c2da5e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:06.595851 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-088a266d-9ce7-45b5-9feb-a22808c2da5e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:06.597132 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-088a266d-9ce7-45b5-9feb-a22808c2da5e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1794 microversion: 2.20 time: 1.533536 Jul 19 22:56:06.598246 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2586/5178] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:56:05 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1794 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:56:06.955667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e5f6fcbb-c0ce-4953-ae80-47efe33c8e6f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12c557be-9ba9-4bee-ae5e-2685d2a29ec7"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:56:06.957672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e5f6fcbb-c0ce-4953-ae80-47efe33c8e6f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:06.965946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5f6fcbb-c0ce-4953-ae80-47efe33c8e6f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:06.967369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5f6fcbb-c0ce-4953-ae80-47efe33c8e6f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:06.970353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5f6fcbb-c0ce-4953-ae80-47efe33c8e6f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:06.971898 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5f6fcbb-c0ce-4953-ae80-47efe33c8e6f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:07.462302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:56:07.481304 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0fb55f07-b568-4e18-b00e-ea19e283e806 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:07.481969 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0fb55f07-b568-4e18-b00e-ea19e283e806 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:07.512928 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e5f6fcbb-c0ce-4953-ae80-47efe33c8e6f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "POST /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.561002 Jul 19 22:56:07.514845 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2593/5179] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 19 22:56:06 2022] POST /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb/os-volume_attachments => generated 194 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:56:07.522982 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0fb55f07-b568-4e18-b00e-ea19e283e806 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:07.534428 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0fb55f07-b568-4e18-b00e-ea19e283e806 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:07.547927 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0fb55f07-b568-4e18-b00e-ea19e283e806 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:07.548653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0fb55f07-b568-4e18-b00e-ea19e283e806 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:07.739331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-61482206-9d34-47c1-9bd0-fdf29873c82b req-6129d1b4-df33-4def-a1e1-b6c45705df40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b91701f7-5826-4b0e-acb3-790d11b216c7", "name": "network-vif-plugged", "status": "completed", "tag": "d8cc3438-9336-4995-b930-8e1b14219550"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:56:07.759604 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-61482206-9d34-47c1-9bd0-fdf29873c82b req-6129d1b4-df33-4def-a1e1-b6c45705df40 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:07.760058 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-61482206-9d34-47c1-9bd0-fdf29873c82b req-6129d1b4-df33-4def-a1e1-b6c45705df40 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:07.800906 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-61482206-9d34-47c1-9bd0-fdf29873c82b req-6129d1b4-df33-4def-a1e1-b6c45705df40 service nova] Creating event network-vif-plugged:d8cc3438-9336-4995-b930-8e1b14219550 for instance b91701f7-5826-4b0e-acb3-790d11b216c7 on n-h1-847009-3 Jul 19 22:56:07.810877 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-61482206-9d34-47c1-9bd0-fdf29873c82b req-6129d1b4-df33-4def-a1e1-b6c45705df40 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076762 Jul 19 22:56:07.816038 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2594/5180] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:56:09.680019 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0fb55f07-b568-4e18-b00e-ea19e283e806 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:09.696374 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0fb55f07-b568-4e18-b00e-ea19e283e806 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1683 microversion: 2.1 time: 2.213484 Jul 19 22:56:09.709543 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2587/5181] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:56:07 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1683 bytes in 2222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:56:25.871430 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=15 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:56:25.872997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=4,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:56:25.879400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dfeab013-ccb5-4f55-b64d-8543ada7288b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12c557be-9ba9-4bee-ae5e-2685d2a29ec7"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:56:25.881112 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dfeab013-ccb5-4f55-b64d-8543ada7288b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:25.888799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dfeab013-ccb5-4f55-b64d-8543ada7288b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:25.889769 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dfeab013-ccb5-4f55-b64d-8543ada7288b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:25.890866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dfeab013-ccb5-4f55-b64d-8543ada7288b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:25.891574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dfeab013-ccb5-4f55-b64d-8543ada7288b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:26.070569 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-dfeab013-ccb5-4f55-b64d-8543ada7288b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] HTTP exception thrown: Invalid volume: volume 12c557be-9ba9-4bee-ae5e-2685d2a29ec7 is already attached to instances: e2998191-f80d-4a79-97d8-3c32a55cc5bb Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dfeab013-ccb5-4f55-b64d-8543ada7288b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Request method failure captured: Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb/os-volume_attachments HTTP/1.1 Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 74 Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zVsSOX-O7ggDcH00KLmZx8wOtg3S3Su8gJRQI2lYa4BxC-OxvaOKnPb2I4UGxeYv7AyyS8e-HsUydLYlXpELI3RwSo4aU8bY9u8sE-NNAsyuAsZv_PYlNBhbG0F8quyfyoOYST6GA8Fbv-UJaQmRhd0xcvaUwo2b-fKMEkbL-YV9Cg Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: c3929e62eb4345f8a69fec37ba7c195f Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: {"volumeAttachment": {"volumeId": "12c557be-9ba9-4bee-ae5e-2685d2a29ec7"}} Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: exception: Invalid volume: volume 12c557be-9ba9-4bee-ae5e-2685d2a29ec7 is already attached to instances: e2998191-f80d-4a79-97d8-3c32a55cc5bb Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'server_id': 'e2998191-f80d-4a79-97d8-3c32a55cc5bb', 'body': {'volumeAttachment': {'volumeId': '12c557be-9ba9-4bee-ae5e-2685d2a29ec7'}}} Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 12c557be-9ba9-4bee-ae5e-2685d2a29ec7 is already attached to instances: e2998191-f80d-4a79-97d8-3c32a55cc5bb Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:56:26.072662 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:56:26.076123 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 22:56:26.076123 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 22:56:26.076123 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 19 22:56:26.076123 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 22:56:26.076123 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 12c557be-9ba9-4bee-ae5e-2685d2a29ec7 is already attached to instances: e2998191-f80d-4a79-97d8-3c32a55cc5bb Jul 19 22:56:26.076123 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:56:26.076123 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:56:26.076123 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:56:26.076123 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:56:26.076123 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:56:26.076123 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:56:26.076123 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:56:26.076123 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:56:26.076123 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 12c557be-9ba9-4bee-ae5e-2685d2a29ec7 is already attached to instances: e2998191-f80d-4a79-97d8-3c32a55cc5bb Jul 19 22:56:26.076123 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:56:26.080077 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dfeab013-ccb5-4f55-b64d-8543ada7288b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Returning 400 to user: Invalid volume: volume 12c557be-9ba9-4bee-ae5e-2685d2a29ec7 is already attached to instances: e2998191-f80d-4a79-97d8-3c32a55cc5bb {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:56:26.081252 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dfeab013-ccb5-4f55-b64d-8543ada7288b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "POST /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.211755 Jul 19 22:56:26.084510 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2595/5182] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 19 22:56:25 2022] POST /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb/os-volume_attachments => generated 174 bytes in 216 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:56:26.765868 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-549b7053-cea5-4986-ba9c-0da2af37920a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:26.766988 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-549b7053-cea5-4986-ba9c-0da2af37920a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:26.777990 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=15 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:56:26.786012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=7 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:56:26.807246 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-549b7053-cea5-4986-ba9c-0da2af37920a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:26.807675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-549b7053-cea5-4986-ba9c-0da2af37920a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:26.808683 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-549b7053-cea5-4986-ba9c-0da2af37920a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:26.811022 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-549b7053-cea5-4986-ba9c-0da2af37920a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:27.016794 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-549b7053-cea5-4986-ba9c-0da2af37920a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lazy-loading 'services' on Instance uuid e2998191-f80d-4a79-97d8-3c32a55cc5bb {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:56:27.173998 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-549b7053-cea5-4986-ba9c-0da2af37920a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb/os-volume_attachments/12c557be-9ba9-4bee-ae5e-2685d2a29ec7" status: 202 len: 0 microversion: 2.1 time: 0.424084 Jul 19 22:56:27.174908 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2588/5183] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 19 22:56:26 2022] DELETE /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb/os-volume_attachments/12c557be-9ba9-4bee-ae5e-2685d2a29ec7 => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:56:27.189945 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0d725694-7051-4b7f-a9b3-af6e9a9b5b2a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:27.193427 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0d725694-7051-4b7f-a9b3-af6e9a9b5b2a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:27.210234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d725694-7051-4b7f-a9b3-af6e9a9b5b2a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:27.211005 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d725694-7051-4b7f-a9b3-af6e9a9b5b2a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:27.212091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d725694-7051-4b7f-a9b3-af6e9a9b5b2a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:27.212984 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d725694-7051-4b7f-a9b3-af6e9a9b5b2a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:27.299549 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0d725694-7051-4b7f-a9b3-af6e9a9b5b2a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117253 Jul 19 22:56:27.304474 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2596/5184] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:56:27 2022] GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:56:28.317037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d56f3233-1eda-415c-b4e2-90a8e173df39 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:28.319777 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d56f3233-1eda-415c-b4e2-90a8e173df39 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:28.342391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d56f3233-1eda-415c-b4e2-90a8e173df39 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:28.345376 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d56f3233-1eda-415c-b4e2-90a8e173df39 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:28.347918 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d56f3233-1eda-415c-b4e2-90a8e173df39 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:28.351740 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d56f3233-1eda-415c-b4e2-90a8e173df39 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:28.496897 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d56f3233-1eda-415c-b4e2-90a8e173df39 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185287 Jul 19 22:56:28.510446 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2589/5185] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:56:28 2022] GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:56:29.525913 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9a6cadbb-d1ea-4e22-9239-c5ddd9b2fa7f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:29.528766 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9a6cadbb-d1ea-4e22-9239-c5ddd9b2fa7f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:29.540227 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9a6cadbb-d1ea-4e22-9239-c5ddd9b2fa7f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:29.541010 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9a6cadbb-d1ea-4e22-9239-c5ddd9b2fa7f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:29.555584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9a6cadbb-d1ea-4e22-9239-c5ddd9b2fa7f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:29.556853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9a6cadbb-d1ea-4e22-9239-c5ddd9b2fa7f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:29.612692 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9a6cadbb-d1ea-4e22-9239-c5ddd9b2fa7f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094683 Jul 19 22:56:29.617601 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2597/5186] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:56:29 2022] GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:56:30.629161 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cd8e2253-4c5c-4651-9e16-3180f9416ffe tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:30.630150 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cd8e2253-4c5c-4651-9e16-3180f9416ffe tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:30.648649 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd8e2253-4c5c-4651-9e16-3180f9416ffe tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:30.652552 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd8e2253-4c5c-4651-9e16-3180f9416ffe tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:30.653987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd8e2253-4c5c-4651-9e16-3180f9416ffe tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:30.656537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd8e2253-4c5c-4651-9e16-3180f9416ffe tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:30.720873 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cd8e2253-4c5c-4651-9e16-3180f9416ffe tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099512 Jul 19 22:56:30.723010 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2590/5187] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:56:30 2022] GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:56:31.733346 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-69c32d11-b1cf-4d8a-847c-78090f7d6097 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:31.734943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-69c32d11-b1cf-4d8a-847c-78090f7d6097 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:31.748976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69c32d11-b1cf-4d8a-847c-78090f7d6097 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:31.750614 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69c32d11-b1cf-4d8a-847c-78090f7d6097 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:31.752755 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69c32d11-b1cf-4d8a-847c-78090f7d6097 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:31.754376 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69c32d11-b1cf-4d8a-847c-78090f7d6097 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:31.811427 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-69c32d11-b1cf-4d8a-847c-78090f7d6097 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081581 Jul 19 22:56:31.812656 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2598/5188] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:56:31 2022] GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:56:32.824451 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aef82389-6292-4daf-82f6-104f1593901d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:32.825924 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-aef82389-6292-4daf-82f6-104f1593901d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:32.848535 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aef82389-6292-4daf-82f6-104f1593901d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:32.850518 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aef82389-6292-4daf-82f6-104f1593901d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:32.853115 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aef82389-6292-4daf-82f6-104f1593901d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:32.853723 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aef82389-6292-4daf-82f6-104f1593901d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:32.933457 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-aef82389-6292-4daf-82f6-104f1593901d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114254 Jul 19 22:56:32.936850 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2591/5189] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:56:32 2022] GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:56:33.678312 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e9a135f0-be1d-4b74-8ec8-88b78dd62823 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Action: 'create', calling method: .version_select at 0x7f7a02fd0dc0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-198859728", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHt5nNojE9vKtkvnQVQIFVPRTI+nqLBZCoGt1JFnHJapMnC1wEFW4KngvdIZ8KHZj7gyZ4bcyjBpTnXeZOxOX4mGSTSkYOuMmYo+sQLwiDPygVvsn5UcobWxMGqAQu4Biw=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:56:33.707181 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-e9a135f0-be1d-4b74-8ec8-88b78dd62823 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Getting quotas for project aacf3f67cf95455985dda79eb06b826c. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:56:33.720622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-e9a135f0-be1d-4b74-8ec8-88b78dd62823 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Getting quotas for user 4403795b53d3430897fa30d42acbd9ca and project aacf3f67cf95455985dda79eb06b826c. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:56:33.794679 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e9a135f0-be1d-4b74-8ec8-88b78dd62823 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.554559 Jul 19 22:56:33.796838 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2599/5190] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:56:33 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:56:33.946588 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8ee3c855-2fdd-4393-ad91-a7dbf23e3c76 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:33.947633 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8ee3c855-2fdd-4393-ad91-a7dbf23e3c76 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:33.965858 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ee3c855-2fdd-4393-ad91-a7dbf23e3c76 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:33.966500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ee3c855-2fdd-4393-ad91-a7dbf23e3c76 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:33.967485 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ee3c855-2fdd-4393-ad91-a7dbf23e3c76 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:33.968096 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ee3c855-2fdd-4393-ad91-a7dbf23e3c76 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:34.078573 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8ee3c855-2fdd-4393-ad91-a7dbf23e3c76 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136039 Jul 19 22:56:34.080703 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2592/5191] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:56:33 2022] GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:56:35.092244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-69d72fc0-be91-43b9-8349-3708d8038c12 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:35.094474 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-69d72fc0-be91-43b9-8349-3708d8038c12 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:35.109581 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69d72fc0-be91-43b9-8349-3708d8038c12 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:35.110320 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69d72fc0-be91-43b9-8349-3708d8038c12 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:35.111373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69d72fc0-be91-43b9-8349-3708d8038c12 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:35.111954 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-69d72fc0-be91-43b9-8349-3708d8038c12 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:35.183836 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-69d72fc0-be91-43b9-8349-3708d8038c12 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.095694 Jul 19 22:56:35.186391 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2600/5192] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:56:35 2022] GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:56:35.275102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-93bf35e3-b7e8-4049-9fb9-4993c8897b29 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:35.276718 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-93bf35e3-b7e8-4049-9fb9-4993c8897b29 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:35.289853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93bf35e3-b7e8-4049-9fb9-4993c8897b29 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:35.290789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93bf35e3-b7e8-4049-9fb9-4993c8897b29 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:35.292114 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93bf35e3-b7e8-4049-9fb9-4993c8897b29 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:35.292865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93bf35e3-b7e8-4049-9fb9-4993c8897b29 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:35.333771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-93bf35e3-b7e8-4049-9fb9-4993c8897b29 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:56:35.448848 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-93bf35e3-b7e8-4049-9fb9-4993c8897b29 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb" status: 204 len: 0 microversion: 2.1 time: 0.182554 Jul 19 22:56:35.450909 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2593/5193] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:56:35 2022] DELETE /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:56:35.459723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-99dabddd-9d33-4900-8aab-fb110a91b247 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:35.460754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-99dabddd-9d33-4900-8aab-fb110a91b247 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:35.469812 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99dabddd-9d33-4900-8aab-fb110a91b247 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:35.470778 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99dabddd-9d33-4900-8aab-fb110a91b247 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:35.473164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99dabddd-9d33-4900-8aab-fb110a91b247 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:35.473897 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99dabddd-9d33-4900-8aab-fb110a91b247 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:35.848069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-99dabddd-9d33-4900-8aab-fb110a91b247 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:35.871716 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-99dabddd-9d33-4900-8aab-fb110a91b247 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb" status: 200 len: 1680 microversion: 2.1 time: 0.417011 Jul 19 22:56:35.880879 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2601/5194] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:56:35 2022] GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb => generated 1680 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:56:36.901687 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d94d8bbd-9111-4b73-b7a0-41206632e817 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:36.903797 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d94d8bbd-9111-4b73-b7a0-41206632e817 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:36.943927 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d94d8bbd-9111-4b73-b7a0-41206632e817 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:36.944441 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d94d8bbd-9111-4b73-b7a0-41206632e817 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:36.945450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d94d8bbd-9111-4b73-b7a0-41206632e817 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:36.949105 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d94d8bbd-9111-4b73-b7a0-41206632e817 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:37.572927 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d94d8bbd-9111-4b73-b7a0-41206632e817 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:37.583706 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d94d8bbd-9111-4b73-b7a0-41206632e817 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb" status: 200 len: 1680 microversion: 2.1 time: 0.695788 Jul 19 22:56:37.585402 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2594/5195] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:56:36 2022] GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb => generated 1680 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:56:38.017765 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-34b01906-2b14-4e33-ac7a-af829a6891fe tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:56:38.020183 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-34b01906-2b14-4e33-ac7a-af829a6891fe tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:38.027240 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-34b01906-2b14-4e33-ac7a-af829a6891fe tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:38.027931 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-34b01906-2b14-4e33-ac7a-af829a6891fe tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:38.028851 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-34b01906-2b14-4e33-ac7a-af829a6891fe tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:38.029431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-34b01906-2b14-4e33-ac7a-af829a6891fe tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:38.101150 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-34b01906-2b14-4e33-ac7a-af829a6891fe tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "POST /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7/action" status: 200 len: 63114 microversion: 2.1 time: 0.086850 Jul 19 22:56:38.103405 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2602/5196] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:56:38 2022] POST /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7/action => generated 63114 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:56:38.611513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c0ef8f2a-59ea-4bf4-b79f-7350b67f05df tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:38.613856 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c0ef8f2a-59ea-4bf4-b79f-7350b67f05df tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:38.659630 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0ef8f2a-59ea-4bf4-b79f-7350b67f05df tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:38.663393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0ef8f2a-59ea-4bf4-b79f-7350b67f05df tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:38.664343 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0ef8f2a-59ea-4bf4-b79f-7350b67f05df tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:38.665043 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0ef8f2a-59ea-4bf4-b79f-7350b67f05df tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:39.367432 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c0ef8f2a-59ea-4bf4-b79f-7350b67f05df tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:39.382221 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c0ef8f2a-59ea-4bf4-b79f-7350b67f05df tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb" status: 200 len: 1680 microversion: 2.1 time: 0.783501 Jul 19 22:56:39.383887 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2595/5197] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:56:38 2022] GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb => generated 1680 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:56:40.407067 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9217326d-31e0-4785-9e1e-4d60f0b55140 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:40.411789 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9217326d-31e0-4785-9e1e-4d60f0b55140 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:40.441288 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9217326d-31e0-4785-9e1e-4d60f0b55140 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:40.447185 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9217326d-31e0-4785-9e1e-4d60f0b55140 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:40.451381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9217326d-31e0-4785-9e1e-4d60f0b55140 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:40.454445 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9217326d-31e0-4785-9e1e-4d60f0b55140 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:40.709987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-682db4c9-2fe0-47ef-86e7-6b40c8088546 req-5d6af596-143a-4a72-8924-cc754eac9dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2998191-f80d-4a79-97d8-3c32a55cc5bb", "name": "network-vif-deleted", "tag": "908289fb-1032-458b-8e1f-4aa7e1f74bc1"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:56:40.730410 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-682db4c9-2fe0-47ef-86e7-6b40c8088546 req-5d6af596-143a-4a72-8924-cc754eac9dc8 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:40.739993 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-682db4c9-2fe0-47ef-86e7-6b40c8088546 req-5d6af596-143a-4a72-8924-cc754eac9dc8 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:40.765500 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-682db4c9-2fe0-47ef-86e7-6b40c8088546 req-5d6af596-143a-4a72-8924-cc754eac9dc8 service nova] Creating event network-vif-deleted:908289fb-1032-458b-8e1f-4aa7e1f74bc1 for instance e2998191-f80d-4a79-97d8-3c32a55cc5bb on n-h2-847009-3 Jul 19 22:56:40.786979 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-682db4c9-2fe0-47ef-86e7-6b40c8088546 req-5d6af596-143a-4a72-8924-cc754eac9dc8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080654 Jul 19 22:56:40.791910 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2596/5198] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:56:40.887575 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9217326d-31e0-4785-9e1e-4d60f0b55140 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:40.901701 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9217326d-31e0-4785-9e1e-4d60f0b55140 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb" status: 200 len: 1612 microversion: 2.1 time: 0.501464 Jul 19 22:56:40.902449 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2603/5199] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:56:40 2022] GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb => generated 1612 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:56:41.925813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4df21bad-20b4-4fc0-9646-6a15206f6bd9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:41.925813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4df21bad-20b4-4fc0-9646-6a15206f6bd9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:41.936585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4df21bad-20b4-4fc0-9646-6a15206f6bd9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:41.938571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4df21bad-20b4-4fc0-9646-6a15206f6bd9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:41.940994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4df21bad-20b4-4fc0-9646-6a15206f6bd9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:41.943675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4df21bad-20b4-4fc0-9646-6a15206f6bd9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:41.979021 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-4df21bad-20b4-4fc0-9646-6a15206f6bd9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] HTTP exception thrown: Instance e2998191-f80d-4a79-97d8-3c32a55cc5bb could not be found. Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4df21bad-20b4-4fc0-9646-6a15206f6bd9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Request method failure captured: Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb HTTP/1.1 Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zVsSOX-O7ggDcH00KLmZx8wOtg3S3Su8gJRQI2lYa4BxC-OxvaOKnPb2I4UGxeYv7AyyS8e-HsUydLYlXpELI3RwSo4aU8bY9u8sE-NNAsyuAsZv_PYlNBhbG0F8quyfyoOYST6GA8Fbv-UJaQmRhd0xcvaUwo2b-fKMEkbL-YV9Cg Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: c3929e62eb4345f8a69fec37ba7c195f Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance e2998191-f80d-4a79-97d8-3c32a55cc5bb could not be found. Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'e2998191-f80d-4a79-97d8-3c32a55cc5bb'} Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2998191-f80d-4a79-97d8-3c32a55cc5bb could not be found. Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2998191-f80d-4a79-97d8-3c32a55cc5bb could not be found. Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:56:41.981541 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:56:41.985260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:56:41.985260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:56:41.985260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:56:41.985260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:56:41.985260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:56:41.985260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2998191-f80d-4a79-97d8-3c32a55cc5bb could not be found. Jul 19 22:56:41.985260 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:56:41.990881 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4df21bad-20b4-4fc0-9646-6a15206f6bd9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Returning 404 to user: Instance e2998191-f80d-4a79-97d8-3c32a55cc5bb could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:56:41.992140 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4df21bad-20b4-4fc0-9646-6a15206f6bd9 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb" status: 404 len: 111 microversion: 2.1 time: 0.075647 Jul 19 22:56:41.997910 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2597/5200] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:56:41 2022] GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:56:42.011869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c9d623e3-5900-4612-8f13-2ad79c6bb58c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '.version_select at 0x7f7a02fed940>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:42.066647 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c9d623e3-5900-4612-8f13-2ad79c6bb58c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-982002736" status: 202 len: 0 microversion: 2.1 time: 0.068807 Jul 19 22:56:42.070514 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2604/5201] 10.222.0.25 () {58 vars in 1217 bytes} [Tue Jul 19 22:56:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-982002736 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:56:44.362031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-27cfb58c-b8ab-4f62-b20d-59581274bedf tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Action: 'create', calling method: .version_select at 0x7f7a039a8af0>, body: {"keypair": {"name": "tempest-keypair-1458017337", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9VU6n7cUkZEtPnAWBd2AzNMUqguCPPeVIeow0lut1qT4NnSAa7aJBZvmnCjFh8B87pC4XDXEdIxnoUs7Srcr1c+pgVsDn9cAs0Ui7vo73S/RaB+4nk6mmn1vZUwnlW+A=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:56:44.400661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-27cfb58c-b8ab-4f62-b20d-59581274bedf tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Getting quotas for project e3b759a0bda64e3c9df38b624d4145b6. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:56:44.421192 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-27cfb58c-b8ab-4f62-b20d-59581274bedf tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Getting quotas for user c3929e62eb4345f8a69fec37ba7c195f and project e3b759a0bda64e3c9df38b624d4145b6. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:56:44.467070 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-27cfb58c-b8ab-4f62-b20d-59581274bedf tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114500 Jul 19 22:56:44.468143 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2598/5202] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:56:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:56:46.717242 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3517e96c-15e4-44c1-b3b9-f33699efd3d9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:46.718528 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3517e96c-15e4-44c1-b3b9-f33699efd3d9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:46.739509 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=4 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:56:46.745508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3517e96c-15e4-44c1-b3b9-f33699efd3d9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:46.746768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3517e96c-15e4-44c1-b3b9-f33699efd3d9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:46.748573 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3517e96c-15e4-44c1-b3b9-f33699efd3d9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:46.750956 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3517e96c-15e4-44c1-b3b9-f33699efd3d9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:46.830010 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3517e96c-15e4-44c1-b3b9-f33699efd3d9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/os-volume_attachments/c4560f4e-44b8-4084-a542-e3298d9de035" status: 200 len: 194 microversion: 2.20 time: 0.119831 Jul 19 22:56:46.831888 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2605/5203] 10.222.0.25 () {60 vars in 1453 bytes} [Tue Jul 19 22:56:46 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/os-volume_attachments/c4560f4e-44b8-4084-a542-e3298d9de035 => generated 194 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:56:46.941395 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a27a7664-54d9-47e9-993c-13d807857a02 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:46.942006 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a27a7664-54d9-47e9-993c-13d807857a02 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:46.973489 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a27a7664-54d9-47e9-993c-13d807857a02 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:46.973954 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a27a7664-54d9-47e9-993c-13d807857a02 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:46.974756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a27a7664-54d9-47e9-993c-13d807857a02 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:46.975929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a27a7664-54d9-47e9-993c-13d807857a02 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:47.223383 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-a27a7664-54d9-47e9-993c-13d807857a02 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lazy-loading 'services' on Instance uuid 4d98192d-dabe-4541-b7c6-c057e4269d64 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:56:47.345229 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a27a7664-54d9-47e9-993c-13d807857a02 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/os-volume_attachments/c4560f4e-44b8-4084-a542-e3298d9de035" status: 202 len: 0 microversion: 2.20 time: 0.408796 Jul 19 22:56:47.346110 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2599/5204] 10.222.0.25 () {60 vars in 1456 bytes} [Tue Jul 19 22:56:46 2022] DELETE /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/os-volume_attachments/c4560f4e-44b8-4084-a542-e3298d9de035 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:56:47.356777 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6605e175-e445-4e92-8916-eb0002791cbd tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:47.358565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6605e175-e445-4e92-8916-eb0002791cbd tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:47.378953 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6605e175-e445-4e92-8916-eb0002791cbd tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:47.380626 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6605e175-e445-4e92-8916-eb0002791cbd tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:47.381604 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6605e175-e445-4e92-8916-eb0002791cbd tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:47.389260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6605e175-e445-4e92-8916-eb0002791cbd tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:47.437728 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6605e175-e445-4e92-8916-eb0002791cbd tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086256 Jul 19 22:56:47.438888 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2606/5205] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 19 22:56:47 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:56:48.328630 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-86b3f18c-3782-43e3-b015-5f202e1f9671 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1444235229", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d10914df-2da2-4f58-98fa-60d9a22bab41"}], "security_groups": [{"name": "tempest-securitygroup--1401690229"}], "key_name": "tempest-keypair-1458017337", "user_data": "}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:56:48.459555 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9c96a9bf-da7f-43c8-a6ff-a683cba4fd9e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:48.460545 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9c96a9bf-da7f-43c8-a6ff-a683cba4fd9e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:48.495788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9c96a9bf-da7f-43c8-a6ff-a683cba4fd9e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:48.496237 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9c96a9bf-da7f-43c8-a6ff-a683cba4fd9e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:48.497025 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9c96a9bf-da7f-43c8-a6ff-a683cba4fd9e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:48.497460 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9c96a9bf-da7f-43c8-a6ff-a683cba4fd9e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:48.535761 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9c96a9bf-da7f-43c8-a6ff-a683cba4fd9e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089654 Jul 19 22:56:48.536669 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2607/5206] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 19 22:56:48 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:56:48.927583 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-86b3f18c-3782-43e3-b015-5f202e1f9671 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] validate_networks() for [('d10914df-2da2-4f58-98fa-60d9a22bab41', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:56:49.418908 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-541bfd54-0b82-4be5-ba54-c73c0cb36b9e tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:49.420492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-541bfd54-0b82-4be5-ba54-c73c0cb36b9e tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:49.431291 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-541bfd54-0b82-4be5-ba54-c73c0cb36b9e tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:49.431630 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-541bfd54-0b82-4be5-ba54-c73c0cb36b9e tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:49.437468 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-541bfd54-0b82-4be5-ba54-c73c0cb36b9e tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:49.450858 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-541bfd54-0b82-4be5-ba54-c73c0cb36b9e tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:50.455657 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-541bfd54-0b82-4be5-ba54-c73c0cb36b9e tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1834 microversion: 2.1 time: 1.416736 Jul 19 22:56:50.459482 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2608/5207] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:56:49 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1834 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:56:50.466541 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dfdf870c-04b8-4d80-8aea-668246d981f1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:50.467879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dfdf870c-04b8-4d80-8aea-668246d981f1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:50.478146 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dfdf870c-04b8-4d80-8aea-668246d981f1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:50.478833 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dfdf870c-04b8-4d80-8aea-668246d981f1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:50.480003 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dfdf870c-04b8-4d80-8aea-668246d981f1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:50.480653 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dfdf870c-04b8-4d80-8aea-668246d981f1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:50.535147 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dfdf870c-04b8-4d80-8aea-668246d981f1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073934 Jul 19 22:56:50.536161 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2609/5208] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 19 22:56:50 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:56:50.920655 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-86b3f18c-3782-43e3-b015-5f202e1f9671 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:56:50.921750 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-86b3f18c-3782-43e3-b015-5f202e1f9671 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:56:50.922386 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-86b3f18c-3782-43e3-b015-5f202e1f9671 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:56:50.922953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-86b3f18c-3782-43e3-b015-5f202e1f9671 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:56:50.923604 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-86b3f18c-3782-43e3-b015-5f202e1f9671 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:56:50.938429 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86b3f18c-3782-43e3-b015-5f202e1f9671 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:50.939029 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86b3f18c-3782-43e3-b015-5f202e1f9671 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:50.940083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86b3f18c-3782-43e3-b015-5f202e1f9671 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:50.942054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86b3f18c-3782-43e3-b015-5f202e1f9671 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:51.052377 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-86b3f18c-3782-43e3-b015-5f202e1f9671 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Getting quotas for project e3b759a0bda64e3c9df38b624d4145b6. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:56:51.077662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-86b3f18c-3782-43e3-b015-5f202e1f9671 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Getting quotas for user c3929e62eb4345f8a69fec37ba7c195f and project e3b759a0bda64e3c9df38b624d4145b6. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:56:51.111734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-86b3f18c-3782-43e3-b015-5f202e1f9671 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:56:51.124179 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-86b3f18c-3782-43e3-b015-5f202e1f9671 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:56:51.198626 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-86b3f18c-3782-43e3-b015-5f202e1f9671 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.875055 Jul 19 22:56:51.209160 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2600/5209] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:56:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 2881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:56:51.216263 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-782f49ae-2573-4037-85e9-2dde1575b082 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:51.217102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-782f49ae-2573-4037-85e9-2dde1575b082 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:51.464735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-782f49ae-2573-4037-85e9-2dde1575b082 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:51.472212 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-782f49ae-2573-4037-85e9-2dde1575b082 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31" status: 200 len: 1242 microversion: 2.1 time: 0.260874 Jul 19 22:56:51.481846 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2610/5210] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:56:51 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31 => generated 1242 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:56:51.549142 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-186579e0-e7df-4215-b0f1-8570a26ee89b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:51.552084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-186579e0-e7df-4215-b0f1-8570a26ee89b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:51.563734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-186579e0-e7df-4215-b0f1-8570a26ee89b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:51.567479 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-186579e0-e7df-4215-b0f1-8570a26ee89b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:51.570516 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-186579e0-e7df-4215-b0f1-8570a26ee89b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:51.585052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-186579e0-e7df-4215-b0f1-8570a26ee89b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:51.696011 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-186579e0-e7df-4215-b0f1-8570a26ee89b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.152006 Jul 19 22:56:51.697437 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2601/5211] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 19 22:56:51 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:56:52.489098 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-885c803a-9649-4cbf-9cdd-c7a8ae5665f3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:52.489717 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-885c803a-9649-4cbf-9cdd-c7a8ae5665f3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:52.508156 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-885c803a-9649-4cbf-9cdd-c7a8ae5665f3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:52.511760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-885c803a-9649-4cbf-9cdd-c7a8ae5665f3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:52.515713 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-885c803a-9649-4cbf-9cdd-c7a8ae5665f3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:52.519481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-885c803a-9649-4cbf-9cdd-c7a8ae5665f3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:52.697210 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-885c803a-9649-4cbf-9cdd-c7a8ae5665f3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:52.709122 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1e337dc3-8db0-480d-96ec-5a3e2c06df14 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:52.709694 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-885c803a-9649-4cbf-9cdd-c7a8ae5665f3 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31" status: 200 len: 1238 microversion: 2.1 time: 0.224542 Jul 19 22:56:52.710293 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1e337dc3-8db0-480d-96ec-5a3e2c06df14 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:52.711216 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2611/5212] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:56:52 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31 => generated 1238 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:56:52.733035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1e337dc3-8db0-480d-96ec-5a3e2c06df14 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:52.733613 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1e337dc3-8db0-480d-96ec-5a3e2c06df14 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:52.736415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1e337dc3-8db0-480d-96ec-5a3e2c06df14 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:52.738291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1e337dc3-8db0-480d-96ec-5a3e2c06df14 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:52.830546 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1e337dc3-8db0-480d-96ec-5a3e2c06df14 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.125897 Jul 19 22:56:52.839557 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2602/5213] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 19 22:56:52 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 22:56:53.251457 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3dff52e4-3c80-4d92-a5fb-52a038eafaeb tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-632400044-access_point-1026517368", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "f9828d38-f15b-47df-b1ea-e1a44d5df8ff"}], "key_name": "tempest-TestSecurityGroupsBasicOps-198859728", "security_groups": [{"name": "tempest-secgroup_access--539045692"}, {"name": "tempest-secgroup_general--446183634"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:56:53.674170 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-3dff52e4-3c80-4d92-a5fb-52a038eafaeb tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] validate_networks() for [('f9828d38-f15b-47df-b1ea-e1a44d5df8ff', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:56:53.728855 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9a333189-f19f-43a3-aacc-529bb85b088f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:53.729476 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9a333189-f19f-43a3-aacc-529bb85b088f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:53.742728 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a333189-f19f-43a3-aacc-529bb85b088f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:53.743417 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a333189-f19f-43a3-aacc-529bb85b088f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:53.744718 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a333189-f19f-43a3-aacc-529bb85b088f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:53.745485 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9a333189-f19f-43a3-aacc-529bb85b088f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:54.022542 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9a333189-f19f-43a3-aacc-529bb85b088f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:54.037059 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9a333189-f19f-43a3-aacc-529bb85b088f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31" status: 200 len: 1300 microversion: 2.1 time: 0.306960 Jul 19 22:56:54.038969 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2603/5214] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:56:53 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31 => generated 1300 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:56:54.055604 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e63627c7-d995-46e5-a9c4-e7dcea6ad61d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:54.060355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e63627c7-d995-46e5-a9c4-e7dcea6ad61d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:54.077100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e63627c7-d995-46e5-a9c4-e7dcea6ad61d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:54.077589 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e63627c7-d995-46e5-a9c4-e7dcea6ad61d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:54.078416 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e63627c7-d995-46e5-a9c4-e7dcea6ad61d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:54.078925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e63627c7-d995-46e5-a9c4-e7dcea6ad61d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:54.147189 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:56:54.191982 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e63627c7-d995-46e5-a9c4-e7dcea6ad61d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.151719 Jul 19 22:56:54.196159 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2604/5215] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 19 22:56:54 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:56:55.054725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9f7b3992-7620-4bb1-9e54-63d7838bd40a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:55.055371 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9f7b3992-7620-4bb1-9e54-63d7838bd40a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:55.065294 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9f7b3992-7620-4bb1-9e54-63d7838bd40a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:55.071743 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9f7b3992-7620-4bb1-9e54-63d7838bd40a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:55.079330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9f7b3992-7620-4bb1-9e54-63d7838bd40a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:55.082430 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9f7b3992-7620-4bb1-9e54-63d7838bd40a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:55.258235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9f7b3992-7620-4bb1-9e54-63d7838bd40a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:55.279652 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9f7b3992-7620-4bb1-9e54-63d7838bd40a tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31" status: 200 len: 1300 microversion: 2.1 time: 0.229091 Jul 19 22:56:55.283737 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2605/5216] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:56:55 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31 => generated 1300 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:56:55.298626 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b15d89f1-6a10-44a6-a21b-d380056625db tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:55.298854 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-3dff52e4-3c80-4d92-a5fb-52a038eafaeb tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:56:55.299345 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-3dff52e4-3c80-4d92-a5fb-52a038eafaeb tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:56:55.299861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-3dff52e4-3c80-4d92-a5fb-52a038eafaeb tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:56:55.300838 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-3dff52e4-3c80-4d92-a5fb-52a038eafaeb tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:56:55.301033 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b15d89f1-6a10-44a6-a21b-d380056625db tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:55.301392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-3dff52e4-3c80-4d92-a5fb-52a038eafaeb tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:56:55.309800 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b15d89f1-6a10-44a6-a21b-d380056625db tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:55.310608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b15d89f1-6a10-44a6-a21b-d380056625db tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:55.312765 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b15d89f1-6a10-44a6-a21b-d380056625db tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:55.313450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b15d89f1-6a10-44a6-a21b-d380056625db tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:55.324219 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3dff52e4-3c80-4d92-a5fb-52a038eafaeb tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:55.333027 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3dff52e4-3c80-4d92-a5fb-52a038eafaeb tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:55.334173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3dff52e4-3c80-4d92-a5fb-52a038eafaeb tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:55.334763 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3dff52e4-3c80-4d92-a5fb-52a038eafaeb tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:55.353415 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b15d89f1-6a10-44a6-a21b-d380056625db tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064936 Jul 19 22:56:55.354715 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2606/5217] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 19 22:56:55 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:56:55.386950 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-3dff52e4-3c80-4d92-a5fb-52a038eafaeb tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Getting quotas for project aacf3f67cf95455985dda79eb06b826c. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:56:55.399196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-3dff52e4-3c80-4d92-a5fb-52a038eafaeb tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Getting quotas for user 4403795b53d3430897fa30d42acbd9ca and project aacf3f67cf95455985dda79eb06b826c. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:56:55.430804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3dff52e4-3c80-4d92-a5fb-52a038eafaeb tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:56:55.433123 n-d-847009-3 devstack@n-api.service[119337]: WARNING nova.utils [None req-3dff52e4-3c80-4d92-a5fb-52a038eafaeb tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-632400044-access_point-1026517368 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-632400044-acc Jul 19 22:56:55.434102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3dff52e4-3c80-4d92-a5fb-52a038eafaeb tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 3724dd6c-5c35-4803-8f22-67900a52bddc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:56:55.547434 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3dff52e4-3c80-4d92-a5fb-52a038eafaeb tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 2.300312 Jul 19 22:56:55.548423 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2612/5218] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:56:53 2022] POST /compute/v2.1/servers => generated 456 bytes in 2302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:56:55.560023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-16c0801c-2cc1-42b8-b534-9d99c781ca22 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:55.560706 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-16c0801c-2cc1-42b8-b534-9d99c781ca22 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 3724dd6c-5c35-4803-8f22-67900a52bddc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:55.780389 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-16c0801c-2cc1-42b8-b534-9d99c781ca22 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:55.791428 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-16c0801c-2cc1-42b8-b534-9d99c781ca22 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc" status: 200 len: 1293 microversion: 2.1 time: 0.234080 Jul 19 22:56:55.792375 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2607/5219] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:56:55 2022] GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc => generated 1293 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:56:56.302085 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bb685b08-c1e7-4367-a14b-17321eacf4b6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:56.302873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bb685b08-c1e7-4367-a14b-17321eacf4b6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:56.312219 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:56:56.314530 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb685b08-c1e7-4367-a14b-17321eacf4b6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:56.316388 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb685b08-c1e7-4367-a14b-17321eacf4b6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:56.318456 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb685b08-c1e7-4367-a14b-17321eacf4b6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:56.319414 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb685b08-c1e7-4367-a14b-17321eacf4b6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:56.335776 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=85 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:56:56.374716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-716501ce-c21e-4f27-9b7d-4befd7761a02 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:56.380310 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-716501ce-c21e-4f27-9b7d-4befd7761a02 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:56.407239 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-716501ce-c21e-4f27-9b7d-4befd7761a02 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:56.417483 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-716501ce-c21e-4f27-9b7d-4befd7761a02 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:56.418679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-716501ce-c21e-4f27-9b7d-4befd7761a02 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:56.421408 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-716501ce-c21e-4f27-9b7d-4befd7761a02 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:56.477473 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-716501ce-c21e-4f27-9b7d-4befd7761a02 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.110174 Jul 19 22:56:56.479000 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2608/5220] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 19 22:56:56 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:56:56.633544 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-90452068-c921-464b-9f74-1c6584e167a0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:56.635525 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-90452068-c921-464b-9f74-1c6584e167a0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:56.650380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-90452068-c921-464b-9f74-1c6584e167a0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:56.651641 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-90452068-c921-464b-9f74-1c6584e167a0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:56.654201 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-90452068-c921-464b-9f74-1c6584e167a0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:56.655298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-90452068-c921-464b-9f74-1c6584e167a0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:56.764438 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-90452068-c921-464b-9f74-1c6584e167a0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:56:56.972308 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bb685b08-c1e7-4367-a14b-17321eacf4b6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:56.992694 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bb685b08-c1e7-4367-a14b-17321eacf4b6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31" status: 200 len: 1368 microversion: 2.1 time: 0.689627 Jul 19 22:56:56.996846 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2613/5221] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:56:56 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31 => generated 1368 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:56:57.008070 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:56:57.024757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c284395b-c73f-4c1a-a33a-fcda207996c7 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:57.028914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c284395b-c73f-4c1a-a33a-fcda207996c7 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 3724dd6c-5c35-4803-8f22-67900a52bddc] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:57.052027 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c284395b-c73f-4c1a-a33a-fcda207996c7 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:57.052484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c284395b-c73f-4c1a-a33a-fcda207996c7 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:57.053262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c284395b-c73f-4c1a-a33a-fcda207996c7 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:57.055014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c284395b-c73f-4c1a-a33a-fcda207996c7 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:57.087080 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-90452068-c921-464b-9f74-1c6584e167a0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 204 len: 0 microversion: 2.20 time: 0.462857 Jul 19 22:56:57.094644 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2609/5222] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 22:56:56 2022] DELETE /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:56:57.102987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c6cb7c32-9875-4247-95be-85e3a1c8120f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:57.103831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c6cb7c32-9875-4247-95be-85e3a1c8120f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:57.111637 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6cb7c32-9875-4247-95be-85e3a1c8120f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:57.113405 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6cb7c32-9875-4247-95be-85e3a1c8120f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:57.115258 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6cb7c32-9875-4247-95be-85e3a1c8120f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:57.115755 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6cb7c32-9875-4247-95be-85e3a1c8120f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:57.196204 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c284395b-c73f-4c1a-a33a-fcda207996c7 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:57.206904 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c284395b-c73f-4c1a-a33a-fcda207996c7 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc" status: 200 len: 1345 microversion: 2.1 time: 0.208423 Jul 19 22:56:57.209806 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2614/5223] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:56:56 2022] GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc => generated 1345 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:56:57.743494 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c6cb7c32-9875-4247-95be-85e3a1c8120f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:57.755020 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c6cb7c32-9875-4247-95be-85e3a1c8120f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:57.756592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c6cb7c32-9875-4247-95be-85e3a1c8120f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:57.757836 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c6cb7c32-9875-4247-95be-85e3a1c8120f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1722 microversion: 2.20 time: 0.661342 Jul 19 22:56:57.758410 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2610/5224] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:56:57 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1722 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:56:58.010461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-89073d94-052f-4032-a15d-61a4a3dcab66 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:58.011284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-89073d94-052f-4032-a15d-61a4a3dcab66 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:58.031959 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-89073d94-052f-4032-a15d-61a4a3dcab66 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:58.035845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-89073d94-052f-4032-a15d-61a4a3dcab66 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:58.046952 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-89073d94-052f-4032-a15d-61a4a3dcab66 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:58.047772 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-89073d94-052f-4032-a15d-61a4a3dcab66 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:58.229807 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d6721bb6-c14f-4ff4-8aa7-6ba4c03a65a1 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:58.230521 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d6721bb6-c14f-4ff4-8aa7-6ba4c03a65a1 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 3724dd6c-5c35-4803-8f22-67900a52bddc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:58.256015 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d6721bb6-c14f-4ff4-8aa7-6ba4c03a65a1 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:58.274013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d6721bb6-c14f-4ff4-8aa7-6ba4c03a65a1 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:58.275473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d6721bb6-c14f-4ff4-8aa7-6ba4c03a65a1 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:58.284961 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d6721bb6-c14f-4ff4-8aa7-6ba4c03a65a1 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:59.601643 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d6721bb6-c14f-4ff4-8aa7-6ba4c03a65a1 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:56:59.632730 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d6721bb6-c14f-4ff4-8aa7-6ba4c03a65a1 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc" status: 200 len: 1345 microversion: 2.1 time: 1.409310 Jul 19 22:56:59.633629 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2611/5225] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:56:58 2022] GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc => generated 1345 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:56:59.653492 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-750bd2ab-6a64-41f7-a7de-f6d814b86d29 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:56:59.657861 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-750bd2ab-6a64-41f7-a7de-f6d814b86d29 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:56:59.689304 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-750bd2ab-6a64-41f7-a7de-f6d814b86d29 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:59.692820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-750bd2ab-6a64-41f7-a7de-f6d814b86d29 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:59.694213 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-750bd2ab-6a64-41f7-a7de-f6d814b86d29 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:56:59.694827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-750bd2ab-6a64-41f7-a7de-f6d814b86d29 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:56:59.802087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-750bd2ab-6a64-41f7-a7de-f6d814b86d29 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:57:00.145118 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-750bd2ab-6a64-41f7-a7de-f6d814b86d29 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 204 len: 0 microversion: 2.1 time: 0.496831 Jul 19 22:57:00.149182 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2612/5226] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:56:59 2022] DELETE /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:57:00.545388 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-463f6d05-fc62-4aaf-a899-8d87175d8962 req-c995ada5-c98e-4fad-bcde-bede051211c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b91701f7-5826-4b0e-acb3-790d11b216c7", "tag": "d8cc3438-9336-4995-b930-8e1b14219550"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:57:00.559678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-463f6d05-fc62-4aaf-a899-8d87175d8962 req-c995ada5-c98e-4fad-bcde-bede051211c0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:00.560132 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-463f6d05-fc62-4aaf-a899-8d87175d8962 req-c995ada5-c98e-4fad-bcde-bede051211c0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:00.582448 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-463f6d05-fc62-4aaf-a899-8d87175d8962 req-c995ada5-c98e-4fad-bcde-bede051211c0 service nova] Creating event network-changed:d8cc3438-9336-4995-b930-8e1b14219550 for instance b91701f7-5826-4b0e-acb3-790d11b216c7 on n-h1-847009-3 Jul 19 22:57:00.594108 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-463f6d05-fc62-4aaf-a899-8d87175d8962 req-c995ada5-c98e-4fad-bcde-bede051211c0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.441322 Jul 19 22:57:00.595794 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2613/5227] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:57:00.602626 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a024c62a-7309-4bd7-a5e6-9d97e35edaf8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:00.604255 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a024c62a-7309-4bd7-a5e6-9d97e35edaf8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:00.615178 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a024c62a-7309-4bd7-a5e6-9d97e35edaf8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:00.616176 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a024c62a-7309-4bd7-a5e6-9d97e35edaf8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:00.617214 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a024c62a-7309-4bd7-a5e6-9d97e35edaf8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:00.617969 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a024c62a-7309-4bd7-a5e6-9d97e35edaf8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:00.627060 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-89073d94-052f-4032-a15d-61a4a3dcab66 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:00.642867 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-89073d94-052f-4032-a15d-61a4a3dcab66 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31" status: 200 len: 1368 microversion: 2.1 time: 2.636910 Jul 19 22:57:00.659612 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2615/5228] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:56:58 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31 => generated 1368 bytes in 2654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:57:00.671592 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-f5e332a3-11e8-4fe7-bb8a-00070ad16afc req-ff7a35b1-4072-4e74-a2e8-e41e53f4b254 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5652b2-98db-4644-8a70-b1fc399aaf31", "tag": "3ea0531a-a5b6-4ae6-b2cc-2c3268eec7bc"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:57:00.697054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-f5e332a3-11e8-4fe7-bb8a-00070ad16afc req-ff7a35b1-4072-4e74-a2e8-e41e53f4b254 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:00.697504 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-f5e332a3-11e8-4fe7-bb8a-00070ad16afc req-ff7a35b1-4072-4e74-a2e8-e41e53f4b254 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:00.730857 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-f5e332a3-11e8-4fe7-bb8a-00070ad16afc req-ff7a35b1-4072-4e74-a2e8-e41e53f4b254 service nova] Creating event network-changed:3ea0531a-a5b6-4ae6-b2cc-2c3268eec7bc for instance 7a5652b2-98db-4644-8a70-b1fc399aaf31 on n-h2-847009-3 Jul 19 22:57:00.758053 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-f5e332a3-11e8-4fe7-bb8a-00070ad16afc req-ff7a35b1-4072-4e74-a2e8-e41e53f4b254 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096509 Jul 19 22:57:00.758993 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2616/5229] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:57:00.777557 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8311a694-a600-406c-bbf0-a7dd5332fe4a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:00.778282 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8311a694-a600-406c-bbf0-a7dd5332fe4a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:00.795912 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8311a694-a600-406c-bbf0-a7dd5332fe4a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:00.797767 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8311a694-a600-406c-bbf0-a7dd5332fe4a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:00.799992 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8311a694-a600-406c-bbf0-a7dd5332fe4a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:00.800890 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8311a694-a600-406c-bbf0-a7dd5332fe4a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:00.977726 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:57:01.082237 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a024c62a-7309-4bd7-a5e6-9d97e35edaf8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:01.094304 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a024c62a-7309-4bd7-a5e6-9d97e35edaf8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:01.102265 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a024c62a-7309-4bd7-a5e6-9d97e35edaf8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:01.104001 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a024c62a-7309-4bd7-a5e6-9d97e35edaf8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1722 microversion: 2.20 time: 0.506335 Jul 19 22:57:01.115750 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2614/5230] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:57:00 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1722 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:57:01.149109 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0f664d24-9d07-4baa-b283-69c8bda98f09 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:01.149771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0f664d24-9d07-4baa-b283-69c8bda98f09 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 3724dd6c-5c35-4803-8f22-67900a52bddc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:01.182822 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0f664d24-9d07-4baa-b283-69c8bda98f09 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:01.183580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0f664d24-9d07-4baa-b283-69c8bda98f09 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:01.184574 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0f664d24-9d07-4baa-b283-69c8bda98f09 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:01.185687 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0f664d24-9d07-4baa-b283-69c8bda98f09 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:01.216773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8311a694-a600-406c-bbf0-a7dd5332fe4a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:01.228140 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8311a694-a600-406c-bbf0-a7dd5332fe4a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1689 microversion: 2.1 time: 0.467876 Jul 19 22:57:01.229599 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2617/5231] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:00 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1689 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:57:01.328338 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0f664d24-9d07-4baa-b283-69c8bda98f09 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:01.350368 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0f664d24-9d07-4baa-b283-69c8bda98f09 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc" status: 200 len: 1351 microversion: 2.1 time: 0.224726 Jul 19 22:57:01.360486 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2615/5232] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:01 2022] GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc => generated 1351 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:57:01.675173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d3352dcc-a2f6-4c2a-a9f3-1943655653bd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:01.683221 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d3352dcc-a2f6-4c2a-a9f3-1943655653bd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:01.738171 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d3352dcc-a2f6-4c2a-a9f3-1943655653bd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:01.739335 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d3352dcc-a2f6-4c2a-a9f3-1943655653bd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:01.740355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d3352dcc-a2f6-4c2a-a9f3-1943655653bd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:01.747261 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d3352dcc-a2f6-4c2a-a9f3-1943655653bd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:01.877166 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-e9acff9a-382d-4263-89f5-f75187303072 req-12059e09-ef8c-4606-aec9-5c2c02343560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d98192d-dabe-4541-b7c6-c057e4269d64", "name": "network-vif-unplugged", "status": "completed", "tag": "06c1d4f8-d555-478d-9923-73caa8771882"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:57:01.899712 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e9acff9a-382d-4263-89f5-f75187303072 req-12059e09-ef8c-4606-aec9-5c2c02343560 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:01.900162 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e9acff9a-382d-4263-89f5-f75187303072 req-12059e09-ef8c-4606-aec9-5c2c02343560 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:01.939674 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-e9acff9a-382d-4263-89f5-f75187303072 req-12059e09-ef8c-4606-aec9-5c2c02343560 service nova] Creating event network-vif-unplugged:06c1d4f8-d555-478d-9923-73caa8771882 for instance 4d98192d-dabe-4541-b7c6-c057e4269d64 on n-h1-847009-3 Jul 19 22:57:01.959025 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-e9acff9a-382d-4263-89f5-f75187303072 req-12059e09-ef8c-4606-aec9-5c2c02343560 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085414 Jul 19 22:57:01.962175 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2616/5233] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:57:02.130464 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-513f2f8c-151b-42f8-9cb4-2202ce5be82e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:02.131212 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-513f2f8c-151b-42f8-9cb4-2202ce5be82e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:02.156644 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-513f2f8c-151b-42f8-9cb4-2202ce5be82e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:02.157104 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-513f2f8c-151b-42f8-9cb4-2202ce5be82e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:02.157900 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-513f2f8c-151b-42f8-9cb4-2202ce5be82e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:02.158346 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-513f2f8c-151b-42f8-9cb4-2202ce5be82e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:02.854373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-513f2f8c-151b-42f8-9cb4-2202ce5be82e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:02.866737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-513f2f8c-151b-42f8-9cb4-2202ce5be82e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:02.868275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-513f2f8c-151b-42f8-9cb4-2202ce5be82e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:02.869466 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-513f2f8c-151b-42f8-9cb4-2202ce5be82e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1654 microversion: 2.20 time: 0.747448 Jul 19 22:57:02.870040 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2617/5234] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:57:02 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1654 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:57:02.884896 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f149635b-7b7b-477b-b75f-ef44d56a87d5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:02.886232 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f149635b-7b7b-477b-b75f-ef44d56a87d5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:02.907090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f149635b-7b7b-477b-b75f-ef44d56a87d5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:02.915896 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f149635b-7b7b-477b-b75f-ef44d56a87d5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:02.917217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f149635b-7b7b-477b-b75f-ef44d56a87d5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:02.917928 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f149635b-7b7b-477b-b75f-ef44d56a87d5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:03.601397 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d3352dcc-a2f6-4c2a-a9f3-1943655653bd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:03.616400 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d3352dcc-a2f6-4c2a-a9f3-1943655653bd tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31" status: 200 len: 1368 microversion: 2.1 time: 1.955938 Jul 19 22:57:03.617518 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2618/5235] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:01 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31 => generated 1368 bytes in 1958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:57:03.622496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-639c766d-3eea-4391-9a58-5ced5c4145cf tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:03.623502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-639c766d-3eea-4391-9a58-5ced5c4145cf tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 3724dd6c-5c35-4803-8f22-67900a52bddc] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:03.632119 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-639c766d-3eea-4391-9a58-5ced5c4145cf tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:03.632910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-639c766d-3eea-4391-9a58-5ced5c4145cf tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:03.633951 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-639c766d-3eea-4391-9a58-5ced5c4145cf tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:03.634615 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-639c766d-3eea-4391-9a58-5ced5c4145cf tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:03.860449 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f149635b-7b7b-477b-b75f-ef44d56a87d5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:03.869877 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f149635b-7b7b-477b-b75f-ef44d56a87d5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1689 microversion: 2.1 time: 0.993484 Jul 19 22:57:03.894349 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2618/5236] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:02 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1689 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:57:03.901105 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f68f3fef-0cf8-43e4-8162-f4f9a2bf7392 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:03.905791 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f68f3fef-0cf8-43e4-8162-f4f9a2bf7392 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:03.922899 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f68f3fef-0cf8-43e4-8162-f4f9a2bf7392 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:03.929432 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-639c766d-3eea-4391-9a58-5ced5c4145cf tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:03.932955 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f68f3fef-0cf8-43e4-8162-f4f9a2bf7392 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:03.934117 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f68f3fef-0cf8-43e4-8162-f4f9a2bf7392 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:03.940180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f68f3fef-0cf8-43e4-8162-f4f9a2bf7392 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:03.960666 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-639c766d-3eea-4391-9a58-5ced5c4145cf tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc" status: 200 len: 1351 microversion: 2.1 time: 0.341720 Jul 19 22:57:03.964421 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2619/5237] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:03 2022] GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc => generated 1351 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:57:04.165906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f68f3fef-0cf8-43e4-8162-f4f9a2bf7392 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:04.189716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f68f3fef-0cf8-43e4-8162-f4f9a2bf7392 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:04.200000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f68f3fef-0cf8-43e4-8162-f4f9a2bf7392 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:04.206574 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f68f3fef-0cf8-43e4-8162-f4f9a2bf7392 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 200 len: 1654 microversion: 2.20 time: 0.305447 Jul 19 22:57:04.208575 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2619/5238] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:57:03 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 1654 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:57:04.638716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-816ffafa-1014-49f0-95d6-541bbdfc0c0b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:04.640931 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-816ffafa-1014-49f0-95d6-541bbdfc0c0b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:04.670862 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-816ffafa-1014-49f0-95d6-541bbdfc0c0b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:04.671963 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-816ffafa-1014-49f0-95d6-541bbdfc0c0b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:04.675308 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-816ffafa-1014-49f0-95d6-541bbdfc0c0b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:04.676742 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-816ffafa-1014-49f0-95d6-541bbdfc0c0b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:04.910643 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-899f28d4-1017-41cd-8d3e-29de84615ba5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:04.912221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-899f28d4-1017-41cd-8d3e-29de84615ba5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:04.928482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-899f28d4-1017-41cd-8d3e-29de84615ba5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:04.930085 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-899f28d4-1017-41cd-8d3e-29de84615ba5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:04.933047 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-899f28d4-1017-41cd-8d3e-29de84615ba5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:04.936514 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-899f28d4-1017-41cd-8d3e-29de84615ba5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:04.949981 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:57:05.361085 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:57:05.418585 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=8 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:57:05.673546 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-899f28d4-1017-41cd-8d3e-29de84615ba5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:05.683964 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-899f28d4-1017-41cd-8d3e-29de84615ba5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1570 microversion: 2.1 time: 0.777996 Jul 19 22:57:05.687860 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2620/5239] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:04 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1570 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:57:05.692932 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-492f303a-e339-4ef3-837f-9e9fb8685c84 req-33fa550e-e367-43c2-9876-2a26fba7c5fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d98192d-dabe-4541-b7c6-c057e4269d64", "name": "network-vif-deleted", "tag": "06c1d4f8-d555-478d-9923-73caa8771882"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:57:05.723949 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-492f303a-e339-4ef3-837f-9e9fb8685c84 req-33fa550e-e367-43c2-9876-2a26fba7c5fe service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:05.724677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-492f303a-e339-4ef3-837f-9e9fb8685c84 req-33fa550e-e367-43c2-9876-2a26fba7c5fe service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:05.737793 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-492f303a-e339-4ef3-837f-9e9fb8685c84 req-33fa550e-e367-43c2-9876-2a26fba7c5fe service nova] Creating event network-vif-deleted:06c1d4f8-d555-478d-9923-73caa8771882 for instance 4d98192d-dabe-4541-b7c6-c057e4269d64 on n-h1-847009-3 Jul 19 22:57:05.757434 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-492f303a-e339-4ef3-837f-9e9fb8685c84 req-33fa550e-e367-43c2-9876-2a26fba7c5fe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068086 Jul 19 22:57:05.758358 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2621/5240] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:57:05.763471 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1e7d2f37-55aa-48cc-a838-2de6f5eb937f tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:05.764167 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1e7d2f37-55aa-48cc-a838-2de6f5eb937f tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 3724dd6c-5c35-4803-8f22-67900a52bddc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:05.788821 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1e7d2f37-55aa-48cc-a838-2de6f5eb937f tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:05.789275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1e7d2f37-55aa-48cc-a838-2de6f5eb937f tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:05.790073 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1e7d2f37-55aa-48cc-a838-2de6f5eb937f tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:05.790518 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1e7d2f37-55aa-48cc-a838-2de6f5eb937f tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:05.791051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=12 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:57:06.305326 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-816ffafa-1014-49f0-95d6-541bbdfc0c0b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:06.359502 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-816ffafa-1014-49f0-95d6-541bbdfc0c0b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31" status: 200 len: 1368 microversion: 2.1 time: 1.728019 Jul 19 22:57:06.360733 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2620/5241] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:04 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31 => generated 1368 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:57:06.366873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d5bb88ed-031c-4b7f-8d2c-48996a230516 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:06.367832 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d5bb88ed-031c-4b7f-8d2c-48996a230516 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:06.376663 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5bb88ed-031c-4b7f-8d2c-48996a230516 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:06.380428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5bb88ed-031c-4b7f-8d2c-48996a230516 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:06.381832 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5bb88ed-031c-4b7f-8d2c-48996a230516 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:06.383259 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5bb88ed-031c-4b7f-8d2c-48996a230516 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:06.406530 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-d5bb88ed-031c-4b7f-8d2c-48996a230516 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] HTTP exception thrown: Instance 4d98192d-dabe-4541-b7c6-c057e4269d64 could not be found. Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d5bb88ed-031c-4b7f-8d2c-48996a230516 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Request method failure captured: Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 HTTP/1.1 Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zXBtbqPn8V6iAUvkzjoFYlGkiZVdrfWgYW80cDUoLS8TKNM5sFDjp_kFdLhlvWjdWQChQHkIbPptsdu_mP0Lervre7-NrJ51O0srk-Wi96t_EyZzzU04UK7X2NzZ3DcMU5ocoL_MVHzcM6QZPbmwSRM214dtbxlcibZSjRhvVSs0N8 Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: f262a7d579e84c07aef4fff8e5eda67e Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1720924693 Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f262a7d579e84c07aef4fff8e5eda67e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f262a7d579e84c07aef4fff8e5eda67e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f262a7d579e84c07aef4fff8e5eda67e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f262a7d579e84c07aef4fff8e5eda67e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1720924693 Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: f262a7d579e84c07aef4fff8e5eda67e Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1720924693 Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AttachVolumeShelveTestJSON-1720924693-project Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1f187e783d5247bfb54c5d27bab4f048 Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1720924693-project Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 4d98192d-dabe-4541-b7c6-c057e4269d64 could not be found. Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '4d98192d-dabe-4541-b7c6-c057e4269d64'} Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d98192d-dabe-4541-b7c6-c057e4269d64 could not be found. Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d98192d-dabe-4541-b7c6-c057e4269d64 could not be found. Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:57:06.408553 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:57:06.412750 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:57:06.412750 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:57:06.412750 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:57:06.412750 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:57:06.412750 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:57:06.412750 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:57:06.412750 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d98192d-dabe-4541-b7c6-c057e4269d64 could not be found. Jul 19 22:57:06.412750 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:57:06.412750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d5bb88ed-031c-4b7f-8d2c-48996a230516 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Returning 404 to user: Instance 4d98192d-dabe-4541-b7c6-c057e4269d64 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:57:06.412750 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d5bb88ed-031c-4b7f-8d2c-48996a230516 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 404 len: 111 microversion: 2.20 time: 0.049780 Jul 19 22:57:06.416402 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2621/5242] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:57:06 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 22:57:06.422034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8522f87b-8fed-4dfd-a88f-53fdce943e4d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '.version_select at 0x7f7a030348b0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:06.489783 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8522f87b-8fed-4dfd-a88f-53fdce943e4d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2134206595" status: 204 len: 0 microversion: 2.20 time: 0.072123 Jul 19 22:57:06.494731 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2622/5243] 10.222.0.25 () {60 vars in 1261 bytes} [Tue Jul 19 22:57:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2134206595 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 22:57:06.707695 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3b786b2e-8f1b-4aa5-acc3-e8539e763722 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:06.708689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3b786b2e-8f1b-4aa5-acc3-e8539e763722 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:06.732031 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b786b2e-8f1b-4aa5-acc3-e8539e763722 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:06.732478 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b786b2e-8f1b-4aa5-acc3-e8539e763722 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:06.733617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b786b2e-8f1b-4aa5-acc3-e8539e763722 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:06.736066 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b786b2e-8f1b-4aa5-acc3-e8539e763722 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:06.830004 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1e7d2f37-55aa-48cc-a838-2de6f5eb937f tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:06.839804 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1e7d2f37-55aa-48cc-a838-2de6f5eb937f tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc" status: 200 len: 1469 microversion: 2.1 time: 1.080208 Jul 19 22:57:06.843662 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2622/5244] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:05 2022] GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc => generated 1469 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:57:07.174707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3b786b2e-8f1b-4aa5-acc3-e8539e763722 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:07.194846 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3b786b2e-8f1b-4aa5-acc3-e8539e763722 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 200 len: 1502 microversion: 2.1 time: 0.493510 Jul 19 22:57:07.204810 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2623/5245] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:06 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 1502 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:57:07.376473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-785abd03-d5b4-41be-a994-e7d11b84c554 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:07.377267 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-785abd03-d5b4-41be-a994-e7d11b84c554 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:07.399150 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-785abd03-d5b4-41be-a994-e7d11b84c554 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:07.400135 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-785abd03-d5b4-41be-a994-e7d11b84c554 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:07.401418 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-785abd03-d5b4-41be-a994-e7d11b84c554 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:07.403869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-785abd03-d5b4-41be-a994-e7d11b84c554 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:07.818153 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-d52c548a-b82e-4324-9ce8-3821908457f1 req-558949ad-2ac1-4742-b57b-23400e856a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b91701f7-5826-4b0e-acb3-790d11b216c7", "name": "network-vif-deleted", "tag": "d8cc3438-9336-4995-b930-8e1b14219550"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:57:07.839467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d52c548a-b82e-4324-9ce8-3821908457f1 req-558949ad-2ac1-4742-b57b-23400e856a12 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:07.841609 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d52c548a-b82e-4324-9ce8-3821908457f1 req-558949ad-2ac1-4742-b57b-23400e856a12 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:07.888254 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-d52c548a-b82e-4324-9ce8-3821908457f1 req-558949ad-2ac1-4742-b57b-23400e856a12 service nova] Creating event network-vif-deleted:d8cc3438-9336-4995-b930-8e1b14219550 for instance b91701f7-5826-4b0e-acb3-790d11b216c7 on n-h1-847009-3 Jul 19 22:57:07.902045 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-d52c548a-b82e-4324-9ce8-3821908457f1 req-558949ad-2ac1-4742-b57b-23400e856a12 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089486 Jul 19 22:57:07.904219 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2624/5246] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:57:07.921725 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c25c409b-bc13-4b07-a4bb-82dc9b68df72 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:07.923497 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c25c409b-bc13-4b07-a4bb-82dc9b68df72 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 3724dd6c-5c35-4803-8f22-67900a52bddc] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:07.944855 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c25c409b-bc13-4b07-a4bb-82dc9b68df72 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:07.946684 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c25c409b-bc13-4b07-a4bb-82dc9b68df72 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:07.948712 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c25c409b-bc13-4b07-a4bb-82dc9b68df72 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:07.951725 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c25c409b-bc13-4b07-a4bb-82dc9b68df72 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:08.106298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-785abd03-d5b4-41be-a994-e7d11b84c554 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:08.123055 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-785abd03-d5b4-41be-a994-e7d11b84c554 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31" status: 200 len: 1368 microversion: 2.1 time: 0.750580 Jul 19 22:57:08.126564 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2623/5247] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:07 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31 => generated 1368 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:57:08.223774 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-427bac90-4fbc-4f84-8403-657c5c31de60 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:08.224862 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-427bac90-4fbc-4f84-8403-657c5c31de60 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: b91701f7-5826-4b0e-acb3-790d11b216c7] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:08.259268 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-427bac90-4fbc-4f84-8403-657c5c31de60 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:08.262448 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-427bac90-4fbc-4f84-8403-657c5c31de60 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:08.265030 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-427bac90-4fbc-4f84-8403-657c5c31de60 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:08.266531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-427bac90-4fbc-4f84-8403-657c5c31de60 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:08.374815 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-427bac90-4fbc-4f84-8403-657c5c31de60 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] HTTP exception thrown: Instance b91701f7-5826-4b0e-acb3-790d11b216c7 could not be found. Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-427bac90-4fbc-4f84-8403-657c5c31de60 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Request method failure captured: Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 HTTP/1.1 Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zUdF3dTnB0MnLNSU90xG3Mpx7x6_lVTVWk_kalEUBRonF6TVdUymuHFpNlc_2myDjPcJPfG0PGHn_BgqvSGWVp3Gv6a0lkSSx5re0O2646fcLC_MOcllI85X5Gsa3U5ByfiHlS7DUHyk3xHJ5Y4v938fzhiDGHEEqMMUHs8ls1DEl4 Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 4b56c5370d5846f8a8c1535c127c0e12 Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1194986010 Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b56c5370d5846f8a8c1535c127c0e12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b56c5370d5846f8a8c1535c127c0e12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b56c5370d5846f8a8c1535c127c0e12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b56c5370d5846f8a8c1535c127c0e12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1194986010 Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 4b56c5370d5846f8a8c1535c127c0e12 Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1194986010 Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TestNetworkAdvancedServerOps-1194986010-project Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: dcfdbbdf932b43b38725f60dadc738c9 Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1194986010-project Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance b91701f7-5826-4b0e-acb3-790d11b216c7 could not be found. Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'b91701f7-5826-4b0e-acb3-790d11b216c7'} Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b91701f7-5826-4b0e-acb3-790d11b216c7 could not be found. Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b91701f7-5826-4b0e-acb3-790d11b216c7 could not be found. Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:57:08.380846 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:57:08.384878 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:57:08.384878 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:57:08.384878 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:57:08.384878 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:57:08.384878 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:57:08.384878 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:57:08.384878 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b91701f7-5826-4b0e-acb3-790d11b216c7 could not be found. Jul 19 22:57:08.384878 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:57:08.392075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-427bac90-4fbc-4f84-8403-657c5c31de60 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Returning 404 to user: Instance b91701f7-5826-4b0e-acb3-790d11b216c7 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:57:08.394051 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-427bac90-4fbc-4f84-8403-657c5c31de60 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7" status: 404 len: 111 microversion: 2.1 time: 0.175647 Jul 19 22:57:08.396208 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2624/5248] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:08 2022] GET /compute/v2.1/servers/b91701f7-5826-4b0e-acb3-790d11b216c7 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:57:08.616627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c25c409b-bc13-4b07-a4bb-82dc9b68df72 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:08.629158 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c25c409b-bc13-4b07-a4bb-82dc9b68df72 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc" status: 200 len: 1469 microversion: 2.1 time: 0.722688 Jul 19 22:57:08.656920 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2625/5249] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:07 2022] GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc => generated 1469 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:57:09.150923 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9429be47-db48-4a94-9fde-1e9fdfff0a16 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:09.156233 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9429be47-db48-4a94-9fde-1e9fdfff0a16 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:09.165040 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9429be47-db48-4a94-9fde-1e9fdfff0a16 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:09.165670 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9429be47-db48-4a94-9fde-1e9fdfff0a16 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:09.166737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9429be47-db48-4a94-9fde-1e9fdfff0a16 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:09.167227 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9429be47-db48-4a94-9fde-1e9fdfff0a16 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:09.502008 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9429be47-db48-4a94-9fde-1e9fdfff0a16 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:09.518529 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9429be47-db48-4a94-9fde-1e9fdfff0a16 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31" status: 200 len: 1368 microversion: 2.1 time: 0.377678 Jul 19 22:57:09.524222 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2625/5250] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:09 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31 => generated 1368 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:57:09.609841 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e6a69af1-ecb1-4e38-8d1b-9492f16617e4 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Action: 'create', calling method: .version_select at 0x7f7a03038820>, body: {"keypair": {"name": "tempest-keypair-665572650", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXtf8KDfLwPLgXqNYnCQAEQ/7P77DWg4aeFMIffR3pk0QPQ+YmxYZ/1UyihlCkXfM/kCxtSONTlrhJ80PQJGwS4TKAKKoTm42VXOYzU28JLaFeuXfRnnayqhzVJe9/2qQ=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:57:09.651302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-e6a69af1-ecb1-4e38-8d1b-9492f16617e4 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Getting quotas for project f262a7d579e84c07aef4fff8e5eda67e. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:57:09.666016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-38677110-af9d-437a-9cda-093821df086c tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:09.667177 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-38677110-af9d-437a-9cda-093821df086c tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 3724dd6c-5c35-4803-8f22-67900a52bddc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:09.687906 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-e6a69af1-ecb1-4e38-8d1b-9492f16617e4 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Getting quotas for user 1f187e783d5247bfb54c5d27bab4f048 and project f262a7d579e84c07aef4fff8e5eda67e. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:57:09.710865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-38677110-af9d-437a-9cda-093821df086c tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:09.713224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-38677110-af9d-437a-9cda-093821df086c tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:09.715495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-38677110-af9d-437a-9cda-093821df086c tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:09.716869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-38677110-af9d-437a-9cda-093821df086c tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:09.774810 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e6a69af1-ecb1-4e38-8d1b-9492f16617e4 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.175632 Jul 19 22:57:09.785517 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2626/5251] 10.222.0.25 () {62 vars in 1199 bytes} [Tue Jul 19 22:57:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 187 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 22:57:09.929921 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-9d656e90-1735-43ca-bc6f-781b1baa9414 req-f2f0dc52-d6b7-48ba-8021-5bc074f3cfc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5652b2-98db-4644-8a70-b1fc399aaf31", "name": "network-vif-plugged", "status": "completed", "tag": "3ea0531a-a5b6-4ae6-b2cc-2c3268eec7bc"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:57:09.956922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-9d656e90-1735-43ca-bc6f-781b1baa9414 req-f2f0dc52-d6b7-48ba-8021-5bc074f3cfc4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:09.959942 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-9d656e90-1735-43ca-bc6f-781b1baa9414 req-f2f0dc52-d6b7-48ba-8021-5bc074f3cfc4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:09.985764 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-9d656e90-1735-43ca-bc6f-781b1baa9414 req-f2f0dc52-d6b7-48ba-8021-5bc074f3cfc4 service nova] Creating event network-vif-plugged:3ea0531a-a5b6-4ae6-b2cc-2c3268eec7bc for instance 7a5652b2-98db-4644-8a70-b1fc399aaf31 on n-h2-847009-3 Jul 19 22:57:09.999275 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-9d656e90-1735-43ca-bc6f-781b1baa9414 req-f2f0dc52-d6b7-48ba-8021-5bc074f3cfc4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072781 Jul 19 22:57:10.001552 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2627/5252] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:57:10.030910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-cc52e25a-d486-49e6-ad5b-74c604d1929d req-59752e56-8ef2-4206-b6eb-b97872c6de00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3724dd6c-5c35-4803-8f22-67900a52bddc", "tag": "01dc1628-900f-4edc-aa29-b8fa137bb75a"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:57:10.054255 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-cc52e25a-d486-49e6-ad5b-74c604d1929d req-59752e56-8ef2-4206-b6eb-b97872c6de00 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:10.057690 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-cc52e25a-d486-49e6-ad5b-74c604d1929d req-59752e56-8ef2-4206-b6eb-b97872c6de00 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:10.100014 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-cc52e25a-d486-49e6-ad5b-74c604d1929d req-59752e56-8ef2-4206-b6eb-b97872c6de00 service nova] Creating event network-changed:01dc1628-900f-4edc-aa29-b8fa137bb75a for instance 3724dd6c-5c35-4803-8f22-67900a52bddc on n-h1-847009-3 Jul 19 22:57:10.116046 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-cc52e25a-d486-49e6-ad5b-74c604d1929d req-59752e56-8ef2-4206-b6eb-b97872c6de00 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111814 Jul 19 22:57:10.119711 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2628/5253] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:57:10.347619 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-38677110-af9d-437a-9cda-093821df086c tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:10.357610 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-38677110-af9d-437a-9cda-093821df086c tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc" status: 200 len: 1469 microversion: 2.1 time: 0.696751 Jul 19 22:57:10.358226 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2626/5254] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:09 2022] GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc => generated 1469 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:57:10.541178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7d8d7e7d-1f34-40fa-a910-cc9a007a853e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:10.542253 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7d8d7e7d-1f34-40fa-a910-cc9a007a853e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:10.564369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d8d7e7d-1f34-40fa-a910-cc9a007a853e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:10.565827 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d8d7e7d-1f34-40fa-a910-cc9a007a853e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:10.568019 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d8d7e7d-1f34-40fa-a910-cc9a007a853e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:10.568713 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d8d7e7d-1f34-40fa-a910-cc9a007a853e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:10.901686 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7d8d7e7d-1f34-40fa-a910-cc9a007a853e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:10.913398 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7d8d7e7d-1f34-40fa-a910-cc9a007a853e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31" status: 200 len: 1368 microversion: 2.1 time: 0.374815 Jul 19 22:57:10.915399 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2629/5255] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:10 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31 => generated 1368 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:57:11.380187 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0f40f76c-f931-4218-89d1-94c6050e3a16 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:11.381454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0f40f76c-f931-4218-89d1-94c6050e3a16 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 3724dd6c-5c35-4803-8f22-67900a52bddc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:11.390816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0f40f76c-f931-4218-89d1-94c6050e3a16 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:11.391590 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0f40f76c-f931-4218-89d1-94c6050e3a16 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:11.392576 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0f40f76c-f931-4218-89d1-94c6050e3a16 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:11.393545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0f40f76c-f931-4218-89d1-94c6050e3a16 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:11.932292 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9bb2bf90-a2a0-419b-b29a-b63a9e4b8c6e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:11.933056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9bb2bf90-a2a0-419b-b29a-b63a9e4b8c6e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:11.955608 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9bb2bf90-a2a0-419b-b29a-b63a9e4b8c6e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:11.956314 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9bb2bf90-a2a0-419b-b29a-b63a9e4b8c6e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:11.957480 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9bb2bf90-a2a0-419b-b29a-b63a9e4b8c6e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:11.959668 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9bb2bf90-a2a0-419b-b29a-b63a9e4b8c6e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:12.140146 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0f40f76c-f931-4218-89d1-94c6050e3a16 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:12.157412 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0f40f76c-f931-4218-89d1-94c6050e3a16 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc" status: 200 len: 1469 microversion: 2.1 time: 0.781844 Jul 19 22:57:12.158707 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2627/5256] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:11 2022] GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc => generated 1469 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:57:12.344986 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9bb2bf90-a2a0-419b-b29a-b63a9e4b8c6e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:12.363658 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9bb2bf90-a2a0-419b-b29a-b63a9e4b8c6e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31" status: 200 len: 1558 microversion: 2.1 time: 0.432196 Jul 19 22:57:12.365249 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2630/5257] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:11 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31 => generated 1558 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:57:12.381904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-75d7298b-4200-46d8-ac15-217ca63bc130 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:12.382460 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-75d7298b-4200-46d8-ac15-217ca63bc130 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:12.389594 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75d7298b-4200-46d8-ac15-217ca63bc130 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:12.390056 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75d7298b-4200-46d8-ac15-217ca63bc130 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:12.390893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75d7298b-4200-46d8-ac15-217ca63bc130 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:12.391531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75d7298b-4200-46d8-ac15-217ca63bc130 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:12.572734 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-75d7298b-4200-46d8-ac15-217ca63bc130 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.193756 Jul 19 22:57:12.573722 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2628/5258] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 19 22:57:12 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-interface => generated 285 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:57:13.177553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fa127f54-d47a-4633-97ef-ae714ff5bba9 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:13.178362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fa127f54-d47a-4633-97ef-ae714ff5bba9 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 3724dd6c-5c35-4803-8f22-67900a52bddc] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:13.192568 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa127f54-d47a-4633-97ef-ae714ff5bba9 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:13.196230 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa127f54-d47a-4633-97ef-ae714ff5bba9 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:13.197185 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa127f54-d47a-4633-97ef-ae714ff5bba9 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:13.197743 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa127f54-d47a-4633-97ef-ae714ff5bba9 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:13.696702 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fa127f54-d47a-4633-97ef-ae714ff5bba9 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:13.717304 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fa127f54-d47a-4633-97ef-ae714ff5bba9 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc" status: 200 len: 1469 microversion: 2.1 time: 0.543477 Jul 19 22:57:13.728679 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2631/5259] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:13 2022] GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc => generated 1469 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:57:14.014213 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-d51ee770-087c-40bb-a875-3bc8d5ee0b11 req-5df3fee1-5e18-41d5-b0e6-6667678789a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3724dd6c-5c35-4803-8f22-67900a52bddc", "name": "network-vif-plugged", "status": "completed", "tag": "01dc1628-900f-4edc-aa29-b8fa137bb75a"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:57:14.036685 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d51ee770-087c-40bb-a875-3bc8d5ee0b11 req-5df3fee1-5e18-41d5-b0e6-6667678789a0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:14.037147 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d51ee770-087c-40bb-a875-3bc8d5ee0b11 req-5df3fee1-5e18-41d5-b0e6-6667678789a0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:14.061266 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-d51ee770-087c-40bb-a875-3bc8d5ee0b11 req-5df3fee1-5e18-41d5-b0e6-6667678789a0 service nova] Creating event network-vif-plugged:01dc1628-900f-4edc-aa29-b8fa137bb75a for instance 3724dd6c-5c35-4803-8f22-67900a52bddc on n-h1-847009-3 Jul 19 22:57:14.078039 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-d51ee770-087c-40bb-a875-3bc8d5ee0b11 req-5df3fee1-5e18-41d5-b0e6-6667678789a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068188 Jul 19 22:57:14.079215 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2629/5260] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:57:14.738484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-19d1091a-8dc1-497c-8aae-c0b18e8bf291 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:14.739416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-19d1091a-8dc1-497c-8aae-c0b18e8bf291 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 3724dd6c-5c35-4803-8f22-67900a52bddc] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:14.748014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-19d1091a-8dc1-497c-8aae-c0b18e8bf291 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:14.751543 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-19d1091a-8dc1-497c-8aae-c0b18e8bf291 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:14.754269 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-19d1091a-8dc1-497c-8aae-c0b18e8bf291 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:14.757448 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-19d1091a-8dc1-497c-8aae-c0b18e8bf291 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:15.122416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-19d1091a-8dc1-497c-8aae-c0b18e8bf291 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:15.134161 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-19d1091a-8dc1-497c-8aae-c0b18e8bf291 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc" status: 200 len: 1469 microversion: 2.1 time: 0.401697 Jul 19 22:57:15.136136 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2632/5261] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:14 2022] GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc => generated 1469 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:57:15.220161 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-896469e1-e6c4-4632-9fe7-05b9aa629c0f req-bb614f28-c764-4c5d-8000-b108fc3125dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5652b2-98db-4644-8a70-b1fc399aaf31", "tag": "3ea0531a-a5b6-4ae6-b2cc-2c3268eec7bc"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:57:15.234885 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-896469e1-e6c4-4632-9fe7-05b9aa629c0f req-bb614f28-c764-4c5d-8000-b108fc3125dc service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:15.235598 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-896469e1-e6c4-4632-9fe7-05b9aa629c0f req-bb614f28-c764-4c5d-8000-b108fc3125dc service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:15.251292 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-896469e1-e6c4-4632-9fe7-05b9aa629c0f req-bb614f28-c764-4c5d-8000-b108fc3125dc service nova] Creating event network-changed:3ea0531a-a5b6-4ae6-b2cc-2c3268eec7bc for instance 7a5652b2-98db-4644-8a70-b1fc399aaf31 on n-h2-847009-3 Jul 19 22:57:15.260379 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-896469e1-e6c4-4632-9fe7-05b9aa629c0f req-bb614f28-c764-4c5d-8000-b108fc3125dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045860 Jul 19 22:57:15.261582 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2630/5262] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:57:16.153104 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0baac5cf-05b3-4b8d-9730-188e4ddb0a40 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:16.154350 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0baac5cf-05b3-4b8d-9730-188e4ddb0a40 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 3724dd6c-5c35-4803-8f22-67900a52bddc] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:16.170314 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0baac5cf-05b3-4b8d-9730-188e4ddb0a40 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:16.171056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0baac5cf-05b3-4b8d-9730-188e4ddb0a40 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:16.173131 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0baac5cf-05b3-4b8d-9730-188e4ddb0a40 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:16.174768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0baac5cf-05b3-4b8d-9730-188e4ddb0a40 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:16.854401 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0baac5cf-05b3-4b8d-9730-188e4ddb0a40 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:16.864381 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0baac5cf-05b3-4b8d-9730-188e4ddb0a40 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc" status: 200 len: 1640 microversion: 2.1 time: 0.715395 Jul 19 22:57:16.868701 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2633/5263] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:16 2022] GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc => generated 1640 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:57:16.898856 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-69de76e3-da89-42f9-a7ed-73a0a0e5ceb8 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:16.900359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-69de76e3-da89-42f9-a7ed-73a0a0e5ceb8 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 3724dd6c-5c35-4803-8f22-67900a52bddc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:16.916035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-69de76e3-da89-42f9-a7ed-73a0a0e5ceb8 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:16.916794 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-69de76e3-da89-42f9-a7ed-73a0a0e5ceb8 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:16.918511 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-69de76e3-da89-42f9-a7ed-73a0a0e5ceb8 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:16.919997 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-69de76e3-da89-42f9-a7ed-73a0a0e5ceb8 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:17.371279 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-69de76e3-da89-42f9-a7ed-73a0a0e5ceb8 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:17.384948 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-69de76e3-da89-42f9-a7ed-73a0a0e5ceb8 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc" status: 200 len: 1640 microversion: 2.1 time: 0.499371 Jul 19 22:57:17.390795 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2631/5264] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:16 2022] GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc => generated 1640 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:57:17.403676 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5eaf2a69-8e21-4cd2-93e4-31756a7144d1 tempest-TestSecurityGroupsBasicOps-361472052 tempest-TestSecurityGroupsBasicOps-361472052-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:17.404532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5eaf2a69-8e21-4cd2-93e4-31756a7144d1 tempest-TestSecurityGroupsBasicOps-361472052 tempest-TestSecurityGroupsBasicOps-361472052-project-admin] [instance: 3724dd6c-5c35-4803-8f22-67900a52bddc] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:17.427206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5eaf2a69-8e21-4cd2-93e4-31756a7144d1 tempest-TestSecurityGroupsBasicOps-361472052 tempest-TestSecurityGroupsBasicOps-361472052-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:17.429669 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5eaf2a69-8e21-4cd2-93e4-31756a7144d1 tempest-TestSecurityGroupsBasicOps-361472052 tempest-TestSecurityGroupsBasicOps-361472052-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:17.433150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5eaf2a69-8e21-4cd2-93e4-31756a7144d1 tempest-TestSecurityGroupsBasicOps-361472052 tempest-TestSecurityGroupsBasicOps-361472052-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:17.433913 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5eaf2a69-8e21-4cd2-93e4-31756a7144d1 tempest-TestSecurityGroupsBasicOps-361472052 tempest-TestSecurityGroupsBasicOps-361472052-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:18.552995 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5eaf2a69-8e21-4cd2-93e4-31756a7144d1 tempest-TestSecurityGroupsBasicOps-361472052 tempest-TestSecurityGroupsBasicOps-361472052-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc" status: 200 len: 1791 microversion: 2.1 time: 1.153113 Jul 19 22:57:18.557423 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2634/5265] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:17 2022] GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc => generated 1791 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:57:19.990247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c35b9d1b-4d6c-45ac-be3c-0b2115ec6f25 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1648039084", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93c1ea45-39d4-4067-9284-38fc63c2a005"}], "security_groups": [{"name": "tempest-securitygroup--210423936"}], "key_name": "tempest-keypair-665572650", "user_data": "}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:57:20.318330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-c35b9d1b-4d6c-45ac-be3c-0b2115ec6f25 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] validate_networks() for [('93c1ea45-39d4-4067-9284-38fc63c2a005', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:57:21.546521 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f085438d-e8c5-49d2-acc8-8b42284026f5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '.version_select at 0x7f7a02fd6ee0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:21.551532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=4 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:57:21.600089 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f085438d-e8c5-49d2-acc8-8b42284026f5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1495931574" status: 202 len: 0 microversion: 2.1 time: 0.057343 Jul 19 22:57:21.605136 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2635/5266] 10.222.0.25 () {58 vars in 1283 bytes} [Tue Jul 19 22:57:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1495931574 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:57:21.668643 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-02717453-dfca-453b-8179-bc8168d6072d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Action: 'create', calling method: .version_select at 0x7f7a02f9e280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1189313167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9vhPTiM5AB56rTESh+zf/euGYx1c+1MrcBV6qhosxjOAG3gQ2lagGjpWubE9Tgl3FZ060pF9s9NYkW125rJ8Vhm1BgITOI6RaVXKCnOHSq9+8ZSOvKibkxvWFhHxE2Fg=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:57:21.687610 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-c35b9d1b-4d6c-45ac-be3c-0b2115ec6f25 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:57:21.688121 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-c35b9d1b-4d6c-45ac-be3c-0b2115ec6f25 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:57:21.688576 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-c35b9d1b-4d6c-45ac-be3c-0b2115ec6f25 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:57:21.688992 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-c35b9d1b-4d6c-45ac-be3c-0b2115ec6f25 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:57:21.689425 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-c35b9d1b-4d6c-45ac-be3c-0b2115ec6f25 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:57:21.691491 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-02717453-dfca-453b-8179-bc8168d6072d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Getting quotas for project 4b56c5370d5846f8a8c1535c127c0e12. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:57:21.737178 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c35b9d1b-4d6c-45ac-be3c-0b2115ec6f25 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:21.739532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-02717453-dfca-453b-8179-bc8168d6072d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Getting quotas for user dcfdbbdf932b43b38725f60dadc738c9 and project 4b56c5370d5846f8a8c1535c127c0e12. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:57:21.743072 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c35b9d1b-4d6c-45ac-be3c-0b2115ec6f25 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:21.744417 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c35b9d1b-4d6c-45ac-be3c-0b2115ec6f25 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:21.744417 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c35b9d1b-4d6c-45ac-be3c-0b2115ec6f25 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:21.854275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-c35b9d1b-4d6c-45ac-be3c-0b2115ec6f25 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Getting quotas for project f262a7d579e84c07aef4fff8e5eda67e. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:57:21.863737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-c35b9d1b-4d6c-45ac-be3c-0b2115ec6f25 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Getting quotas for user 1f187e783d5247bfb54c5d27bab4f048 and project f262a7d579e84c07aef4fff8e5eda67e. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:57:21.892433 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-02717453-dfca-453b-8179-bc8168d6072d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.238726 Jul 19 22:57:21.897752 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c35b9d1b-4d6c-45ac-be3c-0b2115ec6f25 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:57:21.900386 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c35b9d1b-4d6c-45ac-be3c-0b2115ec6f25 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:57:21.906268 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2636/5267] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 22:57:21 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:57:22.029363 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c35b9d1b-4d6c-45ac-be3c-0b2115ec6f25 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.043184 Jul 19 22:57:22.034347 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2632/5268] 10.222.0.25 () {62 vars in 1187 bytes} [Tue Jul 19 22:57:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 2050 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 22:57:22.045164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-916c45b9-c84b-42e2-9837-bb83e82a53c4 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:22.046030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-916c45b9-c84b-42e2-9837-bb83e82a53c4 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:22.263508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-916c45b9-c84b-42e2-9837-bb83e82a53c4 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:22.278356 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-916c45b9-c84b-42e2-9837-bb83e82a53c4 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:22.282832 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-916c45b9-c84b-42e2-9837-bb83e82a53c4 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:22.285765 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-916c45b9-c84b-42e2-9837-bb83e82a53c4 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1281 microversion: 2.20 time: 0.244814 Jul 19 22:57:22.300061 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2637/5269] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:57:22 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1281 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:57:23.311228 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1997cd2b-4a9f-431b-8970-d664835cb02b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:23.311892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1997cd2b-4a9f-431b-8970-d664835cb02b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:23.343094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1997cd2b-4a9f-431b-8970-d664835cb02b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:23.344031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1997cd2b-4a9f-431b-8970-d664835cb02b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:23.349427 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1997cd2b-4a9f-431b-8970-d664835cb02b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:23.358774 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1997cd2b-4a9f-431b-8970-d664835cb02b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:23.730130 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1997cd2b-4a9f-431b-8970-d664835cb02b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:23.758449 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1997cd2b-4a9f-431b-8970-d664835cb02b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:23.773820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1997cd2b-4a9f-431b-8970-d664835cb02b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:23.773820 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1997cd2b-4a9f-431b-8970-d664835cb02b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1333 microversion: 2.20 time: 0.460438 Jul 19 22:57:23.776130 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2633/5270] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:57:23 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1333 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:57:24.367735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-d4e3d0df-a277-493b-908f-167c8999552a req-fda626c3-0d2f-4973-9da4-07c31b3f02ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3724dd6c-5c35-4803-8f22-67900a52bddc", "tag": "01dc1628-900f-4edc-aa29-b8fa137bb75a"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:57:24.387710 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d4e3d0df-a277-493b-908f-167c8999552a req-fda626c3-0d2f-4973-9da4-07c31b3f02ee service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:24.388161 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d4e3d0df-a277-493b-908f-167c8999552a req-fda626c3-0d2f-4973-9da4-07c31b3f02ee service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:24.401961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:57:24.457365 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-d4e3d0df-a277-493b-908f-167c8999552a req-fda626c3-0d2f-4973-9da4-07c31b3f02ee service nova] Creating event network-changed:01dc1628-900f-4edc-aa29-b8fa137bb75a for instance 3724dd6c-5c35-4803-8f22-67900a52bddc on n-h1-847009-3 Jul 19 22:57:24.468927 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-d4e3d0df-a277-493b-908f-167c8999552a req-fda626c3-0d2f-4973-9da4-07c31b3f02ee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125696 Jul 19 22:57:24.482761 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2638/5271] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:57:24.797878 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-950b6f2a-2ccc-40fb-8424-10baaf31b6e5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:24.798679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-950b6f2a-2ccc-40fb-8424-10baaf31b6e5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:24.819837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-950b6f2a-2ccc-40fb-8424-10baaf31b6e5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:24.820579 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-950b6f2a-2ccc-40fb-8424-10baaf31b6e5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:24.822324 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-950b6f2a-2ccc-40fb-8424-10baaf31b6e5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:24.823153 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-950b6f2a-2ccc-40fb-8424-10baaf31b6e5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:25.121790 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-950b6f2a-2ccc-40fb-8424-10baaf31b6e5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:25.139282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-950b6f2a-2ccc-40fb-8424-10baaf31b6e5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:25.141104 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-950b6f2a-2ccc-40fb-8424-10baaf31b6e5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:25.152226 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-950b6f2a-2ccc-40fb-8424-10baaf31b6e5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1339 microversion: 2.20 time: 0.359933 Jul 19 22:57:25.154720 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2634/5272] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:57:24 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1339 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:57:26.171154 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-22bcffeb-a745-48c2-99a6-a4309db6f7b7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:26.172811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-22bcffeb-a745-48c2-99a6-a4309db6f7b7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:26.192781 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22bcffeb-a745-48c2-99a6-a4309db6f7b7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:26.193318 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22bcffeb-a745-48c2-99a6-a4309db6f7b7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:26.200092 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22bcffeb-a745-48c2-99a6-a4309db6f7b7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:26.200670 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22bcffeb-a745-48c2-99a6-a4309db6f7b7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:26.652113 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-22bcffeb-a745-48c2-99a6-a4309db6f7b7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:26.671892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-22bcffeb-a745-48c2-99a6-a4309db6f7b7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:26.675435 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-22bcffeb-a745-48c2-99a6-a4309db6f7b7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:26.676673 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-22bcffeb-a745-48c2-99a6-a4309db6f7b7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1339 microversion: 2.20 time: 0.510489 Jul 19 22:57:26.687289 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2639/5273] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:57:26 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1339 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:57:27.697053 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b735ad42-de13-40ba-8441-33e0f5147523 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:27.698338 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b735ad42-de13-40ba-8441-33e0f5147523 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:27.703075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:57:27.724088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b735ad42-de13-40ba-8441-33e0f5147523 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:27.724339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b735ad42-de13-40ba-8441-33e0f5147523 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:27.725260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b735ad42-de13-40ba-8441-33e0f5147523 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:27.726659 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b735ad42-de13-40ba-8441-33e0f5147523 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:28.987299 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b735ad42-de13-40ba-8441-33e0f5147523 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:29.000752 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b735ad42-de13-40ba-8441-33e0f5147523 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:29.003286 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b735ad42-de13-40ba-8441-33e0f5147523 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:29.004458 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b735ad42-de13-40ba-8441-33e0f5147523 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1406 microversion: 2.20 time: 1.313795 Jul 19 22:57:29.016582 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2635/5274] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:57:27 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1406 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:57:30.027529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f0b19b73-4860-4ea8-a58b-a70b725adf7f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:30.029768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f0b19b73-4860-4ea8-a58b-a70b725adf7f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:30.039360 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:57:30.059220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f0b19b73-4860-4ea8-a58b-a70b725adf7f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:30.062127 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f0b19b73-4860-4ea8-a58b-a70b725adf7f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:30.073079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f0b19b73-4860-4ea8-a58b-a70b725adf7f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:30.079861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f0b19b73-4860-4ea8-a58b-a70b725adf7f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:30.508867 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f0b19b73-4860-4ea8-a58b-a70b725adf7f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:30.524527 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f0b19b73-4860-4ea8-a58b-a70b725adf7f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:30.532266 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f0b19b73-4860-4ea8-a58b-a70b725adf7f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:30.536926 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f0b19b73-4860-4ea8-a58b-a70b725adf7f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1406 microversion: 2.20 time: 0.515948 Jul 19 22:57:30.540075 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2640/5275] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:57:30 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1406 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:57:31.560313 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5cfd1a74-81ca-44cf-a6de-d2c115bf8472 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:31.561133 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5cfd1a74-81ca-44cf-a6de-d2c115bf8472 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:31.576629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5cfd1a74-81ca-44cf-a6de-d2c115bf8472 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:31.577006 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5cfd1a74-81ca-44cf-a6de-d2c115bf8472 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:31.578163 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5cfd1a74-81ca-44cf-a6de-d2c115bf8472 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:31.578774 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5cfd1a74-81ca-44cf-a6de-d2c115bf8472 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:31.832522 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:57:31.881121 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:57:31.996063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-99285647-17d0-433f-890c-4b45def808b3 req-21a24d7f-9c1a-4b85-ab40-100a7e8ba0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0", "tag": "f0538c77-95fe-460e-98c5-1e6a3dad7e95"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:57:32.021331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-99285647-17d0-433f-890c-4b45def808b3 req-21a24d7f-9c1a-4b85-ab40-100a7e8ba0c7 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:32.027320 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-99285647-17d0-433f-890c-4b45def808b3 req-21a24d7f-9c1a-4b85-ab40-100a7e8ba0c7 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:32.071654 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-99285647-17d0-433f-890c-4b45def808b3 req-21a24d7f-9c1a-4b85-ab40-100a7e8ba0c7 service nova] Creating event network-changed:f0538c77-95fe-460e-98c5-1e6a3dad7e95 for instance e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 on n-h2-847009-3 Jul 19 22:57:32.096745 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-99285647-17d0-433f-890c-4b45def808b3 req-21a24d7f-9c1a-4b85-ab40-100a7e8ba0c7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100039 Jul 19 22:57:32.100853 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2641/5276] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:57:32.275093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5cfd1a74-81ca-44cf-a6de-d2c115bf8472 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:32.289072 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5cfd1a74-81ca-44cf-a6de-d2c115bf8472 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:32.291197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5cfd1a74-81ca-44cf-a6de-d2c115bf8472 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:32.300045 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5cfd1a74-81ca-44cf-a6de-d2c115bf8472 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1406 microversion: 2.20 time: 0.745944 Jul 19 22:57:32.301326 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2636/5277] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:57:31 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1406 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:57:33.320884 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dbef3289-593e-43d7-89d2-44e26ebe6832 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:33.321594 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dbef3289-593e-43d7-89d2-44e26ebe6832 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:33.334759 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:57:33.360155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dbef3289-593e-43d7-89d2-44e26ebe6832 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:33.361183 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dbef3289-593e-43d7-89d2-44e26ebe6832 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:33.364338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dbef3289-593e-43d7-89d2-44e26ebe6832 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:33.368272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dbef3289-593e-43d7-89d2-44e26ebe6832 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:34.177950 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dbef3289-593e-43d7-89d2-44e26ebe6832 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:34.209459 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dbef3289-593e-43d7-89d2-44e26ebe6832 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:34.215272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dbef3289-593e-43d7-89d2-44e26ebe6832 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:34.217512 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dbef3289-593e-43d7-89d2-44e26ebe6832 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1406 microversion: 2.20 time: 0.903204 Jul 19 22:57:34.218773 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2642/5278] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:57:33 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1406 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:57:35.237257 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5e1d080b-7068-458d-b1da-3e32821fecba tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:35.239430 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5e1d080b-7068-458d-b1da-3e32821fecba tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:35.251414 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e1d080b-7068-458d-b1da-3e32821fecba tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:35.263980 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e1d080b-7068-458d-b1da-3e32821fecba tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:35.265148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e1d080b-7068-458d-b1da-3e32821fecba tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:35.265892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e1d080b-7068-458d-b1da-3e32821fecba tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:35.272970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=79 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:57:36.189791 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5e1d080b-7068-458d-b1da-3e32821fecba tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:36.206018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5e1d080b-7068-458d-b1da-3e32821fecba tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:36.218103 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5e1d080b-7068-458d-b1da-3e32821fecba tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:36.227653 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5e1d080b-7068-458d-b1da-3e32821fecba tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1406 microversion: 2.20 time: 0.987026 Jul 19 22:57:36.228460 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2637/5279] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:57:35 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1406 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:57:37.257578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-08e539f8-4b8e-4692-a14b-4917cb0b9391 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:37.258206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-08e539f8-4b8e-4692-a14b-4917cb0b9391 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:37.274417 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08e539f8-4b8e-4692-a14b-4917cb0b9391 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:37.278210 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08e539f8-4b8e-4692-a14b-4917cb0b9391 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:37.279176 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08e539f8-4b8e-4692-a14b-4917cb0b9391 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:37.282182 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-08e539f8-4b8e-4692-a14b-4917cb0b9391 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:37.750061 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-08e539f8-4b8e-4692-a14b-4917cb0b9391 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:37.765429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-08e539f8-4b8e-4692-a14b-4917cb0b9391 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:37.777547 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-08e539f8-4b8e-4692-a14b-4917cb0b9391 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:37.778844 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-08e539f8-4b8e-4692-a14b-4917cb0b9391 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1406 microversion: 2.20 time: 0.532477 Jul 19 22:57:37.779438 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2643/5280] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:57:37 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1406 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:57:38.809932 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e4414f3e-37dd-41a5-ac30-a3e5e479115f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:38.811050 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e4414f3e-37dd-41a5-ac30-a3e5e479115f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:38.838996 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e4414f3e-37dd-41a5-ac30-a3e5e479115f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:38.839514 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e4414f3e-37dd-41a5-ac30-a3e5e479115f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:38.843887 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e4414f3e-37dd-41a5-ac30-a3e5e479115f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:38.844363 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e4414f3e-37dd-41a5-ac30-a3e5e479115f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:39.370657 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e4414f3e-37dd-41a5-ac30-a3e5e479115f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:39.400509 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e4414f3e-37dd-41a5-ac30-a3e5e479115f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:39.410399 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e4414f3e-37dd-41a5-ac30-a3e5e479115f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:39.414177 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e4414f3e-37dd-41a5-ac30-a3e5e479115f tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1406 microversion: 2.20 time: 0.616834 Jul 19 22:57:39.419927 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2638/5281] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:57:38 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1406 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:57:40.452522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-96529c8f-b6de-4ec3-a276-81a728f55555 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:40.455778 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-96529c8f-b6de-4ec3-a276-81a728f55555 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:40.472789 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-96529c8f-b6de-4ec3-a276-81a728f55555 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:40.474464 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-96529c8f-b6de-4ec3-a276-81a728f55555 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:40.475978 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-96529c8f-b6de-4ec3-a276-81a728f55555 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:40.481758 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-96529c8f-b6de-4ec3-a276-81a728f55555 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:41.571277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-96529c8f-b6de-4ec3-a276-81a728f55555 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:41.587474 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-96529c8f-b6de-4ec3-a276-81a728f55555 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:41.589161 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-96529c8f-b6de-4ec3-a276-81a728f55555 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:41.590446 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-96529c8f-b6de-4ec3-a276-81a728f55555 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1406 microversion: 2.20 time: 1.154963 Jul 19 22:57:41.591021 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2644/5282] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:57:40 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1406 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:57:41.686022 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fd47569a-14c4-49de-b527-3fb4610c3f53 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1926838126", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "6f5860a4-8187-4a15-8eaa-6c4e5e927dd6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1189313167", "security_groups": [{"name": "tempest-secgroup-smoke-1303126159"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:57:42.044583 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-fd47569a-14c4-49de-b527-3fb4610c3f53 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] validate_networks() for [('6f5860a4-8187-4a15-8eaa-6c4e5e927dd6', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:57:42.609754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c7c22c53-5531-408f-98fb-1fbd530d1223 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:42.611221 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c7c22c53-5531-408f-98fb-1fbd530d1223 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:42.621201 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c7c22c53-5531-408f-98fb-1fbd530d1223 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:42.621963 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c7c22c53-5531-408f-98fb-1fbd530d1223 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:42.623560 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c7c22c53-5531-408f-98fb-1fbd530d1223 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:42.624237 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c7c22c53-5531-408f-98fb-1fbd530d1223 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:43.009227 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c7c22c53-5531-408f-98fb-1fbd530d1223 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:43.025216 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c7c22c53-5531-408f-98fb-1fbd530d1223 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:43.026803 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c7c22c53-5531-408f-98fb-1fbd530d1223 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:43.027920 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c7c22c53-5531-408f-98fb-1fbd530d1223 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1406 microversion: 2.20 time: 0.422499 Jul 19 22:57:43.028483 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2645/5283] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:57:42 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1406 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:57:43.064885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-5c281528-d2c8-49f7-9ca3-3753e0e9a9d7 req-a97cf94f-49cb-4b4e-b17f-785b2e133344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0", "name": "network-vif-plugged", "status": "completed", "tag": "f0538c77-95fe-460e-98c5-1e6a3dad7e95"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:57:43.088088 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-5c281528-d2c8-49f7-9ca3-3753e0e9a9d7 req-a97cf94f-49cb-4b4e-b17f-785b2e133344 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:43.088559 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-5c281528-d2c8-49f7-9ca3-3753e0e9a9d7 req-a97cf94f-49cb-4b4e-b17f-785b2e133344 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:43.135333 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-5c281528-d2c8-49f7-9ca3-3753e0e9a9d7 req-a97cf94f-49cb-4b4e-b17f-785b2e133344 service nova] Creating event network-vif-plugged:f0538c77-95fe-460e-98c5-1e6a3dad7e95 for instance e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 on n-h2-847009-3 Jul 19 22:57:43.149923 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-5c281528-d2c8-49f7-9ca3-3753e0e9a9d7 req-a97cf94f-49cb-4b4e-b17f-785b2e133344 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103374 Jul 19 22:57:43.159491 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2646/5284] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:57:43.574109 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-fd47569a-14c4-49de-b527-3fb4610c3f53 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:57:43.575273 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-fd47569a-14c4-49de-b527-3fb4610c3f53 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:57:43.575970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-fd47569a-14c4-49de-b527-3fb4610c3f53 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:57:43.576623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-fd47569a-14c4-49de-b527-3fb4610c3f53 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:57:43.577242 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-fd47569a-14c4-49de-b527-3fb4610c3f53 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:57:43.594828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd47569a-14c4-49de-b527-3fb4610c3f53 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:43.600341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd47569a-14c4-49de-b527-3fb4610c3f53 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:43.606378 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd47569a-14c4-49de-b527-3fb4610c3f53 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:43.607005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd47569a-14c4-49de-b527-3fb4610c3f53 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:43.661788 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-fd47569a-14c4-49de-b527-3fb4610c3f53 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Getting quotas for project 4b56c5370d5846f8a8c1535c127c0e12. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:57:43.670698 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-fd47569a-14c4-49de-b527-3fb4610c3f53 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Getting quotas for user dcfdbbdf932b43b38725f60dadc738c9 and project 4b56c5370d5846f8a8c1535c127c0e12. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:57:43.687016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fd47569a-14c4-49de-b527-3fb4610c3f53 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:57:43.690036 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fd47569a-14c4-49de-b527-3fb4610c3f53 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:57:43.804837 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fd47569a-14c4-49de-b527-3fb4610c3f53 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.123323 Jul 19 22:57:43.809462 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2639/5285] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:57:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 2125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 22:57:43.820641 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-93dfd69d-98a2-4130-84e7-a045e62dbbc7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:43.824832 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-93dfd69d-98a2-4130-84e7-a045e62dbbc7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:44.037406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-93dfd69d-98a2-4130-84e7-a045e62dbbc7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:44.050080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e0055e75-e145-44bb-878a-eefcc9083af6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:44.054462 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e0055e75-e145-44bb-878a-eefcc9083af6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:44.069461 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-93dfd69d-98a2-4130-84e7-a045e62dbbc7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1267 microversion: 2.1 time: 0.256228 Jul 19 22:57:44.074683 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2647/5286] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:43 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1267 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:57:44.077456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e0055e75-e145-44bb-878a-eefcc9083af6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:44.078454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e0055e75-e145-44bb-878a-eefcc9083af6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:44.080502 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e0055e75-e145-44bb-878a-eefcc9083af6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:44.081437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e0055e75-e145-44bb-878a-eefcc9083af6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:44.484581 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e0055e75-e145-44bb-878a-eefcc9083af6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:44.512462 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e0055e75-e145-44bb-878a-eefcc9083af6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:44.517210 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e0055e75-e145-44bb-878a-eefcc9083af6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:44.520103 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e0055e75-e145-44bb-878a-eefcc9083af6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1406 microversion: 2.20 time: 0.476292 Jul 19 22:57:44.535005 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2640/5287] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:57:44 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1406 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:57:45.118958 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f56c0d1a-e21f-480d-a9fd-febd04d18b87 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:45.122541 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f56c0d1a-e21f-480d-a9fd-febd04d18b87 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:45.137773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f56c0d1a-e21f-480d-a9fd-febd04d18b87 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:45.138746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f56c0d1a-e21f-480d-a9fd-febd04d18b87 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:45.141116 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f56c0d1a-e21f-480d-a9fd-febd04d18b87 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:45.142789 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f56c0d1a-e21f-480d-a9fd-febd04d18b87 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:45.329193 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f56c0d1a-e21f-480d-a9fd-febd04d18b87 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:45.338232 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f56c0d1a-e21f-480d-a9fd-febd04d18b87 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1271 microversion: 2.1 time: 0.241271 Jul 19 22:57:45.353231 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2648/5288] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:45 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1271 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:57:45.545150 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6f91ea86-1fef-40e6-9f91-2b24096312a0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:45.545957 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6f91ea86-1fef-40e6-9f91-2b24096312a0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:45.559966 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f91ea86-1fef-40e6-9f91-2b24096312a0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:45.560756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f91ea86-1fef-40e6-9f91-2b24096312a0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:45.561750 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f91ea86-1fef-40e6-9f91-2b24096312a0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:45.562285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f91ea86-1fef-40e6-9f91-2b24096312a0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:45.878539 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6f91ea86-1fef-40e6-9f91-2b24096312a0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:45.895443 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6f91ea86-1fef-40e6-9f91-2b24096312a0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:45.905770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6f91ea86-1fef-40e6-9f91-2b24096312a0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:45.929961 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6f91ea86-1fef-40e6-9f91-2b24096312a0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1598 microversion: 2.20 time: 0.369399 Jul 19 22:57:45.930966 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2641/5289] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:57:45 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1598 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:57:45.960720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-de247fb2-8b9a-43e4-9127-85c2d1dad46c tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:45.961989 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-de247fb2-8b9a-43e4-9127-85c2d1dad46c tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:45.973553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de247fb2-8b9a-43e4-9127-85c2d1dad46c tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:45.975189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de247fb2-8b9a-43e4-9127-85c2d1dad46c tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:45.978367 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de247fb2-8b9a-43e4-9127-85c2d1dad46c tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:45.982000 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de247fb2-8b9a-43e4-9127-85c2d1dad46c tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:46.360399 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-85a9b900-87a3-43e7-afbc-c2266fc872e9 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:46.361803 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-85a9b900-87a3-43e7-afbc-c2266fc872e9 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:46.375395 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85a9b900-87a3-43e7-afbc-c2266fc872e9 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:46.375856 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85a9b900-87a3-43e7-afbc-c2266fc872e9 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:46.376764 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85a9b900-87a3-43e7-afbc-c2266fc872e9 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:46.377335 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85a9b900-87a3-43e7-afbc-c2266fc872e9 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:46.386285 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-de247fb2-8b9a-43e4-9127-85c2d1dad46c tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.434502 Jul 19 22:57:46.386892 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2649/5290] 10.222.0.25 () {60 vars in 1315 bytes} [Tue Jul 19 22:57:45 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0/os-interface => generated 285 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:57:47.573085 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-85a9b900-87a3-43e7-afbc-c2266fc872e9 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:47.600651 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-85a9b900-87a3-43e7-afbc-c2266fc872e9 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1325 microversion: 2.1 time: 1.243850 Jul 19 22:57:47.601697 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2642/5291] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:46 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1325 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:57:48.717108 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5b990065-cd21-4072-878e-e7a2bf573c99 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:48.719745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5b990065-cd21-4072-878e-e7a2bf573c99 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:48.756622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b990065-cd21-4072-878e-e7a2bf573c99 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:48.758302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-c0435289-ce36-49fe-b5b0-4752b9ae9c02 req-0c89c3c0-6c84-434a-9213-c0fa97feac8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0", "tag": "f0538c77-95fe-460e-98c5-1e6a3dad7e95"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:57:48.761926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b990065-cd21-4072-878e-e7a2bf573c99 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:48.769958 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b990065-cd21-4072-878e-e7a2bf573c99 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:48.771255 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b990065-cd21-4072-878e-e7a2bf573c99 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:48.802850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c0435289-ce36-49fe-b5b0-4752b9ae9c02 req-0c89c3c0-6c84-434a-9213-c0fa97feac8f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:48.803768 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c0435289-ce36-49fe-b5b0-4752b9ae9c02 req-0c89c3c0-6c84-434a-9213-c0fa97feac8f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:48.866199 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-c0435289-ce36-49fe-b5b0-4752b9ae9c02 req-0c89c3c0-6c84-434a-9213-c0fa97feac8f service nova] Creating event network-changed:f0538c77-95fe-460e-98c5-1e6a3dad7e95 for instance e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 on n-h2-847009-3 Jul 19 22:57:48.881280 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-c0435289-ce36-49fe-b5b0-4752b9ae9c02 req-0c89c3c0-6c84-434a-9213-c0fa97feac8f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136632 Jul 19 22:57:48.883514 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2643/5292] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:57:48.941979 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5b990065-cd21-4072-878e-e7a2bf573c99 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:48.961749 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5b990065-cd21-4072-878e-e7a2bf573c99 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1325 microversion: 2.1 time: 0.342242 Jul 19 22:57:48.966416 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2650/5293] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:48 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1325 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:57:49.986981 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b7cdd61c-dbfc-428b-84c5-c2f77b69f334 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:49.988394 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b7cdd61c-dbfc-428b-84c5-c2f77b69f334 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:50.008381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b7cdd61c-dbfc-428b-84c5-c2f77b69f334 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:50.009350 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b7cdd61c-dbfc-428b-84c5-c2f77b69f334 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:50.010367 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b7cdd61c-dbfc-428b-84c5-c2f77b69f334 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:50.016630 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b7cdd61c-dbfc-428b-84c5-c2f77b69f334 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:50.231833 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b7cdd61c-dbfc-428b-84c5-c2f77b69f334 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:50.242076 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b7cdd61c-dbfc-428b-84c5-c2f77b69f334 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1325 microversion: 2.1 time: 0.260079 Jul 19 22:57:50.251155 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2644/5294] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:49 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1325 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:57:51.276054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-412d0b41-5e14-40d4-9fac-900bf8a0c59f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:51.278578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-412d0b41-5e14-40d4-9fac-900bf8a0c59f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:51.293835 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-412d0b41-5e14-40d4-9fac-900bf8a0c59f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:51.295149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-412d0b41-5e14-40d4-9fac-900bf8a0c59f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:51.296896 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-412d0b41-5e14-40d4-9fac-900bf8a0c59f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:51.298014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-412d0b41-5e14-40d4-9fac-900bf8a0c59f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:52.281675 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-412d0b41-5e14-40d4-9fac-900bf8a0c59f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:52.301286 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-412d0b41-5e14-40d4-9fac-900bf8a0c59f tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1393 microversion: 2.1 time: 1.034429 Jul 19 22:57:52.302805 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2651/5295] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:51 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1393 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:57:53.198103 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-49eb0252-0c2c-4d90-af23-fa1c5a8b457f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:53.203235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-49eb0252-0c2c-4d90-af23-fa1c5a8b457f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:53.215272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-306c4004-55dd-4de4-8b90-799d5b08bda9 req-6df073b8-6b00-4857-85d8-4e6759205998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e166ac4-ba20-4db0-a559-cdaf0a031790", "tag": "9994a687-e09d-4fb9-b9d1-a6ecd7db6038"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:57:53.237622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-306c4004-55dd-4de4-8b90-799d5b08bda9 req-6df073b8-6b00-4857-85d8-4e6759205998 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:53.240159 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-306c4004-55dd-4de4-8b90-799d5b08bda9 req-6df073b8-6b00-4857-85d8-4e6759205998 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:53.241634 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49eb0252-0c2c-4d90-af23-fa1c5a8b457f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:53.244342 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49eb0252-0c2c-4d90-af23-fa1c5a8b457f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:53.248864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49eb0252-0c2c-4d90-af23-fa1c5a8b457f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:53.249324 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49eb0252-0c2c-4d90-af23-fa1c5a8b457f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:53.283939 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-306c4004-55dd-4de4-8b90-799d5b08bda9 req-6df073b8-6b00-4857-85d8-4e6759205998 service nova] Creating event network-changed:9994a687-e09d-4fb9-b9d1-a6ecd7db6038 for instance 7e166ac4-ba20-4db0-a559-cdaf0a031790 on n-h1-847009-3 Jul 19 22:57:53.302307 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-306c4004-55dd-4de4-8b90-799d5b08bda9 req-6df073b8-6b00-4857-85d8-4e6759205998 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090940 Jul 19 22:57:53.317547 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2652/5296] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:57:53.344791 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cfc27ccc-9a52-44bf-8b93-1769eb639417 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:53.345888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cfc27ccc-9a52-44bf-8b93-1769eb639417 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:53.347794 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-49eb0252-0c2c-4d90-af23-fa1c5a8b457f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/ips" status: 200 len: 150 microversion: 2.1 time: 0.156331 Jul 19 22:57:53.352720 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2645/5297] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 19 22:57:53 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/ips => generated 150 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:57:53.365315 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cfc27ccc-9a52-44bf-8b93-1769eb639417 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:53.367290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cfc27ccc-9a52-44bf-8b93-1769eb639417 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:53.369053 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cfc27ccc-9a52-44bf-8b93-1769eb639417 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:53.369670 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cfc27ccc-9a52-44bf-8b93-1769eb639417 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:53.855953 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cfc27ccc-9a52-44bf-8b93-1769eb639417 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:53.868961 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cfc27ccc-9a52-44bf-8b93-1769eb639417 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1393 microversion: 2.1 time: 0.549540 Jul 19 22:57:53.884925 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2653/5298] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:53 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1393 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:57:54.913411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d7a90217-4d5a-44d5-97d9-0ff09d22f4fb tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:54.915139 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d7a90217-4d5a-44d5-97d9-0ff09d22f4fb tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:54.918158 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:57:54.919498 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:57:54.944968 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7a90217-4d5a-44d5-97d9-0ff09d22f4fb tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:54.952377 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7a90217-4d5a-44d5-97d9-0ff09d22f4fb tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:54.953572 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7a90217-4d5a-44d5-97d9-0ff09d22f4fb tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:54.954255 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7a90217-4d5a-44d5-97d9-0ff09d22f4fb tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:56.463565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e81879d3-6b16-4e19-90d7-1ef32e69ea65 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "689a333f-bff5-4788-93ba-d8b87177137b"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:57:56.471311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e81879d3-6b16-4e19-90d7-1ef32e69ea65 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:56.484483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:57:56.522482 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e81879d3-6b16-4e19-90d7-1ef32e69ea65 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:56.522935 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e81879d3-6b16-4e19-90d7-1ef32e69ea65 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:56.540545 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e81879d3-6b16-4e19-90d7-1ef32e69ea65 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:56.541198 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e81879d3-6b16-4e19-90d7-1ef32e69ea65 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:56.570475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=72 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:57:56.941461 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d7a90217-4d5a-44d5-97d9-0ff09d22f4fb tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:56.963954 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d7a90217-4d5a-44d5-97d9-0ff09d22f4fb tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1393 microversion: 2.1 time: 2.054644 Jul 19 22:57:56.969211 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e81879d3-6b16-4e19-90d7-1ef32e69ea65 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "POST /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.496879 Jul 19 22:57:56.973117 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2654/5299] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 19 22:57:56 2022] POST /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-volume_attachments => generated 194 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:57:56.977698 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2646/5300] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:54 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1393 bytes in 2070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:57:57.983207 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-31842a4f-2819-4e7c-9f01-6a57d9020584 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:57.984818 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-31842a4f-2819-4e7c-9f01-6a57d9020584 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:58.011436 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31842a4f-2819-4e7c-9f01-6a57d9020584 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:58.012544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31842a4f-2819-4e7c-9f01-6a57d9020584 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:58.034581 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31842a4f-2819-4e7c-9f01-6a57d9020584 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:58.035650 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31842a4f-2819-4e7c-9f01-6a57d9020584 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:58.838849 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-31842a4f-2819-4e7c-9f01-6a57d9020584 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:57:58.851021 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-31842a4f-2819-4e7c-9f01-6a57d9020584 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1393 microversion: 2.1 time: 0.872634 Jul 19 22:57:58.855076 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2655/5301] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:57 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1393 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:57:59.872958 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-901e2394-e43b-477c-a991-4f601798d62c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:57:59.873671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-901e2394-e43b-477c-a991-4f601798d62c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:57:59.877082 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:57:59.905133 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-901e2394-e43b-477c-a991-4f601798d62c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:59.905593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-901e2394-e43b-477c-a991-4f601798d62c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:57:59.906419 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-901e2394-e43b-477c-a991-4f601798d62c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:57:59.906872 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-901e2394-e43b-477c-a991-4f601798d62c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:00.367723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-76cd5e7c-cf99-4cda-97c3-f312078c785d req-0af5c115-8ade-41b9-b8e9-d27b9c586e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e166ac4-ba20-4db0-a559-cdaf0a031790", "name": "network-vif-plugged", "status": "completed", "tag": "9994a687-e09d-4fb9-b9d1-a6ecd7db6038"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:58:00.392346 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=34 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:58:00.401824 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-76cd5e7c-cf99-4cda-97c3-f312078c785d req-0af5c115-8ade-41b9-b8e9-d27b9c586e19 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:00.403152 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-76cd5e7c-cf99-4cda-97c3-f312078c785d req-0af5c115-8ade-41b9-b8e9-d27b9c586e19 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:00.445966 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-76cd5e7c-cf99-4cda-97c3-f312078c785d req-0af5c115-8ade-41b9-b8e9-d27b9c586e19 service nova] Creating event network-vif-plugged:9994a687-e09d-4fb9-b9d1-a6ecd7db6038 for instance 7e166ac4-ba20-4db0-a559-cdaf0a031790 on n-h1-847009-3 Jul 19 22:58:00.457252 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-76cd5e7c-cf99-4cda-97c3-f312078c785d req-0af5c115-8ade-41b9-b8e9-d27b9c586e19 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094674 Jul 19 22:58:00.457887 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2656/5302] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:58:01.013037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-901e2394-e43b-477c-a991-4f601798d62c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:01.034735 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-901e2394-e43b-477c-a991-4f601798d62c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1393 microversion: 2.1 time: 1.165781 Jul 19 22:58:01.035809 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2647/5303] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:57:59 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1393 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:02.053873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a046325d-a875-4819-9686-02be1156ef7b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:02.055583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a046325d-a875-4819-9686-02be1156ef7b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:02.072839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a046325d-a875-4819-9686-02be1156ef7b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:02.073721 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a046325d-a875-4819-9686-02be1156ef7b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:02.076653 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a046325d-a875-4819-9686-02be1156ef7b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:02.078749 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a046325d-a875-4819-9686-02be1156ef7b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:02.916960 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a046325d-a875-4819-9686-02be1156ef7b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:02.932270 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a046325d-a875-4819-9686-02be1156ef7b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1393 microversion: 2.1 time: 0.883800 Jul 19 22:58:02.941351 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2657/5304] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:02 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1393 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:03.960838 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c63967e8-76df-4aa1-aab3-de654b434bb2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:03.961464 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c63967e8-76df-4aa1-aab3-de654b434bb2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:03.993811 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c63967e8-76df-4aa1-aab3-de654b434bb2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:03.994273 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c63967e8-76df-4aa1-aab3-de654b434bb2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:03.995512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c63967e8-76df-4aa1-aab3-de654b434bb2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:03.996245 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c63967e8-76df-4aa1-aab3-de654b434bb2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:04.972150 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c63967e8-76df-4aa1-aab3-de654b434bb2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:04.984949 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c63967e8-76df-4aa1-aab3-de654b434bb2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1565 microversion: 2.1 time: 1.030441 Jul 19 22:58:04.991240 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2648/5305] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:03 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1565 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:05.013361 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-90506cc7-317a-4e29-9631-df1d600a6166 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:05.014172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-90506cc7-317a-4e29-9631-df1d600a6166 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:05.035175 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-90506cc7-317a-4e29-9631-df1d600a6166 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:05.036884 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-90506cc7-317a-4e29-9631-df1d600a6166 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:05.039007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-90506cc7-317a-4e29-9631-df1d600a6166 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:05.041052 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-90506cc7-317a-4e29-9631-df1d600a6166 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:06.833649 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-90506cc7-317a-4e29-9631-df1d600a6166 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:06.857077 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-90506cc7-317a-4e29-9631-df1d600a6166 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1565 microversion: 2.1 time: 1.848113 Jul 19 22:58:06.864939 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2658/5306] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:05 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1565 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:13.550736 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-32fa3d5c-b213-430c-9f10-5fc8dc06cdc4 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:13.551411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-32fa3d5c-b213-430c-9f10-5fc8dc06cdc4 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:13.560927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-34db5349-beff-47b6-9ce8-5a0dbd7b7d5e req-09e5b96e-776e-4dcc-a535-08e607c4dbcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e166ac4-ba20-4db0-a559-cdaf0a031790", "tag": "9994a687-e09d-4fb9-b9d1-a6ecd7db6038"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:58:13.586643 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-32fa3d5c-b213-430c-9f10-5fc8dc06cdc4 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:13.587101 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-32fa3d5c-b213-430c-9f10-5fc8dc06cdc4 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:13.587951 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-32fa3d5c-b213-430c-9f10-5fc8dc06cdc4 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:13.606569 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-34db5349-beff-47b6-9ce8-5a0dbd7b7d5e req-09e5b96e-776e-4dcc-a535-08e607c4dbcb service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:13.609824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-32fa3d5c-b213-430c-9f10-5fc8dc06cdc4 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:13.614948 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-34db5349-beff-47b6-9ce8-5a0dbd7b7d5e req-09e5b96e-776e-4dcc-a535-08e607c4dbcb service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:13.661650 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-34db5349-beff-47b6-9ce8-5a0dbd7b7d5e req-09e5b96e-776e-4dcc-a535-08e607c4dbcb service nova] Creating event network-changed:9994a687-e09d-4fb9-b9d1-a6ecd7db6038 for instance 7e166ac4-ba20-4db0-a559-cdaf0a031790 on n-h1-847009-3 Jul 19 22:58:13.672276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=62 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:58:13.682299 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-34db5349-beff-47b6-9ce8-5a0dbd7b7d5e req-09e5b96e-776e-4dcc-a535-08e607c4dbcb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126094 Jul 19 22:58:13.688035 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2659/5307] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:58:13.833373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7940a0a4-383e-47e0-a8d6-614aef395bba tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-959637402", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "d4641b76-c1b8-4726-bcc6-976b2bf587c1"}], "key_name": "tempest-TestSecurityGroupsBasicOps-198859728", "security_groups": []}, "os:scheduler_hints": {"different_host": ["3724dd6c-5c35-4803-8f22-67900a52bddc"]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:58:13.904804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-7940a0a4-383e-47e0-a8d6-614aef395bba tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] validate_networks() for [('d4641b76-c1b8-4726-bcc6-976b2bf587c1', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 22:58:14.994448 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-32fa3d5c-b213-430c-9f10-5fc8dc06cdc4 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:15.019275 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-32fa3d5c-b213-430c-9f10-5fc8dc06cdc4 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1565 microversion: 2.1 time: 1.471563 Jul 19 22:58:15.020651 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2649/5308] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:13 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1565 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:15.052824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-048b1fd1-1028-439e-99e4-a36cb9897d5d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:15.053343 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-048b1fd1-1028-439e-99e4-a36cb9897d5d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:15.096412 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-048b1fd1-1028-439e-99e4-a36cb9897d5d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:15.096884 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-048b1fd1-1028-439e-99e4-a36cb9897d5d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:15.097849 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-048b1fd1-1028-439e-99e4-a36cb9897d5d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:15.098299 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-048b1fd1-1028-439e-99e4-a36cb9897d5d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:15.417174 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-048b1fd1-1028-439e-99e4-a36cb9897d5d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lazy-loading 'services' on Instance uuid 7a5652b2-98db-4644-8a70-b1fc399aaf31 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:58:15.659987 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-048b1fd1-1028-439e-99e4-a36cb9897d5d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-volume_attachments/689a333f-bff5-4788-93ba-d8b87177137b" status: 202 len: 0 microversion: 2.1 time: 0.637482 Jul 19 22:58:15.662087 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2650/5309] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 19 22:58:15 2022] DELETE /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-volume_attachments/689a333f-bff5-4788-93ba-d8b87177137b => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:58:15.696775 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3c04bc15-173a-415e-a75f-c219fe74e7f4 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:15.698055 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3c04bc15-173a-415e-a75f-c219fe74e7f4 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:15.750577 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3c04bc15-173a-415e-a75f-c219fe74e7f4 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:15.760256 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3c04bc15-173a-415e-a75f-c219fe74e7f4 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:15.762929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3c04bc15-173a-415e-a75f-c219fe74e7f4 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:15.763375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3c04bc15-173a-415e-a75f-c219fe74e7f4 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:15.888219 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3c04bc15-173a-415e-a75f-c219fe74e7f4 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.221330 Jul 19 22:58:15.888810 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2651/5310] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:58:15 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-volume_attachments => generated 197 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:58:16.604335 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-7940a0a4-383e-47e0-a8d6-614aef395bba tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 22:58:16.605363 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-7940a0a4-383e-47e0-a8d6-614aef395bba tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 22:58:16.606064 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-7940a0a4-383e-47e0-a8d6-614aef395bba tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 22:58:16.606652 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-7940a0a4-383e-47e0-a8d6-614aef395bba tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 22:58:16.608279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-7940a0a4-383e-47e0-a8d6-614aef395bba tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 22:58:16.627922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7940a0a4-383e-47e0-a8d6-614aef395bba tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:16.629119 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7940a0a4-383e-47e0-a8d6-614aef395bba tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:16.630725 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7940a0a4-383e-47e0-a8d6-614aef395bba tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:16.631525 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7940a0a4-383e-47e0-a8d6-614aef395bba tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:16.668401 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-7940a0a4-383e-47e0-a8d6-614aef395bba tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Getting quotas for project aacf3f67cf95455985dda79eb06b826c. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 22:58:16.708307 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-7940a0a4-383e-47e0-a8d6-614aef395bba tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Getting quotas for user 4403795b53d3430897fa30d42acbd9ca and project aacf3f67cf95455985dda79eb06b826c. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 22:58:16.769458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7940a0a4-383e-47e0-a8d6-614aef395bba tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 22:58:16.803094 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7940a0a4-383e-47e0-a8d6-614aef395bba tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 5344385d-32ea-46d6-b7cd-75345d5d3974] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 22:58:16.909018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-72d22f5b-e73d-44ff-abe7-f5cea038d335 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:16.910173 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-72d22f5b-e73d-44ff-abe7-f5cea038d335 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:16.924533 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-72d22f5b-e73d-44ff-abe7-f5cea038d335 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:16.925083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-72d22f5b-e73d-44ff-abe7-f5cea038d335 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:16.925922 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-72d22f5b-e73d-44ff-abe7-f5cea038d335 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:16.926375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-72d22f5b-e73d-44ff-abe7-f5cea038d335 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:17.046774 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7940a0a4-383e-47e0-a8d6-614aef395bba tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 3.210521 Jul 19 22:58:17.048309 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2660/5311] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 22:58:13 2022] POST /compute/v2.1/servers => generated 361 bytes in 3221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 22:58:17.065916 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-63f9d265-5857-4d15-9a38-5ef43c9dbce5 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:17.067843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-63f9d265-5857-4d15-9a38-5ef43c9dbce5 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 5344385d-32ea-46d6-b7cd-75345d5d3974] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:17.069244 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-72d22f5b-e73d-44ff-abe7-f5cea038d335 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.173151 Jul 19 22:58:17.085347 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2652/5312] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:58:16 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:58:18.097299 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1a306aab-39e7-419b-bc50-b3c9f9fecf2c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:18.103805 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1a306aab-39e7-419b-bc50-b3c9f9fecf2c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:18.151981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-63f9d265-5857-4d15-9a38-5ef43c9dbce5 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:18.157394 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a306aab-39e7-419b-bc50-b3c9f9fecf2c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:18.158301 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a306aab-39e7-419b-bc50-b3c9f9fecf2c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:18.159877 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a306aab-39e7-419b-bc50-b3c9f9fecf2c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:18.163292 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a306aab-39e7-419b-bc50-b3c9f9fecf2c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:18.168517 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-63f9d265-5857-4d15-9a38-5ef43c9dbce5 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974" status: 200 len: 1240 microversion: 2.1 time: 1.109009 Jul 19 22:58:18.170877 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2661/5313] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:17 2022] GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974 => generated 1240 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:58:18.279862 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1a306aab-39e7-419b-bc50-b3c9f9fecf2c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191522 Jul 19 22:58:18.280678 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2653/5314] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:58:18 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:58:19.205277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fecd69b2-b72a-4322-b379-4d631621f620 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:19.208332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fecd69b2-b72a-4322-b379-4d631621f620 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 5344385d-32ea-46d6-b7cd-75345d5d3974] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:19.253311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fecd69b2-b72a-4322-b379-4d631621f620 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:19.255748 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fecd69b2-b72a-4322-b379-4d631621f620 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:19.257671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fecd69b2-b72a-4322-b379-4d631621f620 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:19.259400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fecd69b2-b72a-4322-b379-4d631621f620 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:19.297718 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2ac80055-7c52-4dad-9003-5945a83537d4 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:19.298872 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2ac80055-7c52-4dad-9003-5945a83537d4 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:19.340238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2ac80055-7c52-4dad-9003-5945a83537d4 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:19.344383 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2ac80055-7c52-4dad-9003-5945a83537d4 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:19.351154 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2ac80055-7c52-4dad-9003-5945a83537d4 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:19.353038 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2ac80055-7c52-4dad-9003-5945a83537d4 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:19.478329 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2ac80055-7c52-4dad-9003-5945a83537d4 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.187324 Jul 19 22:58:19.482483 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2654/5315] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:58:19 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:58:19.581596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fecd69b2-b72a-4322-b379-4d631621f620 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:19.599910 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fecd69b2-b72a-4322-b379-4d631621f620 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974" status: 200 len: 1292 microversion: 2.1 time: 0.400083 Jul 19 22:58:19.601892 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2662/5316] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:19 2022] GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974 => generated 1292 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:20.497357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3edc6ee1-ae55-4c59-8272-4c81ccd77d3f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:20.498991 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3edc6ee1-ae55-4c59-8272-4c81ccd77d3f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:20.513762 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3edc6ee1-ae55-4c59-8272-4c81ccd77d3f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:20.519850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3edc6ee1-ae55-4c59-8272-4c81ccd77d3f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:20.524787 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3edc6ee1-ae55-4c59-8272-4c81ccd77d3f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:20.526008 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3edc6ee1-ae55-4c59-8272-4c81ccd77d3f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:20.633774 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c13be91e-7f2e-4fd9-9c60-a444859e186f tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:20.635174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c13be91e-7f2e-4fd9-9c60-a444859e186f tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 5344385d-32ea-46d6-b7cd-75345d5d3974] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:20.647706 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3edc6ee1-ae55-4c59-8272-4c81ccd77d3f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154216 Jul 19 22:58:20.651241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c13be91e-7f2e-4fd9-9c60-a444859e186f tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:20.659669 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c13be91e-7f2e-4fd9-9c60-a444859e186f tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:20.662976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c13be91e-7f2e-4fd9-9c60-a444859e186f tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:20.663574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c13be91e-7f2e-4fd9-9c60-a444859e186f tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:20.670246 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2655/5317] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:58:20 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:58:21.193912 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c13be91e-7f2e-4fd9-9c60-a444859e186f tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:21.202763 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c13be91e-7f2e-4fd9-9c60-a444859e186f tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974" status: 200 len: 1298 microversion: 2.1 time: 0.573163 Jul 19 22:58:21.224189 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2663/5318] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:20 2022] GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974 => generated 1298 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:21.675490 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5c6a474b-04d1-45c0-ad05-3b34ce9e123b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:21.677057 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5c6a474b-04d1-45c0-ad05-3b34ce9e123b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:21.694680 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5c6a474b-04d1-45c0-ad05-3b34ce9e123b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:21.705673 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5c6a474b-04d1-45c0-ad05-3b34ce9e123b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:21.706923 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5c6a474b-04d1-45c0-ad05-3b34ce9e123b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:21.709400 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5c6a474b-04d1-45c0-ad05-3b34ce9e123b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:21.830685 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5c6a474b-04d1-45c0-ad05-3b34ce9e123b tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159932 Jul 19 22:58:21.831329 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2656/5319] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:58:21 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:58:22.222621 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ef07dc5e-bf70-4569-802f-7d1776140d37 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:22.223505 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ef07dc5e-bf70-4569-802f-7d1776140d37 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 5344385d-32ea-46d6-b7cd-75345d5d3974] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:22.243075 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ef07dc5e-bf70-4569-802f-7d1776140d37 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:22.250178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ef07dc5e-bf70-4569-802f-7d1776140d37 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:22.251673 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ef07dc5e-bf70-4569-802f-7d1776140d37 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:22.253165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ef07dc5e-bf70-4569-802f-7d1776140d37 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:22.695279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ef07dc5e-bf70-4569-802f-7d1776140d37 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:22.709026 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ef07dc5e-bf70-4569-802f-7d1776140d37 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974" status: 200 len: 1298 microversion: 2.1 time: 0.491028 Jul 19 22:58:22.718752 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2664/5320] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:22 2022] GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974 => generated 1298 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:22.842195 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e8b193e6-81f7-4771-801a-005572297ef2 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:22.843585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e8b193e6-81f7-4771-801a-005572297ef2 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:22.860986 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8b193e6-81f7-4771-801a-005572297ef2 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:22.861198 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8b193e6-81f7-4771-801a-005572297ef2 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:22.862018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8b193e6-81f7-4771-801a-005572297ef2 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:22.862488 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8b193e6-81f7-4771-801a-005572297ef2 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:22.969103 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e8b193e6-81f7-4771-801a-005572297ef2 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130885 Jul 19 22:58:22.975418 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2657/5321] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:58:22 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:58:23.728618 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5a54cfad-e08b-4fef-836c-8d6daffed480 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:23.729347 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5a54cfad-e08b-4fef-836c-8d6daffed480 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 5344385d-32ea-46d6-b7cd-75345d5d3974] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:23.737351 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a54cfad-e08b-4fef-836c-8d6daffed480 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:23.758396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a54cfad-e08b-4fef-836c-8d6daffed480 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:23.759691 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a54cfad-e08b-4fef-836c-8d6daffed480 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:23.760324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a54cfad-e08b-4fef-836c-8d6daffed480 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:23.986074 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fd938628-ab6e-4ef2-bcf5-bf250a7a847f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:23.987036 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fd938628-ab6e-4ef2-bcf5-bf250a7a847f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:24.008263 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd938628-ab6e-4ef2-bcf5-bf250a7a847f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:24.013457 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd938628-ab6e-4ef2-bcf5-bf250a7a847f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:24.015772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd938628-ab6e-4ef2-bcf5-bf250a7a847f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:24.015772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fd938628-ab6e-4ef2-bcf5-bf250a7a847f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:24.136417 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fd938628-ab6e-4ef2-bcf5-bf250a7a847f tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157220 Jul 19 22:58:24.137355 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2658/5322] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:58:23 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:58:24.215585 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5a54cfad-e08b-4fef-836c-8d6daffed480 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:24.229757 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5a54cfad-e08b-4fef-836c-8d6daffed480 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974" status: 200 len: 1298 microversion: 2.1 time: 0.506627 Jul 19 22:58:24.241313 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2665/5323] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:23 2022] GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974 => generated 1298 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:25.151834 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3cf5c087-35ed-4254-958e-7f67737eead5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:25.153652 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3cf5c087-35ed-4254-958e-7f67737eead5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:25.179059 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3cf5c087-35ed-4254-958e-7f67737eead5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:25.179919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3cf5c087-35ed-4254-958e-7f67737eead5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:25.181986 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3cf5c087-35ed-4254-958e-7f67737eead5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:25.183647 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3cf5c087-35ed-4254-958e-7f67737eead5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:25.248337 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b97436d6-792a-45f4-aacd-d76dcfa6fff7 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:25.250220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b97436d6-792a-45f4-aacd-d76dcfa6fff7 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 5344385d-32ea-46d6-b7cd-75345d5d3974] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:25.279240 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b97436d6-792a-45f4-aacd-d76dcfa6fff7 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:25.281227 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b97436d6-792a-45f4-aacd-d76dcfa6fff7 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:25.284125 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b97436d6-792a-45f4-aacd-d76dcfa6fff7 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:25.288882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b97436d6-792a-45f4-aacd-d76dcfa6fff7 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:25.343528 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3cf5c087-35ed-4254-958e-7f67737eead5 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195489 Jul 19 22:58:25.344704 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2659/5324] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:58:25 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:58:25.590095 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b97436d6-792a-45f4-aacd-d76dcfa6fff7 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:25.610577 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b97436d6-792a-45f4-aacd-d76dcfa6fff7 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974" status: 200 len: 1298 microversion: 2.1 time: 0.366019 Jul 19 22:58:25.623058 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2666/5325] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:25 2022] GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974 => generated 1298 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:58:26.357071 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-678cc6ba-5104-4de7-b8d8-416b4aa9ac6d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:26.358811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-678cc6ba-5104-4de7-b8d8-416b4aa9ac6d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:26.379318 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-678cc6ba-5104-4de7-b8d8-416b4aa9ac6d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:26.379787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-678cc6ba-5104-4de7-b8d8-416b4aa9ac6d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:26.380599 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-678cc6ba-5104-4de7-b8d8-416b4aa9ac6d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:26.381047 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-678cc6ba-5104-4de7-b8d8-416b4aa9ac6d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:26.539816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-24f2601b-4734-43ce-94df-b5cbe5e928d0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:26.540451 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-24f2601b-4734-43ce-94df-b5cbe5e928d0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:26.557814 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24f2601b-4734-43ce-94df-b5cbe5e928d0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:26.559857 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24f2601b-4734-43ce-94df-b5cbe5e928d0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:26.574819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24f2601b-4734-43ce-94df-b5cbe5e928d0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:26.576573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24f2601b-4734-43ce-94df-b5cbe5e928d0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:26.581047 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-678cc6ba-5104-4de7-b8d8-416b4aa9ac6d tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.227331 Jul 19 22:58:26.584298 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2667/5326] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:58:26 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-volume_attachments => generated 197 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:58:26.632455 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c8967c6d-7383-4c6f-92ce-beca98cc1f76 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:26.633395 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c8967c6d-7383-4c6f-92ce-beca98cc1f76 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 5344385d-32ea-46d6-b7cd-75345d5d3974] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:26.636923 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-24f2601b-4734-43ce-94df-b5cbe5e928d0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0/ips" status: 200 len: 151 microversion: 2.20 time: 0.710292 Jul 19 22:58:26.639880 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2660/5327] 10.222.0.25 () {60 vars in 1288 bytes} [Tue Jul 19 22:58:25 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0/ips => generated 151 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 22:58:26.642429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:58:26.644591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c8967c6d-7383-4c6f-92ce-beca98cc1f76 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:26.645823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c8967c6d-7383-4c6f-92ce-beca98cc1f76 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:26.647256 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c8967c6d-7383-4c6f-92ce-beca98cc1f76 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:26.648139 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c8967c6d-7383-4c6f-92ce-beca98cc1f76 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:26.680167 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:58:27.171144 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-a4c746f4-a6ed-4214-8579-85f1ab44b63a req-92c424bc-352b-412c-b802-e7790d997b2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5344385d-32ea-46d6-b7cd-75345d5d3974", "tag": "5aea1afd-05ff-4a7b-a81f-3bcf9a439672"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:58:27.219033 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-a4c746f4-a6ed-4214-8579-85f1ab44b63a req-92c424bc-352b-412c-b802-e7790d997b2e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:27.220159 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-a4c746f4-a6ed-4214-8579-85f1ab44b63a req-92c424bc-352b-412c-b802-e7790d997b2e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:27.288036 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-a4c746f4-a6ed-4214-8579-85f1ab44b63a req-92c424bc-352b-412c-b802-e7790d997b2e service nova] Creating event network-changed:5aea1afd-05ff-4a7b-a81f-3bcf9a439672 for instance 5344385d-32ea-46d6-b7cd-75345d5d3974 on n-h2-847009-3 Jul 19 22:58:27.306229 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-a4c746f4-a6ed-4214-8579-85f1ab44b63a req-92c424bc-352b-412c-b802-e7790d997b2e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144496 Jul 19 22:58:27.311680 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2661/5328] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:58:27.596480 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2de3e049-5794-436e-9411-9a1ed79c8117 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:27.599039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2de3e049-5794-436e-9411-9a1ed79c8117 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:27.611056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c8967c6d-7383-4c6f-92ce-beca98cc1f76 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:27.617067 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2de3e049-5794-436e-9411-9a1ed79c8117 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:27.622965 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c8967c6d-7383-4c6f-92ce-beca98cc1f76 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974" status: 200 len: 1298 microversion: 2.1 time: 0.993917 Jul 19 22:58:27.633836 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2668/5329] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:26 2022] GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974 => generated 1298 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:58:27.634693 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2de3e049-5794-436e-9411-9a1ed79c8117 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:27.636108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2de3e049-5794-436e-9411-9a1ed79c8117 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:27.640169 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2de3e049-5794-436e-9411-9a1ed79c8117 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:27.759847 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2de3e049-5794-436e-9411-9a1ed79c8117 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.168937 Jul 19 22:58:27.765686 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2662/5330] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 22:58:27 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31/os-volume_attachments => generated 25 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 22:58:27.897985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-12506eca-674b-4515-9c76-b07dbe77da8e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:27.898503 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-12506eca-674b-4515-9c76-b07dbe77da8e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:27.906731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12506eca-674b-4515-9c76-b07dbe77da8e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:27.919508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12506eca-674b-4515-9c76-b07dbe77da8e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:27.921059 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12506eca-674b-4515-9c76-b07dbe77da8e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:27.924938 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-12506eca-674b-4515-9c76-b07dbe77da8e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:28.036532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-12506eca-674b-4515-9c76-b07dbe77da8e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:58:28.169449 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=8 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:58:28.270203 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-12506eca-674b-4515-9c76-b07dbe77da8e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31" status: 204 len: 0 microversion: 2.1 time: 0.375872 Jul 19 22:58:28.274071 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2669/5331] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:58:27 2022] DELETE /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:58:28.281122 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9e340323-c888-42d3-9184-c0b425b040d7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:28.282993 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9e340323-c888-42d3-9184-c0b425b040d7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:28.307722 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e340323-c888-42d3-9184-c0b425b040d7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:28.308839 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e340323-c888-42d3-9184-c0b425b040d7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:28.309686 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e340323-c888-42d3-9184-c0b425b040d7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:28.310130 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e340323-c888-42d3-9184-c0b425b040d7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:28.644808 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-62a15ff4-315a-4753-9da0-5816eb2be303 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:28.645661 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-62a15ff4-315a-4753-9da0-5816eb2be303 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 5344385d-32ea-46d6-b7cd-75345d5d3974] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:28.671243 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62a15ff4-315a-4753-9da0-5816eb2be303 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:28.675891 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62a15ff4-315a-4753-9da0-5816eb2be303 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:28.676939 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62a15ff4-315a-4753-9da0-5816eb2be303 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:28.678968 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-62a15ff4-315a-4753-9da0-5816eb2be303 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:29.038724 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-62a15ff4-315a-4753-9da0-5816eb2be303 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:29.070281 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-62a15ff4-315a-4753-9da0-5816eb2be303 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974" status: 200 len: 1298 microversion: 2.1 time: 0.432094 Jul 19 22:58:29.071239 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2670/5332] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:28 2022] GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974 => generated 1298 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:58:29.305595 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9e340323-c888-42d3-9184-c0b425b040d7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:29.324715 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9e340323-c888-42d3-9184-c0b425b040d7 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31" status: 200 len: 1683 microversion: 2.1 time: 1.047956 Jul 19 22:58:29.326708 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2663/5333] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:28 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31 => generated 1683 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:30.086703 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-aa24c011-97c6-4bd4-8b45-e7ea93a815cb tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:30.087436 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-aa24c011-97c6-4bd4-8b45-e7ea93a815cb tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 5344385d-32ea-46d6-b7cd-75345d5d3974] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:30.107004 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa24c011-97c6-4bd4-8b45-e7ea93a815cb tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:30.107490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa24c011-97c6-4bd4-8b45-e7ea93a815cb tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:30.108293 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa24c011-97c6-4bd4-8b45-e7ea93a815cb tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:30.108745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa24c011-97c6-4bd4-8b45-e7ea93a815cb tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:30.345267 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f159f11e-b984-4438-9c3d-2a778d126fac tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:30.346097 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f159f11e-b984-4438-9c3d-2a778d126fac tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:30.359333 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=34 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:58:30.361958 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f159f11e-b984-4438-9c3d-2a778d126fac tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:30.365192 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f159f11e-b984-4438-9c3d-2a778d126fac tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:30.366447 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f159f11e-b984-4438-9c3d-2a778d126fac tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:30.367908 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f159f11e-b984-4438-9c3d-2a778d126fac tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:30.621515 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-aa24c011-97c6-4bd4-8b45-e7ea93a815cb tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:30.641869 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-aa24c011-97c6-4bd4-8b45-e7ea93a815cb tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974" status: 200 len: 1298 microversion: 2.1 time: 0.558565 Jul 19 22:58:30.642750 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2671/5334] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:30 2022] GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974 => generated 1298 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:31.400417 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6e196160-f5d1-4a10-92f3-21ae38c69617 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:58:31.401886 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6e196160-f5d1-4a10-92f3-21ae38c69617 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:31.414229 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:58:31.421479 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e196160-f5d1-4a10-92f3-21ae38c69617 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:31.423616 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e196160-f5d1-4a10-92f3-21ae38c69617 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:31.426938 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e196160-f5d1-4a10-92f3-21ae38c69617 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:31.427927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e196160-f5d1-4a10-92f3-21ae38c69617 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:31.492252 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f159f11e-b984-4438-9c3d-2a778d126fac tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:31.505352 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f159f11e-b984-4438-9c3d-2a778d126fac tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31" status: 200 len: 1683 microversion: 2.1 time: 1.162359 Jul 19 22:58:31.507303 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-6e196160-f5d1-4a10-92f3-21ae38c69617 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lazy-loading 'flavor' on Instance uuid e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:58:31.511724 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2664/5335] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:30 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31 => generated 1683 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:31.540314 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a4664af1-3a55-4211-bc53-9e701be4ec60 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:58:31.541632 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a4664af1-3a55-4211-bc53-9e701be4ec60 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:31.557002 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a4664af1-3a55-4211-bc53-9e701be4ec60 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:31.557763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a4664af1-3a55-4211-bc53-9e701be4ec60 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:31.559060 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a4664af1-3a55-4211-bc53-9e701be4ec60 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:31.559716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a4664af1-3a55-4211-bc53-9e701be4ec60 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:31.633827 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a4664af1-3a55-4211-bc53-9e701be4ec60 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "POST /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790/action" status: 200 len: 24566 microversion: 2.1 time: 0.098693 Jul 19 22:58:31.636280 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2665/5336] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:58:31 2022] POST /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790/action => generated 24566 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:58:31.663656 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-35d8dd02-6fa3-44ab-bbad-c8df87bed5ae tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:31.664442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-35d8dd02-6fa3-44ab-bbad-c8df87bed5ae tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 5344385d-32ea-46d6-b7cd-75345d5d3974] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:31.681665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35d8dd02-6fa3-44ab-bbad-c8df87bed5ae tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:31.682132 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35d8dd02-6fa3-44ab-bbad-c8df87bed5ae tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:31.685242 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35d8dd02-6fa3-44ab-bbad-c8df87bed5ae tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:31.685876 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35d8dd02-6fa3-44ab-bbad-c8df87bed5ae tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:31.759872 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:58:32.015772 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6e196160-f5d1-4a10-92f3-21ae38c69617 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "POST /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0/action" status: 202 len: 0 microversion: 2.20 time: 0.620411 Jul 19 22:58:32.017108 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2672/5337] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Jul 19 22:58:31 2022] POST /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0/action => generated 0 bytes in 623 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 19 22:58:32.026817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-56f6ba7a-bfa2-41cc-a79f-32afb387b110 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:32.027832 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-56f6ba7a-bfa2-41cc-a79f-32afb387b110 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:32.037306 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-56f6ba7a-bfa2-41cc-a79f-32afb387b110 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:32.038667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-56f6ba7a-bfa2-41cc-a79f-32afb387b110 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:32.046352 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-56f6ba7a-bfa2-41cc-a79f-32afb387b110 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:32.047233 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-56f6ba7a-bfa2-41cc-a79f-32afb387b110 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:32.315887 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-35d8dd02-6fa3-44ab-bbad-c8df87bed5ae tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:32.330151 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-35d8dd02-6fa3-44ab-bbad-c8df87bed5ae tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974" status: 200 len: 1298 microversion: 2.1 time: 0.673814 Jul 19 22:58:32.330952 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2666/5338] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:31 2022] GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974 => generated 1298 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:32.535024 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1132febf-7e84-4a5c-9e72-ef49acc66ffb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:32.535980 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1132febf-7e84-4a5c-9e72-ef49acc66ffb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:32.564574 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1132febf-7e84-4a5c-9e72-ef49acc66ffb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:32.565636 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1132febf-7e84-4a5c-9e72-ef49acc66ffb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:32.569346 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1132febf-7e84-4a5c-9e72-ef49acc66ffb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:32.571161 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1132febf-7e84-4a5c-9e72-ef49acc66ffb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:32.589421 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-56f6ba7a-bfa2-41cc-a79f-32afb387b110 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:32.599825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-56f6ba7a-bfa2-41cc-a79f-32afb387b110 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:32.605839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-56f6ba7a-bfa2-41cc-a79f-32afb387b110 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:32.609006 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-56f6ba7a-bfa2-41cc-a79f-32afb387b110 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1722 microversion: 2.20 time: 0.587278 Jul 19 22:58:32.613715 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2673/5339] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:58:32 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1722 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:58:32.771247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1132febf-7e84-4a5c-9e72-ef49acc66ffb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:32.779641 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1132febf-7e84-4a5c-9e72-ef49acc66ffb tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31" status: 200 len: 1615 microversion: 2.1 time: 0.250034 Jul 19 22:58:32.780344 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2667/5340] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:32 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31 => generated 1615 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:58:33.205961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-7313a3f6-23d3-44c5-bf83-69b9ea62dbcc req-4f77db01-712b-414f-bbf1-168a6867411d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5652b2-98db-4644-8a70-b1fc399aaf31", "name": "network-vif-deleted", "tag": "3ea0531a-a5b6-4ae6-b2cc-2c3268eec7bc"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:58:33.228149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-7313a3f6-23d3-44c5-bf83-69b9ea62dbcc req-4f77db01-712b-414f-bbf1-168a6867411d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:33.229090 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-7313a3f6-23d3-44c5-bf83-69b9ea62dbcc req-4f77db01-712b-414f-bbf1-168a6867411d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:33.254599 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-7313a3f6-23d3-44c5-bf83-69b9ea62dbcc req-4f77db01-712b-414f-bbf1-168a6867411d service nova] Creating event network-vif-deleted:3ea0531a-a5b6-4ae6-b2cc-2c3268eec7bc for instance 7a5652b2-98db-4644-8a70-b1fc399aaf31 on n-h2-847009-3 Jul 19 22:58:33.267159 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-7313a3f6-23d3-44c5-bf83-69b9ea62dbcc req-4f77db01-712b-414f-bbf1-168a6867411d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066155 Jul 19 22:58:33.271506 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2674/5341] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:58:33.350481 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-14649be2-ec75-4034-9b8d-70357bc2e26b tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:33.351372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-14649be2-ec75-4034-9b8d-70357bc2e26b tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 5344385d-32ea-46d6-b7cd-75345d5d3974] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:33.365378 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-14649be2-ec75-4034-9b8d-70357bc2e26b tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:33.366181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-14649be2-ec75-4034-9b8d-70357bc2e26b tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:33.367417 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-14649be2-ec75-4034-9b8d-70357bc2e26b tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:33.371806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-14649be2-ec75-4034-9b8d-70357bc2e26b tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:33.634834 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f589627e-4c40-457d-9c12-e309ad4113b4 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:33.635674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f589627e-4c40-457d-9c12-e309ad4113b4 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:33.649121 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f589627e-4c40-457d-9c12-e309ad4113b4 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:33.649584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f589627e-4c40-457d-9c12-e309ad4113b4 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:33.650392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f589627e-4c40-457d-9c12-e309ad4113b4 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:33.650838 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f589627e-4c40-457d-9c12-e309ad4113b4 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:33.661709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-14649be2-ec75-4034-9b8d-70357bc2e26b tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:33.670141 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-14649be2-ec75-4034-9b8d-70357bc2e26b tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974" status: 200 len: 1298 microversion: 2.1 time: 0.326868 Jul 19 22:58:33.679473 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2668/5342] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:33 2022] GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974 => generated 1298 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:33.806965 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d2977920-99e8-454a-96d6-0f1f9c5d8b92 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:33.809582 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d2977920-99e8-454a-96d6-0f1f9c5d8b92 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:33.846770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2977920-99e8-454a-96d6-0f1f9c5d8b92 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:33.852424 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2977920-99e8-454a-96d6-0f1f9c5d8b92 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:33.853704 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2977920-99e8-454a-96d6-0f1f9c5d8b92 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:33.854376 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2977920-99e8-454a-96d6-0f1f9c5d8b92 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:33.943675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2977920-99e8-454a-96d6-0f1f9c5d8b92 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:33.944565 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2977920-99e8-454a-96d6-0f1f9c5d8b92 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:33.945350 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-d2977920-99e8-454a-96d6-0f1f9c5d8b92 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lazy-loading 'fault' on Instance uuid 7a5652b2-98db-4644-8a70-b1fc399aaf31 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:58:34.033545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d2977920-99e8-454a-96d6-0f1f9c5d8b92 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3929e62eb4345f8a69fec37ba7c195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b759a0bda64e3c9df38b624d4145b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:34.055090 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d2977920-99e8-454a-96d6-0f1f9c5d8b92 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31" status: 200 len: 1332 microversion: 2.1 time: 0.257158 Jul 19 22:58:34.055952 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2669/5343] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:33 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31 => generated 1332 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:58:34.135207 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f589627e-4c40-457d-9c12-e309ad4113b4 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:34.159426 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f589627e-4c40-457d-9c12-e309ad4113b4 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:34.173848 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f589627e-4c40-457d-9c12-e309ad4113b4 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:34.176972 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f589627e-4c40-457d-9c12-e309ad4113b4 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1722 microversion: 2.20 time: 0.546035 Jul 19 22:58:34.222819 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2675/5344] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:58:33 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1722 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:58:34.690187 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-027eadde-5517-4cf3-92b5-666921d7bff5 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:34.690817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-027eadde-5517-4cf3-92b5-666921d7bff5 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 5344385d-32ea-46d6-b7cd-75345d5d3974] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:34.703036 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-027eadde-5517-4cf3-92b5-666921d7bff5 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:34.709430 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-027eadde-5517-4cf3-92b5-666921d7bff5 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:34.710302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-027eadde-5517-4cf3-92b5-666921d7bff5 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:34.711305 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-027eadde-5517-4cf3-92b5-666921d7bff5 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:35.073493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-87139b2d-c5a3-4dfa-b179-4342d6469a52 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:35.074130 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-87139b2d-c5a3-4dfa-b179-4342d6469a52 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:35.090483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-87139b2d-c5a3-4dfa-b179-4342d6469a52 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:35.091065 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-87139b2d-c5a3-4dfa-b179-4342d6469a52 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:35.091949 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-87139b2d-c5a3-4dfa-b179-4342d6469a52 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:35.092396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-87139b2d-c5a3-4dfa-b179-4342d6469a52 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:35.138985 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-87139b2d-c5a3-4dfa-b179-4342d6469a52 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] HTTP exception thrown: Instance 7a5652b2-98db-4644-8a70-b1fc399aaf31 could not be found. Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-87139b2d-c5a3-4dfa-b179-4342d6469a52 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Request method failure captured: Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31 HTTP/1.1 Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zVsSOX-O7ggDcH00KLmZx8wOtg3S3Su8gJRQI2lYa4BxC-OxvaOKnPb2I4UGxeYv7AyyS8e-HsUydLYlXpELI3RwSo4aU8bY9u8sE-NNAsyuAsZv_PYlNBhbG0F8quyfyoOYST6GA8Fbv-UJaQmRhd0xcvaUwo2b-fKMEkbL-YV9Cg Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: c3929e62eb4345f8a69fec37ba7c195f Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 7a5652b2-98db-4644-8a70-b1fc399aaf31 could not be found. Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '7a5652b2-98db-4644-8a70-b1fc399aaf31'} Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a5652b2-98db-4644-8a70-b1fc399aaf31 could not be found. Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a5652b2-98db-4644-8a70-b1fc399aaf31 could not be found. Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:58:35.144388 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:35.149053 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:58:35.149053 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:58:35.149053 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:58:35.149053 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:58:35.149053 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:58:35.149053 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a5652b2-98db-4644-8a70-b1fc399aaf31 could not be found. Jul 19 22:58:35.149053 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:35.149053 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-87139b2d-c5a3-4dfa-b179-4342d6469a52 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Returning 404 to user: Instance 7a5652b2-98db-4644-8a70-b1fc399aaf31 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:58:35.149053 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-87139b2d-c5a3-4dfa-b179-4342d6469a52 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31" status: 404 len: 111 microversion: 2.1 time: 0.077354 Jul 19 22:58:35.159280 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2676/5345] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:35 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:58:35.166556 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cd42a0f4-0f77-406c-a87a-2877227a9655 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '.version_select at 0x7f7a03086790>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:35.212891 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cd42a0f4-0f77-406c-a87a-2877227a9655 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1458017337" status: 202 len: 0 microversion: 2.1 time: 0.052364 Jul 19 22:58:35.213821 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2677/5346] 10.222.0.25 () {58 vars in 1220 bytes} [Tue Jul 19 22:58:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1458017337 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:58:35.226374 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cef9a219-6df2-46d1-886b-d1f2f5362baa tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:35.231504 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cef9a219-6df2-46d1-886b-d1f2f5362baa tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:35.251373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cef9a219-6df2-46d1-886b-d1f2f5362baa tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:35.252509 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cef9a219-6df2-46d1-886b-d1f2f5362baa tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:35.253327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cef9a219-6df2-46d1-886b-d1f2f5362baa tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:35.253770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cef9a219-6df2-46d1-886b-d1f2f5362baa tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:35.590294 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-027eadde-5517-4cf3-92b5-666921d7bff5 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:35.605636 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-027eadde-5517-4cf3-92b5-666921d7bff5 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974" status: 200 len: 1298 microversion: 2.1 time: 0.919553 Jul 19 22:58:35.606268 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2670/5347] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:34 2022] GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974 => generated 1298 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:35.885833 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cef9a219-6df2-46d1-886b-d1f2f5362baa tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:35.901278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cef9a219-6df2-46d1-886b-d1f2f5362baa tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:35.902920 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cef9a219-6df2-46d1-886b-d1f2f5362baa tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:35.907145 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cef9a219-6df2-46d1-886b-d1f2f5362baa tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1722 microversion: 2.20 time: 0.686300 Jul 19 22:58:35.908271 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2678/5348] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:58:35 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1722 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:58:36.624498 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-51e7fc4a-b7a6-4195-a1d9-50a730b2a85a tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:36.626897 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-51e7fc4a-b7a6-4195-a1d9-50a730b2a85a tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 5344385d-32ea-46d6-b7cd-75345d5d3974] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:36.640424 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51e7fc4a-b7a6-4195-a1d9-50a730b2a85a tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:36.641538 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51e7fc4a-b7a6-4195-a1d9-50a730b2a85a tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:36.642922 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51e7fc4a-b7a6-4195-a1d9-50a730b2a85a tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:36.643723 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51e7fc4a-b7a6-4195-a1d9-50a730b2a85a tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:36.925635 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0cb77303-2bde-4a2d-9227-4d1bd0db3ce3 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:36.926253 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0cb77303-2bde-4a2d-9227-4d1bd0db3ce3 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:36.940282 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0cb77303-2bde-4a2d-9227-4d1bd0db3ce3 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:36.940982 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0cb77303-2bde-4a2d-9227-4d1bd0db3ce3 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:36.948326 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0cb77303-2bde-4a2d-9227-4d1bd0db3ce3 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:36.949075 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0cb77303-2bde-4a2d-9227-4d1bd0db3ce3 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:36.988276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-51e7fc4a-b7a6-4195-a1d9-50a730b2a85a tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:37.001800 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-51e7fc4a-b7a6-4195-a1d9-50a730b2a85a tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974" status: 200 len: 1298 microversion: 2.1 time: 0.382562 Jul 19 22:58:37.009241 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2671/5349] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:36 2022] GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974 => generated 1298 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:37.973759 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0cb77303-2bde-4a2d-9227-4d1bd0db3ce3 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:37.987443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0cb77303-2bde-4a2d-9227-4d1bd0db3ce3 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:37.989984 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0cb77303-2bde-4a2d-9227-4d1bd0db3ce3 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:37.991949 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0cb77303-2bde-4a2d-9227-4d1bd0db3ce3 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1722 microversion: 2.20 time: 1.070573 Jul 19 22:58:38.008709 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2679/5350] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:58:36 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1722 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:58:38.026072 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a156e8c8-a7a1-47d5-82da-c79daddce353 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:38.027374 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a156e8c8-a7a1-47d5-82da-c79daddce353 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 5344385d-32ea-46d6-b7cd-75345d5d3974] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:38.037571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a156e8c8-a7a1-47d5-82da-c79daddce353 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:38.040538 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a156e8c8-a7a1-47d5-82da-c79daddce353 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:38.042141 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a156e8c8-a7a1-47d5-82da-c79daddce353 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:38.042753 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a156e8c8-a7a1-47d5-82da-c79daddce353 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:38.280631 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a156e8c8-a7a1-47d5-82da-c79daddce353 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:38.306561 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a156e8c8-a7a1-47d5-82da-c79daddce353 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974" status: 200 len: 1298 microversion: 2.1 time: 0.276621 Jul 19 22:58:38.309036 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2672/5351] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:38 2022] GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974 => generated 1298 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:38.897184 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-7c46766b-e676-4fb6-a997-383a2fe1c341 req-6dc7f780-e4da-4eea-bf6a-8130f760f286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5344385d-32ea-46d6-b7cd-75345d5d3974", "name": "network-vif-plugged", "status": "completed", "tag": "5aea1afd-05ff-4a7b-a81f-3bcf9a439672"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:58:38.925526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-7c46766b-e676-4fb6-a997-383a2fe1c341 req-6dc7f780-e4da-4eea-bf6a-8130f760f286 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:38.933046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-7c46766b-e676-4fb6-a997-383a2fe1c341 req-6dc7f780-e4da-4eea-bf6a-8130f760f286 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:39.013979 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-7c46766b-e676-4fb6-a997-383a2fe1c341 req-6dc7f780-e4da-4eea-bf6a-8130f760f286 service nova] Creating event network-vif-plugged:5aea1afd-05ff-4a7b-a81f-3bcf9a439672 for instance 5344385d-32ea-46d6-b7cd-75345d5d3974 on n-h2-847009-3 Jul 19 22:58:39.024955 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8f6b7014-6c67-48b2-9f92-32b670193450 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:39.025573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8f6b7014-6c67-48b2-9f92-32b670193450 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:39.049502 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8f6b7014-6c67-48b2-9f92-32b670193450 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:39.050175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8f6b7014-6c67-48b2-9f92-32b670193450 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:39.051085 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8f6b7014-6c67-48b2-9f92-32b670193450 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:39.051557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8f6b7014-6c67-48b2-9f92-32b670193450 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:39.054945 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-7c46766b-e676-4fb6-a997-383a2fe1c341 req-6dc7f780-e4da-4eea-bf6a-8130f760f286 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150208 Jul 19 22:58:39.063912 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2680/5352] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:58:39.333863 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ef87c8ed-7d1a-450d-b3a1-f851b226b828 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:39.335944 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ef87c8ed-7d1a-450d-b3a1-f851b226b828 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 5344385d-32ea-46d6-b7cd-75345d5d3974] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:39.357165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ef87c8ed-7d1a-450d-b3a1-f851b226b828 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:39.360307 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ef87c8ed-7d1a-450d-b3a1-f851b226b828 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:39.361610 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ef87c8ed-7d1a-450d-b3a1-f851b226b828 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:39.362509 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ef87c8ed-7d1a-450d-b3a1-f851b226b828 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:39.660349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ef87c8ed-7d1a-450d-b3a1-f851b226b828 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:39.677990 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ef87c8ed-7d1a-450d-b3a1-f851b226b828 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974" status: 200 len: 1298 microversion: 2.1 time: 0.355611 Jul 19 22:58:39.698001 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2681/5353] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:39 2022] GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974 => generated 1298 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:58:39.824258 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8f6b7014-6c67-48b2-9f92-32b670193450 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:39.841305 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8f6b7014-6c67-48b2-9f92-32b670193450 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:39.847556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8f6b7014-6c67-48b2-9f92-32b670193450 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:39.862282 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8f6b7014-6c67-48b2-9f92-32b670193450 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1722 microversion: 2.20 time: 0.847147 Jul 19 22:58:39.863263 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2673/5354] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:58:39 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1722 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:58:40.706804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e57275f7-3f4c-4e40-8dbe-d7c17325c435 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:40.707467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e57275f7-3f4c-4e40-8dbe-d7c17325c435 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 5344385d-32ea-46d6-b7cd-75345d5d3974] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:40.722863 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e57275f7-3f4c-4e40-8dbe-d7c17325c435 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:40.723351 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e57275f7-3f4c-4e40-8dbe-d7c17325c435 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:40.724153 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e57275f7-3f4c-4e40-8dbe-d7c17325c435 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:40.724600 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e57275f7-3f4c-4e40-8dbe-d7c17325c435 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:40.882676 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4c471d18-0eb1-4fc4-a061-f74e7f483b2a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:40.883307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4c471d18-0eb1-4fc4-a061-f74e7f483b2a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:40.900435 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4c471d18-0eb1-4fc4-a061-f74e7f483b2a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:40.902276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4c471d18-0eb1-4fc4-a061-f74e7f483b2a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:40.905075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4c471d18-0eb1-4fc4-a061-f74e7f483b2a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:40.905743 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4c471d18-0eb1-4fc4-a061-f74e7f483b2a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:41.336305 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e57275f7-3f4c-4e40-8dbe-d7c17325c435 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:41.358961 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e57275f7-3f4c-4e40-8dbe-d7c17325c435 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974" status: 200 len: 1298 microversion: 2.1 time: 0.656940 Jul 19 22:58:41.362346 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2682/5355] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:40 2022] GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974 => generated 1298 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:42.029109 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4c471d18-0eb1-4fc4-a061-f74e7f483b2a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:42.050336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4c471d18-0eb1-4fc4-a061-f74e7f483b2a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:42.051939 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4c471d18-0eb1-4fc4-a061-f74e7f483b2a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:42.056268 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4c471d18-0eb1-4fc4-a061-f74e7f483b2a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1722 microversion: 2.20 time: 1.177783 Jul 19 22:58:42.056846 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2674/5356] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:58:40 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1722 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:58:42.393115 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4d07a027-d81c-4221-90ec-d88bf581b45b tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:42.393804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4d07a027-d81c-4221-90ec-d88bf581b45b tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 5344385d-32ea-46d6-b7cd-75345d5d3974] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:42.436930 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4d07a027-d81c-4221-90ec-d88bf581b45b tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:42.438183 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4d07a027-d81c-4221-90ec-d88bf581b45b tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:42.439562 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4d07a027-d81c-4221-90ec-d88bf581b45b tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:42.440278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4d07a027-d81c-4221-90ec-d88bf581b45b tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:42.598426 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dc5815bf-aec6-453d-b344-fb237a71aebe tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:42.599045 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dc5815bf-aec6-453d-b344-fb237a71aebe tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:42.606114 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dc5815bf-aec6-453d-b344-fb237a71aebe tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:42.607313 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dc5815bf-aec6-453d-b344-fb237a71aebe tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:42.608342 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dc5815bf-aec6-453d-b344-fb237a71aebe tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:42.609015 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dc5815bf-aec6-453d-b344-fb237a71aebe tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:42.896737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4d07a027-d81c-4221-90ec-d88bf581b45b tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:42.942945 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4d07a027-d81c-4221-90ec-d88bf581b45b tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974" status: 200 len: 1470 microversion: 2.1 time: 0.560165 Jul 19 22:58:42.959444 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2683/5357] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:42 2022] GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974 => generated 1470 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:42.971670 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f90b471e-b271-4694-b709-d8e5d34d43e5 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:42.972618 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f90b471e-b271-4694-b709-d8e5d34d43e5 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 5344385d-32ea-46d6-b7cd-75345d5d3974] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:42.980499 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f90b471e-b271-4694-b709-d8e5d34d43e5 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:42.981250 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f90b471e-b271-4694-b709-d8e5d34d43e5 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:42.982274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f90b471e-b271-4694-b709-d8e5d34d43e5 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:42.983034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f90b471e-b271-4694-b709-d8e5d34d43e5 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:42.993369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:58:43.673405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f90b471e-b271-4694-b709-d8e5d34d43e5 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:43.690598 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f90b471e-b271-4694-b709-d8e5d34d43e5 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974" status: 200 len: 1470 microversion: 2.1 time: 0.728628 Jul 19 22:58:43.691577 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2684/5358] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:42 2022] GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974 => generated 1470 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:43.704060 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-43c553ac-a289-48c6-af35-b05909a9bbc2 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:43.704924 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-43c553ac-a289-48c6-af35-b05909a9bbc2 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:43.712315 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-43c553ac-a289-48c6-af35-b05909a9bbc2 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:43.723907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-43c553ac-a289-48c6-af35-b05909a9bbc2 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:43.725218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-43c553ac-a289-48c6-af35-b05909a9bbc2 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:43.726069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-43c553ac-a289-48c6-af35-b05909a9bbc2 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:43.931224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dc5815bf-aec6-453d-b344-fb237a71aebe tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:43.950220 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dc5815bf-aec6-453d-b344-fb237a71aebe tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1684 microversion: 2.1 time: 1.356260 Jul 19 22:58:43.955230 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2675/5359] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:42 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1684 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:58:43.969223 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f6967fa6-66d4-4ea7-9237-422ecdc762f0 tempest-TestSecurityGroupsBasicOps-361472052 tempest-TestSecurityGroupsBasicOps-361472052-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:43.969763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f6967fa6-66d4-4ea7-9237-422ecdc762f0 tempest-TestSecurityGroupsBasicOps-361472052 tempest-TestSecurityGroupsBasicOps-361472052-project-admin] [instance: 5344385d-32ea-46d6-b7cd-75345d5d3974] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:43.987300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f6967fa6-66d4-4ea7-9237-422ecdc762f0 tempest-TestSecurityGroupsBasicOps-361472052 tempest-TestSecurityGroupsBasicOps-361472052-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:43.990368 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f6967fa6-66d4-4ea7-9237-422ecdc762f0 tempest-TestSecurityGroupsBasicOps-361472052 tempest-TestSecurityGroupsBasicOps-361472052-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:43.991484 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f6967fa6-66d4-4ea7-9237-422ecdc762f0 tempest-TestSecurityGroupsBasicOps-361472052 tempest-TestSecurityGroupsBasicOps-361472052-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:43.992173 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f6967fa6-66d4-4ea7-9237-422ecdc762f0 tempest-TestSecurityGroupsBasicOps-361472052 tempest-TestSecurityGroupsBasicOps-361472052-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:44.419933 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f6967fa6-66d4-4ea7-9237-422ecdc762f0 tempest-TestSecurityGroupsBasicOps-361472052 tempest-TestSecurityGroupsBasicOps-361472052-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974" status: 200 len: 1621 microversion: 2.1 time: 0.462724 Jul 19 22:58:44.421067 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2676/5360] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:43 2022] GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974 => generated 1621 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:44.432629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3700dd22-5046-4489-9d9e-27a3792b2684 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:58:44.434761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3700dd22-5046-4489-9d9e-27a3792b2684 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:44.449467 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3700dd22-5046-4489-9d9e-27a3792b2684 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:44.450354 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3700dd22-5046-4489-9d9e-27a3792b2684 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:44.451736 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3700dd22-5046-4489-9d9e-27a3792b2684 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:44.452344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3700dd22-5046-4489-9d9e-27a3792b2684 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:44.584524 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3700dd22-5046-4489-9d9e-27a3792b2684 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "POST /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790/action" status: 200 len: 32639 microversion: 2.1 time: 0.159228 Jul 19 22:58:44.589218 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2677/5361] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:58:44 2022] POST /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790/action => generated 32639 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:58:44.602642 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-002031f7-f0f0-4d35-b885-43a00163cd67 tempest-TestSecurityGroupsBasicOps-361472052 tempest-TestSecurityGroupsBasicOps-361472052-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:44.604208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-002031f7-f0f0-4d35-b885-43a00163cd67 tempest-TestSecurityGroupsBasicOps-361472052 tempest-TestSecurityGroupsBasicOps-361472052-project-admin] [instance: 3724dd6c-5c35-4803-8f22-67900a52bddc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:44.615043 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-002031f7-f0f0-4d35-b885-43a00163cd67 tempest-TestSecurityGroupsBasicOps-361472052 tempest-TestSecurityGroupsBasicOps-361472052-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:44.615871 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-002031f7-f0f0-4d35-b885-43a00163cd67 tempest-TestSecurityGroupsBasicOps-361472052 tempest-TestSecurityGroupsBasicOps-361472052-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:44.616845 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-002031f7-f0f0-4d35-b885-43a00163cd67 tempest-TestSecurityGroupsBasicOps-361472052 tempest-TestSecurityGroupsBasicOps-361472052-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:44.626372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-002031f7-f0f0-4d35-b885-43a00163cd67 tempest-TestSecurityGroupsBasicOps-361472052 tempest-TestSecurityGroupsBasicOps-361472052-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:44.760768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-43c553ac-a289-48c6-af35-b05909a9bbc2 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:44.794017 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-43c553ac-a289-48c6-af35-b05909a9bbc2 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:44.796147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-43c553ac-a289-48c6-af35-b05909a9bbc2 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:44.797936 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-43c553ac-a289-48c6-af35-b05909a9bbc2 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1722 microversion: 2.20 time: 1.105257 Jul 19 22:58:44.799526 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2685/5362] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:58:43 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1722 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:58:44.805951 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7544cf19-1d0e-439d-a280-ad25b0bac4ed tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:44.810146 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7544cf19-1d0e-439d-a280-ad25b0bac4ed tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:44.824622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7544cf19-1d0e-439d-a280-ad25b0bac4ed tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:44.825725 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7544cf19-1d0e-439d-a280-ad25b0bac4ed tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:44.827330 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7544cf19-1d0e-439d-a280-ad25b0bac4ed tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:44.828978 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7544cf19-1d0e-439d-a280-ad25b0bac4ed tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:45.326996 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-002031f7-f0f0-4d35-b885-43a00163cd67 tempest-TestSecurityGroupsBasicOps-361472052 tempest-TestSecurityGroupsBasicOps-361472052-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc" status: 200 len: 1910 microversion: 2.1 time: 0.735476 Jul 19 22:58:45.344948 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2678/5363] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:44 2022] GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc => generated 1910 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:45.355383 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4faba22f-6267-4488-ad99-c3207ae5e766 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:45.358629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4faba22f-6267-4488-ad99-c3207ae5e766 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:45.366869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4faba22f-6267-4488-ad99-c3207ae5e766 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:45.367660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4faba22f-6267-4488-ad99-c3207ae5e766 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:45.369153 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4faba22f-6267-4488-ad99-c3207ae5e766 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:45.369768 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4faba22f-6267-4488-ad99-c3207ae5e766 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:45.404591 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-4faba22f-6267-4488-ad99-c3207ae5e766 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] HTTP exception thrown: Instance 7a5652b2-98db-4644-8a70-b1fc399aaf31 could not be found. Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4faba22f-6267-4488-ad99-c3207ae5e766 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Request method failure captured: Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31 HTTP/1.1 Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zVsSOX-O7ggDcH00KLmZx8wOtg3S3Su8gJRQI2lYa4BxC-OxvaOKnPb2I4UGxeYv7AyyS8e-HsUydLYlXpELI3RwSo4aU8bY9u8sE-NNAsyuAsZv_PYlNBhbG0F8quyfyoOYST6GA8Fbv-UJaQmRhd0xcvaUwo2b-fKMEkbL-YV9Cg Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: c3929e62eb4345f8a69fec37ba7c195f Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 7a5652b2-98db-4644-8a70-b1fc399aaf31 could not be found. Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '7a5652b2-98db-4644-8a70-b1fc399aaf31'} Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a5652b2-98db-4644-8a70-b1fc399aaf31 could not be found. Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:58:45.408773 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:58:45.413007 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a5652b2-98db-4644-8a70-b1fc399aaf31 could not be found. Jul 19 22:58:45.413007 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:58:45.413007 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:58:45.413007 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:58:45.413007 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:58:45.413007 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:58:45.413007 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:58:45.413007 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:58:45.413007 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:58:45.413007 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a5652b2-98db-4644-8a70-b1fc399aaf31 could not be found. Jul 19 22:58:45.413007 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:58:45.414589 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4faba22f-6267-4488-ad99-c3207ae5e766 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Returning 404 to user: Instance 7a5652b2-98db-4644-8a70-b1fc399aaf31 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:58:45.424949 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4faba22f-6267-4488-ad99-c3207ae5e766 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31" status: 404 len: 111 microversion: 2.1 time: 0.077522 Jul 19 22:58:45.425825 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2679/5364] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:58:45 2022] DELETE /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:58:45.442570 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-82d2f1c3-4ecd-4e68-b761-6bbc9acca31e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:45.448261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-82d2f1c3-4ecd-4e68-b761-6bbc9acca31e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 7a5652b2-98db-4644-8a70-b1fc399aaf31] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:45.487506 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7544cf19-1d0e-439d-a280-ad25b0bac4ed tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1835 microversion: 2.1 time: 0.685934 Jul 19 22:58:45.488116 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2686/5365] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:44 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1835 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:45.499525 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-82d2f1c3-4ecd-4e68-b761-6bbc9acca31e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:45.499525 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-82d2f1c3-4ecd-4e68-b761-6bbc9acca31e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:45.499525 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-82d2f1c3-4ecd-4e68-b761-6bbc9acca31e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:45.499525 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-82d2f1c3-4ecd-4e68-b761-6bbc9acca31e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:45.519443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-be15e2d0-2f4f-4322-9bc2-ff2efd89dbc1 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:58:45.520984 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-be15e2d0-2f4f-4322-9bc2-ff2efd89dbc1 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:45.534384 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be15e2d0-2f4f-4322-9bc2-ff2efd89dbc1 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:45.535040 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be15e2d0-2f4f-4322-9bc2-ff2efd89dbc1 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:45.537837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be15e2d0-2f4f-4322-9bc2-ff2efd89dbc1 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:45.546087 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be15e2d0-2f4f-4322-9bc2-ff2efd89dbc1 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:45.551607 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-82d2f1c3-4ecd-4e68-b761-6bbc9acca31e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] HTTP exception thrown: Instance 7a5652b2-98db-4644-8a70-b1fc399aaf31 could not be found. Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-82d2f1c3-4ecd-4e68-b761-6bbc9acca31e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Request method failure captured: Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31 HTTP/1.1 Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zVsSOX-O7ggDcH00KLmZx8wOtg3S3Su8gJRQI2lYa4BxC-OxvaOKnPb2I4UGxeYv7AyyS8e-HsUydLYlXpELI3RwSo4aU8bY9u8sE-NNAsyuAsZv_PYlNBhbG0F8quyfyoOYST6GA8Fbv-UJaQmRhd0xcvaUwo2b-fKMEkbL-YV9Cg Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: c3929e62eb4345f8a69fec37ba7c195f Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 7a5652b2-98db-4644-8a70-b1fc399aaf31 could not be found. Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '7a5652b2-98db-4644-8a70-b1fc399aaf31'} Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a5652b2-98db-4644-8a70-b1fc399aaf31 could not be found. Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a5652b2-98db-4644-8a70-b1fc399aaf31 could not be found. Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:58:45.557139 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:58:45.570946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:58:45.570946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:58:45.570946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:58:45.570946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:58:45.570946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:58:45.570946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a5652b2-98db-4644-8a70-b1fc399aaf31 could not be found. Jul 19 22:58:45.570946 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:58:45.570946 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-82d2f1c3-4ecd-4e68-b761-6bbc9acca31e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Returning 404 to user: Instance 7a5652b2-98db-4644-8a70-b1fc399aaf31 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:58:45.570946 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-82d2f1c3-4ecd-4e68-b761-6bbc9acca31e tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31" status: 404 len: 111 microversion: 2.1 time: 0.135961 Jul 19 22:58:45.576085 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2680/5366] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:45 2022] GET /compute/v2.1/servers/7a5652b2-98db-4644-8a70-b1fc399aaf31 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:58:45.616322 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-143ef203-37cb-4f16-8e0d-28682ad175d4 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:45.622323 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-143ef203-37cb-4f16-8e0d-28682ad175d4 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 5344385d-32ea-46d6-b7cd-75345d5d3974] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:45.644496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-be15e2d0-2f4f-4322-9bc2-ff2efd89dbc1 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lazy-loading 'flavor' on Instance uuid 7e166ac4-ba20-4db0-a559-cdaf0a031790 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:58:45.646445 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-143ef203-37cb-4f16-8e0d-28682ad175d4 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:45.648594 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-143ef203-37cb-4f16-8e0d-28682ad175d4 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:45.650046 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-143ef203-37cb-4f16-8e0d-28682ad175d4 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:45.650709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-143ef203-37cb-4f16-8e0d-28682ad175d4 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:45.680097 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-be15e2d0-2f4f-4322-9bc2-ff2efd89dbc1 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Going to try to live migrate instance to another host {{(pid=119337) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 19 22:58:45.819368 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-143ef203-37cb-4f16-8e0d-28682ad175d4 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 5344385d-32ea-46d6-b7cd-75345d5d3974] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:58:46.271211 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-143ef203-37cb-4f16-8e0d-28682ad175d4 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974" status: 204 len: 0 microversion: 2.1 time: 0.665616 Jul 19 22:58:46.276563 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2681/5367] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:58:45 2022] DELETE /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:58:46.289807 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c709ab36-1d6b-42c5-8a75-86db9ea0b380 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:46.296420 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c709ab36-1d6b-42c5-8a75-86db9ea0b380 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:46.320205 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c709ab36-1d6b-42c5-8a75-86db9ea0b380 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:46.323188 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c709ab36-1d6b-42c5-8a75-86db9ea0b380 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:46.324701 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c709ab36-1d6b-42c5-8a75-86db9ea0b380 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:46.328729 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c709ab36-1d6b-42c5-8a75-86db9ea0b380 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:47.631272 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c709ab36-1d6b-42c5-8a75-86db9ea0b380 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:47.633973 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:58:47.652487 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c709ab36-1d6b-42c5-8a75-86db9ea0b380 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:47.674412 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c709ab36-1d6b-42c5-8a75-86db9ea0b380 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:47.685254 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c709ab36-1d6b-42c5-8a75-86db9ea0b380 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1722 microversion: 2.20 time: 1.400057 Jul 19 22:58:47.697993 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2682/5368] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:58:46 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1722 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:58:47.704369 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-43d74a8b-f07a-492e-9815-ecbce03ad9fd tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:47.704906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-43d74a8b-f07a-492e-9815-ecbce03ad9fd tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 5344385d-32ea-46d6-b7cd-75345d5d3974] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:47.743633 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43d74a8b-f07a-492e-9815-ecbce03ad9fd tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:47.745711 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43d74a8b-f07a-492e-9815-ecbce03ad9fd tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:47.747814 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43d74a8b-f07a-492e-9815-ecbce03ad9fd tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:47.757750 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43d74a8b-f07a-492e-9815-ecbce03ad9fd tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:49.167858 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-43d74a8b-f07a-492e-9815-ecbce03ad9fd tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:49.177537 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-43d74a8b-f07a-492e-9815-ecbce03ad9fd tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974" status: 200 len: 1476 microversion: 2.1 time: 1.480701 Jul 19 22:58:49.178133 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2683/5369] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:47 2022] GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974 => generated 1476 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:49.223905 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3cebf5b9-62e0-4a7d-b3ba-17a4e2a5088c tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:49.224576 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3cebf5b9-62e0-4a7d-b3ba-17a4e2a5088c tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:49.251684 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3cebf5b9-62e0-4a7d-b3ba-17a4e2a5088c tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:49.258117 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3cebf5b9-62e0-4a7d-b3ba-17a4e2a5088c tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:49.259628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3cebf5b9-62e0-4a7d-b3ba-17a4e2a5088c tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:49.260093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3cebf5b9-62e0-4a7d-b3ba-17a4e2a5088c tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:51.098514 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3cebf5b9-62e0-4a7d-b3ba-17a4e2a5088c tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:51.108046 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3cebf5b9-62e0-4a7d-b3ba-17a4e2a5088c tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:51.109623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3cebf5b9-62e0-4a7d-b3ba-17a4e2a5088c tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:51.118553 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3cebf5b9-62e0-4a7d-b3ba-17a4e2a5088c tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1743 microversion: 2.20 time: 1.925999 Jul 19 22:58:51.122797 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2684/5370] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:58:49 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1743 bytes in 1944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:58:51.134339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-07adebe3-1e5c-49a0-9b89-b6c212674bbd tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:51.137553 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-07adebe3-1e5c-49a0-9b89-b6c212674bbd tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 5344385d-32ea-46d6-b7cd-75345d5d3974] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:51.161545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07adebe3-1e5c-49a0-9b89-b6c212674bbd tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:51.168454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07adebe3-1e5c-49a0-9b89-b6c212674bbd tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:51.169352 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07adebe3-1e5c-49a0-9b89-b6c212674bbd tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:51.170284 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07adebe3-1e5c-49a0-9b89-b6c212674bbd tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:51.579177 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-07adebe3-1e5c-49a0-9b89-b6c212674bbd tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:51.591810 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-07adebe3-1e5c-49a0-9b89-b6c212674bbd tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974" status: 200 len: 1476 microversion: 2.1 time: 0.465373 Jul 19 22:58:51.596635 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2685/5371] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:51 2022] GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974 => generated 1476 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:51.610489 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-bffae263-9823-4424-857d-988366930b52 req-71f9e5f0-bcbf-4d62-971e-1ed4a98e8a9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5344385d-32ea-46d6-b7cd-75345d5d3974", "name": "network-vif-deleted", "tag": "5aea1afd-05ff-4a7b-a81f-3bcf9a439672"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:58:51.634524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-bffae263-9823-4424-857d-988366930b52 req-71f9e5f0-bcbf-4d62-971e-1ed4a98e8a9f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:51.634967 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-bffae263-9823-4424-857d-988366930b52 req-71f9e5f0-bcbf-4d62-971e-1ed4a98e8a9f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:51.670479 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-bffae263-9823-4424-857d-988366930b52 req-71f9e5f0-bcbf-4d62-971e-1ed4a98e8a9f service nova] Creating event network-vif-deleted:5aea1afd-05ff-4a7b-a81f-3bcf9a439672 for instance 5344385d-32ea-46d6-b7cd-75345d5d3974 on n-h2-847009-3 Jul 19 22:58:51.683472 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-bffae263-9823-4424-857d-988366930b52 req-71f9e5f0-bcbf-4d62-971e-1ed4a98e8a9f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085183 Jul 19 22:58:51.684808 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2686/5372] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:58:52.140620 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-eaefb5ab-198e-4b0d-a0b1-4aaa191aead8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:52.142252 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-eaefb5ab-198e-4b0d-a0b1-4aaa191aead8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:52.160063 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eaefb5ab-198e-4b0d-a0b1-4aaa191aead8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:52.164498 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eaefb5ab-198e-4b0d-a0b1-4aaa191aead8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:52.165010 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eaefb5ab-198e-4b0d-a0b1-4aaa191aead8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:52.165539 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eaefb5ab-198e-4b0d-a0b1-4aaa191aead8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:52.398701 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-be15e2d0-2f4f-4322-9bc2-ff2efd89dbc1 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790/action" status: 202 len: 0 microversion: 2.1 time: 6.884104 Jul 19 22:58:52.400194 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2687/5373] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:58:45 2022] POST /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790/action => generated 0 bytes in 6886 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:58:52.412345 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f2d607f5-92fe-4c97-b8d5-dfa01d4771bf tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:52.412986 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f2d607f5-92fe-4c97-b8d5-dfa01d4771bf tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:52.472683 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f2d607f5-92fe-4c97-b8d5-dfa01d4771bf tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:52.475861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f2d607f5-92fe-4c97-b8d5-dfa01d4771bf tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:52.476714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f2d607f5-92fe-4c97-b8d5-dfa01d4771bf tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:52.480916 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f2d607f5-92fe-4c97-b8d5-dfa01d4771bf tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:53.212359 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f2d607f5-92fe-4c97-b8d5-dfa01d4771bf tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:53.222086 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f2d607f5-92fe-4c97-b8d5-dfa01d4771bf tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1694 microversion: 2.1 time: 0.815765 Jul 19 22:58:53.222600 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2688/5374] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:52 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1694 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:53.237594 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d8fbb72b-bee3-496a-8b0b-05ee65c0ee72 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:53.245292 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d8fbb72b-bee3-496a-8b0b-05ee65c0ee72 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 5344385d-32ea-46d6-b7cd-75345d5d3974] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:53.267724 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d8fbb72b-bee3-496a-8b0b-05ee65c0ee72 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:53.269280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d8fbb72b-bee3-496a-8b0b-05ee65c0ee72 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:53.275502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d8fbb72b-bee3-496a-8b0b-05ee65c0ee72 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:53.276172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d8fbb72b-bee3-496a-8b0b-05ee65c0ee72 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:53.315300 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-d8fbb72b-bee3-496a-8b0b-05ee65c0ee72 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] HTTP exception thrown: Instance 5344385d-32ea-46d6-b7cd-75345d5d3974 could not be found. Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d8fbb72b-bee3-496a-8b0b-05ee65c0ee72 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Request method failure captured: Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974 HTTP/1.1 Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zae66_ZcyJmhxXb3iBtVHHRrxr7yOXtAwiOpazCfkgRZqgszFtabehCakrWCAUdL3UQz0M9GLpi2QugY_aJXdl-wXeidApChf3kSORyoo9Kj7e_pSNDisymSYPOG3nrfE1zJo4z7wRd9uoC45y5SqAeiH_8oipiI1wzNVZlkvcvIss Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: aacf3f67cf95455985dda79eb06b826c Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-632400044 Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_aacf3f67cf95455985dda79eb06b826c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aacf3f67cf95455985dda79eb06b826c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/aacf3f67cf95455985dda79eb06b826c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aacf3f67cf95455985dda79eb06b826c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-TestSecurityGroupsBasicOps-632400044 Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: aacf3f67cf95455985dda79eb06b826c Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-632400044 Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-TestSecurityGroupsBasicOps-632400044-project Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 4403795b53d3430897fa30d42acbd9ca Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-TestSecurityGroupsBasicOps-632400044-project Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 5344385d-32ea-46d6-b7cd-75345d5d3974 could not be found. Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '5344385d-32ea-46d6-b7cd-75345d5d3974'} Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5344385d-32ea-46d6-b7cd-75345d5d3974 could not be found. Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5344385d-32ea-46d6-b7cd-75345d5d3974 could not be found. Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:58:53.322220 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:53.328615 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:58:53.328615 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:58:53.328615 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:58:53.328615 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:58:53.328615 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:58:53.328615 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5344385d-32ea-46d6-b7cd-75345d5d3974 could not be found. Jul 19 22:58:53.328615 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:53.330547 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d8fbb72b-bee3-496a-8b0b-05ee65c0ee72 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Returning 404 to user: Instance 5344385d-32ea-46d6-b7cd-75345d5d3974 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:58:53.335337 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d8fbb72b-bee3-496a-8b0b-05ee65c0ee72 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974" status: 404 len: 111 microversion: 2.1 time: 0.101760 Jul 19 22:58:53.336626 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2689/5375] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:53 2022] GET /compute/v2.1/servers/5344385d-32ea-46d6-b7cd-75345d5d3974 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:58:53.359983 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-f377393a-740a-40e0-9b70-13e4cf89c766 req-a6b686fc-29f5-4fd7-b476-8a10c1de3a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0", "name": "network-vif-plugged", "status": "completed", "tag": "f0538c77-95fe-460e-98c5-1e6a3dad7e95"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:58:53.374461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-f377393a-740a-40e0-9b70-13e4cf89c766 req-a6b686fc-29f5-4fd7-b476-8a10c1de3a0a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:53.376449 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-f377393a-740a-40e0-9b70-13e4cf89c766 req-a6b686fc-29f5-4fd7-b476-8a10c1de3a0a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:53.412905 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-f377393a-740a-40e0-9b70-13e4cf89c766 req-a6b686fc-29f5-4fd7-b476-8a10c1de3a0a service nova] Creating event network-vif-plugged:f0538c77-95fe-460e-98c5-1e6a3dad7e95 for instance e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 on n-h2-847009-3 Jul 19 22:58:53.429219 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-f377393a-740a-40e0-9b70-13e4cf89c766 req-a6b686fc-29f5-4fd7-b476-8a10c1de3a0a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088182 Jul 19 22:58:53.432599 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2690/5376] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:58:53.844111 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1a456805-24f8-4249-ac8d-c71d7d88b414 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:53.845600 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1a456805-24f8-4249-ac8d-c71d7d88b414 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:53.865094 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a456805-24f8-4249-ac8d-c71d7d88b414 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:53.866183 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a456805-24f8-4249-ac8d-c71d7d88b414 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:53.868473 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a456805-24f8-4249-ac8d-c71d7d88b414 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:53.870251 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a456805-24f8-4249-ac8d-c71d7d88b414 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:53.916193 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-1a456805-24f8-4249-ac8d-c71d7d88b414 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] HTTP exception thrown: Instance e2998191-f80d-4a79-97d8-3c32a55cc5bb could not be found. Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1a456805-24f8-4249-ac8d-c71d7d88b414 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Request method failure captured: Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb HTTP/1.1 Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zVsSOX-O7ggDcH00KLmZx8wOtg3S3Su8gJRQI2lYa4BxC-OxvaOKnPb2I4UGxeYv7AyyS8e-HsUydLYlXpELI3RwSo4aU8bY9u8sE-NNAsyuAsZv_PYlNBhbG0F8quyfyoOYST6GA8Fbv-UJaQmRhd0xcvaUwo2b-fKMEkbL-YV9Cg Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: c3929e62eb4345f8a69fec37ba7c195f Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance e2998191-f80d-4a79-97d8-3c32a55cc5bb could not be found. Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'e2998191-f80d-4a79-97d8-3c32a55cc5bb'} Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2998191-f80d-4a79-97d8-3c32a55cc5bb could not be found. Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:58:53.918254 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:58:53.923180 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2998191-f80d-4a79-97d8-3c32a55cc5bb could not be found. Jul 19 22:58:53.923180 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:53.923180 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:58:53.923180 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:53.923180 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:58:53.923180 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:58:53.923180 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:58:53.923180 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:58:53.923180 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:58:53.923180 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2998191-f80d-4a79-97d8-3c32a55cc5bb could not be found. Jul 19 22:58:53.923180 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:53.926687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1a456805-24f8-4249-ac8d-c71d7d88b414 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Returning 404 to user: Instance e2998191-f80d-4a79-97d8-3c32a55cc5bb could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:58:53.932252 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1a456805-24f8-4249-ac8d-c71d7d88b414 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb" status: 404 len: 111 microversion: 2.1 time: 0.090360 Jul 19 22:58:53.933782 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2691/5377] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:58:53 2022] DELETE /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:58:53.942861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-65e712d7-8d8b-4930-a46a-b9cafeb63b87 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:53.945549 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-65e712d7-8d8b-4930-a46a-b9cafeb63b87 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: e2998191-f80d-4a79-97d8-3c32a55cc5bb] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:53.963697 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65e712d7-8d8b-4930-a46a-b9cafeb63b87 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:53.965402 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65e712d7-8d8b-4930-a46a-b9cafeb63b87 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:53.968496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65e712d7-8d8b-4930-a46a-b9cafeb63b87 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:53.970066 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65e712d7-8d8b-4930-a46a-b9cafeb63b87 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:54.010741 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-65e712d7-8d8b-4930-a46a-b9cafeb63b87 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] HTTP exception thrown: Instance e2998191-f80d-4a79-97d8-3c32a55cc5bb could not be found. Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-65e712d7-8d8b-4930-a46a-b9cafeb63b87 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Request method failure captured: Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb HTTP/1.1 Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zVsSOX-O7ggDcH00KLmZx8wOtg3S3Su8gJRQI2lYa4BxC-OxvaOKnPb2I4UGxeYv7AyyS8e-HsUydLYlXpELI3RwSo4aU8bY9u8sE-NNAsyuAsZv_PYlNBhbG0F8quyfyoOYST6GA8Fbv-UJaQmRhd0xcvaUwo2b-fKMEkbL-YV9Cg Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: c3929e62eb4345f8a69fec37ba7c195f Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance e2998191-f80d-4a79-97d8-3c32a55cc5bb could not be found. Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'e2998191-f80d-4a79-97d8-3c32a55cc5bb'} Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2998191-f80d-4a79-97d8-3c32a55cc5bb could not be found. Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2998191-f80d-4a79-97d8-3c32a55cc5bb could not be found. Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:58:54.013643 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:54.018677 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:58:54.018677 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:58:54.018677 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:58:54.018677 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:58:54.018677 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:58:54.018677 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2998191-f80d-4a79-97d8-3c32a55cc5bb could not be found. Jul 19 22:58:54.018677 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:54.018677 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-65e712d7-8d8b-4930-a46a-b9cafeb63b87 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Returning 404 to user: Instance e2998191-f80d-4a79-97d8-3c32a55cc5bb could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:58:54.018677 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-65e712d7-8d8b-4930-a46a-b9cafeb63b87 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb" status: 404 len: 111 microversion: 2.1 time: 0.080340 Jul 19 22:58:54.021357 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2692/5378] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:53 2022] GET /compute/v2.1/servers/e2998191-f80d-4a79-97d8-3c32a55cc5bb => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 22:58:54.039397 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d3e192ba-5343-470c-a233-85bf1a285bf2 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:54.039915 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d3e192ba-5343-470c-a233-85bf1a285bf2 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9cb08864-7c20-44cc-9f73-87f0da61e0aa] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:54.058925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d3e192ba-5343-470c-a233-85bf1a285bf2 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:54.059579 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d3e192ba-5343-470c-a233-85bf1a285bf2 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:54.061569 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d3e192ba-5343-470c-a233-85bf1a285bf2 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:54.062026 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d3e192ba-5343-470c-a233-85bf1a285bf2 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:54.097687 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-d3e192ba-5343-470c-a233-85bf1a285bf2 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] HTTP exception thrown: Instance 9cb08864-7c20-44cc-9f73-87f0da61e0aa could not be found. Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d3e192ba-5343-470c-a233-85bf1a285bf2 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Request method failure captured: Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa HTTP/1.1 Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zVsSOX-O7ggDcH00KLmZx8wOtg3S3Su8gJRQI2lYa4BxC-OxvaOKnPb2I4UGxeYv7AyyS8e-HsUydLYlXpELI3RwSo4aU8bY9u8sE-NNAsyuAsZv_PYlNBhbG0F8quyfyoOYST6GA8Fbv-UJaQmRhd0xcvaUwo2b-fKMEkbL-YV9Cg Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: c3929e62eb4345f8a69fec37ba7c195f Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 9cb08864-7c20-44cc-9f73-87f0da61e0aa could not be found. Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '9cb08864-7c20-44cc-9f73-87f0da61e0aa'} Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cb08864-7c20-44cc-9f73-87f0da61e0aa could not be found. Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:58:54.102685 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:58:54.107237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cb08864-7c20-44cc-9f73-87f0da61e0aa could not be found. Jul 19 22:58:54.107237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:54.107237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:58:54.107237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:54.107237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:58:54.107237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:58:54.107237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:58:54.107237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:58:54.107237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:58:54.107237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cb08864-7c20-44cc-9f73-87f0da61e0aa could not be found. Jul 19 22:58:54.107237 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:54.107237 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d3e192ba-5343-470c-a233-85bf1a285bf2 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Returning 404 to user: Instance 9cb08864-7c20-44cc-9f73-87f0da61e0aa could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:58:54.107237 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d3e192ba-5343-470c-a233-85bf1a285bf2 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa" status: 404 len: 111 microversion: 2.1 time: 0.078790 Jul 19 22:58:54.108545 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2693/5379] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:58:54 2022] DELETE /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:58:54.119636 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-43645749-bae7-4c34-8d9f-7422d20e7d6c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:54.120272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-43645749-bae7-4c34-8d9f-7422d20e7d6c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9cb08864-7c20-44cc-9f73-87f0da61e0aa] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:54.142582 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-43645749-bae7-4c34-8d9f-7422d20e7d6c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:54.143034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-43645749-bae7-4c34-8d9f-7422d20e7d6c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:54.146156 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-43645749-bae7-4c34-8d9f-7422d20e7d6c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:54.146618 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-43645749-bae7-4c34-8d9f-7422d20e7d6c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:54.185666 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-43645749-bae7-4c34-8d9f-7422d20e7d6c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] HTTP exception thrown: Instance 9cb08864-7c20-44cc-9f73-87f0da61e0aa could not be found. Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-43645749-bae7-4c34-8d9f-7422d20e7d6c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Request method failure captured: Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa HTTP/1.1 Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zVsSOX-O7ggDcH00KLmZx8wOtg3S3Su8gJRQI2lYa4BxC-OxvaOKnPb2I4UGxeYv7AyyS8e-HsUydLYlXpELI3RwSo4aU8bY9u8sE-NNAsyuAsZv_PYlNBhbG0F8quyfyoOYST6GA8Fbv-UJaQmRhd0xcvaUwo2b-fKMEkbL-YV9Cg Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: c3929e62eb4345f8a69fec37ba7c195f Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 9cb08864-7c20-44cc-9f73-87f0da61e0aa could not be found. Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '9cb08864-7c20-44cc-9f73-87f0da61e0aa'} Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cb08864-7c20-44cc-9f73-87f0da61e0aa could not be found. Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cb08864-7c20-44cc-9f73-87f0da61e0aa could not be found. Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:58:54.192513 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:54.196897 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:58:54.196897 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:58:54.196897 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:58:54.196897 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:58:54.196897 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:58:54.196897 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cb08864-7c20-44cc-9f73-87f0da61e0aa could not be found. Jul 19 22:58:54.196897 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:58:54.196897 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-43645749-bae7-4c34-8d9f-7422d20e7d6c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Returning 404 to user: Instance 9cb08864-7c20-44cc-9f73-87f0da61e0aa could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:58:54.196897 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-43645749-bae7-4c34-8d9f-7422d20e7d6c tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa" status: 404 len: 111 microversion: 2.1 time: 0.082695 Jul 19 22:58:54.196897 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2694/5380] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:54 2022] GET /compute/v2.1/servers/9cb08864-7c20-44cc-9f73-87f0da61e0aa => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:58:54.241775 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3ec2eed6-8e77-4f10-a125-93ef59c4b266 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:54.243676 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3ec2eed6-8e77-4f10-a125-93ef59c4b266 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:54.256192 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ec2eed6-8e77-4f10-a125-93ef59c4b266 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:54.260083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ec2eed6-8e77-4f10-a125-93ef59c4b266 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:54.261332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ec2eed6-8e77-4f10-a125-93ef59c4b266 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:54.261981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ec2eed6-8e77-4f10-a125-93ef59c4b266 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:54.800933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-eaefb5ab-198e-4b0d-a0b1-4aaa191aead8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:54.828044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-eaefb5ab-198e-4b0d-a0b1-4aaa191aead8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:54.840042 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-eaefb5ab-198e-4b0d-a0b1-4aaa191aead8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:54.847200 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-eaefb5ab-198e-4b0d-a0b1-4aaa191aead8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1738 microversion: 2.20 time: 2.709677 Jul 19 22:58:54.862636 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2687/5381] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:58:52 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1738 bytes in 2729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:58:55.191772 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3ec2eed6-8e77-4f10-a125-93ef59c4b266 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:55.200518 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3ec2eed6-8e77-4f10-a125-93ef59c4b266 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1694 microversion: 2.1 time: 0.963787 Jul 19 22:58:55.201116 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2695/5382] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:54 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1694 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:55.866851 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b911a103-e36a-471d-9d3e-504a48cf9f18 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:55.867616 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b911a103-e36a-471d-9d3e-504a48cf9f18 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:55.875391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b911a103-e36a-471d-9d3e-504a48cf9f18 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:55.884473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b911a103-e36a-471d-9d3e-504a48cf9f18 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:55.900620 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b911a103-e36a-471d-9d3e-504a48cf9f18 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:55.901273 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b911a103-e36a-471d-9d3e-504a48cf9f18 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:56.223147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b7a6f36c-5b34-4f8b-b576-9d2c2e8a99e1 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:56.225760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b7a6f36c-5b34-4f8b-b576-9d2c2e8a99e1 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:56.252012 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7a6f36c-5b34-4f8b-b576-9d2c2e8a99e1 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:56.255394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7a6f36c-5b34-4f8b-b576-9d2c2e8a99e1 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:56.259461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7a6f36c-5b34-4f8b-b576-9d2c2e8a99e1 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:56.265088 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7a6f36c-5b34-4f8b-b576-9d2c2e8a99e1 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:57.097825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b911a103-e36a-471d-9d3e-504a48cf9f18 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:57.116126 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b911a103-e36a-471d-9d3e-504a48cf9f18 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:57.119783 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b911a103-e36a-471d-9d3e-504a48cf9f18 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:57.127780 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b911a103-e36a-471d-9d3e-504a48cf9f18 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1738 microversion: 2.20 time: 1.264783 Jul 19 22:58:57.128893 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2688/5383] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:58:55 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1738 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:58:57.802267 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b7a6f36c-5b34-4f8b-b576-9d2c2e8a99e1 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:58:57.813836 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b7a6f36c-5b34-4f8b-b576-9d2c2e8a99e1 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1694 microversion: 2.1 time: 1.594870 Jul 19 22:58:57.827229 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2696/5384] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:56 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1694 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:58:58.151345 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e00d19d4-10d6-4c27-8fb5-ba3c975ce9ff tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:58.152571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e00d19d4-10d6-4c27-8fb5-ba3c975ce9ff tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:58.168082 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e00d19d4-10d6-4c27-8fb5-ba3c975ce9ff tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:58.169396 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e00d19d4-10d6-4c27-8fb5-ba3c975ce9ff tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:58.172215 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e00d19d4-10d6-4c27-8fb5-ba3c975ce9ff tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:58.176159 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e00d19d4-10d6-4c27-8fb5-ba3c975ce9ff tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:58.840302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-74362217-55c6-4bc7-82a7-0f382df1195d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:58:58.841643 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-74362217-55c6-4bc7-82a7-0f382df1195d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:58:58.891079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74362217-55c6-4bc7-82a7-0f382df1195d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:58.899535 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74362217-55c6-4bc7-82a7-0f382df1195d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:58:58.905985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74362217-55c6-4bc7-82a7-0f382df1195d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:58:58.912551 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74362217-55c6-4bc7-82a7-0f382df1195d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:00.207818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e00d19d4-10d6-4c27-8fb5-ba3c975ce9ff tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:00.220730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e00d19d4-10d6-4c27-8fb5-ba3c975ce9ff tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:00.222234 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e00d19d4-10d6-4c27-8fb5-ba3c975ce9ff tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:00.223462 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e00d19d4-10d6-4c27-8fb5-ba3c975ce9ff tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1738 microversion: 2.20 time: 2.080311 Jul 19 22:59:00.224037 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2689/5385] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:58:58 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1738 bytes in 2081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:59:00.248354 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-84df8e73-d685-4770-b3b9-ca0e1336f0ef req-88dc0cdc-5da1-41c5-aa02-00c65febbf5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e166ac4-ba20-4db0-a559-cdaf0a031790", "name": "network-vif-unplugged", "status": "completed", "tag": "9994a687-e09d-4fb9-b9d1-a6ecd7db6038"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:59:00.317646 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-84df8e73-d685-4770-b3b9-ca0e1336f0ef req-88dc0cdc-5da1-41c5-aa02-00c65febbf5d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:00.333133 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-84df8e73-d685-4770-b3b9-ca0e1336f0ef req-88dc0cdc-5da1-41c5-aa02-00c65febbf5d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:00.389201 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-84df8e73-d685-4770-b3b9-ca0e1336f0ef req-88dc0cdc-5da1-41c5-aa02-00c65febbf5d service nova] Creating event network-vif-unplugged:9994a687-e09d-4fb9-b9d1-a6ecd7db6038 for instance 7e166ac4-ba20-4db0-a559-cdaf0a031790 on n-h1-847009-3 Jul 19 22:59:00.421197 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-84df8e73-d685-4770-b3b9-ca0e1336f0ef req-88dc0cdc-5da1-41c5-aa02-00c65febbf5d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.177090 Jul 19 22:59:00.430176 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2690/5386] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:59:01.247855 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-02672ae1-bd82-4d8c-95cd-5824e3d51d5a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:01.249221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-02672ae1-bd82-4d8c-95cd-5824e3d51d5a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:01.254009 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:59:01.303066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02672ae1-bd82-4d8c-95cd-5824e3d51d5a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:01.306337 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02672ae1-bd82-4d8c-95cd-5824e3d51d5a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:01.307518 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02672ae1-bd82-4d8c-95cd-5824e3d51d5a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:01.307975 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02672ae1-bd82-4d8c-95cd-5824e3d51d5a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:02.369310 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-74362217-55c6-4bc7-82a7-0f382df1195d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:02.380436 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-74362217-55c6-4bc7-82a7-0f382df1195d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1694 microversion: 2.1 time: 3.549164 Jul 19 22:59:02.388823 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2697/5387] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:58:58 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1694 bytes in 3559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:59:02.465718 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c60d73b0-ddab-49d0-a738-535f1531edb6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:02.472965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c60d73b0-ddab-49d0-a738-535f1531edb6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:02.486075 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:59:02.489285 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c60d73b0-ddab-49d0-a738-535f1531edb6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:02.495008 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c60d73b0-ddab-49d0-a738-535f1531edb6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:02.502972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c60d73b0-ddab-49d0-a738-535f1531edb6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:02.504216 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c60d73b0-ddab-49d0-a738-535f1531edb6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:02.613069 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-c60d73b0-ddab-49d0-a738-535f1531edb6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] HTTP exception thrown: Instance 9abb6a36-c31b-445c-a137-5fb74eb368b0 could not be found. Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c60d73b0-ddab-49d0-a738-535f1531edb6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Request method failure captured: Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0 HTTP/1.1 Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zVsSOX-O7ggDcH00KLmZx8wOtg3S3Su8gJRQI2lYa4BxC-OxvaOKnPb2I4UGxeYv7AyyS8e-HsUydLYlXpELI3RwSo4aU8bY9u8sE-NNAsyuAsZv_PYlNBhbG0F8quyfyoOYST6GA8Fbv-UJaQmRhd0xcvaUwo2b-fKMEkbL-YV9Cg Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: c3929e62eb4345f8a69fec37ba7c195f Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 9abb6a36-c31b-445c-a137-5fb74eb368b0 could not be found. Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '9abb6a36-c31b-445c-a137-5fb74eb368b0'} Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9abb6a36-c31b-445c-a137-5fb74eb368b0 could not be found. Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:59:02.617319 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:59:02.621333 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9abb6a36-c31b-445c-a137-5fb74eb368b0 could not be found. Jul 19 22:59:02.621333 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:59:02.621333 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:59:02.621333 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:59:02.621333 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:59:02.621333 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:59:02.621333 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:59:02.621333 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:59:02.621333 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:59:02.621333 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9abb6a36-c31b-445c-a137-5fb74eb368b0 could not be found. Jul 19 22:59:02.621333 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:59:02.632084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c60d73b0-ddab-49d0-a738-535f1531edb6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Returning 404 to user: Instance 9abb6a36-c31b-445c-a137-5fb74eb368b0 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:59:02.633495 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c60d73b0-ddab-49d0-a738-535f1531edb6 tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0" status: 404 len: 111 microversion: 2.1 time: 0.171754 Jul 19 22:59:02.636906 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2698/5388] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:59:02 2022] DELETE /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:59:02.649735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-56410251-3a4a-484a-8de7-280e56adc8fa tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:02.652575 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-56410251-3a4a-484a-8de7-280e56adc8fa tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] [instance: 9abb6a36-c31b-445c-a137-5fb74eb368b0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:02.668712 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-56410251-3a4a-484a-8de7-280e56adc8fa tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:02.669682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-56410251-3a4a-484a-8de7-280e56adc8fa tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:02.670824 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-56410251-3a4a-484a-8de7-280e56adc8fa tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:02.671612 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-56410251-3a4a-484a-8de7-280e56adc8fa tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:02.727985 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-56410251-3a4a-484a-8de7-280e56adc8fa tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] HTTP exception thrown: Instance 9abb6a36-c31b-445c-a137-5fb74eb368b0 could not be found. Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-56410251-3a4a-484a-8de7-280e56adc8fa tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Request method failure captured: Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0 HTTP/1.1 Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zVsSOX-O7ggDcH00KLmZx8wOtg3S3Su8gJRQI2lYa4BxC-OxvaOKnPb2I4UGxeYv7AyyS8e-HsUydLYlXpELI3RwSo4aU8bY9u8sE-NNAsyuAsZv_PYlNBhbG0F8quyfyoOYST6GA8Fbv-UJaQmRhd0xcvaUwo2b-fKMEkbL-YV9Cg Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3b759a0bda64e3c9df38b624d4145b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: e3b759a0bda64e3c9df38b624d4145b6 Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-338126148 Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: c3929e62eb4345f8a69fec37ba7c195f Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AttachVolumeNegativeTest-338126148-project Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 9abb6a36-c31b-445c-a137-5fb74eb368b0 could not be found. Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '9abb6a36-c31b-445c-a137-5fb74eb368b0'} Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9abb6a36-c31b-445c-a137-5fb74eb368b0 could not be found. Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9abb6a36-c31b-445c-a137-5fb74eb368b0 could not be found. Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:59:02.730829 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:59:02.734721 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:59:02.734721 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:59:02.734721 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:59:02.734721 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:59:02.734721 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:59:02.734721 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9abb6a36-c31b-445c-a137-5fb74eb368b0 could not be found. Jul 19 22:59:02.734721 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 22:59:02.742402 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-56410251-3a4a-484a-8de7-280e56adc8fa tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] Returning 404 to user: Instance 9abb6a36-c31b-445c-a137-5fb74eb368b0 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:59:02.743712 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-56410251-3a4a-484a-8de7-280e56adc8fa tempest-AttachVolumeNegativeTest-338126148 tempest-AttachVolumeNegativeTest-338126148-project] 10.222.0.25 "GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0" status: 404 len: 111 microversion: 2.1 time: 0.103411 Jul 19 22:59:02.744900 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2699/5389] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:59:02 2022] GET /compute/v2.1/servers/9abb6a36-c31b-445c-a137-5fb74eb368b0 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:59:03.406565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-11649cf0-dc63-406b-8926-4a448c9722ba tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:03.410254 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-11649cf0-dc63-406b-8926-4a448c9722ba tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:03.427844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-11649cf0-dc63-406b-8926-4a448c9722ba tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:03.428733 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-11649cf0-dc63-406b-8926-4a448c9722ba tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:03.433038 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-11649cf0-dc63-406b-8926-4a448c9722ba tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:03.438167 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-11649cf0-dc63-406b-8926-4a448c9722ba tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:03.960880 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-02672ae1-bd82-4d8c-95cd-5824e3d51d5a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:03.984212 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-02672ae1-bd82-4d8c-95cd-5824e3d51d5a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:03.995285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-02672ae1-bd82-4d8c-95cd-5824e3d51d5a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:03.998340 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-02672ae1-bd82-4d8c-95cd-5824e3d51d5a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1738 microversion: 2.20 time: 2.758542 Jul 19 22:59:04.002095 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2691/5390] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:59:01 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1738 bytes in 2764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:59:04.635037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1343743a-7941-4b73-a1c7-222105a19ce5 tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-300869835", "availability_zone": "foo_zone"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:59:04.636745 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:59:04.636745 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:59:04.637884 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.aggregate [None req-1343743a-7941-4b73-a1c7-222105a19ce5 tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] Generated uuid ecbaba1c-2e0e-4a3b-8047-366045484636 for aggregate {{(pid=119338) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 19 22:59:04.648130 n-d-847009-3 devstack@n-api.service[119338]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1343743a-7941-4b73-a1c7-222105a19ce5 tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] [57add8b2-ab6b-4b5b-8d19-ca1e88009fab] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 22:59:04.990776 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-11649cf0-dc63-406b-8926-4a448c9722ba tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:05.003371 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-11649cf0-dc63-406b-8926-4a448c9722ba tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1694 microversion: 2.1 time: 1.601253 Jul 19 22:59:05.009175 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2700/5391] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:59:03 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1694 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:59:05.042028 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-851b2dda-93b3-4b75-a578-41012b3abd09 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:05.042942 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-851b2dda-93b3-4b75-a578-41012b3abd09 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:05.062475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-851b2dda-93b3-4b75-a578-41012b3abd09 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:05.075299 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-851b2dda-93b3-4b75-a578-41012b3abd09 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:05.076745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-851b2dda-93b3-4b75-a578-41012b3abd09 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:05.088882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-851b2dda-93b3-4b75-a578-41012b3abd09 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:05.663749 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [None req-1343743a-7941-4b73-a1c7-222105a19ce5 tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] [57add8b2-ab6b-4b5b-8d19-ca1e88009fab] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 40814. Jul 19 22:59:05.752905 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1343743a-7941-4b73-a1c7-222105a19ce5 tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 1.484135 Jul 19 22:59:05.763638 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2692/5392] 10.222.0.25 () {60 vars in 1163 bytes} [Tue Jul 19 22:59:04 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:59:05.782444 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-07ca9c8b-5562-489b-9101-e51a8ffa3ad4 tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:59:05.797937 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:59:05.797937 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:59:05.883931 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-07ca9c8b-5562-489b-9101-e51a8ffa3ad4 tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.114238 Jul 19 22:59:05.889198 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2693/5393] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 19 22:59:05 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:59:05.908130 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3ae84795-147d-43db-95d4-3311da39a5dc tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:05.924246 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:59:05.924246 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:59:05.930586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3ae84795-147d-43db-95d4-3311da39a5dc tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:05.934620 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3ae84795-147d-43db-95d4-3311da39a5dc tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:05.940682 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3ae84795-147d-43db-95d4-3311da39a5dc tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:05.941464 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3ae84795-147d-43db-95d4-3311da39a5dc tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:06.086430 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3ae84795-147d-43db-95d4-3311da39a5dc tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.189905 Jul 19 22:59:06.087056 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2694/5394] 10.222.0.25 () {58 vars in 1175 bytes} [Tue Jul 19 22:59:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:59:06.103373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-993d3e14-d885-4e6c-a819-44e0d79b5542 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:06.111905 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-993d3e14-d885-4e6c-a819-44e0d79b5542 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:06.131919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-993d3e14-d885-4e6c-a819-44e0d79b5542 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:06.132375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-993d3e14-d885-4e6c-a819-44e0d79b5542 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:06.133165 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-993d3e14-d885-4e6c-a819-44e0d79b5542 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:06.133676 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-993d3e14-d885-4e6c-a819-44e0d79b5542 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:06.714338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-851b2dda-93b3-4b75-a578-41012b3abd09 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:06.733621 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-851b2dda-93b3-4b75-a578-41012b3abd09 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:06.742308 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-851b2dda-93b3-4b75-a578-41012b3abd09 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:06.744867 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-851b2dda-93b3-4b75-a578-41012b3abd09 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1738 microversion: 2.20 time: 1.724209 Jul 19 22:59:06.762089 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2701/5395] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:59:05 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1738 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:59:06.774372 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ec8545d4-354a-4fd3-81a3-21455f34d3fe tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:06.784158 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:59:06.784158 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:59:06.836806 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ec8545d4-354a-4fd3-81a3-21455f34d3fe tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.073121 Jul 19 22:59:06.844533 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2702/5396] 10.222.0.25 () {58 vars in 1142 bytes} [Tue Jul 19 22:59:06 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:59:06.858068 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-df66fa34-f0ed-4de9-9a5a-ee28d666008f req-4638c3dc-28aa-46a1-a08b-e5c367374b04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e166ac4-ba20-4db0-a559-cdaf0a031790", "tag": "9994a687-e09d-4fb9-b9d1-a6ecd7db6038"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:59:06.933451 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-df66fa34-f0ed-4de9-9a5a-ee28d666008f req-4638c3dc-28aa-46a1-a08b-e5c367374b04 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:06.935582 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-df66fa34-f0ed-4de9-9a5a-ee28d666008f req-4638c3dc-28aa-46a1-a08b-e5c367374b04 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:06.991581 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-df66fa34-f0ed-4de9-9a5a-ee28d666008f req-4638c3dc-28aa-46a1-a08b-e5c367374b04 service nova] Creating event network-changed:9994a687-e09d-4fb9-b9d1-a6ecd7db6038 for instance 7e166ac4-ba20-4db0-a559-cdaf0a031790 on n-h1-847009-3 Jul 19 22:59:07.019808 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-df66fa34-f0ed-4de9-9a5a-ee28d666008f req-4638c3dc-28aa-46a1-a08b-e5c367374b04 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173086 Jul 19 22:59:07.022765 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2703/5397] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:59:07.040532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-50f50813-bd4c-4f6d-aafa-9d51cccde555 tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-847009-3"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:59:07.042284 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:59:07.042284 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:59:07.081529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-50f50813-bd4c-4f6d-aafa-9d51cccde555 tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:07.092976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-50f50813-bd4c-4f6d-aafa-9d51cccde555 tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:07.804263 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-993d3e14-d885-4e6c-a819-44e0d79b5542 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:07.814155 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-993d3e14-d885-4e6c-a819-44e0d79b5542 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1694 microversion: 2.1 time: 1.718310 Jul 19 22:59:07.819287 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2695/5398] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:59:06 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1694 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:59:07.833845 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-340f725b-b8aa-4bc6-adcb-874ee45d27c8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:07.837079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-340f725b-b8aa-4bc6-adcb-874ee45d27c8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:07.856258 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-340f725b-b8aa-4bc6-adcb-874ee45d27c8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:07.857645 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-340f725b-b8aa-4bc6-adcb-874ee45d27c8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:07.861422 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-340f725b-b8aa-4bc6-adcb-874ee45d27c8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:07.863790 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-340f725b-b8aa-4bc6-adcb-874ee45d27c8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:07.964624 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-50f50813-bd4c-4f6d-aafa-9d51cccde555 tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.937146 Jul 19 22:59:07.974947 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2704/5399] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 19 22:59:07 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:59:08.010876 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-875987a9-7b00-49af-94b2-33f5c8967fb9 tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:08.012571 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:59:08.012571 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:59:08.052988 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-875987a9-7b00-49af-94b2-33f5c8967fb9 tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.074285 Jul 19 22:59:08.064999 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2705/5400] 10.222.0.25 () {58 vars in 1151 bytes} [Tue Jul 19 22:59:07 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:59:08.087171 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3583faa0-1874-4708-a6f3-f24c3e18d4d6 tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1579602932", "availability_zone": "foo_zone"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:59:08.446927 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:59:08.446927 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:59:08.648929 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3583faa0-1874-4708-a6f3-f24c3e18d4d6 tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.577120 Jul 19 22:59:08.649963 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2706/5401] 10.222.0.25 () {60 vars in 1172 bytes} [Tue Jul 19 22:59:08 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:59:08.661629 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9dbbc9a7-1dc6-475f-bc2c-651cc7f7e3b2 tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:59:08.662968 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:59:08.662968 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:59:08.720819 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9dbbc9a7-1dc6-475f-bc2c-651cc7f7e3b2 tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.064701 Jul 19 22:59:08.721746 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2707/5402] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 19 22:59:08 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:59:08.731817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-63714b41-63fb-4aa1-911e-eeb0cad2d37c tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:08.732592 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:59:08.732592 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:59:08.751794 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-63714b41-63fb-4aa1-911e-eeb0cad2d37c tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.020988 Jul 19 22:59:08.752442 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2708/5403] 10.222.0.25 () {58 vars in 1151 bytes} [Tue Jul 19 22:59:08 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 22:59:08.782962 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-89cb5eca-aa79-4818-9960-5df4741d93cc tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-847009-3"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:59:08.786263 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:59:08.786263 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 22:59:08.816553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-89cb5eca-aa79-4818-9960-5df4741d93cc tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:08.819852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-89cb5eca-aa79-4818-9960-5df4741d93cc tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:09.149850 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-89cb5eca-aa79-4818-9960-5df4741d93cc tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.390747 Jul 19 22:59:09.151585 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2709/5404] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 19 22:59:08 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:59:09.171286 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-829b874e-21cb-4963-908c-7df2eb37d460 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:09.172101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-829b874e-21cb-4963-908c-7df2eb37d460 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:09.193721 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-829b874e-21cb-4963-908c-7df2eb37d460 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:09.193992 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-340f725b-b8aa-4bc6-adcb-874ee45d27c8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:09.195760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-829b874e-21cb-4963-908c-7df2eb37d460 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:09.196823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-829b874e-21cb-4963-908c-7df2eb37d460 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:09.199495 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-829b874e-21cb-4963-908c-7df2eb37d460 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:09.209397 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-340f725b-b8aa-4bc6-adcb-874ee45d27c8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:09.213616 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-340f725b-b8aa-4bc6-adcb-874ee45d27c8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:09.216341 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-340f725b-b8aa-4bc6-adcb-874ee45d27c8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1742 microversion: 2.20 time: 1.395640 Jul 19 22:59:09.231480 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2696/5405] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:59:07 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1742 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:59:09.249028 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-712c69cf-cd19-449d-9b7a-d5c8341f2fe0 tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:09.253134 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 22:59:09.253134 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 22:59:09.323234 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-712c69cf-cd19-449d-9b7a-d5c8341f2fe0 tempest-TestAggregatesBasicOps-1456883963 tempest-TestAggregatesBasicOps-1456883963-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.087798 Jul 19 22:59:09.330198 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2697/5406] 10.222.0.25 () {58 vars in 1154 bytes} [Tue Jul 19 22:59:09 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 19 22:59:10.238809 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2138dd5c-cbc5-421c-bff1-5db8847e80b8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:10.239467 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2138dd5c-cbc5-421c-bff1-5db8847e80b8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:10.259750 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2138dd5c-cbc5-421c-bff1-5db8847e80b8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:10.263038 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2138dd5c-cbc5-421c-bff1-5db8847e80b8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:10.266356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2138dd5c-cbc5-421c-bff1-5db8847e80b8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:10.267658 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2138dd5c-cbc5-421c-bff1-5db8847e80b8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:10.910756 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-829b874e-21cb-4963-908c-7df2eb37d460 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:10.915032 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:59:10.931071 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-829b874e-21cb-4963-908c-7df2eb37d460 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1694 microversion: 2.1 time: 1.777901 Jul 19 22:59:10.936474 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2710/5407] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:59:09 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1694 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:59:11.363006 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2138dd5c-cbc5-421c-bff1-5db8847e80b8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:11.379671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2138dd5c-cbc5-421c-bff1-5db8847e80b8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:11.381659 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2138dd5c-cbc5-421c-bff1-5db8847e80b8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:11.385073 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2138dd5c-cbc5-421c-bff1-5db8847e80b8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1738 microversion: 2.20 time: 1.152222 Jul 19 22:59:11.388902 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2698/5408] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:59:10 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1738 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:59:11.955344 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-65723f24-b247-4c71-b7e1-06c2d8982267 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:11.956872 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-65723f24-b247-4c71-b7e1-06c2d8982267 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:11.977963 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65723f24-b247-4c71-b7e1-06c2d8982267 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:11.981067 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65723f24-b247-4c71-b7e1-06c2d8982267 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:11.982428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65723f24-b247-4c71-b7e1-06c2d8982267 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:11.991296 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65723f24-b247-4c71-b7e1-06c2d8982267 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:12.408171 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-565af1c8-0d82-4604-965b-d8e6f82b79d6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:12.408882 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-565af1c8-0d82-4604-965b-d8e6f82b79d6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:12.421003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-565af1c8-0d82-4604-965b-d8e6f82b79d6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:12.421643 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-565af1c8-0d82-4604-965b-d8e6f82b79d6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:12.422707 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-565af1c8-0d82-4604-965b-d8e6f82b79d6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:12.425492 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-565af1c8-0d82-4604-965b-d8e6f82b79d6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:12.622921 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-65723f24-b247-4c71-b7e1-06c2d8982267 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:12.633367 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-65723f24-b247-4c71-b7e1-06c2d8982267 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1694 microversion: 2.1 time: 0.683770 Jul 19 22:59:12.639838 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2711/5409] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:59:11 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1694 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:59:13.151978 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-565af1c8-0d82-4604-965b-d8e6f82b79d6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:13.164516 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-565af1c8-0d82-4604-965b-d8e6f82b79d6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:13.179615 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-565af1c8-0d82-4604-965b-d8e6f82b79d6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:13.189492 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-565af1c8-0d82-4604-965b-d8e6f82b79d6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1738 microversion: 2.20 time: 0.784420 Jul 19 22:59:13.193450 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2699/5410] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:59:12 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1738 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:59:13.666169 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5ebeff70-0725-46fd-a0cb-fd00a9ce3f9b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:13.668077 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5ebeff70-0725-46fd-a0cb-fd00a9ce3f9b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:13.683878 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ebeff70-0725-46fd-a0cb-fd00a9ce3f9b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:13.688088 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ebeff70-0725-46fd-a0cb-fd00a9ce3f9b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:13.691982 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ebeff70-0725-46fd-a0cb-fd00a9ce3f9b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:13.697203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ebeff70-0725-46fd-a0cb-fd00a9ce3f9b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:13.839250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-ee70ad47-f48e-4ab7-9aa2-743272019095 req-c14b5367-6a42-4e6d-b327-35598afe4674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e166ac4-ba20-4db0-a559-cdaf0a031790", "name": "network-vif-unplugged", "status": "completed", "tag": "9994a687-e09d-4fb9-b9d1-a6ecd7db6038"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:59:13.872407 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-ee70ad47-f48e-4ab7-9aa2-743272019095 req-c14b5367-6a42-4e6d-b327-35598afe4674 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:13.875616 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-ee70ad47-f48e-4ab7-9aa2-743272019095 req-c14b5367-6a42-4e6d-b327-35598afe4674 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:13.902967 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-ee70ad47-f48e-4ab7-9aa2-743272019095 req-c14b5367-6a42-4e6d-b327-35598afe4674 service nova] Creating event network-vif-unplugged:9994a687-e09d-4fb9-b9d1-a6ecd7db6038 for instance 7e166ac4-ba20-4db0-a559-cdaf0a031790 on n-h1-847009-3 Jul 19 22:59:13.910942 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-ee70ad47-f48e-4ab7-9aa2-743272019095 req-c14b5367-6a42-4e6d-b327-35598afe4674 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075806 Jul 19 22:59:13.913020 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2700/5411] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:59:14.224669 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cbc29c71-36d0-42f0-9fcb-858fe021b2d9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:14.226601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cbc29c71-36d0-42f0-9fcb-858fe021b2d9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:14.240427 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5ebeff70-0725-46fd-a0cb-fd00a9ce3f9b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:14.243137 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cbc29c71-36d0-42f0-9fcb-858fe021b2d9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:14.244116 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cbc29c71-36d0-42f0-9fcb-858fe021b2d9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:14.246794 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cbc29c71-36d0-42f0-9fcb-858fe021b2d9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:14.247506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cbc29c71-36d0-42f0-9fcb-858fe021b2d9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:14.248951 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5ebeff70-0725-46fd-a0cb-fd00a9ce3f9b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1694 microversion: 2.1 time: 0.593522 Jul 19 22:59:14.249705 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2712/5412] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:59:13 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1694 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:59:15.156432 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-28c48ee0-c4bc-4430-b695-f259bf43c45e tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:15.157680 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-28c48ee0-c4bc-4430-b695-f259bf43c45e tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 3724dd6c-5c35-4803-8f22-67900a52bddc] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:15.176009 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28c48ee0-c4bc-4430-b695-f259bf43c45e tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:15.176475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28c48ee0-c4bc-4430-b695-f259bf43c45e tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:15.188196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28c48ee0-c4bc-4430-b695-f259bf43c45e tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:15.188726 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28c48ee0-c4bc-4430-b695-f259bf43c45e tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:15.378729 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-28c48ee0-c4bc-4430-b695-f259bf43c45e tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 3724dd6c-5c35-4803-8f22-67900a52bddc] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:59:15.426247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cbc29c71-36d0-42f0-9fcb-858fe021b2d9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:15.444650 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cbc29c71-36d0-42f0-9fcb-858fe021b2d9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:15.447160 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cbc29c71-36d0-42f0-9fcb-858fe021b2d9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:15.448690 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cbc29c71-36d0-42f0-9fcb-858fe021b2d9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1738 microversion: 2.20 time: 1.232178 Jul 19 22:59:15.462763 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2701/5413] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:59:14 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1738 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 22:59:15.476575 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-42465d5b-8703-4656-83aa-ec66d9b949c9 req-8f76425a-2ec8-4f57-82ac-d1d934de581b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3724dd6c-5c35-4803-8f22-67900a52bddc", "tag": "01dc1628-900f-4edc-aa29-b8fa137bb75a"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:59:15.532875 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-42465d5b-8703-4656-83aa-ec66d9b949c9 req-8f76425a-2ec8-4f57-82ac-d1d934de581b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:15.533710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-42465d5b-8703-4656-83aa-ec66d9b949c9 req-8f76425a-2ec8-4f57-82ac-d1d934de581b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:15.552700 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-42465d5b-8703-4656-83aa-ec66d9b949c9 req-8f76425a-2ec8-4f57-82ac-d1d934de581b service nova] Creating event network-changed:01dc1628-900f-4edc-aa29-b8fa137bb75a for instance 3724dd6c-5c35-4803-8f22-67900a52bddc on n-h1-847009-3 Jul 19 22:59:15.580977 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-42465d5b-8703-4656-83aa-ec66d9b949c9 req-8f76425a-2ec8-4f57-82ac-d1d934de581b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106645 Jul 19 22:59:15.582079 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2702/5414] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:59:15.589459 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0280348b-8bae-4fbe-bc90-e91acb921691 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:15.591508 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0280348b-8bae-4fbe-bc90-e91acb921691 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:15.624096 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0280348b-8bae-4fbe-bc90-e91acb921691 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:15.624854 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0280348b-8bae-4fbe-bc90-e91acb921691 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:15.625740 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0280348b-8bae-4fbe-bc90-e91acb921691 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:15.626262 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0280348b-8bae-4fbe-bc90-e91acb921691 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:15.629553 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-28c48ee0-c4bc-4430-b695-f259bf43c45e tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc" status: 204 len: 0 microversion: 2.1 time: 0.478483 Jul 19 22:59:15.633980 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2713/5415] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:59:15 2022] DELETE /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 22:59:15.646822 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ce0748ab-679c-495c-b996-7ef97e07af93 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:15.652769 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ce0748ab-679c-495c-b996-7ef97e07af93 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 3724dd6c-5c35-4803-8f22-67900a52bddc] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:15.669111 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ce0748ab-679c-495c-b996-7ef97e07af93 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:15.672517 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ce0748ab-679c-495c-b996-7ef97e07af93 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:15.676405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ce0748ab-679c-495c-b996-7ef97e07af93 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:15.677213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ce0748ab-679c-495c-b996-7ef97e07af93 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:15.990479 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:59:16.308775 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0280348b-8bae-4fbe-bc90-e91acb921691 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:16.318212 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0280348b-8bae-4fbe-bc90-e91acb921691 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1694 microversion: 2.1 time: 0.734865 Jul 19 22:59:16.334115 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2703/5416] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:59:15 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1694 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:59:16.474373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-30c8f63b-abfb-43a5-a770-67396fae71d7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:16.475013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-30c8f63b-abfb-43a5-a770-67396fae71d7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:16.490330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-30c8f63b-abfb-43a5-a770-67396fae71d7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:16.492648 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-30c8f63b-abfb-43a5-a770-67396fae71d7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:16.493841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-30c8f63b-abfb-43a5-a770-67396fae71d7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:16.495651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-30c8f63b-abfb-43a5-a770-67396fae71d7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:17.677014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ce0748ab-679c-495c-b996-7ef97e07af93 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:17.692068 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ce0748ab-679c-495c-b996-7ef97e07af93 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc" status: 200 len: 1765 microversion: 2.1 time: 2.052370 Jul 19 22:59:17.714797 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2714/5417] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:59:15 2022] GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc => generated 1765 bytes in 2056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:59:17.726877 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f9115124-70f4-45b3-a615-bda732361c78 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:17.730554 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f9115124-70f4-45b3-a615-bda732361c78 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:17.791694 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f9115124-70f4-45b3-a615-bda732361c78 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:17.792410 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f9115124-70f4-45b3-a615-bda732361c78 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:17.794501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f9115124-70f4-45b3-a615-bda732361c78 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:17.797738 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f9115124-70f4-45b3-a615-bda732361c78 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:18.267023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-30c8f63b-abfb-43a5-a770-67396fae71d7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:18.271008 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=94 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:59:18.284328 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-30c8f63b-abfb-43a5-a770-67396fae71d7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:18.286186 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-30c8f63b-abfb-43a5-a770-67396fae71d7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:18.287789 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-30c8f63b-abfb-43a5-a770-67396fae71d7 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1738 microversion: 2.20 time: 1.822541 Jul 19 22:59:18.302280 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2704/5418] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:59:16 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1738 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:59:18.713751 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cd4993ce-90b6-42e5-91fb-001964045c55 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:18.714667 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cd4993ce-90b6-42e5-91fb-001964045c55 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 3724dd6c-5c35-4803-8f22-67900a52bddc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:18.728254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd4993ce-90b6-42e5-91fb-001964045c55 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:18.728816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd4993ce-90b6-42e5-91fb-001964045c55 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:18.729513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd4993ce-90b6-42e5-91fb-001964045c55 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:18.729950 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd4993ce-90b6-42e5-91fb-001964045c55 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:19.554607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cd4993ce-90b6-42e5-91fb-001964045c55 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:19.567221 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cd4993ce-90b6-42e5-91fb-001964045c55 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc" status: 200 len: 1765 microversion: 2.1 time: 0.857245 Jul 19 22:59:19.570482 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2705/5419] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:59:18 2022] GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc => generated 1765 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:59:19.575834 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-38593f5b-ff49-40e2-88d3-d2d9c5b8127b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:19.586558 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-38593f5b-ff49-40e2-88d3-d2d9c5b8127b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:19.603538 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-38593f5b-ff49-40e2-88d3-d2d9c5b8127b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:19.604225 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-38593f5b-ff49-40e2-88d3-d2d9c5b8127b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:19.609372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-38593f5b-ff49-40e2-88d3-d2d9c5b8127b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:19.610129 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-38593f5b-ff49-40e2-88d3-d2d9c5b8127b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:21.207422 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f9115124-70f4-45b3-a615-bda732361c78 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:21.236463 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f9115124-70f4-45b3-a615-bda732361c78 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1694 microversion: 2.1 time: 3.514299 Jul 19 22:59:21.242002 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2715/5420] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:59:17 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1694 bytes in 3526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:59:21.264652 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-8459a1ba-0c37-4508-83fd-26cc5342ee73 req-9d828e9c-728e-4612-ae5a-4cce4a92b942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3724dd6c-5c35-4803-8f22-67900a52bddc", "name": "network-vif-unplugged", "status": "completed", "tag": "01dc1628-900f-4edc-aa29-b8fa137bb75a"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:59:21.297620 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-8459a1ba-0c37-4508-83fd-26cc5342ee73 req-9d828e9c-728e-4612-ae5a-4cce4a92b942 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:21.298393 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-8459a1ba-0c37-4508-83fd-26cc5342ee73 req-9d828e9c-728e-4612-ae5a-4cce4a92b942 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:21.340522 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-8459a1ba-0c37-4508-83fd-26cc5342ee73 req-9d828e9c-728e-4612-ae5a-4cce4a92b942 service nova] Creating event network-vif-unplugged:01dc1628-900f-4edc-aa29-b8fa137bb75a for instance 3724dd6c-5c35-4803-8f22-67900a52bddc on n-h1-847009-3 Jul 19 22:59:21.347557 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-8459a1ba-0c37-4508-83fd-26cc5342ee73 req-9d828e9c-728e-4612-ae5a-4cce4a92b942 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103418 Jul 19 22:59:21.353859 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2716/5421] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:59:21.363701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8aa671b2-8e4e-4dd2-a850-9f3c012cae3b tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:21.365196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8aa671b2-8e4e-4dd2-a850-9f3c012cae3b tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 3724dd6c-5c35-4803-8f22-67900a52bddc] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:21.403241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8aa671b2-8e4e-4dd2-a850-9f3c012cae3b tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:21.406436 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8aa671b2-8e4e-4dd2-a850-9f3c012cae3b tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:21.407862 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8aa671b2-8e4e-4dd2-a850-9f3c012cae3b tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:21.412577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8aa671b2-8e4e-4dd2-a850-9f3c012cae3b tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:22.375934 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-38593f5b-ff49-40e2-88d3-d2d9c5b8127b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:22.389465 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-38593f5b-ff49-40e2-88d3-d2d9c5b8127b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:22.392702 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-38593f5b-ff49-40e2-88d3-d2d9c5b8127b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:22.395036 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-38593f5b-ff49-40e2-88d3-d2d9c5b8127b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1738 microversion: 2.20 time: 2.823241 Jul 19 22:59:22.397668 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2706/5422] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:59:19 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1738 bytes in 2826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:59:22.403476 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-42b970f6-ee88-4a09-8de1-0fab3e274674 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:22.409813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-42b970f6-ee88-4a09-8de1-0fab3e274674 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:22.443730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-42b970f6-ee88-4a09-8de1-0fab3e274674 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:22.444881 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-42b970f6-ee88-4a09-8de1-0fab3e274674 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:22.446683 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-42b970f6-ee88-4a09-8de1-0fab3e274674 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:22.448466 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-42b970f6-ee88-4a09-8de1-0fab3e274674 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:22.922824 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8aa671b2-8e4e-4dd2-a850-9f3c012cae3b tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:22.948860 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8aa671b2-8e4e-4dd2-a850-9f3c012cae3b tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc" status: 200 len: 1765 microversion: 2.1 time: 1.593208 Jul 19 22:59:22.961247 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2717/5423] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:59:21 2022] GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc => generated 1765 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:59:23.007812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-42b970f6-ee88-4a09-8de1-0fab3e274674 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:23.025999 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-42b970f6-ee88-4a09-8de1-0fab3e274674 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1694 microversion: 2.1 time: 0.626628 Jul 19 22:59:23.031440 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2707/5424] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:59:22 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1694 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:59:23.302631 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-ccb0d48a-80f8-48ac-aa3d-c789033784c1 req-5c242544-1fb0-4139-a217-42a3b4631e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3724dd6c-5c35-4803-8f22-67900a52bddc", "name": "network-vif-deleted", "tag": "01dc1628-900f-4edc-aa29-b8fa137bb75a"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:59:23.317828 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-ccb0d48a-80f8-48ac-aa3d-c789033784c1 req-5c242544-1fb0-4139-a217-42a3b4631e94 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:23.319786 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-ccb0d48a-80f8-48ac-aa3d-c789033784c1 req-5c242544-1fb0-4139-a217-42a3b4631e94 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:23.343250 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-ccb0d48a-80f8-48ac-aa3d-c789033784c1 req-5c242544-1fb0-4139-a217-42a3b4631e94 service nova] Creating event network-vif-deleted:01dc1628-900f-4edc-aa29-b8fa137bb75a for instance 3724dd6c-5c35-4803-8f22-67900a52bddc on n-h1-847009-3 Jul 19 22:59:23.360990 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-ccb0d48a-80f8-48ac-aa3d-c789033784c1 req-5c242544-1fb0-4139-a217-42a3b4631e94 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062587 Jul 19 22:59:23.361909 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2718/5425] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:59:23.418234 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-570efffb-603a-4196-837e-3483ddeae684 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:23.419893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-570efffb-603a-4196-837e-3483ddeae684 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:23.436091 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-570efffb-603a-4196-837e-3483ddeae684 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:23.442971 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-570efffb-603a-4196-837e-3483ddeae684 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:23.444105 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-570efffb-603a-4196-837e-3483ddeae684 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:23.446136 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-570efffb-603a-4196-837e-3483ddeae684 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:23.970240 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7caf1601-4fb4-4fca-8a34-ae82f12991dc tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:23.971778 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7caf1601-4fb4-4fca-8a34-ae82f12991dc tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 3724dd6c-5c35-4803-8f22-67900a52bddc] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:23.989200 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7caf1601-4fb4-4fca-8a34-ae82f12991dc tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:23.994054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7caf1601-4fb4-4fca-8a34-ae82f12991dc tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:23.996727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7caf1601-4fb4-4fca-8a34-ae82f12991dc tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:23.997420 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7caf1601-4fb4-4fca-8a34-ae82f12991dc tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:24.091002 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7caf1601-4fb4-4fca-8a34-ae82f12991dc tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:24.091497 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7caf1601-4fb4-4fca-8a34-ae82f12991dc tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:24.091970 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-7caf1601-4fb4-4fca-8a34-ae82f12991dc tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lazy-loading 'fault' on Instance uuid 3724dd6c-5c35-4803-8f22-67900a52bddc {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:59:24.234277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7caf1601-4fb4-4fca-8a34-ae82f12991dc tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4403795b53d3430897fa30d42acbd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacf3f67cf95455985dda79eb06b826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:24.257978 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7caf1601-4fb4-4fca-8a34-ae82f12991dc tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc" status: 200 len: 1383 microversion: 2.1 time: 0.291714 Jul 19 22:59:24.270391 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2719/5426] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:59:23 2022] GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc => generated 1383 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 22:59:24.291680 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e1667d4e-dde5-4ebc-85f0-1012183879dc tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:24.296461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e1667d4e-dde5-4ebc-85f0-1012183879dc tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:24.329648 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e1667d4e-dde5-4ebc-85f0-1012183879dc tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:24.339982 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e1667d4e-dde5-4ebc-85f0-1012183879dc tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:24.341295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e1667d4e-dde5-4ebc-85f0-1012183879dc tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:24.341910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e1667d4e-dde5-4ebc-85f0-1012183879dc tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:24.347939 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-570efffb-603a-4196-837e-3483ddeae684 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:24.361166 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-570efffb-603a-4196-837e-3483ddeae684 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:24.365213 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-570efffb-603a-4196-837e-3483ddeae684 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:24.368907 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-570efffb-603a-4196-837e-3483ddeae684 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1720 microversion: 2.20 time: 0.958690 Jul 19 22:59:24.382310 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2708/5427] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:59:23 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1720 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:59:25.267063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e1667d4e-dde5-4ebc-85f0-1012183879dc tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:25.278242 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d561c748-8f1e-4689-96e8-13f25711f80c tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:25.280085 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d561c748-8f1e-4689-96e8-13f25711f80c tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] [instance: 3724dd6c-5c35-4803-8f22-67900a52bddc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:25.301542 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e1667d4e-dde5-4ebc-85f0-1012183879dc tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1684 microversion: 2.1 time: 1.027335 Jul 19 22:59:25.311239 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d561c748-8f1e-4689-96e8-13f25711f80c tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:25.311737 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2720/5428] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:59:24 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1684 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:59:25.312635 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d561c748-8f1e-4689-96e8-13f25711f80c tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:25.313769 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d561c748-8f1e-4689-96e8-13f25711f80c tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:25.314603 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d561c748-8f1e-4689-96e8-13f25711f80c tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:25.322827 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c8316077-b452-4246-b6ca-efd998077c84 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:25.326648 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c8316077-b452-4246-b6ca-efd998077c84 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:25.345561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c8316077-b452-4246-b6ca-efd998077c84 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:25.350896 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c8316077-b452-4246-b6ca-efd998077c84 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:25.352350 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c8316077-b452-4246-b6ca-efd998077c84 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:25.353047 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c8316077-b452-4246-b6ca-efd998077c84 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:25.362143 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-d561c748-8f1e-4689-96e8-13f25711f80c tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] HTTP exception thrown: Instance 3724dd6c-5c35-4803-8f22-67900a52bddc could not be found. Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d561c748-8f1e-4689-96e8-13f25711f80c tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Request method failure captured: Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc HTTP/1.1 Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zae66_ZcyJmhxXb3iBtVHHRrxr7yOXtAwiOpazCfkgRZqgszFtabehCakrWCAUdL3UQz0M9GLpi2QugY_aJXdl-wXeidApChf3kSORyoo9Kj7e_pSNDisymSYPOG3nrfE1zJo4z7wRd9uoC45y5SqAeiH_8oipiI1wzNVZlkvcvIss Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: aacf3f67cf95455985dda79eb06b826c Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-632400044 Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_aacf3f67cf95455985dda79eb06b826c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aacf3f67cf95455985dda79eb06b826c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/aacf3f67cf95455985dda79eb06b826c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aacf3f67cf95455985dda79eb06b826c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TestSecurityGroupsBasicOps-632400044 Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: aacf3f67cf95455985dda79eb06b826c Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-632400044 Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TestSecurityGroupsBasicOps-632400044-project Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 4403795b53d3430897fa30d42acbd9ca Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TestSecurityGroupsBasicOps-632400044-project Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 3724dd6c-5c35-4803-8f22-67900a52bddc could not be found. Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '3724dd6c-5c35-4803-8f22-67900a52bddc'} Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3724dd6c-5c35-4803-8f22-67900a52bddc could not be found. Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3724dd6c-5c35-4803-8f22-67900a52bddc could not be found. Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:59:25.368361 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:59:25.372399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:59:25.372399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:59:25.372399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:59:25.372399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:59:25.372399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:59:25.372399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3724dd6c-5c35-4803-8f22-67900a52bddc could not be found. Jul 19 22:59:25.372399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:59:25.389616 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d561c748-8f1e-4689-96e8-13f25711f80c tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Returning 404 to user: Instance 3724dd6c-5c35-4803-8f22-67900a52bddc could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:59:25.391347 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d561c748-8f1e-4689-96e8-13f25711f80c tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc" status: 404 len: 111 microversion: 2.1 time: 0.119051 Jul 19 22:59:25.392533 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2709/5429] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:59:25 2022] GET /compute/v2.1/servers/3724dd6c-5c35-4803-8f22-67900a52bddc => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:59:25.402259 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-96b5bde5-380f-4fbe-85fc-8c72c6874895 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:25.404052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-96b5bde5-380f-4fbe-85fc-8c72c6874895 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:25.419436 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96b5bde5-380f-4fbe-85fc-8c72c6874895 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:25.425718 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96b5bde5-380f-4fbe-85fc-8c72c6874895 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:25.427076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96b5bde5-380f-4fbe-85fc-8c72c6874895 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:25.427767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96b5bde5-380f-4fbe-85fc-8c72c6874895 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:26.528063 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c8316077-b452-4246-b6ca-efd998077c84 tempest-TestNetworkAdvancedServerOps-139711610 tempest-TestNetworkAdvancedServerOps-139711610-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1835 microversion: 2.1 time: 1.212000 Jul 19 22:59:26.543654 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2721/5430] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:59:25 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1835 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:59:26.553842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-13cb8162-e917-428b-9073-4f85041fc69a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:26.566485 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-96b5bde5-380f-4fbe-85fc-8c72c6874895 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:26.579341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-13cb8162-e917-428b-9073-4f85041fc69a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:26.583969 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-96b5bde5-380f-4fbe-85fc-8c72c6874895 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:26.600144 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-96b5bde5-380f-4fbe-85fc-8c72c6874895 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:26.606694 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-96b5bde5-380f-4fbe-85fc-8c72c6874895 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1720 microversion: 2.20 time: 1.212733 Jul 19 22:59:26.609448 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13cb8162-e917-428b-9073-4f85041fc69a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:26.610957 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2710/5431] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:59:25 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1720 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:59:26.620835 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13cb8162-e917-428b-9073-4f85041fc69a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:26.623650 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13cb8162-e917-428b-9073-4f85041fc69a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:26.629817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13cb8162-e917-428b-9073-4f85041fc69a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:26.795380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-f9713e72-2e9d-446c-aa46-18f744adf513 req-bbbc35fb-1a6e-4ce0-b57a-6739a820afc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0", "name": "network-vif-unplugged", "status": "completed", "tag": "f0538c77-95fe-460e-98c5-1e6a3dad7e95"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:59:26.811592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f9713e72-2e9d-446c-aa46-18f744adf513 req-bbbc35fb-1a6e-4ce0-b57a-6739a820afc2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:26.819500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f9713e72-2e9d-446c-aa46-18f744adf513 req-bbbc35fb-1a6e-4ce0-b57a-6739a820afc2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:26.883906 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-f9713e72-2e9d-446c-aa46-18f744adf513 req-bbbc35fb-1a6e-4ce0-b57a-6739a820afc2 service nova] Creating event network-vif-unplugged:f0538c77-95fe-460e-98c5-1e6a3dad7e95 for instance e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 on n-h2-847009-3 Jul 19 22:59:26.923683 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-f9713e72-2e9d-446c-aa46-18f744adf513 req-bbbc35fb-1a6e-4ce0-b57a-6739a820afc2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118103 Jul 19 22:59:26.937499 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2711/5432] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:59:27.145521 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-13cb8162-e917-428b-9073-4f85041fc69a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:27.156693 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-13cb8162-e917-428b-9073-4f85041fc69a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1684 microversion: 2.1 time: 0.611055 Jul 19 22:59:27.158070 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2722/5433] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:59:26 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1684 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:59:27.291469 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4586870b-35c8-485f-8f08-802f3216db79 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:59:27.292770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4586870b-35c8-485f-8f08-802f3216db79 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:27.314100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4586870b-35c8-485f-8f08-802f3216db79 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:27.316792 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4586870b-35c8-485f-8f08-802f3216db79 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:27.319450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4586870b-35c8-485f-8f08-802f3216db79 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:27.320874 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4586870b-35c8-485f-8f08-802f3216db79 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:27.422698 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4586870b-35c8-485f-8f08-802f3216db79 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "POST /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790/action" status: 200 len: 38588 microversion: 2.1 time: 0.136071 Jul 19 22:59:27.423835 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2712/5434] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 22:59:27 2022] POST /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790/action => generated 38588 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:59:27.633975 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-32a8bf49-a16f-48c4-82a5-85a27abab41b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:27.634816 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-32a8bf49-a16f-48c4-82a5-85a27abab41b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:27.651400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32a8bf49-a16f-48c4-82a5-85a27abab41b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:27.653227 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32a8bf49-a16f-48c4-82a5-85a27abab41b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:27.654840 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32a8bf49-a16f-48c4-82a5-85a27abab41b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:27.657191 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32a8bf49-a16f-48c4-82a5-85a27abab41b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:28.024988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-32a8bf49-a16f-48c4-82a5-85a27abab41b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:28.037432 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-32a8bf49-a16f-48c4-82a5-85a27abab41b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:28.044837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-32a8bf49-a16f-48c4-82a5-85a27abab41b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:28.046907 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-32a8bf49-a16f-48c4-82a5-85a27abab41b tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1663 microversion: 2.20 time: 0.419014 Jul 19 22:59:28.047717 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2723/5435] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:59:27 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1663 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:59:28.066859 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7bef5aa7-3839-4fb0-a0fb-59d5b43aecd3 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1abbeabc-d407-4693-b9b9-0b65d10a7ec8"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:59:28.068848 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7bef5aa7-3839-4fb0-a0fb-59d5b43aecd3 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:28.090883 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bef5aa7-3839-4fb0-a0fb-59d5b43aecd3 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:28.091748 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bef5aa7-3839-4fb0-a0fb-59d5b43aecd3 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:28.092555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bef5aa7-3839-4fb0-a0fb-59d5b43aecd3 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:28.093522 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bef5aa7-3839-4fb0-a0fb-59d5b43aecd3 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:28.708192 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7bef5aa7-3839-4fb0-a0fb-59d5b43aecd3 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "POST /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.646553 Jul 19 22:59:28.713847 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2713/5436] 10.222.0.25 () {62 vars in 1363 bytes} [Tue Jul 19 22:59:28 2022] POST /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0/os-volume_attachments => generated 188 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 22:59:28.877466 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-313477ef-f960-4a27-af2b-b915d2a3dd16 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:28.877984 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-313477ef-f960-4a27-af2b-b915d2a3dd16 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:28.887323 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-313477ef-f960-4a27-af2b-b915d2a3dd16 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:28.887842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-313477ef-f960-4a27-af2b-b915d2a3dd16 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:28.888784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-313477ef-f960-4a27-af2b-b915d2a3dd16 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:28.889776 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-313477ef-f960-4a27-af2b-b915d2a3dd16 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:29.270329 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:59:29.280111 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-313477ef-f960-4a27-af2b-b915d2a3dd16 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0/os-volume_attachments/1abbeabc-d407-4693-b9b9-0b65d10a7ec8" status: 202 len: 0 microversion: 2.20 time: 0.406314 Jul 19 22:59:29.283509 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2724/5437] 10.222.0.25 () {60 vars in 1456 bytes} [Tue Jul 19 22:59:28 2022] DELETE /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0/os-volume_attachments/1abbeabc-d407-4693-b9b9-0b65d10a7ec8 => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:59:29.411570 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f40effbb-f063-480b-978f-c4e55fc3f0df tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:59:29.413789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f40effbb-f063-480b-978f-c4e55fc3f0df tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:29.426239 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f40effbb-f063-480b-978f-c4e55fc3f0df tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:29.427026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f40effbb-f063-480b-978f-c4e55fc3f0df tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:29.431025 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f40effbb-f063-480b-978f-c4e55fc3f0df tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:29.432064 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f40effbb-f063-480b-978f-c4e55fc3f0df tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:29.586809 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f40effbb-f063-480b-978f-c4e55fc3f0df tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "POST /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0/action" status: 202 len: 0 microversion: 2.20 time: 0.175205 Jul 19 22:59:29.587912 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2714/5438] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Jul 19 22:59:29 2022] POST /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 22:59:29.597166 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-74981af6-03e7-44a6-8e77-aaeea33528ea tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:29.597588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-74981af6-03e7-44a6-8e77-aaeea33528ea tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:29.622500 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74981af6-03e7-44a6-8e77-aaeea33528ea tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:29.623060 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74981af6-03e7-44a6-8e77-aaeea33528ea tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:29.624147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74981af6-03e7-44a6-8e77-aaeea33528ea tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:29.624682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-74981af6-03e7-44a6-8e77-aaeea33528ea tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:30.011591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-74981af6-03e7-44a6-8e77-aaeea33528ea tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:30.021051 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-74981af6-03e7-44a6-8e77-aaeea33528ea tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:30.027600 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-74981af6-03e7-44a6-8e77-aaeea33528ea tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:30.032598 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-74981af6-03e7-44a6-8e77-aaeea33528ea tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1671 microversion: 2.20 time: 0.440786 Jul 19 22:59:30.033655 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2725/5439] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:59:29 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1671 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:59:31.053733 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cfec5450-37eb-48b0-b6a4-a2d2f0514e05 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:31.054387 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cfec5450-37eb-48b0-b6a4-a2d2f0514e05 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:31.067358 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cfec5450-37eb-48b0-b6a4-a2d2f0514e05 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:31.067782 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cfec5450-37eb-48b0-b6a4-a2d2f0514e05 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:31.068762 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cfec5450-37eb-48b0-b6a4-a2d2f0514e05 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:31.069366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cfec5450-37eb-48b0-b6a4-a2d2f0514e05 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:31.816785 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cfec5450-37eb-48b0-b6a4-a2d2f0514e05 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:31.831471 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cfec5450-37eb-48b0-b6a4-a2d2f0514e05 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:31.840087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cfec5450-37eb-48b0-b6a4-a2d2f0514e05 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:31.846554 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cfec5450-37eb-48b0-b6a4-a2d2f0514e05 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1671 microversion: 2.20 time: 0.797108 Jul 19 22:59:31.852491 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2715/5440] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:59:31 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1671 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:59:32.869656 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8e629902-8ced-4866-858d-98d884ab7c70 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:32.870287 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8e629902-8ced-4866-858d-98d884ab7c70 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:32.874558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=2,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:59:32.910778 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8e629902-8ced-4866-858d-98d884ab7c70 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:32.912136 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8e629902-8ced-4866-858d-98d884ab7c70 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:32.913277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8e629902-8ced-4866-858d-98d884ab7c70 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:32.913890 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8e629902-8ced-4866-858d-98d884ab7c70 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:33.219155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-93aea78c-53bb-4fee-8d98-da9a001e131b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:33.220645 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-93aea78c-53bb-4fee-8d98-da9a001e131b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:33.237842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:59:33.247044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93aea78c-53bb-4fee-8d98-da9a001e131b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:33.247667 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93aea78c-53bb-4fee-8d98-da9a001e131b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:33.248713 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93aea78c-53bb-4fee-8d98-da9a001e131b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:33.252829 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93aea78c-53bb-4fee-8d98-da9a001e131b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:33.335715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-93aea78c-53bb-4fee-8d98-da9a001e131b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 22:59:33.563853 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-93aea78c-53bb-4fee-8d98-da9a001e131b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 204 len: 0 microversion: 2.1 time: 0.349106 Jul 19 22:59:33.568287 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2716/5441] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 22:59:33 2022] DELETE /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 22:59:33.582591 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-4f71651d-e477-4e5a-8bf4-35894dd9747a req-2a79dfb1-1acc-4302-81f3-0ede2ec996bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e166ac4-ba20-4db0-a559-cdaf0a031790", "tag": "9994a687-e09d-4fb9-b9d1-a6ecd7db6038"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:59:33.605134 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-4f71651d-e477-4e5a-8bf4-35894dd9747a req-2a79dfb1-1acc-4302-81f3-0ede2ec996bb service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:33.609580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-4f71651d-e477-4e5a-8bf4-35894dd9747a req-2a79dfb1-1acc-4302-81f3-0ede2ec996bb service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:33.646424 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-4f71651d-e477-4e5a-8bf4-35894dd9747a req-2a79dfb1-1acc-4302-81f3-0ede2ec996bb service nova] Creating event network-changed:9994a687-e09d-4fb9-b9d1-a6ecd7db6038 for instance 7e166ac4-ba20-4db0-a559-cdaf0a031790 on n-h2-847009-3 Jul 19 22:59:33.657715 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-4f71651d-e477-4e5a-8bf4-35894dd9747a req-2a79dfb1-1acc-4302-81f3-0ede2ec996bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085579 Jul 19 22:59:33.659721 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2717/5442] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:59:33.673254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ad33ddc5-e8bf-4e62-8eec-4377bd256d67 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:33.677757 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ad33ddc5-e8bf-4e62-8eec-4377bd256d67 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:33.694033 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad33ddc5-e8bf-4e62-8eec-4377bd256d67 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:33.694872 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad33ddc5-e8bf-4e62-8eec-4377bd256d67 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:33.696747 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad33ddc5-e8bf-4e62-8eec-4377bd256d67 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:33.697639 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad33ddc5-e8bf-4e62-8eec-4377bd256d67 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:33.734202 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 22:59:34.995506 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8e629902-8ced-4866-858d-98d884ab7c70 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:35.014415 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8e629902-8ced-4866-858d-98d884ab7c70 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:35.016830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8e629902-8ced-4866-858d-98d884ab7c70 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:35.018284 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8e629902-8ced-4866-858d-98d884ab7c70 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1729 microversion: 2.20 time: 2.153250 Jul 19 22:59:35.027894 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2726/5443] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:59:32 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1729 bytes in 2163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:59:35.548026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ad33ddc5-e8bf-4e62-8eec-4377bd256d67 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:35.563671 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ad33ddc5-e8bf-4e62-8eec-4377bd256d67 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1690 microversion: 2.1 time: 1.901842 Jul 19 22:59:35.565152 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2718/5444] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:59:33 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1690 bytes in 1905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:59:36.046938 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6688a4f1-44a4-4dd5-81b4-c302b119b2b5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:36.048056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6688a4f1-44a4-4dd5-81b4-c302b119b2b5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:36.064270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6688a4f1-44a4-4dd5-81b4-c302b119b2b5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:36.065616 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6688a4f1-44a4-4dd5-81b4-c302b119b2b5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:36.066586 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6688a4f1-44a4-4dd5-81b4-c302b119b2b5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:36.067337 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6688a4f1-44a4-4dd5-81b4-c302b119b2b5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:36.558176 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-65005b85-f0ed-40f0-845b-3652bc87bb8d req-6b69d0f6-a590-4a92-b863-e7e45f13d2e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e166ac4-ba20-4db0-a559-cdaf0a031790", "name": "network-vif-deleted", "tag": "9994a687-e09d-4fb9-b9d1-a6ecd7db6038"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:59:36.609301 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-65005b85-f0ed-40f0-845b-3652bc87bb8d req-6b69d0f6-a590-4a92-b863-e7e45f13d2e0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:36.610197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-65005b85-f0ed-40f0-845b-3652bc87bb8d req-6b69d0f6-a590-4a92-b863-e7e45f13d2e0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:36.652081 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-65005b85-f0ed-40f0-845b-3652bc87bb8d req-6b69d0f6-a590-4a92-b863-e7e45f13d2e0 service nova] Creating event network-vif-deleted:9994a687-e09d-4fb9-b9d1-a6ecd7db6038 for instance 7e166ac4-ba20-4db0-a559-cdaf0a031790 on n-h2-847009-3 Jul 19 22:59:36.666722 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-65005b85-f0ed-40f0-845b-3652bc87bb8d req-6b69d0f6-a590-4a92-b863-e7e45f13d2e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115230 Jul 19 22:59:36.669557 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2719/5445] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:59:36.701638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7e6c8dc2-36fe-4093-8b99-d9d9acbb0f18 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:36.707063 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7e6c8dc2-36fe-4093-8b99-d9d9acbb0f18 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:36.718931 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6688a4f1-44a4-4dd5-81b4-c302b119b2b5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:36.728303 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6688a4f1-44a4-4dd5-81b4-c302b119b2b5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:36.729853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6688a4f1-44a4-4dd5-81b4-c302b119b2b5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:36.731145 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6688a4f1-44a4-4dd5-81b4-c302b119b2b5 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1729 microversion: 2.20 time: 0.689120 Jul 19 22:59:36.742886 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e6c8dc2-36fe-4093-8b99-d9d9acbb0f18 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:36.743729 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2727/5446] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:59:36 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1729 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:59:36.749873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e6c8dc2-36fe-4093-8b99-d9d9acbb0f18 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:36.751659 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e6c8dc2-36fe-4093-8b99-d9d9acbb0f18 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:36.757127 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e6c8dc2-36fe-4093-8b99-d9d9acbb0f18 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:36.884828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e6c8dc2-36fe-4093-8b99-d9d9acbb0f18 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:36.886994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7e6c8dc2-36fe-4093-8b99-d9d9acbb0f18 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:36.888678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-7e6c8dc2-36fe-4093-8b99-d9d9acbb0f18 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lazy-loading 'fault' on Instance uuid 7e166ac4-ba20-4db0-a559-cdaf0a031790 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 22:59:37.115590 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7e6c8dc2-36fe-4093-8b99-d9d9acbb0f18 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:37.135439 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7e6c8dc2-36fe-4093-8b99-d9d9acbb0f18 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 200 len: 1357 microversion: 2.1 time: 0.462497 Jul 19 22:59:37.146585 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2720/5447] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:59:36 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 1357 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 22:59:37.759722 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8541b655-38c1-4ea0-8f2d-448d92d74ea0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:37.760380 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8541b655-38c1-4ea0-8f2d-448d92d74ea0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:37.778944 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8541b655-38c1-4ea0-8f2d-448d92d74ea0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:37.788458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8541b655-38c1-4ea0-8f2d-448d92d74ea0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:37.792923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8541b655-38c1-4ea0-8f2d-448d92d74ea0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:37.793616 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8541b655-38c1-4ea0-8f2d-448d92d74ea0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:38.164409 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ab1f066e-f19b-437e-b6f2-feff26cdd98c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:38.165543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ab1f066e-f19b-437e-b6f2-feff26cdd98c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 7e166ac4-ba20-4db0-a559-cdaf0a031790] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:38.177482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab1f066e-f19b-437e-b6f2-feff26cdd98c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:38.182811 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab1f066e-f19b-437e-b6f2-feff26cdd98c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:38.200422 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab1f066e-f19b-437e-b6f2-feff26cdd98c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:38.202113 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab1f066e-f19b-437e-b6f2-feff26cdd98c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:38.252515 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-ab1f066e-f19b-437e-b6f2-feff26cdd98c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] HTTP exception thrown: Instance 7e166ac4-ba20-4db0-a559-cdaf0a031790 could not be found. Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ab1f066e-f19b-437e-b6f2-feff26cdd98c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Request method failure captured: Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 HTTP/1.1 Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zUdF3dTnB0MnLNSU90xG3Mpx7x6_lVTVWk_kalEUBRonF6TVdUymuHFpNlc_2myDjPcJPfG0PGHn_BgqvSGWVp3Gv6a0lkSSx5re0O2646fcLC_MOcllI85X5Gsa3U5ByfiHlS7DUHyk3xHJ5Y4v938fzhiDGHEEqMMUHs8ls1DEl4 Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 4b56c5370d5846f8a8c1535c127c0e12 Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1194986010 Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b56c5370d5846f8a8c1535c127c0e12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b56c5370d5846f8a8c1535c127c0e12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b56c5370d5846f8a8c1535c127c0e12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b56c5370d5846f8a8c1535c127c0e12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1194986010 Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 4b56c5370d5846f8a8c1535c127c0e12 Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1194986010 Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TestNetworkAdvancedServerOps-1194986010-project Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: dcfdbbdf932b43b38725f60dadc738c9 Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1194986010-project Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 7e166ac4-ba20-4db0-a559-cdaf0a031790 could not be found. Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '7e166ac4-ba20-4db0-a559-cdaf0a031790'} Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e166ac4-ba20-4db0-a559-cdaf0a031790 could not be found. Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e166ac4-ba20-4db0-a559-cdaf0a031790 could not be found. Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:59:38.261786 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 22:59:38.266808 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:59:38.266808 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 22:59:38.266808 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 22:59:38.266808 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 22:59:38.266808 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 22:59:38.266808 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 22:59:38.266808 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e166ac4-ba20-4db0-a559-cdaf0a031790 could not be found. Jul 19 22:59:38.266808 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 22:59:38.266808 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ab1f066e-f19b-437e-b6f2-feff26cdd98c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Returning 404 to user: Instance 7e166ac4-ba20-4db0-a559-cdaf0a031790 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 22:59:38.270093 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ab1f066e-f19b-437e-b6f2-feff26cdd98c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790" status: 404 len: 111 microversion: 2.1 time: 0.108005 Jul 19 22:59:38.275094 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2721/5448] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 22:59:38 2022] GET /compute/v2.1/servers/7e166ac4-ba20-4db0-a559-cdaf0a031790 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 22:59:39.813024 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8541b655-38c1-4ea0-8f2d-448d92d74ea0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:39.852413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8541b655-38c1-4ea0-8f2d-448d92d74ea0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:39.861358 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8541b655-38c1-4ea0-8f2d-448d92d74ea0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:39.867040 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8541b655-38c1-4ea0-8f2d-448d92d74ea0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1729 microversion: 2.20 time: 2.111992 Jul 19 22:59:39.872891 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2728/5449] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:59:37 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1729 bytes in 2120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:59:40.894193 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-35db606d-cffb-485e-a670-3668e697671e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:40.895680 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-35db606d-cffb-485e-a670-3668e697671e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:40.929132 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35db606d-cffb-485e-a670-3668e697671e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:40.933519 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35db606d-cffb-485e-a670-3668e697671e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:40.938513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35db606d-cffb-485e-a670-3668e697671e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:40.940078 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35db606d-cffb-485e-a670-3668e697671e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:43.208813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-35db606d-cffb-485e-a670-3668e697671e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:43.220482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-35db606d-cffb-485e-a670-3668e697671e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:43.235624 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-35db606d-cffb-485e-a670-3668e697671e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:43.241756 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-35db606d-cffb-485e-a670-3668e697671e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1729 microversion: 2.20 time: 2.352875 Jul 19 22:59:43.249791 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2722/5450] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:59:40 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1729 bytes in 2366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:59:43.619152 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1a78b843-cb67-4a9b-b251-5fa8eaff2682 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] Calling method '.version_select at 0x7f7a03e7c700>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:43.658456 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1a78b843-cb67-4a9b-b251-5fa8eaff2682 tempest-TestSecurityGroupsBasicOps-632400044 tempest-TestSecurityGroupsBasicOps-632400044-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-198859728" status: 202 len: 0 microversion: 2.1 time: 0.099088 Jul 19 22:59:43.661849 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2729/5451] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 19 22:59:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-198859728 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 22:59:44.271275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-41acc526-ab41-49a2-bc2a-215275ca748e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:44.272042 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-41acc526-ab41-49a2-bc2a-215275ca748e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:44.293877 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-41acc526-ab41-49a2-bc2a-215275ca748e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:44.300838 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-41acc526-ab41-49a2-bc2a-215275ca748e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:44.307931 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-41acc526-ab41-49a2-bc2a-215275ca748e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:44.309239 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-e4f53656-62a8-4578-9b7e-7cd0983f3c9c req-e9c0665f-fcf2-4df3-93d9-a580d28476af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0", "tag": "f0538c77-95fe-460e-98c5-1e6a3dad7e95"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 22:59:44.310357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-41acc526-ab41-49a2-bc2a-215275ca748e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:44.335943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e4f53656-62a8-4578-9b7e-7cd0983f3c9c req-e9c0665f-fcf2-4df3-93d9-a580d28476af service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:44.339354 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e4f53656-62a8-4578-9b7e-7cd0983f3c9c req-e9c0665f-fcf2-4df3-93d9-a580d28476af service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:44.398145 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-e4f53656-62a8-4578-9b7e-7cd0983f3c9c req-e9c0665f-fcf2-4df3-93d9-a580d28476af service nova] Creating event network-changed:f0538c77-95fe-460e-98c5-1e6a3dad7e95 for instance e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 on n-h1-847009-3 Jul 19 22:59:44.432415 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-e4f53656-62a8-4578-9b7e-7cd0983f3c9c req-e9c0665f-fcf2-4df3-93d9-a580d28476af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124336 Jul 19 22:59:44.435436 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2730/5452] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 22:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 22:59:45.922506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-41acc526-ab41-49a2-bc2a-215275ca748e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:45.944866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-41acc526-ab41-49a2-bc2a-215275ca748e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:45.958892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-41acc526-ab41-49a2-bc2a-215275ca748e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:45.960500 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-41acc526-ab41-49a2-bc2a-215275ca748e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1729 microversion: 2.20 time: 1.694032 Jul 19 22:59:45.969207 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2723/5453] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:59:44 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1729 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:59:47.030470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6d94a9b3-aedb-45aa-96f1-6585c684ac8d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:47.035874 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6d94a9b3-aedb-45aa-96f1-6585c684ac8d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:47.086222 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d94a9b3-aedb-45aa-96f1-6585c684ac8d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:47.087652 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d94a9b3-aedb-45aa-96f1-6585c684ac8d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:47.089541 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d94a9b3-aedb-45aa-96f1-6585c684ac8d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:47.090255 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d94a9b3-aedb-45aa-96f1-6585c684ac8d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:48.031622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6d94a9b3-aedb-45aa-96f1-6585c684ac8d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:48.054321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6d94a9b3-aedb-45aa-96f1-6585c684ac8d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:48.058491 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6d94a9b3-aedb-45aa-96f1-6585c684ac8d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:48.060831 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6d94a9b3-aedb-45aa-96f1-6585c684ac8d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1729 microversion: 2.20 time: 1.059552 Jul 19 22:59:48.073814 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2731/5454] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:59:46 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1729 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:59:49.079979 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-94fb57cc-73c8-4e62-9045-70521c9864f8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:49.080680 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-94fb57cc-73c8-4e62-9045-70521c9864f8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:49.097789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-94fb57cc-73c8-4e62-9045-70521c9864f8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:49.099753 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-94fb57cc-73c8-4e62-9045-70521c9864f8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:49.100622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-94fb57cc-73c8-4e62-9045-70521c9864f8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:49.101074 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-94fb57cc-73c8-4e62-9045-70521c9864f8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:49.858751 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-94fb57cc-73c8-4e62-9045-70521c9864f8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:49.885435 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-94fb57cc-73c8-4e62-9045-70521c9864f8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:49.887507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-94fb57cc-73c8-4e62-9045-70521c9864f8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:49.898645 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-94fb57cc-73c8-4e62-9045-70521c9864f8 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1729 microversion: 2.20 time: 0.819785 Jul 19 22:59:49.915325 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2724/5455] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:59:49 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1729 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:59:50.921562 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-45a5ff12-67c1-44ad-b7fa-66e5388e0610 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:50.922198 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-45a5ff12-67c1-44ad-b7fa-66e5388e0610 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:50.944443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45a5ff12-67c1-44ad-b7fa-66e5388e0610 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:50.944913 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45a5ff12-67c1-44ad-b7fa-66e5388e0610 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:50.965055 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45a5ff12-67c1-44ad-b7fa-66e5388e0610 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:50.967415 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45a5ff12-67c1-44ad-b7fa-66e5388e0610 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:52.013101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-45a5ff12-67c1-44ad-b7fa-66e5388e0610 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:52.042423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-45a5ff12-67c1-44ad-b7fa-66e5388e0610 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:52.049336 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-45a5ff12-67c1-44ad-b7fa-66e5388e0610 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:52.058646 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-45a5ff12-67c1-44ad-b7fa-66e5388e0610 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1729 microversion: 2.20 time: 1.138910 Jul 19 22:59:52.062287 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2732/5456] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:59:50 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1729 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:59:53.078257 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2b61b918-e375-46c0-bbe8-405fb647cfb0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:53.078885 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2b61b918-e375-46c0-bbe8-405fb647cfb0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:53.094312 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b61b918-e375-46c0-bbe8-405fb647cfb0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:53.095411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b61b918-e375-46c0-bbe8-405fb647cfb0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:53.096230 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b61b918-e375-46c0-bbe8-405fb647cfb0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:53.112201 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b61b918-e375-46c0-bbe8-405fb647cfb0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:54.394743 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2b61b918-e375-46c0-bbe8-405fb647cfb0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:54.418199 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2b61b918-e375-46c0-bbe8-405fb647cfb0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:54.426592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2b61b918-e375-46c0-bbe8-405fb647cfb0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:54.432017 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2b61b918-e375-46c0-bbe8-405fb647cfb0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1729 microversion: 2.20 time: 1.358106 Jul 19 22:59:54.441589 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2725/5457] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:59:53 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1729 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:59:55.459633 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-59e7cc16-20d6-4fda-b0c7-9dbef020bc2e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:55.464117 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-59e7cc16-20d6-4fda-b0c7-9dbef020bc2e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:55.487003 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-59e7cc16-20d6-4fda-b0c7-9dbef020bc2e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:55.487725 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-59e7cc16-20d6-4fda-b0c7-9dbef020bc2e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:55.488732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-59e7cc16-20d6-4fda-b0c7-9dbef020bc2e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:55.489339 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-59e7cc16-20d6-4fda-b0c7-9dbef020bc2e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:56.069052 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-59e7cc16-20d6-4fda-b0c7-9dbef020bc2e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:56.094509 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-59e7cc16-20d6-4fda-b0c7-9dbef020bc2e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:56.098353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-59e7cc16-20d6-4fda-b0c7-9dbef020bc2e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:56.107265 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-59e7cc16-20d6-4fda-b0c7-9dbef020bc2e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1729 microversion: 2.20 time: 0.651481 Jul 19 22:59:56.120532 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2733/5458] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:59:55 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1729 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:59:57.127037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-90638cb4-3043-4cd2-ba45-cec8208494fe tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:57.128531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-90638cb4-3043-4cd2-ba45-cec8208494fe tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:57.141736 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-90638cb4-3043-4cd2-ba45-cec8208494fe tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:57.145886 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-90638cb4-3043-4cd2-ba45-cec8208494fe tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:57.149072 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-90638cb4-3043-4cd2-ba45-cec8208494fe tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:57.159922 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-90638cb4-3043-4cd2-ba45-cec8208494fe tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:58.497753 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-90638cb4-3043-4cd2-ba45-cec8208494fe tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:58.508280 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-90638cb4-3043-4cd2-ba45-cec8208494fe tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:58.520432 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-90638cb4-3043-4cd2-ba45-cec8208494fe tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 22:59:58.522114 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-90638cb4-3043-4cd2-ba45-cec8208494fe tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1729 microversion: 2.20 time: 1.399888 Jul 19 22:59:58.531374 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2726/5459] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:59:57 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1729 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 22:59:59.549723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-94f69325-b76c-4a92-a713-ef2899e28163 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 22:59:59.551119 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-94f69325-b76c-4a92-a713-ef2899e28163 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 22:59:59.575636 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-94f69325-b76c-4a92-a713-ef2899e28163 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:59.590159 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-94f69325-b76c-4a92-a713-ef2899e28163 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:59.593159 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-94f69325-b76c-4a92-a713-ef2899e28163 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 22:59:59.593720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-94f69325-b76c-4a92-a713-ef2899e28163 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 22:59:59.643166 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:00:00.896163 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-94f69325-b76c-4a92-a713-ef2899e28163 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:00.912576 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-94f69325-b76c-4a92-a713-ef2899e28163 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:00.917454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-94f69325-b76c-4a92-a713-ef2899e28163 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:00.922840 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-94f69325-b76c-4a92-a713-ef2899e28163 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1729 microversion: 2.20 time: 1.377509 Jul 19 23:00:00.937525 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2734/5460] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 22:59:59 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1729 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 23:00:01.946841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-82e479d7-36b2-4e73-ac48-b01f4965ec45 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:01.948149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-82e479d7-36b2-4e73-ac48-b01f4965ec45 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:01.965087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-82e479d7-36b2-4e73-ac48-b01f4965ec45 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:01.969031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-82e479d7-36b2-4e73-ac48-b01f4965ec45 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:01.970172 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-82e479d7-36b2-4e73-ac48-b01f4965ec45 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:01.971681 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-82e479d7-36b2-4e73-ac48-b01f4965ec45 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:03.603226 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-82e479d7-36b2-4e73-ac48-b01f4965ec45 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:03.614806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-82e479d7-36b2-4e73-ac48-b01f4965ec45 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:03.622196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a8abcc6a-87c6-4e76-800e-79f23ecfeddf tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '.version_select at 0x7f7a03fdc430>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:03.624137 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-82e479d7-36b2-4e73-ac48-b01f4965ec45 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:03.625534 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-82e479d7-36b2-4e73-ac48-b01f4965ec45 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1729 microversion: 2.20 time: 1.683659 Jul 19 23:00:03.637168 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2727/5461] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 23:00:01 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1729 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 23:00:03.652129 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:00:03.684160 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a8abcc6a-87c6-4e76-800e-79f23ecfeddf tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1189313167" status: 202 len: 0 microversion: 2.1 time: 0.065928 Jul 19 23:00:03.685422 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2735/5462] 10.222.0.25 () {58 vars in 1283 bytes} [Tue Jul 19 23:00:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1189313167 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:00:03.730285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3c3be31b-745f-42f4-b79e-97eb282ef1d9 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Action: 'create', calling method: .version_select at 0x7f7a03131430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-382381649", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVhrCJ6y9gUiFSt1yrb4ALcqrpBy+t6XIThHzIt7RcYePONwBCFSwYoPJHWztp5lTxROkUId4Ev7SI9S1a4C7LROq32E6xKWfi6K+A9LZxmyvXlQYocNNDRj7a/ivPy7A=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:00:03.763375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:00:03.813410 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-3c3be31b-745f-42f4-b79e-97eb282ef1d9 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Getting quotas for project 4b56c5370d5846f8a8c1535c127c0e12. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:00:03.831471 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-3c3be31b-745f-42f4-b79e-97eb282ef1d9 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Getting quotas for user dcfdbbdf932b43b38725f60dadc738c9 and project 4b56c5370d5846f8a8c1535c127c0e12. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:00:03.911368 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3c3be31b-745f-42f4-b79e-97eb282ef1d9 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.185901 Jul 19 23:00:03.913047 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2728/5463] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 23:00:03 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:00:04.645619 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-106f6494-eff3-49bf-90c8-c78c387c55d9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:04.646444 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-106f6494-eff3-49bf-90c8-c78c387c55d9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:04.663523 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-106f6494-eff3-49bf-90c8-c78c387c55d9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:04.668452 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-106f6494-eff3-49bf-90c8-c78c387c55d9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:04.669678 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-106f6494-eff3-49bf-90c8-c78c387c55d9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:04.672885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-106f6494-eff3-49bf-90c8-c78c387c55d9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:05.400659 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-106f6494-eff3-49bf-90c8-c78c387c55d9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:05.444622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-106f6494-eff3-49bf-90c8-c78c387c55d9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:05.449109 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-106f6494-eff3-49bf-90c8-c78c387c55d9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:05.450361 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-106f6494-eff3-49bf-90c8-c78c387c55d9 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1729 microversion: 2.20 time: 0.809342 Jul 19 23:00:05.462981 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2736/5464] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 23:00:04 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1729 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 23:00:06.478710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3e6570b8-b4d8-4a1c-8f24-0a7fbca48b1a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:06.480030 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3e6570b8-b4d8-4a1c-8f24-0a7fbca48b1a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:06.497265 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e6570b8-b4d8-4a1c-8f24-0a7fbca48b1a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:06.497729 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e6570b8-b4d8-4a1c-8f24-0a7fbca48b1a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:06.504074 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e6570b8-b4d8-4a1c-8f24-0a7fbca48b1a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:06.505882 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e6570b8-b4d8-4a1c-8f24-0a7fbca48b1a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:06.519852 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=52 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:00:06.928294 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3e6570b8-b4d8-4a1c-8f24-0a7fbca48b1a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:06.948339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3e6570b8-b4d8-4a1c-8f24-0a7fbca48b1a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:06.950352 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3e6570b8-b4d8-4a1c-8f24-0a7fbca48b1a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:06.951841 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3e6570b8-b4d8-4a1c-8f24-0a7fbca48b1a tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1729 microversion: 2.20 time: 0.484716 Jul 19 23:00:06.952488 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2729/5465] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 23:00:06 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1729 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 23:00:07.972622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9ec12612-a1cf-49db-9228-e87240dcb76e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:07.973391 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9ec12612-a1cf-49db-9228-e87240dcb76e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:07.988797 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ec12612-a1cf-49db-9228-e87240dcb76e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:07.989755 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ec12612-a1cf-49db-9228-e87240dcb76e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:07.991172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ec12612-a1cf-49db-9228-e87240dcb76e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:07.992440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ec12612-a1cf-49db-9228-e87240dcb76e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:08.526125 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9ec12612-a1cf-49db-9228-e87240dcb76e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:08.563972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9ec12612-a1cf-49db-9228-e87240dcb76e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:08.568295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9ec12612-a1cf-49db-9228-e87240dcb76e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:08.570322 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9ec12612-a1cf-49db-9228-e87240dcb76e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1729 microversion: 2.20 time: 0.603379 Jul 19 23:00:08.571783 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2737/5466] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 23:00:07 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1729 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 23:00:09.596095 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d1060b31-7127-4038-a464-72d7d1f77040 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:09.597294 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d1060b31-7127-4038-a464-72d7d1f77040 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:09.613922 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d1060b31-7127-4038-a464-72d7d1f77040 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:09.617251 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d1060b31-7127-4038-a464-72d7d1f77040 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:09.618914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d1060b31-7127-4038-a464-72d7d1f77040 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:09.619481 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d1060b31-7127-4038-a464-72d7d1f77040 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:10.773889 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d1060b31-7127-4038-a464-72d7d1f77040 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:10.787874 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d1060b31-7127-4038-a464-72d7d1f77040 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:10.789821 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d1060b31-7127-4038-a464-72d7d1f77040 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:10.795131 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d1060b31-7127-4038-a464-72d7d1f77040 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1729 microversion: 2.20 time: 1.209375 Jul 19 23:00:10.799197 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2730/5467] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 23:00:09 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1729 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 23:00:11.228449 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-da9a66b1-dc99-453c-80e1-7d80879203f4 req-15bb15a3-2b17-4002-be21-a1a1f75e9449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0", "name": "network-vif-plugged", "status": "completed", "tag": "f0538c77-95fe-460e-98c5-1e6a3dad7e95"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:00:11.250230 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-da9a66b1-dc99-453c-80e1-7d80879203f4 req-15bb15a3-2b17-4002-be21-a1a1f75e9449 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:11.250695 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-da9a66b1-dc99-453c-80e1-7d80879203f4 req-15bb15a3-2b17-4002-be21-a1a1f75e9449 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:11.269506 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-da9a66b1-dc99-453c-80e1-7d80879203f4 req-15bb15a3-2b17-4002-be21-a1a1f75e9449 service nova] Creating event network-vif-plugged:f0538c77-95fe-460e-98c5-1e6a3dad7e95 for instance e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 on n-h1-847009-3 Jul 19 23:00:11.276128 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-da9a66b1-dc99-453c-80e1-7d80879203f4 req-15bb15a3-2b17-4002-be21-a1a1f75e9449 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051142 Jul 19 23:00:11.278630 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2738/5468] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:00:11.816181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-807b38ff-b449-4ec6-9c64-97835c956aa2 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:11.817375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-807b38ff-b449-4ec6-9c64-97835c956aa2 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:11.837277 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-807b38ff-b449-4ec6-9c64-97835c956aa2 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:11.837992 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-807b38ff-b449-4ec6-9c64-97835c956aa2 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:11.838987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-807b38ff-b449-4ec6-9c64-97835c956aa2 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:11.839626 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-807b38ff-b449-4ec6-9c64-97835c956aa2 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:12.179623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-807b38ff-b449-4ec6-9c64-97835c956aa2 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:12.201504 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-807b38ff-b449-4ec6-9c64-97835c956aa2 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:12.204172 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-807b38ff-b449-4ec6-9c64-97835c956aa2 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:12.208674 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-807b38ff-b449-4ec6-9c64-97835c956aa2 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1729 microversion: 2.20 time: 0.396801 Jul 19 23:00:12.210265 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2731/5469] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 23:00:11 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1729 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 23:00:13.231031 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1b6abffc-a377-4a9a-862e-88f49ca9235e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:13.231944 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1b6abffc-a377-4a9a-862e-88f49ca9235e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:13.258316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b6abffc-a377-4a9a-862e-88f49ca9235e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:13.258819 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b6abffc-a377-4a9a-862e-88f49ca9235e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:13.260051 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b6abffc-a377-4a9a-862e-88f49ca9235e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:13.260653 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b6abffc-a377-4a9a-862e-88f49ca9235e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:14.169736 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1b6abffc-a377-4a9a-862e-88f49ca9235e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:14.210142 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1b6abffc-a377-4a9a-862e-88f49ca9235e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:14.215798 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1b6abffc-a377-4a9a-862e-88f49ca9235e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:14.217907 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1b6abffc-a377-4a9a-862e-88f49ca9235e tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1729 microversion: 2.20 time: 0.990849 Jul 19 23:00:14.225685 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2739/5470] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 23:00:13 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1729 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 23:00:15.239932 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f70d27db-d2eb-49ed-a155-d493271bffd0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:15.241647 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f70d27db-d2eb-49ed-a155-d493271bffd0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:15.269530 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:00:15.271969 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f70d27db-d2eb-49ed-a155-d493271bffd0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:15.272739 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f70d27db-d2eb-49ed-a155-d493271bffd0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:15.273880 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f70d27db-d2eb-49ed-a155-d493271bffd0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:15.274548 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f70d27db-d2eb-49ed-a155-d493271bffd0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:16.445521 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f70d27db-d2eb-49ed-a155-d493271bffd0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:16.467663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f70d27db-d2eb-49ed-a155-d493271bffd0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:16.470219 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f70d27db-d2eb-49ed-a155-d493271bffd0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:16.476225 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f70d27db-d2eb-49ed-a155-d493271bffd0 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1716 microversion: 2.20 time: 1.240381 Jul 19 23:00:16.480255 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2732/5471] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 23:00:15 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1716 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 23:00:31.495222 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e89acaf6-b749-4a6e-b14f-4ede2eea4720 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2004789704", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "6846163a-7698-4d2e-a0af-b9e13733b3cc"}], "key_name": "tempest-TestNetworkAdvancedServerOps-382381649", "security_groups": [{"name": "tempest-secgroup-smoke-868892084"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:00:31.537811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:00:31.541887 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=23 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:00:31.972430 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-e89acaf6-b749-4a6e-b14f-4ede2eea4720 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] validate_networks() for [('6846163a-7698-4d2e-a0af-b9e13733b3cc', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:00:36.006116 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-e89acaf6-b749-4a6e-b14f-4ede2eea4720 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:00:36.007495 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-e89acaf6-b749-4a6e-b14f-4ede2eea4720 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:00:36.009027 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-e89acaf6-b749-4a6e-b14f-4ede2eea4720 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:00:36.009630 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-e89acaf6-b749-4a6e-b14f-4ede2eea4720 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:00:36.010231 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-e89acaf6-b749-4a6e-b14f-4ede2eea4720 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:00:36.036215 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e89acaf6-b749-4a6e-b14f-4ede2eea4720 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:36.040527 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e89acaf6-b749-4a6e-b14f-4ede2eea4720 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:36.043101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e89acaf6-b749-4a6e-b14f-4ede2eea4720 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:36.049501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e89acaf6-b749-4a6e-b14f-4ede2eea4720 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:36.118533 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-e89acaf6-b749-4a6e-b14f-4ede2eea4720 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Getting quotas for project 4b56c5370d5846f8a8c1535c127c0e12. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:00:36.139778 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-e89acaf6-b749-4a6e-b14f-4ede2eea4720 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Getting quotas for user dcfdbbdf932b43b38725f60dadc738c9 and project 4b56c5370d5846f8a8c1535c127c0e12. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:00:36.193709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e89acaf6-b749-4a6e-b14f-4ede2eea4720 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:00:36.197637 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e89acaf6-b749-4a6e-b14f-4ede2eea4720 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:00:36.319255 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e89acaf6-b749-4a6e-b14f-4ede2eea4720 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 4.829605 Jul 19 23:00:36.328993 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2740/5472] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:00:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 4840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:00:36.343005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9d77834f-a1bc-4ace-95df-14746730268a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:36.344011 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9d77834f-a1bc-4ace-95df-14746730268a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:36.350514 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:00:36.351360 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=23 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:00:36.519073 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9d77834f-a1bc-4ace-95df-14746730268a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:36.539616 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9d77834f-a1bc-4ace-95df-14746730268a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1266 microversion: 2.1 time: 0.203317 Jul 19 23:00:36.541370 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2733/5473] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:00:36 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:00:37.561366 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-777ff815-3320-4d44-8bc3-c47a8390f451 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:37.562033 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-777ff815-3320-4d44-8bc3-c47a8390f451 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:37.587765 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-777ff815-3320-4d44-8bc3-c47a8390f451 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:37.588558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-777ff815-3320-4d44-8bc3-c47a8390f451 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:37.589557 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-777ff815-3320-4d44-8bc3-c47a8390f451 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:37.590174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-777ff815-3320-4d44-8bc3-c47a8390f451 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:37.844860 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-777ff815-3320-4d44-8bc3-c47a8390f451 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:37.857342 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-777ff815-3320-4d44-8bc3-c47a8390f451 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1262 microversion: 2.1 time: 0.300066 Jul 19 23:00:37.876305 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2741/5474] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:00:37 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1262 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:00:38.880855 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d3b40343-0daf-4f23-9c12-245dedf4e0af tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:38.882383 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d3b40343-0daf-4f23-9c12-245dedf4e0af tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:38.897195 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3b40343-0daf-4f23-9c12-245dedf4e0af tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:38.897984 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3b40343-0daf-4f23-9c12-245dedf4e0af tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:38.899865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3b40343-0daf-4f23-9c12-245dedf4e0af tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:38.900728 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3b40343-0daf-4f23-9c12-245dedf4e0af tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:39.191402 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d3b40343-0daf-4f23-9c12-245dedf4e0af tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:39.285395 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d3b40343-0daf-4f23-9c12-245dedf4e0af tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1324 microversion: 2.1 time: 0.409694 Jul 19 23:00:39.286659 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2734/5475] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:00:38 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1324 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:00:40.304181 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c9ebaf69-13f1-4f7c-85cc-01e4b5fb0a15 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:40.305251 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c9ebaf69-13f1-4f7c-85cc-01e4b5fb0a15 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:40.322701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c9ebaf69-13f1-4f7c-85cc-01e4b5fb0a15 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:40.323590 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c9ebaf69-13f1-4f7c-85cc-01e4b5fb0a15 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:40.324829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c9ebaf69-13f1-4f7c-85cc-01e4b5fb0a15 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:40.326145 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c9ebaf69-13f1-4f7c-85cc-01e4b5fb0a15 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:41.615891 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c9ebaf69-13f1-4f7c-85cc-01e4b5fb0a15 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:41.630185 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c9ebaf69-13f1-4f7c-85cc-01e4b5fb0a15 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1391 microversion: 2.1 time: 1.330802 Jul 19 23:00:41.640509 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2742/5476] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:00:40 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1391 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:00:42.648704 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-32427e17-799b-4370-a7ac-ca68a172d73b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:42.651686 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-32427e17-799b-4370-a7ac-ca68a172d73b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:42.660491 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-32427e17-799b-4370-a7ac-ca68a172d73b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:42.662065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-32427e17-799b-4370-a7ac-ca68a172d73b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:42.663445 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-32427e17-799b-4370-a7ac-ca68a172d73b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:42.664137 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-32427e17-799b-4370-a7ac-ca68a172d73b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:43.079555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-32427e17-799b-4370-a7ac-ca68a172d73b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:43.089620 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-32427e17-799b-4370-a7ac-ca68a172d73b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1391 microversion: 2.1 time: 0.445367 Jul 19 23:00:43.093622 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2735/5477] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:00:42 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1391 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:00:44.114450 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e225f8a5-51c8-4161-b07f-23f8c1623d74 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:44.115102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e225f8a5-51c8-4161-b07f-23f8c1623d74 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:44.138610 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e225f8a5-51c8-4161-b07f-23f8c1623d74 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:44.139152 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e225f8a5-51c8-4161-b07f-23f8c1623d74 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:44.145403 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e225f8a5-51c8-4161-b07f-23f8c1623d74 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:44.147433 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e225f8a5-51c8-4161-b07f-23f8c1623d74 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:44.640830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e225f8a5-51c8-4161-b07f-23f8c1623d74 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:44.654369 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e225f8a5-51c8-4161-b07f-23f8c1623d74 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1391 microversion: 2.1 time: 0.547971 Jul 19 23:00:44.656416 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2743/5478] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:00:44 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1391 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:00:44.958024 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-2f81a694-c3a4-4450-b844-6a10982447a0 req-88cf1a01-dfe5-43ed-8c74-345e35af2a33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39263746-004a-4127-ab95-8066c7424b88", "tag": "ba51c9f8-79c0-4e2f-ac91-5186661aa91b"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:00:44.983260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-2f81a694-c3a4-4450-b844-6a10982447a0 req-88cf1a01-dfe5-43ed-8c74-345e35af2a33 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:44.988805 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-2f81a694-c3a4-4450-b844-6a10982447a0 req-88cf1a01-dfe5-43ed-8c74-345e35af2a33 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:45.029279 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-2f81a694-c3a4-4450-b844-6a10982447a0 req-88cf1a01-dfe5-43ed-8c74-345e35af2a33 service nova] Creating event network-changed:ba51c9f8-79c0-4e2f-ac91-5186661aa91b for instance 39263746-004a-4127-ab95-8066c7424b88 on n-h2-847009-3 Jul 19 23:00:45.052286 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-2f81a694-c3a4-4450-b844-6a10982447a0 req-88cf1a01-dfe5-43ed-8c74-345e35af2a33 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097896 Jul 19 23:00:45.055984 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2736/5479] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:00:45.675838 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9165da75-3e6c-415e-ad28-7e934574e3b0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:45.677271 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9165da75-3e6c-415e-ad28-7e934574e3b0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:45.702736 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9165da75-3e6c-415e-ad28-7e934574e3b0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:45.705088 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9165da75-3e6c-415e-ad28-7e934574e3b0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:45.710391 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9165da75-3e6c-415e-ad28-7e934574e3b0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:45.710870 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9165da75-3e6c-415e-ad28-7e934574e3b0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:46.085925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:00:46.177075 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:00:46.699885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9165da75-3e6c-415e-ad28-7e934574e3b0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:46.709285 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9165da75-3e6c-415e-ad28-7e934574e3b0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1391 microversion: 2.1 time: 1.040310 Jul 19 23:00:46.715947 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2744/5480] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:00:45 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1391 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:00:47.734187 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-47eaf46f-8cae-4462-a884-cae323461f6a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:47.736589 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-47eaf46f-8cae-4462-a884-cae323461f6a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:47.753972 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:00:47.770651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-47eaf46f-8cae-4462-a884-cae323461f6a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:47.772079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-47eaf46f-8cae-4462-a884-cae323461f6a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:47.773380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-47eaf46f-8cae-4462-a884-cae323461f6a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:47.778227 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-47eaf46f-8cae-4462-a884-cae323461f6a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:48.249836 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-47eaf46f-8cae-4462-a884-cae323461f6a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:48.295936 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-47eaf46f-8cae-4462-a884-cae323461f6a tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1391 microversion: 2.1 time: 0.566434 Jul 19 23:00:48.307217 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2737/5481] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:00:47 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1391 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:00:49.321136 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-001b7ea3-7c81-4919-bf37-a54b96582ce7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:49.322583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-001b7ea3-7c81-4919-bf37-a54b96582ce7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:49.337426 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-001b7ea3-7c81-4919-bf37-a54b96582ce7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:49.345549 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-001b7ea3-7c81-4919-bf37-a54b96582ce7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:49.346788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-001b7ea3-7c81-4919-bf37-a54b96582ce7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:49.347622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-001b7ea3-7c81-4919-bf37-a54b96582ce7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:49.620244 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c6dbf705-4533-486c-824c-519f1a108711 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:49.621181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c6dbf705-4533-486c-824c-519f1a108711 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:49.660148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6dbf705-4533-486c-824c-519f1a108711 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:49.660663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6dbf705-4533-486c-824c-519f1a108711 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:49.661496 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6dbf705-4533-486c-824c-519f1a108711 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:49.662080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6dbf705-4533-486c-824c-519f1a108711 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:49.765969 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c6dbf705-4533-486c-824c-519f1a108711 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.151883 Jul 19 23:00:49.767315 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2738/5482] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 19 23:00:49 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0/os-volume_attachments => generated 25 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:00:49.892837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e2c6eaeb-2030-4337-b426-0b9abbbf1528 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:49.895365 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e2c6eaeb-2030-4337-b426-0b9abbbf1528 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:49.921470 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2c6eaeb-2030-4337-b426-0b9abbbf1528 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:49.923988 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2c6eaeb-2030-4337-b426-0b9abbbf1528 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:49.931649 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2c6eaeb-2030-4337-b426-0b9abbbf1528 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:49.932527 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2c6eaeb-2030-4337-b426-0b9abbbf1528 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:49.985029 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e2c6eaeb-2030-4337-b426-0b9abbbf1528 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:00:49.990205 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-001b7ea3-7c81-4919-bf37-a54b96582ce7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:50.018466 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-001b7ea3-7c81-4919-bf37-a54b96582ce7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1391 microversion: 2.1 time: 0.693661 Jul 19 23:00:50.020490 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2745/5483] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:00:49 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1391 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:00:50.141731 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e2c6eaeb-2030-4337-b426-0b9abbbf1528 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 204 len: 0 microversion: 2.20 time: 0.255666 Jul 19 23:00:50.147751 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2739/5484] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 23:00:49 2022] DELETE /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 23:00:50.156559 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-72b5efa5-add8-4f01-918b-1ef2395c9ecf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:50.157703 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-72b5efa5-add8-4f01-918b-1ef2395c9ecf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:50.173320 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-72b5efa5-add8-4f01-918b-1ef2395c9ecf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:50.174218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-72b5efa5-add8-4f01-918b-1ef2395c9ecf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:50.175306 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-72b5efa5-add8-4f01-918b-1ef2395c9ecf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:50.176676 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-72b5efa5-add8-4f01-918b-1ef2395c9ecf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:50.564099 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-72b5efa5-add8-4f01-918b-1ef2395c9ecf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:50.578829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-72b5efa5-add8-4f01-918b-1ef2395c9ecf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:50.583395 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-72b5efa5-add8-4f01-918b-1ef2395c9ecf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:50.590285 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-72b5efa5-add8-4f01-918b-1ef2395c9ecf tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1722 microversion: 2.20 time: 0.437732 Jul 19 23:00:50.591489 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2746/5485] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 23:00:50 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1722 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 23:00:51.039013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fdb54f01-9ce0-4ec4-b154-0849b842558c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:51.039774 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fdb54f01-9ce0-4ec4-b154-0849b842558c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:51.051913 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fdb54f01-9ce0-4ec4-b154-0849b842558c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:51.056750 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fdb54f01-9ce0-4ec4-b154-0849b842558c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:51.057709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fdb54f01-9ce0-4ec4-b154-0849b842558c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:51.058177 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fdb54f01-9ce0-4ec4-b154-0849b842558c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:51.611158 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a83b7397-0423-487b-9ee5-d15333737800 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:51.612214 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a83b7397-0423-487b-9ee5-d15333737800 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:51.634705 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a83b7397-0423-487b-9ee5-d15333737800 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:51.635947 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a83b7397-0423-487b-9ee5-d15333737800 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:51.638355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a83b7397-0423-487b-9ee5-d15333737800 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:51.641979 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a83b7397-0423-487b-9ee5-d15333737800 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:52.314703 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a83b7397-0423-487b-9ee5-d15333737800 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:52.329110 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a83b7397-0423-487b-9ee5-d15333737800 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:52.332785 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a83b7397-0423-487b-9ee5-d15333737800 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:52.336885 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a83b7397-0423-487b-9ee5-d15333737800 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1722 microversion: 2.20 time: 0.730703 Jul 19 23:00:52.338103 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2747/5486] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 23:00:51 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1722 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 23:00:52.352759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fdb54f01-9ce0-4ec4-b154-0849b842558c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:52.362022 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fdb54f01-9ce0-4ec4-b154-0849b842558c tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1391 microversion: 2.1 time: 1.328092 Jul 19 23:00:52.363514 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2740/5487] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:00:51 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1391 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:00:53.225934 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-edd12b5d-92c5-4227-9d20-daaff0089f02 req-85643f3c-27a8-4fb9-9e20-f2da0ea716bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39263746-004a-4127-ab95-8066c7424b88", "name": "network-vif-plugged", "status": "completed", "tag": "ba51c9f8-79c0-4e2f-ac91-5186661aa91b"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:00:53.239914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-edd12b5d-92c5-4227-9d20-daaff0089f02 req-85643f3c-27a8-4fb9-9e20-f2da0ea716bb service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:53.240616 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-edd12b5d-92c5-4227-9d20-daaff0089f02 req-85643f3c-27a8-4fb9-9e20-f2da0ea716bb service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:53.277042 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-edd12b5d-92c5-4227-9d20-daaff0089f02 req-85643f3c-27a8-4fb9-9e20-f2da0ea716bb service nova] Creating event network-vif-plugged:ba51c9f8-79c0-4e2f-ac91-5186661aa91b for instance 39263746-004a-4127-ab95-8066c7424b88 on n-h2-847009-3 Jul 19 23:00:53.299567 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-edd12b5d-92c5-4227-9d20-daaff0089f02 req-85643f3c-27a8-4fb9-9e20-f2da0ea716bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.319784 Jul 19 23:00:53.299567 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2748/5488] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:00:53.358460 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-32780030-659f-403d-ae53-4caf5ba6ece6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:53.359739 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-32780030-659f-403d-ae53-4caf5ba6ece6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:53.377313 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-32780030-659f-403d-ae53-4caf5ba6ece6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:53.377767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-32780030-659f-403d-ae53-4caf5ba6ece6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:53.378547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-32780030-659f-403d-ae53-4caf5ba6ece6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:53.378990 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-32780030-659f-403d-ae53-4caf5ba6ece6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:53.380512 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4ca575ca-8e56-4410-b3ab-dd9f87474df1 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:53.381450 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4ca575ca-8e56-4410-b3ab-dd9f87474df1 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:53.408862 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ca575ca-8e56-4410-b3ab-dd9f87474df1 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:53.409228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ca575ca-8e56-4410-b3ab-dd9f87474df1 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:53.410346 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ca575ca-8e56-4410-b3ab-dd9f87474df1 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:53.410515 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ca575ca-8e56-4410-b3ab-dd9f87474df1 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:54.323005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-32780030-659f-403d-ae53-4caf5ba6ece6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:54.350576 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-32780030-659f-403d-ae53-4caf5ba6ece6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:54.355496 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-32780030-659f-403d-ae53-4caf5ba6ece6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:54.359465 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-32780030-659f-403d-ae53-4caf5ba6ece6 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1722 microversion: 2.20 time: 1.007347 Jul 19 23:00:54.365235 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2741/5489] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 23:00:53 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1722 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 23:00:54.467191 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4ca575ca-8e56-4410-b3ab-dd9f87474df1 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:54.488777 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4ca575ca-8e56-4410-b3ab-dd9f87474df1 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1391 microversion: 2.1 time: 1.112533 Jul 19 23:00:54.498358 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2749/5490] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:00:53 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1391 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:00:55.384833 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6d1056d2-de05-4491-b538-89619b08e6ae tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:55.386171 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6d1056d2-de05-4491-b538-89619b08e6ae tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:55.401043 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6d1056d2-de05-4491-b538-89619b08e6ae tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:55.401694 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6d1056d2-de05-4491-b538-89619b08e6ae tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:55.408048 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6d1056d2-de05-4491-b538-89619b08e6ae tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:55.408851 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6d1056d2-de05-4491-b538-89619b08e6ae tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:55.515302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6d5e6210-d031-4d9c-ab67-91b6815508b0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:55.515952 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6d5e6210-d031-4d9c-ab67-91b6815508b0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:55.528925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d5e6210-d031-4d9c-ab67-91b6815508b0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:55.531559 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d5e6210-d031-4d9c-ab67-91b6815508b0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:55.532692 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d5e6210-d031-4d9c-ab67-91b6815508b0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:55.533994 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d5e6210-d031-4d9c-ab67-91b6815508b0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:55.612863 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6d1056d2-de05-4491-b538-89619b08e6ae tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:55.631827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6d1056d2-de05-4491-b538-89619b08e6ae tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:55.637229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6d1056d2-de05-4491-b538-89619b08e6ae tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:55.643804 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6d1056d2-de05-4491-b538-89619b08e6ae tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1655 microversion: 2.20 time: 0.261492 Jul 19 23:00:55.645910 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2742/5491] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 23:00:55 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1655 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 23:00:56.663437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4a1fdb97-0208-4ae0-8ce9-48a895cea88c tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:56.664754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4a1fdb97-0208-4ae0-8ce9-48a895cea88c tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:56.680510 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4a1fdb97-0208-4ae0-8ce9-48a895cea88c tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:56.683500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4a1fdb97-0208-4ae0-8ce9-48a895cea88c tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:56.686980 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4a1fdb97-0208-4ae0-8ce9-48a895cea88c tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:56.688132 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4a1fdb97-0208-4ae0-8ce9-48a895cea88c tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:57.113890 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4a1fdb97-0208-4ae0-8ce9-48a895cea88c tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:57.124870 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4a1fdb97-0208-4ae0-8ce9-48a895cea88c tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:57.142976 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4a1fdb97-0208-4ae0-8ce9-48a895cea88c tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f187e783d5247bfb54c5d27bab4f048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f262a7d579e84c07aef4fff8e5eda67e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:57.145981 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4a1fdb97-0208-4ae0-8ce9-48a895cea88c tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 200 len: 1655 microversion: 2.20 time: 0.487290 Jul 19 23:00:57.151452 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2743/5492] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 23:00:56 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 1655 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 23:00:57.177066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-969509d4-2352-43c1-b9ba-06ccc492aaa9 req-76806553-f652-443f-b563-2b9d78f7cfc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0", "name": "network-vif-deleted", "tag": "f0538c77-95fe-460e-98c5-1e6a3dad7e95"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:00:57.203995 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-969509d4-2352-43c1-b9ba-06ccc492aaa9 req-76806553-f652-443f-b563-2b9d78f7cfc8 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:57.207009 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-969509d4-2352-43c1-b9ba-06ccc492aaa9 req-76806553-f652-443f-b563-2b9d78f7cfc8 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:57.236867 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-969509d4-2352-43c1-b9ba-06ccc492aaa9 req-76806553-f652-443f-b563-2b9d78f7cfc8 service nova] Creating event network-vif-deleted:f0538c77-95fe-460e-98c5-1e6a3dad7e95 for instance e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 on n-h1-847009-3 Jul 19 23:00:57.257747 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-969509d4-2352-43c1-b9ba-06ccc492aaa9 req-76806553-f652-443f-b563-2b9d78f7cfc8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102470 Jul 19 23:00:57.259066 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2744/5493] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:00:57.333287 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6d5e6210-d031-4d9c-ab67-91b6815508b0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:57.344245 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6d5e6210-d031-4d9c-ab67-91b6815508b0 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1563 microversion: 2.1 time: 1.834140 Jul 19 23:00:57.346336 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2750/5494] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:00:55 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1563 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:00:57.361599 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f892b6d4-70d1-486c-b049-bf6fa9634d65 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:57.362320 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f892b6d4-70d1-486c-b049-bf6fa9634d65 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:57.374271 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f892b6d4-70d1-486c-b049-bf6fa9634d65 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:57.374727 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f892b6d4-70d1-486c-b049-bf6fa9634d65 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:57.375555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f892b6d4-70d1-486c-b049-bf6fa9634d65 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:57.379957 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f892b6d4-70d1-486c-b049-bf6fa9634d65 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:58.065676 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f892b6d4-70d1-486c-b049-bf6fa9634d65 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:00:58.095540 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f892b6d4-70d1-486c-b049-bf6fa9634d65 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1563 microversion: 2.1 time: 0.730741 Jul 19 23:00:58.096792 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2745/5495] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:00:57 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1563 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:00:58.170451 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1567c8cf-32d3-4ce4-b735-92ece8d76ca1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:58.171757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1567c8cf-32d3-4ce4-b735-92ece8d76ca1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:00:58.187554 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1567c8cf-32d3-4ce4-b735-92ece8d76ca1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:58.187906 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1567c8cf-32d3-4ce4-b735-92ece8d76ca1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:58.188706 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1567c8cf-32d3-4ce4-b735-92ece8d76ca1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:00:58.189149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1567c8cf-32d3-4ce4-b735-92ece8d76ca1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:00:58.255548 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-1567c8cf-32d3-4ce4-b735-92ece8d76ca1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] HTTP exception thrown: Instance e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 could not be found. Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1567c8cf-32d3-4ce4-b735-92ece8d76ca1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Request method failure captured: Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 HTTP/1.1 Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zXBtbqPn8V6iAUvkzjoFYlGkiZVdrfWgYW80cDUoLS8TKNM5sFDjp_kFdLhlvWjdWQChQHkIbPptsdu_mP0Lervre7-NrJ51O0srk-Wi96t_EyZzzU04UK7X2NzZ3DcMU5ocoL_MVHzcM6QZPbmwSRM214dtbxlcibZSjRhvVSs0N8 Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: f262a7d579e84c07aef4fff8e5eda67e Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1720924693 Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f262a7d579e84c07aef4fff8e5eda67e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f262a7d579e84c07aef4fff8e5eda67e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f262a7d579e84c07aef4fff8e5eda67e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f262a7d579e84c07aef4fff8e5eda67e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1720924693 Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: f262a7d579e84c07aef4fff8e5eda67e Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1720924693 Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AttachVolumeShelveTestJSON-1720924693-project Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1f187e783d5247bfb54c5d27bab4f048 Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1720924693-project Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 could not be found. Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0'} Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 could not be found. Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 could not be found. Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:00:58.258485 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:00:58.264747 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:00:58.264747 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:00:58.264747 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:00:58.264747 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:00:58.264747 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:00:58.264747 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:00:58.264747 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 could not be found. Jul 19 23:00:58.264747 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:00:58.264747 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1567c8cf-32d3-4ce4-b735-92ece8d76ca1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Returning 404 to user: Instance e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:00:58.264747 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1567c8cf-32d3-4ce4-b735-92ece8d76ca1 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 404 len: 111 microversion: 2.20 time: 0.094299 Jul 19 23:00:58.270284 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6d76f37c-2710-4968-82ec-91611408d287 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '.version_select at 0x7f7a02f969d0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:00:58.271484 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2751/5496] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 23:00:58 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 23:00:58.326147 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6d76f37c-2710-4968-82ec-91611408d287 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-665572650" status: 204 len: 0 microversion: 2.20 time: 0.058625 Jul 19 23:00:58.328276 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2746/5497] 10.222.0.25 () {60 vars in 1258 bytes} [Tue Jul 19 23:00:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-665572650 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 19 23:01:08.067478 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d5e89083-f0b7-495a-9514-bb091c3d77ea tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:08.079493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d5e89083-f0b7-495a-9514-bb091c3d77ea tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:08.123309 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:01:08.127545 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5e89083-f0b7-495a-9514-bb091c3d77ea tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:08.128664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5e89083-f0b7-495a-9514-bb091c3d77ea tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:08.130219 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5e89083-f0b7-495a-9514-bb091c3d77ea tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:08.135493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5e89083-f0b7-495a-9514-bb091c3d77ea tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:08.246667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=61 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:01:08.247615 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-274de685-440b-48dc-a0df-0026644ed359 req-cb12a129-0dc8-4be5-8f2c-1dcc0df12653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39263746-004a-4127-ab95-8066c7424b88", "tag": "ba51c9f8-79c0-4e2f-ac91-5186661aa91b"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:01:08.312599 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:01:08.315679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:01:08.328533 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-274de685-440b-48dc-a0df-0026644ed359 req-cb12a129-0dc8-4be5-8f2c-1dcc0df12653 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:08.331989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-274de685-440b-48dc-a0df-0026644ed359 req-cb12a129-0dc8-4be5-8f2c-1dcc0df12653 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:08.426368 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-274de685-440b-48dc-a0df-0026644ed359 req-cb12a129-0dc8-4be5-8f2c-1dcc0df12653 service nova] Creating event network-changed:ba51c9f8-79c0-4e2f-ac91-5186661aa91b for instance 39263746-004a-4127-ab95-8066c7424b88 on n-h2-847009-3 Jul 19 23:01:08.456912 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-274de685-440b-48dc-a0df-0026644ed359 req-cb12a129-0dc8-4be5-8f2c-1dcc0df12653 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217981 Jul 19 23:01:08.472370 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2747/5498] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:01:08.980712 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6f6e336d-9514-40b6-a96b-83c9da6c123d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:08.981629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6f6e336d-9514-40b6-a96b-83c9da6c123d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:09.016706 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f6e336d-9514-40b6-a96b-83c9da6c123d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:09.021131 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f6e336d-9514-40b6-a96b-83c9da6c123d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:09.029911 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f6e336d-9514-40b6-a96b-83c9da6c123d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:09.030480 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f6e336d-9514-40b6-a96b-83c9da6c123d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:09.033375 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d5e89083-f0b7-495a-9514-bb091c3d77ea tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:09.047709 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d5e89083-f0b7-495a-9514-bb091c3d77ea tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1563 microversion: 2.1 time: 0.989661 Jul 19 23:01:09.049209 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2752/5499] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:08 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1563 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:01:09.078602 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-6f6e336d-9514-40b6-a96b-83c9da6c123d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] HTTP exception thrown: Instance e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 could not be found. Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6f6e336d-9514-40b6-a96b-83c9da6c123d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Request method failure captured: Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 HTTP/1.1 Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zXBtbqPn8V6iAUvkzjoFYlGkiZVdrfWgYW80cDUoLS8TKNM5sFDjp_kFdLhlvWjdWQChQHkIbPptsdu_mP0Lervre7-NrJ51O0srk-Wi96t_EyZzzU04UK7X2NzZ3DcMU5ocoL_MVHzcM6QZPbmwSRM214dtbxlcibZSjRhvVSs0N8 Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: f262a7d579e84c07aef4fff8e5eda67e Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1720924693 Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f262a7d579e84c07aef4fff8e5eda67e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f262a7d579e84c07aef4fff8e5eda67e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f262a7d579e84c07aef4fff8e5eda67e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f262a7d579e84c07aef4fff8e5eda67e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1720924693 Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: f262a7d579e84c07aef4fff8e5eda67e Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1720924693 Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-AttachVolumeShelveTestJSON-1720924693-project Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1f187e783d5247bfb54c5d27bab4f048 Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1720924693-project Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 could not be found. Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0'} Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 could not be found. Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:01:09.080818 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:01:09.084995 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 could not be found. Jul 19 23:01:09.084995 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:01:09.084995 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:01:09.084995 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:01:09.084995 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:01:09.084995 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:01:09.084995 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:01:09.084995 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:01:09.084995 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:01:09.084995 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 could not be found. Jul 19 23:01:09.084995 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:01:09.084995 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6f6e336d-9514-40b6-a96b-83c9da6c123d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Returning 404 to user: Instance e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:01:09.084995 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6f6e336d-9514-40b6-a96b-83c9da6c123d tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 404 len: 111 microversion: 2.20 time: 0.109268 Jul 19 23:01:09.098071 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2e624fe2-5eaf-4b40-a267-1d5b22f1a226 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:09.099158 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2e624fe2-5eaf-4b40-a267-1d5b22f1a226 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:09.103248 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2748/5500] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 23:01:08 2022] DELETE /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 19 23:01:09.114199 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e624fe2-5eaf-4b40-a267-1d5b22f1a226 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:09.116149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e624fe2-5eaf-4b40-a267-1d5b22f1a226 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:09.124518 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e624fe2-5eaf-4b40-a267-1d5b22f1a226 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:09.125442 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e624fe2-5eaf-4b40-a267-1d5b22f1a226 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:09.176594 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-2e624fe2-5eaf-4b40-a267-1d5b22f1a226 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] HTTP exception thrown: Instance e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 could not be found. Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2e624fe2-5eaf-4b40-a267-1d5b22f1a226 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Request method failure captured: Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 HTTP/1.1 Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zXBtbqPn8V6iAUvkzjoFYlGkiZVdrfWgYW80cDUoLS8TKNM5sFDjp_kFdLhlvWjdWQChQHkIbPptsdu_mP0Lervre7-NrJ51O0srk-Wi96t_EyZzzU04UK7X2NzZ3DcMU5ocoL_MVHzcM6QZPbmwSRM214dtbxlcibZSjRhvVSs0N8 Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: f262a7d579e84c07aef4fff8e5eda67e Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1720924693 Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f262a7d579e84c07aef4fff8e5eda67e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f262a7d579e84c07aef4fff8e5eda67e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f262a7d579e84c07aef4fff8e5eda67e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f262a7d579e84c07aef4fff8e5eda67e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1720924693 Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: f262a7d579e84c07aef4fff8e5eda67e Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1720924693 Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AttachVolumeShelveTestJSON-1720924693-project Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1f187e783d5247bfb54c5d27bab4f048 Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1720924693-project Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 could not be found. Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0'} Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 could not be found. Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 could not be found. Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:01:09.178399 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:01:09.183367 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:01:09.183367 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:01:09.183367 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:01:09.183367 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:01:09.183367 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:01:09.183367 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:01:09.183367 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 could not be found. Jul 19 23:01:09.183367 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:01:09.183367 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2e624fe2-5eaf-4b40-a267-1d5b22f1a226 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Returning 404 to user: Instance e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:01:09.183367 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2e624fe2-5eaf-4b40-a267-1d5b22f1a226 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0" status: 404 len: 111 microversion: 2.20 time: 0.090058 Jul 19 23:01:09.183367 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2753/5501] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 23:01:09 2022] GET /compute/v2.1/servers/e9cd1545-e6ff-4261-8c2e-1f20ddc10ed0 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 23:01:14.951486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-610068f6-3a78-448c-a11d-5a94bced60cb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:14.952182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-610068f6-3a78-448c-a11d-5a94bced60cb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:14.959453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-610068f6-3a78-448c-a11d-5a94bced60cb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:14.959911 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-610068f6-3a78-448c-a11d-5a94bced60cb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:14.960693 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-610068f6-3a78-448c-a11d-5a94bced60cb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:14.961129 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-610068f6-3a78-448c-a11d-5a94bced60cb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:14.977464 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-610068f6-3a78-448c-a11d-5a94bced60cb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] HTTP exception thrown: Instance 4d98192d-dabe-4541-b7c6-c057e4269d64 could not be found. Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-610068f6-3a78-448c-a11d-5a94bced60cb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Request method failure captured: Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 HTTP/1.1 Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zXBtbqPn8V6iAUvkzjoFYlGkiZVdrfWgYW80cDUoLS8TKNM5sFDjp_kFdLhlvWjdWQChQHkIbPptsdu_mP0Lervre7-NrJ51O0srk-Wi96t_EyZzzU04UK7X2NzZ3DcMU5ocoL_MVHzcM6QZPbmwSRM214dtbxlcibZSjRhvVSs0N8 Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: f262a7d579e84c07aef4fff8e5eda67e Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1720924693 Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f262a7d579e84c07aef4fff8e5eda67e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f262a7d579e84c07aef4fff8e5eda67e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f262a7d579e84c07aef4fff8e5eda67e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f262a7d579e84c07aef4fff8e5eda67e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1720924693 Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: f262a7d579e84c07aef4fff8e5eda67e Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1720924693 Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-AttachVolumeShelveTestJSON-1720924693-project Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 1f187e783d5247bfb54c5d27bab4f048 Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1720924693-project Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 4d98192d-dabe-4541-b7c6-c057e4269d64 could not be found. Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '4d98192d-dabe-4541-b7c6-c057e4269d64'} Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d98192d-dabe-4541-b7c6-c057e4269d64 could not be found. Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:01:14.979716 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:01:14.987493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d98192d-dabe-4541-b7c6-c057e4269d64 could not be found. Jul 19 23:01:14.987493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:01:14.987493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:01:14.987493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:01:14.987493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:01:14.987493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:01:14.987493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:01:14.987493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:01:14.987493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:01:14.987493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d98192d-dabe-4541-b7c6-c057e4269d64 could not be found. Jul 19 23:01:14.987493 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:01:14.987493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-610068f6-3a78-448c-a11d-5a94bced60cb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Returning 404 to user: Instance 4d98192d-dabe-4541-b7c6-c057e4269d64 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:01:14.987493 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-610068f6-3a78-448c-a11d-5a94bced60cb tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 404 len: 111 microversion: 2.20 time: 0.035424 Jul 19 23:01:14.987493 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2749/5502] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 19 23:01:14 2022] DELETE /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 23:01:14.999585 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b312c1ab-ec65-4981-8670-9f05e2ab2970 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:15.000219 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b312c1ab-ec65-4981-8670-9f05e2ab2970 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] [instance: 4d98192d-dabe-4541-b7c6-c057e4269d64] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:15.014414 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b312c1ab-ec65-4981-8670-9f05e2ab2970 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:15.014891 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b312c1ab-ec65-4981-8670-9f05e2ab2970 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:15.024139 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b312c1ab-ec65-4981-8670-9f05e2ab2970 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:15.024609 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b312c1ab-ec65-4981-8670-9f05e2ab2970 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:15.054939 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-b312c1ab-ec65-4981-8670-9f05e2ab2970 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] HTTP exception thrown: Instance 4d98192d-dabe-4541-b7c6-c057e4269d64 could not be found. Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b312c1ab-ec65-4981-8670-9f05e2ab2970 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Request method failure captured: Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 HTTP/1.1 Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zXBtbqPn8V6iAUvkzjoFYlGkiZVdrfWgYW80cDUoLS8TKNM5sFDjp_kFdLhlvWjdWQChQHkIbPptsdu_mP0Lervre7-NrJ51O0srk-Wi96t_EyZzzU04UK7X2NzZ3DcMU5ocoL_MVHzcM6QZPbmwSRM214dtbxlcibZSjRhvVSs0N8 Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: f262a7d579e84c07aef4fff8e5eda67e Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1720924693 Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f262a7d579e84c07aef4fff8e5eda67e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f262a7d579e84c07aef4fff8e5eda67e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f262a7d579e84c07aef4fff8e5eda67e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f262a7d579e84c07aef4fff8e5eda67e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1720924693 Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: f262a7d579e84c07aef4fff8e5eda67e Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1720924693 Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AttachVolumeShelveTestJSON-1720924693-project Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 1f187e783d5247bfb54c5d27bab4f048 Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1720924693-project Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 4d98192d-dabe-4541-b7c6-c057e4269d64 could not be found. Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '4d98192d-dabe-4541-b7c6-c057e4269d64'} Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d98192d-dabe-4541-b7c6-c057e4269d64 could not be found. Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d98192d-dabe-4541-b7c6-c057e4269d64 could not be found. Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:01:15.061290 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:01:15.066205 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:01:15.066205 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:01:15.066205 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:01:15.066205 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:01:15.066205 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:01:15.066205 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:01:15.066205 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d98192d-dabe-4541-b7c6-c057e4269d64 could not be found. Jul 19 23:01:15.066205 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:01:15.066205 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b312c1ab-ec65-4981-8670-9f05e2ab2970 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] Returning 404 to user: Instance 4d98192d-dabe-4541-b7c6-c057e4269d64 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:01:15.066205 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b312c1ab-ec65-4981-8670-9f05e2ab2970 tempest-AttachVolumeShelveTestJSON-1720924693 tempest-AttachVolumeShelveTestJSON-1720924693-project] 10.222.0.25 "GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64" status: 404 len: 111 microversion: 2.20 time: 0.070026 Jul 19 23:01:15.073892 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2754/5503] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 19 23:01:14 2022] GET /compute/v2.1/servers/4d98192d-dabe-4541-b7c6-c057e4269d64 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 23:01:19.177411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6fb870e2-7516-473c-b322-c496ab88ddd6 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Action: 'create', calling method: .version_select at 0x7f7a02f105e0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-456325726", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfnwCUrspAbckuxiE+1ccIP06wboS1IzroRQSwfTszNMnffUyhqR6MuF0LeY324QbbPyCR9BSpzz0HnG+bKwZcBJP/Sk3Ua0sjQ2u/l6atpeLy0shGYe7PPREqFJWj6vQ=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:01:19.211652 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-6fb870e2-7516-473c-b322-c496ab88ddd6 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Getting quotas for project 2c39c18707544d2bb4109d95f1833f58. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:01:19.231775 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-6fb870e2-7516-473c-b322-c496ab88ddd6 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Getting quotas for user f423460ee1b64eb3bcd8749db6dd42d9 and project 2c39c18707544d2bb4109d95f1833f58. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:01:19.290047 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6fb870e2-7516-473c-b322-c496ab88ddd6 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.456522 Jul 19 23:01:19.296128 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2750/5504] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 23:01:18 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:01:22.520893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c8bad0bf-ca35-4e45-8043-e5a414c6a43e tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:01:22.522021 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c8bad0bf-ca35-4e45-8043-e5a414c6a43e tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:22.539715 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c8bad0bf-ca35-4e45-8043-e5a414c6a43e tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:22.544358 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c8bad0bf-ca35-4e45-8043-e5a414c6a43e tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:22.545829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c8bad0bf-ca35-4e45-8043-e5a414c6a43e tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:22.546430 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c8bad0bf-ca35-4e45-8043-e5a414c6a43e tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:22.666382 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c8bad0bf-ca35-4e45-8043-e5a414c6a43e tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "POST /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88/action" status: 200 len: 24572 microversion: 2.1 time: 0.155122 Jul 19 23:01:22.675977 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2755/5505] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:01:22 2022] POST /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88/action => generated 24572 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 23:01:27.954504 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:01:27.962886 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f4fab4ed-175a-403a-81f6-21bfe1e331b5 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-900774898", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-456325726", "security_groups": [{"name": "tempest-secgroup-smoke-1600290824"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "781c50d1-fa14-433c-9c13-52f37cdffcc0"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:01:28.419078 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-f4fab4ed-175a-403a-81f6-21bfe1e331b5 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] validate_networks() for [('781c50d1-fa14-433c-9c13-52f37cdffcc0', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:01:29.256829 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:01:30.719018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-f4fab4ed-175a-403a-81f6-21bfe1e331b5 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Getting quotas for project 2c39c18707544d2bb4109d95f1833f58. Resources: dict_keys(['metadata_items']) {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:01:30.757277 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-f4fab4ed-175a-403a-81f6-21bfe1e331b5 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Getting quotas for user f423460ee1b64eb3bcd8749db6dd42d9 and project 2c39c18707544d2bb4109d95f1833f58. Resources: dict_keys(['metadata_items']) {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:01:30.859573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-f4fab4ed-175a-403a-81f6-21bfe1e331b5 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:01:30.862261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-f4fab4ed-175a-403a-81f6-21bfe1e331b5 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:01:30.864349 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-f4fab4ed-175a-403a-81f6-21bfe1e331b5 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:01:30.865156 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-f4fab4ed-175a-403a-81f6-21bfe1e331b5 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:01:30.874302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-f4fab4ed-175a-403a-81f6-21bfe1e331b5 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:01:30.904758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4fab4ed-175a-403a-81f6-21bfe1e331b5 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:30.906142 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4fab4ed-175a-403a-81f6-21bfe1e331b5 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:30.907228 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4fab4ed-175a-403a-81f6-21bfe1e331b5 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:30.909133 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4fab4ed-175a-403a-81f6-21bfe1e331b5 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:30.929493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-f4fab4ed-175a-403a-81f6-21bfe1e331b5 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Getting quotas for project 2c39c18707544d2bb4109d95f1833f58. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:01:30.937434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-f4fab4ed-175a-403a-81f6-21bfe1e331b5 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Getting quotas for user f423460ee1b64eb3bcd8749db6dd42d9 and project 2c39c18707544d2bb4109d95f1833f58. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:01:30.953670 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f4fab4ed-175a-403a-81f6-21bfe1e331b5 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:01:30.956600 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f4fab4ed-175a-403a-81f6-21bfe1e331b5 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] [instance: a67f292a-5ce0-471c-aecc-eaf4217389e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:01:31.091243 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f4fab4ed-175a-403a-81f6-21bfe1e331b5 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.145159 Jul 19 23:01:31.095463 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2751/5506] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:01:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 3151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:01:31.104588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9892b156-e165-4eda-b1c6-1e892cb299f3 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:31.105969 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9892b156-e165-4eda-b1c6-1e892cb299f3 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] [instance: a67f292a-5ce0-471c-aecc-eaf4217389e9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:31.300289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9892b156-e165-4eda-b1c6-1e892cb299f3 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423460ee1b64eb3bcd8749db6dd42d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c39c18707544d2bb4109d95f1833f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:31.308901 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9892b156-e165-4eda-b1c6-1e892cb299f3 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] 10.222.0.25 "GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9" status: 200 len: 1301 microversion: 2.1 time: 0.208019 Jul 19 23:01:31.315873 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2756/5507] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:31 2022] GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9 => generated 1301 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:01:32.343428 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d6925aa0-53a0-4edf-99c9-dcdb7137293c tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:32.347021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d6925aa0-53a0-4edf-99c9-dcdb7137293c tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] [instance: a67f292a-5ce0-471c-aecc-eaf4217389e9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:32.375540 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d6925aa0-53a0-4edf-99c9-dcdb7137293c tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:32.376389 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d6925aa0-53a0-4edf-99c9-dcdb7137293c tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:32.377441 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d6925aa0-53a0-4edf-99c9-dcdb7137293c tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:32.378139 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d6925aa0-53a0-4edf-99c9-dcdb7137293c tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:32.641874 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d6925aa0-53a0-4edf-99c9-dcdb7137293c tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423460ee1b64eb3bcd8749db6dd42d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c39c18707544d2bb4109d95f1833f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:32.655775 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d6925aa0-53a0-4edf-99c9-dcdb7137293c tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] 10.222.0.25 "GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9" status: 200 len: 1353 microversion: 2.1 time: 0.327136 Jul 19 23:01:32.658057 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2752/5508] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:32 2022] GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9 => generated 1353 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:01:33.617775 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8caf5054-1557-4244-8c00-b0ae9d18547b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:01:33.620019 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8caf5054-1557-4244-8c00-b0ae9d18547b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:33.641355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=13 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:01:33.643520 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8caf5054-1557-4244-8c00-b0ae9d18547b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:33.644090 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8caf5054-1557-4244-8c00-b0ae9d18547b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:33.644936 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8caf5054-1557-4244-8c00-b0ae9d18547b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:33.645432 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8caf5054-1557-4244-8c00-b0ae9d18547b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:33.675790 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-41c4bc15-35d5-426a-bbbf-de36adac97e3 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:33.677302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-41c4bc15-35d5-426a-bbbf-de36adac97e3 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] [instance: a67f292a-5ce0-471c-aecc-eaf4217389e9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:33.693312 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-41c4bc15-35d5-426a-bbbf-de36adac97e3 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:33.693778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-41c4bc15-35d5-426a-bbbf-de36adac97e3 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:33.694605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-41c4bc15-35d5-426a-bbbf-de36adac97e3 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:33.695038 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-41c4bc15-35d5-426a-bbbf-de36adac97e3 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:33.857764 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-8caf5054-1557-4244-8c00-b0ae9d18547b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:01:33.858512 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-8caf5054-1557-4244-8c00-b0ae9d18547b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:01:33.859006 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-8caf5054-1557-4244-8c00-b0ae9d18547b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:01:33.859470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-8caf5054-1557-4244-8c00-b0ae9d18547b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:01:33.859899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-8caf5054-1557-4244-8c00-b0ae9d18547b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:01:34.001677 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8caf5054-1557-4244-8c00-b0ae9d18547b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:34.015297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8caf5054-1557-4244-8c00-b0ae9d18547b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:34.015755 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8caf5054-1557-4244-8c00-b0ae9d18547b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:34.016747 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8caf5054-1557-4244-8c00-b0ae9d18547b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:34.017440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8caf5054-1557-4244-8c00-b0ae9d18547b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:34.064459 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8caf5054-1557-4244-8c00-b0ae9d18547b tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "POST /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88/action" status: 202 len: 1138 microversion: 2.1 time: 0.450917 Jul 19 23:01:34.067184 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2757/5509] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:01:33 2022] POST /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88/action => generated 1138 bytes in 454 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 19 23:01:34.085463 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fe226f14-76ea-49cf-85b3-5bd56f79d97e tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:34.086446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fe226f14-76ea-49cf-85b3-5bd56f79d97e tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:34.094526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fe226f14-76ea-49cf-85b3-5bd56f79d97e tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:34.095518 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fe226f14-76ea-49cf-85b3-5bd56f79d97e tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:34.096540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fe226f14-76ea-49cf-85b3-5bd56f79d97e tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:34.097262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fe226f14-76ea-49cf-85b3-5bd56f79d97e tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:34.208434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-41c4bc15-35d5-426a-bbbf-de36adac97e3 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423460ee1b64eb3bcd8749db6dd42d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c39c18707544d2bb4109d95f1833f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:34.218437 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-41c4bc15-35d5-426a-bbbf-de36adac97e3 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] 10.222.0.25 "GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9" status: 200 len: 1359 microversion: 2.1 time: 0.547770 Jul 19 23:01:34.234589 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2753/5510] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:33 2022] GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9 => generated 1359 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:01:34.841009 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fe226f14-76ea-49cf-85b3-5bd56f79d97e tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:34.858808 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fe226f14-76ea-49cf-85b3-5bd56f79d97e tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1691 microversion: 2.1 time: 0.779155 Jul 19 23:01:34.871432 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2758/5511] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:34 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1691 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:01:35.257918 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-449615cf-6375-4df2-97c0-a860dff4fe54 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:35.260208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-449615cf-6375-4df2-97c0-a860dff4fe54 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] [instance: a67f292a-5ce0-471c-aecc-eaf4217389e9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:35.273906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-449615cf-6375-4df2-97c0-a860dff4fe54 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:35.276761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-449615cf-6375-4df2-97c0-a860dff4fe54 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:35.278638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-449615cf-6375-4df2-97c0-a860dff4fe54 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:35.282463 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-449615cf-6375-4df2-97c0-a860dff4fe54 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:35.477275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-449615cf-6375-4df2-97c0-a860dff4fe54 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423460ee1b64eb3bcd8749db6dd42d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c39c18707544d2bb4109d95f1833f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:35.488156 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-449615cf-6375-4df2-97c0-a860dff4fe54 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] 10.222.0.25 "GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9" status: 200 len: 1359 microversion: 2.1 time: 0.249183 Jul 19 23:01:35.493920 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2754/5512] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:35 2022] GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9 => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:01:35.880102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3b8b00c9-4f26-4bd2-9008-0a205a6ec259 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:35.881646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3b8b00c9-4f26-4bd2-9008-0a205a6ec259 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:35.893825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b8b00c9-4f26-4bd2-9008-0a205a6ec259 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:35.904130 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b8b00c9-4f26-4bd2-9008-0a205a6ec259 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:35.905466 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b8b00c9-4f26-4bd2-9008-0a205a6ec259 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:35.906140 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b8b00c9-4f26-4bd2-9008-0a205a6ec259 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:36.488000 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3b8b00c9-4f26-4bd2-9008-0a205a6ec259 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:36.501554 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3b8b00c9-4f26-4bd2-9008-0a205a6ec259 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1691 microversion: 2.1 time: 0.625286 Jul 19 23:01:36.510607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0055b4f4-2daa-4ab7-9c34-2badf7ef242b tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:36.512126 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0055b4f4-2daa-4ab7-9c34-2badf7ef242b tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] [instance: a67f292a-5ce0-471c-aecc-eaf4217389e9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:36.520873 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2759/5513] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:35 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1691 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:01:36.524936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0055b4f4-2daa-4ab7-9c34-2badf7ef242b tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:36.529568 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0055b4f4-2daa-4ab7-9c34-2badf7ef242b tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:36.531136 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0055b4f4-2daa-4ab7-9c34-2badf7ef242b tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:36.533262 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0055b4f4-2daa-4ab7-9c34-2badf7ef242b tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:36.741229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0055b4f4-2daa-4ab7-9c34-2badf7ef242b tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423460ee1b64eb3bcd8749db6dd42d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c39c18707544d2bb4109d95f1833f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:36.752477 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0055b4f4-2daa-4ab7-9c34-2badf7ef242b tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] 10.222.0.25 "GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9" status: 200 len: 1359 microversion: 2.1 time: 0.246186 Jul 19 23:01:36.765063 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2755/5514] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:36 2022] GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9 => generated 1359 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:01:37.540232 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-910dd064-4daa-4277-9c9d-b69f07bf4b39 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:37.540870 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-910dd064-4daa-4277-9c9d-b69f07bf4b39 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:37.548489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-910dd064-4daa-4277-9c9d-b69f07bf4b39 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:37.548991 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-910dd064-4daa-4277-9c9d-b69f07bf4b39 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:37.552062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-910dd064-4daa-4277-9c9d-b69f07bf4b39 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:37.552918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-910dd064-4daa-4277-9c9d-b69f07bf4b39 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:37.771657 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c38cf2c4-ede8-4a43-9ec2-28c5f1dafe3a tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:37.772433 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c38cf2c4-ede8-4a43-9ec2-28c5f1dafe3a tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] [instance: a67f292a-5ce0-471c-aecc-eaf4217389e9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:37.780480 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c38cf2c4-ede8-4a43-9ec2-28c5f1dafe3a tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:37.780930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c38cf2c4-ede8-4a43-9ec2-28c5f1dafe3a tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:37.781706 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c38cf2c4-ede8-4a43-9ec2-28c5f1dafe3a tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:37.794295 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c38cf2c4-ede8-4a43-9ec2-28c5f1dafe3a tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:38.123370 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-910dd064-4daa-4277-9c9d-b69f07bf4b39 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:38.134464 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-910dd064-4daa-4277-9c9d-b69f07bf4b39 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1691 microversion: 2.1 time: 0.598806 Jul 19 23:01:38.139972 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2760/5515] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:37 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1691 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:01:38.400424 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c38cf2c4-ede8-4a43-9ec2-28c5f1dafe3a tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423460ee1b64eb3bcd8749db6dd42d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c39c18707544d2bb4109d95f1833f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:38.424407 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c38cf2c4-ede8-4a43-9ec2-28c5f1dafe3a tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] 10.222.0.25 "GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9" status: 200 len: 1427 microversion: 2.1 time: 0.656503 Jul 19 23:01:38.435281 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2756/5516] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:37 2022] GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9 => generated 1427 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:01:39.153713 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-32a4bc55-c49d-4432-a6f3-dfaa66a513e5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:39.154376 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-32a4bc55-c49d-4432-a6f3-dfaa66a513e5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:39.157469 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=24 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:01:39.175865 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32a4bc55-c49d-4432-a6f3-dfaa66a513e5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:39.176340 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32a4bc55-c49d-4432-a6f3-dfaa66a513e5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:39.177146 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32a4bc55-c49d-4432-a6f3-dfaa66a513e5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:39.177593 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32a4bc55-c49d-4432-a6f3-dfaa66a513e5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:39.442941 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6165c9bc-cedf-4d73-bfe8-f4bcfaa9c5cb tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:39.445618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6165c9bc-cedf-4d73-bfe8-f4bcfaa9c5cb tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] [instance: a67f292a-5ce0-471c-aecc-eaf4217389e9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:39.451165 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:01:39.468910 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6165c9bc-cedf-4d73-bfe8-f4bcfaa9c5cb tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:39.471149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6165c9bc-cedf-4d73-bfe8-f4bcfaa9c5cb tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:39.474409 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6165c9bc-cedf-4d73-bfe8-f4bcfaa9c5cb tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:39.475062 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6165c9bc-cedf-4d73-bfe8-f4bcfaa9c5cb tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:39.779081 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-32a4bc55-c49d-4432-a6f3-dfaa66a513e5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:39.796091 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-32a4bc55-c49d-4432-a6f3-dfaa66a513e5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1691 microversion: 2.1 time: 0.648385 Jul 19 23:01:39.796692 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2761/5517] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:39 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1691 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:01:40.049491 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6165c9bc-cedf-4d73-bfe8-f4bcfaa9c5cb tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423460ee1b64eb3bcd8749db6dd42d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c39c18707544d2bb4109d95f1833f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:40.064247 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6165c9bc-cedf-4d73-bfe8-f4bcfaa9c5cb tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] 10.222.0.25 "GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9" status: 200 len: 1427 microversion: 2.1 time: 0.625688 Jul 19 23:01:40.069012 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2757/5518] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:39 2022] GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9 => generated 1427 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:01:40.387018 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-c1140f9b-cdd4-42ea-88dc-f33b9d143b0e req-303919bb-bd23-4fd3-b259-505984fb637c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a67f292a-5ce0-471c-aecc-eaf4217389e9", "tag": "5cad3db1-cced-43ed-b1fe-1a0112119e1d"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:01:40.403769 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-c1140f9b-cdd4-42ea-88dc-f33b9d143b0e req-303919bb-bd23-4fd3-b259-505984fb637c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:40.404218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-c1140f9b-cdd4-42ea-88dc-f33b9d143b0e req-303919bb-bd23-4fd3-b259-505984fb637c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:40.435479 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-c1140f9b-cdd4-42ea-88dc-f33b9d143b0e req-303919bb-bd23-4fd3-b259-505984fb637c service nova] Creating event network-changed:5cad3db1-cced-43ed-b1fe-1a0112119e1d for instance a67f292a-5ce0-471c-aecc-eaf4217389e9 on n-h1-847009-3 Jul 19 23:01:40.444349 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-c1140f9b-cdd4-42ea-88dc-f33b9d143b0e req-303919bb-bd23-4fd3-b259-505984fb637c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.319247 Jul 19 23:01:40.445240 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2762/5519] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:01:40.814817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-df31c4d6-cd7c-4ef9-a2b6-0a62a2183521 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:40.815875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-df31c4d6-cd7c-4ef9-a2b6-0a62a2183521 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:40.830490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-df31c4d6-cd7c-4ef9-a2b6-0a62a2183521 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:40.831338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-df31c4d6-cd7c-4ef9-a2b6-0a62a2183521 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:40.832488 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-df31c4d6-cd7c-4ef9-a2b6-0a62a2183521 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:40.833121 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-df31c4d6-cd7c-4ef9-a2b6-0a62a2183521 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:40.920367 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:01:40.939039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b2602ead-a165-454a-919f-39bff9941968 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Action: 'create', calling method: .version_select at 0x7f7a02f65c10>, body: {"keypair": {"name": "tempest-keypair-133406498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8/10xryvKkfLfJqoDwYURpuSGzz2xl/RXEEgqiIDgCmEZK8pQj1w927xZoKDFu2kiMX64OsFB4T063QE/pfvJzEbOxu2i8CAKVbm8I18DRjprD7qVS1UOOdCX7oEV68Q=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:01:40.952806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=10 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:01:40.974942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-b2602ead-a165-454a-919f-39bff9941968 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Getting quotas for project 9480697850b44a038ee838b4aed1ff10. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:01:40.987227 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-b2602ead-a165-454a-919f-39bff9941968 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Getting quotas for user 2d887379f25b41cc9dfb7119cc561e05 and project 9480697850b44a038ee838b4aed1ff10. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:01:41.057780 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b2602ead-a165-454a-919f-39bff9941968 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.264769 Jul 19 23:01:41.059854 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2758/5520] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 23:01:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:01:41.081918 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3dc603bf-d58e-4085-a66f-4aca1e4696c5 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:41.082796 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3dc603bf-d58e-4085-a66f-4aca1e4696c5 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] [instance: a67f292a-5ce0-471c-aecc-eaf4217389e9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:41.093053 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3dc603bf-d58e-4085-a66f-4aca1e4696c5 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:41.101895 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3dc603bf-d58e-4085-a66f-4aca1e4696c5 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:41.103079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3dc603bf-d58e-4085-a66f-4aca1e4696c5 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:41.103756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3dc603bf-d58e-4085-a66f-4aca1e4696c5 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:41.304944 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:01:42.124102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-df31c4d6-cd7c-4ef9-a2b6-0a62a2183521 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:42.142293 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-df31c4d6-cd7c-4ef9-a2b6-0a62a2183521 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1691 microversion: 2.1 time: 1.331761 Jul 19 23:01:42.142908 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2763/5521] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:40 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1691 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:01:42.192554 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3dc603bf-d58e-4085-a66f-4aca1e4696c5 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423460ee1b64eb3bcd8749db6dd42d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c39c18707544d2bb4109d95f1833f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:42.211576 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3dc603bf-d58e-4085-a66f-4aca1e4696c5 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] 10.222.0.25 "GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9" status: 200 len: 1427 microversion: 2.1 time: 1.134250 Jul 19 23:01:42.234306 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2759/5522] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:41 2022] GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9 => generated 1427 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:01:43.161836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7d3e32f5-1f0f-4258-bd76-f7ef7dc0370d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:43.162755 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7d3e32f5-1f0f-4258-bd76-f7ef7dc0370d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:43.181969 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d3e32f5-1f0f-4258-bd76-f7ef7dc0370d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:43.185775 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d3e32f5-1f0f-4258-bd76-f7ef7dc0370d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:43.186654 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d3e32f5-1f0f-4258-bd76-f7ef7dc0370d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:43.187134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d3e32f5-1f0f-4258-bd76-f7ef7dc0370d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:43.229931 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3d29a315-daa1-4476-afc3-8cabd81fbda6 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:43.231165 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3d29a315-daa1-4476-afc3-8cabd81fbda6 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] [instance: a67f292a-5ce0-471c-aecc-eaf4217389e9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:43.242065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d29a315-daa1-4476-afc3-8cabd81fbda6 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:43.247891 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d29a315-daa1-4476-afc3-8cabd81fbda6 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:43.249214 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d29a315-daa1-4476-afc3-8cabd81fbda6 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:43.250022 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d29a315-daa1-4476-afc3-8cabd81fbda6 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:43.892046 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3d29a315-daa1-4476-afc3-8cabd81fbda6 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423460ee1b64eb3bcd8749db6dd42d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c39c18707544d2bb4109d95f1833f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:43.915065 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3d29a315-daa1-4476-afc3-8cabd81fbda6 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] 10.222.0.25 "GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9" status: 200 len: 1427 microversion: 2.1 time: 0.689103 Jul 19 23:01:43.916113 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2760/5523] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:43 2022] GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9 => generated 1427 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:01:44.024810 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7d3e32f5-1f0f-4258-bd76-f7ef7dc0370d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:44.048982 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7d3e32f5-1f0f-4258-bd76-f7ef7dc0370d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1691 microversion: 2.1 time: 0.892915 Jul 19 23:01:44.050726 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2764/5524] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:43 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1691 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:01:44.938768 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4d02a418-b055-4a6e-997d-0122309a69e0 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:44.942752 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4d02a418-b055-4a6e-997d-0122309a69e0 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] [instance: a67f292a-5ce0-471c-aecc-eaf4217389e9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:44.965190 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d02a418-b055-4a6e-997d-0122309a69e0 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:44.972179 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d02a418-b055-4a6e-997d-0122309a69e0 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:44.973201 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d02a418-b055-4a6e-997d-0122309a69e0 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:44.973661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d02a418-b055-4a6e-997d-0122309a69e0 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:45.068792 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6fefd91c-fe59-4ee8-9c39-81f855d6b03d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:45.070189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6fefd91c-fe59-4ee8-9c39-81f855d6b03d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:45.113018 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6fefd91c-fe59-4ee8-9c39-81f855d6b03d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:45.114522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6fefd91c-fe59-4ee8-9c39-81f855d6b03d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:45.118345 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6fefd91c-fe59-4ee8-9c39-81f855d6b03d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:45.121466 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6fefd91c-fe59-4ee8-9c39-81f855d6b03d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:45.879882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6fefd91c-fe59-4ee8-9c39-81f855d6b03d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:45.888857 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6fefd91c-fe59-4ee8-9c39-81f855d6b03d tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1691 microversion: 2.1 time: 0.825076 Jul 19 23:01:45.893072 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2765/5525] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:45 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1691 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:01:46.069933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4d02a418-b055-4a6e-997d-0122309a69e0 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423460ee1b64eb3bcd8749db6dd42d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c39c18707544d2bb4109d95f1833f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:46.097847 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4d02a418-b055-4a6e-997d-0122309a69e0 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] 10.222.0.25 "GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9" status: 200 len: 1427 microversion: 2.1 time: 1.166817 Jul 19 23:01:46.098575 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2761/5526] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:44 2022] GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9 => generated 1427 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:01:46.124004 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e304a960-1e31-4c91-956b-b01eaffdec55 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1892411446", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ef296c9d-13d5-4258-9274-6f9f322539cc"}], "security_groups": [{"name": "tempest-securitygroup--738204663"}], "key_name": "tempest-keypair-133406498", "user_data": "}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:01:46.391798 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-e304a960-1e31-4c91-956b-b01eaffdec55 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] validate_networks() for [('ef296c9d-13d5-4258-9274-6f9f322539cc', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:01:46.909704 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d03dfd74-8f71-42ea-a6dd-fcf6b3dccaff tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:46.910541 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d03dfd74-8f71-42ea-a6dd-fcf6b3dccaff tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:46.921709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d03dfd74-8f71-42ea-a6dd-fcf6b3dccaff tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:46.922178 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d03dfd74-8f71-42ea-a6dd-fcf6b3dccaff tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:46.922986 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d03dfd74-8f71-42ea-a6dd-fcf6b3dccaff tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:46.923465 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d03dfd74-8f71-42ea-a6dd-fcf6b3dccaff tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:46.998897 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-e304a960-1e31-4c91-956b-b01eaffdec55 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:01:46.999703 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-e304a960-1e31-4c91-956b-b01eaffdec55 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:01:47.000492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-e304a960-1e31-4c91-956b-b01eaffdec55 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:01:47.001141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-e304a960-1e31-4c91-956b-b01eaffdec55 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:01:47.001788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-e304a960-1e31-4c91-956b-b01eaffdec55 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:01:47.031791 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e304a960-1e31-4c91-956b-b01eaffdec55 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:47.034262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e304a960-1e31-4c91-956b-b01eaffdec55 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:47.036775 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e304a960-1e31-4c91-956b-b01eaffdec55 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:47.038085 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e304a960-1e31-4c91-956b-b01eaffdec55 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:47.094423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-e304a960-1e31-4c91-956b-b01eaffdec55 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Getting quotas for project 9480697850b44a038ee838b4aed1ff10. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:01:47.104175 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-e304a960-1e31-4c91-956b-b01eaffdec55 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Getting quotas for user 2d887379f25b41cc9dfb7119cc561e05 and project 9480697850b44a038ee838b4aed1ff10. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:01:47.135020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e304a960-1e31-4c91-956b-b01eaffdec55 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:01:47.143210 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e304a960-1e31-4c91-956b-b01eaffdec55 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:01:47.290763 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e304a960-1e31-4c91-956b-b01eaffdec55 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.171839 Jul 19 23:01:47.296218 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2766/5527] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:01:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 1178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 23:01:47.311391 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e6525b9b-7ceb-4006-b8d7-9ef6377d23fc tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:47.312403 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e6525b9b-7ceb-4006-b8d7-9ef6377d23fc tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] [instance: a67f292a-5ce0-471c-aecc-eaf4217389e9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:47.331981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6525b9b-7ceb-4006-b8d7-9ef6377d23fc tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:47.332869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6525b9b-7ceb-4006-b8d7-9ef6377d23fc tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:47.333943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6525b9b-7ceb-4006-b8d7-9ef6377d23fc tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:47.336228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6525b9b-7ceb-4006-b8d7-9ef6377d23fc tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:47.779143 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d03dfd74-8f71-42ea-a6dd-fcf6b3dccaff tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:47.794112 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d03dfd74-8f71-42ea-a6dd-fcf6b3dccaff tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1697 microversion: 2.1 time: 0.884136 Jul 19 23:01:47.795358 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2762/5528] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:46 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1697 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:01:47.810003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-89404ff3-a696-43ac-bc72-6fc3e044f8f8 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:47.810670 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-89404ff3-a696-43ac-bc72-6fc3e044f8f8 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:47.814835 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e6525b9b-7ceb-4006-b8d7-9ef6377d23fc tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423460ee1b64eb3bcd8749db6dd42d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c39c18707544d2bb4109d95f1833f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:47.831287 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e6525b9b-7ceb-4006-b8d7-9ef6377d23fc tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] 10.222.0.25 "GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9" status: 200 len: 1427 microversion: 2.1 time: 0.533294 Jul 19 23:01:47.834690 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2767/5529] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:47 2022] GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9 => generated 1427 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:01:47.853850 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-45aa91c0-d1f9-4e87-8a60-9c2aa35f0659 req-d4fdaf63-ecd9-4938-8971-f974d53ab899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a67f292a-5ce0-471c-aecc-eaf4217389e9", "name": "network-vif-plugged", "status": "completed", "tag": "5cad3db1-cced-43ed-b1fe-1a0112119e1d"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:01:47.878624 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-45aa91c0-d1f9-4e87-8a60-9c2aa35f0659 req-d4fdaf63-ecd9-4938-8971-f974d53ab899 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:47.881352 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-45aa91c0-d1f9-4e87-8a60-9c2aa35f0659 req-d4fdaf63-ecd9-4938-8971-f974d53ab899 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:47.921998 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-45aa91c0-d1f9-4e87-8a60-9c2aa35f0659 req-d4fdaf63-ecd9-4938-8971-f974d53ab899 service nova] Creating event network-vif-plugged:5cad3db1-cced-43ed-b1fe-1a0112119e1d for instance a67f292a-5ce0-471c-aecc-eaf4217389e9 on n-h1-847009-3 Jul 19 23:01:47.931670 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-89404ff3-a696-43ac-bc72-6fc3e044f8f8 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:47.948060 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-89404ff3-a696-43ac-bc72-6fc3e044f8f8 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1237 microversion: 2.1 time: 0.151400 Jul 19 23:01:47.952563 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2763/5530] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:47 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1237 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:01:47.965384 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-45aa91c0-d1f9-4e87-8a60-9c2aa35f0659 req-d4fdaf63-ecd9-4938-8971-f974d53ab899 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128062 Jul 19 23:01:47.975398 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2768/5531] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:01:48.820108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dd6fe88e-2911-4406-a264-c62ead1ffd17 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:48.821518 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dd6fe88e-2911-4406-a264-c62ead1ffd17 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:48.842722 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd6fe88e-2911-4406-a264-c62ead1ffd17 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:48.843555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd6fe88e-2911-4406-a264-c62ead1ffd17 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:48.845183 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd6fe88e-2911-4406-a264-c62ead1ffd17 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:48.845869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd6fe88e-2911-4406-a264-c62ead1ffd17 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:48.853453 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9b14b4ca-a956-445a-bcbe-46e01cf3311b tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:48.855327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9b14b4ca-a956-445a-bcbe-46e01cf3311b tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] [instance: a67f292a-5ce0-471c-aecc-eaf4217389e9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:48.876634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b14b4ca-a956-445a-bcbe-46e01cf3311b tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:48.877472 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b14b4ca-a956-445a-bcbe-46e01cf3311b tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:48.878468 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b14b4ca-a956-445a-bcbe-46e01cf3311b tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:48.879080 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b14b4ca-a956-445a-bcbe-46e01cf3311b tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:49.998423 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dd6fe88e-2911-4406-a264-c62ead1ffd17 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:50.015248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9b14b4ca-a956-445a-bcbe-46e01cf3311b tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423460ee1b64eb3bcd8749db6dd42d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c39c18707544d2bb4109d95f1833f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:50.026002 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dd6fe88e-2911-4406-a264-c62ead1ffd17 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1697 microversion: 2.1 time: 1.217186 Jul 19 23:01:50.028764 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9b14b4ca-a956-445a-bcbe-46e01cf3311b tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] 10.222.0.25 "GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9" status: 200 len: 1427 microversion: 2.1 time: 1.179810 Jul 19 23:01:50.030052 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2769/5532] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:48 2022] GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9 => generated 1427 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:01:50.039333 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-26d766e9-543d-40e8-8291-27b754d89af4 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:50.042450 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2764/5533] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:48 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1697 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:01:50.042927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-26d766e9-543d-40e8-8291-27b754d89af4 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:50.050768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-26d766e9-543d-40e8-8291-27b754d89af4 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:50.053109 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-26d766e9-543d-40e8-8291-27b754d89af4 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:50.054412 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-26d766e9-543d-40e8-8291-27b754d89af4 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:50.055026 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-26d766e9-543d-40e8-8291-27b754d89af4 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:50.080059 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-f66df1f8-10fe-420d-95f8-c72f5bd65122 req-e34e650c-122d-40b2-be42-21bbf249f54e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39263746-004a-4127-ab95-8066c7424b88", "name": "network-vif-unplugged", "status": "completed", "tag": "ba51c9f8-79c0-4e2f-ac91-5186661aa91b"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:01:50.130366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f66df1f8-10fe-420d-95f8-c72f5bd65122 req-e34e650c-122d-40b2-be42-21bbf249f54e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:50.133343 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f66df1f8-10fe-420d-95f8-c72f5bd65122 req-e34e650c-122d-40b2-be42-21bbf249f54e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:50.170138 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-f66df1f8-10fe-420d-95f8-c72f5bd65122 req-e34e650c-122d-40b2-be42-21bbf249f54e service nova] Creating event network-vif-unplugged:ba51c9f8-79c0-4e2f-ac91-5186661aa91b for instance 39263746-004a-4127-ab95-8066c7424b88 on n-h2-847009-3 Jul 19 23:01:50.186480 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-f66df1f8-10fe-420d-95f8-c72f5bd65122 req-e34e650c-122d-40b2-be42-21bbf249f54e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142128 Jul 19 23:01:50.189304 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2765/5534] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:01:50.213034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-26d766e9-543d-40e8-8291-27b754d89af4 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:50.227658 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-26d766e9-543d-40e8-8291-27b754d89af4 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1307 microversion: 2.1 time: 0.196171 Jul 19 23:01:50.236344 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2770/5535] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:50 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1307 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:01:51.047979 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-205c3d3a-602a-4a9c-90dd-53397038ea85 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:51.049304 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-205c3d3a-602a-4a9c-90dd-53397038ea85 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:51.054097 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-81868f87-6b2b-44c8-ad79-fc54e1054e16 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:51.056145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-81868f87-6b2b-44c8-ad79-fc54e1054e16 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] [instance: a67f292a-5ce0-471c-aecc-eaf4217389e9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:51.063705 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-205c3d3a-602a-4a9c-90dd-53397038ea85 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:51.064174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-205c3d3a-602a-4a9c-90dd-53397038ea85 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:51.064978 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-205c3d3a-602a-4a9c-90dd-53397038ea85 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:51.065426 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-205c3d3a-602a-4a9c-90dd-53397038ea85 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:51.079003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81868f87-6b2b-44c8-ad79-fc54e1054e16 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:51.079790 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81868f87-6b2b-44c8-ad79-fc54e1054e16 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:51.082524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81868f87-6b2b-44c8-ad79-fc54e1054e16 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:51.086608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81868f87-6b2b-44c8-ad79-fc54e1054e16 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:51.672517 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-81868f87-6b2b-44c8-ad79-fc54e1054e16 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423460ee1b64eb3bcd8749db6dd42d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c39c18707544d2bb4109d95f1833f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:51.679072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-205c3d3a-602a-4a9c-90dd-53397038ea85 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:51.717638 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-81868f87-6b2b-44c8-ad79-fc54e1054e16 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] 10.222.0.25 "GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9" status: 200 len: 1605 microversion: 2.1 time: 0.662583 Jul 19 23:01:51.722040 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-205c3d3a-602a-4a9c-90dd-53397038ea85 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1682 microversion: 2.1 time: 0.665481 Jul 19 23:01:51.726858 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2771/5536] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:51 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1682 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:01:51.732037 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2766/5537] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:51 2022] GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9 => generated 1605 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:01:51.749257 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0367cf3b-beb8-4828-8ca0-7ae398fa816b tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:51.751812 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3aaf34b8-a032-4187-a65a-3014ecb551ca tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:51.757074 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0367cf3b-beb8-4828-8ca0-7ae398fa816b tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:51.759147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3aaf34b8-a032-4187-a65a-3014ecb551ca tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] [instance: a67f292a-5ce0-471c-aecc-eaf4217389e9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:51.795254 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3aaf34b8-a032-4187-a65a-3014ecb551ca tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:51.797154 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0367cf3b-beb8-4828-8ca0-7ae398fa816b tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:51.797944 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0367cf3b-beb8-4828-8ca0-7ae398fa816b tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:51.798606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3aaf34b8-a032-4187-a65a-3014ecb551ca tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:51.799991 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3aaf34b8-a032-4187-a65a-3014ecb551ca tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:51.800639 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0367cf3b-beb8-4828-8ca0-7ae398fa816b tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:51.801244 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0367cf3b-beb8-4828-8ca0-7ae398fa816b tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:51.801846 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3aaf34b8-a032-4187-a65a-3014ecb551ca tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:52.601478 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3aaf34b8-a032-4187-a65a-3014ecb551ca tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423460ee1b64eb3bcd8749db6dd42d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c39c18707544d2bb4109d95f1833f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:52.618239 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3aaf34b8-a032-4187-a65a-3014ecb551ca tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] 10.222.0.25 "GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9" status: 200 len: 1605 microversion: 2.1 time: 0.876025 Jul 19 23:01:52.620120 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2772/5538] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:51 2022] GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9 => generated 1605 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:01:52.637537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-58a02e96-fd00-4387-a7b3-0d90b386017f tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:52.638440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-58a02e96-fd00-4387-a7b3-0d90b386017f tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] [instance: a67f292a-5ce0-471c-aecc-eaf4217389e9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:52.655228 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0367cf3b-beb8-4828-8ca0-7ae398fa816b tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:52.673602 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0367cf3b-beb8-4828-8ca0-7ae398fa816b tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1362 microversion: 2.1 time: 0.936632 Jul 19 23:01:52.674551 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58a02e96-fd00-4387-a7b3-0d90b386017f tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:52.675088 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58a02e96-fd00-4387-a7b3-0d90b386017f tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:52.676270 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2767/5539] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:51 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1362 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:01:52.676808 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58a02e96-fd00-4387-a7b3-0d90b386017f tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:52.677323 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58a02e96-fd00-4387-a7b3-0d90b386017f tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:52.715323 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:01:53.290723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-58a02e96-fd00-4387-a7b3-0d90b386017f tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423460ee1b64eb3bcd8749db6dd42d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c39c18707544d2bb4109d95f1833f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:53.309276 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-58a02e96-fd00-4387-a7b3-0d90b386017f tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] 10.222.0.25 "GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9" status: 200 len: 1605 microversion: 2.1 time: 0.675153 Jul 19 23:01:53.313014 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2773/5540] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:52 2022] GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9 => generated 1605 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:01:53.694900 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f1b16c17-9778-43ab-bb06-31254d1cba2a tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:53.695650 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f1b16c17-9778-43ab-bb06-31254d1cba2a tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:53.718051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1b16c17-9778-43ab-bb06-31254d1cba2a tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:53.718856 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1b16c17-9778-43ab-bb06-31254d1cba2a tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:53.719530 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1b16c17-9778-43ab-bb06-31254d1cba2a tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:53.719989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1b16c17-9778-43ab-bb06-31254d1cba2a tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:54.017418 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f1b16c17-9778-43ab-bb06-31254d1cba2a tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:54.030001 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f1b16c17-9778-43ab-bb06-31254d1cba2a tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1362 microversion: 2.1 time: 0.339584 Jul 19 23:01:54.031415 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2768/5541] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:53 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1362 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:01:55.009881 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-a872e67c-a50f-4d89-9824-8017ff33c716 req-140817c9-e54f-438c-8ece-88e94c10f9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39263746-004a-4127-ab95-8066c7424b88", "name": "network-vif-plugged", "status": "completed", "tag": "ba51c9f8-79c0-4e2f-ac91-5186661aa91b"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:01:55.045173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a872e67c-a50f-4d89-9824-8017ff33c716 req-140817c9-e54f-438c-8ece-88e94c10f9a3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:55.046953 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a872e67c-a50f-4d89-9824-8017ff33c716 req-140817c9-e54f-438c-8ece-88e94c10f9a3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:55.050639 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f1a4a832-3137-463b-a3c5-9ef4b5b20015 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:55.051536 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f1a4a832-3137-463b-a3c5-9ef4b5b20015 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:55.065574 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1a4a832-3137-463b-a3c5-9ef4b5b20015 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:55.066331 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1a4a832-3137-463b-a3c5-9ef4b5b20015 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:55.067101 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1a4a832-3137-463b-a3c5-9ef4b5b20015 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:55.073060 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-a872e67c-a50f-4d89-9824-8017ff33c716 req-140817c9-e54f-438c-8ece-88e94c10f9a3 service nova] Creating event network-vif-plugged:ba51c9f8-79c0-4e2f-ac91-5186661aa91b for instance 39263746-004a-4127-ab95-8066c7424b88 on n-h2-847009-3 Jul 19 23:01:55.076502 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1a4a832-3137-463b-a3c5-9ef4b5b20015 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:55.088626 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-a872e67c-a50f-4d89-9824-8017ff33c716 req-140817c9-e54f-438c-8ece-88e94c10f9a3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080280 Jul 19 23:01:55.091500 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2774/5542] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:01:55.751612 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-342f7c69-39f5-4928-94cd-87418e111417 req-64b40cb2-b395-418f-8fac-6e22a182e278 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b09fea8b-cf15-4aaf-9e24-4418313a878f", "tag": "1cdfc3b5-378c-4139-bb96-4574c6d99a8d"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:01:55.798116 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-342f7c69-39f5-4928-94cd-87418e111417 req-64b40cb2-b395-418f-8fac-6e22a182e278 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:55.799534 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-342f7c69-39f5-4928-94cd-87418e111417 req-64b40cb2-b395-418f-8fac-6e22a182e278 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:55.828099 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-342f7c69-39f5-4928-94cd-87418e111417 req-64b40cb2-b395-418f-8fac-6e22a182e278 service nova] Creating event network-changed:1cdfc3b5-378c-4139-bb96-4574c6d99a8d for instance b09fea8b-cf15-4aaf-9e24-4418313a878f on n-h2-847009-3 Jul 19 23:01:55.838992 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-342f7c69-39f5-4928-94cd-87418e111417 req-64b40cb2-b395-418f-8fac-6e22a182e278 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091330 Jul 19 23:01:55.852804 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2775/5543] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:01:56.185758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f1a4a832-3137-463b-a3c5-9ef4b5b20015 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:56.197036 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f1a4a832-3137-463b-a3c5-9ef4b5b20015 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1362 microversion: 2.1 time: 1.152781 Jul 19 23:01:56.212492 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2769/5544] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:55 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1362 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:01:57.217806 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7e4dac22-d686-4f76-91a1-17ce50732d4e tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:57.218523 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7e4dac22-d686-4f76-91a1-17ce50732d4e tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:57.221694 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:01:57.222413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:01:57.249062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e4dac22-d686-4f76-91a1-17ce50732d4e tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:57.249518 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e4dac22-d686-4f76-91a1-17ce50732d4e tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:57.250415 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e4dac22-d686-4f76-91a1-17ce50732d4e tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:57.250861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e4dac22-d686-4f76-91a1-17ce50732d4e tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:58.340054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7e4dac22-d686-4f76-91a1-17ce50732d4e tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:01:58.353121 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7e4dac22-d686-4f76-91a1-17ce50732d4e tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1362 microversion: 2.1 time: 1.140316 Jul 19 23:01:58.354411 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2776/5545] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:57 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1362 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:01:59.203824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-110500d8-1508-4893-805f-c282bdfd6496 req-d82cc3c7-ef79-4259-950c-eb2af6ff7af0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a67f292a-5ce0-471c-aecc-eaf4217389e9", "tag": "5cad3db1-cced-43ed-b1fe-1a0112119e1d"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:01:59.209022 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:01:59.220869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-110500d8-1508-4893-805f-c282bdfd6496 req-d82cc3c7-ef79-4259-950c-eb2af6ff7af0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:59.223267 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-110500d8-1508-4893-805f-c282bdfd6496 req-d82cc3c7-ef79-4259-950c-eb2af6ff7af0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:59.372054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eb4b3045-af9f-4e94-9e9b-f9006fdd064c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:01:59.372674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eb4b3045-af9f-4e94-9e9b-f9006fdd064c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:01:59.405928 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb4b3045-af9f-4e94-9e9b-f9006fdd064c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:59.408030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb4b3045-af9f-4e94-9e9b-f9006fdd064c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:59.409916 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb4b3045-af9f-4e94-9e9b-f9006fdd064c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:01:59.411631 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb4b3045-af9f-4e94-9e9b-f9006fdd064c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:01:59.718177 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=95 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:01:59.722313 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-110500d8-1508-4893-805f-c282bdfd6496 req-d82cc3c7-ef79-4259-950c-eb2af6ff7af0 service nova] Creating event network-changed:5cad3db1-cced-43ed-b1fe-1a0112119e1d for instance a67f292a-5ce0-471c-aecc-eaf4217389e9 on n-h1-847009-3 Jul 19 23:01:59.728547 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-110500d8-1508-4893-805f-c282bdfd6496 req-d82cc3c7-ef79-4259-950c-eb2af6ff7af0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.529144 Jul 19 23:01:59.730101 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2770/5546] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:02:00.036993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-eb4b3045-af9f-4e94-9e9b-f9006fdd064c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:02:00.055990 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eb4b3045-af9f-4e94-9e9b-f9006fdd064c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1362 microversion: 2.1 time: 0.686903 Jul 19 23:02:00.069192 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2777/5547] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:01:59 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1362 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:02:01.079493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6b2beabb-a2bb-4fac-a89b-3eff54eac637 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:02:01.081439 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6b2beabb-a2bb-4fac-a89b-3eff54eac637 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:02:01.090339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b2beabb-a2bb-4fac-a89b-3eff54eac637 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:01.093292 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b2beabb-a2bb-4fac-a89b-3eff54eac637 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:01.095248 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b2beabb-a2bb-4fac-a89b-3eff54eac637 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:01.101808 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b2beabb-a2bb-4fac-a89b-3eff54eac637 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:02.209861 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6b2beabb-a2bb-4fac-a89b-3eff54eac637 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:02:02.222345 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6b2beabb-a2bb-4fac-a89b-3eff54eac637 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1362 microversion: 2.1 time: 1.148562 Jul 19 23:02:02.222943 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2771/5548] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:02:01 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1362 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:02:03.240243 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ec9d7012-88e1-4e98-8b88-5b05b5766308 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:02:03.241395 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ec9d7012-88e1-4e98-8b88-5b05b5766308 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:02:03.256727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ec9d7012-88e1-4e98-8b88-5b05b5766308 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:03.257181 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ec9d7012-88e1-4e98-8b88-5b05b5766308 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:03.264579 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ec9d7012-88e1-4e98-8b88-5b05b5766308 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:03.267070 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ec9d7012-88e1-4e98-8b88-5b05b5766308 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:03.614315 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ec9d7012-88e1-4e98-8b88-5b05b5766308 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:02:03.630753 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ec9d7012-88e1-4e98-8b88-5b05b5766308 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1362 microversion: 2.1 time: 0.394696 Jul 19 23:02:03.634710 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2778/5549] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:02:03 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1362 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:02:04.656165 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-71641f31-c2f7-4006-a42d-cb910b424b6d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:02:04.658598 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-71641f31-c2f7-4006-a42d-cb910b424b6d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:02:04.673472 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71641f31-c2f7-4006-a42d-cb910b424b6d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:04.675629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71641f31-c2f7-4006-a42d-cb910b424b6d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:04.677207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71641f31-c2f7-4006-a42d-cb910b424b6d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:04.678983 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71641f31-c2f7-4006-a42d-cb910b424b6d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:04.962094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-71641f31-c2f7-4006-a42d-cb910b424b6d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:02:04.970383 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-71641f31-c2f7-4006-a42d-cb910b424b6d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1362 microversion: 2.1 time: 0.322299 Jul 19 23:02:04.983189 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2772/5550] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:02:04 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:02:05.046570 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-8023eea3-cfea-409d-93a9-939b77caea9e req-2c09342c-b90f-42b2-9fbd-025d4f55a6dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b09fea8b-cf15-4aaf-9e24-4418313a878f", "name": "network-vif-plugged", "status": "completed", "tag": "1cdfc3b5-378c-4139-bb96-4574c6d99a8d"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:02:05.069303 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-8023eea3-cfea-409d-93a9-939b77caea9e req-2c09342c-b90f-42b2-9fbd-025d4f55a6dd service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:05.073155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-8023eea3-cfea-409d-93a9-939b77caea9e req-2c09342c-b90f-42b2-9fbd-025d4f55a6dd service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:05.092902 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-8023eea3-cfea-409d-93a9-939b77caea9e req-2c09342c-b90f-42b2-9fbd-025d4f55a6dd service nova] Creating event network-vif-plugged:1cdfc3b5-378c-4139-bb96-4574c6d99a8d for instance b09fea8b-cf15-4aaf-9e24-4418313a878f on n-h2-847009-3 Jul 19 23:02:05.098992 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-8023eea3-cfea-409d-93a9-939b77caea9e req-2c09342c-b90f-42b2-9fbd-025d4f55a6dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057798 Jul 19 23:02:05.100546 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2779/5551] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:02:05.987926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9dc7ce38-cb12-40d1-bafb-209d5f414fbd tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:02:05.989115 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9dc7ce38-cb12-40d1-bafb-209d5f414fbd tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:02:06.001784 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9dc7ce38-cb12-40d1-bafb-209d5f414fbd tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:06.007834 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9dc7ce38-cb12-40d1-bafb-209d5f414fbd tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:06.008792 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9dc7ce38-cb12-40d1-bafb-209d5f414fbd tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:06.009317 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9dc7ce38-cb12-40d1-bafb-209d5f414fbd tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:06.593247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9dc7ce38-cb12-40d1-bafb-209d5f414fbd tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:02:06.601999 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9dc7ce38-cb12-40d1-bafb-209d5f414fbd tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1362 microversion: 2.1 time: 0.618542 Jul 19 23:02:06.609116 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2773/5552] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:02:05 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1362 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:02:07.694962 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c68e9727-5321-45b4-8ec5-162f68b7f31c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:02:07.696642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c68e9727-5321-45b4-8ec5-162f68b7f31c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:02:07.724198 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c68e9727-5321-45b4-8ec5-162f68b7f31c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:07.725461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c68e9727-5321-45b4-8ec5-162f68b7f31c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:07.727699 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c68e9727-5321-45b4-8ec5-162f68b7f31c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:07.731138 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c68e9727-5321-45b4-8ec5-162f68b7f31c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:08.065466 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c68e9727-5321-45b4-8ec5-162f68b7f31c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:02:08.079838 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c68e9727-5321-45b4-8ec5-162f68b7f31c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1362 microversion: 2.1 time: 0.451240 Jul 19 23:02:08.080482 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2780/5553] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:02:07 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1362 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:02:09.107410 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ab4d8566-bcb6-4f2d-8ad9-6b68095a488f tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:02:09.108044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ab4d8566-bcb6-4f2d-8ad9-6b68095a488f tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:02:09.118221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab4d8566-bcb6-4f2d-8ad9-6b68095a488f tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:09.123900 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab4d8566-bcb6-4f2d-8ad9-6b68095a488f tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:09.127978 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab4d8566-bcb6-4f2d-8ad9-6b68095a488f tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:09.128655 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab4d8566-bcb6-4f2d-8ad9-6b68095a488f tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:09.882336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ab4d8566-bcb6-4f2d-8ad9-6b68095a488f tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:02:09.908389 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ab4d8566-bcb6-4f2d-8ad9-6b68095a488f tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1546 microversion: 2.1 time: 0.800903 Jul 19 23:02:09.909090 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2774/5554] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:02:09 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1546 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:02:09.931144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d9822c8c-872c-4bb9-85d7-3ffd9864a3ad tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:02:09.931790 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d9822c8c-872c-4bb9-85d7-3ffd9864a3ad tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:02:09.939914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:02:09.968718 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d9822c8c-872c-4bb9-85d7-3ffd9864a3ad tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:09.969189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d9822c8c-872c-4bb9-85d7-3ffd9864a3ad tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:09.970513 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d9822c8c-872c-4bb9-85d7-3ffd9864a3ad tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:09.971467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d9822c8c-872c-4bb9-85d7-3ffd9864a3ad tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:10.514443 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d9822c8c-872c-4bb9-85d7-3ffd9864a3ad tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.589475 Jul 19 23:02:10.522611 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2781/5555] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 19 23:02:09 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f/os-interface => generated 284 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:02:12.986661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-2bb34e05-f7d1-4ff9-b914-e12c2d404e6c req-a1a3d59f-9f1d-43fd-bcef-19d51434b9fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b09fea8b-cf15-4aaf-9e24-4418313a878f", "tag": "1cdfc3b5-378c-4139-bb96-4574c6d99a8d"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:02:12.991546 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:02:13.012219 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-2bb34e05-f7d1-4ff9-b914-e12c2d404e6c req-a1a3d59f-9f1d-43fd-bcef-19d51434b9fa service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:13.013476 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-2bb34e05-f7d1-4ff9-b914-e12c2d404e6c req-a1a3d59f-9f1d-43fd-bcef-19d51434b9fa service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:13.056566 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-2bb34e05-f7d1-4ff9-b914-e12c2d404e6c req-a1a3d59f-9f1d-43fd-bcef-19d51434b9fa service nova] Creating event network-changed:1cdfc3b5-378c-4139-bb96-4574c6d99a8d for instance b09fea8b-cf15-4aaf-9e24-4418313a878f on n-h2-847009-3 Jul 19 23:02:13.067889 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-2bb34e05-f7d1-4ff9-b914-e12c2d404e6c req-a1a3d59f-9f1d-43fd-bcef-19d51434b9fa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.373055 Jul 19 23:02:13.068504 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2775/5556] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:02:20.400621 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:02:20.402398 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=36 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:02:20.410199 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-322567d8-682d-4123-812c-86484d1cf6dc tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:02:20.423008 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-322567d8-682d-4123-812c-86484d1cf6dc tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:02:20.454510 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-322567d8-682d-4123-812c-86484d1cf6dc tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:20.455389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-322567d8-682d-4123-812c-86484d1cf6dc tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:20.456113 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-322567d8-682d-4123-812c-86484d1cf6dc tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:20.456628 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-322567d8-682d-4123-812c-86484d1cf6dc tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:20.649352 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-322567d8-682d-4123-812c-86484d1cf6dc tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "POST /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88/action" status: 200 len: 24568 microversion: 2.1 time: 0.250648 Jul 19 23:02:20.663077 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2782/5557] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:02:20 2022] POST /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88/action => generated 24568 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 23:02:33.547747 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:02:33.548966 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=27 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:02:33.556889 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-45bebfe8-e3a1-444c-b2a3-86cba9f3eeb1 req-b2aadde2-91d7-4e76-bca0-275deb20c4b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39263746-004a-4127-ab95-8066c7424b88", "tag": "ba51c9f8-79c0-4e2f-ac91-5186661aa91b"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:02:33.562593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6d34e0a4-65c4-4919-92cd-3b0e7cbb86b7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:02:33.562593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6d34e0a4-65c4-4919-92cd-3b0e7cbb86b7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:02:33.578486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6d34e0a4-65c4-4919-92cd-3b0e7cbb86b7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:33.582382 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6d34e0a4-65c4-4919-92cd-3b0e7cbb86b7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:33.583416 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6d34e0a4-65c4-4919-92cd-3b0e7cbb86b7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:33.583981 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6d34e0a4-65c4-4919-92cd-3b0e7cbb86b7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:33.596327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:02:33.598187 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=4 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:02:33.609968 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-45bebfe8-e3a1-444c-b2a3-86cba9f3eeb1 req-b2aadde2-91d7-4e76-bca0-275deb20c4b5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:33.612110 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-45bebfe8-e3a1-444c-b2a3-86cba9f3eeb1 req-b2aadde2-91d7-4e76-bca0-275deb20c4b5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:33.672428 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-45bebfe8-e3a1-444c-b2a3-86cba9f3eeb1 req-b2aadde2-91d7-4e76-bca0-275deb20c4b5 service nova] Creating event network-changed:ba51c9f8-79c0-4e2f-ac91-5186661aa91b for instance 39263746-004a-4127-ab95-8066c7424b88 on n-h2-847009-3 Jul 19 23:02:33.687337 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-45bebfe8-e3a1-444c-b2a3-86cba9f3eeb1 req-b2aadde2-91d7-4e76-bca0-275deb20c4b5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134326 Jul 19 23:02:33.691190 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2783/5558] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:02:33.702416 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6d34e0a4-65c4-4919-92cd-3b0e7cbb86b7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:02:34.011561 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6d34e0a4-65c4-4919-92cd-3b0e7cbb86b7 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "DELETE /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 204 len: 0 microversion: 2.1 time: 0.464197 Jul 19 23:02:34.016998 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2776/5559] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:02:33 2022] DELETE /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:02:34.024594 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bb3a226e-26d3-4fe6-88d2-04760ca10ef5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:02:34.025976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bb3a226e-26d3-4fe6-88d2-04760ca10ef5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:02:34.046732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb3a226e-26d3-4fe6-88d2-04760ca10ef5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:34.051041 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb3a226e-26d3-4fe6-88d2-04760ca10ef5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:34.056497 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb3a226e-26d3-4fe6-88d2-04760ca10ef5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:34.058867 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb3a226e-26d3-4fe6-88d2-04760ca10ef5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:35.099768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bb3a226e-26d3-4fe6-88d2-04760ca10ef5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:02:35.112608 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bb3a226e-26d3-4fe6-88d2-04760ca10ef5 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1688 microversion: 2.1 time: 1.093941 Jul 19 23:02:35.129759 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2784/5560] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:02:34 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1688 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:02:36.177860 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-316bb876-3e37-40fe-815c-e2314644aa55 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:02:36.178589 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-316bb876-3e37-40fe-815c-e2314644aa55 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:02:36.186325 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-316bb876-3e37-40fe-815c-e2314644aa55 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:36.186787 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-316bb876-3e37-40fe-815c-e2314644aa55 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:36.203997 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-316bb876-3e37-40fe-815c-e2314644aa55 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:36.204480 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-316bb876-3e37-40fe-815c-e2314644aa55 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:36.333724 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7473762b-f9e3-4258-89d2-f3324cc2fd24 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:02:36.337240 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7473762b-f9e3-4258-89d2-f3324cc2fd24 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] [instance: a67f292a-5ce0-471c-aecc-eaf4217389e9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:02:36.354968 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7473762b-f9e3-4258-89d2-f3324cc2fd24 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:36.355863 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7473762b-f9e3-4258-89d2-f3324cc2fd24 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:36.356917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7473762b-f9e3-4258-89d2-f3324cc2fd24 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:36.363232 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7473762b-f9e3-4258-89d2-f3324cc2fd24 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:36.442014 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7473762b-f9e3-4258-89d2-f3324cc2fd24 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] 10.222.0.25 "GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.114685 Jul 19 23:02:36.452031 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2785/5561] 10.222.0.25 () {58 vars in 1292 bytes} [Tue Jul 19 23:02:36 2022] GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9/os-server-password => generated 116 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:02:36.512738 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-316bb876-3e37-40fe-815c-e2314644aa55 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:02:36.531205 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-316bb876-3e37-40fe-815c-e2314644aa55 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1688 microversion: 2.1 time: 0.397700 Jul 19 23:02:36.538622 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2777/5562] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:02:36 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1688 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:02:37.558921 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2cc83eea-58ab-4999-a1e6-47fc7f5aaf25 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:02:37.559714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2cc83eea-58ab-4999-a1e6-47fc7f5aaf25 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:02:37.566810 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2cc83eea-58ab-4999-a1e6-47fc7f5aaf25 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:37.567413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2cc83eea-58ab-4999-a1e6-47fc7f5aaf25 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:37.568352 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2cc83eea-58ab-4999-a1e6-47fc7f5aaf25 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:37.568941 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2cc83eea-58ab-4999-a1e6-47fc7f5aaf25 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:37.752405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2cc83eea-58ab-4999-a1e6-47fc7f5aaf25 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:02:37.765822 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2cc83eea-58ab-4999-a1e6-47fc7f5aaf25 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1569 microversion: 2.1 time: 0.213706 Jul 19 23:02:37.781773 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2786/5563] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:02:37 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1569 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:02:38.425802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-b00f510b-3909-4ca2-9878-8a391613bc3f req-de90c30b-787f-4163-b5c8-bb646b4d653d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39263746-004a-4127-ab95-8066c7424b88", "name": "network-vif-deleted", "tag": "ba51c9f8-79c0-4e2f-ac91-5186661aa91b"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:02:38.446850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b00f510b-3909-4ca2-9878-8a391613bc3f req-de90c30b-787f-4163-b5c8-bb646b4d653d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:38.451419 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b00f510b-3909-4ca2-9878-8a391613bc3f req-de90c30b-787f-4163-b5c8-bb646b4d653d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:38.486085 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-b00f510b-3909-4ca2-9878-8a391613bc3f req-de90c30b-787f-4163-b5c8-bb646b4d653d service nova] Creating event network-vif-deleted:ba51c9f8-79c0-4e2f-ac91-5186661aa91b for instance 39263746-004a-4127-ab95-8066c7424b88 on n-h2-847009-3 Jul 19 23:02:38.502629 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-b00f510b-3909-4ca2-9878-8a391613bc3f req-de90c30b-787f-4163-b5c8-bb646b4d653d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084591 Jul 19 23:02:38.504712 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2778/5564] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:02:38.787542 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b7607fae-409c-4b05-b28f-bb31fbc76e99 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:02:38.788576 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b7607fae-409c-4b05-b28f-bb31fbc76e99 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:02:38.808876 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7607fae-409c-4b05-b28f-bb31fbc76e99 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:38.811978 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7607fae-409c-4b05-b28f-bb31fbc76e99 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:38.813007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7607fae-409c-4b05-b28f-bb31fbc76e99 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:38.814283 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7607fae-409c-4b05-b28f-bb31fbc76e99 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:38.895035 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7607fae-409c-4b05-b28f-bb31fbc76e99 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:38.902467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7607fae-409c-4b05-b28f-bb31fbc76e99 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:38.902955 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-b7607fae-409c-4b05-b28f-bb31fbc76e99 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lazy-loading 'fault' on Instance uuid 39263746-004a-4127-ab95-8066c7424b88 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:02:39.100639 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b7607fae-409c-4b05-b28f-bb31fbc76e99 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdbbdf932b43b38725f60dadc738c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56c5370d5846f8a8c1535c127c0e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:02:39.115440 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b7607fae-409c-4b05-b28f-bb31fbc76e99 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 200 len: 1356 microversion: 2.1 time: 0.333219 Jul 19 23:02:39.143147 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2787/5565] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:02:38 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 1356 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:02:40.163134 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8536641a-dad4-467a-999a-418be3f65aa2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:02:40.163971 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8536641a-dad4-467a-999a-418be3f65aa2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] [instance: 39263746-004a-4127-ab95-8066c7424b88] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:02:40.186106 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8536641a-dad4-467a-999a-418be3f65aa2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:40.186717 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8536641a-dad4-467a-999a-418be3f65aa2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:40.187942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8536641a-dad4-467a-999a-418be3f65aa2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:40.188500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8536641a-dad4-467a-999a-418be3f65aa2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:40.213546 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-8536641a-dad4-467a-999a-418be3f65aa2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] HTTP exception thrown: Instance 39263746-004a-4127-ab95-8066c7424b88 could not be found. Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8536641a-dad4-467a-999a-418be3f65aa2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Request method failure captured: Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 HTTP/1.1 Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zUdF3dTnB0MnLNSU90xG3Mpx7x6_lVTVWk_kalEUBRonF6TVdUymuHFpNlc_2myDjPcJPfG0PGHn_BgqvSGWVp3Gv6a0lkSSx5re0O2646fcLC_MOcllI85X5Gsa3U5ByfiHlS7DUHyk3xHJ5Y4v938fzhiDGHEEqMMUHs8ls1DEl4 Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 4b56c5370d5846f8a8c1535c127c0e12 Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1194986010 Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b56c5370d5846f8a8c1535c127c0e12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b56c5370d5846f8a8c1535c127c0e12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b56c5370d5846f8a8c1535c127c0e12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b56c5370d5846f8a8c1535c127c0e12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1194986010 Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 4b56c5370d5846f8a8c1535c127c0e12 Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1194986010 Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TestNetworkAdvancedServerOps-1194986010-project Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: dcfdbbdf932b43b38725f60dadc738c9 Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1194986010-project Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 39263746-004a-4127-ab95-8066c7424b88 could not be found. Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '39263746-004a-4127-ab95-8066c7424b88'} Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39263746-004a-4127-ab95-8066c7424b88 could not be found. Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39263746-004a-4127-ab95-8066c7424b88 could not be found. Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:02:40.215314 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:02:40.219992 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:02:40.219992 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:02:40.219992 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:02:40.219992 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:02:40.219992 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:02:40.219992 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:02:40.219992 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39263746-004a-4127-ab95-8066c7424b88 could not be found. Jul 19 23:02:40.219992 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:02:40.221759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8536641a-dad4-467a-999a-418be3f65aa2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Returning 404 to user: Instance 39263746-004a-4127-ab95-8066c7424b88 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:02:40.222917 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8536641a-dad4-467a-999a-418be3f65aa2 tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88" status: 404 len: 111 microversion: 2.1 time: 0.064862 Jul 19 23:02:40.228035 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2779/5566] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:02:40 2022] GET /compute/v2.1/servers/39263746-004a-4127-ab95-8066c7424b88 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:02:48.404670 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1f69c398-03e4-4768-9c46-5d9b917d6451 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:02:48.405846 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1f69c398-03e4-4768-9c46-5d9b917d6451 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:02:48.417689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1f69c398-03e4-4768-9c46-5d9b917d6451 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:48.420602 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1f69c398-03e4-4768-9c46-5d9b917d6451 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:48.422502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1f69c398-03e4-4768-9c46-5d9b917d6451 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:48.424786 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1f69c398-03e4-4768-9c46-5d9b917d6451 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:48.471324 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1f69c398-03e4-4768-9c46-5d9b917d6451 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f/ips" status: 200 len: 144 microversion: 2.1 time: 0.071365 Jul 19 23:02:48.479664 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2788/5567] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 19 23:02:48 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f/ips => generated 144 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:02:50.267825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0c1006ff-9df3-49c0-9218-a3ab1256a9db tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] Calling method '.version_select at 0x7f7a1556e1f0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:02:50.287040 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:02:50.289886 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:02:50.418413 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0c1006ff-9df3-49c0-9218-a3ab1256a9db tempest-TestNetworkAdvancedServerOps-1194986010 tempest-TestNetworkAdvancedServerOps-1194986010-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-382381649" status: 202 len: 0 microversion: 2.1 time: 0.155047 Jul 19 23:02:50.423403 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2780/5568] 10.222.0.25 () {58 vars in 1280 bytes} [Tue Jul 19 23:02:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-382381649 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:02:54.981197 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9fd899b3-a8af-4c5b-929a-3fb6bcce9fe7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6bbd023e-e27b-4ba8-9400-f33a0e5ed8e6"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:02:54.983190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9fd899b3-a8af-4c5b-929a-3fb6bcce9fe7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:02:55.013705 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9fd899b3-a8af-4c5b-929a-3fb6bcce9fe7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:55.014303 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9fd899b3-a8af-4c5b-929a-3fb6bcce9fe7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:55.018491 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9fd899b3-a8af-4c5b-929a-3fb6bcce9fe7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:02:55.018491 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9fd899b3-a8af-4c5b-929a-3fb6bcce9fe7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:02:55.522989 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9fd899b3-a8af-4c5b-929a-3fb6bcce9fe7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "POST /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.547809 Jul 19 23:02:55.526445 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2789/5569] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 19 23:02:54 2022] POST /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f/os-volume_attachments => generated 194 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:03:02.062434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:03:02.435442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-44af2986-b707-4212-8041-71749d7b5d63 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1615304960", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "0af44705-efff-40a0-ae5e-605763c70b15"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:03:02.539580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-44af2986-b707-4212-8041-71749d7b5d63 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] validate_networks() for [('0af44705-efff-40a0-ae5e-605763c70b15', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:03:03.235473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-44af2986-b707-4212-8041-71749d7b5d63 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:03:03.236739 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-44af2986-b707-4212-8041-71749d7b5d63 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:03:03.237456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-44af2986-b707-4212-8041-71749d7b5d63 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:03:03.238101 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-44af2986-b707-4212-8041-71749d7b5d63 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:03:03.238761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-44af2986-b707-4212-8041-71749d7b5d63 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:03:03.258474 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44af2986-b707-4212-8041-71749d7b5d63 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:03.259419 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44af2986-b707-4212-8041-71749d7b5d63 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:03.263503 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44af2986-b707-4212-8041-71749d7b5d63 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:03.264261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44af2986-b707-4212-8041-71749d7b5d63 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:03.295235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-44af2986-b707-4212-8041-71749d7b5d63 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Getting quotas for project d40bc2d4dde948b2a1be0b9041ee6ad0. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:03:03.302402 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-44af2986-b707-4212-8041-71749d7b5d63 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Getting quotas for user 6390037906f448fc9c7610dbf45f09b3 and project d40bc2d4dde948b2a1be0b9041ee6ad0. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:03:03.320389 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-44af2986-b707-4212-8041-71749d7b5d63 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:03:03.325408 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-44af2986-b707-4212-8041-71749d7b5d63 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:03:03.440351 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-44af2986-b707-4212-8041-71749d7b5d63 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.383360 Jul 19 23:03:03.441666 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2781/5570] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:03:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:03:03.453940 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ef01a81d-394b-459c-b825-da3e9235c3a1 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:03.454930 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ef01a81d-394b-459c-b825-da3e9235c3a1 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:03.614353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ef01a81d-394b-459c-b825-da3e9235c3a1 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390037906f448fc9c7610dbf45f09b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40bc2d4dde948b2a1be0b9041ee6ad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:03.623717 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ef01a81d-394b-459c-b825-da3e9235c3a1 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 200 len: 1215 microversion: 2.1 time: 0.174293 Jul 19 23:03:03.624952 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2790/5571] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:03 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 1215 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:04.643180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-69496c58-32ba-4d68-beb5-d5da11e3148f tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:04.643811 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-69496c58-32ba-4d68-beb5-d5da11e3148f tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:04.768252 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-69496c58-32ba-4d68-beb5-d5da11e3148f tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390037906f448fc9c7610dbf45f09b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40bc2d4dde948b2a1be0b9041ee6ad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:04.778741 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-69496c58-32ba-4d68-beb5-d5da11e3148f tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 200 len: 1215 microversion: 2.1 time: 0.140799 Jul 19 23:03:04.780023 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2782/5572] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:04 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 1215 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:05.797674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-069541cb-d956-47e9-b467-8986962fb7dc tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:05.798444 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-069541cb-d956-47e9-b467-8986962fb7dc tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:05.804317 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:03:05.815303 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=21 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:03:05.835517 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-069541cb-d956-47e9-b467-8986962fb7dc tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:05.836608 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-069541cb-d956-47e9-b467-8986962fb7dc tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:05.838366 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-069541cb-d956-47e9-b467-8986962fb7dc tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:05.839046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-069541cb-d956-47e9-b467-8986962fb7dc tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:05.982453 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-069541cb-d956-47e9-b467-8986962fb7dc tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390037906f448fc9c7610dbf45f09b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40bc2d4dde948b2a1be0b9041ee6ad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:05.994032 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-069541cb-d956-47e9-b467-8986962fb7dc tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 200 len: 1267 microversion: 2.1 time: 0.200824 Jul 19 23:03:06.007175 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2791/5573] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:05 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:07.026897 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3e4e231f-469e-41b2-8f10-10b010a4d985 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:07.028272 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3e4e231f-469e-41b2-8f10-10b010a4d985 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:07.045012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e4e231f-469e-41b2-8f10-10b010a4d985 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:07.049962 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e4e231f-469e-41b2-8f10-10b010a4d985 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:07.051070 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e4e231f-469e-41b2-8f10-10b010a4d985 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:07.051723 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e4e231f-469e-41b2-8f10-10b010a4d985 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:07.336224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3e4e231f-469e-41b2-8f10-10b010a4d985 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390037906f448fc9c7610dbf45f09b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40bc2d4dde948b2a1be0b9041ee6ad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:07.349911 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3e4e231f-469e-41b2-8f10-10b010a4d985 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 200 len: 1273 microversion: 2.1 time: 0.324667 Jul 19 23:03:07.350871 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2783/5574] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:07 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 1273 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:08.372039 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a3a09035-c4bc-4e98-897a-25e78d8044bd tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:08.374237 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a3a09035-c4bc-4e98-897a-25e78d8044bd tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:08.386657 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a3a09035-c4bc-4e98-897a-25e78d8044bd tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:08.388966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a3a09035-c4bc-4e98-897a-25e78d8044bd tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:08.392165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a3a09035-c4bc-4e98-897a-25e78d8044bd tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:08.393156 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a3a09035-c4bc-4e98-897a-25e78d8044bd tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:08.740197 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a3a09035-c4bc-4e98-897a-25e78d8044bd tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390037906f448fc9c7610dbf45f09b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40bc2d4dde948b2a1be0b9041ee6ad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:08.756393 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a3a09035-c4bc-4e98-897a-25e78d8044bd tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 200 len: 1315 microversion: 2.1 time: 0.388170 Jul 19 23:03:08.756999 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2792/5575] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:08 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:09.557182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-7508e734-6709-4b44-8b57-13b182558e62 req-f647aedd-2258-4cc5-a6ea-8860d3bfc331 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e314e43-2bbd-42d2-9429-c8d3885d605d", "tag": "22fecfee-2c3e-4000-8e32-9a56e5324bef"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:03:09.576630 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7508e734-6709-4b44-8b57-13b182558e62 req-f647aedd-2258-4cc5-a6ea-8860d3bfc331 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:09.577080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7508e734-6709-4b44-8b57-13b182558e62 req-f647aedd-2258-4cc5-a6ea-8860d3bfc331 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:09.601367 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-7508e734-6709-4b44-8b57-13b182558e62 req-f647aedd-2258-4cc5-a6ea-8860d3bfc331 service nova] Creating event network-changed:22fecfee-2c3e-4000-8e32-9a56e5324bef for instance 3e314e43-2bbd-42d2-9429-c8d3885d605d on n-h1-847009-3 Jul 19 23:03:09.614608 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-7508e734-6709-4b44-8b57-13b182558e62 req-f647aedd-2258-4cc5-a6ea-8860d3bfc331 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062234 Jul 19 23:03:09.615985 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2784/5576] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:03:09.773704 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fdda05ba-0b31-45cf-a0b0-7d5eb78d9e78 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:09.776300 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fdda05ba-0b31-45cf-a0b0-7d5eb78d9e78 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:09.790232 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fdda05ba-0b31-45cf-a0b0-7d5eb78d9e78 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:09.791477 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fdda05ba-0b31-45cf-a0b0-7d5eb78d9e78 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:09.793517 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fdda05ba-0b31-45cf-a0b0-7d5eb78d9e78 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:09.793974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fdda05ba-0b31-45cf-a0b0-7d5eb78d9e78 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:10.156983 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fdda05ba-0b31-45cf-a0b0-7d5eb78d9e78 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390037906f448fc9c7610dbf45f09b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40bc2d4dde948b2a1be0b9041ee6ad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:10.167811 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fdda05ba-0b31-45cf-a0b0-7d5eb78d9e78 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 200 len: 1315 microversion: 2.1 time: 0.397966 Jul 19 23:03:10.179663 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2793/5577] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:09 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:11.199795 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-127f1a07-8988-4b2c-b95d-6996055af3e8 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:11.200530 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-127f1a07-8988-4b2c-b95d-6996055af3e8 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:11.231364 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-127f1a07-8988-4b2c-b95d-6996055af3e8 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:11.232803 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-127f1a07-8988-4b2c-b95d-6996055af3e8 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:11.234181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-127f1a07-8988-4b2c-b95d-6996055af3e8 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:11.250831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-127f1a07-8988-4b2c-b95d-6996055af3e8 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:12.052512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-127f1a07-8988-4b2c-b95d-6996055af3e8 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390037906f448fc9c7610dbf45f09b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40bc2d4dde948b2a1be0b9041ee6ad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:12.063712 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-127f1a07-8988-4b2c-b95d-6996055af3e8 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 200 len: 1315 microversion: 2.1 time: 0.878932 Jul 19 23:03:12.065625 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2785/5578] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:11 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 1315 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:13.082067 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5b057499-3e6f-49f9-86ea-93b575240fe8 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:13.082737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5b057499-3e6f-49f9-86ea-93b575240fe8 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:13.092935 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b057499-3e6f-49f9-86ea-93b575240fe8 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:13.093392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b057499-3e6f-49f9-86ea-93b575240fe8 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:13.097923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b057499-3e6f-49f9-86ea-93b575240fe8 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:13.098654 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b057499-3e6f-49f9-86ea-93b575240fe8 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:13.321229 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5b057499-3e6f-49f9-86ea-93b575240fe8 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390037906f448fc9c7610dbf45f09b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40bc2d4dde948b2a1be0b9041ee6ad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:13.348851 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5b057499-3e6f-49f9-86ea-93b575240fe8 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 200 len: 1315 microversion: 2.1 time: 0.270535 Jul 19 23:03:13.352625 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2794/5579] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:13 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:13.853321 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-76eda6e4-adbc-4bed-9158-484ab8751419 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:03:13.856933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:03:13.877633 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-76eda6e4-adbc-4bed-9158-484ab8751419 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:13.879935 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-76eda6e4-adbc-4bed-9158-484ab8751419 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:13.968080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-76eda6e4-adbc-4bed-9158-484ab8751419 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Going to try to stop instance {{(pid=119338) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 23:03:14.080892 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-76eda6e4-adbc-4bed-9158-484ab8751419 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "POST /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f/action" status: 202 len: 0 microversion: 2.1 time: 0.218126 Jul 19 23:03:14.088141 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2786/5580] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:03:13 2022] POST /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:03:14.093863 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3b146f48-abe7-4113-aa41-6ea718b77f57 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:14.094507 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3b146f48-abe7-4113-aa41-6ea718b77f57 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:14.098212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:03:14.128478 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b146f48-abe7-4113-aa41-6ea718b77f57 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:14.130857 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b146f48-abe7-4113-aa41-6ea718b77f57 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:14.142543 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b146f48-abe7-4113-aa41-6ea718b77f57 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:14.143678 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b146f48-abe7-4113-aa41-6ea718b77f57 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:14.369929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6c744421-63e4-4fa4-97b3-5a33084b6195 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:14.371186 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6c744421-63e4-4fa4-97b3-5a33084b6195 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:14.389877 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c744421-63e4-4fa4-97b3-5a33084b6195 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:14.390341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c744421-63e4-4fa4-97b3-5a33084b6195 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:14.391364 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c744421-63e4-4fa4-97b3-5a33084b6195 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:14.391813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c744421-63e4-4fa4-97b3-5a33084b6195 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:14.629947 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3b146f48-abe7-4113-aa41-6ea718b77f57 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:14.639785 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3b146f48-abe7-4113-aa41-6ea718b77f57 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1721 microversion: 2.1 time: 0.552858 Jul 19 23:03:14.650408 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2795/5581] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:14 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1721 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:03:14.775262 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=8 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:03:14.815671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6c744421-63e4-4fa4-97b3-5a33084b6195 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390037906f448fc9c7610dbf45f09b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40bc2d4dde948b2a1be0b9041ee6ad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:14.830723 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6c744421-63e4-4fa4-97b3-5a33084b6195 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 200 len: 1315 microversion: 2.1 time: 0.466094 Jul 19 23:03:14.833579 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2787/5582] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:14 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:15.670172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3724a129-b018-4eb4-819b-80d5b0f63cb3 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:15.672177 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3724a129-b018-4eb4-819b-80d5b0f63cb3 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:15.688155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3724a129-b018-4eb4-819b-80d5b0f63cb3 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:15.688621 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3724a129-b018-4eb4-819b-80d5b0f63cb3 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:15.689590 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3724a129-b018-4eb4-819b-80d5b0f63cb3 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:15.695577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3724a129-b018-4eb4-819b-80d5b0f63cb3 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:15.850697 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3a312528-e10d-482d-81fd-0cd4227f1d49 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:15.852152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3a312528-e10d-482d-81fd-0cd4227f1d49 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:15.873751 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a312528-e10d-482d-81fd-0cd4227f1d49 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:15.874805 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a312528-e10d-482d-81fd-0cd4227f1d49 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:15.880348 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a312528-e10d-482d-81fd-0cd4227f1d49 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:15.882578 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a312528-e10d-482d-81fd-0cd4227f1d49 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:16.211907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3724a129-b018-4eb4-819b-80d5b0f63cb3 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:16.229725 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3724a129-b018-4eb4-819b-80d5b0f63cb3 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1721 microversion: 2.1 time: 0.567903 Jul 19 23:03:16.230626 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2796/5583] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:15 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1721 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:16.235644 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-1f295f34-a802-4b5b-b676-bd9f49f79728 req-1e396966-d43d-4811-82e9-494a92c6d212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e314e43-2bbd-42d2-9429-c8d3885d605d", "name": "network-vif-plugged", "status": "completed", "tag": "22fecfee-2c3e-4000-8e32-9a56e5324bef"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:03:16.257123 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1f295f34-a802-4b5b-b676-bd9f49f79728 req-1e396966-d43d-4811-82e9-494a92c6d212 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:16.267498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1f295f34-a802-4b5b-b676-bd9f49f79728 req-1e396966-d43d-4811-82e9-494a92c6d212 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:16.307522 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-1f295f34-a802-4b5b-b676-bd9f49f79728 req-1e396966-d43d-4811-82e9-494a92c6d212 service nova] Creating event network-vif-plugged:22fecfee-2c3e-4000-8e32-9a56e5324bef for instance 3e314e43-2bbd-42d2-9429-c8d3885d605d on n-h1-847009-3 Jul 19 23:03:16.317495 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-1f295f34-a802-4b5b-b676-bd9f49f79728 req-1e396966-d43d-4811-82e9-494a92c6d212 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085274 Jul 19 23:03:16.320079 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2797/5584] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:03:16.490265 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3a312528-e10d-482d-81fd-0cd4227f1d49 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390037906f448fc9c7610dbf45f09b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40bc2d4dde948b2a1be0b9041ee6ad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:16.503468 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3a312528-e10d-482d-81fd-0cd4227f1d49 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 200 len: 1315 microversion: 2.1 time: 0.656860 Jul 19 23:03:16.504883 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2788/5585] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:15 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 1315 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:17.038652 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:03:17.039067 n-d-847009-3 devstack@n-api.service[119337]: Tue Jul 19 23:03:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:03:17.249743 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-de8a1fd2-c29a-48df-82a1-6d704c1aed17 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:17.250468 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-de8a1fd2-c29a-48df-82a1-6d704c1aed17 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:17.277153 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de8a1fd2-c29a-48df-82a1-6d704c1aed17 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:17.277624 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de8a1fd2-c29a-48df-82a1-6d704c1aed17 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:17.278409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de8a1fd2-c29a-48df-82a1-6d704c1aed17 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:17.278856 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de8a1fd2-c29a-48df-82a1-6d704c1aed17 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:17.521660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e30db8e7-70ef-4329-b9e9-4c7e18aeefb2 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:17.523039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e30db8e7-70ef-4329-b9e9-4c7e18aeefb2 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:17.552240 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e30db8e7-70ef-4329-b9e9-4c7e18aeefb2 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:17.556372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e30db8e7-70ef-4329-b9e9-4c7e18aeefb2 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:17.559786 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e30db8e7-70ef-4329-b9e9-4c7e18aeefb2 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:17.561524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e30db8e7-70ef-4329-b9e9-4c7e18aeefb2 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:17.851596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-de8a1fd2-c29a-48df-82a1-6d704c1aed17 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:17.865382 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-de8a1fd2-c29a-48df-82a1-6d704c1aed17 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1721 microversion: 2.1 time: 0.618261 Jul 19 23:03:17.877636 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2798/5586] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:17 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1721 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:17.919147 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e30db8e7-70ef-4329-b9e9-4c7e18aeefb2 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390037906f448fc9c7610dbf45f09b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40bc2d4dde948b2a1be0b9041ee6ad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:17.930097 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e30db8e7-70ef-4329-b9e9-4c7e18aeefb2 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 200 len: 1315 microversion: 2.1 time: 0.412562 Jul 19 23:03:17.930596 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2789/5587] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:17 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:18.884550 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-87a3db83-08d3-4b61-958b-c0b6a5124369 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:18.885319 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-87a3db83-08d3-4b61-958b-c0b6a5124369 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:18.904693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-87a3db83-08d3-4b61-958b-c0b6a5124369 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:18.921939 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-87a3db83-08d3-4b61-958b-c0b6a5124369 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:18.927350 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-87a3db83-08d3-4b61-958b-c0b6a5124369 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:18.930154 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-87a3db83-08d3-4b61-958b-c0b6a5124369 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:18.947577 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6fdfd805-4519-4488-ae04-f0896d63e28d tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:18.948373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6fdfd805-4519-4488-ae04-f0896d63e28d tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:18.962354 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6fdfd805-4519-4488-ae04-f0896d63e28d tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:18.962774 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6fdfd805-4519-4488-ae04-f0896d63e28d tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:18.963734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6fdfd805-4519-4488-ae04-f0896d63e28d tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:18.967570 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6fdfd805-4519-4488-ae04-f0896d63e28d tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:19.324532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-87a3db83-08d3-4b61-958b-c0b6a5124369 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:19.333218 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-87a3db83-08d3-4b61-958b-c0b6a5124369 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1721 microversion: 2.1 time: 0.453052 Jul 19 23:03:19.338291 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2799/5588] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:18 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1721 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:19.363892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6fdfd805-4519-4488-ae04-f0896d63e28d tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390037906f448fc9c7610dbf45f09b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40bc2d4dde948b2a1be0b9041ee6ad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:19.374005 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6fdfd805-4519-4488-ae04-f0896d63e28d tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 200 len: 1502 microversion: 2.1 time: 0.431067 Jul 19 23:03:19.386115 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2790/5589] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:18 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 1502 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:19.391872 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0879bae2-deb5-4fb5-beb3-30d9bea4060d tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:19.392862 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0879bae2-deb5-4fb5-beb3-30d9bea4060d tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:19.400081 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0879bae2-deb5-4fb5-beb3-30d9bea4060d tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:19.400992 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0879bae2-deb5-4fb5-beb3-30d9bea4060d tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:19.402214 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0879bae2-deb5-4fb5-beb3-30d9bea4060d tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:19.402894 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0879bae2-deb5-4fb5-beb3-30d9bea4060d tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:19.582499 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0879bae2-deb5-4fb5-beb3-30d9bea4060d tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390037906f448fc9c7610dbf45f09b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40bc2d4dde948b2a1be0b9041ee6ad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:19.597773 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0879bae2-deb5-4fb5-beb3-30d9bea4060d tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 200 len: 1502 microversion: 2.1 time: 0.210382 Jul 19 23:03:19.598333 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2800/5590] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:19 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 1502 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:03:19.617051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-26f528fa-7cbd-42b6-9aa2-3c165abdc9fb tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:03:19.617867 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-26f528fa-7cbd-42b6-9aa2-3c165abdc9fb tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:19.624611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-26f528fa-7cbd-42b6-9aa2-3c165abdc9fb tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:19.625294 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-26f528fa-7cbd-42b6-9aa2-3c165abdc9fb tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:19.626265 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-26f528fa-7cbd-42b6-9aa2-3c165abdc9fb tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:19.626870 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-26f528fa-7cbd-42b6-9aa2-3c165abdc9fb tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:19.658071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-26f528fa-7cbd-42b6-9aa2-3c165abdc9fb tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lazy-loading 'flavor' on Instance uuid 3e314e43-2bbd-42d2-9429-c8d3885d605d {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:03:19.798041 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-26f528fa-7cbd-42b6-9aa2-3c165abdc9fb tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "POST /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d/action" status: 202 len: 0 microversion: 2.1 time: 0.163140 Jul 19 23:03:19.807146 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2791/5591] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:03:19 2022] POST /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:03:19.811247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-64d72b2d-ea07-4457-8ab4-38c17bb306c1 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:19.817426 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-64d72b2d-ea07-4457-8ab4-38c17bb306c1 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:19.827588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-64d72b2d-ea07-4457-8ab4-38c17bb306c1 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:19.829122 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-64d72b2d-ea07-4457-8ab4-38c17bb306c1 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:19.831578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-64d72b2d-ea07-4457-8ab4-38c17bb306c1 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:19.834917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-64d72b2d-ea07-4457-8ab4-38c17bb306c1 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:20.164681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-64d72b2d-ea07-4457-8ab4-38c17bb306c1 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390037906f448fc9c7610dbf45f09b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40bc2d4dde948b2a1be0b9041ee6ad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:20.184439 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-64d72b2d-ea07-4457-8ab4-38c17bb306c1 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 200 len: 1510 microversion: 2.1 time: 0.375360 Jul 19 23:03:20.184439 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2801/5592] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:19 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 1510 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:03:20.357154 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1c447b38-a4af-48b9-b61d-ed9e461c43c5 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:20.360867 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1c447b38-a4af-48b9-b61d-ed9e461c43c5 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:20.413585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1c447b38-a4af-48b9-b61d-ed9e461c43c5 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:20.416907 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1c447b38-a4af-48b9-b61d-ed9e461c43c5 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:20.420303 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1c447b38-a4af-48b9-b61d-ed9e461c43c5 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:20.422065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1c447b38-a4af-48b9-b61d-ed9e461c43c5 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:20.908606 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1c447b38-a4af-48b9-b61d-ed9e461c43c5 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:20.921720 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1c447b38-a4af-48b9-b61d-ed9e461c43c5 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1721 microversion: 2.1 time: 0.571482 Jul 19 23:03:20.935903 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2792/5593] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:20 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1721 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:21.203405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6cd5cd4f-08a2-4651-b8ec-8b4f72696345 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:21.204049 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6cd5cd4f-08a2-4651-b8ec-8b4f72696345 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:21.218727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6cd5cd4f-08a2-4651-b8ec-8b4f72696345 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:21.219496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6cd5cd4f-08a2-4651-b8ec-8b4f72696345 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:21.220287 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6cd5cd4f-08a2-4651-b8ec-8b4f72696345 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:21.220736 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6cd5cd4f-08a2-4651-b8ec-8b4f72696345 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:21.725804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6cd5cd4f-08a2-4651-b8ec-8b4f72696345 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390037906f448fc9c7610dbf45f09b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40bc2d4dde948b2a1be0b9041ee6ad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:21.742574 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6cd5cd4f-08a2-4651-b8ec-8b4f72696345 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 200 len: 1493 microversion: 2.1 time: 0.547725 Jul 19 23:03:21.763570 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2802/5594] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:21 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 1493 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:21.780627 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f4376374-4b61-4a60-acab-185b981c2b50 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:03:21.783228 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f4376374-4b61-4a60-acab-185b981c2b50 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:21.801327 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4376374-4b61-4a60-acab-185b981c2b50 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:21.802900 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4376374-4b61-4a60-acab-185b981c2b50 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:21.806016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4376374-4b61-4a60-acab-185b981c2b50 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:21.806369 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4376374-4b61-4a60-acab-185b981c2b50 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:21.939845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8c0ac662-dc9b-42e7-a6d2-7846769fd28c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:21.940471 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8c0ac662-dc9b-42e7-a6d2-7846769fd28c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:21.953230 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c0ac662-dc9b-42e7-a6d2-7846769fd28c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:21.953687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c0ac662-dc9b-42e7-a6d2-7846769fd28c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:21.954482 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c0ac662-dc9b-42e7-a6d2-7846769fd28c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:21.954935 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c0ac662-dc9b-42e7-a6d2-7846769fd28c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:21.960403 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f4376374-4b61-4a60-acab-185b981c2b50 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "POST /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d/action" status: 202 len: 0 microversion: 2.1 time: 0.190165 Jul 19 23:03:21.966819 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2793/5595] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:03:21 2022] POST /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:03:21.977816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6c0a50de-1ac0-4458-b4e0-1434fc37fa74 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:21.981418 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6c0a50de-1ac0-4458-b4e0-1434fc37fa74 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:22.004042 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c0a50de-1ac0-4458-b4e0-1434fc37fa74 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:22.006442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c0a50de-1ac0-4458-b4e0-1434fc37fa74 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:22.008532 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c0a50de-1ac0-4458-b4e0-1434fc37fa74 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:22.011455 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c0a50de-1ac0-4458-b4e0-1434fc37fa74 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:22.614553 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6c0a50de-1ac0-4458-b4e0-1434fc37fa74 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390037906f448fc9c7610dbf45f09b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40bc2d4dde948b2a1be0b9041ee6ad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:22.627897 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6c0a50de-1ac0-4458-b4e0-1434fc37fa74 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 200 len: 1499 microversion: 2.1 time: 0.655624 Jul 19 23:03:22.628547 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2794/5596] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:21 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 1499 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:22.742928 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8c0ac662-dc9b-42e7-a6d2-7846769fd28c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:22.758440 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8c0ac662-dc9b-42e7-a6d2-7846769fd28c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1721 microversion: 2.1 time: 0.822638 Jul 19 23:03:22.759077 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2803/5597] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:21 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1721 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:23.647184 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5baf7b09-6d96-409e-a10d-077d7311c5f9 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:23.648355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5baf7b09-6d96-409e-a10d-077d7311c5f9 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:23.666837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5baf7b09-6d96-409e-a10d-077d7311c5f9 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:23.667710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5baf7b09-6d96-409e-a10d-077d7311c5f9 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:23.670325 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5baf7b09-6d96-409e-a10d-077d7311c5f9 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:23.674433 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5baf7b09-6d96-409e-a10d-077d7311c5f9 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:23.779283 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eae56125-8abe-4578-8d46-5d206b998d40 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:23.780174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eae56125-8abe-4578-8d46-5d206b998d40 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:23.800892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eae56125-8abe-4578-8d46-5d206b998d40 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:23.808332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eae56125-8abe-4578-8d46-5d206b998d40 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:23.809529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eae56125-8abe-4578-8d46-5d206b998d40 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:23.812459 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eae56125-8abe-4578-8d46-5d206b998d40 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:24.336153 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-eae56125-8abe-4578-8d46-5d206b998d40 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:24.346352 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eae56125-8abe-4578-8d46-5d206b998d40 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1721 microversion: 2.1 time: 0.572244 Jul 19 23:03:24.353869 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2804/5598] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:23 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1721 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:24.388569 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5baf7b09-6d96-409e-a10d-077d7311c5f9 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390037906f448fc9c7610dbf45f09b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40bc2d4dde948b2a1be0b9041ee6ad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:24.397284 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5baf7b09-6d96-409e-a10d-077d7311c5f9 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 200 len: 1499 microversion: 2.1 time: 0.755317 Jul 19 23:03:24.402451 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2795/5599] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:23 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 1499 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:25.370960 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f05b2967-6c43-4322-9700-15f2f9943500 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:25.371615 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f05b2967-6c43-4322-9700-15f2f9943500 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:25.387997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f05b2967-6c43-4322-9700-15f2f9943500 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:25.388481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f05b2967-6c43-4322-9700-15f2f9943500 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:25.392627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f05b2967-6c43-4322-9700-15f2f9943500 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:25.393122 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f05b2967-6c43-4322-9700-15f2f9943500 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:25.421539 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-58be5968-e3c3-4869-973b-7ed1df0df0aa tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:25.422931 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-58be5968-e3c3-4869-973b-7ed1df0df0aa tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:25.443429 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58be5968-e3c3-4869-973b-7ed1df0df0aa tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:25.443899 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58be5968-e3c3-4869-973b-7ed1df0df0aa tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:25.444720 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58be5968-e3c3-4869-973b-7ed1df0df0aa tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:25.450678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58be5968-e3c3-4869-973b-7ed1df0df0aa tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:25.467990 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:03:26.240232 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f05b2967-6c43-4322-9700-15f2f9943500 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:26.252729 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f05b2967-6c43-4322-9700-15f2f9943500 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1721 microversion: 2.1 time: 0.886664 Jul 19 23:03:26.261360 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2805/5600] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:25 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1721 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:26.432594 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-58be5968-e3c3-4869-973b-7ed1df0df0aa tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390037906f448fc9c7610dbf45f09b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40bc2d4dde948b2a1be0b9041ee6ad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:26.441006 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-58be5968-e3c3-4869-973b-7ed1df0df0aa tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 200 len: 1502 microversion: 2.1 time: 1.026791 Jul 19 23:03:26.441595 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2796/5601] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:25 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 1502 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:03:26.458707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a4899d41-ac89-4a3f-9444-f3a0a84f506f tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:03:26.461471 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a4899d41-ac89-4a3f-9444-f3a0a84f506f tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:26.472419 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a4899d41-ac89-4a3f-9444-f3a0a84f506f tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:26.475693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a4899d41-ac89-4a3f-9444-f3a0a84f506f tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:26.476801 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a4899d41-ac89-4a3f-9444-f3a0a84f506f tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:26.478927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a4899d41-ac89-4a3f-9444-f3a0a84f506f tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:26.542965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-a4899d41-ac89-4a3f-9444-f3a0a84f506f tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lazy-loading 'flavor' on Instance uuid 3e314e43-2bbd-42d2-9429-c8d3885d605d {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:03:26.672325 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:03:26.733751 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a4899d41-ac89-4a3f-9444-f3a0a84f506f tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "POST /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d/action" status: 202 len: 0 microversion: 2.1 time: 0.278275 Jul 19 23:03:26.736606 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2806/5602] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:03:26 2022] POST /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:03:26.745533 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d089d398-cb3f-416c-8b26-231f319c57cd tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:26.746319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d089d398-cb3f-416c-8b26-231f319c57cd tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:26.764355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d089d398-cb3f-416c-8b26-231f319c57cd tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:26.770467 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d089d398-cb3f-416c-8b26-231f319c57cd tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:26.771609 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d089d398-cb3f-416c-8b26-231f319c57cd tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:26.772237 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d089d398-cb3f-416c-8b26-231f319c57cd tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:27.275629 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-28eb9f78-c8fa-493c-b205-421b04093014 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:27.276446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-28eb9f78-c8fa-493c-b205-421b04093014 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:27.535298 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28eb9f78-c8fa-493c-b205-421b04093014 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:27.535298 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28eb9f78-c8fa-493c-b205-421b04093014 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:27.535298 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28eb9f78-c8fa-493c-b205-421b04093014 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:27.535298 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-28eb9f78-c8fa-493c-b205-421b04093014 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:28.083036 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d089d398-cb3f-416c-8b26-231f319c57cd tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390037906f448fc9c7610dbf45f09b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40bc2d4dde948b2a1be0b9041ee6ad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:28.091960 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-28eb9f78-c8fa-493c-b205-421b04093014 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:28.101628 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d089d398-cb3f-416c-8b26-231f319c57cd tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 200 len: 1510 microversion: 2.1 time: 1.351662 Jul 19 23:03:28.103460 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2797/5603] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:26 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 1510 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:28.104761 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-28eb9f78-c8fa-493c-b205-421b04093014 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1721 microversion: 2.1 time: 0.832560 Jul 19 23:03:28.105371 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2807/5604] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:27 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1721 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:03:29.121654 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bc1ab7c9-b48b-4663-ad9a-2bcebf8c4f0a tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:29.122276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bc1ab7c9-b48b-4663-ad9a-2bcebf8c4f0a tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:29.127601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-156df898-bf38-409b-82eb-d682a232b237 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:29.128736 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-156df898-bf38-409b-82eb-d682a232b237 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:29.143544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-156df898-bf38-409b-82eb-d682a232b237 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:29.145566 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bc1ab7c9-b48b-4663-ad9a-2bcebf8c4f0a tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:29.146201 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bc1ab7c9-b48b-4663-ad9a-2bcebf8c4f0a tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:29.146988 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bc1ab7c9-b48b-4663-ad9a-2bcebf8c4f0a tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:29.147632 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-156df898-bf38-409b-82eb-d682a232b237 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:29.148232 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bc1ab7c9-b48b-4663-ad9a-2bcebf8c4f0a tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:29.149187 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-156df898-bf38-409b-82eb-d682a232b237 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:29.153056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-156df898-bf38-409b-82eb-d682a232b237 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:29.420313 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bc1ab7c9-b48b-4663-ad9a-2bcebf8c4f0a tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390037906f448fc9c7610dbf45f09b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40bc2d4dde948b2a1be0b9041ee6ad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:29.435351 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bc1ab7c9-b48b-4663-ad9a-2bcebf8c4f0a tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 200 len: 1493 microversion: 2.1 time: 0.318197 Jul 19 23:03:29.436528 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2798/5605] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:29 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 1493 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:29.454423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-156df898-bf38-409b-82eb-d682a232b237 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:29.457942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c17cad09-4cd7-46d7-81fe-1ea84c928fae tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:03:29.458723 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c17cad09-4cd7-46d7-81fe-1ea84c928fae tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:29.464350 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-156df898-bf38-409b-82eb-d682a232b237 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1721 microversion: 2.1 time: 0.340705 Jul 19 23:03:29.474088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c17cad09-4cd7-46d7-81fe-1ea84c928fae tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:29.475000 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2808/5606] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:29 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1721 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:29.476224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c17cad09-4cd7-46d7-81fe-1ea84c928fae tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:29.479191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c17cad09-4cd7-46d7-81fe-1ea84c928fae tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:29.481408 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c17cad09-4cd7-46d7-81fe-1ea84c928fae tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:29.667782 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c17cad09-4cd7-46d7-81fe-1ea84c928fae tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "POST /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d/action" status: 202 len: 0 microversion: 2.1 time: 0.214986 Jul 19 23:03:29.677756 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3de2fc62-bebf-47c2-bf8d-dd5fd1f9f4c8 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:29.678382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3de2fc62-bebf-47c2-bf8d-dd5fd1f9f4c8 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:29.682862 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2799/5607] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:03:29 2022] POST /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 23:03:29.689316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3de2fc62-bebf-47c2-bf8d-dd5fd1f9f4c8 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:29.692544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3de2fc62-bebf-47c2-bf8d-dd5fd1f9f4c8 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:29.693557 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3de2fc62-bebf-47c2-bf8d-dd5fd1f9f4c8 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:29.696408 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3de2fc62-bebf-47c2-bf8d-dd5fd1f9f4c8 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:30.448130 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3de2fc62-bebf-47c2-bf8d-dd5fd1f9f4c8 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390037906f448fc9c7610dbf45f09b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40bc2d4dde948b2a1be0b9041ee6ad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:30.456391 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3de2fc62-bebf-47c2-bf8d-dd5fd1f9f4c8 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 200 len: 1499 microversion: 2.1 time: 0.783167 Jul 19 23:03:30.465884 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2809/5608] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:29 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 1499 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:30.486500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b34ced93-266e-4c65-90ce-5c70ee46f9d0 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:30.487094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b34ced93-266e-4c65-90ce-5c70ee46f9d0 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:30.503442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b34ced93-266e-4c65-90ce-5c70ee46f9d0 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:30.503442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b34ced93-266e-4c65-90ce-5c70ee46f9d0 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:30.503442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b34ced93-266e-4c65-90ce-5c70ee46f9d0 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:30.503442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b34ced93-266e-4c65-90ce-5c70ee46f9d0 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:30.975261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b34ced93-266e-4c65-90ce-5c70ee46f9d0 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:30.986479 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b34ced93-266e-4c65-90ce-5c70ee46f9d0 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1698 microversion: 2.1 time: 0.504724 Jul 19 23:03:30.997687 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2800/5609] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:30 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1698 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:31.005852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-29583fbc-12da-4b4c-95a9-ac78ce1e400d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:03:31.013182 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-29583fbc-12da-4b4c-95a9-ac78ce1e400d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:31.013884 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-29583fbc-12da-4b4c-95a9-ac78ce1e400d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:31.046012 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-29583fbc-12da-4b4c-95a9-ac78ce1e400d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Going to try to start instance {{(pid=119337) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 23:03:31.177571 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-29583fbc-12da-4b4c-95a9-ac78ce1e400d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "POST /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f/action" status: 202 len: 0 microversion: 2.1 time: 0.176415 Jul 19 23:03:31.182479 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2810/5610] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:03:30 2022] POST /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:03:31.187851 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fcfb21a3-2398-41a6-91d3-5db9c8a652a9 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:31.188694 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fcfb21a3-2398-41a6-91d3-5db9c8a652a9 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:31.202881 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fcfb21a3-2398-41a6-91d3-5db9c8a652a9 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:31.203450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fcfb21a3-2398-41a6-91d3-5db9c8a652a9 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:31.204326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fcfb21a3-2398-41a6-91d3-5db9c8a652a9 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:31.213495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fcfb21a3-2398-41a6-91d3-5db9c8a652a9 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:31.487220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6d1c27cc-f12a-4633-b9ef-c457c1427334 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:31.488145 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6d1c27cc-f12a-4633-b9ef-c457c1427334 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:31.522332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d1c27cc-f12a-4633-b9ef-c457c1427334 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:31.522794 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d1c27cc-f12a-4633-b9ef-c457c1427334 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:31.523666 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d1c27cc-f12a-4633-b9ef-c457c1427334 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:31.524114 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6d1c27cc-f12a-4633-b9ef-c457c1427334 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:31.781193 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fcfb21a3-2398-41a6-91d3-5db9c8a652a9 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:31.835525 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fcfb21a3-2398-41a6-91d3-5db9c8a652a9 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1707 microversion: 2.1 time: 0.651603 Jul 19 23:03:31.860602 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2801/5611] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:31 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1707 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:31.999987 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6d1c27cc-f12a-4633-b9ef-c457c1427334 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390037906f448fc9c7610dbf45f09b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40bc2d4dde948b2a1be0b9041ee6ad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:32.009884 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6d1c27cc-f12a-4633-b9ef-c457c1427334 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 200 len: 1499 microversion: 2.1 time: 0.529886 Jul 19 23:03:32.014255 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2811/5612] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:31 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 1499 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:03:32.861415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e505d82d-75a6-49cf-9566-0e3e74fe86c9 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:32.862173 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e505d82d-75a6-49cf-9566-0e3e74fe86c9 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:32.882241 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:03:32.885598 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e505d82d-75a6-49cf-9566-0e3e74fe86c9 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:32.886395 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e505d82d-75a6-49cf-9566-0e3e74fe86c9 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:32.887710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e505d82d-75a6-49cf-9566-0e3e74fe86c9 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:32.888463 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e505d82d-75a6-49cf-9566-0e3e74fe86c9 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:33.039278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c731049a-87d1-4501-ba3e-660e15683cfb tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:33.040530 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c731049a-87d1-4501-ba3e-660e15683cfb tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:33.093798 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c731049a-87d1-4501-ba3e-660e15683cfb tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:33.104522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c731049a-87d1-4501-ba3e-660e15683cfb tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:33.108438 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c731049a-87d1-4501-ba3e-660e15683cfb tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:33.109911 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c731049a-87d1-4501-ba3e-660e15683cfb tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:33.657043 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e505d82d-75a6-49cf-9566-0e3e74fe86c9 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:33.668195 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e505d82d-75a6-49cf-9566-0e3e74fe86c9 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1707 microversion: 2.1 time: 0.810612 Jul 19 23:03:33.672147 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2802/5613] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:32 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1707 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:33.727129 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c731049a-87d1-4501-ba3e-660e15683cfb tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390037906f448fc9c7610dbf45f09b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40bc2d4dde948b2a1be0b9041ee6ad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:33.737718 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c731049a-87d1-4501-ba3e-660e15683cfb tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 200 len: 1502 microversion: 2.1 time: 0.710474 Jul 19 23:03:33.760778 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2812/5614] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:33 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 1502 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:03:33.807888 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-31b9f61a-e0e3-4eee-9795-05749fe9e897 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:33.808368 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-31b9f61a-e0e3-4eee-9795-05749fe9e897 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:33.841425 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31b9f61a-e0e3-4eee-9795-05749fe9e897 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:33.842019 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31b9f61a-e0e3-4eee-9795-05749fe9e897 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:33.843722 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31b9f61a-e0e3-4eee-9795-05749fe9e897 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:33.853508 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31b9f61a-e0e3-4eee-9795-05749fe9e897 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:33.891811 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-31b9f61a-e0e3-4eee-9795-05749fe9e897 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:03:34.039402 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-31b9f61a-e0e3-4eee-9795-05749fe9e897 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 204 len: 0 microversion: 2.1 time: 0.263529 Jul 19 23:03:34.041761 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2803/5615] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:03:33 2022] DELETE /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:03:34.055138 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-82217542-feb6-41d7-9e7f-24c9751d51b9 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:34.058296 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-82217542-feb6-41d7-9e7f-24c9751d51b9 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:34.079485 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-82217542-feb6-41d7-9e7f-24c9751d51b9 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:34.081278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-82217542-feb6-41d7-9e7f-24c9751d51b9 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:34.082428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-82217542-feb6-41d7-9e7f-24c9751d51b9 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:34.083134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-82217542-feb6-41d7-9e7f-24c9751d51b9 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:34.515661 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-82217542-feb6-41d7-9e7f-24c9751d51b9 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390037906f448fc9c7610dbf45f09b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40bc2d4dde948b2a1be0b9041ee6ad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:34.530341 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-82217542-feb6-41d7-9e7f-24c9751d51b9 tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 200 len: 1508 microversion: 2.1 time: 0.481886 Jul 19 23:03:34.543637 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2813/5616] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:34 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 1508 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:34.700076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8abbe8c7-c745-442e-bf9a-0270beda0bb6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:34.702288 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8abbe8c7-c745-442e-bf9a-0270beda0bb6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:34.711887 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8abbe8c7-c745-442e-bf9a-0270beda0bb6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:34.713588 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8abbe8c7-c745-442e-bf9a-0270beda0bb6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:34.715802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8abbe8c7-c745-442e-bf9a-0270beda0bb6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:34.716569 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8abbe8c7-c745-442e-bf9a-0270beda0bb6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:35.061541 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8abbe8c7-c745-442e-bf9a-0270beda0bb6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:35.074085 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8abbe8c7-c745-442e-bf9a-0270beda0bb6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1707 microversion: 2.1 time: 0.387452 Jul 19 23:03:35.076438 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2804/5617] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:34 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1707 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:35.551480 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-580fd7b6-8413-4089-8ffd-0a5dc7d982fc tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:35.552177 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-580fd7b6-8413-4089-8ffd-0a5dc7d982fc tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:35.566228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-580fd7b6-8413-4089-8ffd-0a5dc7d982fc tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:35.568329 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-580fd7b6-8413-4089-8ffd-0a5dc7d982fc tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:35.571537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-580fd7b6-8413-4089-8ffd-0a5dc7d982fc tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:35.572207 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-580fd7b6-8413-4089-8ffd-0a5dc7d982fc tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:35.840709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-580fd7b6-8413-4089-8ffd-0a5dc7d982fc tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390037906f448fc9c7610dbf45f09b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40bc2d4dde948b2a1be0b9041ee6ad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:35.862702 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-580fd7b6-8413-4089-8ffd-0a5dc7d982fc tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 200 len: 1508 microversion: 2.1 time: 0.308769 Jul 19 23:03:35.863744 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2814/5618] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:35 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 1508 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:36.095842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d5465b09-0469-4285-96ba-72fe2865fd18 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:36.097415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d5465b09-0469-4285-96ba-72fe2865fd18 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:36.118294 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5465b09-0469-4285-96ba-72fe2865fd18 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:36.138200 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5465b09-0469-4285-96ba-72fe2865fd18 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:36.141221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5465b09-0469-4285-96ba-72fe2865fd18 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:36.145395 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5465b09-0469-4285-96ba-72fe2865fd18 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:36.640412 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d5465b09-0469-4285-96ba-72fe2865fd18 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:36.648729 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d5465b09-0469-4285-96ba-72fe2865fd18 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1711 microversion: 2.1 time: 0.558448 Jul 19 23:03:36.652871 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2805/5619] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:36 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1711 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:36.884004 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5cdec2ab-a281-456b-b3df-46b0a02e90dd tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:36.886223 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5cdec2ab-a281-456b-b3df-46b0a02e90dd tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:36.892884 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=48 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:03:36.909910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5cdec2ab-a281-456b-b3df-46b0a02e90dd tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:36.913720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5cdec2ab-a281-456b-b3df-46b0a02e90dd tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:36.914577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5cdec2ab-a281-456b-b3df-46b0a02e90dd tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:36.915102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5cdec2ab-a281-456b-b3df-46b0a02e90dd tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:37.272557 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5cdec2ab-a281-456b-b3df-46b0a02e90dd tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390037906f448fc9c7610dbf45f09b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40bc2d4dde948b2a1be0b9041ee6ad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:37.282704 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5cdec2ab-a281-456b-b3df-46b0a02e90dd tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 200 len: 1508 microversion: 2.1 time: 0.404702 Jul 19 23:03:37.294701 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2815/5620] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:36 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 1508 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:37.693478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-b706c546-8b78-42d4-9fd6-b5758b4082a0 req-0ed4b81b-513a-44d1-9e0a-d48dd3cb4c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e314e43-2bbd-42d2-9429-c8d3885d605d", "name": "network-vif-deleted", "tag": "22fecfee-2c3e-4000-8e32-9a56e5324bef"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:03:37.708756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b706c546-8b78-42d4-9fd6-b5758b4082a0 req-0ed4b81b-513a-44d1-9e0a-d48dd3cb4c16 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:37.709222 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b706c546-8b78-42d4-9fd6-b5758b4082a0 req-0ed4b81b-513a-44d1-9e0a-d48dd3cb4c16 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:37.738180 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-b706c546-8b78-42d4-9fd6-b5758b4082a0 req-0ed4b81b-513a-44d1-9e0a-d48dd3cb4c16 service nova] Creating event network-vif-deleted:22fecfee-2c3e-4000-8e32-9a56e5324bef for instance 3e314e43-2bbd-42d2-9429-c8d3885d605d on n-h1-847009-3 Jul 19 23:03:37.744780 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-b706c546-8b78-42d4-9fd6-b5758b4082a0 req-0ed4b81b-513a-44d1-9e0a-d48dd3cb4c16 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054806 Jul 19 23:03:37.745406 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2806/5621] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:03:38.314986 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ae46ff1b-e051-45d1-b459-57d29e46ba1c tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:38.314986 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ae46ff1b-e051-45d1-b459-57d29e46ba1c tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:38.355790 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae46ff1b-e051-45d1-b459-57d29e46ba1c tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:38.357880 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae46ff1b-e051-45d1-b459-57d29e46ba1c tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:38.363961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae46ff1b-e051-45d1-b459-57d29e46ba1c tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:38.364447 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae46ff1b-e051-45d1-b459-57d29e46ba1c tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:38.460856 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae46ff1b-e051-45d1-b459-57d29e46ba1c tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:38.461316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae46ff1b-e051-45d1-b459-57d29e46ba1c tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:38.469484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-ae46ff1b-e051-45d1-b459-57d29e46ba1c tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lazy-loading 'fault' on Instance uuid 3e314e43-2bbd-42d2-9429-c8d3885d605d {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:03:38.589327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ae46ff1b-e051-45d1-b459-57d29e46ba1c tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390037906f448fc9c7610dbf45f09b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40bc2d4dde948b2a1be0b9041ee6ad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:03:38.601036 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ae46ff1b-e051-45d1-b459-57d29e46ba1c tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 200 len: 1305 microversion: 2.1 time: 0.294530 Jul 19 23:03:38.614211 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2816/5622] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:38 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 1305 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:03:39.624309 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-013dc078-7818-424a-975e-ac22b2b86e6d tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:03:39.628468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-013dc078-7818-424a-975e-ac22b2b86e6d tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] [instance: 3e314e43-2bbd-42d2-9429-c8d3885d605d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:03:39.654479 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-013dc078-7818-424a-975e-ac22b2b86e6d tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:39.654962 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-013dc078-7818-424a-975e-ac22b2b86e6d tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:39.655780 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-013dc078-7818-424a-975e-ac22b2b86e6d tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:03:39.656228 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-013dc078-7818-424a-975e-ac22b2b86e6d tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:03:39.699511 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-013dc078-7818-424a-975e-ac22b2b86e6d tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] HTTP exception thrown: Instance 3e314e43-2bbd-42d2-9429-c8d3885d605d could not be found. Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-013dc078-7818-424a-975e-ac22b2b86e6d tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Request method failure captured: Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d HTTP/1.1 Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zghdWy6-Kyb6b_JRs6h7Jsl7_bzgLPvef1_s771uG2pUZKtTtrpTA17gdanma6PHadhr1TODMNQIQLxs7bhs6YAiWVBTgczPipqwsp4xlX57jjKKs4TG5OLubz09Ou2cQuUVuTz63MpnqAjnUWIzNu43iuooeJz3hYtejzRORcfZPs Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: d40bc2d4dde948b2a1be0b9041ee6ad0 Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TestServerAdvancedOps-1122593597 Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d40bc2d4dde948b2a1be0b9041ee6ad0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d40bc2d4dde948b2a1be0b9041ee6ad0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d40bc2d4dde948b2a1be0b9041ee6ad0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d40bc2d4dde948b2a1be0b9041ee6ad0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TestServerAdvancedOps-1122593597 Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: d40bc2d4dde948b2a1be0b9041ee6ad0 Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TestServerAdvancedOps-1122593597 Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TestServerAdvancedOps-1122593597-project Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 6390037906f448fc9c7610dbf45f09b3 Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TestServerAdvancedOps-1122593597-project Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 3e314e43-2bbd-42d2-9429-c8d3885d605d could not be found. Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '3e314e43-2bbd-42d2-9429-c8d3885d605d'} Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e314e43-2bbd-42d2-9429-c8d3885d605d could not be found. Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e314e43-2bbd-42d2-9429-c8d3885d605d could not be found. Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:03:39.701223 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:03:39.707549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:03:39.707549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:03:39.707549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:03:39.707549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:03:39.707549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:03:39.707549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e314e43-2bbd-42d2-9429-c8d3885d605d could not be found. Jul 19 23:03:39.707549 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:03:39.707549 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-013dc078-7818-424a-975e-ac22b2b86e6d tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] Returning 404 to user: Instance 3e314e43-2bbd-42d2-9429-c8d3885d605d could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:03:39.707549 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-013dc078-7818-424a-975e-ac22b2b86e6d tempest-TestServerAdvancedOps-1122593597 tempest-TestServerAdvancedOps-1122593597-project] 10.222.0.25 "GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d" status: 404 len: 111 microversion: 2.1 time: 0.084812 Jul 19 23:03:39.714585 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2807/5623] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:03:39 2022] GET /compute/v2.1/servers/3e314e43-2bbd-42d2-9429-c8d3885d605d => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:04:03.991476 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-790245b8-71ee-4124-9ab7-2ba656818823 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Action: 'create', calling method: .version_select at 0x7f7a1050e430>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1432859250", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjtrgYd5uDImSwpi2WtgMyfjJFetMqGQA0J4jQf0fyvsOB7FtIKRer6vwzzCfxibgrHMl6mNeXrJlyMORf68THTaYZ66GzoU3qI1SD6KVJGsIUnSvb3eC8xoX0KyQ+BoA=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:04:04.031227 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=5 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:04:04.033462 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=67,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:04:04.069291 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-790245b8-71ee-4124-9ab7-2ba656818823 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Getting quotas for project 84753b1b5aaa4907ad1e5ac13d7b3d8c. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:04:04.091282 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-790245b8-71ee-4124-9ab7-2ba656818823 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Getting quotas for user c9d4cb40261d442fbb80843e6340b699 and project 84753b1b5aaa4907ad1e5ac13d7b3d8c. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:04:04.169566 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-790245b8-71ee-4124-9ab7-2ba656818823 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.179101 Jul 19 23:04:04.170807 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2817/5624] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 23:04:03 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:04:08.495920 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3c665b5b-6f32-49a7-bb3d-ac367f4f0def tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1310617846", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0b73e924-00b7-4bdd-9470-ce6a2d7a326a", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1432859250", "security_groups": [{"name": "tempest-secgroup-smoke-823915246"}], "networks": [{"uuid": "c57784eb-9c5c-4064-a4c7-775bfef977a7"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:04:08.525368 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:04:08.527377 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:04:08.764168 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-3c665b5b-6f32-49a7-bb3d-ac367f4f0def tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] validate_networks() for [('c57784eb-9c5c-4064-a4c7-775bfef977a7', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:04:10.634940 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-3c665b5b-6f32-49a7-bb3d-ac367f4f0def tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:04:10.636341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-3c665b5b-6f32-49a7-bb3d-ac367f4f0def tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:04:10.637065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-3c665b5b-6f32-49a7-bb3d-ac367f4f0def tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:04:10.637660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-3c665b5b-6f32-49a7-bb3d-ac367f4f0def tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:04:10.638260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-3c665b5b-6f32-49a7-bb3d-ac367f4f0def tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:04:10.664766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3c665b5b-6f32-49a7-bb3d-ac367f4f0def tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:10.665460 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3c665b5b-6f32-49a7-bb3d-ac367f4f0def tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:10.666899 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3c665b5b-6f32-49a7-bb3d-ac367f4f0def tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:10.667577 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3c665b5b-6f32-49a7-bb3d-ac367f4f0def tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:10.699827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-3c665b5b-6f32-49a7-bb3d-ac367f4f0def tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Getting quotas for project 84753b1b5aaa4907ad1e5ac13d7b3d8c. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:04:10.707674 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-3c665b5b-6f32-49a7-bb3d-ac367f4f0def tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Getting quotas for user c9d4cb40261d442fbb80843e6340b699 and project 84753b1b5aaa4907ad1e5ac13d7b3d8c. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:04:10.833126 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3c665b5b-6f32-49a7-bb3d-ac367f4f0def tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:04:10.841518 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3c665b5b-6f32-49a7-bb3d-ac367f4f0def tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0b73e924-00b7-4bdd-9470-ce6a2d7a326a',volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:04:11.162077 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3c665b5b-6f32-49a7-bb3d-ac367f4f0def tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.678362 Jul 19 23:04:11.163441 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2808/5625] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:04:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 2680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:04:11.176437 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-697fcbfc-65a6-45b5-9241-9b9956c38e62 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:11.178403 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-697fcbfc-65a6-45b5-9241-9b9956c38e62 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:11.338245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-697fcbfc-65a6-45b5-9241-9b9956c38e62 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:11.350301 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-697fcbfc-65a6-45b5-9241-9b9956c38e62 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1099 microversion: 2.1 time: 0.178157 Jul 19 23:04:11.354385 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2818/5626] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:11 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1099 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:12.370758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9a4a2824-52c1-4a84-9136-e89924bfb4cb tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:12.371870 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9a4a2824-52c1-4a84-9136-e89924bfb4cb tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:12.514502 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9a4a2824-52c1-4a84-9136-e89924bfb4cb tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:12.526568 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9a4a2824-52c1-4a84-9136-e89924bfb4cb tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1099 microversion: 2.1 time: 0.158696 Jul 19 23:04:12.528161 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2809/5627] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:12 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1099 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:13.544158 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6d73d7f6-f824-456e-ac57-925cdd8ebcf0 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:13.545003 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6d73d7f6-f824-456e-ac57-925cdd8ebcf0 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:13.635362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6d73d7f6-f824-456e-ac57-925cdd8ebcf0 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:13.645629 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6d73d7f6-f824-456e-ac57-925cdd8ebcf0 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1099 microversion: 2.1 time: 0.105218 Jul 19 23:04:13.648850 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2819/5628] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:13 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1099 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:14.674873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-66793017-023a-4249-bf1d-9bb55d46c4c1 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:14.675555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-66793017-023a-4249-bf1d-9bb55d46c4c1 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:14.815741 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-66793017-023a-4249-bf1d-9bb55d46c4c1 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:14.826083 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-66793017-023a-4249-bf1d-9bb55d46c4c1 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1099 microversion: 2.1 time: 0.166430 Jul 19 23:04:14.828568 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2810/5629] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:14 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1099 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:15.045484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-458182c5-8833-4621-a3f6-ed50b1110190 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:15.046128 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-458182c5-8833-4621-a3f6-ed50b1110190 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:15.068180 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-458182c5-8833-4621-a3f6-ed50b1110190 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:15.068605 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-458182c5-8833-4621-a3f6-ed50b1110190 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:15.069354 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-458182c5-8833-4621-a3f6-ed50b1110190 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:15.069793 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-458182c5-8833-4621-a3f6-ed50b1110190 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:15.255472 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-458182c5-8833-4621-a3f6-ed50b1110190 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lazy-loading 'services' on Instance uuid b09fea8b-cf15-4aaf-9e24-4418313a878f {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:04:15.408657 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-458182c5-8833-4621-a3f6-ed50b1110190 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f/os-volume_attachments/6bbd023e-e27b-4ba8-9400-f33a0e5ed8e6" status: 202 len: 0 microversion: 2.1 time: 0.367081 Jul 19 23:04:15.409968 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2820/5630] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 19 23:04:15 2022] DELETE /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f/os-volume_attachments/6bbd023e-e27b-4ba8-9400-f33a0e5ed8e6 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:04:15.845562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5b20c11b-f1d7-4af0-9801-52ad89aa4ccc tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:15.847838 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5b20c11b-f1d7-4af0-9801-52ad89aa4ccc tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:15.871277 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b20c11b-f1d7-4af0-9801-52ad89aa4ccc tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:15.873055 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b20c11b-f1d7-4af0-9801-52ad89aa4ccc tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:15.874965 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b20c11b-f1d7-4af0-9801-52ad89aa4ccc tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:15.877997 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b20c11b-f1d7-4af0-9801-52ad89aa4ccc tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:16.067244 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5b20c11b-f1d7-4af0-9801-52ad89aa4ccc tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:16.090036 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5b20c11b-f1d7-4af0-9801-52ad89aa4ccc tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1149 microversion: 2.1 time: 0.250313 Jul 19 23:04:16.090688 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2811/5631] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:15 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1149 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:17.115316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bb0dc43b-e9ce-4264-8cc3-948708a12de5 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:17.117240 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bb0dc43b-e9ce-4264-8cc3-948708a12de5 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:17.133394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb0dc43b-e9ce-4264-8cc3-948708a12de5 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:17.141479 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb0dc43b-e9ce-4264-8cc3-948708a12de5 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:17.142928 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb0dc43b-e9ce-4264-8cc3-948708a12de5 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:17.144214 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb0dc43b-e9ce-4264-8cc3-948708a12de5 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:17.411325 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bb0dc43b-e9ce-4264-8cc3-948708a12de5 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:17.422636 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bb0dc43b-e9ce-4264-8cc3-948708a12de5 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1215 microversion: 2.1 time: 0.317693 Jul 19 23:04:17.448860 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2821/5632] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:17 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1215 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:18.442522 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2258ee70-ef0a-43e2-8c8a-cba97fe7806a tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:18.444310 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2258ee70-ef0a-43e2-8c8a-cba97fe7806a tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:18.463750 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2258ee70-ef0a-43e2-8c8a-cba97fe7806a tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:18.467024 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2258ee70-ef0a-43e2-8c8a-cba97fe7806a tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:18.468415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2258ee70-ef0a-43e2-8c8a-cba97fe7806a tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:18.472732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2258ee70-ef0a-43e2-8c8a-cba97fe7806a tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:18.843615 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2258ee70-ef0a-43e2-8c8a-cba97fe7806a tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:18.854318 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2258ee70-ef0a-43e2-8c8a-cba97fe7806a tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1215 microversion: 2.1 time: 0.417008 Jul 19 23:04:18.856583 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2812/5633] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:18 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1215 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:19.878978 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2cbd1879-fa2b-4d7c-8e7b-0d3f53b6b8b1 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:19.879672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2cbd1879-fa2b-4d7c-8e7b-0d3f53b6b8b1 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:19.899171 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2cbd1879-fa2b-4d7c-8e7b-0d3f53b6b8b1 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:19.900330 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2cbd1879-fa2b-4d7c-8e7b-0d3f53b6b8b1 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:19.901396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2cbd1879-fa2b-4d7c-8e7b-0d3f53b6b8b1 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:19.904115 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2cbd1879-fa2b-4d7c-8e7b-0d3f53b6b8b1 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:20.235902 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2cbd1879-fa2b-4d7c-8e7b-0d3f53b6b8b1 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:20.271286 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2cbd1879-fa2b-4d7c-8e7b-0d3f53b6b8b1 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1282 microversion: 2.1 time: 0.397561 Jul 19 23:04:20.275160 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2822/5634] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:19 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1282 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:04:21.290416 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ee3b6af3-c3b4-4980-8674-21bf5ec92f8a tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:21.291926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ee3b6af3-c3b4-4980-8674-21bf5ec92f8a tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:21.302337 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:04:21.309555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee3b6af3-c3b4-4980-8674-21bf5ec92f8a tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:21.310502 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee3b6af3-c3b4-4980-8674-21bf5ec92f8a tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:21.311616 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee3b6af3-c3b4-4980-8674-21bf5ec92f8a tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:21.319486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee3b6af3-c3b4-4980-8674-21bf5ec92f8a tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:21.721155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-20bee08d-5be8-4ab8-9866-3bed8fc3f824 req-4223adfd-c2ef-4fb8-a543-03f468e91098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98a4d015-588b-473c-afc3-0f6fbc3ea7d6", "tag": "da8cca52-ce59-4c8c-8af1-ffba90ffdf3b"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:04:21.749863 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-20bee08d-5be8-4ab8-9866-3bed8fc3f824 req-4223adfd-c2ef-4fb8-a543-03f468e91098 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:21.750334 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-20bee08d-5be8-4ab8-9866-3bed8fc3f824 req-4223adfd-c2ef-4fb8-a543-03f468e91098 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:21.807688 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-20bee08d-5be8-4ab8-9866-3bed8fc3f824 req-4223adfd-c2ef-4fb8-a543-03f468e91098 service nova] Creating event network-changed:da8cca52-ce59-4c8c-8af1-ffba90ffdf3b for instance 98a4d015-588b-473c-afc3-0f6fbc3ea7d6 on n-h2-847009-3 Jul 19 23:04:21.815805 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-20bee08d-5be8-4ab8-9866-3bed8fc3f824 req-4223adfd-c2ef-4fb8-a543-03f468e91098 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098236 Jul 19 23:04:21.822498 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2823/5635] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:04:21.968483 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ee3b6af3-c3b4-4980-8674-21bf5ec92f8a tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:21.977163 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ee3b6af3-c3b4-4980-8674-21bf5ec92f8a tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1282 microversion: 2.1 time: 0.692030 Jul 19 23:04:21.993721 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2813/5636] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:21 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1282 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:23.011674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2fdf1391-65a2-4ad2-8905-c7504607e188 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:23.012413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2fdf1391-65a2-4ad2-8905-c7504607e188 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:23.044826 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fdf1391-65a2-4ad2-8905-c7504607e188 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:23.045596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fdf1391-65a2-4ad2-8905-c7504607e188 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:23.046586 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fdf1391-65a2-4ad2-8905-c7504607e188 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:23.047321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fdf1391-65a2-4ad2-8905-c7504607e188 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:23.437304 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2fdf1391-65a2-4ad2-8905-c7504607e188 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:23.454690 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2fdf1391-65a2-4ad2-8905-c7504607e188 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1282 microversion: 2.1 time: 0.448360 Jul 19 23:04:23.459331 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2824/5637] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:23 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1282 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:24.483126 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ab60406c-5113-4eca-8a89-7cd2d03eacf2 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:24.483774 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ab60406c-5113-4eca-8a89-7cd2d03eacf2 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:24.509290 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab60406c-5113-4eca-8a89-7cd2d03eacf2 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:24.509759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab60406c-5113-4eca-8a89-7cd2d03eacf2 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:24.510580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab60406c-5113-4eca-8a89-7cd2d03eacf2 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:24.511029 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab60406c-5113-4eca-8a89-7cd2d03eacf2 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:24.822086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=10 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:04:24.984071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ab60406c-5113-4eca-8a89-7cd2d03eacf2 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:25.000201 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ab60406c-5113-4eca-8a89-7cd2d03eacf2 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1282 microversion: 2.1 time: 0.526701 Jul 19 23:04:25.007944 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2814/5638] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:24 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1282 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:26.017982 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2bbfa9a5-ec66-47b2-ab66-70c14fefd5a0 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:26.018619 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2bbfa9a5-ec66-47b2-ab66-70c14fefd5a0 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:26.028862 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=8 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:04:26.041099 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bbfa9a5-ec66-47b2-ab66-70c14fefd5a0 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:26.056288 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bbfa9a5-ec66-47b2-ab66-70c14fefd5a0 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:26.056288 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bbfa9a5-ec66-47b2-ab66-70c14fefd5a0 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:26.056288 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bbfa9a5-ec66-47b2-ab66-70c14fefd5a0 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:26.604726 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2bbfa9a5-ec66-47b2-ab66-70c14fefd5a0 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:26.613349 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2bbfa9a5-ec66-47b2-ab66-70c14fefd5a0 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1282 microversion: 2.1 time: 0.599600 Jul 19 23:04:26.623489 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2825/5639] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:26 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1282 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:26.684113 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a3e6b51b-d0d9-4deb-bbbf-e02c18d965bf tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:04:26.695830 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3e6b51b-d0d9-4deb-bbbf-e02c18d965bf tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:26.704220 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3e6b51b-d0d9-4deb-bbbf-e02c18d965bf tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:26.829229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a3e6b51b-d0d9-4deb-bbbf-e02c18d965bf tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Going to try to stop instance {{(pid=119338) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 23:04:26.967934 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a3e6b51b-d0d9-4deb-bbbf-e02c18d965bf tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "POST /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f/action" status: 202 len: 0 microversion: 2.1 time: 0.286093 Jul 19 23:04:26.968584 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2815/5640] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:04:26 2022] POST /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:04:26.977832 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-183a1ef0-367d-498b-87f5-b87d9a99e737 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:26.978396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-183a1ef0-367d-498b-87f5-b87d9a99e737 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:26.989215 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-183a1ef0-367d-498b-87f5-b87d9a99e737 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:26.989716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-183a1ef0-367d-498b-87f5-b87d9a99e737 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:27.008214 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-183a1ef0-367d-498b-87f5-b87d9a99e737 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:27.008502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-183a1ef0-367d-498b-87f5-b87d9a99e737 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:27.424443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-183a1ef0-367d-498b-87f5-b87d9a99e737 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:27.438196 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-183a1ef0-367d-498b-87f5-b87d9a99e737 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1675 microversion: 2.1 time: 0.464910 Jul 19 23:04:27.452909 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2826/5641] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:26 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1675 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:27.634399 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3190d625-4a7a-410c-9bd0-8da90c15b735 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:27.635326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3190d625-4a7a-410c-9bd0-8da90c15b735 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:27.654369 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3190d625-4a7a-410c-9bd0-8da90c15b735 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:27.654957 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3190d625-4a7a-410c-9bd0-8da90c15b735 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:27.655476 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3190d625-4a7a-410c-9bd0-8da90c15b735 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:27.665282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3190d625-4a7a-410c-9bd0-8da90c15b735 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:28.073607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3190d625-4a7a-410c-9bd0-8da90c15b735 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:28.083245 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3190d625-4a7a-410c-9bd0-8da90c15b735 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1282 microversion: 2.1 time: 0.455096 Jul 19 23:04:28.083831 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2816/5642] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:27 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1282 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:28.457680 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4f08cdb7-398a-43a1-9c39-054b18b1dd62 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:28.460085 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4f08cdb7-398a-43a1-9c39-054b18b1dd62 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:28.472317 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f08cdb7-398a-43a1-9c39-054b18b1dd62 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:28.472776 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f08cdb7-398a-43a1-9c39-054b18b1dd62 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:28.473533 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f08cdb7-398a-43a1-9c39-054b18b1dd62 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:28.483588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f08cdb7-398a-43a1-9c39-054b18b1dd62 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:29.086222 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4f08cdb7-398a-43a1-9c39-054b18b1dd62 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:29.093817 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4f08cdb7-398a-43a1-9c39-054b18b1dd62 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1675 microversion: 2.1 time: 0.640513 Jul 19 23:04:29.094405 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2827/5643] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:28 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1675 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:29.104516 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-547657be-a10d-4d85-8b12-fff15fa2af27 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:29.104516 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-547657be-a10d-4d85-8b12-fff15fa2af27 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:29.116238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-547657be-a10d-4d85-8b12-fff15fa2af27 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:29.118350 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-547657be-a10d-4d85-8b12-fff15fa2af27 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:29.123743 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-547657be-a10d-4d85-8b12-fff15fa2af27 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:29.124539 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-547657be-a10d-4d85-8b12-fff15fa2af27 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:30.111983 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1ebfb7fe-3a71-43ba-9f20-3e45af483f91 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:30.112607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1ebfb7fe-3a71-43ba-9f20-3e45af483f91 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:30.136166 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1ebfb7fe-3a71-43ba-9f20-3e45af483f91 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:30.136788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1ebfb7fe-3a71-43ba-9f20-3e45af483f91 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:30.137596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1ebfb7fe-3a71-43ba-9f20-3e45af483f91 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:30.139763 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1ebfb7fe-3a71-43ba-9f20-3e45af483f91 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:30.548236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-547657be-a10d-4d85-8b12-fff15fa2af27 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:30.558026 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-547657be-a10d-4d85-8b12-fff15fa2af27 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1282 microversion: 2.1 time: 1.461182 Jul 19 23:04:30.581867 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2817/5644] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:29 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1282 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:30.634578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1ebfb7fe-3a71-43ba-9f20-3e45af483f91 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:30.650359 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1ebfb7fe-3a71-43ba-9f20-3e45af483f91 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1675 microversion: 2.1 time: 0.541861 Jul 19 23:04:30.651314 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2828/5645] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:30 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1675 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:04:31.590554 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9b540283-2639-448a-a3e9-74ed6fbf5649 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:31.591901 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9b540283-2639-448a-a3e9-74ed6fbf5649 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:31.610219 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b540283-2639-448a-a3e9-74ed6fbf5649 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:31.610877 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b540283-2639-448a-a3e9-74ed6fbf5649 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:31.615381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b540283-2639-448a-a3e9-74ed6fbf5649 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:31.618518 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b540283-2639-448a-a3e9-74ed6fbf5649 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:31.669323 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-499c7939-42df-45f6-a2bc-e5aaba9f9f32 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:31.670015 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-499c7939-42df-45f6-a2bc-e5aaba9f9f32 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:31.689798 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-499c7939-42df-45f6-a2bc-e5aaba9f9f32 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:31.692332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-499c7939-42df-45f6-a2bc-e5aaba9f9f32 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:31.695987 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-499c7939-42df-45f6-a2bc-e5aaba9f9f32 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:31.697530 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-499c7939-42df-45f6-a2bc-e5aaba9f9f32 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:32.315584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9b540283-2639-448a-a3e9-74ed6fbf5649 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:32.367968 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9b540283-2639-448a-a3e9-74ed6fbf5649 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1282 microversion: 2.1 time: 0.771805 Jul 19 23:04:32.369342 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2818/5646] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:31 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1282 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:04:32.393985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-499c7939-42df-45f6-a2bc-e5aaba9f9f32 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:32.404083 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-499c7939-42df-45f6-a2bc-e5aaba9f9f32 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1675 microversion: 2.1 time: 0.738545 Jul 19 23:04:32.405422 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2829/5647] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:31 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1675 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:33.388947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b3aed1b3-88d1-45fe-b564-7269413689fb tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:33.390684 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b3aed1b3-88d1-45fe-b564-7269413689fb tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:33.398551 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b3aed1b3-88d1-45fe-b564-7269413689fb tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:33.399508 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b3aed1b3-88d1-45fe-b564-7269413689fb tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:33.407472 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b3aed1b3-88d1-45fe-b564-7269413689fb tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:33.408586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b3aed1b3-88d1-45fe-b564-7269413689fb tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:33.421791 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cceae542-b18c-431e-b267-c8970db7ed16 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:33.422416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cceae542-b18c-431e-b267-c8970db7ed16 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:33.442906 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cceae542-b18c-431e-b267-c8970db7ed16 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:33.443700 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cceae542-b18c-431e-b267-c8970db7ed16 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:33.444689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cceae542-b18c-431e-b267-c8970db7ed16 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:33.447222 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cceae542-b18c-431e-b267-c8970db7ed16 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:34.261806 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cceae542-b18c-431e-b267-c8970db7ed16 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:34.277158 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cceae542-b18c-431e-b267-c8970db7ed16 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1675 microversion: 2.1 time: 0.859173 Jul 19 23:04:34.293191 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2830/5648] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:33 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1675 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:04:34.499597 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b3aed1b3-88d1-45fe-b564-7269413689fb tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:34.591939 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b3aed1b3-88d1-45fe-b564-7269413689fb tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1282 microversion: 2.1 time: 1.196442 Jul 19 23:04:34.617609 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2819/5649] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:33 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1282 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:35.301373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6e3e551f-2d65-4459-b967-d09a9b0c4615 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:35.302069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6e3e551f-2d65-4459-b967-d09a9b0c4615 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:35.313043 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:04:35.321423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e3e551f-2d65-4459-b967-d09a9b0c4615 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:35.321922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e3e551f-2d65-4459-b967-d09a9b0c4615 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:35.322760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e3e551f-2d65-4459-b967-d09a9b0c4615 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:35.327689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e3e551f-2d65-4459-b967-d09a9b0c4615 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:35.623313 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ae11c2bd-6783-4877-8c79-c5793a624e9a tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:35.624107 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ae11c2bd-6783-4877-8c79-c5793a624e9a tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:35.642978 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ae11c2bd-6783-4877-8c79-c5793a624e9a tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:35.643536 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ae11c2bd-6783-4877-8c79-c5793a624e9a tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:35.644384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ae11c2bd-6783-4877-8c79-c5793a624e9a tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:35.644827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ae11c2bd-6783-4877-8c79-c5793a624e9a tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:35.815816 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6e3e551f-2d65-4459-b967-d09a9b0c4615 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:35.825465 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6e3e551f-2d65-4459-b967-d09a9b0c4615 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1675 microversion: 2.1 time: 0.528968 Jul 19 23:04:35.830324 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2831/5650] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:35 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1675 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:36.050130 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ae11c2bd-6783-4877-8c79-c5793a624e9a tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:36.081842 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ae11c2bd-6783-4877-8c79-c5793a624e9a tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1282 microversion: 2.1 time: 0.465050 Jul 19 23:04:36.082523 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2820/5651] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:35 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1282 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:04:36.856075 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c356b318-99f1-4b35-b082-64856d21901e tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:36.856713 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c356b318-99f1-4b35-b082-64856d21901e tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:36.869969 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c356b318-99f1-4b35-b082-64856d21901e tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:36.870436 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c356b318-99f1-4b35-b082-64856d21901e tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:36.871265 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c356b318-99f1-4b35-b082-64856d21901e tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:36.871712 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c356b318-99f1-4b35-b082-64856d21901e tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:37.110254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d7872309-9a47-4fa3-94fb-d10afc09bec9 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:37.111557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d7872309-9a47-4fa3-94fb-d10afc09bec9 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:37.125144 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7872309-9a47-4fa3-94fb-d10afc09bec9 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:37.127358 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7872309-9a47-4fa3-94fb-d10afc09bec9 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:37.131089 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7872309-9a47-4fa3-94fb-d10afc09bec9 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:37.131918 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7872309-9a47-4fa3-94fb-d10afc09bec9 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:37.143934 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c356b318-99f1-4b35-b082-64856d21901e tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:37.154901 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c356b318-99f1-4b35-b082-64856d21901e tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1675 microversion: 2.1 time: 0.313277 Jul 19 23:04:37.156129 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2832/5652] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:36 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1675 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:38.046066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d7872309-9a47-4fa3-94fb-d10afc09bec9 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:38.078376 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d7872309-9a47-4fa3-94fb-d10afc09bec9 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1270 microversion: 2.1 time: 0.982316 Jul 19 23:04:38.081276 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2821/5653] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:37 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1270 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:38.172405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0afe01f8-268a-4422-9152-a1ac551b7143 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:38.173612 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0afe01f8-268a-4422-9152-a1ac551b7143 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:38.193248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0afe01f8-268a-4422-9152-a1ac551b7143 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:38.193977 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0afe01f8-268a-4422-9152-a1ac551b7143 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:38.195022 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0afe01f8-268a-4422-9152-a1ac551b7143 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:38.195691 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0afe01f8-268a-4422-9152-a1ac551b7143 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:38.486823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0afe01f8-268a-4422-9152-a1ac551b7143 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:38.497504 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0afe01f8-268a-4422-9152-a1ac551b7143 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1652 microversion: 2.1 time: 0.328983 Jul 19 23:04:38.512829 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2833/5654] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:38 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1652 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:38.514971 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-576d680b-64de-4522-97d7-4dd9cfdd1fa6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:04:38.528453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-576d680b-64de-4522-97d7-4dd9cfdd1fa6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:38.528818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-576d680b-64de-4522-97d7-4dd9cfdd1fa6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:38.598678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:04:38.604692 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-576d680b-64de-4522-97d7-4dd9cfdd1fa6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Going to try to start instance {{(pid=119338) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 23:04:38.687964 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-576d680b-64de-4522-97d7-4dd9cfdd1fa6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "POST /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f/action" status: 202 len: 0 microversion: 2.1 time: 0.176974 Jul 19 23:04:38.701611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-41d5791c-c125-4781-845d-4ae886b6cb28 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:38.703646 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2822/5655] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:04:38 2022] POST /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:04:38.704520 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-41d5791c-c125-4781-845d-4ae886b6cb28 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:38.714864 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41d5791c-c125-4781-845d-4ae886b6cb28 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:38.715867 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41d5791c-c125-4781-845d-4ae886b6cb28 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:38.716834 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41d5791c-c125-4781-845d-4ae886b6cb28 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:38.717624 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-41d5791c-c125-4781-845d-4ae886b6cb28 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:39.052295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-41d5791c-c125-4781-845d-4ae886b6cb28 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:39.064255 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-41d5791c-c125-4781-845d-4ae886b6cb28 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1661 microversion: 2.1 time: 0.370116 Jul 19 23:04:39.064694 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2834/5656] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:38 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1661 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:39.099819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5d09e4e1-7031-41d1-9fe2-ddda7c3e2c1b tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:39.100553 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5d09e4e1-7031-41d1-9fe2-ddda7c3e2c1b tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:39.111491 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:04:39.114617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d09e4e1-7031-41d1-9fe2-ddda7c3e2c1b tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:39.117468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d09e4e1-7031-41d1-9fe2-ddda7c3e2c1b tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:39.120033 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d09e4e1-7031-41d1-9fe2-ddda7c3e2c1b tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:39.134008 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d09e4e1-7031-41d1-9fe2-ddda7c3e2c1b tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:39.431784 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5d09e4e1-7031-41d1-9fe2-ddda7c3e2c1b tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:39.443682 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5d09e4e1-7031-41d1-9fe2-ddda7c3e2c1b tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1270 microversion: 2.1 time: 0.345692 Jul 19 23:04:39.443943 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2823/5657] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:39 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1270 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:40.082664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d11565f9-f77e-42c8-a155-4d907e6dfa35 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:40.083598 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d11565f9-f77e-42c8-a155-4d907e6dfa35 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:40.110588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d11565f9-f77e-42c8-a155-4d907e6dfa35 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:40.111982 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d11565f9-f77e-42c8-a155-4d907e6dfa35 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:40.114187 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d11565f9-f77e-42c8-a155-4d907e6dfa35 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:40.116470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d11565f9-f77e-42c8-a155-4d907e6dfa35 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:40.468495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1d3cde14-0a4e-4da5-9f76-962a482782de tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:40.470488 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1d3cde14-0a4e-4da5-9f76-962a482782de tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:40.500582 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d3cde14-0a4e-4da5-9f76-962a482782de tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:40.505484 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d3cde14-0a4e-4da5-9f76-962a482782de tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:40.505789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d3cde14-0a4e-4da5-9f76-962a482782de tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:40.506223 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d3cde14-0a4e-4da5-9f76-962a482782de tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:40.537585 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d11565f9-f77e-42c8-a155-4d907e6dfa35 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:40.554562 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d11565f9-f77e-42c8-a155-4d907e6dfa35 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1661 microversion: 2.1 time: 0.475613 Jul 19 23:04:40.555830 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2835/5658] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:40 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1661 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:40.897905 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1d3cde14-0a4e-4da5-9f76-962a482782de tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:40.911503 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1d3cde14-0a4e-4da5-9f76-962a482782de tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1270 microversion: 2.1 time: 0.454952 Jul 19 23:04:40.915492 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2824/5659] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:40 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1270 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:04:41.573194 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bdf4a37c-10ec-43e9-8593-a720e1bf8119 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:41.574004 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bdf4a37c-10ec-43e9-8593-a720e1bf8119 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:41.581316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bdf4a37c-10ec-43e9-8593-a720e1bf8119 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:41.581987 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bdf4a37c-10ec-43e9-8593-a720e1bf8119 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:41.582763 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bdf4a37c-10ec-43e9-8593-a720e1bf8119 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:41.583373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bdf4a37c-10ec-43e9-8593-a720e1bf8119 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:41.603898 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:04:41.796610 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bdf4a37c-10ec-43e9-8593-a720e1bf8119 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:41.809694 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bdf4a37c-10ec-43e9-8593-a720e1bf8119 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1665 microversion: 2.1 time: 0.241059 Jul 19 23:04:41.810577 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2836/5660] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:41 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1665 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:41.939160 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-67d9e0e3-ff90-4d38-908a-c4f60ac349ef tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:41.941020 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-67d9e0e3-ff90-4d38-908a-c4f60ac349ef tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:41.949621 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67d9e0e3-ff90-4d38-908a-c4f60ac349ef tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:41.950312 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67d9e0e3-ff90-4d38-908a-c4f60ac349ef tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:41.951221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67d9e0e3-ff90-4d38-908a-c4f60ac349ef tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:41.951738 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67d9e0e3-ff90-4d38-908a-c4f60ac349ef tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:42.286808 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-67d9e0e3-ff90-4d38-908a-c4f60ac349ef tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:42.301529 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-67d9e0e3-ff90-4d38-908a-c4f60ac349ef tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1270 microversion: 2.1 time: 0.367814 Jul 19 23:04:42.317192 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2825/5661] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:41 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1270 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:42.386175 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-121778a9-c5a6-4101-a189-a7438405fca2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1442523049", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7e495128-b23e-4c7f-86c7-8b9a0e045e15", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c424fcca-fcaa-49c5-9171-61018c1542cf"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:04:42.523998 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-121778a9-c5a6-4101-a189-a7438405fca2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] validate_networks() for [('c424fcca-fcaa-49c5-9171-61018c1542cf', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:04:43.176055 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-121778a9-c5a6-4101-a189-a7438405fca2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:04:43.177180 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-121778a9-c5a6-4101-a189-a7438405fca2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:04:43.177861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-121778a9-c5a6-4101-a189-a7438405fca2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:04:43.178474 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-121778a9-c5a6-4101-a189-a7438405fca2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:04:43.179671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-121778a9-c5a6-4101-a189-a7438405fca2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:04:43.191065 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-121778a9-c5a6-4101-a189-a7438405fca2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:43.191817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-121778a9-c5a6-4101-a189-a7438405fca2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:43.192799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-121778a9-c5a6-4101-a189-a7438405fca2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:43.193411 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-121778a9-c5a6-4101-a189-a7438405fca2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:43.215200 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-121778a9-c5a6-4101-a189-a7438405fca2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Getting quotas for project ba6762beb0fe4220b984143b3ea6bd48. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:04:43.221382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-121778a9-c5a6-4101-a189-a7438405fca2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Getting quotas for user deeb5431c1284d02b245ff3a9dc3f4e8 and project ba6762beb0fe4220b984143b3ea6bd48. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:04:43.303790 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-121778a9-c5a6-4101-a189-a7438405fca2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:04:43.309449 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-121778a9-c5a6-4101-a189-a7438405fca2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7e495128-b23e-4c7f-86c7-8b9a0e045e15',volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:04:43.338651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-334a9d97-c9a9-49e7-bebb-7131812c7986 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:43.340015 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-334a9d97-c9a9-49e7-bebb-7131812c7986 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:43.354027 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-334a9d97-c9a9-49e7-bebb-7131812c7986 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:43.356787 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-334a9d97-c9a9-49e7-bebb-7131812c7986 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:43.357876 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-334a9d97-c9a9-49e7-bebb-7131812c7986 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:43.359562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-334a9d97-c9a9-49e7-bebb-7131812c7986 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:43.615952 n-d-847009-3 devstack@n-api.service[119337]: ERROR oslo.messaging._drivers.impl_rabbit [None req-121778a9-c5a6-4101-a189-a7438405fca2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [0b45bbb0-4543-4854-8e6d-e27f8f224e3f] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 23:04:43.756339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-334a9d97-c9a9-49e7-bebb-7131812c7986 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:43.769797 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-334a9d97-c9a9-49e7-bebb-7131812c7986 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1270 microversion: 2.1 time: 0.437620 Jul 19 23:04:43.793045 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2826/5662] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:43 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1270 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:04:44.623686 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [None req-121778a9-c5a6-4101-a189-a7438405fca2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [0b45bbb0-4543-4854-8e6d-e27f8f224e3f] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 47808. Jul 19 23:04:44.627910 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-121778a9-c5a6-4101-a189-a7438405fca2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.248292 Jul 19 23:04:44.629506 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2837/5663] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:04:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 23:04:44.640269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4021b535-a29a-400d-ba96-0de20041184c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:44.641045 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4021b535-a29a-400d-ba96-0de20041184c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:44.799693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-13ede379-acbc-4645-89ae-0ebae41bb10d tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:44.800980 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-13ede379-acbc-4645-89ae-0ebae41bb10d tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:44.832918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13ede379-acbc-4645-89ae-0ebae41bb10d tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:44.833925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13ede379-acbc-4645-89ae-0ebae41bb10d tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:44.834776 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13ede379-acbc-4645-89ae-0ebae41bb10d tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:44.842400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13ede379-acbc-4645-89ae-0ebae41bb10d tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:44.950182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4021b535-a29a-400d-ba96-0de20041184c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:44.957635 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4021b535-a29a-400d-ba96-0de20041184c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1057 microversion: 2.1 time: 0.321246 Jul 19 23:04:44.959055 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2827/5664] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:44 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1057 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:45.341891 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-13ede379-acbc-4645-89ae-0ebae41bb10d tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:45.353001 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-13ede379-acbc-4645-89ae-0ebae41bb10d tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1270 microversion: 2.1 time: 0.557200 Jul 19 23:04:45.354261 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2838/5665] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:44 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1270 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:04:45.979203 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d3a051a9-7b77-48b0-8417-5a574de3d68a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:45.980778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d3a051a9-7b77-48b0-8417-5a574de3d68a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:46.018846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3a051a9-7b77-48b0-8417-5a574de3d68a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:46.021184 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3a051a9-7b77-48b0-8417-5a574de3d68a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:46.024071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3a051a9-7b77-48b0-8417-5a574de3d68a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:46.041173 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3a051a9-7b77-48b0-8417-5a574de3d68a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:46.288412 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d3a051a9-7b77-48b0-8417-5a574de3d68a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:46.301317 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d3a051a9-7b77-48b0-8417-5a574de3d68a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1099 microversion: 2.1 time: 0.328006 Jul 19 23:04:46.319191 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2828/5666] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:45 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1099 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:46.371794 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-05841df1-e5cd-4eb4-bdb4-5a42b4c3cade tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:46.372351 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-05841df1-e5cd-4eb4-bdb4-5a42b4c3cade tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:46.387457 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05841df1-e5cd-4eb4-bdb4-5a42b4c3cade tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:46.387936 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05841df1-e5cd-4eb4-bdb4-5a42b4c3cade tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:46.394421 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05841df1-e5cd-4eb4-bdb4-5a42b4c3cade tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:46.394982 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05841df1-e5cd-4eb4-bdb4-5a42b4c3cade tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:46.989596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-05841df1-e5cd-4eb4-bdb4-5a42b4c3cade tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:46.999364 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-05841df1-e5cd-4eb4-bdb4-5a42b4c3cade tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1270 microversion: 2.1 time: 0.633226 Jul 19 23:04:47.005605 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2839/5667] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:46 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1270 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:47.327034 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8100322b-0b83-49ea-bd93-2cbb394efdf9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:47.327882 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8100322b-0b83-49ea-bd93-2cbb394efdf9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:47.341870 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8100322b-0b83-49ea-bd93-2cbb394efdf9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:47.343966 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8100322b-0b83-49ea-bd93-2cbb394efdf9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:47.344841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8100322b-0b83-49ea-bd93-2cbb394efdf9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:47.345785 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8100322b-0b83-49ea-bd93-2cbb394efdf9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:47.651528 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8100322b-0b83-49ea-bd93-2cbb394efdf9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:47.668882 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8100322b-0b83-49ea-bd93-2cbb394efdf9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1173 microversion: 2.1 time: 0.344980 Jul 19 23:04:47.670765 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2829/5668] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:47 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1173 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:48.029290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5c8efad5-a2ae-486c-af83-5b0324883d82 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:48.030002 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5c8efad5-a2ae-486c-af83-5b0324883d82 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:48.060574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c8efad5-a2ae-486c-af83-5b0324883d82 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:48.062798 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c8efad5-a2ae-486c-af83-5b0324883d82 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:48.064489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c8efad5-a2ae-486c-af83-5b0324883d82 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:48.065836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c8efad5-a2ae-486c-af83-5b0324883d82 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:48.420419 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5c8efad5-a2ae-486c-af83-5b0324883d82 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:48.432818 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5c8efad5-a2ae-486c-af83-5b0324883d82 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1270 microversion: 2.1 time: 0.413374 Jul 19 23:04:48.434891 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2840/5669] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:48 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1270 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:48.687802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f478f2f9-45cf-4398-8840-294dc98b382a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:48.688976 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f478f2f9-45cf-4398-8840-294dc98b382a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:48.702946 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f478f2f9-45cf-4398-8840-294dc98b382a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:48.703731 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f478f2f9-45cf-4398-8840-294dc98b382a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:48.708255 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f478f2f9-45cf-4398-8840-294dc98b382a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:48.709156 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f478f2f9-45cf-4398-8840-294dc98b382a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:49.251024 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f478f2f9-45cf-4398-8840-294dc98b382a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:49.267571 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f478f2f9-45cf-4398-8840-294dc98b382a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1215 microversion: 2.1 time: 0.583732 Jul 19 23:04:49.269030 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2830/5670] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:48 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1215 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:49.452163 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fd30cfce-06b2-436a-97f7-13e3d87ac8f3 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:49.452728 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fd30cfce-06b2-436a-97f7-13e3d87ac8f3 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:49.468978 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd30cfce-06b2-436a-97f7-13e3d87ac8f3 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:49.469448 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd30cfce-06b2-436a-97f7-13e3d87ac8f3 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:49.470252 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd30cfce-06b2-436a-97f7-13e3d87ac8f3 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:49.470700 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fd30cfce-06b2-436a-97f7-13e3d87ac8f3 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:49.861603 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fd30cfce-06b2-436a-97f7-13e3d87ac8f3 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:49.870802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-7896453b-0f9e-465d-8846-0983c559514d req-aaab9a13-2b60-4d16-8706-65696c753f55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a4d015-588b-473c-afc3-0f6fbc3ea7d6", "name": "network-vif-plugged", "status": "completed", "tag": "da8cca52-ce59-4c8c-8af1-ffba90ffdf3b"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:04:49.881375 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fd30cfce-06b2-436a-97f7-13e3d87ac8f3 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1270 microversion: 2.1 time: 0.433887 Jul 19 23:04:49.882795 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2841/5671] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:49 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1270 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:04:49.891833 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7896453b-0f9e-465d-8846-0983c559514d req-aaab9a13-2b60-4d16-8706-65696c753f55 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:49.891833 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7896453b-0f9e-465d-8846-0983c559514d req-aaab9a13-2b60-4d16-8706-65696c753f55 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:49.921797 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-7896453b-0f9e-465d-8846-0983c559514d req-aaab9a13-2b60-4d16-8706-65696c753f55 service nova] Creating event network-vif-plugged:da8cca52-ce59-4c8c-8af1-ffba90ffdf3b for instance 98a4d015-588b-473c-afc3-0f6fbc3ea7d6 on n-h2-847009-3 Jul 19 23:04:49.940410 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-7896453b-0f9e-465d-8846-0983c559514d req-aaab9a13-2b60-4d16-8706-65696c753f55 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074101 Jul 19 23:04:49.941666 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2831/5672] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:04:50.248865 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-0e955c14-3b38-466d-a388-afea20ee6d87 req-58327175-46fe-476d-9bca-23099484f94d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de243299-11bd-403b-a17c-740522b92afc", "tag": "7ad1a526-9040-47d4-b48a-016448bd1684"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:04:50.265632 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-0e955c14-3b38-466d-a388-afea20ee6d87 req-58327175-46fe-476d-9bca-23099484f94d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:50.267685 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-0e955c14-3b38-466d-a388-afea20ee6d87 req-58327175-46fe-476d-9bca-23099484f94d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:50.285781 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0ddac463-4b9f-4c36-b855-2e8bf170052c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:50.286712 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0ddac463-4b9f-4c36-b855-2e8bf170052c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:50.313523 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-0e955c14-3b38-466d-a388-afea20ee6d87 req-58327175-46fe-476d-9bca-23099484f94d service nova] Creating event network-changed:7ad1a526-9040-47d4-b48a-016448bd1684 for instance de243299-11bd-403b-a17c-740522b92afc on n-h1-847009-3 Jul 19 23:04:50.321284 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ddac463-4b9f-4c36-b855-2e8bf170052c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:50.324193 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ddac463-4b9f-4c36-b855-2e8bf170052c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:50.325295 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ddac463-4b9f-4c36-b855-2e8bf170052c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:50.325764 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ddac463-4b9f-4c36-b855-2e8bf170052c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:50.343057 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-0e955c14-3b38-466d-a388-afea20ee6d87 req-58327175-46fe-476d-9bca-23099484f94d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097590 Jul 19 23:04:50.344156 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2842/5673] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:04:50.767429 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0ddac463-4b9f-4c36-b855-2e8bf170052c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:50.785436 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0ddac463-4b9f-4c36-b855-2e8bf170052c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1215 microversion: 2.1 time: 0.503485 Jul 19 23:04:50.801134 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2832/5674] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:50 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1215 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:50.911645 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a80da858-6acf-48a9-b8d2-f41883aa2e34 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:50.913132 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a80da858-6acf-48a9-b8d2-f41883aa2e34 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:50.952379 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a80da858-6acf-48a9-b8d2-f41883aa2e34 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:50.953830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a80da858-6acf-48a9-b8d2-f41883aa2e34 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:50.960828 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a80da858-6acf-48a9-b8d2-f41883aa2e34 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:50.961714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a80da858-6acf-48a9-b8d2-f41883aa2e34 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:51.264614 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a80da858-6acf-48a9-b8d2-f41883aa2e34 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:51.274576 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a80da858-6acf-48a9-b8d2-f41883aa2e34 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1270 microversion: 2.1 time: 0.375202 Jul 19 23:04:51.297671 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2843/5675] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:50 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1270 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:51.814705 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-58a42ddd-1d69-4b20-98ae-e6c6fcd296ac tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:51.816157 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-58a42ddd-1d69-4b20-98ae-e6c6fcd296ac tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:51.833088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58a42ddd-1d69-4b20-98ae-e6c6fcd296ac tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:51.843241 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58a42ddd-1d69-4b20-98ae-e6c6fcd296ac tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:51.844610 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58a42ddd-1d69-4b20-98ae-e6c6fcd296ac tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:51.845259 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58a42ddd-1d69-4b20-98ae-e6c6fcd296ac tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:52.295426 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3220b980-1065-44b5-b884-b4c9fd0e44ed tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:52.296267 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3220b980-1065-44b5-b884-b4c9fd0e44ed tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:52.312040 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3220b980-1065-44b5-b884-b4c9fd0e44ed tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:52.315006 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3220b980-1065-44b5-b884-b4c9fd0e44ed tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:52.316941 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3220b980-1065-44b5-b884-b4c9fd0e44ed tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:52.317508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3220b980-1065-44b5-b884-b4c9fd0e44ed tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:52.557549 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-58a42ddd-1d69-4b20-98ae-e6c6fcd296ac tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:52.566260 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-58a42ddd-1d69-4b20-98ae-e6c6fcd296ac tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1215 microversion: 2.1 time: 0.757232 Jul 19 23:04:52.577057 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2833/5676] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:51 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1215 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:04:52.625366 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3220b980-1065-44b5-b884-b4c9fd0e44ed tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:52.635883 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3220b980-1065-44b5-b884-b4c9fd0e44ed tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1459 microversion: 2.1 time: 0.345857 Jul 19 23:04:52.637061 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2844/5677] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:52 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1459 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:04:52.657608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3b83a2b6-071e-4c50-aae6-ea33ecd9dc42 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:52.658648 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3b83a2b6-071e-4c50-aae6-ea33ecd9dc42 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:52.665428 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b83a2b6-071e-4c50-aae6-ea33ecd9dc42 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:52.666217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b83a2b6-071e-4c50-aae6-ea33ecd9dc42 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:52.667314 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b83a2b6-071e-4c50-aae6-ea33ecd9dc42 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:52.667980 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b83a2b6-071e-4c50-aae6-ea33ecd9dc42 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:52.845093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3b83a2b6-071e-4c50-aae6-ea33ecd9dc42 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:52.854871 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3b83a2b6-071e-4c50-aae6-ea33ecd9dc42 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1459 microversion: 2.1 time: 0.201828 Jul 19 23:04:52.856622 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2834/5678] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:52 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1459 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:53.585377 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a8dc0ab3-b021-403b-8dac-e15b49e6d108 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:53.586364 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a8dc0ab3-b021-403b-8dac-e15b49e6d108 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:53.595210 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:04:53.597899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:04:53.606644 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a8dc0ab3-b021-403b-8dac-e15b49e6d108 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:53.608993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a8dc0ab3-b021-403b-8dac-e15b49e6d108 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:53.611232 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a8dc0ab3-b021-403b-8dac-e15b49e6d108 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:53.612423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a8dc0ab3-b021-403b-8dac-e15b49e6d108 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:53.861585 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a8dc0ab3-b021-403b-8dac-e15b49e6d108 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:53.873473 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a8dc0ab3-b021-403b-8dac-e15b49e6d108 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1215 microversion: 2.1 time: 0.292745 Jul 19 23:04:53.887014 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2845/5679] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:53 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1215 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:54.894430 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e1208858-63a1-4e34-b3e6-7b3d31c334bd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:54.895806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e1208858-63a1-4e34-b3e6-7b3d31c334bd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:54.904344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1208858-63a1-4e34-b3e6-7b3d31c334bd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:54.905204 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1208858-63a1-4e34-b3e6-7b3d31c334bd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:54.906428 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1208858-63a1-4e34-b3e6-7b3d31c334bd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:54.907128 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1208858-63a1-4e34-b3e6-7b3d31c334bd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:54.957607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:04:55.097695 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e1208858-63a1-4e34-b3e6-7b3d31c334bd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:55.107202 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e1208858-63a1-4e34-b3e6-7b3d31c334bd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1215 microversion: 2.1 time: 0.216564 Jul 19 23:04:55.107798 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2835/5680] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:54 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1215 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:56.068974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-9c329777-9fe2-43c5-a076-85398b290508 req-d8044d37-9b31-4a01-9638-b2a1298b55da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98a4d015-588b-473c-afc3-0f6fbc3ea7d6", "tag": "da8cca52-ce59-4c8c-8af1-ffba90ffdf3b"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:04:56.099646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-9c329777-9fe2-43c5-a076-85398b290508 req-d8044d37-9b31-4a01-9638-b2a1298b55da service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:56.102591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-9c329777-9fe2-43c5-a076-85398b290508 req-d8044d37-9b31-4a01-9638-b2a1298b55da service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:56.119984 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-9c329777-9fe2-43c5-a076-85398b290508 req-d8044d37-9b31-4a01-9638-b2a1298b55da service nova] Creating event network-changed:da8cca52-ce59-4c8c-8af1-ffba90ffdf3b for instance 98a4d015-588b-473c-afc3-0f6fbc3ea7d6 on n-h2-847009-3 Jul 19 23:04:56.141385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5e2d120c-0721-445d-a9f8-72f848a8d5c3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:56.142653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5e2d120c-0721-445d-a9f8-72f848a8d5c3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:56.143968 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-9c329777-9fe2-43c5-a076-85398b290508 req-d8044d37-9b31-4a01-9638-b2a1298b55da service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077049 Jul 19 23:04:56.148183 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2846/5681] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:04:56.162448 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e2d120c-0721-445d-a9f8-72f848a8d5c3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:56.163655 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e2d120c-0721-445d-a9f8-72f848a8d5c3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:56.167233 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e2d120c-0721-445d-a9f8-72f848a8d5c3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:56.169783 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e2d120c-0721-445d-a9f8-72f848a8d5c3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:56.572528 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5e2d120c-0721-445d-a9f8-72f848a8d5c3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:56.593972 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5e2d120c-0721-445d-a9f8-72f848a8d5c3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1215 microversion: 2.1 time: 0.462860 Jul 19 23:04:56.595433 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2836/5682] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:56 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1215 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:57.615324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1b4ebfbc-ddc9-40e2-9f4f-43bec66e8b49 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:57.618230 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1b4ebfbc-ddc9-40e2-9f4f-43bec66e8b49 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:57.645981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b4ebfbc-ddc9-40e2-9f4f-43bec66e8b49 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:57.646521 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b4ebfbc-ddc9-40e2-9f4f-43bec66e8b49 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:57.653065 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b4ebfbc-ddc9-40e2-9f4f-43bec66e8b49 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:57.654134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b4ebfbc-ddc9-40e2-9f4f-43bec66e8b49 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:57.921599 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1b4ebfbc-ddc9-40e2-9f4f-43bec66e8b49 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:57.932247 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1b4ebfbc-ddc9-40e2-9f4f-43bec66e8b49 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1215 microversion: 2.1 time: 0.322494 Jul 19 23:04:57.943418 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2847/5683] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:57 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1215 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:04:58.268927 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-40147ed2-c3bb-40b0-ba1e-363b7004131e req-44768721-3ad4-4574-b3d3-7c48ca8be398 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98a4d015-588b-473c-afc3-0f6fbc3ea7d6", "tag": "da8cca52-ce59-4c8c-8af1-ffba90ffdf3b"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:04:58.298180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-40147ed2-c3bb-40b0-ba1e-363b7004131e req-44768721-3ad4-4574-b3d3-7c48ca8be398 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:58.298857 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-40147ed2-c3bb-40b0-ba1e-363b7004131e req-44768721-3ad4-4574-b3d3-7c48ca8be398 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:58.316356 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-40147ed2-c3bb-40b0-ba1e-363b7004131e req-44768721-3ad4-4574-b3d3-7c48ca8be398 service nova] Creating event network-changed:da8cca52-ce59-4c8c-8af1-ffba90ffdf3b for instance 98a4d015-588b-473c-afc3-0f6fbc3ea7d6 on n-h2-847009-3 Jul 19 23:04:58.323612 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-40147ed2-c3bb-40b0-ba1e-363b7004131e req-44768721-3ad4-4574-b3d3-7c48ca8be398 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063186 Jul 19 23:04:58.324586 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2837/5684] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:04:58.958240 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-46b5ef92-d6f9-4609-b3ce-e6813311912c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:04:58.959377 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-46b5ef92-d6f9-4609-b3ce-e6813311912c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:04:59.010758 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46b5ef92-d6f9-4609-b3ce-e6813311912c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:59.011978 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46b5ef92-d6f9-4609-b3ce-e6813311912c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:59.013708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46b5ef92-d6f9-4609-b3ce-e6813311912c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:04:59.016820 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46b5ef92-d6f9-4609-b3ce-e6813311912c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:04:59.402264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-46b5ef92-d6f9-4609-b3ce-e6813311912c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:04:59.429401 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-46b5ef92-d6f9-4609-b3ce-e6813311912c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1215 microversion: 2.1 time: 0.480060 Jul 19 23:04:59.446847 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2848/5685] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:04:58 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1215 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:00.413285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-f9eac912-229d-4a69-9655-2a3c4684a6a1 req-b68560c3-2d48-478e-af3c-2ce6825d993a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98a4d015-588b-473c-afc3-0f6fbc3ea7d6", "tag": "da8cca52-ce59-4c8c-8af1-ffba90ffdf3b"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:05:00.464991 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f9eac912-229d-4a69-9655-2a3c4684a6a1 req-b68560c3-2d48-478e-af3c-2ce6825d993a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:00.464991 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f9eac912-229d-4a69-9655-2a3c4684a6a1 req-b68560c3-2d48-478e-af3c-2ce6825d993a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:00.465393 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d40269df-3c15-4ae5-b607-3873f0dd25bb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:00.465393 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d40269df-3c15-4ae5-b607-3873f0dd25bb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:00.479839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d40269df-3c15-4ae5-b607-3873f0dd25bb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:00.480779 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d40269df-3c15-4ae5-b607-3873f0dd25bb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:00.485413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d40269df-3c15-4ae5-b607-3873f0dd25bb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:00.486332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d40269df-3c15-4ae5-b607-3873f0dd25bb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:00.488411 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-f9eac912-229d-4a69-9655-2a3c4684a6a1 req-b68560c3-2d48-478e-af3c-2ce6825d993a service nova] Creating event network-changed:da8cca52-ce59-4c8c-8af1-ffba90ffdf3b for instance 98a4d015-588b-473c-afc3-0f6fbc3ea7d6 on n-h2-847009-3 Jul 19 23:05:00.509098 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-f9eac912-229d-4a69-9655-2a3c4684a6a1 req-b68560c3-2d48-478e-af3c-2ce6825d993a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112233 Jul 19 23:05:00.513412 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2838/5686] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:05:01.081553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d40269df-3c15-4ae5-b607-3873f0dd25bb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:01.092414 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d40269df-3c15-4ae5-b607-3873f0dd25bb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1215 microversion: 2.1 time: 0.640193 Jul 19 23:05:01.093548 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2849/5687] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:00 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1215 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:02.116919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9834d158-180d-47b8-9303-2bb9a96bc047 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:02.118479 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9834d158-180d-47b8-9303-2bb9a96bc047 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:02.126463 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9834d158-180d-47b8-9303-2bb9a96bc047 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:02.126919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9834d158-180d-47b8-9303-2bb9a96bc047 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:02.127771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9834d158-180d-47b8-9303-2bb9a96bc047 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:02.128214 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9834d158-180d-47b8-9303-2bb9a96bc047 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:02.299944 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9834d158-180d-47b8-9303-2bb9a96bc047 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:02.313513 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9834d158-180d-47b8-9303-2bb9a96bc047 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1203 microversion: 2.1 time: 0.201715 Jul 19 23:05:02.322792 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2839/5688] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:02 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1203 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:03.332309 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b8bf67a1-586c-48c2-8b98-26fd48ddfc29 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:03.333636 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b8bf67a1-586c-48c2-8b98-26fd48ddfc29 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:03.349212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8bf67a1-586c-48c2-8b98-26fd48ddfc29 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:03.350125 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8bf67a1-586c-48c2-8b98-26fd48ddfc29 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:03.351196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8bf67a1-586c-48c2-8b98-26fd48ddfc29 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:03.351844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8bf67a1-586c-48c2-8b98-26fd48ddfc29 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:03.661166 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b8bf67a1-586c-48c2-8b98-26fd48ddfc29 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:03.688871 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b8bf67a1-586c-48c2-8b98-26fd48ddfc29 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1203 microversion: 2.1 time: 0.360902 Jul 19 23:05:03.690060 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2850/5689] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:03 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1203 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:04.721855 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-875b6a76-4bc6-4c3a-9598-5ef58637cc34 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:04.722922 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-875b6a76-4bc6-4c3a-9598-5ef58637cc34 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:04.749007 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-875b6a76-4bc6-4c3a-9598-5ef58637cc34 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:04.751339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-875b6a76-4bc6-4c3a-9598-5ef58637cc34 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:04.755411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-875b6a76-4bc6-4c3a-9598-5ef58637cc34 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:04.757869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-875b6a76-4bc6-4c3a-9598-5ef58637cc34 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:05.216840 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-875b6a76-4bc6-4c3a-9598-5ef58637cc34 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:05.230213 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-875b6a76-4bc6-4c3a-9598-5ef58637cc34 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1203 microversion: 2.1 time: 0.514205 Jul 19 23:05:05.231267 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2840/5690] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:04 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1203 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:06.250530 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-946aca6b-273b-4c43-b125-a0f87274b59d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:06.251753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-946aca6b-273b-4c43-b125-a0f87274b59d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:06.277619 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:05:06.282325 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-946aca6b-273b-4c43-b125-a0f87274b59d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:06.284789 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-946aca6b-273b-4c43-b125-a0f87274b59d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:06.285836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-946aca6b-273b-4c43-b125-a0f87274b59d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:06.286513 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-946aca6b-273b-4c43-b125-a0f87274b59d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:06.687380 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-946aca6b-273b-4c43-b125-a0f87274b59d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:06.705972 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-946aca6b-273b-4c43-b125-a0f87274b59d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1203 microversion: 2.1 time: 0.460182 Jul 19 23:05:06.711695 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2851/5691] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:06 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1203 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:07.729604 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a551018e-9c72-4a5b-b522-b9233a8cfaf9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:07.731037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a551018e-9c72-4a5b-b522-b9233a8cfaf9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:07.750962 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a551018e-9c72-4a5b-b522-b9233a8cfaf9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:07.755506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a551018e-9c72-4a5b-b522-b9233a8cfaf9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:07.757333 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a551018e-9c72-4a5b-b522-b9233a8cfaf9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:07.765074 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a551018e-9c72-4a5b-b522-b9233a8cfaf9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:07.772834 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:05:08.726326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a551018e-9c72-4a5b-b522-b9233a8cfaf9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:08.763319 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a551018e-9c72-4a5b-b522-b9233a8cfaf9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1203 microversion: 2.1 time: 1.021861 Jul 19 23:05:08.763862 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2841/5692] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:07 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1203 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:09.744966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-014497b8-25a3-4ad2-858c-ac255a11b012 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Action: 'create', calling method: .version_select at 0x7f7a03efbdc0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1916981386", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpBdrtvjiOSq5v0vFpOYog74GZ8MXqnnj7k+6Psh2cDbUQ7hy+CvGi66q83oYkiQVCP0MRCff7MEPQ+KBiMVAhVo/fEPPeLGdfy0CnKyPggvdKvVVClDvMwCpMnVt6bnA=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:05:09.767624 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-014497b8-25a3-4ad2-858c-ac255a11b012 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Getting quotas for project 9370b564007740c4a619273e03c78dca. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:05:09.801839 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b928d6f7-bc7e-4302-a976-33e2d8dea110 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:09.802698 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b928d6f7-bc7e-4302-a976-33e2d8dea110 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:09.808295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-014497b8-25a3-4ad2-858c-ac255a11b012 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Getting quotas for user ea2ea35da78245bfaf9651d7afb5fe66 and project 9370b564007740c4a619273e03c78dca. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:05:09.816773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=40 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:05:09.824658 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b928d6f7-bc7e-4302-a976-33e2d8dea110 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:09.826107 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b928d6f7-bc7e-4302-a976-33e2d8dea110 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:09.827012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b928d6f7-bc7e-4302-a976-33e2d8dea110 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:09.829823 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b928d6f7-bc7e-4302-a976-33e2d8dea110 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:09.878955 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-014497b8-25a3-4ad2-858c-ac255a11b012 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.140078 Jul 19 23:05:09.885689 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2852/5693] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 23:05:09 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:05:10.157587 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b928d6f7-bc7e-4302-a976-33e2d8dea110 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:10.170175 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b928d6f7-bc7e-4302-a976-33e2d8dea110 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1203 microversion: 2.1 time: 0.382078 Jul 19 23:05:10.171312 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2842/5694] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:09 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1203 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:11.191882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0d041cba-e0f1-4867-845f-71d01443d20c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:11.193395 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0d041cba-e0f1-4867-845f-71d01443d20c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:11.214124 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d041cba-e0f1-4867-845f-71d01443d20c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:11.215249 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d041cba-e0f1-4867-845f-71d01443d20c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:11.216842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d041cba-e0f1-4867-845f-71d01443d20c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:11.218388 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d041cba-e0f1-4867-845f-71d01443d20c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:11.474545 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0d041cba-e0f1-4867-845f-71d01443d20c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:11.487090 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0d041cba-e0f1-4867-845f-71d01443d20c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1203 microversion: 2.1 time: 0.299371 Jul 19 23:05:11.488328 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2853/5695] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:11 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1203 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:11.875415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ca6a726f-f3d7-4aa3-8837-4ec26862ea89 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-272960970", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "33b9fc35-5749-462e-94ff-48fe98b6dc8f"}], "key_name": "tempest-TestNetworkBasicOps-1916981386", "security_groups": [{"name": "tempest-secgroup-smoke-2008181576"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:05:12.372122 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-ca6a726f-f3d7-4aa3-8837-4ec26862ea89 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] validate_networks() for [('33b9fc35-5749-462e-94ff-48fe98b6dc8f', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:05:12.508746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d20f4012-dbcc-433f-b795-e988de2a26cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:12.511578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d20f4012-dbcc-433f-b795-e988de2a26cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:12.525248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d20f4012-dbcc-433f-b795-e988de2a26cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:12.535669 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d20f4012-dbcc-433f-b795-e988de2a26cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:12.542186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d20f4012-dbcc-433f-b795-e988de2a26cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:12.544160 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d20f4012-dbcc-433f-b795-e988de2a26cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:12.616784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=87 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:05:12.955693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d20f4012-dbcc-433f-b795-e988de2a26cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:12.968207 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d20f4012-dbcc-433f-b795-e988de2a26cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1203 microversion: 2.1 time: 0.463515 Jul 19 23:05:12.977258 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2854/5696] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:12 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1203 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:13.132964 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-ca6a726f-f3d7-4aa3-8837-4ec26862ea89 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:05:13.134866 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-ca6a726f-f3d7-4aa3-8837-4ec26862ea89 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:05:13.135760 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-ca6a726f-f3d7-4aa3-8837-4ec26862ea89 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:05:13.136362 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-ca6a726f-f3d7-4aa3-8837-4ec26862ea89 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:05:13.136963 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-ca6a726f-f3d7-4aa3-8837-4ec26862ea89 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:05:13.151611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca6a726f-f3d7-4aa3-8837-4ec26862ea89 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:13.152369 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca6a726f-f3d7-4aa3-8837-4ec26862ea89 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:13.153680 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca6a726f-f3d7-4aa3-8837-4ec26862ea89 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:13.155307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca6a726f-f3d7-4aa3-8837-4ec26862ea89 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:13.182327 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-ca6a726f-f3d7-4aa3-8837-4ec26862ea89 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Getting quotas for project 9370b564007740c4a619273e03c78dca. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:05:13.189752 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-ca6a726f-f3d7-4aa3-8837-4ec26862ea89 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Getting quotas for user ea2ea35da78245bfaf9651d7afb5fe66 and project 9370b564007740c4a619273e03c78dca. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:05:13.209951 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ca6a726f-f3d7-4aa3-8837-4ec26862ea89 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:05:13.214187 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ca6a726f-f3d7-4aa3-8837-4ec26862ea89 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: abb31b9a-6d7d-43af-8eb3-57af34fc02ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:05:13.278827 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ca6a726f-f3d7-4aa3-8837-4ec26862ea89 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.407014 Jul 19 23:05:13.279874 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2843/5697] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:05:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:05:13.294510 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9820724b-6a5a-4d5d-9336-105e24c7f041 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:13.296097 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9820724b-6a5a-4d5d-9336-105e24c7f041 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: abb31b9a-6d7d-43af-8eb3-57af34fc02ed] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:13.401070 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9820724b-6a5a-4d5d-9336-105e24c7f041 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:13.412418 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9820724b-6a5a-4d5d-9336-105e24c7f041 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed" status: 200 len: 1248 microversion: 2.1 time: 0.125940 Jul 19 23:05:13.414371 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2855/5698] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:13 2022] GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed => generated 1248 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:14.004190 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-43f0235b-0893-488c-ae58-f08137553701 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:14.005191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-43f0235b-0893-488c-ae58-f08137553701 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:14.025965 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43f0235b-0893-488c-ae58-f08137553701 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:14.030391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43f0235b-0893-488c-ae58-f08137553701 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:14.032610 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43f0235b-0893-488c-ae58-f08137553701 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:14.034494 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43f0235b-0893-488c-ae58-f08137553701 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:14.383736 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-43f0235b-0893-488c-ae58-f08137553701 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:14.399287 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-43f0235b-0893-488c-ae58-f08137553701 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1203 microversion: 2.1 time: 0.406595 Jul 19 23:05:14.399981 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2844/5699] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:13 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1203 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:14.437943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7c420a5c-cac5-4dac-983b-f9ae648bda3e tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:14.440105 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7c420a5c-cac5-4dac-983b-f9ae648bda3e tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: abb31b9a-6d7d-43af-8eb3-57af34fc02ed] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:14.468282 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7c420a5c-cac5-4dac-983b-f9ae648bda3e tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:14.470156 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7c420a5c-cac5-4dac-983b-f9ae648bda3e tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:14.471454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7c420a5c-cac5-4dac-983b-f9ae648bda3e tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:14.472306 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7c420a5c-cac5-4dac-983b-f9ae648bda3e tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:14.617460 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7c420a5c-cac5-4dac-983b-f9ae648bda3e tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:14.627218 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7c420a5c-cac5-4dac-983b-f9ae648bda3e tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed" status: 200 len: 1244 microversion: 2.1 time: 0.197049 Jul 19 23:05:14.629028 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2856/5700] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:14 2022] GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed => generated 1244 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:05:14.833215 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-14784fb8-3c8f-4f9b-b798-5d926e05dc69 req-689e9b36-631f-491a-89c5-ed0670bdd35e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de243299-11bd-403b-a17c-740522b92afc", "name": "network-vif-plugged", "status": "completed", "tag": "7ad1a526-9040-47d4-b48a-016448bd1684"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:05:14.844507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-14784fb8-3c8f-4f9b-b798-5d926e05dc69 req-689e9b36-631f-491a-89c5-ed0670bdd35e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:14.845271 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-14784fb8-3c8f-4f9b-b798-5d926e05dc69 req-689e9b36-631f-491a-89c5-ed0670bdd35e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:14.863176 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-14784fb8-3c8f-4f9b-b798-5d926e05dc69 req-689e9b36-631f-491a-89c5-ed0670bdd35e service nova] Creating event network-vif-plugged:7ad1a526-9040-47d4-b48a-016448bd1684 for instance de243299-11bd-403b-a17c-740522b92afc on n-h1-847009-3 Jul 19 23:05:14.874415 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-14784fb8-3c8f-4f9b-b798-5d926e05dc69 req-689e9b36-631f-491a-89c5-ed0670bdd35e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045183 Jul 19 23:05:14.875753 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2845/5701] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:05:15.423602 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d31df655-dd45-496f-9ae5-d2874e3db3d3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:15.423602 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d31df655-dd45-496f-9ae5-d2874e3db3d3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:15.431611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d31df655-dd45-496f-9ae5-d2874e3db3d3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:15.431611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d31df655-dd45-496f-9ae5-d2874e3db3d3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:15.436755 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d31df655-dd45-496f-9ae5-d2874e3db3d3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:15.436755 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d31df655-dd45-496f-9ae5-d2874e3db3d3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:15.635353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d31df655-dd45-496f-9ae5-d2874e3db3d3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:15.649115 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-da504637-979e-49f7-9722-325526759ce6 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:15.650604 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-da504637-979e-49f7-9722-325526759ce6 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: abb31b9a-6d7d-43af-8eb3-57af34fc02ed] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:15.660414 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d31df655-dd45-496f-9ae5-d2874e3db3d3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1203 microversion: 2.1 time: 0.246704 Jul 19 23:05:15.686871 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2857/5702] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:15 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1203 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:15.692909 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da504637-979e-49f7-9722-325526759ce6 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:15.694469 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da504637-979e-49f7-9722-325526759ce6 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:15.698621 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da504637-979e-49f7-9722-325526759ce6 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:15.699283 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da504637-979e-49f7-9722-325526759ce6 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:15.809709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-da504637-979e-49f7-9722-325526759ce6 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:15.822572 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-da504637-979e-49f7-9722-325526759ce6 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed" status: 200 len: 1306 microversion: 2.1 time: 0.180349 Jul 19 23:05:15.823681 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2846/5703] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:15 2022] GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed => generated 1306 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:16.684317 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d086d1a6-0ada-43ec-b44d-85286892c27a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:16.685256 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d086d1a6-0ada-43ec-b44d-85286892c27a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:16.696244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d086d1a6-0ada-43ec-b44d-85286892c27a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:16.697129 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d086d1a6-0ada-43ec-b44d-85286892c27a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:16.698689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d086d1a6-0ada-43ec-b44d-85286892c27a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:16.699710 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d086d1a6-0ada-43ec-b44d-85286892c27a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:16.843936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b634be7d-fb04-4c0c-9818-8f2b1b470e2c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:16.844689 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b634be7d-fb04-4c0c-9818-8f2b1b470e2c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: abb31b9a-6d7d-43af-8eb3-57af34fc02ed] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:16.855681 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b634be7d-fb04-4c0c-9818-8f2b1b470e2c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:16.861193 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b634be7d-fb04-4c0c-9818-8f2b1b470e2c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:16.864487 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b634be7d-fb04-4c0c-9818-8f2b1b470e2c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:16.865205 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b634be7d-fb04-4c0c-9818-8f2b1b470e2c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:17.022162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d086d1a6-0ada-43ec-b44d-85286892c27a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:17.036198 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d086d1a6-0ada-43ec-b44d-85286892c27a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1390 microversion: 2.1 time: 0.359775 Jul 19 23:05:17.036845 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2858/5704] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:16 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1390 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:17.059717 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-46d51e63-3ac1-44b1-aced-b86048ad627b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:17.060574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-46d51e63-3ac1-44b1-aced-b86048ad627b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:17.067697 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46d51e63-3ac1-44b1-aced-b86048ad627b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:17.069383 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46d51e63-3ac1-44b1-aced-b86048ad627b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:17.070381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46d51e63-3ac1-44b1-aced-b86048ad627b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:17.071527 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46d51e63-3ac1-44b1-aced-b86048ad627b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:17.207468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b634be7d-fb04-4c0c-9818-8f2b1b470e2c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:17.223914 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b634be7d-fb04-4c0c-9818-8f2b1b470e2c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed" status: 200 len: 1374 microversion: 2.1 time: 0.386451 Jul 19 23:05:17.237508 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2847/5705] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:16 2022] GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed => generated 1374 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:17.353636 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-46d51e63-3ac1-44b1-aced-b86048ad627b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:17.377393 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-46d51e63-3ac1-44b1-aced-b86048ad627b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1390 microversion: 2.1 time: 0.328050 Jul 19 23:05:17.395936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cbbba07b-7372-4d61-b734-2a2ec1890d5c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:17.397476 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cbbba07b-7372-4d61-b734-2a2ec1890d5c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:17.415845 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cbbba07b-7372-4d61-b734-2a2ec1890d5c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:17.416397 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2859/5706] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:17 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1390 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:17.419027 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cbbba07b-7372-4d61-b734-2a2ec1890d5c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:17.420441 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cbbba07b-7372-4d61-b734-2a2ec1890d5c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:17.421117 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cbbba07b-7372-4d61-b734-2a2ec1890d5c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:17.609910 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cbbba07b-7372-4d61-b734-2a2ec1890d5c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:17.623332 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cbbba07b-7372-4d61-b734-2a2ec1890d5c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1390 microversion: 2.1 time: 0.231045 Jul 19 23:05:17.624766 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2848/5707] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:17 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1390 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:17.643758 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dadce92a-1b70-43da-9f48-11640f7bc1ff tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:17.644668 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dadce92a-1b70-43da-9f48-11640f7bc1ff tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:17.653330 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dadce92a-1b70-43da-9f48-11640f7bc1ff tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:17.653825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dadce92a-1b70-43da-9f48-11640f7bc1ff tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:17.654952 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dadce92a-1b70-43da-9f48-11640f7bc1ff tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:17.655731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dadce92a-1b70-43da-9f48-11640f7bc1ff tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:17.710964 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dadce92a-1b70-43da-9f48-11640f7bc1ff tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:05:17.751464 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-1620297f-dd0e-4c6c-82e0-97792419d617 req-34fa4f4f-a834-4fc3-b8dd-359f42561888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abb31b9a-6d7d-43af-8eb3-57af34fc02ed", "tag": "748a6ed8-6858-4cda-ba15-99debaf1eb59"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:05:17.771532 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-1620297f-dd0e-4c6c-82e0-97792419d617 req-34fa4f4f-a834-4fc3-b8dd-359f42561888 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:17.788196 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-1620297f-dd0e-4c6c-82e0-97792419d617 req-34fa4f4f-a834-4fc3-b8dd-359f42561888 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:17.818404 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-1620297f-dd0e-4c6c-82e0-97792419d617 req-34fa4f4f-a834-4fc3-b8dd-359f42561888 service nova] Creating event network-changed:748a6ed8-6858-4cda-ba15-99debaf1eb59 for instance abb31b9a-6d7d-43af-8eb3-57af34fc02ed on n-h2-847009-3 Jul 19 23:05:17.825592 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-1620297f-dd0e-4c6c-82e0-97792419d617 req-34fa4f4f-a834-4fc3-b8dd-359f42561888 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081259 Jul 19 23:05:17.827285 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2849/5708] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:05:17.985672 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dadce92a-1b70-43da-9f48-11640f7bc1ff tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "DELETE /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 204 len: 0 microversion: 2.1 time: 0.346862 Jul 19 23:05:17.986567 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2860/5709] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:05:17 2022] DELETE /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:05:18.000384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cc088ed5-2743-4413-bd20-315a3f045f3c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:18.002097 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cc088ed5-2743-4413-bd20-315a3f045f3c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:18.013905 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc088ed5-2743-4413-bd20-315a3f045f3c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:18.014660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc088ed5-2743-4413-bd20-315a3f045f3c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:18.016384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc088ed5-2743-4413-bd20-315a3f045f3c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:18.017234 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc088ed5-2743-4413-bd20-315a3f045f3c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:18.263370 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4f6a2883-df0b-4035-b505-d133f7178e3f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:18.264424 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4f6a2883-df0b-4035-b505-d133f7178e3f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: abb31b9a-6d7d-43af-8eb3-57af34fc02ed] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:18.272967 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f6a2883-df0b-4035-b505-d133f7178e3f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:18.274420 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f6a2883-df0b-4035-b505-d133f7178e3f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:18.276577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f6a2883-df0b-4035-b505-d133f7178e3f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:18.277565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f6a2883-df0b-4035-b505-d133f7178e3f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:18.331341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cc088ed5-2743-4413-bd20-315a3f045f3c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:18.343592 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cc088ed5-2743-4413-bd20-315a3f045f3c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1396 microversion: 2.1 time: 0.350334 Jul 19 23:05:18.345310 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2850/5710] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:17 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1396 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:18.558534 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4f6a2883-df0b-4035-b505-d133f7178e3f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:18.575674 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4f6a2883-df0b-4035-b505-d133f7178e3f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed" status: 200 len: 1374 microversion: 2.1 time: 0.335323 Jul 19 23:05:18.587190 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2861/5711] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:18 2022] GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed => generated 1374 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:19.362545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-90d96e32-bc90-4689-b6ed-cc2b5a3cfc24 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:19.364050 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-90d96e32-bc90-4689-b6ed-cc2b5a3cfc24 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:19.372922 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-90d96e32-bc90-4689-b6ed-cc2b5a3cfc24 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:19.373961 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-90d96e32-bc90-4689-b6ed-cc2b5a3cfc24 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:19.374825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-90d96e32-bc90-4689-b6ed-cc2b5a3cfc24 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:19.375505 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-90d96e32-bc90-4689-b6ed-cc2b5a3cfc24 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:19.594807 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5c700d34-b4b0-4200-886d-330a03eb1291 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:19.596133 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5c700d34-b4b0-4200-886d-330a03eb1291 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: abb31b9a-6d7d-43af-8eb3-57af34fc02ed] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:19.607575 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c700d34-b4b0-4200-886d-330a03eb1291 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:19.609584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c700d34-b4b0-4200-886d-330a03eb1291 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:19.611073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c700d34-b4b0-4200-886d-330a03eb1291 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:19.611224 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5c700d34-b4b0-4200-886d-330a03eb1291 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:19.640685 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-90d96e32-bc90-4689-b6ed-cc2b5a3cfc24 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:19.656008 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-90d96e32-bc90-4689-b6ed-cc2b5a3cfc24 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1396 microversion: 2.1 time: 0.297814 Jul 19 23:05:19.676005 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2851/5712] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:19 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1396 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:19.869733 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5c700d34-b4b0-4200-886d-330a03eb1291 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:19.883743 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5c700d34-b4b0-4200-886d-330a03eb1291 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed" status: 200 len: 1374 microversion: 2.1 time: 0.292917 Jul 19 23:05:19.887015 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2862/5713] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:19 2022] GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed => generated 1374 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:05:20.697727 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a61ca02b-306e-456b-83c0-ee12b066fe4f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:20.699476 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a61ca02b-306e-456b-83c0-ee12b066fe4f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:20.710370 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a61ca02b-306e-456b-83c0-ee12b066fe4f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:20.711008 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a61ca02b-306e-456b-83c0-ee12b066fe4f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:20.712077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a61ca02b-306e-456b-83c0-ee12b066fe4f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:20.712882 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a61ca02b-306e-456b-83c0-ee12b066fe4f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:20.904008 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-927bfc03-a31a-4d0b-8ee9-9dc54a5a5966 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:20.907542 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-927bfc03-a31a-4d0b-8ee9-9dc54a5a5966 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: abb31b9a-6d7d-43af-8eb3-57af34fc02ed] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:20.940662 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-927bfc03-a31a-4d0b-8ee9-9dc54a5a5966 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:20.940662 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-927bfc03-a31a-4d0b-8ee9-9dc54a5a5966 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:20.940662 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-927bfc03-a31a-4d0b-8ee9-9dc54a5a5966 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:20.940662 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-927bfc03-a31a-4d0b-8ee9-9dc54a5a5966 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:21.137809 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a61ca02b-306e-456b-83c0-ee12b066fe4f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:21.149138 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a61ca02b-306e-456b-83c0-ee12b066fe4f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1396 microversion: 2.1 time: 0.459224 Jul 19 23:05:21.159169 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2852/5714] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:20 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1396 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:21.159169 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-60590a7f-44ae-477e-b8bf-fbf1826d5967 req-ce1f62f7-1fff-4738-861c-638023ab1fcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de243299-11bd-403b-a17c-740522b92afc", "name": "network-vif-deleted", "tag": "7ad1a526-9040-47d4-b48a-016448bd1684"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:05:21.167126 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-60590a7f-44ae-477e-b8bf-fbf1826d5967 req-ce1f62f7-1fff-4738-861c-638023ab1fcb service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:21.169483 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-60590a7f-44ae-477e-b8bf-fbf1826d5967 req-ce1f62f7-1fff-4738-861c-638023ab1fcb service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:21.208777 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-60590a7f-44ae-477e-b8bf-fbf1826d5967 req-ce1f62f7-1fff-4738-861c-638023ab1fcb service nova] Creating event network-vif-deleted:7ad1a526-9040-47d4-b48a-016448bd1684 for instance de243299-11bd-403b-a17c-740522b92afc on n-h1-847009-3 Jul 19 23:05:21.225423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-927bfc03-a31a-4d0b-8ee9-9dc54a5a5966 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:21.225912 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-60590a7f-44ae-477e-b8bf-fbf1826d5967 req-ce1f62f7-1fff-4738-861c-638023ab1fcb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074309 Jul 19 23:05:21.233746 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2853/5715] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:05:21.236937 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-927bfc03-a31a-4d0b-8ee9-9dc54a5a5966 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed" status: 200 len: 1374 microversion: 2.1 time: 0.334728 Jul 19 23:05:21.238252 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2863/5716] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:20 2022] GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed => generated 1374 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:22.170516 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ea9d31a9-2841-4bc3-92f0-ce6976e9237f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:22.172548 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ea9d31a9-2841-4bc3-92f0-ce6976e9237f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:22.182580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea9d31a9-2841-4bc3-92f0-ce6976e9237f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:22.183354 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea9d31a9-2841-4bc3-92f0-ce6976e9237f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:22.184806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea9d31a9-2841-4bc3-92f0-ce6976e9237f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:22.185541 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea9d31a9-2841-4bc3-92f0-ce6976e9237f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:22.267103 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-14297a68-de20-4249-bf71-dbccf310decc tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:22.268887 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-14297a68-de20-4249-bf71-dbccf310decc tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: abb31b9a-6d7d-43af-8eb3-57af34fc02ed] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:22.292551 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14297a68-de20-4249-bf71-dbccf310decc tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:22.293522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14297a68-de20-4249-bf71-dbccf310decc tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:22.298757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14297a68-de20-4249-bf71-dbccf310decc tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:22.299440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14297a68-de20-4249-bf71-dbccf310decc tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:22.355671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ea9d31a9-2841-4bc3-92f0-ce6976e9237f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:22.373128 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ea9d31a9-2841-4bc3-92f0-ce6976e9237f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1188 microversion: 2.1 time: 0.209062 Jul 19 23:05:22.375764 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2854/5717] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:22 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1188 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:22.587796 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-14297a68-de20-4249-bf71-dbccf310decc tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:22.597374 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-14297a68-de20-4249-bf71-dbccf310decc tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed" status: 200 len: 1374 microversion: 2.1 time: 0.344847 Jul 19 23:05:22.598004 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2864/5718] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:22 2022] GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed => generated 1374 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:23.402615 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-574e03d5-bbea-431e-ace1-56129edd2b75 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:23.403520 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-574e03d5-bbea-431e-ace1-56129edd2b75 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:23.422339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:05:23.425385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:05:23.431520 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-574e03d5-bbea-431e-ace1-56129edd2b75 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:23.432294 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-574e03d5-bbea-431e-ace1-56129edd2b75 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:23.434032 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-574e03d5-bbea-431e-ace1-56129edd2b75 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:23.434898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-574e03d5-bbea-431e-ace1-56129edd2b75 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:23.538763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-574e03d5-bbea-431e-ace1-56129edd2b75 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:23.555573 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-574e03d5-bbea-431e-ace1-56129edd2b75 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1188 microversion: 2.1 time: 0.157501 Jul 19 23:05:23.556528 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2855/5719] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:23 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1188 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:23.626555 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bd5696cc-6329-454c-9a50-e1591ab4b95a tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:23.628016 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bd5696cc-6329-454c-9a50-e1591ab4b95a tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: abb31b9a-6d7d-43af-8eb3-57af34fc02ed] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:23.636434 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:05:23.640426 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bd5696cc-6329-454c-9a50-e1591ab4b95a tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:23.642298 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bd5696cc-6329-454c-9a50-e1591ab4b95a tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:23.643613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bd5696cc-6329-454c-9a50-e1591ab4b95a tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:23.644756 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bd5696cc-6329-454c-9a50-e1591ab4b95a tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:23.746190 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4aa20ea1-0426-44f3-8c4f-6dc19bcd6523 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:23.748001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4aa20ea1-0426-44f3-8c4f-6dc19bcd6523 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:23.755568 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4aa20ea1-0426-44f3-8c4f-6dc19bcd6523 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:23.763846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4aa20ea1-0426-44f3-8c4f-6dc19bcd6523 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:23.765568 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4aa20ea1-0426-44f3-8c4f-6dc19bcd6523 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:23.766177 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4aa20ea1-0426-44f3-8c4f-6dc19bcd6523 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:23.839533 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4aa20ea1-0426-44f3-8c4f-6dc19bcd6523 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.099694 Jul 19 23:05:23.845320 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2856/5720] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:05:23 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 23:05:23.937260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d2dd024a-14c6-4892-8a92-33370e86613a tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:23.938283 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d2dd024a-14c6-4892-8a92-33370e86613a tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:23.951156 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2dd024a-14c6-4892-8a92-33370e86613a tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:23.951156 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2dd024a-14c6-4892-8a92-33370e86613a tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:23.951554 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2dd024a-14c6-4892-8a92-33370e86613a tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:23.951998 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2dd024a-14c6-4892-8a92-33370e86613a tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:23.957820 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bd5696cc-6329-454c-9a50-e1591ab4b95a tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:23.967513 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bd5696cc-6329-454c-9a50-e1591ab4b95a tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed" status: 200 len: 1374 microversion: 2.1 time: 0.350012 Jul 19 23:05:23.977661 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2865/5721] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:23 2022] GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed => generated 1374 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:24.033212 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d2dd024a-14c6-4892-8a92-33370e86613a tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:05:24.101245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-a0ba2cf5-8409-4753-9a6d-535bb5a0881c req-a783c005-de80-491e-992c-8de8c3d2cae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb31b9a-6d7d-43af-8eb3-57af34fc02ed", "name": "network-vif-plugged", "status": "completed", "tag": "748a6ed8-6858-4cda-ba15-99debaf1eb59"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:05:24.117735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a0ba2cf5-8409-4753-9a6d-535bb5a0881c req-a783c005-de80-491e-992c-8de8c3d2cae8 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:24.117735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a0ba2cf5-8409-4753-9a6d-535bb5a0881c req-a783c005-de80-491e-992c-8de8c3d2cae8 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:24.173830 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-a0ba2cf5-8409-4753-9a6d-535bb5a0881c req-a783c005-de80-491e-992c-8de8c3d2cae8 service nova] Creating event network-vif-plugged:748a6ed8-6858-4cda-ba15-99debaf1eb59 for instance abb31b9a-6d7d-43af-8eb3-57af34fc02ed on n-h2-847009-3 Jul 19 23:05:24.186810 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-a0ba2cf5-8409-4753-9a6d-535bb5a0881c req-a783c005-de80-491e-992c-8de8c3d2cae8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110674 Jul 19 23:05:24.196413 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2866/5722] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:05:24.325468 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d2dd024a-14c6-4892-8a92-33370e86613a tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 204 len: 0 microversion: 2.1 time: 0.386648 Jul 19 23:05:24.326357 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2857/5723] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:05:23 2022] DELETE /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:05:24.347300 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3e9de7bc-8624-4ca7-84d2-5d67c3d88759 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:24.348659 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3e9de7bc-8624-4ca7-84d2-5d67c3d88759 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:24.372185 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e9de7bc-8624-4ca7-84d2-5d67c3d88759 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:24.372952 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e9de7bc-8624-4ca7-84d2-5d67c3d88759 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:24.374283 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e9de7bc-8624-4ca7-84d2-5d67c3d88759 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:24.375072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e9de7bc-8624-4ca7-84d2-5d67c3d88759 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:24.584688 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-19753efd-1106-4f4d-bdbd-3efba6314ec2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:24.585685 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-19753efd-1106-4f4d-bdbd-3efba6314ec2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:24.607391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-19753efd-1106-4f4d-bdbd-3efba6314ec2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:24.607777 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-19753efd-1106-4f4d-bdbd-3efba6314ec2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:24.611506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-19753efd-1106-4f4d-bdbd-3efba6314ec2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:24.612191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-19753efd-1106-4f4d-bdbd-3efba6314ec2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:24.711363 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3e9de7bc-8624-4ca7-84d2-5d67c3d88759 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:24.723609 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3e9de7bc-8624-4ca7-84d2-5d67c3d88759 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1671 microversion: 2.1 time: 0.392416 Jul 19 23:05:24.728810 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2867/5724] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:24 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1671 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:24.741211 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-19753efd-1106-4f4d-bdbd-3efba6314ec2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:24.758864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:05:24.764205 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-19753efd-1106-4f4d-bdbd-3efba6314ec2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1188 microversion: 2.1 time: 0.192616 Jul 19 23:05:24.767797 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2858/5725] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:24 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1188 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:24.991552 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c727c421-f776-46b9-9118-9ecf5028df12 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:24.993055 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c727c421-f776-46b9-9118-9ecf5028df12 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: abb31b9a-6d7d-43af-8eb3-57af34fc02ed] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:25.034198 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c727c421-f776-46b9-9118-9ecf5028df12 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:25.037918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c727c421-f776-46b9-9118-9ecf5028df12 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:25.042422 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c727c421-f776-46b9-9118-9ecf5028df12 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:25.043022 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c727c421-f776-46b9-9118-9ecf5028df12 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:25.376174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c727c421-f776-46b9-9118-9ecf5028df12 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:25.403784 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c727c421-f776-46b9-9118-9ecf5028df12 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed" status: 200 len: 1374 microversion: 2.1 time: 0.419390 Jul 19 23:05:25.418624 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2868/5726] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:24 2022] GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed => generated 1374 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:05:25.746998 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-95ae43da-c8cd-4ad9-a50c-69ec8dcf6da6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:25.747690 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-95ae43da-c8cd-4ad9-a50c-69ec8dcf6da6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:25.767663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-95ae43da-c8cd-4ad9-a50c-69ec8dcf6da6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:25.768335 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-95ae43da-c8cd-4ad9-a50c-69ec8dcf6da6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:25.769152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-95ae43da-c8cd-4ad9-a50c-69ec8dcf6da6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:25.769598 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-95ae43da-c8cd-4ad9-a50c-69ec8dcf6da6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:25.788676 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8aeb974f-2106-426c-a4fb-21edeecf2541 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:25.790410 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8aeb974f-2106-426c-a4fb-21edeecf2541 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:25.814485 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8aeb974f-2106-426c-a4fb-21edeecf2541 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:25.815077 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8aeb974f-2106-426c-a4fb-21edeecf2541 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:25.819847 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8aeb974f-2106-426c-a4fb-21edeecf2541 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:25.820317 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8aeb974f-2106-426c-a4fb-21edeecf2541 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:26.015245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8aeb974f-2106-426c-a4fb-21edeecf2541 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:26.042824 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8aeb974f-2106-426c-a4fb-21edeecf2541 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1188 microversion: 2.1 time: 0.256873 Jul 19 23:05:26.043538 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2869/5727] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:25 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1188 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:26.107765 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-95ae43da-c8cd-4ad9-a50c-69ec8dcf6da6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:26.116681 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-95ae43da-c8cd-4ad9-a50c-69ec8dcf6da6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1671 microversion: 2.1 time: 0.374058 Jul 19 23:05:26.118136 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2859/5728] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:25 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1671 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:26.429679 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ceb2c07d-ecf4-4364-bf77-24c60b1148e6 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:26.430388 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ceb2c07d-ecf4-4364-bf77-24c60b1148e6 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: abb31b9a-6d7d-43af-8eb3-57af34fc02ed] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:26.437892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ceb2c07d-ecf4-4364-bf77-24c60b1148e6 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:26.438350 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ceb2c07d-ecf4-4364-bf77-24c60b1148e6 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:26.439179 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ceb2c07d-ecf4-4364-bf77-24c60b1148e6 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:26.439634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ceb2c07d-ecf4-4364-bf77-24c60b1148e6 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:26.712993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ceb2c07d-ecf4-4364-bf77-24c60b1148e6 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:26.714879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:05:26.735186 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ceb2c07d-ecf4-4364-bf77-24c60b1148e6 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed" status: 200 len: 1374 microversion: 2.1 time: 0.312813 Jul 19 23:05:26.757713 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2870/5729] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:26 2022] GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed => generated 1374 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:27.070930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fbd317e1-d04e-45cd-9b37-915e65b6ab0e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:27.072160 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fbd317e1-d04e-45cd-9b37-915e65b6ab0e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:27.084814 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fbd317e1-d04e-45cd-9b37-915e65b6ab0e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:27.085553 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fbd317e1-d04e-45cd-9b37-915e65b6ab0e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:27.087014 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fbd317e1-d04e-45cd-9b37-915e65b6ab0e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:27.087716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fbd317e1-d04e-45cd-9b37-915e65b6ab0e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:27.146938 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4321e0a6-24e0-444d-97ef-3a4363871c66 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:27.148483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4321e0a6-24e0-444d-97ef-3a4363871c66 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:27.157133 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4321e0a6-24e0-444d-97ef-3a4363871c66 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:27.157866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4321e0a6-24e0-444d-97ef-3a4363871c66 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:27.158931 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4321e0a6-24e0-444d-97ef-3a4363871c66 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:27.159962 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4321e0a6-24e0-444d-97ef-3a4363871c66 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:27.181111 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fbd317e1-d04e-45cd-9b37-915e65b6ab0e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:27.195186 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fbd317e1-d04e-45cd-9b37-915e65b6ab0e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 200 len: 1188 microversion: 2.1 time: 0.129260 Jul 19 23:05:27.197206 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2860/5730] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:27 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 1188 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:27.388216 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4321e0a6-24e0-444d-97ef-3a4363871c66 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:27.414858 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4321e0a6-24e0-444d-97ef-3a4363871c66 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1671 microversion: 2.1 time: 0.258230 Jul 19 23:05:27.415761 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2871/5731] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:27 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1671 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:27.753936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-69b4f3b6-13d0-4a5d-ae9f-75c843bef67c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:27.754491 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-69b4f3b6-13d0-4a5d-ae9f-75c843bef67c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: abb31b9a-6d7d-43af-8eb3-57af34fc02ed] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:27.772749 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-69b4f3b6-13d0-4a5d-ae9f-75c843bef67c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:27.773705 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-69b4f3b6-13d0-4a5d-ae9f-75c843bef67c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:27.774884 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-69b4f3b6-13d0-4a5d-ae9f-75c843bef67c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:27.775966 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-69b4f3b6-13d0-4a5d-ae9f-75c843bef67c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:27.951663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-69b4f3b6-13d0-4a5d-ae9f-75c843bef67c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:27.978744 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-69b4f3b6-13d0-4a5d-ae9f-75c843bef67c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed" status: 200 len: 1374 microversion: 2.1 time: 0.212687 Jul 19 23:05:27.985496 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2861/5732] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:27 2022] GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed => generated 1374 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:28.218083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a83141f4-d4d1-4836-b4bc-845c3767b6d3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:28.218715 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a83141f4-d4d1-4836-b4bc-845c3767b6d3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: de243299-11bd-403b-a17c-740522b92afc] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:28.235709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a83141f4-d4d1-4836-b4bc-845c3767b6d3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:28.239279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a83141f4-d4d1-4836-b4bc-845c3767b6d3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:28.243764 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a83141f4-d4d1-4836-b4bc-845c3767b6d3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:28.246075 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a83141f4-d4d1-4836-b4bc-845c3767b6d3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:28.274962 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-a83141f4-d4d1-4836-b4bc-845c3767b6d3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] HTTP exception thrown: Instance de243299-11bd-403b-a17c-740522b92afc could not be found. Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a83141f4-d4d1-4836-b4bc-845c3767b6d3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Request method failure captured: Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc HTTP/1.1 Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zh6YPXnZEfL25DbrOo5AahkBCmHYOrAvKJnhgzQ9JlHxbrun4XI2EwE2n1nf4tgNFUaArqBEbFq4Toj7uUUuANo7JRuxksIEPvDD1AFl7fhy2XFxh_IYAhLXnE4PI4_QoyTOcOGpDghFYkpTUUI4xKODXHZZ1_feIKHlU2SknrcKPQ Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: deeb5431c1284d02b245ff3a9dc3f4e8 Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance de243299-11bd-403b-a17c-740522b92afc could not be found. Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'de243299-11bd-403b-a17c-740522b92afc'} Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de243299-11bd-403b-a17c-740522b92afc could not be found. Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de243299-11bd-403b-a17c-740522b92afc could not be found. Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:05:28.277704 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:05:28.281428 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:05:28.281428 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:05:28.281428 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:05:28.281428 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:05:28.281428 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:05:28.281428 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de243299-11bd-403b-a17c-740522b92afc could not be found. Jul 19 23:05:28.281428 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:05:28.283793 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a83141f4-d4d1-4836-b4bc-845c3767b6d3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Returning 404 to user: Instance de243299-11bd-403b-a17c-740522b92afc could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:05:28.285101 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a83141f4-d4d1-4836-b4bc-845c3767b6d3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc" status: 404 len: 111 microversion: 2.1 time: 0.073015 Jul 19 23:05:28.286422 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2872/5733] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:28 2022] GET /compute/v2.1/servers/de243299-11bd-403b-a17c-740522b92afc => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:05:28.433496 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-87f54261-64c6-4c22-b1e8-88761ba7d20d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:28.434913 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-87f54261-64c6-4c22-b1e8-88761ba7d20d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:28.460205 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87f54261-64c6-4c22-b1e8-88761ba7d20d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:28.466278 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87f54261-64c6-4c22-b1e8-88761ba7d20d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:28.472959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87f54261-64c6-4c22-b1e8-88761ba7d20d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:28.474362 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87f54261-64c6-4c22-b1e8-88761ba7d20d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:28.754447 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-87f54261-64c6-4c22-b1e8-88761ba7d20d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:28.766989 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-87f54261-64c6-4c22-b1e8-88761ba7d20d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1671 microversion: 2.1 time: 0.337352 Jul 19 23:05:28.768261 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2862/5734] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:28 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1671 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:29.002096 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8cffca96-b3bc-46e5-a9a0-cda36489ec33 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:29.002784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8cffca96-b3bc-46e5-a9a0-cda36489ec33 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: abb31b9a-6d7d-43af-8eb3-57af34fc02ed] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:29.013026 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8cffca96-b3bc-46e5-a9a0-cda36489ec33 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:29.014084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8cffca96-b3bc-46e5-a9a0-cda36489ec33 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:29.018049 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8cffca96-b3bc-46e5-a9a0-cda36489ec33 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:29.018860 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8cffca96-b3bc-46e5-a9a0-cda36489ec33 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:29.357866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8cffca96-b3bc-46e5-a9a0-cda36489ec33 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:29.371326 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8cffca96-b3bc-46e5-a9a0-cda36489ec33 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed" status: 200 len: 1547 microversion: 2.1 time: 0.373075 Jul 19 23:05:29.372932 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2873/5735] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:28 2022] GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed => generated 1547 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:29.389160 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a3f79ef5-0442-4c76-94e9-53d0e13a52a8 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:29.390049 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a3f79ef5-0442-4c76-94e9-53d0e13a52a8 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: abb31b9a-6d7d-43af-8eb3-57af34fc02ed] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:29.405386 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3f79ef5-0442-4c76-94e9-53d0e13a52a8 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:29.406087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3f79ef5-0442-4c76-94e9-53d0e13a52a8 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:29.407300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3f79ef5-0442-4c76-94e9-53d0e13a52a8 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:29.408221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3f79ef5-0442-4c76-94e9-53d0e13a52a8 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:29.789801 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4c35b8f5-7e35-4e82-8847-7912933dae64 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:29.793257 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4c35b8f5-7e35-4e82-8847-7912933dae64 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:29.819018 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c35b8f5-7e35-4e82-8847-7912933dae64 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:29.820129 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c35b8f5-7e35-4e82-8847-7912933dae64 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:29.823608 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c35b8f5-7e35-4e82-8847-7912933dae64 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:29.825135 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c35b8f5-7e35-4e82-8847-7912933dae64 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:29.831380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a3f79ef5-0442-4c76-94e9-53d0e13a52a8 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:29.849299 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a3f79ef5-0442-4c76-94e9-53d0e13a52a8 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed" status: 200 len: 1547 microversion: 2.1 time: 0.464360 Jul 19 23:05:29.853678 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2863/5736] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:29 2022] GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed => generated 1547 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:29.938108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-128c5101-8230-4eab-add6-3e450956353d req-822c0b10-6c6e-4a65-a706-a918f58d56e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b09fea8b-cf15-4aaf-9e24-4418313a878f", "name": "network-vif-deleted", "tag": "1cdfc3b5-378c-4139-bb96-4574c6d99a8d"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:05:29.967727 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-128c5101-8230-4eab-add6-3e450956353d req-822c0b10-6c6e-4a65-a706-a918f58d56e5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:29.970439 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-128c5101-8230-4eab-add6-3e450956353d req-822c0b10-6c6e-4a65-a706-a918f58d56e5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:30.035230 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-128c5101-8230-4eab-add6-3e450956353d req-822c0b10-6c6e-4a65-a706-a918f58d56e5 service nova] Creating event network-vif-deleted:1cdfc3b5-378c-4139-bb96-4574c6d99a8d for instance b09fea8b-cf15-4aaf-9e24-4418313a878f on n-h2-847009-3 Jul 19 23:05:30.065567 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-128c5101-8230-4eab-add6-3e450956353d req-822c0b10-6c6e-4a65-a706-a918f58d56e5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132561 Jul 19 23:05:30.073092 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2864/5737] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:05:30.201589 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4c35b8f5-7e35-4e82-8847-7912933dae64 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:30.212423 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4c35b8f5-7e35-4e82-8847-7912933dae64 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 200 len: 1604 microversion: 2.1 time: 0.430518 Jul 19 23:05:30.221087 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2874/5738] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:29 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 1604 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:31.237905 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f9f084bc-09db-4988-87da-50deff97e539 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:31.238613 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f9f084bc-09db-4988-87da-50deff97e539 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:31.251778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9f084bc-09db-4988-87da-50deff97e539 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:31.252233 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9f084bc-09db-4988-87da-50deff97e539 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:31.253030 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9f084bc-09db-4988-87da-50deff97e539 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:31.253472 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9f084bc-09db-4988-87da-50deff97e539 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:31.285566 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-f9f084bc-09db-4988-87da-50deff97e539 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] HTTP exception thrown: Instance b09fea8b-cf15-4aaf-9e24-4418313a878f could not be found. Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f9f084bc-09db-4988-87da-50deff97e539 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Request method failure captured: Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f HTTP/1.1 Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zfU3OTA9KkIJ5GmVWQ-vTWZpqZsChudguNJ_V4SWabVMgEux0i_oQ4vBYK9VPjf7Se0DER00Ew4uyMMU8wG0TL685P3K9LwzdVQCt99jV83Ih_cluK8Lo96ITRWNmTgfQ4nvfekknoiaxrtGnKgMzRcBOdFwdTuSEHjINySqs32F5E Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 9480697850b44a038ee838b4aed1ff10 Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-AttachVolumeTestJSON-488468993 Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9480697850b44a038ee838b4aed1ff10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9480697850b44a038ee838b4aed1ff10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9480697850b44a038ee838b4aed1ff10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9480697850b44a038ee838b4aed1ff10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-AttachVolumeTestJSON-488468993 Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 9480697850b44a038ee838b4aed1ff10 Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-AttachVolumeTestJSON-488468993 Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-AttachVolumeTestJSON-488468993-project Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 2d887379f25b41cc9dfb7119cc561e05 Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-AttachVolumeTestJSON-488468993-project Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance b09fea8b-cf15-4aaf-9e24-4418313a878f could not be found. Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'b09fea8b-cf15-4aaf-9e24-4418313a878f'} Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b09fea8b-cf15-4aaf-9e24-4418313a878f could not be found. Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b09fea8b-cf15-4aaf-9e24-4418313a878f could not be found. Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:05:31.287857 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:05:31.291678 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:05:31.291678 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:05:31.291678 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:05:31.291678 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:05:31.291678 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:05:31.291678 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b09fea8b-cf15-4aaf-9e24-4418313a878f could not be found. Jul 19 23:05:31.291678 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:05:31.291678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f9f084bc-09db-4988-87da-50deff97e539 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Returning 404 to user: Instance b09fea8b-cf15-4aaf-9e24-4418313a878f could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:05:31.291678 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f9f084bc-09db-4988-87da-50deff97e539 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 404 len: 111 microversion: 2.1 time: 0.055623 Jul 19 23:05:31.300858 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2865/5739] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:31 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:05:31.302664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-249d6160-e4c7-4f63-a8a3-d040f7171523 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '.version_select at 0x7f7a03e88940>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:31.355658 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-249d6160-e4c7-4f63-a8a3-d040f7171523 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-133406498" status: 202 len: 0 microversion: 2.1 time: 0.059159 Jul 19 23:05:31.356698 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2875/5740] 10.222.0.25 () {58 vars in 1217 bytes} [Tue Jul 19 23:05:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-133406498 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:05:32.900055 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-e62cb9fb-f384-4db8-8637-637666f00b33 req-ac032ae9-e54d-4887-9fdb-357895f3ebbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abb31b9a-6d7d-43af-8eb3-57af34fc02ed", "tag": "748a6ed8-6858-4cda-ba15-99debaf1eb59"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:05:32.919729 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e62cb9fb-f384-4db8-8637-637666f00b33 req-ac032ae9-e54d-4887-9fdb-357895f3ebbc service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:32.922133 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e62cb9fb-f384-4db8-8637-637666f00b33 req-ac032ae9-e54d-4887-9fdb-357895f3ebbc service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:32.994130 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-e62cb9fb-f384-4db8-8637-637666f00b33 req-ac032ae9-e54d-4887-9fdb-357895f3ebbc service nova] Creating event network-changed:748a6ed8-6858-4cda-ba15-99debaf1eb59 for instance abb31b9a-6d7d-43af-8eb3-57af34fc02ed on n-h2-847009-3 Jul 19 23:05:33.013395 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-e62cb9fb-f384-4db8-8637-637666f00b33 req-ac032ae9-e54d-4887-9fdb-357895f3ebbc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115575 Jul 19 23:05:33.030363 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2866/5741] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:05:33.253885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d3b17f4b-a72c-4142-ac32-9d1a92467559 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Action: 'create', calling method: .version_select at 0x7f7a1559da60>, body: {"keypair": {"name": "tempest-keypair-586406540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIu3nD1CC3vB4CopNpWMWAgrSf7XMAHNFg1JZitJAPucy20uEndiDU4bxGvPKwfz38IW/N1YcVDkEVCC8Un1JD8MI5LZcZGCz19GqKCyUMVf29UQQGBCTwolNOFj24nZw=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:05:33.274869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-d3b17f4b-a72c-4142-ac32-9d1a92467559 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Getting quotas for project 9480697850b44a038ee838b4aed1ff10. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:05:33.284164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-d3b17f4b-a72c-4142-ac32-9d1a92467559 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Getting quotas for user 2d887379f25b41cc9dfb7119cc561e05 and project 9480697850b44a038ee838b4aed1ff10. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:05:33.324809 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d3b17f4b-a72c-4142-ac32-9d1a92467559 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.075683 Jul 19 23:05:33.332740 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2876/5742] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 23:05:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:05:36.192259 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-557ca4f7-a05a-4c92-a54b-8a01449cf294 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-920929700", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ef296c9d-13d5-4258-9274-6f9f322539cc"}], "security_groups": [{"name": "tempest-securitygroup--1120887524"}], "key_name": "tempest-keypair-586406540", "user_data": "}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:05:36.352482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-557ca4f7-a05a-4c92-a54b-8a01449cf294 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] validate_networks() for [('ef296c9d-13d5-4258-9274-6f9f322539cc', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:05:36.858899 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-557ca4f7-a05a-4c92-a54b-8a01449cf294 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:05:36.859603 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-557ca4f7-a05a-4c92-a54b-8a01449cf294 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:05:36.860601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-557ca4f7-a05a-4c92-a54b-8a01449cf294 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:05:36.861239 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-557ca4f7-a05a-4c92-a54b-8a01449cf294 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:05:36.861874 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-557ca4f7-a05a-4c92-a54b-8a01449cf294 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:05:36.873598 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-557ca4f7-a05a-4c92-a54b-8a01449cf294 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:36.874380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-557ca4f7-a05a-4c92-a54b-8a01449cf294 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:36.875450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-557ca4f7-a05a-4c92-a54b-8a01449cf294 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:36.876139 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-557ca4f7-a05a-4c92-a54b-8a01449cf294 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:36.900256 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-557ca4f7-a05a-4c92-a54b-8a01449cf294 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Getting quotas for project 9480697850b44a038ee838b4aed1ff10. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:05:36.910862 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-557ca4f7-a05a-4c92-a54b-8a01449cf294 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Getting quotas for user 2d887379f25b41cc9dfb7119cc561e05 and project 9480697850b44a038ee838b4aed1ff10. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:05:36.935035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-557ca4f7-a05a-4c92-a54b-8a01449cf294 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:05:36.939647 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-557ca4f7-a05a-4c92-a54b-8a01449cf294 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:05:37.016042 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-557ca4f7-a05a-4c92-a54b-8a01449cf294 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.825429 Jul 19 23:05:37.020260 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2867/5743] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:05:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:05:37.038397 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b0f032b8-0799-4941-b64a-9257d370baef tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:37.043222 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b0f032b8-0799-4941-b64a-9257d370baef tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:37.055416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:05:37.136673 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b0f032b8-0799-4941-b64a-9257d370baef tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:37.144429 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b0f032b8-0799-4941-b64a-9257d370baef tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd" status: 200 len: 1236 microversion: 2.1 time: 0.116549 Jul 19 23:05:37.147397 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2877/5744] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:37 2022] GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd => generated 1236 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:38.164891 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-91835e8c-1ad5-430d-922e-e51bcf24119d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:38.165873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-91835e8c-1ad5-430d-922e-e51bcf24119d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:38.174518 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91835e8c-1ad5-430d-922e-e51bcf24119d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:38.175078 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91835e8c-1ad5-430d-922e-e51bcf24119d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:38.176244 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91835e8c-1ad5-430d-922e-e51bcf24119d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:38.176659 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91835e8c-1ad5-430d-922e-e51bcf24119d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:38.257209 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-91835e8c-1ad5-430d-922e-e51bcf24119d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:38.272844 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-91835e8c-1ad5-430d-922e-e51bcf24119d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd" status: 200 len: 1288 microversion: 2.1 time: 0.112969 Jul 19 23:05:38.275604 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2868/5745] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:38 2022] GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd => generated 1288 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:39.307060 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4c021ce4-01f6-40fc-be12-c56c80020c51 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:39.308559 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4c021ce4-01f6-40fc-be12-c56c80020c51 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:39.332461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c021ce4-01f6-40fc-be12-c56c80020c51 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:39.338526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c021ce4-01f6-40fc-be12-c56c80020c51 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:39.339651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c021ce4-01f6-40fc-be12-c56c80020c51 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:39.342257 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4c021ce4-01f6-40fc-be12-c56c80020c51 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:39.553505 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4c021ce4-01f6-40fc-be12-c56c80020c51 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:39.570427 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4c021ce4-01f6-40fc-be12-c56c80020c51 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd" status: 200 len: 1294 microversion: 2.1 time: 0.280415 Jul 19 23:05:39.571583 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2878/5746] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:39 2022] GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd => generated 1294 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:40.596727 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d4473f20-c1f4-4c7d-b44c-2c0a518e1c44 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:40.597688 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d4473f20-c1f4-4c7d-b44c-2c0a518e1c44 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:40.611022 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:05:40.614961 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d4473f20-c1f4-4c7d-b44c-2c0a518e1c44 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:40.615486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d4473f20-c1f4-4c7d-b44c-2c0a518e1c44 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:40.616508 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d4473f20-c1f4-4c7d-b44c-2c0a518e1c44 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:40.621879 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d4473f20-c1f4-4c7d-b44c-2c0a518e1c44 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:41.078701 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d4473f20-c1f4-4c7d-b44c-2c0a518e1c44 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:41.097059 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d4473f20-c1f4-4c7d-b44c-2c0a518e1c44 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd" status: 200 len: 1362 microversion: 2.1 time: 0.503861 Jul 19 23:05:41.119275 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2869/5747] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:40 2022] GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd => generated 1362 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:41.425234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-d90cfe91-7df1-46e8-9514-7bbcabdab296 req-9f808bd6-d73d-4f55-891c-df28924f7a59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "987a171b-07c6-4cca-9d53-45b0e72090cd", "tag": "90a4a48e-edda-46f0-90bb-fca8abc89725"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:05:41.449858 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d90cfe91-7df1-46e8-9514-7bbcabdab296 req-9f808bd6-d73d-4f55-891c-df28924f7a59 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:41.451871 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d90cfe91-7df1-46e8-9514-7bbcabdab296 req-9f808bd6-d73d-4f55-891c-df28924f7a59 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:41.480647 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-d90cfe91-7df1-46e8-9514-7bbcabdab296 req-9f808bd6-d73d-4f55-891c-df28924f7a59 service nova] Creating event network-changed:90a4a48e-edda-46f0-90bb-fca8abc89725 for instance 987a171b-07c6-4cca-9d53-45b0e72090cd on n-h1-847009-3 Jul 19 23:05:41.494914 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-d90cfe91-7df1-46e8-9514-7bbcabdab296 req-9f808bd6-d73d-4f55-891c-df28924f7a59 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074060 Jul 19 23:05:41.499744 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2879/5748] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:05:42.118277 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4d4216ce-1377-4bc4-b164-f79744d94d0a tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:42.118858 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4d4216ce-1377-4bc4-b164-f79744d94d0a tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:42.138170 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d4216ce-1377-4bc4-b164-f79744d94d0a tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:42.139071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d4216ce-1377-4bc4-b164-f79744d94d0a tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:42.141577 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d4216ce-1377-4bc4-b164-f79744d94d0a tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:42.144355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d4216ce-1377-4bc4-b164-f79744d94d0a tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:42.392066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4d4216ce-1377-4bc4-b164-f79744d94d0a tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:42.408136 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4d4216ce-1377-4bc4-b164-f79744d94d0a tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd" status: 200 len: 1362 microversion: 2.1 time: 0.292650 Jul 19 23:05:42.420335 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2870/5749] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:42 2022] GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:43.429473 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0c40305e-6614-47bf-bb8b-0a1574fd7e10 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:43.430209 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0c40305e-6614-47bf-bb8b-0a1574fd7e10 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:43.461249 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c40305e-6614-47bf-bb8b-0a1574fd7e10 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:43.461547 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c40305e-6614-47bf-bb8b-0a1574fd7e10 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:43.466124 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c40305e-6614-47bf-bb8b-0a1574fd7e10 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:43.466593 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c40305e-6614-47bf-bb8b-0a1574fd7e10 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:44.224286 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0c40305e-6614-47bf-bb8b-0a1574fd7e10 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:44.237547 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0c40305e-6614-47bf-bb8b-0a1574fd7e10 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd" status: 200 len: 1362 microversion: 2.1 time: 0.814849 Jul 19 23:05:44.238197 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2880/5750] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:43 2022] GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd => generated 1362 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:05:45.256114 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-084e9512-5ff2-403c-99df-eb7fd0628483 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:45.256748 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-084e9512-5ff2-403c-99df-eb7fd0628483 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:45.267846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-084e9512-5ff2-403c-99df-eb7fd0628483 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:45.268312 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-084e9512-5ff2-403c-99df-eb7fd0628483 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:45.269112 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-084e9512-5ff2-403c-99df-eb7fd0628483 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:45.269559 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-084e9512-5ff2-403c-99df-eb7fd0628483 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:45.918741 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-084e9512-5ff2-403c-99df-eb7fd0628483 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:45.933854 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-084e9512-5ff2-403c-99df-eb7fd0628483 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd" status: 200 len: 1362 microversion: 2.1 time: 0.681715 Jul 19 23:05:45.940829 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2871/5751] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:45 2022] GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd => generated 1362 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:46.311636 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d388d495-6fd9-4334-a95a-609a9a5bd04c tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:46.313126 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d388d495-6fd9-4334-a95a-609a9a5bd04c tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:46.333601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-c7a13943-2de0-480e-bbac-10aac8ab7cdc req-9b15fc5a-7843-4159-ac6a-a0da3cbb1ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98a4d015-588b-473c-afc3-0f6fbc3ea7d6", "tag": "da8cca52-ce59-4c8c-8af1-ffba90ffdf3b"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:05:46.345606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d388d495-6fd9-4334-a95a-609a9a5bd04c tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:46.347181 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d388d495-6fd9-4334-a95a-609a9a5bd04c tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:46.355263 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d388d495-6fd9-4334-a95a-609a9a5bd04c tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:46.356018 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d388d495-6fd9-4334-a95a-609a9a5bd04c tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:46.365944 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c7a13943-2de0-480e-bbac-10aac8ab7cdc req-9b15fc5a-7843-4159-ac6a-a0da3cbb1ac9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:46.366836 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c7a13943-2de0-480e-bbac-10aac8ab7cdc req-9b15fc5a-7843-4159-ac6a-a0da3cbb1ac9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:46.410023 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-c7a13943-2de0-480e-bbac-10aac8ab7cdc req-9b15fc5a-7843-4159-ac6a-a0da3cbb1ac9 service nova] Creating event network-changed:da8cca52-ce59-4c8c-8af1-ffba90ffdf3b for instance 98a4d015-588b-473c-afc3-0f6fbc3ea7d6 on n-h2-847009-3 Jul 19 23:05:46.433008 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-c7a13943-2de0-480e-bbac-10aac8ab7cdc req-9b15fc5a-7843-4159-ac6a-a0da3cbb1ac9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103588 Jul 19 23:05:46.441122 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2872/5752] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:05:46.447426 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d388d495-6fd9-4334-a95a-609a9a5bd04c tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:05:46.601742 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d388d495-6fd9-4334-a95a-609a9a5bd04c tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "DELETE /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 204 len: 0 microversion: 2.1 time: 0.295406 Jul 19 23:05:46.608083 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2881/5753] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:05:46 2022] DELETE /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:05:46.621057 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aea03e9a-93b6-4f72-b7dd-ed12901b66e5 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:46.623254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-aea03e9a-93b6-4f72-b7dd-ed12901b66e5 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:46.642928 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aea03e9a-93b6-4f72-b7dd-ed12901b66e5 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:46.644570 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aea03e9a-93b6-4f72-b7dd-ed12901b66e5 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:46.646540 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aea03e9a-93b6-4f72-b7dd-ed12901b66e5 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:46.648645 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aea03e9a-93b6-4f72-b7dd-ed12901b66e5 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:46.650491 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-b8e1776c-7afe-48a2-b8c5-35cdd4d475e0 req-1ac4986a-5531-4b3a-8520-cd3fa2988e09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "987a171b-07c6-4cca-9d53-45b0e72090cd", "name": "network-vif-plugged", "status": "completed", "tag": "90a4a48e-edda-46f0-90bb-fca8abc89725"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:05:46.679881 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b8e1776c-7afe-48a2-b8c5-35cdd4d475e0 req-1ac4986a-5531-4b3a-8520-cd3fa2988e09 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:46.706629 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b8e1776c-7afe-48a2-b8c5-35cdd4d475e0 req-1ac4986a-5531-4b3a-8520-cd3fa2988e09 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:46.782634 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-b8e1776c-7afe-48a2-b8c5-35cdd4d475e0 req-1ac4986a-5531-4b3a-8520-cd3fa2988e09 service nova] Creating event network-vif-plugged:90a4a48e-edda-46f0-90bb-fca8abc89725 for instance 987a171b-07c6-4cca-9d53-45b0e72090cd on n-h1-847009-3 Jul 19 23:05:46.810422 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-b8e1776c-7afe-48a2-b8c5-35cdd4d475e0 req-1ac4986a-5531-4b3a-8520-cd3fa2988e09 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159521 Jul 19 23:05:46.811747 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2882/5754] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:05:46.887001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:05:46.926559 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:05:46.960392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4ab7e933-7ff6-4259-b9d5-bff48816d86e tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:46.961205 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4ab7e933-7ff6-4259-b9d5-bff48816d86e tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:46.977395 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ab7e933-7ff6-4259-b9d5-bff48816d86e tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:46.977861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ab7e933-7ff6-4259-b9d5-bff48816d86e tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:46.978678 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ab7e933-7ff6-4259-b9d5-bff48816d86e tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:46.979145 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ab7e933-7ff6-4259-b9d5-bff48816d86e tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:47.133787 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-aea03e9a-93b6-4f72-b7dd-ed12901b66e5 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:47.142311 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-aea03e9a-93b6-4f72-b7dd-ed12901b66e5 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1584 microversion: 2.1 time: 0.529684 Jul 19 23:05:47.142875 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2873/5755] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:46 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1584 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:47.144273 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:05:47.277236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4ab7e933-7ff6-4259-b9d5-bff48816d86e tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:47.290565 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4ab7e933-7ff6-4259-b9d5-bff48816d86e tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd" status: 200 len: 1362 microversion: 2.1 time: 0.337364 Jul 19 23:05:47.291900 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2883/5756] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:46 2022] GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:05:48.168857 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9ed9a9dc-ccb1-41c6-9c05-074434fc2225 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:48.169644 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9ed9a9dc-ccb1-41c6-9c05-074434fc2225 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:48.177781 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ed9a9dc-ccb1-41c6-9c05-074434fc2225 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:48.178547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ed9a9dc-ccb1-41c6-9c05-074434fc2225 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:48.179689 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ed9a9dc-ccb1-41c6-9c05-074434fc2225 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:48.180327 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ed9a9dc-ccb1-41c6-9c05-074434fc2225 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:48.308897 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f9e23c08-d3cc-4fa1-b0a1-c75682d45569 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:48.310162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f9e23c08-d3cc-4fa1-b0a1-c75682d45569 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:48.324883 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f9e23c08-d3cc-4fa1-b0a1-c75682d45569 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:48.325356 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f9e23c08-d3cc-4fa1-b0a1-c75682d45569 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:48.326147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f9e23c08-d3cc-4fa1-b0a1-c75682d45569 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:48.326596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f9e23c08-d3cc-4fa1-b0a1-c75682d45569 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:48.414056 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9ed9a9dc-ccb1-41c6-9c05-074434fc2225 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:48.430034 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9ed9a9dc-ccb1-41c6-9c05-074434fc2225 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1584 microversion: 2.1 time: 0.260077 Jul 19 23:05:48.433118 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2874/5757] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:48 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1584 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:48.554554 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f9e23c08-d3cc-4fa1-b0a1-c75682d45569 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:48.584618 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f9e23c08-d3cc-4fa1-b0a1-c75682d45569 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd" status: 200 len: 1362 microversion: 2.1 time: 0.279280 Jul 19 23:05:48.595620 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2884/5758] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:48 2022] GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd => generated 1362 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:05:49.296098 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-1ec6d3b1-e38b-4751-be9e-d78e957471e2 req-9176f584-6ed4-4b0a-b82b-f77e7608fe48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a4d015-588b-473c-afc3-0f6fbc3ea7d6", "name": "network-vif-deleted", "tag": "da8cca52-ce59-4c8c-8af1-ffba90ffdf3b"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:05:49.319593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-1ec6d3b1-e38b-4751-be9e-d78e957471e2 req-9176f584-6ed4-4b0a-b82b-f77e7608fe48 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:49.320986 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-1ec6d3b1-e38b-4751-be9e-d78e957471e2 req-9176f584-6ed4-4b0a-b82b-f77e7608fe48 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:49.346393 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-1ec6d3b1-e38b-4751-be9e-d78e957471e2 req-9176f584-6ed4-4b0a-b82b-f77e7608fe48 service nova] Creating event network-vif-deleted:da8cca52-ce59-4c8c-8af1-ffba90ffdf3b for instance 98a4d015-588b-473c-afc3-0f6fbc3ea7d6 on n-h2-847009-3 Jul 19 23:05:49.354456 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-1ec6d3b1-e38b-4751-be9e-d78e957471e2 req-9176f584-6ed4-4b0a-b82b-f77e7608fe48 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062112 Jul 19 23:05:49.367074 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2875/5759] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:05:49.453537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b64096fb-511b-4828-8e83-3685cc70e66c tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:49.454810 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b64096fb-511b-4828-8e83-3685cc70e66c tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:49.467142 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b64096fb-511b-4828-8e83-3685cc70e66c tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:49.467636 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b64096fb-511b-4828-8e83-3685cc70e66c tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:49.468393 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b64096fb-511b-4828-8e83-3685cc70e66c tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:49.469102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b64096fb-511b-4828-8e83-3685cc70e66c tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:49.595024 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b64096fb-511b-4828-8e83-3685cc70e66c tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:49.603384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d185c70a-8ed4-4f48-8f5b-65170bfe2a96 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:49.604095 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d185c70a-8ed4-4f48-8f5b-65170bfe2a96 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:49.605411 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b64096fb-511b-4828-8e83-3685cc70e66c tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1230 microversion: 2.1 time: 0.160291 Jul 19 23:05:49.606361 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2885/5760] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:49 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1230 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:49.629742 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d185c70a-8ed4-4f48-8f5b-65170bfe2a96 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:49.630197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d185c70a-8ed4-4f48-8f5b-65170bfe2a96 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:49.631743 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d185c70a-8ed4-4f48-8f5b-65170bfe2a96 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:49.632835 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d185c70a-8ed4-4f48-8f5b-65170bfe2a96 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:49.919258 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d185c70a-8ed4-4f48-8f5b-65170bfe2a96 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:49.927638 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d185c70a-8ed4-4f48-8f5b-65170bfe2a96 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd" status: 200 len: 1546 microversion: 2.1 time: 0.329185 Jul 19 23:05:49.928231 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2876/5761] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:49 2022] GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd => generated 1546 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:05:49.952701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-79710a2b-9596-4181-b984-04e2781187fe tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:49.953220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-79710a2b-9596-4181-b984-04e2781187fe tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:49.964295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-79710a2b-9596-4181-b984-04e2781187fe tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:49.966188 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-79710a2b-9596-4181-b984-04e2781187fe tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:49.967280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-79710a2b-9596-4181-b984-04e2781187fe tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:49.967737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-79710a2b-9596-4181-b984-04e2781187fe tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:50.084429 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-79710a2b-9596-4181-b984-04e2781187fe tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139926 Jul 19 23:05:50.091937 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2886/5762] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 19 23:05:49 2022] GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:05:50.624943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-79edd6fb-684d-48a6-966f-5615136f324f tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:50.625569 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-79edd6fb-684d-48a6-966f-5615136f324f tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:50.635999 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79edd6fb-684d-48a6-966f-5615136f324f tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:50.650246 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79edd6fb-684d-48a6-966f-5615136f324f tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:50.652044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79edd6fb-684d-48a6-966f-5615136f324f tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:50.652857 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79edd6fb-684d-48a6-966f-5615136f324f tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:50.756748 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-79edd6fb-684d-48a6-966f-5615136f324f tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:50.768815 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-79edd6fb-684d-48a6-966f-5615136f324f tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1230 microversion: 2.1 time: 0.149553 Jul 19 23:05:50.770578 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2877/5763] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:50 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1230 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:51.811588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-be6b1e1d-aca1-4161-807a-31ea57aa7598 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:51.812228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-be6b1e1d-aca1-4161-807a-31ea57aa7598 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:51.818470 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-fcdabee8-5e15-4bc6-9c82-312fdfd771ea req-e29eabe7-2220-4089-94ac-fee8b6c13165 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "987a171b-07c6-4cca-9d53-45b0e72090cd", "tag": "90a4a48e-edda-46f0-90bb-fca8abc89725"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:05:51.830983 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be6b1e1d-aca1-4161-807a-31ea57aa7598 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:51.831468 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be6b1e1d-aca1-4161-807a-31ea57aa7598 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:51.832780 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be6b1e1d-aca1-4161-807a-31ea57aa7598 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:51.833223 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be6b1e1d-aca1-4161-807a-31ea57aa7598 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:51.837297 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-fcdabee8-5e15-4bc6-9c82-312fdfd771ea req-e29eabe7-2220-4089-94ac-fee8b6c13165 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:51.838082 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-fcdabee8-5e15-4bc6-9c82-312fdfd771ea req-e29eabe7-2220-4089-94ac-fee8b6c13165 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:51.857824 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-fcdabee8-5e15-4bc6-9c82-312fdfd771ea req-e29eabe7-2220-4089-94ac-fee8b6c13165 service nova] Creating event network-changed:90a4a48e-edda-46f0-90bb-fca8abc89725 for instance 987a171b-07c6-4cca-9d53-45b0e72090cd on n-h1-847009-3 Jul 19 23:05:51.867826 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-fcdabee8-5e15-4bc6-9c82-312fdfd771ea req-e29eabe7-2220-4089-94ac-fee8b6c13165 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053437 Jul 19 23:05:51.873048 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2878/5764] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:05:51.957541 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-be6b1e1d-aca1-4161-807a-31ea57aa7598 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:51.977159 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-be6b1e1d-aca1-4161-807a-31ea57aa7598 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1230 microversion: 2.1 time: 0.171635 Jul 19 23:05:51.980104 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2887/5765] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:51 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1230 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:53.006767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a3b2d320-4eb2-4998-b9ca-569f045a018f tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:53.007541 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a3b2d320-4eb2-4998-b9ca-569f045a018f tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:53.035829 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3b2d320-4eb2-4998-b9ca-569f045a018f tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:53.039545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3b2d320-4eb2-4998-b9ca-569f045a018f tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:53.040458 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3b2d320-4eb2-4998-b9ca-569f045a018f tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:53.040977 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3b2d320-4eb2-4998-b9ca-569f045a018f tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:53.150107 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a3b2d320-4eb2-4998-b9ca-569f045a018f tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:53.161299 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a3b2d320-4eb2-4998-b9ca-569f045a018f tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1230 microversion: 2.1 time: 0.161501 Jul 19 23:05:53.162669 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2879/5766] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:52 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1230 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:54.181104 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7a2cbd38-4990-4867-8db3-13e386631bf2 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:54.181940 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7a2cbd38-4990-4867-8db3-13e386631bf2 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:54.193676 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a2cbd38-4990-4867-8db3-13e386631bf2 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:54.194720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a2cbd38-4990-4867-8db3-13e386631bf2 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:54.196044 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a2cbd38-4990-4867-8db3-13e386631bf2 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:54.196878 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7a2cbd38-4990-4867-8db3-13e386631bf2 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:54.345300 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7a2cbd38-4990-4867-8db3-13e386631bf2 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:54.357475 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7a2cbd38-4990-4867-8db3-13e386631bf2 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1230 microversion: 2.1 time: 0.182790 Jul 19 23:05:54.369886 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2888/5767] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:54 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1230 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:55.375771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-08dd091d-5097-4667-84fa-8a08df8ceac9 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:55.376409 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-08dd091d-5097-4667-84fa-8a08df8ceac9 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:55.401945 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-08dd091d-5097-4667-84fa-8a08df8ceac9 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:55.402654 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-08dd091d-5097-4667-84fa-8a08df8ceac9 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:55.404037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-08dd091d-5097-4667-84fa-8a08df8ceac9 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:55.404660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-08dd091d-5097-4667-84fa-8a08df8ceac9 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:55.409516 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:05:55.450714 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-08dd091d-5097-4667-84fa-8a08df8ceac9 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:55.451544 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-08dd091d-5097-4667-84fa-8a08df8ceac9 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:55.452212 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-08dd091d-5097-4667-84fa-8a08df8ceac9 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lazy-loading 'fault' on Instance uuid 98a4d015-588b-473c-afc3-0f6fbc3ea7d6 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:05:55.530008 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-08dd091d-5097-4667-84fa-8a08df8ceac9 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d4cb40261d442fbb80843e6340b699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84753b1b5aaa4907ad1e5ac13d7b3d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:55.539207 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-08dd091d-5097-4667-84fa-8a08df8ceac9 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 200 len: 1189 microversion: 2.1 time: 0.167727 Jul 19 23:05:55.540351 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2880/5768] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:55 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 1189 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:56.560685 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b215351c-8702-4932-aaa6-48f639f9a530 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:56.562109 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b215351c-8702-4932-aaa6-48f639f9a530 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] [instance: 98a4d015-588b-473c-afc3-0f6fbc3ea7d6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:56.576966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b215351c-8702-4932-aaa6-48f639f9a530 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:56.579336 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b215351c-8702-4932-aaa6-48f639f9a530 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:56.580262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b215351c-8702-4932-aaa6-48f639f9a530 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:56.581386 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b215351c-8702-4932-aaa6-48f639f9a530 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:56.603955 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-b215351c-8702-4932-aaa6-48f639f9a530 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] HTTP exception thrown: Instance 98a4d015-588b-473c-afc3-0f6fbc3ea7d6 could not be found. Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b215351c-8702-4932-aaa6-48f639f9a530 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Request method failure captured: Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 HTTP/1.1 Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zd6LUCHGUoxvIcZDu7ZhnPdDnAlKaIWAzm_u6Y81lVuEsnMCIQ9z0OB-v2wdDUQgFs7hkTcGXkKbSWuWgxn21sKqhq_qqVIS2lkpdjShc2Ae3k7GIVX_KiLuJOf7dAHDUqQ7p2_kTx_NF1KtrcGqveD4sWBR0nsiW9lPxz-e2_WGLM Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 84753b1b5aaa4907ad1e5ac13d7b3d8c Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-TestVolumeBackupRestore-925349121 Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_84753b1b5aaa4907ad1e5ac13d7b3d8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/84753b1b5aaa4907ad1e5ac13d7b3d8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/84753b1b5aaa4907ad1e5ac13d7b3d8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/84753b1b5aaa4907ad1e5ac13d7b3d8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-TestVolumeBackupRestore-925349121 Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 84753b1b5aaa4907ad1e5ac13d7b3d8c Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-TestVolumeBackupRestore-925349121 Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-TestVolumeBackupRestore-925349121-project Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: c9d4cb40261d442fbb80843e6340b699 Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-TestVolumeBackupRestore-925349121-project Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 98a4d015-588b-473c-afc3-0f6fbc3ea7d6 could not be found. Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '98a4d015-588b-473c-afc3-0f6fbc3ea7d6'} Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98a4d015-588b-473c-afc3-0f6fbc3ea7d6 could not be found. Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98a4d015-588b-473c-afc3-0f6fbc3ea7d6 could not be found. Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:05:56.605823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:05:56.609486 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:05:56.609486 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:05:56.609486 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:05:56.609486 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:05:56.609486 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:05:56.609486 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98a4d015-588b-473c-afc3-0f6fbc3ea7d6 could not be found. Jul 19 23:05:56.609486 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:05:56.622691 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b215351c-8702-4932-aaa6-48f639f9a530 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Returning 404 to user: Instance 98a4d015-588b-473c-afc3-0f6fbc3ea7d6 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:05:56.624063 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b215351c-8702-4932-aaa6-48f639f9a530 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6" status: 404 len: 111 microversion: 2.1 time: 0.069295 Jul 19 23:05:56.640559 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2889/5769] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:56 2022] GET /compute/v2.1/servers/98a4d015-588b-473c-afc3-0f6fbc3ea7d6 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 23:05:56.958220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7b94cc05-5373-4050-b03b-5cdc51d0dac8 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] Calling method '.version_select at 0x7f7a1040f3a0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:56.991359 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7b94cc05-5373-4050-b03b-5cdc51d0dac8 tempest-TestVolumeBackupRestore-925349121 tempest-TestVolumeBackupRestore-925349121-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1432859250" status: 202 len: 0 microversion: 2.1 time: 0.037297 Jul 19 23:05:56.993002 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2890/5770] 10.222.0.25 () {58 vars in 1268 bytes} [Tue Jul 19 23:05:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1432859250 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 23:05:57.140231 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-662b4b7d-0b5a-4973-bfe1-002b79353612 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-911883405", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "c733fe14-c027-497b-ad38-e8afaae55ca4"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:05:57.215044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-662b4b7d-0b5a-4973-bfe1-002b79353612 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] validate_networks() for [('c733fe14-c027-497b-ad38-e8afaae55ca4', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:05:57.749761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-662b4b7d-0b5a-4973-bfe1-002b79353612 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:05:57.750521 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-662b4b7d-0b5a-4973-bfe1-002b79353612 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:05:57.751218 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-662b4b7d-0b5a-4973-bfe1-002b79353612 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:05:57.751944 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-662b4b7d-0b5a-4973-bfe1-002b79353612 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:05:57.756816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-662b4b7d-0b5a-4973-bfe1-002b79353612 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:05:57.775488 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-662b4b7d-0b5a-4973-bfe1-002b79353612 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:57.776460 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-662b4b7d-0b5a-4973-bfe1-002b79353612 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:57.777440 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-662b4b7d-0b5a-4973-bfe1-002b79353612 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:57.777988 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-662b4b7d-0b5a-4973-bfe1-002b79353612 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:57.807936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-662b4b7d-0b5a-4973-bfe1-002b79353612 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Getting quotas for project 815c2caf32104f1bb83a458a4dad32d6. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:05:57.813998 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-662b4b7d-0b5a-4973-bfe1-002b79353612 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Getting quotas for user 5468100cc4304cc5a91e97e51c8e7b3b and project 815c2caf32104f1bb83a458a4dad32d6. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:05:57.830540 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-662b4b7d-0b5a-4973-bfe1-002b79353612 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:05:57.833240 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-662b4b7d-0b5a-4973-bfe1-002b79353612 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] [instance: 03cbfc38-ff65-428a-8878-f4d84e4c458b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:05:57.887213 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-662b4b7d-0b5a-4973-bfe1-002b79353612 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.958629 Jul 19 23:05:57.889150 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2881/5771] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:05:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:05:57.900849 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-108b75ea-00f6-4ea7-b2c8-4db1168c1147 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:57.902000 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-108b75ea-00f6-4ea7-b2c8-4db1168c1147 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] [instance: 03cbfc38-ff65-428a-8878-f4d84e4c458b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:57.967326 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-108b75ea-00f6-4ea7-b2c8-4db1168c1147 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5468100cc4304cc5a91e97e51c8e7b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815c2caf32104f1bb83a458a4dad32d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:57.975466 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-108b75ea-00f6-4ea7-b2c8-4db1168c1147 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] 10.222.0.25 "GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b" status: 200 len: 1213 microversion: 2.1 time: 0.079619 Jul 19 23:05:57.985010 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2891/5772] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:57 2022] GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:05:58.993519 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e549f3f5-c06e-4988-b5b1-662e71bf403a tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:05:58.994824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e549f3f5-c06e-4988-b5b1-662e71bf403a tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] [instance: 03cbfc38-ff65-428a-8878-f4d84e4c458b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:59.005243 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e549f3f5-c06e-4988-b5b1-662e71bf403a tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:59.006033 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e549f3f5-c06e-4988-b5b1-662e71bf403a tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:59.007015 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e549f3f5-c06e-4988-b5b1-662e71bf403a tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:59.007976 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e549f3f5-c06e-4988-b5b1-662e71bf403a tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:59.123256 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e549f3f5-c06e-4988-b5b1-662e71bf403a tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5468100cc4304cc5a91e97e51c8e7b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815c2caf32104f1bb83a458a4dad32d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:05:59.143638 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e549f3f5-c06e-4988-b5b1-662e71bf403a tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] 10.222.0.25 "GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b" status: 200 len: 1265 microversion: 2.1 time: 0.155261 Jul 19 23:05:59.156962 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2882/5773] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:05:58 2022] GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:05:59.970389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ec096177-926d-4ee7-b8e0-dee181c17235 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:05:59.972963 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ec096177-926d-4ee7-b8e0-dee181c17235 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: abb31b9a-6d7d-43af-8eb3-57af34fc02ed] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:05:59.994448 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ec096177-926d-4ee7-b8e0-dee181c17235 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:05:59.996626 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ec096177-926d-4ee7-b8e0-dee181c17235 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:05:59.999571 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ec096177-926d-4ee7-b8e0-dee181c17235 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:00.001504 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ec096177-926d-4ee7-b8e0-dee181c17235 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:00.009666 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:06:00.093838 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ec096177-926d-4ee7-b8e0-dee181c17235 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "POST /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed/action" status: 200 len: 24550 microversion: 2.1 time: 0.127354 Jul 19 23:06:00.093838 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2892/5774] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:05:59 2022] POST /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed/action => generated 24550 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 23:06:00.162933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-14f2c6d5-27dc-4329-bd2f-87a72fc6c90c tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:00.164254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-14f2c6d5-27dc-4329-bd2f-87a72fc6c90c tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] [instance: 03cbfc38-ff65-428a-8878-f4d84e4c458b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:00.179893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-14f2c6d5-27dc-4329-bd2f-87a72fc6c90c tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:00.180360 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-14f2c6d5-27dc-4329-bd2f-87a72fc6c90c tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:00.181229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-14f2c6d5-27dc-4329-bd2f-87a72fc6c90c tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:00.181865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-14f2c6d5-27dc-4329-bd2f-87a72fc6c90c tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:00.376636 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-14f2c6d5-27dc-4329-bd2f-87a72fc6c90c tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5468100cc4304cc5a91e97e51c8e7b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815c2caf32104f1bb83a458a4dad32d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:00.389196 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-14f2c6d5-27dc-4329-bd2f-87a72fc6c90c tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] 10.222.0.25 "GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b" status: 200 len: 1271 microversion: 2.1 time: 0.231566 Jul 19 23:06:00.404703 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2883/5775] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:00 2022] GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b => generated 1271 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:01.413589 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0f5d296c-ee4f-4bb4-9acf-614ac676f4c9 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:01.414567 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0f5d296c-ee4f-4bb4-9acf-614ac676f4c9 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] [instance: 03cbfc38-ff65-428a-8878-f4d84e4c458b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:01.433311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0f5d296c-ee4f-4bb4-9acf-614ac676f4c9 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:01.433625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0f5d296c-ee4f-4bb4-9acf-614ac676f4c9 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:01.434473 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0f5d296c-ee4f-4bb4-9acf-614ac676f4c9 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:01.434969 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0f5d296c-ee4f-4bb4-9acf-614ac676f4c9 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:01.956427 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0f5d296c-ee4f-4bb4-9acf-614ac676f4c9 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5468100cc4304cc5a91e97e51c8e7b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815c2caf32104f1bb83a458a4dad32d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:01.964908 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0f5d296c-ee4f-4bb4-9acf-614ac676f4c9 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] 10.222.0.25 "GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b" status: 200 len: 1313 microversion: 2.1 time: 0.556482 Jul 19 23:06:01.977748 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2893/5776] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:01 2022] GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b => generated 1313 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:02.619706 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-7653f655-be6e-4965-960a-b8b42686b960 req-6319b928-19ac-4593-a086-9de7b2cc97c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03cbfc38-ff65-428a-8878-f4d84e4c458b", "tag": "79990b04-6845-4fc0-9bbe-73275c78b5cf"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:06:02.670018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7653f655-be6e-4965-960a-b8b42686b960 req-6319b928-19ac-4593-a086-9de7b2cc97c1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:02.671682 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7653f655-be6e-4965-960a-b8b42686b960 req-6319b928-19ac-4593-a086-9de7b2cc97c1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:02.708647 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-7653f655-be6e-4965-960a-b8b42686b960 req-6319b928-19ac-4593-a086-9de7b2cc97c1 service nova] Creating event network-changed:79990b04-6845-4fc0-9bbe-73275c78b5cf for instance 03cbfc38-ff65-428a-8878-f4d84e4c458b on n-h2-847009-3 Jul 19 23:06:02.718965 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-7653f655-be6e-4965-960a-b8b42686b960 req-6319b928-19ac-4593-a086-9de7b2cc97c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110107 Jul 19 23:06:02.722602 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2884/5777] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:06:02.985001 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fb7208a8-0f77-4287-9be6-0f7971c3a63a tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:02.985750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fb7208a8-0f77-4287-9be6-0f7971c3a63a tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] [instance: 03cbfc38-ff65-428a-8878-f4d84e4c458b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:03.006902 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fb7208a8-0f77-4287-9be6-0f7971c3a63a tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:03.007617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fb7208a8-0f77-4287-9be6-0f7971c3a63a tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:03.008483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fb7208a8-0f77-4287-9be6-0f7971c3a63a tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:03.011972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fb7208a8-0f77-4287-9be6-0f7971c3a63a tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:03.388630 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fb7208a8-0f77-4287-9be6-0f7971c3a63a tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5468100cc4304cc5a91e97e51c8e7b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815c2caf32104f1bb83a458a4dad32d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:03.411795 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fb7208a8-0f77-4287-9be6-0f7971c3a63a tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] 10.222.0.25 "GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b" status: 200 len: 1313 microversion: 2.1 time: 0.432995 Jul 19 23:06:03.414198 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2894/5778] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:02 2022] GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:06:04.431971 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bb32bd28-5b28-4426-add2-201a621df7a1 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:04.432861 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bb32bd28-5b28-4426-add2-201a621df7a1 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] [instance: 03cbfc38-ff65-428a-8878-f4d84e4c458b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:04.446002 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bb32bd28-5b28-4426-add2-201a621df7a1 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:04.446002 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bb32bd28-5b28-4426-add2-201a621df7a1 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:04.446002 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bb32bd28-5b28-4426-add2-201a621df7a1 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:04.446313 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bb32bd28-5b28-4426-add2-201a621df7a1 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:04.626656 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bb32bd28-5b28-4426-add2-201a621df7a1 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5468100cc4304cc5a91e97e51c8e7b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815c2caf32104f1bb83a458a4dad32d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:04.635931 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bb32bd28-5b28-4426-add2-201a621df7a1 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] 10.222.0.25 "GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b" status: 200 len: 1313 microversion: 2.1 time: 0.208216 Jul 19 23:06:04.636852 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2885/5779] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:04 2022] GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:05.653391 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-37f25d91-8b34-4d7e-b923-104171f5af6c tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:05.653896 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-37f25d91-8b34-4d7e-b923-104171f5af6c tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] [instance: 03cbfc38-ff65-428a-8878-f4d84e4c458b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:05.678973 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37f25d91-8b34-4d7e-b923-104171f5af6c tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:05.679701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37f25d91-8b34-4d7e-b923-104171f5af6c tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:05.680747 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37f25d91-8b34-4d7e-b923-104171f5af6c tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:05.694666 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37f25d91-8b34-4d7e-b923-104171f5af6c tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:06.109582 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-37f25d91-8b34-4d7e-b923-104171f5af6c tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5468100cc4304cc5a91e97e51c8e7b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815c2caf32104f1bb83a458a4dad32d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:06.120254 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-37f25d91-8b34-4d7e-b923-104171f5af6c tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] 10.222.0.25 "GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b" status: 200 len: 1313 microversion: 2.1 time: 0.471448 Jul 19 23:06:06.121491 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2895/5780] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:05 2022] GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b => generated 1313 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:07.163531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-82b85797-0751-483a-a8d7-fd93781a009d tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:07.165493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-82b85797-0751-483a-a8d7-fd93781a009d tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] [instance: 03cbfc38-ff65-428a-8878-f4d84e4c458b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:07.178017 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-82b85797-0751-483a-a8d7-fd93781a009d tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:07.178927 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-82b85797-0751-483a-a8d7-fd93781a009d tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:07.179963 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-82b85797-0751-483a-a8d7-fd93781a009d tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:07.180602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-82b85797-0751-483a-a8d7-fd93781a009d tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:07.380084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-82b85797-0751-483a-a8d7-fd93781a009d tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5468100cc4304cc5a91e97e51c8e7b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815c2caf32104f1bb83a458a4dad32d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:07.387775 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-82b85797-0751-483a-a8d7-fd93781a009d tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] 10.222.0.25 "GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b" status: 200 len: 1313 microversion: 2.1 time: 0.239869 Jul 19 23:06:07.388837 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2886/5781] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:07 2022] GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:08.023844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:06:08.161946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-e5468dec-4f8c-4b20-b739-46d4f69808e8 req-8ee51f74-8b36-423e-b283-d57f9f4e7ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03cbfc38-ff65-428a-8878-f4d84e4c458b", "name": "network-vif-plugged", "status": "completed", "tag": "79990b04-6845-4fc0-9bbe-73275c78b5cf"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:06:08.167383 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:06:08.186060 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e5468dec-4f8c-4b20-b739-46d4f69808e8 req-8ee51f74-8b36-423e-b283-d57f9f4e7ac5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:08.186524 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e5468dec-4f8c-4b20-b739-46d4f69808e8 req-8ee51f74-8b36-423e-b283-d57f9f4e7ac5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:08.203527 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-e5468dec-4f8c-4b20-b739-46d4f69808e8 req-8ee51f74-8b36-423e-b283-d57f9f4e7ac5 service nova] Creating event network-vif-plugged:79990b04-6845-4fc0-9bbe-73275c78b5cf for instance 03cbfc38-ff65-428a-8878-f4d84e4c458b on n-h2-847009-3 Jul 19 23:06:08.210671 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-e5468dec-4f8c-4b20-b739-46d4f69808e8 req-8ee51f74-8b36-423e-b283-d57f9f4e7ac5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193460 Jul 19 23:06:08.211869 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2896/5782] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:06:08.419280 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-737160fd-c72a-48e7-bcc0-5f89e6971319 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:08.421329 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-737160fd-c72a-48e7-bcc0-5f89e6971319 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] [instance: 03cbfc38-ff65-428a-8878-f4d84e4c458b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:08.426926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:06:08.428314 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:06:08.439618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-737160fd-c72a-48e7-bcc0-5f89e6971319 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:08.440398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-737160fd-c72a-48e7-bcc0-5f89e6971319 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:08.442362 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-737160fd-c72a-48e7-bcc0-5f89e6971319 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:08.443206 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-737160fd-c72a-48e7-bcc0-5f89e6971319 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:08.544365 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0062d713-cff4-4c31-a9f9-0c9d7bf6e61e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2056528004", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "4d8bc36c-e2e8-41ef-a34b-db66d5283f13", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "c424fcca-fcaa-49c5-9171-61018c1542cf"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:06:08.657631 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-0062d713-cff4-4c31-a9f9-0c9d7bf6e61e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] validate_networks() for [('c424fcca-fcaa-49c5-9171-61018c1542cf', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:06:08.851482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-737160fd-c72a-48e7-bcc0-5f89e6971319 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5468100cc4304cc5a91e97e51c8e7b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815c2caf32104f1bb83a458a4dad32d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:08.864498 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-737160fd-c72a-48e7-bcc0-5f89e6971319 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] 10.222.0.25 "GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b" status: 200 len: 1313 microversion: 2.1 time: 0.457638 Jul 19 23:06:08.865357 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2887/5783] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:08 2022] GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b => generated 1313 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:09.534809 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-0062d713-cff4-4c31-a9f9-0c9d7bf6e61e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:06:09.535314 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-0062d713-cff4-4c31-a9f9-0c9d7bf6e61e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:06:09.535767 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-0062d713-cff4-4c31-a9f9-0c9d7bf6e61e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:06:09.536182 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-0062d713-cff4-4c31-a9f9-0c9d7bf6e61e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:06:09.536607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-0062d713-cff4-4c31-a9f9-0c9d7bf6e61e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:06:09.552418 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0062d713-cff4-4c31-a9f9-0c9d7bf6e61e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:09.552877 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0062d713-cff4-4c31-a9f9-0c9d7bf6e61e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:09.556605 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0062d713-cff4-4c31-a9f9-0c9d7bf6e61e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:09.557312 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0062d713-cff4-4c31-a9f9-0c9d7bf6e61e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:09.604864 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-0062d713-cff4-4c31-a9f9-0c9d7bf6e61e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Getting quotas for project ba6762beb0fe4220b984143b3ea6bd48. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:06:09.616921 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-0062d713-cff4-4c31-a9f9-0c9d7bf6e61e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Getting quotas for user deeb5431c1284d02b245ff3a9dc3f4e8 and project ba6762beb0fe4220b984143b3ea6bd48. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:06:09.678481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0062d713-cff4-4c31-a9f9-0c9d7bf6e61e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:06:09.685788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0062d713-cff4-4c31-a9f9-0c9d7bf6e61e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='4d8bc36c-e2e8-41ef-a34b-db66d5283f13',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:06:09.914686 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a90ddb2d-8778-40d1-8d85-c0b02ea9adb3 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:09.915809 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a90ddb2d-8778-40d1-8d85-c0b02ea9adb3 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] [instance: 03cbfc38-ff65-428a-8878-f4d84e4c458b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:09.937763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a90ddb2d-8778-40d1-8d85-c0b02ea9adb3 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:09.942693 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a90ddb2d-8778-40d1-8d85-c0b02ea9adb3 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:09.944437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a90ddb2d-8778-40d1-8d85-c0b02ea9adb3 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:09.945189 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a90ddb2d-8778-40d1-8d85-c0b02ea9adb3 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:09.971922 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0062d713-cff4-4c31-a9f9-0c9d7bf6e61e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.432270 Jul 19 23:06:09.984783 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2897/5784] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:06:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:06:10.004425 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7f609bcf-3eb0-4347-bbe7-b17cdbac23f6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:10.005979 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7f609bcf-3eb0-4347-bbe7-b17cdbac23f6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:10.244808 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7f609bcf-3eb0-4347-bbe7-b17cdbac23f6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:10.263040 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7f609bcf-3eb0-4347-bbe7-b17cdbac23f6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1057 microversion: 2.1 time: 0.269915 Jul 19 23:06:10.275218 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2898/5785] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:09 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1057 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:10.297295 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a90ddb2d-8778-40d1-8d85-c0b02ea9adb3 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5468100cc4304cc5a91e97e51c8e7b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815c2caf32104f1bb83a458a4dad32d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:10.312865 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a90ddb2d-8778-40d1-8d85-c0b02ea9adb3 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] 10.222.0.25 "GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b" status: 200 len: 1313 microversion: 2.1 time: 0.423853 Jul 19 23:06:10.314708 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2888/5786] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:09 2022] GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b => generated 1313 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:11.287479 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-32043adc-06f2-40f8-95dc-efd36839d44b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:11.288777 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-32043adc-06f2-40f8-95dc-efd36839d44b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:11.296768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32043adc-06f2-40f8-95dc-efd36839d44b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:11.297627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32043adc-06f2-40f8-95dc-efd36839d44b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:11.298695 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32043adc-06f2-40f8-95dc-efd36839d44b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:11.299409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32043adc-06f2-40f8-95dc-efd36839d44b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:11.336639 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d2c9b841-856b-497b-ac9a-a71800983d6a tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:11.341087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d2c9b841-856b-497b-ac9a-a71800983d6a tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] [instance: 03cbfc38-ff65-428a-8878-f4d84e4c458b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:11.344262 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:06:11.357049 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2c9b841-856b-497b-ac9a-a71800983d6a tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:11.363846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2c9b841-856b-497b-ac9a-a71800983d6a tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:11.365269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2c9b841-856b-497b-ac9a-a71800983d6a tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:11.365940 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d2c9b841-856b-497b-ac9a-a71800983d6a tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:11.454478 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-32043adc-06f2-40f8-95dc-efd36839d44b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:11.466241 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-32043adc-06f2-40f8-95dc-efd36839d44b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1109 microversion: 2.1 time: 0.182897 Jul 19 23:06:11.467207 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2899/5787] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:11 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1109 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:11.802366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d2c9b841-856b-497b-ac9a-a71800983d6a tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5468100cc4304cc5a91e97e51c8e7b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815c2caf32104f1bb83a458a4dad32d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:11.812792 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d2c9b841-856b-497b-ac9a-a71800983d6a tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] 10.222.0.25 "GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b" status: 200 len: 1498 microversion: 2.1 time: 0.485900 Jul 19 23:06:11.813666 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2889/5788] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:11 2022] GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b => generated 1498 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:06:12.489270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-42087782-8819-43ad-b058-664a7bee8c83 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:12.491137 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-42087782-8819-43ad-b058-664a7bee8c83 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:12.520722 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42087782-8819-43ad-b058-664a7bee8c83 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:12.521580 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42087782-8819-43ad-b058-664a7bee8c83 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:12.522539 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42087782-8819-43ad-b058-664a7bee8c83 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:12.523162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42087782-8819-43ad-b058-664a7bee8c83 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:12.798597 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-42087782-8819-43ad-b058-664a7bee8c83 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:12.814960 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-42087782-8819-43ad-b058-664a7bee8c83 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1127 microversion: 2.1 time: 0.332402 Jul 19 23:06:12.824960 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2900/5789] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:12 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1127 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:13.839662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-40f96bb2-82d3-4e08-b88e-5503b089c3f9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:13.841247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-40f96bb2-82d3-4e08-b88e-5503b089c3f9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:13.851356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-40f96bb2-82d3-4e08-b88e-5503b089c3f9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:13.852100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-40f96bb2-82d3-4e08-b88e-5503b089c3f9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:13.853609 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-40f96bb2-82d3-4e08-b88e-5503b089c3f9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:13.854210 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-40f96bb2-82d3-4e08-b88e-5503b089c3f9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:14.209177 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-40f96bb2-82d3-4e08-b88e-5503b089c3f9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:14.222397 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-40f96bb2-82d3-4e08-b88e-5503b089c3f9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1169 microversion: 2.1 time: 0.393896 Jul 19 23:06:14.224675 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2890/5790] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:13 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1169 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:15.069405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-e10ee651-1249-46a3-a737-98957632468f req-16753920-eeee-455d-9c73-500c3733a48e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b03913b-d112-47d1-b9aa-40f1818ca186", "tag": "8e3371ce-5cf7-4cef-a48f-96c692ae1d83"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:06:15.094032 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e10ee651-1249-46a3-a737-98957632468f req-16753920-eeee-455d-9c73-500c3733a48e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:15.094483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e10ee651-1249-46a3-a737-98957632468f req-16753920-eeee-455d-9c73-500c3733a48e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:15.123627 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-e10ee651-1249-46a3-a737-98957632468f req-16753920-eeee-455d-9c73-500c3733a48e service nova] Creating event network-changed:8e3371ce-5cf7-4cef-a48f-96c692ae1d83 for instance 0b03913b-d112-47d1-b9aa-40f1818ca186 on n-h1-847009-3 Jul 19 23:06:15.137620 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-e10ee651-1249-46a3-a737-98957632468f req-16753920-eeee-455d-9c73-500c3733a48e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077516 Jul 19 23:06:15.138285 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2901/5791] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:06:15.241743 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2551fcc5-a7dd-4e5d-b762-b9362582f9b7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:15.242440 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2551fcc5-a7dd-4e5d-b762-b9362582f9b7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:15.278696 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2551fcc5-a7dd-4e5d-b762-b9362582f9b7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:15.284789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2551fcc5-a7dd-4e5d-b762-b9362582f9b7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:15.289442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2551fcc5-a7dd-4e5d-b762-b9362582f9b7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:15.289906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2551fcc5-a7dd-4e5d-b762-b9362582f9b7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:15.718641 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2551fcc5-a7dd-4e5d-b762-b9362582f9b7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:15.733851 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2551fcc5-a7dd-4e5d-b762-b9362582f9b7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1169 microversion: 2.1 time: 0.496481 Jul 19 23:06:15.736387 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2891/5792] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:15 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1169 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:16.768524 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ae5b6355-51ea-4fd3-964d-c79d83066a86 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:16.770305 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ae5b6355-51ea-4fd3-964d-c79d83066a86 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:16.779562 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae5b6355-51ea-4fd3-964d-c79d83066a86 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:16.780299 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae5b6355-51ea-4fd3-964d-c79d83066a86 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:16.781474 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae5b6355-51ea-4fd3-964d-c79d83066a86 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:16.782368 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae5b6355-51ea-4fd3-964d-c79d83066a86 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:16.862522 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-864da754-1a76-4ea1-944a-db1f13bfd3e6 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:16.864607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-864da754-1a76-4ea1-944a-db1f13bfd3e6 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] [instance: 03cbfc38-ff65-428a-8878-f4d84e4c458b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:16.874310 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-864da754-1a76-4ea1-944a-db1f13bfd3e6 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:16.877265 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-864da754-1a76-4ea1-944a-db1f13bfd3e6 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:16.878384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-864da754-1a76-4ea1-944a-db1f13bfd3e6 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:16.879083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-864da754-1a76-4ea1-944a-db1f13bfd3e6 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:16.927751 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-864da754-1a76-4ea1-944a-db1f13bfd3e6 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] [instance: 03cbfc38-ff65-428a-8878-f4d84e4c458b] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:06:17.059794 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-864da754-1a76-4ea1-944a-db1f13bfd3e6 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] 10.222.0.25 "DELETE /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b" status: 204 len: 0 microversion: 2.1 time: 0.201106 Jul 19 23:06:17.061665 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2892/5793] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:06:16 2022] DELETE /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:06:17.087700 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d347143f-7353-4e4e-b46b-de1645e7a827 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:17.089504 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d347143f-7353-4e4e-b46b-de1645e7a827 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] [instance: 03cbfc38-ff65-428a-8878-f4d84e4c458b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:17.096870 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d347143f-7353-4e4e-b46b-de1645e7a827 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:17.097757 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d347143f-7353-4e4e-b46b-de1645e7a827 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:17.098781 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d347143f-7353-4e4e-b46b-de1645e7a827 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:17.099518 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d347143f-7353-4e4e-b46b-de1645e7a827 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:17.196043 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ae5b6355-51ea-4fd3-964d-c79d83066a86 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:17.222178 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ae5b6355-51ea-4fd3-964d-c79d83066a86 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1169 microversion: 2.1 time: 0.462275 Jul 19 23:06:17.224981 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2902/5794] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:16 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1169 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:17.544234 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d347143f-7353-4e4e-b46b-de1645e7a827 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5468100cc4304cc5a91e97e51c8e7b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815c2caf32104f1bb83a458a4dad32d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:17.558116 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d347143f-7353-4e4e-b46b-de1645e7a827 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] 10.222.0.25 "GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b" status: 200 len: 1504 microversion: 2.1 time: 0.476691 Jul 19 23:06:17.570247 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2893/5795] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:17 2022] GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b => generated 1504 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:18.243859 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ca2c9184-6da8-4c35-a76e-5efcc5b23325 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:18.245603 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ca2c9184-6da8-4c35-a76e-5efcc5b23325 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:18.273281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca2c9184-6da8-4c35-a76e-5efcc5b23325 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:18.274313 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca2c9184-6da8-4c35-a76e-5efcc5b23325 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:18.276375 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca2c9184-6da8-4c35-a76e-5efcc5b23325 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:18.279929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca2c9184-6da8-4c35-a76e-5efcc5b23325 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:18.597675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-16dedc49-ee31-41cc-9c63-7d62d3373d99 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:18.597675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-16dedc49-ee31-41cc-9c63-7d62d3373d99 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] [instance: 03cbfc38-ff65-428a-8878-f4d84e4c458b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:18.628114 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16dedc49-ee31-41cc-9c63-7d62d3373d99 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:18.631604 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16dedc49-ee31-41cc-9c63-7d62d3373d99 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:18.632929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16dedc49-ee31-41cc-9c63-7d62d3373d99 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:18.633560 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16dedc49-ee31-41cc-9c63-7d62d3373d99 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:18.656034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ca2c9184-6da8-4c35-a76e-5efcc5b23325 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:18.681234 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ca2c9184-6da8-4c35-a76e-5efcc5b23325 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1169 microversion: 2.1 time: 0.442569 Jul 19 23:06:18.686393 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2903/5796] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:18 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1169 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:18.996947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-16dedc49-ee31-41cc-9c63-7d62d3373d99 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5468100cc4304cc5a91e97e51c8e7b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815c2caf32104f1bb83a458a4dad32d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:19.009232 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-16dedc49-ee31-41cc-9c63-7d62d3373d99 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] 10.222.0.25 "GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b" status: 200 len: 1504 microversion: 2.1 time: 0.431337 Jul 19 23:06:19.021277 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2894/5797] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:18 2022] GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b => generated 1504 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:19.705597 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-102ac094-fd43-46ac-8b20-db9e70cf4b2d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:19.706495 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-102ac094-fd43-46ac-8b20-db9e70cf4b2d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:19.709388 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:06:19.722716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-102ac094-fd43-46ac-8b20-db9e70cf4b2d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:19.724241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-102ac094-fd43-46ac-8b20-db9e70cf4b2d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:19.726127 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-102ac094-fd43-46ac-8b20-db9e70cf4b2d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:19.726127 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-102ac094-fd43-46ac-8b20-db9e70cf4b2d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:20.030411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0d847eca-7aac-4f66-a277-891e60660af1 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:20.032626 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0d847eca-7aac-4f66-a277-891e60660af1 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] [instance: 03cbfc38-ff65-428a-8878-f4d84e4c458b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:20.040836 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d847eca-7aac-4f66-a277-891e60660af1 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:20.052416 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d847eca-7aac-4f66-a277-891e60660af1 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:20.053753 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d847eca-7aac-4f66-a277-891e60660af1 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:20.056612 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d847eca-7aac-4f66-a277-891e60660af1 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:20.107030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-102ac094-fd43-46ac-8b20-db9e70cf4b2d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:20.125515 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-102ac094-fd43-46ac-8b20-db9e70cf4b2d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1169 microversion: 2.1 time: 0.423818 Jul 19 23:06:20.138431 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2904/5798] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:19 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1169 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:20.145823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-c251885b-5b21-45f9-bc58-bdac45843eb9 req-4016767c-be27-40f3-a2d1-5cacfede79cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03cbfc38-ff65-428a-8878-f4d84e4c458b", "name": "network-vif-deleted", "tag": "79990b04-6845-4fc0-9bbe-73275c78b5cf"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:06:20.155174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-c251885b-5b21-45f9-bc58-bdac45843eb9 req-4016767c-be27-40f3-a2d1-5cacfede79cd service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:20.155950 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-c251885b-5b21-45f9-bc58-bdac45843eb9 req-4016767c-be27-40f3-a2d1-5cacfede79cd service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:20.170084 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-c251885b-5b21-45f9-bc58-bdac45843eb9 req-4016767c-be27-40f3-a2d1-5cacfede79cd service nova] Creating event network-vif-deleted:79990b04-6845-4fc0-9bbe-73275c78b5cf for instance 03cbfc38-ff65-428a-8878-f4d84e4c458b on n-h2-847009-3 Jul 19 23:06:20.185517 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-c251885b-5b21-45f9-bc58-bdac45843eb9 req-4016767c-be27-40f3-a2d1-5cacfede79cd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041928 Jul 19 23:06:20.189286 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2905/5799] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:06:20.249563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0d847eca-7aac-4f66-a277-891e60660af1 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5468100cc4304cc5a91e97e51c8e7b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815c2caf32104f1bb83a458a4dad32d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:20.261432 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0d847eca-7aac-4f66-a277-891e60660af1 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] 10.222.0.25 "GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b" status: 200 len: 1462 microversion: 2.1 time: 0.237213 Jul 19 23:06:20.265494 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2895/5800] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:20 2022] GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b => generated 1462 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:20.336269 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=8 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:06:20.342049 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a23c3dd0-5411-40e6-a5f7-c1556c0a775e tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Action: 'create', calling method: .version_select at 0x7f7a032a2e50>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-704409885", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxaX4YXB8dvXUeLPQOlZpe9wV7405kwitqK0/P/u1O2afhFzsL90sQ/NTlL8O6ptgF8Mql6win9lX6GbUeqdM1dP159a7cNliiBhN+Tod9yL2hQ3NwFE046JqJam8Ph1A=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:06:20.381815 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-a23c3dd0-5411-40e6-a5f7-c1556c0a775e tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Getting quotas for project 9370b564007740c4a619273e03c78dca. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:06:20.392618 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-a23c3dd0-5411-40e6-a5f7-c1556c0a775e tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Getting quotas for user ea2ea35da78245bfaf9651d7afb5fe66 and project 9370b564007740c4a619273e03c78dca. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:06:20.446418 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a23c3dd0-5411-40e6-a5f7-c1556c0a775e tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.112082 Jul 19 23:06:20.447504 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2906/5801] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 23:06:20 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:06:21.152033 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9b747027-77a1-4bd6-89d7-51e7c62bce13 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:21.152880 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9b747027-77a1-4bd6-89d7-51e7c62bce13 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:21.163666 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b747027-77a1-4bd6-89d7-51e7c62bce13 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:21.164464 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b747027-77a1-4bd6-89d7-51e7c62bce13 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:21.165867 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b747027-77a1-4bd6-89d7-51e7c62bce13 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:21.166495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b747027-77a1-4bd6-89d7-51e7c62bce13 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:21.185206 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:06:21.299792 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4ec915d1-2bec-46e9-8fee-996bf7aa7e95 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:21.300552 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4ec915d1-2bec-46e9-8fee-996bf7aa7e95 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] [instance: 03cbfc38-ff65-428a-8878-f4d84e4c458b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:21.334451 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ec915d1-2bec-46e9-8fee-996bf7aa7e95 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:21.335240 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ec915d1-2bec-46e9-8fee-996bf7aa7e95 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:21.336187 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ec915d1-2bec-46e9-8fee-996bf7aa7e95 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:21.337452 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ec915d1-2bec-46e9-8fee-996bf7aa7e95 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:21.364076 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-4ec915d1-2bec-46e9-8fee-996bf7aa7e95 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] HTTP exception thrown: Instance 03cbfc38-ff65-428a-8878-f4d84e4c458b could not be found. Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4ec915d1-2bec-46e9-8fee-996bf7aa7e95 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Request method failure captured: Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b HTTP/1.1 Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zjSHVsMU5qY4mDrSDwzEPTE3ohpMIo1hSX7aZ3TIqg7BpZ6BR_BP4TVDewOfYCwgyvhvWtFy-w_H-wecboSK-RSHQGhQ2VjFRumer9zuxK3i4-MxF1QBzkKCNDYXU5f5clSbRraKwpEMtt8qW33Cz0beddNDtLI3cTcbL9RckWDzG0 Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 815c2caf32104f1bb83a458a4dad32d6 Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-VolumesActionsTest-1012996944 Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_815c2caf32104f1bb83a458a4dad32d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/815c2caf32104f1bb83a458a4dad32d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/815c2caf32104f1bb83a458a4dad32d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/815c2caf32104f1bb83a458a4dad32d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-VolumesActionsTest-1012996944 Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 815c2caf32104f1bb83a458a4dad32d6 Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-VolumesActionsTest-1012996944 Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-VolumesActionsTest-1012996944-project Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 5468100cc4304cc5a91e97e51c8e7b3b Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-VolumesActionsTest-1012996944-project Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 03cbfc38-ff65-428a-8878-f4d84e4c458b could not be found. Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '03cbfc38-ff65-428a-8878-f4d84e4c458b'} Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03cbfc38-ff65-428a-8878-f4d84e4c458b could not be found. Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03cbfc38-ff65-428a-8878-f4d84e4c458b could not be found. Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:06:21.366407 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:06:21.370007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:06:21.370007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:06:21.370007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:06:21.370007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:06:21.370007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:06:21.370007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03cbfc38-ff65-428a-8878-f4d84e4c458b could not be found. Jul 19 23:06:21.370007 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:06:21.378874 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4ec915d1-2bec-46e9-8fee-996bf7aa7e95 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] Returning 404 to user: Instance 03cbfc38-ff65-428a-8878-f4d84e4c458b could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:06:21.380872 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4ec915d1-2bec-46e9-8fee-996bf7aa7e95 tempest-VolumesActionsTest-1012996944 tempest-VolumesActionsTest-1012996944-project] 10.222.0.25 "GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b" status: 404 len: 111 microversion: 2.1 time: 0.087484 Jul 19 23:06:21.389336 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2907/5802] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:21 2022] GET /compute/v2.1/servers/03cbfc38-ff65-428a-8878-f4d84e4c458b => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 23:06:21.748881 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9b747027-77a1-4bd6-89d7-51e7c62bce13 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:21.807999 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9b747027-77a1-4bd6-89d7-51e7c62bce13 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1169 microversion: 2.1 time: 0.665470 Jul 19 23:06:21.812707 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2896/5803] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:21 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1169 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:22.837945 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-652d80b8-67e3-48d6-bfdd-8e46e4ad776a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:22.839254 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-652d80b8-67e3-48d6-bfdd-8e46e4ad776a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:22.847664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-652d80b8-67e3-48d6-bfdd-8e46e4ad776a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:22.848316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-652d80b8-67e3-48d6-bfdd-8e46e4ad776a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:22.849418 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-652d80b8-67e3-48d6-bfdd-8e46e4ad776a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:22.850072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-652d80b8-67e3-48d6-bfdd-8e46e4ad776a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:23.132123 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-652d80b8-67e3-48d6-bfdd-8e46e4ad776a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:23.140703 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-652d80b8-67e3-48d6-bfdd-8e46e4ad776a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1169 microversion: 2.1 time: 0.309716 Jul 19 23:06:23.143057 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2908/5804] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:22 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1169 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:23.580160 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a052c529-2b6b-4ae0-ba24-32daca65eeaf tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1848010879", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "44ed8c2d-4a60-435c-a700-aba717de9b6c"}], "key_name": "tempest-TestNetworkBasicOps-704409885", "security_groups": [{"name": "tempest-secgroup-smoke-1824784871"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:06:23.902911 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-a052c529-2b6b-4ae0-ba24-32daca65eeaf tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] validate_networks() for [('44ed8c2d-4a60-435c-a700-aba717de9b6c', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:06:24.179192 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5a3ca93e-0e6b-486c-9fdb-3e196e3e9207 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:24.179843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5a3ca93e-0e6b-486c-9fdb-3e196e3e9207 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:24.206646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a3ca93e-0e6b-486c-9fdb-3e196e3e9207 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:24.207131 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a3ca93e-0e6b-486c-9fdb-3e196e3e9207 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:24.216486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a3ca93e-0e6b-486c-9fdb-3e196e3e9207 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:24.216951 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a3ca93e-0e6b-486c-9fdb-3e196e3e9207 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:24.694425 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5a3ca93e-0e6b-486c-9fdb-3e196e3e9207 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:24.714657 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5a3ca93e-0e6b-486c-9fdb-3e196e3e9207 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1169 microversion: 2.1 time: 0.541265 Jul 19 23:06:24.731290 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2909/5805] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:24 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1169 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:24.978910 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-a052c529-2b6b-4ae0-ba24-32daca65eeaf tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:06:24.980090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-a052c529-2b6b-4ae0-ba24-32daca65eeaf tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:06:24.980815 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-a052c529-2b6b-4ae0-ba24-32daca65eeaf tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:06:24.981444 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-a052c529-2b6b-4ae0-ba24-32daca65eeaf tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:06:24.982116 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-a052c529-2b6b-4ae0-ba24-32daca65eeaf tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:06:25.010238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a052c529-2b6b-4ae0-ba24-32daca65eeaf tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:25.011149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a052c529-2b6b-4ae0-ba24-32daca65eeaf tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:25.012204 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a052c529-2b6b-4ae0-ba24-32daca65eeaf tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:25.013856 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a052c529-2b6b-4ae0-ba24-32daca65eeaf tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:25.079671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-a052c529-2b6b-4ae0-ba24-32daca65eeaf tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Getting quotas for project 9370b564007740c4a619273e03c78dca. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:06:25.088898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-a052c529-2b6b-4ae0-ba24-32daca65eeaf tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Getting quotas for user ea2ea35da78245bfaf9651d7afb5fe66 and project 9370b564007740c4a619273e03c78dca. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:06:25.113991 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a052c529-2b6b-4ae0-ba24-32daca65eeaf tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:06:25.116466 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a052c529-2b6b-4ae0-ba24-32daca65eeaf tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: ea84b044-26fc-44f4-b9c9-83ee0d423b6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:06:25.229981 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a052c529-2b6b-4ae0-ba24-32daca65eeaf tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.655014 Jul 19 23:06:25.248804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8983dd3c-9a9f-4869-a2fa-950126686495 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:25.256588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8983dd3c-9a9f-4869-a2fa-950126686495 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: ea84b044-26fc-44f4-b9c9-83ee0d423b6d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:25.262023 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2897/5806] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:06:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:06:25.409241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8983dd3c-9a9f-4869-a2fa-950126686495 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:25.426033 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8983dd3c-9a9f-4869-a2fa-950126686495 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d" status: 200 len: 1248 microversion: 2.1 time: 0.184004 Jul 19 23:06:25.444448 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2910/5807] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:25 2022] GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d => generated 1248 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:06:25.751234 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-71c57826-86d8-40cf-9649-79420b00c244 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:25.754485 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-71c57826-86d8-40cf-9649-79420b00c244 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:25.780748 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71c57826-86d8-40cf-9649-79420b00c244 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:25.782981 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71c57826-86d8-40cf-9649-79420b00c244 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:25.783907 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71c57826-86d8-40cf-9649-79420b00c244 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:25.784369 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71c57826-86d8-40cf-9649-79420b00c244 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:26.152079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-71c57826-86d8-40cf-9649-79420b00c244 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:26.163950 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-71c57826-86d8-40cf-9649-79420b00c244 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1169 microversion: 2.1 time: 0.419793 Jul 19 23:06:26.175361 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2898/5808] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:25 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1169 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:26.462655 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1d4b3c11-677a-4d4d-8ad8-563602296dd2 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:26.463916 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1d4b3c11-677a-4d4d-8ad8-563602296dd2 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: ea84b044-26fc-44f4-b9c9-83ee0d423b6d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:26.492223 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d4b3c11-677a-4d4d-8ad8-563602296dd2 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:26.497515 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d4b3c11-677a-4d4d-8ad8-563602296dd2 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:26.503785 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d4b3c11-677a-4d4d-8ad8-563602296dd2 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:26.504391 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d4b3c11-677a-4d4d-8ad8-563602296dd2 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:26.682283 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1d4b3c11-677a-4d4d-8ad8-563602296dd2 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:26.695352 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1d4b3c11-677a-4d4d-8ad8-563602296dd2 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d" status: 200 len: 1244 microversion: 2.1 time: 0.246217 Jul 19 23:06:26.698130 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2911/5809] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:26 2022] GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d => generated 1244 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:27.182704 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c7db0ced-70ee-4231-9b08-799f65fb6d32 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:27.190351 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c7db0ced-70ee-4231-9b08-799f65fb6d32 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:27.211477 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7db0ced-70ee-4231-9b08-799f65fb6d32 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:27.216257 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7db0ced-70ee-4231-9b08-799f65fb6d32 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:27.221393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7db0ced-70ee-4231-9b08-799f65fb6d32 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:27.224581 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7db0ced-70ee-4231-9b08-799f65fb6d32 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:27.453759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c7db0ced-70ee-4231-9b08-799f65fb6d32 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:27.464192 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c7db0ced-70ee-4231-9b08-799f65fb6d32 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1169 microversion: 2.1 time: 0.284575 Jul 19 23:06:27.475284 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2899/5810] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:27 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1169 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:06:27.574096 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9c4465a6-d45d-45da-8308-59bf295a9a15 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:27.580789 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9c4465a6-d45d-45da-8308-59bf295a9a15 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:27.603095 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9c4465a6-d45d-45da-8308-59bf295a9a15 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:27.603671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9c4465a6-d45d-45da-8308-59bf295a9a15 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:27.604633 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9c4465a6-d45d-45da-8308-59bf295a9a15 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:27.605290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9c4465a6-d45d-45da-8308-59bf295a9a15 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:27.638137 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9c4465a6-d45d-45da-8308-59bf295a9a15 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd/ips" status: 200 len: 144 microversion: 2.1 time: 0.086076 Jul 19 23:06:27.638743 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2912/5811] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 19 23:06:27 2022] GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd/ips => generated 144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:06:27.715291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0f554a77-8292-4bc2-88d1-10bfd94d4316 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:27.716075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0f554a77-8292-4bc2-88d1-10bfd94d4316 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: ea84b044-26fc-44f4-b9c9-83ee0d423b6d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:27.728339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0f554a77-8292-4bc2-88d1-10bfd94d4316 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:27.729156 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0f554a77-8292-4bc2-88d1-10bfd94d4316 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:27.730312 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0f554a77-8292-4bc2-88d1-10bfd94d4316 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:27.731474 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0f554a77-8292-4bc2-88d1-10bfd94d4316 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:27.818364 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0f554a77-8292-4bc2-88d1-10bfd94d4316 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:27.830105 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0f554a77-8292-4bc2-88d1-10bfd94d4316 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d" status: 200 len: 1306 microversion: 2.1 time: 0.120038 Jul 19 23:06:27.840718 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2900/5812] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:27 2022] GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d => generated 1306 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:28.482552 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-aa8b2679-0a2a-4f16-bfe6-77c6c3b5c1a7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:28.483483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-aa8b2679-0a2a-4f16-bfe6-77c6c3b5c1a7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:28.495554 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa8b2679-0a2a-4f16-bfe6-77c6c3b5c1a7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:28.496062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa8b2679-0a2a-4f16-bfe6-77c6c3b5c1a7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:28.498032 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa8b2679-0a2a-4f16-bfe6-77c6c3b5c1a7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:28.498661 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa8b2679-0a2a-4f16-bfe6-77c6c3b5c1a7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:28.849631 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e984b28b-c7f8-4a16-be41-5bad21802cc1 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:28.850255 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e984b28b-c7f8-4a16-be41-5bad21802cc1 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: ea84b044-26fc-44f4-b9c9-83ee0d423b6d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:28.862505 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e984b28b-c7f8-4a16-be41-5bad21802cc1 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:28.865556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e984b28b-c7f8-4a16-be41-5bad21802cc1 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:28.866610 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e984b28b-c7f8-4a16-be41-5bad21802cc1 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:28.869647 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e984b28b-c7f8-4a16-be41-5bad21802cc1 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:29.124899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-aa8b2679-0a2a-4f16-bfe6-77c6c3b5c1a7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:29.132928 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-aa8b2679-0a2a-4f16-bfe6-77c6c3b5c1a7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1169 microversion: 2.1 time: 0.654536 Jul 19 23:06:29.148757 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2913/5813] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:28 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1169 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:29.235214 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e984b28b-c7f8-4a16-be41-5bad21802cc1 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:29.257154 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e984b28b-c7f8-4a16-be41-5bad21802cc1 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d" status: 200 len: 1374 microversion: 2.1 time: 0.400924 Jul 19 23:06:29.258606 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2901/5814] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:28 2022] GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d => generated 1374 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:06:30.018733 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-714681af-bcd3-467b-9c6d-dea233f20f42 req-2d633661-d6ed-40bf-9d76-b8704e14c27a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea84b044-26fc-44f4-b9c9-83ee0d423b6d", "tag": "cf26a901-fe9c-44fc-83c7-a53085ac0210"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:06:30.047139 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-714681af-bcd3-467b-9c6d-dea233f20f42 req-2d633661-d6ed-40bf-9d76-b8704e14c27a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:30.061020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-714681af-bcd3-467b-9c6d-dea233f20f42 req-2d633661-d6ed-40bf-9d76-b8704e14c27a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:30.095820 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=90 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:06:30.107625 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-714681af-bcd3-467b-9c6d-dea233f20f42 req-2d633661-d6ed-40bf-9d76-b8704e14c27a service nova] Creating event network-changed:cf26a901-fe9c-44fc-83c7-a53085ac0210 for instance ea84b044-26fc-44f4-b9c9-83ee0d423b6d on n-h2-847009-3 Jul 19 23:06:30.134774 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-714681af-bcd3-467b-9c6d-dea233f20f42 req-2d633661-d6ed-40bf-9d76-b8704e14c27a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109603 Jul 19 23:06:30.136737 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2914/5815] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:06:30.169599 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fae5ef99-9048-4514-b7b0-45a8234d9374 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:30.171155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fae5ef99-9048-4514-b7b0-45a8234d9374 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:30.202508 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fae5ef99-9048-4514-b7b0-45a8234d9374 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:30.205559 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fae5ef99-9048-4514-b7b0-45a8234d9374 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:30.207715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fae5ef99-9048-4514-b7b0-45a8234d9374 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:30.208405 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fae5ef99-9048-4514-b7b0-45a8234d9374 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:30.277853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e0212158-7c18-4571-826b-883616811bb6 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:30.278674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e0212158-7c18-4571-826b-883616811bb6 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: ea84b044-26fc-44f4-b9c9-83ee0d423b6d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:30.299076 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0212158-7c18-4571-826b-883616811bb6 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:30.299724 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0212158-7c18-4571-826b-883616811bb6 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:30.300633 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0212158-7c18-4571-826b-883616811bb6 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:30.305751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0212158-7c18-4571-826b-883616811bb6 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:30.677522 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fae5ef99-9048-4514-b7b0-45a8234d9374 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:30.693020 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fae5ef99-9048-4514-b7b0-45a8234d9374 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1169 microversion: 2.1 time: 0.530628 Jul 19 23:06:30.702693 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2902/5816] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:30 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1169 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:30.707975 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cd6db858-5ff6-4c0d-b3d0-bb7ff118bcc2 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51b9775a-d9a9-4c9f-a908-a2ae7d6d0459"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:06:30.709141 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cd6db858-5ff6-4c0d-b3d0-bb7ff118bcc2 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:30.722353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd6db858-5ff6-4c0d-b3d0-bb7ff118bcc2 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:30.722822 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd6db858-5ff6-4c0d-b3d0-bb7ff118bcc2 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:30.723655 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd6db858-5ff6-4c0d-b3d0-bb7ff118bcc2 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:30.724107 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd6db858-5ff6-4c0d-b3d0-bb7ff118bcc2 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:30.740981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e0212158-7c18-4571-826b-883616811bb6 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:30.772540 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e0212158-7c18-4571-826b-883616811bb6 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d" status: 200 len: 1374 microversion: 2.1 time: 0.486062 Jul 19 23:06:30.772540 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2915/5817] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:30 2022] GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d => generated 1374 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:06:31.196776 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cd6db858-5ff6-4c0d-b3d0-bb7ff118bcc2 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "POST /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.501341 Jul 19 23:06:31.197687 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2903/5818] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 19 23:06:30 2022] POST /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd/os-volume_attachments => generated 194 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:06:31.710811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fa6a8b55-3275-413b-aef3-e63beeb0f981 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:31.721594 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fa6a8b55-3275-413b-aef3-e63beeb0f981 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:31.729586 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa6a8b55-3275-413b-aef3-e63beeb0f981 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:31.730037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa6a8b55-3275-413b-aef3-e63beeb0f981 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:31.730818 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa6a8b55-3275-413b-aef3-e63beeb0f981 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:31.731672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa6a8b55-3275-413b-aef3-e63beeb0f981 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:31.784390 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2b4b7d20-8d99-4a8b-9612-bf4b3e510c84 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:31.785613 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2b4b7d20-8d99-4a8b-9612-bf4b3e510c84 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: ea84b044-26fc-44f4-b9c9-83ee0d423b6d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:31.797254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b4b7d20-8d99-4a8b-9612-bf4b3e510c84 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:31.798057 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b4b7d20-8d99-4a8b-9612-bf4b3e510c84 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:31.799855 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b4b7d20-8d99-4a8b-9612-bf4b3e510c84 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:31.800709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b4b7d20-8d99-4a8b-9612-bf4b3e510c84 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:32.400625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fa6a8b55-3275-413b-aef3-e63beeb0f981 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:32.409507 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fa6a8b55-3275-413b-aef3-e63beeb0f981 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1169 microversion: 2.1 time: 0.703307 Jul 19 23:06:32.419390 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2916/5819] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:31 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1169 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:32.422818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2b4b7d20-8d99-4a8b-9612-bf4b3e510c84 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:32.432240 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2b4b7d20-8d99-4a8b-9612-bf4b3e510c84 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d" status: 200 len: 1374 microversion: 2.1 time: 0.655813 Jul 19 23:06:32.433380 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2904/5820] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:31 2022] GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d => generated 1374 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:33.428489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f2afa137-98a2-4a8d-ae0a-07840f654a97 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:33.429120 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f2afa137-98a2-4a8d-ae0a-07840f654a97 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:33.437424 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f2afa137-98a2-4a8d-ae0a-07840f654a97 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:33.438015 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f2afa137-98a2-4a8d-ae0a-07840f654a97 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:33.439146 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f2afa137-98a2-4a8d-ae0a-07840f654a97 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:33.439753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f2afa137-98a2-4a8d-ae0a-07840f654a97 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:33.451238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fc68cad1-1167-4e51-b88c-d67a2b625c90 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:33.452725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fc68cad1-1167-4e51-b88c-d67a2b625c90 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: ea84b044-26fc-44f4-b9c9-83ee0d423b6d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:33.464331 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc68cad1-1167-4e51-b88c-d67a2b625c90 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:33.469747 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc68cad1-1167-4e51-b88c-d67a2b625c90 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:33.470682 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc68cad1-1167-4e51-b88c-d67a2b625c90 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:33.471334 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc68cad1-1167-4e51-b88c-d67a2b625c90 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:33.685319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fc68cad1-1167-4e51-b88c-d67a2b625c90 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:33.689603 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f2afa137-98a2-4a8d-ae0a-07840f654a97 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:33.696814 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fc68cad1-1167-4e51-b88c-d67a2b625c90 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d" status: 200 len: 1374 microversion: 2.1 time: 0.250101 Jul 19 23:06:33.697883 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2905/5821] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:33 2022] GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d => generated 1374 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:33.699918 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f2afa137-98a2-4a8d-ae0a-07840f654a97 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1169 microversion: 2.1 time: 0.277139 Jul 19 23:06:33.700790 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2917/5822] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:33 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1169 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:34.715213 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8cd9dc85-28aa-4c1b-938f-38c902f1369b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:34.716500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8cd9dc85-28aa-4c1b-938f-38c902f1369b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: ea84b044-26fc-44f4-b9c9-83ee0d423b6d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:34.719026 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2e95fe53-8532-41c5-9190-9c460c89a2a5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:34.719704 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2e95fe53-8532-41c5-9190-9c460c89a2a5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:34.726254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8cd9dc85-28aa-4c1b-938f-38c902f1369b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:34.727247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8cd9dc85-28aa-4c1b-938f-38c902f1369b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:34.728109 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8cd9dc85-28aa-4c1b-938f-38c902f1369b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:34.728517 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8cd9dc85-28aa-4c1b-938f-38c902f1369b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:34.729942 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e95fe53-8532-41c5-9190-9c460c89a2a5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:34.730405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e95fe53-8532-41c5-9190-9c460c89a2a5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:34.731959 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e95fe53-8532-41c5-9190-9c460c89a2a5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:34.732478 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e95fe53-8532-41c5-9190-9c460c89a2a5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:34.981440 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8cd9dc85-28aa-4c1b-938f-38c902f1369b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:34.985978 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2e95fe53-8532-41c5-9190-9c460c89a2a5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:34.991249 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8cd9dc85-28aa-4c1b-938f-38c902f1369b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d" status: 200 len: 1374 microversion: 2.1 time: 0.280675 Jul 19 23:06:34.996153 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2906/5823] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:34 2022] GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d => generated 1374 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:34.998930 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2e95fe53-8532-41c5-9190-9c460c89a2a5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1169 microversion: 2.1 time: 0.283925 Jul 19 23:06:35.000340 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2918/5824] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:34 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1169 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:06:36.022662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b40e8598-6277-4094-991a-b1e191dc1400 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:36.023578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ebf5391c-71ad-4224-a41a-f488256303cd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:36.025708 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b40e8598-6277-4094-991a-b1e191dc1400 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: ea84b044-26fc-44f4-b9c9-83ee0d423b6d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:36.026117 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ebf5391c-71ad-4224-a41a-f488256303cd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:36.032078 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:06:36.037354 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:06:36.038314 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:06:36.056149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ebf5391c-71ad-4224-a41a-f488256303cd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:36.057855 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ebf5391c-71ad-4224-a41a-f488256303cd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:36.061052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b40e8598-6277-4094-991a-b1e191dc1400 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:36.061334 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ebf5391c-71ad-4224-a41a-f488256303cd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:36.062986 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b40e8598-6277-4094-991a-b1e191dc1400 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:36.063315 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ebf5391c-71ad-4224-a41a-f488256303cd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:36.064573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b40e8598-6277-4094-991a-b1e191dc1400 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:36.066328 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b40e8598-6277-4094-991a-b1e191dc1400 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:36.298319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b40e8598-6277-4094-991a-b1e191dc1400 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:36.300362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ebf5391c-71ad-4224-a41a-f488256303cd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:36.308173 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ebf5391c-71ad-4224-a41a-f488256303cd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1169 microversion: 2.1 time: 0.295678 Jul 19 23:06:36.310954 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b40e8598-6277-4094-991a-b1e191dc1400 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d" status: 200 len: 1374 microversion: 2.1 time: 0.302706 Jul 19 23:06:36.312453 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2907/5825] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:36 2022] GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d => generated 1374 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:36.317677 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2919/5826] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:36 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1169 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:36.318669 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-dc5fd263-dc14-4a3b-af1c-55d33c64e51c req-93367601-491c-4c8d-9545-8f40ebef6760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea84b044-26fc-44f4-b9c9-83ee0d423b6d", "name": "network-vif-plugged", "status": "completed", "tag": "cf26a901-fe9c-44fc-83c7-a53085ac0210"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:06:36.328772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-dc5fd263-dc14-4a3b-af1c-55d33c64e51c req-93367601-491c-4c8d-9545-8f40ebef6760 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:36.329323 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-dc5fd263-dc14-4a3b-af1c-55d33c64e51c req-93367601-491c-4c8d-9545-8f40ebef6760 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:36.342086 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-dc5fd263-dc14-4a3b-af1c-55d33c64e51c req-93367601-491c-4c8d-9545-8f40ebef6760 service nova] Creating event network-vif-plugged:cf26a901-fe9c-44fc-83c7-a53085ac0210 for instance ea84b044-26fc-44f4-b9c9-83ee0d423b6d on n-h2-847009-3 Jul 19 23:06:36.347968 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-dc5fd263-dc14-4a3b-af1c-55d33c64e51c req-93367601-491c-4c8d-9545-8f40ebef6760 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034083 Jul 19 23:06:36.349045 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2908/5827] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:06:37.329259 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9a7b52ec-7c6c-447c-b597-e28628aecaa5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:37.329829 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-587e2134-0c5b-431e-8bae-612d58f79acf tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:37.330499 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-587e2134-0c5b-431e-8bae-612d58f79acf tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: ea84b044-26fc-44f4-b9c9-83ee0d423b6d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:37.331349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9a7b52ec-7c6c-447c-b597-e28628aecaa5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:37.338824 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9a7b52ec-7c6c-447c-b597-e28628aecaa5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:37.339523 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9a7b52ec-7c6c-447c-b597-e28628aecaa5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:37.340490 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-587e2134-0c5b-431e-8bae-612d58f79acf tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:37.340775 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9a7b52ec-7c6c-447c-b597-e28628aecaa5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:37.341236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-587e2134-0c5b-431e-8bae-612d58f79acf tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:37.341561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9a7b52ec-7c6c-447c-b597-e28628aecaa5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:37.342516 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-587e2134-0c5b-431e-8bae-612d58f79acf tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:37.343229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-587e2134-0c5b-431e-8bae-612d58f79acf tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:37.686056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9a7b52ec-7c6c-447c-b597-e28628aecaa5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:37.702474 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9a7b52ec-7c6c-447c-b597-e28628aecaa5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1215 microversion: 2.1 time: 0.380393 Jul 19 23:06:37.707875 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2920/5828] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:37 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1215 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:37.711439 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-587e2134-0c5b-431e-8bae-612d58f79acf tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:37.729543 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-587e2134-0c5b-431e-8bae-612d58f79acf tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d" status: 200 len: 1374 microversion: 2.1 time: 0.405101 Jul 19 23:06:37.741047 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2909/5829] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:37 2022] GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d => generated 1374 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:38.723940 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6de8dd93-b87e-4313-8cbd-264e12e2a984 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:38.725053 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6de8dd93-b87e-4313-8cbd-264e12e2a984 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:38.730852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:06:38.739573 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6de8dd93-b87e-4313-8cbd-264e12e2a984 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:38.740251 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6de8dd93-b87e-4313-8cbd-264e12e2a984 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:38.742867 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6de8dd93-b87e-4313-8cbd-264e12e2a984 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:38.743509 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6de8dd93-b87e-4313-8cbd-264e12e2a984 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:38.748096 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-06b087e9-febc-48af-a50f-fab93aad3dff tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:38.749413 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-06b087e9-febc-48af-a50f-fab93aad3dff tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: ea84b044-26fc-44f4-b9c9-83ee0d423b6d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:38.756770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-06b087e9-febc-48af-a50f-fab93aad3dff tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:38.757450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-06b087e9-febc-48af-a50f-fab93aad3dff tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:38.758447 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-06b087e9-febc-48af-a50f-fab93aad3dff tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:38.759045 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-06b087e9-febc-48af-a50f-fab93aad3dff tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:39.025192 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-06b087e9-febc-48af-a50f-fab93aad3dff tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:39.034395 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-06b087e9-febc-48af-a50f-fab93aad3dff tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d" status: 200 len: 1547 microversion: 2.1 time: 0.290013 Jul 19 23:06:39.035790 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2910/5830] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:38 2022] GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d => generated 1547 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:39.053932 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aa9500eb-28c9-47ad-bec3-1e89c64c9ce3 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:39.055579 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-aa9500eb-28c9-47ad-bec3-1e89c64c9ce3 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: ea84b044-26fc-44f4-b9c9-83ee0d423b6d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:39.065757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6de8dd93-b87e-4313-8cbd-264e12e2a984 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:39.066406 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa9500eb-28c9-47ad-bec3-1e89c64c9ce3 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:39.067226 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa9500eb-28c9-47ad-bec3-1e89c64c9ce3 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:39.071411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa9500eb-28c9-47ad-bec3-1e89c64c9ce3 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:39.072261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa9500eb-28c9-47ad-bec3-1e89c64c9ce3 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:39.085826 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6de8dd93-b87e-4313-8cbd-264e12e2a984 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1203 microversion: 2.1 time: 0.365667 Jul 19 23:06:39.096144 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2921/5831] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:38 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1203 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:39.290519 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-aa9500eb-28c9-47ad-bec3-1e89c64c9ce3 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:39.300911 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-aa9500eb-28c9-47ad-bec3-1e89c64c9ce3 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d" status: 200 len: 1547 microversion: 2.1 time: 0.251283 Jul 19 23:06:39.301852 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2911/5832] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:39 2022] GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d => generated 1547 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:06:40.103591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-efc964b4-e822-4eb7-bc2d-27e93a52af9f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:40.104257 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-efc964b4-e822-4eb7-bc2d-27e93a52af9f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:40.113628 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-efc964b4-e822-4eb7-bc2d-27e93a52af9f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:40.115206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-efc964b4-e822-4eb7-bc2d-27e93a52af9f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:40.116114 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-efc964b4-e822-4eb7-bc2d-27e93a52af9f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:40.116672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-efc964b4-e822-4eb7-bc2d-27e93a52af9f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:40.283920 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-efc964b4-e822-4eb7-bc2d-27e93a52af9f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:40.298947 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-efc964b4-e822-4eb7-bc2d-27e93a52af9f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1203 microversion: 2.1 time: 0.198864 Jul 19 23:06:40.308961 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2922/5833] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:40 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1203 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:40.631084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c93e7ba2-a1da-4e94-aa1d-37e7dd4ca2f6 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:40.631880 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c93e7ba2-a1da-4e94-aa1d-37e7dd4ca2f6 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] [instance: a67f292a-5ce0-471c-aecc-eaf4217389e9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:40.639404 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c93e7ba2-a1da-4e94-aa1d-37e7dd4ca2f6 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:40.640121 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c93e7ba2-a1da-4e94-aa1d-37e7dd4ca2f6 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:40.640936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c93e7ba2-a1da-4e94-aa1d-37e7dd4ca2f6 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:40.641385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c93e7ba2-a1da-4e94-aa1d-37e7dd4ca2f6 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:40.672376 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c93e7ba2-a1da-4e94-aa1d-37e7dd4ca2f6 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] [instance: a67f292a-5ce0-471c-aecc-eaf4217389e9] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:06:40.675430 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:06:40.757698 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c93e7ba2-a1da-4e94-aa1d-37e7dd4ca2f6 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9" status: 204 len: 0 microversion: 2.1 time: 0.331268 Jul 19 23:06:40.761385 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2912/5834] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:06:40 2022] DELETE /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:06:40.769262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a04dd3d3-8928-4b51-ac6c-1839ccf53cb8 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:40.770316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a04dd3d3-8928-4b51-ac6c-1839ccf53cb8 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] [instance: a67f292a-5ce0-471c-aecc-eaf4217389e9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:40.786611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a04dd3d3-8928-4b51-ac6c-1839ccf53cb8 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:40.787667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a04dd3d3-8928-4b51-ac6c-1839ccf53cb8 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:40.788868 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a04dd3d3-8928-4b51-ac6c-1839ccf53cb8 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:40.789542 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a04dd3d3-8928-4b51-ac6c-1839ccf53cb8 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:41.050830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a04dd3d3-8928-4b51-ac6c-1839ccf53cb8 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423460ee1b64eb3bcd8749db6dd42d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c39c18707544d2bb4109d95f1833f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:41.059311 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a04dd3d3-8928-4b51-ac6c-1839ccf53cb8 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] 10.222.0.25 "GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9" status: 200 len: 1729 microversion: 2.1 time: 0.296281 Jul 19 23:06:41.070049 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2923/5835] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:40 2022] GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9 => generated 1729 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:41.324924 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d7b5e152-f9df-4e90-9707-b426a6529120 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:41.325739 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d7b5e152-f9df-4e90-9707-b426a6529120 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:41.334833 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7b5e152-f9df-4e90-9707-b426a6529120 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:41.337015 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7b5e152-f9df-4e90-9707-b426a6529120 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:41.337860 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7b5e152-f9df-4e90-9707-b426a6529120 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:41.338305 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7b5e152-f9df-4e90-9707-b426a6529120 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:41.544292 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d7b5e152-f9df-4e90-9707-b426a6529120 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:41.554692 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d7b5e152-f9df-4e90-9707-b426a6529120 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1203 microversion: 2.1 time: 0.233805 Jul 19 23:06:41.556060 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2913/5836] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:41 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1203 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:42.077987 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e9c2100f-27c7-4933-8ff9-b5d602daefc9 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:42.078550 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e9c2100f-27c7-4933-8ff9-b5d602daefc9 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] [instance: a67f292a-5ce0-471c-aecc-eaf4217389e9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:42.085682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e9c2100f-27c7-4933-8ff9-b5d602daefc9 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:42.086362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e9c2100f-27c7-4933-8ff9-b5d602daefc9 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:42.087573 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e9c2100f-27c7-4933-8ff9-b5d602daefc9 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:42.088172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e9c2100f-27c7-4933-8ff9-b5d602daefc9 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:42.299151 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e9c2100f-27c7-4933-8ff9-b5d602daefc9 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423460ee1b64eb3bcd8749db6dd42d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c39c18707544d2bb4109d95f1833f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:42.312115 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e9c2100f-27c7-4933-8ff9-b5d602daefc9 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] 10.222.0.25 "GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9" status: 200 len: 1729 microversion: 2.1 time: 0.235720 Jul 19 23:06:42.322468 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2924/5837] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:42 2022] GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9 => generated 1729 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:42.595090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bf3fcad7-751c-42b5-ac41-034852b8297c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:42.595756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bf3fcad7-751c-42b5-ac41-034852b8297c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:42.652730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:06:42.663975 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bf3fcad7-751c-42b5-ac41-034852b8297c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:42.667989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bf3fcad7-751c-42b5-ac41-034852b8297c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:42.669048 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bf3fcad7-751c-42b5-ac41-034852b8297c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:42.669738 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bf3fcad7-751c-42b5-ac41-034852b8297c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:43.026196 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bf3fcad7-751c-42b5-ac41-034852b8297c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:43.035596 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bf3fcad7-751c-42b5-ac41-034852b8297c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1203 microversion: 2.1 time: 0.465318 Jul 19 23:06:43.046156 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2914/5838] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:42 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1203 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:43.329306 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0c043eb0-b040-4cbc-af34-6bf9106e70f1 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:43.330559 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0c043eb0-b040-4cbc-af34-6bf9106e70f1 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] [instance: a67f292a-5ce0-471c-aecc-eaf4217389e9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:43.344984 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c043eb0-b040-4cbc-af34-6bf9106e70f1 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:43.345683 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c043eb0-b040-4cbc-af34-6bf9106e70f1 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:43.346651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c043eb0-b040-4cbc-af34-6bf9106e70f1 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:43.347438 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c043eb0-b040-4cbc-af34-6bf9106e70f1 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:43.474793 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0c043eb0-b040-4cbc-af34-6bf9106e70f1 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423460ee1b64eb3bcd8749db6dd42d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c39c18707544d2bb4109d95f1833f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:43.489561 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0c043eb0-b040-4cbc-af34-6bf9106e70f1 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] 10.222.0.25 "GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9" status: 200 len: 1661 microversion: 2.1 time: 0.164613 Jul 19 23:06:43.503459 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2925/5839] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:43 2022] GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9 => generated 1661 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:43.993580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-0e04b284-0cbe-4188-b0f9-7cd6ce9b7789 req-cff1c7a1-11d0-45fc-a788-5f072764b804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a67f292a-5ce0-471c-aecc-eaf4217389e9", "name": "network-vif-deleted", "tag": "5cad3db1-cced-43ed-b1fe-1a0112119e1d"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:06:44.011764 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0e04b284-0cbe-4188-b0f9-7cd6ce9b7789 req-cff1c7a1-11d0-45fc-a788-5f072764b804 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:44.012654 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0e04b284-0cbe-4188-b0f9-7cd6ce9b7789 req-cff1c7a1-11d0-45fc-a788-5f072764b804 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:44.053564 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-859791bc-603d-414f-8e2e-b7f7e00fd527 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:44.055270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-859791bc-603d-414f-8e2e-b7f7e00fd527 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:44.064682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-859791bc-603d-414f-8e2e-b7f7e00fd527 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:44.065406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-859791bc-603d-414f-8e2e-b7f7e00fd527 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:44.066349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-859791bc-603d-414f-8e2e-b7f7e00fd527 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:44.071770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-859791bc-603d-414f-8e2e-b7f7e00fd527 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:44.072702 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-0e04b284-0cbe-4188-b0f9-7cd6ce9b7789 req-cff1c7a1-11d0-45fc-a788-5f072764b804 service nova] Creating event network-vif-deleted:5cad3db1-cced-43ed-b1fe-1a0112119e1d for instance a67f292a-5ce0-471c-aecc-eaf4217389e9 on n-h1-847009-3 Jul 19 23:06:44.079842 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-0e04b284-0cbe-4188-b0f9-7cd6ce9b7789 req-cff1c7a1-11d0-45fc-a788-5f072764b804 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199113 Jul 19 23:06:44.081159 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2915/5840] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:06:44.361895 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-859791bc-603d-414f-8e2e-b7f7e00fd527 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:44.375860 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-859791bc-603d-414f-8e2e-b7f7e00fd527 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1203 microversion: 2.1 time: 0.326238 Jul 19 23:06:44.377608 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2926/5841] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:44 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1203 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:44.509400 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-31aecccd-8d5c-4e88-9206-93ce52735c83 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:44.510113 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-31aecccd-8d5c-4e88-9206-93ce52735c83 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] [instance: a67f292a-5ce0-471c-aecc-eaf4217389e9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:44.520434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31aecccd-8d5c-4e88-9206-93ce52735c83 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:44.520808 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31aecccd-8d5c-4e88-9206-93ce52735c83 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:44.524643 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31aecccd-8d5c-4e88-9206-93ce52735c83 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:44.528001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31aecccd-8d5c-4e88-9206-93ce52735c83 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:44.583295 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31aecccd-8d5c-4e88-9206-93ce52735c83 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:44.584074 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31aecccd-8d5c-4e88-9206-93ce52735c83 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:44.584682 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-31aecccd-8d5c-4e88-9206-93ce52735c83 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lazy-loading 'fault' on Instance uuid a67f292a-5ce0-471c-aecc-eaf4217389e9 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:06:44.652068 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-31aecccd-8d5c-4e88-9206-93ce52735c83 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423460ee1b64eb3bcd8749db6dd42d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c39c18707544d2bb4109d95f1833f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:44.663735 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-31aecccd-8d5c-4e88-9206-93ce52735c83 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] 10.222.0.25 "GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9" status: 200 len: 1387 microversion: 2.1 time: 0.159465 Jul 19 23:06:44.665005 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2916/5842] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:44 2022] GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9 => generated 1387 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:45.394720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-63d7fead-2377-4a7d-b6b1-634373524a05 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:45.395542 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-63d7fead-2377-4a7d-b6b1-634373524a05 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:45.416014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63d7fead-2377-4a7d-b6b1-634373524a05 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:45.421172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63d7fead-2377-4a7d-b6b1-634373524a05 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:45.422208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63d7fead-2377-4a7d-b6b1-634373524a05 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:45.424005 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63d7fead-2377-4a7d-b6b1-634373524a05 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:45.677421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8b8f2ec1-c50e-4684-910e-b3bf19b3e0bb tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:45.679079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8b8f2ec1-c50e-4684-910e-b3bf19b3e0bb tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:45.697421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8b8f2ec1-c50e-4684-910e-b3bf19b3e0bb tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:45.701513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8b8f2ec1-c50e-4684-910e-b3bf19b3e0bb tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:45.702550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8b8f2ec1-c50e-4684-910e-b3bf19b3e0bb tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:45.703687 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8b8f2ec1-c50e-4684-910e-b3bf19b3e0bb tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:45.726875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-63d7fead-2377-4a7d-b6b1-634373524a05 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:45.739881 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-63d7fead-2377-4a7d-b6b1-634373524a05 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1203 microversion: 2.1 time: 0.349665 Jul 19 23:06:45.751974 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2927/5843] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:45 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1203 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:45.759728 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e384d6df-d0ee-40b3-94f6-3c9df8e5f88d tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:45.760727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e384d6df-d0ee-40b3-94f6-3c9df8e5f88d tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] [instance: a67f292a-5ce0-471c-aecc-eaf4217389e9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:45.768092 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e384d6df-d0ee-40b3-94f6-3c9df8e5f88d tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:45.768869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e384d6df-d0ee-40b3-94f6-3c9df8e5f88d tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:45.769917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e384d6df-d0ee-40b3-94f6-3c9df8e5f88d tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:45.770582 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e384d6df-d0ee-40b3-94f6-3c9df8e5f88d tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:45.777869 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8b8f2ec1-c50e-4684-910e-b3bf19b3e0bb tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105596 Jul 19 23:06:45.783828 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2917/5844] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:06:45 2022] GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:06:45.804044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c8a437fd-6a1f-4026-a373-b8a11aeba02c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:45.804955 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c8a437fd-6a1f-4026-a373-b8a11aeba02c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:45.805161 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-e384d6df-d0ee-40b3-94f6-3c9df8e5f88d tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] HTTP exception thrown: Instance a67f292a-5ce0-471c-aecc-eaf4217389e9 could not be found. Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e384d6df-d0ee-40b3-94f6-3c9df8e5f88d tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Request method failure captured: Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9 HTTP/1.1 Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zekCbXzvqJlJ20nb8j4GlQzdvlMIcmlPfY0hCRPfLECRdH8WnfeYOh0YKYBzJfyWGiZTAbocHsLrw6PU-oTNVloCaAvfrI6hvedjAouKL8GWW5egJEDUMAyerbD-hWhSF-K0_xpQR-8Qapgy5DLeQX3b9qoV6aKXCMyOfNSQspa2CE Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 2c39c18707544d2bb4109d95f1833f58 Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-TestServerBasicOps-2010894572 Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2c39c18707544d2bb4109d95f1833f58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2c39c18707544d2bb4109d95f1833f58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2c39c18707544d2bb4109d95f1833f58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2c39c18707544d2bb4109d95f1833f58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-TestServerBasicOps-2010894572 Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 2c39c18707544d2bb4109d95f1833f58 Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-TestServerBasicOps-2010894572 Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-TestServerBasicOps-2010894572-project Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: f423460ee1b64eb3bcd8749db6dd42d9 Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-TestServerBasicOps-2010894572-project Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance a67f292a-5ce0-471c-aecc-eaf4217389e9 could not be found. Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'a67f292a-5ce0-471c-aecc-eaf4217389e9'} Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a67f292a-5ce0-471c-aecc-eaf4217389e9 could not be found. Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a67f292a-5ce0-471c-aecc-eaf4217389e9 could not be found. Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:06:45.807396 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:06:45.812236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:06:45.812236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:06:45.812236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:06:45.812236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:06:45.812236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:06:45.812236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a67f292a-5ce0-471c-aecc-eaf4217389e9 could not be found. Jul 19 23:06:45.812236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:06:45.813724 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e384d6df-d0ee-40b3-94f6-3c9df8e5f88d tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Returning 404 to user: Instance a67f292a-5ce0-471c-aecc-eaf4217389e9 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:06:45.814875 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e384d6df-d0ee-40b3-94f6-3c9df8e5f88d tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] 10.222.0.25 "GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9" status: 404 len: 111 microversion: 2.1 time: 0.061453 Jul 19 23:06:45.816020 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2928/5845] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:45 2022] GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:06:45.825735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8a437fd-6a1f-4026-a373-b8a11aeba02c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:45.826384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8a437fd-6a1f-4026-a373-b8a11aeba02c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:45.834239 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8a437fd-6a1f-4026-a373-b8a11aeba02c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:45.835622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c8a437fd-6a1f-4026-a373-b8a11aeba02c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:45.915994 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c8a437fd-6a1f-4026-a373-b8a11aeba02c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd/os-volume_attachments/51b9775a-d9a9-4c9f-a908-a2ae7d6d0459" status: 200 len: 194 microversion: 2.1 time: 0.126505 Jul 19 23:06:45.925187 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2918/5846] 10.222.0.25 () {58 vars in 1412 bytes} [Tue Jul 19 23:06:45 2022] GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd/os-volume_attachments/51b9775a-d9a9-4c9f-a908-a2ae7d6d0459 => generated 194 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:06:46.759713 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5ae7eda5-664d-459e-8b6c-29b15e82229a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:46.760546 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5ae7eda5-664d-459e-8b6c-29b15e82229a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:46.815686 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ae7eda5-664d-459e-8b6c-29b15e82229a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:46.816160 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ae7eda5-664d-459e-8b6c-29b15e82229a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:46.816989 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ae7eda5-664d-459e-8b6c-29b15e82229a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:46.817427 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ae7eda5-664d-459e-8b6c-29b15e82229a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:47.143943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5ae7eda5-664d-459e-8b6c-29b15e82229a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:47.157209 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5ae7eda5-664d-459e-8b6c-29b15e82229a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1203 microversion: 2.1 time: 0.401869 Jul 19 23:06:47.158295 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2929/5847] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:46 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1203 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:47.180282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6aac58ea-6a5e-4bfc-8c0b-ec6f3a8a7759 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:47.181343 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6aac58ea-6a5e-4bfc-8c0b-ec6f3a8a7759 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] [instance: a67f292a-5ce0-471c-aecc-eaf4217389e9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:47.196113 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6aac58ea-6a5e-4bfc-8c0b-ec6f3a8a7759 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:47.196573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6aac58ea-6a5e-4bfc-8c0b-ec6f3a8a7759 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:47.208348 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6aac58ea-6a5e-4bfc-8c0b-ec6f3a8a7759 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:47.208811 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6aac58ea-6a5e-4bfc-8c0b-ec6f3a8a7759 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:47.240004 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-6aac58ea-6a5e-4bfc-8c0b-ec6f3a8a7759 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] HTTP exception thrown: Instance a67f292a-5ce0-471c-aecc-eaf4217389e9 could not be found. Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6aac58ea-6a5e-4bfc-8c0b-ec6f3a8a7759 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Request method failure captured: Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9 HTTP/1.1 Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zekCbXzvqJlJ20nb8j4GlQzdvlMIcmlPfY0hCRPfLECRdH8WnfeYOh0YKYBzJfyWGiZTAbocHsLrw6PU-oTNVloCaAvfrI6hvedjAouKL8GWW5egJEDUMAyerbD-hWhSF-K0_xpQR-8Qapgy5DLeQX3b9qoV6aKXCMyOfNSQspa2CE Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 2c39c18707544d2bb4109d95f1833f58 Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TestServerBasicOps-2010894572 Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2c39c18707544d2bb4109d95f1833f58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2c39c18707544d2bb4109d95f1833f58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2c39c18707544d2bb4109d95f1833f58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2c39c18707544d2bb4109d95f1833f58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TestServerBasicOps-2010894572 Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 2c39c18707544d2bb4109d95f1833f58 Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TestServerBasicOps-2010894572 Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TestServerBasicOps-2010894572-project Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: f423460ee1b64eb3bcd8749db6dd42d9 Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TestServerBasicOps-2010894572-project Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance a67f292a-5ce0-471c-aecc-eaf4217389e9 could not be found. Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'a67f292a-5ce0-471c-aecc-eaf4217389e9'} Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a67f292a-5ce0-471c-aecc-eaf4217389e9 could not be found. Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:06:47.243476 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a67f292a-5ce0-471c-aecc-eaf4217389e9 could not be found. Jul 19 23:06:47.246867 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:06:47.246867 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:06:47.246867 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:06:47.246867 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:06:47.246867 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:06:47.246867 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:06:47.246867 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:06:47.246867 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:06:47.246867 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a67f292a-5ce0-471c-aecc-eaf4217389e9 could not be found. Jul 19 23:06:47.246867 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:06:47.246867 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6aac58ea-6a5e-4bfc-8c0b-ec6f3a8a7759 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Returning 404 to user: Instance a67f292a-5ce0-471c-aecc-eaf4217389e9 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:06:47.246867 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6aac58ea-6a5e-4bfc-8c0b-ec6f3a8a7759 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9" status: 404 len: 111 microversion: 2.1 time: 0.071532 Jul 19 23:06:47.246867 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2919/5848] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:06:47 2022] DELETE /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:06:47.256226 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-39464e8d-d207-474a-9611-5cf893cbe5f1 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:47.257057 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-39464e8d-d207-474a-9611-5cf893cbe5f1 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] [instance: a67f292a-5ce0-471c-aecc-eaf4217389e9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:47.264571 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39464e8d-d207-474a-9611-5cf893cbe5f1 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:47.265173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39464e8d-d207-474a-9611-5cf893cbe5f1 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:47.266386 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39464e8d-d207-474a-9611-5cf893cbe5f1 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:47.266987 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39464e8d-d207-474a-9611-5cf893cbe5f1 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:47.296699 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-39464e8d-d207-474a-9611-5cf893cbe5f1 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] HTTP exception thrown: Instance a67f292a-5ce0-471c-aecc-eaf4217389e9 could not be found. Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-39464e8d-d207-474a-9611-5cf893cbe5f1 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Request method failure captured: Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9 HTTP/1.1 Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zekCbXzvqJlJ20nb8j4GlQzdvlMIcmlPfY0hCRPfLECRdH8WnfeYOh0YKYBzJfyWGiZTAbocHsLrw6PU-oTNVloCaAvfrI6hvedjAouKL8GWW5egJEDUMAyerbD-hWhSF-K0_xpQR-8Qapgy5DLeQX3b9qoV6aKXCMyOfNSQspa2CE Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 2c39c18707544d2bb4109d95f1833f58 Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-TestServerBasicOps-2010894572 Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2c39c18707544d2bb4109d95f1833f58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2c39c18707544d2bb4109d95f1833f58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2c39c18707544d2bb4109d95f1833f58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2c39c18707544d2bb4109d95f1833f58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-TestServerBasicOps-2010894572 Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 2c39c18707544d2bb4109d95f1833f58 Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-TestServerBasicOps-2010894572 Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-TestServerBasicOps-2010894572-project Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: f423460ee1b64eb3bcd8749db6dd42d9 Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-TestServerBasicOps-2010894572-project Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance a67f292a-5ce0-471c-aecc-eaf4217389e9 could not be found. Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'a67f292a-5ce0-471c-aecc-eaf4217389e9'} Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a67f292a-5ce0-471c-aecc-eaf4217389e9 could not be found. Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a67f292a-5ce0-471c-aecc-eaf4217389e9 could not be found. Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:06:47.298273 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:06:47.302351 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:06:47.302351 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:06:47.302351 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:06:47.302351 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:06:47.302351 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:06:47.302351 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a67f292a-5ce0-471c-aecc-eaf4217389e9 could not be found. Jul 19 23:06:47.302351 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:06:47.312501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-39464e8d-d207-474a-9611-5cf893cbe5f1 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Returning 404 to user: Instance a67f292a-5ce0-471c-aecc-eaf4217389e9 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:06:47.313661 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-39464e8d-d207-474a-9611-5cf893cbe5f1 tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] 10.222.0.25 "GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9" status: 404 len: 111 microversion: 2.1 time: 0.061373 Jul 19 23:06:47.317692 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2930/5849] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:47 2022] GET /compute/v2.1/servers/a67f292a-5ce0-471c-aecc-eaf4217389e9 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:06:47.649651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ae2eda8b-7f07-4585-800b-0c6df75a23ac tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] Calling method '.version_select at 0x7f7a02f151f0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:47.687005 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ae2eda8b-7f07-4585-800b-0c6df75a23ac tempest-TestServerBasicOps-2010894572 tempest-TestServerBasicOps-2010894572-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-456325726" status: 202 len: 0 microversion: 2.1 time: 0.041156 Jul 19 23:06:47.692353 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2920/5850] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 19 23:06:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-456325726 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:06:48.175633 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e89a5821-398a-4083-b246-446b7f6948fb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:48.176325 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e89a5821-398a-4083-b246-446b7f6948fb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:48.212017 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e89a5821-398a-4083-b246-446b7f6948fb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:48.212560 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e89a5821-398a-4083-b246-446b7f6948fb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:48.213300 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e89a5821-398a-4083-b246-446b7f6948fb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:48.213781 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e89a5821-398a-4083-b246-446b7f6948fb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:48.499452 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e89a5821-398a-4083-b246-446b7f6948fb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:48.509326 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e89a5821-398a-4083-b246-446b7f6948fb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1203 microversion: 2.1 time: 0.338258 Jul 19 23:06:48.510378 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2931/5851] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:48 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1203 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:48.674428 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-493ea50b-08c7-40cc-9d16-58917fd59206 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5235c416-71dc-426e-854e-208abca7906f"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:06:48.676147 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-493ea50b-08c7-40cc-9d16-58917fd59206 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:48.711246 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-493ea50b-08c7-40cc-9d16-58917fd59206 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:48.712156 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-493ea50b-08c7-40cc-9d16-58917fd59206 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:48.719473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-493ea50b-08c7-40cc-9d16-58917fd59206 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:48.720171 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-493ea50b-08c7-40cc-9d16-58917fd59206 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:49.188741 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-a498c5c5-15b1-46da-b4c3-79a5cd22efbf req-f251061b-4e8c-4891-8284-50af02ae3aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b03913b-d112-47d1-b9aa-40f1818ca186", "name": "network-vif-plugged", "status": "completed", "tag": "8e3371ce-5cf7-4cef-a48f-96c692ae1d83"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:06:49.194710 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-493ea50b-08c7-40cc-9d16-58917fd59206 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "POST /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.522045 Jul 19 23:06:49.198113 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2921/5852] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 19 23:06:48 2022] POST /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd/os-volume_attachments => generated 194 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:06:49.214209 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a498c5c5-15b1-46da-b4c3-79a5cd22efbf req-f251061b-4e8c-4891-8284-50af02ae3aba service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:49.214670 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a498c5c5-15b1-46da-b4c3-79a5cd22efbf req-f251061b-4e8c-4891-8284-50af02ae3aba service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:49.245939 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-a498c5c5-15b1-46da-b4c3-79a5cd22efbf req-f251061b-4e8c-4891-8284-50af02ae3aba service nova] Creating event network-vif-plugged:8e3371ce-5cf7-4cef-a48f-96c692ae1d83 for instance 0b03913b-d112-47d1-b9aa-40f1818ca186 on n-h1-847009-3 Jul 19 23:06:49.262786 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-a498c5c5-15b1-46da-b4c3-79a5cd22efbf req-f251061b-4e8c-4891-8284-50af02ae3aba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077662 Jul 19 23:06:49.269637 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2932/5853] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:06:49.529906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c6e14a15-c078-4e61-886c-c33dd792f568 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:49.530837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c6e14a15-c078-4e61-886c-c33dd792f568 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:49.546227 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6e14a15-c078-4e61-886c-c33dd792f568 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:49.546674 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6e14a15-c078-4e61-886c-c33dd792f568 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:49.555797 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6e14a15-c078-4e61-886c-c33dd792f568 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:49.561012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c6e14a15-c078-4e61-886c-c33dd792f568 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:49.873324 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c6e14a15-c078-4e61-886c-c33dd792f568 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:49.886256 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c6e14a15-c078-4e61-886c-c33dd792f568 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1203 microversion: 2.1 time: 0.361027 Jul 19 23:06:49.887534 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2922/5854] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:49 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1203 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:50.906450 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8b7daedc-35cd-4efe-b102-177a8da16f86 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:50.908592 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8b7daedc-35cd-4efe-b102-177a8da16f86 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:50.926861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b7daedc-35cd-4efe-b102-177a8da16f86 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:50.927372 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b7daedc-35cd-4efe-b102-177a8da16f86 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:50.928376 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b7daedc-35cd-4efe-b102-177a8da16f86 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:50.928981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b7daedc-35cd-4efe-b102-177a8da16f86 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:50.981036 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:06:51.369605 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8b7daedc-35cd-4efe-b102-177a8da16f86 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:51.401222 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8b7daedc-35cd-4efe-b102-177a8da16f86 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1203 microversion: 2.1 time: 0.500290 Jul 19 23:06:51.406434 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2933/5855] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:50 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1203 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:52.431468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b17cce8b-8306-4bfa-a9e1-0d0f8ae5e50c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:52.437428 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b17cce8b-8306-4bfa-a9e1-0d0f8ae5e50c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:52.452295 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b17cce8b-8306-4bfa-a9e1-0d0f8ae5e50c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:52.452992 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b17cce8b-8306-4bfa-a9e1-0d0f8ae5e50c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:52.455568 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b17cce8b-8306-4bfa-a9e1-0d0f8ae5e50c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:52.456703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b17cce8b-8306-4bfa-a9e1-0d0f8ae5e50c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:52.809472 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b17cce8b-8306-4bfa-a9e1-0d0f8ae5e50c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:52.820218 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b17cce8b-8306-4bfa-a9e1-0d0f8ae5e50c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1389 microversion: 2.1 time: 0.398495 Jul 19 23:06:52.826397 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2923/5856] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:52 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1389 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:52.849658 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-94e1630f-032d-4ce3-85c6-722f0ab5c6a4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:52.851175 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-94e1630f-032d-4ce3-85c6-722f0ab5c6a4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:52.859954 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-94e1630f-032d-4ce3-85c6-722f0ab5c6a4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:52.860598 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-94e1630f-032d-4ce3-85c6-722f0ab5c6a4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:52.861803 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-94e1630f-032d-4ce3-85c6-722f0ab5c6a4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:52.862398 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-94e1630f-032d-4ce3-85c6-722f0ab5c6a4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:53.229100 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-94e1630f-032d-4ce3-85c6-722f0ab5c6a4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:53.254899 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-94e1630f-032d-4ce3-85c6-722f0ab5c6a4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1389 microversion: 2.1 time: 0.417426 Jul 19 23:06:53.267143 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2934/5857] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:52 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1389 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:06:53.280844 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ed7737d6-646d-4d71-8a84-972b0aaf40ec tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:53.281935 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ed7737d6-646d-4d71-8a84-972b0aaf40ec tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:53.296914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ed7737d6-646d-4d71-8a84-972b0aaf40ec tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:53.298292 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ed7737d6-646d-4d71-8a84-972b0aaf40ec tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:53.299286 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ed7737d6-646d-4d71-8a84-972b0aaf40ec tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:53.299900 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ed7737d6-646d-4d71-8a84-972b0aaf40ec tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:53.620735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ed7737d6-646d-4d71-8a84-972b0aaf40ec tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:53.643749 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ed7737d6-646d-4d71-8a84-972b0aaf40ec tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1389 microversion: 2.1 time: 0.369358 Jul 19 23:06:53.647195 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2924/5858] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:53 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1389 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:53.791706 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-20191e8e-1e83-4071-9a7a-bf500ddf1642 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:53.792353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-20191e8e-1e83-4071-9a7a-bf500ddf1642 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:53.808823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-20191e8e-1e83-4071-9a7a-bf500ddf1642 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:53.809653 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-20191e8e-1e83-4071-9a7a-bf500ddf1642 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:53.811332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-20191e8e-1e83-4071-9a7a-bf500ddf1642 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:53.811940 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-20191e8e-1e83-4071-9a7a-bf500ddf1642 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:53.840847 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-20191e8e-1e83-4071-9a7a-bf500ddf1642 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:06:53.952579 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-20191e8e-1e83-4071-9a7a-bf500ddf1642 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 204 len: 0 microversion: 2.1 time: 0.164599 Jul 19 23:06:53.954294 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2935/5859] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:06:53 2022] DELETE /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:06:53.962003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-392595ed-23bc-4210-b803-b69bcc848c32 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:53.962874 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-392595ed-23bc-4210-b803-b69bcc848c32 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:53.970500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-392595ed-23bc-4210-b803-b69bcc848c32 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:53.971266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-392595ed-23bc-4210-b803-b69bcc848c32 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:53.972221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-392595ed-23bc-4210-b803-b69bcc848c32 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:53.972845 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-392595ed-23bc-4210-b803-b69bcc848c32 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:54.424540 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-392595ed-23bc-4210-b803-b69bcc848c32 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:54.433705 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-392595ed-23bc-4210-b803-b69bcc848c32 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1395 microversion: 2.1 time: 0.475527 Jul 19 23:06:54.438660 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2925/5860] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:53 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1395 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:55.457664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b85a4a3c-9b23-4d89-8e62-b2a75008bc8b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:55.458377 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b85a4a3c-9b23-4d89-8e62-b2a75008bc8b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:55.496817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b85a4a3c-9b23-4d89-8e62-b2a75008bc8b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:55.497920 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b85a4a3c-9b23-4d89-8e62-b2a75008bc8b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:55.503971 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b85a4a3c-9b23-4d89-8e62-b2a75008bc8b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:55.504442 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b85a4a3c-9b23-4d89-8e62-b2a75008bc8b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:56.039739 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b85a4a3c-9b23-4d89-8e62-b2a75008bc8b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:56.057229 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b85a4a3c-9b23-4d89-8e62-b2a75008bc8b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1395 microversion: 2.1 time: 0.605012 Jul 19 23:06:56.058315 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2936/5861] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:55 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1395 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:56.764333 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-b2d95275-c2cc-4803-9b21-54b7fde58a23 req-17f32765-4a66-468b-b5e4-6f53fdb144ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b03913b-d112-47d1-b9aa-40f1818ca186", "name": "network-vif-deleted", "tag": "8e3371ce-5cf7-4cef-a48f-96c692ae1d83"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:06:56.822312 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b2d95275-c2cc-4803-9b21-54b7fde58a23 req-17f32765-4a66-468b-b5e4-6f53fdb144ba service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:56.822769 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b2d95275-c2cc-4803-9b21-54b7fde58a23 req-17f32765-4a66-468b-b5e4-6f53fdb144ba service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:56.878821 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-b2d95275-c2cc-4803-9b21-54b7fde58a23 req-17f32765-4a66-468b-b5e4-6f53fdb144ba service nova] Creating event network-vif-deleted:8e3371ce-5cf7-4cef-a48f-96c692ae1d83 for instance 0b03913b-d112-47d1-b9aa-40f1818ca186 on n-h1-847009-3 Jul 19 23:06:56.898642 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-b2d95275-c2cc-4803-9b21-54b7fde58a23 req-17f32765-4a66-468b-b5e4-6f53fdb144ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145413 Jul 19 23:06:56.899311 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2926/5862] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:06:57.075996 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-05de13bc-b784-4c70-bddd-ad99dcab70d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:57.076638 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-05de13bc-b784-4c70-bddd-ad99dcab70d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:57.096357 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05de13bc-b784-4c70-bddd-ad99dcab70d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:57.096826 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05de13bc-b784-4c70-bddd-ad99dcab70d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:57.097701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05de13bc-b784-4c70-bddd-ad99dcab70d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:57.098045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05de13bc-b784-4c70-bddd-ad99dcab70d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:57.228090 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-05de13bc-b784-4c70-bddd-ad99dcab70d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:57.256594 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-05de13bc-b784-4c70-bddd-ad99dcab70d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1188 microversion: 2.1 time: 0.185055 Jul 19 23:06:57.257186 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2937/5863] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:57 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1188 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:58.275977 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-32af3738-fd55-4e75-9cd5-9eb9639d3c07 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:58.276808 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-32af3738-fd55-4e75-9cd5-9eb9639d3c07 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:58.293373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-32af3738-fd55-4e75-9cd5-9eb9639d3c07 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:58.294355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-32af3738-fd55-4e75-9cd5-9eb9639d3c07 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:58.295191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-32af3738-fd55-4e75-9cd5-9eb9639d3c07 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:58.295880 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-32af3738-fd55-4e75-9cd5-9eb9639d3c07 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:58.464601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-32af3738-fd55-4e75-9cd5-9eb9639d3c07 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:58.474897 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-32af3738-fd55-4e75-9cd5-9eb9639d3c07 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1188 microversion: 2.1 time: 0.203962 Jul 19 23:06:58.475660 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2927/5864] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:58 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1188 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:06:59.493819 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a78d242c-49c4-495f-ab6a-b465d1fe50f7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:06:59.494634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a78d242c-49c4-495f-ab6a-b465d1fe50f7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:06:59.519439 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a78d242c-49c4-495f-ab6a-b465d1fe50f7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:59.520584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a78d242c-49c4-495f-ab6a-b465d1fe50f7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:59.522295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a78d242c-49c4-495f-ab6a-b465d1fe50f7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:06:59.523544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a78d242c-49c4-495f-ab6a-b465d1fe50f7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:06:59.602286 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a78d242c-49c4-495f-ab6a-b465d1fe50f7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:06:59.612693 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a78d242c-49c4-495f-ab6a-b465d1fe50f7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1188 microversion: 2.1 time: 0.123064 Jul 19 23:06:59.622413 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2938/5865] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:06:59 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1188 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:00.630111 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-28c8959c-1462-4cdf-a0b9-0cfb03f1b2c6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:00.630728 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-28c8959c-1462-4cdf-a0b9-0cfb03f1b2c6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:00.639421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-28c8959c-1462-4cdf-a0b9-0cfb03f1b2c6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:00.639811 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-28c8959c-1462-4cdf-a0b9-0cfb03f1b2c6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:00.640620 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-28c8959c-1462-4cdf-a0b9-0cfb03f1b2c6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:00.641347 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-28c8959c-1462-4cdf-a0b9-0cfb03f1b2c6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:00.730687 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-28c8959c-1462-4cdf-a0b9-0cfb03f1b2c6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:00.741739 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-28c8959c-1462-4cdf-a0b9-0cfb03f1b2c6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1188 microversion: 2.1 time: 0.115544 Jul 19 23:07:00.751732 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2928/5866] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:00 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1188 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:01.760076 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ae35f46f-bc8c-421b-91f3-844ad60564c0 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:01.760853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ae35f46f-bc8c-421b-91f3-844ad60564c0 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:01.769625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae35f46f-bc8c-421b-91f3-844ad60564c0 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:01.770076 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae35f46f-bc8c-421b-91f3-844ad60564c0 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:01.771074 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae35f46f-bc8c-421b-91f3-844ad60564c0 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:01.771545 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae35f46f-bc8c-421b-91f3-844ad60564c0 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:01.839497 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ae35f46f-bc8c-421b-91f3-844ad60564c0 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:01.848003 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ae35f46f-bc8c-421b-91f3-844ad60564c0 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1188 microversion: 2.1 time: 0.092005 Jul 19 23:07:01.848583 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2939/5867] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:01 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1188 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:02.866175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-30be3ae0-f2c2-47bf-a0c2-b05ba3787517 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:02.869952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-30be3ae0-f2c2-47bf-a0c2-b05ba3787517 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:02.879476 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-30be3ae0-f2c2-47bf-a0c2-b05ba3787517 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:02.880192 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-30be3ae0-f2c2-47bf-a0c2-b05ba3787517 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:02.881512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-30be3ae0-f2c2-47bf-a0c2-b05ba3787517 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:02.882335 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-30be3ae0-f2c2-47bf-a0c2-b05ba3787517 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:02.889474 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:07:02.932384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-30be3ae0-f2c2-47bf-a0c2-b05ba3787517 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:02.932834 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-30be3ae0-f2c2-47bf-a0c2-b05ba3787517 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:02.933534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-30be3ae0-f2c2-47bf-a0c2-b05ba3787517 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lazy-loading 'fault' on Instance uuid 0b03913b-d112-47d1-b9aa-40f1818ca186 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:07:02.992869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-30be3ae0-f2c2-47bf-a0c2-b05ba3787517 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:03.016062 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-30be3ae0-f2c2-47bf-a0c2-b05ba3787517 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 200 len: 1193 microversion: 2.1 time: 0.152003 Jul 19 23:07:03.016803 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2929/5868] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:02 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 1193 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:04.034289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5df0431c-5c8a-4897-b4c9-e960c8ab9c36 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:04.034910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5df0431c-5c8a-4897-b4c9-e960c8ab9c36 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:04.044080 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5df0431c-5c8a-4897-b4c9-e960c8ab9c36 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:04.044766 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5df0431c-5c8a-4897-b4c9-e960c8ab9c36 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:04.045767 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5df0431c-5c8a-4897-b4c9-e960c8ab9c36 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:04.046350 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5df0431c-5c8a-4897-b4c9-e960c8ab9c36 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:04.062160 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-5df0431c-5c8a-4897-b4c9-e960c8ab9c36 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] HTTP exception thrown: Instance 0b03913b-d112-47d1-b9aa-40f1818ca186 could not be found. Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5df0431c-5c8a-4897-b4c9-e960c8ab9c36 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Request method failure captured: Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 HTTP/1.1 Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zh6YPXnZEfL25DbrOo5AahkBCmHYOrAvKJnhgzQ9JlHxbrun4XI2EwE2n1nf4tgNFUaArqBEbFq4Toj7uUUuANo7JRuxksIEPvDD1AFl7fhy2XFxh_IYAhLXnE4PI4_QoyTOcOGpDghFYkpTUUI4xKODXHZZ1_feIKHlU2SknrcKPQ Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: deeb5431c1284d02b245ff3a9dc3f4e8 Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 0b03913b-d112-47d1-b9aa-40f1818ca186 could not be found. Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '0b03913b-d112-47d1-b9aa-40f1818ca186'} Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b03913b-d112-47d1-b9aa-40f1818ca186 could not be found. Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b03913b-d112-47d1-b9aa-40f1818ca186 could not be found. Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:07:04.064206 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:07:04.068055 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:04.068055 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:07:04.068055 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:07:04.068055 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:07:04.068055 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:07:04.068055 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b03913b-d112-47d1-b9aa-40f1818ca186 could not be found. Jul 19 23:07:04.068055 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:07:04.069547 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5df0431c-5c8a-4897-b4c9-e960c8ab9c36 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Returning 404 to user: Instance 0b03913b-d112-47d1-b9aa-40f1818ca186 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:07:04.070653 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5df0431c-5c8a-4897-b4c9-e960c8ab9c36 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 404 len: 111 microversion: 2.1 time: 0.040351 Jul 19 23:07:04.071580 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2940/5869] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:04 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:07:09.576820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0dc01aff-bce6-456d-ae81-11db0f4beaa6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:09.577493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0dc01aff-bce6-456d-ae81-11db0f4beaa6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:09.596224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0dc01aff-bce6-456d-ae81-11db0f4beaa6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:09.597591 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0dc01aff-bce6-456d-ae81-11db0f4beaa6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:09.598540 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0dc01aff-bce6-456d-ae81-11db0f4beaa6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:09.600762 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0dc01aff-bce6-456d-ae81-11db0f4beaa6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:09.642338 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-0dc01aff-bce6-456d-ae81-11db0f4beaa6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] HTTP exception thrown: Instance 0b03913b-d112-47d1-b9aa-40f1818ca186 could not be found. Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0dc01aff-bce6-456d-ae81-11db0f4beaa6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Request method failure captured: Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 HTTP/1.1 Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zh6YPXnZEfL25DbrOo5AahkBCmHYOrAvKJnhgzQ9JlHxbrun4XI2EwE2n1nf4tgNFUaArqBEbFq4Toj7uUUuANo7JRuxksIEPvDD1AFl7fhy2XFxh_IYAhLXnE4PI4_QoyTOcOGpDghFYkpTUUI4xKODXHZZ1_feIKHlU2SknrcKPQ Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: deeb5431c1284d02b245ff3a9dc3f4e8 Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 0b03913b-d112-47d1-b9aa-40f1818ca186 could not be found. Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '0b03913b-d112-47d1-b9aa-40f1818ca186'} Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b03913b-d112-47d1-b9aa-40f1818ca186 could not be found. Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:07:09.644428 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:07:09.648386 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b03913b-d112-47d1-b9aa-40f1818ca186 could not be found. Jul 19 23:07:09.648386 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:09.648386 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:07:09.648386 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:09.648386 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:09.648386 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:07:09.648386 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:07:09.648386 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:07:09.648386 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:07:09.648386 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b03913b-d112-47d1-b9aa-40f1818ca186 could not be found. Jul 19 23:07:09.648386 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:09.650006 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0dc01aff-bce6-456d-ae81-11db0f4beaa6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Returning 404 to user: Instance 0b03913b-d112-47d1-b9aa-40f1818ca186 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:07:09.650187 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1f97ced5-ea53-4502-bf9e-47e9817ea029 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:09.650619 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1f97ced5-ea53-4502-bf9e-47e9817ea029 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: ea84b044-26fc-44f4-b9c9-83ee0d423b6d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:09.653163 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0dc01aff-bce6-456d-ae81-11db0f4beaa6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 404 len: 111 microversion: 2.1 time: 0.079275 Jul 19 23:07:09.655595 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2930/5870] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:07:09 2022] DELETE /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:07:09.676107 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:07:09.677419 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d3d97e52-4b6d-46c1-b9c2-f70ed5be560f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:09.680203 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d3d97e52-4b6d-46c1-b9c2-f70ed5be560f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 0b03913b-d112-47d1-b9aa-40f1818ca186] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:09.684892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1f97ced5-ea53-4502-bf9e-47e9817ea029 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:09.685304 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1f97ced5-ea53-4502-bf9e-47e9817ea029 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:09.686193 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1f97ced5-ea53-4502-bf9e-47e9817ea029 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:09.695757 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3d97e52-4b6d-46c1-b9c2-f70ed5be560f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:09.697573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3d97e52-4b6d-46c1-b9c2-f70ed5be560f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:09.697793 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1f97ced5-ea53-4502-bf9e-47e9817ea029 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:09.699789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3d97e52-4b6d-46c1-b9c2-f70ed5be560f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:09.704972 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3d97e52-4b6d-46c1-b9c2-f70ed5be560f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:09.743918 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-d3d97e52-4b6d-46c1-b9c2-f70ed5be560f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] HTTP exception thrown: Instance 0b03913b-d112-47d1-b9aa-40f1818ca186 could not be found. Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d3d97e52-4b6d-46c1-b9c2-f70ed5be560f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Request method failure captured: Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 HTTP/1.1 Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zh6YPXnZEfL25DbrOo5AahkBCmHYOrAvKJnhgzQ9JlHxbrun4XI2EwE2n1nf4tgNFUaArqBEbFq4Toj7uUUuANo7JRuxksIEPvDD1AFl7fhy2XFxh_IYAhLXnE4PI4_QoyTOcOGpDghFYkpTUUI4xKODXHZZ1_feIKHlU2SknrcKPQ Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: deeb5431c1284d02b245ff3a9dc3f4e8 Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 0b03913b-d112-47d1-b9aa-40f1818ca186 could not be found. Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '0b03913b-d112-47d1-b9aa-40f1818ca186'} Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b03913b-d112-47d1-b9aa-40f1818ca186 could not be found. Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b03913b-d112-47d1-b9aa-40f1818ca186 could not be found. Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:07:09.752902 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:09.756512 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:09.756512 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:07:09.756512 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:07:09.756512 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:07:09.756512 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:07:09.756512 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b03913b-d112-47d1-b9aa-40f1818ca186 could not be found. Jul 19 23:07:09.756512 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:09.758540 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d3d97e52-4b6d-46c1-b9c2-f70ed5be560f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Returning 404 to user: Instance 0b03913b-d112-47d1-b9aa-40f1818ca186 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:07:09.763562 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d3d97e52-4b6d-46c1-b9c2-f70ed5be560f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186" status: 404 len: 111 microversion: 2.1 time: 0.101150 Jul 19 23:07:09.766933 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2931/5871] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:09 2022] GET /compute/v2.1/servers/0b03913b-d112-47d1-b9aa-40f1818ca186 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 23:07:09.827600 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1f97ced5-ea53-4502-bf9e-47e9817ea029 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: ea84b044-26fc-44f4-b9c9-83ee0d423b6d] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:07:10.074898 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1f97ced5-ea53-4502-bf9e-47e9817ea029 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d" status: 204 len: 0 microversion: 2.1 time: 0.428409 Jul 19 23:07:10.082242 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2941/5872] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:07:09 2022] DELETE /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:07:10.109504 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c0664e73-1f8f-4a6f-a53b-46dbb88f2357 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:10.120189 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c0664e73-1f8f-4a6f-a53b-46dbb88f2357 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: ea84b044-26fc-44f4-b9c9-83ee0d423b6d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:10.187297 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0664e73-1f8f-4a6f-a53b-46dbb88f2357 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:10.203737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0664e73-1f8f-4a6f-a53b-46dbb88f2357 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:10.208123 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0664e73-1f8f-4a6f-a53b-46dbb88f2357 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:10.211840 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0664e73-1f8f-4a6f-a53b-46dbb88f2357 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:10.386746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f3446326-d42f-40ae-a66d-4d4c205014d2 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:10.388083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f3446326-d42f-40ae-a66d-4d4c205014d2 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:10.395242 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3446326-d42f-40ae-a66d-4d4c205014d2 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:10.395937 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3446326-d42f-40ae-a66d-4d4c205014d2 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:10.396873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3446326-d42f-40ae-a66d-4d4c205014d2 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:10.397454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3446326-d42f-40ae-a66d-4d4c205014d2 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:10.473758 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f3446326-d42f-40ae-a66d-4d4c205014d2 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.090600 Jul 19 23:07:10.474369 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2942/5873] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:07:10 2022] GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd/os-volume_attachments => generated 371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:07:10.628524 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8a647761-3202-4a86-ab00-75f852e8eb8c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:10.629030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8a647761-3202-4a86-ab00-75f852e8eb8c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:10.638873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a647761-3202-4a86-ab00-75f852e8eb8c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:10.643650 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a647761-3202-4a86-ab00-75f852e8eb8c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:10.644837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a647761-3202-4a86-ab00-75f852e8eb8c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:10.645447 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a647761-3202-4a86-ab00-75f852e8eb8c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:10.691433 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c0664e73-1f8f-4a6f-a53b-46dbb88f2357 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:10.701372 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c0664e73-1f8f-4a6f-a53b-46dbb88f2357 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d" status: 200 len: 1553 microversion: 2.1 time: 0.609407 Jul 19 23:07:10.710489 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8a647761-3202-4a86-ab00-75f852e8eb8c tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd/os-volume_attachments/51b9775a-d9a9-4c9f-a908-a2ae7d6d0459" status: 200 len: 194 microversion: 2.1 time: 0.085893 Jul 19 23:07:10.712141 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2932/5874] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:10 2022] GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d => generated 1553 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:10.717824 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2943/5875] 10.222.0.25 () {58 vars in 1412 bytes} [Tue Jul 19 23:07:10 2022] GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd/os-volume_attachments/51b9775a-d9a9-4c9f-a908-a2ae7d6d0459 => generated 194 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:07:10.727522 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4233f7ff-6e2c-4931-a437-87e13a8833b7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:10.729112 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4233f7ff-6e2c-4931-a437-87e13a8833b7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:10.740116 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4233f7ff-6e2c-4931-a437-87e13a8833b7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:10.743185 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4233f7ff-6e2c-4931-a437-87e13a8833b7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:10.744337 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4233f7ff-6e2c-4931-a437-87e13a8833b7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:10.745104 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4233f7ff-6e2c-4931-a437-87e13a8833b7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:10.916851 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-4233f7ff-6e2c-4931-a437-87e13a8833b7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lazy-loading 'services' on Instance uuid 987a171b-07c6-4cca-9d53-45b0e72090cd {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:07:11.088843 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4233f7ff-6e2c-4931-a437-87e13a8833b7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "DELETE /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd/os-volume_attachments/51b9775a-d9a9-4c9f-a908-a2ae7d6d0459" status: 202 len: 0 microversion: 2.1 time: 0.358323 Jul 19 23:07:11.090367 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2933/5876] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 19 23:07:10 2022] DELETE /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd/os-volume_attachments/51b9775a-d9a9-4c9f-a908-a2ae7d6d0459 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:07:11.720343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-95296d17-89aa-441d-8fa3-af9207ffb1df tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:11.721216 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-95296d17-89aa-441d-8fa3-af9207ffb1df tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: ea84b044-26fc-44f4-b9c9-83ee0d423b6d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:11.734729 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-95296d17-89aa-441d-8fa3-af9207ffb1df tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:11.735481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-95296d17-89aa-441d-8fa3-af9207ffb1df tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:11.736283 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-95296d17-89aa-441d-8fa3-af9207ffb1df tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:11.736719 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-95296d17-89aa-441d-8fa3-af9207ffb1df tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:12.335178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-95296d17-89aa-441d-8fa3-af9207ffb1df tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:12.346019 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-95296d17-89aa-441d-8fa3-af9207ffb1df tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d" status: 200 len: 1553 microversion: 2.1 time: 0.631017 Jul 19 23:07:12.358308 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2944/5877] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:11 2022] GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d => generated 1553 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:12.822363 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-e78b2f7d-1f65-4ccf-8fbf-34aa1aa95b73 req-9e5fae8c-d580-4eee-adf9-3127fc0ffe96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea84b044-26fc-44f4-b9c9-83ee0d423b6d", "name": "network-vif-deleted", "tag": "cf26a901-fe9c-44fc-83c7-a53085ac0210"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:07:12.858285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:07:12.880627 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e78b2f7d-1f65-4ccf-8fbf-34aa1aa95b73 req-9e5fae8c-d580-4eee-adf9-3127fc0ffe96 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:12.885589 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e78b2f7d-1f65-4ccf-8fbf-34aa1aa95b73 req-9e5fae8c-d580-4eee-adf9-3127fc0ffe96 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:12.912850 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-e78b2f7d-1f65-4ccf-8fbf-34aa1aa95b73 req-9e5fae8c-d580-4eee-adf9-3127fc0ffe96 service nova] Creating event network-vif-deleted:cf26a901-fe9c-44fc-83c7-a53085ac0210 for instance ea84b044-26fc-44f4-b9c9-83ee0d423b6d on n-h2-847009-3 Jul 19 23:07:12.919781 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-e78b2f7d-1f65-4ccf-8fbf-34aa1aa95b73 req-9e5fae8c-d580-4eee-adf9-3127fc0ffe96 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101900 Jul 19 23:07:12.920393 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2934/5878] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:07:13.364933 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4111de0e-d93c-47a9-a8b2-bf882899b452 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:13.365556 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4111de0e-d93c-47a9-a8b2-bf882899b452 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: ea84b044-26fc-44f4-b9c9-83ee0d423b6d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:13.381424 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4111de0e-d93c-47a9-a8b2-bf882899b452 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:13.383506 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4111de0e-d93c-47a9-a8b2-bf882899b452 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:13.388020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4111de0e-d93c-47a9-a8b2-bf882899b452 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:13.393142 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4111de0e-d93c-47a9-a8b2-bf882899b452 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:13.494200 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4111de0e-d93c-47a9-a8b2-bf882899b452 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:13.495849 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4111de0e-d93c-47a9-a8b2-bf882899b452 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:13.497283 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-4111de0e-d93c-47a9-a8b2-bf882899b452 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lazy-loading 'fault' on Instance uuid ea84b044-26fc-44f4-b9c9-83ee0d423b6d {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:07:13.553253 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4111de0e-d93c-47a9-a8b2-bf882899b452 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:13.569355 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4111de0e-d93c-47a9-a8b2-bf882899b452 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d" status: 200 len: 1338 microversion: 2.1 time: 0.207561 Jul 19 23:07:13.587046 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2945/5879] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:13 2022] GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d => generated 1338 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:14.593206 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b0466155-e037-4ab6-ac6d-5f307e214c31 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:14.594545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b0466155-e037-4ab6-ac6d-5f307e214c31 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: ea84b044-26fc-44f4-b9c9-83ee0d423b6d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:14.615515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b0466155-e037-4ab6-ac6d-5f307e214c31 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:14.615688 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b0466155-e037-4ab6-ac6d-5f307e214c31 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:14.617749 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b0466155-e037-4ab6-ac6d-5f307e214c31 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:14.618367 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b0466155-e037-4ab6-ac6d-5f307e214c31 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:14.657010 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-b0466155-e037-4ab6-ac6d-5f307e214c31 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] HTTP exception thrown: Instance ea84b044-26fc-44f4-b9c9-83ee0d423b6d could not be found. Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b0466155-e037-4ab6-ac6d-5f307e214c31 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Request method failure captured: Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d HTTP/1.1 Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1ziZAA1BzPLGaZMVWIQo4VDUH2zaknVBfSNIgtaJjDeGyhK-l1HeVjlSx-V5VkG3_ZewiQN6H33ckhz-2X-b_PGN39eEeCDrbcBiS1RnerotLvY8q3nK5icypC2ZJJoTZTGOEtwbbEQvEDp-n6TMzoOPR3guNKGp2FngGTGNUI-obCg Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 9370b564007740c4a619273e03c78dca Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TestNetworkBasicOps-879177891 Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9370b564007740c4a619273e03c78dca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9370b564007740c4a619273e03c78dca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9370b564007740c4a619273e03c78dca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9370b564007740c4a619273e03c78dca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TestNetworkBasicOps-879177891 Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 9370b564007740c4a619273e03c78dca Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TestNetworkBasicOps-879177891 Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TestNetworkBasicOps-879177891-project Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: ea2ea35da78245bfaf9651d7afb5fe66 Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TestNetworkBasicOps-879177891-project Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance ea84b044-26fc-44f4-b9c9-83ee0d423b6d could not be found. Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'ea84b044-26fc-44f4-b9c9-83ee0d423b6d'} Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea84b044-26fc-44f4-b9c9-83ee0d423b6d could not be found. Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea84b044-26fc-44f4-b9c9-83ee0d423b6d could not be found. Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:07:14.664339 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:14.669962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:14.669962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:07:14.669962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:07:14.669962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:07:14.669962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:07:14.669962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea84b044-26fc-44f4-b9c9-83ee0d423b6d could not be found. Jul 19 23:07:14.669962 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:14.674198 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b0466155-e037-4ab6-ac6d-5f307e214c31 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Returning 404 to user: Instance ea84b044-26fc-44f4-b9c9-83ee0d423b6d could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:07:14.679712 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b0466155-e037-4ab6-ac6d-5f307e214c31 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d" status: 404 len: 111 microversion: 2.1 time: 0.092735 Jul 19 23:07:14.681868 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2935/5880] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:14 2022] GET /compute/v2.1/servers/ea84b044-26fc-44f4-b9c9-83ee0d423b6d => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:07:14.933193 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bb9456b8-30aa-44da-87e7-a3287005a04f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '.version_select at 0x7f7a0308f0d0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:14.970387 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bb9456b8-30aa-44da-87e7-a3287005a04f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-704409885" status: 202 len: 0 microversion: 2.1 time: 0.042247 Jul 19 23:07:14.971573 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2946/5881] 10.222.0.25 () {58 vars in 1253 bytes} [Tue Jul 19 23:07:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-704409885 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:07:17.945218 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2568cec9-b210-40e4-be88-e3047edbd758 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-757287035", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:07:18.029907 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-2568cec9-b210-40e4-be88-e3047edbd758 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] validate_networks() for None {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:07:18.911276 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6513423f-5bb3-4d15-a445-dee90b959f7a tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:18.911791 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6513423f-5bb3-4d15-a445-dee90b959f7a tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: abb31b9a-6d7d-43af-8eb3-57af34fc02ed] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:18.938268 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6513423f-5bb3-4d15-a445-dee90b959f7a tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:18.939154 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6513423f-5bb3-4d15-a445-dee90b959f7a tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:18.940918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6513423f-5bb3-4d15-a445-dee90b959f7a tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:18.944028 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6513423f-5bb3-4d15-a445-dee90b959f7a tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:19.043132 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6513423f-5bb3-4d15-a445-dee90b959f7a tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: abb31b9a-6d7d-43af-8eb3-57af34fc02ed] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:07:19.076711 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:07:19.229657 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-2568cec9-b210-40e4-be88-e3047edbd758 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:07:19.231563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-2568cec9-b210-40e4-be88-e3047edbd758 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:07:19.232278 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-2568cec9-b210-40e4-be88-e3047edbd758 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:07:19.232518 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6513423f-5bb3-4d15-a445-dee90b959f7a tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "DELETE /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed" status: 204 len: 0 microversion: 2.1 time: 0.324939 Jul 19 23:07:19.233350 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2947/5882] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:07:18 2022] DELETE /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 23:07:19.234204 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-2568cec9-b210-40e4-be88-e3047edbd758 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:07:19.235202 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-2568cec9-b210-40e4-be88-e3047edbd758 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:07:19.249481 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2568cec9-b210-40e4-be88-e3047edbd758 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:19.252427 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2568cec9-b210-40e4-be88-e3047edbd758 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:19.254438 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-204ea6ec-ae12-4965-9e61-354868859504 req-d3952368-8b24-4620-b034-2767e5edb60b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abb31b9a-6d7d-43af-8eb3-57af34fc02ed", "tag": "748a6ed8-6858-4cda-ba15-99debaf1eb59"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:07:19.256209 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2568cec9-b210-40e4-be88-e3047edbd758 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:19.257143 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2568cec9-b210-40e4-be88-e3047edbd758 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:19.287317 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-204ea6ec-ae12-4965-9e61-354868859504 req-d3952368-8b24-4620-b034-2767e5edb60b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:19.287853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-204ea6ec-ae12-4965-9e61-354868859504 req-d3952368-8b24-4620-b034-2767e5edb60b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:19.293746 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-2568cec9-b210-40e4-be88-e3047edbd758 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Getting quotas for project ec5fb87ac7b74ff2826e3eabb82aee89. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:07:19.302199 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-2568cec9-b210-40e4-be88-e3047edbd758 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Getting quotas for user 79a675fee9b345d6a51a57d5d71d1859 and project ec5fb87ac7b74ff2826e3eabb82aee89. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:07:19.319828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2568cec9-b210-40e4-be88-e3047edbd758 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:07:19.323647 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2568cec9-b210-40e4-be88-e3047edbd758 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] [instance: 64af567b-0dec-4673-bc8e-8424ec877b65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:07:19.333085 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-204ea6ec-ae12-4965-9e61-354868859504 req-d3952368-8b24-4620-b034-2767e5edb60b service nova] Creating event network-changed:748a6ed8-6858-4cda-ba15-99debaf1eb59 for instance abb31b9a-6d7d-43af-8eb3-57af34fc02ed on n-h2-847009-3 Jul 19 23:07:19.339386 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-204ea6ec-ae12-4965-9e61-354868859504 req-d3952368-8b24-4620-b034-2767e5edb60b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103484 Jul 19 23:07:19.340240 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2948/5883] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:07:19.346774 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-302e10de-9189-4b1a-bd35-d55456bf0cd0 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:19.348495 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-302e10de-9189-4b1a-bd35-d55456bf0cd0 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: abb31b9a-6d7d-43af-8eb3-57af34fc02ed] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:19.356903 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-302e10de-9189-4b1a-bd35-d55456bf0cd0 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:19.358234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-302e10de-9189-4b1a-bd35-d55456bf0cd0 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:19.359290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-302e10de-9189-4b1a-bd35-d55456bf0cd0 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:19.360024 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-302e10de-9189-4b1a-bd35-d55456bf0cd0 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:19.399393 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2568cec9-b210-40e4-be88-e3047edbd758 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.457217 Jul 19 23:07:19.410400 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2936/5884] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:07:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:07:19.417854 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5ffe7dbc-ace9-49d9-9013-5a4029aebded tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:19.418709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5ffe7dbc-ace9-49d9-9013-5a4029aebded tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:19.425903 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ffe7dbc-ace9-49d9-9013-5a4029aebded tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:19.426600 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ffe7dbc-ace9-49d9-9013-5a4029aebded tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:19.428161 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ffe7dbc-ace9-49d9-9013-5a4029aebded tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:19.429526 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ffe7dbc-ace9-49d9-9013-5a4029aebded tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:19.468759 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5ffe7dbc-ace9-49d9-9013-5a4029aebded tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd/os-volume_attachments/5235c416-71dc-426e-854e-208abca7906f" status: 200 len: 194 microversion: 2.1 time: 0.056591 Jul 19 23:07:19.469570 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2937/5885] 10.222.0.25 () {58 vars in 1412 bytes} [Tue Jul 19 23:07:19 2022] GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd/os-volume_attachments/5235c416-71dc-426e-854e-208abca7906f => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:07:19.476344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0d55e280-63e3-4ed9-967f-d46e671787a6 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:19.477898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0d55e280-63e3-4ed9-967f-d46e671787a6 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] [instance: 64af567b-0dec-4673-bc8e-8424ec877b65] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:19.569997 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0d55e280-63e3-4ed9-967f-d46e671787a6 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a675fee9b345d6a51a57d5d71d1859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5fb87ac7b74ff2826e3eabb82aee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:19.579452 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0d55e280-63e3-4ed9-967f-d46e671787a6 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] 10.222.0.25 "GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65" status: 200 len: 1213 microversion: 2.1 time: 0.108251 Jul 19 23:07:19.589855 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2938/5886] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:19 2022] GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65 => generated 1213 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:19.596807 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c2b3e9be-74d6-4de4-8ee3-b0a2b970b9e3 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:19.597854 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c2b3e9be-74d6-4de4-8ee3-b0a2b970b9e3 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:19.608379 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c2b3e9be-74d6-4de4-8ee3-b0a2b970b9e3 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:19.609044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c2b3e9be-74d6-4de4-8ee3-b0a2b970b9e3 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:19.611090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c2b3e9be-74d6-4de4-8ee3-b0a2b970b9e3 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:19.611801 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c2b3e9be-74d6-4de4-8ee3-b0a2b970b9e3 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:19.665371 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-302e10de-9189-4b1a-bd35-d55456bf0cd0 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:19.685553 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-302e10de-9189-4b1a-bd35-d55456bf0cd0 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed" status: 200 len: 1671 microversion: 2.1 time: 0.343374 Jul 19 23:07:19.686543 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2949/5887] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:19 2022] GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed => generated 1671 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:19.796537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-c2b3e9be-74d6-4de4-8ee3-b0a2b970b9e3 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lazy-loading 'services' on Instance uuid 987a171b-07c6-4cca-9d53-45b0e72090cd {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:07:19.904544 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c2b3e9be-74d6-4de4-8ee3-b0a2b970b9e3 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "DELETE /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd/os-volume_attachments/5235c416-71dc-426e-854e-208abca7906f" status: 202 len: 0 microversion: 2.1 time: 0.312613 Jul 19 23:07:19.905525 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2939/5888] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 19 23:07:19 2022] DELETE /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd/os-volume_attachments/5235c416-71dc-426e-854e-208abca7906f => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:07:20.599617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6ce9f9a0-c1a4-4c6a-968b-7b44236d5fdc tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:20.600964 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6ce9f9a0-c1a4-4c6a-968b-7b44236d5fdc tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] [instance: 64af567b-0dec-4673-bc8e-8424ec877b65] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:20.616074 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6ce9f9a0-c1a4-4c6a-968b-7b44236d5fdc tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:20.616535 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6ce9f9a0-c1a4-4c6a-968b-7b44236d5fdc tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:20.617509 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6ce9f9a0-c1a4-4c6a-968b-7b44236d5fdc tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:20.618411 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6ce9f9a0-c1a4-4c6a-968b-7b44236d5fdc tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:20.706241 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-84f85abc-a1c0-4839-b253-4ad8a837a944 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:20.707744 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-84f85abc-a1c0-4839-b253-4ad8a837a944 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: abb31b9a-6d7d-43af-8eb3-57af34fc02ed] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:20.718262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6ce9f9a0-c1a4-4c6a-968b-7b44236d5fdc tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a675fee9b345d6a51a57d5d71d1859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5fb87ac7b74ff2826e3eabb82aee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:20.724288 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-84f85abc-a1c0-4839-b253-4ad8a837a944 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:20.726886 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-84f85abc-a1c0-4839-b253-4ad8a837a944 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:20.727916 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-84f85abc-a1c0-4839-b253-4ad8a837a944 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:20.728371 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-84f85abc-a1c0-4839-b253-4ad8a837a944 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:20.729359 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6ce9f9a0-c1a4-4c6a-968b-7b44236d5fdc tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] 10.222.0.25 "GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65" status: 200 len: 1209 microversion: 2.1 time: 0.135578 Jul 19 23:07:20.730230 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2950/5889] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:20 2022] GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65 => generated 1209 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:21.026421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-84f85abc-a1c0-4839-b253-4ad8a837a944 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:21.039285 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-84f85abc-a1c0-4839-b253-4ad8a837a944 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed" status: 200 len: 1671 microversion: 2.1 time: 0.338411 Jul 19 23:07:21.041462 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2940/5890] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:20 2022] GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed => generated 1671 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:07:21.751438 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-913e486a-0293-475e-b7eb-976cb30f1cdd tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:21.754373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-913e486a-0293-475e-b7eb-976cb30f1cdd tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] [instance: 64af567b-0dec-4673-bc8e-8424ec877b65] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:21.771046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-913e486a-0293-475e-b7eb-976cb30f1cdd tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:21.772528 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-913e486a-0293-475e-b7eb-976cb30f1cdd tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:21.775420 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-913e486a-0293-475e-b7eb-976cb30f1cdd tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:21.777098 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-913e486a-0293-475e-b7eb-976cb30f1cdd tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:21.993771 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-913e486a-0293-475e-b7eb-976cb30f1cdd tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a675fee9b345d6a51a57d5d71d1859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5fb87ac7b74ff2826e3eabb82aee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:22.021061 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-913e486a-0293-475e-b7eb-976cb30f1cdd tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] 10.222.0.25 "GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65" status: 200 len: 1271 microversion: 2.1 time: 0.275163 Jul 19 23:07:22.022932 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2951/5891] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:21 2022] GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65 => generated 1271 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:22.061889 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-209049aa-11b7-457a-9b73-d3674a5e641f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:22.064722 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-209049aa-11b7-457a-9b73-d3674a5e641f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: abb31b9a-6d7d-43af-8eb3-57af34fc02ed] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:22.080418 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-209049aa-11b7-457a-9b73-d3674a5e641f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:22.080887 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-209049aa-11b7-457a-9b73-d3674a5e641f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:22.082460 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-209049aa-11b7-457a-9b73-d3674a5e641f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:22.082910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-209049aa-11b7-457a-9b73-d3674a5e641f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:22.177842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-209049aa-11b7-457a-9b73-d3674a5e641f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:22.179980 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-209049aa-11b7-457a-9b73-d3674a5e641f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:22.183684 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-209049aa-11b7-457a-9b73-d3674a5e641f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lazy-loading 'fault' on Instance uuid abb31b9a-6d7d-43af-8eb3-57af34fc02ed {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:07:22.373272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-209049aa-11b7-457a-9b73-d3674a5e641f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:22.387062 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-209049aa-11b7-457a-9b73-d3674a5e641f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed" status: 200 len: 1338 microversion: 2.1 time: 0.328299 Jul 19 23:07:22.388025 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2952/5892] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:22 2022] GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed => generated 1338 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:07:22.492729 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-93a5f964-5c08-4e8c-ab1c-c2407abb5617 req-324f4275-4f42-4dd2-ba14-21021c6a1768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb31b9a-6d7d-43af-8eb3-57af34fc02ed", "name": "network-vif-deleted", "tag": "748a6ed8-6858-4cda-ba15-99debaf1eb59"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:07:22.509882 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-93a5f964-5c08-4e8c-ab1c-c2407abb5617 req-324f4275-4f42-4dd2-ba14-21021c6a1768 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:22.514970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-93a5f964-5c08-4e8c-ab1c-c2407abb5617 req-324f4275-4f42-4dd2-ba14-21021c6a1768 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:22.540726 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-93a5f964-5c08-4e8c-ab1c-c2407abb5617 req-324f4275-4f42-4dd2-ba14-21021c6a1768 service nova] Creating event network-vif-deleted:748a6ed8-6858-4cda-ba15-99debaf1eb59 for instance abb31b9a-6d7d-43af-8eb3-57af34fc02ed on n-h2-847009-3 Jul 19 23:07:22.557637 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-93a5f964-5c08-4e8c-ab1c-c2407abb5617 req-324f4275-4f42-4dd2-ba14-21021c6a1768 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.628953 Jul 19 23:07:22.560536 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2941/5893] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:07:23.046617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2105418e-0733-4fb4-be05-5574b109252b tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:23.048292 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2105418e-0733-4fb4-be05-5574b109252b tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] [instance: 64af567b-0dec-4673-bc8e-8424ec877b65] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:23.065559 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2105418e-0733-4fb4-be05-5574b109252b tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:23.066539 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2105418e-0733-4fb4-be05-5574b109252b tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:23.068061 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2105418e-0733-4fb4-be05-5574b109252b tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:23.068727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2105418e-0733-4fb4-be05-5574b109252b tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:23.407068 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7b8730a3-4a2d-46de-9a1f-32cbdcd7abb9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:23.407918 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7b8730a3-4a2d-46de-9a1f-32cbdcd7abb9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: abb31b9a-6d7d-43af-8eb3-57af34fc02ed] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:23.418528 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b8730a3-4a2d-46de-9a1f-32cbdcd7abb9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:23.419367 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b8730a3-4a2d-46de-9a1f-32cbdcd7abb9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:23.420453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b8730a3-4a2d-46de-9a1f-32cbdcd7abb9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:23.421276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b8730a3-4a2d-46de-9a1f-32cbdcd7abb9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:23.452972 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-7b8730a3-4a2d-46de-9a1f-32cbdcd7abb9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] HTTP exception thrown: Instance abb31b9a-6d7d-43af-8eb3-57af34fc02ed could not be found. Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7b8730a3-4a2d-46de-9a1f-32cbdcd7abb9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Request method failure captured: Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed HTTP/1.1 Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1ziZAA1BzPLGaZMVWIQo4VDUH2zaknVBfSNIgtaJjDeGyhK-l1HeVjlSx-V5VkG3_ZewiQN6H33ckhz-2X-b_PGN39eEeCDrbcBiS1RnerotLvY8q3nK5icypC2ZJJoTZTGOEtwbbEQvEDp-n6TMzoOPR3guNKGp2FngGTGNUI-obCg Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 9370b564007740c4a619273e03c78dca Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TestNetworkBasicOps-879177891 Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9370b564007740c4a619273e03c78dca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9370b564007740c4a619273e03c78dca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9370b564007740c4a619273e03c78dca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9370b564007740c4a619273e03c78dca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TestNetworkBasicOps-879177891 Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 9370b564007740c4a619273e03c78dca Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TestNetworkBasicOps-879177891 Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TestNetworkBasicOps-879177891-project Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: ea2ea35da78245bfaf9651d7afb5fe66 Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TestNetworkBasicOps-879177891-project Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance abb31b9a-6d7d-43af-8eb3-57af34fc02ed could not be found. Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'abb31b9a-6d7d-43af-8eb3-57af34fc02ed'} Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abb31b9a-6d7d-43af-8eb3-57af34fc02ed could not be found. Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abb31b9a-6d7d-43af-8eb3-57af34fc02ed could not be found. Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:07:23.455862 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:23.460645 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:23.460645 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:07:23.460645 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:07:23.460645 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:07:23.460645 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:07:23.460645 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abb31b9a-6d7d-43af-8eb3-57af34fc02ed could not be found. Jul 19 23:07:23.460645 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:23.465583 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7b8730a3-4a2d-46de-9a1f-32cbdcd7abb9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Returning 404 to user: Instance abb31b9a-6d7d-43af-8eb3-57af34fc02ed could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:07:23.466805 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7b8730a3-4a2d-46de-9a1f-32cbdcd7abb9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed" status: 404 len: 111 microversion: 2.1 time: 0.064452 Jul 19 23:07:23.468670 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2942/5894] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:23 2022] GET /compute/v2.1/servers/abb31b9a-6d7d-43af-8eb3-57af34fc02ed => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 23:07:23.530679 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2105418e-0733-4fb4-be05-5574b109252b tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a675fee9b345d6a51a57d5d71d1859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5fb87ac7b74ff2826e3eabb82aee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:23.548127 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2105418e-0733-4fb4-be05-5574b109252b tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] 10.222.0.25 "GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65" status: 200 len: 1313 microversion: 2.1 time: 0.510764 Jul 19 23:07:23.551083 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2953/5895] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:23 2022] GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65 => generated 1313 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:23.906152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7573f280-45af-472d-a664-9d642e612b29 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '.version_select at 0x7f7a1045de50>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:23.960762 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7573f280-45af-472d-a664-9d642e612b29 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1916981386" status: 202 len: 0 microversion: 2.1 time: 0.060016 Jul 19 23:07:23.966256 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2943/5896] 10.222.0.25 () {58 vars in 1256 bytes} [Tue Jul 19 23:07:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1916981386 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:07:24.318239 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-8af5bd6b-9818-4025-ae4f-dedc376fbaf1 req-995c300d-106b-4db6-ba8d-ca4ebfc845b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64af567b-0dec-4673-bc8e-8424ec877b65", "tag": "7e7866ce-f232-4e19-bd37-801869963fa9"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:07:24.349164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-8af5bd6b-9818-4025-ae4f-dedc376fbaf1 req-995c300d-106b-4db6-ba8d-ca4ebfc845b9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:24.350549 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-8af5bd6b-9818-4025-ae4f-dedc376fbaf1 req-995c300d-106b-4db6-ba8d-ca4ebfc845b9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:24.391416 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-8af5bd6b-9818-4025-ae4f-dedc376fbaf1 req-995c300d-106b-4db6-ba8d-ca4ebfc845b9 service nova] Creating event network-changed:7e7866ce-f232-4e19-bd37-801869963fa9 for instance 64af567b-0dec-4673-bc8e-8424ec877b65 on n-h2-847009-3 Jul 19 23:07:24.412015 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-8af5bd6b-9818-4025-ae4f-dedc376fbaf1 req-995c300d-106b-4db6-ba8d-ca4ebfc845b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096878 Jul 19 23:07:24.412791 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2954/5897] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:07:24.566466 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fe8c8896-28d9-4e31-a6b3-87892a419ad7 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:24.567662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fe8c8896-28d9-4e31-a6b3-87892a419ad7 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] [instance: 64af567b-0dec-4673-bc8e-8424ec877b65] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:24.580118 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe8c8896-28d9-4e31-a6b3-87892a419ad7 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:24.583771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe8c8896-28d9-4e31-a6b3-87892a419ad7 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:24.584836 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe8c8896-28d9-4e31-a6b3-87892a419ad7 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:24.587693 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe8c8896-28d9-4e31-a6b3-87892a419ad7 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:25.150482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fe8c8896-28d9-4e31-a6b3-87892a419ad7 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a675fee9b345d6a51a57d5d71d1859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5fb87ac7b74ff2826e3eabb82aee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:25.159493 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fe8c8896-28d9-4e31-a6b3-87892a419ad7 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] 10.222.0.25 "GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65" status: 200 len: 1313 microversion: 2.1 time: 0.597216 Jul 19 23:07:25.160445 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2944/5898] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:24 2022] GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65 => generated 1313 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:26.180505 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-22cea81d-6f86-4a3f-b8bd-d17dc117d49d tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:26.183467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-22cea81d-6f86-4a3f-b8bd-d17dc117d49d tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] [instance: 64af567b-0dec-4673-bc8e-8424ec877b65] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:26.202272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22cea81d-6f86-4a3f-b8bd-d17dc117d49d tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:26.203279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22cea81d-6f86-4a3f-b8bd-d17dc117d49d tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:26.210641 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22cea81d-6f86-4a3f-b8bd-d17dc117d49d tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:26.211450 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22cea81d-6f86-4a3f-b8bd-d17dc117d49d tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:26.621290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-22cea81d-6f86-4a3f-b8bd-d17dc117d49d tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a675fee9b345d6a51a57d5d71d1859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5fb87ac7b74ff2826e3eabb82aee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:26.630464 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-22cea81d-6f86-4a3f-b8bd-d17dc117d49d tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] 10.222.0.25 "GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65" status: 200 len: 1313 microversion: 2.1 time: 0.455929 Jul 19 23:07:26.631070 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2955/5899] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:26 2022] GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65 => generated 1313 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:27.647881 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5269541b-f38b-47bc-8cc4-79884f9e3aa4 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:27.648504 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5269541b-f38b-47bc-8cc4-79884f9e3aa4 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] [instance: 64af567b-0dec-4673-bc8e-8424ec877b65] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:27.669630 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5269541b-f38b-47bc-8cc4-79884f9e3aa4 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:27.681102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5269541b-f38b-47bc-8cc4-79884f9e3aa4 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:27.684566 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5269541b-f38b-47bc-8cc4-79884f9e3aa4 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:27.685187 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5269541b-f38b-47bc-8cc4-79884f9e3aa4 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:28.257430 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5269541b-f38b-47bc-8cc4-79884f9e3aa4 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a675fee9b345d6a51a57d5d71d1859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5fb87ac7b74ff2826e3eabb82aee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:28.282758 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5269541b-f38b-47bc-8cc4-79884f9e3aa4 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] 10.222.0.25 "GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65" status: 200 len: 1313 microversion: 2.1 time: 0.638999 Jul 19 23:07:28.283399 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2945/5900] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:27 2022] GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65 => generated 1313 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:29.020764 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-34d808b4-381f-4992-81f8-9dcd13645b24 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:29.022302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-34d808b4-381f-4992-81f8-9dcd13645b24 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:29.037281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-34d808b4-381f-4992-81f8-9dcd13645b24 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:29.039000 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-34d808b4-381f-4992-81f8-9dcd13645b24 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:29.041330 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-34d808b4-381f-4992-81f8-9dcd13645b24 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:29.043914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-34d808b4-381f-4992-81f8-9dcd13645b24 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:29.124322 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-34d808b4-381f-4992-81f8-9dcd13645b24 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.109464 Jul 19 23:07:29.130435 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2956/5901] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:07:29 2022] GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 23:07:29.301126 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-92a514eb-b8f7-4677-af7a-5c8583408f29 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:29.301845 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-92a514eb-b8f7-4677-af7a-5c8583408f29 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] [instance: 64af567b-0dec-4673-bc8e-8424ec877b65] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:29.312981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dfd7be2d-ae97-4574-aff9-289bda26a6f9 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:29.314641 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dfd7be2d-ae97-4574-aff9-289bda26a6f9 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:29.325920 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dfd7be2d-ae97-4574-aff9-289bda26a6f9 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:29.326379 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dfd7be2d-ae97-4574-aff9-289bda26a6f9 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:29.326766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:07:29.330444 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-92a514eb-b8f7-4677-af7a-5c8583408f29 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:29.334762 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dfd7be2d-ae97-4574-aff9-289bda26a6f9 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:29.334987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-92a514eb-b8f7-4677-af7a-5c8583408f29 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:29.336218 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-92a514eb-b8f7-4677-af7a-5c8583408f29 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:29.336679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-92a514eb-b8f7-4677-af7a-5c8583408f29 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:29.339044 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dfd7be2d-ae97-4574-aff9-289bda26a6f9 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:29.405714 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dfd7be2d-ae97-4574-aff9-289bda26a6f9 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.095043 Jul 19 23:07:29.416154 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2957/5902] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:07:29 2022] GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 23:07:29.538740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4489db20-6e4f-48c7-9cb4-dabc4dfda5f2 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:29.539606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4489db20-6e4f-48c7-9cb4-dabc4dfda5f2 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:29.554750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4489db20-6e4f-48c7-9cb4-dabc4dfda5f2 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:29.562050 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4489db20-6e4f-48c7-9cb4-dabc4dfda5f2 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:29.563801 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4489db20-6e4f-48c7-9cb4-dabc4dfda5f2 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:29.566029 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4489db20-6e4f-48c7-9cb4-dabc4dfda5f2 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:29.578170 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=8 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:07:29.615925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4489db20-6e4f-48c7-9cb4-dabc4dfda5f2 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:07:29.737451 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-92a514eb-b8f7-4677-af7a-5c8583408f29 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a675fee9b345d6a51a57d5d71d1859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5fb87ac7b74ff2826e3eabb82aee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:29.758669 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-92a514eb-b8f7-4677-af7a-5c8583408f29 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] 10.222.0.25 "GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65" status: 200 len: 1313 microversion: 2.1 time: 0.460874 Jul 19 23:07:29.760704 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2946/5903] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:29 2022] GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65 => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:29.808488 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4489db20-6e4f-48c7-9cb4-dabc4dfda5f2 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "DELETE /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd" status: 204 len: 0 microversion: 2.1 time: 0.274317 Jul 19 23:07:29.809793 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2958/5904] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:07:29 2022] DELETE /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 23:07:29.818914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-23d76153-625f-45bc-9fba-e673b35550a5 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:29.820060 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-23d76153-625f-45bc-9fba-e673b35550a5 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:29.827064 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-23d76153-625f-45bc-9fba-e673b35550a5 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:29.827875 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-23d76153-625f-45bc-9fba-e673b35550a5 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:29.828812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-23d76153-625f-45bc-9fba-e673b35550a5 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:29.829366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-23d76153-625f-45bc-9fba-e673b35550a5 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:30.166264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-23d76153-625f-45bc-9fba-e673b35550a5 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:30.187718 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-23d76153-625f-45bc-9fba-e673b35550a5 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd" status: 200 len: 1671 microversion: 2.1 time: 0.373133 Jul 19 23:07:30.190904 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2947/5905] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:29 2022] GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd => generated 1671 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:30.479949 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-83197b7d-8a9a-4616-b591-3d2c89698f00 req-a75d7a05-0fe1-4c7b-8eb3-ec01a3d00b9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64af567b-0dec-4673-bc8e-8424ec877b65", "name": "network-vif-plugged", "status": "completed", "tag": "7e7866ce-f232-4e19-bd37-801869963fa9"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:07:30.503182 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-83197b7d-8a9a-4616-b591-3d2c89698f00 req-a75d7a05-0fe1-4c7b-8eb3-ec01a3d00b9e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:30.506134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-83197b7d-8a9a-4616-b591-3d2c89698f00 req-a75d7a05-0fe1-4c7b-8eb3-ec01a3d00b9e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:30.528659 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-83197b7d-8a9a-4616-b591-3d2c89698f00 req-a75d7a05-0fe1-4c7b-8eb3-ec01a3d00b9e service nova] Creating event network-vif-plugged:7e7866ce-f232-4e19-bd37-801869963fa9 for instance 64af567b-0dec-4673-bc8e-8424ec877b65 on n-h2-847009-3 Jul 19 23:07:30.539449 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-83197b7d-8a9a-4616-b591-3d2c89698f00 req-a75d7a05-0fe1-4c7b-8eb3-ec01a3d00b9e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065056 Jul 19 23:07:30.541595 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2959/5906] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:07:30.777853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d581ca5d-ea0b-44e2-8857-eb6033c2747e tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:30.779415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d581ca5d-ea0b-44e2-8857-eb6033c2747e tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] [instance: 64af567b-0dec-4673-bc8e-8424ec877b65] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:30.788290 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d581ca5d-ea0b-44e2-8857-eb6033c2747e tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:30.790016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d581ca5d-ea0b-44e2-8857-eb6033c2747e tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:30.792697 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d581ca5d-ea0b-44e2-8857-eb6033c2747e tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:30.795865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d581ca5d-ea0b-44e2-8857-eb6033c2747e tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:31.213502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-58b0be92-6559-4775-9203-86b106873c09 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:31.214206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-58b0be92-6559-4775-9203-86b106873c09 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:31.221203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58b0be92-6559-4775-9203-86b106873c09 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:31.221962 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58b0be92-6559-4775-9203-86b106873c09 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:31.222948 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58b0be92-6559-4775-9203-86b106873c09 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:31.223578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58b0be92-6559-4775-9203-86b106873c09 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:31.417175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d581ca5d-ea0b-44e2-8857-eb6033c2747e tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a675fee9b345d6a51a57d5d71d1859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5fb87ac7b74ff2826e3eabb82aee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:31.441504 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d581ca5d-ea0b-44e2-8857-eb6033c2747e tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] 10.222.0.25 "GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65" status: 200 len: 1313 microversion: 2.1 time: 0.667391 Jul 19 23:07:31.443449 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2948/5907] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:30 2022] GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65 => generated 1313 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:31.581568 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-58b0be92-6559-4775-9203-86b106873c09 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:31.600880 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-58b0be92-6559-4775-9203-86b106873c09 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd" status: 200 len: 1671 microversion: 2.1 time: 0.390831 Jul 19 23:07:31.616709 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2960/5908] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:31 2022] GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd => generated 1671 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:32.461125 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c7752984-cfdd-4c7a-bc85-07af8c3c5e68 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:32.461651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c7752984-cfdd-4c7a-bc85-07af8c3c5e68 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] [instance: 64af567b-0dec-4673-bc8e-8424ec877b65] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:32.473246 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7752984-cfdd-4c7a-bc85-07af8c3c5e68 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:32.484559 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7752984-cfdd-4c7a-bc85-07af8c3c5e68 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:32.485426 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7752984-cfdd-4c7a-bc85-07af8c3c5e68 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:32.485877 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7752984-cfdd-4c7a-bc85-07af8c3c5e68 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:32.637518 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c242b609-d00c-46b2-956d-01d9eac8f0aa tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:32.639289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c242b609-d00c-46b2-956d-01d9eac8f0aa tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:32.671893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c242b609-d00c-46b2-956d-01d9eac8f0aa tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:32.674849 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c242b609-d00c-46b2-956d-01d9eac8f0aa tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:32.678298 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c242b609-d00c-46b2-956d-01d9eac8f0aa tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:32.682287 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c242b609-d00c-46b2-956d-01d9eac8f0aa tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:32.951563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c7752984-cfdd-4c7a-bc85-07af8c3c5e68 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a675fee9b345d6a51a57d5d71d1859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5fb87ac7b74ff2826e3eabb82aee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:32.954262 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:07:32.961232 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c7752984-cfdd-4c7a-bc85-07af8c3c5e68 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] 10.222.0.25 "GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65" status: 200 len: 1313 microversion: 2.1 time: 0.504131 Jul 19 23:07:32.971707 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2949/5909] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:32 2022] GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65 => generated 1313 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:33.177309 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c242b609-d00c-46b2-956d-01d9eac8f0aa tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:33.185933 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c242b609-d00c-46b2-956d-01d9eac8f0aa tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd" status: 200 len: 1671 microversion: 2.1 time: 0.562039 Jul 19 23:07:33.186885 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2961/5910] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:32 2022] GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd => generated 1671 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:33.978434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-51c6213e-76a9-4459-868e-c485d915cb70 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:33.979081 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-51c6213e-76a9-4459-868e-c485d915cb70 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] [instance: 64af567b-0dec-4673-bc8e-8424ec877b65] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:33.987941 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51c6213e-76a9-4459-868e-c485d915cb70 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:33.988849 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51c6213e-76a9-4459-868e-c485d915cb70 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:33.989852 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51c6213e-76a9-4459-868e-c485d915cb70 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:33.991182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51c6213e-76a9-4459-868e-c485d915cb70 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:34.115997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-28ea40c8-b034-4b67-a243-22e14261cbd9 req-8c8a8d37-d5ec-4d39-90d8-8c9cb0c6533b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "987a171b-07c6-4cca-9d53-45b0e72090cd", "name": "network-vif-deleted", "tag": "90a4a48e-edda-46f0-90bb-fca8abc89725"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:07:34.151383 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-28ea40c8-b034-4b67-a243-22e14261cbd9 req-8c8a8d37-d5ec-4d39-90d8-8c9cb0c6533b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:34.152109 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-28ea40c8-b034-4b67-a243-22e14261cbd9 req-8c8a8d37-d5ec-4d39-90d8-8c9cb0c6533b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:34.167463 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-28ea40c8-b034-4b67-a243-22e14261cbd9 req-8c8a8d37-d5ec-4d39-90d8-8c9cb0c6533b service nova] Creating event network-vif-deleted:90a4a48e-edda-46f0-90bb-fca8abc89725 for instance 987a171b-07c6-4cca-9d53-45b0e72090cd on n-h1-847009-3 Jul 19 23:07:34.173907 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-28ea40c8-b034-4b67-a243-22e14261cbd9 req-8c8a8d37-d5ec-4d39-90d8-8c9cb0c6533b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061530 Jul 19 23:07:34.174755 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2962/5911] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:07:34.208388 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4928b865-38f0-4bd4-ad0a-35d9ec222da7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:34.209736 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4928b865-38f0-4bd4-ad0a-35d9ec222da7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:34.228890 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4928b865-38f0-4bd4-ad0a-35d9ec222da7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:34.230926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4928b865-38f0-4bd4-ad0a-35d9ec222da7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:34.234259 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4928b865-38f0-4bd4-ad0a-35d9ec222da7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:34.234778 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4928b865-38f0-4bd4-ad0a-35d9ec222da7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:34.256670 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-51c6213e-76a9-4459-868e-c485d915cb70 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a675fee9b345d6a51a57d5d71d1859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5fb87ac7b74ff2826e3eabb82aee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:34.265279 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-51c6213e-76a9-4459-868e-c485d915cb70 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] 10.222.0.25 "GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65" status: 200 len: 1463 microversion: 2.1 time: 0.291321 Jul 19 23:07:34.283057 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2950/5912] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:33 2022] GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65 => generated 1463 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:34.292930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2e747766-a96f-485b-8946-321be15e5f0b tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93a3844c-f1b4-4c04-905d-738860f58ab9", "device": "/dev/sdb"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:07:34.301754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2e747766-a96f-485b-8946-321be15e5f0b tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] [instance: 64af567b-0dec-4673-bc8e-8424ec877b65] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:34.324180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2e747766-a96f-485b-8946-321be15e5f0b tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:34.324902 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2e747766-a96f-485b-8946-321be15e5f0b tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:34.325998 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2e747766-a96f-485b-8946-321be15e5f0b tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:34.327096 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2e747766-a96f-485b-8946-321be15e5f0b tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:34.381081 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4928b865-38f0-4bd4-ad0a-35d9ec222da7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:34.381544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4928b865-38f0-4bd4-ad0a-35d9ec222da7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:34.382010 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-4928b865-38f0-4bd4-ad0a-35d9ec222da7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lazy-loading 'fault' on Instance uuid 987a171b-07c6-4cca-9d53-45b0e72090cd {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:07:34.385724 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:07:34.476791 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4928b865-38f0-4bd4-ad0a-35d9ec222da7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d887379f25b41cc9dfb7119cc561e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9480697850b44a038ee838b4aed1ff10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:34.496257 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4928b865-38f0-4bd4-ad0a-35d9ec222da7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd" status: 200 len: 1326 microversion: 2.1 time: 0.295766 Jul 19 23:07:34.496863 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2963/5913] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:34 2022] GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd => generated 1326 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:34.928436 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2e747766-a96f-485b-8946-321be15e5f0b tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] 10.222.0.25 "POST /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.643714 Jul 19 23:07:34.936381 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2951/5914] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 19 23:07:34 2022] POST /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65/os-volume_attachments => generated 194 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:07:35.514868 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-59b3d53f-cd34-4836-b39b-9764ba5c5dfe tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:35.516180 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-59b3d53f-cd34-4836-b39b-9764ba5c5dfe tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:35.539446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-59b3d53f-cd34-4836-b39b-9764ba5c5dfe tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:35.540515 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-59b3d53f-cd34-4836-b39b-9764ba5c5dfe tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:35.541366 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-59b3d53f-cd34-4836-b39b-9764ba5c5dfe tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:35.550521 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-59b3d53f-cd34-4836-b39b-9764ba5c5dfe tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:35.583624 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-59b3d53f-cd34-4836-b39b-9764ba5c5dfe tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] HTTP exception thrown: Instance 987a171b-07c6-4cca-9d53-45b0e72090cd could not be found. Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-59b3d53f-cd34-4836-b39b-9764ba5c5dfe tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Request method failure captured: Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd HTTP/1.1 Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zfU3OTA9KkIJ5GmVWQ-vTWZpqZsChudguNJ_V4SWabVMgEux0i_oQ4vBYK9VPjf7Se0DER00Ew4uyMMU8wG0TL685P3K9LwzdVQCt99jV83Ih_cluK8Lo96ITRWNmTgfQ4nvfekknoiaxrtGnKgMzRcBOdFwdTuSEHjINySqs32F5E Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 9480697850b44a038ee838b4aed1ff10 Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AttachVolumeTestJSON-488468993 Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9480697850b44a038ee838b4aed1ff10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9480697850b44a038ee838b4aed1ff10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9480697850b44a038ee838b4aed1ff10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9480697850b44a038ee838b4aed1ff10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AttachVolumeTestJSON-488468993 Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 9480697850b44a038ee838b4aed1ff10 Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AttachVolumeTestJSON-488468993 Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AttachVolumeTestJSON-488468993-project Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 2d887379f25b41cc9dfb7119cc561e05 Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AttachVolumeTestJSON-488468993-project Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 987a171b-07c6-4cca-9d53-45b0e72090cd could not be found. Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '987a171b-07c6-4cca-9d53-45b0e72090cd'} Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 987a171b-07c6-4cca-9d53-45b0e72090cd could not be found. Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 987a171b-07c6-4cca-9d53-45b0e72090cd could not be found. Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:07:35.606146 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:07:35.611398 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:35.611398 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:07:35.611398 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:07:35.611398 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:07:35.611398 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:07:35.611398 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 987a171b-07c6-4cca-9d53-45b0e72090cd could not be found. Jul 19 23:07:35.611398 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:07:35.614622 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-59b3d53f-cd34-4836-b39b-9764ba5c5dfe tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Returning 404 to user: Instance 987a171b-07c6-4cca-9d53-45b0e72090cd could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:07:35.616104 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-59b3d53f-cd34-4836-b39b-9764ba5c5dfe tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd" status: 404 len: 111 microversion: 2.1 time: 0.105416 Jul 19 23:07:35.617275 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2964/5915] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:35 2022] GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:07:35.630465 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c7e67631-fae4-4e12-aa99-2e37247ef06d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '.version_select at 0x7f7a10043c10>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:35.677621 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c7e67631-fae4-4e12-aa99-2e37247ef06d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-586406540" status: 202 len: 0 microversion: 2.1 time: 0.054343 Jul 19 23:07:35.691261 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2952/5916] 10.222.0.25 () {58 vars in 1217 bytes} [Tue Jul 19 23:07:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-586406540 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:07:40.978586 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b59a6bc0-6ebe-4fb7-a13b-7577ffe56ba9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Action: 'create', calling method: .version_select at 0x7f7a03297f70>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1047088018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHFPyvpftQ11IXpNPZTTQ4kMDWvc/C0n6RCrdKWBnckfU3Wq18A6mOr39HwFgmK6Yuh1F0IKpJ+NMAbAzn+7fOUOv5K9TwHWIB9S/lPdZTiM8Jh2upN3sgCMfb17QoSKw=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:07:41.053217 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:07:41.140245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-b59a6bc0-6ebe-4fb7-a13b-7577ffe56ba9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Getting quotas for project 9370b564007740c4a619273e03c78dca. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:07:41.192517 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-b59a6bc0-6ebe-4fb7-a13b-7577ffe56ba9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Getting quotas for user ea2ea35da78245bfaf9651d7afb5fe66 and project 9370b564007740c4a619273e03c78dca. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:07:41.299134 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b59a6bc0-6ebe-4fb7-a13b-7577ffe56ba9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.329268 Jul 19 23:07:41.314156 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2965/5917] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 23:07:40 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:07:43.638191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cc916f90-798d-4ddc-a5c0-faa9f9644b32 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1799009105", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "57d0afa8-95a2-4681-b1c7-a1ac698b74d8"}], "key_name": "tempest-TestNetworkBasicOps-1047088018", "security_groups": [{"name": "tempest-secgroup-smoke-1288513201"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:07:43.832946 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-cc916f90-798d-4ddc-a5c0-faa9f9644b32 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] validate_networks() for [('57d0afa8-95a2-4681-b1c7-a1ac698b74d8', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:07:44.912492 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:07:45.271638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-cc916f90-798d-4ddc-a5c0-faa9f9644b32 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:07:45.272228 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-cc916f90-798d-4ddc-a5c0-faa9f9644b32 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:07:45.272819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-cc916f90-798d-4ddc-a5c0-faa9f9644b32 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:07:45.273529 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-cc916f90-798d-4ddc-a5c0-faa9f9644b32 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:07:45.275958 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-cc916f90-798d-4ddc-a5c0-faa9f9644b32 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:07:45.282219 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:07:45.303666 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc916f90-798d-4ddc-a5c0-faa9f9644b32 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:45.306513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc916f90-798d-4ddc-a5c0-faa9f9644b32 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:45.310926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc916f90-798d-4ddc-a5c0-faa9f9644b32 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:45.311776 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc916f90-798d-4ddc-a5c0-faa9f9644b32 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:45.362264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-cc916f90-798d-4ddc-a5c0-faa9f9644b32 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Getting quotas for project 9370b564007740c4a619273e03c78dca. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:07:45.371837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-cc916f90-798d-4ddc-a5c0-faa9f9644b32 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Getting quotas for user ea2ea35da78245bfaf9651d7afb5fe66 and project 9370b564007740c4a619273e03c78dca. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:07:45.418215 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cc916f90-798d-4ddc-a5c0-faa9f9644b32 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:07:45.424992 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cc916f90-798d-4ddc-a5c0-faa9f9644b32 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: a83063f9-5577-48a0-89a8-3355aab8e880] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:07:45.537704 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cc916f90-798d-4ddc-a5c0-faa9f9644b32 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.903829 Jul 19 23:07:45.538753 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2953/5918] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:07:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 1906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 23:07:45.549875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5dd88447-5611-4b42-8195-60eba6a40b84 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:45.550570 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5dd88447-5611-4b42-8195-60eba6a40b84 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: a83063f9-5577-48a0-89a8-3355aab8e880] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:45.567215 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=5 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:07:45.725226 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5dd88447-5611-4b42-8195-60eba6a40b84 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:45.747151 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5dd88447-5611-4b42-8195-60eba6a40b84 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880" status: 200 len: 1249 microversion: 2.1 time: 0.199467 Jul 19 23:07:45.749780 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2966/5919] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:45 2022] GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880 => generated 1249 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:46.765665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f05b92c5-7b4a-46e2-82d5-b0aa1fe2cb61 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:46.766281 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f05b92c5-7b4a-46e2-82d5-b0aa1fe2cb61 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: a83063f9-5577-48a0-89a8-3355aab8e880] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:46.793927 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f05b92c5-7b4a-46e2-82d5-b0aa1fe2cb61 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:46.794741 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f05b92c5-7b4a-46e2-82d5-b0aa1fe2cb61 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:46.795017 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f05b92c5-7b4a-46e2-82d5-b0aa1fe2cb61 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:46.795528 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f05b92c5-7b4a-46e2-82d5-b0aa1fe2cb61 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:46.904018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f05b92c5-7b4a-46e2-82d5-b0aa1fe2cb61 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:46.915144 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f05b92c5-7b4a-46e2-82d5-b0aa1fe2cb61 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880" status: 200 len: 1301 microversion: 2.1 time: 0.152879 Jul 19 23:07:46.927295 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2954/5920] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:46 2022] GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880 => generated 1301 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:47.936250 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ddf87b11-2120-4763-8f5e-9b2fc8e5abeb tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:47.937435 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ddf87b11-2120-4763-8f5e-9b2fc8e5abeb tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: a83063f9-5577-48a0-89a8-3355aab8e880] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:47.961222 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ddf87b11-2120-4763-8f5e-9b2fc8e5abeb tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:47.961699 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ddf87b11-2120-4763-8f5e-9b2fc8e5abeb tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:47.963045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ddf87b11-2120-4763-8f5e-9b2fc8e5abeb tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:47.963738 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ddf87b11-2120-4763-8f5e-9b2fc8e5abeb tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:48.085252 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ddf87b11-2120-4763-8f5e-9b2fc8e5abeb tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:48.099479 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ddf87b11-2120-4763-8f5e-9b2fc8e5abeb tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880" status: 200 len: 1307 microversion: 2.1 time: 0.169125 Jul 19 23:07:48.102438 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2967/5921] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:47 2022] GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880 => generated 1307 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:49.120051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fb40896a-5a2c-461b-ac8c-6e085e2eccf4 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:49.120684 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fb40896a-5a2c-461b-ac8c-6e085e2eccf4 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: a83063f9-5577-48a0-89a8-3355aab8e880] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:49.139040 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fb40896a-5a2c-461b-ac8c-6e085e2eccf4 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:49.139528 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fb40896a-5a2c-461b-ac8c-6e085e2eccf4 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:49.140456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fb40896a-5a2c-461b-ac8c-6e085e2eccf4 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:49.140917 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fb40896a-5a2c-461b-ac8c-6e085e2eccf4 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:49.419562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fb40896a-5a2c-461b-ac8c-6e085e2eccf4 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:49.435071 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fb40896a-5a2c-461b-ac8c-6e085e2eccf4 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880" status: 200 len: 1375 microversion: 2.1 time: 0.311928 Jul 19 23:07:49.444199 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2955/5922] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:49 2022] GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880 => generated 1375 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:49.637790 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-bd0b3827-0460-4790-b709-1a06dff403e5 req-48558e6e-32ca-4b0d-a258-9de9c785b23a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a83063f9-5577-48a0-89a8-3355aab8e880", "tag": "74b241ad-99ad-40ad-b775-45e253ce6158"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:07:49.670228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-bd0b3827-0460-4790-b709-1a06dff403e5 req-48558e6e-32ca-4b0d-a258-9de9c785b23a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:49.675709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-bd0b3827-0460-4790-b709-1a06dff403e5 req-48558e6e-32ca-4b0d-a258-9de9c785b23a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:49.726979 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-bd0b3827-0460-4790-b709-1a06dff403e5 req-48558e6e-32ca-4b0d-a258-9de9c785b23a service nova] Creating event network-changed:74b241ad-99ad-40ad-b775-45e253ce6158 for instance a83063f9-5577-48a0-89a8-3355aab8e880 on n-h1-847009-3 Jul 19 23:07:49.750148 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-bd0b3827-0460-4790-b709-1a06dff403e5 req-48558e6e-32ca-4b0d-a258-9de9c785b23a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115024 Jul 19 23:07:49.753134 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2968/5923] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:07:49.996978 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-85b5bd70-cdeb-49b2-88d5-32ea3830979a tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-446198518", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:07:50.088891 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-85b5bd70-cdeb-49b2-88d5-32ea3830979a tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] validate_networks() for None {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:07:50.453305 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-85b5bd70-cdeb-49b2-88d5-32ea3830979a tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:07:50.454162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-70429711-677d-416f-8a57-fc4c8f6ba95c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:50.454593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-85b5bd70-cdeb-49b2-88d5-32ea3830979a tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:07:50.455253 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-85b5bd70-cdeb-49b2-88d5-32ea3830979a tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:07:50.455428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-70429711-677d-416f-8a57-fc4c8f6ba95c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: a83063f9-5577-48a0-89a8-3355aab8e880] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:50.456677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-85b5bd70-cdeb-49b2-88d5-32ea3830979a tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:07:50.457466 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-85b5bd70-cdeb-49b2-88d5-32ea3830979a tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:07:50.467150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-70429711-677d-416f-8a57-fc4c8f6ba95c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:50.467767 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-70429711-677d-416f-8a57-fc4c8f6ba95c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:50.468638 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-70429711-677d-416f-8a57-fc4c8f6ba95c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:50.469323 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-70429711-677d-416f-8a57-fc4c8f6ba95c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:50.470101 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85b5bd70-cdeb-49b2-88d5-32ea3830979a tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:50.470627 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85b5bd70-cdeb-49b2-88d5-32ea3830979a tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:50.471551 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85b5bd70-cdeb-49b2-88d5-32ea3830979a tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:50.472159 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-85b5bd70-cdeb-49b2-88d5-32ea3830979a tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:50.494153 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-85b5bd70-cdeb-49b2-88d5-32ea3830979a tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Getting quotas for project 36ab4922734748e2b04e23d754ef4222. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:07:50.501179 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-85b5bd70-cdeb-49b2-88d5-32ea3830979a tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Getting quotas for user b2f33b57a0ae49859d88fcd0e1d6f74a and project 36ab4922734748e2b04e23d754ef4222. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:07:50.517595 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-85b5bd70-cdeb-49b2-88d5-32ea3830979a tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:07:50.520168 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-85b5bd70-cdeb-49b2-88d5-32ea3830979a tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] [instance: 5e699e51-068b-4996-afe6-c330efd3e0b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:07:50.578798 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-85b5bd70-cdeb-49b2-88d5-32ea3830979a tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585041 Jul 19 23:07:50.580965 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2956/5924] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:07:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:07:50.599458 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-642c9866-b521-4de2-9ce0-56fe4d688bd1 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:50.600006 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-642c9866-b521-4de2-9ce0-56fe4d688bd1 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] [instance: 5e699e51-068b-4996-afe6-c330efd3e0b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:50.677622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-642c9866-b521-4de2-9ce0-56fe4d688bd1 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f33b57a0ae49859d88fcd0e1d6f74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab4922734748e2b04e23d754ef4222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:50.688591 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-642c9866-b521-4de2-9ce0-56fe4d688bd1 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] 10.222.0.25 "GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1" status: 200 len: 1214 microversion: 2.1 time: 0.101114 Jul 19 23:07:50.690378 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2957/5925] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:50 2022] GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1 => generated 1214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:50.715275 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-70429711-677d-416f-8a57-fc4c8f6ba95c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:50.723326 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-70429711-677d-416f-8a57-fc4c8f6ba95c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880" status: 200 len: 1375 microversion: 2.1 time: 0.274589 Jul 19 23:07:50.725761 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2969/5926] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:50 2022] GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880 => generated 1375 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:51.285436 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1c520f4e-2e80-4501-9504-6212fbe00642 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1371987412", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7c64f6da-e455-4f0c-bdc0-a9f27cb6dbd6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "c424fcca-fcaa-49c5-9171-61018c1542cf"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:07:51.361657 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-1c520f4e-2e80-4501-9504-6212fbe00642 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] validate_networks() for [('c424fcca-fcaa-49c5-9171-61018c1542cf', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:07:51.706823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e052a99a-a78e-4810-bd09-12d66136123f tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:51.707876 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e052a99a-a78e-4810-bd09-12d66136123f tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] [instance: 5e699e51-068b-4996-afe6-c330efd3e0b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:51.718247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e052a99a-a78e-4810-bd09-12d66136123f tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:51.720498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e052a99a-a78e-4810-bd09-12d66136123f tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:51.723219 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e052a99a-a78e-4810-bd09-12d66136123f tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:51.723936 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e052a99a-a78e-4810-bd09-12d66136123f tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:51.864004 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e052a99a-a78e-4810-bd09-12d66136123f tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f33b57a0ae49859d88fcd0e1d6f74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab4922734748e2b04e23d754ef4222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:51.876399 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e052a99a-a78e-4810-bd09-12d66136123f tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] 10.222.0.25 "GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1" status: 200 len: 1274 microversion: 2.1 time: 0.173832 Jul 19 23:07:51.877423 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2970/5927] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:51 2022] GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1 => generated 1274 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:51.891061 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-722775a0-9fe8-4048-8056-3a9b77751f0c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:51.892073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-722775a0-9fe8-4048-8056-3a9b77751f0c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: a83063f9-5577-48a0-89a8-3355aab8e880] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:51.903781 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-722775a0-9fe8-4048-8056-3a9b77751f0c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:51.905069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-722775a0-9fe8-4048-8056-3a9b77751f0c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:51.906341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-722775a0-9fe8-4048-8056-3a9b77751f0c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:51.907211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-722775a0-9fe8-4048-8056-3a9b77751f0c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:52.289913 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-1c520f4e-2e80-4501-9504-6212fbe00642 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:07:52.290983 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-1c520f4e-2e80-4501-9504-6212fbe00642 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:07:52.291688 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-1c520f4e-2e80-4501-9504-6212fbe00642 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:07:52.292298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-1c520f4e-2e80-4501-9504-6212fbe00642 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:07:52.292879 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-1c520f4e-2e80-4501-9504-6212fbe00642 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:07:52.308599 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1c520f4e-2e80-4501-9504-6212fbe00642 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:52.309319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1c520f4e-2e80-4501-9504-6212fbe00642 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:52.310495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1c520f4e-2e80-4501-9504-6212fbe00642 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:52.310943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1c520f4e-2e80-4501-9504-6212fbe00642 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:52.332421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-1c520f4e-2e80-4501-9504-6212fbe00642 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Getting quotas for project ba6762beb0fe4220b984143b3ea6bd48. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:07:52.338563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-1c520f4e-2e80-4501-9504-6212fbe00642 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Getting quotas for user deeb5431c1284d02b245ff3a9dc3f4e8 and project ba6762beb0fe4220b984143b3ea6bd48. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:07:52.353890 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-722775a0-9fe8-4048-8056-3a9b77751f0c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:52.374873 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-722775a0-9fe8-4048-8056-3a9b77751f0c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880" status: 200 len: 1375 microversion: 2.1 time: 0.496055 Jul 19 23:07:52.380456 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2971/5928] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:51 2022] GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880 => generated 1375 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:52.425583 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1c520f4e-2e80-4501-9504-6212fbe00642 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:07:52.427850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1c520f4e-2e80-4501-9504-6212fbe00642 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7c64f6da-e455-4f0c-bdc0-a9f27cb6dbd6',volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:07:52.603873 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1c520f4e-2e80-4501-9504-6212fbe00642 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.322376 Jul 19 23:07:52.604981 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2958/5929] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:07:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 23:07:52.616157 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8ec779ef-3a4b-4ef8-b991-89015830a254 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:52.617797 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8ec779ef-3a4b-4ef8-b991-89015830a254 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:52.891150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8ec779ef-3a4b-4ef8-b991-89015830a254 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:52.898233 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7d495acf-e940-4649-ae69-10cecae1d4b6 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:52.898921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7d495acf-e940-4649-ae69-10cecae1d4b6 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] [instance: 5e699e51-068b-4996-afe6-c330efd3e0b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:52.913715 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8ec779ef-3a4b-4ef8-b991-89015830a254 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 200 len: 1071 microversion: 2.1 time: 0.301021 Jul 19 23:07:52.917145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7d495acf-e940-4649-ae69-10cecae1d4b6 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:52.917346 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2972/5930] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:52 2022] GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 1071 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:52.917949 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7d495acf-e940-4649-ae69-10cecae1d4b6 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:52.918952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7d495acf-e940-4649-ae69-10cecae1d4b6 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:52.919662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7d495acf-e940-4649-ae69-10cecae1d4b6 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:53.015995 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7d495acf-e940-4649-ae69-10cecae1d4b6 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f33b57a0ae49859d88fcd0e1d6f74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab4922734748e2b04e23d754ef4222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:53.027216 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7d495acf-e940-4649-ae69-10cecae1d4b6 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] 10.222.0.25 "GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1" status: 200 len: 1272 microversion: 2.1 time: 0.132709 Jul 19 23:07:53.030982 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2959/5931] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:52 2022] GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1 => generated 1272 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:53.314076 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ea1f7aee-f190-4daa-adf4-33319d8bfa03 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:53.314760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ea1f7aee-f190-4daa-adf4-33319d8bfa03 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:53.328293 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea1f7aee-f190-4daa-adf4-33319d8bfa03 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:53.329200 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea1f7aee-f190-4daa-adf4-33319d8bfa03 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:53.330756 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea1f7aee-f190-4daa-adf4-33319d8bfa03 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:53.331415 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea1f7aee-f190-4daa-adf4-33319d8bfa03 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:53.349701 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-ea1f7aee-f190-4daa-adf4-33319d8bfa03 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] HTTP exception thrown: Instance 987a171b-07c6-4cca-9d53-45b0e72090cd could not be found. Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ea1f7aee-f190-4daa-adf4-33319d8bfa03 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Request method failure captured: Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd HTTP/1.1 Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zfU3OTA9KkIJ5GmVWQ-vTWZpqZsChudguNJ_V4SWabVMgEux0i_oQ4vBYK9VPjf7Se0DER00Ew4uyMMU8wG0TL685P3K9LwzdVQCt99jV83Ih_cluK8Lo96ITRWNmTgfQ4nvfekknoiaxrtGnKgMzRcBOdFwdTuSEHjINySqs32F5E Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 9480697850b44a038ee838b4aed1ff10 Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-AttachVolumeTestJSON-488468993 Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9480697850b44a038ee838b4aed1ff10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9480697850b44a038ee838b4aed1ff10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9480697850b44a038ee838b4aed1ff10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9480697850b44a038ee838b4aed1ff10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-AttachVolumeTestJSON-488468993 Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 9480697850b44a038ee838b4aed1ff10 Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-AttachVolumeTestJSON-488468993 Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-AttachVolumeTestJSON-488468993-project Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 2d887379f25b41cc9dfb7119cc561e05 Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-AttachVolumeTestJSON-488468993-project Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 987a171b-07c6-4cca-9d53-45b0e72090cd could not be found. Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '987a171b-07c6-4cca-9d53-45b0e72090cd'} Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 987a171b-07c6-4cca-9d53-45b0e72090cd could not be found. Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:07:53.351893 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:07:53.356440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 987a171b-07c6-4cca-9d53-45b0e72090cd could not be found. Jul 19 23:07:53.356440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:07:53.356440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:07:53.356440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:07:53.356440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:53.356440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:07:53.356440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:07:53.356440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:07:53.356440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:07:53.356440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 987a171b-07c6-4cca-9d53-45b0e72090cd could not be found. Jul 19 23:07:53.356440 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:07:53.358548 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ea1f7aee-f190-4daa-adf4-33319d8bfa03 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Returning 404 to user: Instance 987a171b-07c6-4cca-9d53-45b0e72090cd could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:07:53.359641 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ea1f7aee-f190-4daa-adf4-33319d8bfa03 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "DELETE /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd" status: 404 len: 111 microversion: 2.1 time: 0.050455 Jul 19 23:07:53.360752 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2973/5932] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:07:53 2022] DELETE /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:07:53.369308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-43ec3863-8651-4df9-97cf-417bcd2ae85d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:53.370004 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-43ec3863-8651-4df9-97cf-417bcd2ae85d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: 987a171b-07c6-4cca-9d53-45b0e72090cd] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:53.381555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43ec3863-8651-4df9-97cf-417bcd2ae85d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:53.382146 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43ec3863-8651-4df9-97cf-417bcd2ae85d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:53.382969 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43ec3863-8651-4df9-97cf-417bcd2ae85d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:53.389207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-43ec3863-8651-4df9-97cf-417bcd2ae85d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:53.399133 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4b254a6c-0ce4-4b43-896c-bc288bfbbac9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:53.400869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4b254a6c-0ce4-4b43-896c-bc288bfbbac9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: a83063f9-5577-48a0-89a8-3355aab8e880] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:53.414765 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4b254a6c-0ce4-4b43-896c-bc288bfbbac9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:53.415081 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4b254a6c-0ce4-4b43-896c-bc288bfbbac9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:53.415901 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4b254a6c-0ce4-4b43-896c-bc288bfbbac9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:53.416344 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4b254a6c-0ce4-4b43-896c-bc288bfbbac9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:53.464152 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-43ec3863-8651-4df9-97cf-417bcd2ae85d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] HTTP exception thrown: Instance 987a171b-07c6-4cca-9d53-45b0e72090cd could not be found. Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-43ec3863-8651-4df9-97cf-417bcd2ae85d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Request method failure captured: Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd HTTP/1.1 Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zfU3OTA9KkIJ5GmVWQ-vTWZpqZsChudguNJ_V4SWabVMgEux0i_oQ4vBYK9VPjf7Se0DER00Ew4uyMMU8wG0TL685P3K9LwzdVQCt99jV83Ih_cluK8Lo96ITRWNmTgfQ4nvfekknoiaxrtGnKgMzRcBOdFwdTuSEHjINySqs32F5E Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 9480697850b44a038ee838b4aed1ff10 Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-AttachVolumeTestJSON-488468993 Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9480697850b44a038ee838b4aed1ff10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9480697850b44a038ee838b4aed1ff10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9480697850b44a038ee838b4aed1ff10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9480697850b44a038ee838b4aed1ff10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-AttachVolumeTestJSON-488468993 Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 9480697850b44a038ee838b4aed1ff10 Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-AttachVolumeTestJSON-488468993 Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-AttachVolumeTestJSON-488468993-project Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 2d887379f25b41cc9dfb7119cc561e05 Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-AttachVolumeTestJSON-488468993-project Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 987a171b-07c6-4cca-9d53-45b0e72090cd could not be found. Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '987a171b-07c6-4cca-9d53-45b0e72090cd'} Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 987a171b-07c6-4cca-9d53-45b0e72090cd could not be found. Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 987a171b-07c6-4cca-9d53-45b0e72090cd could not be found. Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:07:53.466030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:53.483432 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:53.483432 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:07:53.483432 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:07:53.483432 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:07:53.483432 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:07:53.483432 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 987a171b-07c6-4cca-9d53-45b0e72090cd could not be found. Jul 19 23:07:53.483432 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:53.483432 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-43ec3863-8651-4df9-97cf-417bcd2ae85d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Returning 404 to user: Instance 987a171b-07c6-4cca-9d53-45b0e72090cd could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:07:53.483432 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-43ec3863-8651-4df9-97cf-417bcd2ae85d tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd" status: 404 len: 111 microversion: 2.1 time: 0.104318 Jul 19 23:07:53.483432 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2960/5933] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:53 2022] GET /compute/v2.1/servers/987a171b-07c6-4cca-9d53-45b0e72090cd => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:07:53.852504 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4b254a6c-0ce4-4b43-896c-bc288bfbbac9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:53.863357 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4b254a6c-0ce4-4b43-896c-bc288bfbbac9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880" status: 200 len: 1375 microversion: 2.1 time: 0.470509 Jul 19 23:07:53.864580 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2974/5934] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:53 2022] GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880 => generated 1375 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:07:53.934871 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a2bf1557-5a12-419d-bde8-b417972a3777 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:53.935543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a2bf1557-5a12-419d-bde8-b417972a3777 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:53.950015 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a2bf1557-5a12-419d-bde8-b417972a3777 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:53.950386 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a2bf1557-5a12-419d-bde8-b417972a3777 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:53.951215 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a2bf1557-5a12-419d-bde8-b417972a3777 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:53.952238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a2bf1557-5a12-419d-bde8-b417972a3777 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:54.047890 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8aeadf7f-6e05-4ef7-861b-6aaa4985d616 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:54.048567 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8aeadf7f-6e05-4ef7-861b-6aaa4985d616 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] [instance: 5e699e51-068b-4996-afe6-c330efd3e0b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:54.064218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8aeadf7f-6e05-4ef7-861b-6aaa4985d616 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:54.064683 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8aeadf7f-6e05-4ef7-861b-6aaa4985d616 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:54.065825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8aeadf7f-6e05-4ef7-861b-6aaa4985d616 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:54.066463 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8aeadf7f-6e05-4ef7-861b-6aaa4985d616 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:54.374473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a2bf1557-5a12-419d-bde8-b417972a3777 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:54.399924 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a2bf1557-5a12-419d-bde8-b417972a3777 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 200 len: 1177 microversion: 2.1 time: 0.469594 Jul 19 23:07:54.401810 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2961/5935] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:53 2022] GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 1177 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:54.647449 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8aeadf7f-6e05-4ef7-861b-6aaa4985d616 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f33b57a0ae49859d88fcd0e1d6f74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab4922734748e2b04e23d754ef4222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:54.665305 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8aeadf7f-6e05-4ef7-861b-6aaa4985d616 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] 10.222.0.25 "GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1" status: 200 len: 1314 microversion: 2.1 time: 0.621232 Jul 19 23:07:54.666840 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2975/5936] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:54 2022] GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1 => generated 1314 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:54.883512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-70b613ab-0d39-4210-a88e-c984a8491663 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:54.884148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-70b613ab-0d39-4210-a88e-c984a8491663 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: a83063f9-5577-48a0-89a8-3355aab8e880] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:54.892186 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-70b613ab-0d39-4210-a88e-c984a8491663 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:54.892982 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-70b613ab-0d39-4210-a88e-c984a8491663 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:54.904261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-70b613ab-0d39-4210-a88e-c984a8491663 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:54.904731 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-70b613ab-0d39-4210-a88e-c984a8491663 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:55.228432 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-70b613ab-0d39-4210-a88e-c984a8491663 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:55.244940 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-70b613ab-0d39-4210-a88e-c984a8491663 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880" status: 200 len: 1375 microversion: 2.1 time: 0.365761 Jul 19 23:07:55.270190 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2962/5937] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:54 2022] GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880 => generated 1375 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:55.376511 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-5a061739-5e53-4b36-9021-591e4b1e00e0 req-6b482c61-9330-4a90-b170-8bf36212a5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83063f9-5577-48a0-89a8-3355aab8e880", "name": "network-vif-plugged", "status": "completed", "tag": "74b241ad-99ad-40ad-b775-45e253ce6158"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:07:55.399598 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-5a061739-5e53-4b36-9021-591e4b1e00e0 req-6b482c61-9330-4a90-b170-8bf36212a5d1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:55.400478 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-5a061739-5e53-4b36-9021-591e4b1e00e0 req-6b482c61-9330-4a90-b170-8bf36212a5d1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:55.419076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-82faaef8-1882-4bc4-a3bc-ec7698495158 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:55.419717 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-82faaef8-1882-4bc4-a3bc-ec7698495158 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:55.421627 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-5a061739-5e53-4b36-9021-591e4b1e00e0 req-6b482c61-9330-4a90-b170-8bf36212a5d1 service nova] Creating event network-vif-plugged:74b241ad-99ad-40ad-b775-45e253ce6158 for instance a83063f9-5577-48a0-89a8-3355aab8e880 on n-h1-847009-3 Jul 19 23:07:55.429525 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-5a061739-5e53-4b36-9021-591e4b1e00e0 req-6b482c61-9330-4a90-b170-8bf36212a5d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056603 Jul 19 23:07:55.431357 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2976/5938] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:07:55.450541 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-82faaef8-1882-4bc4-a3bc-ec7698495158 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:55.451431 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-82faaef8-1882-4bc4-a3bc-ec7698495158 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:55.452567 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-82faaef8-1882-4bc4-a3bc-ec7698495158 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:55.461235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-82faaef8-1882-4bc4-a3bc-ec7698495158 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:55.660104 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-82faaef8-1882-4bc4-a3bc-ec7698495158 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:55.672343 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-82faaef8-1882-4bc4-a3bc-ec7698495158 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 200 len: 1187 microversion: 2.1 time: 0.257339 Jul 19 23:07:55.682248 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2963/5939] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:55 2022] GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 1187 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:55.689925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f6182dba-0da0-4218-8545-208a2b6e6ad4 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:55.690651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f6182dba-0da0-4218-8545-208a2b6e6ad4 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] [instance: 5e699e51-068b-4996-afe6-c330efd3e0b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:55.700309 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f6182dba-0da0-4218-8545-208a2b6e6ad4 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:55.701116 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f6182dba-0da0-4218-8545-208a2b6e6ad4 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:55.702077 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f6182dba-0da0-4218-8545-208a2b6e6ad4 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:55.702765 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f6182dba-0da0-4218-8545-208a2b6e6ad4 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:56.113864 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f6182dba-0da0-4218-8545-208a2b6e6ad4 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f33b57a0ae49859d88fcd0e1d6f74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab4922734748e2b04e23d754ef4222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:56.133818 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f6182dba-0da0-4218-8545-208a2b6e6ad4 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] 10.222.0.25 "GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1" status: 200 len: 1314 microversion: 2.1 time: 0.448267 Jul 19 23:07:56.136946 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2977/5940] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:55 2022] GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1 => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:56.263065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c989d0ff-f524-4646-989b-117c0a57047b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:56.265563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c989d0ff-f524-4646-989b-117c0a57047b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: a83063f9-5577-48a0-89a8-3355aab8e880] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:56.278585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c989d0ff-f524-4646-989b-117c0a57047b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:56.279351 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c989d0ff-f524-4646-989b-117c0a57047b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:56.280861 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c989d0ff-f524-4646-989b-117c0a57047b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:56.292416 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c989d0ff-f524-4646-989b-117c0a57047b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:56.608366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c989d0ff-f524-4646-989b-117c0a57047b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:56.624952 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c989d0ff-f524-4646-989b-117c0a57047b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880" status: 200 len: 1375 microversion: 2.1 time: 0.363302 Jul 19 23:07:56.627493 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2964/5941] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:56 2022] GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880 => generated 1375 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:56.696505 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-05ebfc0e-42b1-4796-90f5-8f6ab683b01e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:56.700803 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-05ebfc0e-42b1-4796-90f5-8f6ab683b01e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:56.730245 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-6f58b715-cf38-431e-83df-a1da537f7f9d req-1621e96c-dd63-41cc-bcad-b2b194a3ba01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e699e51-068b-4996-afe6-c330efd3e0b1", "tag": "8c891c1e-4350-4942-a509-29c2369c1ede"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:07:56.740831 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05ebfc0e-42b1-4796-90f5-8f6ab683b01e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:56.741381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05ebfc0e-42b1-4796-90f5-8f6ab683b01e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:56.745493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05ebfc0e-42b1-4796-90f5-8f6ab683b01e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:56.750800 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05ebfc0e-42b1-4796-90f5-8f6ab683b01e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:56.764080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-6f58b715-cf38-431e-83df-a1da537f7f9d req-1621e96c-dd63-41cc-bcad-b2b194a3ba01 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:56.770943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-6f58b715-cf38-431e-83df-a1da537f7f9d req-1621e96c-dd63-41cc-bcad-b2b194a3ba01 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:56.850822 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-6f58b715-cf38-431e-83df-a1da537f7f9d req-1621e96c-dd63-41cc-bcad-b2b194a3ba01 service nova] Creating event network-changed:8c891c1e-4350-4942-a509-29c2369c1ede for instance 5e699e51-068b-4996-afe6-c330efd3e0b1 on n-h2-847009-3 Jul 19 23:07:56.917918 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-6f58b715-cf38-431e-83df-a1da537f7f9d req-1621e96c-dd63-41cc-bcad-b2b194a3ba01 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183940 Jul 19 23:07:56.921221 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2965/5942] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:07:57.161968 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6b0128ac-cd16-41b4-b8a1-c6f8b30b6489 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:57.164267 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6b0128ac-cd16-41b4-b8a1-c6f8b30b6489 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] [instance: 5e699e51-068b-4996-afe6-c330efd3e0b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:57.188005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b0128ac-cd16-41b4-b8a1-c6f8b30b6489 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:57.188816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b0128ac-cd16-41b4-b8a1-c6f8b30b6489 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:57.190772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b0128ac-cd16-41b4-b8a1-c6f8b30b6489 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:57.195742 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b0128ac-cd16-41b4-b8a1-c6f8b30b6489 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:57.544961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-05ebfc0e-42b1-4796-90f5-8f6ab683b01e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:57.560519 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-05ebfc0e-42b1-4796-90f5-8f6ab683b01e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 200 len: 1229 microversion: 2.1 time: 0.872470 Jul 19 23:07:57.571838 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2978/5943] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:56 2022] GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 1229 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:57.582375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6b0128ac-cd16-41b4-b8a1-c6f8b30b6489 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f33b57a0ae49859d88fcd0e1d6f74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab4922734748e2b04e23d754ef4222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:57.593803 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6b0128ac-cd16-41b4-b8a1-c6f8b30b6489 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] 10.222.0.25 "GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1" status: 200 len: 1314 microversion: 2.1 time: 0.444325 Jul 19 23:07:57.596495 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2966/5944] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:57 2022] GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1 => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:57.643473 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b6feed7d-cb17-4c3b-8ad3-292d29b4b5fc tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:57.644279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b6feed7d-cb17-4c3b-8ad3-292d29b4b5fc tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: a83063f9-5577-48a0-89a8-3355aab8e880] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:57.659824 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6feed7d-cb17-4c3b-8ad3-292d29b4b5fc tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:57.660920 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6feed7d-cb17-4c3b-8ad3-292d29b4b5fc tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:57.662507 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6feed7d-cb17-4c3b-8ad3-292d29b4b5fc tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:57.663256 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6feed7d-cb17-4c3b-8ad3-292d29b4b5fc tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:58.492610 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b6feed7d-cb17-4c3b-8ad3-292d29b4b5fc tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:58.507150 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b6feed7d-cb17-4c3b-8ad3-292d29b4b5fc tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880" status: 200 len: 1548 microversion: 2.1 time: 0.867882 Jul 19 23:07:58.512151 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2979/5945] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:57 2022] GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880 => generated 1548 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:58.531269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d76db8e2-4262-422c-8872-8856d868921b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:58.532249 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d76db8e2-4262-422c-8872-8856d868921b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: a83063f9-5577-48a0-89a8-3355aab8e880] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:58.551377 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d76db8e2-4262-422c-8872-8856d868921b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:58.552207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d76db8e2-4262-422c-8872-8856d868921b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:58.553241 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d76db8e2-4262-422c-8872-8856d868921b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:58.555616 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d76db8e2-4262-422c-8872-8856d868921b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:58.591940 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-585fed40-35cc-4b5b-a595-4b2f1368b45d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:58.595235 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-585fed40-35cc-4b5b-a595-4b2f1368b45d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:58.621108 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-585fed40-35cc-4b5b-a595-4b2f1368b45d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:58.621876 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-585fed40-35cc-4b5b-a595-4b2f1368b45d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:58.622871 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-585fed40-35cc-4b5b-a595-4b2f1368b45d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:58.626869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-585fed40-35cc-4b5b-a595-4b2f1368b45d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:59.121053 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-585fed40-35cc-4b5b-a595-4b2f1368b45d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:59.135229 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-585fed40-35cc-4b5b-a595-4b2f1368b45d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 200 len: 1229 microversion: 2.1 time: 0.557617 Jul 19 23:07:59.135963 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2980/5946] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:58 2022] GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 1229 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:59.153593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d76db8e2-4262-422c-8872-8856d868921b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:07:59.166844 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d76db8e2-4262-422c-8872-8856d868921b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880" status: 200 len: 1548 microversion: 2.1 time: 0.640394 Jul 19 23:07:59.171015 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2967/5947] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:58 2022] GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880 => generated 1548 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:07:59.174787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2dfb4dcd-ee94-46d1-83c5-bfad2fca22f9 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:59.176162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2dfb4dcd-ee94-46d1-83c5-bfad2fca22f9 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] [instance: 5e699e51-068b-4996-afe6-c330efd3e0b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:59.207722 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2dfb4dcd-ee94-46d1-83c5-bfad2fca22f9 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:59.208730 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2dfb4dcd-ee94-46d1-83c5-bfad2fca22f9 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:59.210807 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2dfb4dcd-ee94-46d1-83c5-bfad2fca22f9 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:59.213995 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2dfb4dcd-ee94-46d1-83c5-bfad2fca22f9 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:59.256825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0d3ea703-8c93-474f-8ed5-84aae06274a6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:59.262850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0d3ea703-8c93-474f-8ed5-84aae06274a6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:59.296912 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d3ea703-8c93-474f-8ed5-84aae06274a6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:59.302653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d3ea703-8c93-474f-8ed5-84aae06274a6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:59.312857 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d3ea703-8c93-474f-8ed5-84aae06274a6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:59.314128 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d3ea703-8c93-474f-8ed5-84aae06274a6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:59.354195 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-0d3ea703-8c93-474f-8ed5-84aae06274a6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] HTTP exception thrown: Instance b09fea8b-cf15-4aaf-9e24-4418313a878f could not be found. Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0d3ea703-8c93-474f-8ed5-84aae06274a6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Request method failure captured: Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f HTTP/1.1 Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zfU3OTA9KkIJ5GmVWQ-vTWZpqZsChudguNJ_V4SWabVMgEux0i_oQ4vBYK9VPjf7Se0DER00Ew4uyMMU8wG0TL685P3K9LwzdVQCt99jV83Ih_cluK8Lo96ITRWNmTgfQ4nvfekknoiaxrtGnKgMzRcBOdFwdTuSEHjINySqs32F5E Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 9480697850b44a038ee838b4aed1ff10 Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-AttachVolumeTestJSON-488468993 Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9480697850b44a038ee838b4aed1ff10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9480697850b44a038ee838b4aed1ff10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9480697850b44a038ee838b4aed1ff10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9480697850b44a038ee838b4aed1ff10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-AttachVolumeTestJSON-488468993 Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 9480697850b44a038ee838b4aed1ff10 Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-AttachVolumeTestJSON-488468993 Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-AttachVolumeTestJSON-488468993-project Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 2d887379f25b41cc9dfb7119cc561e05 Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-AttachVolumeTestJSON-488468993-project Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance b09fea8b-cf15-4aaf-9e24-4418313a878f could not be found. Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'b09fea8b-cf15-4aaf-9e24-4418313a878f'} Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b09fea8b-cf15-4aaf-9e24-4418313a878f could not be found. Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:07:59.366502 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:07:59.370618 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b09fea8b-cf15-4aaf-9e24-4418313a878f could not be found. Jul 19 23:07:59.370618 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:59.370618 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:07:59.370618 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:59.370618 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:59.370618 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:07:59.370618 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:07:59.370618 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:07:59.370618 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:07:59.370618 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b09fea8b-cf15-4aaf-9e24-4418313a878f could not be found. Jul 19 23:07:59.370618 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:59.370618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0d3ea703-8c93-474f-8ed5-84aae06274a6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Returning 404 to user: Instance b09fea8b-cf15-4aaf-9e24-4418313a878f could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:07:59.370618 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0d3ea703-8c93-474f-8ed5-84aae06274a6 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 404 len: 111 microversion: 2.1 time: 0.116327 Jul 19 23:07:59.370618 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2968/5948] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:07:59 2022] DELETE /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 23:07:59.401976 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-47f23c23-5a96-44c2-8711-96e5df94ded7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:07:59.402895 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-47f23c23-5a96-44c2-8711-96e5df94ded7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] [instance: b09fea8b-cf15-4aaf-9e24-4418313a878f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:07:59.420675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-47f23c23-5a96-44c2-8711-96e5df94ded7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:59.421828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-47f23c23-5a96-44c2-8711-96e5df94ded7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:59.424630 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-47f23c23-5a96-44c2-8711-96e5df94ded7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:59.426904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-47f23c23-5a96-44c2-8711-96e5df94ded7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:59.474582 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-47f23c23-5a96-44c2-8711-96e5df94ded7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] HTTP exception thrown: Instance b09fea8b-cf15-4aaf-9e24-4418313a878f could not be found. Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-47f23c23-5a96-44c2-8711-96e5df94ded7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Request method failure captured: Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f HTTP/1.1 Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zfU3OTA9KkIJ5GmVWQ-vTWZpqZsChudguNJ_V4SWabVMgEux0i_oQ4vBYK9VPjf7Se0DER00Ew4uyMMU8wG0TL685P3K9LwzdVQCt99jV83Ih_cluK8Lo96ITRWNmTgfQ4nvfekknoiaxrtGnKgMzRcBOdFwdTuSEHjINySqs32F5E Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 9480697850b44a038ee838b4aed1ff10 Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-AttachVolumeTestJSON-488468993 Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9480697850b44a038ee838b4aed1ff10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9480697850b44a038ee838b4aed1ff10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9480697850b44a038ee838b4aed1ff10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9480697850b44a038ee838b4aed1ff10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-AttachVolumeTestJSON-488468993 Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 9480697850b44a038ee838b4aed1ff10 Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-AttachVolumeTestJSON-488468993 Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-AttachVolumeTestJSON-488468993-project Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 2d887379f25b41cc9dfb7119cc561e05 Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-AttachVolumeTestJSON-488468993-project Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance b09fea8b-cf15-4aaf-9e24-4418313a878f could not be found. Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'b09fea8b-cf15-4aaf-9e24-4418313a878f'} Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b09fea8b-cf15-4aaf-9e24-4418313a878f could not be found. Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b09fea8b-cf15-4aaf-9e24-4418313a878f could not be found. Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:07:59.477325 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:59.483391 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:07:59.483391 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:07:59.483391 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:07:59.483391 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:07:59.483391 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:07:59.483391 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b09fea8b-cf15-4aaf-9e24-4418313a878f could not be found. Jul 19 23:07:59.483391 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:07:59.486976 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-47f23c23-5a96-44c2-8711-96e5df94ded7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] Returning 404 to user: Instance b09fea8b-cf15-4aaf-9e24-4418313a878f could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:07:59.493173 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-47f23c23-5a96-44c2-8711-96e5df94ded7 tempest-AttachVolumeTestJSON-488468993 tempest-AttachVolumeTestJSON-488468993-project] 10.222.0.25 "GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f" status: 404 len: 111 microversion: 2.1 time: 0.118221 Jul 19 23:07:59.496209 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2969/5949] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:59 2022] GET /compute/v2.1/servers/b09fea8b-cf15-4aaf-9e24-4418313a878f => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:07:59.510649 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-e3fd2b83-294d-4990-be33-9e6449dcfc12 req-f0d1b11d-7563-490f-8813-cb2f9f52751c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e30c02d2-1d86-4ad0-bfa4-4522aad3d73c", "tag": "204d5e7f-29dc-4964-8858-53396d7323bd"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:07:59.553999 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e3fd2b83-294d-4990-be33-9e6449dcfc12 req-f0d1b11d-7563-490f-8813-cb2f9f52751c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:07:59.554797 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e3fd2b83-294d-4990-be33-9e6449dcfc12 req-f0d1b11d-7563-490f-8813-cb2f9f52751c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:07:59.616110 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-e3fd2b83-294d-4990-be33-9e6449dcfc12 req-f0d1b11d-7563-490f-8813-cb2f9f52751c service nova] Creating event network-changed:204d5e7f-29dc-4964-8858-53396d7323bd for instance e30c02d2-1d86-4ad0-bfa4-4522aad3d73c on n-h1-847009-3 Jul 19 23:07:59.655276 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-e3fd2b83-294d-4990-be33-9e6449dcfc12 req-f0d1b11d-7563-490f-8813-cb2f9f52751c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139636 Jul 19 23:07:59.660933 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2970/5950] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:08:00.117838 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2dfb4dcd-ee94-46d1-83c5-bfad2fca22f9 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f33b57a0ae49859d88fcd0e1d6f74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab4922734748e2b04e23d754ef4222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:00.136087 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2dfb4dcd-ee94-46d1-83c5-bfad2fca22f9 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] 10.222.0.25 "GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1" status: 200 len: 1314 microversion: 2.1 time: 0.965293 Jul 19 23:08:00.137016 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2981/5951] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:07:59 2022] GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1 => generated 1314 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:00.157728 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b41e8762-fa62-4f36-8f90-10be6bd6b90d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:00.158760 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b41e8762-fa62-4f36-8f90-10be6bd6b90d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:00.172926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b41e8762-fa62-4f36-8f90-10be6bd6b90d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:00.175306 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b41e8762-fa62-4f36-8f90-10be6bd6b90d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:00.176413 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b41e8762-fa62-4f36-8f90-10be6bd6b90d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:00.177119 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b41e8762-fa62-4f36-8f90-10be6bd6b90d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:00.880779 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b41e8762-fa62-4f36-8f90-10be6bd6b90d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:00.895406 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b41e8762-fa62-4f36-8f90-10be6bd6b90d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 200 len: 1229 microversion: 2.1 time: 0.742131 Jul 19 23:08:00.902470 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2971/5952] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:00 2022] GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 1229 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:01.156432 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0ea3903f-c5f7-417b-b387-d7cd593a580b tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:01.157262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0ea3903f-c5f7-417b-b387-d7cd593a580b tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] [instance: 5e699e51-068b-4996-afe6-c330efd3e0b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:01.174269 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ea3903f-c5f7-417b-b387-d7cd593a580b tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:01.178173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ea3903f-c5f7-417b-b387-d7cd593a580b tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:01.178874 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ea3903f-c5f7-417b-b387-d7cd593a580b tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:01.182428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ea3903f-c5f7-417b-b387-d7cd593a580b tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:01.861232 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0ea3903f-c5f7-417b-b387-d7cd593a580b tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f33b57a0ae49859d88fcd0e1d6f74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab4922734748e2b04e23d754ef4222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:01.893680 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0ea3903f-c5f7-417b-b387-d7cd593a580b tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] 10.222.0.25 "GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1" status: 200 len: 1314 microversion: 2.1 time: 0.741116 Jul 19 23:08:01.901222 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2982/5953] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:01 2022] GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1 => generated 1314 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:01.923846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6aae7ebd-886f-4ecb-af44-f406443501e5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:01.924667 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6aae7ebd-886f-4ecb-af44-f406443501e5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:01.940335 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6aae7ebd-886f-4ecb-af44-f406443501e5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:01.941277 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6aae7ebd-886f-4ecb-af44-f406443501e5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:01.946896 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6aae7ebd-886f-4ecb-af44-f406443501e5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:01.947645 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6aae7ebd-886f-4ecb-af44-f406443501e5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:02.323891 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:08:02.346524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=20 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:08:02.540721 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-44abc62d-2835-4568-b5fb-f322343184ee req-d24156ae-0578-4850-bf8f-1cae5d5f86f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e699e51-068b-4996-afe6-c330efd3e0b1", "name": "network-vif-plugged", "status": "completed", "tag": "8c891c1e-4350-4942-a509-29c2369c1ede"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:08:02.590602 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-44abc62d-2835-4568-b5fb-f322343184ee req-d24156ae-0578-4850-bf8f-1cae5d5f86f1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:02.593628 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-44abc62d-2835-4568-b5fb-f322343184ee req-d24156ae-0578-4850-bf8f-1cae5d5f86f1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:02.640521 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-44abc62d-2835-4568-b5fb-f322343184ee req-d24156ae-0578-4850-bf8f-1cae5d5f86f1 service nova] Creating event network-vif-plugged:8c891c1e-4350-4942-a509-29c2369c1ede for instance 5e699e51-068b-4996-afe6-c330efd3e0b1 on n-h2-847009-3 Jul 19 23:08:02.658995 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-44abc62d-2835-4568-b5fb-f322343184ee req-d24156ae-0578-4850-bf8f-1cae5d5f86f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126191 Jul 19 23:08:02.664856 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2983/5954] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:08:02.916342 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=8 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:08:02.926216 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-06180183-a3d5-41cf-aa86-61c6ab24ee9a tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:02.927355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-06180183-a3d5-41cf-aa86-61c6ab24ee9a tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] [instance: 5e699e51-068b-4996-afe6-c330efd3e0b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:02.934744 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6aae7ebd-886f-4ecb-af44-f406443501e5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:02.941878 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-06180183-a3d5-41cf-aa86-61c6ab24ee9a tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:02.942702 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-06180183-a3d5-41cf-aa86-61c6ab24ee9a tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:02.957016 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-06180183-a3d5-41cf-aa86-61c6ab24ee9a tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:02.960101 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6aae7ebd-886f-4ecb-af44-f406443501e5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 200 len: 1229 microversion: 2.1 time: 1.039886 Jul 19 23:08:02.960287 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-06180183-a3d5-41cf-aa86-61c6ab24ee9a tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:02.966983 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2972/5955] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:01 2022] GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 1229 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:03.265552 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-d549c0ca-31a4-4e6d-a479-99cdce7a13ee req-135c326f-43c1-4fa8-85fb-acf0b02200c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a83063f9-5577-48a0-89a8-3355aab8e880", "tag": "74b241ad-99ad-40ad-b775-45e253ce6158"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:08:03.280919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d549c0ca-31a4-4e6d-a479-99cdce7a13ee req-135c326f-43c1-4fa8-85fb-acf0b02200c5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:03.281326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d549c0ca-31a4-4e6d-a479-99cdce7a13ee req-135c326f-43c1-4fa8-85fb-acf0b02200c5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:03.305861 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-d549c0ca-31a4-4e6d-a479-99cdce7a13ee req-135c326f-43c1-4fa8-85fb-acf0b02200c5 service nova] Creating event network-changed:74b241ad-99ad-40ad-b775-45e253ce6158 for instance a83063f9-5577-48a0-89a8-3355aab8e880 on n-h1-847009-3 Jul 19 23:08:03.321344 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-d549c0ca-31a4-4e6d-a479-99cdce7a13ee req-135c326f-43c1-4fa8-85fb-acf0b02200c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059702 Jul 19 23:08:03.322381 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2973/5956] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:08:03.594152 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-06180183-a3d5-41cf-aa86-61c6ab24ee9a tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f33b57a0ae49859d88fcd0e1d6f74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab4922734748e2b04e23d754ef4222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:03.604519 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-06180183-a3d5-41cf-aa86-61c6ab24ee9a tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] 10.222.0.25 "GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1" status: 200 len: 1314 microversion: 2.1 time: 0.689129 Jul 19 23:08:03.605433 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2984/5957] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:02 2022] GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1 => generated 1314 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:04.015033 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-23b6188a-dc2e-4aea-81fb-71b9b6db31ca tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:04.020396 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-23b6188a-dc2e-4aea-81fb-71b9b6db31ca tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:04.044063 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-23b6188a-dc2e-4aea-81fb-71b9b6db31ca tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:04.044931 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-23b6188a-dc2e-4aea-81fb-71b9b6db31ca tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:04.047161 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-23b6188a-dc2e-4aea-81fb-71b9b6db31ca tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:04.048262 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-23b6188a-dc2e-4aea-81fb-71b9b6db31ca tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:04.545049 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-23b6188a-dc2e-4aea-81fb-71b9b6db31ca tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:04.560241 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-23b6188a-dc2e-4aea-81fb-71b9b6db31ca tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 200 len: 1217 microversion: 2.1 time: 0.568742 Jul 19 23:08:04.560862 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2974/5958] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:03 2022] GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 1217 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:04.641709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-90bef0a6-08c5-4f7e-9415-82679c18578c tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:04.647748 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-90bef0a6-08c5-4f7e-9415-82679c18578c tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] [instance: 5e699e51-068b-4996-afe6-c330efd3e0b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:04.673850 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-90bef0a6-08c5-4f7e-9415-82679c18578c tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:04.675831 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-90bef0a6-08c5-4f7e-9415-82679c18578c tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:04.677228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-90bef0a6-08c5-4f7e-9415-82679c18578c tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:04.681398 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-90bef0a6-08c5-4f7e-9415-82679c18578c tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:05.062667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-90bef0a6-08c5-4f7e-9415-82679c18578c tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f33b57a0ae49859d88fcd0e1d6f74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab4922734748e2b04e23d754ef4222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:05.104270 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-90bef0a6-08c5-4f7e-9415-82679c18578c tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] 10.222.0.25 "GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1" status: 200 len: 1314 microversion: 2.1 time: 0.479483 Jul 19 23:08:05.114377 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2985/5959] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:04 2022] GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1 => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:05.587100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c17afd53-74f2-4a89-8365-a39d4d1b3cff tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:05.590308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c17afd53-74f2-4a89-8365-a39d4d1b3cff tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:05.640638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c17afd53-74f2-4a89-8365-a39d4d1b3cff tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:05.643000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c17afd53-74f2-4a89-8365-a39d4d1b3cff tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:05.645173 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c17afd53-74f2-4a89-8365-a39d4d1b3cff tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:05.646589 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c17afd53-74f2-4a89-8365-a39d4d1b3cff tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:05.929960 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c17afd53-74f2-4a89-8365-a39d4d1b3cff tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:05.941024 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c17afd53-74f2-4a89-8365-a39d4d1b3cff tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 200 len: 1217 microversion: 2.1 time: 0.364522 Jul 19 23:08:05.941844 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2975/5960] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:05 2022] GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 1217 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:06.122988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-542647d1-f8ab-4303-96c9-dec3100b77ee tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:06.123689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-542647d1-f8ab-4303-96c9-dec3100b77ee tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] [instance: 5e699e51-068b-4996-afe6-c330efd3e0b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:06.133931 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-542647d1-f8ab-4303-96c9-dec3100b77ee tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:06.134387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-542647d1-f8ab-4303-96c9-dec3100b77ee tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:06.135200 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-542647d1-f8ab-4303-96c9-dec3100b77ee tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:06.135865 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-542647d1-f8ab-4303-96c9-dec3100b77ee tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:06.370209 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-542647d1-f8ab-4303-96c9-dec3100b77ee tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f33b57a0ae49859d88fcd0e1d6f74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab4922734748e2b04e23d754ef4222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:06.379474 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-542647d1-f8ab-4303-96c9-dec3100b77ee tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] 10.222.0.25 "GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1" status: 200 len: 1464 microversion: 2.1 time: 0.260392 Jul 19 23:08:06.402276 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2986/5961] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:06 2022] GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1 => generated 1464 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:06.433870 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0330df37-ef4d-4bd6-93cd-287a5f3423ed tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:06.434380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0330df37-ef4d-4bd6-93cd-287a5f3423ed tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] [instance: 5e699e51-068b-4996-afe6-c330efd3e0b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:06.441387 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0330df37-ef4d-4bd6-93cd-287a5f3423ed tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:06.442073 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0330df37-ef4d-4bd6-93cd-287a5f3423ed tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:06.442872 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0330df37-ef4d-4bd6-93cd-287a5f3423ed tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:06.444001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0330df37-ef4d-4bd6-93cd-287a5f3423ed tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:06.520931 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:08:06.546113 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0330df37-ef4d-4bd6-93cd-287a5f3423ed tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] [instance: 5e699e51-068b-4996-afe6-c330efd3e0b1] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:08:06.798135 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0330df37-ef4d-4bd6-93cd-287a5f3423ed tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1" status: 204 len: 0 microversion: 2.1 time: 0.368085 Jul 19 23:08:06.799460 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2976/5962] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:08:06 2022] DELETE /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 23:08:06.809470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-184bd41e-18b0-45ec-9630-31ba138593a6 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:06.810727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-184bd41e-18b0-45ec-9630-31ba138593a6 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] [instance: 5e699e51-068b-4996-afe6-c330efd3e0b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:06.821562 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-184bd41e-18b0-45ec-9630-31ba138593a6 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:06.822434 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-184bd41e-18b0-45ec-9630-31ba138593a6 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:06.823806 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-184bd41e-18b0-45ec-9630-31ba138593a6 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:06.825494 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-184bd41e-18b0-45ec-9630-31ba138593a6 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:06.830570 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:08:06.961270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7866303d-c76a-4d5b-b535-ddf7877a6e09 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:06.962106 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7866303d-c76a-4d5b-b535-ddf7877a6e09 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:06.969350 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7866303d-c76a-4d5b-b535-ddf7877a6e09 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:06.970114 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7866303d-c76a-4d5b-b535-ddf7877a6e09 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:06.971429 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7866303d-c76a-4d5b-b535-ddf7877a6e09 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:06.972155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7866303d-c76a-4d5b-b535-ddf7877a6e09 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:07.163897 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-184bd41e-18b0-45ec-9630-31ba138593a6 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f33b57a0ae49859d88fcd0e1d6f74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab4922734748e2b04e23d754ef4222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:07.184040 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-184bd41e-18b0-45ec-9630-31ba138593a6 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] 10.222.0.25 "GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1" status: 200 len: 1470 microversion: 2.1 time: 0.379946 Jul 19 23:08:07.196350 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2987/5963] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:06 2022] GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1 => generated 1470 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:07.263154 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7866303d-c76a-4d5b-b535-ddf7877a6e09 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:07.281909 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7866303d-c76a-4d5b-b535-ddf7877a6e09 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 200 len: 1217 microversion: 2.1 time: 0.325758 Jul 19 23:08:07.283859 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2977/5964] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:06 2022] GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 1217 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:08:08.207777 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cca3a73a-17cb-4df5-bea7-f79c16aad8c9 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:08.210648 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cca3a73a-17cb-4df5-bea7-f79c16aad8c9 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] [instance: 5e699e51-068b-4996-afe6-c330efd3e0b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:08.220088 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cca3a73a-17cb-4df5-bea7-f79c16aad8c9 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:08.221147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cca3a73a-17cb-4df5-bea7-f79c16aad8c9 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:08.223293 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cca3a73a-17cb-4df5-bea7-f79c16aad8c9 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:08.223946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cca3a73a-17cb-4df5-bea7-f79c16aad8c9 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:08.308524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c4b1868a-2aa3-46f7-a6a4-91a37fded3cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:08.310563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c4b1868a-2aa3-46f7-a6a4-91a37fded3cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:08.320251 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4b1868a-2aa3-46f7-a6a4-91a37fded3cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:08.321274 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4b1868a-2aa3-46f7-a6a4-91a37fded3cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:08.322448 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4b1868a-2aa3-46f7-a6a4-91a37fded3cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:08.323289 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c4b1868a-2aa3-46f7-a6a4-91a37fded3cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:08.648646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cca3a73a-17cb-4df5-bea7-f79c16aad8c9 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f33b57a0ae49859d88fcd0e1d6f74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab4922734748e2b04e23d754ef4222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:08.657379 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cca3a73a-17cb-4df5-bea7-f79c16aad8c9 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] 10.222.0.25 "GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1" status: 200 len: 1470 microversion: 2.1 time: 0.453674 Jul 19 23:08:08.657846 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2988/5965] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:08 2022] GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1 => generated 1470 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:08.795976 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c4b1868a-2aa3-46f7-a6a4-91a37fded3cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:08.811562 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c4b1868a-2aa3-46f7-a6a4-91a37fded3cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 200 len: 1217 microversion: 2.1 time: 0.509120 Jul 19 23:08:08.813844 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2978/5966] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:08 2022] GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 1217 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:09.274468 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-2ee49c50-b379-43fd-987a-2806cad15ef3 req-9320b6f8-70c2-4c75-98f2-1c59e06cde73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e699e51-068b-4996-afe6-c330efd3e0b1", "name": "network-vif-deleted", "tag": "8c891c1e-4350-4942-a509-29c2369c1ede"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:08:09.296800 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-2ee49c50-b379-43fd-987a-2806cad15ef3 req-9320b6f8-70c2-4c75-98f2-1c59e06cde73 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:09.297078 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-2ee49c50-b379-43fd-987a-2806cad15ef3 req-9320b6f8-70c2-4c75-98f2-1c59e06cde73 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:09.326427 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-2ee49c50-b379-43fd-987a-2806cad15ef3 req-9320b6f8-70c2-4c75-98f2-1c59e06cde73 service nova] Creating event network-vif-deleted:8c891c1e-4350-4942-a509-29c2369c1ede for instance 5e699e51-068b-4996-afe6-c330efd3e0b1 on n-h2-847009-3 Jul 19 23:08:09.342640 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-2ee49c50-b379-43fd-987a-2806cad15ef3 req-9320b6f8-70c2-4c75-98f2-1c59e06cde73 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072011 Jul 19 23:08:09.343863 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2989/5967] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:08:09.675721 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0cfe2983-f165-40bc-b29d-3178e2ab8c21 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:09.676357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0cfe2983-f165-40bc-b29d-3178e2ab8c21 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] [instance: 5e699e51-068b-4996-afe6-c330efd3e0b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:09.681304 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:08:09.685139 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cfe2983-f165-40bc-b29d-3178e2ab8c21 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:09.685600 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cfe2983-f165-40bc-b29d-3178e2ab8c21 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:09.686420 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cfe2983-f165-40bc-b29d-3178e2ab8c21 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:09.686905 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cfe2983-f165-40bc-b29d-3178e2ab8c21 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:09.733862 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cfe2983-f165-40bc-b29d-3178e2ab8c21 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:09.734328 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cfe2983-f165-40bc-b29d-3178e2ab8c21 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:09.735152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-0cfe2983-f165-40bc-b29d-3178e2ab8c21 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lazy-loading 'fault' on Instance uuid 5e699e51-068b-4996-afe6-c330efd3e0b1 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:08:09.809174 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0cfe2983-f165-40bc-b29d-3178e2ab8c21 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f33b57a0ae49859d88fcd0e1d6f74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ab4922734748e2b04e23d754ef4222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:09.820660 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0cfe2983-f165-40bc-b29d-3178e2ab8c21 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] 10.222.0.25 "GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1" status: 200 len: 1304 microversion: 2.1 time: 0.147301 Jul 19 23:08:09.820660 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2979/5968] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:09 2022] GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1 => generated 1304 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:09.835517 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c8f8c014-a8e7-4473-877b-d52eed301ab5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:09.836244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c8f8c014-a8e7-4473-877b-d52eed301ab5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:09.843092 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c8f8c014-a8e7-4473-877b-d52eed301ab5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:09.843581 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c8f8c014-a8e7-4473-877b-d52eed301ab5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:09.844379 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c8f8c014-a8e7-4473-877b-d52eed301ab5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:09.844869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c8f8c014-a8e7-4473-877b-d52eed301ab5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:10.034684 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c8f8c014-a8e7-4473-877b-d52eed301ab5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:10.044172 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c8f8c014-a8e7-4473-877b-d52eed301ab5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 200 len: 1217 microversion: 2.1 time: 0.217955 Jul 19 23:08:10.045996 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2990/5969] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:09 2022] GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 1217 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:08:10.840972 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bbf59370-11df-40b6-97ce-ed0adb89a0c8 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:10.841618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bbf59370-11df-40b6-97ce-ed0adb89a0c8 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] [instance: 5e699e51-068b-4996-afe6-c330efd3e0b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:10.850760 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bbf59370-11df-40b6-97ce-ed0adb89a0c8 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:10.851149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bbf59370-11df-40b6-97ce-ed0adb89a0c8 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:10.852139 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bbf59370-11df-40b6-97ce-ed0adb89a0c8 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:10.852580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bbf59370-11df-40b6-97ce-ed0adb89a0c8 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:10.868113 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-bbf59370-11df-40b6-97ce-ed0adb89a0c8 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] HTTP exception thrown: Instance 5e699e51-068b-4996-afe6-c330efd3e0b1 could not be found. Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bbf59370-11df-40b6-97ce-ed0adb89a0c8 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Request method failure captured: Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1 HTTP/1.1 Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zlC0wBCmJUl33D4VM9Nu0IcStIdOLXoAEswpsnYR7vmCZ8U2atwBuHnvxYoz9u1R67R79fmaKKkrtCg1dtcLcnHYIqPIBIzeFsCbPCNJF-Bziee_k42QjoDDnh1XW1Xc_fQ9CaM-uYjzmwgbxltUw97RHb8sb8IYK3azzpl-QenW8s Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 36ab4922734748e2b04e23d754ef4222 Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-VolumesNegativeTest-1714511092 Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_36ab4922734748e2b04e23d754ef4222"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36ab4922734748e2b04e23d754ef4222"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/36ab4922734748e2b04e23d754ef4222"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36ab4922734748e2b04e23d754ef4222"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-VolumesNegativeTest-1714511092 Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 36ab4922734748e2b04e23d754ef4222 Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-VolumesNegativeTest-1714511092 Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-VolumesNegativeTest-1714511092-project Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: b2f33b57a0ae49859d88fcd0e1d6f74a Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-VolumesNegativeTest-1714511092-project Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 5e699e51-068b-4996-afe6-c330efd3e0b1 could not be found. Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '5e699e51-068b-4996-afe6-c330efd3e0b1'} Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e699e51-068b-4996-afe6-c330efd3e0b1 could not be found. Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e699e51-068b-4996-afe6-c330efd3e0b1 could not be found. Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:08:10.870030 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:08:10.876782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:08:10.876782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:08:10.876782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:08:10.876782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:08:10.876782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:08:10.876782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e699e51-068b-4996-afe6-c330efd3e0b1 could not be found. Jul 19 23:08:10.876782 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:08:10.876782 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bbf59370-11df-40b6-97ce-ed0adb89a0c8 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] Returning 404 to user: Instance 5e699e51-068b-4996-afe6-c330efd3e0b1 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:08:10.884133 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bbf59370-11df-40b6-97ce-ed0adb89a0c8 tempest-VolumesNegativeTest-1714511092 tempest-VolumesNegativeTest-1714511092-project] 10.222.0.25 "GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1" status: 404 len: 111 microversion: 2.1 time: 0.050974 Jul 19 23:08:10.892224 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2980/5970] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:10 2022] GET /compute/v2.1/servers/5e699e51-068b-4996-afe6-c330efd3e0b1 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:08:11.064505 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8e29dbdc-5a29-4e48-8ce7-91764b49254b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:11.065235 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8e29dbdc-5a29-4e48-8ce7-91764b49254b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:11.081425 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8e29dbdc-5a29-4e48-8ce7-91764b49254b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:11.081990 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8e29dbdc-5a29-4e48-8ce7-91764b49254b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:11.083968 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8e29dbdc-5a29-4e48-8ce7-91764b49254b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:11.085425 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8e29dbdc-5a29-4e48-8ce7-91764b49254b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:11.286126 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8e29dbdc-5a29-4e48-8ce7-91764b49254b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:11.294500 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8e29dbdc-5a29-4e48-8ce7-91764b49254b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 200 len: 1217 microversion: 2.1 time: 0.235647 Jul 19 23:08:11.304721 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2991/5971] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:11 2022] GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 1217 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:12.324010 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-adf16e9a-8055-4b84-8bac-048aff95bdce tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:12.324646 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-adf16e9a-8055-4b84-8bac-048aff95bdce tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:12.343399 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-adf16e9a-8055-4b84-8bac-048aff95bdce tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:12.344038 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-adf16e9a-8055-4b84-8bac-048aff95bdce tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:12.344983 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-adf16e9a-8055-4b84-8bac-048aff95bdce tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:12.345748 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-adf16e9a-8055-4b84-8bac-048aff95bdce tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:12.593142 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-adf16e9a-8055-4b84-8bac-048aff95bdce tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:12.603547 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-adf16e9a-8055-4b84-8bac-048aff95bdce tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 200 len: 1217 microversion: 2.1 time: 0.295967 Jul 19 23:08:12.607583 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2981/5972] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:12 2022] GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 1217 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:13.306539 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-e0c6955b-974b-4977-968c-f2f3e039b4a5 req-60311d7e-f5fd-401d-bbfc-d9c5a2c21a7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e30c02d2-1d86-4ad0-bfa4-4522aad3d73c", "name": "network-vif-plugged", "status": "completed", "tag": "204d5e7f-29dc-4964-8858-53396d7323bd"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:08:13.316649 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:08:13.327577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e0c6955b-974b-4977-968c-f2f3e039b4a5 req-60311d7e-f5fd-401d-bbfc-d9c5a2c21a7a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:13.328382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e0c6955b-974b-4977-968c-f2f3e039b4a5 req-60311d7e-f5fd-401d-bbfc-d9c5a2c21a7a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:13.343100 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-e0c6955b-974b-4977-968c-f2f3e039b4a5 req-60311d7e-f5fd-401d-bbfc-d9c5a2c21a7a service nova] Creating event network-vif-plugged:204d5e7f-29dc-4964-8858-53396d7323bd for instance e30c02d2-1d86-4ad0-bfa4-4522aad3d73c on n-h1-847009-3 Jul 19 23:08:13.349567 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-e0c6955b-974b-4977-968c-f2f3e039b4a5 req-60311d7e-f5fd-401d-bbfc-d9c5a2c21a7a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046211 Jul 19 23:08:13.350855 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2992/5973] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:08:13.623571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aa5c5f45-5ced-41b6-85e9-4022be90aa54 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:13.626444 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-aa5c5f45-5ced-41b6-85e9-4022be90aa54 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:13.637128 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa5c5f45-5ced-41b6-85e9-4022be90aa54 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:13.637831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa5c5f45-5ced-41b6-85e9-4022be90aa54 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:13.639369 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa5c5f45-5ced-41b6-85e9-4022be90aa54 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:13.639992 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aa5c5f45-5ced-41b6-85e9-4022be90aa54 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:13.909927 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-aa5c5f45-5ced-41b6-85e9-4022be90aa54 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:13.922541 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-aa5c5f45-5ced-41b6-85e9-4022be90aa54 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 200 len: 1217 microversion: 2.1 time: 0.303997 Jul 19 23:08:13.923668 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2982/5974] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:13 2022] GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 1217 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:14.944277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9ea86ba8-a954-4c4a-b66b-0970aa1e191a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:14.945007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9ea86ba8-a954-4c4a-b66b-0970aa1e191a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:14.971633 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ea86ba8-a954-4c4a-b66b-0970aa1e191a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:14.972106 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ea86ba8-a954-4c4a-b66b-0970aa1e191a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:14.973965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ea86ba8-a954-4c4a-b66b-0970aa1e191a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:14.974465 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ea86ba8-a954-4c4a-b66b-0970aa1e191a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:15.230211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9ea86ba8-a954-4c4a-b66b-0970aa1e191a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:15.243251 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9ea86ba8-a954-4c4a-b66b-0970aa1e191a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 200 len: 1404 microversion: 2.1 time: 0.305527 Jul 19 23:08:15.246783 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2993/5975] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:14 2022] GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 1404 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:15.264123 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7532629b-292a-43a1-a606-03b5a99d3dfd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:15.264744 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7532629b-292a-43a1-a606-03b5a99d3dfd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:15.275171 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7532629b-292a-43a1-a606-03b5a99d3dfd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:15.275600 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7532629b-292a-43a1-a606-03b5a99d3dfd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:15.276410 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7532629b-292a-43a1-a606-03b5a99d3dfd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:15.277013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7532629b-292a-43a1-a606-03b5a99d3dfd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:15.478098 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7532629b-292a-43a1-a606-03b5a99d3dfd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:15.489776 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7532629b-292a-43a1-a606-03b5a99d3dfd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 200 len: 1404 microversion: 2.1 time: 0.229102 Jul 19 23:08:15.490537 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2983/5976] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:15 2022] GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 1404 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:15.510051 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1cd594c4-e0b7-459a-a042-15fd892be583 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1503722899"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:08:15.511484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1cd594c4-e0b7-459a-a042-15fd892be583 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:15.518747 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1cd594c4-e0b7-459a-a042-15fd892be583 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:15.519587 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1cd594c4-e0b7-459a-a042-15fd892be583 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:15.520791 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1cd594c4-e0b7-459a-a042-15fd892be583 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:15.521301 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1cd594c4-e0b7-459a-a042-15fd892be583 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:15.694451 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.compute.api [None req-1cd594c4-e0b7-459a-a042-15fd892be583 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Attempting to quiesce instance before volume snapshot. Jul 19 23:08:15.766727 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.compute.api [None req-1cd594c4-e0b7-459a-a042-15fd892be583 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jul 19 23:08:15.877844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1cd594c4-e0b7-459a-a042-15fd892be583 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Creating snapshot from volume 7c64f6da-e455-4f0c-bdc0-a9f27cb6dbd6. {{(pid=119337) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jul 19 23:08:17.464203 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1cd594c4-e0b7-459a-a042-15fd892be583 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "POST /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c/action" status: 202 len: 0 microversion: 2.1 time: 1.959375 Jul 19 23:08:17.469282 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2994/5977] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:08:15 2022] POST /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c/action => generated 0 bytes in 1961 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 23:08:18.890699 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6610eb79-6326-498b-81cf-055ec66b51dc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-298426330", "imageRef": "3519f7d6-2a30-45eb-b30e-4486c6c700be", "flavorRef": "452", "networks": [{"uuid": "c424fcca-fcaa-49c5-9171-61018c1542cf"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:08:19.016126 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-6610eb79-6326-498b-81cf-055ec66b51dc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] validate_networks() for [('c424fcca-fcaa-49c5-9171-61018c1542cf', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:08:19.654390 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-6610eb79-6326-498b-81cf-055ec66b51dc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:08:19.655408 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-6610eb79-6326-498b-81cf-055ec66b51dc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:08:19.657159 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-6610eb79-6326-498b-81cf-055ec66b51dc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:08:19.666609 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-6610eb79-6326-498b-81cf-055ec66b51dc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:08:19.667128 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-6610eb79-6326-498b-81cf-055ec66b51dc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:08:19.687919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6610eb79-6326-498b-81cf-055ec66b51dc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:19.688385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6610eb79-6326-498b-81cf-055ec66b51dc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:19.689197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6610eb79-6326-498b-81cf-055ec66b51dc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:19.689650 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6610eb79-6326-498b-81cf-055ec66b51dc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:19.720538 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-6610eb79-6326-498b-81cf-055ec66b51dc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Getting quotas for project ba6762beb0fe4220b984143b3ea6bd48. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:08:19.738439 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-6610eb79-6326-498b-81cf-055ec66b51dc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Getting quotas for user deeb5431c1284d02b245ff3a9dc3f4e8 and project ba6762beb0fe4220b984143b3ea6bd48. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:08:19.793825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6610eb79-6326-498b-81cf-055ec66b51dc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:08:19.799686 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6610eb79-6326-498b-81cf-055ec66b51dc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='89f00445-69e5-4d0b-b743-e1c4c6193433',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:08:19.892968 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6610eb79-6326-498b-81cf-055ec66b51dc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.006654 Jul 19 23:08:19.898754 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2984/5978] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:08:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:08:19.905802 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a1de3356-5d4b-4542-98b7-275d480626b1 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:19.907089 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a1de3356-5d4b-4542-98b7-275d480626b1 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:19.984830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a1de3356-5d4b-4542-98b7-275d480626b1 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:19.993252 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a1de3356-5d4b-4542-98b7-275d480626b1 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1229 microversion: 2.1 time: 0.092713 Jul 19 23:08:19.993966 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2995/5979] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:19 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1229 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:21.014275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8ef3e8cd-d82b-448a-a9eb-a3772994b79f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:21.017398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8ef3e8cd-d82b-448a-a9eb-a3772994b79f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:21.032027 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ef3e8cd-d82b-448a-a9eb-a3772994b79f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:21.034676 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ef3e8cd-d82b-448a-a9eb-a3772994b79f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:21.035772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ef3e8cd-d82b-448a-a9eb-a3772994b79f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:21.036760 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ef3e8cd-d82b-448a-a9eb-a3772994b79f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:21.120673 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8ef3e8cd-d82b-448a-a9eb-a3772994b79f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:21.128992 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8ef3e8cd-d82b-448a-a9eb-a3772994b79f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1281 microversion: 2.1 time: 0.120926 Jul 19 23:08:21.133111 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2985/5980] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:21 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1281 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:22.150786 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5eb410b6-5124-414f-b28a-17201774fa00 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:22.152141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5eb410b6-5124-414f-b28a-17201774fa00 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:22.164874 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5eb410b6-5124-414f-b28a-17201774fa00 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:22.165623 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5eb410b6-5124-414f-b28a-17201774fa00 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:22.167792 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5eb410b6-5124-414f-b28a-17201774fa00 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:22.171471 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5eb410b6-5124-414f-b28a-17201774fa00 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:22.359236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5eb410b6-5124-414f-b28a-17201774fa00 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:22.379424 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5eb410b6-5124-414f-b28a-17201774fa00 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1299 microversion: 2.1 time: 0.232614 Jul 19 23:08:22.395570 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2996/5981] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:22 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1299 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:23.404377 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7f3b0e6a-2934-41e2-a278-701faa3aa0fc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:23.404904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7f3b0e6a-2934-41e2-a278-701faa3aa0fc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:23.414301 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7f3b0e6a-2934-41e2-a278-701faa3aa0fc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:23.415942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7f3b0e6a-2934-41e2-a278-701faa3aa0fc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:23.418624 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7f3b0e6a-2934-41e2-a278-701faa3aa0fc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:23.422319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7f3b0e6a-2934-41e2-a278-701faa3aa0fc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:23.861316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-52529331-5448-4288-8ef0-a67a8113219d tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:08:23.862345 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-52529331-5448-4288-8ef0-a67a8113219d tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: a83063f9-5577-48a0-89a8-3355aab8e880] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:23.887025 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52529331-5448-4288-8ef0-a67a8113219d tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:23.887925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52529331-5448-4288-8ef0-a67a8113219d tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:23.892290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52529331-5448-4288-8ef0-a67a8113219d tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:23.893980 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-52529331-5448-4288-8ef0-a67a8113219d tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:24.106718 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7f3b0e6a-2934-41e2-a278-701faa3aa0fc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:24.123394 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-52529331-5448-4288-8ef0-a67a8113219d tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "POST /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880/action" status: 200 len: 24565 microversion: 2.1 time: 0.267967 Jul 19 23:08:24.139415 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2997/5982] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:08:23 2022] POST /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880/action => generated 24565 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 23:08:24.140106 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7f3b0e6a-2934-41e2-a278-701faa3aa0fc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1341 microversion: 2.1 time: 0.721623 Jul 19 23:08:24.140106 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2986/5983] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:23 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1341 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:25.093820 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-d56b41e1-c28f-40cf-b46f-376de797aefc req-7e16ae53-c645-4c77-ac01-f240a74829db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55f2d7ff-6f07-495b-9ff2-c093c6542d7b", "tag": "0f1b5035-bdee-4dd8-8e92-c768cb3cb3f9"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:08:25.136729 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d56b41e1-c28f-40cf-b46f-376de797aefc req-7e16ae53-c645-4c77-ac01-f240a74829db service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:25.140734 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d56b41e1-c28f-40cf-b46f-376de797aefc req-7e16ae53-c645-4c77-ac01-f240a74829db service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:25.154369 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-95ee8800-3953-4dda-b6e4-eb719814d431 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:25.155742 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-95ee8800-3953-4dda-b6e4-eb719814d431 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:25.171434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-95ee8800-3953-4dda-b6e4-eb719814d431 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:25.183399 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-95ee8800-3953-4dda-b6e4-eb719814d431 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:25.186070 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-95ee8800-3953-4dda-b6e4-eb719814d431 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:25.187611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-95ee8800-3953-4dda-b6e4-eb719814d431 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:25.201453 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-d56b41e1-c28f-40cf-b46f-376de797aefc req-7e16ae53-c645-4c77-ac01-f240a74829db service nova] Creating event network-changed:0f1b5035-bdee-4dd8-8e92-c768cb3cb3f9 for instance 55f2d7ff-6f07-495b-9ff2-c093c6542d7b on n-h2-847009-3 Jul 19 23:08:25.227824 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-d56b41e1-c28f-40cf-b46f-376de797aefc req-7e16ae53-c645-4c77-ac01-f240a74829db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132442 Jul 19 23:08:25.228794 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2998/5984] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:08:25.609615 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-95ee8800-3953-4dda-b6e4-eb719814d431 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:25.618417 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-95ee8800-3953-4dda-b6e4-eb719814d431 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1341 microversion: 2.1 time: 0.469272 Jul 19 23:08:25.619041 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2987/5985] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:25 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1341 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:26.639076 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-47ea823c-029a-4f6f-98cb-76d1fa84d224 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:26.645546 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-47ea823c-029a-4f6f-98cb-76d1fa84d224 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:26.662049 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-47ea823c-029a-4f6f-98cb-76d1fa84d224 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:26.663194 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-47ea823c-029a-4f6f-98cb-76d1fa84d224 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:26.664550 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-47ea823c-029a-4f6f-98cb-76d1fa84d224 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:26.665318 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-47ea823c-029a-4f6f-98cb-76d1fa84d224 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:27.094700 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-47ea823c-029a-4f6f-98cb-76d1fa84d224 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:27.104191 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-47ea823c-029a-4f6f-98cb-76d1fa84d224 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1341 microversion: 2.1 time: 0.471214 Jul 19 23:08:27.114364 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 2999/5986] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:26 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1341 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:28.122411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c3e42d06-429c-4f2e-a618-42c69732417d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:28.123711 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c3e42d06-429c-4f2e-a618-42c69732417d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:28.138940 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c3e42d06-429c-4f2e-a618-42c69732417d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:28.141393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c3e42d06-429c-4f2e-a618-42c69732417d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:28.142308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c3e42d06-429c-4f2e-a618-42c69732417d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:28.142762 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c3e42d06-429c-4f2e-a618-42c69732417d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:28.489970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c3e42d06-429c-4f2e-a618-42c69732417d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:28.511899 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c3e42d06-429c-4f2e-a618-42c69732417d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1341 microversion: 2.1 time: 0.393902 Jul 19 23:08:28.512670 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2988/5987] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:28 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1341 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:29.536150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3c14b826-9569-449f-8ab5-4d326e5d2650 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:29.536926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3c14b826-9569-449f-8ab5-4d326e5d2650 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:29.545664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c14b826-9569-449f-8ab5-4d326e5d2650 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:29.546857 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c14b826-9569-449f-8ab5-4d326e5d2650 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:29.548028 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c14b826-9569-449f-8ab5-4d326e5d2650 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:29.548470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c14b826-9569-449f-8ab5-4d326e5d2650 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:29.829129 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3c14b826-9569-449f-8ab5-4d326e5d2650 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:29.838247 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3c14b826-9569-449f-8ab5-4d326e5d2650 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1341 microversion: 2.1 time: 0.305595 Jul 19 23:08:29.845024 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3000/5988] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:29 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1341 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:30.864692 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2176e1fe-a9ec-480b-9fa3-aff1b65ad7f0 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:30.865891 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2176e1fe-a9ec-480b-9fa3-aff1b65ad7f0 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:30.879838 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:08:30.881207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:08:30.884581 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2176e1fe-a9ec-480b-9fa3-aff1b65ad7f0 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:30.887419 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2176e1fe-a9ec-480b-9fa3-aff1b65ad7f0 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:30.889826 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2176e1fe-a9ec-480b-9fa3-aff1b65ad7f0 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:30.891039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2176e1fe-a9ec-480b-9fa3-aff1b65ad7f0 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:31.265088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2176e1fe-a9ec-480b-9fa3-aff1b65ad7f0 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:31.282184 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2176e1fe-a9ec-480b-9fa3-aff1b65ad7f0 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1341 microversion: 2.1 time: 0.422894 Jul 19 23:08:31.297484 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2989/5989] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:30 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1341 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:32.302276 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:08:32.309567 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3536c260-43c0-4cfb-9948-f3a19cb06427 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:32.310398 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3536c260-43c0-4cfb-9948-f3a19cb06427 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:32.319539 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3536c260-43c0-4cfb-9948-f3a19cb06427 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:32.320001 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3536c260-43c0-4cfb-9948-f3a19cb06427 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:32.321003 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3536c260-43c0-4cfb-9948-f3a19cb06427 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:32.321725 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3536c260-43c0-4cfb-9948-f3a19cb06427 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:32.529276 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3536c260-43c0-4cfb-9948-f3a19cb06427 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:32.542639 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3536c260-43c0-4cfb-9948-f3a19cb06427 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1341 microversion: 2.1 time: 0.245517 Jul 19 23:08:32.554942 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3001/5990] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:32 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1341 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:33.567362 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-433c2ce6-0916-49f5-9f2c-26c333ec3e50 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:33.568628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-433c2ce6-0916-49f5-9f2c-26c333ec3e50 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:33.592904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-433c2ce6-0916-49f5-9f2c-26c333ec3e50 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:33.593368 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-433c2ce6-0916-49f5-9f2c-26c333ec3e50 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:33.594449 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-433c2ce6-0916-49f5-9f2c-26c333ec3e50 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:33.595166 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-433c2ce6-0916-49f5-9f2c-26c333ec3e50 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:33.825876 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-433c2ce6-0916-49f5-9f2c-26c333ec3e50 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:33.860897 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-433c2ce6-0916-49f5-9f2c-26c333ec3e50 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1341 microversion: 2.1 time: 0.298514 Jul 19 23:08:33.864072 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2990/5991] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:33 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1341 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:34.889998 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-16186cfd-8c0e-469e-939f-ea4062db4df9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:34.891778 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-16186cfd-8c0e-469e-939f-ea4062db4df9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:34.901798 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-16186cfd-8c0e-469e-939f-ea4062db4df9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:34.905558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-16186cfd-8c0e-469e-939f-ea4062db4df9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:34.905558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-16186cfd-8c0e-469e-939f-ea4062db4df9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:34.910071 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-16186cfd-8c0e-469e-939f-ea4062db4df9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:35.114396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-16186cfd-8c0e-469e-939f-ea4062db4df9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:35.123496 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-16186cfd-8c0e-469e-939f-ea4062db4df9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1341 microversion: 2.1 time: 0.238068 Jul 19 23:08:35.136667 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3002/5992] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:34 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1341 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:35.259735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7f565334-ebe2-4c96-8df7-5dbacefbb528 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:08:35.260740 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7f565334-ebe2-4c96-8df7-5dbacefbb528 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: a83063f9-5577-48a0-89a8-3355aab8e880] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:35.278039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7f565334-ebe2-4c96-8df7-5dbacefbb528 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:35.278575 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7f565334-ebe2-4c96-8df7-5dbacefbb528 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:35.279585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7f565334-ebe2-4c96-8df7-5dbacefbb528 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:35.280217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7f565334-ebe2-4c96-8df7-5dbacefbb528 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:35.394256 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7f565334-ebe2-4c96-8df7-5dbacefbb528 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "POST /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880/action" status: 200 len: 32638 microversion: 2.1 time: 0.138561 Jul 19 23:08:35.399147 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2991/5993] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:08:35 2022] POST /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880/action => generated 32638 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 23:08:36.143256 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-63250f07-d48e-4111-a67d-1e5bec0a268f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:36.144406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-63250f07-d48e-4111-a67d-1e5bec0a268f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:36.157384 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63250f07-d48e-4111-a67d-1e5bec0a268f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:36.158963 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63250f07-d48e-4111-a67d-1e5bec0a268f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:36.160617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63250f07-d48e-4111-a67d-1e5bec0a268f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:36.161082 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63250f07-d48e-4111-a67d-1e5bec0a268f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:36.446221 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-63250f07-d48e-4111-a67d-1e5bec0a268f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:36.454551 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-63250f07-d48e-4111-a67d-1e5bec0a268f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1341 microversion: 2.1 time: 0.315497 Jul 19 23:08:36.461615 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3003/5994] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:36 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1341 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:08:36.923831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-91e57cfd-66d5-484e-89d4-17c94f675fb9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:36.926099 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-91e57cfd-66d5-484e-89d4-17c94f675fb9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: a83063f9-5577-48a0-89a8-3355aab8e880] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:36.927385 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-b74ef94f-4a58-497a-ab8d-2f20ea92e64e req-2d799f54-e40e-4870-a89b-d9aa94ad4f60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a83063f9-5577-48a0-89a8-3355aab8e880", "tag": "74b241ad-99ad-40ad-b775-45e253ce6158"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:08:36.936608 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b74ef94f-4a58-497a-ab8d-2f20ea92e64e req-2d799f54-e40e-4870-a89b-d9aa94ad4f60 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:36.937310 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b74ef94f-4a58-497a-ab8d-2f20ea92e64e req-2d799f54-e40e-4870-a89b-d9aa94ad4f60 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:36.942265 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:08:36.951949 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-b74ef94f-4a58-497a-ab8d-2f20ea92e64e req-2d799f54-e40e-4870-a89b-d9aa94ad4f60 service nova] Creating event network-changed:74b241ad-99ad-40ad-b775-45e253ce6158 for instance a83063f9-5577-48a0-89a8-3355aab8e880 on n-h1-847009-3 Jul 19 23:08:36.955912 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91e57cfd-66d5-484e-89d4-17c94f675fb9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:36.960336 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-b74ef94f-4a58-497a-ab8d-2f20ea92e64e req-2d799f54-e40e-4870-a89b-d9aa94ad4f60 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036884 Jul 19 23:08:36.961642 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3004/5995] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:08:36.962001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91e57cfd-66d5-484e-89d4-17c94f675fb9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:36.962903 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91e57cfd-66d5-484e-89d4-17c94f675fb9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:36.963921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-91e57cfd-66d5-484e-89d4-17c94f675fb9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:36.978703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:08:37.066289 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-91e57cfd-66d5-484e-89d4-17c94f675fb9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: a83063f9-5577-48a0-89a8-3355aab8e880] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:08:37.257332 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-91e57cfd-66d5-484e-89d4-17c94f675fb9 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880" status: 204 len: 0 microversion: 2.1 time: 0.338377 Jul 19 23:08:37.259502 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2992/5996] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:08:36 2022] DELETE /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:08:37.271584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-22fb131f-d3d9-463b-8ef3-537bccceba6b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:37.272902 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-22fb131f-d3d9-463b-8ef3-537bccceba6b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: a83063f9-5577-48a0-89a8-3355aab8e880] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:37.287739 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22fb131f-d3d9-463b-8ef3-537bccceba6b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:37.288480 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22fb131f-d3d9-463b-8ef3-537bccceba6b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:37.289452 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22fb131f-d3d9-463b-8ef3-537bccceba6b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:37.291660 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-22fb131f-d3d9-463b-8ef3-537bccceba6b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:37.474542 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f2237586-68fb-47b1-83cf-a6bfb24c5ec6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:37.475198 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f2237586-68fb-47b1-83cf-a6bfb24c5ec6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:37.485393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f2237586-68fb-47b1-83cf-a6bfb24c5ec6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:37.485853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f2237586-68fb-47b1-83cf-a6bfb24c5ec6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:37.486643 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f2237586-68fb-47b1-83cf-a6bfb24c5ec6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:37.487131 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f2237586-68fb-47b1-83cf-a6bfb24c5ec6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:37.713260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-22fb131f-d3d9-463b-8ef3-537bccceba6b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:37.730421 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-22fb131f-d3d9-463b-8ef3-537bccceba6b tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880" status: 200 len: 1673 microversion: 2.1 time: 0.462520 Jul 19 23:08:37.732397 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3005/5997] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:37 2022] GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880 => generated 1673 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:37.920778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f2237586-68fb-47b1-83cf-a6bfb24c5ec6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:37.937332 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f2237586-68fb-47b1-83cf-a6bfb24c5ec6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1341 microversion: 2.1 time: 0.467916 Jul 19 23:08:37.950845 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2993/5998] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:37 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1341 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:08:38.758255 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dd21c27e-a0da-49ed-a0b6-0f3909b01c4f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:38.759893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dd21c27e-a0da-49ed-a0b6-0f3909b01c4f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: a83063f9-5577-48a0-89a8-3355aab8e880] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:38.776575 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dd21c27e-a0da-49ed-a0b6-0f3909b01c4f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:38.776575 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dd21c27e-a0da-49ed-a0b6-0f3909b01c4f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:38.776575 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dd21c27e-a0da-49ed-a0b6-0f3909b01c4f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:38.776575 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dd21c27e-a0da-49ed-a0b6-0f3909b01c4f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:38.958772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4ada4571-c55d-4a56-8436-30f9d425db90 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:38.959806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4ada4571-c55d-4a56-8436-30f9d425db90 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:38.975281 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ada4571-c55d-4a56-8436-30f9d425db90 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:38.976232 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ada4571-c55d-4a56-8436-30f9d425db90 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:38.979278 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ada4571-c55d-4a56-8436-30f9d425db90 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:38.980188 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ada4571-c55d-4a56-8436-30f9d425db90 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:39.372888 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4ada4571-c55d-4a56-8436-30f9d425db90 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:39.389811 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4ada4571-c55d-4a56-8436-30f9d425db90 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1341 microversion: 2.1 time: 0.436644 Jul 19 23:08:39.390683 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2994/5999] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:38 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1341 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:08:39.518260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dd21c27e-a0da-49ed-a0b6-0f3909b01c4f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:39.530566 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dd21c27e-a0da-49ed-a0b6-0f3909b01c4f tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880" status: 200 len: 1673 microversion: 2.1 time: 0.776463 Jul 19 23:08:39.536727 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3006/6000] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:38 2022] GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880 => generated 1673 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:40.193220 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-5ce19faf-318d-4a97-abe2-2d22fc60a53e req-de939113-102d-4998-b9fc-fddbb0074628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83063f9-5577-48a0-89a8-3355aab8e880", "name": "network-vif-deleted", "tag": "74b241ad-99ad-40ad-b775-45e253ce6158"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:08:40.207012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:08:40.210534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5ce19faf-318d-4a97-abe2-2d22fc60a53e req-de939113-102d-4998-b9fc-fddbb0074628 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:40.211228 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5ce19faf-318d-4a97-abe2-2d22fc60a53e req-de939113-102d-4998-b9fc-fddbb0074628 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:40.227400 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-5ce19faf-318d-4a97-abe2-2d22fc60a53e req-de939113-102d-4998-b9fc-fddbb0074628 service nova] Creating event network-vif-deleted:74b241ad-99ad-40ad-b775-45e253ce6158 for instance a83063f9-5577-48a0-89a8-3355aab8e880 on n-h1-847009-3 Jul 19 23:08:40.257546 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-5ce19faf-318d-4a97-abe2-2d22fc60a53e req-de939113-102d-4998-b9fc-fddbb0074628 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070465 Jul 19 23:08:40.261182 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2995/6001] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:08:40.408050 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0114daac-0314-4f2a-9720-dc7a9eefc558 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:40.409604 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0114daac-0314-4f2a-9720-dc7a9eefc558 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:40.426966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0114daac-0314-4f2a-9720-dc7a9eefc558 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:40.427672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0114daac-0314-4f2a-9720-dc7a9eefc558 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:40.428721 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0114daac-0314-4f2a-9720-dc7a9eefc558 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:40.430837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0114daac-0314-4f2a-9720-dc7a9eefc558 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:40.577087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a37cf577-7adf-4e49-bb06-aa17f10f539c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:40.578416 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a37cf577-7adf-4e49-bb06-aa17f10f539c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: a83063f9-5577-48a0-89a8-3355aab8e880] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:40.631250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a37cf577-7adf-4e49-bb06-aa17f10f539c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:40.632887 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a37cf577-7adf-4e49-bb06-aa17f10f539c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:40.638758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a37cf577-7adf-4e49-bb06-aa17f10f539c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:40.639634 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a37cf577-7adf-4e49-bb06-aa17f10f539c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:40.819013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a37cf577-7adf-4e49-bb06-aa17f10f539c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:40.821052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a37cf577-7adf-4e49-bb06-aa17f10f539c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:40.821763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-a37cf577-7adf-4e49-bb06-aa17f10f539c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lazy-loading 'fault' on Instance uuid a83063f9-5577-48a0-89a8-3355aab8e880 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:08:41.009460 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a37cf577-7adf-4e49-bb06-aa17f10f539c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2ea35da78245bfaf9651d7afb5fe66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9370b564007740c4a619273e03c78dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:41.017910 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a37cf577-7adf-4e49-bb06-aa17f10f539c tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880" status: 200 len: 1339 microversion: 2.1 time: 0.453659 Jul 19 23:08:41.020823 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2996/6002] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:40 2022] GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880 => generated 1339 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:41.051409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0114daac-0314-4f2a-9720-dc7a9eefc558 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:41.077711 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0114daac-0314-4f2a-9720-dc7a9eefc558 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1341 microversion: 2.1 time: 0.673096 Jul 19 23:08:41.079264 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3007/6003] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:40 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1341 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:42.046610 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bce47384-0a05-45b6-be4b-9fcc377ab5b0 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:42.047173 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bce47384-0a05-45b6-be4b-9fcc377ab5b0 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] [instance: a83063f9-5577-48a0-89a8-3355aab8e880] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:42.061368 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bce47384-0a05-45b6-be4b-9fcc377ab5b0 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:42.062145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bce47384-0a05-45b6-be4b-9fcc377ab5b0 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:42.063214 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bce47384-0a05-45b6-be4b-9fcc377ab5b0 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:42.064385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bce47384-0a05-45b6-be4b-9fcc377ab5b0 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:42.089074 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-bce47384-0a05-45b6-be4b-9fcc377ab5b0 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] HTTP exception thrown: Instance a83063f9-5577-48a0-89a8-3355aab8e880 could not be found. Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bce47384-0a05-45b6-be4b-9fcc377ab5b0 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Request method failure captured: Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880 HTTP/1.1 Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1ziZAA1BzPLGaZMVWIQo4VDUH2zaknVBfSNIgtaJjDeGyhK-l1HeVjlSx-V5VkG3_ZewiQN6H33ckhz-2X-b_PGN39eEeCDrbcBiS1RnerotLvY8q3nK5icypC2ZJJoTZTGOEtwbbEQvEDp-n6TMzoOPR3guNKGp2FngGTGNUI-obCg Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 9370b564007740c4a619273e03c78dca Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TestNetworkBasicOps-879177891 Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9370b564007740c4a619273e03c78dca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9370b564007740c4a619273e03c78dca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9370b564007740c4a619273e03c78dca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9370b564007740c4a619273e03c78dca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TestNetworkBasicOps-879177891 Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 9370b564007740c4a619273e03c78dca Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TestNetworkBasicOps-879177891 Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TestNetworkBasicOps-879177891-project Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: ea2ea35da78245bfaf9651d7afb5fe66 Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TestNetworkBasicOps-879177891-project Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance a83063f9-5577-48a0-89a8-3355aab8e880 could not be found. Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'a83063f9-5577-48a0-89a8-3355aab8e880'} Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a83063f9-5577-48a0-89a8-3355aab8e880 could not be found. Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a83063f9-5577-48a0-89a8-3355aab8e880 could not be found. Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:08:42.091804 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:08:42.095746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:08:42.095746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:08:42.095746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:08:42.095746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:08:42.095746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:08:42.095746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a83063f9-5577-48a0-89a8-3355aab8e880 could not be found. Jul 19 23:08:42.095746 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:08:42.098912 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bce47384-0a05-45b6-be4b-9fcc377ab5b0 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Returning 404 to user: Instance a83063f9-5577-48a0-89a8-3355aab8e880 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:08:42.100161 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bce47384-0a05-45b6-be4b-9fcc377ab5b0 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880" status: 404 len: 111 microversion: 2.1 time: 0.058191 Jul 19 23:08:42.101253 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2997/6004] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:42 2022] GET /compute/v2.1/servers/a83063f9-5577-48a0-89a8-3355aab8e880 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:08:42.101787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9c038783-0458-420d-94ef-e8c05fdc80d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:42.102439 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9c038783-0458-420d-94ef-e8c05fdc80d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:42.117052 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9c038783-0458-420d-94ef-e8c05fdc80d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:42.117440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9c038783-0458-420d-94ef-e8c05fdc80d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:42.118307 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9c038783-0458-420d-94ef-e8c05fdc80d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:42.118777 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9c038783-0458-420d-94ef-e8c05fdc80d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:42.420859 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-278dae46-42b4-47c6-a664-f71a5c090ae2 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] Calling method '.version_select at 0x7f7a038048b0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:42.458278 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-278dae46-42b4-47c6-a664-f71a5c090ae2 tempest-TestNetworkBasicOps-879177891 tempest-TestNetworkBasicOps-879177891-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1047088018" status: 202 len: 0 microversion: 2.1 time: 0.042085 Jul 19 23:08:42.459471 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2998/6005] 10.222.0.25 () {58 vars in 1256 bytes} [Tue Jul 19 23:08:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1047088018 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 23:08:42.571504 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9c038783-0458-420d-94ef-e8c05fdc80d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:42.579365 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9c038783-0458-420d-94ef-e8c05fdc80d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1341 microversion: 2.1 time: 0.481562 Jul 19 23:08:42.579955 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3008/6006] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:42 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1341 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:08:43.598134 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-81720b75-4df1-468f-baa8-7508862e6832 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:43.599580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-81720b75-4df1-468f-baa8-7508862e6832 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:43.622684 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81720b75-4df1-468f-baa8-7508862e6832 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:43.623998 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81720b75-4df1-468f-baa8-7508862e6832 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:43.628617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81720b75-4df1-468f-baa8-7508862e6832 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:43.629666 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81720b75-4df1-468f-baa8-7508862e6832 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:43.942235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-81720b75-4df1-468f-baa8-7508862e6832 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:43.952959 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-81720b75-4df1-468f-baa8-7508862e6832 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1341 microversion: 2.1 time: 0.360105 Jul 19 23:08:43.953928 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 2999/6007] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:43 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1341 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:44.972923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-46c8eaaa-7b5c-429c-98a7-dd9e08327033 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:44.973573 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-46c8eaaa-7b5c-429c-98a7-dd9e08327033 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:44.987559 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=36 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:08:44.991919 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46c8eaaa-7b5c-429c-98a7-dd9e08327033 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:44.992486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46c8eaaa-7b5c-429c-98a7-dd9e08327033 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:44.996262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46c8eaaa-7b5c-429c-98a7-dd9e08327033 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:44.996720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-46c8eaaa-7b5c-429c-98a7-dd9e08327033 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:45.235507 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-46c8eaaa-7b5c-429c-98a7-dd9e08327033 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:45.245261 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-46c8eaaa-7b5c-429c-98a7-dd9e08327033 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1341 microversion: 2.1 time: 0.276855 Jul 19 23:08:45.245852 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3009/6008] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:44 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1341 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:46.263692 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c0922785-5047-4011-a2cc-d13e8227ecbe tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:46.265004 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c0922785-5047-4011-a2cc-d13e8227ecbe tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:46.273314 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0922785-5047-4011-a2cc-d13e8227ecbe tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:46.281466 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0922785-5047-4011-a2cc-d13e8227ecbe tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:46.284194 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0922785-5047-4011-a2cc-d13e8227ecbe tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:46.291839 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0922785-5047-4011-a2cc-d13e8227ecbe tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:46.546462 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c0922785-5047-4011-a2cc-d13e8227ecbe tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:46.571532 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c0922785-5047-4011-a2cc-d13e8227ecbe tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1341 microversion: 2.1 time: 0.312286 Jul 19 23:08:46.572901 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3000/6009] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:46 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1341 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:47.591774 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8b7b262b-2748-4418-83e4-3deaeda47d54 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:47.592590 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8b7b262b-2748-4418-83e4-3deaeda47d54 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:47.606174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b7b262b-2748-4418-83e4-3deaeda47d54 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:47.608145 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b7b262b-2748-4418-83e4-3deaeda47d54 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:47.614280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b7b262b-2748-4418-83e4-3deaeda47d54 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:47.614957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b7b262b-2748-4418-83e4-3deaeda47d54 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:48.152788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8b7b262b-2748-4418-83e4-3deaeda47d54 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:48.170759 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8b7b262b-2748-4418-83e4-3deaeda47d54 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1341 microversion: 2.1 time: 0.583641 Jul 19 23:08:48.179843 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3010/6010] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:47 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1341 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:49.202003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-78310a65-9720-4456-a409-e60ccdcdec2d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:49.202663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-78310a65-9720-4456-a409-e60ccdcdec2d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:49.210774 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78310a65-9720-4456-a409-e60ccdcdec2d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:49.211473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78310a65-9720-4456-a409-e60ccdcdec2d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:49.212459 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78310a65-9720-4456-a409-e60ccdcdec2d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:49.213419 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78310a65-9720-4456-a409-e60ccdcdec2d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:49.562421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-78310a65-9720-4456-a409-e60ccdcdec2d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:49.577232 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-78310a65-9720-4456-a409-e60ccdcdec2d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1341 microversion: 2.1 time: 0.378224 Jul 19 23:08:49.583499 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3001/6011] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:49 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1341 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:50.594810 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0049352a-1339-47e8-80ee-0b8b2728042f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:50.596177 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0049352a-1339-47e8-80ee-0b8b2728042f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:50.604746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0049352a-1339-47e8-80ee-0b8b2728042f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:50.605474 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0049352a-1339-47e8-80ee-0b8b2728042f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:50.606385 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0049352a-1339-47e8-80ee-0b8b2728042f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:50.606844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0049352a-1339-47e8-80ee-0b8b2728042f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:50.841803 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0049352a-1339-47e8-80ee-0b8b2728042f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:50.851331 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0049352a-1339-47e8-80ee-0b8b2728042f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1375 microversion: 2.1 time: 0.260543 Jul 19 23:08:50.852485 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3011/6012] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:50 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1375 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:51.870563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-616a6c74-611c-42c5-a59b-3cfc1102d098 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:51.871309 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-616a6c74-611c-42c5-a59b-3cfc1102d098 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:51.895189 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-616a6c74-611c-42c5-a59b-3cfc1102d098 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:51.895680 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-616a6c74-611c-42c5-a59b-3cfc1102d098 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:51.896453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-616a6c74-611c-42c5-a59b-3cfc1102d098 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:51.896914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-616a6c74-611c-42c5-a59b-3cfc1102d098 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:52.160922 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-616a6c74-611c-42c5-a59b-3cfc1102d098 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:52.170182 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-616a6c74-611c-42c5-a59b-3cfc1102d098 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1375 microversion: 2.1 time: 0.302779 Jul 19 23:08:52.181047 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3002/6013] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:51 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1375 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:53.186962 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c46de625-b386-4cba-b2dd-fa702e3cdef4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:53.187646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c46de625-b386-4cba-b2dd-fa702e3cdef4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:53.195246 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c46de625-b386-4cba-b2dd-fa702e3cdef4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:53.195910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c46de625-b386-4cba-b2dd-fa702e3cdef4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:53.196906 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c46de625-b386-4cba-b2dd-fa702e3cdef4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:53.197538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c46de625-b386-4cba-b2dd-fa702e3cdef4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:53.403357 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c46de625-b386-4cba-b2dd-fa702e3cdef4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:53.413737 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c46de625-b386-4cba-b2dd-fa702e3cdef4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1375 microversion: 2.1 time: 0.230604 Jul 19 23:08:53.414716 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3012/6014] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:53 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1375 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:54.436194 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-275b1559-8260-4f65-9ee5-352211dc4dfb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:54.437117 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-275b1559-8260-4f65-9ee5-352211dc4dfb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:54.446383 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-275b1559-8260-4f65-9ee5-352211dc4dfb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:54.446978 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-275b1559-8260-4f65-9ee5-352211dc4dfb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:54.448155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-275b1559-8260-4f65-9ee5-352211dc4dfb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:54.448827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-275b1559-8260-4f65-9ee5-352211dc4dfb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:54.808058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-275b1559-8260-4f65-9ee5-352211dc4dfb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:54.836383 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-275b1559-8260-4f65-9ee5-352211dc4dfb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1375 microversion: 2.1 time: 0.406840 Jul 19 23:08:54.837649 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3003/6015] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:54 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1375 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:55.857901 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-45106fe0-7c69-405e-8e38-a99c3ccabe81 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:55.858532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-45106fe0-7c69-405e-8e38-a99c3ccabe81 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:55.869879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45106fe0-7c69-405e-8e38-a99c3ccabe81 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:55.870354 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45106fe0-7c69-405e-8e38-a99c3ccabe81 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:55.871178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45106fe0-7c69-405e-8e38-a99c3ccabe81 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:55.871636 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-45106fe0-7c69-405e-8e38-a99c3ccabe81 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:56.233609 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-45106fe0-7c69-405e-8e38-a99c3ccabe81 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:56.246387 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-45106fe0-7c69-405e-8e38-a99c3ccabe81 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1375 microversion: 2.1 time: 0.392276 Jul 19 23:08:56.246793 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3013/6016] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:55 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1375 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:57.273257 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a1e174e9-5d94-4584-bcdb-b531a12a4dea tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:57.275658 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a1e174e9-5d94-4584-bcdb-b531a12a4dea tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:57.295772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1e174e9-5d94-4584-bcdb-b531a12a4dea tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:57.297338 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1e174e9-5d94-4584-bcdb-b531a12a4dea tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:57.299296 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1e174e9-5d94-4584-bcdb-b531a12a4dea tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:57.300229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a1e174e9-5d94-4584-bcdb-b531a12a4dea tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:57.649784 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a1e174e9-5d94-4584-bcdb-b531a12a4dea tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:57.662207 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a1e174e9-5d94-4584-bcdb-b531a12a4dea tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1375 microversion: 2.1 time: 0.400973 Jul 19 23:08:57.664411 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3004/6017] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:57 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1375 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:58.680491 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-87de1d64-bd84-4d44-8c81-b7b0af28681d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:58.681769 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-87de1d64-bd84-4d44-8c81-b7b0af28681d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:58.689605 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-87de1d64-bd84-4d44-8c81-b7b0af28681d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:58.690404 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-87de1d64-bd84-4d44-8c81-b7b0af28681d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:58.691492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-87de1d64-bd84-4d44-8c81-b7b0af28681d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:58.692167 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-87de1d64-bd84-4d44-8c81-b7b0af28681d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:58.879101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-87de1d64-bd84-4d44-8c81-b7b0af28681d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:08:58.889175 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-87de1d64-bd84-4d44-8c81-b7b0af28681d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1375 microversion: 2.1 time: 0.212417 Jul 19 23:08:58.916754 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3014/6018] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:58 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1375 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:08:59.909307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-003da0c2-0c5d-44d4-8047-6095d534961b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:08:59.909935 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-003da0c2-0c5d-44d4-8047-6095d534961b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:08:59.921143 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-003da0c2-0c5d-44d4-8047-6095d534961b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:59.922096 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-003da0c2-0c5d-44d4-8047-6095d534961b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:08:59.925594 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-003da0c2-0c5d-44d4-8047-6095d534961b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:08:59.926108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-003da0c2-0c5d-44d4-8047-6095d534961b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:00.229235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-003da0c2-0c5d-44d4-8047-6095d534961b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:09:00.243596 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-003da0c2-0c5d-44d4-8047-6095d534961b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1375 microversion: 2.1 time: 0.339439 Jul 19 23:09:00.253219 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3005/6019] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:08:59 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1375 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:01.268982 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-35b3076a-1ebe-4ea7-bb38-4cacda679b79 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:01.269679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-ba001a10-634c-4678-9127-4163ed44ae2e req-f869a32d-af48-432e-9ba4-f175c48424ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55f2d7ff-6f07-495b-9ff2-c093c6542d7b", "name": "network-vif-plugged", "status": "completed", "tag": "0f1b5035-bdee-4dd8-8e92-c768cb3cb3f9"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:09:01.274325 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-35b3076a-1ebe-4ea7-bb38-4cacda679b79 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:01.303581 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-ba001a10-634c-4678-9127-4163ed44ae2e req-f869a32d-af48-432e-9ba4-f175c48424ea service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:01.304190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-35b3076a-1ebe-4ea7-bb38-4cacda679b79 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:01.304681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-35b3076a-1ebe-4ea7-bb38-4cacda679b79 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:01.305529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-35b3076a-1ebe-4ea7-bb38-4cacda679b79 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:01.305988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-35b3076a-1ebe-4ea7-bb38-4cacda679b79 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:01.307208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-ba001a10-634c-4678-9127-4163ed44ae2e req-f869a32d-af48-432e-9ba4-f175c48424ea service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:01.358853 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-ba001a10-634c-4678-9127-4163ed44ae2e req-f869a32d-af48-432e-9ba4-f175c48424ea service nova] Creating event network-vif-plugged:0f1b5035-bdee-4dd8-8e92-c768cb3cb3f9 for instance 55f2d7ff-6f07-495b-9ff2-c093c6542d7b on n-h2-847009-3 Jul 19 23:09:01.374353 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-ba001a10-634c-4678-9127-4163ed44ae2e req-f869a32d-af48-432e-9ba4-f175c48424ea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107790 Jul 19 23:09:01.377345 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3006/6020] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:09:01.996437 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-35b3076a-1ebe-4ea7-bb38-4cacda679b79 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:09:02.007487 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-35b3076a-1ebe-4ea7-bb38-4cacda679b79 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1375 microversion: 2.1 time: 0.749447 Jul 19 23:09:02.015670 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3015/6021] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:01 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1375 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:03.038252 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fc8599a9-d071-4ec9-b1fe-73d6eb29dd13 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:03.040103 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fc8599a9-d071-4ec9-b1fe-73d6eb29dd13 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:03.080629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc8599a9-d071-4ec9-b1fe-73d6eb29dd13 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:03.081468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc8599a9-d071-4ec9-b1fe-73d6eb29dd13 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:03.084044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc8599a9-d071-4ec9-b1fe-73d6eb29dd13 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:03.084736 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fc8599a9-d071-4ec9-b1fe-73d6eb29dd13 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:03.692302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fc8599a9-d071-4ec9-b1fe-73d6eb29dd13 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:09:03.701448 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fc8599a9-d071-4ec9-b1fe-73d6eb29dd13 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1375 microversion: 2.1 time: 0.670979 Jul 19 23:09:03.702047 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3007/6022] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:03 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1375 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:04.725680 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e5c6e23f-6d3f-4ec5-a261-0fcff53b8950 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:04.726334 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e5c6e23f-6d3f-4ec5-a261-0fcff53b8950 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:04.739700 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5c6e23f-6d3f-4ec5-a261-0fcff53b8950 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:04.741448 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5c6e23f-6d3f-4ec5-a261-0fcff53b8950 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:04.742438 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5c6e23f-6d3f-4ec5-a261-0fcff53b8950 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:04.746137 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e5c6e23f-6d3f-4ec5-a261-0fcff53b8950 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:05.142800 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e5c6e23f-6d3f-4ec5-a261-0fcff53b8950 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:09:05.154935 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e5c6e23f-6d3f-4ec5-a261-0fcff53b8950 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1561 microversion: 2.1 time: 0.435671 Jul 19 23:09:05.165100 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3016/6023] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:04 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1561 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:05.181656 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-738e2a6a-24cd-4daf-bca1-87d57abde067 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:05.182368 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-738e2a6a-24cd-4daf-bca1-87d57abde067 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:05.198545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-738e2a6a-24cd-4daf-bca1-87d57abde067 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:05.199211 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-738e2a6a-24cd-4daf-bca1-87d57abde067 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:05.200027 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-738e2a6a-24cd-4daf-bca1-87d57abde067 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:05.200583 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-738e2a6a-24cd-4daf-bca1-87d57abde067 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:05.475442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-738e2a6a-24cd-4daf-bca1-87d57abde067 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:09:05.504409 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-738e2a6a-24cd-4daf-bca1-87d57abde067 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1561 microversion: 2.1 time: 0.326488 Jul 19 23:09:05.507572 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3008/6024] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:05 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1561 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:05.631620 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0783e6b0-6851-4605-8f30-e90debaab54c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:05.632148 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0783e6b0-6851-4605-8f30-e90debaab54c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:05.643898 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0783e6b0-6851-4605-8f30-e90debaab54c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:05.644362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0783e6b0-6851-4605-8f30-e90debaab54c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:05.645240 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0783e6b0-6851-4605-8f30-e90debaab54c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:05.645705 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0783e6b0-6851-4605-8f30-e90debaab54c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:05.716630 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0783e6b0-6851-4605-8f30-e90debaab54c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:09:05.912248 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0783e6b0-6851-4605-8f30-e90debaab54c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "DELETE /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 204 len: 0 microversion: 2.1 time: 0.284465 Jul 19 23:09:05.914646 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3017/6025] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:09:05 2022] DELETE /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:09:05.925028 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b899449d-ff85-414f-8835-a3ac62a69573 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:05.925671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b899449d-ff85-414f-8835-a3ac62a69573 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:05.935886 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b899449d-ff85-414f-8835-a3ac62a69573 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:05.936351 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b899449d-ff85-414f-8835-a3ac62a69573 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:05.937167 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b899449d-ff85-414f-8835-a3ac62a69573 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:05.937763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b899449d-ff85-414f-8835-a3ac62a69573 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:06.384594 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b899449d-ff85-414f-8835-a3ac62a69573 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:09:06.387347 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:09:06.396911 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b899449d-ff85-414f-8835-a3ac62a69573 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1567 microversion: 2.1 time: 0.477802 Jul 19 23:09:06.397510 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3009/6026] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:05 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1567 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:07.418474 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f75d15ab-5e4b-4b72-a6d4-b71e28d09ac7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:07.419171 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f75d15ab-5e4b-4b72-a6d4-b71e28d09ac7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:07.442208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f75d15ab-5e4b-4b72-a6d4-b71e28d09ac7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:07.442208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f75d15ab-5e4b-4b72-a6d4-b71e28d09ac7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:07.472411 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f75d15ab-5e4b-4b72-a6d4-b71e28d09ac7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:07.475753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f75d15ab-5e4b-4b72-a6d4-b71e28d09ac7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:07.521823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:09:07.939214 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f75d15ab-5e4b-4b72-a6d4-b71e28d09ac7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:09:07.950499 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f75d15ab-5e4b-4b72-a6d4-b71e28d09ac7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1567 microversion: 2.1 time: 0.536336 Jul 19 23:09:07.961108 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3018/6027] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:07 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1567 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:08.741048 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-af5faf2e-7407-43cc-a5f7-9bffd80236d8 req-7e645438-3e85-4ba9-8109-2d3c111f20cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55f2d7ff-6f07-495b-9ff2-c093c6542d7b", "name": "network-vif-deleted", "tag": "0f1b5035-bdee-4dd8-8e92-c768cb3cb3f9"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:09:08.765773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-af5faf2e-7407-43cc-a5f7-9bffd80236d8 req-7e645438-3e85-4ba9-8109-2d3c111f20cf service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:08.768837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-af5faf2e-7407-43cc-a5f7-9bffd80236d8 req-7e645438-3e85-4ba9-8109-2d3c111f20cf service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:08.825191 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-af5faf2e-7407-43cc-a5f7-9bffd80236d8 req-7e645438-3e85-4ba9-8109-2d3c111f20cf service nova] Creating event network-vif-deleted:0f1b5035-bdee-4dd8-8e92-c768cb3cb3f9 for instance 55f2d7ff-6f07-495b-9ff2-c093c6542d7b on n-h2-847009-3 Jul 19 23:09:08.837180 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-af5faf2e-7407-43cc-a5f7-9bffd80236d8 req-7e645438-3e85-4ba9-8109-2d3c111f20cf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103424 Jul 19 23:09:08.839788 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3010/6028] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:09:08.970446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-297de46a-b6c3-47cf-ae85-cd450fa6631d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:08.972097 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-297de46a-b6c3-47cf-ae85-cd450fa6631d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:08.993135 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-297de46a-b6c3-47cf-ae85-cd450fa6631d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:08.994343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-297de46a-b6c3-47cf-ae85-cd450fa6631d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:08.997782 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-297de46a-b6c3-47cf-ae85-cd450fa6631d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:09.000342 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-297de46a-b6c3-47cf-ae85-cd450fa6631d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:09.253137 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-297de46a-b6c3-47cf-ae85-cd450fa6631d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:09:09.272331 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-297de46a-b6c3-47cf-ae85-cd450fa6631d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1360 microversion: 2.1 time: 0.307222 Jul 19 23:09:09.288328 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3019/6029] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:08 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1360 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:10.304533 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d12284bf-e415-487e-9c29-a04f0c936505 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:10.306252 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d12284bf-e415-487e-9c29-a04f0c936505 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:10.316728 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d12284bf-e415-487e-9c29-a04f0c936505 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:10.317716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d12284bf-e415-487e-9c29-a04f0c936505 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:10.318841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d12284bf-e415-487e-9c29-a04f0c936505 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:10.319803 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d12284bf-e415-487e-9c29-a04f0c936505 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:10.546365 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d12284bf-e415-487e-9c29-a04f0c936505 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:09:10.561231 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d12284bf-e415-487e-9c29-a04f0c936505 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1360 microversion: 2.1 time: 0.263702 Jul 19 23:09:10.577980 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3011/6030] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:10 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1360 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:11.582922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-24f629d4-4d27-4ed2-aa1f-4c0c5af85c74 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:11.584451 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-24f629d4-4d27-4ed2-aa1f-4c0c5af85c74 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:11.600510 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-24f629d4-4d27-4ed2-aa1f-4c0c5af85c74 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:11.602374 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-24f629d4-4d27-4ed2-aa1f-4c0c5af85c74 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:11.603546 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-24f629d4-4d27-4ed2-aa1f-4c0c5af85c74 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:11.605896 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-24f629d4-4d27-4ed2-aa1f-4c0c5af85c74 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:11.950846 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-24f629d4-4d27-4ed2-aa1f-4c0c5af85c74 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:09:11.969864 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-24f629d4-4d27-4ed2-aa1f-4c0c5af85c74 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1360 microversion: 2.1 time: 0.391744 Jul 19 23:09:11.974335 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3020/6031] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:11 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1360 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:12.992281 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-650153f0-c360-483c-9775-3e715f0ab395 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:13.005743 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-650153f0-c360-483c-9775-3e715f0ab395 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:13.021240 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:09:13.026294 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-650153f0-c360-483c-9775-3e715f0ab395 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:13.027264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-650153f0-c360-483c-9775-3e715f0ab395 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:13.028636 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-650153f0-c360-483c-9775-3e715f0ab395 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:13.029292 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-650153f0-c360-483c-9775-3e715f0ab395 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:13.298636 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-650153f0-c360-483c-9775-3e715f0ab395 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:09:13.314590 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-650153f0-c360-483c-9775-3e715f0ab395 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1360 microversion: 2.1 time: 0.327793 Jul 19 23:09:13.320332 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3012/6032] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:12 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1360 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:14.337446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0aef670d-5787-4731-8a41-c7c4234507c4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:14.338884 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0aef670d-5787-4731-8a41-c7c4234507c4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:14.353299 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0aef670d-5787-4731-8a41-c7c4234507c4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:14.356832 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0aef670d-5787-4731-8a41-c7c4234507c4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:14.360755 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0aef670d-5787-4731-8a41-c7c4234507c4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:14.361215 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0aef670d-5787-4731-8a41-c7c4234507c4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:14.841060 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0aef670d-5787-4731-8a41-c7c4234507c4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:09:14.855184 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0aef670d-5787-4731-8a41-c7c4234507c4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1360 microversion: 2.1 time: 0.520518 Jul 19 23:09:14.855950 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3021/6033] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:14 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1360 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:15.876663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a221b87a-9b47-4194-afd1-2463c1f6f4c0 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:15.877448 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a221b87a-9b47-4194-afd1-2463c1f6f4c0 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:15.904343 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a221b87a-9b47-4194-afd1-2463c1f6f4c0 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:15.904759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a221b87a-9b47-4194-afd1-2463c1f6f4c0 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:15.905473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a221b87a-9b47-4194-afd1-2463c1f6f4c0 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:15.906153 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a221b87a-9b47-4194-afd1-2463c1f6f4c0 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:16.733287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a221b87a-9b47-4194-afd1-2463c1f6f4c0 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:09:16.744877 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a221b87a-9b47-4194-afd1-2463c1f6f4c0 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1360 microversion: 2.1 time: 0.872705 Jul 19 23:09:16.746060 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3013/6034] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:15 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1360 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:16.959537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cc52dc9e-2e21-480d-9baa-c4556f287c5e tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:16.960740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cc52dc9e-2e21-480d-9baa-c4556f287c5e tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] [instance: 64af567b-0dec-4673-bc8e-8424ec877b65] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:16.972681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:09:16.981281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc52dc9e-2e21-480d-9baa-c4556f287c5e tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:16.984490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc52dc9e-2e21-480d-9baa-c4556f287c5e tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:16.988280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc52dc9e-2e21-480d-9baa-c4556f287c5e tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:16.989720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc52dc9e-2e21-480d-9baa-c4556f287c5e tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:17.206963 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-cc52dc9e-2e21-480d-9baa-c4556f287c5e tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lazy-loading 'services' on Instance uuid 64af567b-0dec-4673-bc8e-8424ec877b65 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:09:17.440638 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cc52dc9e-2e21-480d-9baa-c4556f287c5e tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] 10.222.0.25 "DELETE /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65/os-volume_attachments/93a3844c-f1b4-4c04-905d-738860f58ab9" status: 202 len: 0 microversion: 2.1 time: 0.483235 Jul 19 23:09:17.441330 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3022/6035] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 19 23:09:16 2022] DELETE /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65/os-volume_attachments/93a3844c-f1b4-4c04-905d-738860f58ab9 => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:09:17.762295 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e83c33ad-c412-48f6-aaea-5b4590bcc49d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:17.762913 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e83c33ad-c412-48f6-aaea-5b4590bcc49d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:17.784453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e83c33ad-c412-48f6-aaea-5b4590bcc49d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:17.786052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e83c33ad-c412-48f6-aaea-5b4590bcc49d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:17.789037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e83c33ad-c412-48f6-aaea-5b4590bcc49d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:17.790652 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e83c33ad-c412-48f6-aaea-5b4590bcc49d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:18.213301 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e83c33ad-c412-48f6-aaea-5b4590bcc49d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:09:18.255073 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e83c33ad-c412-48f6-aaea-5b4590bcc49d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1360 microversion: 2.1 time: 0.492316 Jul 19 23:09:18.261063 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3014/6036] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:17 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1360 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:19.292666 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5ba9bd83-43bb-4373-9973-0b1887bcfbf8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:19.293418 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5ba9bd83-43bb-4373-9973-0b1887bcfbf8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:19.329582 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ba9bd83-43bb-4373-9973-0b1887bcfbf8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:19.338839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ba9bd83-43bb-4373-9973-0b1887bcfbf8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:19.339901 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ba9bd83-43bb-4373-9973-0b1887bcfbf8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:19.343936 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ba9bd83-43bb-4373-9973-0b1887bcfbf8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:19.522603 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5ba9bd83-43bb-4373-9973-0b1887bcfbf8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:09:19.537647 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5ba9bd83-43bb-4373-9973-0b1887bcfbf8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 200 len: 1360 microversion: 2.1 time: 0.253101 Jul 19 23:09:19.539025 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3023/6037] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:19 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 1360 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:20.055264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fb05d731-4a05-4b83-8fd1-4e2d4d45935b tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:20.063141 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 23:09:20.063141 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 23:09:20.065005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fb05d731-4a05-4b83-8fd1-4e2d4d45935b tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:20.065617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fb05d731-4a05-4b83-8fd1-4e2d4d45935b tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:20.080329 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fb05d731-4a05-4b83-8fd1-4e2d4d45935b tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:20.083300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fb05d731-4a05-4b83-8fd1-4e2d4d45935b tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:20.133808 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fb05d731-4a05-4b83-8fd1-4e2d4d45935b tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.426792 Jul 19 23:09:20.135185 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3015/6038] 10.222.0.25 () {58 vars in 1184 bytes} [Tue Jul 19 23:09:19 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:09:20.298598 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0d91986d-b7da-42cf-a13b-5432cce24686 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1330957164", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "availability_zone": "nova:n-h1-847009-3", "networks": [{"uuid": "dd0148c3-2669-496c-99eb-62876ca51d69"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:09:20.426338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-0d91986d-b7da-42cf-a13b-5432cce24686 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] validate_networks() for [('dd0148c3-2669-496c-99eb-62876ca51d69', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:09:20.556778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-df2f168a-de34-4738-aa68-05efe32faf0d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:20.563473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-df2f168a-de34-4738-aa68-05efe32faf0d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:20.574260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-df2f168a-de34-4738-aa68-05efe32faf0d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:20.575050 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-df2f168a-de34-4738-aa68-05efe32faf0d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:20.576651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-df2f168a-de34-4738-aa68-05efe32faf0d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:20.578096 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-df2f168a-de34-4738-aa68-05efe32faf0d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:20.605746 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-df2f168a-de34-4738-aa68-05efe32faf0d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] HTTP exception thrown: Instance 55f2d7ff-6f07-495b-9ff2-c093c6542d7b could not be found. Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-df2f168a-de34-4738-aa68-05efe32faf0d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Request method failure captured: Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b HTTP/1.1 Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zh6YPXnZEfL25DbrOo5AahkBCmHYOrAvKJnhgzQ9JlHxbrun4XI2EwE2n1nf4tgNFUaArqBEbFq4Toj7uUUuANo7JRuxksIEPvDD1AFl7fhy2XFxh_IYAhLXnE4PI4_QoyTOcOGpDghFYkpTUUI4xKODXHZZ1_feIKHlU2SknrcKPQ Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: deeb5431c1284d02b245ff3a9dc3f4e8 Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 55f2d7ff-6f07-495b-9ff2-c093c6542d7b could not be found. Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '55f2d7ff-6f07-495b-9ff2-c093c6542d7b'} Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55f2d7ff-6f07-495b-9ff2-c093c6542d7b could not be found. Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55f2d7ff-6f07-495b-9ff2-c093c6542d7b could not be found. Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:09:20.608951 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:09:20.613632 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:09:20.613632 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:09:20.613632 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:09:20.613632 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:09:20.613632 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:09:20.613632 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55f2d7ff-6f07-495b-9ff2-c093c6542d7b could not be found. Jul 19 23:09:20.613632 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:09:20.616156 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-df2f168a-de34-4738-aa68-05efe32faf0d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Returning 404 to user: Instance 55f2d7ff-6f07-495b-9ff2-c093c6542d7b could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:09:20.617248 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-df2f168a-de34-4738-aa68-05efe32faf0d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 404 len: 111 microversion: 2.1 time: 0.065248 Jul 19 23:09:20.621550 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3016/6039] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:20 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:09:21.237766 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-0d91986d-b7da-42cf-a13b-5432cce24686 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:09:21.238280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-0d91986d-b7da-42cf-a13b-5432cce24686 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:09:21.239227 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-0d91986d-b7da-42cf-a13b-5432cce24686 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:09:21.239672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-0d91986d-b7da-42cf-a13b-5432cce24686 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:09:21.240099 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-0d91986d-b7da-42cf-a13b-5432cce24686 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:09:21.259583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d91986d-b7da-42cf-a13b-5432cce24686 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:21.260338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d91986d-b7da-42cf-a13b-5432cce24686 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:21.261335 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d91986d-b7da-42cf-a13b-5432cce24686 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:21.262566 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0d91986d-b7da-42cf-a13b-5432cce24686 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:21.309537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-0d91986d-b7da-42cf-a13b-5432cce24686 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Getting quotas for project d7238e556f244143a9b2cf8a198109b6. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:09:21.332405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-0d91986d-b7da-42cf-a13b-5432cce24686 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Getting quotas for user 84ddc7d4accc4a3d9e973fb64b32544c and project d7238e556f244143a9b2cf8a198109b6. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:09:21.368944 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0d91986d-b7da-42cf-a13b-5432cce24686 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:09:21.371336 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0d91986d-b7da-42cf-a13b-5432cce24686 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: 23d22800-6cad-43bd-97a7-30c7bf29d2f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:09:21.465223 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0d91986d-b7da-42cf-a13b-5432cce24686 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.171332 Jul 19 23:09:21.468286 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3024/6040] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:09:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:09:21.478755 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6734b98c-9b92-4c1f-9381-84f3cf60f3ff tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:21.480283 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6734b98c-9b92-4c1f-9381-84f3cf60f3ff tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: 23d22800-6cad-43bd-97a7-30c7bf29d2f9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:21.661045 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6734b98c-9b92-4c1f-9381-84f3cf60f3ff tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9" status: 200 len: 1329 microversion: 2.1 time: 0.182574 Jul 19 23:09:21.662141 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3017/6041] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:21 2022] GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9 => generated 1329 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:22.677795 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-767dae44-c937-4589-bbda-b28eecda111e tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:22.679249 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-767dae44-c937-4589-bbda-b28eecda111e tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: 23d22800-6cad-43bd-97a7-30c7bf29d2f9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:22.697167 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-767dae44-c937-4589-bbda-b28eecda111e tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:22.697873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-767dae44-c937-4589-bbda-b28eecda111e tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:22.699925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-767dae44-c937-4589-bbda-b28eecda111e tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:22.705378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-767dae44-c937-4589-bbda-b28eecda111e tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:22.887851 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-767dae44-c937-4589-bbda-b28eecda111e tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9" status: 200 len: 1338 microversion: 2.1 time: 0.213722 Jul 19 23:09:22.888736 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3025/6042] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:22 2022] GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9 => generated 1338 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:23.907213 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2f1ef6a2-8c47-44d5-a0f3-a93ce3579695 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:23.909715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2f1ef6a2-8c47-44d5-a0f3-a93ce3579695 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: 23d22800-6cad-43bd-97a7-30c7bf29d2f9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:23.943583 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f1ef6a2-8c47-44d5-a0f3-a93ce3579695 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:23.944804 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f1ef6a2-8c47-44d5-a0f3-a93ce3579695 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:23.947707 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f1ef6a2-8c47-44d5-a0f3-a93ce3579695 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:23.948527 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f1ef6a2-8c47-44d5-a0f3-a93ce3579695 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:24.153604 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2f1ef6a2-8c47-44d5-a0f3-a93ce3579695 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9" status: 200 len: 1424 microversion: 2.1 time: 0.250615 Jul 19 23:09:24.165283 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3018/6043] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:23 2022] GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9 => generated 1424 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:25.177948 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fa0bad8b-50da-43ff-a9e6-f9f0ed2e0dd2 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:25.178597 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fa0bad8b-50da-43ff-a9e6-f9f0ed2e0dd2 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: 23d22800-6cad-43bd-97a7-30c7bf29d2f9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:25.203751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa0bad8b-50da-43ff-a9e6-f9f0ed2e0dd2 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:25.214084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa0bad8b-50da-43ff-a9e6-f9f0ed2e0dd2 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:25.218607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa0bad8b-50da-43ff-a9e6-f9f0ed2e0dd2 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:25.219233 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa0bad8b-50da-43ff-a9e6-f9f0ed2e0dd2 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:25.462542 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fa0bad8b-50da-43ff-a9e6-f9f0ed2e0dd2 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9" status: 200 len: 1422 microversion: 2.1 time: 0.293104 Jul 19 23:09:25.467670 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3026/6044] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:25 2022] GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9 => generated 1422 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:26.484424 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a611da06-2901-4abf-b061-5d9ff80608b1 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:26.488048 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a611da06-2901-4abf-b061-5d9ff80608b1 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: 23d22800-6cad-43bd-97a7-30c7bf29d2f9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:26.516824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a611da06-2901-4abf-b061-5d9ff80608b1 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:26.525796 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a611da06-2901-4abf-b061-5d9ff80608b1 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:26.526601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a611da06-2901-4abf-b061-5d9ff80608b1 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:26.532577 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a611da06-2901-4abf-b061-5d9ff80608b1 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:27.056504 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a611da06-2901-4abf-b061-5d9ff80608b1 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9" status: 200 len: 1464 microversion: 2.1 time: 0.576912 Jul 19 23:09:27.059341 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3019/6045] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:26 2022] GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9 => generated 1464 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:28.078390 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-be368ece-84d8-485f-9b19-676f7965eaaa tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:28.079404 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-be368ece-84d8-485f-9b19-676f7965eaaa tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: 23d22800-6cad-43bd-97a7-30c7bf29d2f9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:28.095510 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be368ece-84d8-485f-9b19-676f7965eaaa tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:28.098486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be368ece-84d8-485f-9b19-676f7965eaaa tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:28.099452 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be368ece-84d8-485f-9b19-676f7965eaaa tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:28.099948 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be368ece-84d8-485f-9b19-676f7965eaaa tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:28.238946 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-53fe1f3a-25f2-463c-ab1a-5cdb860673b0 req-95b88824-8851-41c3-8b28-e8f865af867b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23d22800-6cad-43bd-97a7-30c7bf29d2f9", "tag": "188bd2ea-0d1d-4a25-a1d1-80ff304a7338"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:09:28.271293 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-53fe1f3a-25f2-463c-ab1a-5cdb860673b0 req-95b88824-8851-41c3-8b28-e8f865af867b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:28.274677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-53fe1f3a-25f2-463c-ab1a-5cdb860673b0 req-95b88824-8851-41c3-8b28-e8f865af867b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:28.301765 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-53fe1f3a-25f2-463c-ab1a-5cdb860673b0 req-95b88824-8851-41c3-8b28-e8f865af867b service nova] Creating event network-changed:188bd2ea-0d1d-4a25-a1d1-80ff304a7338 for instance 23d22800-6cad-43bd-97a7-30c7bf29d2f9 on n-h1-847009-3 Jul 19 23:09:28.314550 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-53fe1f3a-25f2-463c-ab1a-5cdb860673b0 req-95b88824-8851-41c3-8b28-e8f865af867b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079128 Jul 19 23:09:28.319317 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3020/6046] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:09:28.528514 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-be368ece-84d8-485f-9b19-676f7965eaaa tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9" status: 200 len: 1464 microversion: 2.1 time: 0.452858 Jul 19 23:09:28.530365 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3027/6047] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:28 2022] GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9 => generated 1464 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:29.546994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cf1fa3fa-e098-4bc1-80f5-46bf81036a3b tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:29.548017 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cf1fa3fa-e098-4bc1-80f5-46bf81036a3b tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: 23d22800-6cad-43bd-97a7-30c7bf29d2f9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:29.568031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf1fa3fa-e098-4bc1-80f5-46bf81036a3b tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:29.568955 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf1fa3fa-e098-4bc1-80f5-46bf81036a3b tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:29.569955 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf1fa3fa-e098-4bc1-80f5-46bf81036a3b tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:29.570565 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf1fa3fa-e098-4bc1-80f5-46bf81036a3b tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:29.913072 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cf1fa3fa-e098-4bc1-80f5-46bf81036a3b tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9" status: 200 len: 1464 microversion: 2.1 time: 0.370745 Jul 19 23:09:29.916408 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3021/6048] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:29 2022] GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9 => generated 1464 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:30.933732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-72b6229f-b051-4176-bc9a-3cf9b822ef49 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:30.934376 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-72b6229f-b051-4176-bc9a-3cf9b822ef49 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: 23d22800-6cad-43bd-97a7-30c7bf29d2f9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:30.946845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-72b6229f-b051-4176-bc9a-3cf9b822ef49 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:30.946845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-72b6229f-b051-4176-bc9a-3cf9b822ef49 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:30.946845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-72b6229f-b051-4176-bc9a-3cf9b822ef49 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:30.946845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-72b6229f-b051-4176-bc9a-3cf9b822ef49 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:31.180221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-78a961c6-227a-4fce-87e6-93e090b2bf81 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:31.181477 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-78a961c6-227a-4fce-87e6-93e090b2bf81 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] [instance: 64af567b-0dec-4673-bc8e-8424ec877b65] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:31.189569 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:09:31.193396 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78a961c6-227a-4fce-87e6-93e090b2bf81 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:31.194411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78a961c6-227a-4fce-87e6-93e090b2bf81 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:31.196108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78a961c6-227a-4fce-87e6-93e090b2bf81 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:31.196849 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-78a961c6-227a-4fce-87e6-93e090b2bf81 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:31.244744 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-78a961c6-227a-4fce-87e6-93e090b2bf81 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] [instance: 64af567b-0dec-4673-bc8e-8424ec877b65] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:09:31.273878 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:09:31.354149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:09:31.435968 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-78a961c6-227a-4fce-87e6-93e090b2bf81 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] 10.222.0.25 "DELETE /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65" status: 204 len: 0 microversion: 2.1 time: 0.258847 Jul 19 23:09:31.440857 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3022/6049] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:09:31 2022] DELETE /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:09:31.470453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-feb4bc46-81b5-4f5c-b620-de6e75fe7cd3 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:31.475888 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-feb4bc46-81b5-4f5c-b620-de6e75fe7cd3 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] [instance: 64af567b-0dec-4673-bc8e-8424ec877b65] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:31.497311 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-feb4bc46-81b5-4f5c-b620-de6e75fe7cd3 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:31.497726 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-feb4bc46-81b5-4f5c-b620-de6e75fe7cd3 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:31.498616 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-feb4bc46-81b5-4f5c-b620-de6e75fe7cd3 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:31.499181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-feb4bc46-81b5-4f5c-b620-de6e75fe7cd3 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:31.657274 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:09:31.817509 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-72b6229f-b051-4176-bc9a-3cf9b822ef49 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9" status: 200 len: 1464 microversion: 2.1 time: 0.887469 Jul 19 23:09:31.823934 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3028/6050] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:30 2022] GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9 => generated 1464 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:32.127994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-feb4bc46-81b5-4f5c-b620-de6e75fe7cd3 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a675fee9b345d6a51a57d5d71d1859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5fb87ac7b74ff2826e3eabb82aee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:09:32.143969 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-feb4bc46-81b5-4f5c-b620-de6e75fe7cd3 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] 10.222.0.25 "GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65" status: 200 len: 1469 microversion: 2.1 time: 0.680631 Jul 19 23:09:32.146881 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3023/6051] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:31 2022] GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65 => generated 1469 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:32.839466 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-60f7c170-13a2-447c-995e-4852f6d311fc tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:32.840714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-60f7c170-13a2-447c-995e-4852f6d311fc tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: 23d22800-6cad-43bd-97a7-30c7bf29d2f9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:32.849696 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60f7c170-13a2-447c-995e-4852f6d311fc tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:32.850487 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60f7c170-13a2-447c-995e-4852f6d311fc tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:32.852687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60f7c170-13a2-447c-995e-4852f6d311fc tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:32.853321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60f7c170-13a2-447c-995e-4852f6d311fc tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:33.112470 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-60f7c170-13a2-447c-995e-4852f6d311fc tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9" status: 200 len: 1464 microversion: 2.1 time: 0.276570 Jul 19 23:09:33.113781 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3029/6052] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:32 2022] GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9 => generated 1464 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:33.164383 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d901b55f-df4e-4fb6-be82-246b2ca9ea0c tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:33.165820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d901b55f-df4e-4fb6-be82-246b2ca9ea0c tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] [instance: 64af567b-0dec-4673-bc8e-8424ec877b65] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:33.174850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d901b55f-df4e-4fb6-be82-246b2ca9ea0c tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:33.175695 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d901b55f-df4e-4fb6-be82-246b2ca9ea0c tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:33.179432 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d901b55f-df4e-4fb6-be82-246b2ca9ea0c tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:33.180080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d901b55f-df4e-4fb6-be82-246b2ca9ea0c tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:33.544894 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d901b55f-df4e-4fb6-be82-246b2ca9ea0c tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a675fee9b345d6a51a57d5d71d1859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5fb87ac7b74ff2826e3eabb82aee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:09:33.557782 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d901b55f-df4e-4fb6-be82-246b2ca9ea0c tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] 10.222.0.25 "GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65" status: 200 len: 1469 microversion: 2.1 time: 0.397387 Jul 19 23:09:33.564413 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3024/6053] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:33 2022] GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65 => generated 1469 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:33.924436 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-e0b9796b-709f-4a45-8b9a-6fb1f4faaed3 req-abbc5c71-059a-4cf7-90da-16cc4bb98f9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64af567b-0dec-4673-bc8e-8424ec877b65", "name": "network-vif-deleted", "tag": "7e7866ce-f232-4e19-bd37-801869963fa9"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:09:33.952834 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e0b9796b-709f-4a45-8b9a-6fb1f4faaed3 req-abbc5c71-059a-4cf7-90da-16cc4bb98f9b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:33.954921 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e0b9796b-709f-4a45-8b9a-6fb1f4faaed3 req-abbc5c71-059a-4cf7-90da-16cc4bb98f9b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:34.007237 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-e0b9796b-709f-4a45-8b9a-6fb1f4faaed3 req-abbc5c71-059a-4cf7-90da-16cc4bb98f9b service nova] Creating event network-vif-deleted:7e7866ce-f232-4e19-bd37-801869963fa9 for instance 64af567b-0dec-4673-bc8e-8424ec877b65 on n-h2-847009-3 Jul 19 23:09:34.025315 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-e0b9796b-709f-4a45-8b9a-6fb1f4faaed3 req-abbc5c71-059a-4cf7-90da-16cc4bb98f9b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101973 Jul 19 23:09:34.037260 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3030/6054] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:09:34.135968 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d858638e-f39d-4890-ae16-633506ca9ca8 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:34.136603 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d858638e-f39d-4890-ae16-633506ca9ca8 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: 23d22800-6cad-43bd-97a7-30c7bf29d2f9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:34.146291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d858638e-f39d-4890-ae16-633506ca9ca8 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:34.153217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d858638e-f39d-4890-ae16-633506ca9ca8 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:34.154390 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d858638e-f39d-4890-ae16-633506ca9ca8 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:34.155020 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d858638e-f39d-4890-ae16-633506ca9ca8 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:34.243126 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-4e23b2ec-c2d9-4fbb-82bc-f422dfeafc04 req-d0f18019-901f-46d2-bd4d-61f51744a525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d22800-6cad-43bd-97a7-30c7bf29d2f9", "name": "network-vif-plugged", "status": "completed", "tag": "188bd2ea-0d1d-4a25-a1d1-80ff304a7338"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:09:34.257753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-4e23b2ec-c2d9-4fbb-82bc-f422dfeafc04 req-d0f18019-901f-46d2-bd4d-61f51744a525 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:34.275916 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-4e23b2ec-c2d9-4fbb-82bc-f422dfeafc04 req-d0f18019-901f-46d2-bd4d-61f51744a525 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:34.289662 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-4e23b2ec-c2d9-4fbb-82bc-f422dfeafc04 req-d0f18019-901f-46d2-bd4d-61f51744a525 service nova] Creating event network-vif-plugged:188bd2ea-0d1d-4a25-a1d1-80ff304a7338 for instance 23d22800-6cad-43bd-97a7-30c7bf29d2f9 on n-h1-847009-3 Jul 19 23:09:34.327325 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-4e23b2ec-c2d9-4fbb-82bc-f422dfeafc04 req-d0f18019-901f-46d2-bd4d-61f51744a525 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087786 Jul 19 23:09:34.331184 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3031/6055] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:09:34.544029 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d858638e-f39d-4890-ae16-633506ca9ca8 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9" status: 200 len: 1464 microversion: 2.1 time: 0.412518 Jul 19 23:09:34.556294 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3025/6056] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:34 2022] GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9 => generated 1464 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:34.582595 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d02b5c3d-5e42-423a-a2b3-f18df673024f tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:34.583385 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d02b5c3d-5e42-423a-a2b3-f18df673024f tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] [instance: 64af567b-0dec-4673-bc8e-8424ec877b65] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:34.591548 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d02b5c3d-5e42-423a-a2b3-f18df673024f tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:34.592029 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d02b5c3d-5e42-423a-a2b3-f18df673024f tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:34.592835 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d02b5c3d-5e42-423a-a2b3-f18df673024f tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:34.605265 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d02b5c3d-5e42-423a-a2b3-f18df673024f tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:34.723209 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d02b5c3d-5e42-423a-a2b3-f18df673024f tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:34.723883 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d02b5c3d-5e42-423a-a2b3-f18df673024f tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:34.724516 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-d02b5c3d-5e42-423a-a2b3-f18df673024f tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lazy-loading 'fault' on Instance uuid 64af567b-0dec-4673-bc8e-8424ec877b65 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:09:34.789764 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d02b5c3d-5e42-423a-a2b3-f18df673024f tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a675fee9b345d6a51a57d5d71d1859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5fb87ac7b74ff2826e3eabb82aee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:09:34.804496 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d02b5c3d-5e42-423a-a2b3-f18df673024f tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] 10.222.0.25 "GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65" status: 200 len: 1303 microversion: 2.1 time: 0.226660 Jul 19 23:09:34.806724 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3032/6057] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:34 2022] GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65 => generated 1303 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:35.570706 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-63d6be2e-dc59-449e-8c92-d4160f89fc8f tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:35.571968 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-63d6be2e-dc59-449e-8c92-d4160f89fc8f tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: 23d22800-6cad-43bd-97a7-30c7bf29d2f9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:35.587938 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-63d6be2e-dc59-449e-8c92-d4160f89fc8f tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:35.588638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-63d6be2e-dc59-449e-8c92-d4160f89fc8f tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:35.589733 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-63d6be2e-dc59-449e-8c92-d4160f89fc8f tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:35.590929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-63d6be2e-dc59-449e-8c92-d4160f89fc8f tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:35.804896 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-63d6be2e-dc59-449e-8c92-d4160f89fc8f tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9" status: 200 len: 1464 microversion: 2.1 time: 0.238812 Jul 19 23:09:35.806549 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3026/6058] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:35 2022] GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9 => generated 1464 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:35.823894 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c42b6de6-23b0-45bb-af3b-98ea34ae6134 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:35.824529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c42b6de6-23b0-45bb-af3b-98ea34ae6134 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] [instance: 64af567b-0dec-4673-bc8e-8424ec877b65] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:35.834664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c42b6de6-23b0-45bb-af3b-98ea34ae6134 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:35.835147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c42b6de6-23b0-45bb-af3b-98ea34ae6134 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:35.835955 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c42b6de6-23b0-45bb-af3b-98ea34ae6134 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:35.836414 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c42b6de6-23b0-45bb-af3b-98ea34ae6134 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:35.868326 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-c42b6de6-23b0-45bb-af3b-98ea34ae6134 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] HTTP exception thrown: Instance 64af567b-0dec-4673-bc8e-8424ec877b65 could not be found. Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c42b6de6-23b0-45bb-af3b-98ea34ae6134 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Request method failure captured: Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65 HTTP/1.1 Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zkildUuizf8lqxLjhOfj2L_JmzCXMnBvVOMi__rdsEwswLjDn64p_fVOU8yw_dV3wO8QTzF_IwV33Aq-Xyqm8JDdXvWLEsaHU5qAKuHc0jfR7fw4CYu5YB9_0x1zhChKlRroQRLukLOMVh1Wtxuk1VAcDnyTtOZt4C5MZyTjNz4dXI Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: ec5fb87ac7b74ff2826e3eabb82aee89 Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-VolumesBackupsTest-486053692 Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec5fb87ac7b74ff2826e3eabb82aee89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec5fb87ac7b74ff2826e3eabb82aee89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec5fb87ac7b74ff2826e3eabb82aee89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec5fb87ac7b74ff2826e3eabb82aee89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-VolumesBackupsTest-486053692 Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: ec5fb87ac7b74ff2826e3eabb82aee89 Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-VolumesBackupsTest-486053692 Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-VolumesBackupsTest-486053692-project Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 79a675fee9b345d6a51a57d5d71d1859 Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-VolumesBackupsTest-486053692-project Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 64af567b-0dec-4673-bc8e-8424ec877b65 could not be found. Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '64af567b-0dec-4673-bc8e-8424ec877b65'} Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64af567b-0dec-4673-bc8e-8424ec877b65 could not be found. Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64af567b-0dec-4673-bc8e-8424ec877b65 could not be found. Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:09:35.874429 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:09:35.878531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:09:35.878531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:09:35.878531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:09:35.878531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:09:35.878531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:09:35.878531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64af567b-0dec-4673-bc8e-8424ec877b65 could not be found. Jul 19 23:09:35.878531 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:09:35.884435 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c42b6de6-23b0-45bb-af3b-98ea34ae6134 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] Returning 404 to user: Instance 64af567b-0dec-4673-bc8e-8424ec877b65 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:09:35.885619 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c42b6de6-23b0-45bb-af3b-98ea34ae6134 tempest-VolumesBackupsTest-486053692 tempest-VolumesBackupsTest-486053692-project] 10.222.0.25 "GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65" status: 404 len: 111 microversion: 2.1 time: 0.065853 Jul 19 23:09:35.886741 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3033/6059] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:35 2022] GET /compute/v2.1/servers/64af567b-0dec-4673-bc8e-8424ec877b65 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:09:36.822374 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d02251b1-b56d-4885-a2d7-c792be74b578 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:36.823378 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d02251b1-b56d-4885-a2d7-c792be74b578 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: 23d22800-6cad-43bd-97a7-30c7bf29d2f9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:36.847795 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d02251b1-b56d-4885-a2d7-c792be74b578 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:36.848371 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d02251b1-b56d-4885-a2d7-c792be74b578 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:36.851775 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d02251b1-b56d-4885-a2d7-c792be74b578 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:36.852239 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d02251b1-b56d-4885-a2d7-c792be74b578 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:37.208406 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d02251b1-b56d-4885-a2d7-c792be74b578 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9" status: 200 len: 1648 microversion: 2.1 time: 0.390337 Jul 19 23:09:37.209906 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3027/6060] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:36 2022] GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9 => generated 1648 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:37.226048 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2860b2a9-f1af-4190-a720-465c9cfda401 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:37.227644 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2860b2a9-f1af-4190-a720-465c9cfda401 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: 23d22800-6cad-43bd-97a7-30c7bf29d2f9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:37.235133 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2860b2a9-f1af-4190-a720-465c9cfda401 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:37.235964 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2860b2a9-f1af-4190-a720-465c9cfda401 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:37.237037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2860b2a9-f1af-4190-a720-465c9cfda401 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:37.237726 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2860b2a9-f1af-4190-a720-465c9cfda401 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:37.536214 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2860b2a9-f1af-4190-a720-465c9cfda401 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9" status: 200 len: 1648 microversion: 2.1 time: 0.312358 Jul 19 23:09:37.537264 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3034/6061] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:37 2022] GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9 => generated 1648 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:37.558967 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b01cd82c-18be-47b7-9b17-7e3c1841dcd4 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:37.572728 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b01cd82c-18be-47b7-9b17-7e3c1841dcd4 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: 23d22800-6cad-43bd-97a7-30c7bf29d2f9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:37.573358 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ab17bb1b-5c1f-403d-95dc-ebab0fb1822d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:37.573879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ab17bb1b-5c1f-403d-95dc-ebab0fb1822d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:37.584862 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab17bb1b-5c1f-403d-95dc-ebab0fb1822d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:37.585477 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab17bb1b-5c1f-403d-95dc-ebab0fb1822d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:37.586393 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab17bb1b-5c1f-403d-95dc-ebab0fb1822d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:37.586965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab17bb1b-5c1f-403d-95dc-ebab0fb1822d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:37.588841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b01cd82c-18be-47b7-9b17-7e3c1841dcd4 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:37.589807 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b01cd82c-18be-47b7-9b17-7e3c1841dcd4 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:37.590875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:09:37.593829 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b01cd82c-18be-47b7-9b17-7e3c1841dcd4 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:37.595685 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b01cd82c-18be-47b7-9b17-7e3c1841dcd4 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:37.661243 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:09:37.665222 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ab17bb1b-5c1f-403d-95dc-ebab0fb1822d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:09:37.836887 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ab17bb1b-5c1f-403d-95dc-ebab0fb1822d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 204 len: 0 microversion: 2.1 time: 0.280337 Jul 19 23:09:37.839984 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3035/6062] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:09:37 2022] DELETE /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:09:37.866441 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f3f3f433-e54e-403a-aef4-c947a5d45c84 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:37.867214 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f3f3f433-e54e-403a-aef4-c947a5d45c84 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:37.869121 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b01cd82c-18be-47b7-9b17-7e3c1841dcd4 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9" status: 200 len: 1648 microversion: 2.1 time: 0.320253 Jul 19 23:09:37.870450 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3028/6063] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:37 2022] GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9 => generated 1648 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:37.889174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3f3f433-e54e-403a-aef4-c947a5d45c84 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:37.890057 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3f3f433-e54e-403a-aef4-c947a5d45c84 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:37.892175 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3f3f433-e54e-403a-aef4-c947a5d45c84 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:37.893029 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3f3f433-e54e-403a-aef4-c947a5d45c84 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:37.950568 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3b94e2a9-ba37-4abd-ab60-16fcbc182da3 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-803367953", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "availability_zone": "nova:n-h2-847009-3", "networks": [{"uuid": "dd0148c3-2669-496c-99eb-62876ca51d69"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:09:38.046049 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-3b94e2a9-ba37-4abd-ab60-16fcbc182da3 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] validate_networks() for [('dd0148c3-2669-496c-99eb-62876ca51d69', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:09:38.097425 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f3f3f433-e54e-403a-aef4-c947a5d45c84 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:09:38.106671 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f3f3f433-e54e-403a-aef4-c947a5d45c84 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 200 len: 1410 microversion: 2.1 time: 0.244384 Jul 19 23:09:38.109810 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3036/6064] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:37 2022] GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 1410 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:39.127382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8b0fe736-b5a7-402b-8ff1-cd3f41cf3ed1 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:39.129009 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8b0fe736-b5a7-402b-8ff1-cd3f41cf3ed1 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:39.146979 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b0fe736-b5a7-402b-8ff1-cd3f41cf3ed1 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:39.147749 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b0fe736-b5a7-402b-8ff1-cd3f41cf3ed1 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:39.154585 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b0fe736-b5a7-402b-8ff1-cd3f41cf3ed1 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:39.155942 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8b0fe736-b5a7-402b-8ff1-cd3f41cf3ed1 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:39.364890 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-3b94e2a9-ba37-4abd-ab60-16fcbc182da3 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:09:39.367083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-3b94e2a9-ba37-4abd-ab60-16fcbc182da3 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:09:39.370022 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-3b94e2a9-ba37-4abd-ab60-16fcbc182da3 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:09:39.371012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-3b94e2a9-ba37-4abd-ab60-16fcbc182da3 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:09:39.372089 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-3b94e2a9-ba37-4abd-ab60-16fcbc182da3 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:09:39.383848 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b94e2a9-ba37-4abd-ab60-16fcbc182da3 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:39.384224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b94e2a9-ba37-4abd-ab60-16fcbc182da3 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:39.385078 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b94e2a9-ba37-4abd-ab60-16fcbc182da3 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:39.385522 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b94e2a9-ba37-4abd-ab60-16fcbc182da3 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:39.413115 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-3b94e2a9-ba37-4abd-ab60-16fcbc182da3 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Getting quotas for project d7238e556f244143a9b2cf8a198109b6. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:09:39.422496 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-3b94e2a9-ba37-4abd-ab60-16fcbc182da3 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Getting quotas for user 84ddc7d4accc4a3d9e973fb64b32544c and project d7238e556f244143a9b2cf8a198109b6. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:09:39.449627 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3b94e2a9-ba37-4abd-ab60-16fcbc182da3 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:09:39.452182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3b94e2a9-ba37-4abd-ab60-16fcbc182da3 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:09:39.536218 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3b94e2a9-ba37-4abd-ab60-16fcbc182da3 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.588656 Jul 19 23:09:39.539093 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3029/6065] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:09:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 23:09:39.549795 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-84289e09-e4e0-4728-b77c-90b5d06ed1d5 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:39.552244 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-84289e09-e4e0-4728-b77c-90b5d06ed1d5 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:39.761977 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-84289e09-e4e0-4728-b77c-90b5d06ed1d5 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675" status: 200 len: 1328 microversion: 2.1 time: 0.214596 Jul 19 23:09:39.773042 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3030/6066] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:39 2022] GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675 => generated 1328 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:09:40.153436 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8b0fe736-b5a7-402b-8ff1-cd3f41cf3ed1 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:09:40.175042 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8b0fe736-b5a7-402b-8ff1-cd3f41cf3ed1 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 200 len: 1410 microversion: 2.1 time: 1.052004 Jul 19 23:09:40.187647 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3037/6067] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:39 2022] GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 1410 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:09:40.796601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6b225d1d-c1ae-42ed-8c6f-91732274dcbd tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:40.797240 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6b225d1d-c1ae-42ed-8c6f-91732274dcbd tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:40.833534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b225d1d-c1ae-42ed-8c6f-91732274dcbd tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:40.835274 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b225d1d-c1ae-42ed-8c6f-91732274dcbd tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:40.836182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b225d1d-c1ae-42ed-8c6f-91732274dcbd tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:40.836643 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6b225d1d-c1ae-42ed-8c6f-91732274dcbd tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:41.193966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a9a3b133-2cd4-40d0-9d80-1db36611bc89 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:41.195751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a9a3b133-2cd4-40d0-9d80-1db36611bc89 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:41.210987 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9a3b133-2cd4-40d0-9d80-1db36611bc89 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:41.213369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9a3b133-2cd4-40d0-9d80-1db36611bc89 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:41.214447 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9a3b133-2cd4-40d0-9d80-1db36611bc89 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:41.216705 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9a3b133-2cd4-40d0-9d80-1db36611bc89 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:41.336984 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6b225d1d-c1ae-42ed-8c6f-91732274dcbd tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675" status: 200 len: 1415 microversion: 2.1 time: 0.547828 Jul 19 23:09:41.337970 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3031/6068] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:40 2022] GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675 => generated 1415 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:41.686831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-08c8bd8c-14ab-4abf-a3c8-66bd272a562a req-8d29a2a8-beab-4fb6-84ec-beef94307ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e30c02d2-1d86-4ad0-bfa4-4522aad3d73c", "name": "network-vif-deleted", "tag": "204d5e7f-29dc-4964-8858-53396d7323bd"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:09:41.725113 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-08c8bd8c-14ab-4abf-a3c8-66bd272a562a req-8d29a2a8-beab-4fb6-84ec-beef94307ba5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:41.725725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-08c8bd8c-14ab-4abf-a3c8-66bd272a562a req-8d29a2a8-beab-4fb6-84ec-beef94307ba5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:41.741482 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-08c8bd8c-14ab-4abf-a3c8-66bd272a562a req-8d29a2a8-beab-4fb6-84ec-beef94307ba5 service nova] Creating event network-vif-deleted:204d5e7f-29dc-4964-8858-53396d7323bd for instance e30c02d2-1d86-4ad0-bfa4-4522aad3d73c on n-h1-847009-3 Jul 19 23:09:41.747917 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-08c8bd8c-14ab-4abf-a3c8-66bd272a562a req-8d29a2a8-beab-4fb6-84ec-beef94307ba5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065691 Jul 19 23:09:41.748807 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3032/6069] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:09:41.759572 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a9a3b133-2cd4-40d0-9d80-1db36611bc89 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:09:41.771092 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a9a3b133-2cd4-40d0-9d80-1db36611bc89 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 200 len: 1410 microversion: 2.1 time: 0.580999 Jul 19 23:09:41.771714 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3038/6070] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:41 2022] GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 1410 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:09:42.358717 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d1fabb9b-c00a-43d2-b973-de2f7096cf28 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:42.359486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d1fabb9b-c00a-43d2-b973-de2f7096cf28 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:42.401520 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d1fabb9b-c00a-43d2-b973-de2f7096cf28 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:42.401981 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d1fabb9b-c00a-43d2-b973-de2f7096cf28 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:42.402782 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d1fabb9b-c00a-43d2-b973-de2f7096cf28 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:42.404175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d1fabb9b-c00a-43d2-b973-de2f7096cf28 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:42.790683 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-583588ba-69f3-42d8-b007-1f24f93477aa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:42.791383 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-583588ba-69f3-42d8-b007-1f24f93477aa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:42.808985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-583588ba-69f3-42d8-b007-1f24f93477aa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:42.816217 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-583588ba-69f3-42d8-b007-1f24f93477aa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:42.817189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-583588ba-69f3-42d8-b007-1f24f93477aa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:42.817667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-583588ba-69f3-42d8-b007-1f24f93477aa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:43.018579 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-583588ba-69f3-42d8-b007-1f24f93477aa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:09:43.033893 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-583588ba-69f3-42d8-b007-1f24f93477aa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 200 len: 1202 microversion: 2.1 time: 0.248712 Jul 19 23:09:43.036684 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3039/6071] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:42 2022] GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 1202 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:43.045096 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d1fabb9b-c00a-43d2-b973-de2f7096cf28 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675" status: 200 len: 1463 microversion: 2.1 time: 0.682901 Jul 19 23:09:43.047991 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3033/6072] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:42 2022] GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675 => generated 1463 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:44.051925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-03c960e8-8bc9-4f91-b665-4576bfff741e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:44.052663 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-03c960e8-8bc9-4f91-b665-4576bfff741e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:44.064644 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fab48e8f-6501-4841-97ca-dd2ffb294d28 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:44.066961 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fab48e8f-6501-4841-97ca-dd2ffb294d28 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:44.070516 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:09:44.083412 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-03c960e8-8bc9-4f91-b665-4576bfff741e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:44.084314 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-03c960e8-8bc9-4f91-b665-4576bfff741e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:44.086027 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-03c960e8-8bc9-4f91-b665-4576bfff741e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:44.088290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-03c960e8-8bc9-4f91-b665-4576bfff741e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:44.089247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fab48e8f-6501-4841-97ca-dd2ffb294d28 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:44.092461 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fab48e8f-6501-4841-97ca-dd2ffb294d28 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:44.096489 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fab48e8f-6501-4841-97ca-dd2ffb294d28 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:44.096978 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fab48e8f-6501-4841-97ca-dd2ffb294d28 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:44.511965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-03c960e8-8bc9-4f91-b665-4576bfff741e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:09:44.552058 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-03c960e8-8bc9-4f91-b665-4576bfff741e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 200 len: 1202 microversion: 2.1 time: 0.502022 Jul 19 23:09:44.554864 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3040/6073] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:44 2022] GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 1202 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:44.576001 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-b11a31ed-577a-4b0d-8504-6020c2b654c7 req-df5fb6e3-8e1e-4752-ae38-b274a7a1d372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675", "tag": "1661eb82-e03e-44a3-9c43-7942ca9db26f"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:09:44.602124 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b11a31ed-577a-4b0d-8504-6020c2b654c7 req-df5fb6e3-8e1e-4752-ae38-b274a7a1d372 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:44.606477 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b11a31ed-577a-4b0d-8504-6020c2b654c7 req-df5fb6e3-8e1e-4752-ae38-b274a7a1d372 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:44.683734 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-b11a31ed-577a-4b0d-8504-6020c2b654c7 req-df5fb6e3-8e1e-4752-ae38-b274a7a1d372 service nova] Creating event network-changed:1661eb82-e03e-44a3-9c43-7942ca9db26f for instance ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675 on n-h2-847009-3 Jul 19 23:09:44.711251 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-b11a31ed-577a-4b0d-8504-6020c2b654c7 req-df5fb6e3-8e1e-4752-ae38-b274a7a1d372 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153374 Jul 19 23:09:44.722172 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3041/6074] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:09:44.845245 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fab48e8f-6501-4841-97ca-dd2ffb294d28 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675" status: 200 len: 1463 microversion: 2.1 time: 0.785627 Jul 19 23:09:44.863559 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3034/6075] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:44 2022] GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675 => generated 1463 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:45.570377 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-79648ae6-cb60-4f2c-947f-a4725a5bca02 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:45.571127 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-79648ae6-cb60-4f2c-947f-a4725a5bca02 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:45.582561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-79648ae6-cb60-4f2c-947f-a4725a5bca02 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:45.583323 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-79648ae6-cb60-4f2c-947f-a4725a5bca02 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:45.584326 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-79648ae6-cb60-4f2c-947f-a4725a5bca02 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:45.584950 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-79648ae6-cb60-4f2c-947f-a4725a5bca02 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:45.673565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-79648ae6-cb60-4f2c-947f-a4725a5bca02 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:09:45.687629 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-79648ae6-cb60-4f2c-947f-a4725a5bca02 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 200 len: 1202 microversion: 2.1 time: 0.121150 Jul 19 23:09:45.688555 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3042/6076] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:45 2022] GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 1202 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:45.865918 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cd6fae5f-b6c1-4c01-bf3b-66bf48cafc73 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:45.866711 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cd6fae5f-b6c1-4c01-bf3b-66bf48cafc73 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:45.875442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd6fae5f-b6c1-4c01-bf3b-66bf48cafc73 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:45.876177 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd6fae5f-b6c1-4c01-bf3b-66bf48cafc73 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:45.877213 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd6fae5f-b6c1-4c01-bf3b-66bf48cafc73 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:45.878080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd6fae5f-b6c1-4c01-bf3b-66bf48cafc73 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:46.099478 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cd6fae5f-b6c1-4c01-bf3b-66bf48cafc73 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675" status: 200 len: 1463 microversion: 2.1 time: 0.237272 Jul 19 23:09:46.100601 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3035/6077] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:45 2022] GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675 => generated 1463 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:09:46.706856 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c4786533-b277-4b8a-9e9d-1a4e37b57065 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:46.707642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c4786533-b277-4b8a-9e9d-1a4e37b57065 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:46.716708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c4786533-b277-4b8a-9e9d-1a4e37b57065 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:46.717623 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c4786533-b277-4b8a-9e9d-1a4e37b57065 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:46.719458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c4786533-b277-4b8a-9e9d-1a4e37b57065 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:46.720908 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c4786533-b277-4b8a-9e9d-1a4e37b57065 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:46.831970 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c4786533-b277-4b8a-9e9d-1a4e37b57065 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:09:46.843822 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c4786533-b277-4b8a-9e9d-1a4e37b57065 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 200 len: 1202 microversion: 2.1 time: 0.141670 Jul 19 23:09:46.845244 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3043/6078] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:46 2022] GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 1202 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:47.117406 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e1799df6-a28b-476f-aa88-102089bc4055 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:47.118032 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e1799df6-a28b-476f-aa88-102089bc4055 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:47.131703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1799df6-a28b-476f-aa88-102089bc4055 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:47.133182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1799df6-a28b-476f-aa88-102089bc4055 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:47.134032 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1799df6-a28b-476f-aa88-102089bc4055 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:47.134790 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1799df6-a28b-476f-aa88-102089bc4055 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:47.344600 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e1799df6-a28b-476f-aa88-102089bc4055 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675" status: 200 len: 1463 microversion: 2.1 time: 0.231236 Jul 19 23:09:47.346712 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3036/6079] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:47 2022] GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675 => generated 1463 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:47.863557 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c20edcab-c9b7-4dcd-8468-e83fbb895b64 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:47.864186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c20edcab-c9b7-4dcd-8468-e83fbb895b64 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:47.874498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:09:47.876478 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c20edcab-c9b7-4dcd-8468-e83fbb895b64 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:47.877181 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c20edcab-c9b7-4dcd-8468-e83fbb895b64 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:47.878312 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c20edcab-c9b7-4dcd-8468-e83fbb895b64 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:47.879209 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c20edcab-c9b7-4dcd-8468-e83fbb895b64 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:47.992026 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c20edcab-c9b7-4dcd-8468-e83fbb895b64 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:09:48.010022 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c20edcab-c9b7-4dcd-8468-e83fbb895b64 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 200 len: 1202 microversion: 2.1 time: 0.150599 Jul 19 23:09:48.011331 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3044/6080] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:47 2022] GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:48.368434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0e174bf5-c036-4743-9250-2f24bd875e5c tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:48.370028 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0e174bf5-c036-4743-9250-2f24bd875e5c tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:48.379947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0e174bf5-c036-4743-9250-2f24bd875e5c tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:48.380633 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0e174bf5-c036-4743-9250-2f24bd875e5c tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:48.381660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0e174bf5-c036-4743-9250-2f24bd875e5c tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:48.382306 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0e174bf5-c036-4743-9250-2f24bd875e5c tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:48.558266 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0e174bf5-c036-4743-9250-2f24bd875e5c tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675" status: 200 len: 1463 microversion: 2.1 time: 0.198944 Jul 19 23:09:48.561156 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3037/6081] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:48 2022] GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675 => generated 1463 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:48.936181 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-2a38e37a-084f-48ba-857a-6ec26c1bb1b3 req-1ac574d5-eb7f-43f2-9e28-af5f078c7064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675", "name": "network-vif-plugged", "status": "completed", "tag": "1661eb82-e03e-44a3-9c43-7942ca9db26f"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:09:48.955252 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-2a38e37a-084f-48ba-857a-6ec26c1bb1b3 req-1ac574d5-eb7f-43f2-9e28-af5f078c7064 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:48.956021 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-2a38e37a-084f-48ba-857a-6ec26c1bb1b3 req-1ac574d5-eb7f-43f2-9e28-af5f078c7064 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:48.984586 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-2a38e37a-084f-48ba-857a-6ec26c1bb1b3 req-1ac574d5-eb7f-43f2-9e28-af5f078c7064 service nova] Creating event network-vif-plugged:1661eb82-e03e-44a3-9c43-7942ca9db26f for instance ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675 on n-h2-847009-3 Jul 19 23:09:48.998091 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-2a38e37a-084f-48ba-857a-6ec26c1bb1b3 req-1ac574d5-eb7f-43f2-9e28-af5f078c7064 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066257 Jul 19 23:09:49.001825 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3045/6082] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:09:49.031705 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-93a1c65a-fd3e-446a-8574-d107015a74ed tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:49.032484 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-93a1c65a-fd3e-446a-8574-d107015a74ed tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:49.055045 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93a1c65a-fd3e-446a-8574-d107015a74ed tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:49.055921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93a1c65a-fd3e-446a-8574-d107015a74ed tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:49.057363 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93a1c65a-fd3e-446a-8574-d107015a74ed tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:49.058225 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-93a1c65a-fd3e-446a-8574-d107015a74ed tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:49.085676 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-93a1c65a-fd3e-446a-8574-d107015a74ed tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] HTTP exception thrown: Instance e30c02d2-1d86-4ad0-bfa4-4522aad3d73c could not be found. Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-93a1c65a-fd3e-446a-8574-d107015a74ed tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Request method failure captured: Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c HTTP/1.1 Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zh6YPXnZEfL25DbrOo5AahkBCmHYOrAvKJnhgzQ9JlHxbrun4XI2EwE2n1nf4tgNFUaArqBEbFq4Toj7uUUuANo7JRuxksIEPvDD1AFl7fhy2XFxh_IYAhLXnE4PI4_QoyTOcOGpDghFYkpTUUI4xKODXHZZ1_feIKHlU2SknrcKPQ Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: deeb5431c1284d02b245ff3a9dc3f4e8 Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance e30c02d2-1d86-4ad0-bfa4-4522aad3d73c could not be found. Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'e30c02d2-1d86-4ad0-bfa4-4522aad3d73c'} Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e30c02d2-1d86-4ad0-bfa4-4522aad3d73c could not be found. Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e30c02d2-1d86-4ad0-bfa4-4522aad3d73c could not be found. Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:09:49.088984 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:09:49.094781 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:09:49.094781 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:09:49.094781 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:09:49.094781 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:09:49.094781 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:09:49.094781 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e30c02d2-1d86-4ad0-bfa4-4522aad3d73c could not be found. Jul 19 23:09:49.094781 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:09:49.097465 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-93a1c65a-fd3e-446a-8574-d107015a74ed tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Returning 404 to user: Instance e30c02d2-1d86-4ad0-bfa4-4522aad3d73c could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:09:49.098518 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-93a1c65a-fd3e-446a-8574-d107015a74ed tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 404 len: 111 microversion: 2.1 time: 0.073658 Jul 19 23:09:49.099690 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3038/6083] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:49 2022] GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:09:49.577682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-032f77ed-b8a3-4c7a-9af9-f604cb437469 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:49.578662 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-032f77ed-b8a3-4c7a-9af9-f604cb437469 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:49.590090 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-032f77ed-b8a3-4c7a-9af9-f604cb437469 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:49.591454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-032f77ed-b8a3-4c7a-9af9-f604cb437469 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:49.593371 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-032f77ed-b8a3-4c7a-9af9-f604cb437469 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:49.594378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-032f77ed-b8a3-4c7a-9af9-f604cb437469 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:49.794952 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-032f77ed-b8a3-4c7a-9af9-f604cb437469 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675" status: 200 len: 1463 microversion: 2.1 time: 0.220614 Jul 19 23:09:49.804156 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3046/6084] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:49 2022] GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675 => generated 1463 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:50.812677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-75951e50-61da-40df-9964-d7c7397a1ea6 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:50.813759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-75951e50-61da-40df-9964-d7c7397a1ea6 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:50.820515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:09:50.820720 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=8 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:09:50.826059 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75951e50-61da-40df-9964-d7c7397a1ea6 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:50.826650 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75951e50-61da-40df-9964-d7c7397a1ea6 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:50.827516 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75951e50-61da-40df-9964-d7c7397a1ea6 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:50.827964 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-75951e50-61da-40df-9964-d7c7397a1ea6 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:50.986528 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-75951e50-61da-40df-9964-d7c7397a1ea6 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675" status: 200 len: 1647 microversion: 2.1 time: 0.178322 Jul 19 23:09:50.988035 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3039/6085] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:50 2022] GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675 => generated 1647 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:51.010341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ea19f343-7990-4d9d-a6cf-c0d2d7f88ecc tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:51.011025 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ea19f343-7990-4d9d-a6cf-c0d2d7f88ecc tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:51.019301 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea19f343-7990-4d9d-a6cf-c0d2d7f88ecc tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:51.020012 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea19f343-7990-4d9d-a6cf-c0d2d7f88ecc tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:51.021049 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea19f343-7990-4d9d-a6cf-c0d2d7f88ecc tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:51.021939 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ea19f343-7990-4d9d-a6cf-c0d2d7f88ecc tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:51.202044 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ea19f343-7990-4d9d-a6cf-c0d2d7f88ecc tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675" status: 200 len: 1647 microversion: 2.1 time: 0.201662 Jul 19 23:09:51.203611 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3047/6086] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:50 2022] GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675 => generated 1647 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:51.221322 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7111fd68-0bf0-4dfe-bef4-6aa0b0ee52cf tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:51.222430 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7111fd68-0bf0-4dfe-bef4-6aa0b0ee52cf tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:51.238129 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7111fd68-0bf0-4dfe-bef4-6aa0b0ee52cf tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:51.238858 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7111fd68-0bf0-4dfe-bef4-6aa0b0ee52cf tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:51.241449 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7111fd68-0bf0-4dfe-bef4-6aa0b0ee52cf tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:51.249274 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7111fd68-0bf0-4dfe-bef4-6aa0b0ee52cf tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:51.543800 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7111fd68-0bf0-4dfe-bef4-6aa0b0ee52cf tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675" status: 200 len: 1647 microversion: 2.1 time: 0.327394 Jul 19 23:09:51.546656 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3040/6087] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:51 2022] GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675 => generated 1647 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:51.564790 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2bb5fe90-a5ca-4fe7-9d63-0aa6ab85b5b5 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:51.565587 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2bb5fe90-a5ca-4fe7-9d63-0aa6ab85b5b5 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:51.575514 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bb5fe90-a5ca-4fe7-9d63-0aa6ab85b5b5 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:51.576426 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bb5fe90-a5ca-4fe7-9d63-0aa6ab85b5b5 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:51.577471 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bb5fe90-a5ca-4fe7-9d63-0aa6ab85b5b5 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:51.578122 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bb5fe90-a5ca-4fe7-9d63-0aa6ab85b5b5 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:51.611575 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2bb5fe90-a5ca-4fe7-9d63-0aa6ab85b5b5 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:09:51.749591 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2bb5fe90-a5ca-4fe7-9d63-0aa6ab85b5b5 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675" status: 204 len: 0 microversion: 2.1 time: 0.187766 Jul 19 23:09:51.750667 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3048/6088] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:09:51 2022] DELETE /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 23:09:51.762670 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dbc37ffe-3a01-4ded-9e74-03950cc56292 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:51.763627 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dbc37ffe-3a01-4ded-9e74-03950cc56292 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:51.772321 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dbc37ffe-3a01-4ded-9e74-03950cc56292 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:51.772774 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dbc37ffe-3a01-4ded-9e74-03950cc56292 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:51.773953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dbc37ffe-3a01-4ded-9e74-03950cc56292 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:51.774579 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dbc37ffe-3a01-4ded-9e74-03950cc56292 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:51.995871 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dbc37ffe-3a01-4ded-9e74-03950cc56292 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675" status: 200 len: 1653 microversion: 2.1 time: 0.239703 Jul 19 23:09:52.000265 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3041/6089] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:51 2022] GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675 => generated 1653 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:09:53.021165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3fe095de-5643-451c-9a03-66fb9b84bc78 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:53.022647 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3fe095de-5643-451c-9a03-66fb9b84bc78 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:53.035506 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3fe095de-5643-451c-9a03-66fb9b84bc78 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:53.036424 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3fe095de-5643-451c-9a03-66fb9b84bc78 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:53.037595 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3fe095de-5643-451c-9a03-66fb9b84bc78 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:53.038431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3fe095de-5643-451c-9a03-66fb9b84bc78 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:53.250203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:09:53.274325 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3fe095de-5643-451c-9a03-66fb9b84bc78 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675" status: 200 len: 1653 microversion: 2.1 time: 0.258932 Jul 19 23:09:53.275144 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3049/6090] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:53 2022] GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675 => generated 1653 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:54.076956 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-11e0ffe3-e46b-456f-ad4d-1dd644634127 req-0b37b180-7a36-44d8-827a-db2cbe1656d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675", "name": "network-vif-deleted", "tag": "1661eb82-e03e-44a3-9c43-7942ca9db26f"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:09:54.098424 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-11e0ffe3-e46b-456f-ad4d-1dd644634127 req-0b37b180-7a36-44d8-827a-db2cbe1656d6 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:54.100857 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-11e0ffe3-e46b-456f-ad4d-1dd644634127 req-0b37b180-7a36-44d8-827a-db2cbe1656d6 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:54.136064 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-11e0ffe3-e46b-456f-ad4d-1dd644634127 req-0b37b180-7a36-44d8-827a-db2cbe1656d6 service nova] Creating event network-vif-deleted:1661eb82-e03e-44a3-9c43-7942ca9db26f for instance ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675 on n-h2-847009-3 Jul 19 23:09:54.150912 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-11e0ffe3-e46b-456f-ad4d-1dd644634127 req-0b37b180-7a36-44d8-827a-db2cbe1656d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076611 Jul 19 23:09:54.151932 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3042/6091] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 19 23:09:54.299774 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2e559418-afd9-4004-ad2b-345f00bd063f tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:54.301095 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2e559418-afd9-4004-ad2b-345f00bd063f tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:54.309634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e559418-afd9-4004-ad2b-345f00bd063f tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:54.310572 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e559418-afd9-4004-ad2b-345f00bd063f tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:54.311683 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e559418-afd9-4004-ad2b-345f00bd063f tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:54.312565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e559418-afd9-4004-ad2b-345f00bd063f tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:54.374861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e559418-afd9-4004-ad2b-345f00bd063f tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:54.375854 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e559418-afd9-4004-ad2b-345f00bd063f tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:54.377237 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-2e559418-afd9-4004-ad2b-345f00bd063f tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lazy-loading 'fault' on Instance uuid ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:09:54.609206 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dca937b6-cdf3-4db0-9b31-83c534a3f89e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:54.610162 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dca937b6-cdf3-4db0-9b31-83c534a3f89e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:54.623138 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dca937b6-cdf3-4db0-9b31-83c534a3f89e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:54.625094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dca937b6-cdf3-4db0-9b31-83c534a3f89e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:54.627036 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dca937b6-cdf3-4db0-9b31-83c534a3f89e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:54.628502 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dca937b6-cdf3-4db0-9b31-83c534a3f89e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:54.656206 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-dca937b6-cdf3-4db0-9b31-83c534a3f89e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] HTTP exception thrown: Instance 55f2d7ff-6f07-495b-9ff2-c093c6542d7b could not be found. Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dca937b6-cdf3-4db0-9b31-83c534a3f89e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Request method failure captured: Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b HTTP/1.1 Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zh6YPXnZEfL25DbrOo5AahkBCmHYOrAvKJnhgzQ9JlHxbrun4XI2EwE2n1nf4tgNFUaArqBEbFq4Toj7uUUuANo7JRuxksIEPvDD1AFl7fhy2XFxh_IYAhLXnE4PI4_QoyTOcOGpDghFYkpTUUI4xKODXHZZ1_feIKHlU2SknrcKPQ Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: deeb5431c1284d02b245ff3a9dc3f4e8 Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 55f2d7ff-6f07-495b-9ff2-c093c6542d7b could not be found. Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '55f2d7ff-6f07-495b-9ff2-c093c6542d7b'} Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55f2d7ff-6f07-495b-9ff2-c093c6542d7b could not be found. Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:09:54.658882 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:09:54.664172 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55f2d7ff-6f07-495b-9ff2-c093c6542d7b could not be found. Jul 19 23:09:54.664172 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:09:54.664172 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:09:54.664172 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:09:54.664172 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:09:54.664172 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:09:54.664172 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:09:54.664172 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:09:54.664172 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:09:54.664172 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55f2d7ff-6f07-495b-9ff2-c093c6542d7b could not be found. Jul 19 23:09:54.664172 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:09:54.664172 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dca937b6-cdf3-4db0-9b31-83c534a3f89e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Returning 404 to user: Instance 55f2d7ff-6f07-495b-9ff2-c093c6542d7b could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:09:54.666523 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dca937b6-cdf3-4db0-9b31-83c534a3f89e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "DELETE /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 404 len: 111 microversion: 2.1 time: 0.062286 Jul 19 23:09:54.667643 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3043/6092] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:09:54 2022] DELETE /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 23:09:54.678524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9304a349-e853-4f85-b0cc-c5a45bffc323 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:54.679404 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9304a349-e853-4f85-b0cc-c5a45bffc323 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 55f2d7ff-6f07-495b-9ff2-c093c6542d7b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:54.688970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9304a349-e853-4f85-b0cc-c5a45bffc323 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:54.692051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9304a349-e853-4f85-b0cc-c5a45bffc323 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:54.693571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9304a349-e853-4f85-b0cc-c5a45bffc323 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:54.694554 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9304a349-e853-4f85-b0cc-c5a45bffc323 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:54.712825 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-9304a349-e853-4f85-b0cc-c5a45bffc323 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] HTTP exception thrown: Instance 55f2d7ff-6f07-495b-9ff2-c093c6542d7b could not be found. Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9304a349-e853-4f85-b0cc-c5a45bffc323 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Request method failure captured: Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b HTTP/1.1 Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zh6YPXnZEfL25DbrOo5AahkBCmHYOrAvKJnhgzQ9JlHxbrun4XI2EwE2n1nf4tgNFUaArqBEbFq4Toj7uUUuANo7JRuxksIEPvDD1AFl7fhy2XFxh_IYAhLXnE4PI4_QoyTOcOGpDghFYkpTUUI4xKODXHZZ1_feIKHlU2SknrcKPQ Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: deeb5431c1284d02b245ff3a9dc3f4e8 Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 55f2d7ff-6f07-495b-9ff2-c093c6542d7b could not be found. Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '55f2d7ff-6f07-495b-9ff2-c093c6542d7b'} Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55f2d7ff-6f07-495b-9ff2-c093c6542d7b could not be found. Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55f2d7ff-6f07-495b-9ff2-c093c6542d7b could not be found. Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:09:54.715004 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:09:54.719594 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:09:54.719594 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:09:54.719594 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:09:54.719594 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:09:54.719594 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:09:54.719594 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55f2d7ff-6f07-495b-9ff2-c093c6542d7b could not be found. Jul 19 23:09:54.719594 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:09:54.721450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9304a349-e853-4f85-b0cc-c5a45bffc323 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Returning 404 to user: Instance 55f2d7ff-6f07-495b-9ff2-c093c6542d7b could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:09:54.722562 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9304a349-e853-4f85-b0cc-c5a45bffc323 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b" status: 404 len: 111 microversion: 2.1 time: 0.049708 Jul 19 23:09:54.723657 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3044/6093] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:54 2022] GET /compute/v2.1/servers/55f2d7ff-6f07-495b-9ff2-c093c6542d7b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 23:09:54.988759 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2e559418-afd9-4004-ad2b-345f00bd063f tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675" status: 200 len: 1453 microversion: 2.1 time: 0.694090 Jul 19 23:09:54.994247 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3050/6094] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:54 2022] GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675 => generated 1453 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:55.746035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5a2841a0-d348-44d6-87f8-e2e60730d6c9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:55.748558 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5a2841a0-d348-44d6-87f8-e2e60730d6c9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:55.759585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5a2841a0-d348-44d6-87f8-e2e60730d6c9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:55.761134 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5a2841a0-d348-44d6-87f8-e2e60730d6c9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:55.763414 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5a2841a0-d348-44d6-87f8-e2e60730d6c9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:55.764711 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5a2841a0-d348-44d6-87f8-e2e60730d6c9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:55.804733 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-5a2841a0-d348-44d6-87f8-e2e60730d6c9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] HTTP exception thrown: Instance e30c02d2-1d86-4ad0-bfa4-4522aad3d73c could not be found. Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5a2841a0-d348-44d6-87f8-e2e60730d6c9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Request method failure captured: Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c HTTP/1.1 Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zh6YPXnZEfL25DbrOo5AahkBCmHYOrAvKJnhgzQ9JlHxbrun4XI2EwE2n1nf4tgNFUaArqBEbFq4Toj7uUUuANo7JRuxksIEPvDD1AFl7fhy2XFxh_IYAhLXnE4PI4_QoyTOcOGpDghFYkpTUUI4xKODXHZZ1_feIKHlU2SknrcKPQ Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: deeb5431c1284d02b245ff3a9dc3f4e8 Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance e30c02d2-1d86-4ad0-bfa4-4522aad3d73c could not be found. Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'e30c02d2-1d86-4ad0-bfa4-4522aad3d73c'} Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e30c02d2-1d86-4ad0-bfa4-4522aad3d73c could not be found. Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:09:55.807693 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:09:55.812373 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e30c02d2-1d86-4ad0-bfa4-4522aad3d73c could not be found. Jul 19 23:09:55.812373 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:09:55.812373 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:09:55.812373 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:09:55.812373 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:09:55.812373 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:09:55.812373 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:09:55.812373 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:09:55.812373 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:09:55.812373 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e30c02d2-1d86-4ad0-bfa4-4522aad3d73c could not be found. Jul 19 23:09:55.812373 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:09:55.812373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5a2841a0-d348-44d6-87f8-e2e60730d6c9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Returning 404 to user: Instance e30c02d2-1d86-4ad0-bfa4-4522aad3d73c could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:09:55.813285 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5a2841a0-d348-44d6-87f8-e2e60730d6c9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 404 len: 111 microversion: 2.1 time: 0.074831 Jul 19 23:09:55.814423 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3045/6095] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:09:55 2022] DELETE /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:09:55.823728 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-952d4c04-f322-4d6a-bc2a-296bce1800ce tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:55.824578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-952d4c04-f322-4d6a-bc2a-296bce1800ce tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e30c02d2-1d86-4ad0-bfa4-4522aad3d73c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:55.842687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-952d4c04-f322-4d6a-bc2a-296bce1800ce tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:55.843252 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-952d4c04-f322-4d6a-bc2a-296bce1800ce tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:55.843980 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-952d4c04-f322-4d6a-bc2a-296bce1800ce tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:55.844554 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-952d4c04-f322-4d6a-bc2a-296bce1800ce tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:55.861352 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-952d4c04-f322-4d6a-bc2a-296bce1800ce tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] HTTP exception thrown: Instance e30c02d2-1d86-4ad0-bfa4-4522aad3d73c could not be found. Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-952d4c04-f322-4d6a-bc2a-296bce1800ce tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Request method failure captured: Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c HTTP/1.1 Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zh6YPXnZEfL25DbrOo5AahkBCmHYOrAvKJnhgzQ9JlHxbrun4XI2EwE2n1nf4tgNFUaArqBEbFq4Toj7uUUuANo7JRuxksIEPvDD1AFl7fhy2XFxh_IYAhLXnE4PI4_QoyTOcOGpDghFYkpTUUI4xKODXHZZ1_feIKHlU2SknrcKPQ Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: deeb5431c1284d02b245ff3a9dc3f4e8 Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance e30c02d2-1d86-4ad0-bfa4-4522aad3d73c could not be found. Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'e30c02d2-1d86-4ad0-bfa4-4522aad3d73c'} Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e30c02d2-1d86-4ad0-bfa4-4522aad3d73c could not be found. Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e30c02d2-1d86-4ad0-bfa4-4522aad3d73c could not be found. Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:09:55.863314 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:09:55.867915 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:09:55.867915 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:09:55.867915 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:09:55.867915 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:09:55.867915 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:09:55.867915 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e30c02d2-1d86-4ad0-bfa4-4522aad3d73c could not be found. Jul 19 23:09:55.867915 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:09:55.867915 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-952d4c04-f322-4d6a-bc2a-296bce1800ce tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Returning 404 to user: Instance e30c02d2-1d86-4ad0-bfa4-4522aad3d73c could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:09:55.867915 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-952d4c04-f322-4d6a-bc2a-296bce1800ce tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c" status: 404 len: 111 microversion: 2.1 time: 0.046560 Jul 19 23:09:55.868959 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3051/6096] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:55 2022] GET /compute/v2.1/servers/e30c02d2-1d86-4ad0-bfa4-4522aad3d73c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:09:55.990889 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5e4a5242-74cf-4ee2-a42a-c20c3827f155 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Action: 'create', calling method: .version_select at 0x7f7a03831f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-480112255", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIiGZmKm9j8OEP5v8e4WFuUbkH3HSO4lMRDx2dsWLpJKEp0LcrYsO84r8HA5HAVlB2BCMnlY3si6o7aKP7U7DReSq1kZEWCeiV/m68PBREd3u3wBfi0uzbaQ3rYq0c1aZA=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:09:56.012017 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b6de2da7-1b57-4e17-9937-0476a679689a tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:56.012990 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b6de2da7-1b57-4e17-9937-0476a679689a tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:56.023217 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6de2da7-1b57-4e17-9937-0476a679689a tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:56.023627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6de2da7-1b57-4e17-9937-0476a679689a tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:56.024445 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6de2da7-1b57-4e17-9937-0476a679689a tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:56.024780 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-5e4a5242-74cf-4ee2-a42a-c20c3827f155 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Getting quotas for project ba6762beb0fe4220b984143b3ea6bd48. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:09:56.025896 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6de2da7-1b57-4e17-9937-0476a679689a tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:56.042208 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-b6de2da7-1b57-4e17-9937-0476a679689a tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] HTTP exception thrown: Instance ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675 could not be found. Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b6de2da7-1b57-4e17-9937-0476a679689a tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Request method failure captured: Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675 HTTP/1.1 Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zmfn4UpQrZuyBWSdrjqT53dT7ZoLdWbUUZxQm7AG4x86vZvczTRcygmSBGSAkqRDyHU85JWZmGevY8t3keGSIVL9cAoxRSdnpDJzF7Tt9mdChhmHQ1ROX8jb3epmHLugh86oAw1s8CvOEJnFbrb2x0sdtVVTs4PsdEQVk49yTJJrww Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: d7238e556f244143a9b2cf8a198109b6 Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-TestServerMultinode-1464785039 Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7238e556f244143a9b2cf8a198109b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7238e556f244143a9b2cf8a198109b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7238e556f244143a9b2cf8a198109b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7238e556f244143a9b2cf8a198109b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-TestServerMultinode-1464785039 Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: d7238e556f244143a9b2cf8a198109b6 Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-TestServerMultinode-1464785039 Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-TestServerMultinode-1464785039-project-admin Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 84ddc7d4accc4a3d9e973fb64b32544c Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-TestServerMultinode-1464785039-project-admin Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675 could not be found. Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675'} Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675 could not be found. Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675 could not be found. Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:09:56.044457 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:09:56.049355 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:09:56.049355 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:09:56.049355 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:09:56.049355 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:09:56.049355 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:09:56.049355 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675 could not be found. Jul 19 23:09:56.049355 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:09:56.051799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b6de2da7-1b57-4e17-9937-0476a679689a tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Returning 404 to user: Instance ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:09:56.052075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-5e4a5242-74cf-4ee2-a42a-c20c3827f155 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Getting quotas for user deeb5431c1284d02b245ff3a9dc3f4e8 and project ba6762beb0fe4220b984143b3ea6bd48. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:09:56.053766 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b6de2da7-1b57-4e17-9937-0476a679689a tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675" status: 404 len: 111 microversion: 2.1 time: 0.045736 Jul 19 23:09:56.054692 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3052/6097] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:56 2022] GET /compute/v2.1/servers/ff59b5ae-dd2d-4e07-b0cf-9d752b0d7675 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:09:56.065696 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-db2416b1-a39e-4940-91e2-b63932bfd1d4 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:56.067057 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-db2416b1-a39e-4940-91e2-b63932bfd1d4 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: 23d22800-6cad-43bd-97a7-30c7bf29d2f9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:56.079140 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db2416b1-a39e-4940-91e2-b63932bfd1d4 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:56.079915 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db2416b1-a39e-4940-91e2-b63932bfd1d4 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:56.082539 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db2416b1-a39e-4940-91e2-b63932bfd1d4 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:56.086754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db2416b1-a39e-4940-91e2-b63932bfd1d4 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:56.106893 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5e4a5242-74cf-4ee2-a42a-c20c3827f155 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.125172 Jul 19 23:09:56.107937 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3046/6098] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 23:09:55 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:09:56.131177 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-db2416b1-a39e-4940-91e2-b63932bfd1d4 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: 23d22800-6cad-43bd-97a7-30c7bf29d2f9] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:09:56.329031 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-db2416b1-a39e-4940-91e2-b63932bfd1d4 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9" status: 204 len: 0 microversion: 2.1 time: 0.268005 Jul 19 23:09:56.329622 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3053/6099] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:09:56 2022] DELETE /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:09:56.338485 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4cb628b1-b1f1-4aad-9993-cdd0abf86eef tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:56.339157 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4cb628b1-b1f1-4aad-9993-cdd0abf86eef tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: 23d22800-6cad-43bd-97a7-30c7bf29d2f9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:56.353226 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4cb628b1-b1f1-4aad-9993-cdd0abf86eef tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:56.353720 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4cb628b1-b1f1-4aad-9993-cdd0abf86eef tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:56.357441 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4cb628b1-b1f1-4aad-9993-cdd0abf86eef tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:56.357911 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4cb628b1-b1f1-4aad-9993-cdd0abf86eef tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:56.895714 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4cb628b1-b1f1-4aad-9993-cdd0abf86eef tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9" status: 200 len: 1654 microversion: 2.1 time: 0.561800 Jul 19 23:09:56.900603 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3047/6100] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:56 2022] GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9 => generated 1654 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:57.923839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1a7de212-99ef-483e-b1f0-0eef0b3f4340 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:57.925311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1a7de212-99ef-483e-b1f0-0eef0b3f4340 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: 23d22800-6cad-43bd-97a7-30c7bf29d2f9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:57.938182 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a7de212-99ef-483e-b1f0-0eef0b3f4340 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:57.938740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a7de212-99ef-483e-b1f0-0eef0b3f4340 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:57.940409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a7de212-99ef-483e-b1f0-0eef0b3f4340 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:57.940886 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a7de212-99ef-483e-b1f0-0eef0b3f4340 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:58.430558 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1a7de212-99ef-483e-b1f0-0eef0b3f4340 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9" status: 200 len: 1654 microversion: 2.1 time: 0.515034 Jul 19 23:09:58.435006 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3054/6101] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:57 2022] GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9 => generated 1654 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:09:59.055529 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-6f971617-ff0e-4862-8820-75f980c29194 req-ae9c5cf5-7600-4468-be90-2296d0e3224e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d22800-6cad-43bd-97a7-30c7bf29d2f9", "name": "network-vif-deleted", "tag": "188bd2ea-0d1d-4a25-a1d1-80ff304a7338"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:09:59.089980 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-6f971617-ff0e-4862-8820-75f980c29194 req-ae9c5cf5-7600-4468-be90-2296d0e3224e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:59.092776 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-6f971617-ff0e-4862-8820-75f980c29194 req-ae9c5cf5-7600-4468-be90-2296d0e3224e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:59.142497 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-6f971617-ff0e-4862-8820-75f980c29194 req-ae9c5cf5-7600-4468-be90-2296d0e3224e service nova] Creating event network-vif-deleted:188bd2ea-0d1d-4a25-a1d1-80ff304a7338 for instance 23d22800-6cad-43bd-97a7-30c7bf29d2f9 on n-h1-847009-3 Jul 19 23:09:59.164283 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-6f971617-ff0e-4862-8820-75f980c29194 req-ae9c5cf5-7600-4468-be90-2296d0e3224e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116776 Jul 19 23:09:59.177990 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3048/6102] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:09:59.453364 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-39450e81-fbdc-4d6e-bfbe-9e59305bae96 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:09:59.454220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-39450e81-fbdc-4d6e-bfbe-9e59305bae96 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: 23d22800-6cad-43bd-97a7-30c7bf29d2f9] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:09:59.461253 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39450e81-fbdc-4d6e-bfbe-9e59305bae96 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:59.461717 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39450e81-fbdc-4d6e-bfbe-9e59305bae96 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:59.462764 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39450e81-fbdc-4d6e-bfbe-9e59305bae96 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:59.463422 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39450e81-fbdc-4d6e-bfbe-9e59305bae96 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:59.517197 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39450e81-fbdc-4d6e-bfbe-9e59305bae96 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:09:59.519204 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39450e81-fbdc-4d6e-bfbe-9e59305bae96 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:09:59.519778 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-39450e81-fbdc-4d6e-bfbe-9e59305bae96 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lazy-loading 'fault' on Instance uuid 23d22800-6cad-43bd-97a7-30c7bf29d2f9 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:09:59.608300 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-39450e81-fbdc-4d6e-bfbe-9e59305bae96 tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9" status: 200 len: 1454 microversion: 2.1 time: 0.161062 Jul 19 23:09:59.618510 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3055/6103] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:09:59 2022] GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9 => generated 1454 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:10:00.627149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ee0fc65c-c786-43cb-ad16-efaa688226ca tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:00.627860 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ee0fc65c-c786-43cb-ad16-efaa688226ca tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] [instance: 23d22800-6cad-43bd-97a7-30c7bf29d2f9] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:00.634016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee0fc65c-c786-43cb-ad16-efaa688226ca tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:00.634668 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee0fc65c-c786-43cb-ad16-efaa688226ca tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:00.635470 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee0fc65c-c786-43cb-ad16-efaa688226ca tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:00.636094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee0fc65c-c786-43cb-ad16-efaa688226ca tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:00.663361 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-ee0fc65c-c786-43cb-ad16-efaa688226ca tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] HTTP exception thrown: Instance 23d22800-6cad-43bd-97a7-30c7bf29d2f9 could not be found. Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ee0fc65c-c786-43cb-ad16-efaa688226ca tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Request method failure captured: Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9 HTTP/1.1 Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zmfn4UpQrZuyBWSdrjqT53dT7ZoLdWbUUZxQm7AG4x86vZvczTRcygmSBGSAkqRDyHU85JWZmGevY8t3keGSIVL9cAoxRSdnpDJzF7Tt9mdChhmHQ1ROX8jb3epmHLugh86oAw1s8CvOEJnFbrb2x0sdtVVTs4PsdEQVk49yTJJrww Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: d7238e556f244143a9b2cf8a198109b6 Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TestServerMultinode-1464785039 Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: X-Role: admin,member,reader Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: admin,member,reader Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7238e556f244143a9b2cf8a198109b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7238e556f244143a9b2cf8a198109b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7238e556f244143a9b2cf8a198109b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7238e556f244143a9b2cf8a198109b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TestServerMultinode-1464785039 Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: d7238e556f244143a9b2cf8a198109b6 Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TestServerMultinode-1464785039 Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TestServerMultinode-1464785039-project-admin Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 84ddc7d4accc4a3d9e973fb64b32544c Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TestServerMultinode-1464785039-project-admin Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 23d22800-6cad-43bd-97a7-30c7bf29d2f9 could not be found. Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '23d22800-6cad-43bd-97a7-30c7bf29d2f9'} Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23d22800-6cad-43bd-97a7-30c7bf29d2f9 could not be found. Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23d22800-6cad-43bd-97a7-30c7bf29d2f9 could not be found. Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:10:00.665508 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:10:00.671064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:10:00.671064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:10:00.671064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:10:00.671064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:10:00.671064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:10:00.671064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23d22800-6cad-43bd-97a7-30c7bf29d2f9 could not be found. Jul 19 23:10:00.671064 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:10:00.672308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ee0fc65c-c786-43cb-ad16-efaa688226ca tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] Returning 404 to user: Instance 23d22800-6cad-43bd-97a7-30c7bf29d2f9 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:10:00.675088 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ee0fc65c-c786-43cb-ad16-efaa688226ca tempest-TestServerMultinode-1464785039 tempest-TestServerMultinode-1464785039-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9" status: 404 len: 111 microversion: 2.1 time: 0.052555 Jul 19 23:10:00.679165 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3049/6104] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:00 2022] GET /compute/v2.1/servers/23d22800-6cad-43bd-97a7-30c7bf29d2f9 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:10:01.098839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0643966e-df14-45c6-aa51-93fe51f90545 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-394061457", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "cd5ff97c-bddb-4ba8-aa6c-f045828fce6b"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:10:01.499373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-0643966e-df14-45c6-aa51-93fe51f90545 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] validate_networks() for [('cd5ff97c-bddb-4ba8-aa6c-f045828fce6b', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:10:02.403869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-0643966e-df14-45c6-aa51-93fe51f90545 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:10:02.404759 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-0643966e-df14-45c6-aa51-93fe51f90545 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:10:02.405505 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-0643966e-df14-45c6-aa51-93fe51f90545 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:10:02.406409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-0643966e-df14-45c6-aa51-93fe51f90545 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:10:02.409779 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-0643966e-df14-45c6-aa51-93fe51f90545 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:10:02.426063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0643966e-df14-45c6-aa51-93fe51f90545 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:02.427691 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0643966e-df14-45c6-aa51-93fe51f90545 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:02.430720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0643966e-df14-45c6-aa51-93fe51f90545 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:02.431669 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0643966e-df14-45c6-aa51-93fe51f90545 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:02.460606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-0643966e-df14-45c6-aa51-93fe51f90545 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Getting quotas for project 924fe492641145ecb3906bfeda480dde. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:10:02.467829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-0643966e-df14-45c6-aa51-93fe51f90545 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Getting quotas for user 3713bb52f20146a9afc829dc6b9ec38e and project 924fe492641145ecb3906bfeda480dde. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:10:02.510629 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0643966e-df14-45c6-aa51-93fe51f90545 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:10:02.519155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0643966e-df14-45c6-aa51-93fe51f90545 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: c1e1153d-4437-4cd2-b4ff-65942754bb93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:10:02.666046 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0643966e-df14-45c6-aa51-93fe51f90545 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.568424 Jul 19 23:10:02.670116 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3056/6105] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:10:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:10:02.679681 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e7720dd7-4465-48fa-aea7-b4cb9d9fcf94 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:02.680431 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e7720dd7-4465-48fa-aea7-b4cb9d9fcf94 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: c1e1153d-4437-4cd2-b4ff-65942754bb93] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:02.888121 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e7720dd7-4465-48fa-aea7-b4cb9d9fcf94 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3713bb52f20146a9afc829dc6b9ec38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924fe492641145ecb3906bfeda480dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:10:02.901259 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e7720dd7-4465-48fa-aea7-b4cb9d9fcf94 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93" status: 200 len: 1218 microversion: 2.1 time: 0.224034 Jul 19 23:10:02.904105 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3050/6106] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:02 2022] GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93 => generated 1218 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:10:03.927365 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b358250a-b56c-48ae-ad61-ed7151dc41e2 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:03.929897 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b358250a-b56c-48ae-ad61-ed7151dc41e2 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: c1e1153d-4437-4cd2-b4ff-65942754bb93] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:03.973402 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b358250a-b56c-48ae-ad61-ed7151dc41e2 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:03.975461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b358250a-b56c-48ae-ad61-ed7151dc41e2 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:03.986228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b358250a-b56c-48ae-ad61-ed7151dc41e2 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:03.993909 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b358250a-b56c-48ae-ad61-ed7151dc41e2 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:04.138910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b358250a-b56c-48ae-ad61-ed7151dc41e2 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3713bb52f20146a9afc829dc6b9ec38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924fe492641145ecb3906bfeda480dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:10:04.149712 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b358250a-b56c-48ae-ad61-ed7151dc41e2 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93" status: 200 len: 1270 microversion: 2.1 time: 0.230626 Jul 19 23:10:04.150690 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3057/6107] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:03 2022] GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93 => generated 1270 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:10:05.171467 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-df4ea4b5-747b-4beb-96e2-5524ecc573d4 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:05.173334 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-df4ea4b5-747b-4beb-96e2-5524ecc573d4 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: c1e1153d-4437-4cd2-b4ff-65942754bb93] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:05.187550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-df4ea4b5-747b-4beb-96e2-5524ecc573d4 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:05.188233 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-df4ea4b5-747b-4beb-96e2-5524ecc573d4 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:05.189346 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-df4ea4b5-747b-4beb-96e2-5524ecc573d4 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:05.189946 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-df4ea4b5-747b-4beb-96e2-5524ecc573d4 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:05.291918 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-df4ea4b5-747b-4beb-96e2-5524ecc573d4 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3713bb52f20146a9afc829dc6b9ec38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924fe492641145ecb3906bfeda480dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:10:05.302525 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-df4ea4b5-747b-4beb-96e2-5524ecc573d4 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93" status: 200 len: 1276 microversion: 2.1 time: 0.137219 Jul 19 23:10:05.311821 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3051/6108] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:05 2022] GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93 => generated 1276 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:10:06.328821 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-de634b0e-1d39-4127-b9d1-e678e41fa2d1 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:06.330644 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-de634b0e-1d39-4127-b9d1-e678e41fa2d1 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: c1e1153d-4437-4cd2-b4ff-65942754bb93] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:06.366793 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de634b0e-1d39-4127-b9d1-e678e41fa2d1 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:06.367619 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de634b0e-1d39-4127-b9d1-e678e41fa2d1 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:06.368901 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de634b0e-1d39-4127-b9d1-e678e41fa2d1 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:06.369556 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de634b0e-1d39-4127-b9d1-e678e41fa2d1 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:06.992689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-de634b0e-1d39-4127-b9d1-e678e41fa2d1 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3713bb52f20146a9afc829dc6b9ec38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924fe492641145ecb3906bfeda480dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:10:07.024077 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-de634b0e-1d39-4127-b9d1-e678e41fa2d1 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93" status: 200 len: 1318 microversion: 2.1 time: 0.689499 Jul 19 23:10:07.040768 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3058/6109] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:06 2022] GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93 => generated 1318 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:10:08.045181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ef5a6699-b317-417b-b5af-718f780f0544 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:08.046615 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ef5a6699-b317-417b-b5af-718f780f0544 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: c1e1153d-4437-4cd2-b4ff-65942754bb93] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:08.059947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ef5a6699-b317-417b-b5af-718f780f0544 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:08.064826 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ef5a6699-b317-417b-b5af-718f780f0544 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:08.066061 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ef5a6699-b317-417b-b5af-718f780f0544 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:08.066892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ef5a6699-b317-417b-b5af-718f780f0544 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:08.071824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=88 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:10:08.180197 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-b8aec9f3-181f-4b63-8884-9e16034b0099 req-323e5ffe-16c8-4980-86b5-44fa3c836ade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1e1153d-4437-4cd2-b4ff-65942754bb93", "tag": "4834b125-0cad-4d50-90a3-c585d31ad5f7"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:10:08.202653 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b8aec9f3-181f-4b63-8884-9e16034b0099 req-323e5ffe-16c8-4980-86b5-44fa3c836ade service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:08.205447 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b8aec9f3-181f-4b63-8884-9e16034b0099 req-323e5ffe-16c8-4980-86b5-44fa3c836ade service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:08.234938 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-b8aec9f3-181f-4b63-8884-9e16034b0099 req-323e5ffe-16c8-4980-86b5-44fa3c836ade service nova] Creating event network-changed:4834b125-0cad-4d50-90a3-c585d31ad5f7 for instance c1e1153d-4437-4cd2-b4ff-65942754bb93 on n-h2-847009-3 Jul 19 23:10:08.250552 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-b8aec9f3-181f-4b63-8884-9e16034b0099 req-323e5ffe-16c8-4980-86b5-44fa3c836ade service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076562 Jul 19 23:10:08.252598 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3059/6110] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:10:08.437936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ef5a6699-b317-417b-b5af-718f780f0544 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3713bb52f20146a9afc829dc6b9ec38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924fe492641145ecb3906bfeda480dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:10:08.457881 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ef5a6699-b317-417b-b5af-718f780f0544 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93" status: 200 len: 1318 microversion: 2.1 time: 0.418290 Jul 19 23:10:08.458733 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3052/6111] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:08 2022] GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93 => generated 1318 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:10:09.489655 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1a04cf1a-5985-448f-aefa-30c3d81b7226 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:09.490242 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1a04cf1a-5985-448f-aefa-30c3d81b7226 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: c1e1153d-4437-4cd2-b4ff-65942754bb93] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:09.503408 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a04cf1a-5985-448f-aefa-30c3d81b7226 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:09.504266 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a04cf1a-5985-448f-aefa-30c3d81b7226 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:09.505332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a04cf1a-5985-448f-aefa-30c3d81b7226 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:09.505963 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1a04cf1a-5985-448f-aefa-30c3d81b7226 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:09.723468 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1a04cf1a-5985-448f-aefa-30c3d81b7226 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3713bb52f20146a9afc829dc6b9ec38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924fe492641145ecb3906bfeda480dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:10:09.735642 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1a04cf1a-5985-448f-aefa-30c3d81b7226 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93" status: 200 len: 1318 microversion: 2.1 time: 0.252250 Jul 19 23:10:09.736975 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3060/6112] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:09 2022] GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:10:10.755256 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aea8755a-dff2-4e38-a145-ade765a78747 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:10.755973 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-aea8755a-dff2-4e38-a145-ade765a78747 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: c1e1153d-4437-4cd2-b4ff-65942754bb93] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:10.770525 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aea8755a-dff2-4e38-a145-ade765a78747 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:10.773286 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aea8755a-dff2-4e38-a145-ade765a78747 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:10.782338 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aea8755a-dff2-4e38-a145-ade765a78747 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:10.782338 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aea8755a-dff2-4e38-a145-ade765a78747 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:11.182514 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-aea8755a-dff2-4e38-a145-ade765a78747 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3713bb52f20146a9afc829dc6b9ec38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924fe492641145ecb3906bfeda480dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:10:11.192317 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-aea8755a-dff2-4e38-a145-ade765a78747 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93" status: 200 len: 1318 microversion: 2.1 time: 0.441982 Jul 19 23:10:11.193597 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3053/6113] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:10 2022] GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93 => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:10:12.219594 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8dbe2404-2e00-4174-a05b-66820091dc99 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:12.222482 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8dbe2404-2e00-4174-a05b-66820091dc99 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: c1e1153d-4437-4cd2-b4ff-65942754bb93] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:12.250924 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8dbe2404-2e00-4174-a05b-66820091dc99 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:12.252767 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8dbe2404-2e00-4174-a05b-66820091dc99 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:12.253613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8dbe2404-2e00-4174-a05b-66820091dc99 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:12.259721 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8dbe2404-2e00-4174-a05b-66820091dc99 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:12.451732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:10:12.480704 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:10:12.578693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8dbe2404-2e00-4174-a05b-66820091dc99 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3713bb52f20146a9afc829dc6b9ec38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924fe492641145ecb3906bfeda480dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:10:12.601287 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8dbe2404-2e00-4174-a05b-66820091dc99 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93" status: 200 len: 1318 microversion: 2.1 time: 0.392990 Jul 19 23:10:12.605527 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3061/6114] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:12 2022] GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93 => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:10:13.030135 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-2c6906a2-36a1-4c1f-8322-ab8ab464a537 req-96c950c9-7eb0-42a4-9355-681ee69ee776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1e1153d-4437-4cd2-b4ff-65942754bb93", "name": "network-vif-plugged", "status": "completed", "tag": "4834b125-0cad-4d50-90a3-c585d31ad5f7"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:10:13.045132 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:10:13.047689 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-2c6906a2-36a1-4c1f-8322-ab8ab464a537 req-96c950c9-7eb0-42a4-9355-681ee69ee776 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:13.048132 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-2c6906a2-36a1-4c1f-8322-ab8ab464a537 req-96c950c9-7eb0-42a4-9355-681ee69ee776 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:13.080271 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-2c6906a2-36a1-4c1f-8322-ab8ab464a537 req-96c950c9-7eb0-42a4-9355-681ee69ee776 service nova] Creating event network-vif-plugged:4834b125-0cad-4d50-90a3-c585d31ad5f7 for instance c1e1153d-4437-4cd2-b4ff-65942754bb93 on n-h2-847009-3 Jul 19 23:10:13.089344 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-2c6906a2-36a1-4c1f-8322-ab8ab464a537 req-96c950c9-7eb0-42a4-9355-681ee69ee776 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062557 Jul 19 23:10:13.091317 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3054/6115] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:10:13.621946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-727f5540-1616-40e3-b6fc-aee634e51e91 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:13.623653 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-727f5540-1616-40e3-b6fc-aee634e51e91 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: c1e1153d-4437-4cd2-b4ff-65942754bb93] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:13.632700 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-727f5540-1616-40e3-b6fc-aee634e51e91 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:13.633274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-727f5540-1616-40e3-b6fc-aee634e51e91 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:13.640057 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-727f5540-1616-40e3-b6fc-aee634e51e91 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:13.640788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-727f5540-1616-40e3-b6fc-aee634e51e91 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:13.895542 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-727f5540-1616-40e3-b6fc-aee634e51e91 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3713bb52f20146a9afc829dc6b9ec38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924fe492641145ecb3906bfeda480dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:10:13.909911 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-727f5540-1616-40e3-b6fc-aee634e51e91 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93" status: 200 len: 1318 microversion: 2.1 time: 0.292541 Jul 19 23:10:13.910573 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3062/6116] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:13 2022] GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93 => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:10:14.929459 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-457caa89-421b-4b5b-a3dc-1744cc765014 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:14.931387 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-457caa89-421b-4b5b-a3dc-1744cc765014 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: c1e1153d-4437-4cd2-b4ff-65942754bb93] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:14.939964 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:10:14.942638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-457caa89-421b-4b5b-a3dc-1744cc765014 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:14.943950 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-457caa89-421b-4b5b-a3dc-1744cc765014 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:14.945085 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-457caa89-421b-4b5b-a3dc-1744cc765014 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:14.945781 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-457caa89-421b-4b5b-a3dc-1744cc765014 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:15.434772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-457caa89-421b-4b5b-a3dc-1744cc765014 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3713bb52f20146a9afc829dc6b9ec38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924fe492641145ecb3906bfeda480dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:10:15.444324 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-457caa89-421b-4b5b-a3dc-1744cc765014 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93" status: 200 len: 1508 microversion: 2.1 time: 0.520420 Jul 19 23:10:15.445913 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3055/6117] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:14 2022] GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93 => generated 1508 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:10:29.259739 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-846edb1b-a845-4424-97b6-6d0a7249baf5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1794551141", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-480112255", "security_groups": [{"name": "tempest-secgroup-smoke-737929312"}], "block_device_mapping_v2": [{"uuid": "a9b426ed-4927-4bec-8d57-d2406cdcfe54", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c424fcca-fcaa-49c5-9171-61018c1542cf"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:10:29.275211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:10:29.277254 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:10:29.393231 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-846edb1b-a845-4424-97b6-6d0a7249baf5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] validate_networks() for [('c424fcca-fcaa-49c5-9171-61018c1542cf', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:10:29.916739 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-846edb1b-a845-4424-97b6-6d0a7249baf5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:10:29.917834 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-846edb1b-a845-4424-97b6-6d0a7249baf5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:10:29.918806 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-846edb1b-a845-4424-97b6-6d0a7249baf5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:10:29.919480 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-846edb1b-a845-4424-97b6-6d0a7249baf5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:10:29.919922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-846edb1b-a845-4424-97b6-6d0a7249baf5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:10:29.939442 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-846edb1b-a845-4424-97b6-6d0a7249baf5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:29.940078 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-846edb1b-a845-4424-97b6-6d0a7249baf5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:29.941148 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-846edb1b-a845-4424-97b6-6d0a7249baf5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:29.941688 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-846edb1b-a845-4424-97b6-6d0a7249baf5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:29.970162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-846edb1b-a845-4424-97b6-6d0a7249baf5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Getting quotas for project ba6762beb0fe4220b984143b3ea6bd48. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:10:29.979307 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-846edb1b-a845-4424-97b6-6d0a7249baf5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Getting quotas for user deeb5431c1284d02b245ff3a9dc3f4e8 and project ba6762beb0fe4220b984143b3ea6bd48. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:10:30.062451 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-846edb1b-a845-4424-97b6-6d0a7249baf5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:10:30.066350 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-846edb1b-a845-4424-97b6-6d0a7249baf5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a9b426ed-4927-4bec-8d57-d2406cdcfe54',volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:10:30.308812 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-846edb1b-a845-4424-97b6-6d0a7249baf5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.076594 Jul 19 23:10:30.316736 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3063/6118] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:10:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 1085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:10:30.322767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bd7aa43e-72ca-449f-a56f-12b971bddbaa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:30.324129 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bd7aa43e-72ca-449f-a56f-12b971bddbaa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:30.330943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:10:30.332252 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=19 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:10:30.426628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bd7aa43e-72ca-449f-a56f-12b971bddbaa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:10:30.433152 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bd7aa43e-72ca-449f-a56f-12b971bddbaa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 200 len: 1094 microversion: 2.1 time: 0.115921 Jul 19 23:10:30.434106 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3056/6119] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:30 2022] GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 1094 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:10:31.451542 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cf5a99e3-f9d5-4441-b342-027875c41882 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:31.452079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cf5a99e3-f9d5-4441-b342-027875c41882 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:31.471157 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cf5a99e3-f9d5-4441-b342-027875c41882 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:31.471461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cf5a99e3-f9d5-4441-b342-027875c41882 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:31.472255 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cf5a99e3-f9d5-4441-b342-027875c41882 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:31.472747 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cf5a99e3-f9d5-4441-b342-027875c41882 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:31.582991 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cf5a99e3-f9d5-4441-b342-027875c41882 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:10:31.612889 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cf5a99e3-f9d5-4441-b342-027875c41882 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 200 len: 1192 microversion: 2.1 time: 0.163034 Jul 19 23:10:31.613515 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3064/6120] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:31 2022] GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 1192 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:10:32.636582 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5b11d4af-d570-493e-b34b-7d24bfb9036a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:32.638663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5b11d4af-d570-493e-b34b-7d24bfb9036a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:32.660075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b11d4af-d570-493e-b34b-7d24bfb9036a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:32.661323 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b11d4af-d570-493e-b34b-7d24bfb9036a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:32.665649 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b11d4af-d570-493e-b34b-7d24bfb9036a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:32.668908 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b11d4af-d570-493e-b34b-7d24bfb9036a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:33.150623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5b11d4af-d570-493e-b34b-7d24bfb9036a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:10:33.170444 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5b11d4af-d570-493e-b34b-7d24bfb9036a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 200 len: 1277 microversion: 2.1 time: 0.538795 Jul 19 23:10:33.171786 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3057/6121] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:32 2022] GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 1277 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:10:34.194010 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-84d59ef6-5a8f-401f-be92-e2e160ab5313 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:34.195421 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-84d59ef6-5a8f-401f-be92-e2e160ab5313 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:34.212206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-84d59ef6-5a8f-401f-be92-e2e160ab5313 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:34.217747 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-84d59ef6-5a8f-401f-be92-e2e160ab5313 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:34.218879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-84d59ef6-5a8f-401f-be92-e2e160ab5313 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:34.224248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-84d59ef6-5a8f-401f-be92-e2e160ab5313 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:34.488151 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-84d59ef6-5a8f-401f-be92-e2e160ab5313 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:10:34.497286 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-84d59ef6-5a8f-401f-be92-e2e160ab5313 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 200 len: 1277 microversion: 2.1 time: 0.308016 Jul 19 23:10:34.508298 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3065/6122] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:34 2022] GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 1277 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:10:34.709237 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-fe5b24f5-38e8-41ec-b674-d7d3aaa00af3 req-61fb0ada-faad-4672-9408-2b6b73e24723 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68", "tag": "52a49ee4-0773-4a8e-82dc-1a8e8ddce9ea"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:10:34.732085 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-fe5b24f5-38e8-41ec-b674-d7d3aaa00af3 req-61fb0ada-faad-4672-9408-2b6b73e24723 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:34.732550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-fe5b24f5-38e8-41ec-b674-d7d3aaa00af3 req-61fb0ada-faad-4672-9408-2b6b73e24723 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:34.762904 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-fe5b24f5-38e8-41ec-b674-d7d3aaa00af3 req-61fb0ada-faad-4672-9408-2b6b73e24723 service nova] Creating event network-changed:52a49ee4-0773-4a8e-82dc-1a8e8ddce9ea for instance 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 on n-h1-847009-3 Jul 19 23:10:34.772522 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-fe5b24f5-38e8-41ec-b674-d7d3aaa00af3 req-61fb0ada-faad-4672-9408-2b6b73e24723 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069586 Jul 19 23:10:34.775741 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3058/6123] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:10:35.515429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ae9691f7-b63d-41d2-ba31-413461d0aa6b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:35.517075 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ae9691f7-b63d-41d2-ba31-413461d0aa6b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:35.526224 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae9691f7-b63d-41d2-ba31-413461d0aa6b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:35.529189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae9691f7-b63d-41d2-ba31-413461d0aa6b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:35.534169 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae9691f7-b63d-41d2-ba31-413461d0aa6b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:35.535018 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae9691f7-b63d-41d2-ba31-413461d0aa6b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:35.937443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ae9691f7-b63d-41d2-ba31-413461d0aa6b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:10:35.945545 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ae9691f7-b63d-41d2-ba31-413461d0aa6b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 200 len: 1277 microversion: 2.1 time: 0.434421 Jul 19 23:10:35.947437 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3066/6124] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:35 2022] GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 1277 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:10:36.981689 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7543578e-aa8d-4156-8fd7-e65e637daf26 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:36.990203 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7543578e-aa8d-4156-8fd7-e65e637daf26 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:37.015812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7543578e-aa8d-4156-8fd7-e65e637daf26 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:37.016445 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7543578e-aa8d-4156-8fd7-e65e637daf26 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:37.018115 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7543578e-aa8d-4156-8fd7-e65e637daf26 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:37.018707 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7543578e-aa8d-4156-8fd7-e65e637daf26 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:37.299460 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7543578e-aa8d-4156-8fd7-e65e637daf26 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:10:37.310256 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7543578e-aa8d-4156-8fd7-e65e637daf26 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 200 len: 1277 microversion: 2.1 time: 0.345060 Jul 19 23:10:37.311347 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3059/6125] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:36 2022] GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 1277 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:10:38.329843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b5e58401-c24c-4015-8ca0-f47e6ffbe9da tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:38.330607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b5e58401-c24c-4015-8ca0-f47e6ffbe9da tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:38.345410 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b5e58401-c24c-4015-8ca0-f47e6ffbe9da tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:38.355836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b5e58401-c24c-4015-8ca0-f47e6ffbe9da tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:38.357165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b5e58401-c24c-4015-8ca0-f47e6ffbe9da tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:38.357861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b5e58401-c24c-4015-8ca0-f47e6ffbe9da tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:38.617280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b5e58401-c24c-4015-8ca0-f47e6ffbe9da tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:10:38.627536 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b5e58401-c24c-4015-8ca0-f47e6ffbe9da tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 200 len: 1277 microversion: 2.1 time: 0.301414 Jul 19 23:10:38.628300 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3067/6126] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:38 2022] GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 1277 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:10:39.653673 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f7220862-69f8-40eb-87c7-84a1e5dfe9cb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:39.655026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f7220862-69f8-40eb-87c7-84a1e5dfe9cb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:39.669476 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f7220862-69f8-40eb-87c7-84a1e5dfe9cb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:39.674195 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f7220862-69f8-40eb-87c7-84a1e5dfe9cb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:39.675404 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f7220862-69f8-40eb-87c7-84a1e5dfe9cb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:39.676001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f7220862-69f8-40eb-87c7-84a1e5dfe9cb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:39.876478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f7220862-69f8-40eb-87c7-84a1e5dfe9cb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:10:39.886496 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f7220862-69f8-40eb-87c7-84a1e5dfe9cb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 200 len: 1265 microversion: 2.1 time: 0.243160 Jul 19 23:10:39.897620 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3060/6127] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:39 2022] GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:10:40.916442 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9882472f-de51-4667-a886-a48ce15efe4b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:40.917352 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9882472f-de51-4667-a886-a48ce15efe4b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:40.933914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:10:40.937494 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:10:40.940319 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9882472f-de51-4667-a886-a48ce15efe4b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:40.941727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9882472f-de51-4667-a886-a48ce15efe4b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:40.942728 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9882472f-de51-4667-a886-a48ce15efe4b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:40.943225 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9882472f-de51-4667-a886-a48ce15efe4b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:41.119740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9882472f-de51-4667-a886-a48ce15efe4b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:10:41.143599 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9882472f-de51-4667-a886-a48ce15efe4b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 200 len: 1265 microversion: 2.1 time: 0.241827 Jul 19 23:10:41.144826 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3068/6128] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:40 2022] GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:10:42.161576 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3ddb54ad-0b70-4b15-a919-aa0bfe6957b9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:42.162356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3ddb54ad-0b70-4b15-a919-aa0bfe6957b9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:42.170232 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:10:42.173264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3ddb54ad-0b70-4b15-a919-aa0bfe6957b9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:42.173860 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3ddb54ad-0b70-4b15-a919-aa0bfe6957b9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:42.174724 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3ddb54ad-0b70-4b15-a919-aa0bfe6957b9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:42.175422 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3ddb54ad-0b70-4b15-a919-aa0bfe6957b9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:42.672505 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3ddb54ad-0b70-4b15-a919-aa0bfe6957b9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:10:42.681983 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3ddb54ad-0b70-4b15-a919-aa0bfe6957b9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 200 len: 1265 microversion: 2.1 time: 0.524439 Jul 19 23:10:42.682867 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3061/6129] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:42 2022] GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 1265 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:10:42.830969 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d4433366-d4df-4450-9c30-25096ec3e777 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cae33ca-746f-4993-b4f4-89684411a579", "device": "/dev/sdb"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:10:42.832759 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d4433366-d4df-4450-9c30-25096ec3e777 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: c1e1153d-4437-4cd2-b4ff-65942754bb93] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:42.840712 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d4433366-d4df-4450-9c30-25096ec3e777 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:42.841217 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d4433366-d4df-4450-9c30-25096ec3e777 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:42.842044 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d4433366-d4df-4450-9c30-25096ec3e777 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:42.842500 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d4433366-d4df-4450-9c30-25096ec3e777 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:43.179077 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d4433366-d4df-4450-9c30-25096ec3e777 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "POST /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.351484 Jul 19 23:10:43.186507 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3069/6130] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 19 23:10:42 2022] POST /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93/os-volume_attachments => generated 194 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:10:43.703312 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c0411aa3-b029-4974-9f64-6a5376773039 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:43.704042 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c0411aa3-b029-4974-9f64-6a5376773039 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:43.718940 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0411aa3-b029-4974-9f64-6a5376773039 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:43.720028 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0411aa3-b029-4974-9f64-6a5376773039 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:43.721291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0411aa3-b029-4974-9f64-6a5376773039 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:43.722472 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0411aa3-b029-4974-9f64-6a5376773039 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:43.915887 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c0411aa3-b029-4974-9f64-6a5376773039 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:10:43.925031 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c0411aa3-b029-4974-9f64-6a5376773039 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 200 len: 1265 microversion: 2.1 time: 0.228844 Jul 19 23:10:43.936273 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3062/6131] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:43 2022] GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:10:44.947985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7b6a9ac3-6fee-4e10-aef5-60c7c2f6e56d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:44.949571 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7b6a9ac3-6fee-4e10-aef5-60c7c2f6e56d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:44.963616 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7b6a9ac3-6fee-4e10-aef5-60c7c2f6e56d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:44.964689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7b6a9ac3-6fee-4e10-aef5-60c7c2f6e56d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:44.967020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7b6a9ac3-6fee-4e10-aef5-60c7c2f6e56d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:44.967875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7b6a9ac3-6fee-4e10-aef5-60c7c2f6e56d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:45.162988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7b6a9ac3-6fee-4e10-aef5-60c7c2f6e56d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:10:45.173805 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7b6a9ac3-6fee-4e10-aef5-60c7c2f6e56d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 200 len: 1265 microversion: 2.1 time: 0.234034 Jul 19 23:10:45.177875 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3070/6132] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:44 2022] GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:10:46.192697 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3a197052-c329-4ec7-88d7-f2e2ce8bade2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:46.193256 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3a197052-c329-4ec7-88d7-f2e2ce8bade2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:46.209085 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a197052-c329-4ec7-88d7-f2e2ce8bade2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:46.209547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a197052-c329-4ec7-88d7-f2e2ce8bade2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:46.211072 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a197052-c329-4ec7-88d7-f2e2ce8bade2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:46.211814 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a197052-c329-4ec7-88d7-f2e2ce8bade2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:46.401381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3a197052-c329-4ec7-88d7-f2e2ce8bade2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:10:46.421662 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3a197052-c329-4ec7-88d7-f2e2ce8bade2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 200 len: 1265 microversion: 2.1 time: 0.233175 Jul 19 23:10:46.425270 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3063/6133] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:46 2022] GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:10:47.442290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ac4e844c-264b-410c-8b16-8afabbb00ebc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:47.443025 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ac4e844c-264b-410c-8b16-8afabbb00ebc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:47.452449 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac4e844c-264b-410c-8b16-8afabbb00ebc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:47.453123 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac4e844c-264b-410c-8b16-8afabbb00ebc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:47.454105 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac4e844c-264b-410c-8b16-8afabbb00ebc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:47.454723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ac4e844c-264b-410c-8b16-8afabbb00ebc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:47.680546 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ac4e844c-264b-410c-8b16-8afabbb00ebc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:10:47.689099 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ac4e844c-264b-410c-8b16-8afabbb00ebc tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 200 len: 1265 microversion: 2.1 time: 0.251065 Jul 19 23:10:47.700843 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3071/6134] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:47 2022] GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 1265 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:10:48.094439 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-90ed9a88-01b5-445f-ae51-376e5183f123 req-83fae84b-b4ec-45e3-8828-c16b7f25e6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68", "name": "network-vif-plugged", "status": "completed", "tag": "52a49ee4-0773-4a8e-82dc-1a8e8ddce9ea"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:10:48.112791 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-90ed9a88-01b5-445f-ae51-376e5183f123 req-83fae84b-b4ec-45e3-8828-c16b7f25e6b7 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:48.113302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-90ed9a88-01b5-445f-ae51-376e5183f123 req-83fae84b-b4ec-45e3-8828-c16b7f25e6b7 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:48.137319 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-90ed9a88-01b5-445f-ae51-376e5183f123 req-83fae84b-b4ec-45e3-8828-c16b7f25e6b7 service nova] Creating event network-vif-plugged:52a49ee4-0773-4a8e-82dc-1a8e8ddce9ea for instance 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 on n-h1-847009-3 Jul 19 23:10:48.142984 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-90ed9a88-01b5-445f-ae51-376e5183f123 req-83fae84b-b4ec-45e3-8828-c16b7f25e6b7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052644 Jul 19 23:10:48.144235 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3064/6135] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:10:48.708283 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c0769e65-aa5f-4eb7-9dc7-acc1da42cb70 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:48.709751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c0769e65-aa5f-4eb7-9dc7-acc1da42cb70 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:48.718987 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c0769e65-aa5f-4eb7-9dc7-acc1da42cb70 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:48.719818 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c0769e65-aa5f-4eb7-9dc7-acc1da42cb70 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:48.721118 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c0769e65-aa5f-4eb7-9dc7-acc1da42cb70 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:48.722102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c0769e65-aa5f-4eb7-9dc7-acc1da42cb70 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:48.883780 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c0769e65-aa5f-4eb7-9dc7-acc1da42cb70 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:10:48.892778 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c0769e65-aa5f-4eb7-9dc7-acc1da42cb70 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 200 len: 1265 microversion: 2.1 time: 0.188331 Jul 19 23:10:48.895608 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3072/6136] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:48 2022] GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:10:50.049133 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c7a42398-ad5e-4ef1-ba2c-26c7575d93ff tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:50.049771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c7a42398-ad5e-4ef1-ba2c-26c7575d93ff tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:50.057611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7a42398-ad5e-4ef1-ba2c-26c7575d93ff tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:50.058062 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7a42398-ad5e-4ef1-ba2c-26c7575d93ff tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:50.058855 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7a42398-ad5e-4ef1-ba2c-26c7575d93ff tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:50.059326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c7a42398-ad5e-4ef1-ba2c-26c7575d93ff tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:50.211568 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c7a42398-ad5e-4ef1-ba2c-26c7575d93ff tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:10:50.219324 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c7a42398-ad5e-4ef1-ba2c-26c7575d93ff tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 200 len: 1451 microversion: 2.1 time: 0.175346 Jul 19 23:10:50.219906 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3065/6137] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:50 2022] GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 1451 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:10:50.236811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-450b9533-3dbc-4acb-acdc-4f7ddc32f2ef tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:10:50.237548 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-450b9533-3dbc-4acb-acdc-4f7ddc32f2ef tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:10:50.245674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-450b9533-3dbc-4acb-acdc-4f7ddc32f2ef tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:50.246171 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-450b9533-3dbc-4acb-acdc-4f7ddc32f2ef tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:50.246968 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-450b9533-3dbc-4acb-acdc-4f7ddc32f2ef tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:50.247455 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-450b9533-3dbc-4acb-acdc-4f7ddc32f2ef tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:50.407732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-450b9533-3dbc-4acb-acdc-4f7ddc32f2ef tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:10:50.419312 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-450b9533-3dbc-4acb-acdc-4f7ddc32f2ef tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 200 len: 1451 microversion: 2.1 time: 0.184627 Jul 19 23:10:50.419312 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3073/6138] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:10:50 2022] GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 1451 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:10:52.676076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-d4e94f9d-3a25-414a-a7e8-d5e9b409c6ae req-d0b47e87-5e77-40c3-be20-1fa320730564 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68", "tag": "52a49ee4-0773-4a8e-82dc-1a8e8ddce9ea"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:10:52.690401 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d4e94f9d-3a25-414a-a7e8-d5e9b409c6ae req-d0b47e87-5e77-40c3-be20-1fa320730564 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:10:52.691356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d4e94f9d-3a25-414a-a7e8-d5e9b409c6ae req-d0b47e87-5e77-40c3-be20-1fa320730564 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:10:52.713654 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-d4e94f9d-3a25-414a-a7e8-d5e9b409c6ae req-d0b47e87-5e77-40c3-be20-1fa320730564 service nova] Creating event network-changed:52a49ee4-0773-4a8e-82dc-1a8e8ddce9ea for instance 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 on n-h1-847009-3 Jul 19 23:10:52.720679 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-d4e94f9d-3a25-414a-a7e8-d5e9b409c6ae req-d0b47e87-5e77-40c3-be20-1fa320730564 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048293 Jul 19 23:10:52.721724 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3066/6139] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:11:04.957023 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-02fec6eb-ee52-4860-af70-f2611f097163 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-994133325", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "64803b2a-0030-4b11-a03c-cb9f01166a68"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:11:04.966535 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:11:04.967570 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:11:05.024090 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-02fec6eb-ee52-4860-af70-f2611f097163 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] validate_networks() for [('64803b2a-0030-4b11-a03c-cb9f01166a68', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:11:05.425275 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-02fec6eb-ee52-4860-af70-f2611f097163 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:11:05.425799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-02fec6eb-ee52-4860-af70-f2611f097163 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:11:05.426358 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-02fec6eb-ee52-4860-af70-f2611f097163 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:11:05.426999 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-02fec6eb-ee52-4860-af70-f2611f097163 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:11:05.427540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-02fec6eb-ee52-4860-af70-f2611f097163 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:11:05.437997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-02fec6eb-ee52-4860-af70-f2611f097163 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:05.438532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-02fec6eb-ee52-4860-af70-f2611f097163 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:05.439451 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-02fec6eb-ee52-4860-af70-f2611f097163 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:05.439968 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-02fec6eb-ee52-4860-af70-f2611f097163 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:05.459005 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-02fec6eb-ee52-4860-af70-f2611f097163 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Getting quotas for project d260a0dc72e146b987d9cabfd5278f13. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:11:05.465316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-02fec6eb-ee52-4860-af70-f2611f097163 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Getting quotas for user d40b5bd8a50b4a33ab13126ee993d127 and project d260a0dc72e146b987d9cabfd5278f13. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:11:05.479520 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-02fec6eb-ee52-4860-af70-f2611f097163 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:11:05.481962 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-02fec6eb-ee52-4860-af70-f2611f097163 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: b69fac64-4381-4e9a-a3f1-a35fbb6f1adf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:11:05.542027 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-02fec6eb-ee52-4860-af70-f2611f097163 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588783 Jul 19 23:11:05.543051 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3074/6140] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:11:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:11:05.551073 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=24 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:11:05.552297 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=48 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:11:05.556902 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-32e80f05-455a-4537-b059-6d893a54ac89 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:05.557870 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-32e80f05-455a-4537-b059-6d893a54ac89 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: b69fac64-4381-4e9a-a3f1-a35fbb6f1adf] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:05.636781 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-32e80f05-455a-4537-b059-6d893a54ac89 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b5bd8a50b4a33ab13126ee993d127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd260a0dc72e146b987d9cabfd5278f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:05.662176 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-32e80f05-455a-4537-b059-6d893a54ac89 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf" status: 200 len: 1213 microversion: 2.1 time: 0.107871 Jul 19 23:11:05.667892 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3067/6141] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:05 2022] GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf => generated 1213 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:06.682530 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d86027e3-b47c-4e38-8fa7-6265c3183ced tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:06.684223 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d86027e3-b47c-4e38-8fa7-6265c3183ced tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: b69fac64-4381-4e9a-a3f1-a35fbb6f1adf] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:06.693702 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d86027e3-b47c-4e38-8fa7-6265c3183ced tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:06.694956 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d86027e3-b47c-4e38-8fa7-6265c3183ced tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:06.696326 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d86027e3-b47c-4e38-8fa7-6265c3183ced tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:06.696951 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d86027e3-b47c-4e38-8fa7-6265c3183ced tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:06.825190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d86027e3-b47c-4e38-8fa7-6265c3183ced tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b5bd8a50b4a33ab13126ee993d127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd260a0dc72e146b987d9cabfd5278f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:06.838131 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d86027e3-b47c-4e38-8fa7-6265c3183ced tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf" status: 200 len: 1273 microversion: 2.1 time: 0.160105 Jul 19 23:11:06.839256 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3075/6142] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:06 2022] GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf => generated 1273 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:07.859257 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-506ca3d8-77df-4158-9746-be6a576b1eb0 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:07.860576 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-506ca3d8-77df-4158-9746-be6a576b1eb0 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: b69fac64-4381-4e9a-a3f1-a35fbb6f1adf] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:07.872923 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-506ca3d8-77df-4158-9746-be6a576b1eb0 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:07.873482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-506ca3d8-77df-4158-9746-be6a576b1eb0 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:07.874752 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-506ca3d8-77df-4158-9746-be6a576b1eb0 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:07.875080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-506ca3d8-77df-4158-9746-be6a576b1eb0 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:08.138977 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-506ca3d8-77df-4158-9746-be6a576b1eb0 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b5bd8a50b4a33ab13126ee993d127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd260a0dc72e146b987d9cabfd5278f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:08.148265 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-506ca3d8-77df-4158-9746-be6a576b1eb0 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf" status: 200 len: 1313 microversion: 2.1 time: 0.293916 Jul 19 23:11:08.149381 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3068/6143] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:07 2022] GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:08.481382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-5cd47c6f-4e79-4b92-8842-bd5d1b05e6b4 req-c89ac94d-30b4-45b9-bbb9-83d0b9dd74dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b69fac64-4381-4e9a-a3f1-a35fbb6f1adf", "tag": "1c95f666-4f0e-4d5d-98fd-337ce2d8b507"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:11:08.496599 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-5cd47c6f-4e79-4b92-8842-bd5d1b05e6b4 req-c89ac94d-30b4-45b9-bbb9-83d0b9dd74dc service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:08.497059 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-5cd47c6f-4e79-4b92-8842-bd5d1b05e6b4 req-c89ac94d-30b4-45b9-bbb9-83d0b9dd74dc service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:08.516382 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-5cd47c6f-4e79-4b92-8842-bd5d1b05e6b4 req-c89ac94d-30b4-45b9-bbb9-83d0b9dd74dc service nova] Creating event network-changed:1c95f666-4f0e-4d5d-98fd-337ce2d8b507 for instance b69fac64-4381-4e9a-a3f1-a35fbb6f1adf on n-h2-847009-3 Jul 19 23:11:08.521602 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-5cd47c6f-4e79-4b92-8842-bd5d1b05e6b4 req-c89ac94d-30b4-45b9-bbb9-83d0b9dd74dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050818 Jul 19 23:11:08.522379 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3076/6144] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:11:08.625058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-58752339-6254-4c74-83b9-87735172a3b4 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:08.625839 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-58752339-6254-4c74-83b9-87735172a3b4 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: c1e1153d-4437-4cd2-b4ff-65942754bb93] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:08.634014 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58752339-6254-4c74-83b9-87735172a3b4 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:08.634801 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58752339-6254-4c74-83b9-87735172a3b4 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:08.635704 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58752339-6254-4c74-83b9-87735172a3b4 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:08.636239 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58752339-6254-4c74-83b9-87735172a3b4 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:08.728415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-58752339-6254-4c74-83b9-87735172a3b4 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lazy-loading 'services' on Instance uuid c1e1153d-4437-4cd2-b4ff-65942754bb93 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:11:08.823239 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-58752339-6254-4c74-83b9-87735172a3b4 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93/os-volume_attachments/8cae33ca-746f-4993-b4f4-89684411a579" status: 202 len: 0 microversion: 2.1 time: 0.201737 Jul 19 23:11:08.837268 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3069/6145] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 19 23:11:08 2022] DELETE /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93/os-volume_attachments/8cae33ca-746f-4993-b4f4-89684411a579 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:11:09.166595 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8303cfdf-f743-4397-9769-2b59ae7d92fb tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:09.167348 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8303cfdf-f743-4397-9769-2b59ae7d92fb tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: b69fac64-4381-4e9a-a3f1-a35fbb6f1adf] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:09.175302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8303cfdf-f743-4397-9769-2b59ae7d92fb tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:09.175763 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8303cfdf-f743-4397-9769-2b59ae7d92fb tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:09.176555 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8303cfdf-f743-4397-9769-2b59ae7d92fb tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:09.177007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8303cfdf-f743-4397-9769-2b59ae7d92fb tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:09.327212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8303cfdf-f743-4397-9769-2b59ae7d92fb tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b5bd8a50b4a33ab13126ee993d127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd260a0dc72e146b987d9cabfd5278f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:09.336136 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8303cfdf-f743-4397-9769-2b59ae7d92fb tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf" status: 200 len: 1313 microversion: 2.1 time: 0.173735 Jul 19 23:11:09.336742 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3077/6146] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:09 2022] GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:10.355981 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2cb0b8e1-b38c-414f-90be-94b6aa966766 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:10.357305 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2cb0b8e1-b38c-414f-90be-94b6aa966766 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: b69fac64-4381-4e9a-a3f1-a35fbb6f1adf] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:10.364119 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2cb0b8e1-b38c-414f-90be-94b6aa966766 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:10.364764 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2cb0b8e1-b38c-414f-90be-94b6aa966766 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:10.366320 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2cb0b8e1-b38c-414f-90be-94b6aa966766 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:10.366951 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2cb0b8e1-b38c-414f-90be-94b6aa966766 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:10.603787 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2cb0b8e1-b38c-414f-90be-94b6aa966766 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b5bd8a50b4a33ab13126ee993d127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd260a0dc72e146b987d9cabfd5278f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:10.613837 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2cb0b8e1-b38c-414f-90be-94b6aa966766 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf" status: 200 len: 1313 microversion: 2.1 time: 0.263719 Jul 19 23:11:10.623874 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3070/6147] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:10 2022] GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:11.631949 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f4f1d265-b1b6-41f3-bebe-3657df890065 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:11.633392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f4f1d265-b1b6-41f3-bebe-3657df890065 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: b69fac64-4381-4e9a-a3f1-a35fbb6f1adf] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:11.642565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f4f1d265-b1b6-41f3-bebe-3657df890065 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:11.643396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f4f1d265-b1b6-41f3-bebe-3657df890065 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:11.644470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f4f1d265-b1b6-41f3-bebe-3657df890065 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:11.645145 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f4f1d265-b1b6-41f3-bebe-3657df890065 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:11.808714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f4f1d265-b1b6-41f3-bebe-3657df890065 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b5bd8a50b4a33ab13126ee993d127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd260a0dc72e146b987d9cabfd5278f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:11.820261 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f4f1d265-b1b6-41f3-bebe-3657df890065 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf" status: 200 len: 1313 microversion: 2.1 time: 0.192338 Jul 19 23:11:11.821031 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3078/6148] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:11 2022] GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:12.838120 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-76a6db11-1940-4620-817d-350f09f1db40 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:12.838956 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-76a6db11-1940-4620-817d-350f09f1db40 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: b69fac64-4381-4e9a-a3f1-a35fbb6f1adf] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:12.847055 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-76a6db11-1940-4620-817d-350f09f1db40 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:12.847675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-76a6db11-1940-4620-817d-350f09f1db40 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:12.848692 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-76a6db11-1940-4620-817d-350f09f1db40 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:12.849231 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-76a6db11-1940-4620-817d-350f09f1db40 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:13.003195 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-76a6db11-1940-4620-817d-350f09f1db40 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b5bd8a50b4a33ab13126ee993d127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd260a0dc72e146b987d9cabfd5278f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:13.013370 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-76a6db11-1940-4620-817d-350f09f1db40 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf" status: 200 len: 1313 microversion: 2.1 time: 0.179324 Jul 19 23:11:13.024081 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3071/6149] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:12 2022] GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:13.445311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-e6d83141-601b-4ef1-a827-83effe127672 req-646602b0-fe67-49d3-89ae-82f6663d56fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69fac64-4381-4e9a-a3f1-a35fbb6f1adf", "name": "network-vif-plugged", "status": "completed", "tag": "1c95f666-4f0e-4d5d-98fd-337ce2d8b507"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:11:13.453961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e6d83141-601b-4ef1-a827-83effe127672 req-646602b0-fe67-49d3-89ae-82f6663d56fe service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:13.454425 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e6d83141-601b-4ef1-a827-83effe127672 req-646602b0-fe67-49d3-89ae-82f6663d56fe service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:13.467080 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-e6d83141-601b-4ef1-a827-83effe127672 req-646602b0-fe67-49d3-89ae-82f6663d56fe service nova] Creating event network-vif-plugged:1c95f666-4f0e-4d5d-98fd-337ce2d8b507 for instance b69fac64-4381-4e9a-a3f1-a35fbb6f1adf on n-h2-847009-3 Jul 19 23:11:13.472587 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-e6d83141-601b-4ef1-a827-83effe127672 req-646602b0-fe67-49d3-89ae-82f6663d56fe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188073 Jul 19 23:11:13.473577 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3079/6150] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:11:14.036844 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3d8ea55c-ced6-4aea-9532-5706b47595a5 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:14.038136 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3d8ea55c-ced6-4aea-9532-5706b47595a5 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: b69fac64-4381-4e9a-a3f1-a35fbb6f1adf] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:14.051465 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d8ea55c-ced6-4aea-9532-5706b47595a5 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:14.053151 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d8ea55c-ced6-4aea-9532-5706b47595a5 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:14.054661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d8ea55c-ced6-4aea-9532-5706b47595a5 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:14.055417 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3d8ea55c-ced6-4aea-9532-5706b47595a5 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:14.216713 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3d8ea55c-ced6-4aea-9532-5706b47595a5 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b5bd8a50b4a33ab13126ee993d127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd260a0dc72e146b987d9cabfd5278f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:14.229053 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3d8ea55c-ced6-4aea-9532-5706b47595a5 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf" status: 200 len: 1313 microversion: 2.1 time: 0.199930 Jul 19 23:11:14.254298 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3072/6151] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:14 2022] GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:15.249456 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8562887e-a3e5-462d-908b-f222e6dfc1d4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:15.250367 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8562887e-a3e5-462d-908b-f222e6dfc1d4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: b69fac64-4381-4e9a-a3f1-a35fbb6f1adf] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:15.257417 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8562887e-a3e5-462d-908b-f222e6dfc1d4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:15.257875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8562887e-a3e5-462d-908b-f222e6dfc1d4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:15.258710 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8562887e-a3e5-462d-908b-f222e6dfc1d4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:15.259267 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8562887e-a3e5-462d-908b-f222e6dfc1d4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:15.340420 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-46243be3-2e81-4539-87d5-9d1aa26ba713 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:15.341083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-46243be3-2e81-4539-87d5-9d1aa26ba713 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: c1e1153d-4437-4cd2-b4ff-65942754bb93] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:15.349332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-46243be3-2e81-4539-87d5-9d1aa26ba713 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:15.349815 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-46243be3-2e81-4539-87d5-9d1aa26ba713 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:15.350868 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-46243be3-2e81-4539-87d5-9d1aa26ba713 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:15.351337 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-46243be3-2e81-4539-87d5-9d1aa26ba713 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:15.383015 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-46243be3-2e81-4539-87d5-9d1aa26ba713 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: c1e1153d-4437-4cd2-b4ff-65942754bb93] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:11:15.415349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8562887e-a3e5-462d-908b-f222e6dfc1d4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b5bd8a50b4a33ab13126ee993d127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd260a0dc72e146b987d9cabfd5278f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:15.426064 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8562887e-a3e5-462d-908b-f222e6dfc1d4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf" status: 200 len: 1498 microversion: 2.1 time: 0.182490 Jul 19 23:11:15.431214 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3080/6152] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:15 2022] GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf => generated 1498 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:15.470910 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-46243be3-2e81-4539-87d5-9d1aa26ba713 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93" status: 204 len: 0 microversion: 2.1 time: 0.134069 Jul 19 23:11:15.472154 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3073/6153] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:11:15 2022] DELETE /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:11:15.480460 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-92fc4c87-307c-4450-9790-4594fd8323a0 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:15.481106 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-92fc4c87-307c-4450-9790-4594fd8323a0 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: c1e1153d-4437-4cd2-b4ff-65942754bb93] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:15.487294 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:11:15.487987 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:11:15.491056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-92fc4c87-307c-4450-9790-4594fd8323a0 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:15.491946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-92fc4c87-307c-4450-9790-4594fd8323a0 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:15.493092 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-92fc4c87-307c-4450-9790-4594fd8323a0 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:15.493892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-92fc4c87-307c-4450-9790-4594fd8323a0 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:15.668693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-92fc4c87-307c-4450-9790-4594fd8323a0 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3713bb52f20146a9afc829dc6b9ec38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924fe492641145ecb3906bfeda480dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:15.680692 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-92fc4c87-307c-4450-9790-4594fd8323a0 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93" status: 200 len: 1514 microversion: 2.1 time: 0.204147 Jul 19 23:11:15.681286 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3081/6154] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:15 2022] GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93 => generated 1514 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:15.924332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9b8bf3e1-3bfd-4103-9fae-edd6bb35f801 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:15.924952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9b8bf3e1-3bfd-4103-9fae-edd6bb35f801 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: b69fac64-4381-4e9a-a3f1-a35fbb6f1adf] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:15.927041 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:11:15.934158 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b8bf3e1-3bfd-4103-9fae-edd6bb35f801 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:15.934721 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b8bf3e1-3bfd-4103-9fae-edd6bb35f801 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:15.935538 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b8bf3e1-3bfd-4103-9fae-edd6bb35f801 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:15.935984 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b8bf3e1-3bfd-4103-9fae-edd6bb35f801 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:15.967847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9b8bf3e1-3bfd-4103-9fae-edd6bb35f801 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: b69fac64-4381-4e9a-a3f1-a35fbb6f1adf] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:11:16.067517 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9b8bf3e1-3bfd-4103-9fae-edd6bb35f801 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf" status: 204 len: 0 microversion: 2.1 time: 0.147252 Jul 19 23:11:16.068468 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3074/6155] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:11:15 2022] DELETE /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:11:16.080402 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c383a6a5-8dd6-4f6f-a7d3-6c886b5c43e4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:16.081085 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c383a6a5-8dd6-4f6f-a7d3-6c886b5c43e4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: b69fac64-4381-4e9a-a3f1-a35fbb6f1adf] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:16.089823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c383a6a5-8dd6-4f6f-a7d3-6c886b5c43e4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:16.090359 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c383a6a5-8dd6-4f6f-a7d3-6c886b5c43e4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:16.091505 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c383a6a5-8dd6-4f6f-a7d3-6c886b5c43e4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:16.092148 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c383a6a5-8dd6-4f6f-a7d3-6c886b5c43e4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:16.239774 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c383a6a5-8dd6-4f6f-a7d3-6c886b5c43e4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b5bd8a50b4a33ab13126ee993d127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd260a0dc72e146b987d9cabfd5278f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:16.250377 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c383a6a5-8dd6-4f6f-a7d3-6c886b5c43e4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf" status: 200 len: 1504 microversion: 2.1 time: 0.175703 Jul 19 23:11:16.251946 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3082/6156] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:16 2022] GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:16.700551 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3a72dad5-f237-48fe-993d-424cd87688ff tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:16.701270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3a72dad5-f237-48fe-993d-424cd87688ff tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: c1e1153d-4437-4cd2-b4ff-65942754bb93] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:16.711790 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a72dad5-f237-48fe-993d-424cd87688ff tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:16.712243 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a72dad5-f237-48fe-993d-424cd87688ff tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:16.713052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a72dad5-f237-48fe-993d-424cd87688ff tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:16.713493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3a72dad5-f237-48fe-993d-424cd87688ff tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:16.874583 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3a72dad5-f237-48fe-993d-424cd87688ff tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3713bb52f20146a9afc829dc6b9ec38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924fe492641145ecb3906bfeda480dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:16.882921 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3a72dad5-f237-48fe-993d-424cd87688ff tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93" status: 200 len: 1514 microversion: 2.1 time: 0.186750 Jul 19 23:11:16.884295 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3075/6157] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:16 2022] GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:17.271033 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1b87fc32-7184-4caf-8fd5-314f9a146361 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:17.272518 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1b87fc32-7184-4caf-8fd5-314f9a146361 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: b69fac64-4381-4e9a-a3f1-a35fbb6f1adf] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:17.279724 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b87fc32-7184-4caf-8fd5-314f9a146361 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:17.280282 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b87fc32-7184-4caf-8fd5-314f9a146361 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:17.281330 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b87fc32-7184-4caf-8fd5-314f9a146361 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:17.281866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b87fc32-7184-4caf-8fd5-314f9a146361 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:17.456944 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1b87fc32-7184-4caf-8fd5-314f9a146361 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b5bd8a50b4a33ab13126ee993d127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd260a0dc72e146b987d9cabfd5278f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:17.471185 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1b87fc32-7184-4caf-8fd5-314f9a146361 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf" status: 200 len: 1504 microversion: 2.1 time: 0.203626 Jul 19 23:11:17.471185 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3083/6158] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:17 2022] GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf => generated 1504 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:17.905075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ae46b996-c558-4ed5-88b7-31f9e6be1e59 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:17.906144 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ae46b996-c558-4ed5-88b7-31f9e6be1e59 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: c1e1153d-4437-4cd2-b4ff-65942754bb93] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:17.915579 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ae46b996-c558-4ed5-88b7-31f9e6be1e59 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:17.916189 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ae46b996-c558-4ed5-88b7-31f9e6be1e59 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:17.917179 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ae46b996-c558-4ed5-88b7-31f9e6be1e59 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:17.917712 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ae46b996-c558-4ed5-88b7-31f9e6be1e59 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:18.095692 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ae46b996-c558-4ed5-88b7-31f9e6be1e59 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3713bb52f20146a9afc829dc6b9ec38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924fe492641145ecb3906bfeda480dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:18.107763 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ae46b996-c558-4ed5-88b7-31f9e6be1e59 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93" status: 200 len: 1514 microversion: 2.1 time: 0.208454 Jul 19 23:11:18.108359 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3076/6159] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:17 2022] GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93 => generated 1514 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:18.494669 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e22b18d3-9f6c-4566-b7ab-55a68ee27242 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:18.496244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e22b18d3-9f6c-4566-b7ab-55a68ee27242 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: b69fac64-4381-4e9a-a3f1-a35fbb6f1adf] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:18.513179 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e22b18d3-9f6c-4566-b7ab-55a68ee27242 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:18.513893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e22b18d3-9f6c-4566-b7ab-55a68ee27242 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:18.514973 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e22b18d3-9f6c-4566-b7ab-55a68ee27242 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:18.515625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e22b18d3-9f6c-4566-b7ab-55a68ee27242 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:18.766008 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e22b18d3-9f6c-4566-b7ab-55a68ee27242 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b5bd8a50b4a33ab13126ee993d127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd260a0dc72e146b987d9cabfd5278f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:18.783990 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e22b18d3-9f6c-4566-b7ab-55a68ee27242 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf" status: 200 len: 1504 microversion: 2.1 time: 0.289495 Jul 19 23:11:18.785045 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3084/6160] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:18 2022] GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf => generated 1504 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:19.045371 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-eca14785-7e0e-486a-a770-366d7d5cd28c req-e2c2ffc5-b513-4f6d-b27a-217aac0f2033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69fac64-4381-4e9a-a3f1-a35fbb6f1adf", "name": "network-vif-deleted", "tag": "1c95f666-4f0e-4d5d-98fd-337ce2d8b507"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:11:19.056832 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-eca14785-7e0e-486a-a770-366d7d5cd28c req-e2c2ffc5-b513-4f6d-b27a-217aac0f2033 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:19.057655 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-eca14785-7e0e-486a-a770-366d7d5cd28c req-e2c2ffc5-b513-4f6d-b27a-217aac0f2033 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:19.070674 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-eca14785-7e0e-486a-a770-366d7d5cd28c req-e2c2ffc5-b513-4f6d-b27a-217aac0f2033 service nova] Creating event network-vif-deleted:1c95f666-4f0e-4d5d-98fd-337ce2d8b507 for instance b69fac64-4381-4e9a-a3f1-a35fbb6f1adf on n-h2-847009-3 Jul 19 23:11:19.077437 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-219c686d-cffe-4f75-a10a-cbe5908a927c req-d5d67638-16c2-45ac-8d36-b1af5e03df6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1e1153d-4437-4cd2-b4ff-65942754bb93", "name": "network-vif-deleted", "tag": "4834b125-0cad-4d50-90a3-c585d31ad5f7"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:11:19.078640 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-eca14785-7e0e-486a-a770-366d7d5cd28c req-e2c2ffc5-b513-4f6d-b27a-217aac0f2033 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039569 Jul 19 23:11:19.082381 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3077/6161] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:11:19.105898 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-219c686d-cffe-4f75-a10a-cbe5908a927c req-d5d67638-16c2-45ac-8d36-b1af5e03df6c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:19.106708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-219c686d-cffe-4f75-a10a-cbe5908a927c req-d5d67638-16c2-45ac-8d36-b1af5e03df6c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:19.121750 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-219c686d-cffe-4f75-a10a-cbe5908a927c req-d5d67638-16c2-45ac-8d36-b1af5e03df6c service nova] Creating event network-vif-deleted:4834b125-0cad-4d50-90a3-c585d31ad5f7 for instance c1e1153d-4437-4cd2-b4ff-65942754bb93 on n-h2-847009-3 Jul 19 23:11:19.128191 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-219c686d-cffe-4f75-a10a-cbe5908a927c req-d5d67638-16c2-45ac-8d36-b1af5e03df6c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059775 Jul 19 23:11:19.129324 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3085/6162] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:11:19.137582 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a3f3f931-d4c1-4dfc-b609-0cba3514bfd3 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:19.138324 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a3f3f931-d4c1-4dfc-b609-0cba3514bfd3 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: c1e1153d-4437-4cd2-b4ff-65942754bb93] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:19.145000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3f3f931-d4c1-4dfc-b609-0cba3514bfd3 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:19.145505 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3f3f931-d4c1-4dfc-b609-0cba3514bfd3 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:19.146330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3f3f931-d4c1-4dfc-b609-0cba3514bfd3 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:19.146805 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3f3f931-d4c1-4dfc-b609-0cba3514bfd3 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:19.223616 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a3f3f931-d4c1-4dfc-b609-0cba3514bfd3 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3713bb52f20146a9afc829dc6b9ec38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924fe492641145ecb3906bfeda480dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:19.234432 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a3f3f931-d4c1-4dfc-b609-0cba3514bfd3 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93" status: 200 len: 1303 microversion: 2.1 time: 0.105162 Jul 19 23:11:19.236774 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3078/6163] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:19 2022] GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93 => generated 1303 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:11:19.804968 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-972d7baa-0b83-4ccc-ad10-61ff6e3b1442 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:19.805960 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-972d7baa-0b83-4ccc-ad10-61ff6e3b1442 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: b69fac64-4381-4e9a-a3f1-a35fbb6f1adf] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:19.819977 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-972d7baa-0b83-4ccc-ad10-61ff6e3b1442 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:19.820809 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-972d7baa-0b83-4ccc-ad10-61ff6e3b1442 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:19.821784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-972d7baa-0b83-4ccc-ad10-61ff6e3b1442 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:19.822441 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-972d7baa-0b83-4ccc-ad10-61ff6e3b1442 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:19.872007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-972d7baa-0b83-4ccc-ad10-61ff6e3b1442 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:19.872484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-972d7baa-0b83-4ccc-ad10-61ff6e3b1442 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:19.872970 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-972d7baa-0b83-4ccc-ad10-61ff6e3b1442 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lazy-loading 'fault' on Instance uuid b69fac64-4381-4e9a-a3f1-a35fbb6f1adf {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:11:19.923496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-972d7baa-0b83-4ccc-ad10-61ff6e3b1442 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b5bd8a50b4a33ab13126ee993d127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd260a0dc72e146b987d9cabfd5278f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:19.931781 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-972d7baa-0b83-4ccc-ad10-61ff6e3b1442 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf" status: 200 len: 1303 microversion: 2.1 time: 0.132924 Jul 19 23:11:19.932714 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3086/6164] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:19 2022] GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf => generated 1303 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:20.253303 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cb400a7b-7113-47f7-87a5-0a2c6c0c289c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:20.254403 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cb400a7b-7113-47f7-87a5-0a2c6c0c289c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: c1e1153d-4437-4cd2-b4ff-65942754bb93] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:20.263102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cb400a7b-7113-47f7-87a5-0a2c6c0c289c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:20.263678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cb400a7b-7113-47f7-87a5-0a2c6c0c289c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:20.264684 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cb400a7b-7113-47f7-87a5-0a2c6c0c289c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:20.265262 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cb400a7b-7113-47f7-87a5-0a2c6c0c289c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:20.284871 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-cb400a7b-7113-47f7-87a5-0a2c6c0c289c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] HTTP exception thrown: Instance c1e1153d-4437-4cd2-b4ff-65942754bb93 could not be found. Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cb400a7b-7113-47f7-87a5-0a2c6c0c289c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Request method failure captured: Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93 HTTP/1.1 Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zlmZzgqFz7boRhXPEXGyjmRxw70Vpr6rOoaje2PM1ftAN4dBKyT8dQxryjr1vMVyliTkRVEvWqHsYWST35atvkSyA5-SXYf4OfYRWnSAwz1bh1xD8fISZkISqcMuIOn8QJRqki17N0D3GeKn0EK6dk6mZtvWZNgxomEJe-fOeqXLcc Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 924fe492641145ecb3906bfeda480dde Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-VolumesSnapshotTestJSON-354563054 Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_924fe492641145ecb3906bfeda480dde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/924fe492641145ecb3906bfeda480dde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/924fe492641145ecb3906bfeda480dde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/924fe492641145ecb3906bfeda480dde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-VolumesSnapshotTestJSON-354563054 Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 924fe492641145ecb3906bfeda480dde Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-354563054 Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-VolumesSnapshotTestJSON-354563054-project Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 3713bb52f20146a9afc829dc6b9ec38e Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-VolumesSnapshotTestJSON-354563054-project Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance c1e1153d-4437-4cd2-b4ff-65942754bb93 could not be found. Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'c1e1153d-4437-4cd2-b4ff-65942754bb93'} Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1e1153d-4437-4cd2-b4ff-65942754bb93 could not be found. Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1e1153d-4437-4cd2-b4ff-65942754bb93 could not be found. Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:11:20.287365 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:11:20.293146 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:11:20.293146 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:11:20.293146 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:11:20.293146 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:11:20.293146 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:11:20.293146 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1e1153d-4437-4cd2-b4ff-65942754bb93 could not be found. Jul 19 23:11:20.293146 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:11:20.293146 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cb400a7b-7113-47f7-87a5-0a2c6c0c289c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Returning 404 to user: Instance c1e1153d-4437-4cd2-b4ff-65942754bb93 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:11:20.293146 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cb400a7b-7113-47f7-87a5-0a2c6c0c289c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93" status: 404 len: 111 microversion: 2.1 time: 0.040317 Jul 19 23:11:20.293146 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3079/6165] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:20 2022] GET /compute/v2.1/servers/c1e1153d-4437-4cd2-b4ff-65942754bb93 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:11:20.950390 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-158ced99-0db8-466a-b512-49ffd2fe2c36 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:20.951464 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-158ced99-0db8-466a-b512-49ffd2fe2c36 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: b69fac64-4381-4e9a-a3f1-a35fbb6f1adf] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:20.958894 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-158ced99-0db8-466a-b512-49ffd2fe2c36 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:20.959409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-158ced99-0db8-466a-b512-49ffd2fe2c36 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:20.960197 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-158ced99-0db8-466a-b512-49ffd2fe2c36 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:20.960647 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-158ced99-0db8-466a-b512-49ffd2fe2c36 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:20.980486 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-158ced99-0db8-466a-b512-49ffd2fe2c36 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] HTTP exception thrown: Instance b69fac64-4381-4e9a-a3f1-a35fbb6f1adf could not be found. Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-158ced99-0db8-466a-b512-49ffd2fe2c36 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Request method failure captured: Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf HTTP/1.1 Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zoG8RP9Cl1VNv9x3l8OCibQCQRv-GHhJOls8c2gwKcFNPiHz2v9eHbfB9VcFnO9lcTLe1yMXh2UZoJxOhHMCnnL84H_OTqhFJGkmws1B6_CJKKxA0ujDAjXEc5-aUspFT6HVZ8S7t4LQiq-ZwopZ4J8okBB83zua52MjyNbtE0-p_E Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: d260a0dc72e146b987d9cabfd5278f13 Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-VolumesActionsTest-780583513 Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d260a0dc72e146b987d9cabfd5278f13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d260a0dc72e146b987d9cabfd5278f13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d260a0dc72e146b987d9cabfd5278f13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d260a0dc72e146b987d9cabfd5278f13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-VolumesActionsTest-780583513 Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: d260a0dc72e146b987d9cabfd5278f13 Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-VolumesActionsTest-780583513 Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-VolumesActionsTest-780583513-project Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: d40b5bd8a50b4a33ab13126ee993d127 Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-VolumesActionsTest-780583513-project Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance b69fac64-4381-4e9a-a3f1-a35fbb6f1adf could not be found. Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'b69fac64-4381-4e9a-a3f1-a35fbb6f1adf'} Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b69fac64-4381-4e9a-a3f1-a35fbb6f1adf could not be found. Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b69fac64-4381-4e9a-a3f1-a35fbb6f1adf could not be found. Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:11:20.982640 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:11:20.988444 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:11:20.988444 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:11:20.988444 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:11:20.988444 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:11:20.988444 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:11:20.988444 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b69fac64-4381-4e9a-a3f1-a35fbb6f1adf could not be found. Jul 19 23:11:20.988444 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:11:20.988444 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-158ced99-0db8-466a-b512-49ffd2fe2c36 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Returning 404 to user: Instance b69fac64-4381-4e9a-a3f1-a35fbb6f1adf could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:11:20.988444 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-158ced99-0db8-466a-b512-49ffd2fe2c36 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf" status: 404 len: 111 microversion: 2.1 time: 0.038280 Jul 19 23:11:20.995911 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3087/6166] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:20 2022] GET /compute/v2.1/servers/b69fac64-4381-4e9a-a3f1-a35fbb6f1adf => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:11:21.041846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-59608dc2-f288-4fc8-8ae3-9227b1d6133a tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-35040082", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "64803b2a-0030-4b11-a03c-cb9f01166a68"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:11:21.100233 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-59608dc2-f288-4fc8-8ae3-9227b1d6133a tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] validate_networks() for [('64803b2a-0030-4b11-a03c-cb9f01166a68', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:11:21.521710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-59608dc2-f288-4fc8-8ae3-9227b1d6133a tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:11:21.522348 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-59608dc2-f288-4fc8-8ae3-9227b1d6133a tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:11:21.522893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-59608dc2-f288-4fc8-8ae3-9227b1d6133a tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:11:21.523631 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-59608dc2-f288-4fc8-8ae3-9227b1d6133a tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:11:21.524147 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-59608dc2-f288-4fc8-8ae3-9227b1d6133a tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:11:21.534030 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-59608dc2-f288-4fc8-8ae3-9227b1d6133a tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:21.535282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-59608dc2-f288-4fc8-8ae3-9227b1d6133a tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:21.537165 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-59608dc2-f288-4fc8-8ae3-9227b1d6133a tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:21.537836 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-59608dc2-f288-4fc8-8ae3-9227b1d6133a tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:21.558720 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-59608dc2-f288-4fc8-8ae3-9227b1d6133a tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Getting quotas for project d260a0dc72e146b987d9cabfd5278f13. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:11:21.564702 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-59608dc2-f288-4fc8-8ae3-9227b1d6133a tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Getting quotas for user d40b5bd8a50b4a33ab13126ee993d127 and project d260a0dc72e146b987d9cabfd5278f13. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:11:21.579677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-59608dc2-f288-4fc8-8ae3-9227b1d6133a tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:11:21.582274 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-59608dc2-f288-4fc8-8ae3-9227b1d6133a tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: be70ee11-9889-47d1-a1d9-aae8e538a88c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:11:21.636312 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-59608dc2-f288-4fc8-8ae3-9227b1d6133a tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599311 Jul 19 23:11:21.637567 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3080/6167] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:11:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:11:21.657374 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-63670750-da55-4f03-b6bc-b0a2bb4d459a tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:21.658130 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-63670750-da55-4f03-b6bc-b0a2bb4d459a tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: be70ee11-9889-47d1-a1d9-aae8e538a88c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:21.733014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-63670750-da55-4f03-b6bc-b0a2bb4d459a tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b5bd8a50b4a33ab13126ee993d127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd260a0dc72e146b987d9cabfd5278f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:21.740886 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-63670750-da55-4f03-b6bc-b0a2bb4d459a tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c" status: 200 len: 1212 microversion: 2.1 time: 0.096023 Jul 19 23:11:21.741809 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3088/6168] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:21 2022] GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c => generated 1212 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:22.762490 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4561724e-6c04-4320-bfe2-ddb883ef1ce0 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:22.764087 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4561724e-6c04-4320-bfe2-ddb883ef1ce0 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: be70ee11-9889-47d1-a1d9-aae8e538a88c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:22.797467 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4561724e-6c04-4320-bfe2-ddb883ef1ce0 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:22.799931 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4561724e-6c04-4320-bfe2-ddb883ef1ce0 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:22.803508 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4561724e-6c04-4320-bfe2-ddb883ef1ce0 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:22.804755 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4561724e-6c04-4320-bfe2-ddb883ef1ce0 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:22.920821 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4561724e-6c04-4320-bfe2-ddb883ef1ce0 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b5bd8a50b4a33ab13126ee993d127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd260a0dc72e146b987d9cabfd5278f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:22.941152 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4561724e-6c04-4320-bfe2-ddb883ef1ce0 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c" status: 200 len: 1264 microversion: 2.1 time: 0.184495 Jul 19 23:11:22.941925 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3081/6169] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:22 2022] GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c => generated 1264 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:23.961379 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cb851efe-eef3-432b-b3e7-4381c67bf453 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:23.965172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cb851efe-eef3-432b-b3e7-4381c67bf453 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: be70ee11-9889-47d1-a1d9-aae8e538a88c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:23.981247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cb851efe-eef3-432b-b3e7-4381c67bf453 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:23.982078 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cb851efe-eef3-432b-b3e7-4381c67bf453 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:23.983095 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cb851efe-eef3-432b-b3e7-4381c67bf453 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:23.983812 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cb851efe-eef3-432b-b3e7-4381c67bf453 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:24.288799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cb851efe-eef3-432b-b3e7-4381c67bf453 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b5bd8a50b4a33ab13126ee993d127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd260a0dc72e146b987d9cabfd5278f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:24.303191 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cb851efe-eef3-432b-b3e7-4381c67bf453 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c" status: 200 len: 1312 microversion: 2.1 time: 0.346903 Jul 19 23:11:24.304131 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3089/6170] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:23 2022] GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c => generated 1312 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:24.987382 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-d7b80602-78e0-4ccd-b635-f46873f2d3c5 req-304310c4-b90c-49cb-ab80-1b4a0c0b7bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be70ee11-9889-47d1-a1d9-aae8e538a88c", "tag": "06820d46-2b80-47c0-8055-c89b16a0f796"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:11:25.028417 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d7b80602-78e0-4ccd-b635-f46873f2d3c5 req-304310c4-b90c-49cb-ab80-1b4a0c0b7bd0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:25.029159 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d7b80602-78e0-4ccd-b635-f46873f2d3c5 req-304310c4-b90c-49cb-ab80-1b4a0c0b7bd0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:25.043711 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-d7b80602-78e0-4ccd-b635-f46873f2d3c5 req-304310c4-b90c-49cb-ab80-1b4a0c0b7bd0 service nova] Creating event network-changed:06820d46-2b80-47c0-8055-c89b16a0f796 for instance be70ee11-9889-47d1-a1d9-aae8e538a88c on n-h2-847009-3 Jul 19 23:11:25.064803 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-d7b80602-78e0-4ccd-b635-f46873f2d3c5 req-304310c4-b90c-49cb-ab80-1b4a0c0b7bd0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075096 Jul 19 23:11:25.065890 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3082/6171] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:11:25.320322 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c21ced5f-0a16-49bd-8ff3-22ccf1ceb503 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:25.321568 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c21ced5f-0a16-49bd-8ff3-22ccf1ceb503 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: be70ee11-9889-47d1-a1d9-aae8e538a88c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:25.335474 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c21ced5f-0a16-49bd-8ff3-22ccf1ceb503 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:25.337504 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c21ced5f-0a16-49bd-8ff3-22ccf1ceb503 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:25.341390 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c21ced5f-0a16-49bd-8ff3-22ccf1ceb503 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:25.342581 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c21ced5f-0a16-49bd-8ff3-22ccf1ceb503 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:25.620869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c21ced5f-0a16-49bd-8ff3-22ccf1ceb503 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b5bd8a50b4a33ab13126ee993d127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd260a0dc72e146b987d9cabfd5278f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:25.632276 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c21ced5f-0a16-49bd-8ff3-22ccf1ceb503 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c" status: 200 len: 1312 microversion: 2.1 time: 0.315120 Jul 19 23:11:25.633629 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3090/6172] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:25 2022] GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c => generated 1312 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:26.653491 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ca99482f-8410-4382-81db-9b41f28f6760 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:26.654716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ca99482f-8410-4382-81db-9b41f28f6760 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: be70ee11-9889-47d1-a1d9-aae8e538a88c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:26.663915 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca99482f-8410-4382-81db-9b41f28f6760 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:26.664661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca99482f-8410-4382-81db-9b41f28f6760 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:26.665702 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca99482f-8410-4382-81db-9b41f28f6760 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:26.666373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ca99482f-8410-4382-81db-9b41f28f6760 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:26.671785 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:11:26.941963 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ca99482f-8410-4382-81db-9b41f28f6760 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b5bd8a50b4a33ab13126ee993d127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd260a0dc72e146b987d9cabfd5278f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:26.950809 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ca99482f-8410-4382-81db-9b41f28f6760 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c" status: 200 len: 1312 microversion: 2.1 time: 0.305038 Jul 19 23:11:26.951543 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3083/6173] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:26 2022] GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c => generated 1312 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:27.287725 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5e137409-8f58-418c-814c-13d716a6f824 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1905146566", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "cd5ff97c-bddb-4ba8-aa6c-f045828fce6b"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:11:27.344581 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-5e137409-8f58-418c-814c-13d716a6f824 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] validate_networks() for [('cd5ff97c-bddb-4ba8-aa6c-f045828fce6b', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:11:27.798962 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-5e137409-8f58-418c-814c-13d716a6f824 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:11:27.799427 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-5e137409-8f58-418c-814c-13d716a6f824 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:11:27.799945 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-5e137409-8f58-418c-814c-13d716a6f824 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:11:27.800375 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-5e137409-8f58-418c-814c-13d716a6f824 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:11:27.800804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-5e137409-8f58-418c-814c-13d716a6f824 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:11:27.811248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5e137409-8f58-418c-814c-13d716a6f824 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:27.811717 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5e137409-8f58-418c-814c-13d716a6f824 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:27.812533 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5e137409-8f58-418c-814c-13d716a6f824 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:27.812988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5e137409-8f58-418c-814c-13d716a6f824 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:27.831808 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-5e137409-8f58-418c-814c-13d716a6f824 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Getting quotas for project 924fe492641145ecb3906bfeda480dde. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:11:27.837922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-5e137409-8f58-418c-814c-13d716a6f824 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Getting quotas for user 3713bb52f20146a9afc829dc6b9ec38e and project 924fe492641145ecb3906bfeda480dde. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:11:27.851951 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5e137409-8f58-418c-814c-13d716a6f824 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:11:27.854274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5e137409-8f58-418c-814c-13d716a6f824 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: 51afd7bf-0042-4853-b68d-768663bea88d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:11:27.901252 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5e137409-8f58-418c-814c-13d716a6f824 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617427 Jul 19 23:11:27.902180 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3091/6174] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:11:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:11:27.912901 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c329effa-d791-40d4-a2ce-31ada08f36f9 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:27.913510 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c329effa-d791-40d4-a2ce-31ada08f36f9 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: 51afd7bf-0042-4853-b68d-768663bea88d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:27.969453 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-05ba785a-8d6c-4314-902e-c8cf66ce6cb4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:27.970262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-05ba785a-8d6c-4314-902e-c8cf66ce6cb4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: be70ee11-9889-47d1-a1d9-aae8e538a88c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:27.983375 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05ba785a-8d6c-4314-902e-c8cf66ce6cb4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:27.984435 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05ba785a-8d6c-4314-902e-c8cf66ce6cb4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:27.987419 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05ba785a-8d6c-4314-902e-c8cf66ce6cb4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:27.988993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05ba785a-8d6c-4314-902e-c8cf66ce6cb4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:27.993652 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c329effa-d791-40d4-a2ce-31ada08f36f9 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3713bb52f20146a9afc829dc6b9ec38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924fe492641145ecb3906bfeda480dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:28.025051 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c329effa-d791-40d4-a2ce-31ada08f36f9 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d" status: 200 len: 1219 microversion: 2.1 time: 0.116391 Jul 19 23:11:28.025603 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3084/6175] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:27 2022] GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d => generated 1219 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:11:28.193992 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-05ba785a-8d6c-4314-902e-c8cf66ce6cb4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b5bd8a50b4a33ab13126ee993d127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd260a0dc72e146b987d9cabfd5278f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:28.202758 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-05ba785a-8d6c-4314-902e-c8cf66ce6cb4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c" status: 200 len: 1312 microversion: 2.1 time: 0.237992 Jul 19 23:11:28.203391 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3092/6176] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:27 2022] GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c => generated 1312 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:29.042873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-08b96b4d-5ac2-46cc-b51a-1e6e028cf080 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:29.044241 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-08b96b4d-5ac2-46cc-b51a-1e6e028cf080 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: 51afd7bf-0042-4853-b68d-768663bea88d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:29.060840 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-08b96b4d-5ac2-46cc-b51a-1e6e028cf080 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:29.061593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-08b96b4d-5ac2-46cc-b51a-1e6e028cf080 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:29.062605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-08b96b4d-5ac2-46cc-b51a-1e6e028cf080 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:29.064649 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-08b96b4d-5ac2-46cc-b51a-1e6e028cf080 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:29.168323 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-08b96b4d-5ac2-46cc-b51a-1e6e028cf080 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3713bb52f20146a9afc829dc6b9ec38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924fe492641145ecb3906bfeda480dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:29.185826 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-08b96b4d-5ac2-46cc-b51a-1e6e028cf080 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d" status: 200 len: 1289 microversion: 2.1 time: 0.146835 Jul 19 23:11:29.186472 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3085/6177] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:29 2022] GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d => generated 1289 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:29.221889 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-da5e4e57-dce3-47b5-8ec8-4360362593a3 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:29.223417 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-da5e4e57-dce3-47b5-8ec8-4360362593a3 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: be70ee11-9889-47d1-a1d9-aae8e538a88c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:29.232431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-da5e4e57-dce3-47b5-8ec8-4360362593a3 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:29.233301 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-da5e4e57-dce3-47b5-8ec8-4360362593a3 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:29.234351 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-da5e4e57-dce3-47b5-8ec8-4360362593a3 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:29.235093 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-da5e4e57-dce3-47b5-8ec8-4360362593a3 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:29.510600 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-da5e4e57-dce3-47b5-8ec8-4360362593a3 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b5bd8a50b4a33ab13126ee993d127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd260a0dc72e146b987d9cabfd5278f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:29.519089 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-da5e4e57-dce3-47b5-8ec8-4360362593a3 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c" status: 200 len: 1312 microversion: 2.1 time: 0.302344 Jul 19 23:11:29.519721 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3093/6178] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:29 2022] GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c => generated 1312 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:30.204504 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-07a3da73-c0f6-4f2a-b4b5-0f429c8513bf tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:30.205120 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-07a3da73-c0f6-4f2a-b4b5-0f429c8513bf tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: 51afd7bf-0042-4853-b68d-768663bea88d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:30.213363 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07a3da73-c0f6-4f2a-b4b5-0f429c8513bf tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:30.213944 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07a3da73-c0f6-4f2a-b4b5-0f429c8513bf tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:30.214779 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07a3da73-c0f6-4f2a-b4b5-0f429c8513bf tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:30.215240 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-07a3da73-c0f6-4f2a-b4b5-0f429c8513bf tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:30.441995 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-07a3da73-c0f6-4f2a-b4b5-0f429c8513bf tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3713bb52f20146a9afc829dc6b9ec38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924fe492641145ecb3906bfeda480dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:30.457555 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-07a3da73-c0f6-4f2a-b4b5-0f429c8513bf tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d" status: 200 len: 1319 microversion: 2.1 time: 0.256501 Jul 19 23:11:30.460600 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3086/6179] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:30 2022] GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:30.539084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ec464e88-330e-480b-a1c0-75f0d3302236 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:30.540520 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ec464e88-330e-480b-a1c0-75f0d3302236 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: be70ee11-9889-47d1-a1d9-aae8e538a88c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:30.550502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ec464e88-330e-480b-a1c0-75f0d3302236 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:30.551234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ec464e88-330e-480b-a1c0-75f0d3302236 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:30.552351 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ec464e88-330e-480b-a1c0-75f0d3302236 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:30.552944 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ec464e88-330e-480b-a1c0-75f0d3302236 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:30.773321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ec464e88-330e-480b-a1c0-75f0d3302236 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b5bd8a50b4a33ab13126ee993d127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd260a0dc72e146b987d9cabfd5278f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:30.793519 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ec464e88-330e-480b-a1c0-75f0d3302236 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c" status: 200 len: 1312 microversion: 2.1 time: 0.259734 Jul 19 23:11:30.794402 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3094/6180] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:30 2022] GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c => generated 1312 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:30.875344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-f1ff7943-06b8-4d6d-b86a-cc6f21d1538a req-53247a67-31a3-414b-a703-fbf64ead3d9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51afd7bf-0042-4853-b68d-768663bea88d", "tag": "7e8ca965-2938-4f02-bf2e-c074e76face2"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:11:30.889799 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f1ff7943-06b8-4d6d-b86a-cc6f21d1538a req-53247a67-31a3-414b-a703-fbf64ead3d9f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:30.890609 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f1ff7943-06b8-4d6d-b86a-cc6f21d1538a req-53247a67-31a3-414b-a703-fbf64ead3d9f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:30.905067 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-f1ff7943-06b8-4d6d-b86a-cc6f21d1538a req-53247a67-31a3-414b-a703-fbf64ead3d9f service nova] Creating event network-changed:7e8ca965-2938-4f02-bf2e-c074e76face2 for instance 51afd7bf-0042-4853-b68d-768663bea88d on n-h1-847009-3 Jul 19 23:11:30.909907 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-f1ff7943-06b8-4d6d-b86a-cc6f21d1538a req-53247a67-31a3-414b-a703-fbf64ead3d9f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042698 Jul 19 23:11:30.910566 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3087/6181] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:11:31.357580 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-93aee690-2d35-4112-8ff8-c02980bdaafd req-37326fba-8ca6-4268-b992-12eecfc95f5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be70ee11-9889-47d1-a1d9-aae8e538a88c", "name": "network-vif-plugged", "status": "completed", "tag": "06820d46-2b80-47c0-8055-c89b16a0f796"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:11:31.366931 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-93aee690-2d35-4112-8ff8-c02980bdaafd req-37326fba-8ca6-4268-b992-12eecfc95f5c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:31.367424 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-93aee690-2d35-4112-8ff8-c02980bdaafd req-37326fba-8ca6-4268-b992-12eecfc95f5c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:31.372464 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=100 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:11:31.382220 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-93aee690-2d35-4112-8ff8-c02980bdaafd req-37326fba-8ca6-4268-b992-12eecfc95f5c service nova] Creating event network-vif-plugged:06820d46-2b80-47c0-8055-c89b16a0f796 for instance be70ee11-9889-47d1-a1d9-aae8e538a88c on n-h2-847009-3 Jul 19 23:11:31.387690 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-93aee690-2d35-4112-8ff8-c02980bdaafd req-37326fba-8ca6-4268-b992-12eecfc95f5c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034511 Jul 19 23:11:31.388511 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3095/6182] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:11:31.477052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9df4fc8d-ca3b-40fa-a08f-fa2b1cf3fbc3 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:31.477763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9df4fc8d-ca3b-40fa-a08f-fa2b1cf3fbc3 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: 51afd7bf-0042-4853-b68d-768663bea88d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:31.484350 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9df4fc8d-ca3b-40fa-a08f-fa2b1cf3fbc3 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:31.484807 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9df4fc8d-ca3b-40fa-a08f-fa2b1cf3fbc3 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:31.485586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9df4fc8d-ca3b-40fa-a08f-fa2b1cf3fbc3 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:31.486079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9df4fc8d-ca3b-40fa-a08f-fa2b1cf3fbc3 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:31.547330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:11:31.647832 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9df4fc8d-ca3b-40fa-a08f-fa2b1cf3fbc3 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3713bb52f20146a9afc829dc6b9ec38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924fe492641145ecb3906bfeda480dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:31.655664 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9df4fc8d-ca3b-40fa-a08f-fa2b1cf3fbc3 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d" status: 200 len: 1319 microversion: 2.1 time: 0.183676 Jul 19 23:11:31.656262 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3088/6183] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:31 2022] GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:31.812918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6213ef9d-5510-4c35-b19f-87c2bacf3deb tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:31.813651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6213ef9d-5510-4c35-b19f-87c2bacf3deb tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: be70ee11-9889-47d1-a1d9-aae8e538a88c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:31.821836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6213ef9d-5510-4c35-b19f-87c2bacf3deb tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:31.822332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6213ef9d-5510-4c35-b19f-87c2bacf3deb tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:31.823334 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6213ef9d-5510-4c35-b19f-87c2bacf3deb tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:31.823788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6213ef9d-5510-4c35-b19f-87c2bacf3deb tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:31.974074 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6213ef9d-5510-4c35-b19f-87c2bacf3deb tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b5bd8a50b4a33ab13126ee993d127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd260a0dc72e146b987d9cabfd5278f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:31.982923 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6213ef9d-5510-4c35-b19f-87c2bacf3deb tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c" status: 200 len: 1312 microversion: 2.1 time: 0.174762 Jul 19 23:11:31.983589 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3096/6184] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:31 2022] GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c => generated 1312 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:32.678588 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-039dc18f-387b-457d-a843-48fd1aacd615 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:32.679944 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-039dc18f-387b-457d-a843-48fd1aacd615 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: 51afd7bf-0042-4853-b68d-768663bea88d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:32.688768 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-039dc18f-387b-457d-a843-48fd1aacd615 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:32.689518 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-039dc18f-387b-457d-a843-48fd1aacd615 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:32.690554 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-039dc18f-387b-457d-a843-48fd1aacd615 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:32.691419 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-039dc18f-387b-457d-a843-48fd1aacd615 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:33.003663 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3507436a-6185-4dc9-b5a5-4628a5da048e tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:33.005169 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3507436a-6185-4dc9-b5a5-4628a5da048e tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: be70ee11-9889-47d1-a1d9-aae8e538a88c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:33.022079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3507436a-6185-4dc9-b5a5-4628a5da048e tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:33.022560 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3507436a-6185-4dc9-b5a5-4628a5da048e tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:33.023411 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3507436a-6185-4dc9-b5a5-4628a5da048e tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:33.023867 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3507436a-6185-4dc9-b5a5-4628a5da048e tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:33.065279 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-039dc18f-387b-457d-a843-48fd1aacd615 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3713bb52f20146a9afc829dc6b9ec38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924fe492641145ecb3906bfeda480dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:33.080472 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-039dc18f-387b-457d-a843-48fd1aacd615 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d" status: 200 len: 1319 microversion: 2.1 time: 0.409168 Jul 19 23:11:33.081222 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3089/6185] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:32 2022] GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d => generated 1319 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:33.669506 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3507436a-6185-4dc9-b5a5-4628a5da048e tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b5bd8a50b4a33ab13126ee993d127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd260a0dc72e146b987d9cabfd5278f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:33.681580 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3507436a-6185-4dc9-b5a5-4628a5da048e tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c" status: 200 len: 1497 microversion: 2.1 time: 0.681608 Jul 19 23:11:33.682700 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3097/6186] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:32 2022] GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c => generated 1497 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:34.100997 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4b7f32bd-8b5d-472c-a6ac-8f91105fdf15 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:34.102260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4b7f32bd-8b5d-472c-a6ac-8f91105fdf15 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: 51afd7bf-0042-4853-b68d-768663bea88d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:34.110879 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b7f32bd-8b5d-472c-a6ac-8f91105fdf15 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:34.111513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b7f32bd-8b5d-472c-a6ac-8f91105fdf15 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:34.112596 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b7f32bd-8b5d-472c-a6ac-8f91105fdf15 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:34.113488 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b7f32bd-8b5d-472c-a6ac-8f91105fdf15 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:34.279011 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-70489aeb-faef-444c-85fa-ccbbd7035a68 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:34.280014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-70489aeb-faef-444c-85fa-ccbbd7035a68 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: be70ee11-9889-47d1-a1d9-aae8e538a88c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:34.290589 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-70489aeb-faef-444c-85fa-ccbbd7035a68 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:34.291681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-70489aeb-faef-444c-85fa-ccbbd7035a68 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:34.293113 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-70489aeb-faef-444c-85fa-ccbbd7035a68 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:34.293611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-70489aeb-faef-444c-85fa-ccbbd7035a68 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:34.338247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-70489aeb-faef-444c-85fa-ccbbd7035a68 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: be70ee11-9889-47d1-a1d9-aae8e538a88c] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:11:34.350000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4b7f32bd-8b5d-472c-a6ac-8f91105fdf15 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3713bb52f20146a9afc829dc6b9ec38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924fe492641145ecb3906bfeda480dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:34.363261 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4b7f32bd-8b5d-472c-a6ac-8f91105fdf15 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d" status: 200 len: 1319 microversion: 2.1 time: 0.268483 Jul 19 23:11:34.364770 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3090/6187] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:34 2022] GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:11:34.446534 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-70489aeb-faef-444c-85fa-ccbbd7035a68 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "DELETE /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c" status: 204 len: 0 microversion: 2.1 time: 0.173341 Jul 19 23:11:34.447085 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3098/6188] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:11:34 2022] DELETE /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 23:11:34.456456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8d4ef147-4333-4b3a-80f6-3a7d367a8678 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:34.457155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8d4ef147-4333-4b3a-80f6-3a7d367a8678 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: be70ee11-9889-47d1-a1d9-aae8e538a88c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:34.468431 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d4ef147-4333-4b3a-80f6-3a7d367a8678 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:34.468899 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d4ef147-4333-4b3a-80f6-3a7d367a8678 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:34.469692 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d4ef147-4333-4b3a-80f6-3a7d367a8678 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:34.470286 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d4ef147-4333-4b3a-80f6-3a7d367a8678 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:34.634777 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8d4ef147-4333-4b3a-80f6-3a7d367a8678 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b5bd8a50b4a33ab13126ee993d127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd260a0dc72e146b987d9cabfd5278f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:34.644577 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8d4ef147-4333-4b3a-80f6-3a7d367a8678 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c" status: 200 len: 1503 microversion: 2.1 time: 0.192598 Jul 19 23:11:34.656637 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3091/6189] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:34 2022] GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c => generated 1503 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:11:35.383742 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-164e37d7-3372-493a-bf12-ce760a67d6cc tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:35.384599 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-164e37d7-3372-493a-bf12-ce760a67d6cc tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: 51afd7bf-0042-4853-b68d-768663bea88d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:35.387338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:11:35.394117 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-164e37d7-3372-493a-bf12-ce760a67d6cc tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:35.394586 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-164e37d7-3372-493a-bf12-ce760a67d6cc tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:35.396781 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-164e37d7-3372-493a-bf12-ce760a67d6cc tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:35.397244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-164e37d7-3372-493a-bf12-ce760a67d6cc tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:35.541275 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-164e37d7-3372-493a-bf12-ce760a67d6cc tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3713bb52f20146a9afc829dc6b9ec38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924fe492641145ecb3906bfeda480dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:35.549301 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-164e37d7-3372-493a-bf12-ce760a67d6cc tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d" status: 200 len: 1319 microversion: 2.1 time: 0.171012 Jul 19 23:11:35.563437 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3099/6190] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:35 2022] GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:35.664569 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-50474848-9c78-4e9e-8749-5a312e448ac4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:35.665185 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-50474848-9c78-4e9e-8749-5a312e448ac4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: be70ee11-9889-47d1-a1d9-aae8e538a88c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:35.668920 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:11:35.674228 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50474848-9c78-4e9e-8749-5a312e448ac4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:35.674228 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50474848-9c78-4e9e-8749-5a312e448ac4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:35.675646 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50474848-9c78-4e9e-8749-5a312e448ac4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:35.679998 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50474848-9c78-4e9e-8749-5a312e448ac4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:35.834157 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-50474848-9c78-4e9e-8749-5a312e448ac4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b5bd8a50b4a33ab13126ee993d127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd260a0dc72e146b987d9cabfd5278f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:35.842200 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-50474848-9c78-4e9e-8749-5a312e448ac4 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c" status: 200 len: 1503 microversion: 2.1 time: 0.182192 Jul 19 23:11:35.842795 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3092/6191] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:35 2022] GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c => generated 1503 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:11:36.371181 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-ada78d08-e1e7-4325-8760-18e75b53c3c6 req-214bbb6d-d32f-4587-bc8c-6d251c30edd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be70ee11-9889-47d1-a1d9-aae8e538a88c", "name": "network-vif-deleted", "tag": "06820d46-2b80-47c0-8055-c89b16a0f796"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:11:36.397147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-ada78d08-e1e7-4325-8760-18e75b53c3c6 req-214bbb6d-d32f-4587-bc8c-6d251c30edd4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:36.398726 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-ada78d08-e1e7-4325-8760-18e75b53c3c6 req-214bbb6d-d32f-4587-bc8c-6d251c30edd4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:36.414235 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-ada78d08-e1e7-4325-8760-18e75b53c3c6 req-214bbb6d-d32f-4587-bc8c-6d251c30edd4 service nova] Creating event network-vif-deleted:06820d46-2b80-47c0-8055-c89b16a0f796 for instance be70ee11-9889-47d1-a1d9-aae8e538a88c on n-h2-847009-3 Jul 19 23:11:36.419976 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-ada78d08-e1e7-4325-8760-18e75b53c3c6 req-214bbb6d-d32f-4587-bc8c-6d251c30edd4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063299 Jul 19 23:11:36.420774 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3100/6192] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:11:36.496948 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-1d4ca5a8-f9e1-481b-9a73-ccecb29524a0 req-0525399f-6555-4616-9cca-5e66b851812a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51afd7bf-0042-4853-b68d-768663bea88d", "name": "network-vif-plugged", "status": "completed", "tag": "7e8ca965-2938-4f02-bf2e-c074e76face2"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:11:36.510589 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-1d4ca5a8-f9e1-481b-9a73-ccecb29524a0 req-0525399f-6555-4616-9cca-5e66b851812a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:36.511130 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-1d4ca5a8-f9e1-481b-9a73-ccecb29524a0 req-0525399f-6555-4616-9cca-5e66b851812a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:36.527472 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-1d4ca5a8-f9e1-481b-9a73-ccecb29524a0 req-0525399f-6555-4616-9cca-5e66b851812a service nova] Creating event network-vif-plugged:7e8ca965-2938-4f02-bf2e-c074e76face2 for instance 51afd7bf-0042-4853-b68d-768663bea88d on n-h1-847009-3 Jul 19 23:11:36.535637 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-1d4ca5a8-f9e1-481b-9a73-ccecb29524a0 req-0525399f-6555-4616-9cca-5e66b851812a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042314 Jul 19 23:11:36.537099 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3093/6193] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:11:36.577184 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0a362115-1f05-4771-b795-839352f0710c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:36.578511 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0a362115-1f05-4771-b795-839352f0710c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: 51afd7bf-0042-4853-b68d-768663bea88d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:36.587131 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a362115-1f05-4771-b795-839352f0710c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:36.587723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a362115-1f05-4771-b795-839352f0710c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:36.588522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a362115-1f05-4771-b795-839352f0710c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:36.589170 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a362115-1f05-4771-b795-839352f0710c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:36.807757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0a362115-1f05-4771-b795-839352f0710c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3713bb52f20146a9afc829dc6b9ec38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924fe492641145ecb3906bfeda480dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:36.815651 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0a362115-1f05-4771-b795-839352f0710c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d" status: 200 len: 1319 microversion: 2.1 time: 0.245496 Jul 19 23:11:36.816688 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3101/6194] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:36 2022] GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:36.862277 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-773f2029-100e-436c-912f-7c990338ea15 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:36.863174 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-773f2029-100e-436c-912f-7c990338ea15 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: be70ee11-9889-47d1-a1d9-aae8e538a88c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:36.873671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-773f2029-100e-436c-912f-7c990338ea15 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:36.874345 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-773f2029-100e-436c-912f-7c990338ea15 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:36.875291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-773f2029-100e-436c-912f-7c990338ea15 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:36.875833 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-773f2029-100e-436c-912f-7c990338ea15 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:36.910182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-773f2029-100e-436c-912f-7c990338ea15 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:36.912124 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-773f2029-100e-436c-912f-7c990338ea15 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:36.912651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-773f2029-100e-436c-912f-7c990338ea15 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lazy-loading 'fault' on Instance uuid be70ee11-9889-47d1-a1d9-aae8e538a88c {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:11:36.960001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-773f2029-100e-436c-912f-7c990338ea15 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40b5bd8a50b4a33ab13126ee993d127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd260a0dc72e146b987d9cabfd5278f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:36.967198 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-773f2029-100e-436c-912f-7c990338ea15 tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c" status: 200 len: 1302 microversion: 2.1 time: 0.110683 Jul 19 23:11:36.967783 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3094/6195] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:36 2022] GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c => generated 1302 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:37.835097 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3400643c-0566-464f-aaba-1e0b02ca55be tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:37.835784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3400643c-0566-464f-aaba-1e0b02ca55be tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: 51afd7bf-0042-4853-b68d-768663bea88d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:37.838667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:11:37.844193 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=8 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:11:37.846243 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3400643c-0566-464f-aaba-1e0b02ca55be tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:37.846878 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3400643c-0566-464f-aaba-1e0b02ca55be tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:37.848591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3400643c-0566-464f-aaba-1e0b02ca55be tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:37.849060 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3400643c-0566-464f-aaba-1e0b02ca55be tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:37.987624 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-097be078-46f5-4b4e-abd1-0bc080c0512d tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:37.989077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-097be078-46f5-4b4e-abd1-0bc080c0512d tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] [instance: be70ee11-9889-47d1-a1d9-aae8e538a88c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:37.996967 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-097be078-46f5-4b4e-abd1-0bc080c0512d tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:37.997586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-097be078-46f5-4b4e-abd1-0bc080c0512d tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:37.998819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-097be078-46f5-4b4e-abd1-0bc080c0512d tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:37.999293 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-097be078-46f5-4b4e-abd1-0bc080c0512d tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:38.000001 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3400643c-0566-464f-aaba-1e0b02ca55be tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3713bb52f20146a9afc829dc6b9ec38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924fe492641145ecb3906bfeda480dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:38.000153 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=8 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:11:38.017626 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3400643c-0566-464f-aaba-1e0b02ca55be tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d" status: 200 len: 1319 microversion: 2.1 time: 0.187513 Jul 19 23:11:38.018544 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3102/6196] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:37 2022] GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:11:38.026802 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-097be078-46f5-4b4e-abd1-0bc080c0512d tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] HTTP exception thrown: Instance be70ee11-9889-47d1-a1d9-aae8e538a88c could not be found. Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-097be078-46f5-4b4e-abd1-0bc080c0512d tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Request method failure captured: Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c HTTP/1.1 Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zoG8RP9Cl1VNv9x3l8OCibQCQRv-GHhJOls8c2gwKcFNPiHz2v9eHbfB9VcFnO9lcTLe1yMXh2UZoJxOhHMCnnL84H_OTqhFJGkmws1B6_CJKKxA0ujDAjXEc5-aUspFT6HVZ8S7t4LQiq-ZwopZ4J8okBB83zua52MjyNbtE0-p_E Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: d260a0dc72e146b987d9cabfd5278f13 Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-VolumesActionsTest-780583513 Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d260a0dc72e146b987d9cabfd5278f13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d260a0dc72e146b987d9cabfd5278f13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d260a0dc72e146b987d9cabfd5278f13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d260a0dc72e146b987d9cabfd5278f13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-VolumesActionsTest-780583513 Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: d260a0dc72e146b987d9cabfd5278f13 Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-VolumesActionsTest-780583513 Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-VolumesActionsTest-780583513-project Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: d40b5bd8a50b4a33ab13126ee993d127 Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-VolumesActionsTest-780583513-project Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance be70ee11-9889-47d1-a1d9-aae8e538a88c could not be found. Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'be70ee11-9889-47d1-a1d9-aae8e538a88c'} Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be70ee11-9889-47d1-a1d9-aae8e538a88c could not be found. Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be70ee11-9889-47d1-a1d9-aae8e538a88c could not be found. Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:11:38.028833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:11:38.034391 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:11:38.034391 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:11:38.034391 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:11:38.034391 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:11:38.034391 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:11:38.034391 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be70ee11-9889-47d1-a1d9-aae8e538a88c could not be found. Jul 19 23:11:38.034391 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:11:38.034391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-097be078-46f5-4b4e-abd1-0bc080c0512d tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] Returning 404 to user: Instance be70ee11-9889-47d1-a1d9-aae8e538a88c could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:11:38.034391 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-097be078-46f5-4b4e-abd1-0bc080c0512d tempest-VolumesActionsTest-780583513 tempest-VolumesActionsTest-780583513-project] 10.222.0.25 "GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c" status: 404 len: 111 microversion: 2.1 time: 0.046833 Jul 19 23:11:38.034391 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3095/6197] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:37 2022] GET /compute/v2.1/servers/be70ee11-9889-47d1-a1d9-aae8e538a88c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 23:11:39.035896 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d8e9db87-5abc-4f25-a46f-fbd3c605b14f tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:11:39.036919 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d8e9db87-5abc-4f25-a46f-fbd3c605b14f tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: 51afd7bf-0042-4853-b68d-768663bea88d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:39.044134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d8e9db87-5abc-4f25-a46f-fbd3c605b14f tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:39.044643 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d8e9db87-5abc-4f25-a46f-fbd3c605b14f tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:39.045427 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d8e9db87-5abc-4f25-a46f-fbd3c605b14f tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:39.045877 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d8e9db87-5abc-4f25-a46f-fbd3c605b14f tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:39.187688 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d8e9db87-5abc-4f25-a46f-fbd3c605b14f tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3713bb52f20146a9afc829dc6b9ec38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924fe492641145ecb3906bfeda480dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:11:39.197412 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d8e9db87-5abc-4f25-a46f-fbd3c605b14f tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d" status: 200 len: 1508 microversion: 2.1 time: 0.166157 Jul 19 23:11:39.197997 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3103/6198] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:11:39 2022] GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:11:39.215342 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-46d71d91-3254-4d1c-822a-d9038631be8c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65c2cfea-c8b8-4240-aaef-33083418446e", "device": "/dev/sdb"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:11:39.216451 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-46d71d91-3254-4d1c-822a-d9038631be8c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: 51afd7bf-0042-4853-b68d-768663bea88d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:11:39.225044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-46d71d91-3254-4d1c-822a-d9038631be8c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:39.225501 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-46d71d91-3254-4d1c-822a-d9038631be8c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:39.226290 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-46d71d91-3254-4d1c-822a-d9038631be8c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:11:39.226733 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-46d71d91-3254-4d1c-822a-d9038631be8c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:11:39.497129 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-46d71d91-3254-4d1c-822a-d9038631be8c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "POST /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285772 Jul 19 23:11:39.502703 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3096/6199] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 19 23:11:39 2022] POST /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:12:05.172160 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-938186ea-5346-4161-9fdb-83aafda190b0 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:12:05.173396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-938186ea-5346-4161-9fdb-83aafda190b0 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: 51afd7bf-0042-4853-b68d-768663bea88d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:12:05.179425 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=9 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:12:05.180242 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:12:05.184843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-938186ea-5346-4161-9fdb-83aafda190b0 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:12:05.186015 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-938186ea-5346-4161-9fdb-83aafda190b0 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:12:05.186911 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-938186ea-5346-4161-9fdb-83aafda190b0 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:12:05.186911 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-938186ea-5346-4161-9fdb-83aafda190b0 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:12:05.283952 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-938186ea-5346-4161-9fdb-83aafda190b0 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lazy-loading 'services' on Instance uuid 51afd7bf-0042-4853-b68d-768663bea88d {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:12:05.364539 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-938186ea-5346-4161-9fdb-83aafda190b0 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "DELETE /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d/os-volume_attachments/65c2cfea-c8b8-4240-aaef-33083418446e" status: 202 len: 0 microversion: 2.1 time: 0.198996 Jul 19 23:12:05.365217 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3104/6200] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 19 23:12:05 2022] DELETE /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d/os-volume_attachments/65c2cfea-c8b8-4240-aaef-33083418446e => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:12:11.867403 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2ba28760-1364-4f38-9272-d54e2c736f6c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:12:11.868045 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2ba28760-1364-4f38-9272-d54e2c736f6c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: 51afd7bf-0042-4853-b68d-768663bea88d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:12:11.875638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=11 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:12:11.877116 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:12:11.878994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2ba28760-1364-4f38-9272-d54e2c736f6c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:12:11.879673 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2ba28760-1364-4f38-9272-d54e2c736f6c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:12:11.880545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2ba28760-1364-4f38-9272-d54e2c736f6c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:12:11.881076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2ba28760-1364-4f38-9272-d54e2c736f6c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:12:11.909798 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2ba28760-1364-4f38-9272-d54e2c736f6c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: 51afd7bf-0042-4853-b68d-768663bea88d] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:12:12.006272 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2ba28760-1364-4f38-9272-d54e2c736f6c tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "DELETE /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d" status: 204 len: 0 microversion: 2.1 time: 0.143511 Jul 19 23:12:12.010315 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3097/6201] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:12:11 2022] DELETE /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:12:12.017731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-308fceaa-6456-4ed8-802d-0a7938057235 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:12:12.018678 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-308fceaa-6456-4ed8-802d-0a7938057235 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: 51afd7bf-0042-4853-b68d-768663bea88d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:12:12.025369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-308fceaa-6456-4ed8-802d-0a7938057235 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:12:12.025699 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-308fceaa-6456-4ed8-802d-0a7938057235 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:12:12.026492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-308fceaa-6456-4ed8-802d-0a7938057235 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:12:12.026944 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-308fceaa-6456-4ed8-802d-0a7938057235 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:12:12.193412 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-308fceaa-6456-4ed8-802d-0a7938057235 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3713bb52f20146a9afc829dc6b9ec38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924fe492641145ecb3906bfeda480dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:12:12.201749 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-308fceaa-6456-4ed8-802d-0a7938057235 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d" status: 200 len: 1514 microversion: 2.1 time: 0.189758 Jul 19 23:12:12.212072 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3105/6202] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:12:12 2022] GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d => generated 1514 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:12:13.223813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-24381b94-f22c-4b6c-8dc3-5870fd85f4d0 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:12:13.224649 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-24381b94-f22c-4b6c-8dc3-5870fd85f4d0 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: 51afd7bf-0042-4853-b68d-768663bea88d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:12:13.231509 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24381b94-f22c-4b6c-8dc3-5870fd85f4d0 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:12:13.232337 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24381b94-f22c-4b6c-8dc3-5870fd85f4d0 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:12:13.233124 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24381b94-f22c-4b6c-8dc3-5870fd85f4d0 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:12:13.233567 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24381b94-f22c-4b6c-8dc3-5870fd85f4d0 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:12:13.411650 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-24381b94-f22c-4b6c-8dc3-5870fd85f4d0 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3713bb52f20146a9afc829dc6b9ec38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924fe492641145ecb3906bfeda480dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:12:13.420835 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-24381b94-f22c-4b6c-8dc3-5870fd85f4d0 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d" status: 200 len: 1514 microversion: 2.1 time: 0.204682 Jul 19 23:12:13.421840 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3098/6203] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:12:13 2022] GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d => generated 1514 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:12:14.438595 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8654f55c-1bd9-4a4e-a533-e8c122f217d5 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:12:14.441151 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8654f55c-1bd9-4a4e-a533-e8c122f217d5 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: 51afd7bf-0042-4853-b68d-768663bea88d] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:12:14.449513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8654f55c-1bd9-4a4e-a533-e8c122f217d5 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:12:14.450013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8654f55c-1bd9-4a4e-a533-e8c122f217d5 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:12:14.451200 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8654f55c-1bd9-4a4e-a533-e8c122f217d5 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:12:14.456220 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8654f55c-1bd9-4a4e-a533-e8c122f217d5 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:12:14.492029 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-5e327b43-e164-4f8b-b852-aa864f4a7980 req-9d3b9248-eaf8-4ffc-af1e-950f1c6dc98a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51afd7bf-0042-4853-b68d-768663bea88d", "name": "network-vif-deleted", "tag": "7e8ca965-2938-4f02-bf2e-c074e76face2"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:12:14.502642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-5e327b43-e164-4f8b-b852-aa864f4a7980 req-9d3b9248-eaf8-4ffc-af1e-950f1c6dc98a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:12:14.503104 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-5e327b43-e164-4f8b-b852-aa864f4a7980 req-9d3b9248-eaf8-4ffc-af1e-950f1c6dc98a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:12:14.503590 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8654f55c-1bd9-4a4e-a533-e8c122f217d5 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:12:14.504216 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8654f55c-1bd9-4a4e-a533-e8c122f217d5 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:12:14.504850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-8654f55c-1bd9-4a4e-a533-e8c122f217d5 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lazy-loading 'fault' on Instance uuid 51afd7bf-0042-4853-b68d-768663bea88d {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:12:14.516065 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-5e327b43-e164-4f8b-b852-aa864f4a7980 req-9d3b9248-eaf8-4ffc-af1e-950f1c6dc98a service nova] Creating event network-vif-deleted:7e8ca965-2938-4f02-bf2e-c074e76face2 for instance 51afd7bf-0042-4853-b68d-768663bea88d on n-h1-847009-3 Jul 19 23:12:14.522133 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-5e327b43-e164-4f8b-b852-aa864f4a7980 req-9d3b9248-eaf8-4ffc-af1e-950f1c6dc98a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.243370 Jul 19 23:12:14.523097 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3106/6204] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:12:14.552176 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8654f55c-1bd9-4a4e-a533-e8c122f217d5 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3713bb52f20146a9afc829dc6b9ec38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924fe492641145ecb3906bfeda480dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:12:14.559679 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8654f55c-1bd9-4a4e-a533-e8c122f217d5 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d" status: 200 len: 1309 microversion: 2.1 time: 0.125576 Jul 19 23:12:14.560505 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3099/6205] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:12:14 2022] GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d => generated 1309 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:12:15.580855 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-de6b61b9-30c7-4cdf-908d-57dcef0cea06 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:12:15.581954 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-de6b61b9-30c7-4cdf-908d-57dcef0cea06 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] [instance: 51afd7bf-0042-4853-b68d-768663bea88d] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:12:15.591090 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de6b61b9-30c7-4cdf-908d-57dcef0cea06 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:12:15.591653 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de6b61b9-30c7-4cdf-908d-57dcef0cea06 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:12:15.593252 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de6b61b9-30c7-4cdf-908d-57dcef0cea06 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:12:15.594275 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-de6b61b9-30c7-4cdf-908d-57dcef0cea06 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:12:15.611502 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-de6b61b9-30c7-4cdf-908d-57dcef0cea06 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] HTTP exception thrown: Instance 51afd7bf-0042-4853-b68d-768663bea88d could not be found. Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-de6b61b9-30c7-4cdf-908d-57dcef0cea06 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Request method failure captured: Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d HTTP/1.1 Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zlmZzgqFz7boRhXPEXGyjmRxw70Vpr6rOoaje2PM1ftAN4dBKyT8dQxryjr1vMVyliTkRVEvWqHsYWST35atvkSyA5-SXYf4OfYRWnSAwz1bh1xD8fISZkISqcMuIOn8QJRqki17N0D3GeKn0EK6dk6mZtvWZNgxomEJe-fOeqXLcc Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 924fe492641145ecb3906bfeda480dde Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-VolumesSnapshotTestJSON-354563054 Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_924fe492641145ecb3906bfeda480dde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/924fe492641145ecb3906bfeda480dde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/924fe492641145ecb3906bfeda480dde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/924fe492641145ecb3906bfeda480dde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-VolumesSnapshotTestJSON-354563054 Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 924fe492641145ecb3906bfeda480dde Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-354563054 Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-VolumesSnapshotTestJSON-354563054-project Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 3713bb52f20146a9afc829dc6b9ec38e Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-VolumesSnapshotTestJSON-354563054-project Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 51afd7bf-0042-4853-b68d-768663bea88d could not be found. Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '51afd7bf-0042-4853-b68d-768663bea88d'} Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51afd7bf-0042-4853-b68d-768663bea88d could not be found. Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51afd7bf-0042-4853-b68d-768663bea88d could not be found. Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:12:15.613204 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:12:15.617989 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:12:15.617989 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:12:15.617989 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:12:15.617989 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:12:15.617989 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:12:15.617989 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51afd7bf-0042-4853-b68d-768663bea88d could not be found. Jul 19 23:12:15.617989 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:12:15.617989 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-de6b61b9-30c7-4cdf-908d-57dcef0cea06 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] Returning 404 to user: Instance 51afd7bf-0042-4853-b68d-768663bea88d could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:12:15.617989 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-de6b61b9-30c7-4cdf-908d-57dcef0cea06 tempest-VolumesSnapshotTestJSON-354563054 tempest-VolumesSnapshotTestJSON-354563054-project] 10.222.0.25 "GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d" status: 404 len: 111 microversion: 2.1 time: 0.040431 Jul 19 23:12:15.618734 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3107/6206] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:12:15 2022] GET /compute/v2.1/servers/51afd7bf-0042-4853-b68d-768663bea88d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:12:58.367464 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f9c1452a-4bc4-4be3-9bef-ed8fc2ff00d4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:12:58.368805 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f9c1452a-4bc4-4be3-9bef-ed8fc2ff00d4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:12:58.372424 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:12:58.374228 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:12:58.394671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9c1452a-4bc4-4be3-9bef-ed8fc2ff00d4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:12:58.397997 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9c1452a-4bc4-4be3-9bef-ed8fc2ff00d4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:12:58.399013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9c1452a-4bc4-4be3-9bef-ed8fc2ff00d4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:12:58.400494 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f9c1452a-4bc4-4be3-9bef-ed8fc2ff00d4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:12:58.432791 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f9c1452a-4bc4-4be3-9bef-ed8fc2ff00d4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:12:58.560354 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f9c1452a-4bc4-4be3-9bef-ed8fc2ff00d4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "DELETE /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 204 len: 0 microversion: 2.1 time: 0.197854 Jul 19 23:12:58.562585 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3100/6207] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:12:58 2022] DELETE /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:12:58.573749 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7c0957b2-ef0d-40b0-b376-0ec75be7ba3b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:12:58.574702 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7c0957b2-ef0d-40b0-b376-0ec75be7ba3b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:12:58.580257 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=8 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:12:58.581098 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:12:58.588086 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7c0957b2-ef0d-40b0-b376-0ec75be7ba3b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:12:58.590164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7c0957b2-ef0d-40b0-b376-0ec75be7ba3b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:12:58.592445 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7c0957b2-ef0d-40b0-b376-0ec75be7ba3b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:12:58.593395 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7c0957b2-ef0d-40b0-b376-0ec75be7ba3b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:12:58.762592 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7c0957b2-ef0d-40b0-b376-0ec75be7ba3b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:12:58.771862 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7c0957b2-ef0d-40b0-b376-0ec75be7ba3b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 200 len: 1576 microversion: 2.1 time: 0.205326 Jul 19 23:12:58.775136 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3108/6208] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:12:58 2022] GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 1576 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:12:59.793428 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3414a21a-81ca-4656-a3fe-0bc8301c48c3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:12:59.794868 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3414a21a-81ca-4656-a3fe-0bc8301c48c3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:12:59.806550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3414a21a-81ca-4656-a3fe-0bc8301c48c3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:12:59.807354 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3414a21a-81ca-4656-a3fe-0bc8301c48c3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:12:59.808346 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3414a21a-81ca-4656-a3fe-0bc8301c48c3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:12:59.809324 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3414a21a-81ca-4656-a3fe-0bc8301c48c3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:12:59.991282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3414a21a-81ca-4656-a3fe-0bc8301c48c3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:13:00.001063 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3414a21a-81ca-4656-a3fe-0bc8301c48c3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 200 len: 1576 microversion: 2.1 time: 0.212320 Jul 19 23:13:00.001961 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3101/6209] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:12:59 2022] GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 1576 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:13:01.019876 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c4c9cafc-2b47-4bbe-9046-c678f2b8a769 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:13:01.020525 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c4c9cafc-2b47-4bbe-9046-c678f2b8a769 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:13:01.059291 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c4c9cafc-2b47-4bbe-9046-c678f2b8a769 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:01.063924 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c4c9cafc-2b47-4bbe-9046-c678f2b8a769 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:01.064767 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c4c9cafc-2b47-4bbe-9046-c678f2b8a769 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:01.067922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c4c9cafc-2b47-4bbe-9046-c678f2b8a769 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:01.281269 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c4c9cafc-2b47-4bbe-9046-c678f2b8a769 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:13:01.298874 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c4c9cafc-2b47-4bbe-9046-c678f2b8a769 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 200 len: 1509 microversion: 2.1 time: 0.283820 Jul 19 23:13:01.300991 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3109/6210] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:13:01 2022] GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 1509 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:13:01.685175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-1c8af8b9-483d-42b0-b2ed-71c3127dfc5c req-989844a3-53c4-468a-a4a5-1cdd62bb34f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68", "name": "network-vif-deleted", "tag": "52a49ee4-0773-4a8e-82dc-1a8e8ddce9ea"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:13:01.707997 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-1c8af8b9-483d-42b0-b2ed-71c3127dfc5c req-989844a3-53c4-468a-a4a5-1cdd62bb34f2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:01.708882 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-1c8af8b9-483d-42b0-b2ed-71c3127dfc5c req-989844a3-53c4-468a-a4a5-1cdd62bb34f2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:01.733705 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-1c8af8b9-483d-42b0-b2ed-71c3127dfc5c req-989844a3-53c4-468a-a4a5-1cdd62bb34f2 service nova] Creating event network-vif-deleted:52a49ee4-0773-4a8e-82dc-1a8e8ddce9ea for instance 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 on n-h1-847009-3 Jul 19 23:13:01.744750 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-1c8af8b9-483d-42b0-b2ed-71c3127dfc5c req-989844a3-53c4-468a-a4a5-1cdd62bb34f2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063601 Jul 19 23:13:01.747047 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3102/6211] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:13:02.323425 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f2b171a3-d39f-4a27-a949-0baf8861c2aa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:13:02.324669 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f2b171a3-d39f-4a27-a949-0baf8861c2aa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:13:02.339483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f2b171a3-d39f-4a27-a949-0baf8861c2aa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:02.340585 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f2b171a3-d39f-4a27-a949-0baf8861c2aa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:02.341545 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f2b171a3-d39f-4a27-a949-0baf8861c2aa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:02.343726 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f2b171a3-d39f-4a27-a949-0baf8861c2aa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:02.508338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f2b171a3-d39f-4a27-a949-0baf8861c2aa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:13:02.520104 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f2b171a3-d39f-4a27-a949-0baf8861c2aa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 200 len: 1225 microversion: 2.1 time: 0.200770 Jul 19 23:13:02.522703 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3110/6212] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:13:02 2022] GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 1225 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:13:03.543290 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8de3b5e7-9e44-47b1-a3e3-aff43fc842ac tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:13:03.544100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8de3b5e7-9e44-47b1-a3e3-aff43fc842ac tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:13:03.555996 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8de3b5e7-9e44-47b1-a3e3-aff43fc842ac tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:03.559466 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8de3b5e7-9e44-47b1-a3e3-aff43fc842ac tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:03.561501 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8de3b5e7-9e44-47b1-a3e3-aff43fc842ac tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:03.563960 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8de3b5e7-9e44-47b1-a3e3-aff43fc842ac tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:03.678453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8de3b5e7-9e44-47b1-a3e3-aff43fc842ac tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:13:03.689182 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8de3b5e7-9e44-47b1-a3e3-aff43fc842ac tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 200 len: 1225 microversion: 2.1 time: 0.153633 Jul 19 23:13:03.700275 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3103/6213] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:13:03 2022] GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 1225 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:13:04.708986 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-259b1e60-7d75-47ab-9913-632309a455c8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:13:04.709519 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-259b1e60-7d75-47ab-9913-632309a455c8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:13:04.728097 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-259b1e60-7d75-47ab-9913-632309a455c8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:04.728563 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-259b1e60-7d75-47ab-9913-632309a455c8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:04.729350 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-259b1e60-7d75-47ab-9913-632309a455c8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:04.729801 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-259b1e60-7d75-47ab-9913-632309a455c8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:04.843797 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-259b1e60-7d75-47ab-9913-632309a455c8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:13:04.852489 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-259b1e60-7d75-47ab-9913-632309a455c8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 200 len: 1225 microversion: 2.1 time: 0.147591 Jul 19 23:13:04.853075 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3111/6214] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:13:04 2022] GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 1225 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:13:05.871904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-58ddee5a-7746-4537-baa5-5abf88b6f9bb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:13:05.873255 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-58ddee5a-7746-4537-baa5-5abf88b6f9bb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:13:05.880897 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58ddee5a-7746-4537-baa5-5abf88b6f9bb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:05.881769 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58ddee5a-7746-4537-baa5-5abf88b6f9bb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:05.882547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58ddee5a-7746-4537-baa5-5abf88b6f9bb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:05.883441 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58ddee5a-7746-4537-baa5-5abf88b6f9bb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:05.955156 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-58ddee5a-7746-4537-baa5-5abf88b6f9bb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:13:05.964078 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-58ddee5a-7746-4537-baa5-5abf88b6f9bb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 200 len: 1225 microversion: 2.1 time: 0.098331 Jul 19 23:13:05.964726 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3104/6215] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:13:05 2022] GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:13:06.982749 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dd602a7d-79bf-4050-93e8-ef86e0bcd8cb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:13:06.983389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dd602a7d-79bf-4050-93e8-ef86e0bcd8cb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:13:06.993929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dd602a7d-79bf-4050-93e8-ef86e0bcd8cb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:06.994382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dd602a7d-79bf-4050-93e8-ef86e0bcd8cb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:06.995202 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dd602a7d-79bf-4050-93e8-ef86e0bcd8cb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:06.995671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dd602a7d-79bf-4050-93e8-ef86e0bcd8cb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:07.052413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dd602a7d-79bf-4050-93e8-ef86e0bcd8cb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:07.052803 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dd602a7d-79bf-4050-93e8-ef86e0bcd8cb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:07.053276 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-dd602a7d-79bf-4050-93e8-ef86e0bcd8cb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lazy-loading 'fault' on Instance uuid 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:13:07.098601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dd602a7d-79bf-4050-93e8-ef86e0bcd8cb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:13:07.108586 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dd602a7d-79bf-4050-93e8-ef86e0bcd8cb tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 200 len: 1230 microversion: 2.1 time: 0.129952 Jul 19 23:13:07.118831 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3112/6216] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:13:06 2022] GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 1230 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:13:08.126305 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-386d8402-64b8-4da1-93d2-08900d0b899e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:13:08.126925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-386d8402-64b8-4da1-93d2-08900d0b899e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:13:08.133899 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-386d8402-64b8-4da1-93d2-08900d0b899e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:08.134700 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-386d8402-64b8-4da1-93d2-08900d0b899e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:08.136254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-386d8402-64b8-4da1-93d2-08900d0b899e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:08.136763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-386d8402-64b8-4da1-93d2-08900d0b899e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:08.152104 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-386d8402-64b8-4da1-93d2-08900d0b899e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] HTTP exception thrown: Instance 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 could not be found. Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-386d8402-64b8-4da1-93d2-08900d0b899e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Request method failure captured: Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 HTTP/1.1 Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zh6YPXnZEfL25DbrOo5AahkBCmHYOrAvKJnhgzQ9JlHxbrun4XI2EwE2n1nf4tgNFUaArqBEbFq4Toj7uUUuANo7JRuxksIEPvDD1AFl7fhy2XFxh_IYAhLXnE4PI4_QoyTOcOGpDghFYkpTUUI4xKODXHZZ1_feIKHlU2SknrcKPQ Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: deeb5431c1284d02b245ff3a9dc3f4e8 Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 could not be found. Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68'} Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 could not be found. Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 could not be found. Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:13:08.154086 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:13:08.158560 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:13:08.158560 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:13:08.158560 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:13:08.158560 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:13:08.158560 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:13:08.158560 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 could not be found. Jul 19 23:13:08.158560 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:13:08.161176 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-386d8402-64b8-4da1-93d2-08900d0b899e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Returning 404 to user: Instance 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:13:08.162481 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-386d8402-64b8-4da1-93d2-08900d0b899e tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 404 len: 111 microversion: 2.1 time: 0.040688 Jul 19 23:13:08.163680 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3105/6217] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:13:08 2022] GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:13:08.282804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4b30c6b2-c7a9-4ef6-8dab-cccbe7572b93 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-213738206", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-480112255", "security_groups": [{"name": "tempest-secgroup-smoke-737929312"}], "block_device_mapping_v2": [{"uuid": "a9b426ed-4927-4bec-8d57-d2406cdcfe54", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c424fcca-fcaa-49c5-9171-61018c1542cf"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:13:08.445723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-4b30c6b2-c7a9-4ef6-8dab-cccbe7572b93 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] validate_networks() for [('c424fcca-fcaa-49c5-9171-61018c1542cf', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:13:08.935742 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4b30c6b2-c7a9-4ef6-8dab-cccbe7572b93 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:13:08.936463 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4b30c6b2-c7a9-4ef6-8dab-cccbe7572b93 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:13:08.937370 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4b30c6b2-c7a9-4ef6-8dab-cccbe7572b93 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:13:08.938006 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4b30c6b2-c7a9-4ef6-8dab-cccbe7572b93 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:13:08.938666 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4b30c6b2-c7a9-4ef6-8dab-cccbe7572b93 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:13:08.950885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4b30c6b2-c7a9-4ef6-8dab-cccbe7572b93 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:08.951652 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4b30c6b2-c7a9-4ef6-8dab-cccbe7572b93 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:08.952784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4b30c6b2-c7a9-4ef6-8dab-cccbe7572b93 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:08.953488 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4b30c6b2-c7a9-4ef6-8dab-cccbe7572b93 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:08.975392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-4b30c6b2-c7a9-4ef6-8dab-cccbe7572b93 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Getting quotas for project ba6762beb0fe4220b984143b3ea6bd48. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:13:08.983163 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-4b30c6b2-c7a9-4ef6-8dab-cccbe7572b93 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Getting quotas for user deeb5431c1284d02b245ff3a9dc3f4e8 and project ba6762beb0fe4220b984143b3ea6bd48. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:13:09.087411 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4b30c6b2-c7a9-4ef6-8dab-cccbe7572b93 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:13:09.089514 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4b30c6b2-c7a9-4ef6-8dab-cccbe7572b93 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a9b426ed-4927-4bec-8d57-d2406cdcfe54',volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:13:09.363596 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4b30c6b2-c7a9-4ef6-8dab-cccbe7572b93 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.085634 Jul 19 23:13:09.372952 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3113/6218] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:13:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 1091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:13:09.378366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f8022e24-cb3f-42d3-8990-14eee383c747 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:13:09.379148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f8022e24-cb3f-42d3-8990-14eee383c747 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:13:09.484197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f8022e24-cb3f-42d3-8990-14eee383c747 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:13:09.492765 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f8022e24-cb3f-42d3-8990-14eee383c747 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 200 len: 1093 microversion: 2.1 time: 0.118228 Jul 19 23:13:09.493656 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3106/6219] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:13:09 2022] GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 1093 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:13:10.511147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2192a73f-ac9c-4d43-bd93-1138ca1f953b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:13:10.511813 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2192a73f-ac9c-4d43-bd93-1138ca1f953b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:13:10.523932 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2192a73f-ac9c-4d43-bd93-1138ca1f953b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:10.524420 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2192a73f-ac9c-4d43-bd93-1138ca1f953b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:10.525435 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2192a73f-ac9c-4d43-bd93-1138ca1f953b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:10.525900 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2192a73f-ac9c-4d43-bd93-1138ca1f953b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:10.664020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2192a73f-ac9c-4d43-bd93-1138ca1f953b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:13:10.686939 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2192a73f-ac9c-4d43-bd93-1138ca1f953b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 200 len: 1191 microversion: 2.1 time: 0.180410 Jul 19 23:13:10.687769 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3114/6220] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:13:10 2022] GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 1191 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:13:11.706867 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-47058bad-f55e-44d3-8279-70339916be03 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:13:11.708207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-47058bad-f55e-44d3-8279-70339916be03 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:13:11.736370 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-47058bad-f55e-44d3-8279-70339916be03 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:11.737129 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-47058bad-f55e-44d3-8279-70339916be03 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:11.737610 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-47058bad-f55e-44d3-8279-70339916be03 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:11.738121 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-47058bad-f55e-44d3-8279-70339916be03 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:11.898332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-47058bad-f55e-44d3-8279-70339916be03 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:13:11.908549 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-47058bad-f55e-44d3-8279-70339916be03 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 200 len: 1209 microversion: 2.1 time: 0.207710 Jul 19 23:13:11.915193 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3107/6221] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:13:11 2022] GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 1209 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:13:12.926980 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-42a8c913-1e23-4136-bcf1-965b99604432 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:13:12.930236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-42a8c913-1e23-4136-bcf1-965b99604432 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:13:12.939211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42a8c913-1e23-4136-bcf1-965b99604432 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:12.939866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42a8c913-1e23-4136-bcf1-965b99604432 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:12.940816 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42a8c913-1e23-4136-bcf1-965b99604432 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:12.941494 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42a8c913-1e23-4136-bcf1-965b99604432 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:13.613336 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-42a8c913-1e23-4136-bcf1-965b99604432 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:13:13.645507 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-42a8c913-1e23-4136-bcf1-965b99604432 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 200 len: 1276 microversion: 2.1 time: 0.722622 Jul 19 23:13:13.646313 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3115/6222] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:13:12 2022] GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 1276 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:13:13.786526 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-f31d69b7-df2c-4ad2-a761-1d8026c58eff req-368d260d-b983-4df2-8fb0-3edbb6f671e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "590cc12b-36f4-41ca-9cae-c88d19748331", "tag": "114bee9e-390d-452a-84f3-d9867ca8e92c"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:13:13.809431 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f31d69b7-df2c-4ad2-a761-1d8026c58eff req-368d260d-b983-4df2-8fb0-3edbb6f671e7 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:13.810972 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f31d69b7-df2c-4ad2-a761-1d8026c58eff req-368d260d-b983-4df2-8fb0-3edbb6f671e7 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:13.843820 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-f31d69b7-df2c-4ad2-a761-1d8026c58eff req-368d260d-b983-4df2-8fb0-3edbb6f671e7 service nova] Creating event network-changed:114bee9e-390d-452a-84f3-d9867ca8e92c for instance 590cc12b-36f4-41ca-9cae-c88d19748331 on n-h2-847009-3 Jul 19 23:13:13.857638 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-f31d69b7-df2c-4ad2-a761-1d8026c58eff req-368d260d-b983-4df2-8fb0-3edbb6f671e7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079727 Jul 19 23:13:13.864218 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3108/6223] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:13:14.662886 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-65d09850-7c6f-4d05-897f-d9e9f7c7f0ae tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:13:14.663586 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-65d09850-7c6f-4d05-897f-d9e9f7c7f0ae tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:13:14.678049 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65d09850-7c6f-4d05-897f-d9e9f7c7f0ae tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:14.678751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65d09850-7c6f-4d05-897f-d9e9f7c7f0ae tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:14.679726 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65d09850-7c6f-4d05-897f-d9e9f7c7f0ae tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:14.680336 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65d09850-7c6f-4d05-897f-d9e9f7c7f0ae tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:15.040509 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-65d09850-7c6f-4d05-897f-d9e9f7c7f0ae tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:13:15.054286 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-65d09850-7c6f-4d05-897f-d9e9f7c7f0ae tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 200 len: 1276 microversion: 2.1 time: 0.392065 Jul 19 23:13:15.055477 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3116/6224] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:13:14 2022] GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 1276 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:13:15.414504 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:13:15.414504 n-d-847009-3 devstack@n-api.service[119338]: Tue Jul 19 23:13:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:13:16.074065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5ffe5f0b-4ab7-4851-bee8-12f2555ec4ab tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:13:16.075482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5ffe5f0b-4ab7-4851-bee8-12f2555ec4ab tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:13:16.097959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ffe5f0b-4ab7-4851-bee8-12f2555ec4ab tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:16.098413 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ffe5f0b-4ab7-4851-bee8-12f2555ec4ab tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:16.099250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ffe5f0b-4ab7-4851-bee8-12f2555ec4ab tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:16.099696 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ffe5f0b-4ab7-4851-bee8-12f2555ec4ab tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:16.314371 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5ffe5f0b-4ab7-4851-bee8-12f2555ec4ab tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:13:16.332559 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5ffe5f0b-4ab7-4851-bee8-12f2555ec4ab tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 200 len: 1276 microversion: 2.1 time: 0.263512 Jul 19 23:13:16.335952 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3109/6225] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:13:16 2022] GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 1276 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:13:17.063622 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:13:17.064147 n-d-847009-3 devstack@n-api.service[119337]: Tue Jul 19 23:13:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:13:17.350104 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-828ceafa-2406-440d-af38-07d746cb2c1f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:13:17.350757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-828ceafa-2406-440d-af38-07d746cb2c1f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:13:17.358795 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-828ceafa-2406-440d-af38-07d746cb2c1f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:17.359792 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-828ceafa-2406-440d-af38-07d746cb2c1f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:17.361001 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-828ceafa-2406-440d-af38-07d746cb2c1f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:17.361700 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-828ceafa-2406-440d-af38-07d746cb2c1f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:17.547745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-828ceafa-2406-440d-af38-07d746cb2c1f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:13:17.556945 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-828ceafa-2406-440d-af38-07d746cb2c1f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 200 len: 1276 microversion: 2.1 time: 0.210865 Jul 19 23:13:17.561120 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3117/6226] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:13:17 2022] GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 1276 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:13:18.579049 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d986ec07-6635-435f-a86b-fcb2a01a6610 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:13:18.580215 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d986ec07-6635-435f-a86b-fcb2a01a6610 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:13:18.588137 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d986ec07-6635-435f-a86b-fcb2a01a6610 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:18.588735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d986ec07-6635-435f-a86b-fcb2a01a6610 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:18.589397 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d986ec07-6635-435f-a86b-fcb2a01a6610 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:18.589893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d986ec07-6635-435f-a86b-fcb2a01a6610 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:18.740428 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d986ec07-6635-435f-a86b-fcb2a01a6610 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:13:18.748343 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d986ec07-6635-435f-a86b-fcb2a01a6610 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 200 len: 1264 microversion: 2.1 time: 0.174987 Jul 19 23:13:18.758194 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3110/6227] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:13:18 2022] GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:13:19.767286 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6284b375-5659-4ea6-9e59-0e5733b132f5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:13:19.767926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6284b375-5659-4ea6-9e59-0e5733b132f5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:13:19.770862 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:13:19.771774 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:13:19.779868 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6284b375-5659-4ea6-9e59-0e5733b132f5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:19.780328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6284b375-5659-4ea6-9e59-0e5733b132f5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:19.781117 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6284b375-5659-4ea6-9e59-0e5733b132f5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:19.781563 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6284b375-5659-4ea6-9e59-0e5733b132f5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:19.956943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6284b375-5659-4ea6-9e59-0e5733b132f5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:13:19.965178 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6284b375-5659-4ea6-9e59-0e5733b132f5 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 200 len: 1264 microversion: 2.1 time: 0.202592 Jul 19 23:13:19.974804 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3118/6228] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:13:19 2022] GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 1264 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:13:20.986959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5c768c2a-c044-4fc7-b066-0755a2f80255 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:13:20.988403 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5c768c2a-c044-4fc7-b066-0755a2f80255 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:13:20.991302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:13:20.999326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5c768c2a-c044-4fc7-b066-0755a2f80255 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:21.000188 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5c768c2a-c044-4fc7-b066-0755a2f80255 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:21.001128 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5c768c2a-c044-4fc7-b066-0755a2f80255 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:21.001670 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5c768c2a-c044-4fc7-b066-0755a2f80255 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:21.169792 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5c768c2a-c044-4fc7-b066-0755a2f80255 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:13:21.178937 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5c768c2a-c044-4fc7-b066-0755a2f80255 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 200 len: 1264 microversion: 2.1 time: 0.198511 Jul 19 23:13:21.181116 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3111/6229] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:13:20 2022] GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 1264 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:13:22.198195 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-aa77aa83-d133-4b3c-94fa-7e45b5358883 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:13:22.198941 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-aa77aa83-d133-4b3c-94fa-7e45b5358883 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:13:22.207631 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa77aa83-d133-4b3c-94fa-7e45b5358883 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:22.208203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa77aa83-d133-4b3c-94fa-7e45b5358883 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:22.209239 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa77aa83-d133-4b3c-94fa-7e45b5358883 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:22.209915 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa77aa83-d133-4b3c-94fa-7e45b5358883 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:22.379852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-aa77aa83-d133-4b3c-94fa-7e45b5358883 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:13:22.389784 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-aa77aa83-d133-4b3c-94fa-7e45b5358883 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 200 len: 1264 microversion: 2.1 time: 0.195824 Jul 19 23:13:22.390633 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3119/6230] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:13:22 2022] GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 1264 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:13:23.406307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-46f3d66b-15eb-402b-8a66-c3543b71215a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:13:23.406938 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-46f3d66b-15eb-402b-8a66-c3543b71215a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:13:23.417640 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-46f3d66b-15eb-402b-8a66-c3543b71215a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:23.418100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-46f3d66b-15eb-402b-8a66-c3543b71215a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:23.419616 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-46f3d66b-15eb-402b-8a66-c3543b71215a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:23.419995 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-46f3d66b-15eb-402b-8a66-c3543b71215a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:23.568494 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-46f3d66b-15eb-402b-8a66-c3543b71215a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:13:23.577050 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-46f3d66b-15eb-402b-8a66-c3543b71215a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 200 len: 1264 microversion: 2.1 time: 0.175127 Jul 19 23:13:23.577662 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3112/6231] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:13:23 2022] GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:13:24.595253 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2dd75583-7191-405d-a219-8b4ef21737c6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:13:24.596004 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2dd75583-7191-405d-a219-8b4ef21737c6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:13:24.604654 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2dd75583-7191-405d-a219-8b4ef21737c6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:24.605414 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2dd75583-7191-405d-a219-8b4ef21737c6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:24.606576 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2dd75583-7191-405d-a219-8b4ef21737c6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:24.607307 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2dd75583-7191-405d-a219-8b4ef21737c6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:24.779651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2dd75583-7191-405d-a219-8b4ef21737c6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:13:24.789131 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2dd75583-7191-405d-a219-8b4ef21737c6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 200 len: 1264 microversion: 2.1 time: 0.198458 Jul 19 23:13:24.789952 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3120/6232] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:13:24 2022] GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 1264 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:13:25.806203 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cc7e1b41-9cd1-4937-a116-c1efa4af55c9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:13:25.806971 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cc7e1b41-9cd1-4937-a116-c1efa4af55c9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:13:25.814955 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc7e1b41-9cd1-4937-a116-c1efa4af55c9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:25.815575 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc7e1b41-9cd1-4937-a116-c1efa4af55c9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:25.816907 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc7e1b41-9cd1-4937-a116-c1efa4af55c9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:25.817485 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc7e1b41-9cd1-4937-a116-c1efa4af55c9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:25.996084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cc7e1b41-9cd1-4937-a116-c1efa4af55c9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:13:26.005068 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cc7e1b41-9cd1-4937-a116-c1efa4af55c9 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 200 len: 1264 microversion: 2.1 time: 0.203053 Jul 19 23:13:26.005767 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3113/6233] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:13:25 2022] GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 1264 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:13:27.022909 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a6956f2d-2821-4a3c-a779-c6690b8693f1 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:13:27.024812 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a6956f2d-2821-4a3c-a779-c6690b8693f1 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:13:27.031860 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6956f2d-2821-4a3c-a779-c6690b8693f1 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:27.032323 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6956f2d-2821-4a3c-a779-c6690b8693f1 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:27.033108 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6956f2d-2821-4a3c-a779-c6690b8693f1 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:27.033556 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a6956f2d-2821-4a3c-a779-c6690b8693f1 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:27.191369 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a6956f2d-2821-4a3c-a779-c6690b8693f1 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:13:27.199359 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a6956f2d-2821-4a3c-a779-c6690b8693f1 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 200 len: 1264 microversion: 2.1 time: 0.180464 Jul 19 23:13:27.209212 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3121/6234] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:13:27 2022] GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:13:28.219383 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a16cc5be-d128-4f1c-b0ae-f8e27ded57d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:13:28.220658 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a16cc5be-d128-4f1c-b0ae-f8e27ded57d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:13:28.228828 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a16cc5be-d128-4f1c-b0ae-f8e27ded57d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:28.229519 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a16cc5be-d128-4f1c-b0ae-f8e27ded57d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:28.230567 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a16cc5be-d128-4f1c-b0ae-f8e27ded57d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:28.231347 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a16cc5be-d128-4f1c-b0ae-f8e27ded57d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:28.416509 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a16cc5be-d128-4f1c-b0ae-f8e27ded57d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:13:28.422171 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:13:28.429998 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a16cc5be-d128-4f1c-b0ae-f8e27ded57d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 200 len: 1264 microversion: 2.1 time: 0.215514 Jul 19 23:13:28.431030 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3114/6235] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:13:28 2022] GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 1264 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:13:29.454677 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9b8dedf5-6951-447d-9d7e-873c29005955 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:13:29.456218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9b8dedf5-6951-447d-9d7e-873c29005955 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:13:29.463624 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:13:29.466274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b8dedf5-6951-447d-9d7e-873c29005955 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:29.466761 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b8dedf5-6951-447d-9d7e-873c29005955 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:29.467639 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b8dedf5-6951-447d-9d7e-873c29005955 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:29.468091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b8dedf5-6951-447d-9d7e-873c29005955 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:29.471739 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=83 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:13:29.629753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9b8dedf5-6951-447d-9d7e-873c29005955 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:13:29.640235 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9b8dedf5-6951-447d-9d7e-873c29005955 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 200 len: 1264 microversion: 2.1 time: 0.189521 Jul 19 23:13:29.651136 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3122/6236] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:13:29 2022] GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 1264 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:13:29.836450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-77683b03-f45d-454e-8862-39401b3b4c31 req-ec8c7dd5-7b84-4a0f-8aa7-41962e30891e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "590cc12b-36f4-41ca-9cae-c88d19748331", "name": "network-vif-plugged", "status": "completed", "tag": "114bee9e-390d-452a-84f3-d9867ca8e92c"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:13:29.842449 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:13:29.856657 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-77683b03-f45d-454e-8862-39401b3b4c31 req-ec8c7dd5-7b84-4a0f-8aa7-41962e30891e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:29.857906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-77683b03-f45d-454e-8862-39401b3b4c31 req-ec8c7dd5-7b84-4a0f-8aa7-41962e30891e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:29.876718 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-77683b03-f45d-454e-8862-39401b3b4c31 req-ec8c7dd5-7b84-4a0f-8aa7-41962e30891e service nova] Creating event network-vif-plugged:114bee9e-390d-452a-84f3-d9867ca8e92c for instance 590cc12b-36f4-41ca-9cae-c88d19748331 on n-h2-847009-3 Jul 19 23:13:29.882617 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-77683b03-f45d-454e-8862-39401b3b4c31 req-ec8c7dd5-7b84-4a0f-8aa7-41962e30891e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049948 Jul 19 23:13:29.883723 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3115/6237] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:13:30.658047 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8201341c-65bf-417c-a475-60c7821c7a39 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:13:30.659366 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8201341c-65bf-417c-a475-60c7821c7a39 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:13:30.670969 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8201341c-65bf-417c-a475-60c7821c7a39 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:30.672077 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8201341c-65bf-417c-a475-60c7821c7a39 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:30.673284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8201341c-65bf-417c-a475-60c7821c7a39 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:30.674008 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8201341c-65bf-417c-a475-60c7821c7a39 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:30.848244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8201341c-65bf-417c-a475-60c7821c7a39 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:13:30.863240 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8201341c-65bf-417c-a475-60c7821c7a39 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 200 len: 1264 microversion: 2.1 time: 0.209105 Jul 19 23:13:30.864267 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3123/6238] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:13:30 2022] GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 1264 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:13:31.883481 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f20394b6-8fdb-49f7-a3e0-11adf0de56a8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:13:31.885311 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f20394b6-8fdb-49f7-a3e0-11adf0de56a8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:13:31.903990 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f20394b6-8fdb-49f7-a3e0-11adf0de56a8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:31.904654 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f20394b6-8fdb-49f7-a3e0-11adf0de56a8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:31.905580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f20394b6-8fdb-49f7-a3e0-11adf0de56a8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:31.906072 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f20394b6-8fdb-49f7-a3e0-11adf0de56a8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:32.068509 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f20394b6-8fdb-49f7-a3e0-11adf0de56a8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:13:32.077322 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f20394b6-8fdb-49f7-a3e0-11adf0de56a8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 200 len: 1450 microversion: 2.1 time: 0.199711 Jul 19 23:13:32.078562 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3116/6239] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:13:31 2022] GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 1450 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:13:32.095858 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3960caa1-ab23-44d8-aceb-1c2817133180 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:13:32.097338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3960caa1-ab23-44d8-aceb-1c2817133180 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:13:32.107493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3960caa1-ab23-44d8-aceb-1c2817133180 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:32.108175 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3960caa1-ab23-44d8-aceb-1c2817133180 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:32.109349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3960caa1-ab23-44d8-aceb-1c2817133180 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:32.109546 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3960caa1-ab23-44d8-aceb-1c2817133180 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:32.269487 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3960caa1-ab23-44d8-aceb-1c2817133180 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:13:32.277971 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3960caa1-ab23-44d8-aceb-1c2817133180 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 200 len: 1450 microversion: 2.1 time: 0.187100 Jul 19 23:13:32.278649 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3124/6240] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:13:32 2022] GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 1450 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:13:34.371451 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-0d181d46-1328-4032-8996-892b17882f28 req-382419bb-763a-4d62-bc17-473ffac90bac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "590cc12b-36f4-41ca-9cae-c88d19748331", "tag": "114bee9e-390d-452a-84f3-d9867ca8e92c"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:13:34.381381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0d181d46-1328-4032-8996-892b17882f28 req-382419bb-763a-4d62-bc17-473ffac90bac service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:13:34.382303 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0d181d46-1328-4032-8996-892b17882f28 req-382419bb-763a-4d62-bc17-473ffac90bac service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:13:34.397176 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-0d181d46-1328-4032-8996-892b17882f28 req-382419bb-763a-4d62-bc17-473ffac90bac service nova] Creating event network-changed:114bee9e-390d-452a-84f3-d9867ca8e92c for instance 590cc12b-36f4-41ca-9cae-c88d19748331 on n-h2-847009-3 Jul 19 23:13:34.401221 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-0d181d46-1328-4032-8996-892b17882f28 req-382419bb-763a-4d62-bc17-473ffac90bac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034072 Jul 19 23:13:34.401834 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3117/6241] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:15:16.975430 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=5 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:15:16.976185 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=17 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:15:16.981087 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ec7be2eb-b46a-469b-bc9c-5a18d3b4e170 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1196587996", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-480112255", "security_groups": [{"name": "tempest-secgroup-smoke-737929312"}], "block_device_mapping_v2": [{"uuid": "b387cc33-7f89-4e94-9f65-2337fdaf7303", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c424fcca-fcaa-49c5-9171-61018c1542cf"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:15:17.224934 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-ec7be2eb-b46a-469b-bc9c-5a18d3b4e170 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] validate_networks() for [('c424fcca-fcaa-49c5-9171-61018c1542cf', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:15:17.361355 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:15:17.361545 n-d-847009-3 devstack@n-api.service[119337]: Tue Jul 19 23:15:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Jul 19 23:15:17.611455 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ec7be2eb-b46a-469b-bc9c-5a18d3b4e170 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:15:17.611889 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ec7be2eb-b46a-469b-bc9c-5a18d3b4e170 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:15:17.612382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ec7be2eb-b46a-469b-bc9c-5a18d3b4e170 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:15:17.612801 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ec7be2eb-b46a-469b-bc9c-5a18d3b4e170 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:15:17.613233 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-ec7be2eb-b46a-469b-bc9c-5a18d3b4e170 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:15:17.622042 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ec7be2eb-b46a-469b-bc9c-5a18d3b4e170 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:17.622496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ec7be2eb-b46a-469b-bc9c-5a18d3b4e170 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:17.623343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ec7be2eb-b46a-469b-bc9c-5a18d3b4e170 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:17.623797 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ec7be2eb-b46a-469b-bc9c-5a18d3b4e170 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:17.918588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-ec7be2eb-b46a-469b-bc9c-5a18d3b4e170 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Getting quotas for project ba6762beb0fe4220b984143b3ea6bd48. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:15:17.923634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-ec7be2eb-b46a-469b-bc9c-5a18d3b4e170 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Getting quotas for user deeb5431c1284d02b245ff3a9dc3f4e8 and project ba6762beb0fe4220b984143b3ea6bd48. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:15:17.982868 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ec7be2eb-b46a-469b-bc9c-5a18d3b4e170 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:15:17.984888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ec7be2eb-b46a-469b-bc9c-5a18d3b4e170 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b387cc33-7f89-4e94-9f65-2337fdaf7303',volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:15:18.115267 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ec7be2eb-b46a-469b-bc9c-5a18d3b4e170 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.141650 Jul 19 23:15:18.115959 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3125/6242] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:15:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 1143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:15:18.125772 n-d-847009-3 devstack@n-api.service[119338]: ERROR oslo.messaging._drivers.impl_rabbit [-] [33eb9b21-6b86-489c-8081-974c1460dc40] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 23:15:18.126715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=5 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:15:18.127603 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=11 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:15:18.133521 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-78865649-0e6b-4601-8247-6368d30a7c4f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:15:18.134262 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-78865649-0e6b-4601-8247-6368d30a7c4f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:15:18.305591 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-78865649-0e6b-4601-8247-6368d30a7c4f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:15:18.313362 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-78865649-0e6b-4601-8247-6368d30a7c4f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904" status: 200 len: 1094 microversion: 2.1 time: 0.189983 Jul 19 23:15:18.313941 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3118/6243] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:15:18 2022] GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904 => generated 1094 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:15:19.338788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5e858ad7-5544-41b4-82bd-10b5a0e916bd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:15:19.339647 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5e858ad7-5544-41b4-82bd-10b5a0e916bd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:15:19.347264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5e858ad7-5544-41b4-82bd-10b5a0e916bd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:19.347822 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5e858ad7-5544-41b4-82bd-10b5a0e916bd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:19.348689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5e858ad7-5544-41b4-82bd-10b5a0e916bd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:19.349238 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5e858ad7-5544-41b4-82bd-10b5a0e916bd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:19.431627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5e858ad7-5544-41b4-82bd-10b5a0e916bd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:15:19.439402 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5e858ad7-5544-41b4-82bd-10b5a0e916bd tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904" status: 200 len: 1210 microversion: 2.1 time: 0.105711 Jul 19 23:15:19.440228 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3126/6244] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:15:19 2022] GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904 => generated 1210 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:15:20.458486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-11bc7cb0-6121-4de5-acf0-4cfa6557c93b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:15:20.460892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-11bc7cb0-6121-4de5-acf0-4cfa6557c93b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:15:20.472576 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-11bc7cb0-6121-4de5-acf0-4cfa6557c93b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:20.473331 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-11bc7cb0-6121-4de5-acf0-4cfa6557c93b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:20.474121 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-11bc7cb0-6121-4de5-acf0-4cfa6557c93b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:20.474560 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-11bc7cb0-6121-4de5-acf0-4cfa6557c93b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:20.503572 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [-] [33eb9b21-6b86-489c-8081-974c1460dc40] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 34546. Jul 19 23:15:20.827389 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-11bc7cb0-6121-4de5-acf0-4cfa6557c93b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:15:20.836017 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-11bc7cb0-6121-4de5-acf0-4cfa6557c93b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904" status: 200 len: 1277 microversion: 2.1 time: 0.382370 Jul 19 23:15:20.836602 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3119/6245] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:15:20 2022] GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904 => generated 1277 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:15:21.138528 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-44052344-8f80-4eb7-a0fb-631e251ecd66 req-6d494604-6afe-4d11-b339-1cca7d2eda8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e8020e-1509-4a09-85ff-34cbeabf5904", "tag": "5285b963-964c-44bf-a1cd-c9dddf54c1fe"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:15:21.165864 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-44052344-8f80-4eb7-a0fb-631e251ecd66 req-6d494604-6afe-4d11-b339-1cca7d2eda8a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:21.166640 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-44052344-8f80-4eb7-a0fb-631e251ecd66 req-6d494604-6afe-4d11-b339-1cca7d2eda8a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:21.180214 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-44052344-8f80-4eb7-a0fb-631e251ecd66 req-6d494604-6afe-4d11-b339-1cca7d2eda8a service nova] Creating event network-changed:5285b963-964c-44bf-a1cd-c9dddf54c1fe for instance e0e8020e-1509-4a09-85ff-34cbeabf5904 on n-h1-847009-3 Jul 19 23:15:21.198660 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-44052344-8f80-4eb7-a0fb-631e251ecd66 req-6d494604-6afe-4d11-b339-1cca7d2eda8a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068619 Jul 19 23:15:21.201020 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3127/6246] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:15:21.853751 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4ce5654c-054a-428b-8f26-77ab8efa8746 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:15:21.854373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4ce5654c-054a-428b-8f26-77ab8efa8746 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:15:21.862730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ce5654c-054a-428b-8f26-77ab8efa8746 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:21.863539 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ce5654c-054a-428b-8f26-77ab8efa8746 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:21.864324 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ce5654c-054a-428b-8f26-77ab8efa8746 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:21.864885 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4ce5654c-054a-428b-8f26-77ab8efa8746 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:22.077153 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4ce5654c-054a-428b-8f26-77ab8efa8746 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:15:22.085062 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4ce5654c-054a-428b-8f26-77ab8efa8746 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904" status: 200 len: 1277 microversion: 2.1 time: 0.235210 Jul 19 23:15:22.085971 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3120/6247] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:15:21 2022] GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904 => generated 1277 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:15:23.104565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f403f047-5a80-483b-9e81-884aaa7066b4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:15:23.105297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f403f047-5a80-483b-9e81-884aaa7066b4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:15:23.112780 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f403f047-5a80-483b-9e81-884aaa7066b4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:23.113256 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f403f047-5a80-483b-9e81-884aaa7066b4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:23.114039 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f403f047-5a80-483b-9e81-884aaa7066b4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:23.114495 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f403f047-5a80-483b-9e81-884aaa7066b4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:23.261016 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f403f047-5a80-483b-9e81-884aaa7066b4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:15:23.268679 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f403f047-5a80-483b-9e81-884aaa7066b4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904" status: 200 len: 1277 microversion: 2.1 time: 0.169295 Jul 19 23:15:23.269254 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3128/6248] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:15:23 2022] GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:15:24.285834 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3e2d9aee-9cc9-4df1-b81e-b89058df0afa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:15:24.286450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3e2d9aee-9cc9-4df1-b81e-b89058df0afa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:15:24.293920 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e2d9aee-9cc9-4df1-b81e-b89058df0afa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:24.294386 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e2d9aee-9cc9-4df1-b81e-b89058df0afa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:24.295199 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e2d9aee-9cc9-4df1-b81e-b89058df0afa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:24.295643 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e2d9aee-9cc9-4df1-b81e-b89058df0afa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:24.441210 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3e2d9aee-9cc9-4df1-b81e-b89058df0afa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:15:24.449004 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3e2d9aee-9cc9-4df1-b81e-b89058df0afa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904" status: 200 len: 1277 microversion: 2.1 time: 0.167109 Jul 19 23:15:24.450195 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3121/6249] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:15:24 2022] GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:15:25.466204 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8819a942-f8ef-41e5-b2a8-3830a121e865 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:15:25.466837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8819a942-f8ef-41e5-b2a8-3830a121e865 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:15:25.473920 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8819a942-f8ef-41e5-b2a8-3830a121e865 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:25.474384 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8819a942-f8ef-41e5-b2a8-3830a121e865 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:25.475192 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8819a942-f8ef-41e5-b2a8-3830a121e865 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:25.475646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8819a942-f8ef-41e5-b2a8-3830a121e865 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:25.616750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8819a942-f8ef-41e5-b2a8-3830a121e865 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:15:25.625141 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8819a942-f8ef-41e5-b2a8-3830a121e865 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904" status: 200 len: 1265 microversion: 2.1 time: 0.163054 Jul 19 23:15:25.626692 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3129/6250] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:15:25 2022] GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:15:26.646318 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4222e86c-20a5-4e47-a12d-380fbc346baa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:15:26.647202 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4222e86c-20a5-4e47-a12d-380fbc346baa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:15:26.656305 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4222e86c-20a5-4e47-a12d-380fbc346baa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:26.656861 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4222e86c-20a5-4e47-a12d-380fbc346baa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:26.657800 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4222e86c-20a5-4e47-a12d-380fbc346baa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:26.658275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4222e86c-20a5-4e47-a12d-380fbc346baa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:26.815488 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4222e86c-20a5-4e47-a12d-380fbc346baa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:15:26.825081 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4222e86c-20a5-4e47-a12d-380fbc346baa tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904" status: 200 len: 1265 microversion: 2.1 time: 0.184323 Jul 19 23:15:26.826025 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3122/6251] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:15:26 2022] GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:15:27.846904 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2b357070-b2e5-435e-98f6-d1950840ba2f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:15:27.847724 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2b357070-b2e5-435e-98f6-d1950840ba2f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:15:27.857169 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2b357070-b2e5-435e-98f6-d1950840ba2f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:27.857723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2b357070-b2e5-435e-98f6-d1950840ba2f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:27.858667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2b357070-b2e5-435e-98f6-d1950840ba2f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:27.859147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2b357070-b2e5-435e-98f6-d1950840ba2f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:27.908696 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:15:27.929887 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:15:28.008159 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2b357070-b2e5-435e-98f6-d1950840ba2f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:15:28.018707 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2b357070-b2e5-435e-98f6-d1950840ba2f tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904" status: 200 len: 1265 microversion: 2.1 time: 0.177164 Jul 19 23:15:28.019660 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3130/6252] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:15:27 2022] GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:15:29.036236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d588d20a-7268-48e4-921a-155b29e33176 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:15:29.036809 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d588d20a-7268-48e4-921a-155b29e33176 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:15:29.039532 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:15:29.045358 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d588d20a-7268-48e4-921a-155b29e33176 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:29.045809 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d588d20a-7268-48e4-921a-155b29e33176 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:29.046588 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d588d20a-7268-48e4-921a-155b29e33176 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:29.047033 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d588d20a-7268-48e4-921a-155b29e33176 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:29.186194 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d588d20a-7268-48e4-921a-155b29e33176 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:15:29.193788 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d588d20a-7268-48e4-921a-155b29e33176 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904" status: 200 len: 1265 microversion: 2.1 time: 0.161569 Jul 19 23:15:29.194363 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3123/6253] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:15:29 2022] GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:15:30.211431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0ad4d487-19ec-4d71-ad22-ec8a0b3c428b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:15:30.212328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0ad4d487-19ec-4d71-ad22-ec8a0b3c428b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:15:30.219991 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ad4d487-19ec-4d71-ad22-ec8a0b3c428b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:30.220485 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ad4d487-19ec-4d71-ad22-ec8a0b3c428b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:30.221256 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ad4d487-19ec-4d71-ad22-ec8a0b3c428b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:30.221713 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ad4d487-19ec-4d71-ad22-ec8a0b3c428b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:30.368591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0ad4d487-19ec-4d71-ad22-ec8a0b3c428b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:15:30.376480 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0ad4d487-19ec-4d71-ad22-ec8a0b3c428b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904" status: 200 len: 1265 microversion: 2.1 time: 0.168998 Jul 19 23:15:30.377064 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3131/6254] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:15:30 2022] GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:15:31.393731 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1df7d996-7b00-4c47-a8a4-25f8c6fb3357 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:15:31.394348 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1df7d996-7b00-4c47-a8a4-25f8c6fb3357 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:15:31.401463 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1df7d996-7b00-4c47-a8a4-25f8c6fb3357 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:31.401935 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1df7d996-7b00-4c47-a8a4-25f8c6fb3357 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:31.403034 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1df7d996-7b00-4c47-a8a4-25f8c6fb3357 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:31.403507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1df7d996-7b00-4c47-a8a4-25f8c6fb3357 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:31.546251 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1df7d996-7b00-4c47-a8a4-25f8c6fb3357 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:15:31.553866 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1df7d996-7b00-4c47-a8a4-25f8c6fb3357 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904" status: 200 len: 1265 microversion: 2.1 time: 0.164085 Jul 19 23:15:31.554631 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3124/6255] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:15:31 2022] GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:15:32.571867 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f57b5f10-6bf1-430f-9fb0-7a3b1751c8be tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:15:32.572529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f57b5f10-6bf1-430f-9fb0-7a3b1751c8be tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:15:32.579465 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f57b5f10-6bf1-430f-9fb0-7a3b1751c8be tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:32.579927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f57b5f10-6bf1-430f-9fb0-7a3b1751c8be tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:32.580692 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f57b5f10-6bf1-430f-9fb0-7a3b1751c8be tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:32.581138 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f57b5f10-6bf1-430f-9fb0-7a3b1751c8be tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:32.713013 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f57b5f10-6bf1-430f-9fb0-7a3b1751c8be tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:15:32.721571 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f57b5f10-6bf1-430f-9fb0-7a3b1751c8be tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904" status: 200 len: 1265 microversion: 2.1 time: 0.153590 Jul 19 23:15:32.722150 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3132/6256] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:15:32 2022] GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:15:33.529822 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-e26c0566-7341-41a1-8c2b-05c9bd2865a8 req-ca0c0a32-18c3-4364-bf9a-54b41e44e4c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e8020e-1509-4a09-85ff-34cbeabf5904", "name": "network-vif-plugged", "status": "completed", "tag": "5285b963-964c-44bf-a1cd-c9dddf54c1fe"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:15:33.540166 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e26c0566-7341-41a1-8c2b-05c9bd2865a8 req-ca0c0a32-18c3-4364-bf9a-54b41e44e4c4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:33.540624 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e26c0566-7341-41a1-8c2b-05c9bd2865a8 req-ca0c0a32-18c3-4364-bf9a-54b41e44e4c4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:33.556042 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-e26c0566-7341-41a1-8c2b-05c9bd2865a8 req-ca0c0a32-18c3-4364-bf9a-54b41e44e4c4 service nova] Creating event network-vif-plugged:5285b963-964c-44bf-a1cd-c9dddf54c1fe for instance e0e8020e-1509-4a09-85ff-34cbeabf5904 on n-h1-847009-3 Jul 19 23:15:33.562327 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-e26c0566-7341-41a1-8c2b-05c9bd2865a8 req-ca0c0a32-18c3-4364-bf9a-54b41e44e4c4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036397 Jul 19 23:15:33.562927 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3125/6257] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:15:33.737846 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d69a544a-b0b7-41bf-99b7-7123b1c30002 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:15:33.738477 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d69a544a-b0b7-41bf-99b7-7123b1c30002 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:15:33.745476 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d69a544a-b0b7-41bf-99b7-7123b1c30002 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:33.746678 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d69a544a-b0b7-41bf-99b7-7123b1c30002 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:33.747561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d69a544a-b0b7-41bf-99b7-7123b1c30002 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:33.748016 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d69a544a-b0b7-41bf-99b7-7123b1c30002 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:33.879036 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d69a544a-b0b7-41bf-99b7-7123b1c30002 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:15:33.886700 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d69a544a-b0b7-41bf-99b7-7123b1c30002 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904" status: 200 len: 1265 microversion: 2.1 time: 0.152653 Jul 19 23:15:33.887435 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3133/6258] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:15:33 2022] GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:15:34.905631 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-990639a2-aa85-409c-aa0d-cfa748c570cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:15:34.906345 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-990639a2-aa85-409c-aa0d-cfa748c570cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:15:34.913572 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-990639a2-aa85-409c-aa0d-cfa748c570cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:34.914037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-990639a2-aa85-409c-aa0d-cfa748c570cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:34.914805 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-990639a2-aa85-409c-aa0d-cfa748c570cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:34.915290 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-990639a2-aa85-409c-aa0d-cfa748c570cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:35.055802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-990639a2-aa85-409c-aa0d-cfa748c570cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:15:35.064137 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-990639a2-aa85-409c-aa0d-cfa748c570cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904" status: 200 len: 1265 microversion: 2.1 time: 0.162900 Jul 19 23:15:35.064713 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3126/6259] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:15:34 2022] GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:15:36.082236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3a69d076-00a9-4f41-b145-2f7a0ee7ff5b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:15:36.082879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3a69d076-00a9-4f41-b145-2f7a0ee7ff5b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:15:36.090464 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3a69d076-00a9-4f41-b145-2f7a0ee7ff5b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:36.090937 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3a69d076-00a9-4f41-b145-2f7a0ee7ff5b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:36.091830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3a69d076-00a9-4f41-b145-2f7a0ee7ff5b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:36.092293 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3a69d076-00a9-4f41-b145-2f7a0ee7ff5b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:36.636508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3a69d076-00a9-4f41-b145-2f7a0ee7ff5b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:15:36.643956 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3a69d076-00a9-4f41-b145-2f7a0ee7ff5b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904" status: 200 len: 1452 microversion: 2.1 time: 0.565900 Jul 19 23:15:36.644525 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3134/6260] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:15:36 2022] GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904 => generated 1452 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:15:36.660283 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6c4a5c74-87c9-4aaf-9935-c3f6dcdcc33c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:15:36.660964 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6c4a5c74-87c9-4aaf-9935-c3f6dcdcc33c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:15:36.668723 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c4a5c74-87c9-4aaf-9935-c3f6dcdcc33c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:36.669181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c4a5c74-87c9-4aaf-9935-c3f6dcdcc33c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:36.669955 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c4a5c74-87c9-4aaf-9935-c3f6dcdcc33c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:36.670390 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6c4a5c74-87c9-4aaf-9935-c3f6dcdcc33c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:36.903193 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6c4a5c74-87c9-4aaf-9935-c3f6dcdcc33c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:15:36.912151 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6c4a5c74-87c9-4aaf-9935-c3f6dcdcc33c tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904" status: 200 len: 1452 microversion: 2.1 time: 0.255665 Jul 19 23:15:36.912950 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3127/6261] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:15:36 2022] GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904 => generated 1452 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:15:38.866159 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-9ba6b342-007f-47cf-8102-186259166bed req-471f3a8c-3107-4172-9b89-ad9825682f9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e8020e-1509-4a09-85ff-34cbeabf5904", "tag": "5285b963-964c-44bf-a1cd-c9dddf54c1fe"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:15:38.874400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-9ba6b342-007f-47cf-8102-186259166bed req-471f3a8c-3107-4172-9b89-ad9825682f9c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:15:38.874861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-9ba6b342-007f-47cf-8102-186259166bed req-471f3a8c-3107-4172-9b89-ad9825682f9c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:15:38.885785 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-9ba6b342-007f-47cf-8102-186259166bed req-471f3a8c-3107-4172-9b89-ad9825682f9c service nova] Creating event network-changed:5285b963-964c-44bf-a1cd-c9dddf54c1fe for instance e0e8020e-1509-4a09-85ff-34cbeabf5904 on n-h1-847009-3 Jul 19 23:15:38.891517 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-9ba6b342-007f-47cf-8102-186259166bed req-471f3a8c-3107-4172-9b89-ad9825682f9c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096603 Jul 19 23:15:38.892423 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3135/6262] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:16:35.277136 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:16:35.277758 n-d-847009-3 devstack@n-api.service[119338]: Tue Jul 19 23:16:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:16:35.368320 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:16:35.368518 n-d-847009-3 devstack@n-api.service[119338]: Tue Jul 19 23:16:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:16:37.075893 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:16:37.076507 n-d-847009-3 devstack@n-api.service[119337]: Tue Jul 19 23:16:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:17:07.763153 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=22 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:17:07.764550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=50 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:17:07.766021 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:17:07.766776 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=54 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:17:07.770011 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b5a30cb3-3d2d-4389-8268-8045c07f0ef6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:17:07.770641 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b5a30cb3-3d2d-4389-8268-8045c07f0ef6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:17:07.771453 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-64a9d11c-0073-4b19-8ba5-48d47a134547 req-a72f2243-7bc7-4534-b5d2-15846f509628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e8020e-1509-4a09-85ff-34cbeabf5904", "tag": "5285b963-964c-44bf-a1cd-c9dddf54c1fe"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:17:07.783266 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-64a9d11c-0073-4b19-8ba5-48d47a134547 req-a72f2243-7bc7-4534-b5d2-15846f509628 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:07.783266 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-64a9d11c-0073-4b19-8ba5-48d47a134547 req-a72f2243-7bc7-4534-b5d2-15846f509628 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:07.791742 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b5a30cb3-3d2d-4389-8268-8045c07f0ef6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:07.792345 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b5a30cb3-3d2d-4389-8268-8045c07f0ef6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:07.793219 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b5a30cb3-3d2d-4389-8268-8045c07f0ef6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:07.793577 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b5a30cb3-3d2d-4389-8268-8045c07f0ef6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:07.795786 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-64a9d11c-0073-4b19-8ba5-48d47a134547 req-a72f2243-7bc7-4534-b5d2-15846f509628 service nova] Creating event network-changed:5285b963-964c-44bf-a1cd-c9dddf54c1fe for instance e0e8020e-1509-4a09-85ff-34cbeabf5904 on n-h1-847009-3 Jul 19 23:17:07.800921 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-64a9d11c-0073-4b19-8ba5-48d47a134547 req-a72f2243-7bc7-4534-b5d2-15846f509628 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037576 Jul 19 23:17:07.801871 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3136/6263] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:17:07.822996 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b5a30cb3-3d2d-4389-8268-8045c07f0ef6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:17:07.913053 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b5a30cb3-3d2d-4389-8268-8045c07f0ef6 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904" status: 204 len: 0 microversion: 2.1 time: 0.151792 Jul 19 23:17:07.914768 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3128/6264] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:17:07 2022] DELETE /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:17:07.925533 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-72d8a5b6-ec20-4c4d-b354-e313ba38b981 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:17:07.926264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-72d8a5b6-ec20-4c4d-b354-e313ba38b981 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:17:07.933723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-72d8a5b6-ec20-4c4d-b354-e313ba38b981 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:07.934190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-72d8a5b6-ec20-4c4d-b354-e313ba38b981 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:07.934977 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-72d8a5b6-ec20-4c4d-b354-e313ba38b981 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:07.935505 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-72d8a5b6-ec20-4c4d-b354-e313ba38b981 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:08.084035 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-72d8a5b6-ec20-4c4d-b354-e313ba38b981 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:17:08.093368 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-72d8a5b6-ec20-4c4d-b354-e313ba38b981 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904" status: 200 len: 1576 microversion: 2.1 time: 0.173716 Jul 19 23:17:08.093946 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3137/6265] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:17:07 2022] GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:17:09.111851 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8b20bfbd-e65e-41a8-897d-c881253355ca tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:17:09.112582 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8b20bfbd-e65e-41a8-897d-c881253355ca tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:17:09.120001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8b20bfbd-e65e-41a8-897d-c881253355ca tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:09.120446 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8b20bfbd-e65e-41a8-897d-c881253355ca tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:09.121218 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8b20bfbd-e65e-41a8-897d-c881253355ca tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:09.121644 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8b20bfbd-e65e-41a8-897d-c881253355ca tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:09.296965 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8b20bfbd-e65e-41a8-897d-c881253355ca tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:17:09.304961 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8b20bfbd-e65e-41a8-897d-c881253355ca tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904" status: 200 len: 1576 microversion: 2.1 time: 0.197370 Jul 19 23:17:09.305547 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3129/6266] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:17:09 2022] GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904 => generated 1576 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:17:10.149615 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-9a8c4986-28c9-4b77-ad70-c2f12cdc4d70 req-16eb869a-3f26-4957-82a2-f05c37bcd34a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e8020e-1509-4a09-85ff-34cbeabf5904", "name": "network-vif-deleted", "tag": "5285b963-964c-44bf-a1cd-c9dddf54c1fe"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:17:10.161667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-9a8c4986-28c9-4b77-ad70-c2f12cdc4d70 req-16eb869a-3f26-4957-82a2-f05c37bcd34a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:10.162498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-9a8c4986-28c9-4b77-ad70-c2f12cdc4d70 req-16eb869a-3f26-4957-82a2-f05c37bcd34a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:10.175088 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-9a8c4986-28c9-4b77-ad70-c2f12cdc4d70 req-16eb869a-3f26-4957-82a2-f05c37bcd34a service nova] Creating event network-vif-deleted:5285b963-964c-44bf-a1cd-c9dddf54c1fe for instance e0e8020e-1509-4a09-85ff-34cbeabf5904 on n-h1-847009-3 Jul 19 23:17:10.182799 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-9a8c4986-28c9-4b77-ad70-c2f12cdc4d70 req-16eb869a-3f26-4957-82a2-f05c37bcd34a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037459 Jul 19 23:17:10.183428 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3138/6267] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:17:10.323498 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-795050e4-8c6d-466b-8987-c6ec1650253d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:17:10.324118 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-795050e4-8c6d-466b-8987-c6ec1650253d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:17:10.331024 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-795050e4-8c6d-466b-8987-c6ec1650253d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:10.331544 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-795050e4-8c6d-466b-8987-c6ec1650253d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:10.332312 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-795050e4-8c6d-466b-8987-c6ec1650253d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:10.332745 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-795050e4-8c6d-466b-8987-c6ec1650253d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:10.403765 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-795050e4-8c6d-466b-8987-c6ec1650253d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:17:10.411998 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-795050e4-8c6d-466b-8987-c6ec1650253d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904" status: 200 len: 1225 microversion: 2.1 time: 0.092703 Jul 19 23:17:10.413162 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3130/6268] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:17:10 2022] GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:17:11.431611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-046cd8a1-a82a-4fe1-ad8d-6555cd673c44 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:17:11.432324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-046cd8a1-a82a-4fe1-ad8d-6555cd673c44 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:17:11.439714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-046cd8a1-a82a-4fe1-ad8d-6555cd673c44 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:11.440192 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-046cd8a1-a82a-4fe1-ad8d-6555cd673c44 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:11.440983 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-046cd8a1-a82a-4fe1-ad8d-6555cd673c44 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:11.441438 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-046cd8a1-a82a-4fe1-ad8d-6555cd673c44 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:11.509653 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-046cd8a1-a82a-4fe1-ad8d-6555cd673c44 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:17:11.517768 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-046cd8a1-a82a-4fe1-ad8d-6555cd673c44 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904" status: 200 len: 1225 microversion: 2.1 time: 0.091502 Jul 19 23:17:11.518356 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3139/6269] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:17:11 2022] GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:17:12.534311 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-89fa156f-17fd-42e0-bdb3-6dee9c2be05b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:17:12.534932 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-89fa156f-17fd-42e0-bdb3-6dee9c2be05b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:17:12.542360 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-89fa156f-17fd-42e0-bdb3-6dee9c2be05b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:12.542810 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-89fa156f-17fd-42e0-bdb3-6dee9c2be05b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:12.543626 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-89fa156f-17fd-42e0-bdb3-6dee9c2be05b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:12.544068 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-89fa156f-17fd-42e0-bdb3-6dee9c2be05b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:12.609511 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-89fa156f-17fd-42e0-bdb3-6dee9c2be05b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:17:12.617919 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-89fa156f-17fd-42e0-bdb3-6dee9c2be05b tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904" status: 200 len: 1225 microversion: 2.1 time: 0.087388 Jul 19 23:17:12.618517 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3131/6270] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:17:12 2022] GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:17:13.635493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5a960dbe-3fdc-4607-9c5e-ddd4135990da tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:17:13.636134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5a960dbe-3fdc-4607-9c5e-ddd4135990da tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:17:13.643256 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a960dbe-3fdc-4607-9c5e-ddd4135990da tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:13.643704 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a960dbe-3fdc-4607-9c5e-ddd4135990da tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:13.644488 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a960dbe-3fdc-4607-9c5e-ddd4135990da tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:13.644940 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a960dbe-3fdc-4607-9c5e-ddd4135990da tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:13.707373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5a960dbe-3fdc-4607-9c5e-ddd4135990da tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:17:13.716207 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5a960dbe-3fdc-4607-9c5e-ddd4135990da tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904" status: 200 len: 1225 microversion: 2.1 time: 0.084874 Jul 19 23:17:13.716682 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3140/6271] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:17:13 2022] GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:17:14.732935 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cf66589c-5356-4af7-bcb2-36d5a0c82fc2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:17:14.733531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cf66589c-5356-4af7-bcb2-36d5a0c82fc2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:17:14.740761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf66589c-5356-4af7-bcb2-36d5a0c82fc2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:14.741837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf66589c-5356-4af7-bcb2-36d5a0c82fc2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:14.742867 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf66589c-5356-4af7-bcb2-36d5a0c82fc2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:14.743331 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf66589c-5356-4af7-bcb2-36d5a0c82fc2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:14.781211 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf66589c-5356-4af7-bcb2-36d5a0c82fc2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:14.781623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cf66589c-5356-4af7-bcb2-36d5a0c82fc2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:14.782083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-cf66589c-5356-4af7-bcb2-36d5a0c82fc2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lazy-loading 'fault' on Instance uuid e0e8020e-1509-4a09-85ff-34cbeabf5904 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:17:14.834551 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cf66589c-5356-4af7-bcb2-36d5a0c82fc2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:17:14.841511 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cf66589c-5356-4af7-bcb2-36d5a0c82fc2 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904" status: 200 len: 1184 microversion: 2.1 time: 0.112579 Jul 19 23:17:14.842077 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3132/6272] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:17:14 2022] GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904 => generated 1184 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:17:15.859688 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-aa7cce18-d171-4ee1-a70c-391ff6fe82ab tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:17:15.860328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-aa7cce18-d171-4ee1-a70c-391ff6fe82ab tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: e0e8020e-1509-4a09-85ff-34cbeabf5904] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:17:15.868255 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa7cce18-d171-4ee1-a70c-391ff6fe82ab tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:15.868968 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa7cce18-d171-4ee1-a70c-391ff6fe82ab tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:15.870178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa7cce18-d171-4ee1-a70c-391ff6fe82ab tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:15.870916 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aa7cce18-d171-4ee1-a70c-391ff6fe82ab tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:15.891158 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-aa7cce18-d171-4ee1-a70c-391ff6fe82ab tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] HTTP exception thrown: Instance e0e8020e-1509-4a09-85ff-34cbeabf5904 could not be found. Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-aa7cce18-d171-4ee1-a70c-391ff6fe82ab tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Request method failure captured: Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904 HTTP/1.1 Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zh6YPXnZEfL25DbrOo5AahkBCmHYOrAvKJnhgzQ9JlHxbrun4XI2EwE2n1nf4tgNFUaArqBEbFq4Toj7uUUuANo7JRuxksIEPvDD1AFl7fhy2XFxh_IYAhLXnE4PI4_QoyTOcOGpDghFYkpTUUI4xKODXHZZ1_feIKHlU2SknrcKPQ Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: deeb5431c1284d02b245ff3a9dc3f4e8 Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance e0e8020e-1509-4a09-85ff-34cbeabf5904 could not be found. Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'e0e8020e-1509-4a09-85ff-34cbeabf5904'} Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0e8020e-1509-4a09-85ff-34cbeabf5904 could not be found. Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0e8020e-1509-4a09-85ff-34cbeabf5904 could not be found. Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:17:15.892879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:17:15.899156 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:17:15.899156 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:17:15.899156 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:17:15.899156 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:17:15.899156 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:17:15.899156 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0e8020e-1509-4a09-85ff-34cbeabf5904 could not be found. Jul 19 23:17:15.899156 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:17:15.899156 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-aa7cce18-d171-4ee1-a70c-391ff6fe82ab tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Returning 404 to user: Instance e0e8020e-1509-4a09-85ff-34cbeabf5904 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:17:15.899156 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-aa7cce18-d171-4ee1-a70c-391ff6fe82ab tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904" status: 404 len: 111 microversion: 2.1 time: 0.038691 Jul 19 23:17:15.899156 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3141/6273] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:17:15 2022] GET /compute/v2.1/servers/e0e8020e-1509-4a09-85ff-34cbeabf5904 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:17:22.453751 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a4235fe0-8562-4653-b9ac-57d5fc7f149d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:17:22.454299 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a4235fe0-8562-4653-b9ac-57d5fc7f149d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:17:22.469115 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a4235fe0-8562-4653-b9ac-57d5fc7f149d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:22.469586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a4235fe0-8562-4653-b9ac-57d5fc7f149d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:22.470390 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a4235fe0-8562-4653-b9ac-57d5fc7f149d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:22.470858 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a4235fe0-8562-4653-b9ac-57d5fc7f149d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:22.498401 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a4235fe0-8562-4653-b9ac-57d5fc7f149d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:17:22.555769 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-016511ff-3c7e-4987-a665-24095a46ed24 req-e4ee2355-9d45-484f-a15b-ebe05ececfee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "590cc12b-36f4-41ca-9cae-c88d19748331", "tag": "114bee9e-390d-452a-84f3-d9867ca8e92c"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:17:22.568565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-016511ff-3c7e-4987-a665-24095a46ed24 req-e4ee2355-9d45-484f-a15b-ebe05ececfee service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:22.569880 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-016511ff-3c7e-4987-a665-24095a46ed24 req-e4ee2355-9d45-484f-a15b-ebe05ececfee service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:22.583066 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-016511ff-3c7e-4987-a665-24095a46ed24 req-e4ee2355-9d45-484f-a15b-ebe05ececfee service nova] Creating event network-changed:114bee9e-390d-452a-84f3-d9867ca8e92c for instance 590cc12b-36f4-41ca-9cae-c88d19748331 on n-h2-847009-3 Jul 19 23:17:22.590165 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-016511ff-3c7e-4987-a665-24095a46ed24 req-e4ee2355-9d45-484f-a15b-ebe05ececfee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138710 Jul 19 23:17:22.591707 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3142/6274] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:17:22.601249 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a4235fe0-8562-4653-b9ac-57d5fc7f149d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "DELETE /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 204 len: 0 microversion: 2.1 time: 0.151866 Jul 19 23:17:22.602145 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3133/6275] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:17:22 2022] DELETE /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:17:22.613732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5ec01c73-3db5-4ded-bf1f-3ab7a84fe37d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:17:22.614892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5ec01c73-3db5-4ded-bf1f-3ab7a84fe37d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:17:22.623128 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ec01c73-3db5-4ded-bf1f-3ab7a84fe37d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:22.623816 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ec01c73-3db5-4ded-bf1f-3ab7a84fe37d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:22.625450 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ec01c73-3db5-4ded-bf1f-3ab7a84fe37d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:22.626088 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5ec01c73-3db5-4ded-bf1f-3ab7a84fe37d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:22.780241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5ec01c73-3db5-4ded-bf1f-3ab7a84fe37d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:17:22.790712 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5ec01c73-3db5-4ded-bf1f-3ab7a84fe37d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 200 len: 1575 microversion: 2.1 time: 0.181952 Jul 19 23:17:22.795280 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3143/6276] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:17:22 2022] GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 1575 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:17:23.811694 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6806d3f5-b07b-47be-a077-158ffe37a82d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:17:23.812405 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6806d3f5-b07b-47be-a077-158ffe37a82d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:17:23.819809 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6806d3f5-b07b-47be-a077-158ffe37a82d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:23.820381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6806d3f5-b07b-47be-a077-158ffe37a82d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:23.821059 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6806d3f5-b07b-47be-a077-158ffe37a82d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:23.821507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6806d3f5-b07b-47be-a077-158ffe37a82d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:24.026553 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6806d3f5-b07b-47be-a077-158ffe37a82d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:17:24.034302 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6806d3f5-b07b-47be-a077-158ffe37a82d tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 200 len: 1575 microversion: 2.1 time: 0.227178 Jul 19 23:17:24.035317 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3134/6277] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:17:23 2022] GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 1575 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:17:24.790826 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-248c35cc-8801-4bb3-9857-3217804af136 req-d4b45fc4-21a0-4913-aa71-1442e63e3292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "590cc12b-36f4-41ca-9cae-c88d19748331", "name": "network-vif-deleted", "tag": "114bee9e-390d-452a-84f3-d9867ca8e92c"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:17:24.812607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-248c35cc-8801-4bb3-9857-3217804af136 req-d4b45fc4-21a0-4913-aa71-1442e63e3292 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:24.813483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-248c35cc-8801-4bb3-9857-3217804af136 req-d4b45fc4-21a0-4913-aa71-1442e63e3292 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:24.828232 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-248c35cc-8801-4bb3-9857-3217804af136 req-d4b45fc4-21a0-4913-aa71-1442e63e3292 service nova] Creating event network-vif-deleted:114bee9e-390d-452a-84f3-d9867ca8e92c for instance 590cc12b-36f4-41ca-9cae-c88d19748331 on n-h2-847009-3 Jul 19 23:17:24.835221 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-248c35cc-8801-4bb3-9857-3217804af136 req-d4b45fc4-21a0-4913-aa71-1442e63e3292 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048300 Jul 19 23:17:24.837014 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3144/6278] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:17:25.056506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-51768c73-fcb2-40a3-9d95-20bce4ab16e3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:17:25.057475 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-51768c73-fcb2-40a3-9d95-20bce4ab16e3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:17:25.065748 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51768c73-fcb2-40a3-9d95-20bce4ab16e3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:25.066210 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51768c73-fcb2-40a3-9d95-20bce4ab16e3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:25.067042 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51768c73-fcb2-40a3-9d95-20bce4ab16e3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:25.067720 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51768c73-fcb2-40a3-9d95-20bce4ab16e3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:25.149187 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-51768c73-fcb2-40a3-9d95-20bce4ab16e3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:17:25.158424 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-51768c73-fcb2-40a3-9d95-20bce4ab16e3 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 200 len: 1389 microversion: 2.1 time: 0.108886 Jul 19 23:17:25.159023 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3135/6279] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:17:25 2022] GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 1389 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:17:26.176880 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6f61154b-938d-430b-be64-5c0ede3a022a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:17:26.177595 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6f61154b-938d-430b-be64-5c0ede3a022a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:17:26.184731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6f61154b-938d-430b-be64-5c0ede3a022a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:26.185196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6f61154b-938d-430b-be64-5c0ede3a022a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:26.185977 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6f61154b-938d-430b-be64-5c0ede3a022a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:26.186428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6f61154b-938d-430b-be64-5c0ede3a022a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:26.251261 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6f61154b-938d-430b-be64-5c0ede3a022a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:17:26.259721 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6f61154b-938d-430b-be64-5c0ede3a022a tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 200 len: 1389 microversion: 2.1 time: 0.087990 Jul 19 23:17:26.260294 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3145/6280] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:17:26 2022] GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:17:27.277190 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-da146dca-0c17-4eea-b212-6cfc2ac534c4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:17:27.277826 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-da146dca-0c17-4eea-b212-6cfc2ac534c4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:17:27.285079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da146dca-0c17-4eea-b212-6cfc2ac534c4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:27.285527 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da146dca-0c17-4eea-b212-6cfc2ac534c4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:27.286305 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da146dca-0c17-4eea-b212-6cfc2ac534c4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:27.286740 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-da146dca-0c17-4eea-b212-6cfc2ac534c4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:27.351395 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-da146dca-0c17-4eea-b212-6cfc2ac534c4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:17:27.359267 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-da146dca-0c17-4eea-b212-6cfc2ac534c4 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 200 len: 1389 microversion: 2.1 time: 0.086063 Jul 19 23:17:27.359923 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3136/6281] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:17:27 2022] GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:17:28.376782 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-81384f0b-e867-467b-b37b-9ed3bf8a78cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:17:28.377481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-81384f0b-e867-467b-b37b-9ed3bf8a78cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:17:28.385435 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-81384f0b-e867-467b-b37b-9ed3bf8a78cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:28.385906 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-81384f0b-e867-467b-b37b-9ed3bf8a78cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:28.386693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-81384f0b-e867-467b-b37b-9ed3bf8a78cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:28.387178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-81384f0b-e867-467b-b37b-9ed3bf8a78cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:28.457283 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-81384f0b-e867-467b-b37b-9ed3bf8a78cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deeb5431c1284d02b245ff3a9dc3f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba6762beb0fe4220b984143b3ea6bd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:17:28.466217 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-81384f0b-e867-467b-b37b-9ed3bf8a78cf tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 200 len: 1389 microversion: 2.1 time: 0.093390 Jul 19 23:17:28.466800 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3146/6282] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:17:28 2022] GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:17:29.484093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6159ab53-8887-4851-93aa-2d747106ad20 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:17:29.484715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6159ab53-8887-4851-93aa-2d747106ad20 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 590cc12b-36f4-41ca-9cae-c88d19748331] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:17:29.491923 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6159ab53-8887-4851-93aa-2d747106ad20 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:29.492389 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6159ab53-8887-4851-93aa-2d747106ad20 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:29.493165 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6159ab53-8887-4851-93aa-2d747106ad20 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:29.493611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6159ab53-8887-4851-93aa-2d747106ad20 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:29.507293 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-6159ab53-8887-4851-93aa-2d747106ad20 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] HTTP exception thrown: Instance 590cc12b-36f4-41ca-9cae-c88d19748331 could not be found. Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6159ab53-8887-4851-93aa-2d747106ad20 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Request method failure captured: Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 HTTP/1.1 Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zh6YPXnZEfL25DbrOo5AahkBCmHYOrAvKJnhgzQ9JlHxbrun4XI2EwE2n1nf4tgNFUaArqBEbFq4Toj7uUUuANo7JRuxksIEPvDD1AFl7fhy2XFxh_IYAhLXnE4PI4_QoyTOcOGpDghFYkpTUUI4xKODXHZZ1_feIKHlU2SknrcKPQ Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: deeb5431c1284d02b245ff3a9dc3f4e8 Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 590cc12b-36f4-41ca-9cae-c88d19748331 could not be found. Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '590cc12b-36f4-41ca-9cae-c88d19748331'} Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 590cc12b-36f4-41ca-9cae-c88d19748331 could not be found. Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 590cc12b-36f4-41ca-9cae-c88d19748331 could not be found. Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:17:29.508941 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:17:29.514427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:17:29.514427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:17:29.514427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:17:29.514427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:17:29.514427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:17:29.514427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 590cc12b-36f4-41ca-9cae-c88d19748331 could not be found. Jul 19 23:17:29.514427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:17:29.514427 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6159ab53-8887-4851-93aa-2d747106ad20 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Returning 404 to user: Instance 590cc12b-36f4-41ca-9cae-c88d19748331 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:17:29.514427 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6159ab53-8887-4851-93aa-2d747106ad20 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331" status: 404 len: 111 microversion: 2.1 time: 0.030166 Jul 19 23:17:29.514427 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3137/6283] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:17:29 2022] GET /compute/v2.1/servers/590cc12b-36f4-41ca-9cae-c88d19748331 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:17:29.950899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4cb6ed78-d670-4d5c-a19e-165e3acaf7d7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:17:29.951447 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4cb6ed78-d670-4d5c-a19e-165e3acaf7d7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:17:29.958350 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4cb6ed78-d670-4d5c-a19e-165e3acaf7d7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:29.959081 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4cb6ed78-d670-4d5c-a19e-165e3acaf7d7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:29.960877 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4cb6ed78-d670-4d5c-a19e-165e3acaf7d7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:29.961338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4cb6ed78-d670-4d5c-a19e-165e3acaf7d7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:29.975793 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-4cb6ed78-d670-4d5c-a19e-165e3acaf7d7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] HTTP exception thrown: Instance 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 could not be found. Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4cb6ed78-d670-4d5c-a19e-165e3acaf7d7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Request method failure captured: Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 HTTP/1.1 Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zh6YPXnZEfL25DbrOo5AahkBCmHYOrAvKJnhgzQ9JlHxbrun4XI2EwE2n1nf4tgNFUaArqBEbFq4Toj7uUUuANo7JRuxksIEPvDD1AFl7fhy2XFxh_IYAhLXnE4PI4_QoyTOcOGpDghFYkpTUUI4xKODXHZZ1_feIKHlU2SknrcKPQ Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: deeb5431c1284d02b245ff3a9dc3f4e8 Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 could not be found. Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68'} Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 could not be found. Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:17:29.977491 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:17:29.982191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 could not be found. Jul 19 23:17:29.982191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:17:29.982191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:17:29.982191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:17:29.982191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:17:29.982191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:17:29.982191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:17:29.982191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:17:29.982191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:17:29.982191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 could not be found. Jul 19 23:17:29.982191 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:17:29.982191 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4cb6ed78-d670-4d5c-a19e-165e3acaf7d7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Returning 404 to user: Instance 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:17:29.982191 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4cb6ed78-d670-4d5c-a19e-165e3acaf7d7 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "DELETE /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 404 len: 111 microversion: 2.1 time: 0.032023 Jul 19 23:17:29.982191 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3147/6284] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:17:29 2022] DELETE /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:17:29.987626 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-993ba106-e3b2-4533-8810-4957e1f8c8d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:17:29.988247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-993ba106-e3b2-4533-8810-4957e1f8c8d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] [instance: 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:17:29.995025 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-993ba106-e3b2-4533-8810-4957e1f8c8d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:29.995519 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-993ba106-e3b2-4533-8810-4957e1f8c8d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:29.996286 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-993ba106-e3b2-4533-8810-4957e1f8c8d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:29.996727 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-993ba106-e3b2-4533-8810-4957e1f8c8d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:30.010215 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-993ba106-e3b2-4533-8810-4957e1f8c8d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] HTTP exception thrown: Instance 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 could not be found. Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-993ba106-e3b2-4533-8810-4957e1f8c8d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Request method failure captured: Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 HTTP/1.1 Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zh6YPXnZEfL25DbrOo5AahkBCmHYOrAvKJnhgzQ9JlHxbrun4XI2EwE2n1nf4tgNFUaArqBEbFq4Toj7uUUuANo7JRuxksIEPvDD1AFl7fhy2XFxh_IYAhLXnE4PI4_QoyTOcOGpDghFYkpTUUI4xKODXHZZ1_feIKHlU2SknrcKPQ Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba6762beb0fe4220b984143b3ea6bd48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: ba6762beb0fe4220b984143b3ea6bd48 Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TestVolumeBootPattern-1460791253 Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: deeb5431c1284d02b245ff3a9dc3f4e8 Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TestVolumeBootPattern-1460791253-project Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 could not be found. Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68'} Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 could not be found. Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 could not be found. Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:17:30.011824 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:17:30.017193 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:17:30.017193 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:17:30.017193 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:17:30.017193 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:17:30.017193 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:17:30.017193 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 could not be found. Jul 19 23:17:30.017193 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:17:30.017193 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-993ba106-e3b2-4533-8810-4957e1f8c8d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Returning 404 to user: Instance 76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:17:30.017193 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-993ba106-e3b2-4533-8810-4957e1f8c8d8 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68" status: 404 len: 111 microversion: 2.1 time: 0.029451 Jul 19 23:17:30.017193 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3138/6285] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:17:29 2022] GET /compute/v2.1/servers/76d9741a-ee6f-47f1-8f3d-f6b8a7cf5a68 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:17:33.434565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b461a381-ed37-41df-9a51-9bd1a8429ae1 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] Calling method '.version_select at 0x7f7a033390d0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:17:33.468292 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b461a381-ed37-41df-9a51-9bd1a8429ae1 tempest-TestVolumeBootPattern-1460791253 tempest-TestVolumeBootPattern-1460791253-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-480112255" status: 202 len: 0 microversion: 2.1 time: 0.044607 Jul 19 23:17:33.469089 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3148/6286] 10.222.0.25 () {58 vars in 1259 bytes} [Tue Jul 19 23:17:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-480112255 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:17:51.647664 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:17:51.648405 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:17:51.757953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-24f869b6-3251-438f-b279-90c2171e8ecf tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1506160235", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:17:51.812210 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-24f869b6-3251-438f-b279-90c2171e8ecf tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] validate_networks() for None {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:17:52.004456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-24f869b6-3251-438f-b279-90c2171e8ecf tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:17:52.005458 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-24f869b6-3251-438f-b279-90c2171e8ecf tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:17:52.005941 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-24f869b6-3251-438f-b279-90c2171e8ecf tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:17:52.006358 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-24f869b6-3251-438f-b279-90c2171e8ecf tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:17:52.006815 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-24f869b6-3251-438f-b279-90c2171e8ecf tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:17:52.015945 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24f869b6-3251-438f-b279-90c2171e8ecf tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:52.016403 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24f869b6-3251-438f-b279-90c2171e8ecf tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:52.017215 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24f869b6-3251-438f-b279-90c2171e8ecf tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:52.017663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24f869b6-3251-438f-b279-90c2171e8ecf tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:52.035315 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-24f869b6-3251-438f-b279-90c2171e8ecf tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Getting quotas for project fabd5b6a7e504db69a4f473a27790ac8. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:17:52.040596 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-24f869b6-3251-438f-b279-90c2171e8ecf tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Getting quotas for user 821aa156db754ac39ee0245a9a2da2cf and project fabd5b6a7e504db69a4f473a27790ac8. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:17:52.053146 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-24f869b6-3251-438f-b279-90c2171e8ecf tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:17:52.055425 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-24f869b6-3251-438f-b279-90c2171e8ecf tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] [instance: fe0ec34b-7879-4b6d-8ca4-74fedd145440] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:17:52.099964 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-24f869b6-3251-438f-b279-90c2171e8ecf tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.458219 Jul 19 23:17:52.100610 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3139/6287] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:17:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:17:52.108700 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=48 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:17:52.109591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:17:52.113593 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-187ad4c0-dde6-4aed-9ce0-ad264dbca9c8 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:17:52.115460 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-187ad4c0-dde6-4aed-9ce0-ad264dbca9c8 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] [instance: fe0ec34b-7879-4b6d-8ca4-74fedd145440] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:17:52.171079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-187ad4c0-dde6-4aed-9ce0-ad264dbca9c8 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821aa156db754ac39ee0245a9a2da2cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabd5b6a7e504db69a4f473a27790ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:17:52.178328 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-187ad4c0-dde6-4aed-9ce0-ad264dbca9c8 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] 10.222.0.25 "GET /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440" status: 200 len: 1222 microversion: 2.1 time: 0.071450 Jul 19 23:17:52.178888 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3149/6288] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:17:52 2022] GET /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440 => generated 1222 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:17:53.196780 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f3572428-50e7-45f7-9bd8-48dbd237bc49 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:17:53.197400 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f3572428-50e7-45f7-9bd8-48dbd237bc49 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] [instance: fe0ec34b-7879-4b6d-8ca4-74fedd145440] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:17:53.253249 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f3572428-50e7-45f7-9bd8-48dbd237bc49 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821aa156db754ac39ee0245a9a2da2cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabd5b6a7e504db69a4f473a27790ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:17:53.260173 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f3572428-50e7-45f7-9bd8-48dbd237bc49 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] 10.222.0.25 "GET /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440" status: 200 len: 1222 microversion: 2.1 time: 0.068907 Jul 19 23:17:53.260739 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3140/6289] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:17:53 2022] GET /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440 => generated 1222 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:17:54.279309 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-028e80f8-da41-418c-a5e5-3c5a3be16d31 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:17:54.280134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-028e80f8-da41-418c-a5e5-3c5a3be16d31 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] [instance: fe0ec34b-7879-4b6d-8ca4-74fedd145440] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:17:54.289140 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-028e80f8-da41-418c-a5e5-3c5a3be16d31 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:54.289616 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-028e80f8-da41-418c-a5e5-3c5a3be16d31 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:54.290431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-028e80f8-da41-418c-a5e5-3c5a3be16d31 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:54.290894 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-028e80f8-da41-418c-a5e5-3c5a3be16d31 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:54.367727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-028e80f8-da41-418c-a5e5-3c5a3be16d31 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821aa156db754ac39ee0245a9a2da2cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabd5b6a7e504db69a4f473a27790ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:17:54.375908 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-028e80f8-da41-418c-a5e5-3c5a3be16d31 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] 10.222.0.25 "GET /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440" status: 200 len: 1280 microversion: 2.1 time: 0.101093 Jul 19 23:17:54.376707 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3150/6290] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:17:54 2022] GET /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440 => generated 1280 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:17:55.394017 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fa9a8dd5-73b1-49ce-b203-d6351f886bd0 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:17:55.394638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fa9a8dd5-73b1-49ce-b203-d6351f886bd0 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] [instance: fe0ec34b-7879-4b6d-8ca4-74fedd145440] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:17:55.403171 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa9a8dd5-73b1-49ce-b203-d6351f886bd0 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:55.403943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa9a8dd5-73b1-49ce-b203-d6351f886bd0 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:55.404922 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa9a8dd5-73b1-49ce-b203-d6351f886bd0 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:55.405359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fa9a8dd5-73b1-49ce-b203-d6351f886bd0 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:55.601059 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fa9a8dd5-73b1-49ce-b203-d6351f886bd0 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821aa156db754ac39ee0245a9a2da2cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabd5b6a7e504db69a4f473a27790ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:17:55.611618 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fa9a8dd5-73b1-49ce-b203-d6351f886bd0 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] 10.222.0.25 "GET /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440" status: 200 len: 1322 microversion: 2.1 time: 0.221267 Jul 19 23:17:55.622980 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3141/6291] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:17:55 2022] GET /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:17:56.087272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-93d23305-3309-4f61-8676-b85bea7de494 req-933227ff-9a01-4372-b4f7-fc37524e7742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe0ec34b-7879-4b6d-8ca4-74fedd145440", "tag": "91cde2bb-1d2c-4048-8b39-594e750fc6ec"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:17:56.101886 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-93d23305-3309-4f61-8676-b85bea7de494 req-933227ff-9a01-4372-b4f7-fc37524e7742 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:56.102753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-93d23305-3309-4f61-8676-b85bea7de494 req-933227ff-9a01-4372-b4f7-fc37524e7742 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:56.120823 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-93d23305-3309-4f61-8676-b85bea7de494 req-933227ff-9a01-4372-b4f7-fc37524e7742 service nova] Creating event network-changed:91cde2bb-1d2c-4048-8b39-594e750fc6ec for instance fe0ec34b-7879-4b6d-8ca4-74fedd145440 on n-h2-847009-3 Jul 19 23:17:56.126536 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-93d23305-3309-4f61-8676-b85bea7de494 req-933227ff-9a01-4372-b4f7-fc37524e7742 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045075 Jul 19 23:17:56.127852 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3151/6292] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:17:56.630513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8c451012-1cbc-4a69-b5fa-508b68b047dd tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:17:56.631191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8c451012-1cbc-4a69-b5fa-508b68b047dd tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] [instance: fe0ec34b-7879-4b6d-8ca4-74fedd145440] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:17:56.638094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8c451012-1cbc-4a69-b5fa-508b68b047dd tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:56.638543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8c451012-1cbc-4a69-b5fa-508b68b047dd tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:56.639359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8c451012-1cbc-4a69-b5fa-508b68b047dd tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:56.639799 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8c451012-1cbc-4a69-b5fa-508b68b047dd tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:56.777354 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8c451012-1cbc-4a69-b5fa-508b68b047dd tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821aa156db754ac39ee0245a9a2da2cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabd5b6a7e504db69a4f473a27790ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:17:56.781640 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8c451012-1cbc-4a69-b5fa-508b68b047dd tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] 10.222.0.25 "GET /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440" status: 200 len: 1322 microversion: 2.1 time: 0.155605 Jul 19 23:17:56.782220 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3142/6293] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:17:56 2022] GET /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:17:57.798977 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-20f182b7-d813-41dc-a6eb-46396ad88aeb tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:17:57.799740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-20f182b7-d813-41dc-a6eb-46396ad88aeb tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] [instance: fe0ec34b-7879-4b6d-8ca4-74fedd145440] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:17:57.806946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-20f182b7-d813-41dc-a6eb-46396ad88aeb tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:57.807443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-20f182b7-d813-41dc-a6eb-46396ad88aeb tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:57.808240 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-20f182b7-d813-41dc-a6eb-46396ad88aeb tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:57.808695 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-20f182b7-d813-41dc-a6eb-46396ad88aeb tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:57.944527 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-20f182b7-d813-41dc-a6eb-46396ad88aeb tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821aa156db754ac39ee0245a9a2da2cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabd5b6a7e504db69a4f473a27790ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:17:57.952066 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-20f182b7-d813-41dc-a6eb-46396ad88aeb tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] 10.222.0.25 "GET /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440" status: 200 len: 1322 microversion: 2.1 time: 0.157427 Jul 19 23:17:57.952635 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3152/6294] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:17:57 2022] GET /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:17:58.969771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-61300d41-7059-4d1e-bd05-9513c443f5ce tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:17:58.970437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-61300d41-7059-4d1e-bd05-9513c443f5ce tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] [instance: fe0ec34b-7879-4b6d-8ca4-74fedd145440] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:17:58.977435 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-61300d41-7059-4d1e-bd05-9513c443f5ce tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:58.977882 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-61300d41-7059-4d1e-bd05-9513c443f5ce tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:58.978645 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-61300d41-7059-4d1e-bd05-9513c443f5ce tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:17:58.979078 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-61300d41-7059-4d1e-bd05-9513c443f5ce tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:17:59.118405 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-61300d41-7059-4d1e-bd05-9513c443f5ce tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821aa156db754ac39ee0245a9a2da2cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabd5b6a7e504db69a4f473a27790ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:17:59.126219 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-61300d41-7059-4d1e-bd05-9513c443f5ce tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] 10.222.0.25 "GET /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440" status: 200 len: 1322 microversion: 2.1 time: 0.160301 Jul 19 23:17:59.126806 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3143/6295] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:17:58 2022] GET /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:00.143848 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a3302128-db2f-48f5-b18d-bb43f9b8cb92 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:00.144488 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a3302128-db2f-48f5-b18d-bb43f9b8cb92 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] [instance: fe0ec34b-7879-4b6d-8ca4-74fedd145440] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:00.152173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a3302128-db2f-48f5-b18d-bb43f9b8cb92 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:00.152644 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a3302128-db2f-48f5-b18d-bb43f9b8cb92 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:00.153430 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a3302128-db2f-48f5-b18d-bb43f9b8cb92 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:00.153900 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a3302128-db2f-48f5-b18d-bb43f9b8cb92 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:00.284577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a3302128-db2f-48f5-b18d-bb43f9b8cb92 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821aa156db754ac39ee0245a9a2da2cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabd5b6a7e504db69a4f473a27790ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:00.292617 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a3302128-db2f-48f5-b18d-bb43f9b8cb92 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] 10.222.0.25 "GET /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440" status: 200 len: 1322 microversion: 2.1 time: 0.152734 Jul 19 23:18:00.293188 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3153/6296] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:00 2022] GET /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:01.310548 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1f4582a2-c0ec-4c86-92c7-6914e0c9e88d tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:01.311238 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1f4582a2-c0ec-4c86-92c7-6914e0c9e88d tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] [instance: fe0ec34b-7879-4b6d-8ca4-74fedd145440] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:01.318483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1f4582a2-c0ec-4c86-92c7-6914e0c9e88d tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:01.318955 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1f4582a2-c0ec-4c86-92c7-6914e0c9e88d tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:01.319979 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1f4582a2-c0ec-4c86-92c7-6914e0c9e88d tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:01.320708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1f4582a2-c0ec-4c86-92c7-6914e0c9e88d tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:01.337902 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-28205968-cdd1-418a-9f15-37c6a875b3da req-f6b22f63-b471-43de-b003-75499770b9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe0ec34b-7879-4b6d-8ca4-74fedd145440", "name": "network-vif-plugged", "status": "completed", "tag": "91cde2bb-1d2c-4048-8b39-594e750fc6ec"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:18:01.346325 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-28205968-cdd1-418a-9f15-37c6a875b3da req-f6b22f63-b471-43de-b003-75499770b9e5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:01.346767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-28205968-cdd1-418a-9f15-37c6a875b3da req-f6b22f63-b471-43de-b003-75499770b9e5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:01.359032 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-28205968-cdd1-418a-9f15-37c6a875b3da req-f6b22f63-b471-43de-b003-75499770b9e5 service nova] Creating event network-vif-plugged:91cde2bb-1d2c-4048-8b39-594e750fc6ec for instance fe0ec34b-7879-4b6d-8ca4-74fedd145440 on n-h2-847009-3 Jul 19 23:18:01.364088 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-28205968-cdd1-418a-9f15-37c6a875b3da req-f6b22f63-b471-43de-b003-75499770b9e5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097809 Jul 19 23:18:01.364823 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3144/6297] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:18:01.501515 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1f4582a2-c0ec-4c86-92c7-6914e0c9e88d tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821aa156db754ac39ee0245a9a2da2cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabd5b6a7e504db69a4f473a27790ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:01.510032 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1f4582a2-c0ec-4c86-92c7-6914e0c9e88d tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] 10.222.0.25 "GET /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440" status: 200 len: 1322 microversion: 2.1 time: 0.203956 Jul 19 23:18:01.510739 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3154/6298] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:01 2022] GET /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:02.524542 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:18:02.529582 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-60778d78-56ba-47dd-bda2-fb50fb68117b tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:02.530334 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-60778d78-56ba-47dd-bda2-fb50fb68117b tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] [instance: fe0ec34b-7879-4b6d-8ca4-74fedd145440] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:02.538367 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-60778d78-56ba-47dd-bda2-fb50fb68117b tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:02.538831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-60778d78-56ba-47dd-bda2-fb50fb68117b tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:02.539649 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-60778d78-56ba-47dd-bda2-fb50fb68117b tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:02.540108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-60778d78-56ba-47dd-bda2-fb50fb68117b tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:02.679524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-60778d78-56ba-47dd-bda2-fb50fb68117b tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821aa156db754ac39ee0245a9a2da2cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabd5b6a7e504db69a4f473a27790ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:02.687164 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-60778d78-56ba-47dd-bda2-fb50fb68117b tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] 10.222.0.25 "GET /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440" status: 200 len: 1471 microversion: 2.1 time: 0.163608 Jul 19 23:18:02.687746 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3145/6299] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:02 2022] GET /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440 => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:02.706247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:18:02.763814 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-68b35b76-9ec0-440b-9c89-3dbc1cb6a3f8 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Calling method '.version_select at 0x7f7a030c7dc0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:02.835067 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-68b35b76-9ec0-440b-9c89-3dbc1cb6a3f8 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/e4a86dab45f542829f7c06613bf4fd1f" status: 200 len: 371 microversion: 2.1 time: 0.133413 Jul 19 23:18:02.835686 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3155/6300] 10.222.0.25 () {58 vars in 1241 bytes} [Tue Jul 19 23:18:02 2022] GET /compute/v2.1/os-quota-sets/e4a86dab45f542829f7c06613bf4fd1f => generated 371 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:18:02.846974 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0d11c49c-f861-4071-9809-ad2de938e504 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1921727807", "id": 965920932, "os-flavor-access:is_public": "True"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:18:02.849399 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 23:18:02.849399 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 23:18:02.864527 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0d11c49c-f861-4071-9809-ad2de938e504 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.021181 Jul 19 23:18:02.865116 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3146/6301] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:18:02 2022] POST /compute/v2.1/flavors => generated 435 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:18:02.875700 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0dc0025b-4289-47ed-808f-6ad0662e1038 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "965920932"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:18:02.876676 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0dc0025b-4289-47ed-808f-6ad0662e1038 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] [instance: fe0ec34b-7879-4b6d-8ca4-74fedd145440] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:02.883165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0dc0025b-4289-47ed-808f-6ad0662e1038 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:02.883632 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0dc0025b-4289-47ed-808f-6ad0662e1038 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:02.884408 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0dc0025b-4289-47ed-808f-6ad0662e1038 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:02.884858 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0dc0025b-4289-47ed-808f-6ad0662e1038 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:03.070725 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0dc0025b-4289-47ed-808f-6ad0662e1038 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4f78b41b6841463dbfd6b693606c1bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4a86dab45f542829f7c06613bf4fd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:03.077343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0dc0025b-4289-47ed-808f-6ad0662e1038 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] [instance: fe0ec34b-7879-4b6d-8ca4-74fedd145440] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1921727807 {{(pid=119337) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 23:18:03.086791 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0dc0025b-4289-47ed-808f-6ad0662e1038 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:03.087296 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0dc0025b-4289-47ed-808f-6ad0662e1038 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:03.088108 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0dc0025b-4289-47ed-808f-6ad0662e1038 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:03.088559 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0dc0025b-4289-47ed-808f-6ad0662e1038 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:03.108917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-0dc0025b-4289-47ed-808f-6ad0662e1038 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Getting quotas for project fabd5b6a7e504db69a4f473a27790ac8. Resources: {'cores', 'ram'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:18:03.114021 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-0dc0025b-4289-47ed-808f-6ad0662e1038 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Getting quotas for user 821aa156db754ac39ee0245a9a2da2cf and project fabd5b6a7e504db69a4f473a27790ac8. Resources: {'cores', 'ram'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:18:03.125832 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.compute.api [None req-0dc0025b-4289-47ed-808f-6ad0662e1038 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] ram quota exceeded for e4a86dab45f542829f7c06613bf4fd1f, tried to resize instance. Jul 19 23:18:03.126384 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-0dc0025b-4289-47ed-808f-6ad0662e1038 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0dc0025b-4289-47ed-808f-6ad0662e1038 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Request method failure captured: Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440/action HTTP/1.1 Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 38 Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zuf-MaFi2oO6aq0TJodrG-6Zg6uqf0wOn7AqanCUgrPOtHyfPT1eskCjwD8B2KQcPJlHjrnURSCyjEyJ3CNDglcUgOiPUexEUNm2euANl7vkq0Cawa5dvARVz9hMMdyfLVv1HO7nD3yHhoyrmQVIsTwPzkDGA36pAbmIBQsEHSossE Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: e4a86dab45f542829f7c06613bf4fd1f Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-771657497 Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: X-Role: admin,member,reader Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: admin,member,reader Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4a86dab45f542829f7c06613bf4fd1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4a86dab45f542829f7c06613bf4fd1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4a86dab45f542829f7c06613bf4fd1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4a86dab45f542829f7c06613bf4fd1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersAdminNegativeTestJSON-771657497 Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: e4a86dab45f542829f7c06613bf4fd1f Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-771657497 Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersAdminNegativeTestJSON-771657497-project-admin Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 4f78b41b6841463dbfd6b693606c1bbf Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersAdminNegativeTestJSON-771657497-project-admin Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: {"resize": {"flavorRef": "965920932"}} Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'fe0ec34b-7879-4b6d-8ca4-74fedd145440', 'body': {'resize': {'flavorRef': '965920932'}}} Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 23:18:03.134185 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0dc0025b-4289-47ed-808f-6ad0662e1038 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0dc0025b-4289-47ed-808f-6ad0662e1038 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440/action" status: 403 len: 118 microversion: 2.1 time: 0.263831 Jul 19 23:18:03.140045 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3156/6302] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:18:02 2022] POST /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440/action => generated 118 bytes in 265 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:18:03.144919 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4e74350a-690f-43ff-beed-d2b86b35508a tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:03.145678 n-d-847009-3 devstack@n-api.service[119338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 23:18:03.145678 n-d-847009-3 devstack@n-api.service[119338]: warnings.warn(msg) Jul 19 23:18:03.163179 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4e74350a-690f-43ff-beed-d2b86b35508a tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/965920932" status: 202 len: 0 microversion: 2.1 time: 0.022160 Jul 19 23:18:03.163706 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3147/6303] 10.222.0.25 () {58 vars in 1157 bytes} [Tue Jul 19 23:18:03 2022] DELETE /compute/v2.1/flavors/965920932 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:18:03.171908 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cfd12afb-9f2f-43a6-a434-167c9e4c293a tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:03.190984 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cfd12afb-9f2f-43a6-a434-167c9e4c293a tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022955 Jul 19 23:18:03.192270 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3157/6304] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 23:18:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:03.209780 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1c9c2469-3c63-42b2-866c-dc6f51e383e2 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Calling method '.version_select at 0x7f7a031b1af0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:03.257398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=8 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:18:03.281884 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1c9c2469-3c63-42b2-866c-dc6f51e383e2 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/e4a86dab45f542829f7c06613bf4fd1f" status: 200 len: 371 microversion: 2.1 time: 0.076630 Jul 19 23:18:03.282402 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3148/6305] 10.222.0.25 () {58 vars in 1241 bytes} [Tue Jul 19 23:18:03 2022] GET /compute/v2.1/os-quota-sets/e4a86dab45f542829f7c06613bf4fd1f => generated 371 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:18:03.292506 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d2c2f0a4-e609-4c3d-a2d2-6bb33259fd7f tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-111792177", "id": 1838199898, "os-flavor-access:is_public": "True"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:18:03.294101 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 23:18:03.294101 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 23:18:03.309732 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d2c2f0a4-e609-4c3d-a2d2-6bb33259fd7f tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.020908 Jul 19 23:18:03.310318 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3158/6306] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:18:03 2022] POST /compute/v2.1/flavors => generated 436 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:18:03.321752 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ef30dfab-e9df-4d94-af89-f0be636676ed tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1838199898"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:18:03.322931 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ef30dfab-e9df-4d94-af89-f0be636676ed tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] [instance: fe0ec34b-7879-4b6d-8ca4-74fedd145440] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:03.329310 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ef30dfab-e9df-4d94-af89-f0be636676ed tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:03.329759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ef30dfab-e9df-4d94-af89-f0be636676ed tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:03.330526 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ef30dfab-e9df-4d94-af89-f0be636676ed tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:03.330962 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ef30dfab-e9df-4d94-af89-f0be636676ed tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:03.471781 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ef30dfab-e9df-4d94-af89-f0be636676ed tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4f78b41b6841463dbfd6b693606c1bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4a86dab45f542829f7c06613bf4fd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:03.480248 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ef30dfab-e9df-4d94-af89-f0be636676ed tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] [instance: fe0ec34b-7879-4b6d-8ca4-74fedd145440] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-111792177 {{(pid=119338) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 23:18:03.487338 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ef30dfab-e9df-4d94-af89-f0be636676ed tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:03.487796 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ef30dfab-e9df-4d94-af89-f0be636676ed tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:03.489455 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ef30dfab-e9df-4d94-af89-f0be636676ed tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:03.489624 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ef30dfab-e9df-4d94-af89-f0be636676ed tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:03.513841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-ef30dfab-e9df-4d94-af89-f0be636676ed tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Getting quotas for project fabd5b6a7e504db69a4f473a27790ac8. Resources: {'cores', 'ram'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:18:03.520961 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-ef30dfab-e9df-4d94-af89-f0be636676ed tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Getting quotas for user 821aa156db754ac39ee0245a9a2da2cf and project fabd5b6a7e504db69a4f473a27790ac8. Resources: {'cores', 'ram'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:18:03.540908 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.compute.api [None req-ef30dfab-e9df-4d94-af89-f0be636676ed tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] cores quota exceeded for e4a86dab45f542829f7c06613bf4fd1f, tried to resize instance. Jul 19 23:18:03.541597 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-ef30dfab-e9df-4d94-af89-f0be636676ed tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ef30dfab-e9df-4d94-af89-f0be636676ed tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Request method failure captured: Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440/action HTTP/1.1 Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 39 Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zuf-MaFi2oO6aq0TJodrG-6Zg6uqf0wOn7AqanCUgrPOtHyfPT1eskCjwD8B2KQcPJlHjrnURSCyjEyJ3CNDglcUgOiPUexEUNm2euANl7vkq0Cawa5dvARVz9hMMdyfLVv1HO7nD3yHhoyrmQVIsTwPzkDGA36pAbmIBQsEHSossE Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: e4a86dab45f542829f7c06613bf4fd1f Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-771657497 Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: X-Role: admin,member,reader Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: admin,member,reader Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4a86dab45f542829f7c06613bf4fd1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4a86dab45f542829f7c06613bf4fd1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4a86dab45f542829f7c06613bf4fd1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4a86dab45f542829f7c06613bf4fd1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersAdminNegativeTestJSON-771657497 Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: e4a86dab45f542829f7c06613bf4fd1f Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-771657497 Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersAdminNegativeTestJSON-771657497-project-admin Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 4f78b41b6841463dbfd6b693606c1bbf Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersAdminNegativeTestJSON-771657497-project-admin Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: {"resize": {"flavorRef": "1838199898"}} Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'fe0ec34b-7879-4b6d-8ca4-74fedd145440', 'body': {'resize': {'flavorRef': '1838199898'}}} Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 23:18:03.543514 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ef30dfab-e9df-4d94-af89-f0be636676ed tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:18:03.548779 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ef30dfab-e9df-4d94-af89-f0be636676ed tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440/action" status: 403 len: 113 microversion: 2.1 time: 0.227218 Jul 19 23:18:03.553773 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3149/6307] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:18:03 2022] POST /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440/action => generated 113 bytes in 234 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:18:03.556364 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2a878f16-ffe5-4d70-b680-832cf057e4d2 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:03.557144 n-d-847009-3 devstack@n-api.service[119337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 23:18:03.557144 n-d-847009-3 devstack@n-api.service[119337]: warnings.warn(msg) Jul 19 23:18:03.576049 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2a878f16-ffe5-4d70-b680-832cf057e4d2 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1838199898" status: 202 len: 0 microversion: 2.1 time: 0.023411 Jul 19 23:18:03.576627 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3159/6308] 10.222.0.25 () {58 vars in 1160 bytes} [Tue Jul 19 23:18:03 2022] DELETE /compute/v2.1/flavors/1838199898 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:18:03.587614 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2ea5e36e-262b-4df4-ac73-48cf0a7c2b72 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:03.608670 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2ea5e36e-262b-4df4-ac73-48cf0a7c2b72 tempest-ServersAdminNegativeTestJSON-771657497 tempest-ServersAdminNegativeTestJSON-771657497-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026716 Jul 19 23:18:03.609268 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3150/6309] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Jul 19 23:18:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:03.626973 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3ab6885c-d3c1-4e94-88a4-438cddf88ab0 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:03.627519 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3ab6885c-d3c1-4e94-88a4-438cddf88ab0 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] [instance: fe0ec34b-7879-4b6d-8ca4-74fedd145440] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:03.635743 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ab6885c-d3c1-4e94-88a4-438cddf88ab0 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:03.636280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ab6885c-d3c1-4e94-88a4-438cddf88ab0 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:03.637180 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ab6885c-d3c1-4e94-88a4-438cddf88ab0 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:03.637724 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ab6885c-d3c1-4e94-88a4-438cddf88ab0 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:03.668262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3ab6885c-d3c1-4e94-88a4-438cddf88ab0 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] [instance: fe0ec34b-7879-4b6d-8ca4-74fedd145440] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:18:03.749936 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3ab6885c-d3c1-4e94-88a4-438cddf88ab0 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440" status: 204 len: 0 microversion: 2.1 time: 0.127149 Jul 19 23:18:03.750691 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3160/6310] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:18:03 2022] DELETE /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:18:03.764493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-49a76522-74dd-4361-8c35-5d7a0fc07132 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:03.764493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-49a76522-74dd-4361-8c35-5d7a0fc07132 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] [instance: fe0ec34b-7879-4b6d-8ca4-74fedd145440] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:03.767873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49a76522-74dd-4361-8c35-5d7a0fc07132 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:03.767873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49a76522-74dd-4361-8c35-5d7a0fc07132 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:03.768432 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49a76522-74dd-4361-8c35-5d7a0fc07132 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:03.768897 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49a76522-74dd-4361-8c35-5d7a0fc07132 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:03.942649 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-49a76522-74dd-4361-8c35-5d7a0fc07132 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821aa156db754ac39ee0245a9a2da2cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabd5b6a7e504db69a4f473a27790ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:03.952390 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-49a76522-74dd-4361-8c35-5d7a0fc07132 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] 10.222.0.25 "GET /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440" status: 200 len: 1477 microversion: 2.1 time: 0.196136 Jul 19 23:18:03.953278 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3151/6311] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:03 2022] GET /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440 => generated 1477 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:04.972284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-54f3cdc2-aba6-4228-a4d8-8b2a0a8817b0 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:04.973671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-54f3cdc2-aba6-4228-a4d8-8b2a0a8817b0 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] [instance: fe0ec34b-7879-4b6d-8ca4-74fedd145440] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:04.981541 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-54f3cdc2-aba6-4228-a4d8-8b2a0a8817b0 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:04.982034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-54f3cdc2-aba6-4228-a4d8-8b2a0a8817b0 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:04.982828 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-54f3cdc2-aba6-4228-a4d8-8b2a0a8817b0 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:04.983318 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-54f3cdc2-aba6-4228-a4d8-8b2a0a8817b0 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:05.127264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-54f3cdc2-aba6-4228-a4d8-8b2a0a8817b0 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821aa156db754ac39ee0245a9a2da2cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabd5b6a7e504db69a4f473a27790ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:05.137217 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-54f3cdc2-aba6-4228-a4d8-8b2a0a8817b0 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] 10.222.0.25 "GET /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440" status: 200 len: 1477 microversion: 2.1 time: 0.169293 Jul 19 23:18:05.137796 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3161/6312] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:04 2022] GET /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440 => generated 1477 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:05.638186 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-886a2802-2b2e-4d35-80c4-eb67bf8595d3 req-177293db-3e0a-4a90-aac2-7d69b8d3a8d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe0ec34b-7879-4b6d-8ca4-74fedd145440", "name": "network-vif-deleted", "tag": "91cde2bb-1d2c-4048-8b39-594e750fc6ec"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:18:05.648759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-886a2802-2b2e-4d35-80c4-eb67bf8595d3 req-177293db-3e0a-4a90-aac2-7d69b8d3a8d4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:05.649209 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-886a2802-2b2e-4d35-80c4-eb67bf8595d3 req-177293db-3e0a-4a90-aac2-7d69b8d3a8d4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:05.666720 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-886a2802-2b2e-4d35-80c4-eb67bf8595d3 req-177293db-3e0a-4a90-aac2-7d69b8d3a8d4 service nova] Creating event network-vif-deleted:91cde2bb-1d2c-4048-8b39-594e750fc6ec for instance fe0ec34b-7879-4b6d-8ca4-74fedd145440 on n-h2-847009-3 Jul 19 23:18:05.671836 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-886a2802-2b2e-4d35-80c4-eb67bf8595d3 req-177293db-3e0a-4a90-aac2-7d69b8d3a8d4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037326 Jul 19 23:18:05.672434 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3152/6313] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:18:06.156955 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7dce80d3-25b7-4167-a68b-41894d5ddca3 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:06.157573 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7dce80d3-25b7-4167-a68b-41894d5ddca3 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] [instance: fe0ec34b-7879-4b6d-8ca4-74fedd145440] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:06.165893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7dce80d3-25b7-4167-a68b-41894d5ddca3 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:06.166362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7dce80d3-25b7-4167-a68b-41894d5ddca3 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:06.167186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7dce80d3-25b7-4167-a68b-41894d5ddca3 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:06.167674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7dce80d3-25b7-4167-a68b-41894d5ddca3 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:06.183047 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-7dce80d3-25b7-4167-a68b-41894d5ddca3 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] HTTP exception thrown: Instance fe0ec34b-7879-4b6d-8ca4-74fedd145440 could not be found. Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7dce80d3-25b7-4167-a68b-41894d5ddca3 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Request method failure captured: Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440 HTTP/1.1 Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zue9GHdWIyidurRNFS52jnwDu32D5Ih0iCYEZ4tDcjKJ-GR2YKicNztGMfXjZOMbvrXDbFhUl_3AJVZIxkuKSANiF_9qxzNHhgh_9s_Yxfvwy8ax0iDW47ASnWLYIwlbyHoT7hJb0obT83ZvPNUII_1cwJu0_e84LKu_cHK7-LmKSc Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: fabd5b6a7e504db69a4f473a27790ac8 Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1287974679 Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fabd5b6a7e504db69a4f473a27790ac8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fabd5b6a7e504db69a4f473a27790ac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fabd5b6a7e504db69a4f473a27790ac8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fabd5b6a7e504db69a4f473a27790ac8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1287974679 Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: fabd5b6a7e504db69a4f473a27790ac8 Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1287974679 Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersAdminNegativeTestJSON-1287974679-project Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 821aa156db754ac39ee0245a9a2da2cf Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1287974679-project Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance fe0ec34b-7879-4b6d-8ca4-74fedd145440 could not be found. Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'fe0ec34b-7879-4b6d-8ca4-74fedd145440'} Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe0ec34b-7879-4b6d-8ca4-74fedd145440 could not be found. Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe0ec34b-7879-4b6d-8ca4-74fedd145440 could not be found. Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:18:06.184781 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:18:06.193236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:18:06.193236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:18:06.193236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:18:06.193236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:18:06.193236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:18:06.193236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:18:06.193236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe0ec34b-7879-4b6d-8ca4-74fedd145440 could not be found. Jul 19 23:18:06.193236 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:18:06.193236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7dce80d3-25b7-4167-a68b-41894d5ddca3 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] Returning 404 to user: Instance fe0ec34b-7879-4b6d-8ca4-74fedd145440 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:18:06.193236 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7dce80d3-25b7-4167-a68b-41894d5ddca3 tempest-ServersAdminNegativeTestJSON-1287974679 tempest-ServersAdminNegativeTestJSON-1287974679-project] 10.222.0.25 "GET /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440" status: 404 len: 111 microversion: 2.1 time: 0.033309 Jul 19 23:18:06.193236 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3162/6314] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:06 2022] GET /compute/v2.1/servers/fe0ec34b-7879-4b6d-8ca4-74fedd145440 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:18:12.408465 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4f5c2f83-724b-4457-be9a-f9a256ed37e1 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-449483927", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "89bec26e-da44-4624-a861-a422e7f6df43"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:18:12.464097 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-4f5c2f83-724b-4457-be9a-f9a256ed37e1 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] validate_networks() for [('89bec26e-da44-4624-a861-a422e7f6df43', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:18:13.276406 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-4f5c2f83-724b-4457-be9a-f9a256ed37e1 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:18:13.277045 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-4f5c2f83-724b-4457-be9a-f9a256ed37e1 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:18:13.277563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-4f5c2f83-724b-4457-be9a-f9a256ed37e1 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:18:13.277985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-4f5c2f83-724b-4457-be9a-f9a256ed37e1 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:18:13.278413 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-4f5c2f83-724b-4457-be9a-f9a256ed37e1 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:18:13.280948 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:18:13.292732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f5c2f83-724b-4457-be9a-f9a256ed37e1 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:13.293578 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f5c2f83-724b-4457-be9a-f9a256ed37e1 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:13.294628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f5c2f83-724b-4457-be9a-f9a256ed37e1 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:13.295329 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f5c2f83-724b-4457-be9a-f9a256ed37e1 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:13.314403 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-4f5c2f83-724b-4457-be9a-f9a256ed37e1 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Getting quotas for project f1daa1114cce427eb61d3c837ea8c1f4. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:18:13.322603 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-4f5c2f83-724b-4457-be9a-f9a256ed37e1 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Getting quotas for user 42f8eedddb624080b26e2f4754beaa7c and project f1daa1114cce427eb61d3c837ea8c1f4. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:18:13.336353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4f5c2f83-724b-4457-be9a-f9a256ed37e1 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:18:13.338820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4f5c2f83-724b-4457-be9a-f9a256ed37e1 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:18:13.387544 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4f5c2f83-724b-4457-be9a-f9a256ed37e1 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.106347 Jul 19 23:18:13.389729 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3153/6315] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:18:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:18:13.399882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-37ff0898-fc51-416f-9ff4-e6dcbbe12bab tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:13.400644 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-37ff0898-fc51-416f-9ff4-e6dcbbe12bab tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:13.403571 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:18:13.404494 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:18:13.461596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-37ff0898-fc51-416f-9ff4-e6dcbbe12bab tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:13.468488 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-37ff0898-fc51-416f-9ff4-e6dcbbe12bab tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1214 microversion: 2.1 time: 0.072954 Jul 19 23:18:13.469051 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3163/6316] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:13 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:14.490512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2fa75b93-7472-47ed-ba54-9de44c23bab7 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:14.492037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2fa75b93-7472-47ed-ba54-9de44c23bab7 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:14.558571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2fa75b93-7472-47ed-ba54-9de44c23bab7 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:14.565734 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2fa75b93-7472-47ed-ba54-9de44c23bab7 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1214 microversion: 2.1 time: 0.082513 Jul 19 23:18:14.567744 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3154/6317] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:14 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:15.584958 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c64c6913-2557-4c47-84bf-4bf5fc15855e tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:15.585595 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c64c6913-2557-4c47-84bf-4bf5fc15855e tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:15.654134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c64c6913-2557-4c47-84bf-4bf5fc15855e tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:15.663726 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c64c6913-2557-4c47-84bf-4bf5fc15855e tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1214 microversion: 2.1 time: 0.083351 Jul 19 23:18:15.665018 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3164/6318] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:15 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:16.334163 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:18:16.334383 n-d-847009-3 devstack@n-api.service[119337]: Tue Jul 19 23:18:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:18:16.681969 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ff5af88d-ac23-457e-90ec-887def1d51d2 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:16.682597 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ff5af88d-ac23-457e-90ec-887def1d51d2 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:16.742592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ff5af88d-ac23-457e-90ec-887def1d51d2 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:16.749287 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ff5af88d-ac23-457e-90ec-887def1d51d2 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1214 microversion: 2.1 time: 0.071466 Jul 19 23:18:16.749852 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3155/6319] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:16 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:18:17.766009 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d68573bd-8bec-4d79-b88f-a10e0d0e91be tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:17.766645 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d68573bd-8bec-4d79-b88f-a10e0d0e91be tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:17.768565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:18:17.775079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d68573bd-8bec-4d79-b88f-a10e0d0e91be tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:17.775596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d68573bd-8bec-4d79-b88f-a10e0d0e91be tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:17.776388 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d68573bd-8bec-4d79-b88f-a10e0d0e91be tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:17.776839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d68573bd-8bec-4d79-b88f-a10e0d0e91be tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:17.839540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d68573bd-8bec-4d79-b88f-a10e0d0e91be tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:17.846845 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d68573bd-8bec-4d79-b88f-a10e0d0e91be tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1218 microversion: 2.1 time: 0.084806 Jul 19 23:18:17.847439 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3165/6320] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:17 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:18.863005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9011317f-846d-49fd-a4c8-c4c3d8849959 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:18.863918 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9011317f-846d-49fd-a4c8-c4c3d8849959 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:18.871754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9011317f-846d-49fd-a4c8-c4c3d8849959 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:18.872207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9011317f-846d-49fd-a4c8-c4c3d8849959 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:18.872974 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9011317f-846d-49fd-a4c8-c4c3d8849959 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:18.873413 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9011317f-846d-49fd-a4c8-c4c3d8849959 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:18.959690 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9011317f-846d-49fd-a4c8-c4c3d8849959 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:18.967490 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9011317f-846d-49fd-a4c8-c4c3d8849959 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1272 microversion: 2.1 time: 0.108604 Jul 19 23:18:18.968158 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3156/6321] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:18 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1272 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:19.809854 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-f8ea55c1-1f44-4918-979b-2a388b52f076 req-2d6cdc3b-e3af-4bb3-8d63-291299478763 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e55f43d-738f-4dd6-8d22-4e5febac41b1", "tag": "a1ea258c-124a-4ea9-ab08-499ca1942ffc"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:18:19.827027 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-f8ea55c1-1f44-4918-979b-2a388b52f076 req-2d6cdc3b-e3af-4bb3-8d63-291299478763 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:19.828351 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-f8ea55c1-1f44-4918-979b-2a388b52f076 req-2d6cdc3b-e3af-4bb3-8d63-291299478763 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:19.845222 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-f8ea55c1-1f44-4918-979b-2a388b52f076 req-2d6cdc3b-e3af-4bb3-8d63-291299478763 service nova] Creating event network-changed:a1ea258c-124a-4ea9-ab08-499ca1942ffc for instance 2e55f43d-738f-4dd6-8d22-4e5febac41b1 on n-h2-847009-3 Jul 19 23:18:19.851882 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-f8ea55c1-1f44-4918-979b-2a388b52f076 req-2d6cdc3b-e3af-4bb3-8d63-291299478763 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046348 Jul 19 23:18:19.852912 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3166/6322] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:18:19.984960 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-71315e89-82ac-47d4-a6d8-a646a665d78f tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:19.985593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-71315e89-82ac-47d4-a6d8-a646a665d78f tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:19.993964 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71315e89-82ac-47d4-a6d8-a646a665d78f tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:19.994633 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71315e89-82ac-47d4-a6d8-a646a665d78f tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:19.995548 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71315e89-82ac-47d4-a6d8-a646a665d78f tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:19.995946 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71315e89-82ac-47d4-a6d8-a646a665d78f tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:20.208903 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-71315e89-82ac-47d4-a6d8-a646a665d78f tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:20.216687 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-71315e89-82ac-47d4-a6d8-a646a665d78f tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1314 microversion: 2.1 time: 0.235544 Jul 19 23:18:20.217033 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3157/6323] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:19 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:21.234209 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5b124482-9fe7-48ad-a7d3-c75ffc880fd9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:21.234973 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5b124482-9fe7-48ad-a7d3-c75ffc880fd9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:21.243620 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b124482-9fe7-48ad-a7d3-c75ffc880fd9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:21.244103 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b124482-9fe7-48ad-a7d3-c75ffc880fd9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:21.244888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b124482-9fe7-48ad-a7d3-c75ffc880fd9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:21.245432 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b124482-9fe7-48ad-a7d3-c75ffc880fd9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:21.473673 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5b124482-9fe7-48ad-a7d3-c75ffc880fd9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:21.481194 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5b124482-9fe7-48ad-a7d3-c75ffc880fd9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1314 microversion: 2.1 time: 0.251246 Jul 19 23:18:21.481782 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3167/6324] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:21 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:22.497826 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fb24ce4f-2a5a-47cc-a546-45deb9f04ab9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:22.498447 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fb24ce4f-2a5a-47cc-a546-45deb9f04ab9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:22.500716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:18:22.506735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fb24ce4f-2a5a-47cc-a546-45deb9f04ab9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:22.507217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fb24ce4f-2a5a-47cc-a546-45deb9f04ab9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:22.507990 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fb24ce4f-2a5a-47cc-a546-45deb9f04ab9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:22.508431 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fb24ce4f-2a5a-47cc-a546-45deb9f04ab9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:22.512906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=64 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:18:22.638644 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fb24ce4f-2a5a-47cc-a546-45deb9f04ab9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:22.647233 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fb24ce4f-2a5a-47cc-a546-45deb9f04ab9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1314 microversion: 2.1 time: 0.153277 Jul 19 23:18:22.647795 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3158/6325] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:22 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:23.664900 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4867caa5-482b-409d-8829-f0f085d2477c tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:23.665615 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4867caa5-482b-409d-8829-f0f085d2477c tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:23.668558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:18:23.674664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4867caa5-482b-409d-8829-f0f085d2477c tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:23.676493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4867caa5-482b-409d-8829-f0f085d2477c tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:23.677349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4867caa5-482b-409d-8829-f0f085d2477c tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:23.677812 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4867caa5-482b-409d-8829-f0f085d2477c tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:23.829287 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4867caa5-482b-409d-8829-f0f085d2477c tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:23.839075 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4867caa5-482b-409d-8829-f0f085d2477c tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1314 microversion: 2.1 time: 0.178032 Jul 19 23:18:23.839690 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3168/6326] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:23 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:24.857147 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-452df947-2fba-4fde-ad8c-6d889feab130 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:24.857761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-452df947-2fba-4fde-ad8c-6d889feab130 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:24.859685 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=5 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:18:24.866098 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-452df947-2fba-4fde-ad8c-6d889feab130 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:24.866547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-452df947-2fba-4fde-ad8c-6d889feab130 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:24.867349 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-452df947-2fba-4fde-ad8c-6d889feab130 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:24.867787 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-452df947-2fba-4fde-ad8c-6d889feab130 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:24.997318 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-452df947-2fba-4fde-ad8c-6d889feab130 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:25.005632 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-452df947-2fba-4fde-ad8c-6d889feab130 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1314 microversion: 2.1 time: 0.152288 Jul 19 23:18:25.006204 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3159/6327] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:24 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:25.348701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-5d41331e-dbfe-431d-90e2-67aa0daf0be5 req-21c16475-49b7-48fe-a52c-66d28584de05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e55f43d-738f-4dd6-8d22-4e5febac41b1", "name": "network-vif-plugged", "status": "completed", "tag": "a1ea258c-124a-4ea9-ab08-499ca1942ffc"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:18:25.360215 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-5d41331e-dbfe-431d-90e2-67aa0daf0be5 req-21c16475-49b7-48fe-a52c-66d28584de05 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:25.361024 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-5d41331e-dbfe-431d-90e2-67aa0daf0be5 req-21c16475-49b7-48fe-a52c-66d28584de05 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:25.376017 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-5d41331e-dbfe-431d-90e2-67aa0daf0be5 req-21c16475-49b7-48fe-a52c-66d28584de05 service nova] Creating event network-vif-plugged:a1ea258c-124a-4ea9-ab08-499ca1942ffc for instance 2e55f43d-738f-4dd6-8d22-4e5febac41b1 on n-h2-847009-3 Jul 19 23:18:25.383791 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-5d41331e-dbfe-431d-90e2-67aa0daf0be5 req-21c16475-49b7-48fe-a52c-66d28584de05 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039544 Jul 19 23:18:25.385465 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3169/6328] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:18:26.024047 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6946d0b0-b45c-435f-90c5-2c42ea57064a tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:26.024620 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6946d0b0-b45c-435f-90c5-2c42ea57064a tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:26.032108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6946d0b0-b45c-435f-90c5-2c42ea57064a tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:26.032108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6946d0b0-b45c-435f-90c5-2c42ea57064a tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:26.032831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6946d0b0-b45c-435f-90c5-2c42ea57064a tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:26.033276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6946d0b0-b45c-435f-90c5-2c42ea57064a tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:26.188719 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6946d0b0-b45c-435f-90c5-2c42ea57064a tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:26.197221 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6946d0b0-b45c-435f-90c5-2c42ea57064a tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1314 microversion: 2.1 time: 0.177639 Jul 19 23:18:26.197876 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3160/6329] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:26 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:27.212252 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=4 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:18:27.217422 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e1d53439-709f-4513-b32d-7736168ff9c8 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:27.218151 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e1d53439-709f-4513-b32d-7736168ff9c8 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:27.225302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e1d53439-709f-4513-b32d-7736168ff9c8 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:27.225763 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e1d53439-709f-4513-b32d-7736168ff9c8 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:27.226543 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e1d53439-709f-4513-b32d-7736168ff9c8 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:27.227034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e1d53439-709f-4513-b32d-7736168ff9c8 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:27.358707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e1d53439-709f-4513-b32d-7736168ff9c8 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:27.367404 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e1d53439-709f-4513-b32d-7736168ff9c8 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1502 microversion: 2.1 time: 0.156126 Jul 19 23:18:27.367978 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3170/6330] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:27 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:27.383770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cac73cf7-cb9a-40bd-8533-6cc06c008920 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:18:27.384809 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cac73cf7-cb9a-40bd-8533-6cc06c008920 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:27.386689 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=10 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:18:27.392929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cac73cf7-cb9a-40bd-8533-6cc06c008920 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:27.393384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cac73cf7-cb9a-40bd-8533-6cc06c008920 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:27.394247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cac73cf7-cb9a-40bd-8533-6cc06c008920 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:27.394611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cac73cf7-cb9a-40bd-8533-6cc06c008920 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:27.423093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cac73cf7-cb9a-40bd-8533-6cc06c008920 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:27.429908 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cac73cf7-cb9a-40bd-8533-6cc06c008920 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Old instance type m1.heat2, new instance type m1.heat {{(pid=119338) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 23:18:27.436202 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-cac73cf7-cb9a-40bd-8533-6cc06c008920 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:18:27.436632 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-cac73cf7-cb9a-40bd-8533-6cc06c008920 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:18:27.437116 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-cac73cf7-cb9a-40bd-8533-6cc06c008920 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:18:27.437565 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-cac73cf7-cb9a-40bd-8533-6cc06c008920 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:18:27.437985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-cac73cf7-cb9a-40bd-8533-6cc06c008920 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:18:27.500814 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cac73cf7-cb9a-40bd-8533-6cc06c008920 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "POST /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1/action" status: 202 len: 0 microversion: 2.1 time: 0.120787 Jul 19 23:18:27.501809 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3161/6331] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:18:27 2022] POST /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:18:27.509676 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fa0107bb-4614-4101-bc87-b1a1392b2338 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:27.510318 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fa0107bb-4614-4101-bc87-b1a1392b2338 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:27.516557 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa0107bb-4614-4101-bc87-b1a1392b2338 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:27.517029 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa0107bb-4614-4101-bc87-b1a1392b2338 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:27.517824 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa0107bb-4614-4101-bc87-b1a1392b2338 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:27.518278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fa0107bb-4614-4101-bc87-b1a1392b2338 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:27.661166 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fa0107bb-4614-4101-bc87-b1a1392b2338 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:27.669408 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fa0107bb-4614-4101-bc87-b1a1392b2338 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1511 microversion: 2.1 time: 0.163597 Jul 19 23:18:27.670005 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3171/6332] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:27 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:28.687158 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dd5af4fd-36ec-463e-89be-fafe7f629bfe tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:28.687721 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dd5af4fd-36ec-463e-89be-fafe7f629bfe tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:28.693785 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd5af4fd-36ec-463e-89be-fafe7f629bfe tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:28.694232 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd5af4fd-36ec-463e-89be-fafe7f629bfe tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:28.694998 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd5af4fd-36ec-463e-89be-fafe7f629bfe tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:28.695457 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd5af4fd-36ec-463e-89be-fafe7f629bfe tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:28.826027 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dd5af4fd-36ec-463e-89be-fafe7f629bfe tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:28.834190 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dd5af4fd-36ec-463e-89be-fafe7f629bfe tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1511 microversion: 2.1 time: 0.152269 Jul 19 23:18:28.834780 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3162/6333] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:28 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:29.851556 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e89c1e22-36f3-484a-88a3-f0625ab1a316 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:29.852188 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e89c1e22-36f3-484a-88a3-f0625ab1a316 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:29.859141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e89c1e22-36f3-484a-88a3-f0625ab1a316 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:29.859607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e89c1e22-36f3-484a-88a3-f0625ab1a316 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:29.860382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e89c1e22-36f3-484a-88a3-f0625ab1a316 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:29.860827 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e89c1e22-36f3-484a-88a3-f0625ab1a316 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:29.994312 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e89c1e22-36f3-484a-88a3-f0625ab1a316 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:30.001773 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e89c1e22-36f3-484a-88a3-f0625ab1a316 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1516 microversion: 2.1 time: 0.154245 Jul 19 23:18:30.002336 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3172/6334] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:29 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:31.020250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5051d7f6-5b82-4167-9d32-b2b094c0f4bb tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:31.020869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5051d7f6-5b82-4167-9d32-b2b094c0f4bb tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:31.027920 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5051d7f6-5b82-4167-9d32-b2b094c0f4bb tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:31.028376 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5051d7f6-5b82-4167-9d32-b2b094c0f4bb tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:31.029149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5051d7f6-5b82-4167-9d32-b2b094c0f4bb tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:31.029593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5051d7f6-5b82-4167-9d32-b2b094c0f4bb tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:31.169690 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5051d7f6-5b82-4167-9d32-b2b094c0f4bb tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:31.178451 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5051d7f6-5b82-4167-9d32-b2b094c0f4bb tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1516 microversion: 2.1 time: 0.162831 Jul 19 23:18:31.179032 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3163/6335] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:31 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:32.195583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b553ed2f-7007-428c-b218-ec33af3865c5 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:32.196223 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b553ed2f-7007-428c-b218-ec33af3865c5 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:32.203207 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b553ed2f-7007-428c-b218-ec33af3865c5 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:32.203663 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b553ed2f-7007-428c-b218-ec33af3865c5 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:32.204469 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b553ed2f-7007-428c-b218-ec33af3865c5 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:32.204917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b553ed2f-7007-428c-b218-ec33af3865c5 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:32.339656 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b553ed2f-7007-428c-b218-ec33af3865c5 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:32.347830 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b553ed2f-7007-428c-b218-ec33af3865c5 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1516 microversion: 2.1 time: 0.156397 Jul 19 23:18:32.348404 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3173/6336] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:32 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:33.365336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a422412d-c9e3-40a4-809c-c9cf34ce9547 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:33.365955 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a422412d-c9e3-40a4-809c-c9cf34ce9547 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:33.372917 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a422412d-c9e3-40a4-809c-c9cf34ce9547 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:33.373370 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a422412d-c9e3-40a4-809c-c9cf34ce9547 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:33.374145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a422412d-c9e3-40a4-809c-c9cf34ce9547 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:33.374585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a422412d-c9e3-40a4-809c-c9cf34ce9547 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:33.508959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a422412d-c9e3-40a4-809c-c9cf34ce9547 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:33.516489 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a422412d-c9e3-40a4-809c-c9cf34ce9547 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1516 microversion: 2.1 time: 0.155483 Jul 19 23:18:33.517068 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3164/6337] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:33 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:34.534346 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d68b5b73-d753-4bbc-9957-d7293a3f4cb7 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:34.535147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d68b5b73-d753-4bbc-9957-d7293a3f4cb7 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:34.542036 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d68b5b73-d753-4bbc-9957-d7293a3f4cb7 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:34.542513 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d68b5b73-d753-4bbc-9957-d7293a3f4cb7 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:34.543331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d68b5b73-d753-4bbc-9957-d7293a3f4cb7 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:34.543790 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d68b5b73-d753-4bbc-9957-d7293a3f4cb7 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:34.675986 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d68b5b73-d753-4bbc-9957-d7293a3f4cb7 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:34.683456 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d68b5b73-d753-4bbc-9957-d7293a3f4cb7 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1516 microversion: 2.1 time: 0.153664 Jul 19 23:18:34.684035 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3174/6338] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:34 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:35.701592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-003fa8e7-7362-4244-8103-0dea526f382f tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:35.702209 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-003fa8e7-7362-4244-8103-0dea526f382f tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:35.710649 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-003fa8e7-7362-4244-8103-0dea526f382f tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:35.711103 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-003fa8e7-7362-4244-8103-0dea526f382f tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:35.711917 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-003fa8e7-7362-4244-8103-0dea526f382f tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:35.712555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-003fa8e7-7362-4244-8103-0dea526f382f tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:35.861674 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-003fa8e7-7362-4244-8103-0dea526f382f tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:35.869893 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-003fa8e7-7362-4244-8103-0dea526f382f tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1516 microversion: 2.1 time: 0.172217 Jul 19 23:18:35.870489 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3165/6339] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:35 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:36.889117 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7d98da93-467c-4200-9d3f-3cba82135b89 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:36.889753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7d98da93-467c-4200-9d3f-3cba82135b89 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:36.897113 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d98da93-467c-4200-9d3f-3cba82135b89 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:36.897571 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d98da93-467c-4200-9d3f-3cba82135b89 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:36.898343 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d98da93-467c-4200-9d3f-3cba82135b89 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:36.898793 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d98da93-467c-4200-9d3f-3cba82135b89 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:37.035287 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7d98da93-467c-4200-9d3f-3cba82135b89 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:37.042941 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7d98da93-467c-4200-9d3f-3cba82135b89 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1516 microversion: 2.1 time: 0.157662 Jul 19 23:18:37.043484 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3175/6340] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:36 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:38.060657 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-038cfdd9-951f-4e9c-995c-6aebe487513d tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:38.061231 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-038cfdd9-951f-4e9c-995c-6aebe487513d tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:38.068952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-038cfdd9-951f-4e9c-995c-6aebe487513d tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:38.069404 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-038cfdd9-951f-4e9c-995c-6aebe487513d tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:38.070204 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-038cfdd9-951f-4e9c-995c-6aebe487513d tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:38.070644 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-038cfdd9-951f-4e9c-995c-6aebe487513d tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:38.208170 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-038cfdd9-951f-4e9c-995c-6aebe487513d tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:38.216082 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-038cfdd9-951f-4e9c-995c-6aebe487513d tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1516 microversion: 2.1 time: 0.159382 Jul 19 23:18:38.216652 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3166/6341] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:38 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:39.235668 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7b9495c8-922e-493d-8f7c-95838b7bcddb tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:39.236302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7b9495c8-922e-493d-8f7c-95838b7bcddb tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:39.244199 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7b9495c8-922e-493d-8f7c-95838b7bcddb tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:39.244666 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7b9495c8-922e-493d-8f7c-95838b7bcddb tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:39.245454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7b9495c8-922e-493d-8f7c-95838b7bcddb tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:39.245908 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7b9495c8-922e-493d-8f7c-95838b7bcddb tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:39.388213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7b9495c8-922e-493d-8f7c-95838b7bcddb tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:39.391770 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7b9495c8-922e-493d-8f7c-95838b7bcddb tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1516 microversion: 2.1 time: 0.161372 Jul 19 23:18:39.392361 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3176/6342] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:39 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:40.409860 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-452d40c1-6827-4a52-a7e4-ffe0096d81ac tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:40.410474 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-452d40c1-6827-4a52-a7e4-ffe0096d81ac tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:40.417477 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-452d40c1-6827-4a52-a7e4-ffe0096d81ac tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:40.417928 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-452d40c1-6827-4a52-a7e4-ffe0096d81ac tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:40.418692 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-452d40c1-6827-4a52-a7e4-ffe0096d81ac tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:40.419152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-452d40c1-6827-4a52-a7e4-ffe0096d81ac tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:40.554999 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-452d40c1-6827-4a52-a7e4-ffe0096d81ac tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:40.562859 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-452d40c1-6827-4a52-a7e4-ffe0096d81ac tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1516 microversion: 2.1 time: 0.157678 Jul 19 23:18:40.563673 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3167/6343] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:40 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:41.580799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e6df5291-e03b-4173-80f5-37972cb54271 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:41.581435 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e6df5291-e03b-4173-80f5-37972cb54271 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:41.588910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6df5291-e03b-4173-80f5-37972cb54271 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:41.589629 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6df5291-e03b-4173-80f5-37972cb54271 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:41.590432 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6df5291-e03b-4173-80f5-37972cb54271 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:41.590893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6df5291-e03b-4173-80f5-37972cb54271 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:41.729049 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e6df5291-e03b-4173-80f5-37972cb54271 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:41.737148 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e6df5291-e03b-4173-80f5-37972cb54271 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1516 microversion: 2.1 time: 0.159807 Jul 19 23:18:41.737740 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3177/6344] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:41 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:42.754352 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-35997543-6e0e-4024-bbdc-4df7cbcdf800 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:42.755139 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-35997543-6e0e-4024-bbdc-4df7cbcdf800 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:42.761917 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35997543-6e0e-4024-bbdc-4df7cbcdf800 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:42.762373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35997543-6e0e-4024-bbdc-4df7cbcdf800 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:42.763175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35997543-6e0e-4024-bbdc-4df7cbcdf800 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:42.763632 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35997543-6e0e-4024-bbdc-4df7cbcdf800 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:42.897608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-35997543-6e0e-4024-bbdc-4df7cbcdf800 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:42.905252 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-35997543-6e0e-4024-bbdc-4df7cbcdf800 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1516 microversion: 2.1 time: 0.155067 Jul 19 23:18:42.905852 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3168/6345] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:42 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:43.923641 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-31d1fa8f-6033-4169-b0e4-8219a7f7cb6e tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:43.924345 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-31d1fa8f-6033-4169-b0e4-8219a7f7cb6e tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:43.931247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31d1fa8f-6033-4169-b0e4-8219a7f7cb6e tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:43.931706 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31d1fa8f-6033-4169-b0e4-8219a7f7cb6e tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:43.932480 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31d1fa8f-6033-4169-b0e4-8219a7f7cb6e tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:43.932926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31d1fa8f-6033-4169-b0e4-8219a7f7cb6e tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:44.069069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-31d1fa8f-6033-4169-b0e4-8219a7f7cb6e tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:44.076908 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-31d1fa8f-6033-4169-b0e4-8219a7f7cb6e tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1516 microversion: 2.1 time: 0.157283 Jul 19 23:18:44.077476 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3178/6346] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:43 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:45.093766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-37f00234-1d09-49c7-a2e1-a76a96262a3b tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:45.094383 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-37f00234-1d09-49c7-a2e1-a76a96262a3b tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:45.102132 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-37f00234-1d09-49c7-a2e1-a76a96262a3b tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:45.102581 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-37f00234-1d09-49c7-a2e1-a76a96262a3b tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:45.103367 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-37f00234-1d09-49c7-a2e1-a76a96262a3b tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:45.103806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-37f00234-1d09-49c7-a2e1-a76a96262a3b tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:45.241707 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-37f00234-1d09-49c7-a2e1-a76a96262a3b tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:45.249284 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-37f00234-1d09-49c7-a2e1-a76a96262a3b tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1516 microversion: 2.1 time: 0.159403 Jul 19 23:18:45.250097 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3169/6347] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:45 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:46.266467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2d95e49a-d722-4ce7-9ff0-609b3a3829a7 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:46.267203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2d95e49a-d722-4ce7-9ff0-609b3a3829a7 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:46.274966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2d95e49a-d722-4ce7-9ff0-609b3a3829a7 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:46.275464 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2d95e49a-d722-4ce7-9ff0-609b3a3829a7 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:46.276245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2d95e49a-d722-4ce7-9ff0-609b3a3829a7 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:46.276690 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2d95e49a-d722-4ce7-9ff0-609b3a3829a7 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:46.411272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2d95e49a-d722-4ce7-9ff0-609b3a3829a7 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:46.419074 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2d95e49a-d722-4ce7-9ff0-609b3a3829a7 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1516 microversion: 2.1 time: 0.156557 Jul 19 23:18:46.419682 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3179/6348] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:46 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:47.437326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ac6dec3e-35e0-4aab-a737-d6a8bc4fd1ef tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:47.437967 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ac6dec3e-35e0-4aab-a737-d6a8bc4fd1ef tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:47.445523 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac6dec3e-35e0-4aab-a737-d6a8bc4fd1ef tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:47.445973 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac6dec3e-35e0-4aab-a737-d6a8bc4fd1ef tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:47.446741 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac6dec3e-35e0-4aab-a737-d6a8bc4fd1ef tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:47.447216 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ac6dec3e-35e0-4aab-a737-d6a8bc4fd1ef tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:47.601119 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ac6dec3e-35e0-4aab-a737-d6a8bc4fd1ef tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:47.609197 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ac6dec3e-35e0-4aab-a737-d6a8bc4fd1ef tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1516 microversion: 2.1 time: 0.175776 Jul 19 23:18:47.609781 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3170/6349] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:47 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:48.627715 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-20243a1d-845c-480b-88da-85e6f56ab1bb tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:48.628366 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-20243a1d-845c-480b-88da-85e6f56ab1bb tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:48.635650 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-20243a1d-845c-480b-88da-85e6f56ab1bb tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:48.636118 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-20243a1d-845c-480b-88da-85e6f56ab1bb tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:48.636918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-20243a1d-845c-480b-88da-85e6f56ab1bb tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:48.637376 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-20243a1d-845c-480b-88da-85e6f56ab1bb tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:48.641408 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=83 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:18:48.771484 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-20243a1d-845c-480b-88da-85e6f56ab1bb tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:48.779754 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-20243a1d-845c-480b-88da-85e6f56ab1bb tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1516 microversion: 2.1 time: 0.156516 Jul 19 23:18:48.780337 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3180/6350] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:48 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:18:49.797898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ba4ac18d-d71e-4863-af31-7d31a4ed2ef1 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:49.799129 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ba4ac18d-d71e-4863-af31-7d31a4ed2ef1 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:49.806123 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba4ac18d-d71e-4863-af31-7d31a4ed2ef1 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:49.806570 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba4ac18d-d71e-4863-af31-7d31a4ed2ef1 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:49.807367 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba4ac18d-d71e-4863-af31-7d31a4ed2ef1 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:49.807805 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ba4ac18d-d71e-4863-af31-7d31a4ed2ef1 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:49.946877 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ba4ac18d-d71e-4863-af31-7d31a4ed2ef1 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:49.956081 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ba4ac18d-d71e-4863-af31-7d31a4ed2ef1 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1516 microversion: 2.1 time: 0.162006 Jul 19 23:18:49.956684 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3171/6351] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:49 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:50.973375 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6aeb9839-0af6-474c-9514-d11c62955dbe tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:50.974252 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6aeb9839-0af6-474c-9514-d11c62955dbe tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:50.981240 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6aeb9839-0af6-474c-9514-d11c62955dbe tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:50.981708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6aeb9839-0af6-474c-9514-d11c62955dbe tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:50.982505 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6aeb9839-0af6-474c-9514-d11c62955dbe tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:50.982960 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6aeb9839-0af6-474c-9514-d11c62955dbe tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:51.118003 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6aeb9839-0af6-474c-9514-d11c62955dbe tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:51.125599 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6aeb9839-0af6-474c-9514-d11c62955dbe tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1516 microversion: 2.1 time: 0.156168 Jul 19 23:18:51.126173 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3181/6352] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:50 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:52.143596 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b31ab53c-213d-4bb8-baa9-e520cd80fe8d tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:52.144191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b31ab53c-213d-4bb8-baa9-e520cd80fe8d tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:52.150553 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b31ab53c-213d-4bb8-baa9-e520cd80fe8d tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:52.151001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b31ab53c-213d-4bb8-baa9-e520cd80fe8d tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:52.151810 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b31ab53c-213d-4bb8-baa9-e520cd80fe8d tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:52.152249 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b31ab53c-213d-4bb8-baa9-e520cd80fe8d tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:52.282742 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b31ab53c-213d-4bb8-baa9-e520cd80fe8d tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:52.291039 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b31ab53c-213d-4bb8-baa9-e520cd80fe8d tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1516 microversion: 2.1 time: 0.151577 Jul 19 23:18:52.291646 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3172/6353] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:52 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:53.308442 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9f1f19f4-9686-4aeb-bd14-e224281ee926 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:53.309083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9f1f19f4-9686-4aeb-bd14-e224281ee926 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:53.316225 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9f1f19f4-9686-4aeb-bd14-e224281ee926 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:53.316689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9f1f19f4-9686-4aeb-bd14-e224281ee926 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:53.317471 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9f1f19f4-9686-4aeb-bd14-e224281ee926 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:53.317925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9f1f19f4-9686-4aeb-bd14-e224281ee926 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:53.454984 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9f1f19f4-9686-4aeb-bd14-e224281ee926 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:53.464249 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9f1f19f4-9686-4aeb-bd14-e224281ee926 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1516 microversion: 2.1 time: 0.159697 Jul 19 23:18:53.464856 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3182/6354] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:53 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:54.482156 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7bf0fb97-c4e0-490a-a518-9e94e92f2fd3 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:54.482756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7bf0fb97-c4e0-490a-a518-9e94e92f2fd3 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:54.485429 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=34 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:18:54.490999 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bf0fb97-c4e0-490a-a518-9e94e92f2fd3 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:54.491475 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bf0fb97-c4e0-490a-a518-9e94e92f2fd3 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:54.492235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bf0fb97-c4e0-490a-a518-9e94e92f2fd3 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:54.492669 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bf0fb97-c4e0-490a-a518-9e94e92f2fd3 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:54.495215 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:18:54.625315 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7bf0fb97-c4e0-490a-a518-9e94e92f2fd3 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:54.633624 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7bf0fb97-c4e0-490a-a518-9e94e92f2fd3 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1516 microversion: 2.1 time: 0.155353 Jul 19 23:18:54.634225 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3173/6355] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:54 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:55.651446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a3aa4718-5248-460a-be01-c9782ddf0c82 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:55.652094 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a3aa4718-5248-460a-be01-c9782ddf0c82 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:55.654860 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=30 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:18:55.661084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a3aa4718-5248-460a-be01-c9782ddf0c82 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:55.661549 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a3aa4718-5248-460a-be01-c9782ddf0c82 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:55.662345 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a3aa4718-5248-460a-be01-c9782ddf0c82 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:55.662800 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a3aa4718-5248-460a-be01-c9782ddf0c82 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:55.805402 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a3aa4718-5248-460a-be01-c9782ddf0c82 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:55.813131 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a3aa4718-5248-460a-be01-c9782ddf0c82 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1516 microversion: 2.1 time: 0.165679 Jul 19 23:18:55.813727 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3183/6356] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:55 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:56.830986 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7d7d1b00-e3f0-41c9-9a5a-ebc13c034456 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:56.833351 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7d7d1b00-e3f0-41c9-9a5a-ebc13c034456 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:56.840296 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7d7d1b00-e3f0-41c9-9a5a-ebc13c034456 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:56.840740 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7d7d1b00-e3f0-41c9-9a5a-ebc13c034456 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:56.841510 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7d7d1b00-e3f0-41c9-9a5a-ebc13c034456 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:56.841942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7d7d1b00-e3f0-41c9-9a5a-ebc13c034456 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:57.031429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-db9a8449-6c62-48b1-a42f-4e777bbb50d9 req-8124632e-d21c-4354-84f5-351b6727c759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e55f43d-738f-4dd6-8d22-4e5febac41b1", "name": "network-vif-unplugged", "status": "completed", "tag": "a1ea258c-124a-4ea9-ab08-499ca1942ffc"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:18:57.041378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-db9a8449-6c62-48b1-a42f-4e777bbb50d9 req-8124632e-d21c-4354-84f5-351b6727c759 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:57.041754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-db9a8449-6c62-48b1-a42f-4e777bbb50d9 req-8124632e-d21c-4354-84f5-351b6727c759 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:57.054632 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-db9a8449-6c62-48b1-a42f-4e777bbb50d9 req-8124632e-d21c-4354-84f5-351b6727c759 service nova] Creating event network-vif-unplugged:a1ea258c-124a-4ea9-ab08-499ca1942ffc for instance 2e55f43d-738f-4dd6-8d22-4e5febac41b1 on n-h1-847009-3 Jul 19 23:18:57.055824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7d7d1b00-e3f0-41c9-9a5a-ebc13c034456 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:57.060325 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [req-db9a8449-6c62-48b1-a42f-4e777bbb50d9 req-8124632e-d21c-4354-84f5-351b6727c759 service nova] Instance 2e55f43d-738f-4dd6-8d22-4e5febac41b1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119337) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 23:18:57.065730 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7d7d1b00-e3f0-41c9-9a5a-ebc13c034456 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1515 microversion: 2.1 time: 0.238262 Jul 19 23:18:57.076538 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3174/6357] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:56 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1515 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:57.077457 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-db9a8449-6c62-48b1-a42f-4e777bbb50d9 req-8124632e-d21c-4354-84f5-351b6727c759 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049815 Jul 19 23:18:57.078051 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3184/6358] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:18:58.083329 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7417dc00-8275-4a15-b860-82182fc08b41 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:58.084637 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7417dc00-8275-4a15-b860-82182fc08b41 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:58.091603 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7417dc00-8275-4a15-b860-82182fc08b41 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:58.092053 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7417dc00-8275-4a15-b860-82182fc08b41 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:58.092820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7417dc00-8275-4a15-b860-82182fc08b41 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:58.093256 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7417dc00-8275-4a15-b860-82182fc08b41 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:58.228180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7417dc00-8275-4a15-b860-82182fc08b41 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:58.235764 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7417dc00-8275-4a15-b860-82182fc08b41 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1513 microversion: 2.1 time: 0.156728 Jul 19 23:18:58.236812 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3175/6359] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:58 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:18:59.095893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-2ae9394a-7cc7-4cd9-941c-0b5ccbd4bdb4 req-e74ad0d6-6cde-4393-891c-6da565f3417c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e55f43d-738f-4dd6-8d22-4e5febac41b1", "tag": "a1ea258c-124a-4ea9-ab08-499ca1942ffc"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:18:59.104116 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-2ae9394a-7cc7-4cd9-941c-0b5ccbd4bdb4 req-e74ad0d6-6cde-4393-891c-6da565f3417c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:59.104572 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-2ae9394a-7cc7-4cd9-941c-0b5ccbd4bdb4 req-e74ad0d6-6cde-4393-891c-6da565f3417c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:59.116447 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-2ae9394a-7cc7-4cd9-941c-0b5ccbd4bdb4 req-e74ad0d6-6cde-4393-891c-6da565f3417c service nova] Creating event network-changed:a1ea258c-124a-4ea9-ab08-499ca1942ffc for instance 2e55f43d-738f-4dd6-8d22-4e5febac41b1 on n-h1-847009-3 Jul 19 23:18:59.121682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [req-2ae9394a-7cc7-4cd9-941c-0b5ccbd4bdb4 req-e74ad0d6-6cde-4393-891c-6da565f3417c service nova] Instance 2e55f43d-738f-4dd6-8d22-4e5febac41b1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119337) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 23:18:59.133064 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-2ae9394a-7cc7-4cd9-941c-0b5ccbd4bdb4 req-e74ad0d6-6cde-4393-891c-6da565f3417c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042131 Jul 19 23:18:59.133689 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3185/6360] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:18:59.254262 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e6898785-ffd9-42a9-9db4-f6f9ebff864f tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:18:59.255013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e6898785-ffd9-42a9-9db4-f6f9ebff864f tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:18:59.262000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e6898785-ffd9-42a9-9db4-f6f9ebff864f tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:59.262461 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e6898785-ffd9-42a9-9db4-f6f9ebff864f tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:59.263277 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e6898785-ffd9-42a9-9db4-f6f9ebff864f tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:18:59.263725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e6898785-ffd9-42a9-9db4-f6f9ebff864f tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:18:59.927257 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e6898785-ffd9-42a9-9db4-f6f9ebff864f tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:18:59.934766 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e6898785-ffd9-42a9-9db4-f6f9ebff864f tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1513 microversion: 2.1 time: 0.685085 Jul 19 23:18:59.935378 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3176/6361] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:18:59 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1513 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:00.953804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4a5b907f-1296-4dd4-962f-174a1582a6f9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:00.954526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4a5b907f-1296-4dd4-962f-174a1582a6f9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:00.961328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4a5b907f-1296-4dd4-962f-174a1582a6f9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:00.961789 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4a5b907f-1296-4dd4-962f-174a1582a6f9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:00.962603 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4a5b907f-1296-4dd4-962f-174a1582a6f9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:00.963051 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4a5b907f-1296-4dd4-962f-174a1582a6f9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:01.101022 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4a5b907f-1296-4dd4-962f-174a1582a6f9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:01.108592 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4a5b907f-1296-4dd4-962f-174a1582a6f9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1510 microversion: 2.1 time: 0.160016 Jul 19 23:19:01.109161 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3186/6362] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:00 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:01.124894 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-17d26e98-9f63-4617-8527-85d8c81c9c54 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:01.125410 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-17d26e98-9f63-4617-8527-85d8c81c9c54 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:01.132490 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-17d26e98-9f63-4617-8527-85d8c81c9c54 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:01.132939 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-17d26e98-9f63-4617-8527-85d8c81c9c54 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:01.133726 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-17d26e98-9f63-4617-8527-85d8c81c9c54 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:01.134237 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-17d26e98-9f63-4617-8527-85d8c81c9c54 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:01.160634 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-17d26e98-9f63-4617-8527-85d8c81c9c54 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:19:01.214797 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.compute.api [None req-17d26e98-9f63-4617-8527-85d8c81c9c54 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Found an unconfirmed migration during delete, id: 16, status: finished Jul 19 23:19:02.566924 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-17d26e98-9f63-4617-8527-85d8c81c9c54 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 204 len: 0 microversion: 2.1 time: 1.445586 Jul 19 23:19:02.572087 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3177/6363] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:19:01 2022] DELETE /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 0 bytes in 1448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:19:02.578100 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ca1d3850-e72b-443c-95d1-f0dda37f94e9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:02.578937 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ca1d3850-e72b-443c-95d1-f0dda37f94e9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:02.586682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca1d3850-e72b-443c-95d1-f0dda37f94e9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:02.587196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca1d3850-e72b-443c-95d1-f0dda37f94e9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:02.588027 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca1d3850-e72b-443c-95d1-f0dda37f94e9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:02.588529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca1d3850-e72b-443c-95d1-f0dda37f94e9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:02.617568 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-a44495d0-74dd-487e-a1e9-6a0fb5250711 req-5e05cca3-289e-4853-94ce-25a32d962426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e55f43d-738f-4dd6-8d22-4e5febac41b1", "name": "network-vif-plugged", "status": "completed", "tag": "a1ea258c-124a-4ea9-ab08-499ca1942ffc"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:19:02.626959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-a44495d0-74dd-487e-a1e9-6a0fb5250711 req-5e05cca3-289e-4853-94ce-25a32d962426 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:02.627476 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-a44495d0-74dd-487e-a1e9-6a0fb5250711 req-5e05cca3-289e-4853-94ce-25a32d962426 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:02.639505 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-a44495d0-74dd-487e-a1e9-6a0fb5250711 req-5e05cca3-289e-4853-94ce-25a32d962426 service nova] Creating event network-vif-plugged:a1ea258c-124a-4ea9-ab08-499ca1942ffc for instance 2e55f43d-738f-4dd6-8d22-4e5febac41b1 on n-h1-847009-3 Jul 19 23:19:02.644588 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-a44495d0-74dd-487e-a1e9-6a0fb5250711 req-5e05cca3-289e-4853-94ce-25a32d962426 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032371 Jul 19 23:19:02.645193 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3178/6364] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:19:02.729694 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ca1d3850-e72b-443c-95d1-f0dda37f94e9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:02.737934 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ca1d3850-e72b-443c-95d1-f0dda37f94e9 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1502 microversion: 2.1 time: 0.164232 Jul 19 23:19:02.738518 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3187/6365] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:02 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:03.756339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b14bb1b2-73be-430b-b3c9-b5623eeb7538 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:03.757041 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b14bb1b2-73be-430b-b3c9-b5623eeb7538 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:03.763329 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b14bb1b2-73be-430b-b3c9-b5623eeb7538 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:03.763778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b14bb1b2-73be-430b-b3c9-b5623eeb7538 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:03.764533 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b14bb1b2-73be-430b-b3c9-b5623eeb7538 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:03.764970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b14bb1b2-73be-430b-b3c9-b5623eeb7538 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:03.897232 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b14bb1b2-73be-430b-b3c9-b5623eeb7538 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f8eedddb624080b26e2f4754beaa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1daa1114cce427eb61d3c837ea8c1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:03.904928 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b14bb1b2-73be-430b-b3c9-b5623eeb7538 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 200 len: 1502 microversion: 2.1 time: 0.154314 Jul 19 23:19:03.905509 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3179/6366] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:03 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:04.528858 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-95a2a9a6-29ab-4198-8c4f-7b050d0dbbb0 req-ca7c8a09-947a-4b93-a3f4-6ec88fce1b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e55f43d-738f-4dd6-8d22-4e5febac41b1", "name": "network-vif-deleted", "tag": "a1ea258c-124a-4ea9-ab08-499ca1942ffc"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:19:04.539578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-95a2a9a6-29ab-4198-8c4f-7b050d0dbbb0 req-ca7c8a09-947a-4b93-a3f4-6ec88fce1b0d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:04.540363 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-95a2a9a6-29ab-4198-8c4f-7b050d0dbbb0 req-ca7c8a09-947a-4b93-a3f4-6ec88fce1b0d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:04.552757 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-95a2a9a6-29ab-4198-8c4f-7b050d0dbbb0 req-ca7c8a09-947a-4b93-a3f4-6ec88fce1b0d service nova] Creating event network-vif-deleted:a1ea258c-124a-4ea9-ab08-499ca1942ffc for instance 2e55f43d-738f-4dd6-8d22-4e5febac41b1 on n-h1-847009-3 Jul 19 23:19:04.558502 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-95a2a9a6-29ab-4198-8c4f-7b050d0dbbb0 req-ca7c8a09-947a-4b93-a3f4-6ec88fce1b0d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033276 Jul 19 23:19:04.559454 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3188/6367] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:19:04.923570 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-76d0d099-97a1-49da-820a-d4765a33b87e tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:04.925245 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-76d0d099-97a1-49da-820a-d4765a33b87e tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:04.933933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-76d0d099-97a1-49da-820a-d4765a33b87e tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:04.934394 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-76d0d099-97a1-49da-820a-d4765a33b87e tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:04.935800 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-76d0d099-97a1-49da-820a-d4765a33b87e tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:04.936355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-76d0d099-97a1-49da-820a-d4765a33b87e tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:04.951705 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-76d0d099-97a1-49da-820a-d4765a33b87e tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] HTTP exception thrown: Instance 2e55f43d-738f-4dd6-8d22-4e5febac41b1 could not be found. Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-76d0d099-97a1-49da-820a-d4765a33b87e tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Request method failure captured: Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 HTTP/1.1 Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zu0p4RIOtjRL-XYHc-P1i9_93XDDzkmxPxRkXN93hDF_SC2g9j6RdGOz4vheDuXoWU6tgN2r35WOIixFdQ-Dl8Hv5dmeP3TgUByblk7TzaiLU7QHVNdisqfpdxOc3P8rmjPR6RSfMqQSedeMgKqRo8SsLToU8-m0FoSRMVWwBOz9as Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: f1daa1114cce427eb61d3c837ea8c1f4 Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-DeleteServersTestJSON-1717397945 Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1daa1114cce427eb61d3c837ea8c1f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1daa1114cce427eb61d3c837ea8c1f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1daa1114cce427eb61d3c837ea8c1f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1daa1114cce427eb61d3c837ea8c1f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-DeleteServersTestJSON-1717397945 Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: f1daa1114cce427eb61d3c837ea8c1f4 Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-DeleteServersTestJSON-1717397945 Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-DeleteServersTestJSON-1717397945-project Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 42f8eedddb624080b26e2f4754beaa7c Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-DeleteServersTestJSON-1717397945-project Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 2e55f43d-738f-4dd6-8d22-4e5febac41b1 could not be found. Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '2e55f43d-738f-4dd6-8d22-4e5febac41b1'} Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e55f43d-738f-4dd6-8d22-4e5febac41b1 could not be found. Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e55f43d-738f-4dd6-8d22-4e5febac41b1 could not be found. Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:19:04.953376 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:19:04.959472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:19:04.959472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:19:04.959472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:19:04.959472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:19:04.959472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:19:04.959472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e55f43d-738f-4dd6-8d22-4e5febac41b1 could not be found. Jul 19 23:19:04.959472 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:19:04.959472 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-76d0d099-97a1-49da-820a-d4765a33b87e tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Returning 404 to user: Instance 2e55f43d-738f-4dd6-8d22-4e5febac41b1 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:19:04.959472 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-76d0d099-97a1-49da-820a-d4765a33b87e tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 404 len: 111 microversion: 2.1 time: 0.036046 Jul 19 23:19:04.959472 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3180/6368] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:04 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:19:04.975563 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7572145a-0c2c-4457-ad3c-df9c99bc252d tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:04.976220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7572145a-0c2c-4457-ad3c-df9c99bc252d tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:04.982669 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7572145a-0c2c-4457-ad3c-df9c99bc252d tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:04.983172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7572145a-0c2c-4457-ad3c-df9c99bc252d tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:04.983971 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7572145a-0c2c-4457-ad3c-df9c99bc252d tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:04.984428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7572145a-0c2c-4457-ad3c-df9c99bc252d tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:04.998989 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-7572145a-0c2c-4457-ad3c-df9c99bc252d tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] HTTP exception thrown: Instance 2e55f43d-738f-4dd6-8d22-4e5febac41b1 could not be found. Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7572145a-0c2c-4457-ad3c-df9c99bc252d tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Request method failure captured: Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 HTTP/1.1 Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zu0p4RIOtjRL-XYHc-P1i9_93XDDzkmxPxRkXN93hDF_SC2g9j6RdGOz4vheDuXoWU6tgN2r35WOIixFdQ-Dl8Hv5dmeP3TgUByblk7TzaiLU7QHVNdisqfpdxOc3P8rmjPR6RSfMqQSedeMgKqRo8SsLToU8-m0FoSRMVWwBOz9as Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: f1daa1114cce427eb61d3c837ea8c1f4 Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-DeleteServersTestJSON-1717397945 Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1daa1114cce427eb61d3c837ea8c1f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1daa1114cce427eb61d3c837ea8c1f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1daa1114cce427eb61d3c837ea8c1f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1daa1114cce427eb61d3c837ea8c1f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-DeleteServersTestJSON-1717397945 Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: f1daa1114cce427eb61d3c837ea8c1f4 Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-DeleteServersTestJSON-1717397945 Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-DeleteServersTestJSON-1717397945-project Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 42f8eedddb624080b26e2f4754beaa7c Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-DeleteServersTestJSON-1717397945-project Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 2e55f43d-738f-4dd6-8d22-4e5febac41b1 could not be found. Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '2e55f43d-738f-4dd6-8d22-4e5febac41b1'} Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e55f43d-738f-4dd6-8d22-4e5febac41b1 could not be found. Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:19:05.000735 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:19:05.007502 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e55f43d-738f-4dd6-8d22-4e5febac41b1 could not be found. Jul 19 23:19:05.007502 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:19:05.007502 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:19:05.007502 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:19:05.007502 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:19:05.007502 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:19:05.007502 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:19:05.007502 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:19:05.007502 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:19:05.007502 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e55f43d-738f-4dd6-8d22-4e5febac41b1 could not be found. Jul 19 23:19:05.007502 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:19:05.007502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7572145a-0c2c-4457-ad3c-df9c99bc252d tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Returning 404 to user: Instance 2e55f43d-738f-4dd6-8d22-4e5febac41b1 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:19:05.007502 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7572145a-0c2c-4457-ad3c-df9c99bc252d tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 404 len: 111 microversion: 2.1 time: 0.032061 Jul 19 23:19:05.007502 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3189/6369] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:19:04 2022] DELETE /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:19:05.011611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3ccff6d9-7dda-48f3-a83a-3b9f36cb79f0 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:05.012800 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3ccff6d9-7dda-48f3-a83a-3b9f36cb79f0 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] [instance: 2e55f43d-738f-4dd6-8d22-4e5febac41b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:05.023734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3ccff6d9-7dda-48f3-a83a-3b9f36cb79f0 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:05.023734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3ccff6d9-7dda-48f3-a83a-3b9f36cb79f0 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:05.024552 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3ccff6d9-7dda-48f3-a83a-3b9f36cb79f0 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:05.025554 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3ccff6d9-7dda-48f3-a83a-3b9f36cb79f0 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:05.040394 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-3ccff6d9-7dda-48f3-a83a-3b9f36cb79f0 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] HTTP exception thrown: Instance 2e55f43d-738f-4dd6-8d22-4e5febac41b1 could not be found. Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3ccff6d9-7dda-48f3-a83a-3b9f36cb79f0 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Request method failure captured: Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 HTTP/1.1 Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zu0p4RIOtjRL-XYHc-P1i9_93XDDzkmxPxRkXN93hDF_SC2g9j6RdGOz4vheDuXoWU6tgN2r35WOIixFdQ-Dl8Hv5dmeP3TgUByblk7TzaiLU7QHVNdisqfpdxOc3P8rmjPR6RSfMqQSedeMgKqRo8SsLToU8-m0FoSRMVWwBOz9as Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: f1daa1114cce427eb61d3c837ea8c1f4 Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-DeleteServersTestJSON-1717397945 Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1daa1114cce427eb61d3c837ea8c1f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1daa1114cce427eb61d3c837ea8c1f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1daa1114cce427eb61d3c837ea8c1f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1daa1114cce427eb61d3c837ea8c1f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-DeleteServersTestJSON-1717397945 Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: f1daa1114cce427eb61d3c837ea8c1f4 Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-DeleteServersTestJSON-1717397945 Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-DeleteServersTestJSON-1717397945-project Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 42f8eedddb624080b26e2f4754beaa7c Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-DeleteServersTestJSON-1717397945-project Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 2e55f43d-738f-4dd6-8d22-4e5febac41b1 could not be found. Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '2e55f43d-738f-4dd6-8d22-4e5febac41b1'} Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e55f43d-738f-4dd6-8d22-4e5febac41b1 could not be found. Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e55f43d-738f-4dd6-8d22-4e5febac41b1 could not be found. Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:19:05.041847 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:19:05.050809 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:19:05.050809 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:19:05.050809 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:19:05.050809 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:19:05.050809 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:19:05.050809 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e55f43d-738f-4dd6-8d22-4e5febac41b1 could not be found. Jul 19 23:19:05.050809 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:19:05.050809 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3ccff6d9-7dda-48f3-a83a-3b9f36cb79f0 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] Returning 404 to user: Instance 2e55f43d-738f-4dd6-8d22-4e5febac41b1 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:19:05.050809 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3ccff6d9-7dda-48f3-a83a-3b9f36cb79f0 tempest-DeleteServersTestJSON-1717397945 tempest-DeleteServersTestJSON-1717397945-project] 10.222.0.25 "GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1" status: 404 len: 111 microversion: 2.1 time: 0.036255 Jul 19 23:19:05.050809 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3181/6370] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:05 2022] GET /compute/v2.1/servers/2e55f43d-738f-4dd6-8d22-4e5febac41b1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:19:13.909585 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a259a471-427b-4685-840e-9853a3b2d8af tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-143926456", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "59da1dcc-d9cf-4e0d-9ef9-ec78818ee6e1"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:19:13.963201 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-a259a471-427b-4685-840e-9853a3b2d8af tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] validate_networks() for [('59da1dcc-d9cf-4e0d-9ef9-ec78818ee6e1', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:19:14.353581 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-a259a471-427b-4685-840e-9853a3b2d8af tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:19:14.354035 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-a259a471-427b-4685-840e-9853a3b2d8af tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:19:14.354537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-a259a471-427b-4685-840e-9853a3b2d8af tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:19:14.354973 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-a259a471-427b-4685-840e-9853a3b2d8af tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:19:14.355455 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-a259a471-427b-4685-840e-9853a3b2d8af tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:19:14.365081 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a259a471-427b-4685-840e-9853a3b2d8af tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:14.365558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a259a471-427b-4685-840e-9853a3b2d8af tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:14.366388 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a259a471-427b-4685-840e-9853a3b2d8af tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:14.366852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a259a471-427b-4685-840e-9853a3b2d8af tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:14.384766 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-a259a471-427b-4685-840e-9853a3b2d8af tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Getting quotas for project be99de8a278748409929647066c0e296. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:19:14.390208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-a259a471-427b-4685-840e-9853a3b2d8af tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Getting quotas for user 26335bfc44d24b9f99e1a10894710c08 and project be99de8a278748409929647066c0e296. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:19:14.403912 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a259a471-427b-4685-840e-9853a3b2d8af tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:19:14.406151 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a259a471-427b-4685-840e-9853a3b2d8af tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:19:14.454106 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a259a471-427b-4685-840e-9853a3b2d8af tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.665949 Jul 19 23:19:14.455137 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3190/6371] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:19:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:19:14.465272 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0d7cd085-0639-4cdf-ac7e-1a443beea6a7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:14.465900 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0d7cd085-0639-4cdf-ac7e-1a443beea6a7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:14.523907 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0d7cd085-0639-4cdf-ac7e-1a443beea6a7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:14.530878 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0d7cd085-0639-4cdf-ac7e-1a443beea6a7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1217 microversion: 2.1 time: 0.069599 Jul 19 23:19:14.531713 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3182/6372] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:14 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:15.551888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9b703417-5b2b-4584-b722-41b65237a3e4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:15.552604 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9b703417-5b2b-4584-b722-41b65237a3e4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:15.565959 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b703417-5b2b-4584-b722-41b65237a3e4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:15.566422 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b703417-5b2b-4584-b722-41b65237a3e4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:15.567606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b703417-5b2b-4584-b722-41b65237a3e4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:15.568581 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b703417-5b2b-4584-b722-41b65237a3e4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:15.692341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9b703417-5b2b-4584-b722-41b65237a3e4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:15.701363 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9b703417-5b2b-4584-b722-41b65237a3e4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1277 microversion: 2.1 time: 0.155762 Jul 19 23:19:15.702353 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3191/6373] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:15 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:16.719151 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e4f0da7b-676a-4a9a-a0ff-3521348f138a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:16.721196 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e4f0da7b-676a-4a9a-a0ff-3521348f138a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:16.728037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:19:16.734029 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e4f0da7b-676a-4a9a-a0ff-3521348f138a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:16.734824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e4f0da7b-676a-4a9a-a0ff-3521348f138a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:16.736515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e4f0da7b-676a-4a9a-a0ff-3521348f138a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:16.737425 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e4f0da7b-676a-4a9a-a0ff-3521348f138a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:17.018004 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e4f0da7b-676a-4a9a-a0ff-3521348f138a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:17.027192 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e4f0da7b-676a-4a9a-a0ff-3521348f138a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1317 microversion: 2.1 time: 0.311835 Jul 19 23:19:17.029678 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3183/6374] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:16 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:17.216315 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-169f2162-1d70-41dc-b67d-6e210183154a req-0f9b415e-d74b-42b2-9031-9f35abd89a46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bea0e99-3b70-454d-8578-65d55210456e", "tag": "39e112f9-af8a-4886-93b4-e99b08ff990e"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:19:17.228869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-169f2162-1d70-41dc-b67d-6e210183154a req-0f9b415e-d74b-42b2-9031-9f35abd89a46 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:17.234573 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-169f2162-1d70-41dc-b67d-6e210183154a req-0f9b415e-d74b-42b2-9031-9f35abd89a46 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:17.272827 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-169f2162-1d70-41dc-b67d-6e210183154a req-0f9b415e-d74b-42b2-9031-9f35abd89a46 service nova] Creating event network-changed:39e112f9-af8a-4886-93b4-e99b08ff990e for instance 0bea0e99-3b70-454d-8578-65d55210456e on n-h1-847009-3 Jul 19 23:19:17.279183 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-169f2162-1d70-41dc-b67d-6e210183154a req-0f9b415e-d74b-42b2-9031-9f35abd89a46 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066874 Jul 19 23:19:17.286946 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3192/6375] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:19:18.045860 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dd1697db-cef4-4c29-9ea5-406a166c12d6 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:18.046460 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dd1697db-cef4-4c29-9ea5-406a166c12d6 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:18.054056 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd1697db-cef4-4c29-9ea5-406a166c12d6 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:18.054503 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd1697db-cef4-4c29-9ea5-406a166c12d6 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:18.055304 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd1697db-cef4-4c29-9ea5-406a166c12d6 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:18.055751 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd1697db-cef4-4c29-9ea5-406a166c12d6 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:18.193335 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dd1697db-cef4-4c29-9ea5-406a166c12d6 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:18.200774 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dd1697db-cef4-4c29-9ea5-406a166c12d6 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1317 microversion: 2.1 time: 0.158870 Jul 19 23:19:18.201343 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3184/6376] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:18 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:19.219242 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e2dfe7f8-4bc3-4036-8c98-8d99702de4de tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:19.220164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e2dfe7f8-4bc3-4036-8c98-8d99702de4de tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:19.226698 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e2dfe7f8-4bc3-4036-8c98-8d99702de4de tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:19.227186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e2dfe7f8-4bc3-4036-8c98-8d99702de4de tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:19.227967 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e2dfe7f8-4bc3-4036-8c98-8d99702de4de tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:19.228417 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e2dfe7f8-4bc3-4036-8c98-8d99702de4de tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:19.232465 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=58 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:19:19.367687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e2dfe7f8-4bc3-4036-8c98-8d99702de4de tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:19.375244 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e2dfe7f8-4bc3-4036-8c98-8d99702de4de tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1317 microversion: 2.1 time: 0.161140 Jul 19 23:19:19.375807 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3193/6377] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:19 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:20.392118 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6ff4e650-2529-45cb-8278-4c99658b07b8 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:20.392822 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6ff4e650-2529-45cb-8278-4c99658b07b8 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:20.399743 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ff4e650-2529-45cb-8278-4c99658b07b8 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:20.400186 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ff4e650-2529-45cb-8278-4c99658b07b8 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:20.400945 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ff4e650-2529-45cb-8278-4c99658b07b8 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:20.401381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ff4e650-2529-45cb-8278-4c99658b07b8 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:20.537056 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6ff4e650-2529-45cb-8278-4c99658b07b8 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:20.544662 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6ff4e650-2529-45cb-8278-4c99658b07b8 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1317 microversion: 2.1 time: 0.156494 Jul 19 23:19:20.545333 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3185/6378] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:20 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:21.561991 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-39f02f13-8b01-45fb-8ee5-bb2a69b472e3 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:21.562637 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-39f02f13-8b01-45fb-8ee5-bb2a69b472e3 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:21.570567 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39f02f13-8b01-45fb-8ee5-bb2a69b472e3 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:21.571035 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39f02f13-8b01-45fb-8ee5-bb2a69b472e3 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:21.571863 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39f02f13-8b01-45fb-8ee5-bb2a69b472e3 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:21.572321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39f02f13-8b01-45fb-8ee5-bb2a69b472e3 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:21.705490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-39f02f13-8b01-45fb-8ee5-bb2a69b472e3 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:21.713233 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-39f02f13-8b01-45fb-8ee5-bb2a69b472e3 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1317 microversion: 2.1 time: 0.155330 Jul 19 23:19:21.713804 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3194/6379] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:21 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:22.643829 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-de90583d-46c0-4daf-bde2-75e98f49b727 req-4f0aeffc-80cb-46ac-afd3-488dc8e8a5cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bea0e99-3b70-454d-8578-65d55210456e", "name": "network-vif-plugged", "status": "completed", "tag": "39e112f9-af8a-4886-93b4-e99b08ff990e"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:19:22.652889 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-de90583d-46c0-4daf-bde2-75e98f49b727 req-4f0aeffc-80cb-46ac-afd3-488dc8e8a5cb service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:22.653799 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-de90583d-46c0-4daf-bde2-75e98f49b727 req-4f0aeffc-80cb-46ac-afd3-488dc8e8a5cb service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:22.665631 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-de90583d-46c0-4daf-bde2-75e98f49b727 req-4f0aeffc-80cb-46ac-afd3-488dc8e8a5cb service nova] Creating event network-vif-plugged:39e112f9-af8a-4886-93b4-e99b08ff990e for instance 0bea0e99-3b70-454d-8578-65d55210456e on n-h1-847009-3 Jul 19 23:19:22.670547 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-de90583d-46c0-4daf-bde2-75e98f49b727 req-4f0aeffc-80cb-46ac-afd3-488dc8e8a5cb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031364 Jul 19 23:19:22.671168 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3186/6380] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:19:22.730322 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-75cadd89-7ff4-4b70-bd94-64f365a61f0f tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:22.730895 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-75cadd89-7ff4-4b70-bd94-64f365a61f0f tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:22.738355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-75cadd89-7ff4-4b70-bd94-64f365a61f0f tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:22.738825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-75cadd89-7ff4-4b70-bd94-64f365a61f0f tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:22.739664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-75cadd89-7ff4-4b70-bd94-64f365a61f0f tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:22.740123 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-75cadd89-7ff4-4b70-bd94-64f365a61f0f tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:22.908596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-75cadd89-7ff4-4b70-bd94-64f365a61f0f tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:22.916152 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-75cadd89-7ff4-4b70-bd94-64f365a61f0f tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1317 microversion: 2.1 time: 0.189858 Jul 19 23:19:22.916730 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3195/6381] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:22 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:23.933698 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-56d4776c-78d6-4977-b803-d9a03e04ac1c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:23.934409 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-56d4776c-78d6-4977-b803-d9a03e04ac1c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:23.941767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56d4776c-78d6-4977-b803-d9a03e04ac1c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:23.942221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56d4776c-78d6-4977-b803-d9a03e04ac1c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:23.943007 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56d4776c-78d6-4977-b803-d9a03e04ac1c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:23.943493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56d4776c-78d6-4977-b803-d9a03e04ac1c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:24.083126 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-56d4776c-78d6-4977-b803-d9a03e04ac1c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:24.090596 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-56d4776c-78d6-4977-b803-d9a03e04ac1c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1317 microversion: 2.1 time: 0.161070 Jul 19 23:19:24.091191 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3187/6382] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:23 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:25.107965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d47d01d4-c7b4-4cfe-91f2-fef5566c51e3 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:25.108727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d47d01d4-c7b4-4cfe-91f2-fef5566c51e3 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:25.111902 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:19:25.112819 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:19:25.119650 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d47d01d4-c7b4-4cfe-91f2-fef5566c51e3 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:25.120118 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d47d01d4-c7b4-4cfe-91f2-fef5566c51e3 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:25.120912 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d47d01d4-c7b4-4cfe-91f2-fef5566c51e3 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:25.121366 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d47d01d4-c7b4-4cfe-91f2-fef5566c51e3 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:25.256088 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d47d01d4-c7b4-4cfe-91f2-fef5566c51e3 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:25.263643 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d47d01d4-c7b4-4cfe-91f2-fef5566c51e3 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1506 microversion: 2.1 time: 0.159712 Jul 19 23:19:25.264222 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3196/6383] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:25 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:25.280478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-62bb77ba-c6df-4bb2-9b5d-64619f0a3e55 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:25.281092 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-62bb77ba-c6df-4bb2-9b5d-64619f0a3e55 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:25.283214 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:19:25.284841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:19:25.290975 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62bb77ba-c6df-4bb2-9b5d-64619f0a3e55 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:25.291462 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62bb77ba-c6df-4bb2-9b5d-64619f0a3e55 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:25.292442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62bb77ba-c6df-4bb2-9b5d-64619f0a3e55 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:25.292877 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-62bb77ba-c6df-4bb2-9b5d-64619f0a3e55 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:25.431203 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-62bb77ba-c6df-4bb2-9b5d-64619f0a3e55 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:25.439606 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-62bb77ba-c6df-4bb2-9b5d-64619f0a3e55 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1506 microversion: 2.1 time: 0.162416 Jul 19 23:19:25.440196 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3188/6384] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:25 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:25.456529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-18afe681-4946-4ad4-858a-8a7c2c57f4cb tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:19:25.457738 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-18afe681-4946-4ad4-858a-8a7c2c57f4cb tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:25.464073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-18afe681-4946-4ad4-858a-8a7c2c57f4cb tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:25.464548 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-18afe681-4946-4ad4-858a-8a7c2c57f4cb tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:25.465337 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-18afe681-4946-4ad4-858a-8a7c2c57f4cb tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:25.465795 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-18afe681-4946-4ad4-858a-8a7c2c57f4cb tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:25.529713 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-18afe681-4946-4ad4-858a-8a7c2c57f4cb tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "PUT /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1078 microversion: 2.1 time: 0.077408 Jul 19 23:19:25.530550 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3197/6385] 10.222.0.25 () {60 vars in 1255 bytes} [Tue Jul 19 23:19:25 2022] PUT /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1078 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:19:25.544151 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6fae231f-801a-4797-b399-3fd7c6c0de55 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:25.544857 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6fae231f-801a-4797-b399-3fd7c6c0de55 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:25.551641 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6fae231f-801a-4797-b399-3fd7c6c0de55 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:25.552156 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6fae231f-801a-4797-b399-3fd7c6c0de55 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:25.553142 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6fae231f-801a-4797-b399-3fd7c6c0de55 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:25.553684 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6fae231f-801a-4797-b399-3fd7c6c0de55 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:25.687151 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6fae231f-801a-4797-b399-3fd7c6c0de55 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:25.696399 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6fae231f-801a-4797-b399-3fd7c6c0de55 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1504 microversion: 2.1 time: 0.156005 Jul 19 23:19:25.697007 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3189/6386] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:25 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:25.714325 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-107f9484-2d9f-41de-a7aa-ba48217d8c11 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:25.715004 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-107f9484-2d9f-41de-a7aa-ba48217d8c11 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:25.717120 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:19:25.723411 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-107f9484-2d9f-41de-a7aa-ba48217d8c11 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:25.723889 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-107f9484-2d9f-41de-a7aa-ba48217d8c11 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:25.724687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-107f9484-2d9f-41de-a7aa-ba48217d8c11 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:25.725270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-107f9484-2d9f-41de-a7aa-ba48217d8c11 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:25.868837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-107f9484-2d9f-41de-a7aa-ba48217d8c11 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:25.876959 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-107f9484-2d9f-41de-a7aa-ba48217d8c11 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1504 microversion: 2.1 time: 0.166179 Jul 19 23:19:25.877605 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3198/6387] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:25 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:25.894260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9bf8d334-d4ac-48a6-bcb4-3297d69a8bcd tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:19:25.895217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9bf8d334-d4ac-48a6-bcb4-3297d69a8bcd tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:25.901292 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9bf8d334-d4ac-48a6-bcb4-3297d69a8bcd tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:25.901751 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9bf8d334-d4ac-48a6-bcb4-3297d69a8bcd tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:25.902523 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9bf8d334-d4ac-48a6-bcb4-3297d69a8bcd tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:25.902968 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9bf8d334-d4ac-48a6-bcb4-3297d69a8bcd tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:25.930684 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9bf8d334-d4ac-48a6-bcb4-3297d69a8bcd tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:25.937075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9bf8d334-d4ac-48a6-bcb4-3297d69a8bcd tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Old instance type m1.heat2, new instance type m1.heat {{(pid=119338) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 23:19:25.944337 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-9bf8d334-d4ac-48a6-bcb4-3297d69a8bcd tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:19:25.944810 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-9bf8d334-d4ac-48a6-bcb4-3297d69a8bcd tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:19:25.945279 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-9bf8d334-d4ac-48a6-bcb4-3297d69a8bcd tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:19:25.945715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-9bf8d334-d4ac-48a6-bcb4-3297d69a8bcd tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:19:25.946127 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-9bf8d334-d4ac-48a6-bcb4-3297d69a8bcd tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:19:26.009299 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9bf8d334-d4ac-48a6-bcb4-3297d69a8bcd tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "POST /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e/action" status: 202 len: 0 microversion: 2.1 time: 0.119540 Jul 19 23:19:26.012787 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3190/6388] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:19:25 2022] POST /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:19:26.018222 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-409d20aa-a31a-4d3a-9622-ef016a8c009c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:26.018852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-409d20aa-a31a-4d3a-9622-ef016a8c009c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:26.024996 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-409d20aa-a31a-4d3a-9622-ef016a8c009c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:26.025472 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-409d20aa-a31a-4d3a-9622-ef016a8c009c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:26.026243 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-409d20aa-a31a-4d3a-9622-ef016a8c009c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:26.026689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-409d20aa-a31a-4d3a-9622-ef016a8c009c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:26.168502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-409d20aa-a31a-4d3a-9622-ef016a8c009c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:26.176915 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-409d20aa-a31a-4d3a-9622-ef016a8c009c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1515 microversion: 2.1 time: 0.162777 Jul 19 23:19:26.183179 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3199/6389] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:26 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:27.198595 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e195101b-ab66-4a17-b6d4-de4013117544 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:27.199309 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e195101b-ab66-4a17-b6d4-de4013117544 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:27.207714 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e195101b-ab66-4a17-b6d4-de4013117544 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:27.208159 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e195101b-ab66-4a17-b6d4-de4013117544 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:27.208936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e195101b-ab66-4a17-b6d4-de4013117544 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:27.209369 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e195101b-ab66-4a17-b6d4-de4013117544 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:27.446059 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e195101b-ab66-4a17-b6d4-de4013117544 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:27.453512 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e195101b-ab66-4a17-b6d4-de4013117544 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1515 microversion: 2.1 time: 0.259662 Jul 19 23:19:27.454295 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3191/6390] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:27 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1515 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:28.472671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-669959f3-9d8e-4041-8526-b262c00cfaca tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:28.473318 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-669959f3-9d8e-4041-8526-b262c00cfaca tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:28.480654 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-669959f3-9d8e-4041-8526-b262c00cfaca tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:28.481192 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-669959f3-9d8e-4041-8526-b262c00cfaca tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:28.482002 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-669959f3-9d8e-4041-8526-b262c00cfaca tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:28.482494 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-669959f3-9d8e-4041-8526-b262c00cfaca tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:28.617059 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-669959f3-9d8e-4041-8526-b262c00cfaca tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:28.624790 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-669959f3-9d8e-4041-8526-b262c00cfaca tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1520 microversion: 2.1 time: 0.156902 Jul 19 23:19:28.625373 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3200/6391] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:28 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:29.642577 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7baec4ce-b1fb-40aa-a398-1f7cd8ea0608 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:29.644260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7baec4ce-b1fb-40aa-a398-1f7cd8ea0608 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:29.651702 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7baec4ce-b1fb-40aa-a398-1f7cd8ea0608 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:29.652157 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7baec4ce-b1fb-40aa-a398-1f7cd8ea0608 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:29.652942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7baec4ce-b1fb-40aa-a398-1f7cd8ea0608 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:29.653390 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7baec4ce-b1fb-40aa-a398-1f7cd8ea0608 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:29.786127 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7baec4ce-b1fb-40aa-a398-1f7cd8ea0608 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:29.793845 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7baec4ce-b1fb-40aa-a398-1f7cd8ea0608 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1520 microversion: 2.1 time: 0.155111 Jul 19 23:19:29.794420 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3192/6392] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:29 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:30.811116 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-331c4347-e744-42eb-8df2-e4437386b8ab tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:30.811755 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-331c4347-e744-42eb-8df2-e4437386b8ab tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:30.819634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-331c4347-e744-42eb-8df2-e4437386b8ab tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:30.820096 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-331c4347-e744-42eb-8df2-e4437386b8ab tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:30.820865 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-331c4347-e744-42eb-8df2-e4437386b8ab tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:30.821312 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-331c4347-e744-42eb-8df2-e4437386b8ab tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:30.949959 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-331c4347-e744-42eb-8df2-e4437386b8ab tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:30.958692 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-331c4347-e744-42eb-8df2-e4437386b8ab tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1520 microversion: 2.1 time: 0.151521 Jul 19 23:19:30.959289 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3201/6393] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:30 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:31.977048 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9b5314d0-0cb0-4b60-a9f2-542f46fa261c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:31.977694 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9b5314d0-0cb0-4b60-a9f2-542f46fa261c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:31.984543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b5314d0-0cb0-4b60-a9f2-542f46fa261c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:31.984973 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b5314d0-0cb0-4b60-a9f2-542f46fa261c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:31.985726 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b5314d0-0cb0-4b60-a9f2-542f46fa261c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:31.986163 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b5314d0-0cb0-4b60-a9f2-542f46fa261c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:32.118219 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9b5314d0-0cb0-4b60-a9f2-542f46fa261c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:32.125732 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9b5314d0-0cb0-4b60-a9f2-542f46fa261c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1520 microversion: 2.1 time: 0.152645 Jul 19 23:19:32.126305 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3193/6394] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:31 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:33.143255 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1bebec6f-daea-468d-8171-df1bfa986de4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:33.143874 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1bebec6f-daea-468d-8171-df1bfa986de4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:33.150826 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1bebec6f-daea-468d-8171-df1bfa986de4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:33.151346 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1bebec6f-daea-468d-8171-df1bfa986de4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:33.152122 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1bebec6f-daea-468d-8171-df1bfa986de4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:33.152570 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1bebec6f-daea-468d-8171-df1bfa986de4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:33.286669 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1bebec6f-daea-468d-8171-df1bfa986de4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:33.294433 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1bebec6f-daea-468d-8171-df1bfa986de4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1520 microversion: 2.1 time: 0.155310 Jul 19 23:19:33.295011 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3202/6395] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:33 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:34.312422 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4f7901f0-8e3e-4c29-bff6-0b49401a9ff9 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:34.313045 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4f7901f0-8e3e-4c29-bff6-0b49401a9ff9 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:34.320902 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f7901f0-8e3e-4c29-bff6-0b49401a9ff9 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:34.321354 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f7901f0-8e3e-4c29-bff6-0b49401a9ff9 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:34.322128 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f7901f0-8e3e-4c29-bff6-0b49401a9ff9 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:34.322574 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f7901f0-8e3e-4c29-bff6-0b49401a9ff9 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:34.457120 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4f7901f0-8e3e-4c29-bff6-0b49401a9ff9 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:34.465804 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4f7901f0-8e3e-4c29-bff6-0b49401a9ff9 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1520 microversion: 2.1 time: 0.157324 Jul 19 23:19:34.466413 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3194/6396] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:34 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:35.484065 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ee56d6fb-07d9-4104-abbc-1f8413f175a7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:35.484642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ee56d6fb-07d9-4104-abbc-1f8413f175a7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:35.491966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ee56d6fb-07d9-4104-abbc-1f8413f175a7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:35.492419 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ee56d6fb-07d9-4104-abbc-1f8413f175a7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:35.493206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ee56d6fb-07d9-4104-abbc-1f8413f175a7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:35.493751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ee56d6fb-07d9-4104-abbc-1f8413f175a7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:35.625947 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ee56d6fb-07d9-4104-abbc-1f8413f175a7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:35.634252 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ee56d6fb-07d9-4104-abbc-1f8413f175a7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1520 microversion: 2.1 time: 0.154380 Jul 19 23:19:35.634833 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3203/6397] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:35 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:36.651930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-45e309cf-3005-47e8-b4be-3f2e3209c553 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:36.652551 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-45e309cf-3005-47e8-b4be-3f2e3209c553 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:36.660703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-45e309cf-3005-47e8-b4be-3f2e3209c553 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:36.661154 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-45e309cf-3005-47e8-b4be-3f2e3209c553 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:36.662023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-45e309cf-3005-47e8-b4be-3f2e3209c553 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:36.662466 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-45e309cf-3005-47e8-b4be-3f2e3209c553 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:36.798859 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-45e309cf-3005-47e8-b4be-3f2e3209c553 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:36.806497 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-45e309cf-3005-47e8-b4be-3f2e3209c553 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1520 microversion: 2.1 time: 0.158500 Jul 19 23:19:36.807061 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3195/6398] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:36 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:37.824334 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-afdaacf5-808a-4f00-abeb-b2a8e6aa48b2 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:37.824965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-afdaacf5-808a-4f00-abeb-b2a8e6aa48b2 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:37.833443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-afdaacf5-808a-4f00-abeb-b2a8e6aa48b2 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:37.833703 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-afdaacf5-808a-4f00-abeb-b2a8e6aa48b2 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:37.834282 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-afdaacf5-808a-4f00-abeb-b2a8e6aa48b2 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:37.834732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-afdaacf5-808a-4f00-abeb-b2a8e6aa48b2 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:37.965364 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-afdaacf5-808a-4f00-abeb-b2a8e6aa48b2 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:37.973457 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-afdaacf5-808a-4f00-abeb-b2a8e6aa48b2 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1520 microversion: 2.1 time: 0.153093 Jul 19 23:19:37.974076 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3204/6399] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:37 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:38.990855 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fe684510-aa19-41bd-b8b4-ba0255696f79 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:38.991516 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fe684510-aa19-41bd-b8b4-ba0255696f79 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:38.998403 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe684510-aa19-41bd-b8b4-ba0255696f79 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:38.998854 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe684510-aa19-41bd-b8b4-ba0255696f79 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:38.999651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe684510-aa19-41bd-b8b4-ba0255696f79 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:39.000090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe684510-aa19-41bd-b8b4-ba0255696f79 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:39.219462 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fe684510-aa19-41bd-b8b4-ba0255696f79 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:39.227833 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fe684510-aa19-41bd-b8b4-ba0255696f79 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1520 microversion: 2.1 time: 0.240843 Jul 19 23:19:39.228414 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3196/6400] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:38 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:40.244920 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3ef0e7e5-787c-4eec-92f1-5e3bd1aab55e tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:40.245555 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3ef0e7e5-787c-4eec-92f1-5e3bd1aab55e tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:40.253083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ef0e7e5-787c-4eec-92f1-5e3bd1aab55e tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:40.253541 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ef0e7e5-787c-4eec-92f1-5e3bd1aab55e tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:40.254316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ef0e7e5-787c-4eec-92f1-5e3bd1aab55e tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:40.254766 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ef0e7e5-787c-4eec-92f1-5e3bd1aab55e tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:40.741633 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3ef0e7e5-787c-4eec-92f1-5e3bd1aab55e tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:40.749225 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3ef0e7e5-787c-4eec-92f1-5e3bd1aab55e tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1520 microversion: 2.1 time: 0.508309 Jul 19 23:19:40.749794 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3205/6401] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:40 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1520 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:41.766260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9b7d1402-2853-4997-9013-58a692c37130 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:41.766878 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9b7d1402-2853-4997-9013-58a692c37130 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:41.773997 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b7d1402-2853-4997-9013-58a692c37130 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:41.774444 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b7d1402-2853-4997-9013-58a692c37130 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:41.775233 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b7d1402-2853-4997-9013-58a692c37130 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:41.775674 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b7d1402-2853-4997-9013-58a692c37130 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:41.907031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9b7d1402-2853-4997-9013-58a692c37130 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:41.915982 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9b7d1402-2853-4997-9013-58a692c37130 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1520 microversion: 2.1 time: 0.153676 Jul 19 23:19:41.916581 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3197/6402] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:41 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:42.934113 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-35ed4700-f5e7-431c-830c-3251ac280802 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:42.934755 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-35ed4700-f5e7-431c-830c-3251ac280802 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:42.942533 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-35ed4700-f5e7-431c-830c-3251ac280802 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:42.942998 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-35ed4700-f5e7-431c-830c-3251ac280802 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:42.943804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-35ed4700-f5e7-431c-830c-3251ac280802 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:42.944257 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-35ed4700-f5e7-431c-830c-3251ac280802 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:43.079040 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-35ed4700-f5e7-431c-830c-3251ac280802 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:43.087583 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-35ed4700-f5e7-431c-830c-3251ac280802 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1520 microversion: 2.1 time: 0.157450 Jul 19 23:19:43.088185 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3206/6403] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:42 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:44.104150 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-16ca64d5-0871-4948-ad7c-9d184aa77ca9 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:44.104767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-16ca64d5-0871-4948-ad7c-9d184aa77ca9 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:44.111660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16ca64d5-0871-4948-ad7c-9d184aa77ca9 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:44.112106 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16ca64d5-0871-4948-ad7c-9d184aa77ca9 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:44.112864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16ca64d5-0871-4948-ad7c-9d184aa77ca9 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:44.113298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16ca64d5-0871-4948-ad7c-9d184aa77ca9 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:44.245054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-16ca64d5-0871-4948-ad7c-9d184aa77ca9 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:44.248487 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:19:44.253782 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-16ca64d5-0871-4948-ad7c-9d184aa77ca9 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1520 microversion: 2.1 time: 0.153494 Jul 19 23:19:44.254354 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3198/6404] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:44 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:45.269894 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-81824156-1de1-4835-b1aa-3770493b8560 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:45.270646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-81824156-1de1-4835-b1aa-3770493b8560 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:45.277677 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-81824156-1de1-4835-b1aa-3770493b8560 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:45.278147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-81824156-1de1-4835-b1aa-3770493b8560 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:45.278927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-81824156-1de1-4835-b1aa-3770493b8560 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:45.279412 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-81824156-1de1-4835-b1aa-3770493b8560 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:45.413498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-81824156-1de1-4835-b1aa-3770493b8560 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:45.421224 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-81824156-1de1-4835-b1aa-3770493b8560 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1520 microversion: 2.1 time: 0.155287 Jul 19 23:19:45.421805 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3207/6405] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:45 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:46.438123 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7ab70620-fa08-4579-ae90-ee8340120c19 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:46.439802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7ab70620-fa08-4579-ae90-ee8340120c19 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:46.447320 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7ab70620-fa08-4579-ae90-ee8340120c19 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:46.447773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7ab70620-fa08-4579-ae90-ee8340120c19 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:46.448531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7ab70620-fa08-4579-ae90-ee8340120c19 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:46.448965 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7ab70620-fa08-4579-ae90-ee8340120c19 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:46.582104 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7ab70620-fa08-4579-ae90-ee8340120c19 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:46.589638 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7ab70620-fa08-4579-ae90-ee8340120c19 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1520 microversion: 2.1 time: 0.155714 Jul 19 23:19:46.590213 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3199/6406] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:46 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:47.607993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e6f0f0ea-e5df-4a1c-80f3-b08bb81ee7fb tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:47.608630 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e6f0f0ea-e5df-4a1c-80f3-b08bb81ee7fb tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:47.616438 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6f0f0ea-e5df-4a1c-80f3-b08bb81ee7fb tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:47.616904 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6f0f0ea-e5df-4a1c-80f3-b08bb81ee7fb tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:47.617697 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6f0f0ea-e5df-4a1c-80f3-b08bb81ee7fb tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:47.618152 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6f0f0ea-e5df-4a1c-80f3-b08bb81ee7fb tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:47.746678 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e6f0f0ea-e5df-4a1c-80f3-b08bb81ee7fb tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:47.754627 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e6f0f0ea-e5df-4a1c-80f3-b08bb81ee7fb tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1520 microversion: 2.1 time: 0.150577 Jul 19 23:19:47.755231 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3208/6407] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:47 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:48.771206 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dccc6206-3d9e-4ee4-ad00-9622b370611b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:48.771868 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dccc6206-3d9e-4ee4-ad00-9622b370611b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:48.779149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dccc6206-3d9e-4ee4-ad00-9622b370611b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:48.779608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dccc6206-3d9e-4ee4-ad00-9622b370611b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:48.780386 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dccc6206-3d9e-4ee4-ad00-9622b370611b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:48.780825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dccc6206-3d9e-4ee4-ad00-9622b370611b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:48.913745 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dccc6206-3d9e-4ee4-ad00-9622b370611b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:48.921211 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dccc6206-3d9e-4ee4-ad00-9622b370611b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1520 microversion: 2.1 time: 0.154200 Jul 19 23:19:48.921781 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3200/6408] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:48 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:49.938822 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f59d698f-2510-4790-9311-d6a4b406c45b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:49.939614 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f59d698f-2510-4790-9311-d6a4b406c45b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:49.946457 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f59d698f-2510-4790-9311-d6a4b406c45b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:49.946922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f59d698f-2510-4790-9311-d6a4b406c45b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:49.947731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f59d698f-2510-4790-9311-d6a4b406c45b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:49.948192 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f59d698f-2510-4790-9311-d6a4b406c45b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:49.952142 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:19:50.081447 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f59d698f-2510-4790-9311-d6a4b406c45b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:50.089008 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f59d698f-2510-4790-9311-d6a4b406c45b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1520 microversion: 2.1 time: 0.154105 Jul 19 23:19:50.089585 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3209/6409] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:49 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:51.106732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-24c75ffc-99c4-4c48-a912-13347040d983 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:51.107357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-24c75ffc-99c4-4c48-a912-13347040d983 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:51.114493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24c75ffc-99c4-4c48-a912-13347040d983 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:51.114937 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24c75ffc-99c4-4c48-a912-13347040d983 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:51.115732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24c75ffc-99c4-4c48-a912-13347040d983 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:51.116172 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24c75ffc-99c4-4c48-a912-13347040d983 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:51.253847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-24c75ffc-99c4-4c48-a912-13347040d983 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:51.261522 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-24c75ffc-99c4-4c48-a912-13347040d983 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1520 microversion: 2.1 time: 0.158617 Jul 19 23:19:51.262093 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3201/6410] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:51 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:52.278759 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-21ab5338-26b9-4e96-8571-39dd7d7debe1 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:52.279423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-21ab5338-26b9-4e96-8571-39dd7d7debe1 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:52.286894 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-21ab5338-26b9-4e96-8571-39dd7d7debe1 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:52.287392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-21ab5338-26b9-4e96-8571-39dd7d7debe1 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:52.288177 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-21ab5338-26b9-4e96-8571-39dd7d7debe1 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:52.288634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-21ab5338-26b9-4e96-8571-39dd7d7debe1 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:52.419979 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-21ab5338-26b9-4e96-8571-39dd7d7debe1 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:52.427874 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-21ab5338-26b9-4e96-8571-39dd7d7debe1 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1520 microversion: 2.1 time: 0.153089 Jul 19 23:19:52.428470 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3210/6411] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:52 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:53.446574 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-30ab9282-dac1-432f-a3db-57ad5b3a39db tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:53.447321 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-30ab9282-dac1-432f-a3db-57ad5b3a39db tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:53.456068 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-30ab9282-dac1-432f-a3db-57ad5b3a39db tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:53.456847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-30ab9282-dac1-432f-a3db-57ad5b3a39db tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:53.457756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-30ab9282-dac1-432f-a3db-57ad5b3a39db tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:53.458269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-30ab9282-dac1-432f-a3db-57ad5b3a39db tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:53.592431 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-30ab9282-dac1-432f-a3db-57ad5b3a39db tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:53.599930 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-30ab9282-dac1-432f-a3db-57ad5b3a39db tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1520 microversion: 2.1 time: 0.157933 Jul 19 23:19:53.600510 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3202/6412] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:53 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:54.616972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3b633cfd-ccaa-4807-9028-4e5f1c4789c5 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:54.617678 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3b633cfd-ccaa-4807-9028-4e5f1c4789c5 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:54.624899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b633cfd-ccaa-4807-9028-4e5f1c4789c5 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:54.625372 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b633cfd-ccaa-4807-9028-4e5f1c4789c5 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:54.626166 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b633cfd-ccaa-4807-9028-4e5f1c4789c5 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:54.626628 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b633cfd-ccaa-4807-9028-4e5f1c4789c5 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:54.764232 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3b633cfd-ccaa-4807-9028-4e5f1c4789c5 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:54.772314 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3b633cfd-ccaa-4807-9028-4e5f1c4789c5 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1520 microversion: 2.1 time: 0.159327 Jul 19 23:19:54.772902 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3211/6413] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:54 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:55.375667 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:19:55.376272 n-d-847009-3 devstack@n-api.service[119338]: Tue Jul 19 23:19:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:19:55.574224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-49c6d92d-f7cf-4e86-976d-e3fd1cb47fda req-67707a86-4b69-4f01-b813-43ea49713292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bea0e99-3b70-454d-8578-65d55210456e", "name": "network-vif-unplugged", "status": "completed", "tag": "39e112f9-af8a-4886-93b4-e99b08ff990e"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:19:55.578543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=34 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:19:55.585927 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-49c6d92d-f7cf-4e86-976d-e3fd1cb47fda req-67707a86-4b69-4f01-b813-43ea49713292 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:55.586381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-49c6d92d-f7cf-4e86-976d-e3fd1cb47fda req-67707a86-4b69-4f01-b813-43ea49713292 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:55.598923 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-49c6d92d-f7cf-4e86-976d-e3fd1cb47fda req-67707a86-4b69-4f01-b813-43ea49713292 service nova] Creating event network-vif-unplugged:39e112f9-af8a-4886-93b4-e99b08ff990e for instance 0bea0e99-3b70-454d-8578-65d55210456e on n-h2-847009-3 Jul 19 23:19:55.605043 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [req-49c6d92d-f7cf-4e86-976d-e3fd1cb47fda req-67707a86-4b69-4f01-b813-43ea49713292 service nova] Instance 0bea0e99-3b70-454d-8578-65d55210456e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119338) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 23:19:55.621872 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-49c6d92d-f7cf-4e86-976d-e3fd1cb47fda req-67707a86-4b69-4f01-b813-43ea49713292 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046637 Jul 19 23:19:55.621872 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3203/6414] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:19:55.791333 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e4b62527-f9b2-4042-b51f-c6b901024005 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:55.792126 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e4b62527-f9b2-4042-b51f-c6b901024005 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:55.800291 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=28 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:19:55.803150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e4b62527-f9b2-4042-b51f-c6b901024005 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:55.804172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e4b62527-f9b2-4042-b51f-c6b901024005 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:55.804861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e4b62527-f9b2-4042-b51f-c6b901024005 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:55.805359 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e4b62527-f9b2-4042-b51f-c6b901024005 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:56.066931 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e4b62527-f9b2-4042-b51f-c6b901024005 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:56.074652 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e4b62527-f9b2-4042-b51f-c6b901024005 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1519 microversion: 2.1 time: 0.288684 Jul 19 23:19:56.075264 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3212/6415] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:55 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1519 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:57.085636 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:19:57.086298 n-d-847009-3 devstack@n-api.service[119337]: Tue Jul 19 23:19:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:19:57.094652 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ea27cd16-7580-4daf-8cf1-99b27ba21e7c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:57.096094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ea27cd16-7580-4daf-8cf1-99b27ba21e7c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:57.103004 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea27cd16-7580-4daf-8cf1-99b27ba21e7c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:57.103484 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea27cd16-7580-4daf-8cf1-99b27ba21e7c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:57.104267 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea27cd16-7580-4daf-8cf1-99b27ba21e7c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:57.104710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea27cd16-7580-4daf-8cf1-99b27ba21e7c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:57.244076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ea27cd16-7580-4daf-8cf1-99b27ba21e7c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:57.251821 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ea27cd16-7580-4daf-8cf1-99b27ba21e7c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1517 microversion: 2.1 time: 0.162421 Jul 19 23:19:57.252589 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3204/6416] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:57 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:57.639176 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-1303de4e-0cd5-4172-982b-912064b81d31 req-faa1424d-a965-4889-8363-c675082d2ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bea0e99-3b70-454d-8578-65d55210456e", "tag": "39e112f9-af8a-4886-93b4-e99b08ff990e"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:19:57.648540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1303de4e-0cd5-4172-982b-912064b81d31 req-faa1424d-a965-4889-8363-c675082d2ba5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:57.649007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1303de4e-0cd5-4172-982b-912064b81d31 req-faa1424d-a965-4889-8363-c675082d2ba5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:57.661100 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-1303de4e-0cd5-4172-982b-912064b81d31 req-faa1424d-a965-4889-8363-c675082d2ba5 service nova] Creating event network-changed:39e112f9-af8a-4886-93b4-e99b08ff990e for instance 0bea0e99-3b70-454d-8578-65d55210456e on n-h2-847009-3 Jul 19 23:19:57.666633 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [req-1303de4e-0cd5-4172-982b-912064b81d31 req-faa1424d-a965-4889-8363-c675082d2ba5 service nova] Instance 0bea0e99-3b70-454d-8578-65d55210456e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119337) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 23:19:57.679178 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-1303de4e-0cd5-4172-982b-912064b81d31 req-faa1424d-a965-4889-8363-c675082d2ba5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043663 Jul 19 23:19:57.679863 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3213/6417] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:19:58.270398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f1f5b7ee-d51b-427f-be5d-57d23dd6e44b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:58.275101 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f1f5b7ee-d51b-427f-be5d-57d23dd6e44b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:58.282365 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1f5b7ee-d51b-427f-be5d-57d23dd6e44b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:58.282814 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1f5b7ee-d51b-427f-be5d-57d23dd6e44b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:58.284247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1f5b7ee-d51b-427f-be5d-57d23dd6e44b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:58.284710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f1f5b7ee-d51b-427f-be5d-57d23dd6e44b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:58.576285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f1f5b7ee-d51b-427f-be5d-57d23dd6e44b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:58.585250 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f1f5b7ee-d51b-427f-be5d-57d23dd6e44b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1514 microversion: 2.1 time: 0.319651 Jul 19 23:19:58.585841 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3205/6418] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:58 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1514 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:58.602394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-15c401ad-4242-4402-ab15-624c1b784a95 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:19:58.603045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-15c401ad-4242-4402-ab15-624c1b784a95 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:58.609799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-15c401ad-4242-4402-ab15-624c1b784a95 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:58.610272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-15c401ad-4242-4402-ab15-624c1b784a95 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:58.611176 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-15c401ad-4242-4402-ab15-624c1b784a95 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:58.611651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-15c401ad-4242-4402-ab15-624c1b784a95 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:58.681390 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-15c401ad-4242-4402-ab15-624c1b784a95 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "POST /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e/action" status: 204 len: 0 microversion: 2.1 time: 0.083412 Jul 19 23:19:58.682119 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3214/6419] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:19:58 2022] POST /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e/action => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:19:58.692351 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2d7b3773-cf0e-4eae-860a-45cbaf8cf32b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:58.693075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2d7b3773-cf0e-4eae-860a-45cbaf8cf32b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:58.699984 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d7b3773-cf0e-4eae-860a-45cbaf8cf32b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:58.700513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d7b3773-cf0e-4eae-860a-45cbaf8cf32b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:58.701836 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d7b3773-cf0e-4eae-860a-45cbaf8cf32b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:58.702537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d7b3773-cf0e-4eae-860a-45cbaf8cf32b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:58.916785 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2d7b3773-cf0e-4eae-860a-45cbaf8cf32b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:19:58.925079 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2d7b3773-cf0e-4eae-860a-45cbaf8cf32b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1514 microversion: 2.1 time: 0.237124 Jul 19 23:19:58.925655 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3206/6420] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:58 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1514 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:19:59.943522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-61bcbba8-2bf3-4de1-90e4-088fc406cd71 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:19:59.944147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-61bcbba8-2bf3-4de1-90e4-088fc406cd71 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:19:59.951404 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61bcbba8-2bf3-4de1-90e4-088fc406cd71 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:59.951874 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61bcbba8-2bf3-4de1-90e4-088fc406cd71 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:19:59.952679 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61bcbba8-2bf3-4de1-90e4-088fc406cd71 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:19:59.953128 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-61bcbba8-2bf3-4de1-90e4-088fc406cd71 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:00.116597 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-61bcbba8-2bf3-4de1-90e4-088fc406cd71 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:00.124685 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-61bcbba8-2bf3-4de1-90e4-088fc406cd71 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1506 microversion: 2.1 time: 0.186437 Jul 19 23:20:00.125188 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3215/6421] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:19:59 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:00.141947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-48d7d6cc-0f8b-4899-ad0a-9865063437f3 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:00.142827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-48d7d6cc-0f8b-4899-ad0a-9865063437f3 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:00.149898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48d7d6cc-0f8b-4899-ad0a-9865063437f3 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:00.150622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48d7d6cc-0f8b-4899-ad0a-9865063437f3 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:00.151432 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48d7d6cc-0f8b-4899-ad0a-9865063437f3 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:00.151874 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48d7d6cc-0f8b-4899-ad0a-9865063437f3 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:00.324867 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-48d7d6cc-0f8b-4899-ad0a-9865063437f3 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:00.333651 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-48d7d6cc-0f8b-4899-ad0a-9865063437f3 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1506 microversion: 2.1 time: 0.196093 Jul 19 23:20:00.334248 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3207/6422] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:00 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1506 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:00.354374 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-aaa4fca4-7824-42c0-972d-ecc364c654a1 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Action: 'create', calling method: .version_select at 0x7f7a032fa0d0>, body: {"keypair": {"name": "tempest-keypair-408705276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyX860Lycta1zaV+ALDsODQIDNIDQuSc5CEptIhpjR9xDV0mQv9Ug27ljhloZYv+RMJwIwt1wXEQvQPBzfFIKD835kn8Z787SHhmGfXpVMBVKd7mCXg212AyZ9Tz20BCQ=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:20:00.369894 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-aaa4fca4-7824-42c0-972d-ecc364c654a1 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Getting quotas for project be99de8a278748409929647066c0e296. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:20:00.375574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-aaa4fca4-7824-42c0-972d-ecc364c654a1 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Getting quotas for user 26335bfc44d24b9f99e1a10894710c08 and project be99de8a278748409929647066c0e296. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:20:00.413015 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-aaa4fca4-7824-42c0-972d-ecc364c654a1 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.062614 Jul 19 23:20:00.413616 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3216/6423] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 23:20:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:20:01.620851 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1cd5b183-9e0a-4da8-9843-a46b8901d75c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:01.621476 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1cd5b183-9e0a-4da8-9843-a46b8901d75c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:01.629712 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1cd5b183-9e0a-4da8-9843-a46b8901d75c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:01.630166 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1cd5b183-9e0a-4da8-9843-a46b8901d75c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:01.630940 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1cd5b183-9e0a-4da8-9843-a46b8901d75c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:01.631592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1cd5b183-9e0a-4da8-9843-a46b8901d75c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:01.766028 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1cd5b183-9e0a-4da8-9843-a46b8901d75c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:01.773769 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1cd5b183-9e0a-4da8-9843-a46b8901d75c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 200 len: 1506 microversion: 2.1 time: 0.156837 Jul 19 23:20:01.774448 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3208/6424] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:01 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:01.791643 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a4d0f2e5-68bc-4976-a440-eeb1cc88f0b6 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:01.792726 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a4d0f2e5-68bc-4976-a440-eeb1cc88f0b6 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:01.795713 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-f6063b01-e8ee-4b39-afe0-f8fc18bc2e0d req-dde7c039-1a1e-4fbf-8b6a-d9f7fc3d9156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bea0e99-3b70-454d-8578-65d55210456e", "name": "network-vif-plugged", "status": "completed", "tag": "39e112f9-af8a-4886-93b4-e99b08ff990e"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:20:01.801577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a4d0f2e5-68bc-4976-a440-eeb1cc88f0b6 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:01.802387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a4d0f2e5-68bc-4976-a440-eeb1cc88f0b6 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:01.803398 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a4d0f2e5-68bc-4976-a440-eeb1cc88f0b6 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:01.803929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a4d0f2e5-68bc-4976-a440-eeb1cc88f0b6 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:01.804977 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f6063b01-e8ee-4b39-afe0-f8fc18bc2e0d req-dde7c039-1a1e-4fbf-8b6a-d9f7fc3d9156 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:01.805594 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f6063b01-e8ee-4b39-afe0-f8fc18bc2e0d req-dde7c039-1a1e-4fbf-8b6a-d9f7fc3d9156 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:01.820456 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-f6063b01-e8ee-4b39-afe0-f8fc18bc2e0d req-dde7c039-1a1e-4fbf-8b6a-d9f7fc3d9156 service nova] Creating event network-vif-plugged:39e112f9-af8a-4886-93b4-e99b08ff990e for instance 0bea0e99-3b70-454d-8578-65d55210456e on n-h2-847009-3 Jul 19 23:20:01.825811 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-f6063b01-e8ee-4b39-afe0-f8fc18bc2e0d req-dde7c039-1a1e-4fbf-8b6a-d9f7fc3d9156 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034471 Jul 19 23:20:01.826713 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3209/6425] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:20:01.830841 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a4d0f2e5-68bc-4976-a440-eeb1cc88f0b6 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:20:01.911210 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a4d0f2e5-68bc-4976-a440-eeb1cc88f0b6 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 204 len: 0 microversion: 2.1 time: 0.123948 Jul 19 23:20:01.912247 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3217/6426] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:20:01 2022] DELETE /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 23:20:01.975683 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5b72822d-46f8-4682-b1fe-789da65e68a4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-85554541", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "59da1dcc-d9cf-4e0d-9ef9-ec78818ee6e1"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:20:02.026669 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-5b72822d-46f8-4682-b1fe-789da65e68a4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] validate_networks() for [('59da1dcc-d9cf-4e0d-9ef9-ec78818ee6e1', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:20:02.420238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-5b72822d-46f8-4682-b1fe-789da65e68a4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:20:02.420659 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-5b72822d-46f8-4682-b1fe-789da65e68a4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:20:02.421133 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-5b72822d-46f8-4682-b1fe-789da65e68a4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:20:02.421541 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-5b72822d-46f8-4682-b1fe-789da65e68a4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:20:02.421949 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-5b72822d-46f8-4682-b1fe-789da65e68a4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:20:02.431835 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b72822d-46f8-4682-b1fe-789da65e68a4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:02.432285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b72822d-46f8-4682-b1fe-789da65e68a4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:02.433078 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b72822d-46f8-4682-b1fe-789da65e68a4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:02.433517 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b72822d-46f8-4682-b1fe-789da65e68a4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:02.453986 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-5b72822d-46f8-4682-b1fe-789da65e68a4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Getting quotas for project be99de8a278748409929647066c0e296. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:20:02.460487 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-5b72822d-46f8-4682-b1fe-789da65e68a4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Getting quotas for user 26335bfc44d24b9f99e1a10894710c08 and project be99de8a278748409929647066c0e296. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:20:02.473292 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5b72822d-46f8-4682-b1fe-789da65e68a4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:20:02.475718 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5b72822d-46f8-4682-b1fe-789da65e68a4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:20:02.521909 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5b72822d-46f8-4682-b1fe-789da65e68a4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550980 Jul 19 23:20:02.522601 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3210/6427] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:20:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 23:20:02.534774 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9c46fc91-67c7-424f-bcc9-540a4ad10be4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:02.535548 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9c46fc91-67c7-424f-bcc9-540a4ad10be4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:02.592439 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9c46fc91-67c7-424f-bcc9-540a4ad10be4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:02.607357 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9c46fc91-67c7-424f-bcc9-540a4ad10be4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1216 microversion: 2.1 time: 0.078031 Jul 19 23:20:02.608151 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3218/6428] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:02 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1216 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:03.626556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2119eb2a-0c8a-4bf8-9242-d8f4a812a832 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:03.628455 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2119eb2a-0c8a-4bf8-9242-d8f4a812a832 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:03.638529 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2119eb2a-0c8a-4bf8-9242-d8f4a812a832 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:03.639066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2119eb2a-0c8a-4bf8-9242-d8f4a812a832 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:03.640221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2119eb2a-0c8a-4bf8-9242-d8f4a812a832 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:03.640869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2119eb2a-0c8a-4bf8-9242-d8f4a812a832 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:03.719433 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2119eb2a-0c8a-4bf8-9242-d8f4a812a832 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:03.737848 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2119eb2a-0c8a-4bf8-9242-d8f4a812a832 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1268 microversion: 2.1 time: 0.115882 Jul 19 23:20:03.739941 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3211/6429] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:03 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1268 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:20:04.093114 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-bb3797c3-feba-4a7e-ad8e-bd05ddc3855c req-7b95e81c-fcde-4431-9a16-352504ada617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bea0e99-3b70-454d-8578-65d55210456e", "name": "network-vif-deleted", "tag": "39e112f9-af8a-4886-93b4-e99b08ff990e"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:20:04.112905 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-bb3797c3-feba-4a7e-ad8e-bd05ddc3855c req-7b95e81c-fcde-4431-9a16-352504ada617 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:04.113675 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-bb3797c3-feba-4a7e-ad8e-bd05ddc3855c req-7b95e81c-fcde-4431-9a16-352504ada617 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:04.125670 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-bb3797c3-feba-4a7e-ad8e-bd05ddc3855c req-7b95e81c-fcde-4431-9a16-352504ada617 service nova] Creating event network-vif-deleted:39e112f9-af8a-4886-93b4-e99b08ff990e for instance 0bea0e99-3b70-454d-8578-65d55210456e on n-h2-847009-3 Jul 19 23:20:04.132855 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-bb3797c3-feba-4a7e-ad8e-bd05ddc3855c req-7b95e81c-fcde-4431-9a16-352504ada617 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043687 Jul 19 23:20:04.134305 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3219/6430] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:20:04.757570 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1b963924-a512-48d0-9490-b62ebdf7d62d tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:04.758135 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1b963924-a512-48d0-9490-b62ebdf7d62d tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:04.765112 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b963924-a512-48d0-9490-b62ebdf7d62d tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:04.765562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b963924-a512-48d0-9490-b62ebdf7d62d tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:04.766327 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b963924-a512-48d0-9490-b62ebdf7d62d tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:04.766817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1b963924-a512-48d0-9490-b62ebdf7d62d tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:04.921221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1b963924-a512-48d0-9490-b62ebdf7d62d tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:04.930095 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1b963924-a512-48d0-9490-b62ebdf7d62d tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1316 microversion: 2.1 time: 0.176667 Jul 19 23:20:04.939573 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3212/6431] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:04 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:05.578646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-b730c426-179c-4178-9a95-9fd4e7e6cc9f req-de3fe8da-1f4a-495e-a9e6-c5d672848fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "915f076f-8179-469b-950d-bfe412d3c038", "tag": "d55a48a7-17a4-4457-b29d-74d59f0b6b21"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:20:05.601471 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b730c426-179c-4178-9a95-9fd4e7e6cc9f req-de3fe8da-1f4a-495e-a9e6-c5d672848fb4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:05.603260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b730c426-179c-4178-9a95-9fd4e7e6cc9f req-de3fe8da-1f4a-495e-a9e6-c5d672848fb4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:05.621727 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-b730c426-179c-4178-9a95-9fd4e7e6cc9f req-de3fe8da-1f4a-495e-a9e6-c5d672848fb4 service nova] Creating event network-changed:d55a48a7-17a4-4457-b29d-74d59f0b6b21 for instance 915f076f-8179-469b-950d-bfe412d3c038 on n-h2-847009-3 Jul 19 23:20:05.627826 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-b730c426-179c-4178-9a95-9fd4e7e6cc9f req-de3fe8da-1f4a-495e-a9e6-c5d672848fb4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060799 Jul 19 23:20:05.628437 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3220/6432] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:20:05.948593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-83addf5e-c70c-45f3-95d8-7988a2129204 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:05.949190 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-83addf5e-c70c-45f3-95d8-7988a2129204 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:05.957014 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-83addf5e-c70c-45f3-95d8-7988a2129204 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:05.957476 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-83addf5e-c70c-45f3-95d8-7988a2129204 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:05.958251 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-83addf5e-c70c-45f3-95d8-7988a2129204 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:05.958691 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-83addf5e-c70c-45f3-95d8-7988a2129204 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:06.097317 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-83addf5e-c70c-45f3-95d8-7988a2129204 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:06.105304 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-83addf5e-c70c-45f3-95d8-7988a2129204 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1316 microversion: 2.1 time: 0.160537 Jul 19 23:20:06.105885 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3213/6433] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:05 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:07.123217 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-474acaa3-886a-4c61-a335-41ea17fd4674 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:07.124062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-474acaa3-886a-4c61-a335-41ea17fd4674 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:07.131626 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-474acaa3-886a-4c61-a335-41ea17fd4674 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:07.132084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-474acaa3-886a-4c61-a335-41ea17fd4674 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:07.132925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-474acaa3-886a-4c61-a335-41ea17fd4674 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:07.133712 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-474acaa3-886a-4c61-a335-41ea17fd4674 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:07.277159 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-474acaa3-886a-4c61-a335-41ea17fd4674 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:07.285548 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-474acaa3-886a-4c61-a335-41ea17fd4674 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1316 microversion: 2.1 time: 0.166662 Jul 19 23:20:07.286128 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3221/6434] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:07 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:08.302626 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-66c8da0c-9af3-4e2a-a974-06488ae0670c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:08.303295 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-66c8da0c-9af3-4e2a-a974-06488ae0670c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:08.310266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66c8da0c-9af3-4e2a-a974-06488ae0670c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:08.310723 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66c8da0c-9af3-4e2a-a974-06488ae0670c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:08.311548 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66c8da0c-9af3-4e2a-a974-06488ae0670c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:08.311985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66c8da0c-9af3-4e2a-a974-06488ae0670c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:08.439199 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-66c8da0c-9af3-4e2a-a974-06488ae0670c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:08.446784 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-66c8da0c-9af3-4e2a-a974-06488ae0670c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1316 microversion: 2.1 time: 0.148885 Jul 19 23:20:08.447399 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3214/6435] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:08 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:09.469175 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b692dafb-040b-4811-9baf-e0f92ceb6fe0 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:09.469733 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b692dafb-040b-4811-9baf-e0f92ceb6fe0 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:09.477564 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b692dafb-040b-4811-9baf-e0f92ceb6fe0 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:09.478040 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b692dafb-040b-4811-9baf-e0f92ceb6fe0 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:09.478836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b692dafb-040b-4811-9baf-e0f92ceb6fe0 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:09.479338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b692dafb-040b-4811-9baf-e0f92ceb6fe0 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:09.613461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b692dafb-040b-4811-9baf-e0f92ceb6fe0 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:09.621541 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b692dafb-040b-4811-9baf-e0f92ceb6fe0 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1316 microversion: 2.1 time: 0.161265 Jul 19 23:20:09.622117 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3222/6436] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:09 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:10.638000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-00ae6804-25df-4240-a512-459e5e36cb5b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:10.638617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-00ae6804-25df-4240-a512-459e5e36cb5b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:10.645650 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00ae6804-25df-4240-a512-459e5e36cb5b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:10.646154 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00ae6804-25df-4240-a512-459e5e36cb5b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:10.646922 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00ae6804-25df-4240-a512-459e5e36cb5b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:10.647396 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00ae6804-25df-4240-a512-459e5e36cb5b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:10.776564 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-00ae6804-25df-4240-a512-459e5e36cb5b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:10.784739 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-00ae6804-25df-4240-a512-459e5e36cb5b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1316 microversion: 2.1 time: 0.150559 Jul 19 23:20:10.785323 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3215/6437] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:10 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:11.802157 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a9167327-5743-4591-8a63-e09c97e5dd3b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:11.803044 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a9167327-5743-4591-8a63-e09c97e5dd3b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:11.810474 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9167327-5743-4591-8a63-e09c97e5dd3b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:11.810954 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9167327-5743-4591-8a63-e09c97e5dd3b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:11.811760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9167327-5743-4591-8a63-e09c97e5dd3b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:11.812218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a9167327-5743-4591-8a63-e09c97e5dd3b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:11.846015 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-e018630b-d144-4b21-91c5-d9eb28fa0d52 req-bd20e5ab-331d-44b9-9144-24bc5d7c879e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "915f076f-8179-469b-950d-bfe412d3c038", "name": "network-vif-plugged", "status": "completed", "tag": "d55a48a7-17a4-4457-b29d-74d59f0b6b21"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:20:11.857362 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e018630b-d144-4b21-91c5-d9eb28fa0d52 req-bd20e5ab-331d-44b9-9144-24bc5d7c879e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:11.858048 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e018630b-d144-4b21-91c5-d9eb28fa0d52 req-bd20e5ab-331d-44b9-9144-24bc5d7c879e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:11.871034 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-e018630b-d144-4b21-91c5-d9eb28fa0d52 req-bd20e5ab-331d-44b9-9144-24bc5d7c879e service nova] Creating event network-vif-plugged:d55a48a7-17a4-4457-b29d-74d59f0b6b21 for instance 915f076f-8179-469b-950d-bfe412d3c038 on n-h2-847009-3 Jul 19 23:20:11.876321 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-e018630b-d144-4b21-91c5-d9eb28fa0d52 req-bd20e5ab-331d-44b9-9144-24bc5d7c879e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034813 Jul 19 23:20:11.877380 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3216/6438] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:20:11.964263 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a9167327-5743-4591-8a63-e09c97e5dd3b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:11.971959 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a9167327-5743-4591-8a63-e09c97e5dd3b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1316 microversion: 2.1 time: 0.174813 Jul 19 23:20:11.972544 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3223/6439] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:11 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1316 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:12.991746 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d04be939-288d-4fda-9ba0-b4e275fe1d66 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:12.992600 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d04be939-288d-4fda-9ba0-b4e275fe1d66 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:12.994617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:20:12.995449 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:20:13.004290 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d04be939-288d-4fda-9ba0-b4e275fe1d66 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:13.005296 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d04be939-288d-4fda-9ba0-b4e275fe1d66 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:13.006266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d04be939-288d-4fda-9ba0-b4e275fe1d66 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:13.007230 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d04be939-288d-4fda-9ba0-b4e275fe1d66 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:13.154556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d04be939-288d-4fda-9ba0-b4e275fe1d66 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:13.158025 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=100 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:20:13.164664 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d04be939-288d-4fda-9ba0-b4e275fe1d66 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1505 microversion: 2.1 time: 0.178897 Jul 19 23:20:13.165260 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3217/6440] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:12 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1505 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:13.181966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-248a7944-2378-4c41-bc0f-042e4e664c8a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:13.182540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-248a7944-2378-4c41-bc0f-042e4e664c8a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:13.184557 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:20:13.191353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-248a7944-2378-4c41-bc0f-042e4e664c8a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:13.191819 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-248a7944-2378-4c41-bc0f-042e4e664c8a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:13.192607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-248a7944-2378-4c41-bc0f-042e4e664c8a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:13.193058 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-248a7944-2378-4c41-bc0f-042e4e664c8a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:13.329508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-248a7944-2378-4c41-bc0f-042e4e664c8a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:13.338287 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-248a7944-2378-4c41-bc0f-042e4e664c8a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1505 microversion: 2.1 time: 0.160277 Jul 19 23:20:13.338866 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3224/6441] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:13 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:13.354174 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-261b7453-d58e-4b69-8084-3d7625def8fc tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:20:13.355217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-261b7453-d58e-4b69-8084-3d7625def8fc tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:13.361325 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-261b7453-d58e-4b69-8084-3d7625def8fc tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:13.362402 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-261b7453-d58e-4b69-8084-3d7625def8fc tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:13.363197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-261b7453-d58e-4b69-8084-3d7625def8fc tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:13.363641 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-261b7453-d58e-4b69-8084-3d7625def8fc tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:13.391493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-261b7453-d58e-4b69-8084-3d7625def8fc tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:13.397551 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-261b7453-d58e-4b69-8084-3d7625def8fc tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Old instance type m1.heat2, new instance type m1.heat {{(pid=119338) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 23:20:13.403787 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-261b7453-d58e-4b69-8084-3d7625def8fc tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:20:13.404217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-261b7453-d58e-4b69-8084-3d7625def8fc tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:20:13.404732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-261b7453-d58e-4b69-8084-3d7625def8fc tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:20:13.405152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-261b7453-d58e-4b69-8084-3d7625def8fc tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:20:13.405569 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-261b7453-d58e-4b69-8084-3d7625def8fc tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:20:13.467897 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-261b7453-d58e-4b69-8084-3d7625def8fc tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "POST /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038/action" status: 202 len: 0 microversion: 2.1 time: 0.117425 Jul 19 23:20:13.468911 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3218/6442] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:20:13 2022] POST /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:20:13.477088 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0ee322cf-6d39-415b-a81a-cc08d5a42dd5 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:13.477875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0ee322cf-6d39-415b-a81a-cc08d5a42dd5 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:13.484321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ee322cf-6d39-415b-a81a-cc08d5a42dd5 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:13.484822 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ee322cf-6d39-415b-a81a-cc08d5a42dd5 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:13.486036 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ee322cf-6d39-415b-a81a-cc08d5a42dd5 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:13.486141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ee322cf-6d39-415b-a81a-cc08d5a42dd5 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:13.633014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0ee322cf-6d39-415b-a81a-cc08d5a42dd5 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:13.641424 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0ee322cf-6d39-415b-a81a-cc08d5a42dd5 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1512 microversion: 2.1 time: 0.168153 Jul 19 23:20:13.642013 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3225/6443] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:13 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:14.660810 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-28278128-8684-4405-8691-967d179cc13c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:14.661438 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-28278128-8684-4405-8691-967d179cc13c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:14.667612 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-28278128-8684-4405-8691-967d179cc13c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:14.668068 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-28278128-8684-4405-8691-967d179cc13c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:14.668846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-28278128-8684-4405-8691-967d179cc13c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:14.669492 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-28278128-8684-4405-8691-967d179cc13c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:14.809294 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-28278128-8684-4405-8691-967d179cc13c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:14.817467 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-28278128-8684-4405-8691-967d179cc13c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1512 microversion: 2.1 time: 0.162174 Jul 19 23:20:14.818087 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3219/6444] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:14 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:15.834909 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-da24a5b3-d1e8-4d8e-8db8-e9c9b9c1a354 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:15.835575 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-da24a5b3-d1e8-4d8e-8db8-e9c9b9c1a354 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:15.842504 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-da24a5b3-d1e8-4d8e-8db8-e9c9b9c1a354 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:15.842975 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-da24a5b3-d1e8-4d8e-8db8-e9c9b9c1a354 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:15.843802 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-da24a5b3-d1e8-4d8e-8db8-e9c9b9c1a354 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:15.844261 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-da24a5b3-d1e8-4d8e-8db8-e9c9b9c1a354 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:15.862723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:20:15.983008 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-da24a5b3-d1e8-4d8e-8db8-e9c9b9c1a354 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:15.990705 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-da24a5b3-d1e8-4d8e-8db8-e9c9b9c1a354 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1517 microversion: 2.1 time: 0.160443 Jul 19 23:20:15.991328 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3226/6445] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:15 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:17.008580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e32639f5-846c-42f6-b242-6e2c3395543a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:17.009161 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e32639f5-846c-42f6-b242-6e2c3395543a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:17.016593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e32639f5-846c-42f6-b242-6e2c3395543a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:17.017393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e32639f5-846c-42f6-b242-6e2c3395543a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:17.018622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e32639f5-846c-42f6-b242-6e2c3395543a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:17.019118 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e32639f5-846c-42f6-b242-6e2c3395543a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:17.151211 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e32639f5-846c-42f6-b242-6e2c3395543a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:17.159483 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e32639f5-846c-42f6-b242-6e2c3395543a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1517 microversion: 2.1 time: 0.154736 Jul 19 23:20:17.160064 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3220/6446] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:17 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:18.176563 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7c22dfb9-5e6d-4b8b-8352-d1f59a3fb208 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:18.177204 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7c22dfb9-5e6d-4b8b-8352-d1f59a3fb208 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:18.184362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7c22dfb9-5e6d-4b8b-8352-d1f59a3fb208 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:18.184832 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7c22dfb9-5e6d-4b8b-8352-d1f59a3fb208 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:18.185624 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7c22dfb9-5e6d-4b8b-8352-d1f59a3fb208 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:18.186079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7c22dfb9-5e6d-4b8b-8352-d1f59a3fb208 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:18.397038 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7c22dfb9-5e6d-4b8b-8352-d1f59a3fb208 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:18.404511 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7c22dfb9-5e6d-4b8b-8352-d1f59a3fb208 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1517 microversion: 2.1 time: 0.232034 Jul 19 23:20:18.405080 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3227/6447] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:18 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1517 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:19.421715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1c528eb8-b54f-48d9-bd3a-23ddd031eab4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:19.422324 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1c528eb8-b54f-48d9-bd3a-23ddd031eab4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:19.429872 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1c528eb8-b54f-48d9-bd3a-23ddd031eab4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:19.430324 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1c528eb8-b54f-48d9-bd3a-23ddd031eab4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:19.431090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1c528eb8-b54f-48d9-bd3a-23ddd031eab4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:19.431570 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1c528eb8-b54f-48d9-bd3a-23ddd031eab4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:19.625014 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1c528eb8-b54f-48d9-bd3a-23ddd031eab4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:19.633583 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1c528eb8-b54f-48d9-bd3a-23ddd031eab4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1517 microversion: 2.1 time: 0.216065 Jul 19 23:20:19.634153 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3221/6448] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:19 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1517 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:20.651980 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8584a4b2-985c-4ad4-89b7-cd74ad44a1b7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:20.652616 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8584a4b2-985c-4ad4-89b7-cd74ad44a1b7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:20.659870 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8584a4b2-985c-4ad4-89b7-cd74ad44a1b7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:20.660339 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8584a4b2-985c-4ad4-89b7-cd74ad44a1b7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:20.661123 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8584a4b2-985c-4ad4-89b7-cd74ad44a1b7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:20.661587 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8584a4b2-985c-4ad4-89b7-cd74ad44a1b7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:20.796857 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8584a4b2-985c-4ad4-89b7-cd74ad44a1b7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:20.804958 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8584a4b2-985c-4ad4-89b7-cd74ad44a1b7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1517 microversion: 2.1 time: 0.156971 Jul 19 23:20:20.805542 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3228/6449] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:20 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:21.822066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-114cd9e0-b989-43ff-a11d-b34aeebe636c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:21.822681 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-114cd9e0-b989-43ff-a11d-b34aeebe636c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:21.829760 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-114cd9e0-b989-43ff-a11d-b34aeebe636c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:21.830468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-114cd9e0-b989-43ff-a11d-b34aeebe636c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:21.831334 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-114cd9e0-b989-43ff-a11d-b34aeebe636c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:21.831772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-114cd9e0-b989-43ff-a11d-b34aeebe636c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:21.964110 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-114cd9e0-b989-43ff-a11d-b34aeebe636c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:21.972137 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-114cd9e0-b989-43ff-a11d-b34aeebe636c tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1517 microversion: 2.1 time: 0.154169 Jul 19 23:20:21.972745 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3222/6450] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:21 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:22.989724 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b9de95a5-524c-4973-a421-b79da6418f45 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:22.990387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b9de95a5-524c-4973-a421-b79da6418f45 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:22.997446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b9de95a5-524c-4973-a421-b79da6418f45 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:22.998003 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b9de95a5-524c-4973-a421-b79da6418f45 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:22.998782 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b9de95a5-524c-4973-a421-b79da6418f45 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:22.999270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b9de95a5-524c-4973-a421-b79da6418f45 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:23.131770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b9de95a5-524c-4973-a421-b79da6418f45 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:23.139435 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b9de95a5-524c-4973-a421-b79da6418f45 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1517 microversion: 2.1 time: 0.154201 Jul 19 23:20:23.140009 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3229/6451] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:22 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:24.157824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5e04e65a-3ff8-4b21-83a3-3c3fc4b41250 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:24.158512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5e04e65a-3ff8-4b21-83a3-3c3fc4b41250 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:24.166118 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e04e65a-3ff8-4b21-83a3-3c3fc4b41250 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:24.166617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e04e65a-3ff8-4b21-83a3-3c3fc4b41250 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:24.167649 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e04e65a-3ff8-4b21-83a3-3c3fc4b41250 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:24.168093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e04e65a-3ff8-4b21-83a3-3c3fc4b41250 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:24.321653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5e04e65a-3ff8-4b21-83a3-3c3fc4b41250 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:24.329591 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5e04e65a-3ff8-4b21-83a3-3c3fc4b41250 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1517 microversion: 2.1 time: 0.175535 Jul 19 23:20:24.331027 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3223/6452] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:24 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1517 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:25.347565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9b4a5317-58be-4b81-8464-ab1b797f83a0 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:25.348205 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9b4a5317-58be-4b81-8464-ab1b797f83a0 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:25.355767 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b4a5317-58be-4b81-8464-ab1b797f83a0 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:25.356238 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b4a5317-58be-4b81-8464-ab1b797f83a0 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:25.357031 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b4a5317-58be-4b81-8464-ab1b797f83a0 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:25.357493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b4a5317-58be-4b81-8464-ab1b797f83a0 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:25.494475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9b4a5317-58be-4b81-8464-ab1b797f83a0 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:25.503339 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9b4a5317-58be-4b81-8464-ab1b797f83a0 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1517 microversion: 2.1 time: 0.159775 Jul 19 23:20:25.503931 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3230/6453] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:25 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:26.521129 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-248cdb16-e58d-49de-883e-82ee2cd9d4ce tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:26.521694 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-248cdb16-e58d-49de-883e-82ee2cd9d4ce tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:26.524370 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:20:26.529873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-248cdb16-e58d-49de-883e-82ee2cd9d4ce tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:26.530326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-248cdb16-e58d-49de-883e-82ee2cd9d4ce tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:26.531094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-248cdb16-e58d-49de-883e-82ee2cd9d4ce tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:26.531559 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-248cdb16-e58d-49de-883e-82ee2cd9d4ce tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:26.666623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-248cdb16-e58d-49de-883e-82ee2cd9d4ce tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:26.674770 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-248cdb16-e58d-49de-883e-82ee2cd9d4ce tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1517 microversion: 2.1 time: 0.158262 Jul 19 23:20:26.675379 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3224/6454] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:26 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:27.692172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-437a41b1-d507-46fd-941e-163514df185f tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:27.692805 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-437a41b1-d507-46fd-941e-163514df185f tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:27.695537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:20:27.701089 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-437a41b1-d507-46fd-941e-163514df185f tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:27.701550 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-437a41b1-d507-46fd-941e-163514df185f tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:27.702331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-437a41b1-d507-46fd-941e-163514df185f tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:27.702780 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-437a41b1-d507-46fd-941e-163514df185f tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:27.838382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-437a41b1-d507-46fd-941e-163514df185f tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:27.846507 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-437a41b1-d507-46fd-941e-163514df185f tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1517 microversion: 2.1 time: 0.158463 Jul 19 23:20:27.847081 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3231/6455] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:27 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:28.864677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ee0855ac-176f-42f7-985b-9d790001392e tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:28.865298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ee0855ac-176f-42f7-985b-9d790001392e tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:28.872323 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee0855ac-176f-42f7-985b-9d790001392e tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:28.872775 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee0855ac-176f-42f7-985b-9d790001392e tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:28.873541 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee0855ac-176f-42f7-985b-9d790001392e tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:28.873987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ee0855ac-176f-42f7-985b-9d790001392e tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:29.005584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ee0855ac-176f-42f7-985b-9d790001392e tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:29.013122 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ee0855ac-176f-42f7-985b-9d790001392e tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1517 microversion: 2.1 time: 0.153530 Jul 19 23:20:29.013700 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3225/6456] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:28 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:30.030460 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2974d015-8945-4a74-a16d-8bf09766e406 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:30.031150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2974d015-8945-4a74-a16d-8bf09766e406 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:30.039191 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2974d015-8945-4a74-a16d-8bf09766e406 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:30.039612 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2974d015-8945-4a74-a16d-8bf09766e406 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:30.040390 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2974d015-8945-4a74-a16d-8bf09766e406 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:30.040841 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2974d015-8945-4a74-a16d-8bf09766e406 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:30.181593 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2974d015-8945-4a74-a16d-8bf09766e406 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:30.189280 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2974d015-8945-4a74-a16d-8bf09766e406 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1517 microversion: 2.1 time: 0.162760 Jul 19 23:20:30.189882 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3232/6457] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:30 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:31.206754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3f5fb858-7783-4b87-abc4-ce1a0a2f3d2e tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:31.207477 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3f5fb858-7783-4b87-abc4-ce1a0a2f3d2e tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:31.214533 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3f5fb858-7783-4b87-abc4-ce1a0a2f3d2e tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:31.214981 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3f5fb858-7783-4b87-abc4-ce1a0a2f3d2e tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:31.215886 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3f5fb858-7783-4b87-abc4-ce1a0a2f3d2e tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:31.216279 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3f5fb858-7783-4b87-abc4-ce1a0a2f3d2e tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:31.350278 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3f5fb858-7783-4b87-abc4-ce1a0a2f3d2e tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:31.397527 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3f5fb858-7783-4b87-abc4-ce1a0a2f3d2e tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1517 microversion: 2.1 time: 0.156117 Jul 19 23:20:31.397527 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3226/6458] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:31 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:32.375855 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-50f129ea-f4c2-467e-aa93-3a8b5565d2c4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:32.376494 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-50f129ea-f4c2-467e-aa93-3a8b5565d2c4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:32.384094 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-50f129ea-f4c2-467e-aa93-3a8b5565d2c4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:32.384988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-50f129ea-f4c2-467e-aa93-3a8b5565d2c4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:32.385319 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-50f129ea-f4c2-467e-aa93-3a8b5565d2c4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:32.385766 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-50f129ea-f4c2-467e-aa93-3a8b5565d2c4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:32.859930 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-50f129ea-f4c2-467e-aa93-3a8b5565d2c4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:32.868503 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-50f129ea-f4c2-467e-aa93-3a8b5565d2c4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1517 microversion: 2.1 time: 0.496544 Jul 19 23:20:32.869109 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3233/6459] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:32 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1517 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:20:33.887803 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d5ee48a6-8118-4385-930d-e4a6753932c4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:33.888423 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d5ee48a6-8118-4385-930d-e4a6753932c4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:33.895794 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5ee48a6-8118-4385-930d-e4a6753932c4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:33.896255 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5ee48a6-8118-4385-930d-e4a6753932c4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:33.897050 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5ee48a6-8118-4385-930d-e4a6753932c4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:33.897497 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d5ee48a6-8118-4385-930d-e4a6753932c4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:34.028322 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d5ee48a6-8118-4385-930d-e4a6753932c4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:34.036579 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d5ee48a6-8118-4385-930d-e4a6753932c4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1517 microversion: 2.1 time: 0.154189 Jul 19 23:20:34.037163 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3227/6460] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:33 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:35.054647 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9643b29c-468b-410b-a7c4-839324568555 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:35.055234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9643b29c-468b-410b-a7c4-839324568555 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:35.062576 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9643b29c-468b-410b-a7c4-839324568555 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:35.063070 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9643b29c-468b-410b-a7c4-839324568555 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:35.063914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9643b29c-468b-410b-a7c4-839324568555 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:35.064402 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9643b29c-468b-410b-a7c4-839324568555 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:35.206807 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9643b29c-468b-410b-a7c4-839324568555 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:35.214525 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9643b29c-468b-410b-a7c4-839324568555 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1517 microversion: 2.1 time: 0.164512 Jul 19 23:20:35.215101 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3234/6461] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:35 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:36.232744 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-45ded01f-ff6f-403e-882a-4848257df3f6 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:36.233362 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-45ded01f-ff6f-403e-882a-4848257df3f6 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:36.241707 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-45ded01f-ff6f-403e-882a-4848257df3f6 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:36.242161 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-45ded01f-ff6f-403e-882a-4848257df3f6 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:36.242942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-45ded01f-ff6f-403e-882a-4848257df3f6 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:36.243410 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-45ded01f-ff6f-403e-882a-4848257df3f6 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:36.377832 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-45ded01f-ff6f-403e-882a-4848257df3f6 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:36.385526 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-45ded01f-ff6f-403e-882a-4848257df3f6 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1517 microversion: 2.1 time: 0.156714 Jul 19 23:20:36.386104 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3228/6462] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:36 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:37.403844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-062da07d-193a-471b-8224-33f4e6f89aa7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:37.404506 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-062da07d-193a-471b-8224-33f4e6f89aa7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:37.411544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-062da07d-193a-471b-8224-33f4e6f89aa7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:37.412012 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-062da07d-193a-471b-8224-33f4e6f89aa7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:37.412803 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-062da07d-193a-471b-8224-33f4e6f89aa7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:37.413251 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-062da07d-193a-471b-8224-33f4e6f89aa7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:37.570436 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-062da07d-193a-471b-8224-33f4e6f89aa7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:37.578943 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-062da07d-193a-471b-8224-33f4e6f89aa7 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1517 microversion: 2.1 time: 0.179137 Jul 19 23:20:37.579562 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3235/6463] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:37 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1517 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:38.597218 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-44a9129b-555a-4112-92ce-3845a28bde1d tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:38.597830 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-44a9129b-555a-4112-92ce-3845a28bde1d tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:38.604858 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44a9129b-555a-4112-92ce-3845a28bde1d tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:38.605312 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44a9129b-555a-4112-92ce-3845a28bde1d tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:38.606091 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44a9129b-555a-4112-92ce-3845a28bde1d tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:38.606529 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-44a9129b-555a-4112-92ce-3845a28bde1d tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:38.749267 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-44a9129b-555a-4112-92ce-3845a28bde1d tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:38.763857 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-44a9129b-555a-4112-92ce-3845a28bde1d tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1517 microversion: 2.1 time: 0.170458 Jul 19 23:20:38.764751 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3229/6464] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:38 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:39.782298 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4fe0ae34-e98f-4531-a410-7ec2c2f5f52a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:39.783136 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4fe0ae34-e98f-4531-a410-7ec2c2f5f52a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:39.791051 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4fe0ae34-e98f-4531-a410-7ec2c2f5f52a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:39.791557 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4fe0ae34-e98f-4531-a410-7ec2c2f5f52a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:39.792365 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4fe0ae34-e98f-4531-a410-7ec2c2f5f52a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:39.792833 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4fe0ae34-e98f-4531-a410-7ec2c2f5f52a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:39.929807 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4fe0ae34-e98f-4531-a410-7ec2c2f5f52a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:39.937513 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4fe0ae34-e98f-4531-a410-7ec2c2f5f52a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1517 microversion: 2.1 time: 0.159214 Jul 19 23:20:39.938099 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3236/6465] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:39 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:40.955382 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2d3fb651-a3c1-454e-b2af-a8a70d801fdf tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:40.955999 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2d3fb651-a3c1-454e-b2af-a8a70d801fdf tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:40.964303 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d3fb651-a3c1-454e-b2af-a8a70d801fdf tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:40.964753 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d3fb651-a3c1-454e-b2af-a8a70d801fdf tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:40.965522 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d3fb651-a3c1-454e-b2af-a8a70d801fdf tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:40.965959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2d3fb651-a3c1-454e-b2af-a8a70d801fdf tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:41.107422 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2d3fb651-a3c1-454e-b2af-a8a70d801fdf tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:41.116381 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2d3fb651-a3c1-454e-b2af-a8a70d801fdf tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1517 microversion: 2.1 time: 0.164995 Jul 19 23:20:41.116959 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3230/6466] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:40 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:42.134436 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-032db523-3dd9-458c-9e50-518eabd98751 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:42.135410 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-032db523-3dd9-458c-9e50-518eabd98751 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:42.142747 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-032db523-3dd9-458c-9e50-518eabd98751 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:42.143329 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-032db523-3dd9-458c-9e50-518eabd98751 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:42.144141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-032db523-3dd9-458c-9e50-518eabd98751 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:42.144598 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-032db523-3dd9-458c-9e50-518eabd98751 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:42.354730 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-032db523-3dd9-458c-9e50-518eabd98751 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:42.362648 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-032db523-3dd9-458c-9e50-518eabd98751 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1516 microversion: 2.1 time: 0.232007 Jul 19 23:20:42.363339 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3237/6467] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:42 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1516 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:42.638967 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-7c6b000c-d4a8-4d72-b485-591c98abd41b req-8581b6cc-55e5-42d2-b8a0-2b9087ecf843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "915f076f-8179-469b-950d-bfe412d3c038", "name": "network-vif-unplugged", "status": "completed", "tag": "d55a48a7-17a4-4457-b29d-74d59f0b6b21"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:20:42.649404 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7c6b000c-d4a8-4d72-b485-591c98abd41b req-8581b6cc-55e5-42d2-b8a0-2b9087ecf843 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:42.649970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7c6b000c-d4a8-4d72-b485-591c98abd41b req-8581b6cc-55e5-42d2-b8a0-2b9087ecf843 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:42.663229 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-7c6b000c-d4a8-4d72-b485-591c98abd41b req-8581b6cc-55e5-42d2-b8a0-2b9087ecf843 service nova] Creating event network-vif-unplugged:d55a48a7-17a4-4457-b29d-74d59f0b6b21 for instance 915f076f-8179-469b-950d-bfe412d3c038 on n-h1-847009-3 Jul 19 23:20:42.668777 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [req-7c6b000c-d4a8-4d72-b485-591c98abd41b req-8581b6cc-55e5-42d2-b8a0-2b9087ecf843 service nova] Instance 915f076f-8179-469b-950d-bfe412d3c038 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119338) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 23:20:42.681685 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-7c6b000c-d4a8-4d72-b485-591c98abd41b req-8581b6cc-55e5-42d2-b8a0-2b9087ecf843 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045960 Jul 19 23:20:42.682224 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3231/6468] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:20:43.380658 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b20dd28c-7ab4-489e-8c1a-374227750869 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:43.381313 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b20dd28c-7ab4-489e-8c1a-374227750869 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:43.388436 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b20dd28c-7ab4-489e-8c1a-374227750869 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:43.388851 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b20dd28c-7ab4-489e-8c1a-374227750869 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:43.389643 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b20dd28c-7ab4-489e-8c1a-374227750869 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:43.390102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b20dd28c-7ab4-489e-8c1a-374227750869 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:43.540196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b20dd28c-7ab4-489e-8c1a-374227750869 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:43.548256 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b20dd28c-7ab4-489e-8c1a-374227750869 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1516 microversion: 2.1 time: 0.172286 Jul 19 23:20:43.548844 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3238/6469] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:43 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:44.573130 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9e5f83a3-b5b0-4814-a0b0-91b8ae416353 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:44.573835 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9e5f83a3-b5b0-4814-a0b0-91b8ae416353 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:44.581733 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e5f83a3-b5b0-4814-a0b0-91b8ae416353 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:44.582188 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e5f83a3-b5b0-4814-a0b0-91b8ae416353 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:44.582951 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e5f83a3-b5b0-4814-a0b0-91b8ae416353 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:44.583426 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e5f83a3-b5b0-4814-a0b0-91b8ae416353 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:44.586065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:20:44.696221 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-f56afc15-19f8-4043-9d92-f2e97886a5f7 req-99668ec3-e0af-4a86-9f7b-9183671896be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "915f076f-8179-469b-950d-bfe412d3c038", "tag": "d55a48a7-17a4-4457-b29d-74d59f0b6b21"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:20:44.705417 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-f56afc15-19f8-4043-9d92-f2e97886a5f7 req-99668ec3-e0af-4a86-9f7b-9183671896be service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:44.706399 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-f56afc15-19f8-4043-9d92-f2e97886a5f7 req-99668ec3-e0af-4a86-9f7b-9183671896be service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:44.718270 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-f56afc15-19f8-4043-9d92-f2e97886a5f7 req-99668ec3-e0af-4a86-9f7b-9183671896be service nova] Creating event network-changed:d55a48a7-17a4-4457-b29d-74d59f0b6b21 for instance 915f076f-8179-469b-950d-bfe412d3c038 on n-h1-847009-3 Jul 19 23:20:44.724270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9e5f83a3-b5b0-4814-a0b0-91b8ae416353 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:44.724890 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [req-f56afc15-19f8-4043-9d92-f2e97886a5f7 req-99668ec3-e0af-4a86-9f7b-9183671896be service nova] Instance 915f076f-8179-469b-950d-bfe412d3c038 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119337) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 23:20:44.731795 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9e5f83a3-b5b0-4814-a0b0-91b8ae416353 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1514 microversion: 2.1 time: 0.162963 Jul 19 23:20:44.732375 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3232/6470] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:44 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:44.735948 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-f56afc15-19f8-4043-9d92-f2e97886a5f7 req-99668ec3-e0af-4a86-9f7b-9183671896be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043460 Jul 19 23:20:44.736627 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3239/6471] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:20:45.749506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c3cdba17-2abf-4ae1-9ef8-b2830618c660 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:45.750120 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c3cdba17-2abf-4ae1-9ef8-b2830618c660 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:45.757133 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c3cdba17-2abf-4ae1-9ef8-b2830618c660 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:45.757577 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c3cdba17-2abf-4ae1-9ef8-b2830618c660 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:45.758360 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c3cdba17-2abf-4ae1-9ef8-b2830618c660 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:45.758793 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c3cdba17-2abf-4ae1-9ef8-b2830618c660 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:45.894358 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c3cdba17-2abf-4ae1-9ef8-b2830618c660 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:45.901941 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c3cdba17-2abf-4ae1-9ef8-b2830618c660 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1511 microversion: 2.1 time: 0.156275 Jul 19 23:20:45.902511 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3233/6472] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:45 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:45.920170 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-31a6513c-5226-4227-a21e-ee2b4a1b8ed8 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:20:45.920825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-31a6513c-5226-4227-a21e-ee2b4a1b8ed8 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:45.928193 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31a6513c-5226-4227-a21e-ee2b4a1b8ed8 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:45.928668 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31a6513c-5226-4227-a21e-ee2b4a1b8ed8 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:45.929471 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31a6513c-5226-4227-a21e-ee2b4a1b8ed8 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:45.929933 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31a6513c-5226-4227-a21e-ee2b4a1b8ed8 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:45.934218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=79 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:20:45.990989 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-31a6513c-5226-4227-a21e-ee2b4a1b8ed8 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "POST /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038/action" status: 204 len: 0 microversion: 2.1 time: 0.075940 Jul 19 23:20:45.991796 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3240/6473] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:20:45 2022] POST /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:20:46.001595 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4b14eff6-c957-4f6d-95a9-a39291dc13ce tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:46.002594 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4b14eff6-c957-4f6d-95a9-a39291dc13ce tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:46.011952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b14eff6-c957-4f6d-95a9-a39291dc13ce tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:46.012643 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b14eff6-c957-4f6d-95a9-a39291dc13ce tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:46.013937 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b14eff6-c957-4f6d-95a9-a39291dc13ce tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:46.014619 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b14eff6-c957-4f6d-95a9-a39291dc13ce tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:46.161159 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4b14eff6-c957-4f6d-95a9-a39291dc13ce tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:46.169038 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4b14eff6-c957-4f6d-95a9-a39291dc13ce tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1511 microversion: 2.1 time: 0.172954 Jul 19 23:20:46.169634 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3234/6474] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:45 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:47.187446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1d3e8c4a-ae7c-4e4d-bea8-4af6c81d108a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:47.188128 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1d3e8c4a-ae7c-4e4d-bea8-4af6c81d108a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:47.195847 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d3e8c4a-ae7c-4e4d-bea8-4af6c81d108a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:47.196316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d3e8c4a-ae7c-4e4d-bea8-4af6c81d108a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:47.197270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d3e8c4a-ae7c-4e4d-bea8-4af6c81d108a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:47.197550 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1d3e8c4a-ae7c-4e4d-bea8-4af6c81d108a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:47.343829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1d3e8c4a-ae7c-4e4d-bea8-4af6c81d108a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:47.352721 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1d3e8c4a-ae7c-4e4d-bea8-4af6c81d108a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1503 microversion: 2.1 time: 0.170525 Jul 19 23:20:47.353315 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3241/6475] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:47 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:47.370108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-79fd88ad-2232-4be1-8f26-35dabfee2a32 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:47.371444 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-79fd88ad-2232-4be1-8f26-35dabfee2a32 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:47.379542 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79fd88ad-2232-4be1-8f26-35dabfee2a32 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:47.379703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79fd88ad-2232-4be1-8f26-35dabfee2a32 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:47.380547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79fd88ad-2232-4be1-8f26-35dabfee2a32 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:47.380972 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79fd88ad-2232-4be1-8f26-35dabfee2a32 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:47.531909 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-79fd88ad-2232-4be1-8f26-35dabfee2a32 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:47.539629 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-79fd88ad-2232-4be1-8f26-35dabfee2a32 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1503 microversion: 2.1 time: 0.173494 Jul 19 23:20:47.540205 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3235/6476] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:47 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:47.555432 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-736a8583-018d-4d7c-949d-d8fcfc47f462 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:47.556006 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-736a8583-018d-4d7c-949d-d8fcfc47f462 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:47.562123 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-736a8583-018d-4d7c-949d-d8fcfc47f462 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:47.562588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-736a8583-018d-4d7c-949d-d8fcfc47f462 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:47.563401 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-736a8583-018d-4d7c-949d-d8fcfc47f462 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:47.563857 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-736a8583-018d-4d7c-949d-d8fcfc47f462 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:47.695434 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-736a8583-018d-4d7c-949d-d8fcfc47f462 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:47.702958 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-736a8583-018d-4d7c-949d-d8fcfc47f462 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1503 microversion: 2.1 time: 0.151513 Jul 19 23:20:47.703568 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3242/6477] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:47 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:47.719076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9e4f45fb-ce91-49ba-aefa-7475d7c08e1d tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:47.719601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9e4f45fb-ce91-49ba-aefa-7475d7c08e1d tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:47.726493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e4f45fb-ce91-49ba-aefa-7475d7c08e1d tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:47.726948 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e4f45fb-ce91-49ba-aefa-7475d7c08e1d tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:47.727733 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e4f45fb-ce91-49ba-aefa-7475d7c08e1d tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:47.728172 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e4f45fb-ce91-49ba-aefa-7475d7c08e1d tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:47.754526 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9e4f45fb-ce91-49ba-aefa-7475d7c08e1d tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:20:47.828933 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9e4f45fb-ce91-49ba-aefa-7475d7c08e1d tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "DELETE /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 204 len: 0 microversion: 2.1 time: 0.113386 Jul 19 23:20:47.829902 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3236/6478] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:20:47 2022] DELETE /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:20:47.846842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4e36d04d-0f67-4fee-9f94-fd7075c1ba01 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:47.847530 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4e36d04d-0f67-4fee-9f94-fd7075c1ba01 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:47.853670 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4e36d04d-0f67-4fee-9f94-fd7075c1ba01 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:47.854137 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4e36d04d-0f67-4fee-9f94-fd7075c1ba01 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:47.854916 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4e36d04d-0f67-4fee-9f94-fd7075c1ba01 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:47.855394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4e36d04d-0f67-4fee-9f94-fd7075c1ba01 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:47.881483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4e36d04d-0f67-4fee-9f94-fd7075c1ba01 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:20:47.925408 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.compute.api [None req-4e36d04d-0f67-4fee-9f94-fd7075c1ba01 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Instance is already in deleting state, ignoring this request Jul 19 23:20:47.926255 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4e36d04d-0f67-4fee-9f94-fd7075c1ba01 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "DELETE /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 204 len: 0 microversion: 2.1 time: 0.083425 Jul 19 23:20:47.926818 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3243/6479] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:20:47 2022] DELETE /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:20:47.935318 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b9bc1f68-0025-4ed0-870c-5fce2933be0a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:47.936080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b9bc1f68-0025-4ed0-870c-5fce2933be0a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:47.942875 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b9bc1f68-0025-4ed0-870c-5fce2933be0a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:47.943353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b9bc1f68-0025-4ed0-870c-5fce2933be0a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:47.944113 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b9bc1f68-0025-4ed0-870c-5fce2933be0a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:47.944543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b9bc1f68-0025-4ed0-870c-5fce2933be0a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:48.079523 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b9bc1f68-0025-4ed0-870c-5fce2933be0a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:48.087886 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b9bc1f68-0025-4ed0-870c-5fce2933be0a tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1509 microversion: 2.1 time: 0.156684 Jul 19 23:20:48.088503 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3237/6480] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:47 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:48.992467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-b49616cd-f875-436a-93a4-1d3cee74bdfc req-c65f2b6f-bc7f-4b95-858e-764836f48020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "915f076f-8179-469b-950d-bfe412d3c038", "name": "network-vif-plugged", "status": "completed", "tag": "d55a48a7-17a4-4457-b29d-74d59f0b6b21"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:20:49.001181 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b49616cd-f875-436a-93a4-1d3cee74bdfc req-c65f2b6f-bc7f-4b95-858e-764836f48020 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:49.001870 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b49616cd-f875-436a-93a4-1d3cee74bdfc req-c65f2b6f-bc7f-4b95-858e-764836f48020 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:49.014686 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-b49616cd-f875-436a-93a4-1d3cee74bdfc req-c65f2b6f-bc7f-4b95-858e-764836f48020 service nova] Creating event network-vif-plugged:d55a48a7-17a4-4457-b29d-74d59f0b6b21 for instance 915f076f-8179-469b-950d-bfe412d3c038 on n-h1-847009-3 Jul 19 23:20:49.020294 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-b49616cd-f875-436a-93a4-1d3cee74bdfc req-c65f2b6f-bc7f-4b95-858e-764836f48020 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031541 Jul 19 23:20:49.020902 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3244/6481] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:20:49.105799 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0ef30f45-63c4-414a-93e2-471375dcb66b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:49.106423 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0ef30f45-63c4-414a-93e2-471375dcb66b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:49.114502 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ef30f45-63c4-414a-93e2-471375dcb66b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:49.114957 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ef30f45-63c4-414a-93e2-471375dcb66b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:49.115770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ef30f45-63c4-414a-93e2-471375dcb66b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:49.116213 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ef30f45-63c4-414a-93e2-471375dcb66b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:49.246247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0ef30f45-63c4-414a-93e2-471375dcb66b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26335bfc44d24b9f99e1a10894710c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99de8a278748409929647066c0e296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:20:49.254365 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0ef30f45-63c4-414a-93e2-471375dcb66b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 200 len: 1509 microversion: 2.1 time: 0.152541 Jul 19 23:20:49.254942 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3238/6482] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:49 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:20:49.758797 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-ee5addd9-3932-45ea-9641-b7992d7d3a9e req-4883aa90-ba53-449a-9471-cbb0f355e849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "915f076f-8179-469b-950d-bfe412d3c038", "name": "network-vif-deleted", "tag": "d55a48a7-17a4-4457-b29d-74d59f0b6b21"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:20:49.769029 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-ee5addd9-3932-45ea-9641-b7992d7d3a9e req-4883aa90-ba53-449a-9471-cbb0f355e849 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:49.769494 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-ee5addd9-3932-45ea-9641-b7992d7d3a9e req-4883aa90-ba53-449a-9471-cbb0f355e849 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:49.787872 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-ee5addd9-3932-45ea-9641-b7992d7d3a9e req-4883aa90-ba53-449a-9471-cbb0f355e849 service nova] Creating event network-vif-deleted:d55a48a7-17a4-4457-b29d-74d59f0b6b21 for instance 915f076f-8179-469b-950d-bfe412d3c038 on n-h1-847009-3 Jul 19 23:20:49.792731 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-ee5addd9-3932-45ea-9641-b7992d7d3a9e req-4883aa90-ba53-449a-9471-cbb0f355e849 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038051 Jul 19 23:20:49.793337 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3245/6483] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:20:50.272405 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dd9f4ab8-9a00-45d5-9f26-60e3fea60b6b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:50.272946 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dd9f4ab8-9a00-45d5-9f26-60e3fea60b6b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 915f076f-8179-469b-950d-bfe412d3c038] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:50.280045 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd9f4ab8-9a00-45d5-9f26-60e3fea60b6b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:50.280500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd9f4ab8-9a00-45d5-9f26-60e3fea60b6b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:50.281269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd9f4ab8-9a00-45d5-9f26-60e3fea60b6b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:50.281711 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd9f4ab8-9a00-45d5-9f26-60e3fea60b6b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:50.295122 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-dd9f4ab8-9a00-45d5-9f26-60e3fea60b6b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] HTTP exception thrown: Instance 915f076f-8179-469b-950d-bfe412d3c038 could not be found. Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dd9f4ab8-9a00-45d5-9f26-60e3fea60b6b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Request method failure captured: Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 HTTP/1.1 Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zvxS3TZ9jzuDG1JlVlNpE4eWPYe3GPqV43qnQP3TucYjRahTDOMpElI0tA4cq9oyflqDUY-QVpCOk7X7YOteCHlh7_HRBsLdOQLkAUJi_qI_4cODHgF28kl4ES6OWvEIqUbpN90UXLFI9dsS4TYmmVzR5xhsu-qtgVPRo-dNI2adk8 Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: be99de8a278748409929647066c0e296 Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerDiskConfigTestJSON-606659387 Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be99de8a278748409929647066c0e296"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be99de8a278748409929647066c0e296"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be99de8a278748409929647066c0e296"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be99de8a278748409929647066c0e296"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerDiskConfigTestJSON-606659387 Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: be99de8a278748409929647066c0e296 Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-606659387 Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerDiskConfigTestJSON-606659387-project Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 26335bfc44d24b9f99e1a10894710c08 Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerDiskConfigTestJSON-606659387-project Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 915f076f-8179-469b-950d-bfe412d3c038 could not be found. Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '915f076f-8179-469b-950d-bfe412d3c038'} Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 915f076f-8179-469b-950d-bfe412d3c038 could not be found. Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 915f076f-8179-469b-950d-bfe412d3c038 could not be found. Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:20:50.296802 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:20:50.301609 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:20:50.301609 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:20:50.301609 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:20:50.301609 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:20:50.301609 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:20:50.301609 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 915f076f-8179-469b-950d-bfe412d3c038 could not be found. Jul 19 23:20:50.301609 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:20:50.301609 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dd9f4ab8-9a00-45d5-9f26-60e3fea60b6b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Returning 404 to user: Instance 915f076f-8179-469b-950d-bfe412d3c038 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:20:50.301609 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dd9f4ab8-9a00-45d5-9f26-60e3fea60b6b tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038" status: 404 len: 111 microversion: 2.1 time: 0.030731 Jul 19 23:20:50.301609 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3239/6484] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:50 2022] GET /compute/v2.1/servers/915f076f-8179-469b-950d-bfe412d3c038 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:20:50.307574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ce6c7ab9-9f34-471d-96fc-c4983ed90330 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '.version_select at 0x7f7a03430310>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:50.328176 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ce6c7ab9-9f34-471d-96fc-c4983ed90330 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-408705276" status: 202 len: 0 microversion: 2.1 time: 0.024487 Jul 19 23:20:50.328925 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3246/6485] 10.222.0.25 () {58 vars in 1217 bytes} [Tue Jul 19 23:20:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-408705276 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:20:50.949910 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dfecebe7-0827-4bd6-bc7e-8432f18944b4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:50.950415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dfecebe7-0827-4bd6-bc7e-8432f18944b4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:50.958108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfecebe7-0827-4bd6-bc7e-8432f18944b4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:50.958563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfecebe7-0827-4bd6-bc7e-8432f18944b4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:50.959364 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfecebe7-0827-4bd6-bc7e-8432f18944b4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:50.959813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dfecebe7-0827-4bd6-bc7e-8432f18944b4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:50.974251 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-dfecebe7-0827-4bd6-bc7e-8432f18944b4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] HTTP exception thrown: Instance 0bea0e99-3b70-454d-8578-65d55210456e could not be found. Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dfecebe7-0827-4bd6-bc7e-8432f18944b4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Request method failure captured: Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e HTTP/1.1 Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zvxS3TZ9jzuDG1JlVlNpE4eWPYe3GPqV43qnQP3TucYjRahTDOMpElI0tA4cq9oyflqDUY-QVpCOk7X7YOteCHlh7_HRBsLdOQLkAUJi_qI_4cODHgF28kl4ES6OWvEIqUbpN90UXLFI9dsS4TYmmVzR5xhsu-qtgVPRo-dNI2adk8 Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: be99de8a278748409929647066c0e296 Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerDiskConfigTestJSON-606659387 Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be99de8a278748409929647066c0e296"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be99de8a278748409929647066c0e296"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be99de8a278748409929647066c0e296"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be99de8a278748409929647066c0e296"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerDiskConfigTestJSON-606659387 Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: be99de8a278748409929647066c0e296 Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-606659387 Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerDiskConfigTestJSON-606659387-project Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 26335bfc44d24b9f99e1a10894710c08 Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerDiskConfigTestJSON-606659387-project Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 0bea0e99-3b70-454d-8578-65d55210456e could not be found. Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '0bea0e99-3b70-454d-8578-65d55210456e'} Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bea0e99-3b70-454d-8578-65d55210456e could not be found. Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:20:50.975850 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:20:50.978810 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bea0e99-3b70-454d-8578-65d55210456e could not be found. Jul 19 23:20:50.978810 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:20:50.978810 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:20:50.978810 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:20:50.978810 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:20:50.978810 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:20:50.978810 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:20:50.978810 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:20:50.978810 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:20:50.978810 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bea0e99-3b70-454d-8578-65d55210456e could not be found. Jul 19 23:20:50.978810 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:20:50.978810 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dfecebe7-0827-4bd6-bc7e-8432f18944b4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Returning 404 to user: Instance 0bea0e99-3b70-454d-8578-65d55210456e could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:20:50.978810 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dfecebe7-0827-4bd6-bc7e-8432f18944b4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 404 len: 111 microversion: 2.1 time: 0.031352 Jul 19 23:20:50.978810 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3240/6486] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:20:50 2022] DELETE /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:20:50.986034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a2513e11-c605-4d5a-9204-b883814121f4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:20:50.986795 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a2513e11-c605-4d5a-9204-b883814121f4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] [instance: 0bea0e99-3b70-454d-8578-65d55210456e] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:20:50.995004 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a2513e11-c605-4d5a-9204-b883814121f4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:50.995500 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a2513e11-c605-4d5a-9204-b883814121f4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:50.996305 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a2513e11-c605-4d5a-9204-b883814121f4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:20:50.996762 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a2513e11-c605-4d5a-9204-b883814121f4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:20:51.012937 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-a2513e11-c605-4d5a-9204-b883814121f4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] HTTP exception thrown: Instance 0bea0e99-3b70-454d-8578-65d55210456e could not be found. Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a2513e11-c605-4d5a-9204-b883814121f4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Request method failure captured: Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e HTTP/1.1 Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zvxS3TZ9jzuDG1JlVlNpE4eWPYe3GPqV43qnQP3TucYjRahTDOMpElI0tA4cq9oyflqDUY-QVpCOk7X7YOteCHlh7_HRBsLdOQLkAUJi_qI_4cODHgF28kl4ES6OWvEIqUbpN90UXLFI9dsS4TYmmVzR5xhsu-qtgVPRo-dNI2adk8 Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: be99de8a278748409929647066c0e296 Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerDiskConfigTestJSON-606659387 Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be99de8a278748409929647066c0e296"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be99de8a278748409929647066c0e296"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be99de8a278748409929647066c0e296"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be99de8a278748409929647066c0e296"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerDiskConfigTestJSON-606659387 Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: be99de8a278748409929647066c0e296 Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-606659387 Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerDiskConfigTestJSON-606659387-project Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 26335bfc44d24b9f99e1a10894710c08 Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerDiskConfigTestJSON-606659387-project Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 0bea0e99-3b70-454d-8578-65d55210456e could not be found. Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '0bea0e99-3b70-454d-8578-65d55210456e'} Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bea0e99-3b70-454d-8578-65d55210456e could not be found. Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bea0e99-3b70-454d-8578-65d55210456e could not be found. Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:20:51.014614 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:20:51.018061 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:20:51.018061 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:20:51.018061 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:20:51.018061 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:20:51.018061 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:20:51.018061 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bea0e99-3b70-454d-8578-65d55210456e could not be found. Jul 19 23:20:51.018061 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:20:51.018061 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a2513e11-c605-4d5a-9204-b883814121f4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] Returning 404 to user: Instance 0bea0e99-3b70-454d-8578-65d55210456e could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:20:51.018061 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a2513e11-c605-4d5a-9204-b883814121f4 tempest-ServerDiskConfigTestJSON-606659387 tempest-ServerDiskConfigTestJSON-606659387-project] 10.222.0.25 "GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e" status: 404 len: 111 microversion: 2.1 time: 0.033994 Jul 19 23:20:51.018061 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3247/6487] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:20:50 2022] GET /compute/v2.1/servers/0bea0e99-3b70-454d-8578-65d55210456e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:20:59.695756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5c21cf86-9171-401f-826c-d75dde0fd1c3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Action: 'create', calling method: .version_select at 0x7f7a02ea3550>, body: {"keypair": {"name": "tempest-keypair-1107466307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUnkANYC/4d4fNwf1deccb7HRjHBBTwZIBT9Ab9Y51oahK/3T1D+mOOOBzFwcpnQxsf9tYawaYjwqOLsIixuK06C4jQyM2zvhAa9Heyq0J2UvXtCw3kdPwdFgU2p59gIw=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:20:59.699831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:20:59.713884 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-5c21cf86-9171-401f-826c-d75dde0fd1c3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Getting quotas for project a9630a1ac2a54421a9b04421e1560776. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:20:59.719100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-5c21cf86-9171-401f-826c-d75dde0fd1c3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Getting quotas for user 31a6b598a39a45bbb09381b4c27f354f and project a9630a1ac2a54421a9b04421e1560776. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:20:59.749119 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5c21cf86-9171-401f-826c-d75dde0fd1c3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.180895 Jul 19 23:20:59.749645 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3241/6488] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 23:20:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:21:01.071209 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7ef1af23-7236-4c8f-bffa-e2513614deb9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2076675061", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ec89eb26-634b-4a9b-b267-bb50a8595550"}], "security_groups": [{"name": "tempest-securitygroup--1231291026"}], "key_name": "tempest-keypair-1107466307", "user_data": "}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:21:01.079251 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:21:01.081132 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:21:01.220070 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-7ef1af23-7236-4c8f-bffa-e2513614deb9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] validate_networks() for [('ec89eb26-634b-4a9b-b267-bb50a8595550', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:21:01.669211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-7ef1af23-7236-4c8f-bffa-e2513614deb9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:21:01.669657 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-7ef1af23-7236-4c8f-bffa-e2513614deb9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:21:01.670149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-7ef1af23-7236-4c8f-bffa-e2513614deb9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:21:01.670747 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-7ef1af23-7236-4c8f-bffa-e2513614deb9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:21:01.671342 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-7ef1af23-7236-4c8f-bffa-e2513614deb9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:21:01.682514 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7ef1af23-7236-4c8f-bffa-e2513614deb9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:01.682985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7ef1af23-7236-4c8f-bffa-e2513614deb9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:01.683846 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7ef1af23-7236-4c8f-bffa-e2513614deb9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:01.684304 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7ef1af23-7236-4c8f-bffa-e2513614deb9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:01.704293 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-7ef1af23-7236-4c8f-bffa-e2513614deb9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Getting quotas for project a9630a1ac2a54421a9b04421e1560776. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:21:01.711882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-7ef1af23-7236-4c8f-bffa-e2513614deb9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Getting quotas for user 31a6b598a39a45bbb09381b4c27f354f and project a9630a1ac2a54421a9b04421e1560776. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:21:01.728230 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7ef1af23-7236-4c8f-bffa-e2513614deb9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:21:01.730900 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7ef1af23-7236-4c8f-bffa-e2513614deb9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:21:01.790433 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7ef1af23-7236-4c8f-bffa-e2513614deb9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.723268 Jul 19 23:21:01.791458 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3248/6489] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:21:01 2022] POST /compute/v2.1/servers => generated 409 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 23:21:01.799684 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:21:01.804103 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-72381b1e-bc80-461f-adae-e2144e230252 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:21:01.804731 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-72381b1e-bc80-461f-adae-e2144e230252 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:21:01.905583 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-72381b1e-bc80-461f-adae-e2144e230252 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:21:01.915482 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-72381b1e-bc80-461f-adae-e2144e230252 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1239 microversion: 2.1 time: 0.117903 Jul 19 23:21:01.916808 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3242/6490] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:21:01 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1239 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:21:02.934184 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2e99c77b-de77-4c97-bbf6-9d025a13b475 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:21:02.934835 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2e99c77b-de77-4c97-bbf6-9d025a13b475 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:21:02.942590 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e99c77b-de77-4c97-bbf6-9d025a13b475 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:02.943309 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e99c77b-de77-4c97-bbf6-9d025a13b475 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:02.944281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e99c77b-de77-4c97-bbf6-9d025a13b475 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:02.944759 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2e99c77b-de77-4c97-bbf6-9d025a13b475 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:03.029433 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2e99c77b-de77-4c97-bbf6-9d025a13b475 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:21:03.038954 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2e99c77b-de77-4c97-bbf6-9d025a13b475 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1291 microversion: 2.1 time: 0.109837 Jul 19 23:21:03.039912 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3249/6491] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:21:02 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1291 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:21:04.056693 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-030bb3fe-21b3-4a6b-adaa-423825168872 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:21:04.057331 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-030bb3fe-21b3-4a6b-adaa-423825168872 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:21:04.065171 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-030bb3fe-21b3-4a6b-adaa-423825168872 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:04.065527 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-030bb3fe-21b3-4a6b-adaa-423825168872 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:04.066733 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-030bb3fe-21b3-4a6b-adaa-423825168872 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:04.067205 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-030bb3fe-21b3-4a6b-adaa-423825168872 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:04.287947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-030bb3fe-21b3-4a6b-adaa-423825168872 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:21:04.295607 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-030bb3fe-21b3-4a6b-adaa-423825168872 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1365 microversion: 2.1 time: 0.242843 Jul 19 23:21:04.296198 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3243/6492] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:21:04 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:21:04.623102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-3793bde8-e937-4163-8698-98bd1b478dd8 req-34e37814-fc57-40f5-a248-3eabed357578 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bb20180-3fa4-49fc-88fa-a0e6d4078c0a", "tag": "1ea43174-9163-4922-b777-a27097045cfa"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:21:04.649625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-3793bde8-e937-4163-8698-98bd1b478dd8 req-34e37814-fc57-40f5-a248-3eabed357578 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:04.652314 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-3793bde8-e937-4163-8698-98bd1b478dd8 req-34e37814-fc57-40f5-a248-3eabed357578 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:04.666858 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-3793bde8-e937-4163-8698-98bd1b478dd8 req-34e37814-fc57-40f5-a248-3eabed357578 service nova] Creating event network-changed:1ea43174-9163-4922-b777-a27097045cfa for instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a on n-h1-847009-3 Jul 19 23:21:04.676031 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-3793bde8-e937-4163-8698-98bd1b478dd8 req-34e37814-fc57-40f5-a248-3eabed357578 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053882 Jul 19 23:21:04.676718 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3250/6493] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:21:05.313288 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-04026352-02a8-46c7-af0b-838c19e72df1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:21:05.313818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-04026352-02a8-46c7-af0b-838c19e72df1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:21:05.321617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04026352-02a8-46c7-af0b-838c19e72df1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:05.322064 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04026352-02a8-46c7-af0b-838c19e72df1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:05.322821 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04026352-02a8-46c7-af0b-838c19e72df1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:05.323285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04026352-02a8-46c7-af0b-838c19e72df1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:05.455556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-04026352-02a8-46c7-af0b-838c19e72df1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:21:05.464186 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-04026352-02a8-46c7-af0b-838c19e72df1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1365 microversion: 2.1 time: 0.154830 Jul 19 23:21:05.464762 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3244/6494] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:21:05 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:21:06.482634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1b483b21-4f97-45dd-9a9d-5caae9673c20 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:21:06.484758 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1b483b21-4f97-45dd-9a9d-5caae9673c20 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:21:06.493634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b483b21-4f97-45dd-9a9d-5caae9673c20 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:06.494103 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b483b21-4f97-45dd-9a9d-5caae9673c20 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:06.494931 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b483b21-4f97-45dd-9a9d-5caae9673c20 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:06.495415 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1b483b21-4f97-45dd-9a9d-5caae9673c20 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:06.641168 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1b483b21-4f97-45dd-9a9d-5caae9673c20 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:21:06.649464 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1b483b21-4f97-45dd-9a9d-5caae9673c20 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1365 microversion: 2.1 time: 0.172021 Jul 19 23:21:06.650280 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3251/6495] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:21:06 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:21:07.667184 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9beec179-988c-4f34-8e97-bd8e881fc716 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:21:07.667836 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9beec179-988c-4f34-8e97-bd8e881fc716 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:21:07.674862 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9beec179-988c-4f34-8e97-bd8e881fc716 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:07.676025 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9beec179-988c-4f34-8e97-bd8e881fc716 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:07.676848 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9beec179-988c-4f34-8e97-bd8e881fc716 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:07.677282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9beec179-988c-4f34-8e97-bd8e881fc716 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:07.808366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9beec179-988c-4f34-8e97-bd8e881fc716 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:21:07.816486 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9beec179-988c-4f34-8e97-bd8e881fc716 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1365 microversion: 2.1 time: 0.153133 Jul 19 23:21:07.816924 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3245/6496] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:21:07 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:21:08.833934 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-041ac2f1-e642-4b71-a3a4-784208e0a509 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:21:08.834566 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-041ac2f1-e642-4b71-a3a4-784208e0a509 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:21:08.842127 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-041ac2f1-e642-4b71-a3a4-784208e0a509 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:08.842591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-041ac2f1-e642-4b71-a3a4-784208e0a509 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:08.843419 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-041ac2f1-e642-4b71-a3a4-784208e0a509 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:08.843875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-041ac2f1-e642-4b71-a3a4-784208e0a509 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:08.992682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-041ac2f1-e642-4b71-a3a4-784208e0a509 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:21:09.000980 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-041ac2f1-e642-4b71-a3a4-784208e0a509 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1365 microversion: 2.1 time: 0.171514 Jul 19 23:21:09.001776 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3252/6497] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:21:08 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:21:10.018773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-50ef281f-097e-48e0-8ca7-fd3a082f486a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:21:10.020112 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-50ef281f-097e-48e0-8ca7-fd3a082f486a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:21:10.027182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50ef281f-097e-48e0-8ca7-fd3a082f486a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:10.027634 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50ef281f-097e-48e0-8ca7-fd3a082f486a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:10.028394 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50ef281f-097e-48e0-8ca7-fd3a082f486a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:10.028830 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50ef281f-097e-48e0-8ca7-fd3a082f486a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:10.161483 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-50ef281f-097e-48e0-8ca7-fd3a082f486a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:21:10.169088 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-50ef281f-097e-48e0-8ca7-fd3a082f486a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1365 microversion: 2.1 time: 0.154184 Jul 19 23:21:10.169665 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3246/6498] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:21:10 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:21:11.135206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-a4a61a1a-1b1f-4bf1-a66b-07567d767fa7 req-872eaf90-d699-4e19-91c7-3d6452030c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb20180-3fa4-49fc-88fa-a0e6d4078c0a", "name": "network-vif-plugged", "status": "completed", "tag": "1ea43174-9163-4922-b777-a27097045cfa"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:21:11.145128 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a4a61a1a-1b1f-4bf1-a66b-07567d767fa7 req-872eaf90-d699-4e19-91c7-3d6452030c94 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:11.145756 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a4a61a1a-1b1f-4bf1-a66b-07567d767fa7 req-872eaf90-d699-4e19-91c7-3d6452030c94 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:11.157745 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-a4a61a1a-1b1f-4bf1-a66b-07567d767fa7 req-872eaf90-d699-4e19-91c7-3d6452030c94 service nova] Creating event network-vif-plugged:1ea43174-9163-4922-b777-a27097045cfa for instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a on n-h1-847009-3 Jul 19 23:21:11.163547 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-a4a61a1a-1b1f-4bf1-a66b-07567d767fa7 req-872eaf90-d699-4e19-91c7-3d6452030c94 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032117 Jul 19 23:21:11.164387 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3253/6499] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:21:11.190300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-521f59aa-b019-4a0c-adc2-6a885c509c70 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:21:11.191633 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-521f59aa-b019-4a0c-adc2-6a885c509c70 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:21:11.200031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-521f59aa-b019-4a0c-adc2-6a885c509c70 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:11.200640 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-521f59aa-b019-4a0c-adc2-6a885c509c70 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:11.202943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-521f59aa-b019-4a0c-adc2-6a885c509c70 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:11.203766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-521f59aa-b019-4a0c-adc2-6a885c509c70 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:11.387535 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-521f59aa-b019-4a0c-adc2-6a885c509c70 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:21:11.395890 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-521f59aa-b019-4a0c-adc2-6a885c509c70 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1365 microversion: 2.1 time: 0.210619 Jul 19 23:21:11.396459 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3247/6500] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:21:11 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:21:12.410041 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:21:12.411693 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:21:12.417188 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1141b381-561a-4eff-8572-eb274ace5855 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:21:12.417939 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1141b381-561a-4eff-8572-eb274ace5855 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:21:12.426844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1141b381-561a-4eff-8572-eb274ace5855 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:12.427334 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1141b381-561a-4eff-8572-eb274ace5855 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:12.428262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1141b381-561a-4eff-8572-eb274ace5855 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:12.428781 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1141b381-561a-4eff-8572-eb274ace5855 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:12.571990 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1141b381-561a-4eff-8572-eb274ace5855 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:21:12.580273 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1141b381-561a-4eff-8572-eb274ace5855 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1365 microversion: 2.1 time: 0.171110 Jul 19 23:21:12.580855 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3254/6501] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:21:12 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:21:13.598415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7536f34a-363f-4832-9fde-8f1e9fdf5cb8 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:21:13.599033 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7536f34a-363f-4832-9fde-8f1e9fdf5cb8 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:21:13.600861 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:21:13.607055 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7536f34a-363f-4832-9fde-8f1e9fdf5cb8 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:13.607521 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7536f34a-363f-4832-9fde-8f1e9fdf5cb8 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:13.608282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7536f34a-363f-4832-9fde-8f1e9fdf5cb8 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:13.608715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7536f34a-363f-4832-9fde-8f1e9fdf5cb8 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:13.751088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7536f34a-363f-4832-9fde-8f1e9fdf5cb8 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:21:13.759416 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7536f34a-363f-4832-9fde-8f1e9fdf5cb8 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1551 microversion: 2.1 time: 0.164932 Jul 19 23:21:13.759994 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3248/6502] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:21:13 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1551 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:21:13.776574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1e4988ef-cdb2-4574-9114-c2a75553b6e0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:21:13.776574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1e4988ef-cdb2-4574-9114-c2a75553b6e0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:21:13.783720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e4988ef-cdb2-4574-9114-c2a75553b6e0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:13.784258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e4988ef-cdb2-4574-9114-c2a75553b6e0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:13.785166 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e4988ef-cdb2-4574-9114-c2a75553b6e0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:13.786107 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e4988ef-cdb2-4574-9114-c2a75553b6e0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:13.869119 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1e4988ef-cdb2-4574-9114-c2a75553b6e0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097287 Jul 19 23:21:13.869775 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3255/6503] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 19 23:21:13 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:21:14.820412 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-fae4d319-f042-45c2-bc99-bd1148b216ad req-ce016b7a-163f-402b-bcee-ad448c8fd25e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bb20180-3fa4-49fc-88fa-a0e6d4078c0a", "tag": "1ea43174-9163-4922-b777-a27097045cfa"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:21:14.830190 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-fae4d319-f042-45c2-bc99-bd1148b216ad req-ce016b7a-163f-402b-bcee-ad448c8fd25e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:14.830643 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-fae4d319-f042-45c2-bc99-bd1148b216ad req-ce016b7a-163f-402b-bcee-ad448c8fd25e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:14.841858 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-fae4d319-f042-45c2-bc99-bd1148b216ad req-ce016b7a-163f-402b-bcee-ad448c8fd25e service nova] Creating event network-changed:1ea43174-9163-4922-b777-a27097045cfa for instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a on n-h1-847009-3 Jul 19 23:21:14.847451 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-fae4d319-f042-45c2-bc99-bd1148b216ad req-ce016b7a-163f-402b-bcee-ad448c8fd25e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031402 Jul 19 23:21:14.848066 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3249/6504] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:21:51.094968 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:21:51.095778 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=34 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:21:51.100393 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-38482802-f775-40cc-811d-d332a7e8042c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:21:51.101040 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-38482802-f775-40cc-811d-d332a7e8042c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:21:51.108506 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-38482802-f775-40cc-811d-d332a7e8042c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:51.109062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-38482802-f775-40cc-811d-d332a7e8042c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:51.109880 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-38482802-f775-40cc-811d-d332a7e8042c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:51.110338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-38482802-f775-40cc-811d-d332a7e8042c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:51.248541 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-38482802-f775-40cc-811d-d332a7e8042c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:21:51.257745 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-38482802-f775-40cc-811d-d332a7e8042c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1669 microversion: 2.1 time: 0.165316 Jul 19 23:21:51.258325 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3256/6505] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:21:51 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1669 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:21:51.271610 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:21:51.272353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=38 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:21:51.276385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4783fc14-ae22-4924-8ad2-44bffb07d14f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:21:51.277088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4783fc14-ae22-4924-8ad2-44bffb07d14f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:21:51.284423 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4783fc14-ae22-4924-8ad2-44bffb07d14f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:51.284869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4783fc14-ae22-4924-8ad2-44bffb07d14f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:51.286102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4783fc14-ae22-4924-8ad2-44bffb07d14f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:51.286268 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4783fc14-ae22-4924-8ad2-44bffb07d14f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:51.419801 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4783fc14-ae22-4924-8ad2-44bffb07d14f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:21:51.428288 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4783fc14-ae22-4924-8ad2-44bffb07d14f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1669 microversion: 2.1 time: 0.158302 Jul 19 23:21:51.428860 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3250/6506] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:21:51 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:21:51.444869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ed289860-1d72-4907-88c5-00699a61749d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:21:51.445544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ed289860-1d72-4907-88c5-00699a61749d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:21:51.451673 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ed289860-1d72-4907-88c5-00699a61749d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:51.452139 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ed289860-1d72-4907-88c5-00699a61749d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:51.452923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ed289860-1d72-4907-88c5-00699a61749d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:51.453380 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ed289860-1d72-4907-88c5-00699a61749d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:51.587262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ed289860-1d72-4907-88c5-00699a61749d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:21:51.594827 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ed289860-1d72-4907-88c5-00699a61749d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1669 microversion: 2.1 time: 0.154556 Jul 19 23:21:51.595444 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3257/6507] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:21:51 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:21:51.611660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1bbc5ac5-bacb-404d-a6bc-930b04b89d3a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:21:51.612663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1bbc5ac5-bacb-404d-a6bc-930b04b89d3a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:21:51.619373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1bbc5ac5-bacb-404d-a6bc-930b04b89d3a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:51.619771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1bbc5ac5-bacb-404d-a6bc-930b04b89d3a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:51.620537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1bbc5ac5-bacb-404d-a6bc-930b04b89d3a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:51.620971 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1bbc5ac5-bacb-404d-a6bc-930b04b89d3a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:51.648082 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1bbc5ac5-bacb-404d-a6bc-930b04b89d3a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:21:51.654255 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1bbc5ac5-bacb-404d-a6bc-930b04b89d3a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Old instance type m1.heat2, new instance type m1.heat {{(pid=119338) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 23:21:51.661572 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-1bbc5ac5-bacb-404d-a6bc-930b04b89d3a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:21:51.662024 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-1bbc5ac5-bacb-404d-a6bc-930b04b89d3a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:21:51.662598 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-1bbc5ac5-bacb-404d-a6bc-930b04b89d3a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:21:51.663042 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-1bbc5ac5-bacb-404d-a6bc-930b04b89d3a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:21:51.663508 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-1bbc5ac5-bacb-404d-a6bc-930b04b89d3a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:21:51.726011 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1bbc5ac5-bacb-404d-a6bc-930b04b89d3a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "POST /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a/action" status: 202 len: 0 microversion: 2.1 time: 0.118154 Jul 19 23:21:51.726690 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3251/6508] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:21:51 2022] POST /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:21:51.741220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-537b2b2d-c267-4933-b712-9d05d4fc3bb9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:21:51.742316 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-537b2b2d-c267-4933-b712-9d05d4fc3bb9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:21:51.752893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-537b2b2d-c267-4933-b712-9d05d4fc3bb9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:51.753727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-537b2b2d-c267-4933-b712-9d05d4fc3bb9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:51.755463 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-537b2b2d-c267-4933-b712-9d05d4fc3bb9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:51.756277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-537b2b2d-c267-4933-b712-9d05d4fc3bb9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:51.904467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-537b2b2d-c267-4933-b712-9d05d4fc3bb9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:21:51.912997 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-537b2b2d-c267-4933-b712-9d05d4fc3bb9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1678 microversion: 2.1 time: 0.179875 Jul 19 23:21:51.913783 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3258/6509] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:21:51 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:21:52.935554 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-860a35fe-c090-44ec-90a3-ef14a0ea83db tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:21:52.936535 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-860a35fe-c090-44ec-90a3-ef14a0ea83db tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:21:52.945585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-860a35fe-c090-44ec-90a3-ef14a0ea83db tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:52.946047 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-860a35fe-c090-44ec-90a3-ef14a0ea83db tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:52.946819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-860a35fe-c090-44ec-90a3-ef14a0ea83db tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:52.947308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-860a35fe-c090-44ec-90a3-ef14a0ea83db tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:53.164264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-860a35fe-c090-44ec-90a3-ef14a0ea83db tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:21:53.171913 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-860a35fe-c090-44ec-90a3-ef14a0ea83db tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1678 microversion: 2.1 time: 0.245014 Jul 19 23:21:53.172586 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3252/6510] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:21:52 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1678 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:21:54.189677 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7727e3ca-e451-4e16-a0ef-5029e0eb5d00 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:21:54.190315 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7727e3ca-e451-4e16-a0ef-5029e0eb5d00 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:21:54.197834 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7727e3ca-e451-4e16-a0ef-5029e0eb5d00 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:54.198304 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7727e3ca-e451-4e16-a0ef-5029e0eb5d00 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:54.199088 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7727e3ca-e451-4e16-a0ef-5029e0eb5d00 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:54.199571 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7727e3ca-e451-4e16-a0ef-5029e0eb5d00 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:54.340463 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7727e3ca-e451-4e16-a0ef-5029e0eb5d00 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:21:54.348740 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7727e3ca-e451-4e16-a0ef-5029e0eb5d00 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1683 microversion: 2.1 time: 0.162395 Jul 19 23:21:54.349321 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3259/6511] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:21:54 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:21:55.366546 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5f775e1f-2723-4018-bcd4-8d1fc273678b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:21:55.367180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5f775e1f-2723-4018-bcd4-8d1fc273678b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:21:55.374002 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5f775e1f-2723-4018-bcd4-8d1fc273678b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:55.374471 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5f775e1f-2723-4018-bcd4-8d1fc273678b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:55.375245 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5f775e1f-2723-4018-bcd4-8d1fc273678b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:55.375682 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5f775e1f-2723-4018-bcd4-8d1fc273678b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:55.505122 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5f775e1f-2723-4018-bcd4-8d1fc273678b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:21:55.512745 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5f775e1f-2723-4018-bcd4-8d1fc273678b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1683 microversion: 2.1 time: 0.150435 Jul 19 23:21:55.513339 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3253/6512] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:21:55 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:21:56.530756 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4bae2d38-175e-4058-b3d4-3487b0b377d8 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:21:56.531341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4bae2d38-175e-4058-b3d4-3487b0b377d8 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:21:56.538939 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4bae2d38-175e-4058-b3d4-3487b0b377d8 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:56.539594 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4bae2d38-175e-4058-b3d4-3487b0b377d8 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:56.540248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4bae2d38-175e-4058-b3d4-3487b0b377d8 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:56.540701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4bae2d38-175e-4058-b3d4-3487b0b377d8 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:56.677859 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4bae2d38-175e-4058-b3d4-3487b0b377d8 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:21:56.685469 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4bae2d38-175e-4058-b3d4-3487b0b377d8 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1683 microversion: 2.1 time: 0.158773 Jul 19 23:21:56.686040 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3260/6513] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:21:56 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:21:57.702927 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-21f0e27d-7e11-4032-869e-d56a8816732c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:21:57.703833 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-21f0e27d-7e11-4032-869e-d56a8816732c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:21:57.711961 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-21f0e27d-7e11-4032-869e-d56a8816732c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:57.712420 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-21f0e27d-7e11-4032-869e-d56a8816732c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:57.713187 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-21f0e27d-7e11-4032-869e-d56a8816732c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:57.713627 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-21f0e27d-7e11-4032-869e-d56a8816732c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:57.843464 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-21f0e27d-7e11-4032-869e-d56a8816732c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:21:57.851711 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-21f0e27d-7e11-4032-869e-d56a8816732c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1683 microversion: 2.1 time: 0.152647 Jul 19 23:21:57.852299 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3254/6514] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:21:57 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:21:58.869431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ae7817e9-f08f-4503-b75a-93ffc9371ebe tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:21:58.870071 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ae7817e9-f08f-4503-b75a-93ffc9371ebe tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:21:58.877111 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae7817e9-f08f-4503-b75a-93ffc9371ebe tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:58.877576 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae7817e9-f08f-4503-b75a-93ffc9371ebe tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:58.878382 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae7817e9-f08f-4503-b75a-93ffc9371ebe tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:21:58.878843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae7817e9-f08f-4503-b75a-93ffc9371ebe tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:21:59.011504 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ae7817e9-f08f-4503-b75a-93ffc9371ebe tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:21:59.019208 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ae7817e9-f08f-4503-b75a-93ffc9371ebe tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1683 microversion: 2.1 time: 0.154263 Jul 19 23:21:59.019781 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3261/6515] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:21:58 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:22:00.036975 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e1f6da90-4040-4e38-b226-56d456668102 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:00.037639 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e1f6da90-4040-4e38-b226-56d456668102 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:00.044677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1f6da90-4040-4e38-b226-56d456668102 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:00.045068 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1f6da90-4040-4e38-b226-56d456668102 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:00.045863 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1f6da90-4040-4e38-b226-56d456668102 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:00.046297 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e1f6da90-4040-4e38-b226-56d456668102 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:00.180998 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e1f6da90-4040-4e38-b226-56d456668102 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:22:00.188598 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e1f6da90-4040-4e38-b226-56d456668102 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1683 microversion: 2.1 time: 0.155739 Jul 19 23:22:00.189148 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3255/6516] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:22:00 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:22:01.208014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-99896f4d-8cf8-47ba-aa1e-c15ca367aaf7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:01.209487 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-99896f4d-8cf8-47ba-aa1e-c15ca367aaf7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:01.216489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99896f4d-8cf8-47ba-aa1e-c15ca367aaf7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:01.216985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99896f4d-8cf8-47ba-aa1e-c15ca367aaf7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:01.217770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99896f4d-8cf8-47ba-aa1e-c15ca367aaf7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:01.218220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99896f4d-8cf8-47ba-aa1e-c15ca367aaf7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:01.355715 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-99896f4d-8cf8-47ba-aa1e-c15ca367aaf7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:22:01.363290 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-99896f4d-8cf8-47ba-aa1e-c15ca367aaf7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1683 microversion: 2.1 time: 0.160206 Jul 19 23:22:01.363858 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3262/6517] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:22:01 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:22:02.381000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-77d7b7ee-e077-471a-8af2-c8e85a4eb97b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:02.381728 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-77d7b7ee-e077-471a-8af2-c8e85a4eb97b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:02.389799 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-77d7b7ee-e077-471a-8af2-c8e85a4eb97b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:02.390250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-77d7b7ee-e077-471a-8af2-c8e85a4eb97b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:02.391058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-77d7b7ee-e077-471a-8af2-c8e85a4eb97b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:02.391531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-77d7b7ee-e077-471a-8af2-c8e85a4eb97b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:02.528623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-77d7b7ee-e077-471a-8af2-c8e85a4eb97b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:22:02.537373 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-77d7b7ee-e077-471a-8af2-c8e85a4eb97b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1683 microversion: 2.1 time: 0.159937 Jul 19 23:22:02.538217 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3256/6518] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:22:02 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:22:03.554548 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ce25b24b-e8c7-41b4-a81e-dbd76d915391 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:03.555222 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ce25b24b-e8c7-41b4-a81e-dbd76d915391 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:03.562237 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ce25b24b-e8c7-41b4-a81e-dbd76d915391 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:03.562706 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ce25b24b-e8c7-41b4-a81e-dbd76d915391 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:03.563594 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ce25b24b-e8c7-41b4-a81e-dbd76d915391 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:03.564052 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ce25b24b-e8c7-41b4-a81e-dbd76d915391 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:03.697786 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ce25b24b-e8c7-41b4-a81e-dbd76d915391 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:22:03.705675 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ce25b24b-e8c7-41b4-a81e-dbd76d915391 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1683 microversion: 2.1 time: 0.155686 Jul 19 23:22:03.706286 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3263/6519] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:22:03 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:22:04.723071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e9538508-1e73-4320-a93d-639885783802 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:04.723716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e9538508-1e73-4320-a93d-639885783802 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:04.730754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9538508-1e73-4320-a93d-639885783802 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:04.731235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9538508-1e73-4320-a93d-639885783802 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:04.732095 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9538508-1e73-4320-a93d-639885783802 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:04.732536 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e9538508-1e73-4320-a93d-639885783802 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:04.866409 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e9538508-1e73-4320-a93d-639885783802 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:22:04.874163 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e9538508-1e73-4320-a93d-639885783802 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1683 microversion: 2.1 time: 0.154934 Jul 19 23:22:04.874740 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3257/6520] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:22:04 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:22:05.892260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e2d221c8-0fc9-4030-a3ed-7df99c21abbd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:05.892905 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e2d221c8-0fc9-4030-a3ed-7df99c21abbd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:05.900989 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e2d221c8-0fc9-4030-a3ed-7df99c21abbd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:05.901540 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e2d221c8-0fc9-4030-a3ed-7df99c21abbd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:05.902461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e2d221c8-0fc9-4030-a3ed-7df99c21abbd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:05.902979 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e2d221c8-0fc9-4030-a3ed-7df99c21abbd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:06.039047 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e2d221c8-0fc9-4030-a3ed-7df99c21abbd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:22:06.046780 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e2d221c8-0fc9-4030-a3ed-7df99c21abbd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1682 microversion: 2.1 time: 0.158523 Jul 19 23:22:06.047407 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3264/6521] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:22:05 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:22:06.374307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-9c875fac-27fd-486d-bb47-6e458ea1db9d req-604726dc-8230-4617-8a22-8d089d5e419f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb20180-3fa4-49fc-88fa-a0e6d4078c0a", "name": "network-vif-unplugged", "status": "completed", "tag": "1ea43174-9163-4922-b777-a27097045cfa"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:22:06.384497 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-9c875fac-27fd-486d-bb47-6e458ea1db9d req-604726dc-8230-4617-8a22-8d089d5e419f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:06.385013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-9c875fac-27fd-486d-bb47-6e458ea1db9d req-604726dc-8230-4617-8a22-8d089d5e419f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:06.397738 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-9c875fac-27fd-486d-bb47-6e458ea1db9d req-604726dc-8230-4617-8a22-8d089d5e419f service nova] Creating event network-vif-unplugged:1ea43174-9163-4922-b777-a27097045cfa for instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a on n-h2-847009-3 Jul 19 23:22:06.403709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [req-9c875fac-27fd-486d-bb47-6e458ea1db9d req-604726dc-8230-4617-8a22-8d089d5e419f service nova] Instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119338) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 23:22:06.418147 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-9c875fac-27fd-486d-bb47-6e458ea1db9d req-604726dc-8230-4617-8a22-8d089d5e419f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112633 Jul 19 23:22:06.418147 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3258/6522] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:22:07.065176 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-88fef594-1be7-4f3e-aa4f-b291a82aea43 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:07.065735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-88fef594-1be7-4f3e-aa4f-b291a82aea43 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:07.073220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88fef594-1be7-4f3e-aa4f-b291a82aea43 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:07.073679 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88fef594-1be7-4f3e-aa4f-b291a82aea43 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:07.074471 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88fef594-1be7-4f3e-aa4f-b291a82aea43 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:07.074922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-88fef594-1be7-4f3e-aa4f-b291a82aea43 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:07.215334 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-88fef594-1be7-4f3e-aa4f-b291a82aea43 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:22:07.223203 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-88fef594-1be7-4f3e-aa4f-b291a82aea43 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1682 microversion: 2.1 time: 0.162201 Jul 19 23:22:07.223785 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3265/6523] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:22:07 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:22:08.243231 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a3e9dc2e-aadd-4cad-9afb-13936b1fb3c0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:08.243962 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a3e9dc2e-aadd-4cad-9afb-13936b1fb3c0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:08.250391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3e9dc2e-aadd-4cad-9afb-13936b1fb3c0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:08.250884 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3e9dc2e-aadd-4cad-9afb-13936b1fb3c0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:08.251947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3e9dc2e-aadd-4cad-9afb-13936b1fb3c0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:08.252099 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a3e9dc2e-aadd-4cad-9afb-13936b1fb3c0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:08.395943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a3e9dc2e-aadd-4cad-9afb-13936b1fb3c0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:22:08.403997 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a3e9dc2e-aadd-4cad-9afb-13936b1fb3c0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1680 microversion: 2.1 time: 0.166057 Jul 19 23:22:08.404581 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3259/6524] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:22:08 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:22:08.433541 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-6dac1ec1-28d8-4267-8911-538fe9098663 req-c3c143f3-80d7-44b8-bd3f-ce1d74ddf7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bb20180-3fa4-49fc-88fa-a0e6d4078c0a", "tag": "1ea43174-9163-4922-b777-a27097045cfa"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:22:08.442849 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-6dac1ec1-28d8-4267-8911-538fe9098663 req-c3c143f3-80d7-44b8-bd3f-ce1d74ddf7b5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:08.443347 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-6dac1ec1-28d8-4267-8911-538fe9098663 req-c3c143f3-80d7-44b8-bd3f-ce1d74ddf7b5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:08.456841 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-6dac1ec1-28d8-4267-8911-538fe9098663 req-c3c143f3-80d7-44b8-bd3f-ce1d74ddf7b5 service nova] Creating event network-changed:1ea43174-9163-4922-b777-a27097045cfa for instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a on n-h2-847009-3 Jul 19 23:22:08.462551 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [req-6dac1ec1-28d8-4267-8911-538fe9098663 req-c3c143f3-80d7-44b8-bd3f-ce1d74ddf7b5 service nova] Instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119337) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 23:22:08.473292 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-6dac1ec1-28d8-4267-8911-538fe9098663 req-c3c143f3-80d7-44b8-bd3f-ce1d74ddf7b5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044259 Jul 19 23:22:08.473962 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3266/6525] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:22:09.422046 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-890c8fd8-f0bf-4a91-a115-28ed3b2ea1ac tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:09.422658 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-890c8fd8-f0bf-4a91-a115-28ed3b2ea1ac tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:09.429769 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-890c8fd8-f0bf-4a91-a115-28ed3b2ea1ac tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:09.430223 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-890c8fd8-f0bf-4a91-a115-28ed3b2ea1ac tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:09.431004 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-890c8fd8-f0bf-4a91-a115-28ed3b2ea1ac tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:09.431472 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-890c8fd8-f0bf-4a91-a115-28ed3b2ea1ac tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:09.573279 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-890c8fd8-f0bf-4a91-a115-28ed3b2ea1ac tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:22:09.581083 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-890c8fd8-f0bf-4a91-a115-28ed3b2ea1ac tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1677 microversion: 2.1 time: 0.162922 Jul 19 23:22:09.581671 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3260/6526] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:22:09 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:22:09.599495 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b55240b9-0379-4599-b249-1ad2e4ccad26 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:22:09.600143 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b55240b9-0379-4599-b249-1ad2e4ccad26 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:09.606761 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b55240b9-0379-4599-b249-1ad2e4ccad26 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:09.607336 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b55240b9-0379-4599-b249-1ad2e4ccad26 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:09.608169 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b55240b9-0379-4599-b249-1ad2e4ccad26 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:09.608630 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b55240b9-0379-4599-b249-1ad2e4ccad26 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:09.668318 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b55240b9-0379-4599-b249-1ad2e4ccad26 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "POST /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a/action" status: 204 len: 0 microversion: 2.1 time: 0.073781 Jul 19 23:22:09.668965 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3267/6527] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:22:09 2022] POST /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:22:09.677307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8b0e6fdc-838e-49bf-a46c-0cf2b6ebe606 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:09.677927 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8b0e6fdc-838e-49bf-a46c-0cf2b6ebe606 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:09.684684 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8b0e6fdc-838e-49bf-a46c-0cf2b6ebe606 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:09.685130 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8b0e6fdc-838e-49bf-a46c-0cf2b6ebe606 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:09.685926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8b0e6fdc-838e-49bf-a46c-0cf2b6ebe606 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:09.686370 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8b0e6fdc-838e-49bf-a46c-0cf2b6ebe606 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:09.896624 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8b0e6fdc-838e-49bf-a46c-0cf2b6ebe606 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:22:09.904729 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8b0e6fdc-838e-49bf-a46c-0cf2b6ebe606 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1677 microversion: 2.1 time: 0.231328 Jul 19 23:22:09.905317 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3261/6528] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:22:09 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1677 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:22:10.923353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-21d4da18-e3d1-428f-8e9c-3934115706e6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:10.924092 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-21d4da18-e3d1-428f-8e9c-3934115706e6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:10.937527 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-21d4da18-e3d1-428f-8e9c-3934115706e6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:10.938012 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-21d4da18-e3d1-428f-8e9c-3934115706e6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:10.939561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-21d4da18-e3d1-428f-8e9c-3934115706e6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:10.940384 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-21d4da18-e3d1-428f-8e9c-3934115706e6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:11.122773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-21d4da18-e3d1-428f-8e9c-3934115706e6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:22:11.134194 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-21d4da18-e3d1-428f-8e9c-3934115706e6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1669 microversion: 2.1 time: 0.215898 Jul 19 23:22:11.135052 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3268/6529] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:22:10 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1669 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:22:11.159026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c88f2b18-08c8-4afd-9a6c-8ca4bc120a33 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:11.160666 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c88f2b18-08c8-4afd-9a6c-8ca4bc120a33 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:11.170839 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c88f2b18-08c8-4afd-9a6c-8ca4bc120a33 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:11.171333 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c88f2b18-08c8-4afd-9a6c-8ca4bc120a33 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:11.172148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c88f2b18-08c8-4afd-9a6c-8ca4bc120a33 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:11.172592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c88f2b18-08c8-4afd-9a6c-8ca4bc120a33 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:11.331493 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c88f2b18-08c8-4afd-9a6c-8ca4bc120a33 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:22:11.342502 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c88f2b18-08c8-4afd-9a6c-8ca4bc120a33 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1669 microversion: 2.1 time: 0.190383 Jul 19 23:22:11.343132 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3262/6530] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:22:11 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1669 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:22:11.360489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c03fe97b-cc38-4175-a895-b1b6c5cd9c2f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:11.361126 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c03fe97b-cc38-4175-a895-b1b6c5cd9c2f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:11.368467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c03fe97b-cc38-4175-a895-b1b6c5cd9c2f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:11.368938 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c03fe97b-cc38-4175-a895-b1b6c5cd9c2f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:11.369722 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c03fe97b-cc38-4175-a895-b1b6c5cd9c2f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:11.370185 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c03fe97b-cc38-4175-a895-b1b6c5cd9c2f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:11.516984 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c03fe97b-cc38-4175-a895-b1b6c5cd9c2f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:22:11.525255 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c03fe97b-cc38-4175-a895-b1b6c5cd9c2f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1669 microversion: 2.1 time: 0.168362 Jul 19 23:22:11.525739 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3269/6531] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:22:11 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1669 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:22:11.541428 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8d3ff7bc-3e46-40a5-9aee-ce04f6ec0e96 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:11.541925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8d3ff7bc-3e46-40a5-9aee-ce04f6ec0e96 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:11.548051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d3ff7bc-3e46-40a5-9aee-ce04f6ec0e96 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:11.548503 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d3ff7bc-3e46-40a5-9aee-ce04f6ec0e96 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:11.549268 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d3ff7bc-3e46-40a5-9aee-ce04f6ec0e96 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:11.549710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d3ff7bc-3e46-40a5-9aee-ce04f6ec0e96 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:11.575768 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8d3ff7bc-3e46-40a5-9aee-ce04f6ec0e96 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:22:11.629047 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:22:11.661226 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8d3ff7bc-3e46-40a5-9aee-ce04f6ec0e96 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 204 len: 0 microversion: 2.1 time: 0.123389 Jul 19 23:22:11.662549 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3263/6532] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:22:11 2022] DELETE /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:22:11.672525 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-248bf48e-f7ae-4cea-8228-84db20549e7d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:11.673167 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-248bf48e-f7ae-4cea-8228-84db20549e7d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:11.682568 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-248bf48e-f7ae-4cea-8228-84db20549e7d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:11.683031 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-248bf48e-f7ae-4cea-8228-84db20549e7d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:11.683850 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-248bf48e-f7ae-4cea-8228-84db20549e7d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:11.684299 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-248bf48e-f7ae-4cea-8228-84db20549e7d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:11.821394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-248bf48e-f7ae-4cea-8228-84db20549e7d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:22:11.829533 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-248bf48e-f7ae-4cea-8228-84db20549e7d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1675 microversion: 2.1 time: 0.160897 Jul 19 23:22:11.830132 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3270/6533] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:22:11 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:22:12.495558 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-de74e54d-075e-41e0-b597-852570001f9c req-fff6c972-5f42-4327-a768-a87f95bbe5bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb20180-3fa4-49fc-88fa-a0e6d4078c0a", "name": "network-vif-plugged", "status": "completed", "tag": "1ea43174-9163-4922-b777-a27097045cfa"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:22:12.504914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-de74e54d-075e-41e0-b597-852570001f9c req-fff6c972-5f42-4327-a768-a87f95bbe5bf service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:12.505401 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-de74e54d-075e-41e0-b597-852570001f9c req-fff6c972-5f42-4327-a768-a87f95bbe5bf service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:12.518764 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-de74e54d-075e-41e0-b597-852570001f9c req-fff6c972-5f42-4327-a768-a87f95bbe5bf service nova] Creating event network-vif-plugged:1ea43174-9163-4922-b777-a27097045cfa for instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a on n-h2-847009-3 Jul 19 23:22:12.523882 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-de74e54d-075e-41e0-b597-852570001f9c req-fff6c972-5f42-4327-a768-a87f95bbe5bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033014 Jul 19 23:22:12.524499 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3264/6534] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:22:12.847772 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-11143218-fbab-4022-8a01-80502021401d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:12.848425 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-11143218-fbab-4022-8a01-80502021401d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:12.857372 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-11143218-fbab-4022-8a01-80502021401d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:12.857863 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-11143218-fbab-4022-8a01-80502021401d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:12.858672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-11143218-fbab-4022-8a01-80502021401d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:12.859153 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-11143218-fbab-4022-8a01-80502021401d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:12.996577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-11143218-fbab-4022-8a01-80502021401d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:22:12.998892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:22:13.006284 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-11143218-fbab-4022-8a01-80502021401d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1675 microversion: 2.1 time: 0.162534 Jul 19 23:22:13.007148 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3271/6535] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:22:12 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:22:13.940391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-e5333781-2811-4c3d-84db-2850a7432b00 req-48ffb3f9-f6d1-4146-819d-af6a745f051f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb20180-3fa4-49fc-88fa-a0e6d4078c0a", "name": "network-vif-deleted", "tag": "1ea43174-9163-4922-b777-a27097045cfa"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:22:13.949817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e5333781-2811-4c3d-84db-2850a7432b00 req-48ffb3f9-f6d1-4146-819d-af6a745f051f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:13.950587 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e5333781-2811-4c3d-84db-2850a7432b00 req-48ffb3f9-f6d1-4146-819d-af6a745f051f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:13.964416 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-e5333781-2811-4c3d-84db-2850a7432b00 req-48ffb3f9-f6d1-4146-819d-af6a745f051f service nova] Creating event network-vif-deleted:1ea43174-9163-4922-b777-a27097045cfa for instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a on n-h2-847009-3 Jul 19 23:22:13.970246 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-e5333781-2811-4c3d-84db-2850a7432b00 req-48ffb3f9-f6d1-4146-819d-af6a745f051f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034821 Jul 19 23:22:13.971512 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3265/6536] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:22:14.025413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3e2354ba-b8db-4ba5-9e29-976632aa037a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:14.026066 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3e2354ba-b8db-4ba5-9e29-976632aa037a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:14.035558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e2354ba-b8db-4ba5-9e29-976632aa037a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:14.036198 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e2354ba-b8db-4ba5-9e29-976632aa037a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:14.037115 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e2354ba-b8db-4ba5-9e29-976632aa037a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:14.037579 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e2354ba-b8db-4ba5-9e29-976632aa037a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:14.073492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e2354ba-b8db-4ba5-9e29-976632aa037a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:14.074005 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3e2354ba-b8db-4ba5-9e29-976632aa037a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:14.074432 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-3e2354ba-b8db-4ba5-9e29-976632aa037a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lazy-loading 'fault' on Instance uuid 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:22:14.119096 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3e2354ba-b8db-4ba5-9e29-976632aa037a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:22:14.128204 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3e2354ba-b8db-4ba5-9e29-976632aa037a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 200 len: 1329 microversion: 2.1 time: 0.107549 Jul 19 23:22:14.128795 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3272/6537] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:22:14 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 1329 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:22:15.147988 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a7b252a9-f34d-4b5e-a563-2a224ba3d39e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:15.148705 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a7b252a9-f34d-4b5e-a563-2a224ba3d39e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:15.155088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a7b252a9-f34d-4b5e-a563-2a224ba3d39e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:15.155576 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a7b252a9-f34d-4b5e-a563-2a224ba3d39e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:15.156349 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a7b252a9-f34d-4b5e-a563-2a224ba3d39e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:15.156790 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a7b252a9-f34d-4b5e-a563-2a224ba3d39e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:15.169913 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-a7b252a9-f34d-4b5e-a563-2a224ba3d39e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] HTTP exception thrown: Instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a could not be found. Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a7b252a9-f34d-4b5e-a563-2a224ba3d39e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Request method failure captured: Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a HTTP/1.1 Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zxbjEL1rIaQyxdVky0xIYD_tIAWcYLUfp6LpkDLw-jF6fnAMxiX8SS4d5Ix1ZKPVX7s3onGefSgeKLTlOXzWrM0MnLdSrmCJf8_C472uqB44monndTK4btN_tzIPDRcV1Z3ZuBZsMiKg4z2aZ3Jy7asoPb-HoMx-iBmC_MF92p7pXk Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerActionsTestJSON-338741719 Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 31a6b598a39a45bbb09381b4c27f354f Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a could not be found. Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '3bb20180-3fa4-49fc-88fa-a0e6d4078c0a'} Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a could not be found. Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a could not be found. Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:22:15.171566 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:22:15.175210 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:22:15.175210 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:22:15.175210 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:22:15.175210 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:22:15.175210 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:22:15.175210 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a could not be found. Jul 19 23:22:15.175210 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:22:15.175210 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a7b252a9-f34d-4b5e-a563-2a224ba3d39e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Returning 404 to user: Instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:22:15.175210 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a7b252a9-f34d-4b5e-a563-2a224ba3d39e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 404 len: 111 microversion: 2.1 time: 0.030811 Jul 19 23:22:15.175210 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3266/6538] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:22:15 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:22:15.186237 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6319542d-0442-4e20-9d23-f4662a449eb3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:15.186875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6319542d-0442-4e20-9d23-f4662a449eb3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:15.193835 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6319542d-0442-4e20-9d23-f4662a449eb3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:15.195767 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6319542d-0442-4e20-9d23-f4662a449eb3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:15.196900 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6319542d-0442-4e20-9d23-f4662a449eb3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:15.197387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6319542d-0442-4e20-9d23-f4662a449eb3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:15.211728 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-6319542d-0442-4e20-9d23-f4662a449eb3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] HTTP exception thrown: Instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a could not be found. Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6319542d-0442-4e20-9d23-f4662a449eb3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Request method failure captured: Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a HTTP/1.1 Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zxbjEL1rIaQyxdVky0xIYD_tIAWcYLUfp6LpkDLw-jF6fnAMxiX8SS4d5Ix1ZKPVX7s3onGefSgeKLTlOXzWrM0MnLdSrmCJf8_C472uqB44monndTK4btN_tzIPDRcV1Z3ZuBZsMiKg4z2aZ3Jy7asoPb-HoMx-iBmC_MF92p7pXk Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerActionsTestJSON-338741719 Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 31a6b598a39a45bbb09381b4c27f354f Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a could not be found. Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '3bb20180-3fa4-49fc-88fa-a0e6d4078c0a'} Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a could not be found. Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a could not be found. Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:22:15.213390 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:22:15.223441 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:22:15.223441 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:22:15.223441 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:22:15.223441 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:22:15.223441 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:22:15.223441 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a could not be found. Jul 19 23:22:15.223441 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:22:15.223441 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6319542d-0442-4e20-9d23-f4662a449eb3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Returning 404 to user: Instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:22:15.223441 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6319542d-0442-4e20-9d23-f4662a449eb3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 404 len: 111 microversion: 2.1 time: 0.032584 Jul 19 23:22:15.223441 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3273/6539] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:22:15 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:22:15.263940 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7cd26cb6-0e31-4c11-b536-d3f4c07e25ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-682191920", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "ec89eb26-634b-4a9b-b267-bb50a8595550"}], "security_groups": [{"name": "tempest-securitygroup--1231291026"}], "key_name": "tempest-keypair-1107466307", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:22:15.365402 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-7cd26cb6-0e31-4c11-b536-d3f4c07e25ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] validate_networks() for [('ec89eb26-634b-4a9b-b267-bb50a8595550', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:22:15.736304 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-7cd26cb6-0e31-4c11-b536-d3f4c07e25ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:22:15.736728 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-7cd26cb6-0e31-4c11-b536-d3f4c07e25ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:22:15.737201 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-7cd26cb6-0e31-4c11-b536-d3f4c07e25ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:22:15.737603 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-7cd26cb6-0e31-4c11-b536-d3f4c07e25ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:22:15.738189 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-7cd26cb6-0e31-4c11-b536-d3f4c07e25ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:22:15.748223 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7cd26cb6-0e31-4c11-b536-d3f4c07e25ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:15.748675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7cd26cb6-0e31-4c11-b536-d3f4c07e25ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:15.749463 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7cd26cb6-0e31-4c11-b536-d3f4c07e25ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:15.750119 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7cd26cb6-0e31-4c11-b536-d3f4c07e25ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:15.767517 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-7cd26cb6-0e31-4c11-b536-d3f4c07e25ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Getting quotas for project a9630a1ac2a54421a9b04421e1560776. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:22:15.777690 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-7cd26cb6-0e31-4c11-b536-d3f4c07e25ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Getting quotas for user 31a6b598a39a45bbb09381b4c27f354f and project a9630a1ac2a54421a9b04421e1560776. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:22:15.793750 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7cd26cb6-0e31-4c11-b536-d3f4c07e25ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:22:15.796377 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7cd26cb6-0e31-4c11-b536-d3f4c07e25ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:22:15.844255 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7cd26cb6-0e31-4c11-b536-d3f4c07e25ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.584041 Jul 19 23:22:15.851166 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3267/6540] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:22:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:22:15.856239 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-78c2b009-a14b-473d-89cb-6f315dbec354 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:15.856975 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-78c2b009-a14b-473d-89cb-6f315dbec354 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:15.927019 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-78c2b009-a14b-473d-89cb-6f315dbec354 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:22:15.934365 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-78c2b009-a14b-473d-89cb-6f315dbec354 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1238 microversion: 2.1 time: 0.082314 Jul 19 23:22:15.934956 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3274/6541] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:22:15 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1238 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:22:16.953813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-64ce4c6b-2bf9-403e-bcfc-5b68b7a588d2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:16.954904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-64ce4c6b-2bf9-403e-bcfc-5b68b7a588d2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:16.966563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-64ce4c6b-2bf9-403e-bcfc-5b68b7a588d2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:16.967020 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-64ce4c6b-2bf9-403e-bcfc-5b68b7a588d2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:16.967830 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-64ce4c6b-2bf9-403e-bcfc-5b68b7a588d2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:16.968268 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-64ce4c6b-2bf9-403e-bcfc-5b68b7a588d2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:17.052120 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-64ce4c6b-2bf9-403e-bcfc-5b68b7a588d2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:22:17.060780 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-64ce4c6b-2bf9-403e-bcfc-5b68b7a588d2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1296 microversion: 2.1 time: 0.112505 Jul 19 23:22:17.061357 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3268/6542] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:22:16 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1296 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:22:18.079395 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eb5b3886-bf8d-4e3a-ad6b-5ef26a97508b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:18.080190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eb5b3886-bf8d-4e3a-ad6b-5ef26a97508b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:18.089899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb5b3886-bf8d-4e3a-ad6b-5ef26a97508b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:18.090620 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb5b3886-bf8d-4e3a-ad6b-5ef26a97508b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:18.091526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb5b3886-bf8d-4e3a-ad6b-5ef26a97508b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:18.092173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb5b3886-bf8d-4e3a-ad6b-5ef26a97508b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:18.290959 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-eb5b3886-bf8d-4e3a-ad6b-5ef26a97508b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:22:18.298622 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eb5b3886-bf8d-4e3a-ad6b-5ef26a97508b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1364 microversion: 2.1 time: 0.223469 Jul 19 23:22:18.299218 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3275/6543] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:22:18 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:22:18.327791 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-eda99a9d-34ae-403e-bdb9-6f1709ef0d63 req-b74a3441-cf47-45d5-a52e-8e377eccd22e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1be9290-bfde-4f06-b0fc-aab377544f1c", "tag": "7b7ad16e-ad23-4bc1-baff-c4f385013df3"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:22:18.341904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-eda99a9d-34ae-403e-bdb9-6f1709ef0d63 req-b74a3441-cf47-45d5-a52e-8e377eccd22e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:18.342359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-eda99a9d-34ae-403e-bdb9-6f1709ef0d63 req-b74a3441-cf47-45d5-a52e-8e377eccd22e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:18.355720 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-eda99a9d-34ae-403e-bdb9-6f1709ef0d63 req-b74a3441-cf47-45d5-a52e-8e377eccd22e service nova] Creating event network-changed:7b7ad16e-ad23-4bc1-baff-c4f385013df3 for instance f1be9290-bfde-4f06-b0fc-aab377544f1c on n-h1-847009-3 Jul 19 23:22:18.360464 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-eda99a9d-34ae-403e-bdb9-6f1709ef0d63 req-b74a3441-cf47-45d5-a52e-8e377eccd22e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037029 Jul 19 23:22:18.361092 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3269/6544] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:22:19.316145 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e84aeae1-416e-4ea5-8e0d-365e4cc86d5c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:19.316784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e84aeae1-416e-4ea5-8e0d-365e4cc86d5c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:19.324262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e84aeae1-416e-4ea5-8e0d-365e4cc86d5c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:19.324727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e84aeae1-416e-4ea5-8e0d-365e4cc86d5c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:19.325508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e84aeae1-416e-4ea5-8e0d-365e4cc86d5c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:19.325962 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e84aeae1-416e-4ea5-8e0d-365e4cc86d5c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:19.455187 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e84aeae1-416e-4ea5-8e0d-365e4cc86d5c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:22:19.463320 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e84aeae1-416e-4ea5-8e0d-365e4cc86d5c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1364 microversion: 2.1 time: 0.151115 Jul 19 23:22:19.463908 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3276/6545] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:22:19 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:22:20.482611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f794d9d6-04d5-41dd-94c8-f37764a3fa77 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:20.483339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f794d9d6-04d5-41dd-94c8-f37764a3fa77 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:20.489620 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f794d9d6-04d5-41dd-94c8-f37764a3fa77 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:20.490071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f794d9d6-04d5-41dd-94c8-f37764a3fa77 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:20.491546 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f794d9d6-04d5-41dd-94c8-f37764a3fa77 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:20.492133 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f794d9d6-04d5-41dd-94c8-f37764a3fa77 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:20.963490 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f794d9d6-04d5-41dd-94c8-f37764a3fa77 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:22:20.971583 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f794d9d6-04d5-41dd-94c8-f37764a3fa77 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1364 microversion: 2.1 time: 0.493963 Jul 19 23:22:20.972153 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3270/6546] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:22:20 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1364 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:22:21.988424 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-16cdaf3f-724f-437c-a1d1-09266428376a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:21.989059 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-16cdaf3f-724f-437c-a1d1-09266428376a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:21.992611 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=47 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:22:21.998051 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-16cdaf3f-724f-437c-a1d1-09266428376a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:21.998516 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-16cdaf3f-724f-437c-a1d1-09266428376a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:21.999326 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-16cdaf3f-724f-437c-a1d1-09266428376a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:21.999778 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-16cdaf3f-724f-437c-a1d1-09266428376a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:22.135098 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-16cdaf3f-724f-437c-a1d1-09266428376a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:22:22.142642 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-16cdaf3f-724f-437c-a1d1-09266428376a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1364 microversion: 2.1 time: 0.158217 Jul 19 23:22:22.143250 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3277/6547] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:22:21 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:22:23.160813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-16dc4db8-5faa-4fdf-a882-6e7b6e4ce242 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:23.161426 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-16dc4db8-5faa-4fdf-a882-6e7b6e4ce242 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:23.164600 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:22:23.169994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16dc4db8-5faa-4fdf-a882-6e7b6e4ce242 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:23.170440 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16dc4db8-5faa-4fdf-a882-6e7b6e4ce242 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:23.171234 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16dc4db8-5faa-4fdf-a882-6e7b6e4ce242 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:23.171670 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16dc4db8-5faa-4fdf-a882-6e7b6e4ce242 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:23.305939 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-16dc4db8-5faa-4fdf-a882-6e7b6e4ce242 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:22:23.313708 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-16dc4db8-5faa-4fdf-a882-6e7b6e4ce242 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1364 microversion: 2.1 time: 0.156683 Jul 19 23:22:23.314302 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3271/6548] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:22:23 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:22:23.511994 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-9502e9fd-9f3b-4171-80cd-ef0cc98c6acd req-1ea2b6cb-c764-4a49-a057-ef24ac136e70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1be9290-bfde-4f06-b0fc-aab377544f1c", "name": "network-vif-plugged", "status": "completed", "tag": "7b7ad16e-ad23-4bc1-baff-c4f385013df3"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:22:23.522768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-9502e9fd-9f3b-4171-80cd-ef0cc98c6acd req-1ea2b6cb-c764-4a49-a057-ef24ac136e70 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:23.523878 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-9502e9fd-9f3b-4171-80cd-ef0cc98c6acd req-1ea2b6cb-c764-4a49-a057-ef24ac136e70 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:23.535527 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-9502e9fd-9f3b-4171-80cd-ef0cc98c6acd req-1ea2b6cb-c764-4a49-a057-ef24ac136e70 service nova] Creating event network-vif-plugged:7b7ad16e-ad23-4bc1-baff-c4f385013df3 for instance f1be9290-bfde-4f06-b0fc-aab377544f1c on n-h1-847009-3 Jul 19 23:22:23.541564 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-9502e9fd-9f3b-4171-80cd-ef0cc98c6acd req-1ea2b6cb-c764-4a49-a057-ef24ac136e70 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033290 Jul 19 23:22:23.542169 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3278/6549] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:22:24.331359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-974e2748-09fe-4815-a6c0-122452f37cda tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:24.332002 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-974e2748-09fe-4815-a6c0-122452f37cda tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:24.341419 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-974e2748-09fe-4815-a6c0-122452f37cda tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:24.342096 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-974e2748-09fe-4815-a6c0-122452f37cda tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:24.343315 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-974e2748-09fe-4815-a6c0-122452f37cda tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:24.343980 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-974e2748-09fe-4815-a6c0-122452f37cda tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:24.478997 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-974e2748-09fe-4815-a6c0-122452f37cda tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:22:24.486746 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-974e2748-09fe-4815-a6c0-122452f37cda tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1364 microversion: 2.1 time: 0.159515 Jul 19 23:22:24.487352 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3272/6550] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:22:24 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:22:25.505730 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5a2fb0ac-2f6b-40f2-88bd-e505c8a4f0ae tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:25.507053 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5a2fb0ac-2f6b-40f2-88bd-e505c8a4f0ae tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:25.514672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a2fb0ac-2f6b-40f2-88bd-e505c8a4f0ae tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:25.515158 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a2fb0ac-2f6b-40f2-88bd-e505c8a4f0ae tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:25.515956 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a2fb0ac-2f6b-40f2-88bd-e505c8a4f0ae tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:25.516403 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a2fb0ac-2f6b-40f2-88bd-e505c8a4f0ae tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:25.652008 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5a2fb0ac-2f6b-40f2-88bd-e505c8a4f0ae tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:22:25.660094 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5a2fb0ac-2f6b-40f2-88bd-e505c8a4f0ae tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1550 microversion: 2.1 time: 0.158762 Jul 19 23:22:25.660826 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3279/6551] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:22:25 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:22:25.677651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-19634324-eae7-47dd-8d43-ffecc973634a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:22:25.678233 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-19634324-eae7-47dd-8d43-ffecc973634a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:22:25.686054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-19634324-eae7-47dd-8d43-ffecc973634a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:25.686514 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-19634324-eae7-47dd-8d43-ffecc973634a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:25.687337 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-19634324-eae7-47dd-8d43-ffecc973634a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:25.687779 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-19634324-eae7-47dd-8d43-ffecc973634a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:25.757680 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:22:25.766130 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-19634324-eae7-47dd-8d43-ffecc973634a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092447 Jul 19 23:22:25.766922 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3273/6552] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 19 23:22:25 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:22:26.704357 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:22:26.772455 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-64123e6c-76a8-46b9-9fd5-9f5aef4c2e96 req-febf6e1e-ae20-4178-9aa8-c0d7df82269d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1be9290-bfde-4f06-b0fc-aab377544f1c", "tag": "7b7ad16e-ad23-4bc1-baff-c4f385013df3"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:22:26.781534 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-64123e6c-76a8-46b9-9fd5-9f5aef4c2e96 req-febf6e1e-ae20-4178-9aa8-c0d7df82269d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:22:26.782000 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-64123e6c-76a8-46b9-9fd5-9f5aef4c2e96 req-febf6e1e-ae20-4178-9aa8-c0d7df82269d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:22:26.794210 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-64123e6c-76a8-46b9-9fd5-9f5aef4c2e96 req-febf6e1e-ae20-4178-9aa8-c0d7df82269d service nova] Creating event network-changed:7b7ad16e-ad23-4bc1-baff-c4f385013df3 for instance f1be9290-bfde-4f06-b0fc-aab377544f1c on n-h1-847009-3 Jul 19 23:22:26.799497 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-64123e6c-76a8-46b9-9fd5-9f5aef4c2e96 req-febf6e1e-ae20-4178-9aa8-c0d7df82269d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100008 Jul 19 23:22:26.800105 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3280/6553] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:23:07.420300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:23:07.422500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=5 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:23:07.423207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=38 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:23:07.429243 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aae39374-d8bc-4b1c-b720-3f4d2e355e98 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:23:07.436405 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aae39374-d8bc-4b1c-b720-3f4d2e355e98 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:07.436856 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aae39374-d8bc-4b1c-b720-3f4d2e355e98 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:07.458578 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-aae39374-d8bc-4b1c-b720-3f4d2e355e98 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Going to try to stop instance {{(pid=119338) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 23:23:07.504980 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-aae39374-d8bc-4b1c-b720-3f4d2e355e98 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "POST /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c/action" status: 202 len: 0 microversion: 2.1 time: 0.085119 Jul 19 23:23:07.506301 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3274/6554] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:23:07 2022] POST /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:23:07.513205 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=7 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:23:07.514344 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=39 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:23:07.519302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b47f5f5c-5f9f-4324-a1b3-f4905a927b51 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:07.520163 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b47f5f5c-5f9f-4324-a1b3-f4905a927b51 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:07.528383 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b47f5f5c-5f9f-4324-a1b3-f4905a927b51 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:07.528851 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b47f5f5c-5f9f-4324-a1b3-f4905a927b51 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:07.529637 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b47f5f5c-5f9f-4324-a1b3-f4905a927b51 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:07.530098 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b47f5f5c-5f9f-4324-a1b3-f4905a927b51 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:07.857357 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b47f5f5c-5f9f-4324-a1b3-f4905a927b51 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:07.865459 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b47f5f5c-5f9f-4324-a1b3-f4905a927b51 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1678 microversion: 2.1 time: 0.354100 Jul 19 23:23:07.866702 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3281/6555] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:07 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1678 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:08.884807 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-309395ee-085c-4992-a736-89a4d30b92f3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:08.885514 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-309395ee-085c-4992-a736-89a4d30b92f3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:08.892620 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-309395ee-085c-4992-a736-89a4d30b92f3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:08.893076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-309395ee-085c-4992-a736-89a4d30b92f3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:08.893846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-309395ee-085c-4992-a736-89a4d30b92f3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:08.894293 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-309395ee-085c-4992-a736-89a4d30b92f3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:09.154360 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-309395ee-085c-4992-a736-89a4d30b92f3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:09.162663 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-309395ee-085c-4992-a736-89a4d30b92f3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1678 microversion: 2.1 time: 0.282324 Jul 19 23:23:09.163443 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3275/6556] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:08 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1678 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:10.180788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-51213cd8-f2e4-4b16-a87c-4d71d416c9aa tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:10.181468 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-51213cd8-f2e4-4b16-a87c-4d71d416c9aa tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:10.188399 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51213cd8-f2e4-4b16-a87c-4d71d416c9aa tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:10.188868 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51213cd8-f2e4-4b16-a87c-4d71d416c9aa tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:10.189649 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51213cd8-f2e4-4b16-a87c-4d71d416c9aa tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:10.190100 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-51213cd8-f2e4-4b16-a87c-4d71d416c9aa tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:10.329186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-51213cd8-f2e4-4b16-a87c-4d71d416c9aa tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:10.339876 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-51213cd8-f2e4-4b16-a87c-4d71d416c9aa tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1678 microversion: 2.1 time: 0.163202 Jul 19 23:23:10.340478 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3282/6557] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:10 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:11.356793 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-144314f8-ff07-44ce-b030-760783afbe31 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:11.357411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-144314f8-ff07-44ce-b030-760783afbe31 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:11.364691 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-144314f8-ff07-44ce-b030-760783afbe31 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:11.365190 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-144314f8-ff07-44ce-b030-760783afbe31 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:11.365964 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-144314f8-ff07-44ce-b030-760783afbe31 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:11.366409 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-144314f8-ff07-44ce-b030-760783afbe31 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:11.499819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-144314f8-ff07-44ce-b030-760783afbe31 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:11.508040 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-144314f8-ff07-44ce-b030-760783afbe31 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1678 microversion: 2.1 time: 0.155206 Jul 19 23:23:11.508607 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3276/6558] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:11 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:12.525534 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-56f80176-bc72-4d89-833d-cfa11e70c170 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:12.526168 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-56f80176-bc72-4d89-833d-cfa11e70c170 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:12.533139 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-56f80176-bc72-4d89-833d-cfa11e70c170 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:12.533597 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-56f80176-bc72-4d89-833d-cfa11e70c170 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:12.534368 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-56f80176-bc72-4d89-833d-cfa11e70c170 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:12.534823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-56f80176-bc72-4d89-833d-cfa11e70c170 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:12.665756 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-56f80176-bc72-4d89-833d-cfa11e70c170 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:12.673563 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-56f80176-bc72-4d89-833d-cfa11e70c170 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1678 microversion: 2.1 time: 0.152187 Jul 19 23:23:12.674387 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3283/6559] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:12 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:13.693870 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ea5f2b81-a9b8-4948-999d-4791abdc57ff tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:13.694749 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ea5f2b81-a9b8-4948-999d-4791abdc57ff tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:13.701999 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea5f2b81-a9b8-4948-999d-4791abdc57ff tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:13.702696 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea5f2b81-a9b8-4948-999d-4791abdc57ff tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:13.703485 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea5f2b81-a9b8-4948-999d-4791abdc57ff tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:13.703920 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ea5f2b81-a9b8-4948-999d-4791abdc57ff tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:13.837876 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ea5f2b81-a9b8-4948-999d-4791abdc57ff tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:13.845406 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ea5f2b81-a9b8-4948-999d-4791abdc57ff tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1678 microversion: 2.1 time: 0.156016 Jul 19 23:23:13.845972 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3277/6560] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:13 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:14.861806 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2a46d6be-58df-4ace-8655-3c96aec031b1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:14.862435 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2a46d6be-58df-4ace-8655-3c96aec031b1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:14.869441 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2a46d6be-58df-4ace-8655-3c96aec031b1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:14.869904 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2a46d6be-58df-4ace-8655-3c96aec031b1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:14.870681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2a46d6be-58df-4ace-8655-3c96aec031b1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:14.871159 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2a46d6be-58df-4ace-8655-3c96aec031b1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:15.004956 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2a46d6be-58df-4ace-8655-3c96aec031b1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:15.013127 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2a46d6be-58df-4ace-8655-3c96aec031b1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1678 microversion: 2.1 time: 0.155233 Jul 19 23:23:15.013712 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3284/6561] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:14 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:16.030944 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-31edd7fd-fadb-451f-b630-5275944dbd47 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:16.031526 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-31edd7fd-fadb-451f-b630-5275944dbd47 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:16.039470 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31edd7fd-fadb-451f-b630-5275944dbd47 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:16.039942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31edd7fd-fadb-451f-b630-5275944dbd47 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:16.040757 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31edd7fd-fadb-451f-b630-5275944dbd47 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:16.041198 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31edd7fd-fadb-451f-b630-5275944dbd47 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:16.345776 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:23:16.346333 n-d-847009-3 devstack@n-api.service[119337]: Tue Jul 19 23:23:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:23:16.441564 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-31edd7fd-fadb-451f-b630-5275944dbd47 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:16.449773 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-31edd7fd-fadb-451f-b630-5275944dbd47 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1678 microversion: 2.1 time: 0.422818 Jul 19 23:23:16.450436 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3278/6562] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:16 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1678 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:17.094273 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:23:17.094434 n-d-847009-3 devstack@n-api.service[119337]: Tue Jul 19 23:23:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:23:17.469411 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-34d37f4c-1db1-4403-bf58-95a6e8190cd3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:17.470439 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-34d37f4c-1db1-4403-bf58-95a6e8190cd3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:17.479158 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-34d37f4c-1db1-4403-bf58-95a6e8190cd3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:17.479628 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-34d37f4c-1db1-4403-bf58-95a6e8190cd3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:17.480414 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-34d37f4c-1db1-4403-bf58-95a6e8190cd3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:17.480850 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-34d37f4c-1db1-4403-bf58-95a6e8190cd3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:17.613959 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-34d37f4c-1db1-4403-bf58-95a6e8190cd3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:17.621496 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-34d37f4c-1db1-4403-bf58-95a6e8190cd3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1678 microversion: 2.1 time: 0.157921 Jul 19 23:23:17.622062 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3285/6563] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:17 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:18.638890 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-310c967c-727d-477e-aba6-06b98fa0168c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:18.639693 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-310c967c-727d-477e-aba6-06b98fa0168c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:18.646730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-310c967c-727d-477e-aba6-06b98fa0168c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:18.647219 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-310c967c-727d-477e-aba6-06b98fa0168c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:18.647998 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-310c967c-727d-477e-aba6-06b98fa0168c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:18.648436 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-310c967c-727d-477e-aba6-06b98fa0168c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:18.776758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-310c967c-727d-477e-aba6-06b98fa0168c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:18.784483 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-310c967c-727d-477e-aba6-06b98fa0168c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1678 microversion: 2.1 time: 0.149488 Jul 19 23:23:18.785050 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3279/6564] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:18 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:19.801842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3c9811f7-072d-4f99-a6f4-a3e863abd605 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:19.802490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3c9811f7-072d-4f99-a6f4-a3e863abd605 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:19.810137 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c9811f7-072d-4f99-a6f4-a3e863abd605 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:19.810600 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c9811f7-072d-4f99-a6f4-a3e863abd605 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:19.811422 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c9811f7-072d-4f99-a6f4-a3e863abd605 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:19.811875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3c9811f7-072d-4f99-a6f4-a3e863abd605 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:19.945814 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3c9811f7-072d-4f99-a6f4-a3e863abd605 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:19.953732 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3c9811f7-072d-4f99-a6f4-a3e863abd605 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1678 microversion: 2.1 time: 0.155845 Jul 19 23:23:19.954296 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3286/6565] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:19 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:20.970899 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-02a60a6a-1661-4f8d-8ca6-4966fb0fec87 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:20.971578 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-02a60a6a-1661-4f8d-8ca6-4966fb0fec87 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:20.978292 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02a60a6a-1661-4f8d-8ca6-4966fb0fec87 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:20.978748 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02a60a6a-1661-4f8d-8ca6-4966fb0fec87 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:20.979548 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02a60a6a-1661-4f8d-8ca6-4966fb0fec87 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:20.979989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02a60a6a-1661-4f8d-8ca6-4966fb0fec87 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:21.108297 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-02a60a6a-1661-4f8d-8ca6-4966fb0fec87 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:21.115849 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-02a60a6a-1661-4f8d-8ca6-4966fb0fec87 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1678 microversion: 2.1 time: 0.148908 Jul 19 23:23:21.116479 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3280/6566] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:20 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:22.133368 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b182e1d2-c6a1-491f-a3a5-870d065510d9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:22.134001 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b182e1d2-c6a1-491f-a3a5-870d065510d9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:22.141005 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b182e1d2-c6a1-491f-a3a5-870d065510d9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:22.141466 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b182e1d2-c6a1-491f-a3a5-870d065510d9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:22.142242 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b182e1d2-c6a1-491f-a3a5-870d065510d9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:22.142691 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b182e1d2-c6a1-491f-a3a5-870d065510d9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:22.273347 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b182e1d2-c6a1-491f-a3a5-870d065510d9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:22.281064 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b182e1d2-c6a1-491f-a3a5-870d065510d9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1678 microversion: 2.1 time: 0.151917 Jul 19 23:23:22.281647 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3287/6567] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:22 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:23.300521 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1d0a356e-d747-41dc-8932-ccd49e075b7c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:23.301144 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1d0a356e-d747-41dc-8932-ccd49e075b7c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:23.308268 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d0a356e-d747-41dc-8932-ccd49e075b7c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:23.308719 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d0a356e-d747-41dc-8932-ccd49e075b7c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:23.309497 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d0a356e-d747-41dc-8932-ccd49e075b7c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:23.309937 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1d0a356e-d747-41dc-8932-ccd49e075b7c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:23.443185 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1d0a356e-d747-41dc-8932-ccd49e075b7c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:23.452269 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1d0a356e-d747-41dc-8932-ccd49e075b7c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1655 microversion: 2.1 time: 0.155382 Jul 19 23:23:23.452851 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3281/6568] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:23 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1655 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:23.468695 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-58b0946c-af17-4d31-9203-7b6dba81aa6e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:23:23.469703 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-58b0946c-af17-4d31-9203-7b6dba81aa6e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:23.477143 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58b0946c-af17-4d31-9203-7b6dba81aa6e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:23.477609 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58b0946c-af17-4d31-9203-7b6dba81aa6e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:23.478393 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58b0946c-af17-4d31-9203-7b6dba81aa6e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:23.478845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-58b0946c-af17-4d31-9203-7b6dba81aa6e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:23.508268 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-58b0946c-af17-4d31-9203-7b6dba81aa6e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:23.514120 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-58b0946c-af17-4d31-9203-7b6dba81aa6e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Old instance type m1.heat2, new instance type m1.heat {{(pid=119337) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 23:23:23.520274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-58b0946c-af17-4d31-9203-7b6dba81aa6e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:23:23.520712 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-58b0946c-af17-4d31-9203-7b6dba81aa6e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:23:23.521199 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-58b0946c-af17-4d31-9203-7b6dba81aa6e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:23:23.521627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-58b0946c-af17-4d31-9203-7b6dba81aa6e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:23:23.522055 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-58b0946c-af17-4d31-9203-7b6dba81aa6e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:23:23.586459 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-58b0946c-af17-4d31-9203-7b6dba81aa6e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "POST /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c/action" status: 202 len: 0 microversion: 2.1 time: 0.121676 Jul 19 23:23:23.587442 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3288/6569] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:23:23 2022] POST /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 23:23:23.595186 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-82915a55-07bd-4a1d-9009-6ad6d476b5ec tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:23.595812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-82915a55-07bd-4a1d-9009-6ad6d476b5ec tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:23.602336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-82915a55-07bd-4a1d-9009-6ad6d476b5ec tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:23.602795 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-82915a55-07bd-4a1d-9009-6ad6d476b5ec tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:23.603653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-82915a55-07bd-4a1d-9009-6ad6d476b5ec tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:23.604077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-82915a55-07bd-4a1d-9009-6ad6d476b5ec tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:23.742784 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-82915a55-07bd-4a1d-9009-6ad6d476b5ec tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:23.750693 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-82915a55-07bd-4a1d-9009-6ad6d476b5ec tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1678 microversion: 2.1 time: 0.159344 Jul 19 23:23:23.751474 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3282/6570] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:23 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:24.773118 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4ca4e1a7-dc3d-498f-bc59-948a74492141 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:24.773850 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4ca4e1a7-dc3d-498f-bc59-948a74492141 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:24.782817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ca4e1a7-dc3d-498f-bc59-948a74492141 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:24.783579 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ca4e1a7-dc3d-498f-bc59-948a74492141 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:24.784405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ca4e1a7-dc3d-498f-bc59-948a74492141 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:24.784873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ca4e1a7-dc3d-498f-bc59-948a74492141 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:24.963782 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4ca4e1a7-dc3d-498f-bc59-948a74492141 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:24.971530 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4ca4e1a7-dc3d-498f-bc59-948a74492141 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1678 microversion: 2.1 time: 0.206677 Jul 19 23:23:24.972503 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3289/6571] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:24 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1678 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:25.990341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e43b825a-c16b-4812-8f65-6c7120adb815 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:25.991525 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e43b825a-c16b-4812-8f65-6c7120adb815 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:25.999600 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e43b825a-c16b-4812-8f65-6c7120adb815 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:26.000069 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e43b825a-c16b-4812-8f65-6c7120adb815 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:26.000875 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e43b825a-c16b-4812-8f65-6c7120adb815 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:26.001328 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e43b825a-c16b-4812-8f65-6c7120adb815 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:26.139004 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e43b825a-c16b-4812-8f65-6c7120adb815 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:26.146654 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e43b825a-c16b-4812-8f65-6c7120adb815 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1683 microversion: 2.1 time: 0.160427 Jul 19 23:23:26.147288 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3283/6572] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:25 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:27.165342 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cbc6547f-a652-4075-8523-5c79f33ecb92 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:27.165981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cbc6547f-a652-4075-8523-5c79f33ecb92 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:27.173154 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cbc6547f-a652-4075-8523-5c79f33ecb92 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:27.173617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cbc6547f-a652-4075-8523-5c79f33ecb92 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:27.174400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cbc6547f-a652-4075-8523-5c79f33ecb92 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:27.174850 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cbc6547f-a652-4075-8523-5c79f33ecb92 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:27.314231 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cbc6547f-a652-4075-8523-5c79f33ecb92 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:27.322710 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cbc6547f-a652-4075-8523-5c79f33ecb92 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1683 microversion: 2.1 time: 0.162219 Jul 19 23:23:27.323330 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3290/6573] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:27 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:28.340398 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-35750083-1930-4772-b5ce-ff51ad0d7581 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:28.341823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-35750083-1930-4772-b5ce-ff51ad0d7581 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:28.352606 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-a3e34f9e-b9a9-42e3-a938-574584e82dc9 req-2c4f5a85-df81-4343-ae69-aecc024c4bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1be9290-bfde-4f06-b0fc-aab377544f1c", "name": "network-vif-unplugged", "status": "completed", "tag": "7b7ad16e-ad23-4bc1-baff-c4f385013df3"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:23:28.362230 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-35750083-1930-4772-b5ce-ff51ad0d7581 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:28.363298 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-35750083-1930-4772-b5ce-ff51ad0d7581 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:28.364328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-35750083-1930-4772-b5ce-ff51ad0d7581 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:28.365342 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-a3e34f9e-b9a9-42e3-a938-574584e82dc9 req-2c4f5a85-df81-4343-ae69-aecc024c4bb3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:28.365835 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-a3e34f9e-b9a9-42e3-a938-574584e82dc9 req-2c4f5a85-df81-4343-ae69-aecc024c4bb3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:28.366913 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-35750083-1930-4772-b5ce-ff51ad0d7581 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:28.380421 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-a3e34f9e-b9a9-42e3-a938-574584e82dc9 req-2c4f5a85-df81-4343-ae69-aecc024c4bb3 service nova] Creating event network-vif-unplugged:7b7ad16e-ad23-4bc1-baff-c4f385013df3 for instance f1be9290-bfde-4f06-b0fc-aab377544f1c on n-h2-847009-3 Jul 19 23:23:28.392794 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [req-a3e34f9e-b9a9-42e3-a938-574584e82dc9 req-2c4f5a85-df81-4343-ae69-aecc024c4bb3 service nova] Instance f1be9290-bfde-4f06-b0fc-aab377544f1c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119338) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 23:23:28.408257 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-a3e34f9e-b9a9-42e3-a938-574584e82dc9 req-2c4f5a85-df81-4343-ae69-aecc024c4bb3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131603 Jul 19 23:23:28.409115 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3284/6574] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:23:28.528794 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-35750083-1930-4772-b5ce-ff51ad0d7581 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:28.538002 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-35750083-1930-4772-b5ce-ff51ad0d7581 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1682 microversion: 2.1 time: 0.201549 Jul 19 23:23:28.538710 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3291/6575] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:28 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1682 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:29.558773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5bc34181-b3fe-4869-bbb6-2f1b43868277 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:29.559536 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5bc34181-b3fe-4869-bbb6-2f1b43868277 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:29.566181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5bc34181-b3fe-4869-bbb6-2f1b43868277 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:29.566640 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5bc34181-b3fe-4869-bbb6-2f1b43868277 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:29.567506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5bc34181-b3fe-4869-bbb6-2f1b43868277 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:29.567955 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5bc34181-b3fe-4869-bbb6-2f1b43868277 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:29.714180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5bc34181-b3fe-4869-bbb6-2f1b43868277 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:29.723718 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5bc34181-b3fe-4869-bbb6-2f1b43868277 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1680 microversion: 2.1 time: 0.171354 Jul 19 23:23:29.724305 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3285/6576] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:29 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:30.445498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-c0546da4-ebcf-4b7c-b1aa-7db255fe8198 req-b781f1e0-db2f-4885-9ee2-eaee790a10cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1be9290-bfde-4f06-b0fc-aab377544f1c", "tag": "7b7ad16e-ad23-4bc1-baff-c4f385013df3"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:23:30.456636 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-c0546da4-ebcf-4b7c-b1aa-7db255fe8198 req-b781f1e0-db2f-4885-9ee2-eaee790a10cb service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:30.457490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-c0546da4-ebcf-4b7c-b1aa-7db255fe8198 req-b781f1e0-db2f-4885-9ee2-eaee790a10cb service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:30.472386 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-c0546da4-ebcf-4b7c-b1aa-7db255fe8198 req-b781f1e0-db2f-4885-9ee2-eaee790a10cb service nova] Creating event network-changed:7b7ad16e-ad23-4bc1-baff-c4f385013df3 for instance f1be9290-bfde-4f06-b0fc-aab377544f1c on n-h2-847009-3 Jul 19 23:23:30.479243 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [req-c0546da4-ebcf-4b7c-b1aa-7db255fe8198 req-b781f1e0-db2f-4885-9ee2-eaee790a10cb service nova] Instance f1be9290-bfde-4f06-b0fc-aab377544f1c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119337) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 23:23:30.491433 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-c0546da4-ebcf-4b7c-b1aa-7db255fe8198 req-b781f1e0-db2f-4885-9ee2-eaee790a10cb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052655 Jul 19 23:23:30.492441 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3292/6577] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:23:30.743736 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-be318315-475d-451b-8989-99c21d04b2b3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:30.744981 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-be318315-475d-451b-8989-99c21d04b2b3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:30.752162 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be318315-475d-451b-8989-99c21d04b2b3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:30.752675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be318315-475d-451b-8989-99c21d04b2b3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:30.753398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be318315-475d-451b-8989-99c21d04b2b3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:30.753845 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-be318315-475d-451b-8989-99c21d04b2b3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:30.993402 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-be318315-475d-451b-8989-99c21d04b2b3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:31.002993 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-be318315-475d-451b-8989-99c21d04b2b3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1676 microversion: 2.1 time: 0.264675 Jul 19 23:23:31.003719 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3286/6578] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:30 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1676 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:31.021469 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b45fa62b-aac7-4051-91fe-b5e0b4edb020 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:23:31.022227 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b45fa62b-aac7-4051-91fe-b5e0b4edb020 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:31.028929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b45fa62b-aac7-4051-91fe-b5e0b4edb020 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:31.029609 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b45fa62b-aac7-4051-91fe-b5e0b4edb020 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:31.030407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b45fa62b-aac7-4051-91fe-b5e0b4edb020 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:31.030863 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b45fa62b-aac7-4051-91fe-b5e0b4edb020 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:31.094153 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b45fa62b-aac7-4051-91fe-b5e0b4edb020 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "POST /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c/action" status: 204 len: 0 microversion: 2.1 time: 0.076990 Jul 19 23:23:31.095026 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3293/6579] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:23:31 2022] POST /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 23:23:31.106761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a92f5d29-3efc-4257-85c6-ce7f3b36ae3a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:31.112904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a92f5d29-3efc-4257-85c6-ce7f3b36ae3a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:31.127806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a92f5d29-3efc-4257-85c6-ce7f3b36ae3a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:31.128734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a92f5d29-3efc-4257-85c6-ce7f3b36ae3a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:31.130217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a92f5d29-3efc-4257-85c6-ce7f3b36ae3a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:31.133519 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a92f5d29-3efc-4257-85c6-ce7f3b36ae3a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:31.359377 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a92f5d29-3efc-4257-85c6-ce7f3b36ae3a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:31.367817 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a92f5d29-3efc-4257-85c6-ce7f3b36ae3a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1676 microversion: 2.1 time: 0.268406 Jul 19 23:23:31.368412 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3287/6580] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:31 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1676 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:32.387333 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-aec6f3f9-bf56-485e-83ce-773e449e5af7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:32.388099 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-aec6f3f9-bf56-485e-83ce-773e449e5af7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:32.394393 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aec6f3f9-bf56-485e-83ce-773e449e5af7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:32.394854 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aec6f3f9-bf56-485e-83ce-773e449e5af7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:32.395658 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aec6f3f9-bf56-485e-83ce-773e449e5af7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:32.396109 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-aec6f3f9-bf56-485e-83ce-773e449e5af7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:32.531181 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-aec6f3f9-bf56-485e-83ce-773e449e5af7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:32.539428 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-aec6f3f9-bf56-485e-83ce-773e449e5af7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1676 microversion: 2.1 time: 0.157969 Jul 19 23:23:32.539997 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3294/6581] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:32 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:33.557023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9f4485ed-2e4b-4b65-9df1-8e007f9434da tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:33.557557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9f4485ed-2e4b-4b65-9df1-8e007f9434da tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:33.564607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9f4485ed-2e4b-4b65-9df1-8e007f9434da tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:33.565054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9f4485ed-2e4b-4b65-9df1-8e007f9434da tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:33.565827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9f4485ed-2e4b-4b65-9df1-8e007f9434da tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:33.566267 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9f4485ed-2e4b-4b65-9df1-8e007f9434da tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:33.706579 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9f4485ed-2e4b-4b65-9df1-8e007f9434da tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:33.714545 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9f4485ed-2e4b-4b65-9df1-8e007f9434da tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1655 microversion: 2.1 time: 0.161649 Jul 19 23:23:33.715189 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3288/6582] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:33 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1655 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:33.730947 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-98987502-d999-43bb-ba8f-3748da9f0610 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:33.731614 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-98987502-d999-43bb-ba8f-3748da9f0610 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:33.738558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-98987502-d999-43bb-ba8f-3748da9f0610 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:33.739019 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-98987502-d999-43bb-ba8f-3748da9f0610 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:33.739828 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-98987502-d999-43bb-ba8f-3748da9f0610 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:33.740275 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-98987502-d999-43bb-ba8f-3748da9f0610 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:33.755802 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:23:33.878209 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-98987502-d999-43bb-ba8f-3748da9f0610 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:33.886681 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-98987502-d999-43bb-ba8f-3748da9f0610 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1655 microversion: 2.1 time: 0.159563 Jul 19 23:23:33.887307 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3295/6583] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:33 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1655 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:33.903249 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bfdedf90-0154-4781-b2c8-c4f104d2bc64 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:23:33.909366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bfdedf90-0154-4781-b2c8-c4f104d2bc64 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:33.909816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bfdedf90-0154-4781-b2c8-c4f104d2bc64 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:33.932336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bfdedf90-0154-4781-b2c8-c4f104d2bc64 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Going to try to start instance {{(pid=119338) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 23:23:33.936620 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:23:33.974565 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bfdedf90-0154-4781-b2c8-c4f104d2bc64 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "POST /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c/action" status: 202 len: 0 microversion: 2.1 time: 0.074670 Jul 19 23:23:33.975247 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3289/6584] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:23:33 2022] POST /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:23:33.983800 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-be8da59f-0a83-43a7-aedb-d05bf747df12 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:33.984520 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-be8da59f-0a83-43a7-aedb-d05bf747df12 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:33.992087 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be8da59f-0a83-43a7-aedb-d05bf747df12 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:33.992585 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be8da59f-0a83-43a7-aedb-d05bf747df12 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:33.994231 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be8da59f-0a83-43a7-aedb-d05bf747df12 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:33.995193 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-be8da59f-0a83-43a7-aedb-d05bf747df12 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:34.138831 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-be8da59f-0a83-43a7-aedb-d05bf747df12 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:34.146508 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-be8da59f-0a83-43a7-aedb-d05bf747df12 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1664 microversion: 2.1 time: 0.166618 Jul 19 23:23:34.157633 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3296/6585] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:33 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1664 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:35.157347 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-01674a0d-3740-4480-96bc-5ba0d6ddeade req-9e9e984d-0b39-40d6-a41a-f009086de40f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1be9290-bfde-4f06-b0fc-aab377544f1c", "name": "network-vif-plugged", "status": "completed", "tag": "7b7ad16e-ad23-4bc1-baff-c4f385013df3"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:23:35.166883 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-efd4539b-11bc-491e-8678-11ff0a13ed1d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:35.167651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-01674a0d-3740-4480-96bc-5ba0d6ddeade req-9e9e984d-0b39-40d6-a41a-f009086de40f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:35.167890 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-01674a0d-3740-4480-96bc-5ba0d6ddeade req-9e9e984d-0b39-40d6-a41a-f009086de40f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:35.168243 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-efd4539b-11bc-491e-8678-11ff0a13ed1d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:35.175068 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-efd4539b-11bc-491e-8678-11ff0a13ed1d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:35.175578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-efd4539b-11bc-491e-8678-11ff0a13ed1d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:35.176354 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-efd4539b-11bc-491e-8678-11ff0a13ed1d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:35.176801 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-efd4539b-11bc-491e-8678-11ff0a13ed1d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:35.179294 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-01674a0d-3740-4480-96bc-5ba0d6ddeade req-9e9e984d-0b39-40d6-a41a-f009086de40f service nova] Creating event network-vif-plugged:7b7ad16e-ad23-4bc1-baff-c4f385013df3 for instance f1be9290-bfde-4f06-b0fc-aab377544f1c on n-h2-847009-3 Jul 19 23:23:35.184454 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-01674a0d-3740-4480-96bc-5ba0d6ddeade req-9e9e984d-0b39-40d6-a41a-f009086de40f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093751 Jul 19 23:23:35.185126 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3290/6586] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:23:35.315332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-efd4539b-11bc-491e-8678-11ff0a13ed1d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:35.323172 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-efd4539b-11bc-491e-8678-11ff0a13ed1d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1668 microversion: 2.1 time: 0.160984 Jul 19 23:23:35.323763 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3297/6587] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:35 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:23:35.342066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-305bfdcf-3a1f-4b89-a5db-3a549c7538c2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:35.342652 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-305bfdcf-3a1f-4b89-a5db-3a549c7538c2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:35.348991 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-305bfdcf-3a1f-4b89-a5db-3a549c7538c2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:35.349442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-305bfdcf-3a1f-4b89-a5db-3a549c7538c2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:35.350777 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-305bfdcf-3a1f-4b89-a5db-3a549c7538c2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:35.351240 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-305bfdcf-3a1f-4b89-a5db-3a549c7538c2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:35.378051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-305bfdcf-3a1f-4b89-a5db-3a549c7538c2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:23:35.454851 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-305bfdcf-3a1f-4b89-a5db-3a549c7538c2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 204 len: 0 microversion: 2.1 time: 0.116849 Jul 19 23:23:35.455752 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3291/6588] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:23:35 2022] DELETE /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:23:35.464868 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-97d2beb2-1820-4e8e-89f0-62e969845508 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:35.465788 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-97d2beb2-1820-4e8e-89f0-62e969845508 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:35.472054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-97d2beb2-1820-4e8e-89f0-62e969845508 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:35.472521 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-97d2beb2-1820-4e8e-89f0-62e969845508 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:35.473314 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-97d2beb2-1820-4e8e-89f0-62e969845508 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:35.473765 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-97d2beb2-1820-4e8e-89f0-62e969845508 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:35.618288 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-97d2beb2-1820-4e8e-89f0-62e969845508 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:35.626229 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-97d2beb2-1820-4e8e-89f0-62e969845508 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1674 microversion: 2.1 time: 0.165491 Jul 19 23:23:35.626823 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3298/6589] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:35 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:36.644227 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0ba22fdc-b219-408e-a251-ca2e56b2e7c9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:36.644966 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0ba22fdc-b219-408e-a251-ca2e56b2e7c9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:36.652764 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ba22fdc-b219-408e-a251-ca2e56b2e7c9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:36.653212 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ba22fdc-b219-408e-a251-ca2e56b2e7c9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:36.654001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ba22fdc-b219-408e-a251-ca2e56b2e7c9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:36.654440 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ba22fdc-b219-408e-a251-ca2e56b2e7c9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:36.790867 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0ba22fdc-b219-408e-a251-ca2e56b2e7c9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:36.798915 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0ba22fdc-b219-408e-a251-ca2e56b2e7c9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1674 microversion: 2.1 time: 0.159072 Jul 19 23:23:36.799599 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3292/6590] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:36 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:37.816802 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d73f2c93-b329-4b47-a56f-782917a9a731 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:37.817511 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d73f2c93-b329-4b47-a56f-782917a9a731 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:37.820980 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=41 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:23:37.827081 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d73f2c93-b329-4b47-a56f-782917a9a731 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:37.827690 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d73f2c93-b329-4b47-a56f-782917a9a731 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:37.828490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d73f2c93-b329-4b47-a56f-782917a9a731 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:37.828951 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d73f2c93-b329-4b47-a56f-782917a9a731 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:37.892671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d73f2c93-b329-4b47-a56f-782917a9a731 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:37.900960 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d73f2c93-b329-4b47-a56f-782917a9a731 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 200 len: 1606 microversion: 2.1 time: 0.088259 Jul 19 23:23:37.901548 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3299/6591] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:37 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 1606 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:37.970845 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-045a842e-2ddd-416f-a4b2-4e42380a4c4c req-ac5ad350-7f1a-4b94-845a-4c03e880e4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1be9290-bfde-4f06-b0fc-aab377544f1c", "name": "network-vif-deleted", "tag": "7b7ad16e-ad23-4bc1-baff-c4f385013df3"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:23:37.978630 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:23:37.996515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-045a842e-2ddd-416f-a4b2-4e42380a4c4c req-ac5ad350-7f1a-4b94-845a-4c03e880e4b9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:37.996957 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-045a842e-2ddd-416f-a4b2-4e42380a4c4c req-ac5ad350-7f1a-4b94-845a-4c03e880e4b9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:38.011865 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-045a842e-2ddd-416f-a4b2-4e42380a4c4c req-ac5ad350-7f1a-4b94-845a-4c03e880e4b9 service nova] Creating event network-vif-deleted:7b7ad16e-ad23-4bc1-baff-c4f385013df3 for instance f1be9290-bfde-4f06-b0fc-aab377544f1c on n-h2-847009-3 Jul 19 23:23:38.018918 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-045a842e-2ddd-416f-a4b2-4e42380a4c4c req-ac5ad350-7f1a-4b94-845a-4c03e880e4b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057789 Jul 19 23:23:38.019819 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3293/6592] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:23:38.919669 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b00ebb27-9728-4e57-b0c5-718adb37c4aa tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:38.920278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b00ebb27-9728-4e57-b0c5-718adb37c4aa tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:38.927384 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b00ebb27-9728-4e57-b0c5-718adb37c4aa tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:38.928288 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b00ebb27-9728-4e57-b0c5-718adb37c4aa tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:38.929170 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b00ebb27-9728-4e57-b0c5-718adb37c4aa tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:38.929596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b00ebb27-9728-4e57-b0c5-718adb37c4aa tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:38.943911 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-b00ebb27-9728-4e57-b0c5-718adb37c4aa tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] HTTP exception thrown: Instance f1be9290-bfde-4f06-b0fc-aab377544f1c could not be found. Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b00ebb27-9728-4e57-b0c5-718adb37c4aa tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Request method failure captured: Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c HTTP/1.1 Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zxbjEL1rIaQyxdVky0xIYD_tIAWcYLUfp6LpkDLw-jF6fnAMxiX8SS4d5Ix1ZKPVX7s3onGefSgeKLTlOXzWrM0MnLdSrmCJf8_C472uqB44monndTK4btN_tzIPDRcV1Z3ZuBZsMiKg4z2aZ3Jy7asoPb-HoMx-iBmC_MF92p7pXk Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerActionsTestJSON-338741719 Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 31a6b598a39a45bbb09381b4c27f354f Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance f1be9290-bfde-4f06-b0fc-aab377544f1c could not be found. Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'f1be9290-bfde-4f06-b0fc-aab377544f1c'} Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1be9290-bfde-4f06-b0fc-aab377544f1c could not be found. Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1be9290-bfde-4f06-b0fc-aab377544f1c could not be found. Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:23:38.945612 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:23:38.949803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:23:38.949803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:23:38.949803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:23:38.949803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:23:38.949803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:23:38.949803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1be9290-bfde-4f06-b0fc-aab377544f1c could not be found. Jul 19 23:23:38.949803 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:23:38.949803 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b00ebb27-9728-4e57-b0c5-718adb37c4aa tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Returning 404 to user: Instance f1be9290-bfde-4f06-b0fc-aab377544f1c could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:23:38.949803 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b00ebb27-9728-4e57-b0c5-718adb37c4aa tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 404 len: 111 microversion: 2.1 time: 0.032442 Jul 19 23:23:38.952769 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3300/6593] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:38 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:23:38.963057 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5b030169-01cb-426d-8b6e-56675ec04246 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:38.963801 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5b030169-01cb-426d-8b6e-56675ec04246 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:38.970137 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b030169-01cb-426d-8b6e-56675ec04246 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:38.970586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b030169-01cb-426d-8b6e-56675ec04246 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:38.971372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b030169-01cb-426d-8b6e-56675ec04246 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:38.971901 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b030169-01cb-426d-8b6e-56675ec04246 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:38.986881 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-5b030169-01cb-426d-8b6e-56675ec04246 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] HTTP exception thrown: Instance f1be9290-bfde-4f06-b0fc-aab377544f1c could not be found. Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5b030169-01cb-426d-8b6e-56675ec04246 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Request method failure captured: Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c HTTP/1.1 Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zxbjEL1rIaQyxdVky0xIYD_tIAWcYLUfp6LpkDLw-jF6fnAMxiX8SS4d5Ix1ZKPVX7s3onGefSgeKLTlOXzWrM0MnLdSrmCJf8_C472uqB44monndTK4btN_tzIPDRcV1Z3ZuBZsMiKg4z2aZ3Jy7asoPb-HoMx-iBmC_MF92p7pXk Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerActionsTestJSON-338741719 Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 31a6b598a39a45bbb09381b4c27f354f Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance f1be9290-bfde-4f06-b0fc-aab377544f1c could not be found. Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'f1be9290-bfde-4f06-b0fc-aab377544f1c'} Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1be9290-bfde-4f06-b0fc-aab377544f1c could not be found. Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1be9290-bfde-4f06-b0fc-aab377544f1c could not be found. Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:23:38.988574 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:23:38.993399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:23:38.993399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:23:38.993399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:23:38.993399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:23:38.993399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:23:38.993399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1be9290-bfde-4f06-b0fc-aab377544f1c could not be found. Jul 19 23:23:38.993399 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:23:38.993399 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5b030169-01cb-426d-8b6e-56675ec04246 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Returning 404 to user: Instance f1be9290-bfde-4f06-b0fc-aab377544f1c could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:23:38.993399 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5b030169-01cb-426d-8b6e-56675ec04246 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 404 len: 111 microversion: 2.1 time: 0.032037 Jul 19 23:23:38.993399 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3294/6594] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:38 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:23:39.038143 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-67c3c4d5-31ce-4bb4-a203-9e2457367498 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-375846795", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "ec89eb26-634b-4a9b-b267-bb50a8595550"}], "security_groups": [{"name": "tempest-securitygroup--1231291026"}], "key_name": "tempest-keypair-1107466307", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:23:39.149259 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-67c3c4d5-31ce-4bb4-a203-9e2457367498 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] validate_networks() for [('ec89eb26-634b-4a9b-b267-bb50a8595550', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:23:39.617209 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-67c3c4d5-31ce-4bb4-a203-9e2457367498 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:23:39.617735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-67c3c4d5-31ce-4bb4-a203-9e2457367498 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:23:39.618238 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-67c3c4d5-31ce-4bb4-a203-9e2457367498 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:23:39.618672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-67c3c4d5-31ce-4bb4-a203-9e2457367498 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:23:39.619139 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-67c3c4d5-31ce-4bb4-a203-9e2457367498 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:23:39.628836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67c3c4d5-31ce-4bb4-a203-9e2457367498 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:39.629309 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67c3c4d5-31ce-4bb4-a203-9e2457367498 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:39.630429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67c3c4d5-31ce-4bb4-a203-9e2457367498 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:39.630651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67c3c4d5-31ce-4bb4-a203-9e2457367498 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:39.649384 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-67c3c4d5-31ce-4bb4-a203-9e2457367498 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Getting quotas for project a9630a1ac2a54421a9b04421e1560776. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:23:39.656031 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-67c3c4d5-31ce-4bb4-a203-9e2457367498 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Getting quotas for user 31a6b598a39a45bbb09381b4c27f354f and project a9630a1ac2a54421a9b04421e1560776. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:23:39.671191 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-67c3c4d5-31ce-4bb4-a203-9e2457367498 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:23:39.673501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-67c3c4d5-31ce-4bb4-a203-9e2457367498 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:23:39.721938 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-67c3c4d5-31ce-4bb4-a203-9e2457367498 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.688437 Jul 19 23:23:39.722609 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3301/6595] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:23:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 23:23:39.733146 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-030d56ee-3d0e-4d73-823a-91d0c5b955c9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:39.733807 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-030d56ee-3d0e-4d73-823a-91d0c5b955c9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:39.793334 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-030d56ee-3d0e-4d73-823a-91d0c5b955c9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:39.804569 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-030d56ee-3d0e-4d73-823a-91d0c5b955c9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1238 microversion: 2.1 time: 0.075382 Jul 19 23:23:39.805167 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3295/6596] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:39 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1238 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:40.823136 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4f61d461-5a79-4186-ad5f-a396085c8df1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:40.823773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4f61d461-5a79-4186-ad5f-a396085c8df1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:40.831618 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f61d461-5a79-4186-ad5f-a396085c8df1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:40.832093 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f61d461-5a79-4186-ad5f-a396085c8df1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:40.832893 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f61d461-5a79-4186-ad5f-a396085c8df1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:40.833350 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f61d461-5a79-4186-ad5f-a396085c8df1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:40.906115 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4f61d461-5a79-4186-ad5f-a396085c8df1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:40.915852 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4f61d461-5a79-4186-ad5f-a396085c8df1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1296 microversion: 2.1 time: 0.097763 Jul 19 23:23:40.925754 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3302/6597] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:40 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1296 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:41.934817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-23ba1b1a-c8e4-42a7-8c35-e3010baff8a5 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:41.935479 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-23ba1b1a-c8e4-42a7-8c35-e3010baff8a5 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:41.943856 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-23ba1b1a-c8e4-42a7-8c35-e3010baff8a5 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:41.944718 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-23ba1b1a-c8e4-42a7-8c35-e3010baff8a5 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:41.945503 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-23ba1b1a-c8e4-42a7-8c35-e3010baff8a5 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:41.945961 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-23ba1b1a-c8e4-42a7-8c35-e3010baff8a5 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:42.090731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-d306bbbb-4245-43a4-b36f-b3a21a582cd9 req-645fa5a6-75fd-46b9-9f1d-b93698a7386c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94fe62ab-c4e5-420e-9924-aa0b127a63b1", "tag": "67743435-a3b7-459e-adc7-1f70baa8efee"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:23:42.105311 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-23ba1b1a-c8e4-42a7-8c35-e3010baff8a5 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:42.109079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d306bbbb-4245-43a4-b36f-b3a21a582cd9 req-645fa5a6-75fd-46b9-9f1d-b93698a7386c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:42.111815 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d306bbbb-4245-43a4-b36f-b3a21a582cd9 req-645fa5a6-75fd-46b9-9f1d-b93698a7386c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:42.118684 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-23ba1b1a-c8e4-42a7-8c35-e3010baff8a5 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1364 microversion: 2.1 time: 0.187871 Jul 19 23:23:42.119283 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3296/6598] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:41 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:42.127331 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-d306bbbb-4245-43a4-b36f-b3a21a582cd9 req-645fa5a6-75fd-46b9-9f1d-b93698a7386c service nova] Creating event network-changed:67743435-a3b7-459e-adc7-1f70baa8efee for instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 on n-h2-847009-3 Jul 19 23:23:42.133147 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-d306bbbb-4245-43a4-b36f-b3a21a582cd9 req-645fa5a6-75fd-46b9-9f1d-b93698a7386c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046100 Jul 19 23:23:42.133916 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3303/6599] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:23:43.136656 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-55df0ae6-e175-456d-a845-6c8dbd993172 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:43.137268 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-55df0ae6-e175-456d-a845-6c8dbd993172 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:43.144450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55df0ae6-e175-456d-a845-6c8dbd993172 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:43.144900 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55df0ae6-e175-456d-a845-6c8dbd993172 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:43.145679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55df0ae6-e175-456d-a845-6c8dbd993172 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:43.146121 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55df0ae6-e175-456d-a845-6c8dbd993172 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:43.294008 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-55df0ae6-e175-456d-a845-6c8dbd993172 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:43.302213 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-55df0ae6-e175-456d-a845-6c8dbd993172 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1364 microversion: 2.1 time: 0.169527 Jul 19 23:23:43.303413 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3297/6600] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:43 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:44.321601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3ed5e51e-94ec-42fc-bc53-508a8f3239b9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:44.322445 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3ed5e51e-94ec-42fc-bc53-508a8f3239b9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:44.329185 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ed5e51e-94ec-42fc-bc53-508a8f3239b9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:44.329651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ed5e51e-94ec-42fc-bc53-508a8f3239b9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:44.330440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ed5e51e-94ec-42fc-bc53-508a8f3239b9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:44.330906 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ed5e51e-94ec-42fc-bc53-508a8f3239b9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:44.463859 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3ed5e51e-94ec-42fc-bc53-508a8f3239b9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:44.471354 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3ed5e51e-94ec-42fc-bc53-508a8f3239b9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1364 microversion: 2.1 time: 0.154980 Jul 19 23:23:44.471922 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3304/6601] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:44 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:45.489689 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-96461242-961f-49cb-a10c-197642952e3c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:45.491427 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-96461242-961f-49cb-a10c-197642952e3c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:45.498419 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96461242-961f-49cb-a10c-197642952e3c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:45.498864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96461242-961f-49cb-a10c-197642952e3c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:45.499676 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96461242-961f-49cb-a10c-197642952e3c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:45.500121 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96461242-961f-49cb-a10c-197642952e3c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:45.641698 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-96461242-961f-49cb-a10c-197642952e3c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:45.650308 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-96461242-961f-49cb-a10c-197642952e3c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1364 microversion: 2.1 time: 0.164578 Jul 19 23:23:45.651130 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3298/6602] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:45 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:46.669591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-851c46e2-8a63-4945-92f7-55086d895add tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:46.670231 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-851c46e2-8a63-4945-92f7-55086d895add tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:46.677185 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-851c46e2-8a63-4945-92f7-55086d895add tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:46.677758 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-851c46e2-8a63-4945-92f7-55086d895add tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:46.678875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-851c46e2-8a63-4945-92f7-55086d895add tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:46.679349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-851c46e2-8a63-4945-92f7-55086d895add tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:46.813431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-851c46e2-8a63-4945-92f7-55086d895add tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:46.821143 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-851c46e2-8a63-4945-92f7-55086d895add tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1364 microversion: 2.1 time: 0.155560 Jul 19 23:23:46.821726 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3305/6603] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:46 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:47.090948 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-5ccc3ca9-43c9-498e-a613-8ac365ff54ec req-2edb2584-278b-4cdc-8b08-e762ba998343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94fe62ab-c4e5-420e-9924-aa0b127a63b1", "name": "network-vif-plugged", "status": "completed", "tag": "67743435-a3b7-459e-adc7-1f70baa8efee"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:23:47.100669 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5ccc3ca9-43c9-498e-a613-8ac365ff54ec req-2edb2584-278b-4cdc-8b08-e762ba998343 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:47.101082 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5ccc3ca9-43c9-498e-a613-8ac365ff54ec req-2edb2584-278b-4cdc-8b08-e762ba998343 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:47.116483 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-5ccc3ca9-43c9-498e-a613-8ac365ff54ec req-2edb2584-278b-4cdc-8b08-e762ba998343 service nova] Creating event network-vif-plugged:67743435-a3b7-459e-adc7-1f70baa8efee for instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 on n-h2-847009-3 Jul 19 23:23:47.121101 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-5ccc3ca9-43c9-498e-a613-8ac365ff54ec req-2edb2584-278b-4cdc-8b08-e762ba998343 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033877 Jul 19 23:23:47.121865 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3299/6604] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:23:47.838976 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-78978bed-abeb-410c-bb8c-80da577fa955 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:47.839649 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-78978bed-abeb-410c-bb8c-80da577fa955 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:47.846773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-78978bed-abeb-410c-bb8c-80da577fa955 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:47.847281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-78978bed-abeb-410c-bb8c-80da577fa955 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:47.848071 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-78978bed-abeb-410c-bb8c-80da577fa955 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:47.848531 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-78978bed-abeb-410c-bb8c-80da577fa955 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:47.993941 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-78978bed-abeb-410c-bb8c-80da577fa955 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:48.001808 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-78978bed-abeb-410c-bb8c-80da577fa955 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1364 microversion: 2.1 time: 0.166824 Jul 19 23:23:48.002378 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3306/6605] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:47 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:49.020056 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f867f201-8819-43fe-8dc4-dc8faead1538 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:49.020761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f867f201-8819-43fe-8dc4-dc8faead1538 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:49.027620 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f867f201-8819-43fe-8dc4-dc8faead1538 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:49.028072 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f867f201-8819-43fe-8dc4-dc8faead1538 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:49.028839 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f867f201-8819-43fe-8dc4-dc8faead1538 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:49.029277 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f867f201-8819-43fe-8dc4-dc8faead1538 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:49.169219 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f867f201-8819-43fe-8dc4-dc8faead1538 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:23:49.176826 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f867f201-8819-43fe-8dc4-dc8faead1538 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1550 microversion: 2.1 time: 0.161952 Jul 19 23:23:49.178060 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3300/6606] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:23:49 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1550 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:23:49.194336 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b6a4467d-2fcb-4235-a1ca-d93561ed726e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:23:49.194828 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b6a4467d-2fcb-4235-a1ca-d93561ed726e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:23:49.201988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6a4467d-2fcb-4235-a1ca-d93561ed726e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:49.202444 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6a4467d-2fcb-4235-a1ca-d93561ed726e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:49.203239 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6a4467d-2fcb-4235-a1ca-d93561ed726e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:49.203688 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b6a4467d-2fcb-4235-a1ca-d93561ed726e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:49.280969 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b6a4467d-2fcb-4235-a1ca-d93561ed726e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090765 Jul 19 23:23:49.281580 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3307/6607] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 19 23:23:49 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:23:50.279401 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:23:50.331021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-636ab070-d979-4936-b7f6-cec7f4f5d27c req-19ed06a9-fafa-4cd8-a940-a0d85afd8b8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94fe62ab-c4e5-420e-9924-aa0b127a63b1", "tag": "67743435-a3b7-459e-adc7-1f70baa8efee"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:23:50.339705 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-636ab070-d979-4936-b7f6-cec7f4f5d27c req-19ed06a9-fafa-4cd8-a940-a0d85afd8b8a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:23:50.340159 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-636ab070-d979-4936-b7f6-cec7f4f5d27c req-19ed06a9-fafa-4cd8-a940-a0d85afd8b8a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:23:50.351236 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-636ab070-d979-4936-b7f6-cec7f4f5d27c req-19ed06a9-fafa-4cd8-a940-a0d85afd8b8a service nova] Creating event network-changed:67743435-a3b7-459e-adc7-1f70baa8efee for instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 on n-h2-847009-3 Jul 19 23:23:50.363284 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-636ab070-d979-4936-b7f6-cec7f4f5d27c req-19ed06a9-fafa-4cd8-a940-a0d85afd8b8a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081838 Jul 19 23:23:50.363284 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3301/6608] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:24:25.148115 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:24:25.149056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:24:25.152427 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:24:25.153107 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=61 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:24:25.157394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b365d0d5-9737-455b-ad3a-b5da76dce59b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:24:25.158389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b365d0d5-9737-455b-ad3a-b5da76dce59b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:25.169532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b365d0d5-9737-455b-ad3a-b5da76dce59b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:25.169532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b365d0d5-9737-455b-ad3a-b5da76dce59b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:25.169532 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b365d0d5-9737-455b-ad3a-b5da76dce59b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:25.177710 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b365d0d5-9737-455b-ad3a-b5da76dce59b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:25.205389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b365d0d5-9737-455b-ad3a-b5da76dce59b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:25.215730 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b365d0d5-9737-455b-ad3a-b5da76dce59b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Old instance type m1.heat2, new instance type m1.heat {{(pid=119337) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 23:24:25.223290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-b365d0d5-9737-455b-ad3a-b5da76dce59b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:24:25.223901 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-b365d0d5-9737-455b-ad3a-b5da76dce59b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:24:25.224203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-b365d0d5-9737-455b-ad3a-b5da76dce59b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:24:25.224663 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-b365d0d5-9737-455b-ad3a-b5da76dce59b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:24:25.225143 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-b365d0d5-9737-455b-ad3a-b5da76dce59b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:24:25.298158 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b365d0d5-9737-455b-ad3a-b5da76dce59b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "POST /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1/action" status: 202 len: 0 microversion: 2.1 time: 0.150647 Jul 19 23:24:25.299263 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3308/6609] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:24:25 2022] POST /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:24:25.309043 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-67b4585b-2466-45e0-9238-fa7defef8dd9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:25.310237 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-67b4585b-2466-45e0-9238-fa7defef8dd9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:25.314544 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=19 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:24:25.314949 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:24:25.324604 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67b4585b-2466-45e0-9238-fa7defef8dd9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:25.325430 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67b4585b-2466-45e0-9238-fa7defef8dd9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:25.327013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67b4585b-2466-45e0-9238-fa7defef8dd9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:25.327691 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67b4585b-2466-45e0-9238-fa7defef8dd9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:25.509140 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-67b4585b-2466-45e0-9238-fa7defef8dd9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:25.517912 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-67b4585b-2466-45e0-9238-fa7defef8dd9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1677 microversion: 2.1 time: 0.214292 Jul 19 23:24:25.519004 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3302/6610] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:25 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1677 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:24:26.538733 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cdf0e04c-4712-46c2-ae6a-7d8df055c624 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:26.539416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cdf0e04c-4712-46c2-ae6a-7d8df055c624 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:26.546722 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cdf0e04c-4712-46c2-ae6a-7d8df055c624 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:26.547221 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cdf0e04c-4712-46c2-ae6a-7d8df055c624 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:26.548002 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cdf0e04c-4712-46c2-ae6a-7d8df055c624 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:26.548453 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cdf0e04c-4712-46c2-ae6a-7d8df055c624 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:26.683269 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cdf0e04c-4712-46c2-ae6a-7d8df055c624 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:26.690910 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cdf0e04c-4712-46c2-ae6a-7d8df055c624 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1677 microversion: 2.1 time: 0.157084 Jul 19 23:24:26.691876 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3309/6611] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:26 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:27.708656 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-21525d24-224b-4915-873d-7e9294cc8503 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:27.709224 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-21525d24-224b-4915-873d-7e9294cc8503 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:27.719319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-21525d24-224b-4915-873d-7e9294cc8503 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:27.720057 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-21525d24-224b-4915-873d-7e9294cc8503 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:27.720547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-21525d24-224b-4915-873d-7e9294cc8503 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:27.720987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-21525d24-224b-4915-873d-7e9294cc8503 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:27.867477 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-21525d24-224b-4915-873d-7e9294cc8503 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:27.876061 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-21525d24-224b-4915-873d-7e9294cc8503 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1682 microversion: 2.1 time: 0.171417 Jul 19 23:24:27.876672 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3303/6612] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:27 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:28.894277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a762d8c9-4f83-47ad-88dc-dc244c767f28 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:28.894827 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a762d8c9-4f83-47ad-88dc-dc244c767f28 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:28.901974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a762d8c9-4f83-47ad-88dc-dc244c767f28 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:28.902439 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a762d8c9-4f83-47ad-88dc-dc244c767f28 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:28.903250 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a762d8c9-4f83-47ad-88dc-dc244c767f28 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:28.903699 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a762d8c9-4f83-47ad-88dc-dc244c767f28 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:29.043917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a762d8c9-4f83-47ad-88dc-dc244c767f28 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:29.051525 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a762d8c9-4f83-47ad-88dc-dc244c767f28 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1682 microversion: 2.1 time: 0.161306 Jul 19 23:24:29.052113 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3310/6613] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:28 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:30.068672 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c93e0dc4-b0d8-4dfa-82b8-b6631e80fd53 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:30.069421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c93e0dc4-b0d8-4dfa-82b8-b6631e80fd53 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:30.076773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c93e0dc4-b0d8-4dfa-82b8-b6631e80fd53 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:30.077225 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c93e0dc4-b0d8-4dfa-82b8-b6631e80fd53 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:30.078001 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c93e0dc4-b0d8-4dfa-82b8-b6631e80fd53 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:30.078446 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c93e0dc4-b0d8-4dfa-82b8-b6631e80fd53 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:30.210851 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c93e0dc4-b0d8-4dfa-82b8-b6631e80fd53 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:30.219312 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c93e0dc4-b0d8-4dfa-82b8-b6631e80fd53 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1682 microversion: 2.1 time: 0.154675 Jul 19 23:24:30.219885 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3304/6614] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:30 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:31.236570 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-434a2171-feb1-4645-8d42-871f1d7c1ab3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:31.237224 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-434a2171-feb1-4645-8d42-871f1d7c1ab3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:31.244072 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-434a2171-feb1-4645-8d42-871f1d7c1ab3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:31.244586 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-434a2171-feb1-4645-8d42-871f1d7c1ab3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:31.245405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-434a2171-feb1-4645-8d42-871f1d7c1ab3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:31.245856 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-434a2171-feb1-4645-8d42-871f1d7c1ab3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:31.386103 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-434a2171-feb1-4645-8d42-871f1d7c1ab3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:31.393739 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-434a2171-feb1-4645-8d42-871f1d7c1ab3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1682 microversion: 2.1 time: 0.161093 Jul 19 23:24:31.394324 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3311/6615] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:31 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:32.411614 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cd848f50-c67b-44de-a3a5-2394e95d180b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:32.412275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cd848f50-c67b-44de-a3a5-2394e95d180b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:32.419725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd848f50-c67b-44de-a3a5-2394e95d180b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:32.420180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd848f50-c67b-44de-a3a5-2394e95d180b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:32.420980 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd848f50-c67b-44de-a3a5-2394e95d180b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:32.421415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cd848f50-c67b-44de-a3a5-2394e95d180b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:32.554898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cd848f50-c67b-44de-a3a5-2394e95d180b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:32.563350 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cd848f50-c67b-44de-a3a5-2394e95d180b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1682 microversion: 2.1 time: 0.155755 Jul 19 23:24:32.563933 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3305/6616] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:32 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:33.580870 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ab0c76dd-f9aa-4601-ba87-3ce627da3ca9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:33.581502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ab0c76dd-f9aa-4601-ba87-3ce627da3ca9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:33.588456 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab0c76dd-f9aa-4601-ba87-3ce627da3ca9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:33.589029 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab0c76dd-f9aa-4601-ba87-3ce627da3ca9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:33.589798 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab0c76dd-f9aa-4601-ba87-3ce627da3ca9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:33.590246 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab0c76dd-f9aa-4601-ba87-3ce627da3ca9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:33.723277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ab0c76dd-f9aa-4601-ba87-3ce627da3ca9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:33.727834 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ab0c76dd-f9aa-4601-ba87-3ce627da3ca9 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1682 microversion: 2.1 time: 0.150887 Jul 19 23:24:33.728410 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3312/6617] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:33 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:34.744084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8ed90219-3984-4287-8e21-00f2da525085 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:34.745355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8ed90219-3984-4287-8e21-00f2da525085 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:34.752374 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ed90219-3984-4287-8e21-00f2da525085 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:34.752826 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ed90219-3984-4287-8e21-00f2da525085 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:34.753606 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ed90219-3984-4287-8e21-00f2da525085 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:34.754046 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8ed90219-3984-4287-8e21-00f2da525085 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:34.898831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8ed90219-3984-4287-8e21-00f2da525085 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:34.906862 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8ed90219-3984-4287-8e21-00f2da525085 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1682 microversion: 2.1 time: 0.166695 Jul 19 23:24:34.907484 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3306/6618] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:34 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:35.925121 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d81a60c3-834c-41e1-8791-74e36f6b74e6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:35.925771 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d81a60c3-834c-41e1-8791-74e36f6b74e6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:35.933406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d81a60c3-834c-41e1-8791-74e36f6b74e6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:35.933877 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d81a60c3-834c-41e1-8791-74e36f6b74e6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:35.934653 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d81a60c3-834c-41e1-8791-74e36f6b74e6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:35.935136 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d81a60c3-834c-41e1-8791-74e36f6b74e6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:36.065483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d81a60c3-834c-41e1-8791-74e36f6b74e6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:36.073798 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d81a60c3-834c-41e1-8791-74e36f6b74e6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1682 microversion: 2.1 time: 0.152787 Jul 19 23:24:36.074370 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3313/6619] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:35 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:37.092170 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4a3aa254-2cff-4c1f-b356-babf3b50b321 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:37.092782 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4a3aa254-2cff-4c1f-b356-babf3b50b321 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:37.099900 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4a3aa254-2cff-4c1f-b356-babf3b50b321 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:37.100341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4a3aa254-2cff-4c1f-b356-babf3b50b321 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:37.101118 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4a3aa254-2cff-4c1f-b356-babf3b50b321 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:37.101550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4a3aa254-2cff-4c1f-b356-babf3b50b321 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:37.243847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4a3aa254-2cff-4c1f-b356-babf3b50b321 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:37.252671 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4a3aa254-2cff-4c1f-b356-babf3b50b321 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1682 microversion: 2.1 time: 0.165151 Jul 19 23:24:37.253329 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3307/6620] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:37 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:38.271228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9bc3b254-0300-41ec-99e3-77de66aecf92 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:38.272153 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9bc3b254-0300-41ec-99e3-77de66aecf92 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:38.278989 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9bc3b254-0300-41ec-99e3-77de66aecf92 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:38.279654 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9bc3b254-0300-41ec-99e3-77de66aecf92 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:38.280440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9bc3b254-0300-41ec-99e3-77de66aecf92 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:38.280885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9bc3b254-0300-41ec-99e3-77de66aecf92 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:38.412800 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9bc3b254-0300-41ec-99e3-77de66aecf92 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:38.420708 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9bc3b254-0300-41ec-99e3-77de66aecf92 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1682 microversion: 2.1 time: 0.154575 Jul 19 23:24:38.421285 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3314/6621] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:38 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:39.438479 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2c06b6ce-29b0-4209-b97c-28426c8b003e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:39.439093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2c06b6ce-29b0-4209-b97c-28426c8b003e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:39.446020 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c06b6ce-29b0-4209-b97c-28426c8b003e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:39.446476 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c06b6ce-29b0-4209-b97c-28426c8b003e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:39.447342 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c06b6ce-29b0-4209-b97c-28426c8b003e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:39.447730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2c06b6ce-29b0-4209-b97c-28426c8b003e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:39.583379 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2c06b6ce-29b0-4209-b97c-28426c8b003e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:39.592656 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2c06b6ce-29b0-4209-b97c-28426c8b003e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1682 microversion: 2.1 time: 0.158062 Jul 19 23:24:39.593249 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3308/6622] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:39 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:40.609831 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7d1e4247-9efe-40dc-93d8-c2453f4d0d2f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:40.611128 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7d1e4247-9efe-40dc-93d8-c2453f4d0d2f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:40.625787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d1e4247-9efe-40dc-93d8-c2453f4d0d2f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:40.626606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d1e4247-9efe-40dc-93d8-c2453f4d0d2f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:40.628733 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d1e4247-9efe-40dc-93d8-c2453f4d0d2f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:40.629203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d1e4247-9efe-40dc-93d8-c2453f4d0d2f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:40.772098 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7d1e4247-9efe-40dc-93d8-c2453f4d0d2f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:40.781023 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7d1e4247-9efe-40dc-93d8-c2453f4d0d2f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1682 microversion: 2.1 time: 0.175000 Jul 19 23:24:40.782004 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3315/6623] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:40 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:41.798653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3c64203a-3dbd-4ea7-ad34-689febb71233 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:41.799318 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3c64203a-3dbd-4ea7-ad34-689febb71233 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:41.806395 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3c64203a-3dbd-4ea7-ad34-689febb71233 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:41.807371 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3c64203a-3dbd-4ea7-ad34-689febb71233 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:41.807839 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3c64203a-3dbd-4ea7-ad34-689febb71233 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:41.808289 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3c64203a-3dbd-4ea7-ad34-689febb71233 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:41.938484 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3c64203a-3dbd-4ea7-ad34-689febb71233 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:41.946108 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3c64203a-3dbd-4ea7-ad34-689febb71233 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1682 microversion: 2.1 time: 0.151394 Jul 19 23:24:41.946687 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3309/6624] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:41 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:42.964428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7c58edfd-7097-4262-aaf8-77ce27dfb027 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:42.965091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7c58edfd-7097-4262-aaf8-77ce27dfb027 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:42.972234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7c58edfd-7097-4262-aaf8-77ce27dfb027 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:42.972705 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7c58edfd-7097-4262-aaf8-77ce27dfb027 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:42.973495 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7c58edfd-7097-4262-aaf8-77ce27dfb027 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:42.973949 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7c58edfd-7097-4262-aaf8-77ce27dfb027 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:43.116179 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7c58edfd-7097-4262-aaf8-77ce27dfb027 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:43.124720 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7c58edfd-7097-4262-aaf8-77ce27dfb027 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1682 microversion: 2.1 time: 0.164463 Jul 19 23:24:43.125322 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3316/6625] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:42 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:44.142000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-95c49ac6-692c-4028-a6aa-c2f00b951403 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:44.142664 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-95c49ac6-692c-4028-a6aa-c2f00b951403 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:44.150040 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-95c49ac6-692c-4028-a6aa-c2f00b951403 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:44.150561 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-95c49ac6-692c-4028-a6aa-c2f00b951403 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:44.151482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-95c49ac6-692c-4028-a6aa-c2f00b951403 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:44.151811 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-95c49ac6-692c-4028-a6aa-c2f00b951403 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:44.296942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-95c49ac6-692c-4028-a6aa-c2f00b951403 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:44.304727 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-95c49ac6-692c-4028-a6aa-c2f00b951403 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1682 microversion: 2.1 time: 0.166655 Jul 19 23:24:44.305307 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3310/6626] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:44 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:44.788696 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-a36aec52-e682-4e4c-ac63-8c6789fb1920 req-591075b1-a391-4d44-aaa9-d78b7af364a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94fe62ab-c4e5-420e-9924-aa0b127a63b1", "name": "network-vif-unplugged", "status": "completed", "tag": "67743435-a3b7-459e-adc7-1f70baa8efee"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:24:44.799774 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a36aec52-e682-4e4c-ac63-8c6789fb1920 req-591075b1-a391-4d44-aaa9-d78b7af364a0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:44.800354 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a36aec52-e682-4e4c-ac63-8c6789fb1920 req-591075b1-a391-4d44-aaa9-d78b7af364a0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:44.818223 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-a36aec52-e682-4e4c-ac63-8c6789fb1920 req-591075b1-a391-4d44-aaa9-d78b7af364a0 service nova] Creating event network-vif-unplugged:67743435-a3b7-459e-adc7-1f70baa8efee for instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 on n-h1-847009-3 Jul 19 23:24:44.824467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [req-a36aec52-e682-4e4c-ac63-8c6789fb1920 req-591075b1-a391-4d44-aaa9-d78b7af364a0 service nova] Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119337) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 23:24:44.845609 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-a36aec52-e682-4e4c-ac63-8c6789fb1920 req-591075b1-a391-4d44-aaa9-d78b7af364a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054142 Jul 19 23:24:44.845609 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3317/6627] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:24:45.324392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-74e9845b-f6f2-40ba-8573-bf5293e73254 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:45.325353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-74e9845b-f6f2-40ba-8573-bf5293e73254 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:45.332862 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-74e9845b-f6f2-40ba-8573-bf5293e73254 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:45.333318 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-74e9845b-f6f2-40ba-8573-bf5293e73254 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:45.334385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-74e9845b-f6f2-40ba-8573-bf5293e73254 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:45.334826 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-74e9845b-f6f2-40ba-8573-bf5293e73254 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:45.962573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-74e9845b-f6f2-40ba-8573-bf5293e73254 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:45.972741 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-74e9845b-f6f2-40ba-8573-bf5293e73254 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1681 microversion: 2.1 time: 0.652651 Jul 19 23:24:45.973341 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3311/6628] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:45 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1681 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:46.859413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-39b80874-c135-40dc-870c-74db31f9b9d5 req-ded87538-930e-49ff-b746-fa38130912f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94fe62ab-c4e5-420e-9924-aa0b127a63b1", "tag": "67743435-a3b7-459e-adc7-1f70baa8efee"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:24:46.868665 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-39b80874-c135-40dc-870c-74db31f9b9d5 req-ded87538-930e-49ff-b746-fa38130912f9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:46.870247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-39b80874-c135-40dc-870c-74db31f9b9d5 req-ded87538-930e-49ff-b746-fa38130912f9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:46.881940 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-39b80874-c135-40dc-870c-74db31f9b9d5 req-ded87538-930e-49ff-b746-fa38130912f9 service nova] Creating event network-changed:67743435-a3b7-459e-adc7-1f70baa8efee for instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 on n-h1-847009-3 Jul 19 23:24:46.888429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [req-39b80874-c135-40dc-870c-74db31f9b9d5 req-ded87538-930e-49ff-b746-fa38130912f9 service nova] Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119337) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 23:24:46.901936 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-39b80874-c135-40dc-870c-74db31f9b9d5 req-ded87538-930e-49ff-b746-fa38130912f9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046662 Jul 19 23:24:46.902557 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3318/6629] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:24:46.989870 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-09f3d9c3-d980-41a6-9928-5180af619e42 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:46.990495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-09f3d9c3-d980-41a6-9928-5180af619e42 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:46.998045 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-09f3d9c3-d980-41a6-9928-5180af619e42 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:46.998504 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-09f3d9c3-d980-41a6-9928-5180af619e42 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:46.999309 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-09f3d9c3-d980-41a6-9928-5180af619e42 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:46.999758 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-09f3d9c3-d980-41a6-9928-5180af619e42 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:47.137115 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-09f3d9c3-d980-41a6-9928-5180af619e42 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:47.144973 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-09f3d9c3-d980-41a6-9928-5180af619e42 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1679 microversion: 2.1 time: 0.159006 Jul 19 23:24:47.145573 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3312/6630] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:46 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:48.163535 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-afa1af3f-f72d-4340-8379-1f0e331f6239 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:48.164308 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-afa1af3f-f72d-4340-8379-1f0e331f6239 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:48.172344 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-afa1af3f-f72d-4340-8379-1f0e331f6239 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:48.173110 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-afa1af3f-f72d-4340-8379-1f0e331f6239 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:48.174103 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-afa1af3f-f72d-4340-8379-1f0e331f6239 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:48.174635 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-afa1af3f-f72d-4340-8379-1f0e331f6239 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:48.370362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-afa1af3f-f72d-4340-8379-1f0e331f6239 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:48.378052 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-afa1af3f-f72d-4340-8379-1f0e331f6239 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1679 microversion: 2.1 time: 0.218884 Jul 19 23:24:48.378846 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3319/6631] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:48 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1679 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:49.396136 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2ee131d7-3b67-4e51-8b34-453a68f35ef1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:49.396929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2ee131d7-3b67-4e51-8b34-453a68f35ef1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:49.404911 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2ee131d7-3b67-4e51-8b34-453a68f35ef1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:49.405369 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2ee131d7-3b67-4e51-8b34-453a68f35ef1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:49.406136 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2ee131d7-3b67-4e51-8b34-453a68f35ef1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:49.406576 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2ee131d7-3b67-4e51-8b34-453a68f35ef1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:49.536623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2ee131d7-3b67-4e51-8b34-453a68f35ef1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:49.544828 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2ee131d7-3b67-4e51-8b34-453a68f35ef1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1676 microversion: 2.1 time: 0.153044 Jul 19 23:24:49.545403 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3313/6632] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:49 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:49.561327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fda70535-a3bd-4127-a5df-e6bfd4785198 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:24:49.561957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fda70535-a3bd-4127-a5df-e6bfd4785198 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:49.568898 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fda70535-a3bd-4127-a5df-e6bfd4785198 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:49.569356 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fda70535-a3bd-4127-a5df-e6bfd4785198 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:49.570126 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fda70535-a3bd-4127-a5df-e6bfd4785198 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:49.570577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fda70535-a3bd-4127-a5df-e6bfd4785198 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:49.608548 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fda70535-a3bd-4127-a5df-e6bfd4785198 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:49.608928 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fda70535-a3bd-4127-a5df-e6bfd4785198 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:49.609734 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fda70535-a3bd-4127-a5df-e6bfd4785198 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:49.610182 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fda70535-a3bd-4127-a5df-e6bfd4785198 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:49.632965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-fda70535-a3bd-4127-a5df-e6bfd4785198 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Getting quotas for project a9630a1ac2a54421a9b04421e1560776. Resources: {'cores', 'ram'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:24:49.638200 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-fda70535-a3bd-4127-a5df-e6bfd4785198 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Getting quotas for user 31a6b598a39a45bbb09381b4c27f354f and project a9630a1ac2a54421a9b04421e1560776. Resources: {'cores', 'ram'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:24:49.721723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:24:49.737654 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fda70535-a3bd-4127-a5df-e6bfd4785198 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "POST /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1/action" status: 202 len: 0 microversion: 2.1 time: 0.180202 Jul 19 23:24:49.738367 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3320/6633] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:24:49 2022] POST /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:24:49.747612 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-81371050-c620-4ffb-a980-b206dd65bea1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:49.748230 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-81371050-c620-4ffb-a980-b206dd65bea1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:49.754459 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81371050-c620-4ffb-a980-b206dd65bea1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:49.754913 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81371050-c620-4ffb-a980-b206dd65bea1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:49.755713 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81371050-c620-4ffb-a980-b206dd65bea1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:49.756189 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81371050-c620-4ffb-a980-b206dd65bea1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:49.961960 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-81371050-c620-4ffb-a980-b206dd65bea1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:49.970491 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-81371050-c620-4ffb-a980-b206dd65bea1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1675 microversion: 2.1 time: 0.227915 Jul 19 23:24:49.971593 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3314/6634] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:49 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1675 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:50.990587 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b0fbb59c-a35b-4182-8dd2-e27bd09823c7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:50.991337 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b0fbb59c-a35b-4182-8dd2-e27bd09823c7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:51.000103 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b0fbb59c-a35b-4182-8dd2-e27bd09823c7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:51.000601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b0fbb59c-a35b-4182-8dd2-e27bd09823c7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:51.001394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b0fbb59c-a35b-4182-8dd2-e27bd09823c7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:51.001856 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b0fbb59c-a35b-4182-8dd2-e27bd09823c7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:51.139667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b0fbb59c-a35b-4182-8dd2-e27bd09823c7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:51.147336 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b0fbb59c-a35b-4182-8dd2-e27bd09823c7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1675 microversion: 2.1 time: 0.162395 Jul 19 23:24:51.147916 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3321/6635] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:50 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:52.164981 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4b47eeba-934c-469a-8cd0-cfc8234ae172 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:52.165731 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4b47eeba-934c-469a-8cd0-cfc8234ae172 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:52.172736 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b47eeba-934c-469a-8cd0-cfc8234ae172 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:52.173202 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b47eeba-934c-469a-8cd0-cfc8234ae172 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:52.173994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b47eeba-934c-469a-8cd0-cfc8234ae172 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:52.174613 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b47eeba-934c-469a-8cd0-cfc8234ae172 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:52.308586 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4b47eeba-934c-469a-8cd0-cfc8234ae172 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:52.318342 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4b47eeba-934c-469a-8cd0-cfc8234ae172 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1675 microversion: 2.1 time: 0.156842 Jul 19 23:24:52.319475 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3315/6636] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:52 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:52.352302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-cae62825-2750-42dd-9137-41e936d00c7e req-98b7dde2-c00d-4e90-b2d5-005a3385805d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94fe62ab-c4e5-420e-9924-aa0b127a63b1", "name": "network-vif-plugged", "status": "completed", "tag": "67743435-a3b7-459e-adc7-1f70baa8efee"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:24:52.362974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-cae62825-2750-42dd-9137-41e936d00c7e req-98b7dde2-c00d-4e90-b2d5-005a3385805d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:52.363537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-cae62825-2750-42dd-9137-41e936d00c7e req-98b7dde2-c00d-4e90-b2d5-005a3385805d service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:52.377927 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-cae62825-2750-42dd-9137-41e936d00c7e req-98b7dde2-c00d-4e90-b2d5-005a3385805d service nova] Creating event network-vif-plugged:67743435-a3b7-459e-adc7-1f70baa8efee for instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 on n-h1-847009-3 Jul 19 23:24:52.385998 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [req-cae62825-2750-42dd-9137-41e936d00c7e req-98b7dde2-c00d-4e90-b2d5-005a3385805d service nova] Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119337) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 23:24:52.397431 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-cae62825-2750-42dd-9137-41e936d00c7e req-98b7dde2-c00d-4e90-b2d5-005a3385805d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049464 Jul 19 23:24:52.398302 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3322/6637] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:24:53.094771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-0ef194e4-89a3-4674-9769-174703211b65 req-ff510ede-9c8d-4148-b436-3f3c24caa28f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94fe62ab-c4e5-420e-9924-aa0b127a63b1", "name": "network-vif-unplugged", "status": "completed", "tag": "67743435-a3b7-459e-adc7-1f70baa8efee"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:24:53.103153 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0ef194e4-89a3-4674-9769-174703211b65 req-ff510ede-9c8d-4148-b436-3f3c24caa28f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:53.103618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0ef194e4-89a3-4674-9769-174703211b65 req-ff510ede-9c8d-4148-b436-3f3c24caa28f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:53.116060 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-0ef194e4-89a3-4674-9769-174703211b65 req-ff510ede-9c8d-4148-b436-3f3c24caa28f service nova] Creating event network-vif-unplugged:67743435-a3b7-459e-adc7-1f70baa8efee for instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 on n-h2-847009-3 Jul 19 23:24:53.122380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [req-0ef194e4-89a3-4674-9769-174703211b65 req-ff510ede-9c8d-4148-b436-3f3c24caa28f service nova] Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119338) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 23:24:53.133507 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-0ef194e4-89a3-4674-9769-174703211b65 req-ff510ede-9c8d-4148-b436-3f3c24caa28f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042428 Jul 19 23:24:53.134179 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3316/6638] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:24:53.339354 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a5aec76c-9760-4038-89bd-1544fe0ffe40 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:53.340186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a5aec76c-9760-4038-89bd-1544fe0ffe40 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:53.346634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5aec76c-9760-4038-89bd-1544fe0ffe40 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:53.347224 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5aec76c-9760-4038-89bd-1544fe0ffe40 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:53.348021 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5aec76c-9760-4038-89bd-1544fe0ffe40 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:53.348500 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5aec76c-9760-4038-89bd-1544fe0ffe40 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:53.489234 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a5aec76c-9760-4038-89bd-1544fe0ffe40 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:53.497414 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a5aec76c-9760-4038-89bd-1544fe0ffe40 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1675 microversion: 2.1 time: 0.163167 Jul 19 23:24:53.498017 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3323/6639] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:53 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:54.515355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9d267cb8-3578-41e2-8d09-d8f624fb2200 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:54.516058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9d267cb8-3578-41e2-8d09-d8f624fb2200 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:54.522296 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d267cb8-3578-41e2-8d09-d8f624fb2200 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:54.522759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d267cb8-3578-41e2-8d09-d8f624fb2200 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:54.523557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d267cb8-3578-41e2-8d09-d8f624fb2200 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:54.524003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d267cb8-3578-41e2-8d09-d8f624fb2200 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:54.669928 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9d267cb8-3578-41e2-8d09-d8f624fb2200 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:54.677634 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9d267cb8-3578-41e2-8d09-d8f624fb2200 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1675 microversion: 2.1 time: 0.167480 Jul 19 23:24:54.678205 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3317/6640] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:54 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:55.154890 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-1cb15b18-db32-41da-8f16-d133b73c7798 req-1b0398c5-916b-4e7e-a1d1-08e84e1d4d17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94fe62ab-c4e5-420e-9924-aa0b127a63b1", "tag": "67743435-a3b7-459e-adc7-1f70baa8efee"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:24:55.163045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1cb15b18-db32-41da-8f16-d133b73c7798 req-1b0398c5-916b-4e7e-a1d1-08e84e1d4d17 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:55.163535 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1cb15b18-db32-41da-8f16-d133b73c7798 req-1b0398c5-916b-4e7e-a1d1-08e84e1d4d17 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:55.179554 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-1cb15b18-db32-41da-8f16-d133b73c7798 req-1b0398c5-916b-4e7e-a1d1-08e84e1d4d17 service nova] Creating event network-changed:67743435-a3b7-459e-adc7-1f70baa8efee for instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 on n-h2-847009-3 Jul 19 23:24:55.185482 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [req-1cb15b18-db32-41da-8f16-d133b73c7798 req-1b0398c5-916b-4e7e-a1d1-08e84e1d4d17 service nova] Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119337) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 23:24:55.196209 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-1cb15b18-db32-41da-8f16-d133b73c7798 req-1b0398c5-916b-4e7e-a1d1-08e84e1d4d17 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046595 Jul 19 23:24:55.198341 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3324/6641] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:24:55.290885 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:24:55.291074 n-d-847009-3 devstack@n-api.service[119338]: Tue Jul 19 23:24:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:24:55.699412 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-64e3d1d0-f4d8-4368-af36-af82f87f7f6d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:55.700078 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-64e3d1d0-f4d8-4368-af36-af82f87f7f6d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:55.706815 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=33 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:24:55.708515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-64e3d1d0-f4d8-4368-af36-af82f87f7f6d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:55.709228 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-64e3d1d0-f4d8-4368-af36-af82f87f7f6d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:55.710291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-64e3d1d0-f4d8-4368-af36-af82f87f7f6d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:55.711093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-64e3d1d0-f4d8-4368-af36-af82f87f7f6d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:55.717331 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=95 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:24:55.878373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-64e3d1d0-f4d8-4368-af36-af82f87f7f6d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:55.886781 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-64e3d1d0-f4d8-4368-af36-af82f87f7f6d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1675 microversion: 2.1 time: 0.194594 Jul 19 23:24:55.887399 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3318/6642] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:55 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1675 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:56.906743 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0efb15ac-25ed-4bf3-a81a-320ea7cd7e43 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:56.907529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0efb15ac-25ed-4bf3-a81a-320ea7cd7e43 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:56.909486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:24:56.916378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0efb15ac-25ed-4bf3-a81a-320ea7cd7e43 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:56.916933 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0efb15ac-25ed-4bf3-a81a-320ea7cd7e43 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:56.917727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0efb15ac-25ed-4bf3-a81a-320ea7cd7e43 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:56.918186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0efb15ac-25ed-4bf3-a81a-320ea7cd7e43 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:57.054080 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0efb15ac-25ed-4bf3-a81a-320ea7cd7e43 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:57.061834 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0efb15ac-25ed-4bf3-a81a-320ea7cd7e43 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1668 microversion: 2.1 time: 0.160253 Jul 19 23:24:57.062415 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3325/6643] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:56 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:24:57.078742 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e97c42c2-5e10-4db5-b5f1-a65c16a2b329 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:57.079380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e97c42c2-5e10-4db5-b5f1-a65c16a2b329 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:57.086160 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e97c42c2-5e10-4db5-b5f1-a65c16a2b329 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:57.086606 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e97c42c2-5e10-4db5-b5f1-a65c16a2b329 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:57.088036 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e97c42c2-5e10-4db5-b5f1-a65c16a2b329 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:57.088479 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e97c42c2-5e10-4db5-b5f1-a65c16a2b329 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:57.219874 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e97c42c2-5e10-4db5-b5f1-a65c16a2b329 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:57.227372 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e97c42c2-5e10-4db5-b5f1-a65c16a2b329 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1668 microversion: 2.1 time: 0.152711 Jul 19 23:24:57.227985 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3319/6644] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:57 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:57.244770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f15dd869-ac52-4c58-8933-bed303521528 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:57.245395 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f15dd869-ac52-4c58-8933-bed303521528 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:57.251741 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f15dd869-ac52-4c58-8933-bed303521528 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:57.252198 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f15dd869-ac52-4c58-8933-bed303521528 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:57.252973 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f15dd869-ac52-4c58-8933-bed303521528 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:57.253422 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f15dd869-ac52-4c58-8933-bed303521528 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:57.383753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f15dd869-ac52-4c58-8933-bed303521528 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:57.392247 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f15dd869-ac52-4c58-8933-bed303521528 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1668 microversion: 2.1 time: 0.151345 Jul 19 23:24:57.392830 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3326/6645] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:57 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:57.409480 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cfc1ca00-7f2b-4e5c-ab94-a2eb52efa8d7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:57.410013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cfc1ca00-7f2b-4e5c-ab94-a2eb52efa8d7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:57.418961 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cfc1ca00-7f2b-4e5c-ab94-a2eb52efa8d7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:57.419457 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cfc1ca00-7f2b-4e5c-ab94-a2eb52efa8d7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:57.420238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cfc1ca00-7f2b-4e5c-ab94-a2eb52efa8d7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:57.420676 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cfc1ca00-7f2b-4e5c-ab94-a2eb52efa8d7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:57.446020 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cfc1ca00-7f2b-4e5c-ab94-a2eb52efa8d7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:24:57.527653 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cfc1ca00-7f2b-4e5c-ab94-a2eb52efa8d7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "DELETE /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 204 len: 0 microversion: 2.1 time: 0.121619 Jul 19 23:24:57.528356 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3320/6646] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:24:57 2022] DELETE /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:24:57.537211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dfb605be-e4d0-479c-8e5d-6dfcde55e90f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:57.537863 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dfb605be-e4d0-479c-8e5d-6dfcde55e90f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:57.544578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dfb605be-e4d0-479c-8e5d-6dfcde55e90f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:57.545045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dfb605be-e4d0-479c-8e5d-6dfcde55e90f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:57.545851 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dfb605be-e4d0-479c-8e5d-6dfcde55e90f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:57.546306 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dfb605be-e4d0-479c-8e5d-6dfcde55e90f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:57.708707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dfb605be-e4d0-479c-8e5d-6dfcde55e90f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:57.717156 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dfb605be-e4d0-479c-8e5d-6dfcde55e90f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1674 microversion: 2.1 time: 0.184470 Jul 19 23:24:57.717750 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3327/6647] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:57 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1674 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:58.735716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-53de1646-3fc4-4545-a5bc-2e62969b2f90 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:58.736502 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-53de1646-3fc4-4545-a5bc-2e62969b2f90 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:58.743439 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53de1646-3fc4-4545-a5bc-2e62969b2f90 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:58.743914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53de1646-3fc4-4545-a5bc-2e62969b2f90 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:58.744773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53de1646-3fc4-4545-a5bc-2e62969b2f90 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:58.745213 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53de1646-3fc4-4545-a5bc-2e62969b2f90 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:58.888653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-53de1646-3fc4-4545-a5bc-2e62969b2f90 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:24:58.896269 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-53de1646-3fc4-4545-a5bc-2e62969b2f90 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1674 microversion: 2.1 time: 0.165123 Jul 19 23:24:58.896841 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3321/6648] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:58 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:24:59.835607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-6eaf11e7-efb3-450b-8f86-4b9a84b2fe14 req-57a4bcbf-6e01-48bd-810b-6f27ead7ee4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94fe62ab-c4e5-420e-9924-aa0b127a63b1", "name": "network-vif-deleted", "tag": "67743435-a3b7-459e-adc7-1f70baa8efee"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:24:59.842448 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:24:59.846980 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-6eaf11e7-efb3-450b-8f86-4b9a84b2fe14 req-57a4bcbf-6e01-48bd-810b-6f27ead7ee4c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:59.847545 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-6eaf11e7-efb3-450b-8f86-4b9a84b2fe14 req-57a4bcbf-6e01-48bd-810b-6f27ead7ee4c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:59.861328 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-6eaf11e7-efb3-450b-8f86-4b9a84b2fe14 req-57a4bcbf-6e01-48bd-810b-6f27ead7ee4c service nova] Creating event network-vif-deleted:67743435-a3b7-459e-adc7-1f70baa8efee for instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 on n-h2-847009-3 Jul 19 23:24:59.866350 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-6eaf11e7-efb3-450b-8f86-4b9a84b2fe14 req-57a4bcbf-6e01-48bd-810b-6f27ead7ee4c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034646 Jul 19 23:24:59.867269 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3328/6649] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:24:59.918610 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d8a97343-4583-4912-864a-9ff2044371ed tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:24:59.919237 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d8a97343-4583-4912-864a-9ff2044371ed tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:24:59.927543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d8a97343-4583-4912-864a-9ff2044371ed tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:59.928076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d8a97343-4583-4912-864a-9ff2044371ed tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:59.929052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d8a97343-4583-4912-864a-9ff2044371ed tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:59.929734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d8a97343-4583-4912-864a-9ff2044371ed tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:59.967230 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d8a97343-4583-4912-864a-9ff2044371ed tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:24:59.967426 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d8a97343-4583-4912-864a-9ff2044371ed tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:24:59.967798 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-d8a97343-4583-4912-864a-9ff2044371ed tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lazy-loading 'fault' on Instance uuid 94fe62ab-c4e5-420e-9924-aa0b127a63b1 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:25:00.022428 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d8a97343-4583-4912-864a-9ff2044371ed tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:25:00.031457 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d8a97343-4583-4912-864a-9ff2044371ed tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 200 len: 1328 microversion: 2.1 time: 0.119758 Jul 19 23:25:00.037243 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3322/6650] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:24:59 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 1328 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:25:01.050763 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8c772f87-d6b6-4958-ba88-b53eb90cf0ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:25:01.051515 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8c772f87-d6b6-4958-ba88-b53eb90cf0ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:25:01.058528 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c772f87-d6b6-4958-ba88-b53eb90cf0ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:01.058994 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c772f87-d6b6-4958-ba88-b53eb90cf0ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:01.059803 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c772f87-d6b6-4958-ba88-b53eb90cf0ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:01.060259 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c772f87-d6b6-4958-ba88-b53eb90cf0ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:01.074594 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-8c772f87-d6b6-4958-ba88-b53eb90cf0ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] HTTP exception thrown: Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 could not be found. Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8c772f87-d6b6-4958-ba88-b53eb90cf0ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Request method failure captured: Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 HTTP/1.1 Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zxbjEL1rIaQyxdVky0xIYD_tIAWcYLUfp6LpkDLw-jF6fnAMxiX8SS4d5Ix1ZKPVX7s3onGefSgeKLTlOXzWrM0MnLdSrmCJf8_C472uqB44monndTK4btN_tzIPDRcV1Z3ZuBZsMiKg4z2aZ3Jy7asoPb-HoMx-iBmC_MF92p7pXk Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerActionsTestJSON-338741719 Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 31a6b598a39a45bbb09381b4c27f354f Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 could not be found. Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '94fe62ab-c4e5-420e-9924-aa0b127a63b1'} Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 could not be found. Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 could not be found. Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:25:01.076554 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:25:01.080823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:25:01.080823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:25:01.080823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:25:01.080823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:25:01.080823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:25:01.080823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 could not be found. Jul 19 23:25:01.080823 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:25:01.080823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8c772f87-d6b6-4958-ba88-b53eb90cf0ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Returning 404 to user: Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:25:01.080823 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8c772f87-d6b6-4958-ba88-b53eb90cf0ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 404 len: 111 microversion: 2.1 time: 0.032414 Jul 19 23:25:01.080823 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3329/6651] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:25:01 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:25:01.096261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7807dc40-0521-46a8-bd38-b7a07bb2cdbb tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:25:01.096876 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7807dc40-0521-46a8-bd38-b7a07bb2cdbb tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:25:01.103888 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7807dc40-0521-46a8-bd38-b7a07bb2cdbb tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:01.104337 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7807dc40-0521-46a8-bd38-b7a07bb2cdbb tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:01.105095 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7807dc40-0521-46a8-bd38-b7a07bb2cdbb tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:01.105532 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7807dc40-0521-46a8-bd38-b7a07bb2cdbb tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:01.118863 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-7807dc40-0521-46a8-bd38-b7a07bb2cdbb tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] HTTP exception thrown: Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 could not be found. Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7807dc40-0521-46a8-bd38-b7a07bb2cdbb tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Request method failure captured: Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 HTTP/1.1 Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zxbjEL1rIaQyxdVky0xIYD_tIAWcYLUfp6LpkDLw-jF6fnAMxiX8SS4d5Ix1ZKPVX7s3onGefSgeKLTlOXzWrM0MnLdSrmCJf8_C472uqB44monndTK4btN_tzIPDRcV1Z3ZuBZsMiKg4z2aZ3Jy7asoPb-HoMx-iBmC_MF92p7pXk Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerActionsTestJSON-338741719 Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 31a6b598a39a45bbb09381b4c27f354f Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 could not be found. Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '94fe62ab-c4e5-420e-9924-aa0b127a63b1'} Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 could not be found. Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 could not be found. Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:25:01.120420 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:25:01.124233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:25:01.124233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:25:01.124233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:25:01.124233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:25:01.124233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:25:01.124233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 could not be found. Jul 19 23:25:01.124233 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:25:01.124233 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7807dc40-0521-46a8-bd38-b7a07bb2cdbb tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Returning 404 to user: Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:25:01.124233 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7807dc40-0521-46a8-bd38-b7a07bb2cdbb tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 404 len: 111 microversion: 2.1 time: 0.029812 Jul 19 23:25:01.124233 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3323/6652] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:25:01 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:25:01.169783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9644763b-5529-4b0a-a052-22397afe2939 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-375379858", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "ec89eb26-634b-4a9b-b267-bb50a8595550"}], "security_groups": [{"name": "tempest-securitygroup--1231291026"}], "key_name": "tempest-keypair-1107466307", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:25:01.273425 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-9644763b-5529-4b0a-a052-22397afe2939 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] validate_networks() for [('ec89eb26-634b-4a9b-b267-bb50a8595550', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:25:01.720801 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-9644763b-5529-4b0a-a052-22397afe2939 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:25:01.721245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-9644763b-5529-4b0a-a052-22397afe2939 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:25:01.721738 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-9644763b-5529-4b0a-a052-22397afe2939 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:25:01.722167 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-9644763b-5529-4b0a-a052-22397afe2939 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:25:01.722596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-9644763b-5529-4b0a-a052-22397afe2939 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:25:01.734791 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9644763b-5529-4b0a-a052-22397afe2939 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:01.735305 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9644763b-5529-4b0a-a052-22397afe2939 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:01.736159 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9644763b-5529-4b0a-a052-22397afe2939 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:01.736617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9644763b-5529-4b0a-a052-22397afe2939 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:01.753931 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-9644763b-5529-4b0a-a052-22397afe2939 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Getting quotas for project a9630a1ac2a54421a9b04421e1560776. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:25:01.759363 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-9644763b-5529-4b0a-a052-22397afe2939 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Getting quotas for user 31a6b598a39a45bbb09381b4c27f354f and project a9630a1ac2a54421a9b04421e1560776. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:25:01.771701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9644763b-5529-4b0a-a052-22397afe2939 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:25:01.773970 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9644763b-5529-4b0a-a052-22397afe2939 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:25:01.821073 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9644763b-5529-4b0a-a052-22397afe2939 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.655160 Jul 19 23:25:01.821780 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3330/6653] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:25:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:25:01.832250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f223b8ae-ec73-4e4e-bbf6-04324cdcd3f2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:25:01.832875 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f223b8ae-ec73-4e4e-bbf6-04324cdcd3f2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:25:01.887391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f223b8ae-ec73-4e4e-bbf6-04324cdcd3f2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:25:01.896663 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f223b8ae-ec73-4e4e-bbf6-04324cdcd3f2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1238 microversion: 2.1 time: 0.068396 Jul 19 23:25:01.897235 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3324/6654] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:25:01 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:25:02.914539 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-44084191-b155-470f-a288-6b54513e58b3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:25:02.915274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-44084191-b155-470f-a288-6b54513e58b3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:25:02.923647 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-44084191-b155-470f-a288-6b54513e58b3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:02.924109 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-44084191-b155-470f-a288-6b54513e58b3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:02.924906 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-44084191-b155-470f-a288-6b54513e58b3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:02.925356 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-44084191-b155-470f-a288-6b54513e58b3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:02.990720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-44084191-b155-470f-a288-6b54513e58b3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:25:02.999036 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-44084191-b155-470f-a288-6b54513e58b3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1296 microversion: 2.1 time: 0.088685 Jul 19 23:25:02.999644 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3331/6655] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:25:02 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1296 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:25:04.018899 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b86d97e4-c7f0-4110-b2eb-c719c8ad8bc2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:25:04.020914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b86d97e4-c7f0-4110-b2eb-c719c8ad8bc2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:25:04.030407 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b86d97e4-c7f0-4110-b2eb-c719c8ad8bc2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:04.032044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b86d97e4-c7f0-4110-b2eb-c719c8ad8bc2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:04.033221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b86d97e4-c7f0-4110-b2eb-c719c8ad8bc2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:04.033863 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b86d97e4-c7f0-4110-b2eb-c719c8ad8bc2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:04.192315 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-468c092f-bac1-493d-a7d9-a6f1f7c99b26 req-3ed54122-8641-4a91-90e3-e743c43a5d91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ae72d38-25d9-4e38-830c-6bbd80831125", "tag": "c666060c-0b74-4f27-aec9-13a6ad3ef0e5"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:25:04.216316 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b86d97e4-c7f0-4110-b2eb-c719c8ad8bc2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:25:04.216708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-468c092f-bac1-493d-a7d9-a6f1f7c99b26 req-3ed54122-8641-4a91-90e3-e743c43a5d91 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:04.218574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-468c092f-bac1-493d-a7d9-a6f1f7c99b26 req-3ed54122-8641-4a91-90e3-e743c43a5d91 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:04.229158 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b86d97e4-c7f0-4110-b2eb-c719c8ad8bc2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1364 microversion: 2.1 time: 0.215683 Jul 19 23:25:04.229757 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3325/6656] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:25:04 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:25:04.240738 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-468c092f-bac1-493d-a7d9-a6f1f7c99b26 req-3ed54122-8641-4a91-90e3-e743c43a5d91 service nova] Creating event network-changed:c666060c-0b74-4f27-aec9-13a6ad3ef0e5 for instance 8ae72d38-25d9-4e38-830c-6bbd80831125 on n-h2-847009-3 Jul 19 23:25:04.255159 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-468c092f-bac1-493d-a7d9-a6f1f7c99b26 req-3ed54122-8641-4a91-90e3-e743c43a5d91 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067847 Jul 19 23:25:04.258618 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3332/6657] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:25:05.246820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-981bf3a4-b4c9-4ca1-8a8b-08975f9dc995 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:25:05.247462 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-981bf3a4-b4c9-4ca1-8a8b-08975f9dc995 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:25:05.254580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-981bf3a4-b4c9-4ca1-8a8b-08975f9dc995 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:05.255027 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-981bf3a4-b4c9-4ca1-8a8b-08975f9dc995 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:05.255827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-981bf3a4-b4c9-4ca1-8a8b-08975f9dc995 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:05.256264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-981bf3a4-b4c9-4ca1-8a8b-08975f9dc995 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:05.397301 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-981bf3a4-b4c9-4ca1-8a8b-08975f9dc995 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:25:05.406368 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-981bf3a4-b4c9-4ca1-8a8b-08975f9dc995 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1364 microversion: 2.1 time: 0.163612 Jul 19 23:25:05.406952 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3326/6658] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:25:05 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:25:06.424625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3bb52823-9156-4587-9025-74fc9f6debcf tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:25:06.425360 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3bb52823-9156-4587-9025-74fc9f6debcf tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:25:06.432467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3bb52823-9156-4587-9025-74fc9f6debcf tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:06.432935 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3bb52823-9156-4587-9025-74fc9f6debcf tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:06.433723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3bb52823-9156-4587-9025-74fc9f6debcf tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:06.434183 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3bb52823-9156-4587-9025-74fc9f6debcf tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:06.573817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3bb52823-9156-4587-9025-74fc9f6debcf tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:25:06.581957 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3bb52823-9156-4587-9025-74fc9f6debcf tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1364 microversion: 2.1 time: 0.162610 Jul 19 23:25:06.582545 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3333/6659] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:25:06 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:25:07.599909 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5481c298-f28b-4c25-bf4c-2587ad7b98ce tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:25:07.600571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5481c298-f28b-4c25-bf4c-2587ad7b98ce tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:25:07.609079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5481c298-f28b-4c25-bf4c-2587ad7b98ce tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:07.609543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5481c298-f28b-4c25-bf4c-2587ad7b98ce tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:07.610335 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5481c298-f28b-4c25-bf4c-2587ad7b98ce tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:07.610785 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5481c298-f28b-4c25-bf4c-2587ad7b98ce tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:07.758430 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5481c298-f28b-4c25-bf4c-2587ad7b98ce tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:25:07.766386 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5481c298-f28b-4c25-bf4c-2587ad7b98ce tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1364 microversion: 2.1 time: 0.170323 Jul 19 23:25:07.766987 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3327/6660] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:25:07 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:25:08.786338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6bc65785-59f0-4004-8241-d73e3ec02564 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:25:08.786957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6bc65785-59f0-4004-8241-d73e3ec02564 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:25:08.794021 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6bc65785-59f0-4004-8241-d73e3ec02564 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:08.794492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6bc65785-59f0-4004-8241-d73e3ec02564 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:08.795314 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6bc65785-59f0-4004-8241-d73e3ec02564 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:08.795842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6bc65785-59f0-4004-8241-d73e3ec02564 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:08.927521 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6bc65785-59f0-4004-8241-d73e3ec02564 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:25:08.935728 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6bc65785-59f0-4004-8241-d73e3ec02564 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1364 microversion: 2.1 time: 0.153321 Jul 19 23:25:08.936306 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3334/6661] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:25:08 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:25:09.599378 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-1af8e7b2-b4ed-4e4d-8edb-33474ef78445 req-f1da9113-9d3c-4a80-be9e-6d418770a234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae72d38-25d9-4e38-830c-6bbd80831125", "name": "network-vif-plugged", "status": "completed", "tag": "c666060c-0b74-4f27-aec9-13a6ad3ef0e5"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:25:09.609994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-1af8e7b2-b4ed-4e4d-8edb-33474ef78445 req-f1da9113-9d3c-4a80-be9e-6d418770a234 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:09.610467 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-1af8e7b2-b4ed-4e4d-8edb-33474ef78445 req-f1da9113-9d3c-4a80-be9e-6d418770a234 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:09.622676 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-1af8e7b2-b4ed-4e4d-8edb-33474ef78445 req-f1da9113-9d3c-4a80-be9e-6d418770a234 service nova] Creating event network-vif-plugged:c666060c-0b74-4f27-aec9-13a6ad3ef0e5 for instance 8ae72d38-25d9-4e38-830c-6bbd80831125 on n-h2-847009-3 Jul 19 23:25:09.627932 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-1af8e7b2-b4ed-4e4d-8edb-33474ef78445 req-f1da9113-9d3c-4a80-be9e-6d418770a234 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032219 Jul 19 23:25:09.628578 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3328/6662] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:25:09.953575 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0ecbf6ef-3d5c-433d-8be3-1ddcb04e9ddf tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:25:09.954260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0ecbf6ef-3d5c-433d-8be3-1ddcb04e9ddf tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:25:09.961385 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ecbf6ef-3d5c-433d-8be3-1ddcb04e9ddf tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:09.962497 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ecbf6ef-3d5c-433d-8be3-1ddcb04e9ddf tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:09.963243 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ecbf6ef-3d5c-433d-8be3-1ddcb04e9ddf tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:09.963698 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ecbf6ef-3d5c-433d-8be3-1ddcb04e9ddf tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:10.105671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0ecbf6ef-3d5c-433d-8be3-1ddcb04e9ddf tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:25:10.113522 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0ecbf6ef-3d5c-433d-8be3-1ddcb04e9ddf tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1364 microversion: 2.1 time: 0.164096 Jul 19 23:25:10.114119 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3335/6663] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:25:09 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:25:11.132906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-56713908-e616-4dfd-9330-b566d51c7b4e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:25:11.133788 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-56713908-e616-4dfd-9330-b566d51c7b4e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:25:11.141484 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56713908-e616-4dfd-9330-b566d51c7b4e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:11.141943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56713908-e616-4dfd-9330-b566d51c7b4e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:11.142733 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56713908-e616-4dfd-9330-b566d51c7b4e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:11.143222 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-56713908-e616-4dfd-9330-b566d51c7b4e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:11.286488 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-56713908-e616-4dfd-9330-b566d51c7b4e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:25:11.295454 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-56713908-e616-4dfd-9330-b566d51c7b4e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1550 microversion: 2.1 time: 0.167164 Jul 19 23:25:11.296039 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3329/6664] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:25:11 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1550 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:25:11.312421 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d32b7c90-026b-44e5-9abc-ebc305cb4c8b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:25:11.312914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d32b7c90-026b-44e5-9abc-ebc305cb4c8b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:25:11.319955 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d32b7c90-026b-44e5-9abc-ebc305cb4c8b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:11.320426 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d32b7c90-026b-44e5-9abc-ebc305cb4c8b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:11.322106 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d32b7c90-026b-44e5-9abc-ebc305cb4c8b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:11.322563 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d32b7c90-026b-44e5-9abc-ebc305cb4c8b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:11.400553 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d32b7c90-026b-44e5-9abc-ebc305cb4c8b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091944 Jul 19 23:25:11.401161 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3336/6665] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 19 23:25:11 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:25:12.692285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-0dbae19d-6013-481a-9a58-974b08936538 req-7e7fa68f-a99e-4910-a54a-75971f1b9b93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ae72d38-25d9-4e38-830c-6bbd80831125", "tag": "c666060c-0b74-4f27-aec9-13a6ad3ef0e5"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:25:12.696361 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:25:12.703924 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0dbae19d-6013-481a-9a58-974b08936538 req-7e7fa68f-a99e-4910-a54a-75971f1b9b93 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:12.704468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0dbae19d-6013-481a-9a58-974b08936538 req-7e7fa68f-a99e-4910-a54a-75971f1b9b93 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:12.717435 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-0dbae19d-6013-481a-9a58-974b08936538 req-7e7fa68f-a99e-4910-a54a-75971f1b9b93 service nova] Creating event network-changed:c666060c-0b74-4f27-aec9-13a6ad3ef0e5 for instance 8ae72d38-25d9-4e38-830c-6bbd80831125 on n-h2-847009-3 Jul 19 23:25:12.722548 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-0dbae19d-6013-481a-9a58-974b08936538 req-7e7fa68f-a99e-4910-a54a-75971f1b9b93 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034058 Jul 19 23:25:12.723271 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3330/6666] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:25:48.928748 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:25:48.929680 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:25:48.932521 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:25:48.933362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=74 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:25:48.937791 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-830e57e5-898b-48d0-a5f1-3f3bbf524681 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:25:48.938441 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-830e57e5-898b-48d0-a5f1-3f3bbf524681 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:25:48.947964 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-830e57e5-898b-48d0-a5f1-3f3bbf524681 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:48.948436 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-830e57e5-898b-48d0-a5f1-3f3bbf524681 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:48.949238 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-830e57e5-898b-48d0-a5f1-3f3bbf524681 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:48.949698 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-830e57e5-898b-48d0-a5f1-3f3bbf524681 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:49.089325 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-830e57e5-898b-48d0-a5f1-3f3bbf524681 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:25:49.096948 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-830e57e5-898b-48d0-a5f1-3f3bbf524681 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1668 microversion: 2.1 time: 0.169046 Jul 19 23:25:49.097527 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3337/6667] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:25:48 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:25:49.112077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:25:49.112995 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:25:49.117557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-66f95fe8-dbb4-4a47-a766-04b144d632cc tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "475d614f-0754-4618-9918-d95c57cfe407"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:25:49.119346 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-66f95fe8-dbb4-4a47-a766-04b144d632cc tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:25:49.127748 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66f95fe8-dbb4-4a47-a766-04b144d632cc tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:49.128200 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66f95fe8-dbb4-4a47-a766-04b144d632cc tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:49.128970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66f95fe8-dbb4-4a47-a766-04b144d632cc tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:25:49.129408 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-66f95fe8-dbb4-4a47-a766-04b144d632cc tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:25:49.370327 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-66f95fe8-dbb4-4a47-a766-04b144d632cc tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "POST /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260103 Jul 19 23:25:49.371022 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3331/6668] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 19 23:25:49 2022] POST /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:26:00.033281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9258e890-942a-4347-b014-96ac0e37d735 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:26:00.034269 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9258e890-942a-4347-b014-96ac0e37d735 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:00.037144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:26:00.037829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:26:00.046384 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9258e890-942a-4347-b014-96ac0e37d735 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:00.046848 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9258e890-942a-4347-b014-96ac0e37d735 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:00.047670 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9258e890-942a-4347-b014-96ac0e37d735 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:00.048121 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9258e890-942a-4347-b014-96ac0e37d735 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:00.075988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9258e890-942a-4347-b014-96ac0e37d735 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:00.081770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9258e890-942a-4347-b014-96ac0e37d735 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Old instance type m1.heat2, new instance type m1.heat {{(pid=119337) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 23:26:00.088325 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-9258e890-942a-4347-b014-96ac0e37d735 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:26:00.088757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-9258e890-942a-4347-b014-96ac0e37d735 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:26:00.089243 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-9258e890-942a-4347-b014-96ac0e37d735 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:26:00.089670 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-9258e890-942a-4347-b014-96ac0e37d735 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:26:00.090088 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-9258e890-942a-4347-b014-96ac0e37d735 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:26:00.151939 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9258e890-942a-4347-b014-96ac0e37d735 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "POST /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125/action" status: 202 len: 0 microversion: 2.1 time: 0.123354 Jul 19 23:26:00.152579 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3338/6669] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:26:00 2022] POST /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:26:00.159505 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:26:00.160280 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:26:00.164945 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e3cf1a94-0775-4861-b6c3-bd9fe2c96f9b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:00.165716 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e3cf1a94-0775-4861-b6c3-bd9fe2c96f9b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:00.175240 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e3cf1a94-0775-4861-b6c3-bd9fe2c96f9b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:00.175780 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e3cf1a94-0775-4861-b6c3-bd9fe2c96f9b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:00.176885 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e3cf1a94-0775-4861-b6c3-bd9fe2c96f9b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:00.177320 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e3cf1a94-0775-4861-b6c3-bd9fe2c96f9b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:00.321834 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e3cf1a94-0775-4861-b6c3-bd9fe2c96f9b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:00.332303 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e3cf1a94-0775-4861-b6c3-bd9fe2c96f9b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1723 microversion: 2.1 time: 0.174150 Jul 19 23:26:00.332443 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3332/6670] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:00 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:01.351303 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5a95501b-6512-45e7-923a-aff192af7dd6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:01.352051 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5a95501b-6512-45e7-923a-aff192af7dd6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:01.358909 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a95501b-6512-45e7-923a-aff192af7dd6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:01.359399 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a95501b-6512-45e7-923a-aff192af7dd6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:01.360185 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a95501b-6512-45e7-923a-aff192af7dd6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:01.360634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5a95501b-6512-45e7-923a-aff192af7dd6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:01.506690 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5a95501b-6512-45e7-923a-aff192af7dd6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:01.514953 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5a95501b-6512-45e7-923a-aff192af7dd6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1723 microversion: 2.1 time: 0.168403 Jul 19 23:26:01.515670 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3339/6671] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:01 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:26:02.534146 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a55d4ccb-4f81-49f2-a2e2-62f07a3517f6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:02.535498 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a55d4ccb-4f81-49f2-a2e2-62f07a3517f6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:02.542198 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a55d4ccb-4f81-49f2-a2e2-62f07a3517f6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:02.542665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a55d4ccb-4f81-49f2-a2e2-62f07a3517f6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:02.543481 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a55d4ccb-4f81-49f2-a2e2-62f07a3517f6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:02.544165 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a55d4ccb-4f81-49f2-a2e2-62f07a3517f6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:02.686867 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a55d4ccb-4f81-49f2-a2e2-62f07a3517f6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:02.695023 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a55d4ccb-4f81-49f2-a2e2-62f07a3517f6 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1728 microversion: 2.1 time: 0.164984 Jul 19 23:26:02.695630 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3333/6672] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:02 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:03.713386 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2b130423-8e43-48ab-8e61-54b3e007669e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:03.714028 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2b130423-8e43-48ab-8e61-54b3e007669e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:03.721158 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2b130423-8e43-48ab-8e61-54b3e007669e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:03.721624 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2b130423-8e43-48ab-8e61-54b3e007669e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:03.722408 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2b130423-8e43-48ab-8e61-54b3e007669e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:03.722864 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2b130423-8e43-48ab-8e61-54b3e007669e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:03.861177 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2b130423-8e43-48ab-8e61-54b3e007669e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:03.869217 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2b130423-8e43-48ab-8e61-54b3e007669e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1728 microversion: 2.1 time: 0.159824 Jul 19 23:26:03.869787 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3340/6673] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:03 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:04.887135 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e8899452-3a17-41f7-aafc-0980c6271286 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:04.888662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e8899452-3a17-41f7-aafc-0980c6271286 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:04.895640 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8899452-3a17-41f7-aafc-0980c6271286 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:04.896091 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8899452-3a17-41f7-aafc-0980c6271286 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:04.896852 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8899452-3a17-41f7-aafc-0980c6271286 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:04.897292 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8899452-3a17-41f7-aafc-0980c6271286 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:05.029191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e8899452-3a17-41f7-aafc-0980c6271286 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:05.037346 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e8899452-3a17-41f7-aafc-0980c6271286 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1728 microversion: 2.1 time: 0.154163 Jul 19 23:26:05.037971 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3334/6674] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:04 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:06.054966 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e281fba4-ae3d-4d5b-b6db-954a4625ae4c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:06.055585 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e281fba4-ae3d-4d5b-b6db-954a4625ae4c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:06.062975 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e281fba4-ae3d-4d5b-b6db-954a4625ae4c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:06.063481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e281fba4-ae3d-4d5b-b6db-954a4625ae4c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:06.064266 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e281fba4-ae3d-4d5b-b6db-954a4625ae4c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:06.064723 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e281fba4-ae3d-4d5b-b6db-954a4625ae4c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:06.196496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e281fba4-ae3d-4d5b-b6db-954a4625ae4c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:06.205160 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e281fba4-ae3d-4d5b-b6db-954a4625ae4c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1728 microversion: 2.1 time: 0.154147 Jul 19 23:26:06.205742 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3341/6675] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:06 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:07.221922 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f48a86b8-80a6-41ac-96eb-9eca0f1e0ec5 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:07.222531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f48a86b8-80a6-41ac-96eb-9eca0f1e0ec5 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:07.229396 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f48a86b8-80a6-41ac-96eb-9eca0f1e0ec5 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:07.229841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f48a86b8-80a6-41ac-96eb-9eca0f1e0ec5 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:07.230601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f48a86b8-80a6-41ac-96eb-9eca0f1e0ec5 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:07.231036 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f48a86b8-80a6-41ac-96eb-9eca0f1e0ec5 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:07.364419 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f48a86b8-80a6-41ac-96eb-9eca0f1e0ec5 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:07.373319 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f48a86b8-80a6-41ac-96eb-9eca0f1e0ec5 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1728 microversion: 2.1 time: 0.155271 Jul 19 23:26:07.374008 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3335/6676] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:07 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:08.391489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3ad31846-687c-4940-bb98-1c19641b0761 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:08.392134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3ad31846-687c-4940-bb98-1c19641b0761 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:08.398673 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ad31846-687c-4940-bb98-1c19641b0761 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:08.399157 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ad31846-687c-4940-bb98-1c19641b0761 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:08.399941 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ad31846-687c-4940-bb98-1c19641b0761 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:08.400396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3ad31846-687c-4940-bb98-1c19641b0761 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:08.532421 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3ad31846-687c-4940-bb98-1c19641b0761 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:08.540680 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3ad31846-687c-4940-bb98-1c19641b0761 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1728 microversion: 2.1 time: 0.154036 Jul 19 23:26:08.541479 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3342/6677] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:08 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:09.557900 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a8d6300b-e1e9-40d8-9cb1-067a5ea1bc58 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:09.558524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a8d6300b-e1e9-40d8-9cb1-067a5ea1bc58 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:09.566116 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a8d6300b-e1e9-40d8-9cb1-067a5ea1bc58 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:09.566576 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a8d6300b-e1e9-40d8-9cb1-067a5ea1bc58 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:09.567381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a8d6300b-e1e9-40d8-9cb1-067a5ea1bc58 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:09.567824 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a8d6300b-e1e9-40d8-9cb1-067a5ea1bc58 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:09.706483 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a8d6300b-e1e9-40d8-9cb1-067a5ea1bc58 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:09.714595 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a8d6300b-e1e9-40d8-9cb1-067a5ea1bc58 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1728 microversion: 2.1 time: 0.160720 Jul 19 23:26:09.715189 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3336/6678] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:09 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:10.732131 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1810d616-3d9e-4a4f-9c17-5535ef100199 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:10.732770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1810d616-3d9e-4a4f-9c17-5535ef100199 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:10.739815 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1810d616-3d9e-4a4f-9c17-5535ef100199 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:10.740284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1810d616-3d9e-4a4f-9c17-5535ef100199 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:10.741073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1810d616-3d9e-4a4f-9c17-5535ef100199 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:10.741534 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1810d616-3d9e-4a4f-9c17-5535ef100199 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:10.882260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1810d616-3d9e-4a4f-9c17-5535ef100199 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:10.892098 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1810d616-3d9e-4a4f-9c17-5535ef100199 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1728 microversion: 2.1 time: 0.163966 Jul 19 23:26:10.892960 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3343/6679] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:10 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:11.910145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e8c580cc-76a3-4dd0-976a-e3cc80876ea0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:11.911319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e8c580cc-76a3-4dd0-976a-e3cc80876ea0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:11.920834 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8c580cc-76a3-4dd0-976a-e3cc80876ea0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:11.921310 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8c580cc-76a3-4dd0-976a-e3cc80876ea0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:11.922118 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8c580cc-76a3-4dd0-976a-e3cc80876ea0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:11.922654 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e8c580cc-76a3-4dd0-976a-e3cc80876ea0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:12.077521 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e8c580cc-76a3-4dd0-976a-e3cc80876ea0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:12.086667 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e8c580cc-76a3-4dd0-976a-e3cc80876ea0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1728 microversion: 2.1 time: 0.180603 Jul 19 23:26:12.087287 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3337/6680] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:11 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:13.105066 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f25295fe-8b7c-4649-94cb-100288c7ffa5 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:13.105709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f25295fe-8b7c-4649-94cb-100288c7ffa5 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:13.113402 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f25295fe-8b7c-4649-94cb-100288c7ffa5 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:13.113871 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f25295fe-8b7c-4649-94cb-100288c7ffa5 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:13.114658 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f25295fe-8b7c-4649-94cb-100288c7ffa5 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:13.115131 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f25295fe-8b7c-4649-94cb-100288c7ffa5 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:13.252239 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f25295fe-8b7c-4649-94cb-100288c7ffa5 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:13.260291 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f25295fe-8b7c-4649-94cb-100288c7ffa5 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1728 microversion: 2.1 time: 0.159149 Jul 19 23:26:13.260864 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3344/6681] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:13 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:14.278226 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0ff3bc76-8e18-41c2-9b91-4a5495a56467 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:14.279071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0ff3bc76-8e18-41c2-9b91-4a5495a56467 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:14.287151 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ff3bc76-8e18-41c2-9b91-4a5495a56467 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:14.287608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ff3bc76-8e18-41c2-9b91-4a5495a56467 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:14.288393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ff3bc76-8e18-41c2-9b91-4a5495a56467 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:14.288833 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0ff3bc76-8e18-41c2-9b91-4a5495a56467 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:14.429578 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0ff3bc76-8e18-41c2-9b91-4a5495a56467 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:14.438530 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0ff3bc76-8e18-41c2-9b91-4a5495a56467 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1728 microversion: 2.1 time: 0.164297 Jul 19 23:26:14.439143 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3338/6682] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:14 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:15.456016 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-04bea447-557e-4a5e-b19d-725067fa6fc3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:15.456655 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-04bea447-557e-4a5e-b19d-725067fa6fc3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:15.463614 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-04bea447-557e-4a5e-b19d-725067fa6fc3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:15.464082 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-04bea447-557e-4a5e-b19d-725067fa6fc3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:15.464859 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-04bea447-557e-4a5e-b19d-725067fa6fc3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:15.465308 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-04bea447-557e-4a5e-b19d-725067fa6fc3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:15.604694 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-04bea447-557e-4a5e-b19d-725067fa6fc3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:15.612802 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-04bea447-557e-4a5e-b19d-725067fa6fc3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1728 microversion: 2.1 time: 0.160699 Jul 19 23:26:15.613387 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3345/6683] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:15 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:16.629872 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e2525b03-67e9-490d-be70-7d97f95a3f9f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:16.630484 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e2525b03-67e9-490d-be70-7d97f95a3f9f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:16.637288 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2525b03-67e9-490d-be70-7d97f95a3f9f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:16.637859 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2525b03-67e9-490d-be70-7d97f95a3f9f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:16.638835 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2525b03-67e9-490d-be70-7d97f95a3f9f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:16.639303 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2525b03-67e9-490d-be70-7d97f95a3f9f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:16.769676 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e2525b03-67e9-490d-be70-7d97f95a3f9f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:16.778208 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e2525b03-67e9-490d-be70-7d97f95a3f9f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1728 microversion: 2.1 time: 0.152220 Jul 19 23:26:16.784534 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3339/6684] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:16 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:17.796091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1e5c1cfc-decf-423d-a819-a652a5e7932d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:17.796727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1e5c1cfc-decf-423d-a819-a652a5e7932d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:17.803861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e5c1cfc-decf-423d-a819-a652a5e7932d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:17.804321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e5c1cfc-decf-423d-a819-a652a5e7932d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:17.805102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e5c1cfc-decf-423d-a819-a652a5e7932d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:17.805547 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1e5c1cfc-decf-423d-a819-a652a5e7932d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:17.950186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1e5c1cfc-decf-423d-a819-a652a5e7932d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:17.958539 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1e5c1cfc-decf-423d-a819-a652a5e7932d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1728 microversion: 2.1 time: 0.166876 Jul 19 23:26:17.959142 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3346/6685] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:17 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:18.976322 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f7f9d2f6-7860-4876-8233-78ca0d688d32 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:18.976941 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f7f9d2f6-7860-4876-8233-78ca0d688d32 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:18.984880 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f7f9d2f6-7860-4876-8233-78ca0d688d32 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:18.985330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f7f9d2f6-7860-4876-8233-78ca0d688d32 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:18.986114 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f7f9d2f6-7860-4876-8233-78ca0d688d32 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:18.986555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f7f9d2f6-7860-4876-8233-78ca0d688d32 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:19.125857 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f7f9d2f6-7860-4876-8233-78ca0d688d32 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:19.133862 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f7f9d2f6-7860-4876-8233-78ca0d688d32 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1728 microversion: 2.1 time: 0.161486 Jul 19 23:26:19.134440 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3340/6686] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:18 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:20.152499 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eed4fa87-7641-4419-95f0-d2b405c40d34 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:20.153205 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eed4fa87-7641-4419-95f0-d2b405c40d34 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:20.160046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eed4fa87-7641-4419-95f0-d2b405c40d34 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:20.160509 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eed4fa87-7641-4419-95f0-d2b405c40d34 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:20.161288 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eed4fa87-7641-4419-95f0-d2b405c40d34 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:20.161735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eed4fa87-7641-4419-95f0-d2b405c40d34 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:20.294672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-eed4fa87-7641-4419-95f0-d2b405c40d34 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:20.303464 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eed4fa87-7641-4419-95f0-d2b405c40d34 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1728 microversion: 2.1 time: 0.155232 Jul 19 23:26:20.304047 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3347/6687] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:20 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:21.320794 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8774357a-158c-44e2-bb2b-1d0052d5790c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:21.321454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8774357a-158c-44e2-bb2b-1d0052d5790c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:21.328927 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8774357a-158c-44e2-bb2b-1d0052d5790c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:21.329385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8774357a-158c-44e2-bb2b-1d0052d5790c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:21.330159 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8774357a-158c-44e2-bb2b-1d0052d5790c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:21.330597 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8774357a-158c-44e2-bb2b-1d0052d5790c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:21.540504 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8774357a-158c-44e2-bb2b-1d0052d5790c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:21.548966 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8774357a-158c-44e2-bb2b-1d0052d5790c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1727 microversion: 2.1 time: 0.232083 Jul 19 23:26:21.549558 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3341/6688] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:21 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1727 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:21.637613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-701488b0-05c8-41dd-a6b1-91282cbd4e39 req-567b7ba6-6de7-41b9-858f-3454f1517819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae72d38-25d9-4e38-830c-6bbd80831125", "name": "network-vif-unplugged", "status": "completed", "tag": "c666060c-0b74-4f27-aec9-13a6ad3ef0e5"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:26:21.648333 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-701488b0-05c8-41dd-a6b1-91282cbd4e39 req-567b7ba6-6de7-41b9-858f-3454f1517819 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:21.648472 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-701488b0-05c8-41dd-a6b1-91282cbd4e39 req-567b7ba6-6de7-41b9-858f-3454f1517819 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:21.660764 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-701488b0-05c8-41dd-a6b1-91282cbd4e39 req-567b7ba6-6de7-41b9-858f-3454f1517819 service nova] Creating event network-vif-unplugged:c666060c-0b74-4f27-aec9-13a6ad3ef0e5 for instance 8ae72d38-25d9-4e38-830c-6bbd80831125 on n-h1-847009-3 Jul 19 23:26:21.666104 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [req-701488b0-05c8-41dd-a6b1-91282cbd4e39 req-567b7ba6-6de7-41b9-858f-3454f1517819 service nova] Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119337) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 23:26:21.678158 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-701488b0-05c8-41dd-a6b1-91282cbd4e39 req-567b7ba6-6de7-41b9-858f-3454f1517819 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044228 Jul 19 23:26:21.679182 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3348/6689] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:26:22.566397 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-24511a67-7c51-4164-9fec-7ac9c7aa8b9c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:22.567619 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-24511a67-7c51-4164-9fec-7ac9c7aa8b9c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:22.575290 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24511a67-7c51-4164-9fec-7ac9c7aa8b9c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:22.575762 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24511a67-7c51-4164-9fec-7ac9c7aa8b9c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:22.578084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24511a67-7c51-4164-9fec-7ac9c7aa8b9c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:22.578084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24511a67-7c51-4164-9fec-7ac9c7aa8b9c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:22.714098 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-24511a67-7c51-4164-9fec-7ac9c7aa8b9c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:22.722995 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-24511a67-7c51-4164-9fec-7ac9c7aa8b9c tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1727 microversion: 2.1 time: 0.160756 Jul 19 23:26:22.723607 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3342/6690] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:22 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:23.696938 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-50199f51-07d5-4e69-9345-10f433d1e4f9 req-93a9d64b-2725-42e6-b733-18a4a7aa05f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ae72d38-25d9-4e38-830c-6bbd80831125", "tag": "c666060c-0b74-4f27-aec9-13a6ad3ef0e5"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:26:23.706274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-50199f51-07d5-4e69-9345-10f433d1e4f9 req-93a9d64b-2725-42e6-b733-18a4a7aa05f0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:23.706730 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-50199f51-07d5-4e69-9345-10f433d1e4f9 req-93a9d64b-2725-42e6-b733-18a4a7aa05f0 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:23.718342 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-50199f51-07d5-4e69-9345-10f433d1e4f9 req-93a9d64b-2725-42e6-b733-18a4a7aa05f0 service nova] Creating event network-changed:c666060c-0b74-4f27-aec9-13a6ad3ef0e5 for instance 8ae72d38-25d9-4e38-830c-6bbd80831125 on n-h1-847009-3 Jul 19 23:26:23.723605 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [req-50199f51-07d5-4e69-9345-10f433d1e4f9 req-93a9d64b-2725-42e6-b733-18a4a7aa05f0 service nova] Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119337) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 23:26:23.734123 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-50199f51-07d5-4e69-9345-10f433d1e4f9 req-93a9d64b-2725-42e6-b733-18a4a7aa05f0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042059 Jul 19 23:26:23.734908 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3349/6691] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:26:23.740476 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5d17019b-35c8-4363-8560-1c4f1c8a6583 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:23.741101 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5d17019b-35c8-4363-8560-1c4f1c8a6583 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:23.751300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d17019b-35c8-4363-8560-1c4f1c8a6583 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:23.751765 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d17019b-35c8-4363-8560-1c4f1c8a6583 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:23.752565 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d17019b-35c8-4363-8560-1c4f1c8a6583 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:23.753000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d17019b-35c8-4363-8560-1c4f1c8a6583 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:24.003524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5d17019b-35c8-4363-8560-1c4f1c8a6583 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:24.016656 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5d17019b-35c8-4363-8560-1c4f1c8a6583 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1725 microversion: 2.1 time: 0.280049 Jul 19 23:26:24.027127 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3343/6692] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:23 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1725 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:25.035370 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-db60496e-43e5-4459-abe4-c799d78505ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:25.036096 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-db60496e-43e5-4459-abe4-c799d78505ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:25.042799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db60496e-43e5-4459-abe4-c799d78505ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:25.043236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db60496e-43e5-4459-abe4-c799d78505ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:25.044049 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db60496e-43e5-4459-abe4-c799d78505ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:25.044578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-db60496e-43e5-4459-abe4-c799d78505ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:25.204437 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-db60496e-43e5-4459-abe4-c799d78505ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:25.213296 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-db60496e-43e5-4459-abe4-c799d78505ad tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1725 microversion: 2.1 time: 0.183141 Jul 19 23:26:25.214031 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3350/6693] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:25 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:26.231494 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b789eb54-69ef-4277-b3a3-d8f218001b5f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:26.232143 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b789eb54-69ef-4277-b3a3-d8f218001b5f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:26.240024 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b789eb54-69ef-4277-b3a3-d8f218001b5f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:26.240475 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b789eb54-69ef-4277-b3a3-d8f218001b5f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:26.241258 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b789eb54-69ef-4277-b3a3-d8f218001b5f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:26.241692 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b789eb54-69ef-4277-b3a3-d8f218001b5f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:26.380892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b789eb54-69ef-4277-b3a3-d8f218001b5f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:26.389465 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b789eb54-69ef-4277-b3a3-d8f218001b5f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1725 microversion: 2.1 time: 0.161421 Jul 19 23:26:26.390216 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3344/6694] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:26 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:27.406518 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0be2d707-4bb5-47cc-ba70-8a47234648a3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:27.407357 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0be2d707-4bb5-47cc-ba70-8a47234648a3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:27.414631 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0be2d707-4bb5-47cc-ba70-8a47234648a3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:27.415241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0be2d707-4bb5-47cc-ba70-8a47234648a3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:27.416030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0be2d707-4bb5-47cc-ba70-8a47234648a3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:27.416608 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0be2d707-4bb5-47cc-ba70-8a47234648a3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:27.554271 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0be2d707-4bb5-47cc-ba70-8a47234648a3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:27.564284 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0be2d707-4bb5-47cc-ba70-8a47234648a3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1725 microversion: 2.1 time: 0.161801 Jul 19 23:26:27.564874 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3351/6695] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:27 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:28.582553 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-08171adc-0958-4366-b8b0-ac0084fe8964 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:28.583182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-08171adc-0958-4366-b8b0-ac0084fe8964 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:28.590029 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-08171adc-0958-4366-b8b0-ac0084fe8964 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:28.590474 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-08171adc-0958-4366-b8b0-ac0084fe8964 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:28.591262 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-08171adc-0958-4366-b8b0-ac0084fe8964 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:28.591817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-08171adc-0958-4366-b8b0-ac0084fe8964 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:28.723438 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-08171adc-0958-4366-b8b0-ac0084fe8964 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:28.731478 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-08171adc-0958-4366-b8b0-ac0084fe8964 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1725 microversion: 2.1 time: 0.152810 Jul 19 23:26:28.732054 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3345/6696] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:28 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:29.749022 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e008b551-1d41-4427-a64c-33fb3e22ccfd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:29.749677 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e008b551-1d41-4427-a64c-33fb3e22ccfd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:29.756604 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e008b551-1d41-4427-a64c-33fb3e22ccfd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:29.757059 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e008b551-1d41-4427-a64c-33fb3e22ccfd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:29.757829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e008b551-1d41-4427-a64c-33fb3e22ccfd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:29.758276 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e008b551-1d41-4427-a64c-33fb3e22ccfd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:29.895859 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e008b551-1d41-4427-a64c-33fb3e22ccfd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:29.903889 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e008b551-1d41-4427-a64c-33fb3e22ccfd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1725 microversion: 2.1 time: 0.159042 Jul 19 23:26:29.904984 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3352/6697] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:29 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:30.922634 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8d31d78d-51b5-4f68-a84b-55341d6bfd07 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:30.923286 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8d31d78d-51b5-4f68-a84b-55341d6bfd07 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:30.925982 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=29 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:26:30.931424 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d31d78d-51b5-4f68-a84b-55341d6bfd07 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:30.931880 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d31d78d-51b5-4f68-a84b-55341d6bfd07 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:30.932656 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d31d78d-51b5-4f68-a84b-55341d6bfd07 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:30.933101 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d31d78d-51b5-4f68-a84b-55341d6bfd07 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:30.938958 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=85 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:26:31.066307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8d31d78d-51b5-4f68-a84b-55341d6bfd07 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:31.074744 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8d31d78d-51b5-4f68-a84b-55341d6bfd07 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1725 microversion: 2.1 time: 0.156624 Jul 19 23:26:31.075338 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3346/6698] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:30 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:32.092493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ab3f5121-e895-4767-9bf2-9dbd24b684be tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:32.093086 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ab3f5121-e895-4767-9bf2-9dbd24b684be tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:32.096033 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=35 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:26:32.101786 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab3f5121-e895-4767-9bf2-9dbd24b684be tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:32.102245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab3f5121-e895-4767-9bf2-9dbd24b684be tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:32.103019 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab3f5121-e895-4767-9bf2-9dbd24b684be tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:32.103566 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab3f5121-e895-4767-9bf2-9dbd24b684be tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:32.107888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:26:32.240982 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ab3f5121-e895-4767-9bf2-9dbd24b684be tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:32.249784 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ab3f5121-e895-4767-9bf2-9dbd24b684be tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1725 microversion: 2.1 time: 0.161299 Jul 19 23:26:32.250491 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3353/6699] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:32 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:33.270425 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-383ccbeb-18a9-4b4c-ab4f-7bb82f6e9d41 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:33.271049 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-383ccbeb-18a9-4b4c-ab4f-7bb82f6e9d41 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:33.278227 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-383ccbeb-18a9-4b4c-ab4f-7bb82f6e9d41 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:33.278834 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-383ccbeb-18a9-4b4c-ab4f-7bb82f6e9d41 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:33.279649 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-383ccbeb-18a9-4b4c-ab4f-7bb82f6e9d41 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:33.280776 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-383ccbeb-18a9-4b4c-ab4f-7bb82f6e9d41 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:33.410040 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-383ccbeb-18a9-4b4c-ab4f-7bb82f6e9d41 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:33.418011 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-383ccbeb-18a9-4b4c-ab4f-7bb82f6e9d41 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1725 microversion: 2.1 time: 0.151557 Jul 19 23:26:33.418589 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3347/6700] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:33 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:34.435920 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9de8f5ad-0217-4519-b891-66b10fc026f1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:34.436596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9de8f5ad-0217-4519-b891-66b10fc026f1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:34.443592 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9de8f5ad-0217-4519-b891-66b10fc026f1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:34.444055 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9de8f5ad-0217-4519-b891-66b10fc026f1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:34.444837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9de8f5ad-0217-4519-b891-66b10fc026f1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:34.445285 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9de8f5ad-0217-4519-b891-66b10fc026f1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:34.582141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9de8f5ad-0217-4519-b891-66b10fc026f1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:34.590116 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9de8f5ad-0217-4519-b891-66b10fc026f1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1725 microversion: 2.1 time: 0.158126 Jul 19 23:26:34.590966 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3354/6701] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:34 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:35.389281 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:26:35.389856 n-d-847009-3 devstack@n-api.service[119338]: Tue Jul 19 23:26:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:26:35.609636 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-776c17fe-3be1-49c8-b39b-aa77d6bf6c5b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:35.610264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-776c17fe-3be1-49c8-b39b-aa77d6bf6c5b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:35.617339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-776c17fe-3be1-49c8-b39b-aa77d6bf6c5b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:35.617797 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-776c17fe-3be1-49c8-b39b-aa77d6bf6c5b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:35.618571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-776c17fe-3be1-49c8-b39b-aa77d6bf6c5b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:35.619023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-776c17fe-3be1-49c8-b39b-aa77d6bf6c5b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:35.747637 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-776c17fe-3be1-49c8-b39b-aa77d6bf6c5b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:35.755830 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-776c17fe-3be1-49c8-b39b-aa77d6bf6c5b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1722 microversion: 2.1 time: 0.151090 Jul 19 23:26:35.756405 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3348/6702] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:35 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:35.772491 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bca50cd7-5401-4a8a-8703-29462866f9e2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:26:35.773070 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bca50cd7-5401-4a8a-8703-29462866f9e2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:35.780706 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bca50cd7-5401-4a8a-8703-29462866f9e2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:35.781190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bca50cd7-5401-4a8a-8703-29462866f9e2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:35.781982 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bca50cd7-5401-4a8a-8703-29462866f9e2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:35.782431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bca50cd7-5401-4a8a-8703-29462866f9e2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:35.820277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bca50cd7-5401-4a8a-8703-29462866f9e2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:35.820743 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bca50cd7-5401-4a8a-8703-29462866f9e2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:35.821547 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bca50cd7-5401-4a8a-8703-29462866f9e2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:35.821997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bca50cd7-5401-4a8a-8703-29462866f9e2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:35.842882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-bca50cd7-5401-4a8a-8703-29462866f9e2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Getting quotas for project a9630a1ac2a54421a9b04421e1560776. Resources: {'cores', 'ram'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:26:35.848125 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-bca50cd7-5401-4a8a-8703-29462866f9e2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Getting quotas for user 31a6b598a39a45bbb09381b4c27f354f and project a9630a1ac2a54421a9b04421e1560776. Resources: {'cores', 'ram'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:26:35.948377 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bca50cd7-5401-4a8a-8703-29462866f9e2 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "POST /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125/action" status: 202 len: 0 microversion: 2.1 time: 0.179519 Jul 19 23:26:35.948988 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3355/6703] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:26:35 2022] POST /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 23:26:35.958179 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f90b1c12-0309-453f-8435-282051b36ef4 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:35.958814 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f90b1c12-0309-453f-8435-282051b36ef4 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:35.964947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f90b1c12-0309-453f-8435-282051b36ef4 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:35.965411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f90b1c12-0309-453f-8435-282051b36ef4 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:35.966200 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f90b1c12-0309-453f-8435-282051b36ef4 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:35.966679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f90b1c12-0309-453f-8435-282051b36ef4 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:36.169541 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f90b1c12-0309-453f-8435-282051b36ef4 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:36.177888 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f90b1c12-0309-453f-8435-282051b36ef4 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1721 microversion: 2.1 time: 0.223462 Jul 19 23:26:36.178496 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3349/6704] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:35 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:36.875857 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-a773b0f8-e3d5-49ec-8f0c-654589426f00 req-b3291285-fb8e-478f-afdd-fcab647591d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae72d38-25d9-4e38-830c-6bbd80831125", "name": "network-vif-plugged", "status": "completed", "tag": "c666060c-0b74-4f27-aec9-13a6ad3ef0e5"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:26:36.886101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a773b0f8-e3d5-49ec-8f0c-654589426f00 req-b3291285-fb8e-478f-afdd-fcab647591d1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:36.886658 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a773b0f8-e3d5-49ec-8f0c-654589426f00 req-b3291285-fb8e-478f-afdd-fcab647591d1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:36.898999 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-a773b0f8-e3d5-49ec-8f0c-654589426f00 req-b3291285-fb8e-478f-afdd-fcab647591d1 service nova] Creating event network-vif-plugged:c666060c-0b74-4f27-aec9-13a6ad3ef0e5 for instance 8ae72d38-25d9-4e38-830c-6bbd80831125 on n-h1-847009-3 Jul 19 23:26:36.904517 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [req-a773b0f8-e3d5-49ec-8f0c-654589426f00 req-b3291285-fb8e-478f-afdd-fcab647591d1 service nova] Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119337) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 23:26:36.915898 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-a773b0f8-e3d5-49ec-8f0c-654589426f00 req-b3291285-fb8e-478f-afdd-fcab647591d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045913 Jul 19 23:26:36.917117 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3356/6705] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:26:37.103439 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:26:37.103605 n-d-847009-3 devstack@n-api.service[119337]: Tue Jul 19 23:26:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:26:37.196698 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-de034474-eab6-45bf-85dc-24c1dcce65fd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:37.197353 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-de034474-eab6-45bf-85dc-24c1dcce65fd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:37.205342 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de034474-eab6-45bf-85dc-24c1dcce65fd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:37.205806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de034474-eab6-45bf-85dc-24c1dcce65fd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:37.206583 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de034474-eab6-45bf-85dc-24c1dcce65fd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:37.207030 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de034474-eab6-45bf-85dc-24c1dcce65fd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:37.341937 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-de034474-eab6-45bf-85dc-24c1dcce65fd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:37.350606 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-de034474-eab6-45bf-85dc-24c1dcce65fd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1721 microversion: 2.1 time: 0.158448 Jul 19 23:26:37.351196 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3350/6706] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:37 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:38.369112 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3f4aa8bd-5e9f-48a7-9c03-042f087cd88f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:38.369830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3f4aa8bd-5e9f-48a7-9c03-042f087cd88f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:38.377833 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f4aa8bd-5e9f-48a7-9c03-042f087cd88f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:38.378294 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f4aa8bd-5e9f-48a7-9c03-042f087cd88f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:38.379070 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f4aa8bd-5e9f-48a7-9c03-042f087cd88f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:38.379545 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3f4aa8bd-5e9f-48a7-9c03-042f087cd88f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:38.515306 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3f4aa8bd-5e9f-48a7-9c03-042f087cd88f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:38.523225 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3f4aa8bd-5e9f-48a7-9c03-042f087cd88f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1721 microversion: 2.1 time: 0.158412 Jul 19 23:26:38.523787 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3357/6707] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:38 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:39.541121 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b50015c5-1b49-4a4b-a883-3785f8e4c614 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:39.541739 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b50015c5-1b49-4a4b-a883-3785f8e4c614 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:39.549352 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b50015c5-1b49-4a4b-a883-3785f8e4c614 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:39.549809 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b50015c5-1b49-4a4b-a883-3785f8e4c614 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:39.550744 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b50015c5-1b49-4a4b-a883-3785f8e4c614 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:39.551212 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b50015c5-1b49-4a4b-a883-3785f8e4c614 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:39.685146 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b50015c5-1b49-4a4b-a883-3785f8e4c614 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:39.693791 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b50015c5-1b49-4a4b-a883-3785f8e4c614 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1721 microversion: 2.1 time: 0.156590 Jul 19 23:26:39.694370 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3351/6708] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:39 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:40.713836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5e99012c-6d72-44d8-9d59-468233f2c972 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:40.714469 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5e99012c-6d72-44d8-9d59-468233f2c972 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:40.721534 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5e99012c-6d72-44d8-9d59-468233f2c972 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:40.722003 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5e99012c-6d72-44d8-9d59-468233f2c972 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:40.722785 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5e99012c-6d72-44d8-9d59-468233f2c972 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:40.723271 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5e99012c-6d72-44d8-9d59-468233f2c972 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:40.873534 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5e99012c-6d72-44d8-9d59-468233f2c972 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:40.884389 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5e99012c-6d72-44d8-9d59-468233f2c972 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1721 microversion: 2.1 time: 0.174648 Jul 19 23:26:40.884969 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3358/6709] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:40 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:41.522066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-adacf16e-151c-4504-965a-a4c0374a62a3 req-6bb33979-9247-4a81-a239-8001fb2553eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae72d38-25d9-4e38-830c-6bbd80831125", "name": "network-vif-unplugged", "status": "completed", "tag": "c666060c-0b74-4f27-aec9-13a6ad3ef0e5"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:26:41.533887 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-adacf16e-151c-4504-965a-a4c0374a62a3 req-6bb33979-9247-4a81-a239-8001fb2553eb service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:41.534425 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-adacf16e-151c-4504-965a-a4c0374a62a3 req-6bb33979-9247-4a81-a239-8001fb2553eb service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:41.549487 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-adacf16e-151c-4504-965a-a4c0374a62a3 req-6bb33979-9247-4a81-a239-8001fb2553eb service nova] Creating event network-vif-unplugged:c666060c-0b74-4f27-aec9-13a6ad3ef0e5 for instance 8ae72d38-25d9-4e38-830c-6bbd80831125 on n-h2-847009-3 Jul 19 23:26:41.555413 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [req-adacf16e-151c-4504-965a-a4c0374a62a3 req-6bb33979-9247-4a81-a239-8001fb2553eb service nova] Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119338) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 23:26:41.568372 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-adacf16e-151c-4504-965a-a4c0374a62a3 req-6bb33979-9247-4a81-a239-8001fb2553eb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050884 Jul 19 23:26:41.568980 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3352/6710] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:26:41.901993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d3507c6d-1412-424d-93be-977456859a64 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:41.902643 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d3507c6d-1412-424d-93be-977456859a64 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:41.910213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d3507c6d-1412-424d-93be-977456859a64 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:41.910680 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d3507c6d-1412-424d-93be-977456859a64 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:41.911581 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d3507c6d-1412-424d-93be-977456859a64 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:41.911963 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d3507c6d-1412-424d-93be-977456859a64 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:42.065855 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d3507c6d-1412-424d-93be-977456859a64 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:42.074136 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d3507c6d-1412-424d-93be-977456859a64 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1721 microversion: 2.1 time: 0.176054 Jul 19 23:26:42.074995 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3359/6711] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:41 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:43.092838 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-deecbcb9-e7d8-489c-b572-9de9c59d324b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:43.093553 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-deecbcb9-e7d8-489c-b572-9de9c59d324b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:43.101062 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-deecbcb9-e7d8-489c-b572-9de9c59d324b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:43.101520 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-deecbcb9-e7d8-489c-b572-9de9c59d324b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:43.102309 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-deecbcb9-e7d8-489c-b572-9de9c59d324b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:43.102754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-deecbcb9-e7d8-489c-b572-9de9c59d324b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:43.249182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-deecbcb9-e7d8-489c-b572-9de9c59d324b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:43.257970 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-deecbcb9-e7d8-489c-b572-9de9c59d324b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1721 microversion: 2.1 time: 0.169494 Jul 19 23:26:43.258551 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3353/6712] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:43 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:43.586192 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-3ee5ac4e-eed5-4dbd-a68f-b8945d7f221f req-1b29cd48-d104-4899-b2ef-2ff2c7517792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ae72d38-25d9-4e38-830c-6bbd80831125", "tag": "c666060c-0b74-4f27-aec9-13a6ad3ef0e5"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:26:43.596073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-3ee5ac4e-eed5-4dbd-a68f-b8945d7f221f req-1b29cd48-d104-4899-b2ef-2ff2c7517792 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:43.596561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-3ee5ac4e-eed5-4dbd-a68f-b8945d7f221f req-1b29cd48-d104-4899-b2ef-2ff2c7517792 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:43.608398 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-3ee5ac4e-eed5-4dbd-a68f-b8945d7f221f req-1b29cd48-d104-4899-b2ef-2ff2c7517792 service nova] Creating event network-changed:c666060c-0b74-4f27-aec9-13a6ad3ef0e5 for instance 8ae72d38-25d9-4e38-830c-6bbd80831125 on n-h2-847009-3 Jul 19 23:26:43.613665 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [req-3ee5ac4e-eed5-4dbd-a68f-b8945d7f221f req-1b29cd48-d104-4899-b2ef-2ff2c7517792 service nova] Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119337) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 23:26:43.625122 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-3ee5ac4e-eed5-4dbd-a68f-b8945d7f221f req-1b29cd48-d104-4899-b2ef-2ff2c7517792 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042858 Jul 19 23:26:43.625908 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3360/6713] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:26:44.276083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aab4c759-ea37-433d-9893-034d57890d6b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:44.276626 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-aab4c759-ea37-433d-9893-034d57890d6b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:44.284002 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aab4c759-ea37-433d-9893-034d57890d6b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:44.284457 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aab4c759-ea37-433d-9893-034d57890d6b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:44.285268 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aab4c759-ea37-433d-9893-034d57890d6b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:44.285717 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aab4c759-ea37-433d-9893-034d57890d6b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:44.423362 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-aab4c759-ea37-433d-9893-034d57890d6b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:44.431605 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-aab4c759-ea37-433d-9893-034d57890d6b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1721 microversion: 2.1 time: 0.159472 Jul 19 23:26:44.432313 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3354/6714] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:44 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:26:45.450437 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-864c437c-920f-4ed5-8507-9755dd7c4466 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:45.451264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-864c437c-920f-4ed5-8507-9755dd7c4466 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:45.459264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-864c437c-920f-4ed5-8507-9755dd7c4466 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:45.459734 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-864c437c-920f-4ed5-8507-9755dd7c4466 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:45.460514 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-864c437c-920f-4ed5-8507-9755dd7c4466 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:45.460962 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-864c437c-920f-4ed5-8507-9755dd7c4466 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:45.598350 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-864c437c-920f-4ed5-8507-9755dd7c4466 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:45.606737 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-864c437c-920f-4ed5-8507-9755dd7c4466 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1721 microversion: 2.1 time: 0.160884 Jul 19 23:26:45.607352 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3361/6715] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:45 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:46.624999 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8cad7302-10e8-4995-89d2-cb95302311a7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:46.625612 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8cad7302-10e8-4995-89d2-cb95302311a7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:46.632775 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8cad7302-10e8-4995-89d2-cb95302311a7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:46.633357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8cad7302-10e8-4995-89d2-cb95302311a7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:46.634132 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8cad7302-10e8-4995-89d2-cb95302311a7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:46.634593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8cad7302-10e8-4995-89d2-cb95302311a7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:46.772463 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8cad7302-10e8-4995-89d2-cb95302311a7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:46.782152 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8cad7302-10e8-4995-89d2-cb95302311a7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1721 microversion: 2.1 time: 0.161588 Jul 19 23:26:46.782584 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3355/6716] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:46 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:47.800799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-776503f7-1d81-457f-9ff5-e0dd3edbdad7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:47.801428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-776503f7-1d81-457f-9ff5-e0dd3edbdad7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:47.803481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:26:47.810332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-776503f7-1d81-457f-9ff5-e0dd3edbdad7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:47.810809 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-776503f7-1d81-457f-9ff5-e0dd3edbdad7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:47.811740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-776503f7-1d81-457f-9ff5-e0dd3edbdad7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:47.812195 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-776503f7-1d81-457f-9ff5-e0dd3edbdad7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:47.947429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-776503f7-1d81-457f-9ff5-e0dd3edbdad7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:47.957505 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-776503f7-1d81-457f-9ff5-e0dd3edbdad7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1721 microversion: 2.1 time: 0.161906 Jul 19 23:26:47.958108 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3362/6717] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:47 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:48.976111 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2f7b9100-d8a8-4a90-a88c-81fe6eb65b72 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:48.976731 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2f7b9100-d8a8-4a90-a88c-81fe6eb65b72 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:48.984936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f7b9100-d8a8-4a90-a88c-81fe6eb65b72 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:48.985388 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f7b9100-d8a8-4a90-a88c-81fe6eb65b72 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:48.986160 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f7b9100-d8a8-4a90-a88c-81fe6eb65b72 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:48.986600 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f7b9100-d8a8-4a90-a88c-81fe6eb65b72 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:49.122142 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2f7b9100-d8a8-4a90-a88c-81fe6eb65b72 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:49.130471 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2f7b9100-d8a8-4a90-a88c-81fe6eb65b72 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1721 microversion: 2.1 time: 0.158330 Jul 19 23:26:49.131042 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3356/6718] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:48 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:50.148308 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-da039042-ca36-49c1-be55-812c0d6ddcbd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:50.148937 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-da039042-ca36-49c1-be55-812c0d6ddcbd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:50.156174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-da039042-ca36-49c1-be55-812c0d6ddcbd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:50.156638 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-da039042-ca36-49c1-be55-812c0d6ddcbd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:50.157411 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-da039042-ca36-49c1-be55-812c0d6ddcbd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:50.157857 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-da039042-ca36-49c1-be55-812c0d6ddcbd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:50.288647 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-da039042-ca36-49c1-be55-812c0d6ddcbd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:50.297164 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-da039042-ca36-49c1-be55-812c0d6ddcbd tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1721 microversion: 2.1 time: 0.152719 Jul 19 23:26:50.297745 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3363/6719] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:50 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:51.315098 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9abf6e04-5f0f-4a12-8bed-70fa98fb1b25 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:51.315733 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9abf6e04-5f0f-4a12-8bed-70fa98fb1b25 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:51.322259 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9abf6e04-5f0f-4a12-8bed-70fa98fb1b25 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:51.322706 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9abf6e04-5f0f-4a12-8bed-70fa98fb1b25 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:51.323491 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9abf6e04-5f0f-4a12-8bed-70fa98fb1b25 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:51.323932 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9abf6e04-5f0f-4a12-8bed-70fa98fb1b25 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:51.456518 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9abf6e04-5f0f-4a12-8bed-70fa98fb1b25 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:51.464506 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9abf6e04-5f0f-4a12-8bed-70fa98fb1b25 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1721 microversion: 2.1 time: 0.154145 Jul 19 23:26:51.465090 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3357/6720] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:51 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:52.482381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0c10b080-1662-44df-8443-59f7979bdcb0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:52.483014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0c10b080-1662-44df-8443-59f7979bdcb0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:52.490494 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c10b080-1662-44df-8443-59f7979bdcb0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:52.490953 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c10b080-1662-44df-8443-59f7979bdcb0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:52.491765 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c10b080-1662-44df-8443-59f7979bdcb0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:52.492219 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c10b080-1662-44df-8443-59f7979bdcb0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:52.634184 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0c10b080-1662-44df-8443-59f7979bdcb0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:52.642342 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0c10b080-1662-44df-8443-59f7979bdcb0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1721 microversion: 2.1 time: 0.163868 Jul 19 23:26:52.642922 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3364/6721] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:52 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:53.660178 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cc3396a1-e455-4e31-90d9-2052acee8e7a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:53.660788 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cc3396a1-e455-4e31-90d9-2052acee8e7a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:53.667630 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc3396a1-e455-4e31-90d9-2052acee8e7a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:53.668085 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc3396a1-e455-4e31-90d9-2052acee8e7a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:53.668849 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc3396a1-e455-4e31-90d9-2052acee8e7a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:53.669287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc3396a1-e455-4e31-90d9-2052acee8e7a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:53.808709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cc3396a1-e455-4e31-90d9-2052acee8e7a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:53.818147 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cc3396a1-e455-4e31-90d9-2052acee8e7a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1721 microversion: 2.1 time: 0.162076 Jul 19 23:26:53.818724 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3358/6722] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:53 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:54.836332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9ca2f8ce-6595-44bb-95d2-59fa79a3bfe3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:54.836960 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9ca2f8ce-6595-44bb-95d2-59fa79a3bfe3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:54.844498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ca2f8ce-6595-44bb-95d2-59fa79a3bfe3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:54.844953 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ca2f8ce-6595-44bb-95d2-59fa79a3bfe3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:54.845722 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ca2f8ce-6595-44bb-95d2-59fa79a3bfe3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:54.846171 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ca2f8ce-6595-44bb-95d2-59fa79a3bfe3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:55.352848 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9ca2f8ce-6595-44bb-95d2-59fa79a3bfe3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:55.360862 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9ca2f8ce-6595-44bb-95d2-59fa79a3bfe3 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1714 microversion: 2.1 time: 0.528455 Jul 19 23:26:55.361427 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3365/6723] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:54 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1714 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:55.377699 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ab85d656-deae-4a8b-94e8-f9154575426f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:55.378298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ab85d656-deae-4a8b-94e8-f9154575426f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:55.385240 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab85d656-deae-4a8b-94e8-f9154575426f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:55.385689 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab85d656-deae-4a8b-94e8-f9154575426f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:55.386449 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab85d656-deae-4a8b-94e8-f9154575426f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:55.386890 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab85d656-deae-4a8b-94e8-f9154575426f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:55.519711 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ab85d656-deae-4a8b-94e8-f9154575426f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:55.527709 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ab85d656-deae-4a8b-94e8-f9154575426f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1714 microversion: 2.1 time: 0.154608 Jul 19 23:26:55.528282 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3359/6724] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:55 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1714 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:55.544056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d38c7180-a96e-4112-8ff4-7a719dd9464d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:55.544695 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d38c7180-a96e-4112-8ff4-7a719dd9464d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:55.551439 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d38c7180-a96e-4112-8ff4-7a719dd9464d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:55.551913 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d38c7180-a96e-4112-8ff4-7a719dd9464d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:55.552698 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d38c7180-a96e-4112-8ff4-7a719dd9464d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:55.553160 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d38c7180-a96e-4112-8ff4-7a719dd9464d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:55.685910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d38c7180-a96e-4112-8ff4-7a719dd9464d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:55.694730 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d38c7180-a96e-4112-8ff4-7a719dd9464d tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1714 microversion: 2.1 time: 0.154546 Jul 19 23:26:55.695345 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3366/6725] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:55 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1714 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:55.711464 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e5934886-299c-4395-ba51-9da1e6363c1f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:55.711971 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e5934886-299c-4395-ba51-9da1e6363c1f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:55.718318 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e5934886-299c-4395-ba51-9da1e6363c1f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:55.718771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e5934886-299c-4395-ba51-9da1e6363c1f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:55.719575 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e5934886-299c-4395-ba51-9da1e6363c1f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:55.720024 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e5934886-299c-4395-ba51-9da1e6363c1f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:55.744756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e5934886-299c-4395-ba51-9da1e6363c1f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:26:55.822617 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e5934886-299c-4395-ba51-9da1e6363c1f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 204 len: 0 microversion: 2.1 time: 0.114529 Jul 19 23:26:55.823349 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3360/6726] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:26:55 2022] DELETE /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:26:55.832822 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-57a04fce-b8b2-4cf1-afb7-07efc132e025 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:55.833737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-57a04fce-b8b2-4cf1-afb7-07efc132e025 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:55.841194 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57a04fce-b8b2-4cf1-afb7-07efc132e025 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:55.841852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57a04fce-b8b2-4cf1-afb7-07efc132e025 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:55.842553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57a04fce-b8b2-4cf1-afb7-07efc132e025 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:55.843573 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57a04fce-b8b2-4cf1-afb7-07efc132e025 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:55.860916 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:26:55.979977 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-57a04fce-b8b2-4cf1-afb7-07efc132e025 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:55.989121 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-57a04fce-b8b2-4cf1-afb7-07efc132e025 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1720 microversion: 2.1 time: 0.160864 Jul 19 23:26:55.989859 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3367/6727] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:55 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:57.009577 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b2299c85-c4ef-4031-b514-d84a23009bec tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:57.010311 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b2299c85-c4ef-4031-b514-d84a23009bec tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:57.018017 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b2299c85-c4ef-4031-b514-d84a23009bec tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:57.018780 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b2299c85-c4ef-4031-b514-d84a23009bec tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:57.019678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b2299c85-c4ef-4031-b514-d84a23009bec tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:57.020184 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b2299c85-c4ef-4031-b514-d84a23009bec tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:57.037183 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:26:57.175914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b2299c85-c4ef-4031-b514-d84a23009bec tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:57.184840 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b2299c85-c4ef-4031-b514-d84a23009bec tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1720 microversion: 2.1 time: 0.181587 Jul 19 23:26:57.185520 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3361/6728] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:57 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1720 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:58.206241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ede0bf60-4520-40e3-9ab1-a9fdc5bde3c0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:58.206969 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ede0bf60-4520-40e3-9ab1-a9fdc5bde3c0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:58.214851 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ede0bf60-4520-40e3-9ab1-a9fdc5bde3c0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:58.215431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ede0bf60-4520-40e3-9ab1-a9fdc5bde3c0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:58.216295 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ede0bf60-4520-40e3-9ab1-a9fdc5bde3c0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:58.216837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ede0bf60-4520-40e3-9ab1-a9fdc5bde3c0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:58.288198 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ede0bf60-4520-40e3-9ab1-a9fdc5bde3c0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:58.296497 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ede0bf60-4520-40e3-9ab1-a9fdc5bde3c0 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1652 microversion: 2.1 time: 0.095986 Jul 19 23:26:58.297497 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3368/6729] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:58 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1652 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:26:58.325233 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-d3d3bfa9-1924-4178-b679-023fc67ceb4f req-ac0787b2-e357-4cd7-ae57-4560ef63addd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae72d38-25d9-4e38-830c-6bbd80831125", "name": "network-vif-deleted", "tag": "c666060c-0b74-4f27-aec9-13a6ad3ef0e5"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:26:58.338715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d3d3bfa9-1924-4178-b679-023fc67ceb4f req-ac0787b2-e357-4cd7-ae57-4560ef63addd service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:58.339200 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d3d3bfa9-1924-4178-b679-023fc67ceb4f req-ac0787b2-e357-4cd7-ae57-4560ef63addd service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:58.353518 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-d3d3bfa9-1924-4178-b679-023fc67ceb4f req-ac0787b2-e357-4cd7-ae57-4560ef63addd service nova] Creating event network-vif-deleted:c666060c-0b74-4f27-aec9-13a6ad3ef0e5 for instance 8ae72d38-25d9-4e38-830c-6bbd80831125 on n-h2-847009-3 Jul 19 23:26:58.360600 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-d3d3bfa9-1924-4178-b679-023fc67ceb4f req-ac0787b2-e357-4cd7-ae57-4560ef63addd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039355 Jul 19 23:26:58.361541 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3362/6730] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:26:59.314325 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-76e13cb2-7a50-4426-9f27-ba02cd39478b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:26:59.315063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-76e13cb2-7a50-4426-9f27-ba02cd39478b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:26:59.322387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-76e13cb2-7a50-4426-9f27-ba02cd39478b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:59.322957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-76e13cb2-7a50-4426-9f27-ba02cd39478b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:59.323931 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-76e13cb2-7a50-4426-9f27-ba02cd39478b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:26:59.324762 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-76e13cb2-7a50-4426-9f27-ba02cd39478b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:26:59.407607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-76e13cb2-7a50-4426-9f27-ba02cd39478b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:26:59.416528 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-76e13cb2-7a50-4426-9f27-ba02cd39478b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1369 microversion: 2.1 time: 0.106440 Jul 19 23:26:59.417435 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3369/6731] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:26:59 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:00.434548 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-76a0d240-7619-41e2-93fa-6d98bf10927e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:00.435287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-76a0d240-7619-41e2-93fa-6d98bf10927e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:00.443394 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-76a0d240-7619-41e2-93fa-6d98bf10927e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:00.443849 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-76a0d240-7619-41e2-93fa-6d98bf10927e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:00.444852 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-76a0d240-7619-41e2-93fa-6d98bf10927e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:00.445473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-76a0d240-7619-41e2-93fa-6d98bf10927e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:00.512420 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-76a0d240-7619-41e2-93fa-6d98bf10927e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:00.520911 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-76a0d240-7619-41e2-93fa-6d98bf10927e tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1369 microversion: 2.1 time: 0.090597 Jul 19 23:27:00.521485 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3363/6732] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:00 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:01.538490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c9f5736c-a4b2-4a62-a59f-81d9476f1cd7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:01.539047 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c9f5736c-a4b2-4a62-a59f-81d9476f1cd7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:01.546215 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c9f5736c-a4b2-4a62-a59f-81d9476f1cd7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:01.546678 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c9f5736c-a4b2-4a62-a59f-81d9476f1cd7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:01.547475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c9f5736c-a4b2-4a62-a59f-81d9476f1cd7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:01.547929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c9f5736c-a4b2-4a62-a59f-81d9476f1cd7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:01.611342 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c9f5736c-a4b2-4a62-a59f-81d9476f1cd7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:01.620277 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c9f5736c-a4b2-4a62-a59f-81d9476f1cd7 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1369 microversion: 2.1 time: 0.085659 Jul 19 23:27:01.620882 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3370/6733] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:01 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:02.637768 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8e989396-6fee-43d5-b365-446ad4bc057a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:02.638462 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8e989396-6fee-43d5-b365-446ad4bc057a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:02.642074 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:27:02.647414 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8e989396-6fee-43d5-b365-446ad4bc057a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:02.647873 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8e989396-6fee-43d5-b365-446ad4bc057a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:02.648665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8e989396-6fee-43d5-b365-446ad4bc057a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:02.649108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8e989396-6fee-43d5-b365-446ad4bc057a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:02.688115 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8e989396-6fee-43d5-b365-446ad4bc057a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:02.688462 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8e989396-6fee-43d5-b365-446ad4bc057a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:02.688930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-8e989396-6fee-43d5-b365-446ad4bc057a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lazy-loading 'fault' on Instance uuid 8ae72d38-25d9-4e38-830c-6bbd80831125 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:27:02.731010 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8e989396-6fee-43d5-b365-446ad4bc057a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a6b598a39a45bbb09381b4c27f354f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9630a1ac2a54421a9b04421e1560776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:02.740466 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8e989396-6fee-43d5-b365-446ad4bc057a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 200 len: 1374 microversion: 2.1 time: 0.106506 Jul 19 23:27:02.741053 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3364/6734] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:02 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 1374 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:03.757844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0f7eb178-22d3-4aad-b9d2-a77494cc84dc tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:03.758472 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0f7eb178-22d3-4aad-b9d2-a77494cc84dc tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:03.761260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:27:03.766797 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0f7eb178-22d3-4aad-b9d2-a77494cc84dc tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:03.767284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0f7eb178-22d3-4aad-b9d2-a77494cc84dc tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:03.768094 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0f7eb178-22d3-4aad-b9d2-a77494cc84dc tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:03.768547 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0f7eb178-22d3-4aad-b9d2-a77494cc84dc tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:03.785626 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-0f7eb178-22d3-4aad-b9d2-a77494cc84dc tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] HTTP exception thrown: Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 could not be found. Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0f7eb178-22d3-4aad-b9d2-a77494cc84dc tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Request method failure captured: Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 HTTP/1.1 Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zxbjEL1rIaQyxdVky0xIYD_tIAWcYLUfp6LpkDLw-jF6fnAMxiX8SS4d5Ix1ZKPVX7s3onGefSgeKLTlOXzWrM0MnLdSrmCJf8_C472uqB44monndTK4btN_tzIPDRcV1Z3ZuBZsMiKg4z2aZ3Jy7asoPb-HoMx-iBmC_MF92p7pXk Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 31a6b598a39a45bbb09381b4c27f354f Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 could not be found. Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '8ae72d38-25d9-4e38-830c-6bbd80831125'} Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 could not be found. Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 could not be found. Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:03.787340 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:03.792124 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:03.792124 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:03.792124 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:03.792124 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:27:03.792124 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:27:03.792124 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 could not be found. Jul 19 23:27:03.792124 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:03.792124 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0f7eb178-22d3-4aad-b9d2-a77494cc84dc tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Returning 404 to user: Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:27:03.792124 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0f7eb178-22d3-4aad-b9d2-a77494cc84dc tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 404 len: 111 microversion: 2.1 time: 0.034855 Jul 19 23:27:03.792124 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3371/6735] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:03 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:27:03.847017 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1777cbeb-5d5e-4be9-b7b1-35e18d0c211b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:03.848079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1777cbeb-5d5e-4be9-b7b1-35e18d0c211b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:03.855124 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1777cbeb-5d5e-4be9-b7b1-35e18d0c211b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:03.855596 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1777cbeb-5d5e-4be9-b7b1-35e18d0c211b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:03.856367 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1777cbeb-5d5e-4be9-b7b1-35e18d0c211b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:03.856811 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1777cbeb-5d5e-4be9-b7b1-35e18d0c211b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:03.870287 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-1777cbeb-5d5e-4be9-b7b1-35e18d0c211b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] HTTP exception thrown: Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 could not be found. Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1777cbeb-5d5e-4be9-b7b1-35e18d0c211b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Request method failure captured: Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125/os-volume_attachments HTTP/1.1 Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zxbjEL1rIaQyxdVky0xIYD_tIAWcYLUfp6LpkDLw-jF6fnAMxiX8SS4d5Ix1ZKPVX7s3onGefSgeKLTlOXzWrM0MnLdSrmCJf8_C472uqB44monndTK4btN_tzIPDRcV1Z3ZuBZsMiKg4z2aZ3Jy7asoPb-HoMx-iBmC_MF92p7pXk Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 31a6b598a39a45bbb09381b4c27f354f Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 could not be found. Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'server_id': '8ae72d38-25d9-4e38-830c-6bbd80831125'} Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 could not be found. Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:27:03.871982 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 could not be found. Jul 19 23:27:03.877038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:03.877038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:03.877038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:03.877038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:03.877038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:03.877038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:03.877038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:27:03.877038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:27:03.877038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 could not be found. Jul 19 23:27:03.877038 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:03.877038 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1777cbeb-5d5e-4be9-b7b1-35e18d0c211b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Returning 404 to user: Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:27:03.877038 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1777cbeb-5d5e-4be9-b7b1-35e18d0c211b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030989 Jul 19 23:27:03.877038 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3365/6736] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:27:03 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:27:07.185959 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ba60ce03-287d-475d-8bac-1c48e2308655 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:07.186473 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ba60ce03-287d-475d-8bac-1c48e2308655 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:07.193420 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba60ce03-287d-475d-8bac-1c48e2308655 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:07.193896 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba60ce03-287d-475d-8bac-1c48e2308655 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:07.194687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba60ce03-287d-475d-8bac-1c48e2308655 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:07.195177 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba60ce03-287d-475d-8bac-1c48e2308655 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:07.209191 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-ba60ce03-287d-475d-8bac-1c48e2308655 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] HTTP exception thrown: Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 could not be found. Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ba60ce03-287d-475d-8bac-1c48e2308655 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Request method failure captured: Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 HTTP/1.1 Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zxbjEL1rIaQyxdVky0xIYD_tIAWcYLUfp6LpkDLw-jF6fnAMxiX8SS4d5Ix1ZKPVX7s3onGefSgeKLTlOXzWrM0MnLdSrmCJf8_C472uqB44monndTK4btN_tzIPDRcV1Z3ZuBZsMiKg4z2aZ3Jy7asoPb-HoMx-iBmC_MF92p7pXk Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 31a6b598a39a45bbb09381b4c27f354f Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 could not be found. Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '8ae72d38-25d9-4e38-830c-6bbd80831125'} Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 could not be found. Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:27:07.210782 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:27:07.214831 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 could not be found. Jul 19 23:27:07.214831 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.214831 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:07.214831 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.214831 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:07.214831 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:07.214831 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:07.214831 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:27:07.214831 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:27:07.214831 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 could not be found. Jul 19 23:27:07.214831 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.214831 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ba60ce03-287d-475d-8bac-1c48e2308655 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Returning 404 to user: Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:27:07.214831 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ba60ce03-287d-475d-8bac-1c48e2308655 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 404 len: 111 microversion: 2.1 time: 0.030497 Jul 19 23:27:07.214831 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3372/6737] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:27:07 2022] DELETE /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:27:07.221277 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-54c966b9-b0ad-47e3-aedc-03946e94d5c4 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:07.221900 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-54c966b9-b0ad-47e3-aedc-03946e94d5c4 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 8ae72d38-25d9-4e38-830c-6bbd80831125] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:07.229021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54c966b9-b0ad-47e3-aedc-03946e94d5c4 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:07.229481 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54c966b9-b0ad-47e3-aedc-03946e94d5c4 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:07.230254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54c966b9-b0ad-47e3-aedc-03946e94d5c4 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:07.230703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54c966b9-b0ad-47e3-aedc-03946e94d5c4 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:07.245012 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-54c966b9-b0ad-47e3-aedc-03946e94d5c4 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] HTTP exception thrown: Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 could not be found. Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-54c966b9-b0ad-47e3-aedc-03946e94d5c4 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Request method failure captured: Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 HTTP/1.1 Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zxbjEL1rIaQyxdVky0xIYD_tIAWcYLUfp6LpkDLw-jF6fnAMxiX8SS4d5Ix1ZKPVX7s3onGefSgeKLTlOXzWrM0MnLdSrmCJf8_C472uqB44monndTK4btN_tzIPDRcV1Z3ZuBZsMiKg4z2aZ3Jy7asoPb-HoMx-iBmC_MF92p7pXk Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 31a6b598a39a45bbb09381b4c27f354f Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 could not be found. Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '8ae72d38-25d9-4e38-830c-6bbd80831125'} Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 could not be found. Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 could not be found. Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:07.246556 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.250369 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:07.250369 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:07.250369 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:07.250369 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:27:07.250369 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:27:07.250369 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 could not be found. Jul 19 23:27:07.250369 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.250369 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-54c966b9-b0ad-47e3-aedc-03946e94d5c4 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Returning 404 to user: Instance 8ae72d38-25d9-4e38-830c-6bbd80831125 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:27:07.250369 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-54c966b9-b0ad-47e3-aedc-03946e94d5c4 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125" status: 404 len: 111 microversion: 2.1 time: 0.031141 Jul 19 23:27:07.250369 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3366/6738] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:07 2022] GET /compute/v2.1/servers/8ae72d38-25d9-4e38-830c-6bbd80831125 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:27:07.257176 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-32f4ffad-0a40-4342-a96a-4d3444df98d1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:07.257689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-32f4ffad-0a40-4342-a96a-4d3444df98d1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:07.264165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32f4ffad-0a40-4342-a96a-4d3444df98d1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:07.264641 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32f4ffad-0a40-4342-a96a-4d3444df98d1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:07.265461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32f4ffad-0a40-4342-a96a-4d3444df98d1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:07.265927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32f4ffad-0a40-4342-a96a-4d3444df98d1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:07.281032 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-32f4ffad-0a40-4342-a96a-4d3444df98d1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] HTTP exception thrown: Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 could not be found. Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-32f4ffad-0a40-4342-a96a-4d3444df98d1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Request method failure captured: Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 HTTP/1.1 Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zxbjEL1rIaQyxdVky0xIYD_tIAWcYLUfp6LpkDLw-jF6fnAMxiX8SS4d5Ix1ZKPVX7s3onGefSgeKLTlOXzWrM0MnLdSrmCJf8_C472uqB44monndTK4btN_tzIPDRcV1Z3ZuBZsMiKg4z2aZ3Jy7asoPb-HoMx-iBmC_MF92p7pXk Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 31a6b598a39a45bbb09381b4c27f354f Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 could not be found. Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '94fe62ab-c4e5-420e-9924-aa0b127a63b1'} Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 could not be found. Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:27:07.283267 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:27:07.287001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 could not be found. Jul 19 23:27:07.287001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.287001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:07.287001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.287001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:07.287001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:07.287001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:07.287001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:27:07.287001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:27:07.287001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 could not be found. Jul 19 23:27:07.287001 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.287001 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-32f4ffad-0a40-4342-a96a-4d3444df98d1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Returning 404 to user: Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:27:07.287001 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-32f4ffad-0a40-4342-a96a-4d3444df98d1 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "DELETE /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 404 len: 111 microversion: 2.1 time: 0.031558 Jul 19 23:27:07.287001 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3373/6739] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:27:07 2022] DELETE /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:27:07.298665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-655f3825-68ff-46c7-a6a3-472eb3806805 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:07.299625 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-655f3825-68ff-46c7-a6a3-472eb3806805 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 94fe62ab-c4e5-420e-9924-aa0b127a63b1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:07.306110 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-655f3825-68ff-46c7-a6a3-472eb3806805 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:07.306570 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-655f3825-68ff-46c7-a6a3-472eb3806805 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:07.307390 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-655f3825-68ff-46c7-a6a3-472eb3806805 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:07.307838 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-655f3825-68ff-46c7-a6a3-472eb3806805 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:07.322935 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-655f3825-68ff-46c7-a6a3-472eb3806805 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] HTTP exception thrown: Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 could not be found. Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-655f3825-68ff-46c7-a6a3-472eb3806805 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Request method failure captured: Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 HTTP/1.1 Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zxbjEL1rIaQyxdVky0xIYD_tIAWcYLUfp6LpkDLw-jF6fnAMxiX8SS4d5Ix1ZKPVX7s3onGefSgeKLTlOXzWrM0MnLdSrmCJf8_C472uqB44monndTK4btN_tzIPDRcV1Z3ZuBZsMiKg4z2aZ3Jy7asoPb-HoMx-iBmC_MF92p7pXk Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 31a6b598a39a45bbb09381b4c27f354f Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 could not be found. Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '94fe62ab-c4e5-420e-9924-aa0b127a63b1'} Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 could not be found. Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 could not be found. Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:07.324827 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.328752 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:07.328752 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:07.328752 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:07.328752 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:27:07.328752 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:27:07.328752 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 could not be found. Jul 19 23:27:07.328752 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.328752 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-655f3825-68ff-46c7-a6a3-472eb3806805 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Returning 404 to user: Instance 94fe62ab-c4e5-420e-9924-aa0b127a63b1 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:27:07.328752 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-655f3825-68ff-46c7-a6a3-472eb3806805 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1" status: 404 len: 111 microversion: 2.1 time: 0.035824 Jul 19 23:27:07.330311 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3367/6740] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:07 2022] GET /compute/v2.1/servers/94fe62ab-c4e5-420e-9924-aa0b127a63b1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:27:07.338252 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9d587511-7e51-4e76-a7d1-36a3e46e7cfb tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:07.338866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9d587511-7e51-4e76-a7d1-36a3e46e7cfb tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:07.346350 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d587511-7e51-4e76-a7d1-36a3e46e7cfb tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:07.346825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d587511-7e51-4e76-a7d1-36a3e46e7cfb tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:07.347691 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d587511-7e51-4e76-a7d1-36a3e46e7cfb tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:07.348305 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9d587511-7e51-4e76-a7d1-36a3e46e7cfb tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:07.362921 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-9d587511-7e51-4e76-a7d1-36a3e46e7cfb tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] HTTP exception thrown: Instance f1be9290-bfde-4f06-b0fc-aab377544f1c could not be found. Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9d587511-7e51-4e76-a7d1-36a3e46e7cfb tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Request method failure captured: Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c HTTP/1.1 Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zxbjEL1rIaQyxdVky0xIYD_tIAWcYLUfp6LpkDLw-jF6fnAMxiX8SS4d5Ix1ZKPVX7s3onGefSgeKLTlOXzWrM0MnLdSrmCJf8_C472uqB44monndTK4btN_tzIPDRcV1Z3ZuBZsMiKg4z2aZ3Jy7asoPb-HoMx-iBmC_MF92p7pXk Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 31a6b598a39a45bbb09381b4c27f354f Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance f1be9290-bfde-4f06-b0fc-aab377544f1c could not be found. Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'f1be9290-bfde-4f06-b0fc-aab377544f1c'} Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1be9290-bfde-4f06-b0fc-aab377544f1c could not be found. Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:27:07.364542 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:27:07.368089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1be9290-bfde-4f06-b0fc-aab377544f1c could not be found. Jul 19 23:27:07.368089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.368089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:07.368089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.368089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:07.368089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:07.368089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:07.368089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:27:07.368089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:27:07.368089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1be9290-bfde-4f06-b0fc-aab377544f1c could not be found. Jul 19 23:27:07.368089 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.368089 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9d587511-7e51-4e76-a7d1-36a3e46e7cfb tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Returning 404 to user: Instance f1be9290-bfde-4f06-b0fc-aab377544f1c could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:27:07.368089 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9d587511-7e51-4e76-a7d1-36a3e46e7cfb tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 404 len: 111 microversion: 2.1 time: 0.032077 Jul 19 23:27:07.368089 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3374/6741] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:27:07 2022] DELETE /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:27:07.374708 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-69e0e4b0-49da-4c5d-b6b6-dcd033d6cd3b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:07.375360 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-69e0e4b0-49da-4c5d-b6b6-dcd033d6cd3b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: f1be9290-bfde-4f06-b0fc-aab377544f1c] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:07.382005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-69e0e4b0-49da-4c5d-b6b6-dcd033d6cd3b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:07.382464 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-69e0e4b0-49da-4c5d-b6b6-dcd033d6cd3b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:07.383261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-69e0e4b0-49da-4c5d-b6b6-dcd033d6cd3b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:07.383707 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-69e0e4b0-49da-4c5d-b6b6-dcd033d6cd3b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:07.398502 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-69e0e4b0-49da-4c5d-b6b6-dcd033d6cd3b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] HTTP exception thrown: Instance f1be9290-bfde-4f06-b0fc-aab377544f1c could not be found. Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-69e0e4b0-49da-4c5d-b6b6-dcd033d6cd3b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Request method failure captured: Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c HTTP/1.1 Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zxbjEL1rIaQyxdVky0xIYD_tIAWcYLUfp6LpkDLw-jF6fnAMxiX8SS4d5Ix1ZKPVX7s3onGefSgeKLTlOXzWrM0MnLdSrmCJf8_C472uqB44monndTK4btN_tzIPDRcV1Z3ZuBZsMiKg4z2aZ3Jy7asoPb-HoMx-iBmC_MF92p7pXk Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 31a6b598a39a45bbb09381b4c27f354f Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance f1be9290-bfde-4f06-b0fc-aab377544f1c could not be found. Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'f1be9290-bfde-4f06-b0fc-aab377544f1c'} Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1be9290-bfde-4f06-b0fc-aab377544f1c could not be found. Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1be9290-bfde-4f06-b0fc-aab377544f1c could not be found. Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:07.400066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.403913 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:07.403913 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:07.403913 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:07.403913 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:27:07.403913 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:27:07.403913 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1be9290-bfde-4f06-b0fc-aab377544f1c could not be found. Jul 19 23:27:07.403913 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.403913 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-69e0e4b0-49da-4c5d-b6b6-dcd033d6cd3b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Returning 404 to user: Instance f1be9290-bfde-4f06-b0fc-aab377544f1c could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:27:07.403913 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-69e0e4b0-49da-4c5d-b6b6-dcd033d6cd3b tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c" status: 404 len: 111 microversion: 2.1 time: 0.030762 Jul 19 23:27:07.403913 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3368/6742] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:07 2022] GET /compute/v2.1/servers/f1be9290-bfde-4f06-b0fc-aab377544f1c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:27:07.411061 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ae3efdd8-21a3-4974-ad62-a41ba24c3631 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:07.411602 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ae3efdd8-21a3-4974-ad62-a41ba24c3631 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:07.418422 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae3efdd8-21a3-4974-ad62-a41ba24c3631 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:07.418888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae3efdd8-21a3-4974-ad62-a41ba24c3631 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:07.419690 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae3efdd8-21a3-4974-ad62-a41ba24c3631 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:07.420143 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae3efdd8-21a3-4974-ad62-a41ba24c3631 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:07.434569 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-ae3efdd8-21a3-4974-ad62-a41ba24c3631 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] HTTP exception thrown: Instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a could not be found. Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ae3efdd8-21a3-4974-ad62-a41ba24c3631 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Request method failure captured: Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: request: DELETE /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a HTTP/1.1 Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1zxbjEL1rIaQyxdVky0xIYD_tIAWcYLUfp6LpkDLw-jF6fnAMxiX8SS4d5Ix1ZKPVX7s3onGefSgeKLTlOXzWrM0MnLdSrmCJf8_C472uqB44monndTK4btN_tzIPDRcV1Z3ZuBZsMiKg4z2aZ3Jy7asoPb-HoMx-iBmC_MF92p7pXk Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 31a6b598a39a45bbb09381b4c27f354f Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a could not be found. Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '3bb20180-3fa4-49fc-88fa-a0e6d4078c0a'} Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a could not be found. Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:27:07.436172 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:27:07.440913 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a could not be found. Jul 19 23:27:07.440913 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.440913 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:07.440913 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.440913 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:07.440913 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:07.440913 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:07.440913 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:27:07.440913 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:27:07.440913 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a could not be found. Jul 19 23:27:07.440913 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.440913 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ae3efdd8-21a3-4974-ad62-a41ba24c3631 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Returning 404 to user: Instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:27:07.440913 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ae3efdd8-21a3-4974-ad62-a41ba24c3631 tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 404 len: 111 microversion: 2.1 time: 0.031161 Jul 19 23:27:07.440913 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3375/6743] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:27:07 2022] DELETE /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:27:07.446771 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a26cc12d-9d9b-43c6-821d-1b40942f774f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:07.447414 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a26cc12d-9d9b-43c6-821d-1b40942f774f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] [instance: 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:07.453894 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a26cc12d-9d9b-43c6-821d-1b40942f774f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:07.455393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a26cc12d-9d9b-43c6-821d-1b40942f774f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:07.456180 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a26cc12d-9d9b-43c6-821d-1b40942f774f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:07.456624 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a26cc12d-9d9b-43c6-821d-1b40942f774f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:07.471621 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-a26cc12d-9d9b-43c6-821d-1b40942f774f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] HTTP exception thrown: Instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a could not be found. Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a26cc12d-9d9b-43c6-821d-1b40942f774f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Request method failure captured: Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a HTTP/1.1 Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1zxbjEL1rIaQyxdVky0xIYD_tIAWcYLUfp6LpkDLw-jF6fnAMxiX8SS4d5Ix1ZKPVX7s3onGefSgeKLTlOXzWrM0MnLdSrmCJf8_C472uqB44monndTK4btN_tzIPDRcV1Z3ZuBZsMiKg4z2aZ3Jy7asoPb-HoMx-iBmC_MF92p7pXk Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9630a1ac2a54421a9b04421e1560776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: a9630a1ac2a54421a9b04421e1560776 Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServerActionsTestJSON-338741719 Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 31a6b598a39a45bbb09381b4c27f354f Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServerActionsTestJSON-338741719-project Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a could not be found. Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '3bb20180-3fa4-49fc-88fa-a0e6d4078c0a'} Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a could not be found. Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a could not be found. Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:07.473204 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.477446 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:07.477446 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:07.477446 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:07.477446 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:27:07.477446 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:27:07.477446 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a could not be found. Jul 19 23:27:07.477446 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:07.477446 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a26cc12d-9d9b-43c6-821d-1b40942f774f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Returning 404 to user: Instance 3bb20180-3fa4-49fc-88fa-a0e6d4078c0a could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:27:07.477446 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a26cc12d-9d9b-43c6-821d-1b40942f774f tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a" status: 404 len: 111 microversion: 2.1 time: 0.031779 Jul 19 23:27:07.478224 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3369/6744] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:07 2022] GET /compute/v2.1/servers/3bb20180-3fa4-49fc-88fa-a0e6d4078c0a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:27:07.483405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f91995d9-5db4-43e3-947d-68b0da7a159a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] Calling method '.version_select at 0x7f7a107c7820>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:07.506402 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f91995d9-5db4-43e3-947d-68b0da7a159a tempest-ServerActionsTestJSON-338741719 tempest-ServerActionsTestJSON-338741719-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107466307" status: 202 len: 0 microversion: 2.1 time: 0.026833 Jul 19 23:27:07.506986 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3376/6745] 10.222.0.25 () {58 vars in 1220 bytes} [Tue Jul 19 23:27:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107466307 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:27:17.343583 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-51e7dbcc-18c6-47b4-ab9a-5a583fcddcfe tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1623511759", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "99540dd3-de7d-4783-bd72-48be16b30c66"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:27:17.426658 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-51e7dbcc-18c6-47b4-ab9a-5a583fcddcfe tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] validate_networks() for [('99540dd3-de7d-4783-bd72-48be16b30c66', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:27:17.462037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=29 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:27:17.901597 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-51e7dbcc-18c6-47b4-ab9a-5a583fcddcfe tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:27:17.902056 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-51e7dbcc-18c6-47b4-ab9a-5a583fcddcfe tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:27:17.902537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-51e7dbcc-18c6-47b4-ab9a-5a583fcddcfe tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:27:17.902957 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-51e7dbcc-18c6-47b4-ab9a-5a583fcddcfe tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:27:17.903398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-51e7dbcc-18c6-47b4-ab9a-5a583fcddcfe tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:27:17.913678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51e7dbcc-18c6-47b4-ab9a-5a583fcddcfe tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:17.914130 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51e7dbcc-18c6-47b4-ab9a-5a583fcddcfe tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:17.914932 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51e7dbcc-18c6-47b4-ab9a-5a583fcddcfe tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:17.915408 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51e7dbcc-18c6-47b4-ab9a-5a583fcddcfe tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:17.935410 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-51e7dbcc-18c6-47b4-ab9a-5a583fcddcfe tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Getting quotas for project 3969c9b551e2436aa066ba89b9bba0c4. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:27:17.941784 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-51e7dbcc-18c6-47b4-ab9a-5a583fcddcfe tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Getting quotas for user cc433fd4f38340cda50e88534d1ae2c7 and project 3969c9b551e2436aa066ba89b9bba0c4. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:27:17.955737 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-51e7dbcc-18c6-47b4-ab9a-5a583fcddcfe tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:27:17.958004 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-51e7dbcc-18c6-47b4-ab9a-5a583fcddcfe tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:27:18.005599 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-51e7dbcc-18c6-47b4-ab9a-5a583fcddcfe tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.854757 Jul 19 23:27:18.006253 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3370/6746] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:27:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:27:18.017383 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-85bbdcd6-4cb7-49f7-aeea-572c1386231c tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:18.018633 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-85bbdcd6-4cb7-49f7-aeea-572c1386231c tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:18.021585 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=31 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:27:18.022375 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:27:18.085585 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-85bbdcd6-4cb7-49f7-aeea-572c1386231c tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:18.092593 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-85bbdcd6-4cb7-49f7-aeea-572c1386231c tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22" status: 200 len: 1217 microversion: 2.1 time: 0.080157 Jul 19 23:27:18.093157 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3377/6747] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:18 2022] GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:19.112564 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-de383f59-f872-45f8-9b7c-3a3ba50b45e4 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:19.113172 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-de383f59-f872-45f8-9b7c-3a3ba50b45e4 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:19.128578 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de383f59-f872-45f8-9b7c-3a3ba50b45e4 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:19.129312 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de383f59-f872-45f8-9b7c-3a3ba50b45e4 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:19.134145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de383f59-f872-45f8-9b7c-3a3ba50b45e4 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:19.135264 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-de383f59-f872-45f8-9b7c-3a3ba50b45e4 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:19.252736 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-de383f59-f872-45f8-9b7c-3a3ba50b45e4 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:19.265092 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-de383f59-f872-45f8-9b7c-3a3ba50b45e4 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22" status: 200 len: 1277 microversion: 2.1 time: 0.158600 Jul 19 23:27:19.279158 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3371/6748] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:19 2022] GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:20.288156 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-65c5f9af-1438-4c89-b5e5-2b1ca900730b tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:20.288810 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-65c5f9af-1438-4c89-b5e5-2b1ca900730b tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:20.296195 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65c5f9af-1438-4c89-b5e5-2b1ca900730b tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:20.296662 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65c5f9af-1438-4c89-b5e5-2b1ca900730b tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:20.297530 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65c5f9af-1438-4c89-b5e5-2b1ca900730b tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:20.297984 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-65c5f9af-1438-4c89-b5e5-2b1ca900730b tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:20.460614 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-65c5f9af-1438-4c89-b5e5-2b1ca900730b tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:20.470743 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-65c5f9af-1438-4c89-b5e5-2b1ca900730b tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22" status: 200 len: 1317 microversion: 2.1 time: 0.186524 Jul 19 23:27:20.481306 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3378/6749] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:20 2022] GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:20.677606 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-d332158d-0799-40bf-9583-251d75f92b39 req-338bb1d8-3d59-4403-a63f-0067d873bd1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22", "tag": "16622f0d-ab7c-4746-a712-6f158f5f37c0"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:27:20.693462 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d332158d-0799-40bf-9583-251d75f92b39 req-338bb1d8-3d59-4403-a63f-0067d873bd1b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:20.696825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d332158d-0799-40bf-9583-251d75f92b39 req-338bb1d8-3d59-4403-a63f-0067d873bd1b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:20.720481 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-d332158d-0799-40bf-9583-251d75f92b39 req-338bb1d8-3d59-4403-a63f-0067d873bd1b service nova] Creating event network-changed:16622f0d-ab7c-4746-a712-6f158f5f37c0 for instance c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 on n-h2-847009-3 Jul 19 23:27:20.725957 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-d332158d-0799-40bf-9583-251d75f92b39 req-338bb1d8-3d59-4403-a63f-0067d873bd1b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052270 Jul 19 23:27:20.731548 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3372/6750] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:27:21.488351 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-09b2ac5d-b7a8-42b3-8959-5c710b0d3cd2 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:21.489016 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-09b2ac5d-b7a8-42b3-8959-5c710b0d3cd2 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:21.497799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-09b2ac5d-b7a8-42b3-8959-5c710b0d3cd2 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:21.498176 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-09b2ac5d-b7a8-42b3-8959-5c710b0d3cd2 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:21.498963 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-09b2ac5d-b7a8-42b3-8959-5c710b0d3cd2 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:21.499451 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-09b2ac5d-b7a8-42b3-8959-5c710b0d3cd2 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:21.638287 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-09b2ac5d-b7a8-42b3-8959-5c710b0d3cd2 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:21.646257 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-09b2ac5d-b7a8-42b3-8959-5c710b0d3cd2 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22" status: 200 len: 1317 microversion: 2.1 time: 0.161916 Jul 19 23:27:21.646841 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3379/6751] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:21 2022] GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:22.665656 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0fe86c97-014d-4426-8a1b-a4f69549a8c8 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:22.666358 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0fe86c97-014d-4426-8a1b-a4f69549a8c8 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:22.672887 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0fe86c97-014d-4426-8a1b-a4f69549a8c8 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:22.673342 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0fe86c97-014d-4426-8a1b-a4f69549a8c8 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:22.674102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0fe86c97-014d-4426-8a1b-a4f69549a8c8 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:22.674547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0fe86c97-014d-4426-8a1b-a4f69549a8c8 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:22.812359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0fe86c97-014d-4426-8a1b-a4f69549a8c8 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:22.820680 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0fe86c97-014d-4426-8a1b-a4f69549a8c8 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22" status: 200 len: 1317 microversion: 2.1 time: 0.160146 Jul 19 23:27:22.821276 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3373/6752] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:22 2022] GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:23.838183 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a91af791-16f3-4530-be3f-80dbe1323476 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:23.838822 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a91af791-16f3-4530-be3f-80dbe1323476 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:23.846555 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a91af791-16f3-4530-be3f-80dbe1323476 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:23.847018 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a91af791-16f3-4530-be3f-80dbe1323476 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:23.847832 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a91af791-16f3-4530-be3f-80dbe1323476 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:23.848279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a91af791-16f3-4530-be3f-80dbe1323476 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:23.976279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a91af791-16f3-4530-be3f-80dbe1323476 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:23.983727 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a91af791-16f3-4530-be3f-80dbe1323476 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22" status: 200 len: 1317 microversion: 2.1 time: 0.149624 Jul 19 23:27:23.984297 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3380/6753] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:23 2022] GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:25.001361 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-26ceb671-6e89-47e1-badc-05574960d0ba tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:25.001989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-26ceb671-6e89-47e1-badc-05574960d0ba tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:25.010701 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-26ceb671-6e89-47e1-badc-05574960d0ba tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:25.011185 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-26ceb671-6e89-47e1-badc-05574960d0ba tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:25.011975 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-26ceb671-6e89-47e1-badc-05574960d0ba tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:25.012423 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-26ceb671-6e89-47e1-badc-05574960d0ba tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:25.164937 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-26ceb671-6e89-47e1-badc-05574960d0ba tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:25.172821 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-26ceb671-6e89-47e1-badc-05574960d0ba tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22" status: 200 len: 1317 microversion: 2.1 time: 0.175371 Jul 19 23:27:25.173460 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3374/6754] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:24 2022] GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:26.190132 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-501c8b92-518b-43d0-9f86-7b82576a73dc tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:26.190793 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-501c8b92-518b-43d0-9f86-7b82576a73dc tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:26.197978 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-501c8b92-518b-43d0-9f86-7b82576a73dc tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:26.198446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-501c8b92-518b-43d0-9f86-7b82576a73dc tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:26.199563 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-501c8b92-518b-43d0-9f86-7b82576a73dc tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:26.200026 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-501c8b92-518b-43d0-9f86-7b82576a73dc tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:26.337701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-501c8b92-518b-43d0-9f86-7b82576a73dc tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:26.345756 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-501c8b92-518b-43d0-9f86-7b82576a73dc tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22" status: 200 len: 1317 microversion: 2.1 time: 0.159560 Jul 19 23:27:26.346355 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3381/6755] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:26 2022] GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:26.372439 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-c1680715-edfd-4175-9aba-31f60aff237a req-012aa783-9ffc-400b-bf8f-3656b4c797ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22", "name": "network-vif-plugged", "status": "completed", "tag": "16622f0d-ab7c-4746-a712-6f158f5f37c0"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:27:26.382569 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c1680715-edfd-4175-9aba-31f60aff237a req-012aa783-9ffc-400b-bf8f-3656b4c797ba service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:26.383067 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c1680715-edfd-4175-9aba-31f60aff237a req-012aa783-9ffc-400b-bf8f-3656b4c797ba service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:26.395333 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-c1680715-edfd-4175-9aba-31f60aff237a req-012aa783-9ffc-400b-bf8f-3656b4c797ba service nova] Creating event network-vif-plugged:16622f0d-ab7c-4746-a712-6f158f5f37c0 for instance c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 on n-h2-847009-3 Jul 19 23:27:26.400573 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-c1680715-edfd-4175-9aba-31f60aff237a req-012aa783-9ffc-400b-bf8f-3656b4c797ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031893 Jul 19 23:27:26.401250 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3375/6756] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:27:27.363891 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-42c6eaa3-2da6-4fde-9e27-926dd0b02472 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:27.364741 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-42c6eaa3-2da6-4fde-9e27-926dd0b02472 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:27.372318 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42c6eaa3-2da6-4fde-9e27-926dd0b02472 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:27.372782 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42c6eaa3-2da6-4fde-9e27-926dd0b02472 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:27.373560 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42c6eaa3-2da6-4fde-9e27-926dd0b02472 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:27.374008 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42c6eaa3-2da6-4fde-9e27-926dd0b02472 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:27.526705 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-42c6eaa3-2da6-4fde-9e27-926dd0b02472 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:27.539550 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-42c6eaa3-2da6-4fde-9e27-926dd0b02472 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22" status: 200 len: 1317 microversion: 2.1 time: 0.179432 Jul 19 23:27:27.540149 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3382/6757] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:27 2022] GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:28.555836 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:27:28.556607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:27:28.560619 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7bd64bbe-d2c5-4097-99dc-d713b89b1450 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:28.561309 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7bd64bbe-d2c5-4097-99dc-d713b89b1450 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:28.569114 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bd64bbe-d2c5-4097-99dc-d713b89b1450 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:28.569565 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bd64bbe-d2c5-4097-99dc-d713b89b1450 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:28.570329 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bd64bbe-d2c5-4097-99dc-d713b89b1450 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:28.570770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bd64bbe-d2c5-4097-99dc-d713b89b1450 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:28.707931 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7bd64bbe-d2c5-4097-99dc-d713b89b1450 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:28.716518 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7bd64bbe-d2c5-4097-99dc-d713b89b1450 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22" status: 200 len: 1506 microversion: 2.1 time: 0.162561 Jul 19 23:27:28.717100 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3376/6758] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:28 2022] GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:28.770217 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fc1fd161-94d3-408e-92ee-b117e619f85d tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-375990502", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "99540dd3-de7d-4783-bd72-48be16b30c66"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:27:28.777304 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:27:28.824577 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-fc1fd161-94d3-408e-92ee-b117e619f85d tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] validate_networks() for [('99540dd3-de7d-4783-bd72-48be16b30c66', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:27:29.202084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-fc1fd161-94d3-408e-92ee-b117e619f85d tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:27:29.202754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-fc1fd161-94d3-408e-92ee-b117e619f85d tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:27:29.204096 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-fc1fd161-94d3-408e-92ee-b117e619f85d tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:27:29.204712 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-fc1fd161-94d3-408e-92ee-b117e619f85d tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:27:29.205287 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-fc1fd161-94d3-408e-92ee-b117e619f85d tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:27:29.215854 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc1fd161-94d3-408e-92ee-b117e619f85d tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:29.216328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc1fd161-94d3-408e-92ee-b117e619f85d tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:29.217153 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc1fd161-94d3-408e-92ee-b117e619f85d tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:29.217613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fc1fd161-94d3-408e-92ee-b117e619f85d tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:29.234853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-fc1fd161-94d3-408e-92ee-b117e619f85d tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Getting quotas for project 3969c9b551e2436aa066ba89b9bba0c4. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:27:29.240300 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-fc1fd161-94d3-408e-92ee-b117e619f85d tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Getting quotas for user cc433fd4f38340cda50e88534d1ae2c7 and project 3969c9b551e2436aa066ba89b9bba0c4. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:27:29.253228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fc1fd161-94d3-408e-92ee-b117e619f85d tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:27:29.255917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fc1fd161-94d3-408e-92ee-b117e619f85d tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: a99d21f0-7b34-4830-bd7e-4b649581714f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:27:29.301246 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fc1fd161-94d3-408e-92ee-b117e619f85d tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534863 Jul 19 23:27:29.301953 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3383/6759] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:27:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:27:29.312090 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-91e5642c-12aa-49ab-bce0-b1bbded894b9 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:29.312722 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-91e5642c-12aa-49ab-bce0-b1bbded894b9 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: a99d21f0-7b34-4830-bd7e-4b649581714f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:29.367164 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-91e5642c-12aa-49ab-bce0-b1bbded894b9 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:29.375966 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-91e5642c-12aa-49ab-bce0-b1bbded894b9 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f" status: 200 len: 1216 microversion: 2.1 time: 0.067501 Jul 19 23:27:29.376633 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3377/6760] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:29 2022] GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f => generated 1216 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:27:30.396255 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4a00638e-e0d2-4bea-9645-7f885f7ef9ae tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:30.396896 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4a00638e-e0d2-4bea-9645-7f885f7ef9ae tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: a99d21f0-7b34-4830-bd7e-4b649581714f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:30.404774 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4a00638e-e0d2-4bea-9645-7f885f7ef9ae tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:30.405237 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4a00638e-e0d2-4bea-9645-7f885f7ef9ae tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:30.406196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4a00638e-e0d2-4bea-9645-7f885f7ef9ae tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:30.406658 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4a00638e-e0d2-4bea-9645-7f885f7ef9ae tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:30.502607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4a00638e-e0d2-4bea-9645-7f885f7ef9ae tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:30.510597 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4a00638e-e0d2-4bea-9645-7f885f7ef9ae tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f" status: 200 len: 1274 microversion: 2.1 time: 0.119343 Jul 19 23:27:30.511205 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3384/6761] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:30 2022] GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f => generated 1274 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:31.527749 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0a287698-ed59-4a9b-bfbf-781e31155278 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:31.532520 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0a287698-ed59-4a9b-bfbf-781e31155278 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: a99d21f0-7b34-4830-bd7e-4b649581714f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:31.541428 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a287698-ed59-4a9b-bfbf-781e31155278 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:31.542158 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a287698-ed59-4a9b-bfbf-781e31155278 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:31.543142 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a287698-ed59-4a9b-bfbf-781e31155278 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:31.543584 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a287698-ed59-4a9b-bfbf-781e31155278 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:31.766818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0a287698-ed59-4a9b-bfbf-781e31155278 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:31.788832 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-eff944c8-3f24-4776-a823-171bd2a8887f req-290954e3-f1bc-4d3c-872a-ec13784aff60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a99d21f0-7b34-4830-bd7e-4b649581714f", "tag": "843b44e0-5988-41e7-8589-c6ac0f1700a6"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:27:31.789723 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0a287698-ed59-4a9b-bfbf-781e31155278 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f" status: 200 len: 1316 microversion: 2.1 time: 0.265804 Jul 19 23:27:31.790869 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3378/6762] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:31 2022] GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:31.814962 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-eff944c8-3f24-4776-a823-171bd2a8887f req-290954e3-f1bc-4d3c-872a-ec13784aff60 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:31.815462 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-eff944c8-3f24-4776-a823-171bd2a8887f req-290954e3-f1bc-4d3c-872a-ec13784aff60 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:31.837598 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-eff944c8-3f24-4776-a823-171bd2a8887f req-290954e3-f1bc-4d3c-872a-ec13784aff60 service nova] Creating event network-changed:843b44e0-5988-41e7-8589-c6ac0f1700a6 for instance a99d21f0-7b34-4830-bd7e-4b649581714f on n-h1-847009-3 Jul 19 23:27:31.843124 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-eff944c8-3f24-4776-a823-171bd2a8887f req-290954e3-f1bc-4d3c-872a-ec13784aff60 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058211 Jul 19 23:27:31.843914 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3385/6763] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:27:32.807780 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5ff3a232-7f97-4723-aa49-89bfecf89ba4 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:32.808419 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5ff3a232-7f97-4723-aa49-89bfecf89ba4 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: a99d21f0-7b34-4830-bd7e-4b649581714f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:32.811120 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:27:32.816552 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ff3a232-7f97-4723-aa49-89bfecf89ba4 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:32.817635 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ff3a232-7f97-4723-aa49-89bfecf89ba4 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:32.818484 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ff3a232-7f97-4723-aa49-89bfecf89ba4 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:32.818934 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ff3a232-7f97-4723-aa49-89bfecf89ba4 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:32.947714 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5ff3a232-7f97-4723-aa49-89bfecf89ba4 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:32.955378 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5ff3a232-7f97-4723-aa49-89bfecf89ba4 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f" status: 200 len: 1316 microversion: 2.1 time: 0.151578 Jul 19 23:27:32.955950 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3379/6764] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:32 2022] GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:33.974673 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8a12c05f-aef4-46a0-b883-ba8e1c424a2c tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:33.975423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8a12c05f-aef4-46a0-b883-ba8e1c424a2c tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: a99d21f0-7b34-4830-bd7e-4b649581714f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:33.981662 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a12c05f-aef4-46a0-b883-ba8e1c424a2c tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:33.982130 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a12c05f-aef4-46a0-b883-ba8e1c424a2c tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:33.982907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a12c05f-aef4-46a0-b883-ba8e1c424a2c tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:33.983392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a12c05f-aef4-46a0-b883-ba8e1c424a2c tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:34.118435 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8a12c05f-aef4-46a0-b883-ba8e1c424a2c tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:34.125907 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8a12c05f-aef4-46a0-b883-ba8e1c424a2c tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f" status: 200 len: 1316 microversion: 2.1 time: 0.156990 Jul 19 23:27:34.126478 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3386/6765] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:33 2022] GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:35.143019 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e226a047-7839-4c96-af5e-7d6fbd443f45 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:35.143675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e226a047-7839-4c96-af5e-7d6fbd443f45 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: a99d21f0-7b34-4830-bd7e-4b649581714f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:35.150869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e226a047-7839-4c96-af5e-7d6fbd443f45 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:35.151360 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e226a047-7839-4c96-af5e-7d6fbd443f45 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:35.152144 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e226a047-7839-4c96-af5e-7d6fbd443f45 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:35.152587 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e226a047-7839-4c96-af5e-7d6fbd443f45 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:35.286274 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e226a047-7839-4c96-af5e-7d6fbd443f45 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:35.294119 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e226a047-7839-4c96-af5e-7d6fbd443f45 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f" status: 200 len: 1316 microversion: 2.1 time: 0.154935 Jul 19 23:27:35.294727 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3380/6766] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:35 2022] GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:36.312044 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a44cc096-db74-4bbe-8e71-1e385fdbbfb1 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:36.313901 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a44cc096-db74-4bbe-8e71-1e385fdbbfb1 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: a99d21f0-7b34-4830-bd7e-4b649581714f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:36.326265 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a44cc096-db74-4bbe-8e71-1e385fdbbfb1 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:36.327187 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a44cc096-db74-4bbe-8e71-1e385fdbbfb1 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:36.328140 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a44cc096-db74-4bbe-8e71-1e385fdbbfb1 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:36.328632 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a44cc096-db74-4bbe-8e71-1e385fdbbfb1 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:36.470915 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a44cc096-db74-4bbe-8e71-1e385fdbbfb1 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:36.480869 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a44cc096-db74-4bbe-8e71-1e385fdbbfb1 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f" status: 200 len: 1316 microversion: 2.1 time: 0.172920 Jul 19 23:27:36.481687 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3387/6767] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:36 2022] GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:27:37.075678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-a27a8f74-7ffb-4cb2-92b3-c9583abd289a req-6de776c2-f173-4a12-845d-89dd880f4f09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99d21f0-7b34-4830-bd7e-4b649581714f", "name": "network-vif-plugged", "status": "completed", "tag": "843b44e0-5988-41e7-8589-c6ac0f1700a6"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:27:37.086084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-a27a8f74-7ffb-4cb2-92b3-c9583abd289a req-6de776c2-f173-4a12-845d-89dd880f4f09 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:37.086540 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-a27a8f74-7ffb-4cb2-92b3-c9583abd289a req-6de776c2-f173-4a12-845d-89dd880f4f09 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:37.098105 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-a27a8f74-7ffb-4cb2-92b3-c9583abd289a req-6de776c2-f173-4a12-845d-89dd880f4f09 service nova] Creating event network-vif-plugged:843b44e0-5988-41e7-8589-c6ac0f1700a6 for instance a99d21f0-7b34-4830-bd7e-4b649581714f on n-h1-847009-3 Jul 19 23:27:37.103165 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-a27a8f74-7ffb-4cb2-92b3-c9583abd289a req-6de776c2-f173-4a12-845d-89dd880f4f09 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031541 Jul 19 23:27:37.104145 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3381/6768] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:27:37.497826 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dd6238fa-abe7-41f1-bc55-240425f748ce tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:37.498578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dd6238fa-abe7-41f1-bc55-240425f748ce tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: a99d21f0-7b34-4830-bd7e-4b649581714f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:37.506020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dd6238fa-abe7-41f1-bc55-240425f748ce tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:37.506480 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dd6238fa-abe7-41f1-bc55-240425f748ce tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:37.507288 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dd6238fa-abe7-41f1-bc55-240425f748ce tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:37.507745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dd6238fa-abe7-41f1-bc55-240425f748ce tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:37.638953 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dd6238fa-abe7-41f1-bc55-240425f748ce tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:37.648528 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dd6238fa-abe7-41f1-bc55-240425f748ce tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f" status: 200 len: 1316 microversion: 2.1 time: 0.154726 Jul 19 23:27:37.649105 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3388/6769] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:37 2022] GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:38.666625 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-956816d8-59c3-4587-8670-b5a4069f12fe tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:38.667357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-956816d8-59c3-4587-8670-b5a4069f12fe tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: a99d21f0-7b34-4830-bd7e-4b649581714f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:38.673741 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-956816d8-59c3-4587-8670-b5a4069f12fe tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:38.674214 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-956816d8-59c3-4587-8670-b5a4069f12fe tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:38.674984 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-956816d8-59c3-4587-8670-b5a4069f12fe tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:38.675456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-956816d8-59c3-4587-8670-b5a4069f12fe tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:38.816240 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-956816d8-59c3-4587-8670-b5a4069f12fe tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:38.824765 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-956816d8-59c3-4587-8670-b5a4069f12fe tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f" status: 200 len: 1506 microversion: 2.1 time: 0.163342 Jul 19 23:27:38.825366 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3382/6770] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:38 2022] GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:38.841389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5aa10b8b-8598-4a80-832b-01054b85f3fa tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:38.841980 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5aa10b8b-8598-4a80-832b-01054b85f3fa tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: a99d21f0-7b34-4830-bd7e-4b649581714f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:38.849681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5aa10b8b-8598-4a80-832b-01054b85f3fa tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:38.850149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5aa10b8b-8598-4a80-832b-01054b85f3fa tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:38.850941 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5aa10b8b-8598-4a80-832b-01054b85f3fa tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:38.851431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5aa10b8b-8598-4a80-832b-01054b85f3fa tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:38.881809 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5aa10b8b-8598-4a80-832b-01054b85f3fa tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: a99d21f0-7b34-4830-bd7e-4b649581714f] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:27:38.978966 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5aa10b8b-8598-4a80-832b-01054b85f3fa tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f" status: 204 len: 0 microversion: 2.1 time: 0.141198 Jul 19 23:27:38.979223 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3389/6771] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:27:38 2022] DELETE /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:27:38.987630 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-eea55c49-6700-4780-a8c7-a9cbb4f16065 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:38.988252 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-eea55c49-6700-4780-a8c7-a9cbb4f16065 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: a99d21f0-7b34-4830-bd7e-4b649581714f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:38.995067 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eea55c49-6700-4780-a8c7-a9cbb4f16065 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:38.995562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eea55c49-6700-4780-a8c7-a9cbb4f16065 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:38.996340 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eea55c49-6700-4780-a8c7-a9cbb4f16065 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:38.996781 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eea55c49-6700-4780-a8c7-a9cbb4f16065 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:39.127917 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-eea55c49-6700-4780-a8c7-a9cbb4f16065 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:39.136226 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-eea55c49-6700-4780-a8c7-a9cbb4f16065 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f" status: 200 len: 1512 microversion: 2.1 time: 0.152569 Jul 19 23:27:39.136797 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3383/6772] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:38 2022] GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:40.154654 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b3af9aaa-2906-4b07-8a16-50e0e7e61921 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:40.155401 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b3af9aaa-2906-4b07-8a16-50e0e7e61921 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: a99d21f0-7b34-4830-bd7e-4b649581714f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:40.157342 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:27:40.158018 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:27:40.166010 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b3af9aaa-2906-4b07-8a16-50e0e7e61921 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:40.166467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b3af9aaa-2906-4b07-8a16-50e0e7e61921 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:40.167268 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b3af9aaa-2906-4b07-8a16-50e0e7e61921 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:40.167720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b3af9aaa-2906-4b07-8a16-50e0e7e61921 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:40.304477 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b3af9aaa-2906-4b07-8a16-50e0e7e61921 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:40.315333 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b3af9aaa-2906-4b07-8a16-50e0e7e61921 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f" status: 200 len: 1512 microversion: 2.1 time: 0.164623 Jul 19 23:27:40.315605 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3390/6773] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:40 2022] GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:40.967454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-07b38b4d-8937-4a59-be48-e3a9f08f1ee7 req-27b1531b-781d-4d30-b6ff-396fdf749eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99d21f0-7b34-4830-bd7e-4b649581714f", "name": "network-vif-deleted", "tag": "843b44e0-5988-41e7-8589-c6ac0f1700a6"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:27:40.986266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:27:40.993680 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-07b38b4d-8937-4a59-be48-e3a9f08f1ee7 req-27b1531b-781d-4d30-b6ff-396fdf749eed service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:40.994623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-07b38b4d-8937-4a59-be48-e3a9f08f1ee7 req-27b1531b-781d-4d30-b6ff-396fdf749eed service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:41.011000 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-07b38b4d-8937-4a59-be48-e3a9f08f1ee7 req-27b1531b-781d-4d30-b6ff-396fdf749eed service nova] Creating event network-vif-deleted:843b44e0-5988-41e7-8589-c6ac0f1700a6 for instance a99d21f0-7b34-4830-bd7e-4b649581714f on n-h1-847009-3 Jul 19 23:27:41.015770 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-07b38b4d-8937-4a59-be48-e3a9f08f1ee7 req-27b1531b-781d-4d30-b6ff-396fdf749eed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054139 Jul 19 23:27:41.016876 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3384/6774] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:27:41.332134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-127afa89-1e03-4ae0-b931-1d372dfeaa6d tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:41.333648 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-127afa89-1e03-4ae0-b931-1d372dfeaa6d tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: a99d21f0-7b34-4830-bd7e-4b649581714f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:41.340725 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-127afa89-1e03-4ae0-b931-1d372dfeaa6d tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:41.341196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-127afa89-1e03-4ae0-b931-1d372dfeaa6d tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:41.341988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-127afa89-1e03-4ae0-b931-1d372dfeaa6d tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:41.342448 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-127afa89-1e03-4ae0-b931-1d372dfeaa6d tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:41.374833 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-127afa89-1e03-4ae0-b931-1d372dfeaa6d tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:41.375337 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-127afa89-1e03-4ae0-b931-1d372dfeaa6d tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:41.375808 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-127afa89-1e03-4ae0-b931-1d372dfeaa6d tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lazy-loading 'fault' on Instance uuid a99d21f0-7b34-4830-bd7e-4b649581714f {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:27:41.419864 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-127afa89-1e03-4ae0-b931-1d372dfeaa6d tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:41.427620 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-127afa89-1e03-4ae0-b931-1d372dfeaa6d tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f" status: 200 len: 1306 microversion: 2.1 time: 0.099346 Jul 19 23:27:41.428371 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3391/6775] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:41 2022] GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f => generated 1306 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:27:42.447821 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f82b8278-7d3d-4ffd-bf7f-b33b4a4fad1f tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:42.448446 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f82b8278-7d3d-4ffd-bf7f-b33b4a4fad1f tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: a99d21f0-7b34-4830-bd7e-4b649581714f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:42.455125 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f82b8278-7d3d-4ffd-bf7f-b33b4a4fad1f tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:42.455592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f82b8278-7d3d-4ffd-bf7f-b33b4a4fad1f tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:42.456369 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f82b8278-7d3d-4ffd-bf7f-b33b4a4fad1f tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:42.456816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f82b8278-7d3d-4ffd-bf7f-b33b4a4fad1f tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:42.471252 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-f82b8278-7d3d-4ffd-bf7f-b33b4a4fad1f tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] HTTP exception thrown: Instance a99d21f0-7b34-4830-bd7e-4b649581714f could not be found. Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f82b8278-7d3d-4ffd-bf7f-b33b4a4fad1f tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Request method failure captured: Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f HTTP/1.1 Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1z3V-_UE1_xrZ7kRHbTtsp34ROlZtewthBCIucx1_r0pJBHg9YN32Bz7Hp5lDz11Y7roAY-wUahUz3AYhLHE9cfMpPWwXAuVX16Tq0-uRbi7U3rmLl7ht4eOrRwFKy1KiasJxxjirFI1b7VWzqBAXRT2JCHwZNIGst7aGGpFvM6azuQ Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 3969c9b551e2436aa066ba89b9bba0c4 Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersNegativeTestJSON-290774130 Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersNegativeTestJSON-290774130 Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 3969c9b551e2436aa066ba89b9bba0c4 Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersNegativeTestJSON-290774130 Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersNegativeTestJSON-290774130-project Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: cc433fd4f38340cda50e88534d1ae2c7 Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersNegativeTestJSON-290774130-project Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance a99d21f0-7b34-4830-bd7e-4b649581714f could not be found. Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'a99d21f0-7b34-4830-bd7e-4b649581714f'} Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a99d21f0-7b34-4830-bd7e-4b649581714f could not be found. Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a99d21f0-7b34-4830-bd7e-4b649581714f could not be found. Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:42.473010 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:42.477481 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:42.477481 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:42.477481 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:42.477481 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:27:42.477481 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:27:42.477481 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a99d21f0-7b34-4830-bd7e-4b649581714f could not be found. Jul 19 23:27:42.477481 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:42.477481 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f82b8278-7d3d-4ffd-bf7f-b33b4a4fad1f tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Returning 404 to user: Instance a99d21f0-7b34-4830-bd7e-4b649581714f could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:27:42.477481 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f82b8278-7d3d-4ffd-bf7f-b33b4a4fad1f tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f" status: 404 len: 111 microversion: 2.1 time: 0.032837 Jul 19 23:27:42.478326 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3385/6776] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:42 2022] GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 23:27:42.483854 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d4ad257f-bf87-42c6-9ce5-c3f1a6f6d6bb tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:42.484489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d4ad257f-bf87-42c6-9ce5-c3f1a6f6d6bb tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:42.493011 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d4ad257f-bf87-42c6-9ce5-c3f1a6f6d6bb tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:42.493472 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d4ad257f-bf87-42c6-9ce5-c3f1a6f6d6bb tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:42.494248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d4ad257f-bf87-42c6-9ce5-c3f1a6f6d6bb tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:42.494698 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d4ad257f-bf87-42c6-9ce5-c3f1a6f6d6bb tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:42.629057 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d4ad257f-bf87-42c6-9ce5-c3f1a6f6d6bb tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:42.637224 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d4ad257f-bf87-42c6-9ce5-c3f1a6f6d6bb tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22" status: 200 len: 1506 microversion: 2.1 time: 0.157496 Jul 19 23:27:42.637792 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3392/6777] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:42 2022] GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:42.653399 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f7d29ba2-feb1-4b11-b9ab-ee4a338cb411 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:27:42.654366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f7d29ba2-feb1-4b11-b9ab-ee4a338cb411 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: 8725dc20-1156-4959-aa12-55875e053dd5] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:42.659899 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-f7d29ba2-feb1-4b11-b9ab-ee4a338cb411 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] HTTP exception thrown: Instance 8725dc20-1156-4959-aa12-55875e053dd5 could not be found. Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f7d29ba2-feb1-4b11-b9ab-ee4a338cb411 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Request method failure captured: Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers/8725dc20-1156-4959-aa12-55875e053dd5/action HTTP/1.1 Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 32 Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1z3V-_UE1_xrZ7kRHbTtsp34ROlZtewthBCIucx1_r0pJBHg9YN32Bz7Hp5lDz11Y7roAY-wUahUz3AYhLHE9cfMpPWwXAuVX16Tq0-uRbi7U3rmLl7ht4eOrRwFKy1KiasJxxjirFI1b7VWzqBAXRT2JCHwZNIGst7aGGpFvM6azuQ Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 3969c9b551e2436aa066ba89b9bba0c4 Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersNegativeTestJSON-290774130 Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersNegativeTestJSON-290774130 Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 3969c9b551e2436aa066ba89b9bba0c4 Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersNegativeTestJSON-290774130 Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersNegativeTestJSON-290774130-project Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: cc433fd4f38340cda50e88534d1ae2c7 Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersNegativeTestJSON-290774130-project Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: {"resize": {"flavorRef": "452"}} Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 8725dc20-1156-4959-aa12-55875e053dd5 could not be found. Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '8725dc20-1156-4959-aa12-55875e053dd5', 'body': {'resize': {'flavorRef': '452'}}} Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8725dc20-1156-4959-aa12-55875e053dd5 could not be found. Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:27:42.661569 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:27:42.665464 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8725dc20-1156-4959-aa12-55875e053dd5 could not be found. Jul 19 23:27:42.665464 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:42.665464 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:42.665464 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:42.665464 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:42.665464 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:42.665464 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:42.665464 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:27:42.665464 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:27:42.665464 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8725dc20-1156-4959-aa12-55875e053dd5 could not be found. Jul 19 23:27:42.665464 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:42.665464 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f7d29ba2-feb1-4b11-b9ab-ee4a338cb411 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Returning 404 to user: Instance 8725dc20-1156-4959-aa12-55875e053dd5 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:27:42.665464 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f7d29ba2-feb1-4b11-b9ab-ee4a338cb411 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "POST /compute/v2.1/servers/8725dc20-1156-4959-aa12-55875e053dd5/action" status: 404 len: 111 microversion: 2.1 time: 0.013514 Jul 19 23:27:42.665464 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3386/6778] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:27:42 2022] POST /compute/v2.1/servers/8725dc20-1156-4959-aa12-55875e053dd5/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:27:42.671448 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f56507be-a24e-4698-a1f3-6ed89e1dcaad tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:42.672080 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f56507be-a24e-4698-a1f3-6ed89e1dcaad tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:42.678518 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f56507be-a24e-4698-a1f3-6ed89e1dcaad tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:42.678985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f56507be-a24e-4698-a1f3-6ed89e1dcaad tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:42.679793 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f56507be-a24e-4698-a1f3-6ed89e1dcaad tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:42.680243 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f56507be-a24e-4698-a1f3-6ed89e1dcaad tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:42.811374 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f56507be-a24e-4698-a1f3-6ed89e1dcaad tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:42.814858 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:27:42.819853 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f56507be-a24e-4698-a1f3-6ed89e1dcaad tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22" status: 200 len: 1506 microversion: 2.1 time: 0.152185 Jul 19 23:27:42.820423 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3393/6779] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:42 2022] GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:42.836872 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8d1ed90c-9c70-4fa8-a20f-032551341a6e tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:42.837486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8d1ed90c-9c70-4fa8-a20f-032551341a6e tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:42.844455 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d1ed90c-9c70-4fa8-a20f-032551341a6e tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:42.844903 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d1ed90c-9c70-4fa8-a20f-032551341a6e tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:42.845662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d1ed90c-9c70-4fa8-a20f-032551341a6e tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:42.846099 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8d1ed90c-9c70-4fa8-a20f-032551341a6e tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:42.986267 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8d1ed90c-9c70-4fa8-a20f-032551341a6e tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:42.994686 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8d1ed90c-9c70-4fa8-a20f-032551341a6e tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22" status: 200 len: 1506 microversion: 2.1 time: 0.161710 Jul 19 23:27:42.995318 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3387/6780] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:42 2022] GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:43.011823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7557a83e-a34f-43fd-8f8e-6bb4e46d85b3 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "05c11644-2430-407a-b01a-d993026f8e87"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:27:43.012733 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7557a83e-a34f-43fd-8f8e-6bb4e46d85b3 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:43.019372 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7557a83e-a34f-43fd-8f8e-6bb4e46d85b3 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:43.019875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7557a83e-a34f-43fd-8f8e-6bb4e46d85b3 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:43.020757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7557a83e-a34f-43fd-8f8e-6bb4e46d85b3 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:43.021205 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7557a83e-a34f-43fd-8f8e-6bb4e46d85b3 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:43.054021 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7557a83e-a34f-43fd-8f8e-6bb4e46d85b3 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:43.059507 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-7557a83e-a34f-43fd-8f8e-6bb4e46d85b3 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] HTTP exception thrown: Flavor 05c11644-2430-407a-b01a-d993026f8e87 could not be found. Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7557a83e-a34f-43fd-8f8e-6bb4e46d85b3 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Request method failure captured: Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: request: POST /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22/action HTTP/1.1 Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 65 Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1z3V-_UE1_xrZ7kRHbTtsp34ROlZtewthBCIucx1_r0pJBHg9YN32Bz7Hp5lDz11Y7roAY-wUahUz3AYhLHE9cfMpPWwXAuVX16Tq0-uRbi7U3rmLl7ht4eOrRwFKy1KiasJxxjirFI1b7VWzqBAXRT2JCHwZNIGst7aGGpFvM6azuQ Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 3969c9b551e2436aa066ba89b9bba0c4 Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-290774130 Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-290774130 Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 3969c9b551e2436aa066ba89b9bba0c4 Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-290774130 Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-290774130-project Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: cc433fd4f38340cda50e88534d1ae2c7 Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-290774130-project Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: {"resize": {"flavorRef": "05c11644-2430-407a-b01a-d993026f8e87"}} Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: exception: Flavor 05c11644-2430-407a-b01a-d993026f8e87 could not be found. Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22', 'body': {'resize': {'flavorRef': '05c11644-2430-407a-b01a-d993026f8e87'}}} Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 23:27:43.065938 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 05c11644-2430-407a-b01a-d993026f8e87 could not be found. Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 05c11644-2430-407a-b01a-d993026f8e87 could not be found. Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 05c11644-2430-407a-b01a-d993026f8e87 could not be found. Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7557a83e-a34f-43fd-8f8e-6bb4e46d85b3 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Returning 400 to user: Flavor 05c11644-2430-407a-b01a-d993026f8e87 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7557a83e-a34f-43fd-8f8e-6bb4e46d85b3 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "POST /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22/action" status: 400 len: 107 microversion: 2.1 time: 0.060328 Jul 19 23:27:43.070432 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3394/6781] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:27:43 2022] POST /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22/action => generated 107 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 23:27:43.077146 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cad18fc7-c288-490a-8420-c0cf93e994f8 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:43.077773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cad18fc7-c288-490a-8420-c0cf93e994f8 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:43.084742 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cad18fc7-c288-490a-8420-c0cf93e994f8 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:43.085195 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cad18fc7-c288-490a-8420-c0cf93e994f8 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:43.085973 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cad18fc7-c288-490a-8420-c0cf93e994f8 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:43.086417 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cad18fc7-c288-490a-8420-c0cf93e994f8 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:43.236768 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cad18fc7-c288-490a-8420-c0cf93e994f8 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:43.248631 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cad18fc7-c288-490a-8420-c0cf93e994f8 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22" status: 200 len: 1506 microversion: 2.1 time: 0.175596 Jul 19 23:27:43.249232 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3388/6782] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:43 2022] GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:43.266940 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e9282d6a-b4db-49de-83c5-4554fc7fb381 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:43.268635 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e9282d6a-b4db-49de-83c5-4554fc7fb381 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:43.276135 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e9282d6a-b4db-49de-83c5-4554fc7fb381 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:43.277303 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e9282d6a-b4db-49de-83c5-4554fc7fb381 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:43.277420 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e9282d6a-b4db-49de-83c5-4554fc7fb381 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:43.278503 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e9282d6a-b4db-49de-83c5-4554fc7fb381 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:43.435425 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e9282d6a-b4db-49de-83c5-4554fc7fb381 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:43.443325 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e9282d6a-b4db-49de-83c5-4554fc7fb381 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22" status: 200 len: 1506 microversion: 2.1 time: 0.180408 Jul 19 23:27:43.443905 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3395/6783] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:43 2022] GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:43.461669 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-08e8eb51-4ef2-406b-975c-28abc2c2cdb8 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-08e8eb51-4ef2-406b-975c-28abc2c2cdb8 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Request method failure captured: Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: request: POST /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22/action HTTP/1.1 Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 29 Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1z3V-_UE1_xrZ7kRHbTtsp34ROlZtewthBCIucx1_r0pJBHg9YN32Bz7Hp5lDz11Y7roAY-wUahUz3AYhLHE9cfMpPWwXAuVX16Tq0-uRbi7U3rmLl7ht4eOrRwFKy1KiasJxxjirFI1b7VWzqBAXRT2JCHwZNIGst7aGGpFvM6azuQ Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 3969c9b551e2436aa066ba89b9bba0c4 Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersNegativeTestJSON-290774130 Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersNegativeTestJSON-290774130 Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 3969c9b551e2436aa066ba89b9bba0c4 Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersNegativeTestJSON-290774130 Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersNegativeTestJSON-290774130-project Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: cc433fd4f38340cda50e88534d1ae2c7 Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersNegativeTestJSON-290774130-project Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: {"resize": {"flavorRef": ""}} Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22', 'body': {'resize': {'flavorRef': ''}}} Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise error Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi On instance['resize']: Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi '' Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:43.464123 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:43.468479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:43.468479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:43.468479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:43.468479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 23:27:43.468479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 23:27:43.468479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 19 23:27:43.468479 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:43.468479 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-08e8eb51-4ef2-406b-975c-28abc2c2cdb8 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:27:43.468479 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-08e8eb51-4ef2-406b-975c-28abc2c2cdb8 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "POST /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22/action" status: 400 len: 113 microversion: 2.1 time: 0.010160 Jul 19 23:27:43.469376 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3389/6784] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:27:43 2022] POST /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22/action => generated 113 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 23:27:43.477167 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2c50fcab-735b-4c27-a777-eb8122c3b163 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:43.477820 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2c50fcab-735b-4c27-a777-eb8122c3b163 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:43.484716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2c50fcab-735b-4c27-a777-eb8122c3b163 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:43.485357 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2c50fcab-735b-4c27-a777-eb8122c3b163 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:43.485978 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2c50fcab-735b-4c27-a777-eb8122c3b163 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:43.486566 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2c50fcab-735b-4c27-a777-eb8122c3b163 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:43.635356 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2c50fcab-735b-4c27-a777-eb8122c3b163 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:43.643377 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2c50fcab-735b-4c27-a777-eb8122c3b163 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22" status: 200 len: 1506 microversion: 2.1 time: 0.170945 Jul 19 23:27:43.643966 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3396/6785] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:43 2022] GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:43.669275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d1edbe2c-30d7-4988-bf29-3c6f60c9c904 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:43.669991 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d1edbe2c-30d7-4988-bf29-3c6f60c9c904 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: a99d21f0-7b34-4830-bd7e-4b649581714f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:43.678650 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d1edbe2c-30d7-4988-bf29-3c6f60c9c904 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:43.679102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d1edbe2c-30d7-4988-bf29-3c6f60c9c904 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:43.679908 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d1edbe2c-30d7-4988-bf29-3c6f60c9c904 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:43.680344 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d1edbe2c-30d7-4988-bf29-3c6f60c9c904 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:43.697215 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-d1edbe2c-30d7-4988-bf29-3c6f60c9c904 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] HTTP exception thrown: Instance a99d21f0-7b34-4830-bd7e-4b649581714f could not be found. Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d1edbe2c-30d7-4988-bf29-3c6f60c9c904 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Request method failure captured: Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f HTTP/1.1 Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1z3V-_UE1_xrZ7kRHbTtsp34ROlZtewthBCIucx1_r0pJBHg9YN32Bz7Hp5lDz11Y7roAY-wUahUz3AYhLHE9cfMpPWwXAuVX16Tq0-uRbi7U3rmLl7ht4eOrRwFKy1KiasJxxjirFI1b7VWzqBAXRT2JCHwZNIGst7aGGpFvM6azuQ Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 3969c9b551e2436aa066ba89b9bba0c4 Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-ServersNegativeTestJSON-290774130 Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-ServersNegativeTestJSON-290774130 Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 3969c9b551e2436aa066ba89b9bba0c4 Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-ServersNegativeTestJSON-290774130 Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-ServersNegativeTestJSON-290774130-project Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: cc433fd4f38340cda50e88534d1ae2c7 Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-ServersNegativeTestJSON-290774130-project Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance a99d21f0-7b34-4830-bd7e-4b649581714f could not be found. Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'a99d21f0-7b34-4830-bd7e-4b649581714f'} Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a99d21f0-7b34-4830-bd7e-4b649581714f could not be found. Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:27:43.699066 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:27:43.705742 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a99d21f0-7b34-4830-bd7e-4b649581714f could not be found. Jul 19 23:27:43.705742 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:43.705742 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:43.705742 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:43.705742 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:43.705742 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:43.705742 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:43.705742 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:27:43.705742 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:27:43.705742 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a99d21f0-7b34-4830-bd7e-4b649581714f could not be found. Jul 19 23:27:43.705742 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:27:43.705742 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d1edbe2c-30d7-4988-bf29-3c6f60c9c904 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Returning 404 to user: Instance a99d21f0-7b34-4830-bd7e-4b649581714f could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:27:43.705742 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d1edbe2c-30d7-4988-bf29-3c6f60c9c904 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f" status: 404 len: 111 microversion: 2.1 time: 0.035807 Jul 19 23:27:43.705742 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3390/6786] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:27:43 2022] DELETE /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:27:43.710630 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7e2b7367-39ac-4c03-ad36-f7ae81e8041f tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:43.711318 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7e2b7367-39ac-4c03-ad36-f7ae81e8041f tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: a99d21f0-7b34-4830-bd7e-4b649581714f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:43.717565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e2b7367-39ac-4c03-ad36-f7ae81e8041f tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:43.718024 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e2b7367-39ac-4c03-ad36-f7ae81e8041f tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:43.719609 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e2b7367-39ac-4c03-ad36-f7ae81e8041f tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:43.719609 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7e2b7367-39ac-4c03-ad36-f7ae81e8041f tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:43.733428 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-7e2b7367-39ac-4c03-ad36-f7ae81e8041f tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] HTTP exception thrown: Instance a99d21f0-7b34-4830-bd7e-4b649581714f could not be found. Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7e2b7367-39ac-4c03-ad36-f7ae81e8041f tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Request method failure captured: Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f HTTP/1.1 Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1z3V-_UE1_xrZ7kRHbTtsp34ROlZtewthBCIucx1_r0pJBHg9YN32Bz7Hp5lDz11Y7roAY-wUahUz3AYhLHE9cfMpPWwXAuVX16Tq0-uRbi7U3rmLl7ht4eOrRwFKy1KiasJxxjirFI1b7VWzqBAXRT2JCHwZNIGst7aGGpFvM6azuQ Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 3969c9b551e2436aa066ba89b9bba0c4 Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-290774130 Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-290774130 Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 3969c9b551e2436aa066ba89b9bba0c4 Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-290774130 Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-290774130-project Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: cc433fd4f38340cda50e88534d1ae2c7 Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-290774130-project Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance a99d21f0-7b34-4830-bd7e-4b649581714f could not be found. Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'a99d21f0-7b34-4830-bd7e-4b649581714f'} Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a99d21f0-7b34-4830-bd7e-4b649581714f could not be found. Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a99d21f0-7b34-4830-bd7e-4b649581714f could not be found. Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:43.734988 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:43.739529 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:43.739529 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:43.739529 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:43.739529 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:27:43.739529 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:27:43.739529 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a99d21f0-7b34-4830-bd7e-4b649581714f could not be found. Jul 19 23:27:43.739529 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:43.739529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7e2b7367-39ac-4c03-ad36-f7ae81e8041f tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Returning 404 to user: Instance a99d21f0-7b34-4830-bd7e-4b649581714f could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:27:43.739529 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7e2b7367-39ac-4c03-ad36-f7ae81e8041f tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f" status: 404 len: 111 microversion: 2.1 time: 0.030999 Jul 19 23:27:43.739529 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3397/6787] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:43 2022] GET /compute/v2.1/servers/a99d21f0-7b34-4830-bd7e-4b649581714f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:27:43.746567 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ff34e172-36c5-45e1-b09f-16d4938224b5 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:43.747098 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ff34e172-36c5-45e1-b09f-16d4938224b5 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:43.753671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ff34e172-36c5-45e1-b09f-16d4938224b5 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:43.754668 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ff34e172-36c5-45e1-b09f-16d4938224b5 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:43.755547 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ff34e172-36c5-45e1-b09f-16d4938224b5 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:43.756113 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ff34e172-36c5-45e1-b09f-16d4938224b5 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:43.786769 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ff34e172-36c5-45e1-b09f-16d4938224b5 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:27:43.880837 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ff34e172-36c5-45e1-b09f-16d4938224b5 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22" status: 204 len: 0 microversion: 2.1 time: 0.138011 Jul 19 23:27:43.881538 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3391/6788] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:27:43 2022] DELETE /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:27:43.889780 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c156ee56-4731-47c0-834b-bd973ef2aa70 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:43.890421 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c156ee56-4731-47c0-834b-bd973ef2aa70 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:43.898550 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c156ee56-4731-47c0-834b-bd973ef2aa70 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:43.899066 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c156ee56-4731-47c0-834b-bd973ef2aa70 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:43.899900 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c156ee56-4731-47c0-834b-bd973ef2aa70 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:43.899900 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c156ee56-4731-47c0-834b-bd973ef2aa70 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:44.044043 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c156ee56-4731-47c0-834b-bd973ef2aa70 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:44.052818 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c156ee56-4731-47c0-834b-bd973ef2aa70 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22" status: 200 len: 1512 microversion: 2.1 time: 0.167040 Jul 19 23:27:44.053383 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3398/6789] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:43 2022] GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:45.072588 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-eda2f41d-a023-4b9a-8e8b-e300a784bb25 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:45.073915 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-eda2f41d-a023-4b9a-8e8b-e300a784bb25 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:45.080664 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eda2f41d-a023-4b9a-8e8b-e300a784bb25 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:45.081117 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eda2f41d-a023-4b9a-8e8b-e300a784bb25 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:45.081890 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eda2f41d-a023-4b9a-8e8b-e300a784bb25 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:45.082334 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-eda2f41d-a023-4b9a-8e8b-e300a784bb25 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:45.103008 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:27:45.250975 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-eda2f41d-a023-4b9a-8e8b-e300a784bb25 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:45.259298 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-eda2f41d-a023-4b9a-8e8b-e300a784bb25 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22" status: 200 len: 1512 microversion: 2.1 time: 0.192603 Jul 19 23:27:45.259875 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3392/6790] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:45 2022] GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 => generated 1512 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:45.818794 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-c8aa56a5-20f4-41aa-a35e-7a8be024c23d req-8f5c9143-a75c-443c-a0c6-2f39ee96fe00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22", "name": "network-vif-deleted", "tag": "16622f0d-ab7c-4746-a712-6f158f5f37c0"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:27:45.830264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-c8aa56a5-20f4-41aa-a35e-7a8be024c23d req-8f5c9143-a75c-443c-a0c6-2f39ee96fe00 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:45.830771 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-c8aa56a5-20f4-41aa-a35e-7a8be024c23d req-8f5c9143-a75c-443c-a0c6-2f39ee96fe00 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:45.845768 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-c8aa56a5-20f4-41aa-a35e-7a8be024c23d req-8f5c9143-a75c-443c-a0c6-2f39ee96fe00 service nova] Creating event network-vif-deleted:16622f0d-ab7c-4746-a712-6f158f5f37c0 for instance c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 on n-h2-847009-3 Jul 19 23:27:45.853898 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-c8aa56a5-20f4-41aa-a35e-7a8be024c23d req-8f5c9143-a75c-443c-a0c6-2f39ee96fe00 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039778 Jul 19 23:27:45.855175 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3399/6791] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:27:46.276481 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ad81dbd2-bd44-497a-a084-61ee43ae1dea tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:46.277161 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ad81dbd2-bd44-497a-a084-61ee43ae1dea tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:46.284446 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad81dbd2-bd44-497a-a084-61ee43ae1dea tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:46.284906 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad81dbd2-bd44-497a-a084-61ee43ae1dea tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:46.285823 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad81dbd2-bd44-497a-a084-61ee43ae1dea tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:46.286948 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad81dbd2-bd44-497a-a084-61ee43ae1dea tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:46.322269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad81dbd2-bd44-497a-a084-61ee43ae1dea tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:46.322722 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ad81dbd2-bd44-497a-a084-61ee43ae1dea tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:46.323203 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-ad81dbd2-bd44-497a-a084-61ee43ae1dea tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lazy-loading 'fault' on Instance uuid c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:27:46.368266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ad81dbd2-bd44-497a-a084-61ee43ae1dea tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc433fd4f38340cda50e88534d1ae2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3969c9b551e2436aa066ba89b9bba0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:27:46.375256 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ad81dbd2-bd44-497a-a084-61ee43ae1dea tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22" status: 200 len: 1307 microversion: 2.1 time: 0.102820 Jul 19 23:27:46.375862 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3393/6792] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:46 2022] GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 => generated 1307 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:27:47.393453 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bf24bfd9-14d9-4036-9214-48f1b7d09a71 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:27:47.394096 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bf24bfd9-14d9-4036-9214-48f1b7d09a71 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] [instance: c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:27:47.402065 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bf24bfd9-14d9-4036-9214-48f1b7d09a71 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:47.402534 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bf24bfd9-14d9-4036-9214-48f1b7d09a71 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:47.403353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bf24bfd9-14d9-4036-9214-48f1b7d09a71 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:27:47.403810 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bf24bfd9-14d9-4036-9214-48f1b7d09a71 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:27:47.417973 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-bf24bfd9-14d9-4036-9214-48f1b7d09a71 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] HTTP exception thrown: Instance c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 could not be found. Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bf24bfd9-14d9-4036-9214-48f1b7d09a71 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Request method failure captured: Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 HTTP/1.1 Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1z3V-_UE1_xrZ7kRHbTtsp34ROlZtewthBCIucx1_r0pJBHg9YN32Bz7Hp5lDz11Y7roAY-wUahUz3AYhLHE9cfMpPWwXAuVX16Tq0-uRbi7U3rmLl7ht4eOrRwFKy1KiasJxxjirFI1b7VWzqBAXRT2JCHwZNIGst7aGGpFvM6azuQ Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 3969c9b551e2436aa066ba89b9bba0c4 Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-ServersNegativeTestJSON-290774130 Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3969c9b551e2436aa066ba89b9bba0c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-ServersNegativeTestJSON-290774130 Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 3969c9b551e2436aa066ba89b9bba0c4 Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-ServersNegativeTestJSON-290774130 Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-ServersNegativeTestJSON-290774130-project Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: cc433fd4f38340cda50e88534d1ae2c7 Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-ServersNegativeTestJSON-290774130-project Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 could not be found. Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22'} Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 could not be found. Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 could not be found. Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:27:47.419645 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:47.424084 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:27:47.424084 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:27:47.424084 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:27:47.424084 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:27:47.424084 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:27:47.424084 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 could not be found. Jul 19 23:27:47.424084 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:27:47.424084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bf24bfd9-14d9-4036-9214-48f1b7d09a71 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] Returning 404 to user: Instance c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:27:47.424084 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bf24bfd9-14d9-4036-9214-48f1b7d09a71 tempest-ServersNegativeTestJSON-290774130 tempest-ServersNegativeTestJSON-290774130-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22" status: 404 len: 111 microversion: 2.1 time: 0.032016 Jul 19 23:27:47.424084 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3400/6793] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:27:47 2022] GET /compute/v2.1/servers/c0a41ef4-f29d-4a9f-b0f6-ef6865b66c22 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:28:18.520915 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:28:18.521691 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=10 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:28:18.710734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d11ac5e2-5124-4f59-81ea-7218a49f2b82 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Action: 'create', calling method: .version_select at 0x7f7a03062a60>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1904676746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMesY91zoMRUTnc+nl6ECB9w0ud+QWFN0lyPs6fMi2+Zut36yAjy/NUe4rXUDp1PvdoMUl0IJ72puBu7Vv+zNUrcG2GaImuaIglSsfGafjObzB2d8DZeAy9WEvoRnQ3OXw=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:28:18.725210 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-d11ac5e2-5124-4f59-81ea-7218a49f2b82 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Getting quotas for project 1e8921e8b6734f6ab59fbf880dfd622b. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:28:18.730811 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-d11ac5e2-5124-4f59-81ea-7218a49f2b82 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Getting quotas for user 4d23e30a643947ec8040a9ad564ea328 and project 1e8921e8b6734f6ab59fbf880dfd622b. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:28:18.760728 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d11ac5e2-5124-4f59-81ea-7218a49f2b82 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.245521 Jul 19 23:28:18.761568 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3394/6794] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 23:28:18 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:28:18.817046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2c075145-256b-415b-8473-061f5322efd4 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1586383945", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1904676746", "networks": [{"uuid": "6bfaa678-c966-4567-8104-72d8031a6435"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:28:18.824564 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:28:18.825214 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=28 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:28:19.047021 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-2c075145-256b-415b-8473-061f5322efd4 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] validate_networks() for [('6bfaa678-c966-4567-8104-72d8031a6435', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:28:19.498079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-2c075145-256b-415b-8473-061f5322efd4 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:28:19.498518 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-2c075145-256b-415b-8473-061f5322efd4 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:28:19.499006 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-2c075145-256b-415b-8473-061f5322efd4 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:28:19.499452 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-2c075145-256b-415b-8473-061f5322efd4 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:28:19.499907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-2c075145-256b-415b-8473-061f5322efd4 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:28:19.511094 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2c075145-256b-415b-8473-061f5322efd4 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:19.511644 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2c075145-256b-415b-8473-061f5322efd4 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:19.512460 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2c075145-256b-415b-8473-061f5322efd4 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:19.512911 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2c075145-256b-415b-8473-061f5322efd4 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:19.531271 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-2c075145-256b-415b-8473-061f5322efd4 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Getting quotas for project 1e8921e8b6734f6ab59fbf880dfd622b. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:28:19.537817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-2c075145-256b-415b-8473-061f5322efd4 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Getting quotas for user 4d23e30a643947ec8040a9ad564ea328 and project 1e8921e8b6734f6ab59fbf880dfd622b. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:28:19.550946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2c075145-256b-415b-8473-061f5322efd4 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:28:19.553445 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2c075145-256b-415b-8473-061f5322efd4 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:28:19.603922 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2c075145-256b-415b-8473-061f5322efd4 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791453 Jul 19 23:28:19.605144 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3401/6795] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:28:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:28:19.615954 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-86d45067-d47c-4a7c-8210-dcb9a2437be7 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:19.616718 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-86d45067-d47c-4a7c-8210-dcb9a2437be7 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:19.819235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-86d45067-d47c-4a7c-8210-dcb9a2437be7 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d23e30a643947ec8040a9ad564ea328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8921e8b6734f6ab59fbf880dfd622b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:28:19.829574 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-86d45067-d47c-4a7c-8210-dcb9a2437be7 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f" status: 200 len: 1263 microversion: 2.1 time: 0.218542 Jul 19 23:28:19.830239 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3395/6796] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:28:19 2022] GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f => generated 1263 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:28:20.851408 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5e33b362-1399-45aa-932a-4c2f416504f2 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:20.852056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5e33b362-1399-45aa-932a-4c2f416504f2 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:20.863390 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5e33b362-1399-45aa-932a-4c2f416504f2 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:20.864133 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5e33b362-1399-45aa-932a-4c2f416504f2 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:20.865037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5e33b362-1399-45aa-932a-4c2f416504f2 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:20.865568 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5e33b362-1399-45aa-932a-4c2f416504f2 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:20.942176 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5e33b362-1399-45aa-932a-4c2f416504f2 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d23e30a643947ec8040a9ad564ea328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8921e8b6734f6ab59fbf880dfd622b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:28:20.950148 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5e33b362-1399-45aa-932a-4c2f416504f2 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f" status: 200 len: 1321 microversion: 2.1 time: 0.105170 Jul 19 23:28:20.950913 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3402/6797] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:28:20 2022] GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f => generated 1321 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:28:21.968200 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c93887aa-c486-4588-8874-6090d0c6c0eb tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:21.968819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c93887aa-c486-4588-8874-6090d0c6c0eb tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:21.978692 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c93887aa-c486-4588-8874-6090d0c6c0eb tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:21.979242 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c93887aa-c486-4588-8874-6090d0c6c0eb tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:21.980404 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c93887aa-c486-4588-8874-6090d0c6c0eb tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:21.981067 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c93887aa-c486-4588-8874-6090d0c6c0eb tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:22.239743 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c93887aa-c486-4588-8874-6090d0c6c0eb tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d23e30a643947ec8040a9ad564ea328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8921e8b6734f6ab59fbf880dfd622b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:28:22.257389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-2ba31dc3-6804-4662-970f-a0faf4d1874b req-6f3623dc-8e2b-4473-ba32-846da9c3fff5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f", "tag": "c6cda4fa-e9dd-438b-b410-eaed881d626f"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:28:22.263764 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c93887aa-c486-4588-8874-6090d0c6c0eb tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f" status: 200 len: 1363 microversion: 2.1 time: 0.299343 Jul 19 23:28:22.266616 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3396/6798] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:28:21 2022] GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:28:22.286752 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-2ba31dc3-6804-4662-970f-a0faf4d1874b req-6f3623dc-8e2b-4473-ba32-846da9c3fff5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:22.287258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-2ba31dc3-6804-4662-970f-a0faf4d1874b req-6f3623dc-8e2b-4473-ba32-846da9c3fff5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:22.308207 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-2ba31dc3-6804-4662-970f-a0faf4d1874b req-6f3623dc-8e2b-4473-ba32-846da9c3fff5 service nova] Creating event network-changed:c6cda4fa-e9dd-438b-b410-eaed881d626f for instance c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f on n-h1-847009-3 Jul 19 23:28:22.324019 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-2ba31dc3-6804-4662-970f-a0faf4d1874b req-6f3623dc-8e2b-4473-ba32-846da9c3fff5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061751 Jul 19 23:28:22.328965 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3403/6799] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:28:23.283192 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-67998e2b-5924-4252-b5ad-1ef7c90bd624 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:23.283946 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-67998e2b-5924-4252-b5ad-1ef7c90bd624 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:23.291209 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67998e2b-5924-4252-b5ad-1ef7c90bd624 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:23.291673 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67998e2b-5924-4252-b5ad-1ef7c90bd624 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:23.292463 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67998e2b-5924-4252-b5ad-1ef7c90bd624 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:23.292908 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-67998e2b-5924-4252-b5ad-1ef7c90bd624 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:23.429583 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-67998e2b-5924-4252-b5ad-1ef7c90bd624 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d23e30a643947ec8040a9ad564ea328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8921e8b6734f6ab59fbf880dfd622b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:28:23.437377 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-67998e2b-5924-4252-b5ad-1ef7c90bd624 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f" status: 200 len: 1363 microversion: 2.1 time: 0.158107 Jul 19 23:28:23.437959 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3397/6800] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:28:23 2022] GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:28:24.455655 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e8596752-b036-4e24-9845-6acf16c462de tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:24.456885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e8596752-b036-4e24-9845-6acf16c462de tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:24.463363 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e8596752-b036-4e24-9845-6acf16c462de tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:24.463835 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e8596752-b036-4e24-9845-6acf16c462de tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:24.464621 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e8596752-b036-4e24-9845-6acf16c462de tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:24.465081 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e8596752-b036-4e24-9845-6acf16c462de tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:24.604092 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e8596752-b036-4e24-9845-6acf16c462de tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d23e30a643947ec8040a9ad564ea328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8921e8b6734f6ab59fbf880dfd622b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:28:24.611585 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e8596752-b036-4e24-9845-6acf16c462de tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f" status: 200 len: 1363 microversion: 2.1 time: 0.161175 Jul 19 23:28:24.612266 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3404/6801] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:28:24 2022] GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:28:25.630362 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-12ea694b-67a7-4257-8f62-4e95eeb5866c tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:25.630938 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-12ea694b-67a7-4257-8f62-4e95eeb5866c tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:25.637886 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-12ea694b-67a7-4257-8f62-4e95eeb5866c tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:25.638342 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-12ea694b-67a7-4257-8f62-4e95eeb5866c tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:25.639140 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-12ea694b-67a7-4257-8f62-4e95eeb5866c tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:25.639595 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-12ea694b-67a7-4257-8f62-4e95eeb5866c tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:25.783640 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-12ea694b-67a7-4257-8f62-4e95eeb5866c tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d23e30a643947ec8040a9ad564ea328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8921e8b6734f6ab59fbf880dfd622b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:28:25.791310 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-12ea694b-67a7-4257-8f62-4e95eeb5866c tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f" status: 200 len: 1363 microversion: 2.1 time: 0.166025 Jul 19 23:28:25.791882 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3398/6802] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:28:25 2022] GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:28:26.808024 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-39daf328-388e-44c4-a68f-a3f1c18c7c4c tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:26.808668 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-39daf328-388e-44c4-a68f-a3f1c18c7c4c tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:26.815712 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39daf328-388e-44c4-a68f-a3f1c18c7c4c tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:26.816184 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39daf328-388e-44c4-a68f-a3f1c18c7c4c tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:26.816974 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39daf328-388e-44c4-a68f-a3f1c18c7c4c tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:26.817430 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39daf328-388e-44c4-a68f-a3f1c18c7c4c tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:26.948806 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-39daf328-388e-44c4-a68f-a3f1c18c7c4c tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d23e30a643947ec8040a9ad564ea328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8921e8b6734f6ab59fbf880dfd622b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:28:26.956358 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-39daf328-388e-44c4-a68f-a3f1c18c7c4c tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f" status: 200 len: 1363 microversion: 2.1 time: 0.152370 Jul 19 23:28:26.957141 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3405/6803] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:28:26 2022] GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:28:27.429854 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-5bb795ac-d742-4eaf-ac04-f76614d9f13f req-5a3e9359-751f-46e0-9aa3-555bf441a693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f", "name": "network-vif-plugged", "status": "completed", "tag": "c6cda4fa-e9dd-438b-b410-eaed881d626f"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:28:27.439573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5bb795ac-d742-4eaf-ac04-f76614d9f13f req-5a3e9359-751f-46e0-9aa3-555bf441a693 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:27.440009 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5bb795ac-d742-4eaf-ac04-f76614d9f13f req-5a3e9359-751f-46e0-9aa3-555bf441a693 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:27.452790 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-5bb795ac-d742-4eaf-ac04-f76614d9f13f req-5a3e9359-751f-46e0-9aa3-555bf441a693 service nova] Creating event network-vif-plugged:c6cda4fa-e9dd-438b-b410-eaed881d626f for instance c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f on n-h1-847009-3 Jul 19 23:28:27.458853 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-5bb795ac-d742-4eaf-ac04-f76614d9f13f req-5a3e9359-751f-46e0-9aa3-555bf441a693 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032779 Jul 19 23:28:27.459646 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3399/6804] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:28:27.974205 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c79da923-26e7-4d52-8703-e922d09df6bd tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:27.974832 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c79da923-26e7-4d52-8703-e922d09df6bd tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:27.981773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c79da923-26e7-4d52-8703-e922d09df6bd tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:27.982238 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c79da923-26e7-4d52-8703-e922d09df6bd tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:27.983015 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c79da923-26e7-4d52-8703-e922d09df6bd tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:27.983501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c79da923-26e7-4d52-8703-e922d09df6bd tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:28.113951 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c79da923-26e7-4d52-8703-e922d09df6bd tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d23e30a643947ec8040a9ad564ea328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8921e8b6734f6ab59fbf880dfd622b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:28:28.121638 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c79da923-26e7-4d52-8703-e922d09df6bd tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f" status: 200 len: 1363 microversion: 2.1 time: 0.152145 Jul 19 23:28:28.122210 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3406/6805] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:28:27 2022] GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:28:29.139391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-80cb4a98-bb13-4491-a735-0c7d30b6a64b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:29.140100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-80cb4a98-bb13-4491-a735-0c7d30b6a64b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:29.147134 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-80cb4a98-bb13-4491-a735-0c7d30b6a64b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:29.147596 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-80cb4a98-bb13-4491-a735-0c7d30b6a64b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:29.148371 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-80cb4a98-bb13-4491-a735-0c7d30b6a64b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:29.148811 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-80cb4a98-bb13-4491-a735-0c7d30b6a64b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:29.287600 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-80cb4a98-bb13-4491-a735-0c7d30b6a64b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d23e30a643947ec8040a9ad564ea328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8921e8b6734f6ab59fbf880dfd622b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:28:29.295457 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-80cb4a98-bb13-4491-a735-0c7d30b6a64b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f" status: 200 len: 1555 microversion: 2.1 time: 0.161361 Jul 19 23:28:29.296038 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3400/6806] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:28:29 2022] GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:28:29.311691 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4cce3149-1651-4494-9879-23681c266978 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:29.312328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4cce3149-1651-4494-9879-23681c266978 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:29.320235 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4cce3149-1651-4494-9879-23681c266978 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:29.320695 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4cce3149-1651-4494-9879-23681c266978 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:29.321472 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4cce3149-1651-4494-9879-23681c266978 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:29.321921 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4cce3149-1651-4494-9879-23681c266978 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:29.454825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4cce3149-1651-4494-9879-23681c266978 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d23e30a643947ec8040a9ad564ea328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8921e8b6734f6ab59fbf880dfd622b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:28:29.463128 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4cce3149-1651-4494-9879-23681c266978 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f" status: 200 len: 1555 microversion: 2.1 time: 0.155161 Jul 19 23:28:29.463721 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3407/6807] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:28:29 2022] GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:28:31.095698 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-49b1b393-3c76-47da-b8a3-c6e5d961968a tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "614e4b48-2b73-45c7-b176-6f80f9045874"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:28:31.096778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-49b1b393-3c76-47da-b8a3-c6e5d961968a tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:31.098762 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:28:31.105170 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49b1b393-3c76-47da-b8a3-c6e5d961968a tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:31.105616 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49b1b393-3c76-47da-b8a3-c6e5d961968a tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:31.106446 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49b1b393-3c76-47da-b8a3-c6e5d961968a tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:31.106880 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49b1b393-3c76-47da-b8a3-c6e5d961968a tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:31.351191 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-49b1b393-3c76-47da-b8a3-c6e5d961968a tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "POST /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259218 Jul 19 23:28:31.351813 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3401/6808] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 19 23:28:31 2022] POST /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:28:42.006141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cd1ac288-9ec6-4697-a778-ad7d553dccbf tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:42.006638 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cd1ac288-9ec6-4697-a778-ad7d553dccbf tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:42.008961 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:28:42.009809 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:28:42.010520 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:28:42.011228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=34 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:28:42.018261 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd1ac288-9ec6-4697-a778-ad7d553dccbf tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:42.018722 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd1ac288-9ec6-4697-a778-ad7d553dccbf tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:42.019539 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd1ac288-9ec6-4697-a778-ad7d553dccbf tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:42.020636 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd1ac288-9ec6-4697-a778-ad7d553dccbf tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:42.101361 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-cd1ac288-9ec6-4697-a778-ad7d553dccbf tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lazy-loading 'services' on Instance uuid c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:28:42.179328 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cd1ac288-9ec6-4697-a778-ad7d553dccbf tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f/os-volume_attachments/614e4b48-2b73-45c7-b176-6f80f9045874" status: 202 len: 0 microversion: 2.1 time: 0.177005 Jul 19 23:28:42.179936 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3408/6809] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 19 23:28:42 2022] DELETE /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f/os-volume_attachments/614e4b48-2b73-45c7-b176-6f80f9045874 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:28:42.186200 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:28:42.187170 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:28:42.191448 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-848608d8-d22d-4953-b0e6-49c7fc5e9c0c tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:42.193222 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-848608d8-d22d-4953-b0e6-49c7fc5e9c0c tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:42.201669 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-848608d8-d22d-4953-b0e6-49c7fc5e9c0c tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:42.202054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-848608d8-d22d-4953-b0e6-49c7fc5e9c0c tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:42.202814 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-848608d8-d22d-4953-b0e6-49c7fc5e9c0c tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:42.203289 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-848608d8-d22d-4953-b0e6-49c7fc5e9c0c tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:42.234444 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-848608d8-d22d-4953-b0e6-49c7fc5e9c0c tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049911 Jul 19 23:28:42.234918 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3402/6810] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:28:42 2022] GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:28:43.247778 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-89bcbced-0aa2-461e-9203-af46593edf98 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:43.248908 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-89bcbced-0aa2-461e-9203-af46593edf98 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:43.256802 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-89bcbced-0aa2-461e-9203-af46593edf98 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:43.257361 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-89bcbced-0aa2-461e-9203-af46593edf98 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:43.258236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-89bcbced-0aa2-461e-9203-af46593edf98 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:43.258752 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-89bcbced-0aa2-461e-9203-af46593edf98 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:43.292304 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-89bcbced-0aa2-461e-9203-af46593edf98 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049766 Jul 19 23:28:43.293421 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3409/6811] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:28:43 2022] GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:28:44.305246 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e4764f96-4686-42d1-86b1-fc28bd14120b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:44.306197 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e4764f96-4686-42d1-86b1-fc28bd14120b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:44.313693 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e4764f96-4686-42d1-86b1-fc28bd14120b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:44.314158 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e4764f96-4686-42d1-86b1-fc28bd14120b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:44.314990 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e4764f96-4686-42d1-86b1-fc28bd14120b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:44.315506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e4764f96-4686-42d1-86b1-fc28bd14120b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:44.351798 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e4764f96-4686-42d1-86b1-fc28bd14120b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051400 Jul 19 23:28:44.355728 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3403/6812] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:28:44 2022] GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:28:45.363165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c2c4d20b-5f72-4a39-8f44-41e7c44a1124 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:45.364867 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c2c4d20b-5f72-4a39-8f44-41e7c44a1124 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:45.372116 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c2c4d20b-5f72-4a39-8f44-41e7c44a1124 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:45.372518 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c2c4d20b-5f72-4a39-8f44-41e7c44a1124 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:45.373309 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c2c4d20b-5f72-4a39-8f44-41e7c44a1124 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:45.373759 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c2c4d20b-5f72-4a39-8f44-41e7c44a1124 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:45.405326 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c2c4d20b-5f72-4a39-8f44-41e7c44a1124 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046031 Jul 19 23:28:45.405822 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3410/6813] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:28:45 2022] GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:28:46.417511 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8fdc2b31-2815-457e-b830-90afbe09c68e tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:46.418562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8fdc2b31-2815-457e-b830-90afbe09c68e tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:46.425533 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8fdc2b31-2815-457e-b830-90afbe09c68e tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:46.426013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8fdc2b31-2815-457e-b830-90afbe09c68e tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:46.427514 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8fdc2b31-2815-457e-b830-90afbe09c68e tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:46.427963 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8fdc2b31-2815-457e-b830-90afbe09c68e tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:46.460836 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8fdc2b31-2815-457e-b830-90afbe09c68e tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047395 Jul 19 23:28:46.461678 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3404/6814] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:28:46 2022] GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:28:47.472851 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f49acbbd-d037-4d6b-aea7-7be81453fcc2 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:47.474325 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f49acbbd-d037-4d6b-aea7-7be81453fcc2 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:47.481268 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f49acbbd-d037-4d6b-aea7-7be81453fcc2 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:47.481733 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f49acbbd-d037-4d6b-aea7-7be81453fcc2 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:47.482519 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f49acbbd-d037-4d6b-aea7-7be81453fcc2 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:47.482973 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f49acbbd-d037-4d6b-aea7-7be81453fcc2 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:47.515381 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f49acbbd-d037-4d6b-aea7-7be81453fcc2 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046563 Jul 19 23:28:47.515965 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3411/6815] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:28:47 2022] GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 23:28:47.525974 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1facf1e7-3488-411e-95d9-4d8321f2a652 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:47.526470 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1facf1e7-3488-411e-95d9-4d8321f2a652 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:47.533335 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1facf1e7-3488-411e-95d9-4d8321f2a652 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:47.533789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1facf1e7-3488-411e-95d9-4d8321f2a652 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:47.534564 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1facf1e7-3488-411e-95d9-4d8321f2a652 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:47.535005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1facf1e7-3488-411e-95d9-4d8321f2a652 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:47.612104 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-1facf1e7-3488-411e-95d9-4d8321f2a652 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] HTTP exception thrown: Instance c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f is not attached to volume 614e4b48-2b73-45c7-b176-6f80f9045874 Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1facf1e7-3488-411e-95d9-4d8321f2a652 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Request method failure captured: Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f/os-volume_attachments/614e4b48-2b73-45c7-b176-6f80f9045874 HTTP/1.1 Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1z4NVST-UffqrWKBNvWTv3A-mC-VvWpPUcA3Ebfk1nOcB42CI-qlSz8lWwhm70RWA-OGgzpQ3DLQCvc_WCNT-zb4JHodajlBR9hFB4NnuA0Jlkzxtolu8664jbycmnv_9YqffXwSWA2jz4PoWq6rjPGDuFpdeC4t9EGdStSbxE3aJsE Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 1e8921e8b6734f6ab59fbf880dfd622b Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TestEncryptedCinderVolumes-656384943 Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e8921e8b6734f6ab59fbf880dfd622b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e8921e8b6734f6ab59fbf880dfd622b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e8921e8b6734f6ab59fbf880dfd622b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e8921e8b6734f6ab59fbf880dfd622b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TestEncryptedCinderVolumes-656384943 Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 1e8921e8b6734f6ab59fbf880dfd622b Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-656384943 Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TestEncryptedCinderVolumes-656384943-project Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 4d23e30a643947ec8040a9ad564ea328 Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TestEncryptedCinderVolumes-656384943-project Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f is not attached to volume 614e4b48-2b73-45c7-b176-6f80f9045874 Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'server_id': 'c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f', 'id': '614e4b48-2b73-45c7-b176-6f80f9045874'} Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 614e4b48-2b73-45c7-b176-6f80f9045874. Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f is not attached to volume 614e4b48-2b73-45c7-b176-6f80f9045874 Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:28:47.623989 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:28:47.627806 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:28:47.627806 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:28:47.627806 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f is not attached to volume 614e4b48-2b73-45c7-b176-6f80f9045874 Jul 19 23:28:47.627806 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:28:47.627806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1facf1e7-3488-411e-95d9-4d8321f2a652 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Returning 404 to user: Instance c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f is not attached to volume 614e4b48-2b73-45c7-b176-6f80f9045874 {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:28:47.627806 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1facf1e7-3488-411e-95d9-4d8321f2a652 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f/os-volume_attachments/614e4b48-2b73-45c7-b176-6f80f9045874" status: 404 len: 154 microversion: 2.1 time: 0.103666 Jul 19 23:28:47.627806 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3405/6816] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 19 23:28:47 2022] DELETE /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f/os-volume_attachments/614e4b48-2b73-45c7-b176-6f80f9045874 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:28:50.995355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9ca5abdb-e06a-4f5c-a7ad-878db1da9101 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:50.995853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9ca5abdb-e06a-4f5c-a7ad-878db1da9101 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:51.002687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ca5abdb-e06a-4f5c-a7ad-878db1da9101 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:51.003183 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ca5abdb-e06a-4f5c-a7ad-878db1da9101 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:51.003983 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ca5abdb-e06a-4f5c-a7ad-878db1da9101 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:51.004526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ca5abdb-e06a-4f5c-a7ad-878db1da9101 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:51.029926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9ca5abdb-e06a-4f5c-a7ad-878db1da9101 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:28:51.115495 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9ca5abdb-e06a-4f5c-a7ad-878db1da9101 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f" status: 204 len: 0 microversion: 2.1 time: 0.122965 Jul 19 23:28:51.116103 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3412/6817] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:28:50 2022] DELETE /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:28:51.124460 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4a0da479-ca87-4956-a6db-1b3f4165e176 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:51.125074 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4a0da479-ca87-4956-a6db-1b3f4165e176 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:51.133312 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4a0da479-ca87-4956-a6db-1b3f4165e176 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:51.133747 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4a0da479-ca87-4956-a6db-1b3f4165e176 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:51.134524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4a0da479-ca87-4956-a6db-1b3f4165e176 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:51.134960 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4a0da479-ca87-4956-a6db-1b3f4165e176 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:51.274283 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4a0da479-ca87-4956-a6db-1b3f4165e176 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d23e30a643947ec8040a9ad564ea328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8921e8b6734f6ab59fbf880dfd622b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:28:51.282229 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4a0da479-ca87-4956-a6db-1b3f4165e176 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f" status: 200 len: 1561 microversion: 2.1 time: 0.161720 Jul 19 23:28:51.282805 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3406/6818] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:28:51 2022] GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:28:52.300374 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-67673eba-9842-4186-bec7-20c2eadfd9de tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:52.301409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-67673eba-9842-4186-bec7-20c2eadfd9de tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:52.308320 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67673eba-9842-4186-bec7-20c2eadfd9de tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:52.308789 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67673eba-9842-4186-bec7-20c2eadfd9de tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:52.309569 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67673eba-9842-4186-bec7-20c2eadfd9de tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:52.310022 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67673eba-9842-4186-bec7-20c2eadfd9de tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:52.443381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-67673eba-9842-4186-bec7-20c2eadfd9de tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d23e30a643947ec8040a9ad564ea328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8921e8b6734f6ab59fbf880dfd622b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:28:52.451383 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-67673eba-9842-4186-bec7-20c2eadfd9de tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f" status: 200 len: 1561 microversion: 2.1 time: 0.155247 Jul 19 23:28:52.451967 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3413/6819] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:28:52 2022] GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:28:53.378316 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-bd2a9d04-2b5b-43ea-add5-21667931738e req-b852ebda-d0d1-44f2-943a-252832fcefe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f", "name": "network-vif-deleted", "tag": "c6cda4fa-e9dd-438b-b410-eaed881d626f"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:28:53.389792 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-bd2a9d04-2b5b-43ea-add5-21667931738e req-b852ebda-d0d1-44f2-943a-252832fcefe1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:53.390248 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-bd2a9d04-2b5b-43ea-add5-21667931738e req-b852ebda-d0d1-44f2-943a-252832fcefe1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:53.403736 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-bd2a9d04-2b5b-43ea-add5-21667931738e req-b852ebda-d0d1-44f2-943a-252832fcefe1 service nova] Creating event network-vif-deleted:c6cda4fa-e9dd-438b-b410-eaed881d626f for instance c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f on n-h1-847009-3 Jul 19 23:28:53.409375 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-bd2a9d04-2b5b-43ea-add5-21667931738e req-b852ebda-d0d1-44f2-943a-252832fcefe1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102067 Jul 19 23:28:53.410458 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3407/6820] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:28:53.469046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dcf1f032-4c48-4c83-b85f-018aaccbf2d3 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:53.469715 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dcf1f032-4c48-4c83-b85f-018aaccbf2d3 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:53.477427 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dcf1f032-4c48-4c83-b85f-018aaccbf2d3 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:53.477891 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dcf1f032-4c48-4c83-b85f-018aaccbf2d3 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:53.478674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dcf1f032-4c48-4c83-b85f-018aaccbf2d3 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:53.479188 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dcf1f032-4c48-4c83-b85f-018aaccbf2d3 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:53.512480 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dcf1f032-4c48-4c83-b85f-018aaccbf2d3 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:53.512866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dcf1f032-4c48-4c83-b85f-018aaccbf2d3 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:53.513361 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-dcf1f032-4c48-4c83-b85f-018aaccbf2d3 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lazy-loading 'fault' on Instance uuid c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:28:53.554501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dcf1f032-4c48-4c83-b85f-018aaccbf2d3 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d23e30a643947ec8040a9ad564ea328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8921e8b6734f6ab59fbf880dfd622b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:28:53.562071 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dcf1f032-4c48-4c83-b85f-018aaccbf2d3 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f" status: 200 len: 1353 microversion: 2.1 time: 0.097148 Jul 19 23:28:53.562643 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3414/6821] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:28:53 2022] GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f => generated 1353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:28:54.581328 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-445b1a43-eda8-4a7f-84c2-757e0f09c9ef tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:54.582050 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-445b1a43-eda8-4a7f-84c2-757e0f09c9ef tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:54.588435 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-445b1a43-eda8-4a7f-84c2-757e0f09c9ef tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:54.588883 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-445b1a43-eda8-4a7f-84c2-757e0f09c9ef tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:54.589640 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-445b1a43-eda8-4a7f-84c2-757e0f09c9ef tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:54.590075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-445b1a43-eda8-4a7f-84c2-757e0f09c9ef tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:54.603938 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-445b1a43-eda8-4a7f-84c2-757e0f09c9ef tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] HTTP exception thrown: Instance c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f could not be found. Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-445b1a43-eda8-4a7f-84c2-757e0f09c9ef tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Request method failure captured: Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f HTTP/1.1 Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1z4NVST-UffqrWKBNvWTv3A-mC-VvWpPUcA3Ebfk1nOcB42CI-qlSz8lWwhm70RWA-OGgzpQ3DLQCvc_WCNT-zb4JHodajlBR9hFB4NnuA0Jlkzxtolu8664jbycmnv_9YqffXwSWA2jz4PoWq6rjPGDuFpdeC4t9EGdStSbxE3aJsE Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 1e8921e8b6734f6ab59fbf880dfd622b Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TestEncryptedCinderVolumes-656384943 Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e8921e8b6734f6ab59fbf880dfd622b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e8921e8b6734f6ab59fbf880dfd622b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e8921e8b6734f6ab59fbf880dfd622b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e8921e8b6734f6ab59fbf880dfd622b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TestEncryptedCinderVolumes-656384943 Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 1e8921e8b6734f6ab59fbf880dfd622b Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-656384943 Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TestEncryptedCinderVolumes-656384943-project Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 4d23e30a643947ec8040a9ad564ea328 Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TestEncryptedCinderVolumes-656384943-project Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f could not be found. Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': 'c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f'} Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f could not be found. Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f could not be found. Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:28:54.605552 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:28:54.609427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:28:54.609427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:28:54.609427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:28:54.609427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:28:54.609427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:28:54.609427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f could not be found. Jul 19 23:28:54.609427 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:28:54.609427 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-445b1a43-eda8-4a7f-84c2-757e0f09c9ef tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Returning 404 to user: Instance c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:28:54.609427 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-445b1a43-eda8-4a7f-84c2-757e0f09c9ef tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f" status: 404 len: 111 microversion: 2.1 time: 0.030715 Jul 19 23:28:54.609427 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3408/6822] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:28:54 2022] GET /compute/v2.1/servers/c8ceac50-f30e-4fe9-b6c3-1e19449ecf0f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:28:54.616537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-577c6797-e36f-4ee7-894e-70518ca472cb tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '.version_select at 0x7f7a1559dee0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:54.634948 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-577c6797-e36f-4ee7-894e-70518ca472cb tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1904676746" status: 202 len: 0 microversion: 2.1 time: 0.022954 Jul 19 23:28:54.635553 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3415/6823] 10.222.0.25 () {58 vars in 1277 bytes} [Tue Jul 19 23:28:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1904676746 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:28:54.652211 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8290f567-00ef-40bd-a5fc-4c3207600c02 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Action: 'create', calling method: .version_select at 0x7f7a15569d30>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-58366604", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfRwt10NmTvG8hkOaWAIGxiS1jvrJmZZFlBAKCCaJRVaX9Uu1DG5Z3vzPMik3VHvRG63xNeivfujCy6AyrEga4RUAxA9HGacJmlYPZq/JZCMzoeATY+rhaIvkkHegyyvA=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:28:54.667207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-8290f567-00ef-40bd-a5fc-4c3207600c02 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Getting quotas for project 1e8921e8b6734f6ab59fbf880dfd622b. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:28:54.672297 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-8290f567-00ef-40bd-a5fc-4c3207600c02 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Getting quotas for user 4d23e30a643947ec8040a9ad564ea328 and project 1e8921e8b6734f6ab59fbf880dfd622b. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:28:54.695550 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8290f567-00ef-40bd-a5fc-4c3207600c02 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.047307 Jul 19 23:28:54.696154 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3409/6824] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 23:28:54 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:28:54.744958 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8a101f24-a940-4935-8d85-efc6d1ad1aca tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1352439803", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-58366604", "networks": [{"uuid": "6bfaa678-c966-4567-8104-72d8031a6435"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:28:54.800411 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-8a101f24-a940-4935-8d85-efc6d1ad1aca tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] validate_networks() for [('6bfaa678-c966-4567-8104-72d8031a6435', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:28:55.184476 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-8a101f24-a940-4935-8d85-efc6d1ad1aca tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:28:55.184921 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-8a101f24-a940-4935-8d85-efc6d1ad1aca tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:28:55.185408 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-8a101f24-a940-4935-8d85-efc6d1ad1aca tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:28:55.185829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-8a101f24-a940-4935-8d85-efc6d1ad1aca tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:28:55.186255 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-8a101f24-a940-4935-8d85-efc6d1ad1aca tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:28:55.197283 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a101f24-a940-4935-8d85-efc6d1ad1aca tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:55.197748 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a101f24-a940-4935-8d85-efc6d1ad1aca tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:55.198809 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a101f24-a940-4935-8d85-efc6d1ad1aca tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:55.199290 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a101f24-a940-4935-8d85-efc6d1ad1aca tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:55.217841 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-8a101f24-a940-4935-8d85-efc6d1ad1aca tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Getting quotas for project 1e8921e8b6734f6ab59fbf880dfd622b. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:28:55.223616 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-8a101f24-a940-4935-8d85-efc6d1ad1aca tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Getting quotas for user 4d23e30a643947ec8040a9ad564ea328 and project 1e8921e8b6734f6ab59fbf880dfd622b. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:28:55.235908 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8a101f24-a940-4935-8d85-efc6d1ad1aca tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:28:55.238222 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8a101f24-a940-4935-8d85-efc6d1ad1aca tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:28:55.284300 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8a101f24-a940-4935-8d85-efc6d1ad1aca tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543114 Jul 19 23:28:55.284971 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3416/6825] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:28:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:28:55.294826 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e5ae88db-a684-4229-be67-091585203984 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:55.295477 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e5ae88db-a684-4229-be67-091585203984 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:55.353071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e5ae88db-a684-4229-be67-091585203984 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d23e30a643947ec8040a9ad564ea328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8921e8b6734f6ab59fbf880dfd622b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:28:55.360741 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e5ae88db-a684-4229-be67-091585203984 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770" status: 200 len: 1261 microversion: 2.1 time: 0.069788 Jul 19 23:28:55.361307 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3410/6826] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:28:55 2022] GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 => generated 1261 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:28:56.378684 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2fd1853b-bbbd-418b-ad76-78966a4a3f79 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:56.380003 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2fd1853b-bbbd-418b-ad76-78966a4a3f79 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:56.389367 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fd1853b-bbbd-418b-ad76-78966a4a3f79 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:56.389842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fd1853b-bbbd-418b-ad76-78966a4a3f79 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:56.390644 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fd1853b-bbbd-418b-ad76-78966a4a3f79 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:56.391102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2fd1853b-bbbd-418b-ad76-78966a4a3f79 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:56.460533 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2fd1853b-bbbd-418b-ad76-78966a4a3f79 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d23e30a643947ec8040a9ad564ea328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8921e8b6734f6ab59fbf880dfd622b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:28:56.468690 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2fd1853b-bbbd-418b-ad76-78966a4a3f79 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770" status: 200 len: 1331 microversion: 2.1 time: 0.094254 Jul 19 23:28:56.469286 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3417/6827] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:28:56 2022] GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:28:57.486862 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3c8976ea-3937-438f-9b17-8d4c6f3774d7 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:57.488278 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3c8976ea-3937-438f-9b17-8d4c6f3774d7 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:57.499075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3c8976ea-3937-438f-9b17-8d4c6f3774d7 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:57.499568 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3c8976ea-3937-438f-9b17-8d4c6f3774d7 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:57.500386 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3c8976ea-3937-438f-9b17-8d4c6f3774d7 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:57.500999 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3c8976ea-3937-438f-9b17-8d4c6f3774d7 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:57.646007 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3c8976ea-3937-438f-9b17-8d4c6f3774d7 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d23e30a643947ec8040a9ad564ea328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8921e8b6734f6ab59fbf880dfd622b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:28:57.654289 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3c8976ea-3937-438f-9b17-8d4c6f3774d7 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770" status: 200 len: 1361 microversion: 2.1 time: 0.171432 Jul 19 23:28:57.655211 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3411/6828] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:28:57 2022] GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:28:57.802452 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-42ec5e25-280c-41de-9330-9407f286b42e req-07758f29-15fe-4e84-994f-9581632bbcd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770", "tag": "2bd595e8-b1be-4d11-826c-1702ee5ec51d"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:28:57.824256 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-42ec5e25-280c-41de-9330-9407f286b42e req-07758f29-15fe-4e84-994f-9581632bbcd8 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:57.824849 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-42ec5e25-280c-41de-9330-9407f286b42e req-07758f29-15fe-4e84-994f-9581632bbcd8 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:57.845009 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-42ec5e25-280c-41de-9330-9407f286b42e req-07758f29-15fe-4e84-994f-9581632bbcd8 service nova] Creating event network-changed:2bd595e8-b1be-4d11-826c-1702ee5ec51d for instance e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 on n-h2-847009-3 Jul 19 23:28:57.851588 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-42ec5e25-280c-41de-9330-9407f286b42e req-07758f29-15fe-4e84-994f-9581632bbcd8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131732 Jul 19 23:28:57.852380 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3418/6829] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:28:58.671418 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-33cccdd9-6338-4471-8008-67b1290d9780 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:58.672335 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-33cccdd9-6338-4471-8008-67b1290d9780 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:58.680139 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-33cccdd9-6338-4471-8008-67b1290d9780 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:58.680609 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-33cccdd9-6338-4471-8008-67b1290d9780 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:58.681380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-33cccdd9-6338-4471-8008-67b1290d9780 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:58.681839 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-33cccdd9-6338-4471-8008-67b1290d9780 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:58.821447 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-33cccdd9-6338-4471-8008-67b1290d9780 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d23e30a643947ec8040a9ad564ea328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8921e8b6734f6ab59fbf880dfd622b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:28:58.829589 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-33cccdd9-6338-4471-8008-67b1290d9780 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770" status: 200 len: 1361 microversion: 2.1 time: 0.162153 Jul 19 23:28:58.830184 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3412/6830] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:28:58 2022] GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:28:59.847751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f69ad65a-2d93-442f-919d-b108cffa41df tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:28:59.848655 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f69ad65a-2d93-442f-919d-b108cffa41df tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:28:59.855324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f69ad65a-2d93-442f-919d-b108cffa41df tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:59.855791 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f69ad65a-2d93-442f-919d-b108cffa41df tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:59.856574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f69ad65a-2d93-442f-919d-b108cffa41df tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:28:59.857021 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f69ad65a-2d93-442f-919d-b108cffa41df tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:28:59.992141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f69ad65a-2d93-442f-919d-b108cffa41df tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d23e30a643947ec8040a9ad564ea328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8921e8b6734f6ab59fbf880dfd622b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:28:59.999667 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f69ad65a-2d93-442f-919d-b108cffa41df tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770" status: 200 len: 1361 microversion: 2.1 time: 0.157156 Jul 19 23:29:00.000238 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3419/6831] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:28:59 2022] GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:29:01.017242 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4931bf88-db93-4594-85b0-545e75c69f5b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:29:01.017868 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4931bf88-db93-4594-85b0-545e75c69f5b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:29:01.025846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4931bf88-db93-4594-85b0-545e75c69f5b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:01.026303 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4931bf88-db93-4594-85b0-545e75c69f5b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:01.027094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4931bf88-db93-4594-85b0-545e75c69f5b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:01.027643 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4931bf88-db93-4594-85b0-545e75c69f5b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:01.166446 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4931bf88-db93-4594-85b0-545e75c69f5b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d23e30a643947ec8040a9ad564ea328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8921e8b6734f6ab59fbf880dfd622b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:29:01.174027 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4931bf88-db93-4594-85b0-545e75c69f5b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770" status: 200 len: 1361 microversion: 2.1 time: 0.160658 Jul 19 23:29:01.174554 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3413/6832] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:29:01 2022] GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:29:02.190972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8cfda662-e0a1-477d-8dca-b6b434568fd6 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:29:02.191818 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8cfda662-e0a1-477d-8dca-b6b434568fd6 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:29:02.199313 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8cfda662-e0a1-477d-8dca-b6b434568fd6 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:02.199783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8cfda662-e0a1-477d-8dca-b6b434568fd6 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:02.200569 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8cfda662-e0a1-477d-8dca-b6b434568fd6 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:02.201022 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8cfda662-e0a1-477d-8dca-b6b434568fd6 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:02.332620 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8cfda662-e0a1-477d-8dca-b6b434568fd6 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d23e30a643947ec8040a9ad564ea328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8921e8b6734f6ab59fbf880dfd622b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:29:02.340193 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8cfda662-e0a1-477d-8dca-b6b434568fd6 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770" status: 200 len: 1361 microversion: 2.1 time: 0.153330 Jul 19 23:29:02.340768 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3420/6833] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:29:02 2022] GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:29:02.886959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-783de2c6-aa09-4303-81c9-7ccf463931e9 req-38a5c362-bc8c-4e70-a9cd-7521a663a413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770", "name": "network-vif-plugged", "status": "completed", "tag": "2bd595e8-b1be-4d11-826c-1702ee5ec51d"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:29:02.895394 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-783de2c6-aa09-4303-81c9-7ccf463931e9 req-38a5c362-bc8c-4e70-a9cd-7521a663a413 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:02.896426 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-783de2c6-aa09-4303-81c9-7ccf463931e9 req-38a5c362-bc8c-4e70-a9cd-7521a663a413 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:02.907060 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-783de2c6-aa09-4303-81c9-7ccf463931e9 req-38a5c362-bc8c-4e70-a9cd-7521a663a413 service nova] Creating event network-vif-plugged:2bd595e8-b1be-4d11-826c-1702ee5ec51d for instance e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 on n-h2-847009-3 Jul 19 23:29:02.912715 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-783de2c6-aa09-4303-81c9-7ccf463931e9 req-38a5c362-bc8c-4e70-a9cd-7521a663a413 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087975 Jul 19 23:29:02.913430 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3414/6834] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:29:03.356916 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4264894a-90ef-4bb4-ad4c-13eced80dfa0 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:29:03.357546 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4264894a-90ef-4bb4-ad4c-13eced80dfa0 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:29:03.364549 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4264894a-90ef-4bb4-ad4c-13eced80dfa0 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:03.365153 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4264894a-90ef-4bb4-ad4c-13eced80dfa0 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:03.365949 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4264894a-90ef-4bb4-ad4c-13eced80dfa0 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:03.366392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4264894a-90ef-4bb4-ad4c-13eced80dfa0 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:03.502731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4264894a-90ef-4bb4-ad4c-13eced80dfa0 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d23e30a643947ec8040a9ad564ea328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8921e8b6734f6ab59fbf880dfd622b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:29:03.511333 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4264894a-90ef-4bb4-ad4c-13eced80dfa0 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770" status: 200 len: 1361 microversion: 2.1 time: 0.158144 Jul 19 23:29:03.511918 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3421/6835] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:29:03 2022] GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:29:04.529662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b2e34bd1-fb45-4269-9a6a-8b79ecd37de5 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:29:04.530425 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b2e34bd1-fb45-4269-9a6a-8b79ecd37de5 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:29:04.538139 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b2e34bd1-fb45-4269-9a6a-8b79ecd37de5 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:04.538823 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b2e34bd1-fb45-4269-9a6a-8b79ecd37de5 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:04.540041 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b2e34bd1-fb45-4269-9a6a-8b79ecd37de5 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:04.540761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b2e34bd1-fb45-4269-9a6a-8b79ecd37de5 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:04.672229 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b2e34bd1-fb45-4269-9a6a-8b79ecd37de5 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d23e30a643947ec8040a9ad564ea328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8921e8b6734f6ab59fbf880dfd622b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:29:04.680496 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b2e34bd1-fb45-4269-9a6a-8b79ecd37de5 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770" status: 200 len: 1552 microversion: 2.1 time: 0.156024 Jul 19 23:29:04.681072 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3415/6836] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:29:04 2022] GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:29:04.696500 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a5e3cd2d-46a3-4b51-ac3c-3fabe4ecf2ad tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:29:04.697176 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a5e3cd2d-46a3-4b51-ac3c-3fabe4ecf2ad tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:29:04.704169 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5e3cd2d-46a3-4b51-ac3c-3fabe4ecf2ad tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:04.704636 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5e3cd2d-46a3-4b51-ac3c-3fabe4ecf2ad tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:04.705419 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5e3cd2d-46a3-4b51-ac3c-3fabe4ecf2ad tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:04.705874 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5e3cd2d-46a3-4b51-ac3c-3fabe4ecf2ad tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:04.840179 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a5e3cd2d-46a3-4b51-ac3c-3fabe4ecf2ad tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d23e30a643947ec8040a9ad564ea328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8921e8b6734f6ab59fbf880dfd622b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:29:04.847602 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a5e3cd2d-46a3-4b51-ac3c-3fabe4ecf2ad tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770" status: 200 len: 1552 microversion: 2.1 time: 0.155070 Jul 19 23:29:04.848287 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3422/6837] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:29:04 2022] GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:29:06.322534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a844f5b6-4ae6-405d-aef6-2644d3b72dae tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "799cb716-bb34-46c4-97a1-9cdcfc57a726"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:29:06.323929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a844f5b6-4ae6-405d-aef6-2644d3b72dae tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:29:06.326964 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:29:06.331960 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a844f5b6-4ae6-405d-aef6-2644d3b72dae tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:06.332413 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a844f5b6-4ae6-405d-aef6-2644d3b72dae tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:06.333376 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a844f5b6-4ae6-405d-aef6-2644d3b72dae tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:06.334529 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a844f5b6-4ae6-405d-aef6-2644d3b72dae tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:06.572578 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a844f5b6-4ae6-405d-aef6-2644d3b72dae tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "POST /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254747 Jul 19 23:29:06.578092 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3416/6838] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 19 23:29:06 2022] POST /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:29:17.240854 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eb11d961-dcce-41de-b1bb-1c4b33b85b3b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:29:17.241441 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eb11d961-dcce-41de-b1bb-1c4b33b85b3b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:29:17.243433 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:29:17.244112 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:29:17.245311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:29:17.245929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:29:17.252842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb11d961-dcce-41de-b1bb-1c4b33b85b3b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:17.253309 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb11d961-dcce-41de-b1bb-1c4b33b85b3b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:17.254126 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb11d961-dcce-41de-b1bb-1c4b33b85b3b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:17.254557 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eb11d961-dcce-41de-b1bb-1c4b33b85b3b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:17.357640 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-eb11d961-dcce-41de-b1bb-1c4b33b85b3b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lazy-loading 'services' on Instance uuid e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:29:17.440364 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eb11d961-dcce-41de-b1bb-1c4b33b85b3b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770/os-volume_attachments/799cb716-bb34-46c4-97a1-9cdcfc57a726" status: 202 len: 0 microversion: 2.1 time: 0.204126 Jul 19 23:29:17.441061 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3423/6839] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 19 23:29:17 2022] DELETE /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770/os-volume_attachments/799cb716-bb34-46c4-97a1-9cdcfc57a726 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 23:29:17.448934 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:29:17.449773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:29:17.454767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2dc3f880-6c23-4684-bbbf-26212208782a tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:29:17.455933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2dc3f880-6c23-4684-bbbf-26212208782a tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:29:17.467323 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2dc3f880-6c23-4684-bbbf-26212208782a tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:17.467934 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2dc3f880-6c23-4684-bbbf-26212208782a tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:17.468744 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2dc3f880-6c23-4684-bbbf-26212208782a tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:17.469187 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2dc3f880-6c23-4684-bbbf-26212208782a tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:17.518115 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2dc3f880-6c23-4684-bbbf-26212208782a tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071359 Jul 19 23:29:17.522809 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3417/6840] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:29:17 2022] GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:29:18.530613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9e816704-5c54-49bd-a048-f823a40f40df tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:29:18.531731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9e816704-5c54-49bd-a048-f823a40f40df tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:29:18.540170 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9e816704-5c54-49bd-a048-f823a40f40df tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:18.540752 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9e816704-5c54-49bd-a048-f823a40f40df tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:18.541240 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9e816704-5c54-49bd-a048-f823a40f40df tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:18.541685 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9e816704-5c54-49bd-a048-f823a40f40df tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:18.573311 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9e816704-5c54-49bd-a048-f823a40f40df tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046809 Jul 19 23:29:18.574028 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3424/6841] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:29:18 2022] GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:29:19.585451 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3e58ca0b-7403-4abb-a0be-7ee4271d191d tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:29:19.586466 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3e58ca0b-7403-4abb-a0be-7ee4271d191d tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:29:19.593849 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e58ca0b-7403-4abb-a0be-7ee4271d191d tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:19.594470 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e58ca0b-7403-4abb-a0be-7ee4271d191d tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:19.595471 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e58ca0b-7403-4abb-a0be-7ee4271d191d tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:19.595918 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3e58ca0b-7403-4abb-a0be-7ee4271d191d tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:19.629320 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3e58ca0b-7403-4abb-a0be-7ee4271d191d tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048142 Jul 19 23:29:19.630727 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3418/6842] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:29:19 2022] GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:29:20.643664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c7aa154f-101b-49b0-8222-e17fff93aec0 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:29:20.644732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c7aa154f-101b-49b0-8222-e17fff93aec0 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:29:20.652194 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c7aa154f-101b-49b0-8222-e17fff93aec0 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:20.652655 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c7aa154f-101b-49b0-8222-e17fff93aec0 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:20.653444 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c7aa154f-101b-49b0-8222-e17fff93aec0 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:20.653896 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c7aa154f-101b-49b0-8222-e17fff93aec0 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:20.684504 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c7aa154f-101b-49b0-8222-e17fff93aec0 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044862 Jul 19 23:29:20.685085 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3425/6843] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:29:20 2022] GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:29:21.696602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-31b4aeae-7aea-4376-9299-6ed500b3f3da tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:29:21.697550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-31b4aeae-7aea-4376-9299-6ed500b3f3da tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:29:21.704894 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31b4aeae-7aea-4376-9299-6ed500b3f3da tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:21.705359 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31b4aeae-7aea-4376-9299-6ed500b3f3da tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:21.706139 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31b4aeae-7aea-4376-9299-6ed500b3f3da tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:21.706579 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31b4aeae-7aea-4376-9299-6ed500b3f3da tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:21.737913 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-31b4aeae-7aea-4376-9299-6ed500b3f3da tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045648 Jul 19 23:29:21.738493 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3419/6844] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:29:21 2022] GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:29:22.751132 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-82c09213-e92d-4a65-a26e-716a8d91fc01 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:29:22.752094 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-82c09213-e92d-4a65-a26e-716a8d91fc01 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:29:22.760136 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-82c09213-e92d-4a65-a26e-716a8d91fc01 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:22.760602 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-82c09213-e92d-4a65-a26e-716a8d91fc01 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:22.761394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-82c09213-e92d-4a65-a26e-716a8d91fc01 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:22.761848 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-82c09213-e92d-4a65-a26e-716a8d91fc01 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:22.793600 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-82c09213-e92d-4a65-a26e-716a8d91fc01 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046435 Jul 19 23:29:22.794179 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3426/6845] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:29:22 2022] GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 23:29:22.804213 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8257d28b-6b47-43ca-8522-c22c83d5ea1f tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:29:22.804724 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8257d28b-6b47-43ca-8522-c22c83d5ea1f tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:29:22.811424 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8257d28b-6b47-43ca-8522-c22c83d5ea1f tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:22.811942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8257d28b-6b47-43ca-8522-c22c83d5ea1f tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:22.812740 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8257d28b-6b47-43ca-8522-c22c83d5ea1f tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:22.813158 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8257d28b-6b47-43ca-8522-c22c83d5ea1f tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:22.893308 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-8257d28b-6b47-43ca-8522-c22c83d5ea1f tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] HTTP exception thrown: Instance e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 is not attached to volume 799cb716-bb34-46c4-97a1-9cdcfc57a726 Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8257d28b-6b47-43ca-8522-c22c83d5ea1f tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Request method failure captured: Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770/os-volume_attachments/799cb716-bb34-46c4-97a1-9cdcfc57a726 HTTP/1.1 Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1z4NVST-UffqrWKBNvWTv3A-mC-VvWpPUcA3Ebfk1nOcB42CI-qlSz8lWwhm70RWA-OGgzpQ3DLQCvc_WCNT-zb4JHodajlBR9hFB4NnuA0Jlkzxtolu8664jbycmnv_9YqffXwSWA2jz4PoWq6rjPGDuFpdeC4t9EGdStSbxE3aJsE Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 1e8921e8b6734f6ab59fbf880dfd622b Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TestEncryptedCinderVolumes-656384943 Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e8921e8b6734f6ab59fbf880dfd622b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e8921e8b6734f6ab59fbf880dfd622b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e8921e8b6734f6ab59fbf880dfd622b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e8921e8b6734f6ab59fbf880dfd622b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TestEncryptedCinderVolumes-656384943 Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 1e8921e8b6734f6ab59fbf880dfd622b Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-656384943 Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TestEncryptedCinderVolumes-656384943-project Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: 4d23e30a643947ec8040a9ad564ea328 Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TestEncryptedCinderVolumes-656384943-project Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 is not attached to volume 799cb716-bb34-46c4-97a1-9cdcfc57a726 Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'server_id': 'e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770', 'id': '799cb716-bb34-46c4-97a1-9cdcfc57a726'} Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 799cb716-bb34-46c4-97a1-9cdcfc57a726. Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 is not attached to volume 799cb716-bb34-46c4-97a1-9cdcfc57a726 Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:29:22.894927 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:29:22.898833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:29:22.898833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:29:22.898833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 is not attached to volume 799cb716-bb34-46c4-97a1-9cdcfc57a726 Jul 19 23:29:22.898833 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:29:22.898833 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8257d28b-6b47-43ca-8522-c22c83d5ea1f tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Returning 404 to user: Instance e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 is not attached to volume 799cb716-bb34-46c4-97a1-9cdcfc57a726 {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:29:22.898833 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8257d28b-6b47-43ca-8522-c22c83d5ea1f tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770/os-volume_attachments/799cb716-bb34-46c4-97a1-9cdcfc57a726" status: 404 len: 154 microversion: 2.1 time: 0.096674 Jul 19 23:29:22.898833 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3420/6846] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 19 23:29:22 2022] DELETE /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770/os-volume_attachments/799cb716-bb34-46c4-97a1-9cdcfc57a726 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:29:26.240219 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e6b4c49e-3c82-413c-9502-b2c13fd6e605 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:29:26.240760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e6b4c49e-3c82-413c-9502-b2c13fd6e605 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:29:26.247687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6b4c49e-3c82-413c-9502-b2c13fd6e605 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:26.248164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6b4c49e-3c82-413c-9502-b2c13fd6e605 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:26.248964 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6b4c49e-3c82-413c-9502-b2c13fd6e605 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:26.249423 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6b4c49e-3c82-413c-9502-b2c13fd6e605 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:26.276684 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e6b4c49e-3c82-413c-9502-b2c13fd6e605 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:29:26.359676 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e6b4c49e-3c82-413c-9502-b2c13fd6e605 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770" status: 204 len: 0 microversion: 2.1 time: 0.123725 Jul 19 23:29:26.360278 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3427/6847] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:29:26 2022] DELETE /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:29:26.369174 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-88cd00c6-3b50-45f0-86ff-c3e5ffb6fef6 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:29:26.370021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-88cd00c6-3b50-45f0-86ff-c3e5ffb6fef6 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:29:26.377118 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-88cd00c6-3b50-45f0-86ff-c3e5ffb6fef6 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:26.377555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-88cd00c6-3b50-45f0-86ff-c3e5ffb6fef6 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:26.378339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-88cd00c6-3b50-45f0-86ff-c3e5ffb6fef6 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:26.378775 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-88cd00c6-3b50-45f0-86ff-c3e5ffb6fef6 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:26.541301 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-88cd00c6-3b50-45f0-86ff-c3e5ffb6fef6 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d23e30a643947ec8040a9ad564ea328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8921e8b6734f6ab59fbf880dfd622b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:29:26.549824 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-88cd00c6-3b50-45f0-86ff-c3e5ffb6fef6 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770" status: 200 len: 1558 microversion: 2.1 time: 0.184385 Jul 19 23:29:26.550659 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3421/6848] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:29:26 2022] GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 => generated 1558 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:29:27.569731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-901101fc-3b52-46bf-b2c5-5c8b56d2cd1d tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:29:27.570457 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-901101fc-3b52-46bf-b2c5-5c8b56d2cd1d tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:29:27.578262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-901101fc-3b52-46bf-b2c5-5c8b56d2cd1d tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:27.578724 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-901101fc-3b52-46bf-b2c5-5c8b56d2cd1d tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:27.579555 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-901101fc-3b52-46bf-b2c5-5c8b56d2cd1d tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:27.580007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-901101fc-3b52-46bf-b2c5-5c8b56d2cd1d tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:27.732211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-901101fc-3b52-46bf-b2c5-5c8b56d2cd1d tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d23e30a643947ec8040a9ad564ea328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8921e8b6734f6ab59fbf880dfd622b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:29:27.741172 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-901101fc-3b52-46bf-b2c5-5c8b56d2cd1d tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770" status: 200 len: 1558 microversion: 2.1 time: 0.176720 Jul 19 23:29:27.741781 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3428/6849] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:29:27 2022] GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:29:28.759717 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-04342866-6306-4da5-8a35-9fa6a6b617c6 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:29:28.760332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-04342866-6306-4da5-8a35-9fa6a6b617c6 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:29:28.769026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04342866-6306-4da5-8a35-9fa6a6b617c6 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:28.769391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04342866-6306-4da5-8a35-9fa6a6b617c6 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:28.770962 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04342866-6306-4da5-8a35-9fa6a6b617c6 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:28.771629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-04342866-6306-4da5-8a35-9fa6a6b617c6 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:28.815581 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-e3d60282-82f3-4a0f-9728-b1083c31df81 req-fdad1a5f-e9a4-4b2f-82f8-a9563f0e23ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770", "name": "network-vif-deleted", "tag": "2bd595e8-b1be-4d11-826c-1702ee5ec51d"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:29:28.827139 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e3d60282-82f3-4a0f-9728-b1083c31df81 req-fdad1a5f-e9a4-4b2f-82f8-a9563f0e23ee service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:28.827620 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-e3d60282-82f3-4a0f-9728-b1083c31df81 req-fdad1a5f-e9a4-4b2f-82f8-a9563f0e23ee service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:28.843427 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-e3d60282-82f3-4a0f-9728-b1083c31df81 req-fdad1a5f-e9a4-4b2f-82f8-a9563f0e23ee service nova] Creating event network-vif-deleted:2bd595e8-b1be-4d11-826c-1702ee5ec51d for instance e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 on n-h2-847009-3 Jul 19 23:29:28.851850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-04342866-6306-4da5-8a35-9fa6a6b617c6 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d23e30a643947ec8040a9ad564ea328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8921e8b6734f6ab59fbf880dfd622b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:29:28.853172 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-e3d60282-82f3-4a0f-9728-b1083c31df81 req-fdad1a5f-e9a4-4b2f-82f8-a9563f0e23ee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042475 Jul 19 23:29:28.854309 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3429/6850] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:29:28.867226 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-04342866-6306-4da5-8a35-9fa6a6b617c6 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770" status: 200 len: 1516 microversion: 2.1 time: 0.111340 Jul 19 23:29:28.868190 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3422/6851] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:29:28 2022] GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 => generated 1516 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:29:29.885650 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-14d7ff8b-99e0-4904-b506-dab3381f6e4b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:29:29.886378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-14d7ff8b-99e0-4904-b506-dab3381f6e4b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] [instance: e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:29:29.892656 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14d7ff8b-99e0-4904-b506-dab3381f6e4b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:29.893123 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14d7ff8b-99e0-4904-b506-dab3381f6e4b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:29.893902 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14d7ff8b-99e0-4904-b506-dab3381f6e4b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:29.894357 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14d7ff8b-99e0-4904-b506-dab3381f6e4b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:29.907428 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-14d7ff8b-99e0-4904-b506-dab3381f6e4b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] HTTP exception thrown: Instance e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 could not be found. Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-14d7ff8b-99e0-4904-b506-dab3381f6e4b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Request method failure captured: Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 HTTP/1.1 Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1z4NVST-UffqrWKBNvWTv3A-mC-VvWpPUcA3Ebfk1nOcB42CI-qlSz8lWwhm70RWA-OGgzpQ3DLQCvc_WCNT-zb4JHodajlBR9hFB4NnuA0Jlkzxtolu8664jbycmnv_9YqffXwSWA2jz4PoWq6rjPGDuFpdeC4t9EGdStSbxE3aJsE Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 1e8921e8b6734f6ab59fbf880dfd622b Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-TestEncryptedCinderVolumes-656384943 Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e8921e8b6734f6ab59fbf880dfd622b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e8921e8b6734f6ab59fbf880dfd622b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e8921e8b6734f6ab59fbf880dfd622b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e8921e8b6734f6ab59fbf880dfd622b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-TestEncryptedCinderVolumes-656384943 Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 1e8921e8b6734f6ab59fbf880dfd622b Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-656384943 Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-TestEncryptedCinderVolumes-656384943-project Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 4d23e30a643947ec8040a9ad564ea328 Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-TestEncryptedCinderVolumes-656384943-project Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 could not be found. Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770'} Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 could not be found. Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 could not be found. Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:29:29.909056 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:29:29.913910 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:29:29.913910 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:29:29.913910 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:29:29.913910 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:29:29.913910 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:29:29.913910 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 could not be found. Jul 19 23:29:29.913910 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:29:29.913910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-14d7ff8b-99e0-4904-b506-dab3381f6e4b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Returning 404 to user: Instance e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:29:29.913910 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-14d7ff8b-99e0-4904-b506-dab3381f6e4b tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770" status: 404 len: 111 microversion: 2.1 time: 0.029999 Jul 19 23:29:29.913910 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3430/6852] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:29:29 2022] GET /compute/v2.1/servers/e16b5dc5-572b-40ee-9eb5-1e7b0a0f2770 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:29:29.919750 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ecca4e0a-721a-4529-805d-2a79bea3f1e1 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] Calling method '.version_select at 0x7f7a03119790>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:29:29.938847 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ecca4e0a-721a-4529-805d-2a79bea3f1e1 tempest-TestEncryptedCinderVolumes-656384943 tempest-TestEncryptedCinderVolumes-656384943-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-58366604" status: 202 len: 0 microversion: 2.1 time: 0.022865 Jul 19 23:29:29.939458 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3423/6853] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 23:29:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-58366604 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 23:29:55.302086 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:29:55.302763 n-d-847009-3 devstack@n-api.service[119338]: Tue Jul 19 23:29:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:29:56.800028 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e99af83f-aa21-4129-9de7-fb2e2302aff4 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Action: 'create', calling method: .version_select at 0x7f7a03e64c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1518899070", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPvpki6DGFBUeJk2lGqSAuaBYSH6J1aItCdWf8zKwuET2ZnFshPvk/qq1lq/A0SOpviN7BdwK14EdPFM5g5tmIpQo2n836VyF9g7SRXcxiatgcvDfjDF1tRE9YiApxycg=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:29:56.804742 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:29:56.805418 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:29:56.820267 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-e99af83f-aa21-4129-9de7-fb2e2302aff4 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Getting quotas for project 78238a06f1c645b4a145710a4b1c0c01. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:29:56.825762 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-e99af83f-aa21-4129-9de7-fb2e2302aff4 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Getting quotas for user f0883f3e353340a4b67bf932f3cbcb03 and project 78238a06f1c645b4a145710a4b1c0c01. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:29:56.849302 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e99af83f-aa21-4129-9de7-fb2e2302aff4 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053107 Jul 19 23:29:56.849988 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3431/6854] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 23:29:56 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:29:56.898083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=36 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:29:56.898837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:29:56.903306 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-09f2ce9c-5237-435d-9288-1df11791f8e1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1179856056", "imageRef": "ccf02594-8fa7-4931-b859-94e40bdaddde", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1518899070", "networks": [{"uuid": "775bc66a-282c-433a-81c9-925ad963cf63"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:29:56.954854 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-09f2ce9c-5237-435d-9288-1df11791f8e1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] validate_networks() for [('775bc66a-282c-433a-81c9-925ad963cf63', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:29:57.354249 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-09f2ce9c-5237-435d-9288-1df11791f8e1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:29:57.354682 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-09f2ce9c-5237-435d-9288-1df11791f8e1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:29:57.355193 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-09f2ce9c-5237-435d-9288-1df11791f8e1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:29:57.355616 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-09f2ce9c-5237-435d-9288-1df11791f8e1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:29:57.356042 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-09f2ce9c-5237-435d-9288-1df11791f8e1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:29:57.365659 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-09f2ce9c-5237-435d-9288-1df11791f8e1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:57.366113 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-09f2ce9c-5237-435d-9288-1df11791f8e1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:57.366922 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-09f2ce9c-5237-435d-9288-1df11791f8e1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:57.367394 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-09f2ce9c-5237-435d-9288-1df11791f8e1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:57.385248 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-09f2ce9c-5237-435d-9288-1df11791f8e1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Getting quotas for project 78238a06f1c645b4a145710a4b1c0c01. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:29:57.390503 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-09f2ce9c-5237-435d-9288-1df11791f8e1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Getting quotas for user f0883f3e353340a4b67bf932f3cbcb03 and project 78238a06f1c645b4a145710a4b1c0c01. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:29:57.402909 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-09f2ce9c-5237-435d-9288-1df11791f8e1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:29:57.405111 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-09f2ce9c-5237-435d-9288-1df11791f8e1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ccf02594-8fa7-4931-b859-94e40bdaddde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:29:57.451443 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-09f2ce9c-5237-435d-9288-1df11791f8e1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554936 Jul 19 23:29:57.452276 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3424/6855] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:29:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:29:57.463037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8488a162-480b-4655-ae9d-d35fd4647052 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:29:57.463795 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8488a162-480b-4655-ae9d-d35fd4647052 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:29:57.520677 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8488a162-480b-4655-ae9d-d35fd4647052 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:29:57.527980 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8488a162-480b-4655-ae9d-d35fd4647052 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782" status: 200 len: 1259 microversion: 2.1 time: 0.068774 Jul 19 23:29:57.528584 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3432/6856] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:29:57 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 => generated 1259 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:29:58.546803 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a0419d2a-48c2-4cd8-b1ca-7ad253030367 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:29:58.547462 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a0419d2a-48c2-4cd8-b1ca-7ad253030367 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:29:58.556225 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0419d2a-48c2-4cd8-b1ca-7ad253030367 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:58.556674 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0419d2a-48c2-4cd8-b1ca-7ad253030367 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:58.557456 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0419d2a-48c2-4cd8-b1ca-7ad253030367 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:58.557915 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0419d2a-48c2-4cd8-b1ca-7ad253030367 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:58.626663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a0419d2a-48c2-4cd8-b1ca-7ad253030367 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:29:58.635384 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a0419d2a-48c2-4cd8-b1ca-7ad253030367 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782" status: 200 len: 1317 microversion: 2.1 time: 0.093314 Jul 19 23:29:58.635966 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3425/6857] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:29:58 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 => generated 1317 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:29:59.652433 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-afe93d9a-3b81-4b0e-8709-44e7ee8fccac tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:29:59.653734 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-afe93d9a-3b81-4b0e-8709-44e7ee8fccac tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:29:59.664427 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-afe93d9a-3b81-4b0e-8709-44e7ee8fccac tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:59.664894 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-afe93d9a-3b81-4b0e-8709-44e7ee8fccac tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:59.665759 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-afe93d9a-3b81-4b0e-8709-44e7ee8fccac tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:29:59.666211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-afe93d9a-3b81-4b0e-8709-44e7ee8fccac tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:29:59.818635 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-afe93d9a-3b81-4b0e-8709-44e7ee8fccac tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:29:59.827347 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-afe93d9a-3b81-4b0e-8709-44e7ee8fccac tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782" status: 200 len: 1359 microversion: 2.1 time: 0.178796 Jul 19 23:29:59.828957 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3433/6858] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:29:59 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:30:00.845522 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ae589870-1a4a-445f-a793-945512dd986c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:30:00.846349 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ae589870-1a4a-445f-a793-945512dd986c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:30:00.855542 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ae589870-1a4a-445f-a793-945512dd986c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:00.856003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ae589870-1a4a-445f-a793-945512dd986c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:00.856806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ae589870-1a4a-445f-a793-945512dd986c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:00.857259 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ae589870-1a4a-445f-a793-945512dd986c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:01.013102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ae589870-1a4a-445f-a793-945512dd986c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:30:01.021420 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ae589870-1a4a-445f-a793-945512dd986c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782" status: 200 len: 1359 microversion: 2.1 time: 0.180768 Jul 19 23:30:01.029729 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3426/6859] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:30:00 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:30:02.042080 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-13c79661-9d7a-41ad-84ec-3287e8db6ab3 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:30:02.043365 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-13c79661-9d7a-41ad-84ec-3287e8db6ab3 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:30:02.050932 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13c79661-9d7a-41ad-84ec-3287e8db6ab3 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:02.051467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13c79661-9d7a-41ad-84ec-3287e8db6ab3 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:02.052283 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13c79661-9d7a-41ad-84ec-3287e8db6ab3 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:02.052735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-13c79661-9d7a-41ad-84ec-3287e8db6ab3 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:02.205030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-13c79661-9d7a-41ad-84ec-3287e8db6ab3 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:30:02.214515 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-13c79661-9d7a-41ad-84ec-3287e8db6ab3 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782" status: 200 len: 1359 microversion: 2.1 time: 0.178078 Jul 19 23:30:02.215309 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3434/6860] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:30:02 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:30:03.236460 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f50be8ba-01e2-4b93-8a43-947ab873a7f2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:30:03.238897 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f50be8ba-01e2-4b93-8a43-947ab873a7f2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:30:03.249589 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f50be8ba-01e2-4b93-8a43-947ab873a7f2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:03.250306 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f50be8ba-01e2-4b93-8a43-947ab873a7f2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:03.251208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f50be8ba-01e2-4b93-8a43-947ab873a7f2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:03.251742 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f50be8ba-01e2-4b93-8a43-947ab873a7f2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:03.403133 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f50be8ba-01e2-4b93-8a43-947ab873a7f2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:30:03.410744 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f50be8ba-01e2-4b93-8a43-947ab873a7f2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782" status: 200 len: 1359 microversion: 2.1 time: 0.180595 Jul 19 23:30:03.411383 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3427/6861] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:30:03 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:30:04.430284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-60d6b5f0-3a62-459a-8927-937b9f5f9b51 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:30:04.431442 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-60d6b5f0-3a62-459a-8927-937b9f5f9b51 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:30:04.440092 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60d6b5f0-3a62-459a-8927-937b9f5f9b51 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:04.440658 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60d6b5f0-3a62-459a-8927-937b9f5f9b51 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:04.441554 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60d6b5f0-3a62-459a-8927-937b9f5f9b51 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:04.442011 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-60d6b5f0-3a62-459a-8927-937b9f5f9b51 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:04.586419 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-60d6b5f0-3a62-459a-8927-937b9f5f9b51 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:30:04.594950 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-60d6b5f0-3a62-459a-8927-937b9f5f9b51 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782" status: 200 len: 1359 microversion: 2.1 time: 0.170932 Jul 19 23:30:04.596087 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3435/6862] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:30:04 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:30:05.616021 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7687dffb-4c9e-4bfe-b07d-a571f04be88c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:30:05.616627 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7687dffb-4c9e-4bfe-b07d-a571f04be88c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:30:05.625314 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7687dffb-4c9e-4bfe-b07d-a571f04be88c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:05.626211 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7687dffb-4c9e-4bfe-b07d-a571f04be88c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:05.627413 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7687dffb-4c9e-4bfe-b07d-a571f04be88c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:05.628221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7687dffb-4c9e-4bfe-b07d-a571f04be88c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:05.785622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7687dffb-4c9e-4bfe-b07d-a571f04be88c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:30:05.798121 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7687dffb-4c9e-4bfe-b07d-a571f04be88c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782" status: 200 len: 1359 microversion: 2.1 time: 0.186619 Jul 19 23:30:05.798845 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3428/6863] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:30:05 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:30:06.815571 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7644467e-8035-4e1d-a7e6-a3ce36fcacc2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:30:06.816401 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7644467e-8035-4e1d-a7e6-a3ce36fcacc2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:30:06.823748 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7644467e-8035-4e1d-a7e6-a3ce36fcacc2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:06.824219 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7644467e-8035-4e1d-a7e6-a3ce36fcacc2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:06.825272 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7644467e-8035-4e1d-a7e6-a3ce36fcacc2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:06.825732 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7644467e-8035-4e1d-a7e6-a3ce36fcacc2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:06.970151 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7644467e-8035-4e1d-a7e6-a3ce36fcacc2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:30:06.979214 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7644467e-8035-4e1d-a7e6-a3ce36fcacc2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782" status: 200 len: 1359 microversion: 2.1 time: 0.167768 Jul 19 23:30:06.979795 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3436/6864] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:30:06 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:30:07.626672 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-51b668bb-fd73-4133-ae4d-00774189faab req-796af77e-382a-48eb-b054-4a318bc8c092 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9429e5e0-e487-4401-b05f-3fe3e9e2e782", "tag": "a73624a6-d7e8-4e7f-a1a8-ba77aed96388"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:30:07.632889 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:30:07.634377 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:30:07.639825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-51b668bb-fd73-4133-ae4d-00774189faab req-796af77e-382a-48eb-b054-4a318bc8c092 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:07.640573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-51b668bb-fd73-4133-ae4d-00774189faab req-796af77e-382a-48eb-b054-4a318bc8c092 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:07.653889 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-51b668bb-fd73-4133-ae4d-00774189faab req-796af77e-382a-48eb-b054-4a318bc8c092 service nova] Creating event network-changed:a73624a6-d7e8-4e7f-a1a8-ba77aed96388 for instance 9429e5e0-e487-4401-b05f-3fe3e9e2e782 on n-h2-847009-3 Jul 19 23:30:07.660320 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-51b668bb-fd73-4133-ae4d-00774189faab req-796af77e-382a-48eb-b054-4a318bc8c092 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037269 Jul 19 23:30:07.663393 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3429/6865] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:30:07.997613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-742f138f-62da-43d3-8109-3a89fa5aab8e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:30:07.998451 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-742f138f-62da-43d3-8109-3a89fa5aab8e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:30:08.000538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:30:08.007595 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-742f138f-62da-43d3-8109-3a89fa5aab8e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:08.008068 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-742f138f-62da-43d3-8109-3a89fa5aab8e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:08.008868 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-742f138f-62da-43d3-8109-3a89fa5aab8e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:08.009322 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-742f138f-62da-43d3-8109-3a89fa5aab8e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:08.145133 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-742f138f-62da-43d3-8109-3a89fa5aab8e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:30:08.153577 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-742f138f-62da-43d3-8109-3a89fa5aab8e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782" status: 200 len: 1359 microversion: 2.1 time: 0.159984 Jul 19 23:30:08.158593 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3437/6866] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:30:07 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:30:09.173279 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-082d79a6-c56a-43ab-9bc6-17662be860c1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:30:09.173989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-082d79a6-c56a-43ab-9bc6-17662be860c1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:30:09.181276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-082d79a6-c56a-43ab-9bc6-17662be860c1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:09.181745 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-082d79a6-c56a-43ab-9bc6-17662be860c1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:09.182531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-082d79a6-c56a-43ab-9bc6-17662be860c1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:09.182974 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-082d79a6-c56a-43ab-9bc6-17662be860c1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:09.323506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-082d79a6-c56a-43ab-9bc6-17662be860c1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:30:09.331304 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-082d79a6-c56a-43ab-9bc6-17662be860c1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782" status: 200 len: 1359 microversion: 2.1 time: 0.163285 Jul 19 23:30:09.331886 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3430/6867] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:30:09 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:30:10.348519 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ad181bbd-2f2f-46c6-a84e-cff1e96cda96 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:30:10.349665 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ad181bbd-2f2f-46c6-a84e-cff1e96cda96 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:30:10.356793 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad181bbd-2f2f-46c6-a84e-cff1e96cda96 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:10.357262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad181bbd-2f2f-46c6-a84e-cff1e96cda96 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:10.358052 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad181bbd-2f2f-46c6-a84e-cff1e96cda96 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:10.358510 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ad181bbd-2f2f-46c6-a84e-cff1e96cda96 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:10.489261 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ad181bbd-2f2f-46c6-a84e-cff1e96cda96 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:30:10.496787 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ad181bbd-2f2f-46c6-a84e-cff1e96cda96 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782" status: 200 len: 1359 microversion: 2.1 time: 0.152400 Jul 19 23:30:10.497360 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3438/6868] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:30:10 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:30:11.513931 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e3e2daba-5bc1-492a-889b-014e0e6b39ec tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:30:11.514543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e3e2daba-5bc1-492a-889b-014e0e6b39ec tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:30:11.522049 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e3e2daba-5bc1-492a-889b-014e0e6b39ec tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:11.522492 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e3e2daba-5bc1-492a-889b-014e0e6b39ec tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:11.523302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e3e2daba-5bc1-492a-889b-014e0e6b39ec tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:11.523740 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e3e2daba-5bc1-492a-889b-014e0e6b39ec tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:11.664443 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e3e2daba-5bc1-492a-889b-014e0e6b39ec tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:30:11.672233 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e3e2daba-5bc1-492a-889b-014e0e6b39ec tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782" status: 200 len: 1359 microversion: 2.1 time: 0.162226 Jul 19 23:30:11.672811 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3431/6869] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:30:11 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:30:12.689920 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7eb4ca5f-5881-4dde-96cf-481620c8933d tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:30:12.690582 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7eb4ca5f-5881-4dde-96cf-481620c8933d tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:30:12.698852 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7eb4ca5f-5881-4dde-96cf-481620c8933d tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:12.699350 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7eb4ca5f-5881-4dde-96cf-481620c8933d tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:12.700121 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7eb4ca5f-5881-4dde-96cf-481620c8933d tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:12.700568 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7eb4ca5f-5881-4dde-96cf-481620c8933d tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:12.831194 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7eb4ca5f-5881-4dde-96cf-481620c8933d tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:30:12.838814 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7eb4ca5f-5881-4dde-96cf-481620c8933d tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782" status: 200 len: 1359 microversion: 2.1 time: 0.152872 Jul 19 23:30:12.839432 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3439/6870] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:30:12 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:30:13.123148 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-76c3c6c5-35de-478e-876a-06d565ef07b7 req-0988587d-38bf-414c-902d-25ec4c6fa36c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9429e5e0-e487-4401-b05f-3fe3e9e2e782", "name": "network-vif-plugged", "status": "completed", "tag": "a73624a6-d7e8-4e7f-a1a8-ba77aed96388"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:30:13.133200 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-76c3c6c5-35de-478e-876a-06d565ef07b7 req-0988587d-38bf-414c-902d-25ec4c6fa36c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:13.133652 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-76c3c6c5-35de-478e-876a-06d565ef07b7 req-0988587d-38bf-414c-902d-25ec4c6fa36c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:13.145478 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-76c3c6c5-35de-478e-876a-06d565ef07b7 req-0988587d-38bf-414c-902d-25ec4c6fa36c service nova] Creating event network-vif-plugged:a73624a6-d7e8-4e7f-a1a8-ba77aed96388 for instance 9429e5e0-e487-4401-b05f-3fe3e9e2e782 on n-h2-847009-3 Jul 19 23:30:13.150533 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-76c3c6c5-35de-478e-876a-06d565ef07b7 req-0988587d-38bf-414c-902d-25ec4c6fa36c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031295 Jul 19 23:30:13.151207 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3432/6871] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:30:13.856544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6b467720-9248-47a3-96e4-a729c53d73eb tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:30:13.857214 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6b467720-9248-47a3-96e4-a729c53d73eb tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:30:13.864236 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b467720-9248-47a3-96e4-a729c53d73eb tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:13.864699 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b467720-9248-47a3-96e4-a729c53d73eb tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:13.865481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b467720-9248-47a3-96e4-a729c53d73eb tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:13.865931 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6b467720-9248-47a3-96e4-a729c53d73eb tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:14.010775 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6b467720-9248-47a3-96e4-a729c53d73eb tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:30:14.018280 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6b467720-9248-47a3-96e4-a729c53d73eb tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782" status: 200 len: 1359 microversion: 2.1 time: 0.165658 Jul 19 23:30:14.018879 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3440/6872] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:30:13 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:30:15.037935 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-42c6f4b8-b2c6-4b4e-be68-5e7f4329cbe1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:30:15.038697 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-42c6f4b8-b2c6-4b4e-be68-5e7f4329cbe1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:30:15.045077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-42c6f4b8-b2c6-4b4e-be68-5e7f4329cbe1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:15.045536 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-42c6f4b8-b2c6-4b4e-be68-5e7f4329cbe1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:15.046309 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-42c6f4b8-b2c6-4b4e-be68-5e7f4329cbe1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:15.046757 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-42c6f4b8-b2c6-4b4e-be68-5e7f4329cbe1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:15.176955 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-42c6f4b8-b2c6-4b4e-be68-5e7f4329cbe1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:30:15.184526 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-42c6f4b8-b2c6-4b4e-be68-5e7f4329cbe1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782" status: 200 len: 1549 microversion: 2.1 time: 0.152483 Jul 19 23:30:15.185102 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3433/6873] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:30:15 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:30:15.202254 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7ea481bd-8079-4982-a1ab-7399fd1be556 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:30:15.202901 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7ea481bd-8079-4982-a1ab-7399fd1be556 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:30:15.210831 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7ea481bd-8079-4982-a1ab-7399fd1be556 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:15.211338 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7ea481bd-8079-4982-a1ab-7399fd1be556 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:15.212128 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7ea481bd-8079-4982-a1ab-7399fd1be556 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:15.212582 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7ea481bd-8079-4982-a1ab-7399fd1be556 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:15.354278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7ea481bd-8079-4982-a1ab-7399fd1be556 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:30:15.361789 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7ea481bd-8079-4982-a1ab-7399fd1be556 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782" status: 200 len: 1549 microversion: 2.1 time: 0.164648 Jul 19 23:30:15.362362 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3441/6874] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:30:15 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 => generated 1549 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:30:15.377683 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8906b167-42dd-4079-98ce-3f48a4e21275 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:30:15.381778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8906b167-42dd-4079-98ce-3f48a4e21275 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:30:15.382579 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8906b167-42dd-4079-98ce-3f48a4e21275 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Searching by: {'deleted': False, 'project_id': '78238a06f1c645b4a145710a4b1c0c01'} {{(pid=119338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 23:30:15.388076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8906b167-42dd-4079-98ce-3f48a4e21275 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:15.388538 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8906b167-42dd-4079-98ce-3f48a4e21275 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:15.389336 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8906b167-42dd-4079-98ce-3f48a4e21275 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:15.389778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8906b167-42dd-4079-98ce-3f48a4e21275 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:15.421691 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.multi_cell_list [None req-8906b167-42dd-4079-98ce-3f48a4e21275 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119338) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 23:30:15.451806 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8906b167-42dd-4079-98ce-3f48a4e21275 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.077996 Jul 19 23:30:15.452403 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3434/6875] 10.222.0.25 () {58 vars in 1124 bytes} [Tue Jul 19 23:30:15 2022] GET /compute/v2.1/servers => generated 343 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:30:15.463385 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a1ce75b9-d20f-4658-9de6-6cb324632b17 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:30:15.464030 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a1ce75b9-d20f-4658-9de6-6cb324632b17 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:30:15.470174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a1ce75b9-d20f-4658-9de6-6cb324632b17 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:15.470643 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a1ce75b9-d20f-4658-9de6-6cb324632b17 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:15.471463 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a1ce75b9-d20f-4658-9de6-6cb324632b17 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:15.471925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a1ce75b9-d20f-4658-9de6-6cb324632b17 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:15.601077 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a1ce75b9-d20f-4658-9de6-6cb324632b17 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:30:15.608835 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a1ce75b9-d20f-4658-9de6-6cb324632b17 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782" status: 200 len: 1549 microversion: 2.1 time: 0.149395 Jul 19 23:30:15.609415 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3442/6876] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:30:15 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:30:17.135013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7011a60a-7e63-4354-9cdd-68a4cebfdb94 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1c25fcf-a182-4a88-b268-b5b38021f79a"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:30:17.136144 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7011a60a-7e63-4354-9cdd-68a4cebfdb94 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:30:17.143076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7011a60a-7e63-4354-9cdd-68a4cebfdb94 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:17.143562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7011a60a-7e63-4354-9cdd-68a4cebfdb94 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:17.144314 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7011a60a-7e63-4354-9cdd-68a4cebfdb94 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:17.144787 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7011a60a-7e63-4354-9cdd-68a4cebfdb94 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:17.386664 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7011a60a-7e63-4354-9cdd-68a4cebfdb94 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "POST /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255561 Jul 19 23:30:17.387399 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3435/6877] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 19 23:30:17 2022] POST /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:30:30.419394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-964af14e-496d-4e68-baae-57db7d83524c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:30:30.420036 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-964af14e-496d-4e68-baae-57db7d83524c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:30:30.423209 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:30:30.423886 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=60 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:30:30.430918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-964af14e-496d-4e68-baae-57db7d83524c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:30.431411 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-964af14e-496d-4e68-baae-57db7d83524c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:30.432208 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-964af14e-496d-4e68-baae-57db7d83524c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:30.432694 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-964af14e-496d-4e68-baae-57db7d83524c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:30.568305 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-964af14e-496d-4e68-baae-57db7d83524c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:30:30.576642 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-964af14e-496d-4e68-baae-57db7d83524c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782" status: 200 len: 1595 microversion: 2.1 time: 0.161229 Jul 19 23:30:30.577226 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3443/6878] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:30:30 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 => generated 1595 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:30:32.344070 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:30:32.344848 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:30:32.345597 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:30:32.350385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-3b3e8bf4-abf6-494a-9e9c-f62194fa0857 req-51f08034-98b5-4442-8144-6251e9589ccd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9429e5e0-e487-4401-b05f-3fe3e9e2e782", "tag": "a73624a6-d7e8-4e7f-a1a8-ba77aed96388"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:30:32.362107 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-3b3e8bf4-abf6-494a-9e9c-f62194fa0857 req-51f08034-98b5-4442-8144-6251e9589ccd service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:32.363263 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-3b3e8bf4-abf6-494a-9e9c-f62194fa0857 req-51f08034-98b5-4442-8144-6251e9589ccd service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:32.385005 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-3b3e8bf4-abf6-494a-9e9c-f62194fa0857 req-51f08034-98b5-4442-8144-6251e9589ccd service nova] Creating event network-changed:a73624a6-d7e8-4e7f-a1a8-ba77aed96388 for instance 9429e5e0-e487-4401-b05f-3fe3e9e2e782 on n-h2-847009-3 Jul 19 23:30:32.391153 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-3b3e8bf4-abf6-494a-9e9c-f62194fa0857 req-51f08034-98b5-4442-8144-6251e9589ccd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048219 Jul 19 23:30:32.394898 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3436/6879] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:30:33.541834 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2949945b-2752-4dcd-904c-aca389ee5059 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2009785436"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:30:33.542367 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2949945b-2752-4dcd-904c-aca389ee5059 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:30:33.549490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2949945b-2752-4dcd-904c-aca389ee5059 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:33.550143 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2949945b-2752-4dcd-904c-aca389ee5059 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:33.551188 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2949945b-2752-4dcd-904c-aca389ee5059 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:33.551655 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2949945b-2752-4dcd-904c-aca389ee5059 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:33.695851 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.network.security_group_api [None req-2949945b-2752-4dcd-904c-aca389ee5059 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Adding security group 41a5bded-0510-4621-b6dd-5c75efd1804f to port a73624a6-d7e8-4e7f-a1a8-ba77aed96388 Jul 19 23:30:34.060679 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2949945b-2752-4dcd-904c-aca389ee5059 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "POST /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782/action" status: 202 len: 0 microversion: 2.1 time: 0.524062 Jul 19 23:30:34.065142 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3444/6880] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:30:33 2022] POST /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:30:34.075754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2b4d4251-3c5a-4cf0-9e04-ec19bbd493f7 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:30:34.076301 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-181abe49-5910-4186-b886-ed5616a7d857 req-b7d335fc-b756-43b1-8f1c-d6332de16f46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9429e5e0-e487-4401-b05f-3fe3e9e2e782", "tag": "a73624a6-d7e8-4e7f-a1a8-ba77aed96388"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:30:34.077250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2b4d4251-3c5a-4cf0-9e04-ec19bbd493f7 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:30:34.089062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-181abe49-5910-4186-b886-ed5616a7d857 req-b7d335fc-b756-43b1-8f1c-d6332de16f46 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:34.090845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-181abe49-5910-4186-b886-ed5616a7d857 req-b7d335fc-b756-43b1-8f1c-d6332de16f46 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:34.095524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b4d4251-3c5a-4cf0-9e04-ec19bbd493f7 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:34.096618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b4d4251-3c5a-4cf0-9e04-ec19bbd493f7 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:34.098044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b4d4251-3c5a-4cf0-9e04-ec19bbd493f7 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:30:34.098489 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b4d4251-3c5a-4cf0-9e04-ec19bbd493f7 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:30:34.107489 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-181abe49-5910-4186-b886-ed5616a7d857 req-b7d335fc-b756-43b1-8f1c-d6332de16f46 service nova] Creating event network-changed:a73624a6-d7e8-4e7f-a1a8-ba77aed96388 for instance 9429e5e0-e487-4401-b05f-3fe3e9e2e782 on n-h2-847009-3 Jul 19 23:30:34.114739 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-181abe49-5910-4186-b886-ed5616a7d857 req-b7d335fc-b756-43b1-8f1c-d6332de16f46 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043274 Jul 19 23:30:34.116119 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3445/6881] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:30:34.326578 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2b4d4251-3c5a-4cf0-9e04-ec19bbd493f7 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:30:34.338423 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2b4d4251-3c5a-4cf0-9e04-ec19bbd493f7 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782" status: 200 len: 1761 microversion: 2.1 time: 0.271860 Jul 19 23:30:34.339762 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3437/6882] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:30:34 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 => generated 1761 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:31:35.400630 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:31:35.401400 n-d-847009-3 devstack@n-api.service[119338]: Tue Jul 19 23:31:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:31:36.362324 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:31:36.362916 n-d-847009-3 devstack@n-api.service[119337]: Tue Jul 19 23:31:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:32:13.716388 n-d-847009-3 devstack@n-api.service[119337]: ERROR oslo.messaging._drivers.impl_rabbit [-] [798b565c-2a51-4094-a95e-de275b58674b] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 19 23:32:13.717447 n-d-847009-3 devstack@n-api.service[119337]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4d9f90d1-6e88-4978-b2b1-8e2a2dbb4cb7] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 19 23:32:13.718038 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:32:13.718797 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=12 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:32:13.723864 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-77d8defd-09a9-444a-8f26-9a004d8e3d58 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:32:13.724923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-77d8defd-09a9-444a-8f26-9a004d8e3d58 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:32:13.735169 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-77d8defd-09a9-444a-8f26-9a004d8e3d58 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:32:13.735641 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-77d8defd-09a9-444a-8f26-9a004d8e3d58 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:32:13.736430 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-77d8defd-09a9-444a-8f26-9a004d8e3d58 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:32:13.736885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-77d8defd-09a9-444a-8f26-9a004d8e3d58 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:32:13.809610 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-77d8defd-09a9-444a-8f26-9a004d8e3d58 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "POST /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782/action" status: 202 len: 0 microversion: 2.1 time: 0.094893 Jul 19 23:32:13.810263 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3446/6883] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:32:13 2022] POST /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:32:13.817903 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:32:13.819006 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=8 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:32:13.825331 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f321c2a4-5edd-452d-ab27-1f5b3885c6d8 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:32:13.825942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f321c2a4-5edd-452d-ab27-1f5b3885c6d8 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:32:13.835680 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f321c2a4-5edd-452d-ab27-1f5b3885c6d8 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:32:13.836129 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f321c2a4-5edd-452d-ab27-1f5b3885c6d8 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:32:13.837451 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f321c2a4-5edd-452d-ab27-1f5b3885c6d8 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:32:13.838655 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f321c2a4-5edd-452d-ab27-1f5b3885c6d8 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:32:13.993043 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f321c2a4-5edd-452d-ab27-1f5b3885c6d8 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:32:14.002641 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f321c2a4-5edd-452d-ab27-1f5b3885c6d8 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782" status: 200 len: 1763 microversion: 2.1 time: 0.187861 Jul 19 23:32:14.003249 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3438/6884] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:32:13 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 => generated 1763 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:32:15.022592 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ca9ea3c3-8ae8-4b20-b3d0-d492897dc914 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:32:15.023333 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ca9ea3c3-8ae8-4b20-b3d0-d492897dc914 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:32:15.031907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca9ea3c3-8ae8-4b20-b3d0-d492897dc914 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:32:15.032363 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca9ea3c3-8ae8-4b20-b3d0-d492897dc914 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:32:15.033144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca9ea3c3-8ae8-4b20-b3d0-d492897dc914 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:32:15.033594 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca9ea3c3-8ae8-4b20-b3d0-d492897dc914 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:32:15.037444 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] [798b565c-2a51-4094-a95e-de275b58674b] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 37702. Jul 19 23:32:15.041341 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] [4d9f90d1-6e88-4978-b2b1-8e2a2dbb4cb7] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 37704. Jul 19 23:32:15.185376 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ca9ea3c3-8ae8-4b20-b3d0-d492897dc914 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:32:15.193506 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ca9ea3c3-8ae8-4b20-b3d0-d492897dc914 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782" status: 200 len: 1761 microversion: 2.1 time: 0.177192 Jul 19 23:32:15.194082 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3447/6885] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:32:15 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 => generated 1761 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:33:15.313063 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:33:15.313790 n-d-847009-3 devstack@n-api.service[119338]: Tue Jul 19 23:33:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:33:28.338882 n-d-847009-3 devstack@n-api.service[119338]: ERROR oslo.messaging._drivers.impl_rabbit [-] [33eb9b21-6b86-489c-8081-974c1460dc40] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 23:33:28.339814 n-d-847009-3 devstack@n-api.service[119338]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f9ad43fa-8ace-4c60-a52f-7afb16c145c7] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 23:33:28.340548 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:33:28.341298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:33:28.346579 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9b844d82-9890-4163-a97f-edb142f30a6a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2009785436"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:33:28.347175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9b844d82-9890-4163-a97f-edb142f30a6a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:33:28.354097 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b844d82-9890-4163-a97f-edb142f30a6a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:28.354555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b844d82-9890-4163-a97f-edb142f30a6a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:28.355361 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b844d82-9890-4163-a97f-edb142f30a6a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:28.355811 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9b844d82-9890-4163-a97f-edb142f30a6a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:28.663499 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.network.security_group_api [None req-9b844d82-9890-4163-a97f-edb142f30a6a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Removing security group 41a5bded-0510-4621-b6dd-5c75efd1804f from port a73624a6-d7e8-4e7f-a1a8-ba77aed96388 Jul 19 23:33:29.004222 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9b844d82-9890-4163-a97f-edb142f30a6a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "POST /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782/action" status: 202 len: 0 microversion: 2.1 time: 0.666949 Jul 19 23:33:29.008204 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3439/6886] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:33:28 2022] POST /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782/action => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:33:29.012313 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=4 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:33:29.013839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:33:29.018537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-1f31c578-85b4-4a58-b3ef-a931e373b3bd req-0c8784ca-8a2d-4320-a373-226f8c385bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9429e5e0-e487-4401-b05f-3fe3e9e2e782", "tag": "a73624a6-d7e8-4e7f-a1a8-ba77aed96388"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:33:29.036146 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1f31c578-85b4-4a58-b3ef-a931e373b3bd req-0c8784ca-8a2d-4320-a373-226f8c385bf5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:29.036927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1f31c578-85b4-4a58-b3ef-a931e373b3bd req-0c8784ca-8a2d-4320-a373-226f8c385bf5 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:29.076218 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-1f31c578-85b4-4a58-b3ef-a931e373b3bd req-0c8784ca-8a2d-4320-a373-226f8c385bf5 service nova] Creating event network-changed:a73624a6-d7e8-4e7f-a1a8-ba77aed96388 for instance 9429e5e0-e487-4401-b05f-3fe3e9e2e782 on n-h2-847009-3 Jul 19 23:33:29.085027 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-1f31c578-85b4-4a58-b3ef-a931e373b3bd req-0c8784ca-8a2d-4320-a373-226f8c385bf5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073737 Jul 19 23:33:29.086424 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3448/6887] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:33:29.829189 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:33:29.829733 n-d-847009-3 devstack@n-api.service[119338]: Tue Jul 19 23:33:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:33:30.309447 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e460e515-9e68-4efb-b1fa-1cb76942de1b tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:33:30.309958 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e460e515-9e68-4efb-b1fa-1cb76942de1b tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:33:30.320012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e460e515-9e68-4efb-b1fa-1cb76942de1b tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:30.320725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e460e515-9e68-4efb-b1fa-1cb76942de1b tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:30.321503 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e460e515-9e68-4efb-b1fa-1cb76942de1b tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:30.321946 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e460e515-9e68-4efb-b1fa-1cb76942de1b tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:30.327644 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [-] [f9ad43fa-8ace-4c60-a52f-7afb16c145c7] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 37750. Jul 19 23:33:30.329893 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [-] [33eb9b21-6b86-489c-8081-974c1460dc40] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 37748. Jul 19 23:33:30.407042 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-e460e515-9e68-4efb-b1fa-1cb76942de1b tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lazy-loading 'services' on Instance uuid 9429e5e0-e487-4401-b05f-3fe3e9e2e782 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:33:30.484199 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e460e515-9e68-4efb-b1fa-1cb76942de1b tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782/os-volume_attachments/e1c25fcf-a182-4a88-b268-b5b38021f79a" status: 202 len: 0 microversion: 2.1 time: 0.178984 Jul 19 23:33:30.484755 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3440/6888] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 19 23:33:30 2022] DELETE /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782/os-volume_attachments/e1c25fcf-a182-4a88-b268-b5b38021f79a => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:33:30.493692 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-245209bd-95ce-4cce-9d43-c2de378d2df1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:33:30.494743 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-245209bd-95ce-4cce-9d43-c2de378d2df1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:33:30.505416 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-245209bd-95ce-4cce-9d43-c2de378d2df1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:30.505884 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-245209bd-95ce-4cce-9d43-c2de378d2df1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:30.507328 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-245209bd-95ce-4cce-9d43-c2de378d2df1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:30.508410 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-245209bd-95ce-4cce-9d43-c2de378d2df1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:30.543908 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-245209bd-95ce-4cce-9d43-c2de378d2df1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054465 Jul 19 23:33:30.544502 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3449/6889] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:33:30 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:33:31.102627 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-474c0972-89bb-46e9-a676-8e189ea23758 req-557a97fd-2cab-4e9b-8c9b-d841d30417f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9429e5e0-e487-4401-b05f-3fe3e9e2e782", "tag": "a73624a6-d7e8-4e7f-a1a8-ba77aed96388"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:33:31.115847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-474c0972-89bb-46e9-a676-8e189ea23758 req-557a97fd-2cab-4e9b-8c9b-d841d30417f8 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:31.116701 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-474c0972-89bb-46e9-a676-8e189ea23758 req-557a97fd-2cab-4e9b-8c9b-d841d30417f8 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:31.129861 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-474c0972-89bb-46e9-a676-8e189ea23758 req-557a97fd-2cab-4e9b-8c9b-d841d30417f8 service nova] Creating event network-changed:a73624a6-d7e8-4e7f-a1a8-ba77aed96388 for instance 9429e5e0-e487-4401-b05f-3fe3e9e2e782 on n-h2-847009-3 Jul 19 23:33:31.135845 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-474c0972-89bb-46e9-a676-8e189ea23758 req-557a97fd-2cab-4e9b-8c9b-d841d30417f8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037417 Jul 19 23:33:31.136635 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3441/6890] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:33:31.558076 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f8961c0f-70e1-468c-948c-d9e5e95d19ee tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:33:31.559526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f8961c0f-70e1-468c-948c-d9e5e95d19ee tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:33:31.566994 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f8961c0f-70e1-468c-948c-d9e5e95d19ee tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:31.567491 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f8961c0f-70e1-468c-948c-d9e5e95d19ee tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:31.568291 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f8961c0f-70e1-468c-948c-d9e5e95d19ee tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:31.568740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f8961c0f-70e1-468c-948c-d9e5e95d19ee tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:31.600394 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f8961c0f-70e1-468c-948c-d9e5e95d19ee tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047559 Jul 19 23:33:31.600949 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3450/6891] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:33:31 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:33:32.614379 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5099cb29-008f-4983-b2cc-9788ae1977c6 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:33:32.615511 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5099cb29-008f-4983-b2cc-9788ae1977c6 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:33:32.622236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5099cb29-008f-4983-b2cc-9788ae1977c6 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:32.622681 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5099cb29-008f-4983-b2cc-9788ae1977c6 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:32.623486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5099cb29-008f-4983-b2cc-9788ae1977c6 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:32.624637 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5099cb29-008f-4983-b2cc-9788ae1977c6 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:32.655588 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5099cb29-008f-4983-b2cc-9788ae1977c6 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046478 Jul 19 23:33:32.656183 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3442/6892] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:33:32 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:33:33.666701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a58e18f1-55cf-4149-b8a2-36a4e361b586 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:33:33.667587 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a58e18f1-55cf-4149-b8a2-36a4e361b586 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:33:33.675399 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a58e18f1-55cf-4149-b8a2-36a4e361b586 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:33.675865 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a58e18f1-55cf-4149-b8a2-36a4e361b586 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:33.676640 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a58e18f1-55cf-4149-b8a2-36a4e361b586 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:33.677088 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a58e18f1-55cf-4149-b8a2-36a4e361b586 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:33.707118 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a58e18f1-55cf-4149-b8a2-36a4e361b586 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044484 Jul 19 23:33:33.707689 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3451/6893] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:33:33 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:33:34.719369 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0cac8973-c040-4252-968b-1abc1944cafa tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:33:34.720307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0cac8973-c040-4252-968b-1abc1944cafa tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:33:34.727288 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cac8973-c040-4252-968b-1abc1944cafa tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:34.727741 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cac8973-c040-4252-968b-1abc1944cafa tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:34.728510 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cac8973-c040-4252-968b-1abc1944cafa tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:34.728953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0cac8973-c040-4252-968b-1abc1944cafa tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:34.758556 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0cac8973-c040-4252-968b-1abc1944cafa tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043606 Jul 19 23:33:34.759144 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3443/6894] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:33:34 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:33:35.770184 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-056d1f5e-5be5-4f4c-867b-1095dbd86e25 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:33:35.771143 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-056d1f5e-5be5-4f4c-867b-1095dbd86e25 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:33:35.778315 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-056d1f5e-5be5-4f4c-867b-1095dbd86e25 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:35.778783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-056d1f5e-5be5-4f4c-867b-1095dbd86e25 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:35.779613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-056d1f5e-5be5-4f4c-867b-1095dbd86e25 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:35.780682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-056d1f5e-5be5-4f4c-867b-1095dbd86e25 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:35.810114 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-056d1f5e-5be5-4f4c-867b-1095dbd86e25 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043878 Jul 19 23:33:35.810685 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3452/6895] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:33:35 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 23:33:35.820820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0d59c0f2-8df3-4345-b00c-a348db89107a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:33:35.821446 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0d59c0f2-8df3-4345-b00c-a348db89107a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:33:35.829044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d59c0f2-8df3-4345-b00c-a348db89107a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:35.829498 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d59c0f2-8df3-4345-b00c-a348db89107a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:35.830266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d59c0f2-8df3-4345-b00c-a348db89107a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:35.830707 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d59c0f2-8df3-4345-b00c-a348db89107a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:35.910364 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-0d59c0f2-8df3-4345-b00c-a348db89107a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] HTTP exception thrown: Instance 9429e5e0-e487-4401-b05f-3fe3e9e2e782 is not attached to volume e1c25fcf-a182-4a88-b268-b5b38021f79a Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0d59c0f2-8df3-4345-b00c-a348db89107a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Request method failure captured: Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782/os-volume_attachments/e1c25fcf-a182-4a88-b268-b5b38021f79a HTTP/1.1 Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1z5l-tlPRxj7FMHBXa1P2hvPZ4buf4P2dlOPno0l2N17D3k19haJXe3QsN1CxW3yYUv-Uwmrtm8ZG258GlmKwQ7aTVirBBAYSyPhiHmHHSezFuu5NcpIDecA3QoGQRRFyRIcXxNJP8hdIqftKK44olLCfkM_asGDttuL2Z_VzadUDw0 Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 78238a06f1c645b4a145710a4b1c0c01 Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TestMinimumBasicScenario-2045292981 Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_78238a06f1c645b4a145710a4b1c0c01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78238a06f1c645b4a145710a4b1c0c01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/78238a06f1c645b4a145710a4b1c0c01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78238a06f1c645b4a145710a4b1c0c01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TestMinimumBasicScenario-2045292981 Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 78238a06f1c645b4a145710a4b1c0c01 Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2045292981 Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TestMinimumBasicScenario-2045292981-project Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: f0883f3e353340a4b67bf932f3cbcb03 Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TestMinimumBasicScenario-2045292981-project Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 9429e5e0-e487-4401-b05f-3fe3e9e2e782 is not attached to volume e1c25fcf-a182-4a88-b268-b5b38021f79a Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'server_id': '9429e5e0-e487-4401-b05f-3fe3e9e2e782', 'id': 'e1c25fcf-a182-4a88-b268-b5b38021f79a'} Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e1c25fcf-a182-4a88-b268-b5b38021f79a. Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9429e5e0-e487-4401-b05f-3fe3e9e2e782 is not attached to volume e1c25fcf-a182-4a88-b268-b5b38021f79a Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:33:35.912070 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:33:35.916453 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:33:35.916453 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:33:35.916453 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9429e5e0-e487-4401-b05f-3fe3e9e2e782 is not attached to volume e1c25fcf-a182-4a88-b268-b5b38021f79a Jul 19 23:33:35.916453 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:33:35.916453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0d59c0f2-8df3-4345-b00c-a348db89107a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Returning 404 to user: Instance 9429e5e0-e487-4401-b05f-3fe3e9e2e782 is not attached to volume e1c25fcf-a182-4a88-b268-b5b38021f79a {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:33:35.916453 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0d59c0f2-8df3-4345-b00c-a348db89107a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782/os-volume_attachments/e1c25fcf-a182-4a88-b268-b5b38021f79a" status: 404 len: 154 microversion: 2.1 time: 0.096943 Jul 19 23:33:35.916453 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3444/6896] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 19 23:33:35 2022] DELETE /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782/os-volume_attachments/e1c25fcf-a182-4a88-b268-b5b38021f79a => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:33:39.150220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f34f354b-2f5d-4744-a162-3b11d1c73dd2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:33:39.150739 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f34f354b-2f5d-4744-a162-3b11d1c73dd2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:33:39.158457 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f34f354b-2f5d-4744-a162-3b11d1c73dd2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:39.158919 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f34f354b-2f5d-4744-a162-3b11d1c73dd2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:39.159720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f34f354b-2f5d-4744-a162-3b11d1c73dd2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:39.160168 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f34f354b-2f5d-4744-a162-3b11d1c73dd2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:39.188883 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f34f354b-2f5d-4744-a162-3b11d1c73dd2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:33:39.265330 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f34f354b-2f5d-4744-a162-3b11d1c73dd2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782" status: 204 len: 0 microversion: 2.1 time: 0.118583 Jul 19 23:33:39.266515 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3453/6897] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:33:39 2022] DELETE /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:33:39.277489 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-89ded132-8022-46bb-a79f-afcde7fdf141 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:33:39.278712 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-89ded132-8022-46bb-a79f-afcde7fdf141 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:33:39.288563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-89ded132-8022-46bb-a79f-afcde7fdf141 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:39.289019 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-89ded132-8022-46bb-a79f-afcde7fdf141 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:39.289822 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-89ded132-8022-46bb-a79f-afcde7fdf141 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:39.291268 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-89ded132-8022-46bb-a79f-afcde7fdf141 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:39.440891 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-89ded132-8022-46bb-a79f-afcde7fdf141 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:33:39.451128 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-89ded132-8022-46bb-a79f-afcde7fdf141 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782" status: 200 len: 1555 microversion: 2.1 time: 0.179612 Jul 19 23:33:39.451730 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3445/6898] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:33:39 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 => generated 1555 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:33:40.470365 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6a3701f7-14d3-474e-935d-ba33fe0f54dc tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:33:40.471098 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6a3701f7-14d3-474e-935d-ba33fe0f54dc tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:33:40.478896 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6a3701f7-14d3-474e-935d-ba33fe0f54dc tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:40.479383 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6a3701f7-14d3-474e-935d-ba33fe0f54dc tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:40.480170 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6a3701f7-14d3-474e-935d-ba33fe0f54dc tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:40.480617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6a3701f7-14d3-474e-935d-ba33fe0f54dc tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:40.705520 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6a3701f7-14d3-474e-935d-ba33fe0f54dc tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:33:40.713902 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6a3701f7-14d3-474e-935d-ba33fe0f54dc tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782" status: 200 len: 1555 microversion: 2.1 time: 0.247965 Jul 19 23:33:40.714505 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3454/6899] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:33:40 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 => generated 1555 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:33:41.433739 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-5da8d619-6620-4550-8f65-92e26a0c1ac6 req-b83c474f-deec-41bf-bfce-cc4ba28b1abe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9429e5e0-e487-4401-b05f-3fe3e9e2e782", "name": "network-vif-deleted", "tag": "a73624a6-d7e8-4e7f-a1a8-ba77aed96388"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:33:41.446810 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5da8d619-6620-4550-8f65-92e26a0c1ac6 req-b83c474f-deec-41bf-bfce-cc4ba28b1abe service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:41.447356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5da8d619-6620-4550-8f65-92e26a0c1ac6 req-b83c474f-deec-41bf-bfce-cc4ba28b1abe service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:41.461976 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-5da8d619-6620-4550-8f65-92e26a0c1ac6 req-b83c474f-deec-41bf-bfce-cc4ba28b1abe service nova] Creating event network-vif-deleted:a73624a6-d7e8-4e7f-a1a8-ba77aed96388 for instance 9429e5e0-e487-4401-b05f-3fe3e9e2e782 on n-h2-847009-3 Jul 19 23:33:41.468760 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-5da8d619-6620-4550-8f65-92e26a0c1ac6 req-b83c474f-deec-41bf-bfce-cc4ba28b1abe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037383 Jul 19 23:33:41.470039 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3446/6900] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:33:41.731958 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-42f62f41-0553-430f-a41e-6e783effd169 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:33:41.732607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-42f62f41-0553-430f-a41e-6e783effd169 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:33:41.740051 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42f62f41-0553-430f-a41e-6e783effd169 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:41.740772 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42f62f41-0553-430f-a41e-6e783effd169 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:41.740772 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42f62f41-0553-430f-a41e-6e783effd169 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:41.741846 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42f62f41-0553-430f-a41e-6e783effd169 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:41.778715 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42f62f41-0553-430f-a41e-6e783effd169 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:41.779214 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-42f62f41-0553-430f-a41e-6e783effd169 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:41.779699 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-42f62f41-0553-430f-a41e-6e783effd169 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lazy-loading 'fault' on Instance uuid 9429e5e0-e487-4401-b05f-3fe3e9e2e782 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:33:41.826442 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-42f62f41-0553-430f-a41e-6e783effd169 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:33:41.835499 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-42f62f41-0553-430f-a41e-6e783effd169 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782" status: 200 len: 1349 microversion: 2.1 time: 0.107461 Jul 19 23:33:41.836277 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3455/6901] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:33:41 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 => generated 1349 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:33:42.854556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1a4b0e93-88e1-4762-bf1c-956144e74c5e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:33:42.855328 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1a4b0e93-88e1-4762-bf1c-956144e74c5e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: 9429e5e0-e487-4401-b05f-3fe3e9e2e782] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:33:42.862763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a4b0e93-88e1-4762-bf1c-956144e74c5e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:42.863259 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a4b0e93-88e1-4762-bf1c-956144e74c5e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:42.864038 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a4b0e93-88e1-4762-bf1c-956144e74c5e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:42.864486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1a4b0e93-88e1-4762-bf1c-956144e74c5e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:42.878560 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-1a4b0e93-88e1-4762-bf1c-956144e74c5e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] HTTP exception thrown: Instance 9429e5e0-e487-4401-b05f-3fe3e9e2e782 could not be found. Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1a4b0e93-88e1-4762-bf1c-956144e74c5e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Request method failure captured: Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 HTTP/1.1 Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1z5l-tlPRxj7FMHBXa1P2hvPZ4buf4P2dlOPno0l2N17D3k19haJXe3QsN1CxW3yYUv-Uwmrtm8ZG258GlmKwQ7aTVirBBAYSyPhiHmHHSezFuu5NcpIDecA3QoGQRRFyRIcXxNJP8hdIqftKK44olLCfkM_asGDttuL2Z_VzadUDw0 Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 78238a06f1c645b4a145710a4b1c0c01 Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TestMinimumBasicScenario-2045292981 Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_78238a06f1c645b4a145710a4b1c0c01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78238a06f1c645b4a145710a4b1c0c01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/78238a06f1c645b4a145710a4b1c0c01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78238a06f1c645b4a145710a4b1c0c01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TestMinimumBasicScenario-2045292981 Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 78238a06f1c645b4a145710a4b1c0c01 Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2045292981 Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TestMinimumBasicScenario-2045292981-project Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: f0883f3e353340a4b67bf932f3cbcb03 Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TestMinimumBasicScenario-2045292981-project Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 9429e5e0-e487-4401-b05f-3fe3e9e2e782 could not be found. Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '9429e5e0-e487-4401-b05f-3fe3e9e2e782'} Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9429e5e0-e487-4401-b05f-3fe3e9e2e782 could not be found. Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9429e5e0-e487-4401-b05f-3fe3e9e2e782 could not be found. Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:33:42.880247 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:33:42.884871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:33:42.884871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:33:42.884871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:33:42.884871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:33:42.884871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:33:42.884871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9429e5e0-e487-4401-b05f-3fe3e9e2e782 could not be found. Jul 19 23:33:42.884871 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:33:42.884871 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1a4b0e93-88e1-4762-bf1c-956144e74c5e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Returning 404 to user: Instance 9429e5e0-e487-4401-b05f-3fe3e9e2e782 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:33:42.884871 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1a4b0e93-88e1-4762-bf1c-956144e74c5e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782" status: 404 len: 111 microversion: 2.1 time: 0.032257 Jul 19 23:33:42.884871 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3447/6902] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:33:42 2022] GET /compute/v2.1/servers/9429e5e0-e487-4401-b05f-3fe3e9e2e782 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:33:42.891081 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9bfcf3ae-e35a-425f-9b86-6e5c33458a7c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '.version_select at 0x7f7a03f783a0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:33:42.910366 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9bfcf3ae-e35a-425f-9b86-6e5c33458a7c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1518899070" status: 202 len: 0 microversion: 2.1 time: 0.023417 Jul 19 23:33:42.910945 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3456/6903] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 19 23:33:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1518899070 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 23:33:51.840585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-07905732-52e3-4166-ad91-1be453e590b6 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Action: 'create', calling method: .version_select at 0x7f7a03a33280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-745232966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUlRgwb+eok1nxNnQo7e92uciKak38c6eSnYfZ7z035DNTbdxZ724ThvBWjDBH7pmnlqkEltGCgdAkKORtfm/a2ppCOwf2PzJyJd3cFeQ/0piVRoG+XzuARfqb84ZUFJg=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:33:51.857337 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-07905732-52e3-4166-ad91-1be453e590b6 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Getting quotas for project 78238a06f1c645b4a145710a4b1c0c01. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:33:51.863381 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-07905732-52e3-4166-ad91-1be453e590b6 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Getting quotas for user f0883f3e353340a4b67bf932f3cbcb03 and project 78238a06f1c645b4a145710a4b1c0c01. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:33:51.891273 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-07905732-52e3-4166-ad91-1be453e590b6 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.054604 Jul 19 23:33:51.891881 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3448/6904] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 23:33:51 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:33:51.937921 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:33:51.942164 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f7416517-734f-4b07-8385-940ac09a57fd tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1934388685", "imageRef": "aded642b-6a54-47d2-ae5e-40567a15f4bc", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-745232966", "networks": [{"uuid": "775bc66a-282c-433a-81c9-925ad963cf63"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:33:51.994146 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-f7416517-734f-4b07-8385-940ac09a57fd tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] validate_networks() for [('775bc66a-282c-433a-81c9-925ad963cf63', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:33:52.417464 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-f7416517-734f-4b07-8385-940ac09a57fd tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:33:52.417913 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-f7416517-734f-4b07-8385-940ac09a57fd tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:33:52.418450 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-f7416517-734f-4b07-8385-940ac09a57fd tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:33:52.418882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-f7416517-734f-4b07-8385-940ac09a57fd tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:33:52.419350 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-f7416517-734f-4b07-8385-940ac09a57fd tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:33:52.428325 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f7416517-734f-4b07-8385-940ac09a57fd tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:52.428798 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f7416517-734f-4b07-8385-940ac09a57fd tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:52.429659 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f7416517-734f-4b07-8385-940ac09a57fd tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:52.430118 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f7416517-734f-4b07-8385-940ac09a57fd tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:52.447521 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-f7416517-734f-4b07-8385-940ac09a57fd tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Getting quotas for project 78238a06f1c645b4a145710a4b1c0c01. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:33:52.453790 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-f7416517-734f-4b07-8385-940ac09a57fd tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Getting quotas for user f0883f3e353340a4b67bf932f3cbcb03 and project 78238a06f1c645b4a145710a4b1c0c01. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:33:52.466244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f7416517-734f-4b07-8385-940ac09a57fd tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:33:52.468709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f7416517-734f-4b07-8385-940ac09a57fd tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aded642b-6a54-47d2-ae5e-40567a15f4bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:33:52.514695 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f7416517-734f-4b07-8385-940ac09a57fd tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578382 Jul 19 23:33:52.515907 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3457/6905] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:33:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:33:52.525882 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-33915c5a-ee11-4121-b644-ff0a52740a25 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:33:52.526508 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-33915c5a-ee11-4121-b644-ff0a52740a25 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:33:52.584501 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-33915c5a-ee11-4121-b644-ff0a52740a25 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:33:52.591431 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-33915c5a-ee11-4121-b644-ff0a52740a25 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1258 microversion: 2.1 time: 0.069461 Jul 19 23:33:52.592012 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3449/6906] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:33:52 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:33:53.609856 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3b1a3c65-6ae9-4bd8-8741-afaa5cc9c536 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:33:53.610758 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3b1a3c65-6ae9-4bd8-8741-afaa5cc9c536 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:33:53.619209 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b1a3c65-6ae9-4bd8-8741-afaa5cc9c536 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:53.619709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b1a3c65-6ae9-4bd8-8741-afaa5cc9c536 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:53.620516 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b1a3c65-6ae9-4bd8-8741-afaa5cc9c536 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:53.620973 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b1a3c65-6ae9-4bd8-8741-afaa5cc9c536 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:54.074172 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3b1a3c65-6ae9-4bd8-8741-afaa5cc9c536 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:33:54.083645 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3b1a3c65-6ae9-4bd8-8741-afaa5cc9c536 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1328 microversion: 2.1 time: 0.477915 Jul 19 23:33:54.095610 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3458/6907] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:33:53 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1328 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:33:55.101892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e14c565a-e83d-47ec-916b-8d07340f8888 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:33:55.102614 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e14c565a-e83d-47ec-916b-8d07340f8888 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:33:55.105795 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:33:55.116202 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e14c565a-e83d-47ec-916b-8d07340f8888 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:55.116714 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e14c565a-e83d-47ec-916b-8d07340f8888 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:55.117515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e14c565a-e83d-47ec-916b-8d07340f8888 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:55.117964 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e14c565a-e83d-47ec-916b-8d07340f8888 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:55.275764 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e14c565a-e83d-47ec-916b-8d07340f8888 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:33:55.284043 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e14c565a-e83d-47ec-916b-8d07340f8888 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1358 microversion: 2.1 time: 0.186026 Jul 19 23:33:55.284647 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3450/6908] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:33:55 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:33:56.301455 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-974c12f0-eb77-4c72-b4b8-6f5de946ea30 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:33:56.302163 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-974c12f0-eb77-4c72-b4b8-6f5de946ea30 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:33:56.309449 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-974c12f0-eb77-4c72-b4b8-6f5de946ea30 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:56.309917 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-974c12f0-eb77-4c72-b4b8-6f5de946ea30 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:56.310705 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-974c12f0-eb77-4c72-b4b8-6f5de946ea30 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:56.311174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-974c12f0-eb77-4c72-b4b8-6f5de946ea30 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:56.465842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-974c12f0-eb77-4c72-b4b8-6f5de946ea30 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:33:56.474244 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-974c12f0-eb77-4c72-b4b8-6f5de946ea30 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1358 microversion: 2.1 time: 0.176681 Jul 19 23:33:56.474836 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3459/6909] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:33:56 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:33:57.491459 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9e10cbde-fea5-4f22-bbd5-091846bed7e2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:33:57.492076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9e10cbde-fea5-4f22-bbd5-091846bed7e2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:33:57.500152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e10cbde-fea5-4f22-bbd5-091846bed7e2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:57.500692 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e10cbde-fea5-4f22-bbd5-091846bed7e2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:57.501503 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e10cbde-fea5-4f22-bbd5-091846bed7e2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:57.501975 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9e10cbde-fea5-4f22-bbd5-091846bed7e2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:57.642665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9e10cbde-fea5-4f22-bbd5-091846bed7e2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:33:57.650529 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9e10cbde-fea5-4f22-bbd5-091846bed7e2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1358 microversion: 2.1 time: 0.163078 Jul 19 23:33:57.651155 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3451/6910] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:33:57 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:33:58.668834 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d5c42dee-89e9-466d-94b7-6151acbf29a0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:33:58.669620 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d5c42dee-89e9-466d-94b7-6151acbf29a0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:33:58.677624 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5c42dee-89e9-466d-94b7-6151acbf29a0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:58.678082 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5c42dee-89e9-466d-94b7-6151acbf29a0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:58.679049 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5c42dee-89e9-466d-94b7-6151acbf29a0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:58.679747 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5c42dee-89e9-466d-94b7-6151acbf29a0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:58.836417 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d5c42dee-89e9-466d-94b7-6151acbf29a0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:33:58.844401 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d5c42dee-89e9-466d-94b7-6151acbf29a0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1358 microversion: 2.1 time: 0.180092 Jul 19 23:33:58.846192 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3460/6911] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:33:58 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:33:59.861531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-475340a5-da1a-4e0d-a50b-929fa181fb58 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:33:59.862156 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-475340a5-da1a-4e0d-a50b-929fa181fb58 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:33:59.864886 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:33:59.870968 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-475340a5-da1a-4e0d-a50b-929fa181fb58 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:59.871453 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-475340a5-da1a-4e0d-a50b-929fa181fb58 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:33:59.872227 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-475340a5-da1a-4e0d-a50b-929fa181fb58 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:33:59.872666 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-475340a5-da1a-4e0d-a50b-929fa181fb58 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:00.018635 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-475340a5-da1a-4e0d-a50b-929fa181fb58 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:34:00.026685 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-475340a5-da1a-4e0d-a50b-929fa181fb58 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1358 microversion: 2.1 time: 0.169237 Jul 19 23:34:00.027478 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3452/6912] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:33:59 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:34:01.042916 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2cd02760-4c73-4e9b-8aca-fd51c7df1729 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:34:01.043638 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2cd02760-4c73-4e9b-8aca-fd51c7df1729 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:34:01.046368 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:34:01.053556 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2cd02760-4c73-4e9b-8aca-fd51c7df1729 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:01.054053 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2cd02760-4c73-4e9b-8aca-fd51c7df1729 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:01.055591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2cd02760-4c73-4e9b-8aca-fd51c7df1729 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:01.055712 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2cd02760-4c73-4e9b-8aca-fd51c7df1729 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:01.199433 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2cd02760-4c73-4e9b-8aca-fd51c7df1729 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:34:01.208532 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2cd02760-4c73-4e9b-8aca-fd51c7df1729 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1358 microversion: 2.1 time: 0.169473 Jul 19 23:34:01.209111 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3461/6913] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:34:01 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:34:02.234234 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dd321875-e94d-482f-a0be-b31be7efd173 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:34:02.238643 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dd321875-e94d-482f-a0be-b31be7efd173 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:34:02.242830 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd321875-e94d-482f-a0be-b31be7efd173 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:02.246772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd321875-e94d-482f-a0be-b31be7efd173 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:02.246772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd321875-e94d-482f-a0be-b31be7efd173 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:02.246772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd321875-e94d-482f-a0be-b31be7efd173 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:02.480067 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dd321875-e94d-482f-a0be-b31be7efd173 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:34:02.487684 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dd321875-e94d-482f-a0be-b31be7efd173 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1358 microversion: 2.1 time: 0.265463 Jul 19 23:34:02.488268 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3453/6914] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:34:02 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:34:02.947817 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:34:02.948639 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:34:03.037538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-0e041f64-4ccc-44e5-852d-910dd9e2ebcb req-03e39d43-9a1d-4d10-acbc-b52575529f6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1", "tag": "7fefbd6f-822b-435c-b3cf-7c066d11c1cf"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:34:03.046054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-0e041f64-4ccc-44e5-852d-910dd9e2ebcb req-03e39d43-9a1d-4d10-acbc-b52575529f6a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:03.046676 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-0e041f64-4ccc-44e5-852d-910dd9e2ebcb req-03e39d43-9a1d-4d10-acbc-b52575529f6a service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:03.059642 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-0e041f64-4ccc-44e5-852d-910dd9e2ebcb req-03e39d43-9a1d-4d10-acbc-b52575529f6a service nova] Creating event network-changed:7fefbd6f-822b-435c-b3cf-7c066d11c1cf for instance d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 on n-h1-847009-3 Jul 19 23:34:03.065499 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-0e041f64-4ccc-44e5-852d-910dd9e2ebcb req-03e39d43-9a1d-4d10-acbc-b52575529f6a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124637 Jul 19 23:34:03.066216 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3462/6915] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:34:03.504910 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f849f7db-7d53-4b62-8fc8-3c4a3c52e09b tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:34:03.505575 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f849f7db-7d53-4b62-8fc8-3c4a3c52e09b tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:34:03.507476 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:34:03.514102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f849f7db-7d53-4b62-8fc8-3c4a3c52e09b tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:03.514559 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f849f7db-7d53-4b62-8fc8-3c4a3c52e09b tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:03.515374 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f849f7db-7d53-4b62-8fc8-3c4a3c52e09b tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:03.515834 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f849f7db-7d53-4b62-8fc8-3c4a3c52e09b tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:03.653093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f849f7db-7d53-4b62-8fc8-3c4a3c52e09b tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:34:03.660926 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f849f7db-7d53-4b62-8fc8-3c4a3c52e09b tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1358 microversion: 2.1 time: 0.160065 Jul 19 23:34:03.661506 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3454/6916] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:34:03 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:34:04.680127 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1eccef57-38dc-433a-b9fa-9dfeebc23130 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:34:04.680875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1eccef57-38dc-433a-b9fa-9dfeebc23130 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:34:04.687274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1eccef57-38dc-433a-b9fa-9dfeebc23130 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:04.687678 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1eccef57-38dc-433a-b9fa-9dfeebc23130 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:04.688453 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1eccef57-38dc-433a-b9fa-9dfeebc23130 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:04.688899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1eccef57-38dc-433a-b9fa-9dfeebc23130 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:04.915531 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1eccef57-38dc-433a-b9fa-9dfeebc23130 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:34:04.922922 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1eccef57-38dc-433a-b9fa-9dfeebc23130 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1358 microversion: 2.1 time: 0.248027 Jul 19 23:34:04.924803 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3463/6917] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:34:04 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:34:05.940685 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d0300d9a-fead-4ac7-b2ea-770c79e432de tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:34:05.941293 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d0300d9a-fead-4ac7-b2ea-770c79e432de tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:34:05.948610 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d0300d9a-fead-4ac7-b2ea-770c79e432de tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:05.949060 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d0300d9a-fead-4ac7-b2ea-770c79e432de tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:05.949839 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d0300d9a-fead-4ac7-b2ea-770c79e432de tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:05.950259 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d0300d9a-fead-4ac7-b2ea-770c79e432de tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:06.085102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d0300d9a-fead-4ac7-b2ea-770c79e432de tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:34:06.092753 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d0300d9a-fead-4ac7-b2ea-770c79e432de tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1358 microversion: 2.1 time: 0.156211 Jul 19 23:34:06.093333 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3455/6918] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:34:05 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:34:07.110466 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-14a6b605-fb90-4246-b0d7-6ada057f773e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:34:07.111186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-14a6b605-fb90-4246-b0d7-6ada057f773e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:34:07.118194 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14a6b605-fb90-4246-b0d7-6ada057f773e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:07.118667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14a6b605-fb90-4246-b0d7-6ada057f773e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:07.119507 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14a6b605-fb90-4246-b0d7-6ada057f773e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:07.119953 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-14a6b605-fb90-4246-b0d7-6ada057f773e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:07.255162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-14a6b605-fb90-4246-b0d7-6ada057f773e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:34:07.262662 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-14a6b605-fb90-4246-b0d7-6ada057f773e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1358 microversion: 2.1 time: 0.156425 Jul 19 23:34:07.263269 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3464/6919] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:34:07 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:34:08.280429 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dd8ce7ea-7118-4672-aab9-19d90151f359 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:34:08.281048 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dd8ce7ea-7118-4672-aab9-19d90151f359 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:34:08.288097 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd8ce7ea-7118-4672-aab9-19d90151f359 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:08.288549 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd8ce7ea-7118-4672-aab9-19d90151f359 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:08.289470 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd8ce7ea-7118-4672-aab9-19d90151f359 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:08.289763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd8ce7ea-7118-4672-aab9-19d90151f359 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:08.421382 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dd8ce7ea-7118-4672-aab9-19d90151f359 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:34:08.429377 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dd8ce7ea-7118-4672-aab9-19d90151f359 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1358 microversion: 2.1 time: 0.152892 Jul 19 23:34:08.429959 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3456/6920] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:34:08 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:34:08.994331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-1bf92ffa-5aaa-41f8-b240-4079a9424831 req-f2f88286-0113-495b-87f7-0f68c285001c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1", "name": "network-vif-plugged", "status": "completed", "tag": "7fefbd6f-822b-435c-b3cf-7c066d11c1cf"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:34:09.004535 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1bf92ffa-5aaa-41f8-b240-4079a9424831 req-f2f88286-0113-495b-87f7-0f68c285001c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:09.005010 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1bf92ffa-5aaa-41f8-b240-4079a9424831 req-f2f88286-0113-495b-87f7-0f68c285001c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:09.015907 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-1bf92ffa-5aaa-41f8-b240-4079a9424831 req-f2f88286-0113-495b-87f7-0f68c285001c service nova] Creating event network-vif-plugged:7fefbd6f-822b-435c-b3cf-7c066d11c1cf for instance d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 on n-h1-847009-3 Jul 19 23:34:09.021181 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-1bf92ffa-5aaa-41f8-b240-4079a9424831 req-f2f88286-0113-495b-87f7-0f68c285001c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090430 Jul 19 23:34:09.021836 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3465/6921] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:34:09.447912 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-96ebd768-3283-4268-821d-1abb8060d324 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:34:09.448523 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-96ebd768-3283-4268-821d-1abb8060d324 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:34:09.455450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96ebd768-3283-4268-821d-1abb8060d324 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:09.455901 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96ebd768-3283-4268-821d-1abb8060d324 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:09.456661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96ebd768-3283-4268-821d-1abb8060d324 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:09.457094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96ebd768-3283-4268-821d-1abb8060d324 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:09.588810 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-96ebd768-3283-4268-821d-1abb8060d324 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:34:09.596448 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-96ebd768-3283-4268-821d-1abb8060d324 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1358 microversion: 2.1 time: 0.152726 Jul 19 23:34:09.597027 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3457/6922] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:34:09 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:34:10.615156 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0a41ad1a-7e9a-425f-9e1e-2b967a10c8fc tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:34:10.615883 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0a41ad1a-7e9a-425f-9e1e-2b967a10c8fc tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:34:10.622349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a41ad1a-7e9a-425f-9e1e-2b967a10c8fc tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:10.624074 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a41ad1a-7e9a-425f-9e1e-2b967a10c8fc tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:10.624869 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a41ad1a-7e9a-425f-9e1e-2b967a10c8fc tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:10.625321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0a41ad1a-7e9a-425f-9e1e-2b967a10c8fc tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:10.768016 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0a41ad1a-7e9a-425f-9e1e-2b967a10c8fc tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:34:10.775740 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0a41ad1a-7e9a-425f-9e1e-2b967a10c8fc tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1549 microversion: 2.1 time: 0.166197 Jul 19 23:34:10.776523 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3466/6923] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:34:10 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1549 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:34:10.792326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c0d3cf1e-be0a-4f6a-8dcf-f3742cd94ef6 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:34:10.792949 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c0d3cf1e-be0a-4f6a-8dcf-f3742cd94ef6 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:34:10.799993 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0d3cf1e-be0a-4f6a-8dcf-f3742cd94ef6 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:10.800450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0d3cf1e-be0a-4f6a-8dcf-f3742cd94ef6 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:10.801225 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0d3cf1e-be0a-4f6a-8dcf-f3742cd94ef6 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:10.801667 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0d3cf1e-be0a-4f6a-8dcf-f3742cd94ef6 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:10.933268 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c0d3cf1e-be0a-4f6a-8dcf-f3742cd94ef6 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:34:10.941461 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c0d3cf1e-be0a-4f6a-8dcf-f3742cd94ef6 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1549 microversion: 2.1 time: 0.153297 Jul 19 23:34:10.942037 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3458/6924] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:34:10 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:34:10.957247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-36f9e9e9-8e12-47de-8e2a-c97303ccad0d tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:34:10.960581 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-36f9e9e9-8e12-47de-8e2a-c97303ccad0d tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:34:10.961365 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-36f9e9e9-8e12-47de-8e2a-c97303ccad0d tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Searching by: {'deleted': False, 'project_id': '78238a06f1c645b4a145710a4b1c0c01'} {{(pid=119337) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 23:34:10.967492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36f9e9e9-8e12-47de-8e2a-c97303ccad0d tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:10.967950 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36f9e9e9-8e12-47de-8e2a-c97303ccad0d tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:10.968746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36f9e9e9-8e12-47de-8e2a-c97303ccad0d tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:10.969195 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36f9e9e9-8e12-47de-8e2a-c97303ccad0d tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:10.995412 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.multi_cell_list [None req-36f9e9e9-8e12-47de-8e2a-c97303ccad0d tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119337) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 23:34:11.022877 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-36f9e9e9-8e12-47de-8e2a-c97303ccad0d tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.069411 Jul 19 23:34:11.023505 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3467/6925] 10.222.0.25 () {58 vars in 1124 bytes} [Tue Jul 19 23:34:10 2022] GET /compute/v2.1/servers => generated 343 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:34:11.034323 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-53ff3c2f-5bdd-4aef-8807-625aa676b24e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:34:11.034943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-53ff3c2f-5bdd-4aef-8807-625aa676b24e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:34:11.041054 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53ff3c2f-5bdd-4aef-8807-625aa676b24e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:11.041508 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53ff3c2f-5bdd-4aef-8807-625aa676b24e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:11.042275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53ff3c2f-5bdd-4aef-8807-625aa676b24e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:11.042714 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-53ff3c2f-5bdd-4aef-8807-625aa676b24e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:11.172630 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-53ff3c2f-5bdd-4aef-8807-625aa676b24e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:34:11.181043 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-53ff3c2f-5bdd-4aef-8807-625aa676b24e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1549 microversion: 2.1 time: 0.151161 Jul 19 23:34:11.181630 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3459/6926] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:34:11 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:34:12.665575 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-223daa16-6217-4684-ab67-84c7d6d06dcb tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e5ee781-22de-499a-bc27-7ab4dc263d20"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:34:12.666669 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-223daa16-6217-4684-ab67-84c7d6d06dcb tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:34:12.674294 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-223daa16-6217-4684-ab67-84c7d6d06dcb tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:12.674762 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-223daa16-6217-4684-ab67-84c7d6d06dcb tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:12.675573 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-223daa16-6217-4684-ab67-84c7d6d06dcb tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:12.676034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-223daa16-6217-4684-ab67-84c7d6d06dcb tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:12.918514 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-223daa16-6217-4684-ab67-84c7d6d06dcb tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "POST /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256720 Jul 19 23:34:12.919412 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3468/6927] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 19 23:34:12 2022] POST /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:34:23.647327 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d80b915e-b2b6-4298-8ad7-ca12af474bc2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:34:23.647944 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d80b915e-b2b6-4298-8ad7-ca12af474bc2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:34:23.650805 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=15 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:34:23.651623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=60 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:34:23.658525 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d80b915e-b2b6-4298-8ad7-ca12af474bc2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:23.658998 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d80b915e-b2b6-4298-8ad7-ca12af474bc2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:23.659816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d80b915e-b2b6-4298-8ad7-ca12af474bc2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:23.660271 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d80b915e-b2b6-4298-8ad7-ca12af474bc2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:23.793700 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d80b915e-b2b6-4298-8ad7-ca12af474bc2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:34:23.802373 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d80b915e-b2b6-4298-8ad7-ca12af474bc2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1595 microversion: 2.1 time: 0.158866 Jul 19 23:34:23.802950 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3460/6928] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:34:23 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1595 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:34:25.562440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:34:25.563387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=15 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:34:25.563890 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:34:25.568690 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-6e6baff4-76d2-4a30-a889-565e1170f92f req-24367d13-a60a-4ffb-992f-64f1f613c258 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1", "tag": "7fefbd6f-822b-435c-b3cf-7c066d11c1cf"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:34:25.579287 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-6e6baff4-76d2-4a30-a889-565e1170f92f req-24367d13-a60a-4ffb-992f-64f1f613c258 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:25.580310 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-6e6baff4-76d2-4a30-a889-565e1170f92f req-24367d13-a60a-4ffb-992f-64f1f613c258 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:25.593793 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-6e6baff4-76d2-4a30-a889-565e1170f92f req-24367d13-a60a-4ffb-992f-64f1f613c258 service nova] Creating event network-changed:7fefbd6f-822b-435c-b3cf-7c066d11c1cf for instance d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 on n-h1-847009-3 Jul 19 23:34:25.601342 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-6e6baff4-76d2-4a30-a889-565e1170f92f req-24367d13-a60a-4ffb-992f-64f1f613c258 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040404 Jul 19 23:34:25.605589 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3469/6929] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:34:26.660709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-595ed04c-eed5-4db1-8bd5-a8b0e0c3e0d2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1409288597"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:34:26.661387 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-595ed04c-eed5-4db1-8bd5-a8b0e0c3e0d2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:34:26.669546 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-595ed04c-eed5-4db1-8bd5-a8b0e0c3e0d2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:26.671057 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-595ed04c-eed5-4db1-8bd5-a8b0e0c3e0d2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:26.672715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-595ed04c-eed5-4db1-8bd5-a8b0e0c3e0d2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:26.673154 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-595ed04c-eed5-4db1-8bd5-a8b0e0c3e0d2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:26.832090 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.network.security_group_api [None req-595ed04c-eed5-4db1-8bd5-a8b0e0c3e0d2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Adding security group 5584e754-1c01-4442-924f-45c996a399f8 to port 7fefbd6f-822b-435c-b3cf-7c066d11c1cf Jul 19 23:34:27.185232 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-595ed04c-eed5-4db1-8bd5-a8b0e0c3e0d2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "POST /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1/action" status: 202 len: 0 microversion: 2.1 time: 0.530003 Jul 19 23:34:27.185868 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3461/6930] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:34:26 2022] POST /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:34:27.201101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-740d4f63-d0db-4915-9a87-519c4a3761d0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:34:27.202347 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-740d4f63-d0db-4915-9a87-519c4a3761d0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:34:27.212331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-740d4f63-d0db-4915-9a87-519c4a3761d0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:27.213048 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-740d4f63-d0db-4915-9a87-519c4a3761d0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:27.213853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-740d4f63-d0db-4915-9a87-519c4a3761d0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:27.214473 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-740d4f63-d0db-4915-9a87-519c4a3761d0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:27.402501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-740d4f63-d0db-4915-9a87-519c4a3761d0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:34:27.410661 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-740d4f63-d0db-4915-9a87-519c4a3761d0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1761 microversion: 2.1 time: 0.220086 Jul 19 23:34:27.411267 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3470/6931] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:34:27 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1761 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:34:27.617415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-031e4546-63b6-4da7-a232-48846fcc628b req-ed7a1a83-d525-43bd-ae51-af3a99dccb6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1", "tag": "7fefbd6f-822b-435c-b3cf-7c066d11c1cf"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:34:27.625912 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-031e4546-63b6-4da7-a232-48846fcc628b req-ed7a1a83-d525-43bd-ae51-af3a99dccb6c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:27.626409 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-031e4546-63b6-4da7-a232-48846fcc628b req-ed7a1a83-d525-43bd-ae51-af3a99dccb6c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:27.639920 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-031e4546-63b6-4da7-a232-48846fcc628b req-ed7a1a83-d525-43bd-ae51-af3a99dccb6c service nova] Creating event network-changed:7fefbd6f-822b-435c-b3cf-7c066d11c1cf for instance d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 on n-h1-847009-3 Jul 19 23:34:27.645338 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-031e4546-63b6-4da7-a232-48846fcc628b req-ed7a1a83-d525-43bd-ae51-af3a99dccb6c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031653 Jul 19 23:34:27.645949 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3462/6932] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:34:50.099971 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=4 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:34:50.100733 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=8 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:34:50.146220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-820ff9aa-5fb0-4e30-a027-77047140e541 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:34:50.147291 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-820ff9aa-5fb0-4e30-a027-77047140e541 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:34:50.153406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-820ff9aa-5fb0-4e30-a027-77047140e541 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:50.153873 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-820ff9aa-5fb0-4e30-a027-77047140e541 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:50.154652 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-820ff9aa-5fb0-4e30-a027-77047140e541 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:50.155122 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-820ff9aa-5fb0-4e30-a027-77047140e541 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:50.228376 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-820ff9aa-5fb0-4e30-a027-77047140e541 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "POST /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1/action" status: 202 len: 0 microversion: 2.1 time: 0.133656 Jul 19 23:34:50.229001 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3471/6933] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:34:50 2022] POST /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:34:50.237536 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d538ad9a-3df1-4124-933b-1eac8f122cfe tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:34:50.238266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d538ad9a-3df1-4124-933b-1eac8f122cfe tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:34:50.242480 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:34:50.243141 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=12 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:34:50.248151 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d538ad9a-3df1-4124-933b-1eac8f122cfe tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:50.248706 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d538ad9a-3df1-4124-933b-1eac8f122cfe tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:50.249505 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d538ad9a-3df1-4124-933b-1eac8f122cfe tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:50.249952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d538ad9a-3df1-4124-933b-1eac8f122cfe tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:50.490762 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d538ad9a-3df1-4124-933b-1eac8f122cfe tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:34:50.499163 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d538ad9a-3df1-4124-933b-1eac8f122cfe tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1753 microversion: 2.1 time: 0.265723 Jul 19 23:34:50.499756 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3463/6934] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:34:50 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1753 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:34:51.518375 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-799bdb27-ca73-4e20-8336-3135fd8410d2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:34:51.519084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-799bdb27-ca73-4e20-8336-3135fd8410d2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:34:51.526078 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-799bdb27-ca73-4e20-8336-3135fd8410d2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:51.526536 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-799bdb27-ca73-4e20-8336-3135fd8410d2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:51.527335 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-799bdb27-ca73-4e20-8336-3135fd8410d2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:51.527786 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-799bdb27-ca73-4e20-8336-3135fd8410d2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:51.672918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-799bdb27-ca73-4e20-8336-3135fd8410d2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:34:51.681588 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-799bdb27-ca73-4e20-8336-3135fd8410d2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1758 microversion: 2.1 time: 0.168366 Jul 19 23:34:51.682161 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3472/6935] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:34:51 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:34:52.699081 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-31ef5415-94e2-4bd2-8bb2-cae7c03e9fe5 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:34:52.699715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-31ef5415-94e2-4bd2-8bb2-cae7c03e9fe5 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:34:52.706990 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31ef5415-94e2-4bd2-8bb2-cae7c03e9fe5 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:52.707465 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31ef5415-94e2-4bd2-8bb2-cae7c03e9fe5 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:52.709271 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31ef5415-94e2-4bd2-8bb2-cae7c03e9fe5 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:52.709710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-31ef5415-94e2-4bd2-8bb2-cae7c03e9fe5 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:52.854607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-31ef5415-94e2-4bd2-8bb2-cae7c03e9fe5 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:34:52.862772 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-31ef5415-94e2-4bd2-8bb2-cae7c03e9fe5 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1758 microversion: 2.1 time: 0.167830 Jul 19 23:34:52.863404 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3464/6936] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:34:52 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:34:53.881281 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-66594396-b634-4b4f-af40-33fcf171b21e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:34:53.881914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-66594396-b634-4b4f-af40-33fcf171b21e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:34:53.888841 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-66594396-b634-4b4f-af40-33fcf171b21e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:53.889307 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-66594396-b634-4b4f-af40-33fcf171b21e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:53.890087 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-66594396-b634-4b4f-af40-33fcf171b21e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:53.890546 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-66594396-b634-4b4f-af40-33fcf171b21e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:54.042297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-66594396-b634-4b4f-af40-33fcf171b21e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:34:54.050377 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-66594396-b634-4b4f-af40-33fcf171b21e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1758 microversion: 2.1 time: 0.173709 Jul 19 23:34:54.050942 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3473/6937] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:34:53 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:34:55.068637 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c9ac2b23-03d6-4689-8092-8e70ff34d3c5 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:34:55.069164 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c9ac2b23-03d6-4689-8092-8e70ff34d3c5 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:34:55.076454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c9ac2b23-03d6-4689-8092-8e70ff34d3c5 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:55.076898 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c9ac2b23-03d6-4689-8092-8e70ff34d3c5 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:55.077661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c9ac2b23-03d6-4689-8092-8e70ff34d3c5 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:55.078095 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c9ac2b23-03d6-4689-8092-8e70ff34d3c5 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:55.227170 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c9ac2b23-03d6-4689-8092-8e70ff34d3c5 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:34:55.240549 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c9ac2b23-03d6-4689-8092-8e70ff34d3c5 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1758 microversion: 2.1 time: 0.176164 Jul 19 23:34:55.241453 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3465/6938] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:34:55 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:34:56.259097 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-17755efc-fe6e-4cf0-a5fc-1da8a7753f37 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:34:56.259760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-17755efc-fe6e-4cf0-a5fc-1da8a7753f37 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:34:56.266625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-17755efc-fe6e-4cf0-a5fc-1da8a7753f37 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:56.267092 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-17755efc-fe6e-4cf0-a5fc-1da8a7753f37 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:56.267907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-17755efc-fe6e-4cf0-a5fc-1da8a7753f37 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:56.268362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-17755efc-fe6e-4cf0-a5fc-1da8a7753f37 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:56.499041 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-17755efc-fe6e-4cf0-a5fc-1da8a7753f37 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:34:56.507098 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-17755efc-fe6e-4cf0-a5fc-1da8a7753f37 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1758 microversion: 2.1 time: 0.253069 Jul 19 23:34:56.507700 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3474/6939] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:34:56 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1758 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:34:57.525142 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-aef67925-5736-428e-bd1a-39175b1ce016 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:34:57.525767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-aef67925-5736-428e-bd1a-39175b1ce016 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:34:57.532847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aef67925-5736-428e-bd1a-39175b1ce016 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:57.533328 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aef67925-5736-428e-bd1a-39175b1ce016 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:57.534121 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aef67925-5736-428e-bd1a-39175b1ce016 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:57.534568 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-aef67925-5736-428e-bd1a-39175b1ce016 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:57.682340 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-aef67925-5736-428e-bd1a-39175b1ce016 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:34:57.690405 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-aef67925-5736-428e-bd1a-39175b1ce016 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1758 microversion: 2.1 time: 0.169909 Jul 19 23:34:57.690988 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3466/6940] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:34:57 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:34:58.709204 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8431515a-cd99-4507-9d9e-14b3a1ed373e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:34:58.709842 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8431515a-cd99-4507-9d9e-14b3a1ed373e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:34:58.716801 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8431515a-cd99-4507-9d9e-14b3a1ed373e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:58.717267 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8431515a-cd99-4507-9d9e-14b3a1ed373e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:58.718050 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8431515a-cd99-4507-9d9e-14b3a1ed373e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:58.718508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8431515a-cd99-4507-9d9e-14b3a1ed373e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:58.868989 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8431515a-cd99-4507-9d9e-14b3a1ed373e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:34:58.877099 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8431515a-cd99-4507-9d9e-14b3a1ed373e tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1758 microversion: 2.1 time: 0.171941 Jul 19 23:34:58.877662 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3475/6941] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:34:58 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:34:59.895120 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a7ac3f54-b548-40e7-a2b9-7796be806052 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:34:59.896355 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a7ac3f54-b548-40e7-a2b9-7796be806052 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:34:59.903248 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a7ac3f54-b548-40e7-a2b9-7796be806052 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:59.903710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a7ac3f54-b548-40e7-a2b9-7796be806052 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:34:59.904486 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a7ac3f54-b548-40e7-a2b9-7796be806052 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:34:59.904932 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a7ac3f54-b548-40e7-a2b9-7796be806052 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:00.047735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a7ac3f54-b548-40e7-a2b9-7796be806052 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:35:00.056417 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a7ac3f54-b548-40e7-a2b9-7796be806052 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1758 microversion: 2.1 time: 0.165249 Jul 19 23:35:00.057006 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3467/6942] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:34:59 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:35:01.074113 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-37a62891-eb54-4710-8411-f5b52192a1e3 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:35:01.074786 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-37a62891-eb54-4710-8411-f5b52192a1e3 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:35:01.081942 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37a62891-eb54-4710-8411-f5b52192a1e3 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:01.082409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37a62891-eb54-4710-8411-f5b52192a1e3 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:01.083719 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37a62891-eb54-4710-8411-f5b52192a1e3 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:01.084176 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37a62891-eb54-4710-8411-f5b52192a1e3 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:01.234641 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-37a62891-eb54-4710-8411-f5b52192a1e3 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:35:01.243903 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-37a62891-eb54-4710-8411-f5b52192a1e3 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1758 microversion: 2.1 time: 0.174150 Jul 19 23:35:01.244487 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3476/6943] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:35:01 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:35:02.262015 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-81fc6e10-fd4a-4094-aa99-f4364b06e33a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:35:02.262626 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-81fc6e10-fd4a-4094-aa99-f4364b06e33a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:35:02.268959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81fc6e10-fd4a-4094-aa99-f4364b06e33a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:02.269438 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81fc6e10-fd4a-4094-aa99-f4364b06e33a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:02.270222 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81fc6e10-fd4a-4094-aa99-f4364b06e33a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:02.270760 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-81fc6e10-fd4a-4094-aa99-f4364b06e33a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:02.415882 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-81fc6e10-fd4a-4094-aa99-f4364b06e33a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:35:02.423831 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-81fc6e10-fd4a-4094-aa99-f4364b06e33a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1758 microversion: 2.1 time: 0.165956 Jul 19 23:35:02.424405 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3468/6944] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:35:02 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:35:03.441275 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-477c31a2-1419-45ad-bdcb-963795308cc5 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:35:03.441911 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-477c31a2-1419-45ad-bdcb-963795308cc5 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:35:03.449725 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-477c31a2-1419-45ad-bdcb-963795308cc5 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:03.450279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-477c31a2-1419-45ad-bdcb-963795308cc5 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:03.451059 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-477c31a2-1419-45ad-bdcb-963795308cc5 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:03.451541 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-477c31a2-1419-45ad-bdcb-963795308cc5 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:03.597968 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-477c31a2-1419-45ad-bdcb-963795308cc5 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:35:03.606062 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-477c31a2-1419-45ad-bdcb-963795308cc5 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1758 microversion: 2.1 time: 0.168801 Jul 19 23:35:03.606632 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3477/6945] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:35:03 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:35:04.623945 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-79718538-51ce-4052-8eb2-20aeaf709602 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:35:04.624567 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-79718538-51ce-4052-8eb2-20aeaf709602 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:35:04.634402 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79718538-51ce-4052-8eb2-20aeaf709602 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:04.634850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79718538-51ce-4052-8eb2-20aeaf709602 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:04.635643 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79718538-51ce-4052-8eb2-20aeaf709602 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:04.636080 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-79718538-51ce-4052-8eb2-20aeaf709602 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:04.783178 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-79718538-51ce-4052-8eb2-20aeaf709602 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:35:04.791763 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-79718538-51ce-4052-8eb2-20aeaf709602 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1758 microversion: 2.1 time: 0.171699 Jul 19 23:35:04.792355 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3469/6946] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:35:04 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:35:05.809756 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-63b6362a-ee50-4469-8cf6-04050983b6c0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:35:05.810387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-63b6362a-ee50-4469-8cf6-04050983b6c0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:35:05.817606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63b6362a-ee50-4469-8cf6-04050983b6c0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:05.818158 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63b6362a-ee50-4469-8cf6-04050983b6c0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:05.818937 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63b6362a-ee50-4469-8cf6-04050983b6c0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:05.819409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63b6362a-ee50-4469-8cf6-04050983b6c0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:05.962734 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-63b6362a-ee50-4469-8cf6-04050983b6c0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:35:05.970892 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-63b6362a-ee50-4469-8cf6-04050983b6c0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1758 microversion: 2.1 time: 0.165009 Jul 19 23:35:05.971496 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3478/6947] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:35:05 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:35:06.988176 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-18c726fa-a214-4cfe-8f53-4baa4040d0b3 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:35:06.988690 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-18c726fa-a214-4cfe-8f53-4baa4040d0b3 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:35:06.996905 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-18c726fa-a214-4cfe-8f53-4baa4040d0b3 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:06.997363 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-18c726fa-a214-4cfe-8f53-4baa4040d0b3 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:06.998138 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-18c726fa-a214-4cfe-8f53-4baa4040d0b3 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:06.998575 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-18c726fa-a214-4cfe-8f53-4baa4040d0b3 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:07.157587 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-18c726fa-a214-4cfe-8f53-4baa4040d0b3 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:35:07.167193 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-18c726fa-a214-4cfe-8f53-4baa4040d0b3 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1761 microversion: 2.1 time: 0.182977 Jul 19 23:35:07.167819 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3470/6948] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:35:06 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1761 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:35:39.938830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b37c5d9b-639e-4ae3-8035-d39a647fabdd tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1409288597"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:35:39.939482 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b37c5d9b-639e-4ae3-8035-d39a647fabdd tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:35:39.941556 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=16 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:35:39.942225 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:35:39.948922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b37c5d9b-639e-4ae3-8035-d39a647fabdd tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:39.949381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b37c5d9b-639e-4ae3-8035-d39a647fabdd tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:39.950155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b37c5d9b-639e-4ae3-8035-d39a647fabdd tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:39.950601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b37c5d9b-639e-4ae3-8035-d39a647fabdd tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:40.083748 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.network.security_group_api [None req-b37c5d9b-639e-4ae3-8035-d39a647fabdd tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Removing security group 5584e754-1c01-4442-924f-45c996a399f8 from port 7fefbd6f-822b-435c-b3cf-7c066d11c1cf Jul 19 23:35:40.424682 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b37c5d9b-639e-4ae3-8035-d39a647fabdd tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "POST /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1/action" status: 202 len: 0 microversion: 2.1 time: 0.489908 Jul 19 23:35:40.446302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-e5a7ca03-96c8-4464-87bc-5d06cf2e0b88 req-57520c06-c64d-4499-8e97-99052cf875ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1", "tag": "7fefbd6f-822b-435c-b3cf-7c066d11c1cf"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:35:40.447392 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3479/6949] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:35:39 2022] POST /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:35:40.462495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=16 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:35:40.466128 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=48 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:35:40.469810 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e5a7ca03-96c8-4464-87bc-5d06cf2e0b88 req-57520c06-c64d-4499-8e97-99052cf875ce service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:40.472956 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e5a7ca03-96c8-4464-87bc-5d06cf2e0b88 req-57520c06-c64d-4499-8e97-99052cf875ce service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:40.490440 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-e5a7ca03-96c8-4464-87bc-5d06cf2e0b88 req-57520c06-c64d-4499-8e97-99052cf875ce service nova] Creating event network-changed:7fefbd6f-822b-435c-b3cf-7c066d11c1cf for instance d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 on n-h1-847009-3 Jul 19 23:35:40.510761 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-e5a7ca03-96c8-4464-87bc-5d06cf2e0b88 req-57520c06-c64d-4499-8e97-99052cf875ce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078843 Jul 19 23:35:40.512215 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3471/6950] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:35:41.547399 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-66f1fcb6-5261-4bac-a84c-5fadde84e87a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:35:41.547895 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-66f1fcb6-5261-4bac-a84c-5fadde84e87a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:35:41.555943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-66f1fcb6-5261-4bac-a84c-5fadde84e87a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:41.556410 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-66f1fcb6-5261-4bac-a84c-5fadde84e87a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:41.557198 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-66f1fcb6-5261-4bac-a84c-5fadde84e87a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:41.557652 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-66f1fcb6-5261-4bac-a84c-5fadde84e87a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:41.620715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-2a4c42d2-d2e9-4e63-bbd4-1f8207bdea37 req-5580a6b1-af62-419f-bd36-9663a0abea4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1", "tag": "7fefbd6f-822b-435c-b3cf-7c066d11c1cf"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:35:41.629301 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-2a4c42d2-d2e9-4e63-bbd4-1f8207bdea37 req-5580a6b1-af62-419f-bd36-9663a0abea4e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:41.629751 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-2a4c42d2-d2e9-4e63-bbd4-1f8207bdea37 req-5580a6b1-af62-419f-bd36-9663a0abea4e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:41.645089 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-2a4c42d2-d2e9-4e63-bbd4-1f8207bdea37 req-5580a6b1-af62-419f-bd36-9663a0abea4e service nova] Creating event network-changed:7fefbd6f-822b-435c-b3cf-7c066d11c1cf for instance d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 on n-h1-847009-3 Jul 19 23:35:41.650297 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-2a4c42d2-d2e9-4e63-bbd4-1f8207bdea37 req-5580a6b1-af62-419f-bd36-9663a0abea4e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103981 Jul 19 23:35:41.651308 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3472/6951] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:35:41.652096 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-66f1fcb6-5261-4bac-a84c-5fadde84e87a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lazy-loading 'services' on Instance uuid d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:35:41.735058 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-66f1fcb6-5261-4bac-a84c-5fadde84e87a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1/os-volume_attachments/9e5ee781-22de-499a-bc27-7ab4dc263d20" status: 202 len: 0 microversion: 2.1 time: 0.191498 Jul 19 23:35:41.735969 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3480/6952] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 19 23:35:41 2022] DELETE /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1/os-volume_attachments/9e5ee781-22de-499a-bc27-7ab4dc263d20 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:35:41.745668 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ffd47aee-fd69-4197-828f-045b964d83fe tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:35:41.746851 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ffd47aee-fd69-4197-828f-045b964d83fe tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:35:41.754745 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ffd47aee-fd69-4197-828f-045b964d83fe tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:41.755392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ffd47aee-fd69-4197-828f-045b964d83fe tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:41.757235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ffd47aee-fd69-4197-828f-045b964d83fe tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:41.757897 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ffd47aee-fd69-4197-828f-045b964d83fe tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:41.803887 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ffd47aee-fd69-4197-828f-045b964d83fe tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062781 Jul 19 23:35:41.804526 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3473/6953] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:35:41 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:35:42.817399 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-adc4e33d-58ff-41d9-8849-ee3f8b030b06 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:35:42.818853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-adc4e33d-58ff-41d9-8849-ee3f8b030b06 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:35:42.825572 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-adc4e33d-58ff-41d9-8849-ee3f8b030b06 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:42.826046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-adc4e33d-58ff-41d9-8849-ee3f8b030b06 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:42.826837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-adc4e33d-58ff-41d9-8849-ee3f8b030b06 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:42.827327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-adc4e33d-58ff-41d9-8849-ee3f8b030b06 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:42.858765 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-adc4e33d-58ff-41d9-8849-ee3f8b030b06 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046469 Jul 19 23:35:42.859367 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3481/6954] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:35:42 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:35:43.870859 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-29491518-ee77-420c-9841-ec1118208bc8 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:35:43.871915 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-29491518-ee77-420c-9841-ec1118208bc8 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:35:43.879394 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29491518-ee77-420c-9841-ec1118208bc8 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:43.879851 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29491518-ee77-420c-9841-ec1118208bc8 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:43.881765 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29491518-ee77-420c-9841-ec1118208bc8 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:43.882223 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29491518-ee77-420c-9841-ec1118208bc8 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:43.915399 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-29491518-ee77-420c-9841-ec1118208bc8 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048475 Jul 19 23:35:43.916006 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3474/6955] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:35:43 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:35:44.927733 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c85cb2db-6c72-4586-a8fa-0b284882ea5a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:35:44.928673 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c85cb2db-6c72-4586-a8fa-0b284882ea5a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:35:44.935588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c85cb2db-6c72-4586-a8fa-0b284882ea5a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:44.936051 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c85cb2db-6c72-4586-a8fa-0b284882ea5a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:44.936831 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c85cb2db-6c72-4586-a8fa-0b284882ea5a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:44.937278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c85cb2db-6c72-4586-a8fa-0b284882ea5a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:44.967490 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c85cb2db-6c72-4586-a8fa-0b284882ea5a tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044041 Jul 19 23:35:44.968056 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3482/6956] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:35:44 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:35:45.979308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8703ac97-d1c8-4a74-90e8-c0ce9b268ad2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:35:45.980237 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8703ac97-d1c8-4a74-90e8-c0ce9b268ad2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:35:45.987193 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8703ac97-d1c8-4a74-90e8-c0ce9b268ad2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:45.987772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8703ac97-d1c8-4a74-90e8-c0ce9b268ad2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:45.988546 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8703ac97-d1c8-4a74-90e8-c0ce9b268ad2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:45.988977 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8703ac97-d1c8-4a74-90e8-c0ce9b268ad2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:46.020248 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8703ac97-d1c8-4a74-90e8-c0ce9b268ad2 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044923 Jul 19 23:35:46.020888 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3475/6957] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:35:45 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:35:47.032275 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-64dc5679-b94a-46c4-8960-4bc8b7a6438c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:35:47.033217 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-64dc5679-b94a-46c4-8960-4bc8b7a6438c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:35:47.040232 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-64dc5679-b94a-46c4-8960-4bc8b7a6438c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:47.040627 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-64dc5679-b94a-46c4-8960-4bc8b7a6438c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:47.041402 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-64dc5679-b94a-46c4-8960-4bc8b7a6438c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:47.041847 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-64dc5679-b94a-46c4-8960-4bc8b7a6438c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:47.070474 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-64dc5679-b94a-46c4-8960-4bc8b7a6438c tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042344 Jul 19 23:35:47.071029 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3483/6958] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 19 23:35:47 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 23:35:47.080863 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-257ac5a9-e971-4aaa-aa5f-98b4efc142d0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:35:47.081350 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-257ac5a9-e971-4aaa-aa5f-98b4efc142d0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:35:47.088642 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-257ac5a9-e971-4aaa-aa5f-98b4efc142d0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:47.089731 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-257ac5a9-e971-4aaa-aa5f-98b4efc142d0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:47.089974 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-257ac5a9-e971-4aaa-aa5f-98b4efc142d0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:47.090411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-257ac5a9-e971-4aaa-aa5f-98b4efc142d0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:47.168404 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-257ac5a9-e971-4aaa-aa5f-98b4efc142d0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] HTTP exception thrown: Instance d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 is not attached to volume 9e5ee781-22de-499a-bc27-7ab4dc263d20 Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-257ac5a9-e971-4aaa-aa5f-98b4efc142d0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Request method failure captured: Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: request: DELETE /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1/os-volume_attachments/9e5ee781-22de-499a-bc27-7ab4dc263d20 HTTP/1.1 Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1z5l-tlPRxj7FMHBXa1P2hvPZ4buf4P2dlOPno0l2N17D3k19haJXe3QsN1CxW3yYUv-Uwmrtm8ZG258GlmKwQ7aTVirBBAYSyPhiHmHHSezFuu5NcpIDecA3QoGQRRFyRIcXxNJP8hdIqftKK44olLCfkM_asGDttuL2Z_VzadUDw0 Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: 78238a06f1c645b4a145710a4b1c0c01 Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TestMinimumBasicScenario-2045292981 Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_78238a06f1c645b4a145710a4b1c0c01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78238a06f1c645b4a145710a4b1c0c01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/78238a06f1c645b4a145710a4b1c0c01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78238a06f1c645b4a145710a4b1c0c01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TestMinimumBasicScenario-2045292981 Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: 78238a06f1c645b4a145710a4b1c0c01 Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2045292981 Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TestMinimumBasicScenario-2045292981-project Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: f0883f3e353340a4b67bf932f3cbcb03 Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TestMinimumBasicScenario-2045292981-project Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 is not attached to volume 9e5ee781-22de-499a-bc27-7ab4dc263d20 Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'server_id': 'd2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1', 'id': '9e5ee781-22de-499a-bc27-7ab4dc263d20'} Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9e5ee781-22de-499a-bc27-7ab4dc263d20. Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 is not attached to volume 9e5ee781-22de-499a-bc27-7ab4dc263d20 Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:35:47.170011 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:35:47.174665 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:35:47.174665 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:35:47.174665 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 is not attached to volume 9e5ee781-22de-499a-bc27-7ab4dc263d20 Jul 19 23:35:47.174665 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:35:47.174665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-257ac5a9-e971-4aaa-aa5f-98b4efc142d0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Returning 404 to user: Instance d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 is not attached to volume 9e5ee781-22de-499a-bc27-7ab4dc263d20 {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:35:47.174665 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-257ac5a9-e971-4aaa-aa5f-98b4efc142d0 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1/os-volume_attachments/9e5ee781-22de-499a-bc27-7ab4dc263d20" status: 404 len: 154 microversion: 2.1 time: 0.094592 Jul 19 23:35:47.174665 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3476/6959] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 19 23:35:47 2022] DELETE /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1/os-volume_attachments/9e5ee781-22de-499a-bc27-7ab4dc263d20 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:35:50.411020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2bd21ecf-4de3-4f0b-9d2a-8068d6c8459b tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:35:50.411696 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2bd21ecf-4de3-4f0b-9d2a-8068d6c8459b tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:35:50.422951 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bd21ecf-4de3-4f0b-9d2a-8068d6c8459b tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:50.423434 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bd21ecf-4de3-4f0b-9d2a-8068d6c8459b tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:50.424216 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bd21ecf-4de3-4f0b-9d2a-8068d6c8459b tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:50.424845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2bd21ecf-4de3-4f0b-9d2a-8068d6c8459b tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:50.452971 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2bd21ecf-4de3-4f0b-9d2a-8068d6c8459b tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:35:50.549987 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2bd21ecf-4de3-4f0b-9d2a-8068d6c8459b tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 204 len: 0 microversion: 2.1 time: 0.142603 Jul 19 23:35:50.550797 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3484/6960] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:35:50 2022] DELETE /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:35:50.561941 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-165db1b3-f918-40fe-a79d-7562355fa98f tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:35:50.562579 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-165db1b3-f918-40fe-a79d-7562355fa98f tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:35:50.572128 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-165db1b3-f918-40fe-a79d-7562355fa98f tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:50.572309 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-165db1b3-f918-40fe-a79d-7562355fa98f tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:50.573103 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-165db1b3-f918-40fe-a79d-7562355fa98f tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:50.573550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-165db1b3-f918-40fe-a79d-7562355fa98f tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:50.716477 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-165db1b3-f918-40fe-a79d-7562355fa98f tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:35:50.727573 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-165db1b3-f918-40fe-a79d-7562355fa98f tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1555 microversion: 2.1 time: 0.170710 Jul 19 23:35:50.728284 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3477/6961] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:35:50 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:35:51.745261 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6cf054ba-65ec-4fb5-aecb-02763ab811c1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:35:51.745989 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6cf054ba-65ec-4fb5-aecb-02763ab811c1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:35:51.752916 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6cf054ba-65ec-4fb5-aecb-02763ab811c1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:51.753384 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6cf054ba-65ec-4fb5-aecb-02763ab811c1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:51.754168 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6cf054ba-65ec-4fb5-aecb-02763ab811c1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:51.754625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6cf054ba-65ec-4fb5-aecb-02763ab811c1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:51.892346 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6cf054ba-65ec-4fb5-aecb-02763ab811c1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:35:51.900002 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6cf054ba-65ec-4fb5-aecb-02763ab811c1 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1555 microversion: 2.1 time: 0.158995 Jul 19 23:35:51.900588 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3485/6962] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:35:51 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:35:52.918361 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-16721f2f-7816-40cb-a3a6-792ee8e6e3ec tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:35:52.920094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-16721f2f-7816-40cb-a3a6-792ee8e6e3ec tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:35:52.929444 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16721f2f-7816-40cb-a3a6-792ee8e6e3ec tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:52.929905 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16721f2f-7816-40cb-a3a6-792ee8e6e3ec tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:52.930698 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16721f2f-7816-40cb-a3a6-792ee8e6e3ec tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:52.931186 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16721f2f-7816-40cb-a3a6-792ee8e6e3ec tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:52.934762 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-b416f47f-7e99-4e7b-8b1b-8629b6a8f17c req-2efe15ae-6929-425f-8691-ed8b72b75725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1", "name": "network-vif-deleted", "tag": "7fefbd6f-822b-435c-b3cf-7c066d11c1cf"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:35:52.945259 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b416f47f-7e99-4e7b-8b1b-8629b6a8f17c req-2efe15ae-6929-425f-8691-ed8b72b75725 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:52.945836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b416f47f-7e99-4e7b-8b1b-8629b6a8f17c req-2efe15ae-6929-425f-8691-ed8b72b75725 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:52.961106 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-b416f47f-7e99-4e7b-8b1b-8629b6a8f17c req-2efe15ae-6929-425f-8691-ed8b72b75725 service nova] Creating event network-vif-deleted:7fefbd6f-822b-435c-b3cf-7c066d11c1cf for instance d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 on n-h1-847009-3 Jul 19 23:35:52.966074 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-b416f47f-7e99-4e7b-8b1b-8629b6a8f17c req-2efe15ae-6929-425f-8691-ed8b72b75725 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035612 Jul 19 23:35:52.966778 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3486/6963] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:35:53.001508 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-16721f2f-7816-40cb-a3a6-792ee8e6e3ec tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0883f3e353340a4b67bf932f3cbcb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78238a06f1c645b4a145710a4b1c0c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:35:53.009923 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-16721f2f-7816-40cb-a3a6-792ee8e6e3ec tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 200 len: 1513 microversion: 2.1 time: 0.095892 Jul 19 23:35:53.010510 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3478/6964] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:35:52 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 1513 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:35:54.028768 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c279a02b-5623-4aa3-8820-3dc1989fcd32 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:35:54.029491 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c279a02b-5623-4aa3-8820-3dc1989fcd32 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] [instance: d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:35:54.035810 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c279a02b-5623-4aa3-8820-3dc1989fcd32 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:54.036279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c279a02b-5623-4aa3-8820-3dc1989fcd32 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:54.037660 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c279a02b-5623-4aa3-8820-3dc1989fcd32 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:35:54.038062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c279a02b-5623-4aa3-8820-3dc1989fcd32 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:35:54.051289 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-c279a02b-5623-4aa3-8820-3dc1989fcd32 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] HTTP exception thrown: Instance d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 could not be found. Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c279a02b-5623-4aa3-8820-3dc1989fcd32 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Request method failure captured: Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 HTTP/1.1 Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1z5l-tlPRxj7FMHBXa1P2hvPZ4buf4P2dlOPno0l2N17D3k19haJXe3QsN1CxW3yYUv-Uwmrtm8ZG258GlmKwQ7aTVirBBAYSyPhiHmHHSezFuu5NcpIDecA3QoGQRRFyRIcXxNJP8hdIqftKK44olLCfkM_asGDttuL2Z_VzadUDw0 Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 78238a06f1c645b4a145710a4b1c0c01 Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-TestMinimumBasicScenario-2045292981 Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_78238a06f1c645b4a145710a4b1c0c01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78238a06f1c645b4a145710a4b1c0c01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/78238a06f1c645b4a145710a4b1c0c01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78238a06f1c645b4a145710a4b1c0c01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-TestMinimumBasicScenario-2045292981 Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 78238a06f1c645b4a145710a4b1c0c01 Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2045292981 Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-TestMinimumBasicScenario-2045292981-project Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: f0883f3e353340a4b67bf932f3cbcb03 Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-TestMinimumBasicScenario-2045292981-project Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 could not be found. Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'd2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1'} Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 could not be found. Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 could not be found. Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:35:54.053558 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:35:54.058308 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:35:54.058308 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:35:54.058308 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:35:54.058308 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:35:54.058308 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:35:54.058308 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 could not be found. Jul 19 23:35:54.058308 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:35:54.058308 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c279a02b-5623-4aa3-8820-3dc1989fcd32 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Returning 404 to user: Instance d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:35:54.058308 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c279a02b-5623-4aa3-8820-3dc1989fcd32 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1" status: 404 len: 111 microversion: 2.1 time: 0.031471 Jul 19 23:35:54.058308 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3487/6965] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:35:54 2022] GET /compute/v2.1/servers/d2655b2c-a1b6-4cee-9c6f-d34dfe94f6c1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:35:54.064189 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a96c8be6-d4d0-4590-a884-c773c7a340d8 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] Calling method '.version_select at 0x7f7a1044c5e0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:35:54.084233 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a96c8be6-d4d0-4590-a884-c773c7a340d8 tempest-TestMinimumBasicScenario-2045292981 tempest-TestMinimumBasicScenario-2045292981-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-745232966" status: 202 len: 0 microversion: 2.1 time: 0.023695 Jul 19 23:35:54.084988 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3479/6966] 10.222.0.25 () {58 vars in 1268 bytes} [Tue Jul 19 23:35:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-745232966 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:36:03.164704 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d5975abf-e77c-48d4-a910-067942d73afd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'create', calling method: .version_select at 0x7f7a03e64d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2061930254", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJqGyYFFZnZVJKXNYKasDtY9u+y+oH4+rUmgDnJ+rsDf2feMcmooGWc4KMbInF2xLQM9vp9VW8u90pDRnnMtK/BaDmWCAmBFKg+at0BRO/o75D1Hq8y3doALkpUBE4yjA=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:36:03.179741 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-d5975abf-e77c-48d4-a910-067942d73afd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Getting quotas for project e250763e59c741fbbbf193ca4cac4189. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:36:03.184903 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-d5975abf-e77c-48d4-a910-067942d73afd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Getting quotas for user bdaa1c19bfa34fd69fd610406f41f728 and project e250763e59c741fbbbf193ca4cac4189. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:36:03.212263 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d5975abf-e77c-48d4-a910-067942d73afd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.217833 Jul 19 23:36:03.212866 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3488/6967] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 23:36:02 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:36:09.128069 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=40 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:36:09.128832 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:36:09.133434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-053a6672-ab81-4647-bbf1-6ea52b689612 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-139665667", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "0af0c1ea-43da-43b7-8ef0-3dbf6c964765"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2061930254", "security_groups": [{"name": "tempest-secgroup-smoke-561002296"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:36:09.259082 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-053a6672-ab81-4647-bbf1-6ea52b689612 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] validate_networks() for [('0af0c1ea-43da-43b7-8ef0-3dbf6c964765', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:36:09.802585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-053a6672-ab81-4647-bbf1-6ea52b689612 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:36:09.803028 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-053a6672-ab81-4647-bbf1-6ea52b689612 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:36:09.803534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-053a6672-ab81-4647-bbf1-6ea52b689612 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:36:09.803952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-053a6672-ab81-4647-bbf1-6ea52b689612 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:36:09.804372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-053a6672-ab81-4647-bbf1-6ea52b689612 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:36:09.820721 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-053a6672-ab81-4647-bbf1-6ea52b689612 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:09.821184 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-053a6672-ab81-4647-bbf1-6ea52b689612 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:09.822627 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-053a6672-ab81-4647-bbf1-6ea52b689612 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:09.823307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-053a6672-ab81-4647-bbf1-6ea52b689612 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:09.849124 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-053a6672-ab81-4647-bbf1-6ea52b689612 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Getting quotas for project e250763e59c741fbbbf193ca4cac4189. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:36:09.856490 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-053a6672-ab81-4647-bbf1-6ea52b689612 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Getting quotas for user bdaa1c19bfa34fd69fd610406f41f728 and project e250763e59c741fbbbf193ca4cac4189. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:36:09.872427 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-053a6672-ab81-4647-bbf1-6ea52b689612 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:36:09.875212 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-053a6672-ab81-4647-bbf1-6ea52b689612 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:36:09.955779 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-053a6672-ab81-4647-bbf1-6ea52b689612 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.828168 Jul 19 23:36:09.963510 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3480/6968] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:36:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:36:09.976385 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fb2be5c2-0076-46a1-b1cc-c58b9b3300ef tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:36:09.978960 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fb2be5c2-0076-46a1-b1cc-c58b9b3300ef tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:36:09.986545 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:36:09.987389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:36:10.063070 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fb2be5c2-0076-46a1-b1cc-c58b9b3300ef tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:36:10.071947 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fb2be5c2-0076-46a1-b1cc-c58b9b3300ef tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501" status: 200 len: 1266 microversion: 2.1 time: 0.105241 Jul 19 23:36:10.083256 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3489/6969] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:36:09 2022] GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501 => generated 1266 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:36:11.091338 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-49b2580b-6961-4b07-9a2b-162e96ee100e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:36:11.092007 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-49b2580b-6961-4b07-9a2b-162e96ee100e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:36:11.112299 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49b2580b-6961-4b07-9a2b-162e96ee100e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:11.113046 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49b2580b-6961-4b07-9a2b-162e96ee100e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:11.113886 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49b2580b-6961-4b07-9a2b-162e96ee100e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:11.114929 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-49b2580b-6961-4b07-9a2b-162e96ee100e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:11.201773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-49b2580b-6961-4b07-9a2b-162e96ee100e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:36:11.210158 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-49b2580b-6961-4b07-9a2b-162e96ee100e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501" status: 200 len: 1318 microversion: 2.1 time: 0.123526 Jul 19 23:36:11.214560 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3481/6970] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:36:11 2022] GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501 => generated 1318 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:36:12.233165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2135d845-d784-422f-aca1-2f2a919998b9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:36:12.233809 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2135d845-d784-422f-aca1-2f2a919998b9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:36:12.243929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2135d845-d784-422f-aca1-2f2a919998b9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:12.244671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2135d845-d784-422f-aca1-2f2a919998b9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:12.245845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2135d845-d784-422f-aca1-2f2a919998b9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:12.246461 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2135d845-d784-422f-aca1-2f2a919998b9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:12.413999 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2135d845-d784-422f-aca1-2f2a919998b9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:36:12.421562 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2135d845-d784-422f-aca1-2f2a919998b9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501" status: 200 len: 1391 microversion: 2.1 time: 0.192998 Jul 19 23:36:12.422140 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3490/6971] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:36:12 2022] GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501 => generated 1391 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:36:13.113290 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-01c6de43-658a-431c-bdad-ea4d6c468743 req-246b1054-0585-456e-870d-5a1737a2b063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9e58dd4-7835-4a55-b523-f9e0f3d90501", "tag": "01f233ce-1c1e-4d51-afef-fb195c51e4a0"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:36:13.125423 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-01c6de43-658a-431c-bdad-ea4d6c468743 req-246b1054-0585-456e-870d-5a1737a2b063 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:13.125794 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-01c6de43-658a-431c-bdad-ea4d6c468743 req-246b1054-0585-456e-870d-5a1737a2b063 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:13.149100 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-01c6de43-658a-431c-bdad-ea4d6c468743 req-246b1054-0585-456e-870d-5a1737a2b063 service nova] Creating event network-changed:01f233ce-1c1e-4d51-afef-fb195c51e4a0 for instance b9e58dd4-7835-4a55-b523-f9e0f3d90501 on n-h2-847009-3 Jul 19 23:36:13.154751 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-01c6de43-658a-431c-bdad-ea4d6c468743 req-246b1054-0585-456e-870d-5a1737a2b063 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045075 Jul 19 23:36:13.155514 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3482/6972] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:36:13.439213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9a1682a5-7b48-4057-a8f4-e19b2fb34733 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:36:13.440001 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9a1682a5-7b48-4057-a8f4-e19b2fb34733 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:36:13.450483 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9a1682a5-7b48-4057-a8f4-e19b2fb34733 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:13.451349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9a1682a5-7b48-4057-a8f4-e19b2fb34733 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:13.452726 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9a1682a5-7b48-4057-a8f4-e19b2fb34733 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:13.453512 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9a1682a5-7b48-4057-a8f4-e19b2fb34733 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:13.592486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9a1682a5-7b48-4057-a8f4-e19b2fb34733 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:36:13.601280 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9a1682a5-7b48-4057-a8f4-e19b2fb34733 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501" status: 200 len: 1391 microversion: 2.1 time: 0.166028 Jul 19 23:36:13.601872 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3491/6973] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:36:13 2022] GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:36:14.619886 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-29eebb6b-1f1a-45d2-98b3-b340d7f2bade tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:36:14.620602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-29eebb6b-1f1a-45d2-98b3-b340d7f2bade tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:36:14.626942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29eebb6b-1f1a-45d2-98b3-b340d7f2bade tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:14.627440 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29eebb6b-1f1a-45d2-98b3-b340d7f2bade tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:14.628227 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29eebb6b-1f1a-45d2-98b3-b340d7f2bade tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:14.628677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-29eebb6b-1f1a-45d2-98b3-b340d7f2bade tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:14.767823 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-29eebb6b-1f1a-45d2-98b3-b340d7f2bade tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:36:14.775568 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-29eebb6b-1f1a-45d2-98b3-b340d7f2bade tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501" status: 200 len: 1391 microversion: 2.1 time: 0.161392 Jul 19 23:36:14.776154 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3483/6974] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:36:14 2022] GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:36:15.793019 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d0930095-f0a5-4e74-8377-3c8e29912ec7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:36:15.793683 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d0930095-f0a5-4e74-8377-3c8e29912ec7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:36:15.799867 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0930095-f0a5-4e74-8377-3c8e29912ec7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:15.800332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0930095-f0a5-4e74-8377-3c8e29912ec7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:15.801109 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0930095-f0a5-4e74-8377-3c8e29912ec7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:15.802126 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0930095-f0a5-4e74-8377-3c8e29912ec7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:15.934453 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d0930095-f0a5-4e74-8377-3c8e29912ec7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:36:15.942728 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d0930095-f0a5-4e74-8377-3c8e29912ec7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501" status: 200 len: 1391 microversion: 2.1 time: 0.153214 Jul 19 23:36:15.943330 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3492/6975] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:36:15 2022] GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:36:16.960751 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6851460c-153c-4463-9e8d-e4690fc1192d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:36:16.961409 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6851460c-153c-4463-9e8d-e4690fc1192d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:36:16.968503 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6851460c-153c-4463-9e8d-e4690fc1192d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:16.968961 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6851460c-153c-4463-9e8d-e4690fc1192d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:16.969746 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6851460c-153c-4463-9e8d-e4690fc1192d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:16.970183 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6851460c-153c-4463-9e8d-e4690fc1192d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:17.108714 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6851460c-153c-4463-9e8d-e4690fc1192d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:36:17.117656 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6851460c-153c-4463-9e8d-e4690fc1192d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501" status: 200 len: 1391 microversion: 2.1 time: 0.161634 Jul 19 23:36:17.118772 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3484/6976] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:36:16 2022] GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:36:18.135850 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f75e2e7b-7342-4459-9b00-86bfd3808ad0 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:36:18.136486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f75e2e7b-7342-4459-9b00-86bfd3808ad0 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:36:18.143346 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f75e2e7b-7342-4459-9b00-86bfd3808ad0 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:18.143809 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f75e2e7b-7342-4459-9b00-86bfd3808ad0 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:18.144583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f75e2e7b-7342-4459-9b00-86bfd3808ad0 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:18.145349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f75e2e7b-7342-4459-9b00-86bfd3808ad0 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:18.282341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f75e2e7b-7342-4459-9b00-86bfd3808ad0 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:36:18.289868 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f75e2e7b-7342-4459-9b00-86bfd3808ad0 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501" status: 200 len: 1391 microversion: 2.1 time: 0.158309 Jul 19 23:36:18.290435 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3493/6977] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:36:18 2022] GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:36:18.846544 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-ef3ef3ca-b24a-49ab-8e85-954c5e4c9548 req-bba571e1-e157-4bf0-8310-86e6ccc4f438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e58dd4-7835-4a55-b523-f9e0f3d90501", "name": "network-vif-plugged", "status": "completed", "tag": "01f233ce-1c1e-4d51-afef-fb195c51e4a0"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:36:18.857893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-ef3ef3ca-b24a-49ab-8e85-954c5e4c9548 req-bba571e1-e157-4bf0-8310-86e6ccc4f438 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:18.858618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-ef3ef3ca-b24a-49ab-8e85-954c5e4c9548 req-bba571e1-e157-4bf0-8310-86e6ccc4f438 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:18.870864 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-ef3ef3ca-b24a-49ab-8e85-954c5e4c9548 req-bba571e1-e157-4bf0-8310-86e6ccc4f438 service nova] Creating event network-vif-plugged:01f233ce-1c1e-4d51-afef-fb195c51e4a0 for instance b9e58dd4-7835-4a55-b523-f9e0f3d90501 on n-h2-847009-3 Jul 19 23:36:18.875945 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-ef3ef3ca-b24a-49ab-8e85-954c5e4c9548 req-bba571e1-e157-4bf0-8310-86e6ccc4f438 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033165 Jul 19 23:36:18.876619 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3485/6978] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:36:19.307348 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-37a39734-abfc-4bf6-99a7-79440f3790d8 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:36:19.307896 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-37a39734-abfc-4bf6-99a7-79440f3790d8 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:36:19.315041 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37a39734-abfc-4bf6-99a7-79440f3790d8 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:19.315553 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37a39734-abfc-4bf6-99a7-79440f3790d8 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:19.316341 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37a39734-abfc-4bf6-99a7-79440f3790d8 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:19.317428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37a39734-abfc-4bf6-99a7-79440f3790d8 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:19.464707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-37a39734-abfc-4bf6-99a7-79440f3790d8 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:36:19.472265 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-37a39734-abfc-4bf6-99a7-79440f3790d8 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501" status: 200 len: 1391 microversion: 2.1 time: 0.169065 Jul 19 23:36:19.472845 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3494/6979] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:36:19 2022] GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:36:20.487045 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:36:20.489416 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:36:20.494104 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ccd3f007-f1ef-4309-bf9c-18316bbf4277 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:36:20.494811 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ccd3f007-f1ef-4309-bf9c-18316bbf4277 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:36:20.501859 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ccd3f007-f1ef-4309-bf9c-18316bbf4277 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:20.502314 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ccd3f007-f1ef-4309-bf9c-18316bbf4277 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:20.503084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ccd3f007-f1ef-4309-bf9c-18316bbf4277 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:20.503577 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ccd3f007-f1ef-4309-bf9c-18316bbf4277 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:20.641795 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ccd3f007-f1ef-4309-bf9c-18316bbf4277 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:36:20.650137 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ccd3f007-f1ef-4309-bf9c-18316bbf4277 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501" status: 200 len: 1564 microversion: 2.1 time: 0.164071 Jul 19 23:36:20.650716 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3486/6980] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:36:20 2022] GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501 => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:36:20.666811 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3d2e47ac-31c4-48c2-ab9d-52c8be50ecbd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:36:20.667481 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3d2e47ac-31c4-48c2-ab9d-52c8be50ecbd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:36:20.669348 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:36:20.676497 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d2e47ac-31c4-48c2-ab9d-52c8be50ecbd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:20.676969 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d2e47ac-31c4-48c2-ab9d-52c8be50ecbd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:20.677753 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d2e47ac-31c4-48c2-ab9d-52c8be50ecbd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:20.678214 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d2e47ac-31c4-48c2-ab9d-52c8be50ecbd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:20.812775 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3d2e47ac-31c4-48c2-ab9d-52c8be50ecbd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:36:20.820735 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3d2e47ac-31c4-48c2-ab9d-52c8be50ecbd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501" status: 200 len: 1564 microversion: 2.1 time: 0.157891 Jul 19 23:36:20.821329 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3495/6981] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:36:20 2022] GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:36:22.793583 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6ff8680a-4cd8-476f-a51d-c9637273e47b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:36:22.794210 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6ff8680a-4cd8-476f-a51d-c9637273e47b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:36:22.798323 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-f0d4e5f2-858c-4f19-b06b-59b2c14671ef req-47ed1252-39d6-4df3-af98-b8b0694216e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9e58dd4-7835-4a55-b523-f9e0f3d90501", "tag": "01f233ce-1c1e-4d51-afef-fb195c51e4a0"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:36:22.802850 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ff8680a-4cd8-476f-a51d-c9637273e47b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:22.804115 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ff8680a-4cd8-476f-a51d-c9637273e47b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:22.805242 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ff8680a-4cd8-476f-a51d-c9637273e47b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:22.805833 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6ff8680a-4cd8-476f-a51d-c9637273e47b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:22.808714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-f0d4e5f2-858c-4f19-b06b-59b2c14671ef req-47ed1252-39d6-4df3-af98-b8b0694216e1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:22.809179 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-f0d4e5f2-858c-4f19-b06b-59b2c14671ef req-47ed1252-39d6-4df3-af98-b8b0694216e1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:22.822590 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-f0d4e5f2-858c-4f19-b06b-59b2c14671ef req-47ed1252-39d6-4df3-af98-b8b0694216e1 service nova] Creating event network-changed:01f233ce-1c1e-4d51-afef-fb195c51e4a0 for instance b9e58dd4-7835-4a55-b523-f9e0f3d90501 on n-h2-847009-3 Jul 19 23:36:22.827982 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-f0d4e5f2-858c-4f19-b06b-59b2c14671ef req-47ed1252-39d6-4df3-af98-b8b0694216e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033231 Jul 19 23:36:22.829199 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3496/6982] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:36:22.951325 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6ff8680a-4cd8-476f-a51d-c9637273e47b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:36:22.960089 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6ff8680a-4cd8-476f-a51d-c9637273e47b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501" status: 200 len: 1564 microversion: 2.1 time: 0.171081 Jul 19 23:36:22.960849 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3487/6983] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:36:22 2022] GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501 => generated 1564 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:36:36.379224 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:36:36.379876 n-d-847009-3 devstack@n-api.service[119337]: Tue Jul 19 23:36:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:36:46.212227 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=17 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:36:46.213015 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=38 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:36:46.217360 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8933d476-aad2-4262-9cf0-c4f9f6046357 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:36:46.218448 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8933d476-aad2-4262-9cf0-c4f9f6046357 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:36:46.226620 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8933d476-aad2-4262-9cf0-c4f9f6046357 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:46.227080 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8933d476-aad2-4262-9cf0-c4f9f6046357 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:46.227928 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8933d476-aad2-4262-9cf0-c4f9f6046357 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:46.228385 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8933d476-aad2-4262-9cf0-c4f9f6046357 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:46.283810 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8933d476-aad2-4262-9cf0-c4f9f6046357 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501/action" status: 200 len: 24571 microversion: 2.1 time: 0.073042 Jul 19 23:36:46.284720 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3497/6984] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:36:46 2022] POST /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501/action => generated 24571 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 23:36:52.703221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e2161a10-a32d-46a8-b2a7-3a48b4684c29 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:36:52.703846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e2161a10-a32d-46a8-b2a7-3a48b4684c29 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:36:52.705984 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:36:52.706631 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=36 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:36:52.713082 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2161a10-a32d-46a8-b2a7-3a48b4684c29 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:52.713530 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2161a10-a32d-46a8-b2a7-3a48b4684c29 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:52.714305 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2161a10-a32d-46a8-b2a7-3a48b4684c29 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:52.714749 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e2161a10-a32d-46a8-b2a7-3a48b4684c29 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:52.790402 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e2161a10-a32d-46a8-b2a7-3a48b4684c29 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501/action" status: 202 len: 0 microversion: 2.1 time: 0.091191 Jul 19 23:36:52.791081 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3488/6985] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:36:52 2022] POST /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:36:52.799790 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-847c8c52-1218-40ef-b02c-ea2a5a0f6101 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:36:52.800513 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-847c8c52-1218-40ef-b02c-ea2a5a0f6101 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:36:52.808890 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-847c8c52-1218-40ef-b02c-ea2a5a0f6101 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:52.809353 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-847c8c52-1218-40ef-b02c-ea2a5a0f6101 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:52.810137 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-847c8c52-1218-40ef-b02c-ea2a5a0f6101 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:52.810584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-847c8c52-1218-40ef-b02c-ea2a5a0f6101 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:52.963048 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-847c8c52-1218-40ef-b02c-ea2a5a0f6101 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:36:52.970675 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-847c8c52-1218-40ef-b02c-ea2a5a0f6101 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501" status: 200 len: 1688 microversion: 2.1 time: 0.175175 Jul 19 23:36:52.971273 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3498/6986] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:36:52 2022] GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501 => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:36:53.991760 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1ba44e9b-8641-49af-9098-64ec76ebb1a6 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:36:53.992498 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1ba44e9b-8641-49af-9098-64ec76ebb1a6 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:36:53.998775 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1ba44e9b-8641-49af-9098-64ec76ebb1a6 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:53.999270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1ba44e9b-8641-49af-9098-64ec76ebb1a6 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:54.000036 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1ba44e9b-8641-49af-9098-64ec76ebb1a6 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:54.000474 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1ba44e9b-8641-49af-9098-64ec76ebb1a6 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:54.138667 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1ba44e9b-8641-49af-9098-64ec76ebb1a6 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:36:54.146252 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1ba44e9b-8641-49af-9098-64ec76ebb1a6 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501" status: 200 len: 1668 microversion: 2.1 time: 0.160325 Jul 19 23:36:54.147065 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3489/6987] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:36:53 2022] GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501 => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:36:55.242794 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b44ae63b-84a3-435e-b697-d21f8f0ea8a9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:36:55.243779 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b44ae63b-84a3-435e-b697-d21f8f0ea8a9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:36:55.252335 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b44ae63b-84a3-435e-b697-d21f8f0ea8a9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:55.252800 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b44ae63b-84a3-435e-b697-d21f8f0ea8a9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:55.253579 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b44ae63b-84a3-435e-b697-d21f8f0ea8a9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:55.254027 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b44ae63b-84a3-435e-b697-d21f8f0ea8a9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:55.303643 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b44ae63b-84a3-435e-b697-d21f8f0ea8a9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501/action" status: 200 len: 32645 microversion: 2.1 time: 0.065211 Jul 19 23:36:55.304528 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3499/6988] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:36:55 2022] POST /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501/action => generated 32645 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 23:36:55.315767 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bcfefa35-2226-4a48-9763-5cbe4aef1bbc tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:36:55.316314 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bcfefa35-2226-4a48-9763-5cbe4aef1bbc tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:36:55.324231 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bcfefa35-2226-4a48-9763-5cbe4aef1bbc tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:55.324684 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bcfefa35-2226-4a48-9763-5cbe4aef1bbc tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:55.325452 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bcfefa35-2226-4a48-9763-5cbe4aef1bbc tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:55.325891 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bcfefa35-2226-4a48-9763-5cbe4aef1bbc tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:55.402623 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bcfefa35-2226-4a48-9763-5cbe4aef1bbc tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501/action" status: 202 len: 0 microversion: 2.1 time: 0.090570 Jul 19 23:36:55.403450 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3490/6989] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:36:55 2022] POST /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:36:55.412079 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-513f5e75-22df-4338-81b5-9102257d1212 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:36:55.412807 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-513f5e75-22df-4338-81b5-9102257d1212 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:36:55.420218 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-513f5e75-22df-4338-81b5-9102257d1212 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:55.420724 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-513f5e75-22df-4338-81b5-9102257d1212 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:55.421646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-513f5e75-22df-4338-81b5-9102257d1212 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:55.422101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-513f5e75-22df-4338-81b5-9102257d1212 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:55.573465 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-513f5e75-22df-4338-81b5-9102257d1212 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:36:55.581637 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-513f5e75-22df-4338-81b5-9102257d1212 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501" status: 200 len: 1675 microversion: 2.1 time: 0.173559 Jul 19 23:36:55.582529 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3500/6990] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:36:55 2022] GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501 => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:36:56.602462 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d7b7c6f3-6ee8-4e90-a0e0-239663815535 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:36:56.603073 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d7b7c6f3-6ee8-4e90-a0e0-239663815535 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:36:56.609422 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7b7c6f3-6ee8-4e90-a0e0-239663815535 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:56.609872 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7b7c6f3-6ee8-4e90-a0e0-239663815535 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:56.610632 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7b7c6f3-6ee8-4e90-a0e0-239663815535 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:56.611070 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d7b7c6f3-6ee8-4e90-a0e0-239663815535 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:56.755161 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d7b7c6f3-6ee8-4e90-a0e0-239663815535 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:36:56.763666 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d7b7c6f3-6ee8-4e90-a0e0-239663815535 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501" status: 200 len: 1683 microversion: 2.1 time: 0.167227 Jul 19 23:36:56.764243 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3491/6991] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:36:56 2022] GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:36:56.872061 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3cec83c0-0ef4-4357-83dd-5bedf6f1fd98 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:36:56.872956 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3cec83c0-0ef4-4357-83dd-5bedf6f1fd98 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:36:56.881719 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3cec83c0-0ef4-4357-83dd-5bedf6f1fd98 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:56.882284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3cec83c0-0ef4-4357-83dd-5bedf6f1fd98 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:56.883513 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3cec83c0-0ef4-4357-83dd-5bedf6f1fd98 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:56.883972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3cec83c0-0ef4-4357-83dd-5bedf6f1fd98 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:56.942551 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3cec83c0-0ef4-4357-83dd-5bedf6f1fd98 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501/action" status: 200 len: 35396 microversion: 2.1 time: 0.074187 Jul 19 23:36:56.944639 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3501/6992] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:36:56 2022] POST /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501/action => generated 35396 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 23:36:58.020923 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-00c5011c-cf00-48b2-94f1-40c0c2e6cdd7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:36:58.022819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-00c5011c-cf00-48b2-94f1-40c0c2e6cdd7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:36:58.024792 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-907fc761-0a1e-46c3-895a-e2f44c87f8eb req-4f845788-eb06-45a3-8258-8b3e10549a6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9e58dd4-7835-4a55-b523-f9e0f3d90501", "tag": "01f233ce-1c1e-4d51-afef-fb195c51e4a0"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:36:58.030304 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00c5011c-cf00-48b2-94f1-40c0c2e6cdd7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:58.030829 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00c5011c-cf00-48b2-94f1-40c0c2e6cdd7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:58.032051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00c5011c-cf00-48b2-94f1-40c0c2e6cdd7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:58.032573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-00c5011c-cf00-48b2-94f1-40c0c2e6cdd7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:58.034287 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-907fc761-0a1e-46c3-895a-e2f44c87f8eb req-4f845788-eb06-45a3-8258-8b3e10549a6f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:58.034700 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-907fc761-0a1e-46c3-895a-e2f44c87f8eb req-4f845788-eb06-45a3-8258-8b3e10549a6f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:58.048286 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-907fc761-0a1e-46c3-895a-e2f44c87f8eb req-4f845788-eb06-45a3-8258-8b3e10549a6f service nova] Creating event network-changed:01f233ce-1c1e-4d51-afef-fb195c51e4a0 for instance b9e58dd4-7835-4a55-b523-f9e0f3d90501 on n-h2-847009-3 Jul 19 23:36:58.057736 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-907fc761-0a1e-46c3-895a-e2f44c87f8eb req-4f845788-eb06-45a3-8258-8b3e10549a6f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032845 Jul 19 23:36:58.057736 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3502/6993] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:36:58.064130 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-00c5011c-cf00-48b2-94f1-40c0c2e6cdd7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:36:58.163888 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-00c5011c-cf00-48b2-94f1-40c0c2e6cdd7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501" status: 204 len: 0 microversion: 2.1 time: 0.145594 Jul 19 23:36:58.164859 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3492/6994] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:36:58 2022] DELETE /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:36:58.175963 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b98cf1cc-6d28-4956-841d-d0a498b0333d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:36:58.177219 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b98cf1cc-6d28-4956-841d-d0a498b0333d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:36:58.184619 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b98cf1cc-6d28-4956-841d-d0a498b0333d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:58.185639 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b98cf1cc-6d28-4956-841d-d0a498b0333d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:58.186705 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b98cf1cc-6d28-4956-841d-d0a498b0333d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:58.187635 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b98cf1cc-6d28-4956-841d-d0a498b0333d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:58.348907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b98cf1cc-6d28-4956-841d-d0a498b0333d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:36:58.360610 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b98cf1cc-6d28-4956-841d-d0a498b0333d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501" status: 200 len: 1689 microversion: 2.1 time: 0.189921 Jul 19 23:36:58.361598 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3503/6995] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:36:58 2022] GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501 => generated 1689 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:36:59.378912 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e4cfec3f-0aa8-4083-86e0-11ed2faa0751 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:36:59.379694 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e4cfec3f-0aa8-4083-86e0-11ed2faa0751 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:36:59.387451 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e4cfec3f-0aa8-4083-86e0-11ed2faa0751 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:59.387950 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e4cfec3f-0aa8-4083-86e0-11ed2faa0751 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:59.390773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e4cfec3f-0aa8-4083-86e0-11ed2faa0751 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:36:59.390773 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e4cfec3f-0aa8-4083-86e0-11ed2faa0751 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:36:59.552622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e4cfec3f-0aa8-4083-86e0-11ed2faa0751 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:36:59.561037 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e4cfec3f-0aa8-4083-86e0-11ed2faa0751 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501" status: 200 len: 1689 microversion: 2.1 time: 0.186736 Jul 19 23:36:59.561656 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3493/6996] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:36:59 2022] GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501 => generated 1689 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:37:00.539925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-afc7812d-42e6-4a23-be1c-e447de00f3c7 req-d0240f63-6422-4d5c-9afd-2053b0098056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e58dd4-7835-4a55-b523-f9e0f3d90501", "name": "network-vif-deleted", "tag": "01f233ce-1c1e-4d51-afef-fb195c51e4a0"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:37:00.551289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-afc7812d-42e6-4a23-be1c-e447de00f3c7 req-d0240f63-6422-4d5c-9afd-2053b0098056 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:00.551674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-afc7812d-42e6-4a23-be1c-e447de00f3c7 req-d0240f63-6422-4d5c-9afd-2053b0098056 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:00.564561 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-afc7812d-42e6-4a23-be1c-e447de00f3c7 req-d0240f63-6422-4d5c-9afd-2053b0098056 service nova] Creating event network-vif-deleted:01f233ce-1c1e-4d51-afef-fb195c51e4a0 for instance b9e58dd4-7835-4a55-b523-f9e0f3d90501 on n-h2-847009-3 Jul 19 23:37:00.571710 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-afc7812d-42e6-4a23-be1c-e447de00f3c7 req-d0240f63-6422-4d5c-9afd-2053b0098056 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036327 Jul 19 23:37:00.572318 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3504/6997] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:37:00.580268 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b555623c-bfd2-4a42-97a9-fb1c712b4984 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:37:00.580895 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b555623c-bfd2-4a42-97a9-fb1c712b4984 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:37:00.589842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b555623c-bfd2-4a42-97a9-fb1c712b4984 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:00.590592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b555623c-bfd2-4a42-97a9-fb1c712b4984 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:00.591418 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b555623c-bfd2-4a42-97a9-fb1c712b4984 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:00.591862 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b555623c-bfd2-4a42-97a9-fb1c712b4984 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:00.661060 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b555623c-bfd2-4a42-97a9-fb1c712b4984 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:37:00.671218 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b555623c-bfd2-4a42-97a9-fb1c712b4984 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501" status: 200 len: 1351 microversion: 2.1 time: 0.094997 Jul 19 23:37:00.671812 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3494/6998] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:37:00 2022] GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501 => generated 1351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:37:01.690721 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d0f503f8-ed24-4b48-850b-6a9a31a75df2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:37:01.691386 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d0f503f8-ed24-4b48-850b-6a9a31a75df2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: b9e58dd4-7835-4a55-b523-f9e0f3d90501] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:37:01.698667 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0f503f8-ed24-4b48-850b-6a9a31a75df2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:01.699146 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0f503f8-ed24-4b48-850b-6a9a31a75df2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:01.699930 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0f503f8-ed24-4b48-850b-6a9a31a75df2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:01.700386 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d0f503f8-ed24-4b48-850b-6a9a31a75df2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:01.714568 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-d0f503f8-ed24-4b48-850b-6a9a31a75df2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] HTTP exception thrown: Instance b9e58dd4-7835-4a55-b523-f9e0f3d90501 could not be found. Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d0f503f8-ed24-4b48-850b-6a9a31a75df2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Request method failure captured: Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501 HTTP/1.1 Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1z_i3_paGortEfNaOQ-D6RCdDbS-gFpUd1lXlaBmT5d8oYP2yebmdV_XnM7ZxXqP9UNbb4IDO7U57P8_q5lGyi5pGaH1sCoNIZdz_Yb4nbHkmoo7pLg5PveXEAt6VDocXQIXfFoPvZAh1aLRxH9YfhSo3R3-TTentuS0y213WSMCEEw Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: e250763e59c741fbbbf193ca4cac4189 Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-660489764 Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e250763e59c741fbbbf193ca4cac4189"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e250763e59c741fbbbf193ca4cac4189"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e250763e59c741fbbbf193ca4cac4189"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e250763e59c741fbbbf193ca4cac4189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-TestNetworkAdvancedServerOps-660489764 Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: e250763e59c741fbbbf193ca4cac4189 Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-660489764 Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-TestNetworkAdvancedServerOps-660489764-project Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: bdaa1c19bfa34fd69fd610406f41f728 Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-TestNetworkAdvancedServerOps-660489764-project Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance b9e58dd4-7835-4a55-b523-f9e0f3d90501 could not be found. Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'b9e58dd4-7835-4a55-b523-f9e0f3d90501'} Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9e58dd4-7835-4a55-b523-f9e0f3d90501 could not be found. Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9e58dd4-7835-4a55-b523-f9e0f3d90501 could not be found. Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:37:01.716248 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:37:01.720943 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:37:01.720943 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:37:01.720943 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:37:01.720943 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:37:01.720943 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:37:01.720943 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9e58dd4-7835-4a55-b523-f9e0f3d90501 could not be found. Jul 19 23:37:01.720943 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:37:01.720943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d0f503f8-ed24-4b48-850b-6a9a31a75df2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Returning 404 to user: Instance b9e58dd4-7835-4a55-b523-f9e0f3d90501 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:37:01.720943 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d0f503f8-ed24-4b48-850b-6a9a31a75df2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501" status: 404 len: 111 microversion: 2.1 time: 0.032176 Jul 19 23:37:01.720943 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3505/6999] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:37:01 2022] GET /compute/v2.1/servers/b9e58dd4-7835-4a55-b523-f9e0f3d90501 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:37:05.112409 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7a9f3a38-a566-43a7-b039-de45659e0a3b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '.version_select at 0x7f7a10251a60>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:37:05.133731 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7a9f3a38-a566-43a7-b039-de45659e0a3b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2061930254" status: 202 len: 0 microversion: 2.1 time: 0.025762 Jul 19 23:37:05.134341 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3495/7000] 10.222.0.25 () {58 vars in 1283 bytes} [Tue Jul 19 23:37:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2061930254 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:37:05.165674 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3a2e92ca-d6c7-4ed6-b31b-68d56db4c88a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'create', calling method: .version_select at 0x7f7a02f589d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-47667492", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImEWDVgNO5v83W8cNfj2Dco5rTc/4Zxb0AGcsLcn9qyOoT6Bm9eBZV7SY3R5ySHB864WOBppUn5ArBtAwl0aUZraVgZPELlBxub6SmxFLfZArDkkR4W/5a7imw6dGVF3g=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:37:05.184725 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-3a2e92ca-d6c7-4ed6-b31b-68d56db4c88a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Getting quotas for project e250763e59c741fbbbf193ca4cac4189. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:37:05.190212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-3a2e92ca-d6c7-4ed6-b31b-68d56db4c88a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Getting quotas for user bdaa1c19bfa34fd69fd610406f41f728 and project e250763e59c741fbbbf193ca4cac4189. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:37:05.217664 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3a2e92ca-d6c7-4ed6-b31b-68d56db4c88a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.056771 Jul 19 23:37:05.218282 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3506/7001] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 23:37:05 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:37:10.840509 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:37:10.845560 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1bed90d9-d4a2-46a2-af14-70f9710b057b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-193978739", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "06207fac-d85a-41a1-a094-d293c03f4090"}], "key_name": "tempest-TestNetworkAdvancedServerOps-47667492", "security_groups": [{"name": "tempest-secgroup-smoke-970250375"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:37:10.959639 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-1bed90d9-d4a2-46a2-af14-70f9710b057b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] validate_networks() for [('06207fac-d85a-41a1-a094-d293c03f4090', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:37:11.358533 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-1bed90d9-d4a2-46a2-af14-70f9710b057b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:37:11.359400 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-1bed90d9-d4a2-46a2-af14-70f9710b057b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:37:11.359995 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-1bed90d9-d4a2-46a2-af14-70f9710b057b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:37:11.360710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-1bed90d9-d4a2-46a2-af14-70f9710b057b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:37:11.361394 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-1bed90d9-d4a2-46a2-af14-70f9710b057b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:37:11.373742 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1bed90d9-d4a2-46a2-af14-70f9710b057b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:11.374605 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1bed90d9-d4a2-46a2-af14-70f9710b057b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:11.376268 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1bed90d9-d4a2-46a2-af14-70f9710b057b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:11.376967 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1bed90d9-d4a2-46a2-af14-70f9710b057b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:11.397800 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-1bed90d9-d4a2-46a2-af14-70f9710b057b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Getting quotas for project e250763e59c741fbbbf193ca4cac4189. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:37:11.424515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-1bed90d9-d4a2-46a2-af14-70f9710b057b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Getting quotas for user bdaa1c19bfa34fd69fd610406f41f728 and project e250763e59c741fbbbf193ca4cac4189. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:37:11.448039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1bed90d9-d4a2-46a2-af14-70f9710b057b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:37:11.451458 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1bed90d9-d4a2-46a2-af14-70f9710b057b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:37:11.517589 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1bed90d9-d4a2-46a2-af14-70f9710b057b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.678050 Jul 19 23:37:11.519152 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3496/7002] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:37:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:37:11.531652 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ef6f5c5a-9de9-4847-8d82-276db9f39e68 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:37:11.533666 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ef6f5c5a-9de9-4847-8d82-276db9f39e68 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:37:11.638712 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ef6f5c5a-9de9-4847-8d82-276db9f39e68 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:37:11.645685 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ef6f5c5a-9de9-4847-8d82-276db9f39e68 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6" status: 200 len: 1264 microversion: 2.1 time: 0.119692 Jul 19 23:37:11.646460 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3507/7003] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:37:11 2022] GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 => generated 1264 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:37:12.664566 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4d494e35-92f4-4078-9139-85d1cd44eb10 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:37:12.665204 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4d494e35-92f4-4078-9139-85d1cd44eb10 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:37:12.674835 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d494e35-92f4-4078-9139-85d1cd44eb10 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:12.675825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d494e35-92f4-4078-9139-85d1cd44eb10 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:12.677083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d494e35-92f4-4078-9139-85d1cd44eb10 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:12.678387 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4d494e35-92f4-4078-9139-85d1cd44eb10 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:12.770479 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4d494e35-92f4-4078-9139-85d1cd44eb10 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:37:12.790087 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4d494e35-92f4-4078-9139-85d1cd44eb10 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6" status: 200 len: 1316 microversion: 2.1 time: 0.130602 Jul 19 23:37:12.797306 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3497/7004] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:37:12 2022] GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 => generated 1316 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:37:13.817509 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-688cbf45-1f2d-42a5-95c4-7cca058346cb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:37:13.819442 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-688cbf45-1f2d-42a5-95c4-7cca058346cb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:37:13.826018 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=36 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:37:13.830053 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-688cbf45-1f2d-42a5-95c4-7cca058346cb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:13.830998 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-688cbf45-1f2d-42a5-95c4-7cca058346cb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:13.832224 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-688cbf45-1f2d-42a5-95c4-7cca058346cb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:13.832840 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-688cbf45-1f2d-42a5-95c4-7cca058346cb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:14.427903 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-688cbf45-1f2d-42a5-95c4-7cca058346cb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:37:14.435776 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-688cbf45-1f2d-42a5-95c4-7cca058346cb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6" status: 200 len: 1389 microversion: 2.1 time: 0.625386 Jul 19 23:37:14.436349 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3508/7005] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:37:13 2022] GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 => generated 1389 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:37:14.761383 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-230d7de5-1133-4d2d-969a-d3e846f44538 req-19442ccf-aa15-426b-bea6-7641d0649db4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27da0098-e8f4-49f7-9649-527421198bf6", "tag": "13036b30-28c5-4236-ad3b-d13cf956b4d4"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:37:14.772957 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-230d7de5-1133-4d2d-969a-d3e846f44538 req-19442ccf-aa15-426b-bea6-7641d0649db4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:14.774305 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-230d7de5-1133-4d2d-969a-d3e846f44538 req-19442ccf-aa15-426b-bea6-7641d0649db4 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:14.787647 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-230d7de5-1133-4d2d-969a-d3e846f44538 req-19442ccf-aa15-426b-bea6-7641d0649db4 service nova] Creating event network-changed:13036b30-28c5-4236-ad3b-d13cf956b4d4 for instance 27da0098-e8f4-49f7-9649-527421198bf6 on n-h1-847009-3 Jul 19 23:37:14.795962 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-230d7de5-1133-4d2d-969a-d3e846f44538 req-19442ccf-aa15-426b-bea6-7641d0649db4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038432 Jul 19 23:37:14.797235 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3498/7006] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:37:15.453697 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0e1f504a-7690-44c2-b761-1b272f86574d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:37:15.454241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0e1f504a-7690-44c2-b761-1b272f86574d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:37:15.461144 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0e1f504a-7690-44c2-b761-1b272f86574d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:15.461601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0e1f504a-7690-44c2-b761-1b272f86574d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:15.462378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0e1f504a-7690-44c2-b761-1b272f86574d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:15.462823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0e1f504a-7690-44c2-b761-1b272f86574d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:15.600376 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0e1f504a-7690-44c2-b761-1b272f86574d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:37:15.608092 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0e1f504a-7690-44c2-b761-1b272f86574d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6" status: 200 len: 1389 microversion: 2.1 time: 0.158528 Jul 19 23:37:15.608670 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3509/7007] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:37:15 2022] GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 => generated 1389 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:37:16.627754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-65e99a25-b1c7-4890-84a0-447296b7ca20 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:37:16.628467 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-65e99a25-b1c7-4890-84a0-447296b7ca20 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:37:16.636214 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65e99a25-b1c7-4890-84a0-447296b7ca20 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:16.636665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65e99a25-b1c7-4890-84a0-447296b7ca20 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:16.637440 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65e99a25-b1c7-4890-84a0-447296b7ca20 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:16.637878 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65e99a25-b1c7-4890-84a0-447296b7ca20 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:16.778149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-65e99a25-b1c7-4890-84a0-447296b7ca20 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:37:16.785774 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-65e99a25-b1c7-4890-84a0-447296b7ca20 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6" status: 200 len: 1389 microversion: 2.1 time: 0.164198 Jul 19 23:37:16.786356 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3499/7008] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:37:16 2022] GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 => generated 1389 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:37:17.804085 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3d290057-1912-4f49-ae07-92268ba98b31 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:37:17.804716 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3d290057-1912-4f49-ae07-92268ba98b31 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:37:17.807454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:37:17.812839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d290057-1912-4f49-ae07-92268ba98b31 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:17.813301 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d290057-1912-4f49-ae07-92268ba98b31 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:17.814110 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d290057-1912-4f49-ae07-92268ba98b31 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:17.814587 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3d290057-1912-4f49-ae07-92268ba98b31 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:17.953835 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3d290057-1912-4f49-ae07-92268ba98b31 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:37:17.961692 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3d290057-1912-4f49-ae07-92268ba98b31 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6" status: 200 len: 1389 microversion: 2.1 time: 0.162388 Jul 19 23:37:17.962285 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3510/7009] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:37:17 2022] GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 => generated 1389 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:37:18.979352 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f300cdee-897f-47d8-9b83-b476bea208a5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:37:18.979899 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f300cdee-897f-47d8-9b83-b476bea208a5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:37:18.986820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f300cdee-897f-47d8-9b83-b476bea208a5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:18.987309 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f300cdee-897f-47d8-9b83-b476bea208a5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:18.988091 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f300cdee-897f-47d8-9b83-b476bea208a5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:18.988528 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f300cdee-897f-47d8-9b83-b476bea208a5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:19.120842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f300cdee-897f-47d8-9b83-b476bea208a5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:37:19.128398 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f300cdee-897f-47d8-9b83-b476bea208a5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6" status: 200 len: 1389 microversion: 2.1 time: 0.153091 Jul 19 23:37:19.128999 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3500/7010] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:37:18 2022] GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 => generated 1389 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:37:19.714542 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-63664408-ab2d-43de-9411-44fa53975c93 req-2bd576f4-4516-476e-8639-18eb7bdf5717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27da0098-e8f4-49f7-9649-527421198bf6", "name": "network-vif-plugged", "status": "completed", "tag": "13036b30-28c5-4236-ad3b-d13cf956b4d4"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:37:19.724809 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-63664408-ab2d-43de-9411-44fa53975c93 req-2bd576f4-4516-476e-8639-18eb7bdf5717 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:19.725339 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-63664408-ab2d-43de-9411-44fa53975c93 req-2bd576f4-4516-476e-8639-18eb7bdf5717 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:19.737264 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-63664408-ab2d-43de-9411-44fa53975c93 req-2bd576f4-4516-476e-8639-18eb7bdf5717 service nova] Creating event network-vif-plugged:13036b30-28c5-4236-ad3b-d13cf956b4d4 for instance 27da0098-e8f4-49f7-9649-527421198bf6 on n-h1-847009-3 Jul 19 23:37:19.742620 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-63664408-ab2d-43de-9411-44fa53975c93 req-2bd576f4-4516-476e-8639-18eb7bdf5717 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031707 Jul 19 23:37:19.743421 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3511/7011] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:37:20.146094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-710666ba-e41b-4fcf-91c3-3ec969c16b85 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:37:20.147058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-710666ba-e41b-4fcf-91c3-3ec969c16b85 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:37:20.153545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-710666ba-e41b-4fcf-91c3-3ec969c16b85 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:20.154007 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-710666ba-e41b-4fcf-91c3-3ec969c16b85 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:20.154778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-710666ba-e41b-4fcf-91c3-3ec969c16b85 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:20.155249 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-710666ba-e41b-4fcf-91c3-3ec969c16b85 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:20.293085 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-710666ba-e41b-4fcf-91c3-3ec969c16b85 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:37:20.300624 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-710666ba-e41b-4fcf-91c3-3ec969c16b85 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6" status: 200 len: 1389 microversion: 2.1 time: 0.158739 Jul 19 23:37:20.301235 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3501/7012] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:37:20 2022] GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 => generated 1389 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:37:21.319661 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4cb510b9-116a-4440-924c-c2c8e896e591 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:37:21.320379 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4cb510b9-116a-4440-924c-c2c8e896e591 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:37:21.326926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4cb510b9-116a-4440-924c-c2c8e896e591 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:21.327417 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4cb510b9-116a-4440-924c-c2c8e896e591 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:21.328188 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4cb510b9-116a-4440-924c-c2c8e896e591 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:21.328637 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4cb510b9-116a-4440-924c-c2c8e896e591 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:21.467080 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4cb510b9-116a-4440-924c-c2c8e896e591 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:37:21.475705 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4cb510b9-116a-4440-924c-c2c8e896e591 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6" status: 200 len: 1560 microversion: 2.1 time: 0.161448 Jul 19 23:37:21.476296 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3512/7013] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:37:21 2022] GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:37:21.491954 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d3cd99cb-67c1-4571-bc31-f6603c637720 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:37:21.492614 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d3cd99cb-67c1-4571-bc31-f6603c637720 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:37:21.495495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:37:21.496171 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:37:21.501924 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3cd99cb-67c1-4571-bc31-f6603c637720 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:21.502592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3cd99cb-67c1-4571-bc31-f6603c637720 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:21.503415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3cd99cb-67c1-4571-bc31-f6603c637720 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:21.503863 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d3cd99cb-67c1-4571-bc31-f6603c637720 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:21.638266 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d3cd99cb-67c1-4571-bc31-f6603c637720 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:37:21.646332 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d3cd99cb-67c1-4571-bc31-f6603c637720 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6" status: 200 len: 1560 microversion: 2.1 time: 0.157885 Jul 19 23:37:21.646958 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3502/7014] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:37:21 2022] GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:37:23.260904 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9cc55895-4440-44e7-a3d6-59ff3fbc2e31 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:37:23.261546 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9cc55895-4440-44e7-a3d6-59ff3fbc2e31 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:37:23.264860 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:37:23.266787 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-2d7413fa-f481-42b8-84e2-327c4ac26592 req-ec95a423-0b46-4031-8014-d9b69e7a3a4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27da0098-e8f4-49f7-9649-527421198bf6", "tag": "13036b30-28c5-4236-ad3b-d13cf956b4d4"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:37:23.269919 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9cc55895-4440-44e7-a3d6-59ff3fbc2e31 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:23.270390 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9cc55895-4440-44e7-a3d6-59ff3fbc2e31 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:23.272339 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:37:23.272662 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9cc55895-4440-44e7-a3d6-59ff3fbc2e31 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:23.273421 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9cc55895-4440-44e7-a3d6-59ff3fbc2e31 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:23.276659 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-2d7413fa-f481-42b8-84e2-327c4ac26592 req-ec95a423-0b46-4031-8014-d9b69e7a3a4e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:23.277104 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-2d7413fa-f481-42b8-84e2-327c4ac26592 req-ec95a423-0b46-4031-8014-d9b69e7a3a4e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:23.289155 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-2d7413fa-f481-42b8-84e2-327c4ac26592 req-ec95a423-0b46-4031-8014-d9b69e7a3a4e service nova] Creating event network-changed:13036b30-28c5-4236-ad3b-d13cf956b4d4 for instance 27da0098-e8f4-49f7-9649-527421198bf6 on n-h1-847009-3 Jul 19 23:37:23.294871 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-2d7413fa-f481-42b8-84e2-327c4ac26592 req-ec95a423-0b46-4031-8014-d9b69e7a3a4e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032866 Jul 19 23:37:23.295565 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3503/7015] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:37:23.500243 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9cc55895-4440-44e7-a3d6-59ff3fbc2e31 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:37:23.509891 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9cc55895-4440-44e7-a3d6-59ff3fbc2e31 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6" status: 200 len: 1560 microversion: 2.1 time: 0.253363 Jul 19 23:37:23.510576 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3513/7016] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:37:23 2022] GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 => generated 1560 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:37:48.757985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=36 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:37:48.762465 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f58eb3f8-7071-43f0-916d-513181bf4b97 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:37:48.763550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f58eb3f8-7071-43f0-916d-513181bf4b97 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:37:48.771046 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f58eb3f8-7071-43f0-916d-513181bf4b97 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:48.771612 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f58eb3f8-7071-43f0-916d-513181bf4b97 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:48.772375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f58eb3f8-7071-43f0-916d-513181bf4b97 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:48.772813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f58eb3f8-7071-43f0-916d-513181bf4b97 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:48.830541 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f58eb3f8-7071-43f0-916d-513181bf4b97 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6/action" status: 200 len: 24564 microversion: 2.1 time: 0.074475 Jul 19 23:37:48.831211 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3504/7017] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:37:48 2022] POST /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6/action => generated 24564 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 23:37:59.876941 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1273dc2e-962f-4756-820b-923322ed5ee7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:37:59.877952 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1273dc2e-962f-4756-820b-923322ed5ee7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:37:59.879988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=7 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:37:59.880843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=32 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:37:59.886769 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1273dc2e-962f-4756-820b-923322ed5ee7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:59.887266 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1273dc2e-962f-4756-820b-923322ed5ee7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:59.888055 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1273dc2e-962f-4756-820b-923322ed5ee7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:59.888511 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1273dc2e-962f-4756-820b-923322ed5ee7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:59.961981 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1273dc2e-962f-4756-820b-923322ed5ee7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6/action" status: 202 len: 0 microversion: 2.1 time: 0.089103 Jul 19 23:37:59.962630 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3514/7018] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:37:59 2022] POST /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:37:59.969137 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:37:59.970287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:37:59.975338 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d0eb375a-c7be-4134-8c80-eda6c502f6e7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:37:59.976078 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d0eb375a-c7be-4134-8c80-eda6c502f6e7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:37:59.984207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d0eb375a-c7be-4134-8c80-eda6c502f6e7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:59.984623 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d0eb375a-c7be-4134-8c80-eda6c502f6e7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:37:59.985434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d0eb375a-c7be-4134-8c80-eda6c502f6e7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:37:59.985908 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d0eb375a-c7be-4134-8c80-eda6c502f6e7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:00.210732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d0eb375a-c7be-4134-8c80-eda6c502f6e7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:38:00.218525 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d0eb375a-c7be-4134-8c80-eda6c502f6e7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6" status: 200 len: 1671 microversion: 2.1 time: 0.251379 Jul 19 23:38:00.219142 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3505/7019] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:37:59 2022] GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 => generated 1671 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:38:01.238651 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f52e676c-8f94-41e4-9058-216278696c09 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:38:01.240162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f52e676c-8f94-41e4-9058-216278696c09 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:38:01.246932 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f52e676c-8f94-41e4-9058-216278696c09 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:01.247439 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f52e676c-8f94-41e4-9058-216278696c09 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:01.248226 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f52e676c-8f94-41e4-9058-216278696c09 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:01.248681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f52e676c-8f94-41e4-9058-216278696c09 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:01.384926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f52e676c-8f94-41e4-9058-216278696c09 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:38:01.392474 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f52e676c-8f94-41e4-9058-216278696c09 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6" status: 200 len: 1676 microversion: 2.1 time: 0.159951 Jul 19 23:38:01.393040 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3515/7020] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:38:01 2022] GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:38:02.409983 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0d0d99bc-3cd1-4110-9824-18552c6e5f63 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:38:02.410604 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0d0d99bc-3cd1-4110-9824-18552c6e5f63 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:38:02.417558 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d0d99bc-3cd1-4110-9824-18552c6e5f63 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:02.418016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d0d99bc-3cd1-4110-9824-18552c6e5f63 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:02.418795 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d0d99bc-3cd1-4110-9824-18552c6e5f63 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:02.419277 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0d0d99bc-3cd1-4110-9824-18552c6e5f63 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:02.553621 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0d0d99bc-3cd1-4110-9824-18552c6e5f63 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:38:02.561232 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0d0d99bc-3cd1-4110-9824-18552c6e5f63 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6" status: 200 len: 1676 microversion: 2.1 time: 0.155274 Jul 19 23:38:02.561812 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3506/7021] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:38:02 2022] GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:38:03.579412 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4b39cdf6-d404-4f53-8c81-76eebdfd6d02 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:38:03.580069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4b39cdf6-d404-4f53-8c81-76eebdfd6d02 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:38:03.587597 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4b39cdf6-d404-4f53-8c81-76eebdfd6d02 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:03.588055 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4b39cdf6-d404-4f53-8c81-76eebdfd6d02 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:03.588828 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4b39cdf6-d404-4f53-8c81-76eebdfd6d02 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:03.589276 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4b39cdf6-d404-4f53-8c81-76eebdfd6d02 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:03.719421 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4b39cdf6-d404-4f53-8c81-76eebdfd6d02 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:38:03.727416 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4b39cdf6-d404-4f53-8c81-76eebdfd6d02 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6" status: 200 len: 1676 microversion: 2.1 time: 0.152086 Jul 19 23:38:03.727985 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3516/7022] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:38:03 2022] GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:38:04.745210 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f72ae75c-791f-4137-8604-15838efed7e5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:38:04.745822 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f72ae75c-791f-4137-8604-15838efed7e5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:38:04.752762 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f72ae75c-791f-4137-8604-15838efed7e5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:04.753209 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f72ae75c-791f-4137-8604-15838efed7e5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:04.753970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f72ae75c-791f-4137-8604-15838efed7e5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:04.754408 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f72ae75c-791f-4137-8604-15838efed7e5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:04.888585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f72ae75c-791f-4137-8604-15838efed7e5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:38:04.896708 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f72ae75c-791f-4137-8604-15838efed7e5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6" status: 200 len: 1676 microversion: 2.1 time: 0.155524 Jul 19 23:38:04.897308 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3507/7023] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:38:04 2022] GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:38:05.913849 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-31c456eb-e5f1-4f11-ae1d-ab4dc426f777 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:38:05.914468 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-31c456eb-e5f1-4f11-ae1d-ab4dc426f777 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:38:05.921429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31c456eb-e5f1-4f11-ae1d-ab4dc426f777 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:05.921886 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31c456eb-e5f1-4f11-ae1d-ab4dc426f777 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:05.922658 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31c456eb-e5f1-4f11-ae1d-ab4dc426f777 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:05.923126 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-31c456eb-e5f1-4f11-ae1d-ab4dc426f777 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:06.063495 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-31c456eb-e5f1-4f11-ae1d-ab4dc426f777 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:38:06.071851 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-31c456eb-e5f1-4f11-ae1d-ab4dc426f777 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6" status: 200 len: 1676 microversion: 2.1 time: 0.161894 Jul 19 23:38:06.072431 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3517/7024] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:38:05 2022] GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:38:07.089419 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e5c87113-6ded-4cd8-a7df-c6d12a194106 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:38:07.090066 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e5c87113-6ded-4cd8-a7df-c6d12a194106 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:38:07.096994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e5c87113-6ded-4cd8-a7df-c6d12a194106 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:07.097442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e5c87113-6ded-4cd8-a7df-c6d12a194106 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:07.098202 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e5c87113-6ded-4cd8-a7df-c6d12a194106 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:07.098645 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e5c87113-6ded-4cd8-a7df-c6d12a194106 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:07.233637 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e5c87113-6ded-4cd8-a7df-c6d12a194106 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:38:07.241866 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e5c87113-6ded-4cd8-a7df-c6d12a194106 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6" status: 200 len: 1676 microversion: 2.1 time: 0.156377 Jul 19 23:38:07.242452 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3508/7025] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:38:07 2022] GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:38:08.259889 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-426c190e-5bbb-4715-a03c-cb5fc975288c tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:38:08.260573 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-426c190e-5bbb-4715-a03c-cb5fc975288c tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:38:08.267738 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-426c190e-5bbb-4715-a03c-cb5fc975288c tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:08.268336 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-426c190e-5bbb-4715-a03c-cb5fc975288c tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:08.269124 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-426c190e-5bbb-4715-a03c-cb5fc975288c tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:08.269576 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-426c190e-5bbb-4715-a03c-cb5fc975288c tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:08.404029 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-426c190e-5bbb-4715-a03c-cb5fc975288c tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:38:08.411549 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-426c190e-5bbb-4715-a03c-cb5fc975288c tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6" status: 200 len: 1676 microversion: 2.1 time: 0.156472 Jul 19 23:38:08.412127 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3518/7026] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:38:08 2022] GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:38:09.429281 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b0a1022b-127e-4e83-9d38-56a2e8f99bbb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:38:09.429661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b0a1022b-127e-4e83-9d38-56a2e8f99bbb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:38:09.436517 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b0a1022b-127e-4e83-9d38-56a2e8f99bbb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:09.436980 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b0a1022b-127e-4e83-9d38-56a2e8f99bbb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:09.437764 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b0a1022b-127e-4e83-9d38-56a2e8f99bbb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:09.438211 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b0a1022b-127e-4e83-9d38-56a2e8f99bbb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:09.574446 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b0a1022b-127e-4e83-9d38-56a2e8f99bbb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:38:09.582162 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b0a1022b-127e-4e83-9d38-56a2e8f99bbb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6" status: 200 len: 1676 microversion: 2.1 time: 0.157499 Jul 19 23:38:09.583297 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3509/7027] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:38:09 2022] GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:38:10.600471 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2ebd28ba-dfe0-4942-98cd-33808d7036b1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:38:10.601152 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2ebd28ba-dfe0-4942-98cd-33808d7036b1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:38:10.608581 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2ebd28ba-dfe0-4942-98cd-33808d7036b1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:10.609127 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2ebd28ba-dfe0-4942-98cd-33808d7036b1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:10.609843 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2ebd28ba-dfe0-4942-98cd-33808d7036b1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:10.610293 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2ebd28ba-dfe0-4942-98cd-33808d7036b1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:10.747757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2ebd28ba-dfe0-4942-98cd-33808d7036b1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:38:10.755487 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2ebd28ba-dfe0-4942-98cd-33808d7036b1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6" status: 200 len: 1676 microversion: 2.1 time: 0.159517 Jul 19 23:38:10.756073 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3519/7028] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:38:10 2022] GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:38:11.773237 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-363162c8-6188-4d5d-bf93-b550423343d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:38:11.773852 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-363162c8-6188-4d5d-bf93-b550423343d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:38:11.781101 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-363162c8-6188-4d5d-bf93-b550423343d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:11.781653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-363162c8-6188-4d5d-bf93-b550423343d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:11.782440 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-363162c8-6188-4d5d-bf93-b550423343d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:11.782881 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-363162c8-6188-4d5d-bf93-b550423343d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:11.915145 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-363162c8-6188-4d5d-bf93-b550423343d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:38:11.922873 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-363162c8-6188-4d5d-bf93-b550423343d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6" status: 200 len: 1679 microversion: 2.1 time: 0.153841 Jul 19 23:38:11.923490 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3510/7029] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:38:11 2022] GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:38:38.123136 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2368e794-1bf3-49f4-a058-db3843ab5e68 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:38:38.124087 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2368e794-1bf3-49f4-a058-db3843ab5e68 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:38:38.126378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=12 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:38:38.127065 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:38:38.133266 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2368e794-1bf3-49f4-a058-db3843ab5e68 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:38.133722 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2368e794-1bf3-49f4-a058-db3843ab5e68 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:38.134497 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2368e794-1bf3-49f4-a058-db3843ab5e68 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:38.134942 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2368e794-1bf3-49f4-a058-db3843ab5e68 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:38.198712 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2368e794-1bf3-49f4-a058-db3843ab5e68 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6/action" status: 200 len: 69075 microversion: 2.1 time: 0.079419 Jul 19 23:38:38.199444 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3520/7030] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:38:38 2022] POST /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6/action => generated 69075 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 23:38:45.664178 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-98b88b54-f4de-4855-ae83-3fc6c8f85018 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:38:45.664943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-98b88b54-f4de-4855-ae83-3fc6c8f85018 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:38:45.666705 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-d1a6e78f-3f6f-4990-9bfe-0f169abf5e72 req-8e2567a9-b4d6-499f-882a-e7809cd9fffe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27da0098-e8f4-49f7-9649-527421198bf6", "tag": "13036b30-28c5-4236-ad3b-d13cf956b4d4"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:38:45.667505 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=12 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:38:45.668431 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=36 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:38:45.674421 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-98b88b54-f4de-4855-ae83-3fc6c8f85018 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:45.675025 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-98b88b54-f4de-4855-ae83-3fc6c8f85018 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:45.676088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-98b88b54-f4de-4855-ae83-3fc6c8f85018 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:45.676607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-98b88b54-f4de-4855-ae83-3fc6c8f85018 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:45.678059 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d1a6e78f-3f6f-4990-9bfe-0f169abf5e72 req-8e2567a9-b4d6-499f-882a-e7809cd9fffe service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:45.678718 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-d1a6e78f-3f6f-4990-9bfe-0f169abf5e72 req-8e2567a9-b4d6-499f-882a-e7809cd9fffe service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:45.691908 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-d1a6e78f-3f6f-4990-9bfe-0f169abf5e72 req-8e2567a9-b4d6-499f-882a-e7809cd9fffe service nova] Creating event network-changed:13036b30-28c5-4236-ad3b-d13cf956b4d4 for instance 27da0098-e8f4-49f7-9649-527421198bf6 on n-h1-847009-3 Jul 19 23:38:45.698682 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-d1a6e78f-3f6f-4990-9bfe-0f169abf5e72 req-8e2567a9-b4d6-499f-882a-e7809cd9fffe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036448 Jul 19 23:38:45.699875 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3521/7031] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:38:45.707553 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-98b88b54-f4de-4855-ae83-3fc6c8f85018 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:38:45.812280 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-98b88b54-f4de-4855-ae83-3fc6c8f85018 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "DELETE /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6" status: 204 len: 0 microversion: 2.1 time: 0.149970 Jul 19 23:38:45.813978 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3511/7032] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:38:45 2022] DELETE /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:38:45.823737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ab14aace-28ca-495c-bcca-05625d9d9809 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:38:45.824482 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ab14aace-28ca-495c-bcca-05625d9d9809 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:38:45.831735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab14aace-28ca-495c-bcca-05625d9d9809 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:45.832496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab14aace-28ca-495c-bcca-05625d9d9809 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:45.833331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab14aace-28ca-495c-bcca-05625d9d9809 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:45.833876 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ab14aace-28ca-495c-bcca-05625d9d9809 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:46.055052 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ab14aace-28ca-495c-bcca-05625d9d9809 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:38:46.062664 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ab14aace-28ca-495c-bcca-05625d9d9809 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6" status: 200 len: 1685 microversion: 2.1 time: 0.243645 Jul 19 23:38:46.063305 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3522/7033] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:38:45 2022] GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 => generated 1685 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:38:47.081292 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-214ca4ac-7211-4388-9325-f3e1a607be71 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:38:47.082006 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-214ca4ac-7211-4388-9325-f3e1a607be71 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:38:47.089312 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-214ca4ac-7211-4388-9325-f3e1a607be71 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:47.089770 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-214ca4ac-7211-4388-9325-f3e1a607be71 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:47.090545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-214ca4ac-7211-4388-9325-f3e1a607be71 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:47.090988 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-214ca4ac-7211-4388-9325-f3e1a607be71 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:47.281575 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-214ca4ac-7211-4388-9325-f3e1a607be71 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:38:47.290306 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-214ca4ac-7211-4388-9325-f3e1a607be71 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6" status: 200 len: 1685 microversion: 2.1 time: 0.213259 Jul 19 23:38:47.290895 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3512/7034] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:38:47 2022] GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 => generated 1685 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:38:48.148441 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-076e03ad-f19e-4754-9a74-7c409687bde5 req-9a35a937-933d-4dc0-a7db-fe98642adaaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27da0098-e8f4-49f7-9649-527421198bf6", "name": "network-vif-deleted", "tag": "13036b30-28c5-4236-ad3b-d13cf956b4d4"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:38:48.159751 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-076e03ad-f19e-4754-9a74-7c409687bde5 req-9a35a937-933d-4dc0-a7db-fe98642adaaa service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:48.160213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-076e03ad-f19e-4754-9a74-7c409687bde5 req-9a35a937-933d-4dc0-a7db-fe98642adaaa service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:48.179618 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-076e03ad-f19e-4754-9a74-7c409687bde5 req-9a35a937-933d-4dc0-a7db-fe98642adaaa service nova] Creating event network-vif-deleted:13036b30-28c5-4236-ad3b-d13cf956b4d4 for instance 27da0098-e8f4-49f7-9649-527421198bf6 on n-h1-847009-3 Jul 19 23:38:48.186624 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-076e03ad-f19e-4754-9a74-7c409687bde5 req-9a35a937-933d-4dc0-a7db-fe98642adaaa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042482 Jul 19 23:38:48.187237 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3523/7035] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:38:48.309523 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-65d6393c-8295-4bb9-a8a1-2c3314bbb543 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:38:48.310461 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-65d6393c-8295-4bb9-a8a1-2c3314bbb543 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:38:48.318607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65d6393c-8295-4bb9-a8a1-2c3314bbb543 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:48.319710 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65d6393c-8295-4bb9-a8a1-2c3314bbb543 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:48.320527 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65d6393c-8295-4bb9-a8a1-2c3314bbb543 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:48.320970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65d6393c-8295-4bb9-a8a1-2c3314bbb543 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:48.352023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65d6393c-8295-4bb9-a8a1-2c3314bbb543 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:48.352404 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-65d6393c-8295-4bb9-a8a1-2c3314bbb543 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:48.352899 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-65d6393c-8295-4bb9-a8a1-2c3314bbb543 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lazy-loading 'fault' on Instance uuid 27da0098-e8f4-49f7-9649-527421198bf6 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:38:48.395086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-65d6393c-8295-4bb9-a8a1-2c3314bbb543 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:38:48.402782 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-65d6393c-8295-4bb9-a8a1-2c3314bbb543 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6" status: 200 len: 1354 microversion: 2.1 time: 0.098334 Jul 19 23:38:48.403411 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3513/7036] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:38:48 2022] GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 => generated 1354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:38:49.421837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5b03f1ec-20b5-4237-aa19-4cbc6432a47d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:38:49.422592 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5b03f1ec-20b5-4237-aa19-4cbc6432a47d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 27da0098-e8f4-49f7-9649-527421198bf6] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:38:49.429571 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b03f1ec-20b5-4237-aa19-4cbc6432a47d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:49.430036 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b03f1ec-20b5-4237-aa19-4cbc6432a47d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:49.430814 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b03f1ec-20b5-4237-aa19-4cbc6432a47d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:49.431304 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b03f1ec-20b5-4237-aa19-4cbc6432a47d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:49.444828 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-5b03f1ec-20b5-4237-aa19-4cbc6432a47d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] HTTP exception thrown: Instance 27da0098-e8f4-49f7-9649-527421198bf6 could not be found. Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5b03f1ec-20b5-4237-aa19-4cbc6432a47d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Request method failure captured: Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 HTTP/1.1 Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1z_i3_paGortEfNaOQ-D6RCdDbS-gFpUd1lXlaBmT5d8oYP2yebmdV_XnM7ZxXqP9UNbb4IDO7U57P8_q5lGyi5pGaH1sCoNIZdz_Yb4nbHkmoo7pLg5PveXEAt6VDocXQIXfFoPvZAh1aLRxH9YfhSo3R3-TTentuS0y213WSMCEEw Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: e250763e59c741fbbbf193ca4cac4189 Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-660489764 Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e250763e59c741fbbbf193ca4cac4189"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e250763e59c741fbbbf193ca4cac4189"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e250763e59c741fbbbf193ca4cac4189"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e250763e59c741fbbbf193ca4cac4189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-TestNetworkAdvancedServerOps-660489764 Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: e250763e59c741fbbbf193ca4cac4189 Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-660489764 Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-TestNetworkAdvancedServerOps-660489764-project Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: bdaa1c19bfa34fd69fd610406f41f728 Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-TestNetworkAdvancedServerOps-660489764-project Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 27da0098-e8f4-49f7-9649-527421198bf6 could not be found. Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '27da0098-e8f4-49f7-9649-527421198bf6'} Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27da0098-e8f4-49f7-9649-527421198bf6 could not be found. Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27da0098-e8f4-49f7-9649-527421198bf6 could not be found. Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:38:49.446494 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:38:49.451879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:38:49.451879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:38:49.451879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:38:49.451879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:38:49.451879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:38:49.451879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27da0098-e8f4-49f7-9649-527421198bf6 could not be found. Jul 19 23:38:49.451879 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:38:49.451879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5b03f1ec-20b5-4237-aa19-4cbc6432a47d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Returning 404 to user: Instance 27da0098-e8f4-49f7-9649-527421198bf6 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:38:49.451879 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5b03f1ec-20b5-4237-aa19-4cbc6432a47d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6" status: 404 len: 111 microversion: 2.1 time: 0.031319 Jul 19 23:38:49.451879 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3524/7037] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:38:49 2022] GET /compute/v2.1/servers/27da0098-e8f4-49f7-9649-527421198bf6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 23:38:52.524451 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-868e6ee0-bea9-4957-b8de-3e1e946521ca tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '.version_select at 0x7f7a03a529d0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:38:52.545355 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-868e6ee0-bea9-4957-b8de-3e1e946521ca tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-47667492" status: 202 len: 0 microversion: 2.1 time: 0.024784 Jul 19 23:38:52.546307 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3514/7038] 10.222.0.25 () {58 vars in 1277 bytes} [Tue Jul 19 23:38:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-47667492 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:38:52.575313 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2fdc6cd7-b4fb-4344-825c-b19d7b9db670 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'create', calling method: .version_select at 0x7f7a02fd0790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1162054479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUZutvk8dYw5zW41JltqRjwEz5OMbvnzykPGvbD9nNejsEX54ltZzdmvgRAO6lVziwH+b60wW6R/uq96Aqrej/3RJG5j7u11hamZpwNhtfbTRkc+c+jEZjxxmr/eZWgcA=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:38:52.594586 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-2fdc6cd7-b4fb-4344-825c-b19d7b9db670 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Getting quotas for project e250763e59c741fbbbf193ca4cac4189. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:38:52.601639 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-2fdc6cd7-b4fb-4344-825c-b19d7b9db670 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Getting quotas for user bdaa1c19bfa34fd69fd610406f41f728 and project e250763e59c741fbbbf193ca4cac4189. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:38:52.625383 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2fdc6cd7-b4fb-4344-825c-b19d7b9db670 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054095 Jul 19 23:38:52.626062 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3525/7039] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 23:38:52 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:38:58.314395 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-175016ec-0616-4c45-935b-510594ff8cf2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2120749600", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "5d566460-d045-4857-8b8e-549c0c760e67"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1162054479", "security_groups": [{"name": "tempest-secgroup-smoke-21814000"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:38:58.399709 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:38:58.451698 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-175016ec-0616-4c45-935b-510594ff8cf2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] validate_networks() for [('5d566460-d045-4857-8b8e-549c0c760e67', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:38:58.894300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-175016ec-0616-4c45-935b-510594ff8cf2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:38:58.894722 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-175016ec-0616-4c45-935b-510594ff8cf2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:38:58.895221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-175016ec-0616-4c45-935b-510594ff8cf2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:38:58.895837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-175016ec-0616-4c45-935b-510594ff8cf2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:38:58.896442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-175016ec-0616-4c45-935b-510594ff8cf2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:38:58.911606 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-175016ec-0616-4c45-935b-510594ff8cf2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:58.912500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-175016ec-0616-4c45-935b-510594ff8cf2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:58.913724 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-175016ec-0616-4c45-935b-510594ff8cf2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:38:58.914438 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-175016ec-0616-4c45-935b-510594ff8cf2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:38:58.954785 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-175016ec-0616-4c45-935b-510594ff8cf2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Getting quotas for project e250763e59c741fbbbf193ca4cac4189. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:38:58.963992 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-175016ec-0616-4c45-935b-510594ff8cf2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Getting quotas for user bdaa1c19bfa34fd69fd610406f41f728 and project e250763e59c741fbbbf193ca4cac4189. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:38:58.979365 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-175016ec-0616-4c45-935b-510594ff8cf2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:38:58.981721 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-175016ec-0616-4c45-935b-510594ff8cf2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:38:59.036299 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-175016ec-0616-4c45-935b-510594ff8cf2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.725873 Jul 19 23:38:59.037794 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3515/7040] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:38:58 2022] POST /compute/v2.1/servers => generated 404 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:38:59.049145 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-63cc3ee7-140b-4594-b975-2599040e1e66 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:38:59.050546 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-63cc3ee7-140b-4594-b975-2599040e1e66 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:38:59.112187 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-63cc3ee7-140b-4594-b975-2599040e1e66 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:38:59.120629 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-63cc3ee7-140b-4594-b975-2599040e1e66 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1267 microversion: 2.1 time: 0.076508 Jul 19 23:38:59.130232 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3526/7041] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:38:59 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1267 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:39:00.138909 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4bc14d49-4968-47a9-98ad-aec3bf72fe2a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:39:00.139568 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4bc14d49-4968-47a9-98ad-aec3bf72fe2a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:00.163283 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4bc14d49-4968-47a9-98ad-aec3bf72fe2a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:00.164004 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4bc14d49-4968-47a9-98ad-aec3bf72fe2a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:00.164965 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4bc14d49-4968-47a9-98ad-aec3bf72fe2a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:00.165608 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4bc14d49-4968-47a9-98ad-aec3bf72fe2a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:00.261494 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4bc14d49-4968-47a9-98ad-aec3bf72fe2a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:00.271009 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4bc14d49-4968-47a9-98ad-aec3bf72fe2a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1337 microversion: 2.1 time: 0.136792 Jul 19 23:39:00.272361 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3516/7042] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:39:00 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1337 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:39:01.290098 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-32ee53ba-be98-41ba-8ea7-9eeb2b200a78 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:39:01.290737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-32ee53ba-be98-41ba-8ea7-9eeb2b200a78 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:01.296657 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=16 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:39:01.299987 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32ee53ba-be98-41ba-8ea7-9eeb2b200a78 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:01.300487 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32ee53ba-be98-41ba-8ea7-9eeb2b200a78 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:01.301671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32ee53ba-be98-41ba-8ea7-9eeb2b200a78 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:01.302165 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32ee53ba-be98-41ba-8ea7-9eeb2b200a78 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:01.458186 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-32ee53ba-be98-41ba-8ea7-9eeb2b200a78 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:01.466690 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-32ee53ba-be98-41ba-8ea7-9eeb2b200a78 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1391 microversion: 2.1 time: 0.180895 Jul 19 23:39:01.467700 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3527/7043] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:39:01 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1391 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:39:01.985327 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-9bc495d0-3f0f-4caa-8a23-e8e9c795b11d req-0582a40b-8f80-4a2f-bb33-637be5faf69c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97844773-079b-42e6-b6ac-aef43573abf0", "tag": "391f6ede-1925-4195-ac7d-d43e4b9952f2"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:39:01.994932 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-9bc495d0-3f0f-4caa-8a23-e8e9c795b11d req-0582a40b-8f80-4a2f-bb33-637be5faf69c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:01.995905 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-9bc495d0-3f0f-4caa-8a23-e8e9c795b11d req-0582a40b-8f80-4a2f-bb33-637be5faf69c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:02.010617 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-9bc495d0-3f0f-4caa-8a23-e8e9c795b11d req-0582a40b-8f80-4a2f-bb33-637be5faf69c service nova] Creating event network-changed:391f6ede-1925-4195-ac7d-d43e4b9952f2 for instance 97844773-079b-42e6-b6ac-aef43573abf0 on n-h2-847009-3 Jul 19 23:39:02.020129 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-9bc495d0-3f0f-4caa-8a23-e8e9c795b11d req-0582a40b-8f80-4a2f-bb33-637be5faf69c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034897 Jul 19 23:39:02.020129 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3517/7044] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:39:02.484196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5e495dda-9cfc-4e19-b474-f33f260417fd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:39:02.484946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5e495dda-9cfc-4e19-b474-f33f260417fd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:02.492268 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5e495dda-9cfc-4e19-b474-f33f260417fd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:02.492731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5e495dda-9cfc-4e19-b474-f33f260417fd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:02.493508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5e495dda-9cfc-4e19-b474-f33f260417fd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:02.493958 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5e495dda-9cfc-4e19-b474-f33f260417fd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:02.627435 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5e495dda-9cfc-4e19-b474-f33f260417fd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:02.636212 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5e495dda-9cfc-4e19-b474-f33f260417fd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1391 microversion: 2.1 time: 0.155670 Jul 19 23:39:02.636800 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3528/7045] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:39:02 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:39:03.655149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-265991bd-0dce-467d-a463-fbfbde52688a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:39:03.656450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-265991bd-0dce-467d-a463-fbfbde52688a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:03.666058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-265991bd-0dce-467d-a463-fbfbde52688a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:03.666509 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-265991bd-0dce-467d-a463-fbfbde52688a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:03.667346 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-265991bd-0dce-467d-a463-fbfbde52688a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:03.667791 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-265991bd-0dce-467d-a463-fbfbde52688a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:03.810797 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-265991bd-0dce-467d-a463-fbfbde52688a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:03.819411 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-265991bd-0dce-467d-a463-fbfbde52688a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1391 microversion: 2.1 time: 0.168607 Jul 19 23:39:03.819981 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3518/7046] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:39:03 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:39:04.837054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eecb7974-7c4d-4cfb-9ba6-90f78bbfb1c3 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:39:04.837907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eecb7974-7c4d-4cfb-9ba6-90f78bbfb1c3 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:04.845990 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eecb7974-7c4d-4cfb-9ba6-90f78bbfb1c3 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:04.846456 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eecb7974-7c4d-4cfb-9ba6-90f78bbfb1c3 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:04.847304 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eecb7974-7c4d-4cfb-9ba6-90f78bbfb1c3 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:04.847769 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eecb7974-7c4d-4cfb-9ba6-90f78bbfb1c3 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:04.979488 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-eecb7974-7c4d-4cfb-9ba6-90f78bbfb1c3 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:04.986979 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eecb7974-7c4d-4cfb-9ba6-90f78bbfb1c3 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1391 microversion: 2.1 time: 0.154510 Jul 19 23:39:04.987571 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3529/7047] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:39:04 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:39:06.003803 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-384de91b-fa0f-437d-8988-6c698ec6fa9e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:39:06.004417 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-384de91b-fa0f-437d-8988-6c698ec6fa9e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:06.011442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-384de91b-fa0f-437d-8988-6c698ec6fa9e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:06.011903 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-384de91b-fa0f-437d-8988-6c698ec6fa9e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:06.012699 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-384de91b-fa0f-437d-8988-6c698ec6fa9e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:06.013136 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-384de91b-fa0f-437d-8988-6c698ec6fa9e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:06.153956 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-384de91b-fa0f-437d-8988-6c698ec6fa9e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:06.162363 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-384de91b-fa0f-437d-8988-6c698ec6fa9e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1391 microversion: 2.1 time: 0.161929 Jul 19 23:39:06.163290 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3519/7048] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:39:05 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:39:07.179899 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e0a09921-abb9-4115-9027-3428494d1e23 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:39:07.180537 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e0a09921-abb9-4115-9027-3428494d1e23 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:07.187596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0a09921-abb9-4115-9027-3428494d1e23 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:07.188067 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0a09921-abb9-4115-9027-3428494d1e23 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:07.188855 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0a09921-abb9-4115-9027-3428494d1e23 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:07.189314 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e0a09921-abb9-4115-9027-3428494d1e23 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:07.321163 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e0a09921-abb9-4115-9027-3428494d1e23 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:07.328691 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e0a09921-abb9-4115-9027-3428494d1e23 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1391 microversion: 2.1 time: 0.152797 Jul 19 23:39:07.329271 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3530/7049] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:39:07 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:39:07.605331 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-b1cd8562-16bf-49e5-927b-61cea0d8aaac req-07e2f457-05c3-427f-9b36-4ad1f4b27c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97844773-079b-42e6-b6ac-aef43573abf0", "name": "network-vif-plugged", "status": "completed", "tag": "391f6ede-1925-4195-ac7d-d43e4b9952f2"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:39:07.614644 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b1cd8562-16bf-49e5-927b-61cea0d8aaac req-07e2f457-05c3-427f-9b36-4ad1f4b27c43 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:07.614998 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-b1cd8562-16bf-49e5-927b-61cea0d8aaac req-07e2f457-05c3-427f-9b36-4ad1f4b27c43 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:07.627044 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-b1cd8562-16bf-49e5-927b-61cea0d8aaac req-07e2f457-05c3-427f-9b36-4ad1f4b27c43 service nova] Creating event network-vif-plugged:391f6ede-1925-4195-ac7d-d43e4b9952f2 for instance 97844773-079b-42e6-b6ac-aef43573abf0 on n-h2-847009-3 Jul 19 23:39:07.633068 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-b1cd8562-16bf-49e5-927b-61cea0d8aaac req-07e2f457-05c3-427f-9b36-4ad1f4b27c43 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031470 Jul 19 23:39:07.633871 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3520/7050] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:39:08.346477 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3cf75344-37d5-4fe5-b245-0012c3ba6d35 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:39:08.347123 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3cf75344-37d5-4fe5-b245-0012c3ba6d35 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:08.349891 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:39:08.356279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3cf75344-37d5-4fe5-b245-0012c3ba6d35 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:08.356742 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3cf75344-37d5-4fe5-b245-0012c3ba6d35 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:08.357562 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3cf75344-37d5-4fe5-b245-0012c3ba6d35 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:08.358011 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3cf75344-37d5-4fe5-b245-0012c3ba6d35 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:08.498182 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3cf75344-37d5-4fe5-b245-0012c3ba6d35 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:08.505958 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3cf75344-37d5-4fe5-b245-0012c3ba6d35 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1391 microversion: 2.1 time: 0.163370 Jul 19 23:39:08.507347 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3531/7051] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:39:08 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:39:09.521722 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:39:09.522562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:39:09.526794 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4096100d-2338-46d7-897d-a6391d49c447 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:39:09.527530 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4096100d-2338-46d7-897d-a6391d49c447 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:09.534730 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4096100d-2338-46d7-897d-a6391d49c447 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:09.535210 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4096100d-2338-46d7-897d-a6391d49c447 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:09.535982 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4096100d-2338-46d7-897d-a6391d49c447 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:09.536428 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4096100d-2338-46d7-897d-a6391d49c447 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:09.676245 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4096100d-2338-46d7-897d-a6391d49c447 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:09.684568 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4096100d-2338-46d7-897d-a6391d49c447 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1562 microversion: 2.1 time: 0.164636 Jul 19 23:39:09.685196 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3521/7052] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:39:09 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1562 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:39:09.701476 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-39de449e-a3fe-44af-bece-ebfa4943fb4b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:39:09.702047 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-39de449e-a3fe-44af-bece-ebfa4943fb4b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:09.704007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:39:09.710493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39de449e-a3fe-44af-bece-ebfa4943fb4b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:09.710959 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39de449e-a3fe-44af-bece-ebfa4943fb4b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:09.711782 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39de449e-a3fe-44af-bece-ebfa4943fb4b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:09.712243 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-39de449e-a3fe-44af-bece-ebfa4943fb4b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:09.849491 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-39de449e-a3fe-44af-bece-ebfa4943fb4b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:09.857866 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-39de449e-a3fe-44af-bece-ebfa4943fb4b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1562 microversion: 2.1 time: 0.160331 Jul 19 23:39:09.858446 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3532/7053] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:39:09 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:39:11.486274 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-35b8caa8-c562-457b-b417-d958445e22a7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:39:11.486895 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-35b8caa8-c562-457b-b417-d958445e22a7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:11.489068 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-74eb2f2e-1509-4ade-a9e1-13da2edf9b63 req-fc30e5f4-b5d2-4ff5-8197-4f4b14b31465 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97844773-079b-42e6-b6ac-aef43573abf0", "tag": "391f6ede-1925-4195-ac7d-d43e4b9952f2"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:39:11.495659 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35b8caa8-c562-457b-b417-d958445e22a7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:11.496114 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35b8caa8-c562-457b-b417-d958445e22a7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:11.496896 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35b8caa8-c562-457b-b417-d958445e22a7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:11.497332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-35b8caa8-c562-457b-b417-d958445e22a7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:11.500175 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-74eb2f2e-1509-4ade-a9e1-13da2edf9b63 req-fc30e5f4-b5d2-4ff5-8197-4f4b14b31465 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:11.500838 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-74eb2f2e-1509-4ade-a9e1-13da2edf9b63 req-fc30e5f4-b5d2-4ff5-8197-4f4b14b31465 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:11.512615 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-74eb2f2e-1509-4ade-a9e1-13da2edf9b63 req-fc30e5f4-b5d2-4ff5-8197-4f4b14b31465 service nova] Creating event network-changed:391f6ede-1925-4195-ac7d-d43e4b9952f2 for instance 97844773-079b-42e6-b6ac-aef43573abf0 on n-h2-847009-3 Jul 19 23:39:11.518745 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-74eb2f2e-1509-4ade-a9e1-13da2edf9b63 req-fc30e5f4-b5d2-4ff5-8197-4f4b14b31465 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033286 Jul 19 23:39:11.520062 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3533/7054] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:39:11.651366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-35b8caa8-c562-457b-b417-d958445e22a7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:11.659999 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-35b8caa8-c562-457b-b417-d958445e22a7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1562 microversion: 2.1 time: 0.177776 Jul 19 23:39:11.660595 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3522/7055] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:39:11 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1562 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:39:34.917331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=5 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:39:34.918322 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=38 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:39:34.923039 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0ef5234a-a78c-4213-a793-597aba45f293 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:39:34.924104 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0ef5234a-a78c-4213-a793-597aba45f293 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:34.932085 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ef5234a-a78c-4213-a793-597aba45f293 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:34.932574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ef5234a-a78c-4213-a793-597aba45f293 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:34.933348 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ef5234a-a78c-4213-a793-597aba45f293 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:34.933830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ef5234a-a78c-4213-a793-597aba45f293 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:34.986512 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0ef5234a-a78c-4213-a793-597aba45f293 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0/action" status: 200 len: 24570 microversion: 2.1 time: 0.071103 Jul 19 23:39:34.987243 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3534/7056] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:39:34 2022] POST /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0/action => generated 24570 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 23:39:41.387139 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f897b1d0-f9b5-4641-98e8-32004fd0eea1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:39:41.388134 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f897b1d0-f9b5-4641-98e8-32004fd0eea1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:41.390388 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:39:41.391039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=36 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:39:41.398154 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f897b1d0-f9b5-4641-98e8-32004fd0eea1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:41.398154 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f897b1d0-f9b5-4641-98e8-32004fd0eea1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:41.399343 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f897b1d0-f9b5-4641-98e8-32004fd0eea1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:41.399780 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f897b1d0-f9b5-4641-98e8-32004fd0eea1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:41.445086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f897b1d0-f9b5-4641-98e8-32004fd0eea1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:41.451765 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f897b1d0-f9b5-4641-98e8-32004fd0eea1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Old instance type m1.heat2, new instance type m1.heat {{(pid=119338) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 19 23:39:41.458307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-f897b1d0-f9b5-4641-98e8-32004fd0eea1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:39:41.458734 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-f897b1d0-f9b5-4641-98e8-32004fd0eea1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:39:41.459251 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-f897b1d0-f9b5-4641-98e8-32004fd0eea1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:39:41.459668 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-f897b1d0-f9b5-4641-98e8-32004fd0eea1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:39:41.460749 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-f897b1d0-f9b5-4641-98e8-32004fd0eea1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:39:41.526500 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f897b1d0-f9b5-4641-98e8-32004fd0eea1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0/action" status: 202 len: 0 microversion: 2.1 time: 0.144003 Jul 19 23:39:41.527160 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3523/7057] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:39:41 2022] POST /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:39:41.536214 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7d4ae824-8140-46b3-b677-effd3fb7235f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:39:41.536945 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7d4ae824-8140-46b3-b677-effd3fb7235f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:41.545020 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d4ae824-8140-46b3-b677-effd3fb7235f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:41.545500 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d4ae824-8140-46b3-b677-effd3fb7235f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:41.546331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d4ae824-8140-46b3-b677-effd3fb7235f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:41.546787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7d4ae824-8140-46b3-b677-effd3fb7235f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:41.689163 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7d4ae824-8140-46b3-b677-effd3fb7235f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:41.699465 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7d4ae824-8140-46b3-b677-effd3fb7235f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1689 microversion: 2.1 time: 0.167393 Jul 19 23:39:41.700050 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3535/7058] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:39:41 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:39:42.717946 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f6922a03-9775-446c-9ede-17373a5eb26f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:39:42.722564 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f6922a03-9775-446c-9ede-17373a5eb26f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:42.727300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f6922a03-9775-446c-9ede-17373a5eb26f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:42.727764 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f6922a03-9775-446c-9ede-17373a5eb26f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:42.728557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f6922a03-9775-446c-9ede-17373a5eb26f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:42.729007 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f6922a03-9775-446c-9ede-17373a5eb26f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:42.867236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f6922a03-9775-446c-9ede-17373a5eb26f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:42.875369 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f6922a03-9775-446c-9ede-17373a5eb26f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1689 microversion: 2.1 time: 0.162099 Jul 19 23:39:42.875979 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3524/7059] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:39:42 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:39:43.892853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2afd8be5-2e4b-4420-825f-2fde9ced2596 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:39:43.893491 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2afd8be5-2e4b-4420-825f-2fde9ced2596 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:43.902365 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2afd8be5-2e4b-4420-825f-2fde9ced2596 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:43.903129 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2afd8be5-2e4b-4420-825f-2fde9ced2596 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:43.903930 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2afd8be5-2e4b-4420-825f-2fde9ced2596 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:43.904385 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2afd8be5-2e4b-4420-825f-2fde9ced2596 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:44.042730 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2afd8be5-2e4b-4420-825f-2fde9ced2596 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:44.050458 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2afd8be5-2e4b-4420-825f-2fde9ced2596 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1689 microversion: 2.1 time: 0.161511 Jul 19 23:39:44.051044 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3536/7060] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:39:43 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:39:45.068985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ff26a33c-1eca-42ac-a82a-f29f727c5959 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:39:45.070377 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ff26a33c-1eca-42ac-a82a-f29f727c5959 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:45.077659 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ff26a33c-1eca-42ac-a82a-f29f727c5959 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:45.078166 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ff26a33c-1eca-42ac-a82a-f29f727c5959 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:45.079033 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ff26a33c-1eca-42ac-a82a-f29f727c5959 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:45.079558 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ff26a33c-1eca-42ac-a82a-f29f727c5959 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:45.224319 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ff26a33c-1eca-42ac-a82a-f29f727c5959 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:45.232989 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ff26a33c-1eca-42ac-a82a-f29f727c5959 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1689 microversion: 2.1 time: 0.168818 Jul 19 23:39:45.233579 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3525/7061] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:39:45 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:39:46.250029 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9ca44715-3f64-4236-a811-4aad91b569c9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:39:46.250664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9ca44715-3f64-4236-a811-4aad91b569c9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:46.257450 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ca44715-3f64-4236-a811-4aad91b569c9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:46.265581 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ca44715-3f64-4236-a811-4aad91b569c9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:46.266607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ca44715-3f64-4236-a811-4aad91b569c9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:46.267084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9ca44715-3f64-4236-a811-4aad91b569c9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:46.436262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9ca44715-3f64-4236-a811-4aad91b569c9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:46.444893 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9ca44715-3f64-4236-a811-4aad91b569c9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1689 microversion: 2.1 time: 0.198907 Jul 19 23:39:46.446914 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3537/7062] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:39:46 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1689 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:39:47.464996 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6cda66a0-4efd-455e-b6e2-6f62e36692eb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:39:47.465616 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6cda66a0-4efd-455e-b6e2-6f62e36692eb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:47.473012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6cda66a0-4efd-455e-b6e2-6f62e36692eb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:47.473660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6cda66a0-4efd-455e-b6e2-6f62e36692eb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:47.474637 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6cda66a0-4efd-455e-b6e2-6f62e36692eb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:47.475061 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6cda66a0-4efd-455e-b6e2-6f62e36692eb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:47.616305 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6cda66a0-4efd-455e-b6e2-6f62e36692eb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:47.624879 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6cda66a0-4efd-455e-b6e2-6f62e36692eb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1689 microversion: 2.1 time: 0.164622 Jul 19 23:39:47.625463 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3526/7063] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:39:47 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:39:48.645988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bf53850e-7fa8-4408-bafb-bf8ed0350225 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:39:48.646692 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bf53850e-7fa8-4408-bafb-bf8ed0350225 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:48.653687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bf53850e-7fa8-4408-bafb-bf8ed0350225 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:48.654147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bf53850e-7fa8-4408-bafb-bf8ed0350225 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:48.654962 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bf53850e-7fa8-4408-bafb-bf8ed0350225 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:48.655438 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bf53850e-7fa8-4408-bafb-bf8ed0350225 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:48.796844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bf53850e-7fa8-4408-bafb-bf8ed0350225 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:48.804906 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bf53850e-7fa8-4408-bafb-bf8ed0350225 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1694 microversion: 2.1 time: 0.165572 Jul 19 23:39:48.805653 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3538/7064] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:39:48 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:39:49.822250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-87d026f5-e729-40ce-a3c7-a4506ae974bd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:39:49.823115 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-87d026f5-e729-40ce-a3c7-a4506ae974bd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:49.830515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87d026f5-e729-40ce-a3c7-a4506ae974bd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:49.830991 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87d026f5-e729-40ce-a3c7-a4506ae974bd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:49.831844 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87d026f5-e729-40ce-a3c7-a4506ae974bd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:49.832284 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-87d026f5-e729-40ce-a3c7-a4506ae974bd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:49.966260 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-87d026f5-e729-40ce-a3c7-a4506ae974bd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:49.973891 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-87d026f5-e729-40ce-a3c7-a4506ae974bd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1694 microversion: 2.1 time: 0.156024 Jul 19 23:39:49.974470 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3527/7065] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:39:49 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:39:50.992304 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9b5d8353-6caf-487f-915d-ed5bc87b46e0 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:39:50.993036 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9b5d8353-6caf-487f-915d-ed5bc87b46e0 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:51.000356 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b5d8353-6caf-487f-915d-ed5bc87b46e0 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:51.000816 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b5d8353-6caf-487f-915d-ed5bc87b46e0 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:51.001613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b5d8353-6caf-487f-915d-ed5bc87b46e0 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:51.002065 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b5d8353-6caf-487f-915d-ed5bc87b46e0 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:51.136683 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9b5d8353-6caf-487f-915d-ed5bc87b46e0 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:51.144176 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9b5d8353-6caf-487f-915d-ed5bc87b46e0 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1694 microversion: 2.1 time: 0.155983 Jul 19 23:39:51.144762 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3539/7066] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:39:50 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:39:52.161875 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-276b5efe-8807-4af0-a6ab-61582de6f8ac tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:39:52.162494 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-276b5efe-8807-4af0-a6ab-61582de6f8ac tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:52.170502 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-276b5efe-8807-4af0-a6ab-61582de6f8ac tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:52.170962 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-276b5efe-8807-4af0-a6ab-61582de6f8ac tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:52.171766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-276b5efe-8807-4af0-a6ab-61582de6f8ac tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:52.172212 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-276b5efe-8807-4af0-a6ab-61582de6f8ac tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:52.313468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-276b5efe-8807-4af0-a6ab-61582de6f8ac tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:52.322358 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-276b5efe-8807-4af0-a6ab-61582de6f8ac tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1694 microversion: 2.1 time: 0.164394 Jul 19 23:39:52.322938 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3528/7067] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:39:52 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:39:53.340054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a411ecb1-0466-4877-a757-c35a8664a800 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:39:53.340714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a411ecb1-0466-4877-a757-c35a8664a800 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:53.347897 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a411ecb1-0466-4877-a757-c35a8664a800 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:53.348360 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a411ecb1-0466-4877-a757-c35a8664a800 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:53.349142 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a411ecb1-0466-4877-a757-c35a8664a800 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:53.349589 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a411ecb1-0466-4877-a757-c35a8664a800 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:53.497643 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a411ecb1-0466-4877-a757-c35a8664a800 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:53.506502 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a411ecb1-0466-4877-a757-c35a8664a800 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1694 microversion: 2.1 time: 0.170741 Jul 19 23:39:53.507323 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3540/7068] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:39:53 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1694 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:39:54.526077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f33a4338-207a-4e2e-bd0f-ce27c8800084 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:39:54.526614 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f33a4338-207a-4e2e-bd0f-ce27c8800084 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:54.533979 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f33a4338-207a-4e2e-bd0f-ce27c8800084 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:54.534434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f33a4338-207a-4e2e-bd0f-ce27c8800084 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:54.535236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f33a4338-207a-4e2e-bd0f-ce27c8800084 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:54.535672 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f33a4338-207a-4e2e-bd0f-ce27c8800084 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:54.671665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f33a4338-207a-4e2e-bd0f-ce27c8800084 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:54.679148 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f33a4338-207a-4e2e-bd0f-ce27c8800084 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1694 microversion: 2.1 time: 0.157852 Jul 19 23:39:54.680259 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3529/7069] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:39:54 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:39:55.696856 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0c273d19-d88c-449b-8f7c-2603ce5bd83b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:39:55.697492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0c273d19-d88c-449b-8f7c-2603ce5bd83b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:55.704554 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c273d19-d88c-449b-8f7c-2603ce5bd83b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:55.705022 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c273d19-d88c-449b-8f7c-2603ce5bd83b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:55.705806 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c273d19-d88c-449b-8f7c-2603ce5bd83b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:55.706258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0c273d19-d88c-449b-8f7c-2603ce5bd83b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:55.843612 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0c273d19-d88c-449b-8f7c-2603ce5bd83b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:55.851132 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0c273d19-d88c-449b-8f7c-2603ce5bd83b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1694 microversion: 2.1 time: 0.159006 Jul 19 23:39:55.852338 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3541/7070] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:39:55 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:39:56.387562 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:39:56.387759 n-d-847009-3 devstack@n-api.service[119337]: Tue Jul 19 23:39:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:39:56.869582 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f805b6c4-125c-4bdf-94a0-7f79c13bfdb1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:39:56.870184 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f805b6c4-125c-4bdf-94a0-7f79c13bfdb1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:56.877195 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f805b6c4-125c-4bdf-94a0-7f79c13bfdb1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:56.877641 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f805b6c4-125c-4bdf-94a0-7f79c13bfdb1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:56.878438 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f805b6c4-125c-4bdf-94a0-7f79c13bfdb1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:56.878875 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f805b6c4-125c-4bdf-94a0-7f79c13bfdb1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:57.011946 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f805b6c4-125c-4bdf-94a0-7f79c13bfdb1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:57.019536 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f805b6c4-125c-4bdf-94a0-7f79c13bfdb1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1694 microversion: 2.1 time: 0.154554 Jul 19 23:39:57.020112 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3530/7071] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:39:56 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:39:58.037277 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-751046bf-bf30-4ba4-93b1-c5adbce29a52 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:39:58.037957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-751046bf-bf30-4ba4-93b1-c5adbce29a52 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:58.045516 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-751046bf-bf30-4ba4-93b1-c5adbce29a52 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:58.045978 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-751046bf-bf30-4ba4-93b1-c5adbce29a52 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:58.046755 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-751046bf-bf30-4ba4-93b1-c5adbce29a52 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:58.047243 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-751046bf-bf30-4ba4-93b1-c5adbce29a52 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:58.184287 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-751046bf-bf30-4ba4-93b1-c5adbce29a52 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:58.192448 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-751046bf-bf30-4ba4-93b1-c5adbce29a52 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1694 microversion: 2.1 time: 0.159108 Jul 19 23:39:58.193289 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3542/7072] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:39:58 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:39:59.211074 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-21f5144e-7a5e-410e-91ca-6c00188f39fb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:39:59.211849 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-21f5144e-7a5e-410e-91ca-6c00188f39fb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:39:59.219076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-21f5144e-7a5e-410e-91ca-6c00188f39fb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:59.219553 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-21f5144e-7a5e-410e-91ca-6c00188f39fb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:59.220325 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-21f5144e-7a5e-410e-91ca-6c00188f39fb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:39:59.220766 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-21f5144e-7a5e-410e-91ca-6c00188f39fb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:39:59.361510 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-21f5144e-7a5e-410e-91ca-6c00188f39fb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:39:59.369883 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-21f5144e-7a5e-410e-91ca-6c00188f39fb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1694 microversion: 2.1 time: 0.162796 Jul 19 23:39:59.370658 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3531/7073] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:39:59 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:40:00.387284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f3381b9c-ebe6-428a-b87f-d67ed2f634be tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:40:00.387919 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f3381b9c-ebe6-428a-b87f-d67ed2f634be tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:40:00.394790 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3381b9c-ebe6-428a-b87f-d67ed2f634be tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:00.395311 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3381b9c-ebe6-428a-b87f-d67ed2f634be tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:00.396091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3381b9c-ebe6-428a-b87f-d67ed2f634be tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:00.396538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3381b9c-ebe6-428a-b87f-d67ed2f634be tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:00.531883 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f3381b9c-ebe6-428a-b87f-d67ed2f634be tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:40:00.539348 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f3381b9c-ebe6-428a-b87f-d67ed2f634be tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1694 microversion: 2.1 time: 0.156154 Jul 19 23:40:00.540589 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3543/7074] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:40:00 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:40:01.557144 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-55b9068b-a86f-4a40-a6da-7228bef3033a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:40:01.557763 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-55b9068b-a86f-4a40-a6da-7228bef3033a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:40:01.564238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55b9068b-a86f-4a40-a6da-7228bef3033a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:01.564693 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55b9068b-a86f-4a40-a6da-7228bef3033a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:01.565466 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55b9068b-a86f-4a40-a6da-7228bef3033a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:01.565905 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-55b9068b-a86f-4a40-a6da-7228bef3033a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:01.697800 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-55b9068b-a86f-4a40-a6da-7228bef3033a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:40:01.705502 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-55b9068b-a86f-4a40-a6da-7228bef3033a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1694 microversion: 2.1 time: 0.152888 Jul 19 23:40:01.706091 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3532/7075] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:40:01 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:40:02.723629 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0830f0e5-df48-4cb1-81e0-b4136221614a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:40:02.724268 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0830f0e5-df48-4cb1-81e0-b4136221614a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:40:02.732156 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0830f0e5-df48-4cb1-81e0-b4136221614a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:02.732625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0830f0e5-df48-4cb1-81e0-b4136221614a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:02.733413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0830f0e5-df48-4cb1-81e0-b4136221614a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:02.733865 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0830f0e5-df48-4cb1-81e0-b4136221614a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:02.874038 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0830f0e5-df48-4cb1-81e0-b4136221614a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:40:02.881873 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0830f0e5-df48-4cb1-81e0-b4136221614a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1694 microversion: 2.1 time: 0.162193 Jul 19 23:40:02.882470 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3544/7076] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:40:02 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:40:03.901271 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-198a3af0-55c6-49d9-948e-9dbd4859a666 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:40:03.901880 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-198a3af0-55c6-49d9-948e-9dbd4859a666 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:40:03.909442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-198a3af0-55c6-49d9-948e-9dbd4859a666 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:03.909890 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-198a3af0-55c6-49d9-948e-9dbd4859a666 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:03.910669 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-198a3af0-55c6-49d9-948e-9dbd4859a666 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:03.911097 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-198a3af0-55c6-49d9-948e-9dbd4859a666 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:04.048964 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-198a3af0-55c6-49d9-948e-9dbd4859a666 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:40:04.057179 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-198a3af0-55c6-49d9-948e-9dbd4859a666 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1694 microversion: 2.1 time: 0.160785 Jul 19 23:40:04.058166 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3533/7077] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:40:03 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:40:05.076283 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cac9df61-dfe2-4292-b6e8-6c14ea583117 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:40:05.077902 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cac9df61-dfe2-4292-b6e8-6c14ea583117 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:40:05.084666 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cac9df61-dfe2-4292-b6e8-6c14ea583117 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:05.085117 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cac9df61-dfe2-4292-b6e8-6c14ea583117 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:05.085926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cac9df61-dfe2-4292-b6e8-6c14ea583117 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:05.087195 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cac9df61-dfe2-4292-b6e8-6c14ea583117 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:05.106588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-2edc6f5b-eb78-45f2-aa5f-03b50853fb83 req-888963fb-217b-41e0-ba86-cb3eed8082ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97844773-079b-42e6-b6ac-aef43573abf0", "name": "network-vif-unplugged", "status": "completed", "tag": "391f6ede-1925-4195-ac7d-d43e4b9952f2"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:40:05.111381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=23 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:40:05.119615 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-2edc6f5b-eb78-45f2-aa5f-03b50853fb83 req-888963fb-217b-41e0-ba86-cb3eed8082ba service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:05.120291 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-2edc6f5b-eb78-45f2-aa5f-03b50853fb83 req-888963fb-217b-41e0-ba86-cb3eed8082ba service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:05.125433 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=65 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:40:05.136567 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-2edc6f5b-eb78-45f2-aa5f-03b50853fb83 req-888963fb-217b-41e0-ba86-cb3eed8082ba service nova] Creating event network-vif-unplugged:391f6ede-1925-4195-ac7d-d43e4b9952f2 for instance 97844773-079b-42e6-b6ac-aef43573abf0 on n-h1-847009-3 Jul 19 23:40:05.142335 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [req-2edc6f5b-eb78-45f2-aa5f-03b50853fb83 req-888963fb-217b-41e0-ba86-cb3eed8082ba service nova] Instance 97844773-079b-42e6-b6ac-aef43573abf0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119337) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 23:40:05.155002 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-2edc6f5b-eb78-45f2-aa5f-03b50853fb83 req-888963fb-217b-41e0-ba86-cb3eed8082ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136273 Jul 19 23:40:05.155970 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3545/7078] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:40:05.381450 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cac9df61-dfe2-4292-b6e8-6c14ea583117 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:40:05.389651 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cac9df61-dfe2-4292-b6e8-6c14ea583117 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1693 microversion: 2.1 time: 0.317291 Jul 19 23:40:05.390165 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3534/7079] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:40:05 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1693 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:40:06.410702 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c799b968-0a8c-41b6-86da-21a9870ec5d8 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:40:06.411450 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c799b968-0a8c-41b6-86da-21a9870ec5d8 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:40:06.418584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c799b968-0a8c-41b6-86da-21a9870ec5d8 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:06.419047 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c799b968-0a8c-41b6-86da-21a9870ec5d8 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:06.419866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c799b968-0a8c-41b6-86da-21a9870ec5d8 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:06.420337 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c799b968-0a8c-41b6-86da-21a9870ec5d8 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:06.568614 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c799b968-0a8c-41b6-86da-21a9870ec5d8 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:40:06.577248 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c799b968-0a8c-41b6-86da-21a9870ec5d8 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1693 microversion: 2.1 time: 0.171776 Jul 19 23:40:06.577851 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3546/7080] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:40:06 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:40:07.173967 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-a29b4d44-02be-470b-bfab-df7667b1338a req-915a5124-508a-41d4-b1f5-3afef79b8292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97844773-079b-42e6-b6ac-aef43573abf0", "tag": "391f6ede-1925-4195-ac7d-d43e4b9952f2"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:40:07.183061 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-a29b4d44-02be-470b-bfab-df7667b1338a req-915a5124-508a-41d4-b1f5-3afef79b8292 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:07.183548 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-a29b4d44-02be-470b-bfab-df7667b1338a req-915a5124-508a-41d4-b1f5-3afef79b8292 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:07.198488 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-a29b4d44-02be-470b-bfab-df7667b1338a req-915a5124-508a-41d4-b1f5-3afef79b8292 service nova] Creating event network-changed:391f6ede-1925-4195-ac7d-d43e4b9952f2 for instance 97844773-079b-42e6-b6ac-aef43573abf0 on n-h1-847009-3 Jul 19 23:40:07.204309 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [req-a29b4d44-02be-470b-bfab-df7667b1338a req-915a5124-508a-41d4-b1f5-3afef79b8292 service nova] Instance 97844773-079b-42e6-b6ac-aef43573abf0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-3', 'n-h2-847009-3'} {{(pid=119338) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 19 23:40:07.216981 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-a29b4d44-02be-470b-bfab-df7667b1338a req-915a5124-508a-41d4-b1f5-3afef79b8292 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046709 Jul 19 23:40:07.217721 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3535/7081] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:40:07.595754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-16759414-46b4-4ee3-869c-006f5ca7164a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:40:07.597490 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-16759414-46b4-4ee3-869c-006f5ca7164a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:40:07.604929 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-16759414-46b4-4ee3-869c-006f5ca7164a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:07.605407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-16759414-46b4-4ee3-869c-006f5ca7164a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:07.606259 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-16759414-46b4-4ee3-869c-006f5ca7164a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:07.606720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-16759414-46b4-4ee3-869c-006f5ca7164a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:07.757926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-16759414-46b4-4ee3-869c-006f5ca7164a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:40:07.767098 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-16759414-46b4-4ee3-869c-006f5ca7164a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1691 microversion: 2.1 time: 0.175408 Jul 19 23:40:07.767991 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3547/7082] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:40:07 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:40:08.786889 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-676ff9b3-ec51-4a4d-b832-2e29bc7e42d2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:40:08.787648 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-676ff9b3-ec51-4a4d-b832-2e29bc7e42d2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:40:08.795542 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-676ff9b3-ec51-4a4d-b832-2e29bc7e42d2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:08.796000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-676ff9b3-ec51-4a4d-b832-2e29bc7e42d2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:08.796769 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-676ff9b3-ec51-4a4d-b832-2e29bc7e42d2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:08.797214 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-676ff9b3-ec51-4a4d-b832-2e29bc7e42d2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:08.946297 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-676ff9b3-ec51-4a4d-b832-2e29bc7e42d2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:40:08.954178 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-676ff9b3-ec51-4a4d-b832-2e29bc7e42d2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1688 microversion: 2.1 time: 0.172368 Jul 19 23:40:08.954969 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3536/7083] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:40:08 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:40:08.974569 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5db54a84-e5cf-4d0c-ab59-e31bc8f2ab79 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:40:08.975200 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5db54a84-e5cf-4d0c-ab59-e31bc8f2ab79 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:40:08.983006 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5db54a84-e5cf-4d0c-ab59-e31bc8f2ab79 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:08.983507 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5db54a84-e5cf-4d0c-ab59-e31bc8f2ab79 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:08.984288 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5db54a84-e5cf-4d0c-ab59-e31bc8f2ab79 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:08.984740 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5db54a84-e5cf-4d0c-ab59-e31bc8f2ab79 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:09.044401 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5db54a84-e5cf-4d0c-ab59-e31bc8f2ab79 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0/action" status: 204 len: 0 microversion: 2.1 time: 0.073335 Jul 19 23:40:09.045249 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3548/7084] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:40:08 2022] POST /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:40:09.053256 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6410ef21-832e-4651-8985-7246cbb8c0bb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:40:09.053965 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6410ef21-832e-4651-8985-7246cbb8c0bb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:40:09.061188 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6410ef21-832e-4651-8985-7246cbb8c0bb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:09.062253 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6410ef21-832e-4651-8985-7246cbb8c0bb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:09.063182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6410ef21-832e-4651-8985-7246cbb8c0bb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:09.063907 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6410ef21-832e-4651-8985-7246cbb8c0bb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:09.206839 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6410ef21-832e-4651-8985-7246cbb8c0bb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:40:09.215339 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6410ef21-832e-4651-8985-7246cbb8c0bb tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1688 microversion: 2.1 time: 0.166063 Jul 19 23:40:09.216153 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3537/7085] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:40:09 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:40:09.233260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e2f543d4-f487-4ab3-af17-78fecd316523 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:40:09.233980 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e2f543d4-f487-4ab3-af17-78fecd316523 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:40:09.241558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e2f543d4-f487-4ab3-af17-78fecd316523 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:09.242102 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e2f543d4-f487-4ab3-af17-78fecd316523 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:09.244074 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e2f543d4-f487-4ab3-af17-78fecd316523 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:09.244074 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e2f543d4-f487-4ab3-af17-78fecd316523 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:09.381724 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e2f543d4-f487-4ab3-af17-78fecd316523 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:40:09.390369 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e2f543d4-f487-4ab3-af17-78fecd316523 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1688 microversion: 2.1 time: 0.161711 Jul 19 23:40:09.390884 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3549/7086] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:40:09 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:40:10.408389 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9cced72f-9731-4549-b148-c505220eeb12 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:40:10.409007 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9cced72f-9731-4549-b148-c505220eeb12 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:40:10.416640 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9cced72f-9731-4549-b148-c505220eeb12 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:10.417093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9cced72f-9731-4549-b148-c505220eeb12 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:10.417869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9cced72f-9731-4549-b148-c505220eeb12 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:10.418318 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9cced72f-9731-4549-b148-c505220eeb12 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:10.437040 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:40:10.566299 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9cced72f-9731-4549-b148-c505220eeb12 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:40:10.575295 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9cced72f-9731-4549-b148-c505220eeb12 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1680 microversion: 2.1 time: 0.170740 Jul 19 23:40:10.575897 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3538/7087] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:40:10 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:40:10.599220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-dcbe637c-8efa-4ece-b8af-29f519750867 req-d43037e0-3cc6-4d36-8e85-6a80af1ff8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97844773-079b-42e6-b6ac-aef43573abf0", "name": "network-vif-plugged", "status": "completed", "tag": "391f6ede-1925-4195-ac7d-d43e4b9952f2"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:40:10.609953 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-dcbe637c-8efa-4ece-b8af-29f519750867 req-d43037e0-3cc6-4d36-8e85-6a80af1ff8e1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:10.610477 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-dcbe637c-8efa-4ece-b8af-29f519750867 req-d43037e0-3cc6-4d36-8e85-6a80af1ff8e1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:10.624002 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-dcbe637c-8efa-4ece-b8af-29f519750867 req-d43037e0-3cc6-4d36-8e85-6a80af1ff8e1 service nova] Creating event network-vif-plugged:391f6ede-1925-4195-ac7d-d43e4b9952f2 for instance 97844773-079b-42e6-b6ac-aef43573abf0 on n-h1-847009-3 Jul 19 23:40:10.630183 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-dcbe637c-8efa-4ece-b8af-29f519750867 req-d43037e0-3cc6-4d36-8e85-6a80af1ff8e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109428 Jul 19 23:40:10.631028 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3550/7088] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:40:34.807034 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ccef3693-37f5-4cd9-a469-74b1e0702193 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:40:34.808563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ccef3693-37f5-4cd9-a469-74b1e0702193 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:40:34.810799 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=36 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:40:34.811500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:40:34.817084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ccef3693-37f5-4cd9-a469-74b1e0702193 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:34.817796 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ccef3693-37f5-4cd9-a469-74b1e0702193 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:34.818570 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ccef3693-37f5-4cd9-a469-74b1e0702193 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:34.819015 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ccef3693-37f5-4cd9-a469-74b1e0702193 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:34.876007 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ccef3693-37f5-4cd9-a469-74b1e0702193 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0/action" status: 200 len: 24575 microversion: 2.1 time: 0.072884 Jul 19 23:40:34.876657 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3539/7089] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:40:34 2022] POST /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0/action => generated 24575 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 23:40:42.069845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=11 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:40:42.079763 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:40:42.084762 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0ba81efa-706e-4a4a-8da8-cf29d60d56f7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:40:42.085366 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0ba81efa-706e-4a4a-8da8-cf29d60d56f7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:40:42.096134 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ba81efa-706e-4a4a-8da8-cf29d60d56f7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:42.096595 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ba81efa-706e-4a4a-8da8-cf29d60d56f7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:42.097387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ba81efa-706e-4a4a-8da8-cf29d60d56f7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:42.097837 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ba81efa-706e-4a4a-8da8-cf29d60d56f7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:42.125547 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0ba81efa-706e-4a4a-8da8-cf29d60d56f7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:40:42.142617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-45a703e1-22ce-46c3-bdfa-5586b75ae44b req-3940427b-8eb1-4986-93ab-5821039d1360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97844773-079b-42e6-b6ac-aef43573abf0", "tag": "391f6ede-1925-4195-ac7d-d43e4b9952f2"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:40:42.153095 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-45a703e1-22ce-46c3-bdfa-5586b75ae44b req-3940427b-8eb1-4986-93ab-5821039d1360 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:42.153546 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-45a703e1-22ce-46c3-bdfa-5586b75ae44b req-3940427b-8eb1-4986-93ab-5821039d1360 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:42.164523 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-45a703e1-22ce-46c3-bdfa-5586b75ae44b req-3940427b-8eb1-4986-93ab-5821039d1360 service nova] Creating event network-changed:391f6ede-1925-4195-ac7d-d43e4b9952f2 for instance 97844773-079b-42e6-b6ac-aef43573abf0 on n-h1-847009-3 Jul 19 23:40:42.170188 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-45a703e1-22ce-46c3-bdfa-5586b75ae44b req-3940427b-8eb1-4986-93ab-5821039d1360 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097904 Jul 19 23:40:42.170882 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3540/7090] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:40:42.215203 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0ba81efa-706e-4a4a-8da8-cf29d60d56f7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "DELETE /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 204 len: 0 microversion: 2.1 time: 0.147038 Jul 19 23:40:42.216330 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3551/7091] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:40:42 2022] DELETE /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:40:42.232626 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-03bd826a-7e7e-45b9-b916-5f145e2ba21a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:40:42.233646 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-03bd826a-7e7e-45b9-b916-5f145e2ba21a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:40:42.240562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-03bd826a-7e7e-45b9-b916-5f145e2ba21a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:42.241026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-03bd826a-7e7e-45b9-b916-5f145e2ba21a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:42.242177 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-03bd826a-7e7e-45b9-b916-5f145e2ba21a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:42.242638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-03bd826a-7e7e-45b9-b916-5f145e2ba21a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:42.382918 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-03bd826a-7e7e-45b9-b916-5f145e2ba21a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:40:42.390759 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-03bd826a-7e7e-45b9-b916-5f145e2ba21a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1686 microversion: 2.1 time: 0.167135 Jul 19 23:40:42.391384 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3541/7092] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:40:42 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:40:43.408875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-fbe81326-724b-445f-b46b-5e026b64cd05 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:40:43.409591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-fbe81326-724b-445f-b46b-5e026b64cd05 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:40:43.419903 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fbe81326-724b-445f-b46b-5e026b64cd05 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:43.420375 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fbe81326-724b-445f-b46b-5e026b64cd05 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:43.421153 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fbe81326-724b-445f-b46b-5e026b64cd05 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:43.421601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-fbe81326-724b-445f-b46b-5e026b64cd05 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:43.630203 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-fbe81326-724b-445f-b46b-5e026b64cd05 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:40:43.638117 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-fbe81326-724b-445f-b46b-5e026b64cd05 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1686 microversion: 2.1 time: 0.233533 Jul 19 23:40:43.638750 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3552/7093] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:40:43 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1686 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:40:44.491189 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-8ebaeb9f-7875-409f-9b39-2803cdee857d req-4ef43f2e-8f0a-49d7-ac38-9b16291bcfde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97844773-079b-42e6-b6ac-aef43573abf0", "name": "network-vif-deleted", "tag": "391f6ede-1925-4195-ac7d-d43e4b9952f2"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:40:44.501585 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-8ebaeb9f-7875-409f-9b39-2803cdee857d req-4ef43f2e-8f0a-49d7-ac38-9b16291bcfde service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:44.502035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-8ebaeb9f-7875-409f-9b39-2803cdee857d req-4ef43f2e-8f0a-49d7-ac38-9b16291bcfde service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:44.513960 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-8ebaeb9f-7875-409f-9b39-2803cdee857d req-4ef43f2e-8f0a-49d7-ac38-9b16291bcfde service nova] Creating event network-vif-deleted:391f6ede-1925-4195-ac7d-d43e4b9952f2 for instance 97844773-079b-42e6-b6ac-aef43573abf0 on n-h1-847009-3 Jul 19 23:40:44.519848 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-8ebaeb9f-7875-409f-9b39-2803cdee857d req-4ef43f2e-8f0a-49d7-ac38-9b16291bcfde service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032320 Jul 19 23:40:44.520458 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3542/7094] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:40:44.655731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8c340798-d870-4260-b4cb-73b542c22cce tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:40:44.656372 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8c340798-d870-4260-b4cb-73b542c22cce tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:40:44.663308 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c340798-d870-4260-b4cb-73b542c22cce tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:44.663765 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c340798-d870-4260-b4cb-73b542c22cce tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:44.664541 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c340798-d870-4260-b4cb-73b542c22cce tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:44.664994 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c340798-d870-4260-b4cb-73b542c22cce tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:44.699333 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c340798-d870-4260-b4cb-73b542c22cce tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:44.699700 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c340798-d870-4260-b4cb-73b542c22cce tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:44.700168 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-8c340798-d870-4260-b4cb-73b542c22cce tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lazy-loading 'fault' on Instance uuid 97844773-079b-42e6-b6ac-aef43573abf0 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:40:44.749431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8c340798-d870-4260-b4cb-73b542c22cce tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:40:44.758128 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8c340798-d870-4260-b4cb-73b542c22cce tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 200 len: 1357 microversion: 2.1 time: 0.106226 Jul 19 23:40:44.760295 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3553/7095] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:40:44 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 1357 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:40:45.777155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3b762497-bbcd-44a5-82c1-e9d83b1e5e83 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:40:45.777782 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3b762497-bbcd-44a5-82c1-e9d83b1e5e83 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: 97844773-079b-42e6-b6ac-aef43573abf0] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:40:45.784230 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b762497-bbcd-44a5-82c1-e9d83b1e5e83 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:45.784692 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b762497-bbcd-44a5-82c1-e9d83b1e5e83 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:45.785478 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b762497-bbcd-44a5-82c1-e9d83b1e5e83 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:45.785930 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3b762497-bbcd-44a5-82c1-e9d83b1e5e83 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:45.802145 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.wsgi [None req-3b762497-bbcd-44a5-82c1-e9d83b1e5e83 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] HTTP exception thrown: Instance 97844773-079b-42e6-b6ac-aef43573abf0 could not be found. Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3b762497-bbcd-44a5-82c1-e9d83b1e5e83 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Request method failure captured: Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: request: GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 HTTP/1.1 Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: Accept: application/json Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: Accept-Encoding: identity Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: Connection: close Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: Content-Length: 0 Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: Content-Type: application/json Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: Host: 10.222.0.25 Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: Openstack-System-Scope: None Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: User-Agent: python-urllib3/1.26.9 Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: X-Auth-Token: gAAAAABi1z_i3_paGortEfNaOQ-D6RCdDbS-gFpUd1lXlaBmT5d8oYP2yebmdV_XnM7ZxXqP9UNbb4IDO7U57P8_q5lGyi5pGaH1sCoNIZdz_Yb4nbHkmoo7pLg5PveXEAt6VDocXQIXfFoPvZAh1aLRxH9YfhSo3R3-TTentuS0y213WSMCEEw Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Id: None Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: X-Domain-Name: None Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: X-Identity-Status: Confirmed Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: X-Is-Admin-Project: True Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Id: default Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Domain-Name: Default Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Id: e250763e59c741fbbbf193ca4cac4189 Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-660489764 Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: X-Role: member,reader Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: X-Roles: member,reader Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e250763e59c741fbbbf193ca4cac4189"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e250763e59c741fbbbf193ca4cac4189"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e250763e59c741fbbbf193ca4cac4189"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e250763e59c741fbbbf193ca4cac4189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant: tempest-TestNetworkAdvancedServerOps-660489764 Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Id: e250763e59c741fbbbf193ca4cac4189 Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-660489764 Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: X-User: tempest-TestNetworkAdvancedServerOps-660489764-project Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Id: default Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: X-User-Domain-Name: Default Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: X-User-Id: bdaa1c19bfa34fd69fd610406f41f728 Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: X-User-Name: tempest-TestNetworkAdvancedServerOps-660489764-project Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: method: > Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: exception: Instance 97844773-079b-42e6-b6ac-aef43573abf0 could not be found. Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: action_args: {'id': '97844773-079b-42e6-b6ac-aef43573abf0'} Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97844773-079b-42e6-b6ac-aef43573abf0 could not be found. Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97844773-079b-42e6-b6ac-aef43573abf0 could not be found. Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:40:45.803834 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:40:45.809117 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:40:45.809117 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:40:45.809117 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:40:45.809117 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:40:45.809117 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:40:45.809117 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97844773-079b-42e6-b6ac-aef43573abf0 could not be found. Jul 19 23:40:45.809117 n-d-847009-3 devstack@n-api.service[119338]: ERROR nova.api.openstack.wsgi Jul 19 23:40:45.809117 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3b762497-bbcd-44a5-82c1-e9d83b1e5e83 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Returning 404 to user: Instance 97844773-079b-42e6-b6ac-aef43573abf0 could not be found. {{(pid=119338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:40:45.809117 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3b762497-bbcd-44a5-82c1-e9d83b1e5e83 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0" status: 404 len: 111 microversion: 2.1 time: 0.033460 Jul 19 23:40:45.809117 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3543/7096] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:40:45 2022] GET /compute/v2.1/servers/97844773-079b-42e6-b6ac-aef43573abf0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:40:49.162219 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-165a35dc-ded6-4181-a0ed-1d39957d6688 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '.version_select at 0x7f7a030500d0>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:40:49.193554 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-165a35dc-ded6-4181-a0ed-1d39957d6688 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1162054479" status: 202 len: 0 microversion: 2.1 time: 0.035250 Jul 19 23:40:49.194152 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3554/7097] 10.222.0.25 () {58 vars in 1283 bytes} [Tue Jul 19 23:40:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1162054479 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:40:49.221365 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d8c3178f-d1ba-44e2-9397-e178e1849f9f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'create', calling method: .version_select at 0x7f7a1014a3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-21902788", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzMlvwy0Z/RDV9cu6Sv5oUbsV5b067ncVF38/jm9ar9Y1x9/f91LrxbE3cAFZDvZsqtJr7kZS/cmukRSRsXVU+95Eowsc41qpPsrII1gdZQGA3enuanPFMuUnw7/d59sw=="}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:40:49.237100 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-d8c3178f-d1ba-44e2-9397-e178e1849f9f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Getting quotas for project e250763e59c741fbbbf193ca4cac4189. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:40:49.243175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-d8c3178f-d1ba-44e2-9397-e178e1849f9f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Getting quotas for user bdaa1c19bfa34fd69fd610406f41f728 and project e250763e59c741fbbbf193ca4cac4189. Resources: {'key_pairs'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:40:49.268984 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d8c3178f-d1ba-44e2-9397-e178e1849f9f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.051554 Jul 19 23:40:49.269594 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3544/7098] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 23:40:49 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:40:54.969938 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f055f726-eab2-46cb-9cd6-7c6864915d59 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-98640403", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "161f305b-6fe2-473d-9260-87568d47faf5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-21902788", "security_groups": [{"name": "tempest-secgroup-smoke-1734625088"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:40:54.978127 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:40:55.099189 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-f055f726-eab2-46cb-9cd6-7c6864915d59 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] validate_networks() for [('161f305b-6fe2-473d-9260-87568d47faf5', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:40:55.562428 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-f055f726-eab2-46cb-9cd6-7c6864915d59 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:40:55.563152 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-f055f726-eab2-46cb-9cd6-7c6864915d59 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:40:55.564199 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-f055f726-eab2-46cb-9cd6-7c6864915d59 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:40:55.564731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-f055f726-eab2-46cb-9cd6-7c6864915d59 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:40:55.565242 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-f055f726-eab2-46cb-9cd6-7c6864915d59 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:40:55.577448 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f055f726-eab2-46cb-9cd6-7c6864915d59 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:55.578280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f055f726-eab2-46cb-9cd6-7c6864915d59 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:55.579671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f055f726-eab2-46cb-9cd6-7c6864915d59 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:55.580206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f055f726-eab2-46cb-9cd6-7c6864915d59 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:55.598830 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-f055f726-eab2-46cb-9cd6-7c6864915d59 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Getting quotas for project e250763e59c741fbbbf193ca4cac4189. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:40:55.604810 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-f055f726-eab2-46cb-9cd6-7c6864915d59 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Getting quotas for user bdaa1c19bfa34fd69fd610406f41f728 and project e250763e59c741fbbbf193ca4cac4189. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:40:55.617517 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f055f726-eab2-46cb-9cd6-7c6864915d59 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:40:55.619989 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f055f726-eab2-46cb-9cd6-7c6864915d59 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:40:55.669030 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f055f726-eab2-46cb-9cd6-7c6864915d59 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.702960 Jul 19 23:40:55.674658 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3555/7099] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:40:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 23:40:55.680136 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-729273dc-9e5d-4126-9f7d-e4171b7a4d14 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:40:55.681373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-729273dc-9e5d-4126-9f7d-e4171b7a4d14 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:40:55.739679 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-729273dc-9e5d-4126-9f7d-e4171b7a4d14 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:40:55.748205 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-729273dc-9e5d-4126-9f7d-e4171b7a4d14 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 200 len: 1263 microversion: 2.1 time: 0.072170 Jul 19 23:40:55.748801 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3545/7100] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:40:55 2022] GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 1263 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:40:56.767689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-816829f0-571b-4a59-8114-f8a11f61c414 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:40:56.768547 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-816829f0-571b-4a59-8114-f8a11f61c414 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:40:56.778210 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-816829f0-571b-4a59-8114-f8a11f61c414 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:56.780556 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-816829f0-571b-4a59-8114-f8a11f61c414 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:56.781718 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-816829f0-571b-4a59-8114-f8a11f61c414 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:56.782558 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-816829f0-571b-4a59-8114-f8a11f61c414 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:56.866663 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-816829f0-571b-4a59-8114-f8a11f61c414 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:40:56.875496 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-816829f0-571b-4a59-8114-f8a11f61c414 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 200 len: 1333 microversion: 2.1 time: 0.113190 Jul 19 23:40:56.876331 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3556/7101] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:40:56 2022] GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 1333 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:40:57.893380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-45fb61de-dd8a-4810-97c6-e216d145875a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:40:57.894700 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-45fb61de-dd8a-4810-97c6-e216d145875a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:40:57.897284 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=16 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:40:57.905544 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-45fb61de-dd8a-4810-97c6-e216d145875a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:57.906011 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-45fb61de-dd8a-4810-97c6-e216d145875a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:57.906809 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-45fb61de-dd8a-4810-97c6-e216d145875a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:57.907287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-45fb61de-dd8a-4810-97c6-e216d145875a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:58.077169 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-45fb61de-dd8a-4810-97c6-e216d145875a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:40:58.086386 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-45fb61de-dd8a-4810-97c6-e216d145875a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 200 len: 1389 microversion: 2.1 time: 0.196705 Jul 19 23:40:58.097553 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3546/7102] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:40:57 2022] GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 1389 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:40:58.300641 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-77a1a00f-cc61-4a1f-be88-d129c29e521d req-1e66e025-b076-48a1-8a65-ccc282a6e661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7730e6e-70f4-43fe-959c-6163dc01ea2b", "tag": "5237b614-6182-4c75-8ae6-339a25a175c3"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:40:58.329026 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-77a1a00f-cc61-4a1f-be88-d129c29e521d req-1e66e025-b076-48a1-8a65-ccc282a6e661 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:58.329620 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-77a1a00f-cc61-4a1f-be88-d129c29e521d req-1e66e025-b076-48a1-8a65-ccc282a6e661 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:58.342720 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-77a1a00f-cc61-4a1f-be88-d129c29e521d req-1e66e025-b076-48a1-8a65-ccc282a6e661 service nova] Creating event network-changed:5237b614-6182-4c75-8ae6-339a25a175c3 for instance a7730e6e-70f4-43fe-959c-6163dc01ea2b on n-h2-847009-3 Jul 19 23:40:58.350968 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-77a1a00f-cc61-4a1f-be88-d129c29e521d req-1e66e025-b076-48a1-8a65-ccc282a6e661 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053790 Jul 19 23:40:58.351691 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3557/7103] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:40:59.105135 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cbf863dc-6244-4d01-bd94-6bfd4ab59029 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:40:59.105820 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cbf863dc-6244-4d01-bd94-6bfd4ab59029 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:40:59.112921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cbf863dc-6244-4d01-bd94-6bfd4ab59029 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:59.113382 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cbf863dc-6244-4d01-bd94-6bfd4ab59029 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:59.114160 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cbf863dc-6244-4d01-bd94-6bfd4ab59029 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:40:59.114601 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cbf863dc-6244-4d01-bd94-6bfd4ab59029 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:40:59.263762 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-cbf863dc-6244-4d01-bd94-6bfd4ab59029 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:40:59.271351 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cbf863dc-6244-4d01-bd94-6bfd4ab59029 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 200 len: 1389 microversion: 2.1 time: 0.170275 Jul 19 23:40:59.271926 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3547/7104] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:40:59 2022] GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 1389 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:41:00.290132 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-37d98842-7cce-470d-9bdd-8f694a73ced7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:41:00.290862 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-37d98842-7cce-470d-9bdd-8f694a73ced7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:41:00.297698 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37d98842-7cce-470d-9bdd-8f694a73ced7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:00.298163 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37d98842-7cce-470d-9bdd-8f694a73ced7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:00.298958 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37d98842-7cce-470d-9bdd-8f694a73ced7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:00.299439 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-37d98842-7cce-470d-9bdd-8f694a73ced7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:00.446534 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-37d98842-7cce-470d-9bdd-8f694a73ced7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:41:00.456094 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-37d98842-7cce-470d-9bdd-8f694a73ced7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 200 len: 1389 microversion: 2.1 time: 0.171024 Jul 19 23:41:00.456708 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3558/7105] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:41:00 2022] GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 1389 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:41:01.474131 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c625fe52-61bc-4fc7-911b-29c37ad2a461 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:41:01.474864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c625fe52-61bc-4fc7-911b-29c37ad2a461 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:41:01.482494 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c625fe52-61bc-4fc7-911b-29c37ad2a461 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:01.482952 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c625fe52-61bc-4fc7-911b-29c37ad2a461 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:01.483800 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c625fe52-61bc-4fc7-911b-29c37ad2a461 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:01.484278 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c625fe52-61bc-4fc7-911b-29c37ad2a461 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:01.618285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c625fe52-61bc-4fc7-911b-29c37ad2a461 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:41:01.625903 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c625fe52-61bc-4fc7-911b-29c37ad2a461 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 200 len: 1389 microversion: 2.1 time: 0.155941 Jul 19 23:41:01.626474 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3548/7106] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:41:01 2022] GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:41:02.260304 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-4f9aa018-b3bf-41ed-b207-f6c8086e1c83 req-7de26148-d9a7-4331-a4cd-0c33b72a0edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7730e6e-70f4-43fe-959c-6163dc01ea2b", "name": "network-vif-plugged", "status": "completed", "tag": "5237b614-6182-4c75-8ae6-339a25a175c3"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:41:02.271560 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-4f9aa018-b3bf-41ed-b207-f6c8086e1c83 req-7de26148-d9a7-4331-a4cd-0c33b72a0edf service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:02.272031 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-4f9aa018-b3bf-41ed-b207-f6c8086e1c83 req-7de26148-d9a7-4331-a4cd-0c33b72a0edf service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:02.285374 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-4f9aa018-b3bf-41ed-b207-f6c8086e1c83 req-7de26148-d9a7-4331-a4cd-0c33b72a0edf service nova] Creating event network-vif-plugged:5237b614-6182-4c75-8ae6-339a25a175c3 for instance a7730e6e-70f4-43fe-959c-6163dc01ea2b on n-h2-847009-3 Jul 19 23:41:02.291249 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-4f9aa018-b3bf-41ed-b207-f6c8086e1c83 req-7de26148-d9a7-4331-a4cd-0c33b72a0edf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034431 Jul 19 23:41:02.291876 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3559/7107] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:41:02.693880 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d49ce7f2-3c8f-4d3c-9ba0-7e68e3ef4a86 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:41:02.694506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d49ce7f2-3c8f-4d3c-9ba0-7e68e3ef4a86 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:41:02.701531 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d49ce7f2-3c8f-4d3c-9ba0-7e68e3ef4a86 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:02.701986 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d49ce7f2-3c8f-4d3c-9ba0-7e68e3ef4a86 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:02.702772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d49ce7f2-3c8f-4d3c-9ba0-7e68e3ef4a86 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:02.703250 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d49ce7f2-3c8f-4d3c-9ba0-7e68e3ef4a86 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:02.845823 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d49ce7f2-3c8f-4d3c-9ba0-7e68e3ef4a86 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:41:02.853863 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d49ce7f2-3c8f-4d3c-9ba0-7e68e3ef4a86 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 200 len: 1389 microversion: 2.1 time: 0.214909 Jul 19 23:41:02.854519 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3549/7108] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:41:02 2022] GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 1389 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:41:03.874458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ca298517-5b60-4b2d-bfa8-4b7d8f32d12d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:41:03.875212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ca298517-5b60-4b2d-bfa8-4b7d8f32d12d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:41:03.881631 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca298517-5b60-4b2d-bfa8-4b7d8f32d12d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:03.882093 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca298517-5b60-4b2d-bfa8-4b7d8f32d12d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:03.882872 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca298517-5b60-4b2d-bfa8-4b7d8f32d12d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:03.883359 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ca298517-5b60-4b2d-bfa8-4b7d8f32d12d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:04.026502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ca298517-5b60-4b2d-bfa8-4b7d8f32d12d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:41:04.034665 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ca298517-5b60-4b2d-bfa8-4b7d8f32d12d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 200 len: 1561 microversion: 2.1 time: 0.165329 Jul 19 23:41:04.035255 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3560/7109] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:41:03 2022] GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:41:04.050831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b525a8a6-9b9f-4ea9-8354-9cf2e5b17f07 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:41:04.051488 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b525a8a6-9b9f-4ea9-8354-9cf2e5b17f07 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:41:04.058366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b525a8a6-9b9f-4ea9-8354-9cf2e5b17f07 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:04.058864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b525a8a6-9b9f-4ea9-8354-9cf2e5b17f07 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:04.059662 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b525a8a6-9b9f-4ea9-8354-9cf2e5b17f07 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:04.060103 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b525a8a6-9b9f-4ea9-8354-9cf2e5b17f07 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:04.196117 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b525a8a6-9b9f-4ea9-8354-9cf2e5b17f07 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:41:04.204755 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b525a8a6-9b9f-4ea9-8354-9cf2e5b17f07 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 200 len: 1561 microversion: 2.1 time: 0.157679 Jul 19 23:41:04.205350 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3550/7110] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:41:04 2022] GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:41:05.831862 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-09e4a8d3-e860-49f9-bb90-2599f502a895 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:41:05.832510 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-09e4a8d3-e860-49f9-bb90-2599f502a895 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:41:05.833882 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-3d41736c-521a-4efa-97d4-d2b401f06682 req-dbd595d9-ae66-4b1d-afc0-fd5ccc89eff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7730e6e-70f4-43fe-959c-6163dc01ea2b", "tag": "5237b614-6182-4c75-8ae6-339a25a175c3"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:41:05.838245 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:41:05.838955 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:41:05.840317 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:41:05.841344 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:41:05.843574 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-09e4a8d3-e860-49f9-bb90-2599f502a895 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:05.844111 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-09e4a8d3-e860-49f9-bb90-2599f502a895 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:05.844957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-09e4a8d3-e860-49f9-bb90-2599f502a895 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:05.845434 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-09e4a8d3-e860-49f9-bb90-2599f502a895 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:05.849788 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-3d41736c-521a-4efa-97d4-d2b401f06682 req-dbd595d9-ae66-4b1d-afc0-fd5ccc89eff2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:05.850437 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-3d41736c-521a-4efa-97d4-d2b401f06682 req-dbd595d9-ae66-4b1d-afc0-fd5ccc89eff2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:05.863441 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-3d41736c-521a-4efa-97d4-d2b401f06682 req-dbd595d9-ae66-4b1d-afc0-fd5ccc89eff2 service nova] Creating event network-changed:5237b614-6182-4c75-8ae6-339a25a175c3 for instance a7730e6e-70f4-43fe-959c-6163dc01ea2b on n-h2-847009-3 Jul 19 23:41:05.868781 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-3d41736c-521a-4efa-97d4-d2b401f06682 req-dbd595d9-ae66-4b1d-afc0-fd5ccc89eff2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038536 Jul 19 23:41:05.869921 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3551/7111] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:41:05.990421 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-09e4a8d3-e860-49f9-bb90-2599f502a895 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:41:05.999646 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-09e4a8d3-e860-49f9-bb90-2599f502a895 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 200 len: 1561 microversion: 2.1 time: 0.171908 Jul 19 23:41:06.001535 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3561/7112] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:41:05 2022] GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:41:29.255627 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5e0711fd-ce2e-4538-a9d4-30eefffc8d6b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:41:29.256659 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5e0711fd-ce2e-4538-a9d4-30eefffc8d6b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:41:29.259777 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=32 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:41:29.266961 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e0711fd-ce2e-4538-a9d4-30eefffc8d6b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:29.267446 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e0711fd-ce2e-4538-a9d4-30eefffc8d6b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:29.268225 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e0711fd-ce2e-4538-a9d4-30eefffc8d6b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:29.268688 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5e0711fd-ce2e-4538-a9d4-30eefffc8d6b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:29.331888 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5e0711fd-ce2e-4538-a9d4-30eefffc8d6b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b/action" status: 200 len: 24571 microversion: 2.1 time: 0.080676 Jul 19 23:41:29.332586 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3552/7113] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:41:29 2022] POST /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b/action => generated 24571 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 23:41:35.752785 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b8a8e51d-243a-4bbf-b49f-e4562174e6c1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:41:35.754919 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:41:35.755750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=30 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:41:35.762152 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8a8e51d-243a-4bbf-b49f-e4562174e6c1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:35.762613 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8a8e51d-243a-4bbf-b49f-e4562174e6c1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:35.788735 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b8a8e51d-243a-4bbf-b49f-e4562174e6c1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Going to try to stop instance {{(pid=119337) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 23:41:35.834083 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b8a8e51d-243a-4bbf-b49f-e4562174e6c1 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b/action" status: 202 len: 0 microversion: 2.1 time: 0.086364 Jul 19 23:41:35.834711 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3562/7114] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:41:35 2022] POST /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:41:35.843581 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-86c9923c-b8ac-4da6-a699-d4ba6441427a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:41:35.844376 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-86c9923c-b8ac-4da6-a699-d4ba6441427a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:41:35.852352 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86c9923c-b8ac-4da6-a699-d4ba6441427a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:35.852808 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86c9923c-b8ac-4da6-a699-d4ba6441427a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:35.853604 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86c9923c-b8ac-4da6-a699-d4ba6441427a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:35.854057 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-86c9923c-b8ac-4da6-a699-d4ba6441427a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:36.020495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-86c9923c-b8ac-4da6-a699-d4ba6441427a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:41:36.028387 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-86c9923c-b8ac-4da6-a699-d4ba6441427a tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 200 len: 1689 microversion: 2.1 time: 0.189072 Jul 19 23:41:36.028977 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3553/7115] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:41:35 2022] GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 1689 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:41:37.049463 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-75aef92c-9bca-46e3-8275-c08a0cb0599f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:41:37.050084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-75aef92c-9bca-46e3-8275-c08a0cb0599f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:41:37.056645 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-75aef92c-9bca-46e3-8275-c08a0cb0599f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:37.057105 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-75aef92c-9bca-46e3-8275-c08a0cb0599f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:37.057879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-75aef92c-9bca-46e3-8275-c08a0cb0599f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:37.058326 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-75aef92c-9bca-46e3-8275-c08a0cb0599f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:37.194123 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-75aef92c-9bca-46e3-8275-c08a0cb0599f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:41:37.202130 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-75aef92c-9bca-46e3-8275-c08a0cb0599f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 200 len: 1689 microversion: 2.1 time: 0.157905 Jul 19 23:41:37.202725 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3563/7116] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:41:37 2022] GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:41:38.220980 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-055bc27f-7bb4-4379-b0fe-c6267265777f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:41:38.221607 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-055bc27f-7bb4-4379-b0fe-c6267265777f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:41:38.228722 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-055bc27f-7bb4-4379-b0fe-c6267265777f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:38.229176 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-055bc27f-7bb4-4379-b0fe-c6267265777f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:38.229950 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-055bc27f-7bb4-4379-b0fe-c6267265777f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:38.230387 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-055bc27f-7bb4-4379-b0fe-c6267265777f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:38.370718 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-055bc27f-7bb4-4379-b0fe-c6267265777f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:41:38.379037 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-055bc27f-7bb4-4379-b0fe-c6267265777f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 200 len: 1689 microversion: 2.1 time: 0.162573 Jul 19 23:41:38.379684 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3554/7117] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:41:38 2022] GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:41:39.396583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a21286ee-4477-4116-bdc8-0f79452dacae tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:41:39.397261 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a21286ee-4477-4116-bdc8-0f79452dacae tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:41:39.404240 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a21286ee-4477-4116-bdc8-0f79452dacae tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:39.404695 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a21286ee-4477-4116-bdc8-0f79452dacae tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:39.405476 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a21286ee-4477-4116-bdc8-0f79452dacae tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:39.405923 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a21286ee-4477-4116-bdc8-0f79452dacae tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:39.550248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a21286ee-4477-4116-bdc8-0f79452dacae tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:41:39.558347 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a21286ee-4477-4116-bdc8-0f79452dacae tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 200 len: 1689 microversion: 2.1 time: 0.165695 Jul 19 23:41:39.558940 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3564/7118] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:41:39 2022] GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:41:40.576777 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f78eadcb-d60d-46b3-9c30-38bb245e9164 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:41:40.577435 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f78eadcb-d60d-46b3-9c30-38bb245e9164 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:41:40.584634 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f78eadcb-d60d-46b3-9c30-38bb245e9164 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:40.585095 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f78eadcb-d60d-46b3-9c30-38bb245e9164 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:40.585875 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f78eadcb-d60d-46b3-9c30-38bb245e9164 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:40.586325 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f78eadcb-d60d-46b3-9c30-38bb245e9164 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:40.720805 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f78eadcb-d60d-46b3-9c30-38bb245e9164 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:41:40.728482 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f78eadcb-d60d-46b3-9c30-38bb245e9164 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 200 len: 1689 microversion: 2.1 time: 0.155710 Jul 19 23:41:40.729062 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3555/7119] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:41:40 2022] GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:41:41.746496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9058a6b6-219b-4988-8886-ca74e3bacdf4 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:41:41.747066 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9058a6b6-219b-4988-8886-ca74e3bacdf4 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:41:41.754560 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9058a6b6-219b-4988-8886-ca74e3bacdf4 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:41.755041 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9058a6b6-219b-4988-8886-ca74e3bacdf4 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:41.755839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9058a6b6-219b-4988-8886-ca74e3bacdf4 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:41.756312 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9058a6b6-219b-4988-8886-ca74e3bacdf4 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:41.893711 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9058a6b6-219b-4988-8886-ca74e3bacdf4 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:41:41.901253 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9058a6b6-219b-4988-8886-ca74e3bacdf4 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 200 len: 1689 microversion: 2.1 time: 0.158731 Jul 19 23:41:41.901833 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3565/7120] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:41:41 2022] GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:41:42.919445 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a409cf2a-6229-4fb4-bfe4-e972a716415e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:41:42.920074 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a409cf2a-6229-4fb4-bfe4-e972a716415e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:41:42.928261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a409cf2a-6229-4fb4-bfe4-e972a716415e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:42.928750 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a409cf2a-6229-4fb4-bfe4-e972a716415e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:42.929524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a409cf2a-6229-4fb4-bfe4-e972a716415e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:42.929962 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a409cf2a-6229-4fb4-bfe4-e972a716415e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:43.063236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a409cf2a-6229-4fb4-bfe4-e972a716415e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:41:43.071583 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a409cf2a-6229-4fb4-bfe4-e972a716415e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 200 len: 1689 microversion: 2.1 time: 0.156027 Jul 19 23:41:43.072163 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3556/7121] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:41:42 2022] GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:41:44.088988 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0bc4769a-769d-461b-a33f-4ccf8dde9f37 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:41:44.089625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0bc4769a-769d-461b-a33f-4ccf8dde9f37 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:41:44.097347 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0bc4769a-769d-461b-a33f-4ccf8dde9f37 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:44.097809 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0bc4769a-769d-461b-a33f-4ccf8dde9f37 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:44.098586 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0bc4769a-769d-461b-a33f-4ccf8dde9f37 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:44.099036 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0bc4769a-769d-461b-a33f-4ccf8dde9f37 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:44.244548 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0bc4769a-769d-461b-a33f-4ccf8dde9f37 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:41:44.253029 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0bc4769a-769d-461b-a33f-4ccf8dde9f37 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 200 len: 1689 microversion: 2.1 time: 0.167978 Jul 19 23:41:44.253620 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3566/7122] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:41:44 2022] GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:41:45.271778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1bc7e4d6-8b56-460b-a543-e383675eb43d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:41:45.272425 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1bc7e4d6-8b56-460b-a543-e383675eb43d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:41:45.279395 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1bc7e4d6-8b56-460b-a543-e383675eb43d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:45.279854 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1bc7e4d6-8b56-460b-a543-e383675eb43d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:45.280637 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1bc7e4d6-8b56-460b-a543-e383675eb43d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:45.281083 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1bc7e4d6-8b56-460b-a543-e383675eb43d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:45.418890 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1bc7e4d6-8b56-460b-a543-e383675eb43d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:41:45.427336 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1bc7e4d6-8b56-460b-a543-e383675eb43d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 200 len: 1689 microversion: 2.1 time: 0.159595 Jul 19 23:41:45.427956 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3557/7123] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:41:45 2022] GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:41:46.444944 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-894af91d-e02a-4ff5-bfee-49da5977d587 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:41:46.445572 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-894af91d-e02a-4ff5-bfee-49da5977d587 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:41:46.451838 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-894af91d-e02a-4ff5-bfee-49da5977d587 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:46.452297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-894af91d-e02a-4ff5-bfee-49da5977d587 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:46.453063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-894af91d-e02a-4ff5-bfee-49da5977d587 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:46.454220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-894af91d-e02a-4ff5-bfee-49da5977d587 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:46.588825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-894af91d-e02a-4ff5-bfee-49da5977d587 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:41:46.596705 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-894af91d-e02a-4ff5-bfee-49da5977d587 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 200 len: 1666 microversion: 2.1 time: 0.156200 Jul 19 23:41:46.597284 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3567/7124] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:41:46 2022] GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 1666 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:41:47.690179 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b71ebfd2-fd87-4c89-82fe-627547f6c2b5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:41:47.691170 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b71ebfd2-fd87-4c89-82fe-627547f6c2b5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:41:47.698651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b71ebfd2-fd87-4c89-82fe-627547f6c2b5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:47.699164 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b71ebfd2-fd87-4c89-82fe-627547f6c2b5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:47.699963 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b71ebfd2-fd87-4c89-82fe-627547f6c2b5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:47.700410 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b71ebfd2-fd87-4c89-82fe-627547f6c2b5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:47.757609 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b71ebfd2-fd87-4c89-82fe-627547f6c2b5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b/action" status: 200 len: 35366 microversion: 2.1 time: 0.072534 Jul 19 23:41:47.764132 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3558/7125] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:41:47 2022] POST /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b/action => generated 35366 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 23:41:47.770349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-32c107b1-de5d-4b81-acca-36f27978ccad tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:41:47.777879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32c107b1-de5d-4b81-acca-36f27978ccad tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:47.778404 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32c107b1-de5d-4b81-acca-36f27978ccad tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:47.803309 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-32c107b1-de5d-4b81-acca-36f27978ccad tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Going to try to start instance {{(pid=119337) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 23:41:47.851578 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-32c107b1-de5d-4b81-acca-36f27978ccad tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b/action" status: 202 len: 0 microversion: 2.1 time: 0.085710 Jul 19 23:41:47.852367 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3568/7126] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:41:47 2022] POST /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:41:47.861511 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c0a7295d-2a48-49df-a6a1-ab13cb6ead0b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:41:47.862573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c0a7295d-2a48-49df-a6a1-ab13cb6ead0b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:41:47.871192 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0a7295d-2a48-49df-a6a1-ab13cb6ead0b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:47.871933 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0a7295d-2a48-49df-a6a1-ab13cb6ead0b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:47.872925 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0a7295d-2a48-49df-a6a1-ab13cb6ead0b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:47.873375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c0a7295d-2a48-49df-a6a1-ab13cb6ead0b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:48.019970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c0a7295d-2a48-49df-a6a1-ab13cb6ead0b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:41:48.027961 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c0a7295d-2a48-49df-a6a1-ab13cb6ead0b tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 200 len: 1675 microversion: 2.1 time: 0.170861 Jul 19 23:41:48.028534 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3559/7127] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:41:47 2022] GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:41:49.048131 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a200f697-2f30-4169-a9cb-06466b321693 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:41:49.048846 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a200f697-2f30-4169-a9cb-06466b321693 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:41:49.055404 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a200f697-2f30-4169-a9cb-06466b321693 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:49.055875 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a200f697-2f30-4169-a9cb-06466b321693 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:49.056664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a200f697-2f30-4169-a9cb-06466b321693 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:49.057124 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a200f697-2f30-4169-a9cb-06466b321693 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:49.212448 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a200f697-2f30-4169-a9cb-06466b321693 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:41:49.220844 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a200f697-2f30-4169-a9cb-06466b321693 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 200 len: 1675 microversion: 2.1 time: 0.178445 Jul 19 23:41:49.222213 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3569/7128] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:41:49 2022] GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 1675 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:41:50.239613 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b35a2e3f-8a75-4140-bc6e-1e6bf0a9a7e9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:41:50.240238 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b35a2e3f-8a75-4140-bc6e-1e6bf0a9a7e9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:41:50.247290 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b35a2e3f-8a75-4140-bc6e-1e6bf0a9a7e9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:50.247777 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b35a2e3f-8a75-4140-bc6e-1e6bf0a9a7e9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:50.248551 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b35a2e3f-8a75-4140-bc6e-1e6bf0a9a7e9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:41:50.248991 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b35a2e3f-8a75-4140-bc6e-1e6bf0a9a7e9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:41:50.382506 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b35a2e3f-8a75-4140-bc6e-1e6bf0a9a7e9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:41:50.390125 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b35a2e3f-8a75-4140-bc6e-1e6bf0a9a7e9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 200 len: 1679 microversion: 2.1 time: 0.154487 Jul 19 23:41:50.390805 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3560/7129] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:41:50 2022] GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:42:14.597255 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9efd9c6f-a740-4990-9d20-afa4ba71b8a3 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:42:14.598206 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9efd9c6f-a740-4990-9d20-afa4ba71b8a3 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:42:14.602284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=16 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:42:14.603089 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:42:14.610503 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9efd9c6f-a740-4990-9d20-afa4ba71b8a3 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:14.611754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9efd9c6f-a740-4990-9d20-afa4ba71b8a3 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:14.612934 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9efd9c6f-a740-4990-9d20-afa4ba71b8a3 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:14.613383 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9efd9c6f-a740-4990-9d20-afa4ba71b8a3 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:14.668017 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9efd9c6f-a740-4990-9d20-afa4ba71b8a3 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b/action" status: 200 len: 59929 microversion: 2.1 time: 0.075106 Jul 19 23:42:14.668857 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3570/7130] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:42:14 2022] POST /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b/action => generated 59929 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 23:42:21.720235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f222a948-2e60-4b9c-b115-95cf28528874 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:42:21.720884 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f222a948-2e60-4b9c-b115-95cf28528874 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:42:21.724052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=19 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:42:21.724853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=50 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:42:21.725027 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-4a810b0e-9267-47a8-82f8-598aaf6ff754 req-4cf4d2a0-eeae-4065-9f64-9510affce23c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7730e6e-70f4-43fe-959c-6163dc01ea2b", "tag": "5237b614-6182-4c75-8ae6-339a25a175c3"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:42:21.731404 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f222a948-2e60-4b9c-b115-95cf28528874 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:21.731864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f222a948-2e60-4b9c-b115-95cf28528874 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:21.732636 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f222a948-2e60-4b9c-b115-95cf28528874 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:21.733346 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f222a948-2e60-4b9c-b115-95cf28528874 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:21.734642 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-4a810b0e-9267-47a8-82f8-598aaf6ff754 req-4cf4d2a0-eeae-4065-9f64-9510affce23c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:21.735128 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-4a810b0e-9267-47a8-82f8-598aaf6ff754 req-4cf4d2a0-eeae-4065-9f64-9510affce23c service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:21.748233 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-4a810b0e-9267-47a8-82f8-598aaf6ff754 req-4cf4d2a0-eeae-4065-9f64-9510affce23c service nova] Creating event network-changed:5237b614-6182-4c75-8ae6-339a25a175c3 for instance a7730e6e-70f4-43fe-959c-6163dc01ea2b on n-h2-847009-3 Jul 19 23:42:21.754559 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-4a810b0e-9267-47a8-82f8-598aaf6ff754 req-4cf4d2a0-eeae-4065-9f64-9510affce23c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034896 Jul 19 23:42:21.755307 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3571/7131] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:42:21.764438 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f222a948-2e60-4b9c-b115-95cf28528874 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:42:21.871978 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f222a948-2e60-4b9c-b115-95cf28528874 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 204 len: 0 microversion: 2.1 time: 0.155581 Jul 19 23:42:21.875204 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3561/7132] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:42:21 2022] DELETE /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:42:21.882745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bb86a53e-2203-4092-b7f9-7dc4a4309727 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:42:21.883535 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bb86a53e-2203-4092-b7f9-7dc4a4309727 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:42:21.891584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb86a53e-2203-4092-b7f9-7dc4a4309727 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:21.892059 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb86a53e-2203-4092-b7f9-7dc4a4309727 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:21.892870 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb86a53e-2203-4092-b7f9-7dc4a4309727 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:21.893396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bb86a53e-2203-4092-b7f9-7dc4a4309727 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:22.042116 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bb86a53e-2203-4092-b7f9-7dc4a4309727 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:42:22.051154 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bb86a53e-2203-4092-b7f9-7dc4a4309727 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 200 len: 1685 microversion: 2.1 time: 0.172858 Jul 19 23:42:22.051768 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3572/7133] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:42:21 2022] GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 1685 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:42:23.070403 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-200a2fd4-a7a5-4745-bece-d0758dede9e2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:42:23.071135 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-200a2fd4-a7a5-4745-bece-d0758dede9e2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:42:23.078366 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-200a2fd4-a7a5-4745-bece-d0758dede9e2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:23.078821 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-200a2fd4-a7a5-4745-bece-d0758dede9e2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:23.079634 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-200a2fd4-a7a5-4745-bece-d0758dede9e2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:23.080141 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-200a2fd4-a7a5-4745-bece-d0758dede9e2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:23.230372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-200a2fd4-a7a5-4745-bece-d0758dede9e2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:42:23.239566 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-200a2fd4-a7a5-4745-bece-d0758dede9e2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 200 len: 1685 microversion: 2.1 time: 0.173464 Jul 19 23:42:23.240172 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3562/7134] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:42:23 2022] GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 1685 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:42:24.020706 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-2c8e38bd-0cb8-4862-9ee4-1e5bffe643bf req-4ed93395-2b84-4afd-b207-6df564efdfe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7730e6e-70f4-43fe-959c-6163dc01ea2b", "name": "network-vif-deleted", "tag": "5237b614-6182-4c75-8ae6-339a25a175c3"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:42:24.030982 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-2c8e38bd-0cb8-4862-9ee4-1e5bffe643bf req-4ed93395-2b84-4afd-b207-6df564efdfe1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:24.031671 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-2c8e38bd-0cb8-4862-9ee4-1e5bffe643bf req-4ed93395-2b84-4afd-b207-6df564efdfe1 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:24.043651 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-2c8e38bd-0cb8-4862-9ee4-1e5bffe643bf req-4ed93395-2b84-4afd-b207-6df564efdfe1 service nova] Creating event network-vif-deleted:5237b614-6182-4c75-8ae6-339a25a175c3 for instance a7730e6e-70f4-43fe-959c-6163dc01ea2b on n-h2-847009-3 Jul 19 23:42:24.049582 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-2c8e38bd-0cb8-4862-9ee4-1e5bffe643bf req-4ed93395-2b84-4afd-b207-6df564efdfe1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033002 Jul 19 23:42:24.050950 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3573/7135] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:42:24.258356 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7acd0b91-eb2f-4279-8cbb-b809fa53c0e4 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:42:24.259128 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7acd0b91-eb2f-4279-8cbb-b809fa53c0e4 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:42:24.266714 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7acd0b91-eb2f-4279-8cbb-b809fa53c0e4 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:24.267183 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7acd0b91-eb2f-4279-8cbb-b809fa53c0e4 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:24.268654 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7acd0b91-eb2f-4279-8cbb-b809fa53c0e4 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:24.269004 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7acd0b91-eb2f-4279-8cbb-b809fa53c0e4 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:24.305125 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7acd0b91-eb2f-4279-8cbb-b809fa53c0e4 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:24.305583 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7acd0b91-eb2f-4279-8cbb-b809fa53c0e4 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:24.306048 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-7acd0b91-eb2f-4279-8cbb-b809fa53c0e4 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lazy-loading 'fault' on Instance uuid a7730e6e-70f4-43fe-959c-6163dc01ea2b {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:42:24.355206 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7acd0b91-eb2f-4279-8cbb-b809fa53c0e4 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:42:24.363897 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7acd0b91-eb2f-4279-8cbb-b809fa53c0e4 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 200 len: 1353 microversion: 2.1 time: 0.109979 Jul 19 23:42:24.365200 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3563/7136] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:42:24 2022] GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 1353 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:42:25.383729 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-63d34840-43ee-4540-a47c-fb25c7d18893 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:42:25.384380 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-63d34840-43ee-4540-a47c-fb25c7d18893 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: a7730e6e-70f4-43fe-959c-6163dc01ea2b] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:42:25.390867 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63d34840-43ee-4540-a47c-fb25c7d18893 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:25.391314 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63d34840-43ee-4540-a47c-fb25c7d18893 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:25.392199 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63d34840-43ee-4540-a47c-fb25c7d18893 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:25.393209 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-63d34840-43ee-4540-a47c-fb25c7d18893 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:25.406448 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-63d34840-43ee-4540-a47c-fb25c7d18893 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] HTTP exception thrown: Instance a7730e6e-70f4-43fe-959c-6163dc01ea2b could not be found. Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-63d34840-43ee-4540-a47c-fb25c7d18893 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Request method failure captured: Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b HTTP/1.1 Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1z_i3_paGortEfNaOQ-D6RCdDbS-gFpUd1lXlaBmT5d8oYP2yebmdV_XnM7ZxXqP9UNbb4IDO7U57P8_q5lGyi5pGaH1sCoNIZdz_Yb4nbHkmoo7pLg5PveXEAt6VDocXQIXfFoPvZAh1aLRxH9YfhSo3R3-TTentuS0y213WSMCEEw Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: e250763e59c741fbbbf193ca4cac4189 Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-660489764 Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e250763e59c741fbbbf193ca4cac4189"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e250763e59c741fbbbf193ca4cac4189"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e250763e59c741fbbbf193ca4cac4189"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e250763e59c741fbbbf193ca4cac4189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-TestNetworkAdvancedServerOps-660489764 Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: e250763e59c741fbbbf193ca4cac4189 Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-660489764 Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-TestNetworkAdvancedServerOps-660489764-project Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: bdaa1c19bfa34fd69fd610406f41f728 Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-TestNetworkAdvancedServerOps-660489764-project Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance a7730e6e-70f4-43fe-959c-6163dc01ea2b could not be found. Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'a7730e6e-70f4-43fe-959c-6163dc01ea2b'} Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7730e6e-70f4-43fe-959c-6163dc01ea2b could not be found. Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7730e6e-70f4-43fe-959c-6163dc01ea2b could not be found. Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:42:25.408752 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:42:25.412833 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:42:25.412833 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:42:25.412833 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:42:25.412833 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:42:25.412833 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:42:25.412833 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7730e6e-70f4-43fe-959c-6163dc01ea2b could not be found. Jul 19 23:42:25.412833 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:42:25.412833 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-63d34840-43ee-4540-a47c-fb25c7d18893 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Returning 404 to user: Instance a7730e6e-70f4-43fe-959c-6163dc01ea2b could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:42:25.412833 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-63d34840-43ee-4540-a47c-fb25c7d18893 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b" status: 404 len: 111 microversion: 2.1 time: 0.031894 Jul 19 23:42:25.412833 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3574/7137] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:42:25 2022] GET /compute/v2.1/servers/a7730e6e-70f4-43fe-959c-6163dc01ea2b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:42:28.824255 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-73bc97e1-866d-41bb-9c06-0f795e27e260 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '.version_select at 0x7f7a1052fd30>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:42:28.847702 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-73bc97e1-866d-41bb-9c06-0f795e27e260 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-21902788" status: 202 len: 0 microversion: 2.1 time: 0.026954 Jul 19 23:42:28.852376 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3564/7138] 10.222.0.25 () {58 vars in 1277 bytes} [Tue Jul 19 23:42:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-21902788 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:42:28.885487 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6c45f879-043f-4293-959f-a4a4cda6a894 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'create', calling method: .version_select at 0x7f7a0305ab80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-736026305", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjlzJlsX7xIZwmHIbQWMne2W4fpKxjPFg/g6J+iBhDc9fnjlC3QtLAO/nGXU55gXFSIN2Efo8KMlD/2AhwabUS88vhSpfAk0ZMw+/5jxbztGjbL48UdJ7wLD0Ucz62gOw=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:42:28.904707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-6c45f879-043f-4293-959f-a4a4cda6a894 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Getting quotas for project e250763e59c741fbbbf193ca4cac4189. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:42:28.909997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-6c45f879-043f-4293-959f-a4a4cda6a894 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Getting quotas for user bdaa1c19bfa34fd69fd610406f41f728 and project e250763e59c741fbbbf193ca4cac4189. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:42:28.934508 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6c45f879-043f-4293-959f-a4a4cda6a894 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053154 Jul 19 23:42:28.935182 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3575/7139] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 23:42:28 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:42:34.620538 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e49df23e-0265-4980-a6ae-7868b815f3ab tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-524487016", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "networks": [{"uuid": "7139b3c7-465d-4d8f-acfc-3c1aedc9c2f4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-736026305", "security_groups": [{"name": "tempest-secgroup-smoke-718343792"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:42:34.629541 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:42:34.740577 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-e49df23e-0265-4980-a6ae-7868b815f3ab tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] validate_networks() for [('7139b3c7-465d-4d8f-acfc-3c1aedc9c2f4', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:42:35.256000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-e49df23e-0265-4980-a6ae-7868b815f3ab tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:42:35.256508 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-e49df23e-0265-4980-a6ae-7868b815f3ab tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:42:35.257282 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-e49df23e-0265-4980-a6ae-7868b815f3ab tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:42:35.257964 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-e49df23e-0265-4980-a6ae-7868b815f3ab tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:42:35.258736 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-e49df23e-0265-4980-a6ae-7868b815f3ab tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:42:35.275629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e49df23e-0265-4980-a6ae-7868b815f3ab tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:35.276155 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e49df23e-0265-4980-a6ae-7868b815f3ab tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:35.277018 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e49df23e-0265-4980-a6ae-7868b815f3ab tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:35.277466 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e49df23e-0265-4980-a6ae-7868b815f3ab tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:35.300587 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-e49df23e-0265-4980-a6ae-7868b815f3ab tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Getting quotas for project e250763e59c741fbbbf193ca4cac4189. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:42:35.308897 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-e49df23e-0265-4980-a6ae-7868b815f3ab tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Getting quotas for user bdaa1c19bfa34fd69fd610406f41f728 and project e250763e59c741fbbbf193ca4cac4189. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:42:35.327329 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e49df23e-0265-4980-a6ae-7868b815f3ab tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:42:35.330058 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e49df23e-0265-4980-a6ae-7868b815f3ab tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:42:35.384251 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e49df23e-0265-4980-a6ae-7868b815f3ab tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.767887 Jul 19 23:42:35.384923 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3565/7140] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:42:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:42:35.395564 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2405a2cf-011b-4bd3-94e4-7d3c7bb0233e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:42:35.397037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2405a2cf-011b-4bd3-94e4-7d3c7bb0233e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:42:35.400227 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=16 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:42:35.482942 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2405a2cf-011b-4bd3-94e4-7d3c7bb0233e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:42:35.494621 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2405a2cf-011b-4bd3-94e4-7d3c7bb0233e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360" status: 200 len: 1265 microversion: 2.1 time: 0.103364 Jul 19 23:42:35.495702 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3576/7141] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:42:35 2022] GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360 => generated 1265 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:42:36.515016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5b74a945-27b5-48f6-b077-226df678ef36 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:42:36.516856 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5b74a945-27b5-48f6-b077-226df678ef36 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:42:36.530804 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b74a945-27b5-48f6-b077-226df678ef36 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:36.531550 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b74a945-27b5-48f6-b077-226df678ef36 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:36.533529 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b74a945-27b5-48f6-b077-226df678ef36 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:36.534901 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5b74a945-27b5-48f6-b077-226df678ef36 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:36.631740 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5b74a945-27b5-48f6-b077-226df678ef36 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:42:36.641195 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5b74a945-27b5-48f6-b077-226df678ef36 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360" status: 200 len: 1325 microversion: 2.1 time: 0.132112 Jul 19 23:42:36.651300 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3566/7142] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:42:36 2022] GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360 => generated 1325 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:42:37.661805 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0b84ce46-764c-4851-9fc2-e23ceac4b8d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:42:37.662454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0b84ce46-764c-4851-9fc2-e23ceac4b8d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:42:37.671714 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0b84ce46-764c-4851-9fc2-e23ceac4b8d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:37.672557 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0b84ce46-764c-4851-9fc2-e23ceac4b8d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:37.674096 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0b84ce46-764c-4851-9fc2-e23ceac4b8d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:37.674754 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0b84ce46-764c-4851-9fc2-e23ceac4b8d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:37.903270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0b84ce46-764c-4851-9fc2-e23ceac4b8d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:42:37.910972 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0b84ce46-764c-4851-9fc2-e23ceac4b8d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360" status: 200 len: 1390 microversion: 2.1 time: 0.255997 Jul 19 23:42:37.911578 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3577/7143] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:42:37 2022] GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360 => generated 1390 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:42:38.182020 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-da9deb69-7463-40f5-ab89-0ade34ce9567 req-59eb08b4-6db0-4232-bb6e-4acc91210440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbf6819c-27a3-4767-b2bb-fce9e8701360", "tag": "8c48086d-dfd5-47c1-b144-65b6dac11559"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:42:38.193992 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-da9deb69-7463-40f5-ab89-0ade34ce9567 req-59eb08b4-6db0-4232-bb6e-4acc91210440 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:38.194887 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-da9deb69-7463-40f5-ab89-0ade34ce9567 req-59eb08b4-6db0-4232-bb6e-4acc91210440 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:38.212522 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-da9deb69-7463-40f5-ab89-0ade34ce9567 req-59eb08b4-6db0-4232-bb6e-4acc91210440 service nova] Creating event network-changed:8c48086d-dfd5-47c1-b144-65b6dac11559 for instance dbf6819c-27a3-4767-b2bb-fce9e8701360 on n-h1-847009-3 Jul 19 23:42:38.218593 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-da9deb69-7463-40f5-ab89-0ade34ce9567 req-59eb08b4-6db0-4232-bb6e-4acc91210440 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040247 Jul 19 23:42:38.219943 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3567/7144] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:42:38.928050 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-57803398-ba06-4766-b8c8-17671b692eb2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:42:38.928588 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-57803398-ba06-4766-b8c8-17671b692eb2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:42:38.935522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57803398-ba06-4766-b8c8-17671b692eb2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:38.935992 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57803398-ba06-4766-b8c8-17671b692eb2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:38.936764 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57803398-ba06-4766-b8c8-17671b692eb2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:38.937228 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-57803398-ba06-4766-b8c8-17671b692eb2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:39.072288 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-57803398-ba06-4766-b8c8-17671b692eb2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:42:39.081020 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-57803398-ba06-4766-b8c8-17671b692eb2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360" status: 200 len: 1390 microversion: 2.1 time: 0.155767 Jul 19 23:42:39.081596 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3578/7145] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:42:38 2022] GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:42:40.100039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-257279db-7b8d-4d8d-a8a7-a9f05302eaf8 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:42:40.100778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-257279db-7b8d-4d8d-a8a7-a9f05302eaf8 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:42:40.107026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-257279db-7b8d-4d8d-a8a7-a9f05302eaf8 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:40.107520 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-257279db-7b8d-4d8d-a8a7-a9f05302eaf8 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:40.108287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-257279db-7b8d-4d8d-a8a7-a9f05302eaf8 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:40.108732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-257279db-7b8d-4d8d-a8a7-a9f05302eaf8 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:40.248271 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-257279db-7b8d-4d8d-a8a7-a9f05302eaf8 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:42:40.256022 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-257279db-7b8d-4d8d-a8a7-a9f05302eaf8 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360" status: 200 len: 1390 microversion: 2.1 time: 0.161852 Jul 19 23:42:40.256610 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3568/7146] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:42:40 2022] GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:42:41.273997 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-32a40fed-5ea4-4cc7-9743-4f6aafb37157 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:42:41.274635 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-32a40fed-5ea4-4cc7-9743-4f6aafb37157 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:42:41.281822 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32a40fed-5ea4-4cc7-9743-4f6aafb37157 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:41.282279 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32a40fed-5ea4-4cc7-9743-4f6aafb37157 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:41.283422 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32a40fed-5ea4-4cc7-9743-4f6aafb37157 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:41.283879 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-32a40fed-5ea4-4cc7-9743-4f6aafb37157 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:41.415957 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-32a40fed-5ea4-4cc7-9743-4f6aafb37157 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:42:41.424564 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-32a40fed-5ea4-4cc7-9743-4f6aafb37157 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360" status: 200 len: 1390 microversion: 2.1 time: 0.153342 Jul 19 23:42:41.425146 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3579/7147] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:42:41 2022] GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:42:42.441568 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-94926c6b-a377-4378-bd04-df1475e0a275 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:42:42.442191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-94926c6b-a377-4378-bd04-df1475e0a275 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:42:42.449468 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-94926c6b-a377-4378-bd04-df1475e0a275 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:42.449950 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-94926c6b-a377-4378-bd04-df1475e0a275 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:42.450711 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-94926c6b-a377-4378-bd04-df1475e0a275 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:42.451167 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-94926c6b-a377-4378-bd04-df1475e0a275 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:42.587569 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-94926c6b-a377-4378-bd04-df1475e0a275 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:42:42.595186 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-94926c6b-a377-4378-bd04-df1475e0a275 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360" status: 200 len: 1390 microversion: 2.1 time: 0.158309 Jul 19 23:42:42.595711 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3569/7148] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:42:42 2022] GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:42:43.611844 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8908a07c-2a4c-4582-b6ca-eaa0f8189a08 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:42:43.612565 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8908a07c-2a4c-4582-b6ca-eaa0f8189a08 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:42:43.619417 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8908a07c-2a4c-4582-b6ca-eaa0f8189a08 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:43.619882 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8908a07c-2a4c-4582-b6ca-eaa0f8189a08 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:43.620662 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8908a07c-2a4c-4582-b6ca-eaa0f8189a08 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:43.621112 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8908a07c-2a4c-4582-b6ca-eaa0f8189a08 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:43.758252 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8908a07c-2a4c-4582-b6ca-eaa0f8189a08 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:42:43.766139 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8908a07c-2a4c-4582-b6ca-eaa0f8189a08 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360" status: 200 len: 1390 microversion: 2.1 time: 0.158339 Jul 19 23:42:43.766943 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3580/7149] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:42:43 2022] GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:42:44.784814 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-12061def-c39e-43a7-bd2c-cc1172c65468 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:42:44.785447 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-12061def-c39e-43a7-bd2c-cc1172c65468 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:42:44.792536 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-12061def-c39e-43a7-bd2c-cc1172c65468 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:44.792991 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-12061def-c39e-43a7-bd2c-cc1172c65468 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:44.793760 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-12061def-c39e-43a7-bd2c-cc1172c65468 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:44.794200 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-12061def-c39e-43a7-bd2c-cc1172c65468 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:44.923675 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-12061def-c39e-43a7-bd2c-cc1172c65468 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:42:44.931846 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-12061def-c39e-43a7-bd2c-cc1172c65468 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360" status: 200 len: 1390 microversion: 2.1 time: 0.151699 Jul 19 23:42:44.932430 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3570/7150] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:42:44 2022] GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360 => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:42:45.255599 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-54bff0b3-96b5-4cc9-a954-fe9f4114fc99 req-16d9f0b6-b332-4ab7-925f-2f87a3204693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf6819c-27a3-4767-b2bb-fce9e8701360", "name": "network-vif-plugged", "status": "completed", "tag": "8c48086d-dfd5-47c1-b144-65b6dac11559"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:42:45.259825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:42:45.266256 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-54bff0b3-96b5-4cc9-a954-fe9f4114fc99 req-16d9f0b6-b332-4ab7-925f-2f87a3204693 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:45.266746 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-54bff0b3-96b5-4cc9-a954-fe9f4114fc99 req-16d9f0b6-b332-4ab7-925f-2f87a3204693 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:45.280402 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-54bff0b3-96b5-4cc9-a954-fe9f4114fc99 req-16d9f0b6-b332-4ab7-925f-2f87a3204693 service nova] Creating event network-vif-plugged:8c48086d-dfd5-47c1-b144-65b6dac11559 for instance dbf6819c-27a3-4767-b2bb-fce9e8701360 on n-h1-847009-3 Jul 19 23:42:45.286507 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-54bff0b3-96b5-4cc9-a954-fe9f4114fc99 req-16d9f0b6-b332-4ab7-925f-2f87a3204693 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034775 Jul 19 23:42:45.287323 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3581/7151] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:42:45.948451 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9003a2b1-5947-4368-95ee-9305f29784f0 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:42:45.949075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9003a2b1-5947-4368-95ee-9305f29784f0 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:42:45.951129 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:42:45.951808 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:42:45.960074 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9003a2b1-5947-4368-95ee-9305f29784f0 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:45.960473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9003a2b1-5947-4368-95ee-9305f29784f0 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:45.961257 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9003a2b1-5947-4368-95ee-9305f29784f0 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:45.961706 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9003a2b1-5947-4368-95ee-9305f29784f0 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:46.092324 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9003a2b1-5947-4368-95ee-9305f29784f0 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:42:46.100056 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9003a2b1-5947-4368-95ee-9305f29784f0 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360" status: 200 len: 1390 microversion: 2.1 time: 0.155557 Jul 19 23:42:46.100629 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3571/7152] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:42:45 2022] GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:42:47.117968 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6cbe7d23-9fe4-4cf5-9bd8-3a17930aa6d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:42:47.118682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6cbe7d23-9fe4-4cf5-9bd8-3a17930aa6d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:42:47.120682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:42:47.126940 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6cbe7d23-9fe4-4cf5-9bd8-3a17930aa6d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:47.127436 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6cbe7d23-9fe4-4cf5-9bd8-3a17930aa6d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:47.128948 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6cbe7d23-9fe4-4cf5-9bd8-3a17930aa6d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:47.129400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6cbe7d23-9fe4-4cf5-9bd8-3a17930aa6d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:47.272617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6cbe7d23-9fe4-4cf5-9bd8-3a17930aa6d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:42:47.280200 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6cbe7d23-9fe4-4cf5-9bd8-3a17930aa6d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360" status: 200 len: 1562 microversion: 2.1 time: 0.166761 Jul 19 23:42:47.280769 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3582/7153] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:42:47 2022] GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360 => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:42:47.297069 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f4d4bccd-e7d3-4194-bf4d-742053dd78f6 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:42:47.297695 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f4d4bccd-e7d3-4194-bf4d-742053dd78f6 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:42:47.305385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4d4bccd-e7d3-4194-bf4d-742053dd78f6 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:47.305845 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4d4bccd-e7d3-4194-bf4d-742053dd78f6 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:47.306627 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4d4bccd-e7d3-4194-bf4d-742053dd78f6 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:47.307078 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f4d4bccd-e7d3-4194-bf4d-742053dd78f6 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:47.441279 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f4d4bccd-e7d3-4194-bf4d-742053dd78f6 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:42:47.449147 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f4d4bccd-e7d3-4194-bf4d-742053dd78f6 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360" status: 200 len: 1562 microversion: 2.1 time: 0.156021 Jul 19 23:42:47.449748 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3572/7154] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:42:47 2022] GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:42:49.387885 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f47936a1-31a5-4059-964e-2df98f508dcd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:42:49.388526 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f47936a1-31a5-4059-964e-2df98f508dcd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:42:49.390707 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-24b77e9d-6603-4009-ae8c-d754f93be83a req-530a174e-9582-4b6d-9ec2-4f25a0414ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbf6819c-27a3-4767-b2bb-fce9e8701360", "tag": "8c48086d-dfd5-47c1-b144-65b6dac11559"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:42:49.396784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f47936a1-31a5-4059-964e-2df98f508dcd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:49.397257 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f47936a1-31a5-4059-964e-2df98f508dcd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:49.398233 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f47936a1-31a5-4059-964e-2df98f508dcd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:49.398682 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f47936a1-31a5-4059-964e-2df98f508dcd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:49.402575 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-24b77e9d-6603-4009-ae8c-d754f93be83a req-530a174e-9582-4b6d-9ec2-4f25a0414ca2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:42:49.403032 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-24b77e9d-6603-4009-ae8c-d754f93be83a req-530a174e-9582-4b6d-9ec2-4f25a0414ca2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:42:49.415525 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-24b77e9d-6603-4009-ae8c-d754f93be83a req-530a174e-9582-4b6d-9ec2-4f25a0414ca2 service nova] Creating event network-changed:8c48086d-dfd5-47c1-b144-65b6dac11559 for instance dbf6819c-27a3-4767-b2bb-fce9e8701360 on n-h1-847009-3 Jul 19 23:42:49.424471 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-24b77e9d-6603-4009-ae8c-d754f93be83a req-530a174e-9582-4b6d-9ec2-4f25a0414ca2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038370 Jul 19 23:42:49.425408 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3573/7155] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:42:49.627765 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f47936a1-31a5-4059-964e-2df98f508dcd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:42:49.636750 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f47936a1-31a5-4059-964e-2df98f508dcd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360" status: 200 len: 1562 microversion: 2.1 time: 0.253172 Jul 19 23:42:49.637890 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3583/7156] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:42:49 2022] GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360 => generated 1562 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:43:14.932139 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:43:14.932900 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=42 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:43:14.937190 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9d45a472-6e6d-4baf-a725-bc3debd98744 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:43:14.938191 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9d45a472-6e6d-4baf-a725-bc3debd98744 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:43:14.946621 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d45a472-6e6d-4baf-a725-bc3debd98744 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:14.947073 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d45a472-6e6d-4baf-a725-bc3debd98744 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:14.947864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d45a472-6e6d-4baf-a725-bc3debd98744 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:14.948302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9d45a472-6e6d-4baf-a725-bc3debd98744 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:15.001524 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9d45a472-6e6d-4baf-a725-bc3debd98744 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360/action" status: 200 len: 24557 microversion: 2.1 time: 0.071163 Jul 19 23:43:15.002198 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3574/7157] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:43:14 2022] POST /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360/action => generated 24557 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 23:43:16.395908 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:43:16.396458 n-d-847009-3 devstack@n-api.service[119337]: Tue Jul 19 23:43:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:43:25.969441 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3b75ab5c-0466-43d1-9454-ff711fa2cc40 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:43:25.970056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3b75ab5c-0466-43d1-9454-ff711fa2cc40 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:43:25.972104 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=5 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:43:25.972764 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=38 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:43:25.978947 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b75ab5c-0466-43d1-9454-ff711fa2cc40 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:25.979427 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b75ab5c-0466-43d1-9454-ff711fa2cc40 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:25.980198 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b75ab5c-0466-43d1-9454-ff711fa2cc40 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:25.980647 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3b75ab5c-0466-43d1-9454-ff711fa2cc40 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:26.003498 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.objects.instance [None req-3b75ab5c-0466-43d1-9454-ff711fa2cc40 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lazy-loading 'flavor' on Instance uuid dbf6819c-27a3-4767-b2bb-fce9e8701360 {{(pid=119337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:43:26.069975 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3b75ab5c-0466-43d1-9454-ff711fa2cc40 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360/action" status: 202 len: 0 microversion: 2.1 time: 0.104501 Jul 19 23:43:26.071015 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3584/7158] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:43:25 2022] POST /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:43:26.080142 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6afcc30b-8998-4be6-b713-b1f01c8a9132 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:43:26.080853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6afcc30b-8998-4be6-b713-b1f01c8a9132 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:43:26.085208 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:43:26.085949 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=4 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:43:26.093651 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6afcc30b-8998-4be6-b713-b1f01c8a9132 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:26.094143 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6afcc30b-8998-4be6-b713-b1f01c8a9132 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:26.094923 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6afcc30b-8998-4be6-b713-b1f01c8a9132 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:26.095391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6afcc30b-8998-4be6-b713-b1f01c8a9132 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:26.233754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6afcc30b-8998-4be6-b713-b1f01c8a9132 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:43:26.241968 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6afcc30b-8998-4be6-b713-b1f01c8a9132 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360" status: 200 len: 1689 microversion: 2.1 time: 0.166013 Jul 19 23:43:26.242532 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3575/7159] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:43:26 2022] GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:43:27.261845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9b81ab42-29d0-42bf-a64b-f76de86ee3fd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:43:27.262697 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9b81ab42-29d0-42bf-a64b-f76de86ee3fd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:43:27.269825 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b81ab42-29d0-42bf-a64b-f76de86ee3fd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:27.270889 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b81ab42-29d0-42bf-a64b-f76de86ee3fd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:27.271808 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b81ab42-29d0-42bf-a64b-f76de86ee3fd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:27.272270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9b81ab42-29d0-42bf-a64b-f76de86ee3fd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:27.405312 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9b81ab42-29d0-42bf-a64b-f76de86ee3fd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:43:27.413150 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9b81ab42-29d0-42bf-a64b-f76de86ee3fd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360" status: 200 len: 1672 microversion: 2.1 time: 0.156771 Jul 19 23:43:27.413727 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3585/7160] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:43:27 2022] GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:43:28.505099 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4b42a9dd-901b-4dab-bd59-b48d9ea5c6cd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:43:28.506117 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4b42a9dd-901b-4dab-bd59-b48d9ea5c6cd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:43:28.514094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b42a9dd-901b-4dab-bd59-b48d9ea5c6cd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:28.514546 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b42a9dd-901b-4dab-bd59-b48d9ea5c6cd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:28.515361 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b42a9dd-901b-4dab-bd59-b48d9ea5c6cd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:28.515807 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4b42a9dd-901b-4dab-bd59-b48d9ea5c6cd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:28.577363 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4b42a9dd-901b-4dab-bd59-b48d9ea5c6cd tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360/action" status: 200 len: 37949 microversion: 2.1 time: 0.076632 Jul 19 23:43:28.578022 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3576/7161] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:43:28 2022] POST /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360/action => generated 37949 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 23:43:28.589213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ba6f68f3-2cb6-4d2a-9eb9-e7cee4c15ce5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:43:28.589764 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ba6f68f3-2cb6-4d2a-9eb9-e7cee4c15ce5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:43:28.596685 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba6f68f3-2cb6-4d2a-9eb9-e7cee4c15ce5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:28.597141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba6f68f3-2cb6-4d2a-9eb9-e7cee4c15ce5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:28.597927 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba6f68f3-2cb6-4d2a-9eb9-e7cee4c15ce5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:28.598409 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba6f68f3-2cb6-4d2a-9eb9-e7cee4c15ce5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:28.664670 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ba6f68f3-2cb6-4d2a-9eb9-e7cee4c15ce5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360/action" status: 202 len: 0 microversion: 2.1 time: 0.079103 Jul 19 23:43:28.665455 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3586/7162] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:43:28 2022] POST /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:43:28.675529 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f6c502f2-59b3-4222-8b95-57c70af725d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:43:28.676248 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f6c502f2-59b3-4222-8b95-57c70af725d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:43:28.684966 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f6c502f2-59b3-4222-8b95-57c70af725d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:28.685420 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f6c502f2-59b3-4222-8b95-57c70af725d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:28.686234 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f6c502f2-59b3-4222-8b95-57c70af725d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:28.686787 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f6c502f2-59b3-4222-8b95-57c70af725d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:28.915311 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f6c502f2-59b3-4222-8b95-57c70af725d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:43:28.922860 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f6c502f2-59b3-4222-8b95-57c70af725d5 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360" status: 200 len: 1678 microversion: 2.1 time: 0.252294 Jul 19 23:43:28.923477 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3577/7163] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:43:28 2022] GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360 => generated 1678 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:43:29.942388 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-188ab31a-dfb8-47a2-b60b-e0e7d6e46d4d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:43:29.943546 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-188ab31a-dfb8-47a2-b60b-e0e7d6e46d4d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:43:29.950780 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-188ab31a-dfb8-47a2-b60b-e0e7d6e46d4d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:29.951289 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-188ab31a-dfb8-47a2-b60b-e0e7d6e46d4d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:29.952074 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-188ab31a-dfb8-47a2-b60b-e0e7d6e46d4d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:29.952529 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-188ab31a-dfb8-47a2-b60b-e0e7d6e46d4d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:30.091219 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-188ab31a-dfb8-47a2-b60b-e0e7d6e46d4d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:43:30.098729 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-188ab31a-dfb8-47a2-b60b-e0e7d6e46d4d tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360" status: 200 len: 1678 microversion: 2.1 time: 0.161133 Jul 19 23:43:30.099364 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3587/7164] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:43:29 2022] GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:43:31.117052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5d4f8c11-ca77-4bad-80f3-012c88b012e9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:43:31.117745 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5d4f8c11-ca77-4bad-80f3-012c88b012e9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:43:31.124422 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d4f8c11-ca77-4bad-80f3-012c88b012e9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:31.124882 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d4f8c11-ca77-4bad-80f3-012c88b012e9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:31.125665 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d4f8c11-ca77-4bad-80f3-012c88b012e9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:31.126116 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5d4f8c11-ca77-4bad-80f3-012c88b012e9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:31.260557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5d4f8c11-ca77-4bad-80f3-012c88b012e9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:43:31.269243 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5d4f8c11-ca77-4bad-80f3-012c88b012e9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360" status: 200 len: 1681 microversion: 2.1 time: 0.156912 Jul 19 23:43:31.269820 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3578/7165] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:43:31 2022] GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:43:31.357486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f08627e0-ed22-41f6-b694-249dda015036 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:43:31.358429 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f08627e0-ed22-41f6-b694-249dda015036 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:43:31.365421 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f08627e0-ed22-41f6-b694-249dda015036 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:31.365877 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f08627e0-ed22-41f6-b694-249dda015036 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:31.366647 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f08627e0-ed22-41f6-b694-249dda015036 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:31.367250 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f08627e0-ed22-41f6-b694-249dda015036 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:31.414015 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f08627e0-ed22-41f6-b694-249dda015036 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "POST /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360/action" status: 200 len: 37949 microversion: 2.1 time: 0.060268 Jul 19 23:43:31.414659 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3588/7166] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:43:31 2022] POST /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360/action => generated 37949 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 23:43:32.371797 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1014a354-f54c-4e83-aff9-0d984aaa5dd2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:43:32.372301 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1014a354-f54c-4e83-aff9-0d984aaa5dd2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:43:32.374972 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-39b660c2-e4dd-4634-9b21-1b3ccdac57a0 req-2801c421-f783-42d4-9fd9-9e1494ffa853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbf6819c-27a3-4767-b2bb-fce9e8701360", "tag": "8c48086d-dfd5-47c1-b144-65b6dac11559"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:43:32.380199 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1014a354-f54c-4e83-aff9-0d984aaa5dd2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:32.380668 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1014a354-f54c-4e83-aff9-0d984aaa5dd2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:32.381555 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1014a354-f54c-4e83-aff9-0d984aaa5dd2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:32.381993 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1014a354-f54c-4e83-aff9-0d984aaa5dd2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:32.385452 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-39b660c2-e4dd-4634-9b21-1b3ccdac57a0 req-2801c421-f783-42d4-9fd9-9e1494ffa853 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:32.386023 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-39b660c2-e4dd-4634-9b21-1b3ccdac57a0 req-2801c421-f783-42d4-9fd9-9e1494ffa853 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:32.401307 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-39b660c2-e4dd-4634-9b21-1b3ccdac57a0 req-2801c421-f783-42d4-9fd9-9e1494ffa853 service nova] Creating event network-changed:8c48086d-dfd5-47c1-b144-65b6dac11559 for instance dbf6819c-27a3-4767-b2bb-fce9e8701360 on n-h1-847009-3 Jul 19 23:43:32.406598 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-39b660c2-e4dd-4634-9b21-1b3ccdac57a0 req-2801c421-f783-42d4-9fd9-9e1494ffa853 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035791 Jul 19 23:43:32.407609 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3589/7167] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:43:32.414059 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1014a354-f54c-4e83-aff9-0d984aaa5dd2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:43:32.502337 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1014a354-f54c-4e83-aff9-0d984aaa5dd2 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360" status: 204 len: 0 microversion: 2.1 time: 0.134291 Jul 19 23:43:32.505285 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3579/7168] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:43:32 2022] DELETE /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:43:32.515475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-096f4f1c-d968-4c08-a695-99a710c70e2f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:43:32.516348 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-096f4f1c-d968-4c08-a695-99a710c70e2f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:43:32.524246 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-096f4f1c-d968-4c08-a695-99a710c70e2f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:32.524939 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-096f4f1c-d968-4c08-a695-99a710c70e2f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:32.525834 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-096f4f1c-d968-4c08-a695-99a710c70e2f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:32.526418 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-096f4f1c-d968-4c08-a695-99a710c70e2f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:32.686188 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-096f4f1c-d968-4c08-a695-99a710c70e2f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:43:32.694427 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-096f4f1c-d968-4c08-a695-99a710c70e2f tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360" status: 200 len: 1687 microversion: 2.1 time: 0.184154 Jul 19 23:43:32.695010 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3590/7169] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:43:32 2022] GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360 => generated 1687 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:43:33.714188 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-beb8b14d-4e2f-497d-b60c-c4bc894aade9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:43:33.714831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-beb8b14d-4e2f-497d-b60c-c4bc894aade9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:43:33.721810 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-beb8b14d-4e2f-497d-b60c-c4bc894aade9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:33.722272 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-beb8b14d-4e2f-497d-b60c-c4bc894aade9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:33.723102 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-beb8b14d-4e2f-497d-b60c-c4bc894aade9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:33.724169 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-beb8b14d-4e2f-497d-b60c-c4bc894aade9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:33.857156 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-beb8b14d-4e2f-497d-b60c-c4bc894aade9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:43:33.865652 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-beb8b14d-4e2f-497d-b60c-c4bc894aade9 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360" status: 200 len: 1687 microversion: 2.1 time: 0.155777 Jul 19 23:43:33.866285 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3580/7170] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:43:33 2022] GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:43:34.883662 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6e49af58-55f1-4e20-808b-a50c92d4ca8e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:43:34.884227 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6e49af58-55f1-4e20-808b-a50c92d4ca8e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:43:34.891677 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e49af58-55f1-4e20-808b-a50c92d4ca8e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:34.892141 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e49af58-55f1-4e20-808b-a50c92d4ca8e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:34.892940 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e49af58-55f1-4e20-808b-a50c92d4ca8e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:34.893391 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6e49af58-55f1-4e20-808b-a50c92d4ca8e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:35.219470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-6e49af58-55f1-4e20-808b-a50c92d4ca8e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdaa1c19bfa34fd69fd610406f41f728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e250763e59c741fbbbf193ca4cac4189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:43:35.230867 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6e49af58-55f1-4e20-808b-a50c92d4ca8e tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360" status: 200 len: 1501 microversion: 2.1 time: 0.351940 Jul 19 23:43:35.231759 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3591/7171] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:43:34 2022] GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360 => generated 1501 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:43:35.232442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-cfbb3564-eb1e-4926-9f41-af555c91aa91 req-7cdcc633-0295-40be-9213-1953b5df9b06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf6819c-27a3-4767-b2bb-fce9e8701360", "name": "network-vif-deleted", "tag": "8c48086d-dfd5-47c1-b144-65b6dac11559"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:43:35.248863 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-cfbb3564-eb1e-4926-9f41-af555c91aa91 req-7cdcc633-0295-40be-9213-1953b5df9b06 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:35.249256 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-cfbb3564-eb1e-4926-9f41-af555c91aa91 req-7cdcc633-0295-40be-9213-1953b5df9b06 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:35.262655 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-cfbb3564-eb1e-4926-9f41-af555c91aa91 req-7cdcc633-0295-40be-9213-1953b5df9b06 service nova] Creating event network-vif-deleted:8c48086d-dfd5-47c1-b144-65b6dac11559 for instance dbf6819c-27a3-4767-b2bb-fce9e8701360 on n-h1-847009-3 Jul 19 23:43:35.268425 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-cfbb3564-eb1e-4926-9f41-af555c91aa91 req-7cdcc633-0295-40be-9213-1953b5df9b06 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039547 Jul 19 23:43:35.269332 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3581/7172] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:43:36.249924 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-81009571-b777-4fe4-aec2-484ca7d81f44 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:43:36.250560 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-81009571-b777-4fe4-aec2-484ca7d81f44 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] [instance: dbf6819c-27a3-4767-b2bb-fce9e8701360] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:43:36.257721 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-81009571-b777-4fe4-aec2-484ca7d81f44 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:36.258184 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-81009571-b777-4fe4-aec2-484ca7d81f44 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:36.258965 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-81009571-b777-4fe4-aec2-484ca7d81f44 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:36.259455 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-81009571-b777-4fe4-aec2-484ca7d81f44 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:36.273436 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-81009571-b777-4fe4-aec2-484ca7d81f44 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] HTTP exception thrown: Instance dbf6819c-27a3-4767-b2bb-fce9e8701360 could not be found. Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-81009571-b777-4fe4-aec2-484ca7d81f44 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Request method failure captured: Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360 HTTP/1.1 Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi1z_i3_paGortEfNaOQ-D6RCdDbS-gFpUd1lXlaBmT5d8oYP2yebmdV_XnM7ZxXqP9UNbb4IDO7U57P8_q5lGyi5pGaH1sCoNIZdz_Yb4nbHkmoo7pLg5PveXEAt6VDocXQIXfFoPvZAh1aLRxH9YfhSo3R3-TTentuS0y213WSMCEEw Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: e250763e59c741fbbbf193ca4cac4189 Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-660489764 Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e250763e59c741fbbbf193ca4cac4189"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e250763e59c741fbbbf193ca4cac4189"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e250763e59c741fbbbf193ca4cac4189"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e250763e59c741fbbbf193ca4cac4189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-TestNetworkAdvancedServerOps-660489764 Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: e250763e59c741fbbbf193ca4cac4189 Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-660489764 Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-TestNetworkAdvancedServerOps-660489764-project Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: bdaa1c19bfa34fd69fd610406f41f728 Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-TestNetworkAdvancedServerOps-660489764-project Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance dbf6819c-27a3-4767-b2bb-fce9e8701360 could not be found. Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'dbf6819c-27a3-4767-b2bb-fce9e8701360'} Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbf6819c-27a3-4767-b2bb-fce9e8701360 could not be found. Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbf6819c-27a3-4767-b2bb-fce9e8701360 could not be found. Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:43:36.275101 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:43:36.279626 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:43:36.279626 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:43:36.279626 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:43:36.279626 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:43:36.279626 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:43:36.279626 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbf6819c-27a3-4767-b2bb-fce9e8701360 could not be found. Jul 19 23:43:36.279626 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:43:36.279626 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-81009571-b777-4fe4-aec2-484ca7d81f44 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Returning 404 to user: Instance dbf6819c-27a3-4767-b2bb-fce9e8701360 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:43:36.279626 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-81009571-b777-4fe4-aec2-484ca7d81f44 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360" status: 404 len: 111 microversion: 2.1 time: 0.030576 Jul 19 23:43:36.279626 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3592/7173] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:43:36 2022] GET /compute/v2.1/servers/dbf6819c-27a3-4767-b2bb-fce9e8701360 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:43:39.288889 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2ee49269-47c2-4aa3-b52f-bed4130039b7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] Calling method '.version_select at 0x7f7a1055b3a0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:43:39.309025 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2ee49269-47c2-4aa3-b52f-bed4130039b7 tempest-TestNetworkAdvancedServerOps-660489764 tempest-TestNetworkAdvancedServerOps-660489764-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-736026305" status: 202 len: 0 microversion: 2.1 time: 0.026035 Jul 19 23:43:39.309627 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3582/7174] 10.222.0.25 () {58 vars in 1280 bytes} [Tue Jul 19 23:43:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-736026305 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:43:50.835135 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=18 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:43:50.836492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:43:51.038400 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-153522a0-da23-42fe-9b6a-ac565a63824f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Action: 'create', calling method: .version_select at 0x7f7a1562e3a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-934416640", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEogMsKJW6WQbxKWGQVbIDMX8VxvzusLXu4F9PT8IlSYvTtYdvtBCy67LnY3Zr9GCuAekwsXr7pWIJJAj98moKo4uhhw62x90i8UaP5asL4PdSvlkZBbb9rQqvVmfqegYg=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:43:51.054184 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-153522a0-da23-42fe-9b6a-ac565a63824f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Getting quotas for project 667e58901d514569a21cedcd4055538a. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:43:51.060168 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-153522a0-da23-42fe-9b6a-ac565a63824f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Getting quotas for user 9df24f256f744c569f0b238b79c71e5f and project 667e58901d514569a21cedcd4055538a. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:43:51.091485 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-153522a0-da23-42fe-9b6a-ac565a63824f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.262453 Jul 19 23:43:51.092312 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3593/7175] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 23:43:50 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:43:52.142512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:43:52.143454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:43:52.148300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-24f15861-684d-42ba-b999-bde2ff14ce48 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1007935080", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-934416640", "security_groups": [{"name": "tempest-secgroup-smoke-1986055608"}], "networks": [{"uuid": "7787910c-1843-4e77-95e1-32205e98bfa8"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:43:52.386802 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-24f15861-684d-42ba-b999-bde2ff14ce48 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] validate_networks() for [('7787910c-1843-4e77-95e1-32205e98bfa8', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:43:52.768434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-24f15861-684d-42ba-b999-bde2ff14ce48 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:43:52.768870 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-24f15861-684d-42ba-b999-bde2ff14ce48 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:43:52.769387 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-24f15861-684d-42ba-b999-bde2ff14ce48 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:43:52.769994 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-24f15861-684d-42ba-b999-bde2ff14ce48 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:43:52.770305 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-24f15861-684d-42ba-b999-bde2ff14ce48 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:43:52.779604 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24f15861-684d-42ba-b999-bde2ff14ce48 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:52.780093 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24f15861-684d-42ba-b999-bde2ff14ce48 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:52.780914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24f15861-684d-42ba-b999-bde2ff14ce48 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:52.781362 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-24f15861-684d-42ba-b999-bde2ff14ce48 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:52.799426 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-24f15861-684d-42ba-b999-bde2ff14ce48 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Getting quotas for project 667e58901d514569a21cedcd4055538a. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:43:52.805466 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-24f15861-684d-42ba-b999-bde2ff14ce48 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Getting quotas for user 9df24f256f744c569f0b238b79c71e5f and project 667e58901d514569a21cedcd4055538a. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:43:52.819081 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-24f15861-684d-42ba-b999-bde2ff14ce48 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:43:52.821527 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-24f15861-684d-42ba-b999-bde2ff14ce48 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:43:52.868363 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-24f15861-684d-42ba-b999-bde2ff14ce48 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.727243 Jul 19 23:43:52.873933 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3583/7176] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:43:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:43:52.879562 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4f45d4d0-d53b-4561-9045-9623551b4eb0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:43:52.880783 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4f45d4d0-d53b-4561-9045-9623551b4eb0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:43:53.061855 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4f45d4d0-d53b-4561-9045-9623551b4eb0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:43:53.070052 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4f45d4d0-d53b-4561-9045-9623551b4eb0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1246 microversion: 2.1 time: 0.194816 Jul 19 23:43:53.070626 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3594/7177] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:43:52 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1246 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:43:54.092604 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7912aa2d-d2e4-4cce-9e9a-6cbf9cbfe682 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:43:54.093499 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7912aa2d-d2e4-4cce-9e9a-6cbf9cbfe682 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:43:54.101698 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7912aa2d-d2e4-4cce-9e9a-6cbf9cbfe682 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:54.102202 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7912aa2d-d2e4-4cce-9e9a-6cbf9cbfe682 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:54.103000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7912aa2d-d2e4-4cce-9e9a-6cbf9cbfe682 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:54.103527 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7912aa2d-d2e4-4cce-9e9a-6cbf9cbfe682 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:54.181407 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7912aa2d-d2e4-4cce-9e9a-6cbf9cbfe682 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:43:54.196919 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7912aa2d-d2e4-4cce-9e9a-6cbf9cbfe682 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1298 microversion: 2.1 time: 0.109445 Jul 19 23:43:54.207519 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3584/7178] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:43:54 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1298 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:43:55.215597 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d5cba8e9-9dbd-4ea7-bd11-836b596d7889 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:43:55.216350 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d5cba8e9-9dbd-4ea7-bd11-836b596d7889 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:43:55.224321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5cba8e9-9dbd-4ea7-bd11-836b596d7889 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:55.225300 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5cba8e9-9dbd-4ea7-bd11-836b596d7889 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:55.225900 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5cba8e9-9dbd-4ea7-bd11-836b596d7889 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:55.226355 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d5cba8e9-9dbd-4ea7-bd11-836b596d7889 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:55.384536 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d5cba8e9-9dbd-4ea7-bd11-836b596d7889 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:43:55.395063 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d5cba8e9-9dbd-4ea7-bd11-836b596d7889 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1372 microversion: 2.1 time: 0.182906 Jul 19 23:43:55.395771 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3595/7179] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:43:55 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1372 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:43:55.819837 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-937d67b0-f119-405b-90d4-bc8173408c53 req-86376fd2-1f47-4198-ba3c-f76989e74278 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "401d7fb7-9947-43c3-b118-7bf2d00ad578", "tag": "2d2e88bb-146c-40bb-b527-aa2cc44735ce"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:43:55.829847 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-937d67b0-f119-405b-90d4-bc8173408c53 req-86376fd2-1f47-4198-ba3c-f76989e74278 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:55.831069 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-937d67b0-f119-405b-90d4-bc8173408c53 req-86376fd2-1f47-4198-ba3c-f76989e74278 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:55.861331 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-937d67b0-f119-405b-90d4-bc8173408c53 req-86376fd2-1f47-4198-ba3c-f76989e74278 service nova] Creating event network-changed:2d2e88bb-146c-40bb-b527-aa2cc44735ce for instance 401d7fb7-9947-43c3-b118-7bf2d00ad578 on n-h2-847009-3 Jul 19 23:43:55.869992 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-937d67b0-f119-405b-90d4-bc8173408c53 req-86376fd2-1f47-4198-ba3c-f76989e74278 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054864 Jul 19 23:43:55.875466 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3585/7180] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:43:56.414454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ba343b1d-5eec-4158-b9eb-7b73d67f17f6 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:43:56.415036 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ba343b1d-5eec-4158-b9eb-7b73d67f17f6 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:43:56.422398 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba343b1d-5eec-4158-b9eb-7b73d67f17f6 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:56.422871 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba343b1d-5eec-4158-b9eb-7b73d67f17f6 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:56.423704 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba343b1d-5eec-4158-b9eb-7b73d67f17f6 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:56.424162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ba343b1d-5eec-4158-b9eb-7b73d67f17f6 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:56.578704 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ba343b1d-5eec-4158-b9eb-7b73d67f17f6 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:43:56.589546 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ba343b1d-5eec-4158-b9eb-7b73d67f17f6 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1372 microversion: 2.1 time: 0.179315 Jul 19 23:43:56.590124 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3596/7181] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:43:56 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:43:57.609454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6f7b7a90-5fb3-4009-96fb-272e5dda14af tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:43:57.610789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6f7b7a90-5fb3-4009-96fb-272e5dda14af tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:43:57.618434 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f7b7a90-5fb3-4009-96fb-272e5dda14af tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:57.618817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f7b7a90-5fb3-4009-96fb-272e5dda14af tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:57.619634 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f7b7a90-5fb3-4009-96fb-272e5dda14af tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:57.620084 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f7b7a90-5fb3-4009-96fb-272e5dda14af tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:57.754009 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6f7b7a90-5fb3-4009-96fb-272e5dda14af tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:43:57.761541 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6f7b7a90-5fb3-4009-96fb-272e5dda14af tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1372 microversion: 2.1 time: 0.157352 Jul 19 23:43:57.762111 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3586/7182] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:43:57 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:43:58.779162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0ecd83f1-9f7f-4312-8414-418b2f8d8426 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:43:58.779807 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0ecd83f1-9f7f-4312-8414-418b2f8d8426 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:43:58.787047 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ecd83f1-9f7f-4312-8414-418b2f8d8426 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:58.787561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ecd83f1-9f7f-4312-8414-418b2f8d8426 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:58.788521 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ecd83f1-9f7f-4312-8414-418b2f8d8426 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:58.788797 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0ecd83f1-9f7f-4312-8414-418b2f8d8426 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:58.931968 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-0ecd83f1-9f7f-4312-8414-418b2f8d8426 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:43:58.939732 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0ecd83f1-9f7f-4312-8414-418b2f8d8426 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1372 microversion: 2.1 time: 0.164448 Jul 19 23:43:58.940314 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3597/7183] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:43:58 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:43:59.957865 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ddfebb05-783c-4662-9629-bc0900785918 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:43:59.958615 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ddfebb05-783c-4662-9629-bc0900785918 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:43:59.965879 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ddfebb05-783c-4662-9629-bc0900785918 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:59.966338 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ddfebb05-783c-4662-9629-bc0900785918 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:43:59.967135 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ddfebb05-783c-4662-9629-bc0900785918 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:43:59.967571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ddfebb05-783c-4662-9629-bc0900785918 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:44:00.107736 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ddfebb05-783c-4662-9629-bc0900785918 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:44:00.116025 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ddfebb05-783c-4662-9629-bc0900785918 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1372 microversion: 2.1 time: 0.162691 Jul 19 23:44:00.116607 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3587/7184] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:43:59 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:44:01.134493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d621077f-d3e3-40bf-bf8a-d18ee7b21878 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:44:01.135162 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d621077f-d3e3-40bf-bf8a-d18ee7b21878 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:44:01.141210 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d621077f-d3e3-40bf-bf8a-d18ee7b21878 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:44:01.141673 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d621077f-d3e3-40bf-bf8a-d18ee7b21878 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:44:01.142454 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d621077f-d3e3-40bf-bf8a-d18ee7b21878 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:44:01.142907 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d621077f-d3e3-40bf-bf8a-d18ee7b21878 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:44:01.225669 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-1278fdd5-cd0d-43e7-8345-8a3e1fa181c3 req-b83534c1-92a6-4848-9b93-c38f6b39bd6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "401d7fb7-9947-43c3-b118-7bf2d00ad578", "name": "network-vif-plugged", "status": "completed", "tag": "2d2e88bb-146c-40bb-b527-aa2cc44735ce"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:44:01.236214 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-1278fdd5-cd0d-43e7-8345-8a3e1fa181c3 req-b83534c1-92a6-4848-9b93-c38f6b39bd6e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:44:01.237031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-1278fdd5-cd0d-43e7-8345-8a3e1fa181c3 req-b83534c1-92a6-4848-9b93-c38f6b39bd6e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:44:01.249181 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-1278fdd5-cd0d-43e7-8345-8a3e1fa181c3 req-b83534c1-92a6-4848-9b93-c38f6b39bd6e service nova] Creating event network-vif-plugged:2d2e88bb-146c-40bb-b527-aa2cc44735ce for instance 401d7fb7-9947-43c3-b118-7bf2d00ad578 on n-h2-847009-3 Jul 19 23:44:01.256444 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-1278fdd5-cd0d-43e7-8345-8a3e1fa181c3 req-b83534c1-92a6-4848-9b93-c38f6b39bd6e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034202 Jul 19 23:44:01.257343 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3588/7185] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:44:01.296819 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-d621077f-d3e3-40bf-bf8a-d18ee7b21878 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:44:01.305230 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d621077f-d3e3-40bf-bf8a-d18ee7b21878 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1372 microversion: 2.1 time: 0.176106 Jul 19 23:44:01.306045 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3598/7186] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:44:01 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:44:02.323593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-51fbc572-fff4-4a4a-89ac-660e53b0823c tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:44:02.324529 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-51fbc572-fff4-4a4a-89ac-660e53b0823c tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:44:02.332968 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51fbc572-fff4-4a4a-89ac-660e53b0823c tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:44:02.333545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51fbc572-fff4-4a4a-89ac-660e53b0823c tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:44:02.334411 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51fbc572-fff4-4a4a-89ac-660e53b0823c tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:44:02.334942 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-51fbc572-fff4-4a4a-89ac-660e53b0823c tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:44:02.491322 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-51fbc572-fff4-4a4a-89ac-660e53b0823c tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:44:02.499280 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-51fbc572-fff4-4a4a-89ac-660e53b0823c tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1372 microversion: 2.1 time: 0.180781 Jul 19 23:44:02.499871 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3589/7187] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:44:02 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:44:03.517373 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-24c8c923-892b-48ea-8569-41e02f98a0a6 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:44:03.518011 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-24c8c923-892b-48ea-8569-41e02f98a0a6 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:44:03.521260 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:44:03.526773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-24c8c923-892b-48ea-8569-41e02f98a0a6 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:44:03.527264 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-24c8c923-892b-48ea-8569-41e02f98a0a6 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:44:03.528041 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-24c8c923-892b-48ea-8569-41e02f98a0a6 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:44:03.528491 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-24c8c923-892b-48ea-8569-41e02f98a0a6 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:44:03.673010 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-24c8c923-892b-48ea-8569-41e02f98a0a6 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:44:03.681688 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-24c8c923-892b-48ea-8569-41e02f98a0a6 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1557 microversion: 2.1 time: 0.168216 Jul 19 23:44:03.682268 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3599/7188] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:44:03 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1557 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:44:03.698288 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-01bb7f87-7059-4e0d-bb42-4f0bfe4f8263 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:44:03.698912 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-01bb7f87-7059-4e0d-bb42-4f0bfe4f8263 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:44:03.700923 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:44:03.701596 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:44:03.708959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-01bb7f87-7059-4e0d-bb42-4f0bfe4f8263 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:44:03.709413 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-01bb7f87-7059-4e0d-bb42-4f0bfe4f8263 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:44:03.710196 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-01bb7f87-7059-4e0d-bb42-4f0bfe4f8263 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:44:03.710640 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-01bb7f87-7059-4e0d-bb42-4f0bfe4f8263 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:44:03.847075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-01bb7f87-7059-4e0d-bb42-4f0bfe4f8263 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:44:03.855593 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-01bb7f87-7059-4e0d-bb42-4f0bfe4f8263 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1557 microversion: 2.1 time: 0.161065 Jul 19 23:44:03.856185 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3590/7189] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:44:03 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:44:05.858456 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-53ae6b81-24ee-405b-b718-d62638fd43a7 req-3b491784-d911-420b-b393-76d57f7a9db3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "401d7fb7-9947-43c3-b118-7bf2d00ad578", "tag": "2d2e88bb-146c-40bb-b527-aa2cc44735ce"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:44:05.868614 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-53ae6b81-24ee-405b-b718-d62638fd43a7 req-3b491784-d911-420b-b393-76d57f7a9db3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:44:05.869077 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-53ae6b81-24ee-405b-b718-d62638fd43a7 req-3b491784-d911-420b-b393-76d57f7a9db3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:44:05.883250 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-53ae6b81-24ee-405b-b718-d62638fd43a7 req-3b491784-d911-420b-b393-76d57f7a9db3 service nova] Creating event network-changed:2d2e88bb-146c-40bb-b527-aa2cc44735ce for instance 401d7fb7-9947-43c3-b118-7bf2d00ad578 on n-h2-847009-3 Jul 19 23:44:05.888517 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-53ae6b81-24ee-405b-b718-d62638fd43a7 req-3b491784-d911-420b-b393-76d57f7a9db3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033770 Jul 19 23:44:05.889378 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3600/7190] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:46:01.048412 n-d-847009-3 devstack@n-api.service[119338]: ERROR oslo.messaging._drivers.impl_rabbit [-] [33eb9b21-6b86-489c-8081-974c1460dc40] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 23:46:01.049500 n-d-847009-3 devstack@n-api.service[119338]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f9ad43fa-8ace-4c60-a52f-7afb16c145c7] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 23:46:01.049974 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:46:01.050832 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=36 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:46:01.055842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8970d248-20f5-4bae-a638-c2c1f55aad37 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:46:01.056385 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8970d248-20f5-4bae-a638-c2c1f55aad37 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:01.063575 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8970d248-20f5-4bae-a638-c2c1f55aad37 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:01.064037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8970d248-20f5-4bae-a638-c2c1f55aad37 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:01.064807 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8970d248-20f5-4bae-a638-c2c1f55aad37 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:01.065253 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8970d248-20f5-4bae-a638-c2c1f55aad37 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:01.089523 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-8970d248-20f5-4bae-a638-c2c1f55aad37 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lazy-loading 'flavor' on Instance uuid 401d7fb7-9947-43c3-b118-7bf2d00ad578 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:46:01.352281 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8970d248-20f5-4bae-a638-c2c1f55aad37 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "POST /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578/action" status: 202 len: 0 microversion: 2.1 time: 0.305454 Jul 19 23:46:01.352932 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3591/7191] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:46:01 2022] POST /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:46:01.360968 n-d-847009-3 devstack@n-api.service[119337]: ERROR oslo.messaging._drivers.impl_rabbit [-] [798b565c-2a51-4094-a95e-de275b58674b] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 19 23:46:01.363002 n-d-847009-3 devstack@n-api.service[119337]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4d9f90d1-6e88-4978-b2b1-8e2a2dbb4cb7] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 19 23:46:01.363713 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:46:01.364499 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=32 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:46:01.372058 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8c4b9b7d-440a-4646-9fa1-bdda43baeb48 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:01.372926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8c4b9b7d-440a-4646-9fa1-bdda43baeb48 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:01.383339 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c4b9b7d-440a-4646-9fa1-bdda43baeb48 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:01.383804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c4b9b7d-440a-4646-9fa1-bdda43baeb48 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:01.384589 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c4b9b7d-440a-4646-9fa1-bdda43baeb48 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:01.385037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8c4b9b7d-440a-4646-9fa1-bdda43baeb48 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:01.549795 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8c4b9b7d-440a-4646-9fa1-bdda43baeb48 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:01.558228 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8c4b9b7d-440a-4646-9fa1-bdda43baeb48 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1681 microversion: 2.1 time: 0.200657 Jul 19 23:46:01.558797 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3601/7192] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:01 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1681 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:02.577728 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6f61b541-e424-4e0d-88e9-c207fcbb3ab4 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:02.578442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6f61b541-e424-4e0d-88e9-c207fcbb3ab4 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:02.588332 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f61b541-e424-4e0d-88e9-c207fcbb3ab4 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:02.588785 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f61b541-e424-4e0d-88e9-c207fcbb3ab4 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:02.589565 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f61b541-e424-4e0d-88e9-c207fcbb3ab4 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:02.590007 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6f61b541-e424-4e0d-88e9-c207fcbb3ab4 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:02.594444 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [-] [33eb9b21-6b86-489c-8081-974c1460dc40] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39502. Jul 19 23:46:02.597327 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [-] [f9ad43fa-8ace-4c60-a52f-7afb16c145c7] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39504. Jul 19 23:46:02.729015 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6f61b541-e424-4e0d-88e9-c207fcbb3ab4 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:02.736707 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6f61b541-e424-4e0d-88e9-c207fcbb3ab4 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1681 microversion: 2.1 time: 0.164384 Jul 19 23:46:02.737281 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3592/7193] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:02 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:03.753973 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f57e01c9-8dd1-438c-b7cb-d86e93ea9a9f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:03.754617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f57e01c9-8dd1-438c-b7cb-d86e93ea9a9f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:03.766378 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f57e01c9-8dd1-438c-b7cb-d86e93ea9a9f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:03.766845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f57e01c9-8dd1-438c-b7cb-d86e93ea9a9f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:03.767662 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f57e01c9-8dd1-438c-b7cb-d86e93ea9a9f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:03.768117 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f57e01c9-8dd1-438c-b7cb-d86e93ea9a9f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:03.773086 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] [798b565c-2a51-4094-a95e-de275b58674b] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39508. Jul 19 23:46:03.775390 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] [4d9f90d1-6e88-4978-b2b1-8e2a2dbb4cb7] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39510. Jul 19 23:46:03.907268 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f57e01c9-8dd1-438c-b7cb-d86e93ea9a9f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:03.915824 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f57e01c9-8dd1-438c-b7cb-d86e93ea9a9f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1681 microversion: 2.1 time: 0.165671 Jul 19 23:46:03.916334 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3602/7194] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:03 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:04.932816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2b961651-d112-43f4-953a-13c0ca368cfc tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:04.933432 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2b961651-d112-43f4-953a-13c0ca368cfc tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:04.940464 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b961651-d112-43f4-953a-13c0ca368cfc tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:04.940913 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b961651-d112-43f4-953a-13c0ca368cfc tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:04.941678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b961651-d112-43f4-953a-13c0ca368cfc tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:04.942115 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2b961651-d112-43f4-953a-13c0ca368cfc tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:05.080375 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2b961651-d112-43f4-953a-13c0ca368cfc tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:05.088279 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2b961651-d112-43f4-953a-13c0ca368cfc tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1681 microversion: 2.1 time: 0.159955 Jul 19 23:46:05.088848 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3593/7195] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:04 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:06.105950 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3384d288-dce7-462d-9bba-6a7379e286e3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:06.107514 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3384d288-dce7-462d-9bba-6a7379e286e3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:06.113719 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3384d288-dce7-462d-9bba-6a7379e286e3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:06.114179 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3384d288-dce7-462d-9bba-6a7379e286e3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:06.114963 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3384d288-dce7-462d-9bba-6a7379e286e3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:06.115440 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-3384d288-dce7-462d-9bba-6a7379e286e3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:06.248327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3384d288-dce7-462d-9bba-6a7379e286e3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:06.255971 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3384d288-dce7-462d-9bba-6a7379e286e3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1681 microversion: 2.1 time: 0.153919 Jul 19 23:46:06.257067 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3603/7196] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:06 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:07.274108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-70f5c8e4-0539-42e7-a0ae-2e3be5c3445e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:07.274806 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-70f5c8e4-0539-42e7-a0ae-2e3be5c3445e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:07.282016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-70f5c8e4-0539-42e7-a0ae-2e3be5c3445e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:07.282467 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-70f5c8e4-0539-42e7-a0ae-2e3be5c3445e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:07.283267 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-70f5c8e4-0539-42e7-a0ae-2e3be5c3445e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:07.283713 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-70f5c8e4-0539-42e7-a0ae-2e3be5c3445e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:07.424653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-70f5c8e4-0539-42e7-a0ae-2e3be5c3445e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:07.432987 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-70f5c8e4-0539-42e7-a0ae-2e3be5c3445e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1681 microversion: 2.1 time: 0.163135 Jul 19 23:46:07.433570 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3594/7197] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:07 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:08.450765 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-05cc26c1-e1c6-49f9-951b-d031b2a15712 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:08.451435 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-05cc26c1-e1c6-49f9-951b-d031b2a15712 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:08.458422 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05cc26c1-e1c6-49f9-951b-d031b2a15712 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:08.458890 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05cc26c1-e1c6-49f9-951b-d031b2a15712 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:08.459871 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05cc26c1-e1c6-49f9-951b-d031b2a15712 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:08.460362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-05cc26c1-e1c6-49f9-951b-d031b2a15712 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:08.610150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-05cc26c1-e1c6-49f9-951b-d031b2a15712 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:08.619455 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-05cc26c1-e1c6-49f9-951b-d031b2a15712 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1681 microversion: 2.1 time: 0.172579 Jul 19 23:46:08.620037 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3604/7198] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:08 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:09.636695 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fe30d0f1-28b1-43b9-9d3e-a8b4e1ad9864 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:09.637248 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fe30d0f1-28b1-43b9-9d3e-a8b4e1ad9864 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:09.644272 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe30d0f1-28b1-43b9-9d3e-a8b4e1ad9864 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:09.644720 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe30d0f1-28b1-43b9-9d3e-a8b4e1ad9864 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:09.645515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe30d0f1-28b1-43b9-9d3e-a8b4e1ad9864 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:09.645939 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fe30d0f1-28b1-43b9-9d3e-a8b4e1ad9864 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:09.781211 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fe30d0f1-28b1-43b9-9d3e-a8b4e1ad9864 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:09.789765 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fe30d0f1-28b1-43b9-9d3e-a8b4e1ad9864 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1681 microversion: 2.1 time: 0.157105 Jul 19 23:46:09.790342 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3595/7199] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:09 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:10.806583 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4f12db84-8713-4767-94e4-57dcefe46a75 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:10.807261 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4f12db84-8713-4767-94e4-57dcefe46a75 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:10.814399 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f12db84-8713-4767-94e4-57dcefe46a75 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:10.814868 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f12db84-8713-4767-94e4-57dcefe46a75 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:10.815680 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f12db84-8713-4767-94e4-57dcefe46a75 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:10.816139 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4f12db84-8713-4767-94e4-57dcefe46a75 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:10.947039 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4f12db84-8713-4767-94e4-57dcefe46a75 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:10.954642 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4f12db84-8713-4767-94e4-57dcefe46a75 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1681 microversion: 2.1 time: 0.152698 Jul 19 23:46:10.955228 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3605/7200] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:10 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:11.972395 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f25cf93e-c214-4a43-942b-e8b2a8644931 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:11.973129 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f25cf93e-c214-4a43-942b-e8b2a8644931 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:11.981285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f25cf93e-c214-4a43-942b-e8b2a8644931 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:11.981782 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f25cf93e-c214-4a43-942b-e8b2a8644931 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:11.982611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f25cf93e-c214-4a43-942b-e8b2a8644931 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:11.983152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f25cf93e-c214-4a43-942b-e8b2a8644931 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:12.140413 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f25cf93e-c214-4a43-942b-e8b2a8644931 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:12.148544 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f25cf93e-c214-4a43-942b-e8b2a8644931 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1702 microversion: 2.1 time: 0.179978 Jul 19 23:46:12.150373 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3596/7201] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:11 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1702 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:13.167730 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a5919364-27cf-49f7-aad8-e421ed3e69c3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:13.168360 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a5919364-27cf-49f7-aad8-e421ed3e69c3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:13.176538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5919364-27cf-49f7-aad8-e421ed3e69c3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:13.176998 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5919364-27cf-49f7-aad8-e421ed3e69c3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:13.177779 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5919364-27cf-49f7-aad8-e421ed3e69c3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:13.178381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a5919364-27cf-49f7-aad8-e421ed3e69c3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:13.339476 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a5919364-27cf-49f7-aad8-e421ed3e69c3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:13.347341 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a5919364-27cf-49f7-aad8-e421ed3e69c3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1702 microversion: 2.1 time: 0.184228 Jul 19 23:46:13.347915 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3606/7202] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:13 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1702 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:46:14.015775 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-6ee4fc7a-a7ed-4971-a292-d72a02f79f36 req-3ddbe1e1-36b9-44b9-99c2-e7f3368efea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "401d7fb7-9947-43c3-b118-7bf2d00ad578", "name": "network-vif-plugged", "status": "completed", "tag": "2d2e88bb-146c-40bb-b527-aa2cc44735ce"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:46:14.025495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-6ee4fc7a-a7ed-4971-a292-d72a02f79f36 req-3ddbe1e1-36b9-44b9-99c2-e7f3368efea3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:14.025920 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-6ee4fc7a-a7ed-4971-a292-d72a02f79f36 req-3ddbe1e1-36b9-44b9-99c2-e7f3368efea3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:14.037087 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-6ee4fc7a-a7ed-4971-a292-d72a02f79f36 req-3ddbe1e1-36b9-44b9-99c2-e7f3368efea3 service nova] Creating event network-vif-plugged:2d2e88bb-146c-40bb-b527-aa2cc44735ce for instance 401d7fb7-9947-43c3-b118-7bf2d00ad578 on n-h2-847009-3 Jul 19 23:46:14.044192 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-6ee4fc7a-a7ed-4971-a292-d72a02f79f36 req-3ddbe1e1-36b9-44b9-99c2-e7f3368efea3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106977 Jul 19 23:46:14.044802 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3597/7203] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:46:14.366407 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b2758b3b-d03b-4af4-b671-3be5f03a3e77 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:14.368415 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b2758b3b-d03b-4af4-b671-3be5f03a3e77 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:14.379009 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b2758b3b-d03b-4af4-b671-3be5f03a3e77 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:14.379784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b2758b3b-d03b-4af4-b671-3be5f03a3e77 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:14.381006 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b2758b3b-d03b-4af4-b671-3be5f03a3e77 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:14.381499 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b2758b3b-d03b-4af4-b671-3be5f03a3e77 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:14.552863 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b2758b3b-d03b-4af4-b671-3be5f03a3e77 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:14.563050 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b2758b3b-d03b-4af4-b671-3be5f03a3e77 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1697 microversion: 2.1 time: 0.200577 Jul 19 23:46:14.563679 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3607/7204] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:14 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1697 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:15.585987 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7ebae60d-f375-49b6-9413-f046abfd0ba6 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:15.587387 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7ebae60d-f375-49b6-9413-f046abfd0ba6 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:15.594537 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7ebae60d-f375-49b6-9413-f046abfd0ba6 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:15.595813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7ebae60d-f375-49b6-9413-f046abfd0ba6 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:15.597858 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7ebae60d-f375-49b6-9413-f046abfd0ba6 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:15.598311 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7ebae60d-f375-49b6-9413-f046abfd0ba6 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:15.769845 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7ebae60d-f375-49b6-9413-f046abfd0ba6 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:15.785479 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7ebae60d-f375-49b6-9413-f046abfd0ba6 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1697 microversion: 2.1 time: 0.203884 Jul 19 23:46:15.788492 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3598/7205] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:15 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1697 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:16.803336 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f119f528-1749-47a3-90d3-49f61f9f18a5 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:16.804039 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f119f528-1749-47a3-90d3-49f61f9f18a5 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:16.816584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f119f528-1749-47a3-90d3-49f61f9f18a5 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:16.817233 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f119f528-1749-47a3-90d3-49f61f9f18a5 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:16.818297 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f119f528-1749-47a3-90d3-49f61f9f18a5 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:16.818947 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f119f528-1749-47a3-90d3-49f61f9f18a5 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:16.973230 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f119f528-1749-47a3-90d3-49f61f9f18a5 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:16.981209 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f119f528-1749-47a3-90d3-49f61f9f18a5 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1697 microversion: 2.1 time: 0.182029 Jul 19 23:46:16.985970 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3608/7206] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:16 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1697 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:46:18.000633 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5618d08a-06d3-4cf7-afa9-9f0512ed213b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:18.001222 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5618d08a-06d3-4cf7-afa9-9f0512ed213b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:18.016297 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5618d08a-06d3-4cf7-afa9-9f0512ed213b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:18.017013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5618d08a-06d3-4cf7-afa9-9f0512ed213b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:18.018008 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5618d08a-06d3-4cf7-afa9-9f0512ed213b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:18.018463 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5618d08a-06d3-4cf7-afa9-9f0512ed213b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:18.215548 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5618d08a-06d3-4cf7-afa9-9f0512ed213b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:18.224024 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5618d08a-06d3-4cf7-afa9-9f0512ed213b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1697 microversion: 2.1 time: 0.228773 Jul 19 23:46:18.224793 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3599/7207] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:17 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1697 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:19.241785 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8db29da1-44f1-4576-825b-5b9104e07851 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:19.243222 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8db29da1-44f1-4576-825b-5b9104e07851 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:19.251063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8db29da1-44f1-4576-825b-5b9104e07851 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:19.251708 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8db29da1-44f1-4576-825b-5b9104e07851 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:19.252514 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8db29da1-44f1-4576-825b-5b9104e07851 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:19.252968 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8db29da1-44f1-4576-825b-5b9104e07851 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:19.401926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8db29da1-44f1-4576-825b-5b9104e07851 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:19.412255 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8db29da1-44f1-4576-825b-5b9104e07851 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1697 microversion: 2.1 time: 0.174612 Jul 19 23:46:19.422437 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3609/7208] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:19 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1697 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:20.432475 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-dd9edc40-e92f-4b49-8046-3954b2adfe3f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:20.433214 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-dd9edc40-e92f-4b49-8046-3954b2adfe3f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:20.440554 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd9edc40-e92f-4b49-8046-3954b2adfe3f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:20.441108 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd9edc40-e92f-4b49-8046-3954b2adfe3f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:20.449106 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd9edc40-e92f-4b49-8046-3954b2adfe3f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:20.449676 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-dd9edc40-e92f-4b49-8046-3954b2adfe3f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:20.616009 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-dd9edc40-e92f-4b49-8046-3954b2adfe3f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:20.625744 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-dd9edc40-e92f-4b49-8046-3954b2adfe3f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1697 microversion: 2.1 time: 0.197657 Jul 19 23:46:20.626357 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3600/7209] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:20 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1697 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:21.643322 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cc3a9408-99eb-47ce-ac66-c48575e35596 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:21.643947 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cc3a9408-99eb-47ce-ac66-c48575e35596 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:21.652637 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc3a9408-99eb-47ce-ac66-c48575e35596 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:21.653103 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc3a9408-99eb-47ce-ac66-c48575e35596 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:21.653919 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc3a9408-99eb-47ce-ac66-c48575e35596 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:21.654410 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cc3a9408-99eb-47ce-ac66-c48575e35596 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:21.817023 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cc3a9408-99eb-47ce-ac66-c48575e35596 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:21.827035 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cc3a9408-99eb-47ce-ac66-c48575e35596 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1697 microversion: 2.1 time: 0.187764 Jul 19 23:46:21.827863 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3610/7210] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:21 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1697 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:22.845897 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c2ee0538-bdff-4fdb-909c-e825e2283a9a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:22.846517 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c2ee0538-bdff-4fdb-909c-e825e2283a9a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:22.854525 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c2ee0538-bdff-4fdb-909c-e825e2283a9a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:22.854989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c2ee0538-bdff-4fdb-909c-e825e2283a9a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:22.855813 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c2ee0538-bdff-4fdb-909c-e825e2283a9a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:22.856259 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c2ee0538-bdff-4fdb-909c-e825e2283a9a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:22.996313 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c2ee0538-bdff-4fdb-909c-e825e2283a9a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:23.004154 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c2ee0538-bdff-4fdb-909c-e825e2283a9a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1697 microversion: 2.1 time: 0.162271 Jul 19 23:46:23.004742 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3601/7211] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:22 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:24.022586 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dc3cb306-40e3-47c5-b343-b81996d9ba88 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:24.023880 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dc3cb306-40e3-47c5-b343-b81996d9ba88 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:24.031042 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dc3cb306-40e3-47c5-b343-b81996d9ba88 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:24.031534 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dc3cb306-40e3-47c5-b343-b81996d9ba88 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:24.032327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dc3cb306-40e3-47c5-b343-b81996d9ba88 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:24.032924 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dc3cb306-40e3-47c5-b343-b81996d9ba88 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:24.182548 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dc3cb306-40e3-47c5-b343-b81996d9ba88 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:24.191491 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dc3cb306-40e3-47c5-b343-b81996d9ba88 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1679 microversion: 2.1 time: 0.172703 Jul 19 23:46:24.192285 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3611/7212] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:24 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:46:25.213565 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-63a92480-e406-4581-812a-47742a6049bf tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:25.214464 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-63a92480-e406-4581-812a-47742a6049bf tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:25.223094 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-63a92480-e406-4581-812a-47742a6049bf tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:25.224402 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-63a92480-e406-4581-812a-47742a6049bf tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:25.224654 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-63a92480-e406-4581-812a-47742a6049bf tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:25.225161 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-63a92480-e406-4581-812a-47742a6049bf tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:25.385418 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-63a92480-e406-4581-812a-47742a6049bf tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:25.393245 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-63a92480-e406-4581-812a-47742a6049bf tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1679 microversion: 2.1 time: 0.187003 Jul 19 23:46:25.393830 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3602/7213] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:25 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1679 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:26.410926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9aded2ce-55b1-486a-9a95-63b804f0732a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:26.411591 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9aded2ce-55b1-486a-9a95-63b804f0732a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:26.419771 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9aded2ce-55b1-486a-9a95-63b804f0732a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:26.420237 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9aded2ce-55b1-486a-9a95-63b804f0732a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:26.421045 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9aded2ce-55b1-486a-9a95-63b804f0732a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:26.421501 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9aded2ce-55b1-486a-9a95-63b804f0732a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:26.554413 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-9aded2ce-55b1-486a-9a95-63b804f0732a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:26.562030 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9aded2ce-55b1-486a-9a95-63b804f0732a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1622 microversion: 2.1 time: 0.155100 Jul 19 23:46:26.562610 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3612/7214] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:26 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1622 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:26.578532 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a0f1d4ba-e5e6-4640-9728-1266bdbba3bc tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:46:26.579173 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a0f1d4ba-e5e6-4640-9728-1266bdbba3bc tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:26.586757 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0f1d4ba-e5e6-4640-9728-1266bdbba3bc tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:26.587242 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0f1d4ba-e5e6-4640-9728-1266bdbba3bc tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:26.588012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0f1d4ba-e5e6-4640-9728-1266bdbba3bc tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:26.588451 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a0f1d4ba-e5e6-4640-9728-1266bdbba3bc tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:26.676086 n-d-847009-3 devstack@n-api.service[119338]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a0f1d4ba-e5e6-4640-9728-1266bdbba3bc tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [e885b08f-a38d-4663-aa03-4b9b970f7884] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 23:46:27.684164 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [None req-a0f1d4ba-e5e6-4640-9728-1266bdbba3bc tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [e885b08f-a38d-4663-aa03-4b9b970f7884] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39606. Jul 19 23:46:27.687698 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a0f1d4ba-e5e6-4640-9728-1266bdbba3bc tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "POST /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578/action" status: 202 len: 0 microversion: 2.1 time: 1.113123 Jul 19 23:46:27.688420 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3603/7215] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:46:26 2022] POST /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578/action => generated 0 bytes in 1114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:46:27.697174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-257e0d97-2832-48f7-9d9b-f4238740e0c2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:27.697804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-257e0d97-2832-48f7-9d9b-f4238740e0c2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:27.704648 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-257e0d97-2832-48f7-9d9b-f4238740e0c2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:27.705107 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-257e0d97-2832-48f7-9d9b-f4238740e0c2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:27.705892 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-257e0d97-2832-48f7-9d9b-f4238740e0c2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:27.706347 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-257e0d97-2832-48f7-9d9b-f4238740e0c2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:27.856163 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-257e0d97-2832-48f7-9d9b-f4238740e0c2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:27.869092 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-257e0d97-2832-48f7-9d9b-f4238740e0c2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1630 microversion: 2.1 time: 0.176244 Jul 19 23:46:27.878668 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3613/7216] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:27 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1630 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:27.940323 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-c38ced44-61ee-4ba7-9022-ca454f14179b req-e4f2f623-7dde-47d7-bc77-8ff03abc223b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "401d7fb7-9947-43c3-b118-7bf2d00ad578", "name": "network-vif-unplugged", "status": "completed", "tag": "2d2e88bb-146c-40bb-b527-aa2cc44735ce"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:46:27.950943 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c38ced44-61ee-4ba7-9022-ca454f14179b req-e4f2f623-7dde-47d7-bc77-8ff03abc223b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:27.951495 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c38ced44-61ee-4ba7-9022-ca454f14179b req-e4f2f623-7dde-47d7-bc77-8ff03abc223b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:27.963490 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.compute.server_external_events [req-c38ced44-61ee-4ba7-9022-ca454f14179b req-e4f2f623-7dde-47d7-bc77-8ff03abc223b service nova] Unable to find a host for instance 401d7fb7-9947-43c3-b118-7bf2d00ad578. Dropping event network-vif-unplugged {{(pid=119338) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 19 23:46:27.964615 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-c38ced44-61ee-4ba7-9022-ca454f14179b req-e4f2f623-7dde-47d7-bc77-8ff03abc223b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028249 Jul 19 23:46:27.965308 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3604/7217] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 19 23:46:28.886872 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e51daef9-79eb-4937-85cc-5e0ce24d574d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:28.887643 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e51daef9-79eb-4937-85cc-5e0ce24d574d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:28.894890 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e51daef9-79eb-4937-85cc-5e0ce24d574d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:28.895394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e51daef9-79eb-4937-85cc-5e0ce24d574d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:28.896194 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e51daef9-79eb-4937-85cc-5e0ce24d574d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:28.896668 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e51daef9-79eb-4937-85cc-5e0ce24d574d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:29.111601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e51daef9-79eb-4937-85cc-5e0ce24d574d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:29.119393 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e51daef9-79eb-4937-85cc-5e0ce24d574d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1688 microversion: 2.1 time: 0.237351 Jul 19 23:46:29.119977 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3614/7218] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:28 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1688 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:29.912037 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-c19ef9e5-c190-4818-96d1-604e244f2c6f req-97cbcb58-82ca-40b4-a143-718b8d9276c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "401d7fb7-9947-43c3-b118-7bf2d00ad578", "tag": "2d2e88bb-146c-40bb-b527-aa2cc44735ce"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:46:29.920735 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c19ef9e5-c190-4818-96d1-604e244f2c6f req-97cbcb58-82ca-40b4-a143-718b8d9276c2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:29.921190 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-c19ef9e5-c190-4818-96d1-604e244f2c6f req-97cbcb58-82ca-40b4-a143-718b8d9276c2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:29.933330 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-c19ef9e5-c190-4818-96d1-604e244f2c6f req-97cbcb58-82ca-40b4-a143-718b8d9276c2 service nova] Creating event network-changed:2d2e88bb-146c-40bb-b527-aa2cc44735ce for instance 401d7fb7-9947-43c3-b118-7bf2d00ad578 on n-h1-847009-3 Jul 19 23:46:29.938762 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-c19ef9e5-c190-4818-96d1-604e244f2c6f req-97cbcb58-82ca-40b4-a143-718b8d9276c2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105786 Jul 19 23:46:29.939600 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3605/7219] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:46:30.138149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b8d89228-92cb-4165-8830-1787b4c4154f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:30.138687 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b8d89228-92cb-4165-8830-1787b4c4154f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:30.150450 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8d89228-92cb-4165-8830-1787b4c4154f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:30.150925 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8d89228-92cb-4165-8830-1787b4c4154f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:30.151765 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8d89228-92cb-4165-8830-1787b4c4154f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:30.152221 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b8d89228-92cb-4165-8830-1787b4c4154f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:30.363823 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b8d89228-92cb-4165-8830-1787b4c4154f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:30.371863 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b8d89228-92cb-4165-8830-1787b4c4154f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1688 microversion: 2.1 time: 0.238975 Jul 19 23:46:30.372452 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3615/7220] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:30 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1688 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:31.391797 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f24ef0ec-58e5-4514-88c5-a614ce9f875c tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:31.392671 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f24ef0ec-58e5-4514-88c5-a614ce9f875c tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:31.394705 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=33 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:46:31.401038 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f24ef0ec-58e5-4514-88c5-a614ce9f875c tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:31.401492 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f24ef0ec-58e5-4514-88c5-a614ce9f875c tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:31.402305 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f24ef0ec-58e5-4514-88c5-a614ce9f875c tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:31.402746 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f24ef0ec-58e5-4514-88c5-a614ce9f875c tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:31.405911 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:46:31.563520 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f24ef0ec-58e5-4514-88c5-a614ce9f875c tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:31.572853 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f24ef0ec-58e5-4514-88c5-a614ce9f875c tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1688 microversion: 2.1 time: 0.186909 Jul 19 23:46:31.573460 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3606/7221] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:31 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1688 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:32.590504 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c39115dc-e89d-413f-997c-4d5ae45d9e99 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:32.591190 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c39115dc-e89d-413f-997c-4d5ae45d9e99 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:32.594163 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=31 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:46:32.600049 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c39115dc-e89d-413f-997c-4d5ae45d9e99 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:32.600625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c39115dc-e89d-413f-997c-4d5ae45d9e99 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:32.601930 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c39115dc-e89d-413f-997c-4d5ae45d9e99 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:32.602695 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c39115dc-e89d-413f-997c-4d5ae45d9e99 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:32.606324 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=91 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:46:32.764286 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c39115dc-e89d-413f-997c-4d5ae45d9e99 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:32.786671 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c39115dc-e89d-413f-997c-4d5ae45d9e99 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1688 microversion: 2.1 time: 0.190572 Jul 19 23:46:32.786671 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3616/7222] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:32 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1688 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:33.795199 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-257d2467-ae6c-4243-81ac-314bc9cedf95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:33.796071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-257d2467-ae6c-4243-81ac-314bc9cedf95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:33.806390 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-257d2467-ae6c-4243-81ac-314bc9cedf95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:33.806390 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-257d2467-ae6c-4243-81ac-314bc9cedf95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:33.806390 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-257d2467-ae6c-4243-81ac-314bc9cedf95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:33.806776 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-257d2467-ae6c-4243-81ac-314bc9cedf95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:33.957442 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-257d2467-ae6c-4243-81ac-314bc9cedf95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:33.967479 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-257d2467-ae6c-4243-81ac-314bc9cedf95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1688 microversion: 2.1 time: 0.177006 Jul 19 23:46:33.968135 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3607/7223] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:33 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:34.986408 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-70a00e85-2afe-49bf-bd49-137fd646b350 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:34.987043 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-70a00e85-2afe-49bf-bd49-137fd646b350 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:34.993608 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-70a00e85-2afe-49bf-bd49-137fd646b350 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:34.994081 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-70a00e85-2afe-49bf-bd49-137fd646b350 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:34.995572 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-70a00e85-2afe-49bf-bd49-137fd646b350 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:34.996531 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-70a00e85-2afe-49bf-bd49-137fd646b350 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:35.143410 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-70a00e85-2afe-49bf-bd49-137fd646b350 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:35.153479 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-70a00e85-2afe-49bf-bd49-137fd646b350 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1688 microversion: 2.1 time: 0.171309 Jul 19 23:46:35.154763 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3617/7224] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:34 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:35.421766 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 19 23:46:35.422846 n-d-847009-3 devstack@n-api.service[119338]: Tue Jul 19 23:46:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:46:36.171848 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-54bcef9d-d87b-4cdb-a280-45b93cda3032 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:36.172563 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-54bcef9d-d87b-4cdb-a280-45b93cda3032 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:36.180677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54bcef9d-d87b-4cdb-a280-45b93cda3032 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:36.181138 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54bcef9d-d87b-4cdb-a280-45b93cda3032 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:36.182069 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54bcef9d-d87b-4cdb-a280-45b93cda3032 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:36.183703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-54bcef9d-d87b-4cdb-a280-45b93cda3032 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:36.355062 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-54bcef9d-d87b-4cdb-a280-45b93cda3032 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:36.363041 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-54bcef9d-d87b-4cdb-a280-45b93cda3032 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1688 microversion: 2.1 time: 0.195292 Jul 19 23:46:36.363883 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3608/7225] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:36 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1688 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:36.404067 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:46:36.404660 n-d-847009-3 devstack@n-api.service[119337]: Tue Jul 19 23:46:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:46:37.128888 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:46:37.129115 n-d-847009-3 devstack@n-api.service[119337]: Tue Jul 19 23:46:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:46:37.381291 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-466c03d2-18e1-4c4e-9d48-dbd56de9f584 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:37.381848 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-466c03d2-18e1-4c4e-9d48-dbd56de9f584 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:37.389725 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-466c03d2-18e1-4c4e-9d48-dbd56de9f584 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:37.390194 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-466c03d2-18e1-4c4e-9d48-dbd56de9f584 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:37.391022 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-466c03d2-18e1-4c4e-9d48-dbd56de9f584 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:37.391515 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-466c03d2-18e1-4c4e-9d48-dbd56de9f584 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:37.536434 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-466c03d2-18e1-4c4e-9d48-dbd56de9f584 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:37.544474 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-466c03d2-18e1-4c4e-9d48-dbd56de9f584 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1688 microversion: 2.1 time: 0.167135 Jul 19 23:46:37.545048 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3618/7226] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:37 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:38.561986 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1198d437-12c0-40e9-bede-74222629deef tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:38.562610 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1198d437-12c0-40e9-bede-74222629deef tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:38.570011 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1198d437-12c0-40e9-bede-74222629deef tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:38.570469 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1198d437-12c0-40e9-bede-74222629deef tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:38.571297 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1198d437-12c0-40e9-bede-74222629deef tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:38.571745 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1198d437-12c0-40e9-bede-74222629deef tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:38.749181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1198d437-12c0-40e9-bede-74222629deef tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:38.757159 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1198d437-12c0-40e9-bede-74222629deef tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1688 microversion: 2.1 time: 0.199471 Jul 19 23:46:38.757738 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3609/7227] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:38 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1688 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:39.774772 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-99db5fef-a308-4569-968f-320b08e21b85 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:39.775458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-99db5fef-a308-4569-968f-320b08e21b85 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:39.783439 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99db5fef-a308-4569-968f-320b08e21b85 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:39.783906 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99db5fef-a308-4569-968f-320b08e21b85 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:39.784727 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99db5fef-a308-4569-968f-320b08e21b85 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:39.785180 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-99db5fef-a308-4569-968f-320b08e21b85 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:39.922940 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-99db5fef-a308-4569-968f-320b08e21b85 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:39.930432 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-99db5fef-a308-4569-968f-320b08e21b85 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1688 microversion: 2.1 time: 0.159611 Jul 19 23:46:39.930994 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3619/7228] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:39 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:40.949170 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7053047e-264c-4376-8d0e-03db57c96ac9 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:40.949817 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7053047e-264c-4376-8d0e-03db57c96ac9 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:40.956852 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7053047e-264c-4376-8d0e-03db57c96ac9 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:40.957307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7053047e-264c-4376-8d0e-03db57c96ac9 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:40.958079 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7053047e-264c-4376-8d0e-03db57c96ac9 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:40.958522 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7053047e-264c-4376-8d0e-03db57c96ac9 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:41.090849 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7053047e-264c-4376-8d0e-03db57c96ac9 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:41.098513 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7053047e-264c-4376-8d0e-03db57c96ac9 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1688 microversion: 2.1 time: 0.154143 Jul 19 23:46:41.099096 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3610/7229] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:40 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:42.116836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-66b98997-9a99-4b55-b3cc-067025c4d583 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:42.117475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-66b98997-9a99-4b55-b3cc-067025c4d583 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:42.125273 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-66b98997-9a99-4b55-b3cc-067025c4d583 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:42.125741 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-66b98997-9a99-4b55-b3cc-067025c4d583 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:42.126521 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-66b98997-9a99-4b55-b3cc-067025c4d583 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:42.126975 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-66b98997-9a99-4b55-b3cc-067025c4d583 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:42.264199 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-66b98997-9a99-4b55-b3cc-067025c4d583 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:42.271542 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-66b98997-9a99-4b55-b3cc-067025c4d583 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1688 microversion: 2.1 time: 0.158647 Jul 19 23:46:42.272106 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3620/7230] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:42 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:43.289562 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0169c233-bac6-4d2d-8f82-38c0ebd56349 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:43.290177 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0169c233-bac6-4d2d-8f82-38c0ebd56349 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:43.299031 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0169c233-bac6-4d2d-8f82-38c0ebd56349 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:43.299507 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0169c233-bac6-4d2d-8f82-38c0ebd56349 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:43.300275 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0169c233-bac6-4d2d-8f82-38c0ebd56349 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:43.300713 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0169c233-bac6-4d2d-8f82-38c0ebd56349 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:43.433909 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0169c233-bac6-4d2d-8f82-38c0ebd56349 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:43.442081 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0169c233-bac6-4d2d-8f82-38c0ebd56349 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1688 microversion: 2.1 time: 0.156469 Jul 19 23:46:43.442904 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3611/7231] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:43 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:44.459983 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f6c9afbc-8a58-4af9-bb1b-687d9c15e5c2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:44.460796 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f6c9afbc-8a58-4af9-bb1b-687d9c15e5c2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:44.468209 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f6c9afbc-8a58-4af9-bb1b-687d9c15e5c2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:44.468681 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f6c9afbc-8a58-4af9-bb1b-687d9c15e5c2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:44.469505 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f6c9afbc-8a58-4af9-bb1b-687d9c15e5c2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:44.469963 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f6c9afbc-8a58-4af9-bb1b-687d9c15e5c2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:44.529508 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-44f3f4de-be9c-4393-9983-a3807af545d7 req-17e0cb05-6476-4725-926c-e371cebe7499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "401d7fb7-9947-43c3-b118-7bf2d00ad578", "name": "network-vif-plugged", "status": "completed", "tag": "2d2e88bb-146c-40bb-b527-aa2cc44735ce"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:46:44.540166 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-44f3f4de-be9c-4393-9983-a3807af545d7 req-17e0cb05-6476-4725-926c-e371cebe7499 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:44.540838 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-44f3f4de-be9c-4393-9983-a3807af545d7 req-17e0cb05-6476-4725-926c-e371cebe7499 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:44.555989 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-44f3f4de-be9c-4393-9983-a3807af545d7 req-17e0cb05-6476-4725-926c-e371cebe7499 service nova] Creating event network-vif-plugged:2d2e88bb-146c-40bb-b527-aa2cc44735ce for instance 401d7fb7-9947-43c3-b118-7bf2d00ad578 on n-h1-847009-3 Jul 19 23:46:44.561843 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-44f3f4de-be9c-4393-9983-a3807af545d7 req-17e0cb05-6476-4725-926c-e371cebe7499 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036878 Jul 19 23:46:44.562542 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3612/7232] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:46:44.634571 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f6c9afbc-8a58-4af9-bb1b-687d9c15e5c2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:44.642772 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f6c9afbc-8a58-4af9-bb1b-687d9c15e5c2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1688 microversion: 2.1 time: 0.186992 Jul 19 23:46:44.643401 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3621/7233] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:44 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1688 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:45.662357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-48e7582d-bab3-47ab-bb60-7744fa83dc6a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:45.663060 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-48e7582d-bab3-47ab-bb60-7744fa83dc6a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:45.669374 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48e7582d-bab3-47ab-bb60-7744fa83dc6a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:45.669964 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48e7582d-bab3-47ab-bb60-7744fa83dc6a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:45.670732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48e7582d-bab3-47ab-bb60-7744fa83dc6a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:45.671188 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-48e7582d-bab3-47ab-bb60-7744fa83dc6a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:45.811285 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-48e7582d-bab3-47ab-bb60-7744fa83dc6a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:45.819858 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-48e7582d-bab3-47ab-bb60-7744fa83dc6a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1688 microversion: 2.1 time: 0.162543 Jul 19 23:46:45.820959 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3613/7234] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:45 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:46.837812 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-49d753f7-4710-4e6a-8a2c-62c3c24a7cd2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:46:46.838450 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-49d753f7-4710-4e6a-8a2c-62c3c24a7cd2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:46:46.846032 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49d753f7-4710-4e6a-8a2c-62c3c24a7cd2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:46.846492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49d753f7-4710-4e6a-8a2c-62c3c24a7cd2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:46.847327 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49d753f7-4710-4e6a-8a2c-62c3c24a7cd2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:46:46.847779 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-49d753f7-4710-4e6a-8a2c-62c3c24a7cd2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:46:46.985235 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-49d753f7-4710-4e6a-8a2c-62c3c24a7cd2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:46:46.992751 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-49d753f7-4710-4e6a-8a2c-62c3c24a7cd2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1675 microversion: 2.1 time: 0.158870 Jul 19 23:46:46.993325 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3622/7235] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:46:46 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:46:57.396963 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:46:57.397616 n-d-847009-3 devstack@n-api.service[119337]: Tue Jul 19 23:46:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:48:03.945307 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=15 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:48:03.946788 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=43 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:48:03.947804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=13 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:48:03.948932 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=41 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:48:03.950725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-58cd4fe0-45a1-4adc-bbd3-c2c0b804735a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:48:03.951300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-58cd4fe0-45a1-4adc-bbd3-c2c0b804735a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:48:03.958797 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58cd4fe0-45a1-4adc-bbd3-c2c0b804735a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:03.959789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58cd4fe0-45a1-4adc-bbd3-c2c0b804735a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:03.960077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58cd4fe0-45a1-4adc-bbd3-c2c0b804735a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:03.960521 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-58cd4fe0-45a1-4adc-bbd3-c2c0b804735a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:03.993557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-58cd4fe0-45a1-4adc-bbd3-c2c0b804735a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:48:04.013800 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-b25546fa-847a-4fb2-9244-a728a6ae88be req-c7c84fb9-3e49-472e-9d1a-3c200f72b188 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "401d7fb7-9947-43c3-b118-7bf2d00ad578", "tag": "2d2e88bb-146c-40bb-b527-aa2cc44735ce"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:48:04.022649 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b25546fa-847a-4fb2-9244-a728a6ae88be req-c7c84fb9-3e49-472e-9d1a-3c200f72b188 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:04.023136 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-b25546fa-847a-4fb2-9244-a728a6ae88be req-c7c84fb9-3e49-472e-9d1a-3c200f72b188 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:04.034386 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-b25546fa-847a-4fb2-9244-a728a6ae88be req-c7c84fb9-3e49-472e-9d1a-3c200f72b188 service nova] Creating event network-changed:2d2e88bb-146c-40bb-b527-aa2cc44735ce for instance 401d7fb7-9947-43c3-b118-7bf2d00ad578 on n-h1-847009-3 Jul 19 23:48:04.041518 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-b25546fa-847a-4fb2-9244-a728a6ae88be req-c7c84fb9-3e49-472e-9d1a-3c200f72b188 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095621 Jul 19 23:48:04.042384 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3623/7236] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:48:04.082624 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-58cd4fe0-45a1-4adc-bbd3-c2c0b804735a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "DELETE /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 204 len: 0 microversion: 2.1 time: 0.139424 Jul 19 23:48:04.086862 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3614/7237] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:48:03 2022] DELETE /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:48:04.093914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b58e684a-c6d0-4d9b-b5cc-488d477cc2ea tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:48:04.093914 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b58e684a-c6d0-4d9b-b5cc-488d477cc2ea tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:48:04.100629 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b58e684a-c6d0-4d9b-b5cc-488d477cc2ea tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:04.101211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b58e684a-c6d0-4d9b-b5cc-488d477cc2ea tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:04.102251 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b58e684a-c6d0-4d9b-b5cc-488d477cc2ea tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:04.102782 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b58e684a-c6d0-4d9b-b5cc-488d477cc2ea tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:04.249302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b58e684a-c6d0-4d9b-b5cc-488d477cc2ea tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:48:04.257109 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b58e684a-c6d0-4d9b-b5cc-488d477cc2ea tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1681 microversion: 2.1 time: 0.169120 Jul 19 23:48:04.257875 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3624/7238] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:48:04 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:48:05.276055 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7b9025d5-238a-4802-a084-168f849e6553 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:48:05.276670 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7b9025d5-238a-4802-a084-168f849e6553 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:48:05.283936 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b9025d5-238a-4802-a084-168f849e6553 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:05.284391 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b9025d5-238a-4802-a084-168f849e6553 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:05.285166 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b9025d5-238a-4802-a084-168f849e6553 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:05.285635 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7b9025d5-238a-4802-a084-168f849e6553 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:05.484055 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7b9025d5-238a-4802-a084-168f849e6553 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:48:05.492472 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7b9025d5-238a-4802-a084-168f849e6553 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1681 microversion: 2.1 time: 0.220781 Jul 19 23:48:05.493054 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3615/7239] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:48:05 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1681 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:48:06.510181 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8723d0ca-87f3-4b2a-9d6b-f11a662e32e1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:48:06.510818 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8723d0ca-87f3-4b2a-9d6b-f11a662e32e1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:48:06.518608 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8723d0ca-87f3-4b2a-9d6b-f11a662e32e1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:06.519340 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8723d0ca-87f3-4b2a-9d6b-f11a662e32e1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:06.520160 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8723d0ca-87f3-4b2a-9d6b-f11a662e32e1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:06.520618 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8723d0ca-87f3-4b2a-9d6b-f11a662e32e1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:06.760722 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8723d0ca-87f3-4b2a-9d6b-f11a662e32e1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:48:06.768469 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8723d0ca-87f3-4b2a-9d6b-f11a662e32e1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 200 len: 1563 microversion: 2.1 time: 0.262190 Jul 19 23:48:06.769055 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3625/7240] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:48:06 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 1563 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:48:06.794846 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-f4013335-dc64-4c11-b176-e1104d48c007 req-84cb713c-d464-43ae-9689-158ecbab9ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "401d7fb7-9947-43c3-b118-7bf2d00ad578", "name": "network-vif-deleted", "tag": "2d2e88bb-146c-40bb-b527-aa2cc44735ce"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:48:06.805867 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f4013335-dc64-4c11-b176-e1104d48c007 req-84cb713c-d464-43ae-9689-158ecbab9ddd service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:06.806313 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-f4013335-dc64-4c11-b176-e1104d48c007 req-84cb713c-d464-43ae-9689-158ecbab9ddd service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:06.821070 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-f4013335-dc64-4c11-b176-e1104d48c007 req-84cb713c-d464-43ae-9689-158ecbab9ddd service nova] Creating event network-vif-deleted:2d2e88bb-146c-40bb-b527-aa2cc44735ce for instance 401d7fb7-9947-43c3-b118-7bf2d00ad578 on n-h1-847009-3 Jul 19 23:48:06.826937 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-f4013335-dc64-4c11-b176-e1104d48c007 req-84cb713c-d464-43ae-9689-158ecbab9ddd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036469 Jul 19 23:48:06.827644 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3616/7241] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:48:07.786625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9c4d385d-a6f8-4a5f-bb53-68ba3e42e806 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:48:07.787221 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-9c4d385d-a6f8-4a5f-bb53-68ba3e42e806 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: 401d7fb7-9947-43c3-b118-7bf2d00ad578] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:48:07.794173 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9c4d385d-a6f8-4a5f-bb53-68ba3e42e806 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:07.794641 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9c4d385d-a6f8-4a5f-bb53-68ba3e42e806 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:07.795467 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9c4d385d-a6f8-4a5f-bb53-68ba3e42e806 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:07.795922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-9c4d385d-a6f8-4a5f-bb53-68ba3e42e806 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:07.809073 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-9c4d385d-a6f8-4a5f-bb53-68ba3e42e806 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] HTTP exception thrown: Instance 401d7fb7-9947-43c3-b118-7bf2d00ad578 could not be found. Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9c4d385d-a6f8-4a5f-bb53-68ba3e42e806 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Request method failure captured: Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 HTTP/1.1 Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi10Gx8OPriwbnTdX7dqxIVv4Xaog0RRTXhEc4tr8pYGhKG7zFrTAYhKC9RcTTVPlDwuxILkvEQA6H2BeaHvUnS7ikuBieA7ZSdZQCOTcgIlrQT1piakxXSb0s97b3_gzmBCH29p3C9tt9IhmT9fXh708hIIu6QuJH9m-Nr3EhKtJLVLw Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 667e58901d514569a21cedcd4055538a Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-TestShelveInstance-1298509394 Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_667e58901d514569a21cedcd4055538a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/667e58901d514569a21cedcd4055538a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/667e58901d514569a21cedcd4055538a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/667e58901d514569a21cedcd4055538a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-TestShelveInstance-1298509394 Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 667e58901d514569a21cedcd4055538a Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-TestShelveInstance-1298509394 Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-TestShelveInstance-1298509394-project Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 9df24f256f744c569f0b238b79c71e5f Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-TestShelveInstance-1298509394-project Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 401d7fb7-9947-43c3-b118-7bf2d00ad578 could not be found. Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '401d7fb7-9947-43c3-b118-7bf2d00ad578'} Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 401d7fb7-9947-43c3-b118-7bf2d00ad578 could not be found. Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 401d7fb7-9947-43c3-b118-7bf2d00ad578 could not be found. Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:48:07.810730 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:48:07.816425 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:48:07.816425 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:48:07.816425 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:48:07.816425 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:48:07.816425 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:48:07.816425 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 401d7fb7-9947-43c3-b118-7bf2d00ad578 could not be found. Jul 19 23:48:07.816425 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:48:07.816425 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-9c4d385d-a6f8-4a5f-bb53-68ba3e42e806 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Returning 404 to user: Instance 401d7fb7-9947-43c3-b118-7bf2d00ad578 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:48:07.816425 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-9c4d385d-a6f8-4a5f-bb53-68ba3e42e806 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578" status: 404 len: 111 microversion: 2.1 time: 0.029654 Jul 19 23:48:07.817126 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3626/7242] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:48:07 2022] GET /compute/v2.1/servers/401d7fb7-9947-43c3-b118-7bf2d00ad578 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:48:07.984819 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1cc37032-6fc2-4b6e-bed7-a972b9600842 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '.version_select at 0x7f7a1554e700>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:48:08.012711 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1cc37032-6fc2-4b6e-bed7-a972b9600842 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-934416640" status: 202 len: 0 microversion: 2.1 time: 0.032892 Jul 19 23:48:08.013316 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3617/7243] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 19 23:48:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-934416640 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:48:08.035595 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b29c85cf-14cc-4001-bb69-0bb26eeb6305 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Action: 'create', calling method: .version_select at 0x7f7a02f3f790>, body: {"keypair": {"name": "tempest-TestShelveInstance-1174861797", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLP2s0NKdh39IOo+QWGrX8eM//TfZFGpCIgPIIO+PSi779yQwh/NuPT0IlKQeLYWHIp/5qkdMrikonjhrkR5/h+8/jcBJuIEX/wxXCIXs06c14OCda061v/tkEle6R0eYQ=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:48:08.049631 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-b29c85cf-14cc-4001-bb69-0bb26eeb6305 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Getting quotas for project 667e58901d514569a21cedcd4055538a. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:48:08.054614 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-b29c85cf-14cc-4001-bb69-0bb26eeb6305 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Getting quotas for user 9df24f256f744c569f0b238b79c71e5f and project 667e58901d514569a21cedcd4055538a. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:48:08.083402 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b29c85cf-14cc-4001-bb69-0bb26eeb6305 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.051816 Jul 19 23:48:08.084017 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3627/7244] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 23:48:08 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:48:24.181552 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:48:24.182330 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:48:24.187513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-96108d60-f903-477d-b455-487269a67c8b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1505444307", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1174861797", "security_groups": [{"name": "tempest-secgroup-smoke-2045505193"}], "networks": [{"uuid": "7787910c-1843-4e77-95e1-32205e98bfa8"}], "block_device_mapping_v2": [{"uuid": "08cafa62-0e15-4ef2-818b-4e30dc815aa7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:48:24.304171 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-96108d60-f903-477d-b455-487269a67c8b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] validate_networks() for [('7787910c-1843-4e77-95e1-32205e98bfa8', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:48:24.724071 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-96108d60-f903-477d-b455-487269a67c8b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:48:24.724496 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-96108d60-f903-477d-b455-487269a67c8b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:48:24.724974 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-96108d60-f903-477d-b455-487269a67c8b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:48:24.725384 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-96108d60-f903-477d-b455-487269a67c8b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:48:24.725799 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-96108d60-f903-477d-b455-487269a67c8b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:48:24.734682 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96108d60-f903-477d-b455-487269a67c8b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:24.735772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96108d60-f903-477d-b455-487269a67c8b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:24.736571 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96108d60-f903-477d-b455-487269a67c8b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:24.737005 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-96108d60-f903-477d-b455-487269a67c8b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:24.755221 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-96108d60-f903-477d-b455-487269a67c8b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Getting quotas for project 667e58901d514569a21cedcd4055538a. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:48:24.760515 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-96108d60-f903-477d-b455-487269a67c8b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Getting quotas for user 9df24f256f744c569f0b238b79c71e5f and project 667e58901d514569a21cedcd4055538a. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:48:24.821373 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-96108d60-f903-477d-b455-487269a67c8b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:48:24.823617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-96108d60-f903-477d-b455-487269a67c8b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='08cafa62-0e15-4ef2-818b-4e30dc815aa7',volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:48:24.960017 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-96108d60-f903-477d-b455-487269a67c8b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.780088 Jul 19 23:48:24.965702 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3618/7245] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:48:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:48:24.968829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=16 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:48:24.971738 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=4 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:48:24.972971 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:48:24.977499 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-3cf90683-6c36-4028-9939-8e67185cfe95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:48:24.978225 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-3cf90683-6c36-4028-9939-8e67185cfe95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:48:25.041672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-3cf90683-6c36-4028-9939-8e67185cfe95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:48:25.049686 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-3cf90683-6c36-4028-9939-8e67185cfe95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1089 microversion: 2.1 time: 0.082465 Jul 19 23:48:25.057033 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3628/7246] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:48:24 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1089 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:48:26.072920 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-865c296c-7aff-4e5b-9803-695c547ef2d0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:48:26.073548 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-865c296c-7aff-4e5b-9803-695c547ef2d0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:48:26.082513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-865c296c-7aff-4e5b-9803-695c547ef2d0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:26.082967 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-865c296c-7aff-4e5b-9803-695c547ef2d0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:26.083793 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-865c296c-7aff-4e5b-9803-695c547ef2d0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:26.084340 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-865c296c-7aff-4e5b-9803-695c547ef2d0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:26.150913 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-865c296c-7aff-4e5b-9803-695c547ef2d0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:48:26.160734 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-865c296c-7aff-4e5b-9803-695c547ef2d0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1205 microversion: 2.1 time: 0.093875 Jul 19 23:48:26.161529 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3619/7247] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:48:26 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1205 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:48:27.179367 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b7c9c670-0682-4ca2-a868-420a85bd6d54 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:48:27.180556 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b7c9c670-0682-4ca2-a868-420a85bd6d54 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:48:27.187750 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7c9c670-0682-4ca2-a868-420a85bd6d54 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:27.189022 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7c9c670-0682-4ca2-a868-420a85bd6d54 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:27.190182 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7c9c670-0682-4ca2-a868-420a85bd6d54 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:27.190813 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b7c9c670-0682-4ca2-a868-420a85bd6d54 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:27.374824 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b7c9c670-0682-4ca2-a868-420a85bd6d54 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:48:27.384072 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b7c9c670-0682-4ca2-a868-420a85bd6d54 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1273 microversion: 2.1 time: 0.209473 Jul 19 23:48:27.385371 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3629/7248] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:48:27 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1273 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:48:27.423041 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-7c0d7f51-781e-431a-a183-1c091151489c req-f08f05a5-798d-4938-89ac-1d4b6a49ace9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7d95a7f-6fa1-44ee-9f02-0f39852da011", "tag": "21b370d3-62ee-4c40-99f9-6093a857fa5e"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:48:27.435341 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7c0d7f51-781e-431a-a183-1c091151489c req-f08f05a5-798d-4938-89ac-1d4b6a49ace9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:27.435793 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-7c0d7f51-781e-431a-a183-1c091151489c req-f08f05a5-798d-4938-89ac-1d4b6a49ace9 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:27.458019 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-7c0d7f51-781e-431a-a183-1c091151489c req-f08f05a5-798d-4938-89ac-1d4b6a49ace9 service nova] Creating event network-changed:21b370d3-62ee-4c40-99f9-6093a857fa5e for instance b7d95a7f-6fa1-44ee-9f02-0f39852da011 on n-h2-847009-3 Jul 19 23:48:27.465596 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-7c0d7f51-781e-431a-a183-1c091151489c req-f08f05a5-798d-4938-89ac-1d4b6a49ace9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046878 Jul 19 23:48:27.466758 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3620/7249] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:48:28.401538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-a0068d59-53ee-41c3-9051-6708ef7a6360 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:48:28.402176 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-a0068d59-53ee-41c3-9051-6708ef7a6360 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:48:28.410684 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0068d59-53ee-41c3-9051-6708ef7a6360 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:28.411452 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0068d59-53ee-41c3-9051-6708ef7a6360 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:28.412262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0068d59-53ee-41c3-9051-6708ef7a6360 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:28.412741 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-a0068d59-53ee-41c3-9051-6708ef7a6360 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:28.556881 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-a0068d59-53ee-41c3-9051-6708ef7a6360 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:48:28.566068 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-a0068d59-53ee-41c3-9051-6708ef7a6360 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1273 microversion: 2.1 time: 0.168578 Jul 19 23:48:28.566645 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3630/7250] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:48:28 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1273 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:48:29.585204 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-762512c4-33ae-4746-817d-b0ba8bfcd2b8 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:48:29.586027 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-762512c4-33ae-4746-817d-b0ba8bfcd2b8 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:48:29.592606 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-762512c4-33ae-4746-817d-b0ba8bfcd2b8 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:29.593062 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-762512c4-33ae-4746-817d-b0ba8bfcd2b8 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:29.593852 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-762512c4-33ae-4746-817d-b0ba8bfcd2b8 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:29.594922 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-762512c4-33ae-4746-817d-b0ba8bfcd2b8 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:29.733408 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-762512c4-33ae-4746-817d-b0ba8bfcd2b8 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:48:29.743074 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-762512c4-33ae-4746-817d-b0ba8bfcd2b8 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1273 microversion: 2.1 time: 0.163002 Jul 19 23:48:29.745954 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3621/7251] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:48:29 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:48:30.760347 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-810c0019-412f-4dad-8ff7-861435b6fc31 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:48:30.760981 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-810c0019-412f-4dad-8ff7-861435b6fc31 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:48:30.768993 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-810c0019-412f-4dad-8ff7-861435b6fc31 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:30.769462 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-810c0019-412f-4dad-8ff7-861435b6fc31 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:30.770252 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-810c0019-412f-4dad-8ff7-861435b6fc31 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:30.770737 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-810c0019-412f-4dad-8ff7-861435b6fc31 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:30.918283 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-810c0019-412f-4dad-8ff7-861435b6fc31 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:48:30.926332 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-810c0019-412f-4dad-8ff7-861435b6fc31 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1273 microversion: 2.1 time: 0.169793 Jul 19 23:48:30.927233 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3631/7252] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:48:30 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1273 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:48:31.943663 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-523eaa6c-5f7a-427a-bcd0-c953eb78ee97 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:48:31.944206 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-523eaa6c-5f7a-427a-bcd0-c953eb78ee97 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:48:31.951153 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-523eaa6c-5f7a-427a-bcd0-c953eb78ee97 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:31.951615 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-523eaa6c-5f7a-427a-bcd0-c953eb78ee97 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:31.952398 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-523eaa6c-5f7a-427a-bcd0-c953eb78ee97 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:31.952841 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-523eaa6c-5f7a-427a-bcd0-c953eb78ee97 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:32.086137 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-523eaa6c-5f7a-427a-bcd0-c953eb78ee97 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:48:32.095592 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-523eaa6c-5f7a-427a-bcd0-c953eb78ee97 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1261 microversion: 2.1 time: 0.156234 Jul 19 23:48:32.096173 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3622/7253] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:48:31 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:48:33.114522 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e6d7b9d4-1f8c-4cda-b2b9-c5e56507eee1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:48:33.115179 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e6d7b9d4-1f8c-4cda-b2b9-c5e56507eee1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:48:33.122054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6d7b9d4-1f8c-4cda-b2b9-c5e56507eee1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:33.122508 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6d7b9d4-1f8c-4cda-b2b9-c5e56507eee1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:33.123339 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6d7b9d4-1f8c-4cda-b2b9-c5e56507eee1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:33.123796 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e6d7b9d4-1f8c-4cda-b2b9-c5e56507eee1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:33.253609 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e6d7b9d4-1f8c-4cda-b2b9-c5e56507eee1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:48:33.261144 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e6d7b9d4-1f8c-4cda-b2b9-c5e56507eee1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1261 microversion: 2.1 time: 0.152266 Jul 19 23:48:33.261721 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3632/7254] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:48:33 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:48:34.278582 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-77d8e094-1aa0-44fe-98c0-0397607d24a8 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:48:34.279227 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-77d8e094-1aa0-44fe-98c0-0397607d24a8 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:48:34.286300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-77d8e094-1aa0-44fe-98c0-0397607d24a8 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:34.286778 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-77d8e094-1aa0-44fe-98c0-0397607d24a8 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:34.287803 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-77d8e094-1aa0-44fe-98c0-0397607d24a8 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:34.288302 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-77d8e094-1aa0-44fe-98c0-0397607d24a8 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:34.423917 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-77d8e094-1aa0-44fe-98c0-0397607d24a8 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:48:34.431556 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-77d8e094-1aa0-44fe-98c0-0397607d24a8 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1261 microversion: 2.1 time: 0.157008 Jul 19 23:48:34.432131 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3623/7255] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:48:34 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:48:35.450155 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b632f718-6644-46d3-823f-7534563f7004 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:48:35.450710 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b632f718-6644-46d3-823f-7534563f7004 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:48:35.453494 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:48:35.460606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b632f718-6644-46d3-823f-7534563f7004 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:35.461068 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b632f718-6644-46d3-823f-7534563f7004 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:35.461853 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b632f718-6644-46d3-823f-7534563f7004 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:35.462303 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b632f718-6644-46d3-823f-7534563f7004 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:35.604063 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b632f718-6644-46d3-823f-7534563f7004 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:48:35.612944 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b632f718-6644-46d3-823f-7534563f7004 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1261 microversion: 2.1 time: 0.167210 Jul 19 23:48:35.613526 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3633/7256] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:48:35 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:48:36.629995 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a5834e98-f16a-49af-9487-8afa90b31b93 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:48:36.630614 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a5834e98-f16a-49af-9487-8afa90b31b93 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:48:36.633568 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:48:36.634711 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:48:36.645279 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a5834e98-f16a-49af-9487-8afa90b31b93 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:36.645750 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a5834e98-f16a-49af-9487-8afa90b31b93 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:36.646528 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a5834e98-f16a-49af-9487-8afa90b31b93 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:36.646965 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a5834e98-f16a-49af-9487-8afa90b31b93 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:36.803512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a5834e98-f16a-49af-9487-8afa90b31b93 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:48:36.811750 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a5834e98-f16a-49af-9487-8afa90b31b93 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1261 microversion: 2.1 time: 0.185668 Jul 19 23:48:36.812347 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3624/7257] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:48:36 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1261 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:48:37.828827 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5642264c-99dc-4904-b1cb-51cf3e89f9da tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:48:37.829538 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5642264c-99dc-4904-b1cb-51cf3e89f9da tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:48:37.836606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5642264c-99dc-4904-b1cb-51cf3e89f9da tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:37.837071 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5642264c-99dc-4904-b1cb-51cf3e89f9da tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:37.837848 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5642264c-99dc-4904-b1cb-51cf3e89f9da tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:37.838332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5642264c-99dc-4904-b1cb-51cf3e89f9da tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:37.969067 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5642264c-99dc-4904-b1cb-51cf3e89f9da tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:48:37.977342 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5642264c-99dc-4904-b1cb-51cf3e89f9da tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1261 microversion: 2.1 time: 0.152437 Jul 19 23:48:37.977912 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3634/7258] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:48:37 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:48:38.994415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-34374ac4-bf10-4ec7-82fa-b01b7b964540 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:48:38.995035 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-34374ac4-bf10-4ec7-82fa-b01b7b964540 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:48:39.002743 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-34374ac4-bf10-4ec7-82fa-b01b7b964540 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:39.003222 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-34374ac4-bf10-4ec7-82fa-b01b7b964540 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:39.004022 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-34374ac4-bf10-4ec7-82fa-b01b7b964540 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:39.004447 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-34374ac4-bf10-4ec7-82fa-b01b7b964540 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:39.137075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-34374ac4-bf10-4ec7-82fa-b01b7b964540 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:48:39.144790 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-34374ac4-bf10-4ec7-82fa-b01b7b964540 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1261 microversion: 2.1 time: 0.154306 Jul 19 23:48:39.145368 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3625/7259] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:48:38 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:48:40.162082 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8ccd88d3-310e-43f7-b345-277cb3e17ea0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:48:40.162720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8ccd88d3-310e-43f7-b345-277cb3e17ea0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:48:40.169691 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8ccd88d3-310e-43f7-b345-277cb3e17ea0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:40.170151 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8ccd88d3-310e-43f7-b345-277cb3e17ea0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:40.170915 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8ccd88d3-310e-43f7-b345-277cb3e17ea0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:40.171394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8ccd88d3-310e-43f7-b345-277cb3e17ea0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:40.655901 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8ccd88d3-310e-43f7-b345-277cb3e17ea0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:48:40.664067 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8ccd88d3-310e-43f7-b345-277cb3e17ea0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1261 microversion: 2.1 time: 0.506187 Jul 19 23:48:40.664655 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3635/7260] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:48:40 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1261 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:48:41.680182 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-e0db1714-6bca-45bc-b963-c5db507fee9d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:48:41.680794 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-e0db1714-6bca-45bc-b963-c5db507fee9d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:48:41.687789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e0db1714-6bca-45bc-b963-c5db507fee9d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:41.688237 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e0db1714-6bca-45bc-b963-c5db507fee9d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:41.689002 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e0db1714-6bca-45bc-b963-c5db507fee9d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:41.689971 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-e0db1714-6bca-45bc-b963-c5db507fee9d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:41.823509 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-e0db1714-6bca-45bc-b963-c5db507fee9d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:48:41.831945 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-e0db1714-6bca-45bc-b963-c5db507fee9d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1261 microversion: 2.1 time: 0.155691 Jul 19 23:48:41.832522 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3626/7261] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:48:41 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:48:42.591909 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-af011039-6c6c-4743-916c-f646d5d6117e req-0cff8011-1ac8-4348-a70f-3fbf782913d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d95a7f-6fa1-44ee-9f02-0f39852da011", "name": "network-vif-plugged", "status": "completed", "tag": "21b370d3-62ee-4c40-99f9-6093a857fa5e"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:48:42.602215 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-af011039-6c6c-4743-916c-f646d5d6117e req-0cff8011-1ac8-4348-a70f-3fbf782913d6 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:42.602778 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-af011039-6c6c-4743-916c-f646d5d6117e req-0cff8011-1ac8-4348-a70f-3fbf782913d6 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:42.616963 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-af011039-6c6c-4743-916c-f646d5d6117e req-0cff8011-1ac8-4348-a70f-3fbf782913d6 service nova] Creating event network-vif-plugged:21b370d3-62ee-4c40-99f9-6093a857fa5e for instance b7d95a7f-6fa1-44ee-9f02-0f39852da011 on n-h2-847009-3 Jul 19 23:48:42.628264 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-af011039-6c6c-4743-916c-f646d5d6117e req-0cff8011-1ac8-4348-a70f-3fbf782913d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033851 Jul 19 23:48:42.628264 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3636/7262] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:48:42.849485 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4f4f92d3-7431-41c9-8fb7-d7d0ae560b98 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:48:42.850137 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4f4f92d3-7431-41c9-8fb7-d7d0ae560b98 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:48:42.857207 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f4f92d3-7431-41c9-8fb7-d7d0ae560b98 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:42.857661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f4f92d3-7431-41c9-8fb7-d7d0ae560b98 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:42.858427 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f4f92d3-7431-41c9-8fb7-d7d0ae560b98 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:42.858863 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4f4f92d3-7431-41c9-8fb7-d7d0ae560b98 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:43.003618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4f4f92d3-7431-41c9-8fb7-d7d0ae560b98 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:48:43.011484 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4f4f92d3-7431-41c9-8fb7-d7d0ae560b98 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1261 microversion: 2.1 time: 0.166500 Jul 19 23:48:43.012075 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3627/7263] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:48:42 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:48:44.031046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c1efc89e-f25d-4603-ba4f-aff8238b6796 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:48:44.031748 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c1efc89e-f25d-4603-ba4f-aff8238b6796 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:48:44.038701 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c1efc89e-f25d-4603-ba4f-aff8238b6796 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:44.039196 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c1efc89e-f25d-4603-ba4f-aff8238b6796 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:44.039985 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c1efc89e-f25d-4603-ba4f-aff8238b6796 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:44.040443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c1efc89e-f25d-4603-ba4f-aff8238b6796 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:44.172770 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c1efc89e-f25d-4603-ba4f-aff8238b6796 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:48:44.181085 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c1efc89e-f25d-4603-ba4f-aff8238b6796 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1445 microversion: 2.1 time: 0.155459 Jul 19 23:48:44.181661 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3637/7264] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:48:44 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1445 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:48:44.198592 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7a8dbf4f-68a8-4a70-8c9a-ea02dfa891f1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:48:44.199236 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7a8dbf4f-68a8-4a70-8c9a-ea02dfa891f1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:48:44.206696 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a8dbf4f-68a8-4a70-8c9a-ea02dfa891f1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:44.207241 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a8dbf4f-68a8-4a70-8c9a-ea02dfa891f1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:44.208013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a8dbf4f-68a8-4a70-8c9a-ea02dfa891f1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:44.208454 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7a8dbf4f-68a8-4a70-8c9a-ea02dfa891f1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:44.344374 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7a8dbf4f-68a8-4a70-8c9a-ea02dfa891f1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:48:44.352112 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7a8dbf4f-68a8-4a70-8c9a-ea02dfa891f1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1445 microversion: 2.1 time: 0.157414 Jul 19 23:48:44.352683 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3628/7265] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:48:44 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1445 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:48:45.961793 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-1fad85f8-c16a-4d58-a73d-add57b601f0e req-bf235498-4d78-4142-b723-5364da7ca06f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7d95a7f-6fa1-44ee-9f02-0f39852da011", "tag": "21b370d3-62ee-4c40-99f9-6093a857fa5e"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:48:45.971011 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1fad85f8-c16a-4d58-a73d-add57b601f0e req-bf235498-4d78-4142-b723-5364da7ca06f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:48:45.971299 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1fad85f8-c16a-4d58-a73d-add57b601f0e req-bf235498-4d78-4142-b723-5364da7ca06f service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:48:45.984786 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-1fad85f8-c16a-4d58-a73d-add57b601f0e req-bf235498-4d78-4142-b723-5364da7ca06f service nova] Creating event network-changed:21b370d3-62ee-4c40-99f9-6093a857fa5e for instance b7d95a7f-6fa1-44ee-9f02-0f39852da011 on n-h2-847009-3 Jul 19 23:48:45.990436 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-1fad85f8-c16a-4d58-a73d-add57b601f0e req-bf235498-4d78-4142-b723-5364da7ca06f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032264 Jul 19 23:48:45.991042 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3638/7266] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:49:56.415734 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:49:56.415734 n-d-847009-3 devstack@n-api.service[119337]: Tue Jul 19 23:49:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:50:43.682702 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:50:43.683473 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=58 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:50:43.741928 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b94edf5a-a671-4a95-aa50-f62132ae6177 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:50:43.742466 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b94edf5a-a671-4a95-aa50-f62132ae6177 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:50:43.748589 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b94edf5a-a671-4a95-aa50-f62132ae6177 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:43.749552 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b94edf5a-a671-4a95-aa50-f62132ae6177 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:43.750439 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b94edf5a-a671-4a95-aa50-f62132ae6177 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:43.750953 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b94edf5a-a671-4a95-aa50-f62132ae6177 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:43.774269 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-b94edf5a-a671-4a95-aa50-f62132ae6177 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lazy-loading 'flavor' on Instance uuid b7d95a7f-6fa1-44ee-9f02-0f39852da011 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:50:43.853797 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b94edf5a-a671-4a95-aa50-f62132ae6177 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "POST /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011/action" status: 202 len: 0 microversion: 2.1 time: 0.172646 Jul 19 23:50:43.857597 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3629/7267] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:50:43 2022] POST /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:50:43.863770 n-d-847009-3 devstack@n-api.service[119337]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4d9f90d1-6e88-4978-b2b1-8e2a2dbb4cb7] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 19 23:50:43.865736 n-d-847009-3 devstack@n-api.service[119337]: ERROR oslo.messaging._drivers.impl_rabbit [-] [798b565c-2a51-4094-a95e-de275b58674b] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 19 23:50:43.866371 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=24 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:50:43.867149 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=52 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:50:43.871738 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-ae278d5c-85ca-4849-971f-12fa82a4d618 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:50:43.872458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-ae278d5c-85ca-4849-971f-12fa82a4d618 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:50:43.881346 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae278d5c-85ca-4849-971f-12fa82a4d618 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:43.881810 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae278d5c-85ca-4849-971f-12fa82a4d618 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:43.882590 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae278d5c-85ca-4849-971f-12fa82a4d618 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:43.883037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-ae278d5c-85ca-4849-971f-12fa82a4d618 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:44.073150 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-ae278d5c-85ca-4849-971f-12fa82a4d618 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:50:44.081509 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-ae278d5c-85ca-4849-971f-12fa82a4d618 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1569 microversion: 2.1 time: 0.221947 Jul 19 23:50:44.082071 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3639/7268] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:50:43 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1569 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:50:45.101050 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-98ae288e-ba73-4d70-8714-25bd6aa8a8ba tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:50:45.101756 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-98ae288e-ba73-4d70-8714-25bd6aa8a8ba tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:50:45.108139 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-98ae288e-ba73-4d70-8714-25bd6aa8a8ba tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:45.108714 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-98ae288e-ba73-4d70-8714-25bd6aa8a8ba tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:45.109633 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-98ae288e-ba73-4d70-8714-25bd6aa8a8ba tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:45.110076 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-98ae288e-ba73-4d70-8714-25bd6aa8a8ba tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:45.289827 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-98ae288e-ba73-4d70-8714-25bd6aa8a8ba tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:50:45.301674 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-98ae288e-ba73-4d70-8714-25bd6aa8a8ba tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1569 microversion: 2.1 time: 0.205951 Jul 19 23:50:45.302256 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3630/7269] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:50:45 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1569 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:50:46.319147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-bde5343b-339a-42de-a9aa-74b768677fca tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:50:46.319782 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-bde5343b-339a-42de-a9aa-74b768677fca tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:50:46.337164 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] [4d9f90d1-6e88-4978-b2b1-8e2a2dbb4cb7] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 40050. Jul 19 23:50:46.337894 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] [798b565c-2a51-4094-a95e-de275b58674b] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 40052. Jul 19 23:50:46.339430 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bde5343b-339a-42de-a9aa-74b768677fca tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:46.339897 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bde5343b-339a-42de-a9aa-74b768677fca tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:46.340686 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bde5343b-339a-42de-a9aa-74b768677fca tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:46.341142 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-bde5343b-339a-42de-a9aa-74b768677fca tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:46.478406 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-bde5343b-339a-42de-a9aa-74b768677fca tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:50:46.486928 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-bde5343b-339a-42de-a9aa-74b768677fca tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1569 microversion: 2.1 time: 0.171952 Jul 19 23:50:46.487524 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3640/7270] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:50:46 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:50:47.504345 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9aa8b754-4526-491d-a8a1-d4500f0b041d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:50:47.505219 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9aa8b754-4526-491d-a8a1-d4500f0b041d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:50:47.514840 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9aa8b754-4526-491d-a8a1-d4500f0b041d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:47.515338 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9aa8b754-4526-491d-a8a1-d4500f0b041d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:47.516114 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9aa8b754-4526-491d-a8a1-d4500f0b041d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:47.516549 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9aa8b754-4526-491d-a8a1-d4500f0b041d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:47.648869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9aa8b754-4526-491d-a8a1-d4500f0b041d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:50:47.657031 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9aa8b754-4526-491d-a8a1-d4500f0b041d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1569 microversion: 2.1 time: 0.156958 Jul 19 23:50:47.657609 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3631/7271] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:50:47 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:50:48.674525 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f3312556-556d-433a-8d7b-312ae31f361d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:50:48.675068 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f3312556-556d-433a-8d7b-312ae31f361d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:50:48.683211 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3312556-556d-433a-8d7b-312ae31f361d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:48.683672 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3312556-556d-433a-8d7b-312ae31f361d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:48.684445 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3312556-556d-433a-8d7b-312ae31f361d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:48.684890 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f3312556-556d-433a-8d7b-312ae31f361d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:48.823804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f3312556-556d-433a-8d7b-312ae31f361d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:50:48.831485 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f3312556-556d-433a-8d7b-312ae31f361d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1569 microversion: 2.1 time: 0.161640 Jul 19 23:50:48.832050 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3641/7272] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:50:48 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:50:49.849482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1ad763db-932d-48f3-a0db-14bf3e3776f7 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:50:49.849482 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1ad763db-932d-48f3-a0db-14bf3e3776f7 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:50:49.856380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1ad763db-932d-48f3-a0db-14bf3e3776f7 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:49.856831 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1ad763db-932d-48f3-a0db-14bf3e3776f7 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:49.857647 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1ad763db-932d-48f3-a0db-14bf3e3776f7 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:49.858086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1ad763db-932d-48f3-a0db-14bf3e3776f7 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:49.991892 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-1ad763db-932d-48f3-a0db-14bf3e3776f7 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:50:50.000581 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1ad763db-932d-48f3-a0db-14bf3e3776f7 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1569 microversion: 2.1 time: 0.155792 Jul 19 23:50:50.001158 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3632/7273] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:50:49 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:50:51.018919 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2be416b8-42d8-47c4-8c1a-7a5ca7de1b54 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:50:51.019948 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2be416b8-42d8-47c4-8c1a-7a5ca7de1b54 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:50:51.028874 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2be416b8-42d8-47c4-8c1a-7a5ca7de1b54 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:51.029332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2be416b8-42d8-47c4-8c1a-7a5ca7de1b54 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:51.030786 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2be416b8-42d8-47c4-8c1a-7a5ca7de1b54 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:51.031284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2be416b8-42d8-47c4-8c1a-7a5ca7de1b54 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:51.181774 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2be416b8-42d8-47c4-8c1a-7a5ca7de1b54 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:50:51.191263 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2be416b8-42d8-47c4-8c1a-7a5ca7de1b54 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1569 microversion: 2.1 time: 0.177114 Jul 19 23:50:51.191835 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3642/7274] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:50:51 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:50:52.209352 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-8e5574b6-55c3-446c-8538-7bf5a7f7e8c0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:50:52.209977 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-8e5574b6-55c3-446c-8538-7bf5a7f7e8c0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:50:52.216992 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8e5574b6-55c3-446c-8538-7bf5a7f7e8c0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:52.217460 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8e5574b6-55c3-446c-8538-7bf5a7f7e8c0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:52.218251 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8e5574b6-55c3-446c-8538-7bf5a7f7e8c0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:52.218695 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-8e5574b6-55c3-446c-8538-7bf5a7f7e8c0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:52.354052 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-8e5574b6-55c3-446c-8538-7bf5a7f7e8c0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:50:52.362308 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-8e5574b6-55c3-446c-8538-7bf5a7f7e8c0 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1569 microversion: 2.1 time: 0.156929 Jul 19 23:50:52.362884 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3633/7275] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:50:52 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:50:53.379752 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cd2eba4e-fdba-49ca-8555-c274289c607d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:50:53.380386 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-cd2eba4e-fdba-49ca-8555-c274289c607d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:50:53.387270 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd2eba4e-fdba-49ca-8555-c274289c607d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:53.387729 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd2eba4e-fdba-49ca-8555-c274289c607d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:53.388496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd2eba4e-fdba-49ca-8555-c274289c607d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:53.388943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-cd2eba4e-fdba-49ca-8555-c274289c607d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:53.519556 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-cd2eba4e-fdba-49ca-8555-c274289c607d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:50:53.527076 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cd2eba4e-fdba-49ca-8555-c274289c607d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1569 microversion: 2.1 time: 0.151266 Jul 19 23:50:53.527659 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3643/7276] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:50:53 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:50:54.544392 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-fbfb8297-e0e7-4336-acb8-d6eb04ff2485 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:50:54.545014 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-fbfb8297-e0e7-4336-acb8-d6eb04ff2485 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:50:54.555705 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fbfb8297-e0e7-4336-acb8-d6eb04ff2485 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:54.556152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fbfb8297-e0e7-4336-acb8-d6eb04ff2485 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:54.556959 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fbfb8297-e0e7-4336-acb8-d6eb04ff2485 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:54.557393 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-fbfb8297-e0e7-4336-acb8-d6eb04ff2485 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:54.700520 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-fbfb8297-e0e7-4336-acb8-d6eb04ff2485 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:50:54.709058 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-fbfb8297-e0e7-4336-acb8-d6eb04ff2485 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1569 microversion: 2.1 time: 0.168508 Jul 19 23:50:54.709645 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3634/7277] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:50:54 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:50:55.725922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-af6b26a9-13b2-474a-8bcb-ddd528cb45e3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:50:55.726584 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-af6b26a9-13b2-474a-8bcb-ddd528cb45e3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:50:55.734470 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af6b26a9-13b2-474a-8bcb-ddd528cb45e3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:55.735084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af6b26a9-13b2-474a-8bcb-ddd528cb45e3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:55.736392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af6b26a9-13b2-474a-8bcb-ddd528cb45e3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:55.736392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-af6b26a9-13b2-474a-8bcb-ddd528cb45e3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:55.889351 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-af6b26a9-13b2-474a-8bcb-ddd528cb45e3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:50:55.898381 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-af6b26a9-13b2-474a-8bcb-ddd528cb45e3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1569 microversion: 2.1 time: 0.176435 Jul 19 23:50:55.898951 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3644/7278] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:50:55 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:50:56.917030 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-6cb2fecd-5f4e-4176-a5b9-b6e5b28b2946 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:50:56.917653 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-6cb2fecd-5f4e-4176-a5b9-b6e5b28b2946 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:50:56.925742 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6cb2fecd-5f4e-4176-a5b9-b6e5b28b2946 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:56.926194 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6cb2fecd-5f4e-4176-a5b9-b6e5b28b2946 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:56.926972 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6cb2fecd-5f4e-4176-a5b9-b6e5b28b2946 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:56.927439 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-6cb2fecd-5f4e-4176-a5b9-b6e5b28b2946 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:57.066545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-6cb2fecd-5f4e-4176-a5b9-b6e5b28b2946 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:50:57.079434 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-6cb2fecd-5f4e-4176-a5b9-b6e5b28b2946 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1569 microversion: 2.1 time: 0.166153 Jul 19 23:50:57.080030 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3635/7279] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:50:56 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:50:58.097261 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b129a9ce-7d57-48e1-9c65-593f3bb80f95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:50:58.097904 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b129a9ce-7d57-48e1-9c65-593f3bb80f95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:50:58.105108 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b129a9ce-7d57-48e1-9c65-593f3bb80f95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:58.105562 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b129a9ce-7d57-48e1-9c65-593f3bb80f95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:58.106358 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b129a9ce-7d57-48e1-9c65-593f3bb80f95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:58.106812 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b129a9ce-7d57-48e1-9c65-593f3bb80f95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:58.246492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b129a9ce-7d57-48e1-9c65-593f3bb80f95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:50:58.254428 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b129a9ce-7d57-48e1-9c65-593f3bb80f95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1570 microversion: 2.1 time: 0.161073 Jul 19 23:50:58.255004 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3645/7280] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:50:58 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:50:58.271154 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-1aeccc63-d963-46cf-b0d0-dd361a696a09 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:50:58.271725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-1aeccc63-d963-46cf-b0d0-dd361a696a09 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:50:58.286059 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1aeccc63-d963-46cf-b0d0-dd361a696a09 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:58.286557 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1aeccc63-d963-46cf-b0d0-dd361a696a09 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:58.287732 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1aeccc63-d963-46cf-b0d0-dd361a696a09 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:58.288170 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-1aeccc63-d963-46cf-b0d0-dd361a696a09 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:58.364249 n-d-847009-3 devstack@n-api.service[119338]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1aeccc63-d963-46cf-b0d0-dd361a696a09 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [e885b08f-a38d-4663-aa03-4b9b970f7884] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 23:50:59.175293 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-c11f582e-fd47-4791-aeec-066589f302ff req-ab78b5dc-1ec7-4bc8-aad5-6b1bc21c8e5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d95a7f-6fa1-44ee-9f02-0f39852da011", "name": "network-vif-unplugged", "status": "completed", "tag": "21b370d3-62ee-4c40-99f9-6093a857fa5e"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:50:59.184494 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-c11f582e-fd47-4791-aeec-066589f302ff req-ab78b5dc-1ec7-4bc8-aad5-6b1bc21c8e5b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:59.185083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-c11f582e-fd47-4791-aeec-066589f302ff req-ab78b5dc-1ec7-4bc8-aad5-6b1bc21c8e5b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:59.198321 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.compute.server_external_events [req-c11f582e-fd47-4791-aeec-066589f302ff req-ab78b5dc-1ec7-4bc8-aad5-6b1bc21c8e5b service nova] Unable to find a host for instance b7d95a7f-6fa1-44ee-9f02-0f39852da011. Dropping event network-vif-unplugged {{(pid=119337) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 19 23:50:59.199433 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-c11f582e-fd47-4791-aeec-066589f302ff req-ab78b5dc-1ec7-4bc8-aad5-6b1bc21c8e5b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028687 Jul 19 23:50:59.200028 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3646/7281] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 19 23:50:59.370572 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [None req-1aeccc63-d963-46cf-b0d0-dd361a696a09 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [e885b08f-a38d-4663-aa03-4b9b970f7884] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 40084. Jul 19 23:50:59.374864 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-1aeccc63-d963-46cf-b0d0-dd361a696a09 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "POST /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011/action" status: 202 len: 0 microversion: 2.1 time: 1.107194 Jul 19 23:50:59.375535 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3636/7282] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:50:58 2022] POST /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011/action => generated 0 bytes in 1109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:50:59.383801 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2af8e612-2019-46a1-94a7-497017b85bae tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:50:59.384451 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2af8e612-2019-46a1-94a7-497017b85bae tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:50:59.391664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2af8e612-2019-46a1-94a7-497017b85bae tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:59.392137 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2af8e612-2019-46a1-94a7-497017b85bae tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:59.392918 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2af8e612-2019-46a1-94a7-497017b85bae tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:50:59.393405 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2af8e612-2019-46a1-94a7-497017b85bae tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:50:59.526280 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2af8e612-2019-46a1-94a7-497017b85bae tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:50:59.534568 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2af8e612-2019-46a1-94a7-497017b85bae tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1518 microversion: 2.1 time: 0.154520 Jul 19 23:50:59.535170 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3647/7283] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:50:59 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:51:00.554280 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-50e88bb0-c36e-4582-9913-4ba84a7bf617 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:51:00.555047 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-50e88bb0-c36e-4582-9913-4ba84a7bf617 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:51:00.562333 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50e88bb0-c36e-4582-9913-4ba84a7bf617 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:00.562788 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50e88bb0-c36e-4582-9913-4ba84a7bf617 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:00.563598 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50e88bb0-c36e-4582-9913-4ba84a7bf617 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:00.564051 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-50e88bb0-c36e-4582-9913-4ba84a7bf617 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:00.707276 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-50e88bb0-c36e-4582-9913-4ba84a7bf617 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:51:00.715047 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-50e88bb0-c36e-4582-9913-4ba84a7bf617 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1518 microversion: 2.1 time: 0.165862 Jul 19 23:51:00.715653 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3637/7284] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:51:00 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:51:01.733140 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-519039c3-a394-4daa-9742-462d4834d466 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:51:01.733850 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-519039c3-a394-4daa-9742-462d4834d466 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:51:01.741114 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-519039c3-a394-4daa-9742-462d4834d466 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:01.741379 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-519039c3-a394-4daa-9742-462d4834d466 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:01.742319 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-519039c3-a394-4daa-9742-462d4834d466 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:01.742603 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-519039c3-a394-4daa-9742-462d4834d466 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:01.884210 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-519039c3-a394-4daa-9742-462d4834d466 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:51:01.892725 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-519039c3-a394-4daa-9742-462d4834d466 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1518 microversion: 2.1 time: 0.163548 Jul 19 23:51:01.893293 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3648/7285] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:51:01 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:51:02.910004 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9ea3890f-a688-4c01-99c2-a01566f22661 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:51:02.910628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9ea3890f-a688-4c01-99c2-a01566f22661 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:51:02.917131 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ea3890f-a688-4c01-99c2-a01566f22661 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:02.917581 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ea3890f-a688-4c01-99c2-a01566f22661 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:02.918357 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ea3890f-a688-4c01-99c2-a01566f22661 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:02.918795 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9ea3890f-a688-4c01-99c2-a01566f22661 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:03.052541 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9ea3890f-a688-4c01-99c2-a01566f22661 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:51:03.060086 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9ea3890f-a688-4c01-99c2-a01566f22661 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1518 microversion: 2.1 time: 0.154241 Jul 19 23:51:03.060692 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3638/7286] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:51:02 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:51:04.078018 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-36ef80b5-2148-4fa9-afd5-87508a950df2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:51:04.078653 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-36ef80b5-2148-4fa9-afd5-87508a950df2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:51:04.085818 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36ef80b5-2148-4fa9-afd5-87508a950df2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:04.086278 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36ef80b5-2148-4fa9-afd5-87508a950df2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:04.087057 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36ef80b5-2148-4fa9-afd5-87508a950df2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:04.087546 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-36ef80b5-2148-4fa9-afd5-87508a950df2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:04.222178 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-36ef80b5-2148-4fa9-afd5-87508a950df2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:51:04.229907 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-36ef80b5-2148-4fa9-afd5-87508a950df2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1520 microversion: 2.1 time: 0.156035 Jul 19 23:51:04.230481 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3649/7287] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:51:04 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:51:05.248138 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b515976f-2c27-4a45-9ae0-a0a35783b2fc tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:51:05.249513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b515976f-2c27-4a45-9ae0-a0a35783b2fc tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:51:05.256622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b515976f-2c27-4a45-9ae0-a0a35783b2fc tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:05.257075 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b515976f-2c27-4a45-9ae0-a0a35783b2fc tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:05.257864 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b515976f-2c27-4a45-9ae0-a0a35783b2fc tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:05.258287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b515976f-2c27-4a45-9ae0-a0a35783b2fc tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:05.401352 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b515976f-2c27-4a45-9ae0-a0a35783b2fc tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:51:05.409782 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b515976f-2c27-4a45-9ae0-a0a35783b2fc tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1520 microversion: 2.1 time: 0.165582 Jul 19 23:51:05.410368 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3639/7288] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:51:05 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:51:06.426922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-efb9acc9-2258-4e6b-ae28-09fe27b3cbd3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:51:06.427586 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-efb9acc9-2258-4e6b-ae28-09fe27b3cbd3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:51:06.434995 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-efb9acc9-2258-4e6b-ae28-09fe27b3cbd3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:06.435486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-efb9acc9-2258-4e6b-ae28-09fe27b3cbd3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:06.436757 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-efb9acc9-2258-4e6b-ae28-09fe27b3cbd3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:06.437446 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-efb9acc9-2258-4e6b-ae28-09fe27b3cbd3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:06.569453 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-efb9acc9-2258-4e6b-ae28-09fe27b3cbd3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:51:06.578470 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-efb9acc9-2258-4e6b-ae28-09fe27b3cbd3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1520 microversion: 2.1 time: 0.155369 Jul 19 23:51:06.579043 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3650/7289] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:51:06 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:51:07.596661 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-16e1ccac-0539-43a1-8919-92ed1b54d93d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:51:07.597291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-16e1ccac-0539-43a1-8919-92ed1b54d93d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:51:07.604389 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16e1ccac-0539-43a1-8919-92ed1b54d93d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:07.604842 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16e1ccac-0539-43a1-8919-92ed1b54d93d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:07.605629 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16e1ccac-0539-43a1-8919-92ed1b54d93d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:07.606078 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-16e1ccac-0539-43a1-8919-92ed1b54d93d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:07.746660 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-16e1ccac-0539-43a1-8919-92ed1b54d93d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:51:07.754697 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-16e1ccac-0539-43a1-8919-92ed1b54d93d tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1520 microversion: 2.1 time: 0.162960 Jul 19 23:51:07.755315 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3640/7290] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:51:07 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:51:08.772027 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-81177ed2-25e0-4f1a-9519-35c8c433853b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:51:08.772669 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-81177ed2-25e0-4f1a-9519-35c8c433853b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:51:08.780019 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-81177ed2-25e0-4f1a-9519-35c8c433853b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:08.780698 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-81177ed2-25e0-4f1a-9519-35c8c433853b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:08.781389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-81177ed2-25e0-4f1a-9519-35c8c433853b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:08.781839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-81177ed2-25e0-4f1a-9519-35c8c433853b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:08.929984 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-81177ed2-25e0-4f1a-9519-35c8c433853b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:51:08.939510 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-81177ed2-25e0-4f1a-9519-35c8c433853b tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1520 microversion: 2.1 time: 0.171263 Jul 19 23:51:08.940200 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3651/7291] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:51:08 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:51:09.957298 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-edd11b4f-cdea-468d-b154-2e428bde614f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:51:09.957947 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-edd11b4f-cdea-468d-b154-2e428bde614f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:51:09.965702 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-edd11b4f-cdea-468d-b154-2e428bde614f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:09.965702 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-edd11b4f-cdea-468d-b154-2e428bde614f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:09.966570 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-edd11b4f-cdea-468d-b154-2e428bde614f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:09.966703 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-edd11b4f-cdea-468d-b154-2e428bde614f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:10.102012 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-edd11b4f-cdea-468d-b154-2e428bde614f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:51:10.109912 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-edd11b4f-cdea-468d-b154-2e428bde614f tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1576 microversion: 2.1 time: 0.156507 Jul 19 23:51:10.110590 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3641/7292] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:51:09 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:51:11.128049 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-321227eb-8f75-4d8b-9e24-614d88bbb201 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:51:11.128828 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-321227eb-8f75-4d8b-9e24-614d88bbb201 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:51:11.136618 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-321227eb-8f75-4d8b-9e24-614d88bbb201 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:11.137241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-321227eb-8f75-4d8b-9e24-614d88bbb201 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:11.138139 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-321227eb-8f75-4d8b-9e24-614d88bbb201 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:11.138536 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-321227eb-8f75-4d8b-9e24-614d88bbb201 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:11.273604 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-321227eb-8f75-4d8b-9e24-614d88bbb201 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:51:11.281249 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-321227eb-8f75-4d8b-9e24-614d88bbb201 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1576 microversion: 2.1 time: 0.157397 Jul 19 23:51:11.282556 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3652/7293] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:51:11 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:51:12.300380 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-f6fd5e6b-a791-4fe5-9f8e-b2fd004f1f51 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:51:12.300924 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-f6fd5e6b-a791-4fe5-9f8e-b2fd004f1f51 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:51:12.307920 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f6fd5e6b-a791-4fe5-9f8e-b2fd004f1f51 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:12.308369 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f6fd5e6b-a791-4fe5-9f8e-b2fd004f1f51 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:12.309137 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f6fd5e6b-a791-4fe5-9f8e-b2fd004f1f51 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:12.309573 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-f6fd5e6b-a791-4fe5-9f8e-b2fd004f1f51 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:12.327835 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:51:12.444270 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-f6fd5e6b-a791-4fe5-9f8e-b2fd004f1f51 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:51:12.451887 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-f6fd5e6b-a791-4fe5-9f8e-b2fd004f1f51 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1576 microversion: 2.1 time: 0.156692 Jul 19 23:51:12.452795 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3642/7294] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:51:12 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:51:13.469718 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-b78be788-3e46-424d-8f3e-aed919dbbf00 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:51:13.470349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-b78be788-3e46-424d-8f3e-aed919dbbf00 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:51:13.477392 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b78be788-3e46-424d-8f3e-aed919dbbf00 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:13.477850 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b78be788-3e46-424d-8f3e-aed919dbbf00 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:13.478619 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b78be788-3e46-424d-8f3e-aed919dbbf00 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:13.479061 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-b78be788-3e46-424d-8f3e-aed919dbbf00 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:13.608093 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-b78be788-3e46-424d-8f3e-aed919dbbf00 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:51:13.616723 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-b78be788-3e46-424d-8f3e-aed919dbbf00 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1576 microversion: 2.1 time: 0.150936 Jul 19 23:51:13.617299 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3653/7295] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:51:13 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:51:14.634432 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2e331396-7947-470e-9456-6c6c41948a95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:51:14.635045 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2e331396-7947-470e-9456-6c6c41948a95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:51:14.637772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=31 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:51:14.643185 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2e331396-7947-470e-9456-6c6c41948a95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:14.643638 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2e331396-7947-470e-9456-6c6c41948a95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:14.644500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2e331396-7947-470e-9456-6c6c41948a95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:14.645016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2e331396-7947-470e-9456-6c6c41948a95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:14.781297 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-2e331396-7947-470e-9456-6c6c41948a95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:51:14.790293 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2e331396-7947-470e-9456-6c6c41948a95 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1576 microversion: 2.1 time: 0.159755 Jul 19 23:51:14.790872 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3643/7296] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:51:14 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:51:15.807332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-26a7eca2-ba29-471d-8e64-fc80a1c55c0a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:51:15.808354 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-26a7eca2-ba29-471d-8e64-fc80a1c55c0a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:51:15.810689 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=31 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:51:15.816926 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-26a7eca2-ba29-471d-8e64-fc80a1c55c0a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:15.817641 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-26a7eca2-ba29-471d-8e64-fc80a1c55c0a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:15.818431 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-26a7eca2-ba29-471d-8e64-fc80a1c55c0a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:15.818877 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-26a7eca2-ba29-471d-8e64-fc80a1c55c0a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:15.821747 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=87 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:51:15.955796 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-26a7eca2-ba29-471d-8e64-fc80a1c55c0a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:51:15.963695 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-26a7eca2-ba29-471d-8e64-fc80a1c55c0a tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1576 microversion: 2.1 time: 0.160589 Jul 19 23:51:15.964294 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3654/7297] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:51:15 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:51:16.982077 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7c637717-0717-4bd3-bcc9-cba93bea0531 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:51:16.982693 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7c637717-0717-4bd3-bcc9-cba93bea0531 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:51:16.990372 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7c637717-0717-4bd3-bcc9-cba93bea0531 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:16.990821 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7c637717-0717-4bd3-bcc9-cba93bea0531 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:16.991617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7c637717-0717-4bd3-bcc9-cba93bea0531 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:16.992065 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7c637717-0717-4bd3-bcc9-cba93bea0531 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:17.127649 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7c637717-0717-4bd3-bcc9-cba93bea0531 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:51:17.135403 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7c637717-0717-4bd3-bcc9-cba93bea0531 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1576 microversion: 2.1 time: 0.157182 Jul 19 23:51:17.135992 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3644/7298] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:51:16 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:51:18.152394 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5878be85-1a66-4d5e-bb23-ddd1a2261d88 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:51:18.153046 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5878be85-1a66-4d5e-bb23-ddd1a2261d88 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:51:18.159888 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5878be85-1a66-4d5e-bb23-ddd1a2261d88 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:18.160348 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5878be85-1a66-4d5e-bb23-ddd1a2261d88 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:18.161121 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5878be85-1a66-4d5e-bb23-ddd1a2261d88 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:18.161566 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5878be85-1a66-4d5e-bb23-ddd1a2261d88 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:18.291551 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5878be85-1a66-4d5e-bb23-ddd1a2261d88 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:51:18.300260 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5878be85-1a66-4d5e-bb23-ddd1a2261d88 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1576 microversion: 2.1 time: 0.151936 Jul 19 23:51:18.300785 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3655/7299] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:51:18 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:51:19.319151 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-249e873b-1665-4d27-ba8b-42bc0ca7a0f5 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:51:19.319811 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-249e873b-1665-4d27-ba8b-42bc0ca7a0f5 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:51:19.326715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-249e873b-1665-4d27-ba8b-42bc0ca7a0f5 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:19.327211 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-249e873b-1665-4d27-ba8b-42bc0ca7a0f5 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:19.327989 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-249e873b-1665-4d27-ba8b-42bc0ca7a0f5 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:19.328430 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-249e873b-1665-4d27-ba8b-42bc0ca7a0f5 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:19.474738 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-249e873b-1665-4d27-ba8b-42bc0ca7a0f5 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:51:19.483785 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-249e873b-1665-4d27-ba8b-42bc0ca7a0f5 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1576 microversion: 2.1 time: 0.168777 Jul 19 23:51:19.484589 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3645/7300] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:51:19 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:51:20.501661 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8a18663e-6297-4893-85f9-0d9af0193546 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:51:20.502317 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8a18663e-6297-4893-85f9-0d9af0193546 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:51:20.509475 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a18663e-6297-4893-85f9-0d9af0193546 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:20.509931 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a18663e-6297-4893-85f9-0d9af0193546 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:20.510697 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a18663e-6297-4893-85f9-0d9af0193546 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:20.511171 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8a18663e-6297-4893-85f9-0d9af0193546 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:20.643422 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8a18663e-6297-4893-85f9-0d9af0193546 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:51:20.651154 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8a18663e-6297-4893-85f9-0d9af0193546 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1576 microversion: 2.1 time: 0.153564 Jul 19 23:51:20.651739 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3656/7301] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:51:20 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:51:21.382218 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-8a1e762a-b55d-4143-9318-1035c8e7c105 req-ea562cf9-f619-4a3d-ac92-357ad62f8e92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d95a7f-6fa1-44ee-9f02-0f39852da011", "name": "network-vif-plugged", "status": "completed", "tag": "21b370d3-62ee-4c40-99f9-6093a857fa5e"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:51:21.390818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-8a1e762a-b55d-4143-9318-1035c8e7c105 req-ea562cf9-f619-4a3d-ac92-357ad62f8e92 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:21.390818 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-8a1e762a-b55d-4143-9318-1035c8e7c105 req-ea562cf9-f619-4a3d-ac92-357ad62f8e92 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:21.405180 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-8a1e762a-b55d-4143-9318-1035c8e7c105 req-ea562cf9-f619-4a3d-ac92-357ad62f8e92 service nova] Creating event network-vif-plugged:21b370d3-62ee-4c40-99f9-6093a857fa5e for instance b7d95a7f-6fa1-44ee-9f02-0f39852da011 on n-h2-847009-3 Jul 19 23:51:21.411001 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-8a1e762a-b55d-4143-9318-1035c8e7c105 req-ea562cf9-f619-4a3d-ac92-357ad62f8e92 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093034 Jul 19 23:51:21.411665 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3646/7302] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:51:21.669331 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-2dcc3089-95e6-4751-a71b-17ec5612f58e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:51:21.670014 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-2dcc3089-95e6-4751-a71b-17ec5612f58e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:51:21.684659 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2dcc3089-95e6-4751-a71b-17ec5612f58e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:21.685120 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2dcc3089-95e6-4751-a71b-17ec5612f58e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:21.685920 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2dcc3089-95e6-4751-a71b-17ec5612f58e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:21.686372 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-2dcc3089-95e6-4751-a71b-17ec5612f58e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:21.825433 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-2dcc3089-95e6-4751-a71b-17ec5612f58e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:51:21.834164 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-2dcc3089-95e6-4751-a71b-17ec5612f58e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1576 microversion: 2.1 time: 0.169175 Jul 19 23:51:21.834743 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3657/7303] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:51:21 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:51:22.852469 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-643bdeb6-7bba-4df2-8dd5-ce3aaae5b98e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:51:22.853175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-643bdeb6-7bba-4df2-8dd5-ce3aaae5b98e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:51:22.859494 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-643bdeb6-7bba-4df2-8dd5-ce3aaae5b98e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:22.860561 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-643bdeb6-7bba-4df2-8dd5-ce3aaae5b98e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:22.861343 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-643bdeb6-7bba-4df2-8dd5-ce3aaae5b98e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:51:22.861787 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-643bdeb6-7bba-4df2-8dd5-ce3aaae5b98e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:51:22.998900 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-643bdeb6-7bba-4df2-8dd5-ce3aaae5b98e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:51:23.008083 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-643bdeb6-7bba-4df2-8dd5-ce3aaae5b98e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1563 microversion: 2.1 time: 0.160726 Jul 19 23:51:23.008671 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3647/7304] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:51:22 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:51:57.407340 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:51:57.407982 n-d-847009-3 devstack@n-api.service[119337]: Tue Jul 19 23:51:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:52:39.707787 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=7 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:52:39.709094 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=23 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:52:39.710812 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=9 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:52:39.711617 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=28 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:52:39.714080 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5cbddd43-221f-480e-a1c9-26a3db78371e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:52:39.714709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5cbddd43-221f-480e-a1c9-26a3db78371e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:52:39.726064 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5cbddd43-221f-480e-a1c9-26a3db78371e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:52:39.726777 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5cbddd43-221f-480e-a1c9-26a3db78371e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:52:39.728187 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5cbddd43-221f-480e-a1c9-26a3db78371e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:52:39.728639 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5cbddd43-221f-480e-a1c9-26a3db78371e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:52:39.773985 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-9c05fd76-5ccf-4764-894c-437fff7761ba req-000c40ea-8d35-43ba-a8ea-02fa85584329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7d95a7f-6fa1-44ee-9f02-0f39852da011", "tag": "21b370d3-62ee-4c40-99f9-6093a857fa5e"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:52:39.783253 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-9c05fd76-5ccf-4764-894c-437fff7761ba req-000c40ea-8d35-43ba-a8ea-02fa85584329 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:52:39.783745 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-9c05fd76-5ccf-4764-894c-437fff7761ba req-000c40ea-8d35-43ba-a8ea-02fa85584329 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:52:39.796436 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-9c05fd76-5ccf-4764-894c-437fff7761ba req-000c40ea-8d35-43ba-a8ea-02fa85584329 service nova] Creating event network-changed:21b370d3-62ee-4c40-99f9-6093a857fa5e for instance b7d95a7f-6fa1-44ee-9f02-0f39852da011 on n-h2-847009-3 Jul 19 23:52:39.802517 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-9c05fd76-5ccf-4764-894c-437fff7761ba req-000c40ea-8d35-43ba-a8ea-02fa85584329 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093504 Jul 19 23:52:39.806104 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3648/7305] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:52:40.038212 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5cbddd43-221f-480e-a1c9-26a3db78371e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:52:40.128536 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5cbddd43-221f-480e-a1c9-26a3db78371e tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 204 len: 0 microversion: 2.1 time: 0.422457 Jul 19 23:52:40.129704 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3658/7306] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:52:39 2022] DELETE /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:52:40.138825 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-ab7b51e6-8890-466d-b37e-51d89c016322 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:52:40.139624 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-ab7b51e6-8890-466d-b37e-51d89c016322 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:52:40.147556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab7b51e6-8890-466d-b37e-51d89c016322 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:52:40.148483 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab7b51e6-8890-466d-b37e-51d89c016322 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:52:40.149291 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab7b51e6-8890-466d-b37e-51d89c016322 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:52:40.149733 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-ab7b51e6-8890-466d-b37e-51d89c016322 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:52:40.305016 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-ab7b51e6-8890-466d-b37e-51d89c016322 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:52:40.313897 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-ab7b51e6-8890-466d-b37e-51d89c016322 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1569 microversion: 2.1 time: 0.179152 Jul 19 23:52:40.314686 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3649/7307] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:52:40 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:52:41.335232 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-eda8513e-5783-4ed4-a561-bb1dd476826c tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:52:41.336062 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-eda8513e-5783-4ed4-a561-bb1dd476826c tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:52:41.345884 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eda8513e-5783-4ed4-a561-bb1dd476826c tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:52:41.346396 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eda8513e-5783-4ed4-a561-bb1dd476826c tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:52:41.347262 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eda8513e-5783-4ed4-a561-bb1dd476826c tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:52:41.347720 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-eda8513e-5783-4ed4-a561-bb1dd476826c tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:52:41.506059 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-eda8513e-5783-4ed4-a561-bb1dd476826c tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:52:41.513766 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-eda8513e-5783-4ed4-a561-bb1dd476826c tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1569 microversion: 2.1 time: 0.183803 Jul 19 23:52:41.514335 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3659/7308] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:52:41 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:52:42.290156 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-63f67966-4520-4ed1-b4d4-1c039dc2d40c req-bc691000-bff1-47d6-a1a4-1c4a87e402df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d95a7f-6fa1-44ee-9f02-0f39852da011", "name": "network-vif-deleted", "tag": "21b370d3-62ee-4c40-99f9-6093a857fa5e"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:52:42.305232 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-63f67966-4520-4ed1-b4d4-1c039dc2d40c req-bc691000-bff1-47d6-a1a4-1c4a87e402df service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:52:42.306254 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-63f67966-4520-4ed1-b4d4-1c039dc2d40c req-bc691000-bff1-47d6-a1a4-1c4a87e402df service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:52:42.324742 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-63f67966-4520-4ed1-b4d4-1c039dc2d40c req-bc691000-bff1-47d6-a1a4-1c4a87e402df service nova] Creating event network-vif-deleted:21b370d3-62ee-4c40-99f9-6093a857fa5e for instance b7d95a7f-6fa1-44ee-9f02-0f39852da011 on n-h2-847009-3 Jul 19 23:52:42.331254 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-63f67966-4520-4ed1-b4d4-1c039dc2d40c req-bc691000-bff1-47d6-a1a4-1c4a87e402df service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044641 Jul 19 23:52:42.331855 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3650/7309] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:52:42.531471 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-790b8647-a5f8-45ad-8485-f843ecc05fc2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:52:42.532755 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-790b8647-a5f8-45ad-8485-f843ecc05fc2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:52:42.540066 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-790b8647-a5f8-45ad-8485-f843ecc05fc2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:52:42.540536 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-790b8647-a5f8-45ad-8485-f843ecc05fc2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:52:42.541362 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-790b8647-a5f8-45ad-8485-f843ecc05fc2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:52:42.541814 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-790b8647-a5f8-45ad-8485-f843ecc05fc2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:52:42.610861 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-790b8647-a5f8-45ad-8485-f843ecc05fc2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:52:42.618946 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-790b8647-a5f8-45ad-8485-f843ecc05fc2 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1220 microversion: 2.1 time: 0.091575 Jul 19 23:52:42.619562 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3660/7310] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:52:42 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:52:43.637443 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-3f35f91c-38e5-4995-b3bc-dac95ca56e38 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:52:43.638301 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-3f35f91c-38e5-4995-b3bc-dac95ca56e38 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:52:43.646008 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3f35f91c-38e5-4995-b3bc-dac95ca56e38 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:52:43.646543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3f35f91c-38e5-4995-b3bc-dac95ca56e38 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:52:43.647433 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3f35f91c-38e5-4995-b3bc-dac95ca56e38 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:52:43.647955 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-3f35f91c-38e5-4995-b3bc-dac95ca56e38 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:52:43.712618 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-3f35f91c-38e5-4995-b3bc-dac95ca56e38 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:52:43.720490 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-3f35f91c-38e5-4995-b3bc-dac95ca56e38 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1220 microversion: 2.1 time: 0.088116 Jul 19 23:52:43.721127 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3651/7311] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:52:43 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:52:44.737898 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-50f7d9fd-427e-4ef4-9b17-ffd6bded51cd tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:52:44.738548 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-50f7d9fd-427e-4ef4-9b17-ffd6bded51cd tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:52:44.746564 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-50f7d9fd-427e-4ef4-9b17-ffd6bded51cd tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:52:44.747031 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-50f7d9fd-427e-4ef4-9b17-ffd6bded51cd tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:52:44.747940 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-50f7d9fd-427e-4ef4-9b17-ffd6bded51cd tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:52:44.748397 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-50f7d9fd-427e-4ef4-9b17-ffd6bded51cd tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:52:44.811443 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-50f7d9fd-427e-4ef4-9b17-ffd6bded51cd tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:52:44.819955 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-50f7d9fd-427e-4ef4-9b17-ffd6bded51cd tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1220 microversion: 2.1 time: 0.086363 Jul 19 23:52:44.820616 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3661/7312] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:52:44 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:52:45.837522 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-77a99f98-3b93-4761-a677-ee63070c13f3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:52:45.838053 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-77a99f98-3b93-4761-a677-ee63070c13f3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:52:45.845613 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-77a99f98-3b93-4761-a677-ee63070c13f3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:52:45.846048 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-77a99f98-3b93-4761-a677-ee63070c13f3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:52:45.846920 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-77a99f98-3b93-4761-a677-ee63070c13f3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:52:45.847740 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-77a99f98-3b93-4761-a677-ee63070c13f3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:52:45.913926 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-77a99f98-3b93-4761-a677-ee63070c13f3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df24f256f744c569f0b238b79c71e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667e58901d514569a21cedcd4055538a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:52:45.921708 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-77a99f98-3b93-4761-a677-ee63070c13f3 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 200 len: 1220 microversion: 2.1 time: 0.088238 Jul 19 23:52:45.922289 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3652/7313] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:52:45 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:52:46.940847 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c698389c-645c-4b32-a6da-923b2510ec06 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:52:46.942128 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c698389c-645c-4b32-a6da-923b2510ec06 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [instance: b7d95a7f-6fa1-44ee-9f02-0f39852da011] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:52:46.948709 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c698389c-645c-4b32-a6da-923b2510ec06 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:52:46.949241 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c698389c-645c-4b32-a6da-923b2510ec06 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:52:46.950054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c698389c-645c-4b32-a6da-923b2510ec06 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:52:46.950500 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c698389c-645c-4b32-a6da-923b2510ec06 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:52:46.964890 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-c698389c-645c-4b32-a6da-923b2510ec06 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] HTTP exception thrown: Instance b7d95a7f-6fa1-44ee-9f02-0f39852da011 could not be found. Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c698389c-645c-4b32-a6da-923b2510ec06 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Request method failure captured: Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 HTTP/1.1 Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi10Gx8OPriwbnTdX7dqxIVv4Xaog0RRTXhEc4tr8pYGhKG7zFrTAYhKC9RcTTVPlDwuxILkvEQA6H2BeaHvUnS7ikuBieA7ZSdZQCOTcgIlrQT1piakxXSb0s97b3_gzmBCH29p3C9tt9IhmT9fXh708hIIu6QuJH9m-Nr3EhKtJLVLw Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 667e58901d514569a21cedcd4055538a Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-TestShelveInstance-1298509394 Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_667e58901d514569a21cedcd4055538a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/667e58901d514569a21cedcd4055538a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/667e58901d514569a21cedcd4055538a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/667e58901d514569a21cedcd4055538a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-TestShelveInstance-1298509394 Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 667e58901d514569a21cedcd4055538a Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-TestShelveInstance-1298509394 Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-TestShelveInstance-1298509394-project Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 9df24f256f744c569f0b238b79c71e5f Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-TestShelveInstance-1298509394-project Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance b7d95a7f-6fa1-44ee-9f02-0f39852da011 could not be found. Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'b7d95a7f-6fa1-44ee-9f02-0f39852da011'} Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7d95a7f-6fa1-44ee-9f02-0f39852da011 could not be found. Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7d95a7f-6fa1-44ee-9f02-0f39852da011 could not be found. Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:52:46.966739 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:52:46.971335 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:52:46.971335 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:52:46.971335 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:52:46.971335 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:52:46.971335 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:52:46.971335 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7d95a7f-6fa1-44ee-9f02-0f39852da011 could not be found. Jul 19 23:52:46.971335 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:52:46.971335 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c698389c-645c-4b32-a6da-923b2510ec06 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Returning 404 to user: Instance b7d95a7f-6fa1-44ee-9f02-0f39852da011 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:52:46.971335 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c698389c-645c-4b32-a6da-923b2510ec06 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011" status: 404 len: 111 microversion: 2.1 time: 0.032187 Jul 19 23:52:46.971335 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3662/7314] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:52:46 2022] GET /compute/v2.1/servers/b7d95a7f-6fa1-44ee-9f02-0f39852da011 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:52:47.142569 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d1acf8b9-3cd4-47b6-8729-41a41cf61ac1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] Calling method '.version_select at 0x7f7a100f5ca0>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:52:47.145989 n-d-847009-3 devstack@n-api.service[119338]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d1acf8b9-3cd4-47b6-8729-41a41cf61ac1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [57add8b2-ab6b-4b5b-8d19-ca1e88009fab] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 23:52:48.155177 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [None req-d1acf8b9-3cd4-47b6-8729-41a41cf61ac1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] [57add8b2-ab6b-4b5b-8d19-ca1e88009fab] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 40214. Jul 19 23:52:48.176332 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d1acf8b9-3cd4-47b6-8729-41a41cf61ac1 tempest-TestShelveInstance-1298509394 tempest-TestShelveInstance-1298509394-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1174861797" status: 202 len: 0 microversion: 2.1 time: 1.038279 Jul 19 23:52:48.176921 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3653/7315] 10.222.0.25 () {58 vars in 1253 bytes} [Tue Jul 19 23:52:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1174861797 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:53:06.136018 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:53:06.137679 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:53:06.366263 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-cf213cb2-aba3-4c51-aa28-91603a4ff8f3 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Action: 'create', calling method: .version_select at 0x7f7a030121f0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1060441695", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBlGdf1xBVHJDBEt6f8h29nPFeLmacAoVOuw4Rm7FQkFuJPjjcDzma01+lD2iMtkUK/VwjxPMs44c/sHbmUZwZfYrX+IPBrdn5R91TTyyeT+SfGzoV0v8jknLMd9hADOw=="}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:53:06.388292 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-cf213cb2-aba3-4c51-aa28-91603a4ff8f3 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Getting quotas for project 563ce242cd3e439babb59bb8663a7db6. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:53:06.393910 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-cf213cb2-aba3-4c51-aa28-91603a4ff8f3 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Getting quotas for user 24654c4599c4418d80f94eeb264fbae0 and project 563ce242cd3e439babb59bb8663a7db6. Resources: {'key_pairs'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:53:06.410279 n-d-847009-3 devstack@n-api.service[119337]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cf213cb2-aba3-4c51-aa28-91603a4ff8f3 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [5306ea33-f0bc-4078-9200-2b5cfa51f96d] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 23:53:07.418444 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [None req-cf213cb2-aba3-4c51-aa28-91603a4ff8f3 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [5306ea33-f0bc-4078-9200-2b5cfa51f96d] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 40318. Jul 19 23:53:07.435403 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-cf213cb2-aba3-4c51-aa28-91603a4ff8f3 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 1.305959 Jul 19 23:53:07.436146 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3663/7316] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 19 23:53:06 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:53:08.477937 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-2f2f6b3f-014a-450a-be1d-aec03c2a372a tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-386395832", "imageRef": "3a7659a5-b1a8-4e19-8bfc-eda9874ee691", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1060441695", "security_groups": [{"name": "tempest-secgroup-smoke-1892883911"}], "networks": [{"uuid": "b0411bf2-7cff-4daf-96bd-a64437c30eda"}]}} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:53:08.491383 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=22 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:53:08.492032 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:53:08.598038 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.network.neutron [None req-2f2f6b3f-014a-450a-be1d-aec03c2a372a tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] validate_networks() for [('b0411bf2-7cff-4daf-96bd-a64437c30eda', None, None, None, None, None)] {{(pid=119338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:53:09.051602 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-2f2f6b3f-014a-450a-be1d-aec03c2a372a tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Flavor limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:53:09.052032 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-2f2f6b3f-014a-450a-be1d-aec03c2a372a tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Image limits 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:53:09.052523 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-2f2f6b3f-014a-450a-be1d-aec03c2a372a tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Flavor pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:53:09.052941 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-2f2f6b3f-014a-450a-be1d-aec03c2a372a tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Image pref 0:0:0 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:53:09.053534 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.virt.hardware [None req-2f2f6b3f-014a-450a-be1d-aec03c2a372a tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:53:09.063098 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f2f6b3f-014a-450a-be1d-aec03c2a372a tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:53:09.065023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f2f6b3f-014a-450a-be1d-aec03c2a372a tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:53:09.066023 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f2f6b3f-014a-450a-be1d-aec03c2a372a tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:53:09.066474 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-2f2f6b3f-014a-450a-be1d-aec03c2a372a tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:53:09.088213 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-2f2f6b3f-014a-450a-be1d-aec03c2a372a tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Getting quotas for project 563ce242cd3e439babb59bb8663a7db6. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:53:09.099497 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.quota [None req-2f2f6b3f-014a-450a-be1d-aec03c2a372a tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Getting quotas for user 24654c4599c4418d80f94eeb264fbae0 and project 563ce242cd3e439babb59bb8663a7db6. Resources: {'cores', 'ram', 'instances'} {{(pid=119338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:53:09.111958 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2f2f6b3f-014a-450a-be1d-aec03c2a372a tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Going to run 1 instances... {{(pid=119338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:53:09.114580 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-2f2f6b3f-014a-450a-be1d-aec03c2a372a tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: d8fa9396-3e02-4e3c-8aca-0fbc1abb244f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a7659a5-b1a8-4e19-8bfc-eda9874ee691',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:53:09.173632 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-2f2f6b3f-014a-450a-be1d-aec03c2a372a tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.698572 Jul 19 23:53:09.174609 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3654/7317] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:53:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:53:09.185447 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-34f03511-2bed-4e75-a801-0bd822237ea3 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:53:09.186083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-34f03511-2bed-4e75-a801-0bd822237ea3 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: d8fa9396-3e02-4e3c-8aca-0fbc1abb244f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:53:09.250174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-34f03511-2bed-4e75-a801-0bd822237ea3 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:53:09.261728 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-34f03511-2bed-4e75-a801-0bd822237ea3 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f" status: 200 len: 1248 microversion: 2.1 time: 0.079599 Jul 19 23:53:09.263214 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3664/7318] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:53:09 2022] GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f => generated 1248 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:53:10.281308 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-9894a5b4-8bc7-4716-8579-a271ae44bd05 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:53:10.282152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-9894a5b4-8bc7-4716-8579-a271ae44bd05 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: d8fa9396-3e02-4e3c-8aca-0fbc1abb244f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:53:10.288677 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9894a5b4-8bc7-4716-8579-a271ae44bd05 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:53:10.289120 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9894a5b4-8bc7-4716-8579-a271ae44bd05 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:53:10.289893 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9894a5b4-8bc7-4716-8579-a271ae44bd05 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:53:10.290340 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-9894a5b4-8bc7-4716-8579-a271ae44bd05 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:53:10.352566 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-9894a5b4-8bc7-4716-8579-a271ae44bd05 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:53:10.360846 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-9894a5b4-8bc7-4716-8579-a271ae44bd05 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f" status: 200 len: 1252 microversion: 2.1 time: 0.083788 Jul 19 23:53:10.361526 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3655/7319] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:53:10 2022] GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f => generated 1252 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:53:11.379607 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-c704d702-2f19-4eb0-b743-4a79edab2df6 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:53:11.380258 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-c704d702-2f19-4eb0-b743-4a79edab2df6 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: d8fa9396-3e02-4e3c-8aca-0fbc1abb244f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:53:11.387840 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c704d702-2f19-4eb0-b743-4a79edab2df6 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:53:11.388302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c704d702-2f19-4eb0-b743-4a79edab2df6 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:53:11.389091 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c704d702-2f19-4eb0-b743-4a79edab2df6 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:53:11.389544 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-c704d702-2f19-4eb0-b743-4a79edab2df6 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:53:11.470123 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-c704d702-2f19-4eb0-b743-4a79edab2df6 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:53:11.478070 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-c704d702-2f19-4eb0-b743-4a79edab2df6 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f" status: 200 len: 1308 microversion: 2.1 time: 0.104327 Jul 19 23:53:11.483716 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3665/7320] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:53:11 2022] GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f => generated 1308 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:53:12.499988 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-7bac9092-3218-4855-97d4-44665be714d8 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:53:12.500526 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-7bac9092-3218-4855-97d4-44665be714d8 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: d8fa9396-3e02-4e3c-8aca-0fbc1abb244f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:53:12.507622 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bac9092-3218-4855-97d4-44665be714d8 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:53:12.508078 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bac9092-3218-4855-97d4-44665be714d8 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:53:12.508859 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bac9092-3218-4855-97d4-44665be714d8 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:53:12.509304 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-7bac9092-3218-4855-97d4-44665be714d8 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:53:12.658759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-7bac9092-3218-4855-97d4-44665be714d8 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:53:12.670588 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-7bac9092-3218-4855-97d4-44665be714d8 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f" status: 200 len: 1374 microversion: 2.1 time: 0.174427 Jul 19 23:53:12.671732 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3656/7321] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:53:12 2022] GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f => generated 1374 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:53:12.933145 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-954c6bca-a6cc-420a-a69c-7ea69b6b41e3 req-8b626fe3-7b45-4f99-9d34-5151a1188e46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8fa9396-3e02-4e3c-8aca-0fbc1abb244f", "tag": "58fcf341-6378-4913-856a-58c69d1412ee"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:53:12.942953 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-954c6bca-a6cc-420a-a69c-7ea69b6b41e3 req-8b626fe3-7b45-4f99-9d34-5151a1188e46 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:53:12.943449 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-954c6bca-a6cc-420a-a69c-7ea69b6b41e3 req-8b626fe3-7b45-4f99-9d34-5151a1188e46 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:53:12.956336 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-954c6bca-a6cc-420a-a69c-7ea69b6b41e3 req-8b626fe3-7b45-4f99-9d34-5151a1188e46 service nova] Creating event network-changed:58fcf341-6378-4913-856a-58c69d1412ee for instance d8fa9396-3e02-4e3c-8aca-0fbc1abb244f on n-h2-847009-3 Jul 19 23:53:12.961847 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-954c6bca-a6cc-420a-a69c-7ea69b6b41e3 req-8b626fe3-7b45-4f99-9d34-5151a1188e46 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111161 Jul 19 23:53:12.962800 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3666/7322] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:53:13.690044 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-5ed8432d-9a63-4f86-8bcc-3943a5984ea0 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:53:13.690612 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-5ed8432d-9a63-4f86-8bcc-3943a5984ea0 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: d8fa9396-3e02-4e3c-8aca-0fbc1abb244f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:53:13.698257 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ed8432d-9a63-4f86-8bcc-3943a5984ea0 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:53:13.698715 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ed8432d-9a63-4f86-8bcc-3943a5984ea0 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:53:13.699556 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ed8432d-9a63-4f86-8bcc-3943a5984ea0 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:53:13.700000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-5ed8432d-9a63-4f86-8bcc-3943a5984ea0 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:53:13.838789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-5ed8432d-9a63-4f86-8bcc-3943a5984ea0 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:53:13.846444 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-5ed8432d-9a63-4f86-8bcc-3943a5984ea0 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f" status: 200 len: 1374 microversion: 2.1 time: 0.161061 Jul 19 23:53:13.847021 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3657/7323] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:53:13 2022] GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:53:14.865486 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4ee726fc-99d0-4e73-916f-ce4bf3dfb5e5 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:53:14.866247 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4ee726fc-99d0-4e73-916f-ce4bf3dfb5e5 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: d8fa9396-3e02-4e3c-8aca-0fbc1abb244f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:53:14.872664 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ee726fc-99d0-4e73-916f-ce4bf3dfb5e5 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:53:14.873128 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ee726fc-99d0-4e73-916f-ce4bf3dfb5e5 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:53:14.873916 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ee726fc-99d0-4e73-916f-ce4bf3dfb5e5 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:53:14.874371 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4ee726fc-99d0-4e73-916f-ce4bf3dfb5e5 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:53:15.010389 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-4ee726fc-99d0-4e73-916f-ce4bf3dfb5e5 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:53:15.017902 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4ee726fc-99d0-4e73-916f-ce4bf3dfb5e5 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f" status: 200 len: 1374 microversion: 2.1 time: 0.158128 Jul 19 23:53:15.018474 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3667/7324] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:53:14 2022] GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:53:16.034904 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0a0f0060-11c0-4a67-bbcb-1cc9b24f0ca6 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:53:16.035553 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0a0f0060-11c0-4a67-bbcb-1cc9b24f0ca6 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: d8fa9396-3e02-4e3c-8aca-0fbc1abb244f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:53:16.042725 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a0f0060-11c0-4a67-bbcb-1cc9b24f0ca6 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:53:16.043217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a0f0060-11c0-4a67-bbcb-1cc9b24f0ca6 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:53:16.044000 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a0f0060-11c0-4a67-bbcb-1cc9b24f0ca6 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:53:16.044439 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0a0f0060-11c0-4a67-bbcb-1cc9b24f0ca6 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:53:16.190255 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0a0f0060-11c0-4a67-bbcb-1cc9b24f0ca6 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:53:16.198210 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0a0f0060-11c0-4a67-bbcb-1cc9b24f0ca6 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f" status: 200 len: 1374 microversion: 2.1 time: 0.167536 Jul 19 23:53:16.207645 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3658/7325] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:53:16 2022] GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:53:16.424383 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:53:16.424969 n-d-847009-3 devstack@n-api.service[119337]: Tue Jul 19 23:53:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:53:17.215606 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-f7a49252-00fd-4a91-86ac-6a0b6e379c73 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:53:17.216242 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-f7a49252-00fd-4a91-86ac-6a0b6e379c73 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: d8fa9396-3e02-4e3c-8aca-0fbc1abb244f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:53:17.223527 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f7a49252-00fd-4a91-86ac-6a0b6e379c73 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:53:17.223990 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f7a49252-00fd-4a91-86ac-6a0b6e379c73 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:53:17.224773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f7a49252-00fd-4a91-86ac-6a0b6e379c73 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:53:17.225248 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-f7a49252-00fd-4a91-86ac-6a0b6e379c73 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:53:17.360648 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-f7a49252-00fd-4a91-86ac-6a0b6e379c73 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:53:17.368198 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-f7a49252-00fd-4a91-86ac-6a0b6e379c73 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f" status: 200 len: 1374 microversion: 2.1 time: 0.156676 Jul 19 23:53:17.368767 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3668/7326] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:53:17 2022] GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:53:17.892179 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-5a6d4eeb-69af-4d27-bad3-c7bf7bee965b req-ff50d55d-4c89-46b1-b5f9-4b3d252cbd8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8fa9396-3e02-4e3c-8aca-0fbc1abb244f", "name": "network-vif-plugged", "status": "completed", "tag": "58fcf341-6378-4913-856a-58c69d1412ee"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:53:17.902628 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5a6d4eeb-69af-4d27-bad3-c7bf7bee965b req-ff50d55d-4c89-46b1-b5f9-4b3d252cbd8e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:53:17.903300 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-5a6d4eeb-69af-4d27-bad3-c7bf7bee965b req-ff50d55d-4c89-46b1-b5f9-4b3d252cbd8e service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:53:17.915838 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-5a6d4eeb-69af-4d27-bad3-c7bf7bee965b req-ff50d55d-4c89-46b1-b5f9-4b3d252cbd8e service nova] Creating event network-vif-plugged:58fcf341-6378-4913-856a-58c69d1412ee for instance d8fa9396-3e02-4e3c-8aca-0fbc1abb244f on n-h2-847009-3 Jul 19 23:53:17.920822 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-5a6d4eeb-69af-4d27-bad3-c7bf7bee965b req-ff50d55d-4c89-46b1-b5f9-4b3d252cbd8e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033024 Jul 19 23:53:17.921684 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3659/7327] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:53:18.385731 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-dc3f82bf-f455-4140-ad88-00ccd5864e1e tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:53:18.386368 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-dc3f82bf-f455-4140-ad88-00ccd5864e1e tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: d8fa9396-3e02-4e3c-8aca-0fbc1abb244f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:53:18.394773 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dc3f82bf-f455-4140-ad88-00ccd5864e1e tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:53:18.395274 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dc3f82bf-f455-4140-ad88-00ccd5864e1e tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:53:18.396078 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dc3f82bf-f455-4140-ad88-00ccd5864e1e tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:53:18.396534 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-dc3f82bf-f455-4140-ad88-00ccd5864e1e tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:53:18.546913 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-dc3f82bf-f455-4140-ad88-00ccd5864e1e tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:53:18.555474 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-dc3f82bf-f455-4140-ad88-00ccd5864e1e tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f" status: 200 len: 1374 microversion: 2.1 time: 0.173545 Jul 19 23:53:18.556053 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3669/7328] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:53:18 2022] GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:53:19.574226 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d928ee38-6ce2-49e6-854d-560f92994f9d tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:53:19.574977 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d928ee38-6ce2-49e6-854d-560f92994f9d tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: d8fa9396-3e02-4e3c-8aca-0fbc1abb244f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:53:19.577779 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:53:19.578543 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=6 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:53:19.585512 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d928ee38-6ce2-49e6-854d-560f92994f9d tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:53:19.585962 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d928ee38-6ce2-49e6-854d-560f92994f9d tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:53:19.586726 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d928ee38-6ce2-49e6-854d-560f92994f9d tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:53:19.587190 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d928ee38-6ce2-49e6-854d-560f92994f9d tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:53:19.722503 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d928ee38-6ce2-49e6-854d-560f92994f9d tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:53:19.730378 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d928ee38-6ce2-49e6-854d-560f92994f9d tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f" status: 200 len: 1558 microversion: 2.1 time: 0.160412 Jul 19 23:53:19.730948 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3660/7329] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:53:19 2022] GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:53:19.746949 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-1ac69013-fc07-453b-8713-338de6ab8cc2 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:53:19.747634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-1ac69013-fc07-453b-8713-338de6ab8cc2 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: d8fa9396-3e02-4e3c-8aca-0fbc1abb244f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:53:19.749590 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:53:19.757267 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1ac69013-fc07-453b-8713-338de6ab8cc2 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:53:19.757744 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1ac69013-fc07-453b-8713-338de6ab8cc2 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:53:19.758543 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1ac69013-fc07-453b-8713-338de6ab8cc2 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:53:19.759003 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-1ac69013-fc07-453b-8713-338de6ab8cc2 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:53:19.898106 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-1ac69013-fc07-453b-8713-338de6ab8cc2 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:53:19.905788 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-1ac69013-fc07-453b-8713-338de6ab8cc2 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f" status: 200 len: 1558 microversion: 2.1 time: 0.163024 Jul 19 23:53:19.906347 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3670/7330] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:53:19 2022] GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:53:21.631358 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-e99a79c7-0482-4b41-a675-97b59c228785 req-273ee74d-0b44-42a2-a749-3e43de437c66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8fa9396-3e02-4e3c-8aca-0fbc1abb244f", "tag": "58fcf341-6378-4913-856a-58c69d1412ee"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:53:21.640429 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e99a79c7-0482-4b41-a675-97b59c228785 req-273ee74d-0b44-42a2-a749-3e43de437c66 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:53:21.640883 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-e99a79c7-0482-4b41-a675-97b59c228785 req-273ee74d-0b44-42a2-a749-3e43de437c66 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:53:21.656272 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-e99a79c7-0482-4b41-a675-97b59c228785 req-273ee74d-0b44-42a2-a749-3e43de437c66 service nova] Creating event network-changed:58fcf341-6378-4913-856a-58c69d1412ee for instance d8fa9396-3e02-4e3c-8aca-0fbc1abb244f on n-h2-847009-3 Jul 19 23:53:21.662057 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-e99a79c7-0482-4b41-a675-97b59c228785 req-273ee74d-0b44-42a2-a749-3e43de437c66 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034409 Jul 19 23:53:21.663015 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3661/7331] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:55:19.156411 n-d-847009-3 devstack@n-api.service[119337]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4d9f90d1-6e88-4978-b2b1-8e2a2dbb4cb7] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 23:55:19.157322 n-d-847009-3 devstack@n-api.service[119337]: ERROR oslo.messaging._drivers.impl_rabbit [-] [798b565c-2a51-4094-a95e-de275b58674b] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 23:55:19.158131 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:55:19.158949 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=32 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:55:19.164244 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-281001d5-6072-4f30-b0dc-e668c03168e6 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-528253895"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:55:19.165284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-281001d5-6072-4f30-b0dc-e668c03168e6 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: d8fa9396-3e02-4e3c-8aca-0fbc1abb244f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:55:19.172703 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-281001d5-6072-4f30-b0dc-e668c03168e6 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:19.173161 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-281001d5-6072-4f30-b0dc-e668c03168e6 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:19.173943 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-281001d5-6072-4f30-b0dc-e668c03168e6 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:19.175056 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-281001d5-6072-4f30-b0dc-e668c03168e6 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:19.456919 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-281001d5-6072-4f30-b0dc-e668c03168e6 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "POST /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f/action" status: 202 len: 0 microversion: 2.1 time: 0.302050 Jul 19 23:55:19.457574 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3671/7332] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:55:19 2022] POST /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 19 23:55:24.781540 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-8383696d-fcf5-4f62-b923-e99b8da1d38b req-6bb08e92-4a27-4b0b-8c0b-196cc5b68ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8fa9396-3e02-4e3c-8aca-0fbc1abb244f", "name": "network-vif-plugged", "status": "completed", "tag": "58fcf341-6378-4913-856a-58c69d1412ee"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:55:24.790663 n-d-847009-3 devstack@n-api.service[119338]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f9ad43fa-8ace-4c60-a52f-7afb16c145c7] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 23:55:24.792917 n-d-847009-3 devstack@n-api.service[119338]: ERROR oslo.messaging._drivers.impl_rabbit [-] [33eb9b21-6b86-489c-8081-974c1460dc40] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 23:55:24.793463 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:55:24.794142 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=36 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:55:24.820415 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-8383696d-fcf5-4f62-b923-e99b8da1d38b req-6bb08e92-4a27-4b0b-8c0b-196cc5b68ba7 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:24.821261 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-8383696d-fcf5-4f62-b923-e99b8da1d38b req-6bb08e92-4a27-4b0b-8c0b-196cc5b68ba7 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:24.843413 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-8383696d-fcf5-4f62-b923-e99b8da1d38b req-6bb08e92-4a27-4b0b-8c0b-196cc5b68ba7 service nova] Creating event network-vif-plugged:58fcf341-6378-4913-856a-58c69d1412ee for instance d8fa9396-3e02-4e3c-8aca-0fbc1abb244f on n-h2-847009-3 Jul 19 23:55:24.850709 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-8383696d-fcf5-4f62-b923-e99b8da1d38b req-6bb08e92-4a27-4b0b-8c0b-196cc5b68ba7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076588 Jul 19 23:55:24.852071 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3662/7333] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:55:33.042404 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:55:33.043154 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:55:33.048493 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-4bd1006a-3ddd-43a1-a54d-d9d66a6ea15f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-410866815", "imageRef": "07899bff-8c79-4c4a-b832-b6dcec40c293", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1060441695", "security_groups": [{"name": "tempest-secgroup-smoke-1892883911"}], "networks": [{"uuid": "b0411bf2-7cff-4daf-96bd-a64437c30eda"}]}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:55:33.072265 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] [4d9f90d1-6e88-4978-b2b1-8e2a2dbb4cb7] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 40566. Jul 19 23:55:33.072979 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] [798b565c-2a51-4094-a95e-de275b58674b] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 40568. Jul 19 23:55:33.164489 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.network.neutron [None req-4bd1006a-3ddd-43a1-a54d-d9d66a6ea15f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] validate_networks() for [('b0411bf2-7cff-4daf-96bd-a64437c30eda', None, None, None, None, None)] {{(pid=119337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 23:55:33.604561 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4bd1006a-3ddd-43a1-a54d-d9d66a6ea15f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Flavor limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 23:55:33.605005 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4bd1006a-3ddd-43a1-a54d-d9d66a6ea15f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Image limits 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 23:55:33.605496 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4bd1006a-3ddd-43a1-a54d-d9d66a6ea15f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Flavor pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 23:55:33.605920 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4bd1006a-3ddd-43a1-a54d-d9d66a6ea15f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Image pref 0:0:0 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 23:55:33.606356 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.virt.hardware [None req-4bd1006a-3ddd-43a1-a54d-d9d66a6ea15f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 23:55:33.615457 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4bd1006a-3ddd-43a1-a54d-d9d66a6ea15f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:33.615922 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4bd1006a-3ddd-43a1-a54d-d9d66a6ea15f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:33.616747 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4bd1006a-3ddd-43a1-a54d-d9d66a6ea15f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:33.617191 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-4bd1006a-3ddd-43a1-a54d-d9d66a6ea15f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:33.634560 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-4bd1006a-3ddd-43a1-a54d-d9d66a6ea15f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Getting quotas for project 563ce242cd3e439babb59bb8663a7db6. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 23:55:33.639845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.quota [None req-4bd1006a-3ddd-43a1-a54d-d9d66a6ea15f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Getting quotas for user 24654c4599c4418d80f94eeb264fbae0 and project 563ce242cd3e439babb59bb8663a7db6. Resources: {'cores', 'ram', 'instances'} {{(pid=119337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 23:55:33.652678 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4bd1006a-3ddd-43a1-a54d-d9d66a6ea15f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Going to run 1 instances... {{(pid=119337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 23:55:33.655147 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-4bd1006a-3ddd-43a1-a54d-d9d66a6ea15f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: 4d1686fb-929d-4418-bc65-f419aefc4a71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='07899bff-8c79-4c4a-b832-b6dcec40c293',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 23:55:33.702881 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-4bd1006a-3ddd-43a1-a54d-d9d66a6ea15f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.662747 Jul 19 23:55:33.703707 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3672/7334] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 19 23:55:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 23:55:33.716938 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d7b713a5-d800-432b-a5a0-1a6db9c71351 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:55:33.717772 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d7b713a5-d800-432b-a5a0-1a6db9c71351 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: 4d1686fb-929d-4418-bc65-f419aefc4a71] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:55:33.729509 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [-] [33eb9b21-6b86-489c-8081-974c1460dc40] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 40586. Jul 19 23:55:33.732188 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [-] [f9ad43fa-8ace-4c60-a52f-7afb16c145c7] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 40584. Jul 19 23:55:33.782162 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d7b713a5-d800-432b-a5a0-1a6db9c71351 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:55:33.790876 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d7b713a5-d800-432b-a5a0-1a6db9c71351 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71" status: 200 len: 1248 microversion: 2.1 time: 0.080260 Jul 19 23:55:33.791501 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3663/7335] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:55:33 2022] GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71 => generated 1248 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:55:34.809551 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e00c7a83-af5e-41fc-bb24-0f2083f50c90 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:55:34.811777 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e00c7a83-af5e-41fc-bb24-0f2083f50c90 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: 4d1686fb-929d-4418-bc65-f419aefc4a71] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:55:34.818691 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e00c7a83-af5e-41fc-bb24-0f2083f50c90 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:34.819381 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e00c7a83-af5e-41fc-bb24-0f2083f50c90 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:34.820347 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e00c7a83-af5e-41fc-bb24-0f2083f50c90 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:34.820924 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e00c7a83-af5e-41fc-bb24-0f2083f50c90 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:34.896829 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e00c7a83-af5e-41fc-bb24-0f2083f50c90 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:55:34.905875 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e00c7a83-af5e-41fc-bb24-0f2083f50c90 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71" status: 200 len: 1318 microversion: 2.1 time: 0.101343 Jul 19 23:55:34.906911 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3673/7336] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:55:34 2022] GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71 => generated 1318 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:55:35.924611 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-02e5e5c8-9185-4af1-90d6-33b7afdbb278 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:55:35.925780 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-02e5e5c8-9185-4af1-90d6-33b7afdbb278 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: 4d1686fb-929d-4418-bc65-f419aefc4a71] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:55:35.930836 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:55:35.937333 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02e5e5c8-9185-4af1-90d6-33b7afdbb278 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:35.938059 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02e5e5c8-9185-4af1-90d6-33b7afdbb278 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:35.938853 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02e5e5c8-9185-4af1-90d6-33b7afdbb278 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:35.939326 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-02e5e5c8-9185-4af1-90d6-33b7afdbb278 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:36.086545 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-02e5e5c8-9185-4af1-90d6-33b7afdbb278 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:55:36.094633 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-02e5e5c8-9185-4af1-90d6-33b7afdbb278 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71" status: 200 len: 1374 microversion: 2.1 time: 0.173893 Jul 19 23:55:36.095246 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3664/7337] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:55:35 2022] GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71 => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:55:36.667598 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-ba6ffe7c-725e-4874-90f9-daa413fa83b3 req-6052a4f8-46a0-433d-9925-2e39634d9f12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8fa9396-3e02-4e3c-8aca-0fbc1abb244f", "name": "network-vif-unplugged", "status": "completed", "tag": "58fcf341-6378-4913-856a-58c69d1412ee"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:55:36.678035 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-ba6ffe7c-725e-4874-90f9-daa413fa83b3 req-6052a4f8-46a0-433d-9925-2e39634d9f12 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:36.678786 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-ba6ffe7c-725e-4874-90f9-daa413fa83b3 req-6052a4f8-46a0-433d-9925-2e39634d9f12 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:36.695191 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-ba6ffe7c-725e-4874-90f9-daa413fa83b3 req-6052a4f8-46a0-433d-9925-2e39634d9f12 service nova] Creating event network-vif-unplugged:58fcf341-6378-4913-856a-58c69d1412ee for instance d8fa9396-3e02-4e3c-8aca-0fbc1abb244f on n-h2-847009-3 Jul 19 23:55:36.701049 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-ba6ffe7c-725e-4874-90f9-daa413fa83b3 req-6052a4f8-46a0-433d-9925-2e39634d9f12 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037444 Jul 19 23:55:36.701782 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3674/7338] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:55:37.112061 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b1123332-f473-40a4-b5ff-73ef1ad65471 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:55:37.112678 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-b1123332-f473-40a4-b5ff-73ef1ad65471 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: 4d1686fb-929d-4418-bc65-f419aefc4a71] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:55:37.120039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b1123332-f473-40a4-b5ff-73ef1ad65471 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:37.120538 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b1123332-f473-40a4-b5ff-73ef1ad65471 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:37.121318 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b1123332-f473-40a4-b5ff-73ef1ad65471 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:37.121761 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-b1123332-f473-40a4-b5ff-73ef1ad65471 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:37.286487 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-b1123332-f473-40a4-b5ff-73ef1ad65471 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:55:37.295469 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b1123332-f473-40a4-b5ff-73ef1ad65471 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71" status: 200 len: 1374 microversion: 2.1 time: 0.187208 Jul 19 23:55:37.296084 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3665/7339] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:55:37 2022] GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71 => generated 1374 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:55:38.315795 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-5b97f651-3859-4b67-8a76-0d1128990382 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:55:38.317458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-5b97f651-3859-4b67-8a76-0d1128990382 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: 4d1686fb-929d-4418-bc65-f419aefc4a71] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:55:38.325973 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b97f651-3859-4b67-8a76-0d1128990382 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:38.326614 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b97f651-3859-4b67-8a76-0d1128990382 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:38.327524 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b97f651-3859-4b67-8a76-0d1128990382 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:38.327979 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-5b97f651-3859-4b67-8a76-0d1128990382 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:38.476733 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-5b97f651-3859-4b67-8a76-0d1128990382 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:55:38.484404 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-5b97f651-3859-4b67-8a76-0d1128990382 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71" status: 200 len: 1374 microversion: 2.1 time: 0.174914 Jul 19 23:55:38.485003 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3675/7340] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:55:38 2022] GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71 => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:55:39.502181 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-a967c336-8941-4759-825e-546c82ec5e3c tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:55:39.502814 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-a967c336-8941-4759-825e-546c82ec5e3c tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: 4d1686fb-929d-4418-bc65-f419aefc4a71] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:55:39.511245 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a967c336-8941-4759-825e-546c82ec5e3c tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:39.511954 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a967c336-8941-4759-825e-546c82ec5e3c tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:39.512918 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a967c336-8941-4759-825e-546c82ec5e3c tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:39.513524 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-a967c336-8941-4759-825e-546c82ec5e3c tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:39.673377 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-a967c336-8941-4759-825e-546c82ec5e3c tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:55:39.682044 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-a967c336-8941-4759-825e-546c82ec5e3c tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71" status: 200 len: 1374 microversion: 2.1 time: 0.184338 Jul 19 23:55:39.690769 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3666/7341] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:55:39 2022] GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71 => generated 1374 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:55:40.700174 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e56a8610-e193-4532-b65a-1473bf160d66 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:55:40.700968 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e56a8610-e193-4532-b65a-1473bf160d66 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: 4d1686fb-929d-4418-bc65-f419aefc4a71] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:55:40.708069 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e56a8610-e193-4532-b65a-1473bf160d66 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:40.709804 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e56a8610-e193-4532-b65a-1473bf160d66 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:40.710646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e56a8610-e193-4532-b65a-1473bf160d66 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:40.711135 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e56a8610-e193-4532-b65a-1473bf160d66 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:40.900559 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e56a8610-e193-4532-b65a-1473bf160d66 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:55:40.910079 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e56a8610-e193-4532-b65a-1473bf160d66 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71" status: 200 len: 1374 microversion: 2.1 time: 0.214025 Jul 19 23:55:40.910667 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3676/7342] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:55:40 2022] GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71 => generated 1374 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:55:41.931978 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-4974238e-5bbe-4512-9abf-48f36929fbc1 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:55:41.933589 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-4974238e-5bbe-4512-9abf-48f36929fbc1 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: 4d1686fb-929d-4418-bc65-f419aefc4a71] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:55:41.942047 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4974238e-5bbe-4512-9abf-48f36929fbc1 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:41.942644 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4974238e-5bbe-4512-9abf-48f36929fbc1 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:41.943816 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4974238e-5bbe-4512-9abf-48f36929fbc1 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:41.944409 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-4974238e-5bbe-4512-9abf-48f36929fbc1 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:42.103970 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-4974238e-5bbe-4512-9abf-48f36929fbc1 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:55:42.113237 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-4974238e-5bbe-4512-9abf-48f36929fbc1 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71" status: 200 len: 1374 microversion: 2.1 time: 0.188022 Jul 19 23:55:42.114125 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3667/7343] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:55:41 2022] GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71 => generated 1374 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:55:43.131967 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e922f6ca-6908-414f-9710-ae4ccfb17e5f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:55:43.132612 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e922f6ca-6908-414f-9710-ae4ccfb17e5f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: 4d1686fb-929d-4418-bc65-f419aefc4a71] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:55:43.139625 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e922f6ca-6908-414f-9710-ae4ccfb17e5f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:43.140093 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e922f6ca-6908-414f-9710-ae4ccfb17e5f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:43.140878 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e922f6ca-6908-414f-9710-ae4ccfb17e5f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:43.141334 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e922f6ca-6908-414f-9710-ae4ccfb17e5f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:43.624384 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:55:43.646646 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell0:SELECT=6 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:55:43.730284 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e922f6ca-6908-414f-9710-ae4ccfb17e5f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:55:43.737795 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e922f6ca-6908-414f-9710-ae4ccfb17e5f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71" status: 200 len: 1374 microversion: 2.1 time: 0.610340 Jul 19 23:55:43.738378 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3677/7344] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:55:43 2022] GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71 => generated 1374 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:55:44.047905 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-1549d5ae-4e6f-4c1c-b242-4dfae8b22ed9 req-6c2643be-73bf-426a-aca9-2266b2d8b5d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d1686fb-929d-4418-bc65-f419aefc4a71", "tag": "4cf964e9-0a87-4e09-b347-e25fa602820e"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:55:44.052217 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell0:SELECT=2 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:55:44.061749 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-1549d5ae-4e6f-4c1c-b242-4dfae8b22ed9 req-6c2643be-73bf-426a-aca9-2266b2d8b5d2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:44.062183 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-1549d5ae-4e6f-4c1c-b242-4dfae8b22ed9 req-6c2643be-73bf-426a-aca9-2266b2d8b5d2 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:44.080832 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-1549d5ae-4e6f-4c1c-b242-4dfae8b22ed9 req-6c2643be-73bf-426a-aca9-2266b2d8b5d2 service nova] Creating event network-changed:4cf964e9-0a87-4e09-b347-e25fa602820e for instance 4d1686fb-929d-4418-bc65-f419aefc4a71 on n-h1-847009-3 Jul 19 23:55:44.092040 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-1549d5ae-4e6f-4c1c-b242-4dfae8b22ed9 req-6c2643be-73bf-426a-aca9-2266b2d8b5d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051453 Jul 19 23:55:44.092980 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3668/7345] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:55:44.755706 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8d8dd19b-c701-4b5b-adad-0a80106847da tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:55:44.756265 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8d8dd19b-c701-4b5b-adad-0a80106847da tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: 4d1686fb-929d-4418-bc65-f419aefc4a71] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:55:44.763084 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8d8dd19b-c701-4b5b-adad-0a80106847da tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:44.763578 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8d8dd19b-c701-4b5b-adad-0a80106847da tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:44.764360 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8d8dd19b-c701-4b5b-adad-0a80106847da tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:44.764845 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8d8dd19b-c701-4b5b-adad-0a80106847da tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:44.905232 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-8d8dd19b-c701-4b5b-adad-0a80106847da tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:55:44.913453 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8d8dd19b-c701-4b5b-adad-0a80106847da tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71" status: 200 len: 1374 microversion: 2.1 time: 0.161904 Jul 19 23:55:44.914039 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3678/7346] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:55:44 2022] GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:55:45.932938 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-36f466a8-8642-4496-af11-4960141faad0 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:55:45.934169 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-36f466a8-8642-4496-af11-4960141faad0 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: 4d1686fb-929d-4418-bc65-f419aefc4a71] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:55:45.940086 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-36f466a8-8642-4496-af11-4960141faad0 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:45.940538 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-36f466a8-8642-4496-af11-4960141faad0 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:45.941312 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-36f466a8-8642-4496-af11-4960141faad0 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:45.942014 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-36f466a8-8642-4496-af11-4960141faad0 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:46.162874 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-36f466a8-8642-4496-af11-4960141faad0 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:55:46.170817 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-36f466a8-8642-4496-af11-4960141faad0 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71" status: 200 len: 1374 microversion: 2.1 time: 0.244323 Jul 19 23:55:46.171439 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3669/7347] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:55:45 2022] GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71 => generated 1374 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:55:47.188261 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-67e35aa4-2475-43d9-8d08-d7d64673b90e tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:55:47.188897 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-67e35aa4-2475-43d9-8d08-d7d64673b90e tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: 4d1686fb-929d-4418-bc65-f419aefc4a71] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:55:47.196617 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67e35aa4-2475-43d9-8d08-d7d64673b90e tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:47.197083 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67e35aa4-2475-43d9-8d08-d7d64673b90e tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:47.197865 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67e35aa4-2475-43d9-8d08-d7d64673b90e tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:47.198320 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-67e35aa4-2475-43d9-8d08-d7d64673b90e tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:47.333488 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-67e35aa4-2475-43d9-8d08-d7d64673b90e tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:55:47.341681 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-67e35aa4-2475-43d9-8d08-d7d64673b90e tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71" status: 200 len: 1374 microversion: 2.1 time: 0.157321 Jul 19 23:55:47.342259 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3679/7348] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:55:47 2022] GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:55:48.357860 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d680616b-10b4-4cfa-af3c-660af3857dca tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:55:48.358472 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d680616b-10b4-4cfa-af3c-660af3857dca tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: 4d1686fb-929d-4418-bc65-f419aefc4a71] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:55:48.366164 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d680616b-10b4-4cfa-af3c-660af3857dca tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:48.366614 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d680616b-10b4-4cfa-af3c-660af3857dca tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:48.367407 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d680616b-10b4-4cfa-af3c-660af3857dca tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:48.367844 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d680616b-10b4-4cfa-af3c-660af3857dca tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:48.506701 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d680616b-10b4-4cfa-af3c-660af3857dca tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:55:48.514378 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d680616b-10b4-4cfa-af3c-660af3857dca tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71" status: 200 len: 1374 microversion: 2.1 time: 0.160458 Jul 19 23:55:48.514985 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3670/7349] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:55:48 2022] GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:55:49.483510 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-dfe20f9b-e69d-44be-a15d-95fdd7547307 req-81352f68-26a1-4068-8547-74acb78f338b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d1686fb-929d-4418-bc65-f419aefc4a71", "name": "network-vif-plugged", "status": "completed", "tag": "4cf964e9-0a87-4e09-b347-e25fa602820e"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:55:49.494287 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-dfe20f9b-e69d-44be-a15d-95fdd7547307 req-81352f68-26a1-4068-8547-74acb78f338b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:49.494745 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-dfe20f9b-e69d-44be-a15d-95fdd7547307 req-81352f68-26a1-4068-8547-74acb78f338b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:49.506498 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-dfe20f9b-e69d-44be-a15d-95fdd7547307 req-81352f68-26a1-4068-8547-74acb78f338b service nova] Creating event network-vif-plugged:4cf964e9-0a87-4e09-b347-e25fa602820e for instance 4d1686fb-929d-4418-bc65-f419aefc4a71 on n-h1-847009-3 Jul 19 23:55:49.511679 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-dfe20f9b-e69d-44be-a15d-95fdd7547307 req-81352f68-26a1-4068-8547-74acb78f338b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032298 Jul 19 23:55:49.512281 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3680/7350] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:55:49.531971 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-71e76a32-e6c2-4f09-9243-625a0e99f99f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:55:49.532760 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-71e76a32-e6c2-4f09-9243-625a0e99f99f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: 4d1686fb-929d-4418-bc65-f419aefc4a71] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:55:49.540754 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71e76a32-e6c2-4f09-9243-625a0e99f99f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:49.541206 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71e76a32-e6c2-4f09-9243-625a0e99f99f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:49.541986 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71e76a32-e6c2-4f09-9243-625a0e99f99f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:49.542541 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-71e76a32-e6c2-4f09-9243-625a0e99f99f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:49.746340 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-71e76a32-e6c2-4f09-9243-625a0e99f99f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:55:49.754076 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-71e76a32-e6c2-4f09-9243-625a0e99f99f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71" status: 200 len: 1374 microversion: 2.1 time: 0.225938 Jul 19 23:55:49.754660 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3671/7351] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:55:49 2022] GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71 => generated 1374 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:55:50.773492 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-93725bfd-67f4-4cee-b589-691afd6bdb94 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:55:50.774220 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-93725bfd-67f4-4cee-b589-691afd6bdb94 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: 4d1686fb-929d-4418-bc65-f419aefc4a71] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:55:50.781034 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-93725bfd-67f4-4cee-b589-691afd6bdb94 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:50.781502 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-93725bfd-67f4-4cee-b589-691afd6bdb94 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:50.782302 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-93725bfd-67f4-4cee-b589-691afd6bdb94 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:50.782760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-93725bfd-67f4-4cee-b589-691afd6bdb94 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:50.918848 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-93725bfd-67f4-4cee-b589-691afd6bdb94 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:55:50.926822 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-93725bfd-67f4-4cee-b589-691afd6bdb94 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71" status: 200 len: 1374 microversion: 2.1 time: 0.159038 Jul 19 23:55:50.928107 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3681/7352] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:55:50 2022] GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:55:51.946235 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-06b18da5-cf24-4b32-8c0e-ce3c15b73939 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:55:51.946753 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-06b18da5-cf24-4b32-8c0e-ce3c15b73939 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: 4d1686fb-929d-4418-bc65-f419aefc4a71] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:55:51.953789 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-06b18da5-cf24-4b32-8c0e-ce3c15b73939 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:51.954249 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-06b18da5-cf24-4b32-8c0e-ce3c15b73939 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:51.955024 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-06b18da5-cf24-4b32-8c0e-ce3c15b73939 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:51.955500 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-06b18da5-cf24-4b32-8c0e-ce3c15b73939 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:52.094488 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-06b18da5-cf24-4b32-8c0e-ce3c15b73939 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:55:52.102489 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-06b18da5-cf24-4b32-8c0e-ce3c15b73939 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71" status: 200 len: 1558 microversion: 2.1 time: 0.161135 Jul 19 23:55:52.103060 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3672/7353] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:55:51 2022] GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:55:52.120193 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-e065b291-3a43-4f84-9ce7-b4773c30ecbf tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:55:52.120836 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-e065b291-3a43-4f84-9ce7-b4773c30ecbf tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: 4d1686fb-929d-4418-bc65-f419aefc4a71] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:55:52.126946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e065b291-3a43-4f84-9ce7-b4773c30ecbf tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:52.127458 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e065b291-3a43-4f84-9ce7-b4773c30ecbf tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:52.128245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e065b291-3a43-4f84-9ce7-b4773c30ecbf tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:52.128702 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-e065b291-3a43-4f84-9ce7-b4773c30ecbf tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:52.261213 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-e065b291-3a43-4f84-9ce7-b4773c30ecbf tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:55:52.268780 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-e065b291-3a43-4f84-9ce7-b4773c30ecbf tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71" status: 200 len: 1558 microversion: 2.1 time: 0.154110 Jul 19 23:55:52.269351 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3682/7354] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:55:52 2022] GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:55:53.884700 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-9847f4b9-b6a5-4ffb-94ff-5e106e332d59 req-0d510a4f-8ac8-4795-b240-7b3bba0ec9f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d1686fb-929d-4418-bc65-f419aefc4a71", "tag": "4cf964e9-0a87-4e09-b347-e25fa602820e"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:55:53.893633 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-9847f4b9-b6a5-4ffb-94ff-5e106e332d59 req-0d510a4f-8ac8-4795-b240-7b3bba0ec9f3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:55:53.894078 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-9847f4b9-b6a5-4ffb-94ff-5e106e332d59 req-0d510a4f-8ac8-4795-b240-7b3bba0ec9f3 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:55:53.905729 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-9847f4b9-b6a5-4ffb-94ff-5e106e332d59 req-0d510a4f-8ac8-4795-b240-7b3bba0ec9f3 service nova] Creating event network-changed:4cf964e9-0a87-4e09-b347-e25fa602820e for instance 4d1686fb-929d-4418-bc65-f419aefc4a71 on n-h1-847009-3 Jul 19 23:55:53.911313 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-9847f4b9-b6a5-4ffb-94ff-5e106e332d59 req-0d510a4f-8ac8-4795-b240-7b3bba0ec9f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030888 Jul 19 23:55:53.913601 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3673/7355] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:57:23.109784 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:57:23.110554 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=54 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:57:23.114777 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-0beaf6fc-bd2a-4bce-a339-ff4481d87d7a tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1988578920"}} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:57:23.115904 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-0beaf6fc-bd2a-4bce-a339-ff4481d87d7a tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: 4d1686fb-929d-4418-bc65-f419aefc4a71] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:57:23.124245 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0beaf6fc-bd2a-4bce-a339-ff4481d87d7a tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:23.124710 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0beaf6fc-bd2a-4bce-a339-ff4481d87d7a tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:23.125503 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0beaf6fc-bd2a-4bce-a339-ff4481d87d7a tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:23.125955 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-0beaf6fc-bd2a-4bce-a339-ff4481d87d7a tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:23.408676 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-0beaf6fc-bd2a-4bce-a339-ff4481d87d7a tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "POST /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71/action" status: 202 len: 0 microversion: 2.1 time: 0.300659 Jul 19 23:57:23.409243 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3683/7356] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 19 23:57:23 2022] POST /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 19 23:57:30.042541 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_api:SELECT=26 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:57:30.044131 n-d-847009-3 devstack@n-api.service[119338]: DEBUG dbcounter [-] [119338] Writing DB stats nova_cell1:SELECT=52 {{(pid=119338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:57:30.158088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-0f7de94e-a268-4cf8-ab1d-233705004760 req-2c5db480-def4-4010-8d5e-21df22ce8d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d1686fb-929d-4418-bc65-f419aefc4a71", "name": "network-vif-plugged", "status": "completed", "tag": "4cf964e9-0a87-4e09-b347-e25fa602820e"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:57:30.170293 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0f7de94e-a268-4cf8-ab1d-233705004760 req-2c5db480-def4-4010-8d5e-21df22ce8d86 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:30.171013 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-0f7de94e-a268-4cf8-ab1d-233705004760 req-2c5db480-def4-4010-8d5e-21df22ce8d86 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:30.184166 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-0f7de94e-a268-4cf8-ab1d-233705004760 req-2c5db480-def4-4010-8d5e-21df22ce8d86 service nova] Creating event network-vif-plugged:4cf964e9-0a87-4e09-b347-e25fa602820e for instance 4d1686fb-929d-4418-bc65-f419aefc4a71 on n-h1-847009-3 Jul 19 23:57:30.191685 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-0f7de94e-a268-4cf8-ab1d-233705004760 req-2c5db480-def4-4010-8d5e-21df22ce8d86 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152414 Jul 19 23:57:30.192726 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3674/7357] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:57:38.395861 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-731cc6b6-e267-4d30-8b91-bf7ee7e7469c req-f18f71b5-63cc-4098-9864-0f1f6893c50b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d1686fb-929d-4418-bc65-f419aefc4a71", "tag": "4cf964e9-0a87-4e09-b347-e25fa602820e"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:57:38.397455 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_api:SELECT=2 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:57:38.398349 n-d-847009-3 devstack@n-api.service[119337]: DEBUG dbcounter [-] [119337] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 23:57:38.403968 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-8f9727cb-957e-4d3b-8bfd-48b29ce0bb17 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:57:38.404881 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8f9727cb-957e-4d3b-8bfd-48b29ce0bb17 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: 4d1686fb-929d-4418-bc65-f419aefc4a71] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:57:38.416287 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-731cc6b6-e267-4d30-8b91-bf7ee7e7469c req-f18f71b5-63cc-4098-9864-0f1f6893c50b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:38.416794 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-731cc6b6-e267-4d30-8b91-bf7ee7e7469c req-f18f71b5-63cc-4098-9864-0f1f6893c50b service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:38.418640 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f9727cb-957e-4d3b-8bfd-48b29ce0bb17 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:38.419332 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f9727cb-957e-4d3b-8bfd-48b29ce0bb17 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:38.420418 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f9727cb-957e-4d3b-8bfd-48b29ce0bb17 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:38.421348 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-8f9727cb-957e-4d3b-8bfd-48b29ce0bb17 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:38.429100 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-731cc6b6-e267-4d30-8b91-bf7ee7e7469c req-f18f71b5-63cc-4098-9864-0f1f6893c50b service nova] Creating event network-changed:4cf964e9-0a87-4e09-b347-e25fa602820e for instance 4d1686fb-929d-4418-bc65-f419aefc4a71 on n-h1-847009-3 Jul 19 23:57:38.435907 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-731cc6b6-e267-4d30-8b91-bf7ee7e7469c req-f18f71b5-63cc-4098-9864-0f1f6893c50b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045171 Jul 19 23:57:38.436516 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3675/7358] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:57:38.457007 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-8f9727cb-957e-4d3b-8bfd-48b29ce0bb17 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: 4d1686fb-929d-4418-bc65-f419aefc4a71] Going to try to terminate instance {{(pid=119337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:57:38.550151 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-8f9727cb-957e-4d3b-8bfd-48b29ce0bb17 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71" status: 204 len: 0 microversion: 2.1 time: 0.161757 Jul 19 23:57:38.552128 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3684/7359] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:57:38 2022] DELETE /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 23:57:38.562619 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-0071ac11-a227-414c-911a-df54f6a5f6c8 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:57:38.563609 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-0071ac11-a227-414c-911a-df54f6a5f6c8 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: 4d1686fb-929d-4418-bc65-f419aefc4a71] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:57:38.574458 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0071ac11-a227-414c-911a-df54f6a5f6c8 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:38.574912 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0071ac11-a227-414c-911a-df54f6a5f6c8 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:38.575731 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0071ac11-a227-414c-911a-df54f6a5f6c8 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:38.576168 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-0071ac11-a227-414c-911a-df54f6a5f6c8 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:38.724121 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-0071ac11-a227-414c-911a-df54f6a5f6c8 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:57:38.732449 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-0071ac11-a227-414c-911a-df54f6a5f6c8 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71" status: 200 len: 1683 microversion: 2.1 time: 0.174217 Jul 19 23:57:38.733050 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3676/7360] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:57:38 2022] GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:57:39.750601 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-15b2633f-0cf6-4772-ae43-a2c5fbea56df tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:57:39.751256 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-15b2633f-0cf6-4772-ae43-a2c5fbea56df tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: 4d1686fb-929d-4418-bc65-f419aefc4a71] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:57:39.758122 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-15b2633f-0cf6-4772-ae43-a2c5fbea56df tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:39.759285 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-15b2633f-0cf6-4772-ae43-a2c5fbea56df tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:39.760073 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-15b2633f-0cf6-4772-ae43-a2c5fbea56df tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:39.760525 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-15b2633f-0cf6-4772-ae43-a2c5fbea56df tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:39.897570 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-15b2633f-0cf6-4772-ae43-a2c5fbea56df tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:57:39.905177 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-15b2633f-0cf6-4772-ae43-a2c5fbea56df tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71" status: 200 len: 1683 microversion: 2.1 time: 0.158979 Jul 19 23:57:39.905746 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3685/7361] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:57:39 2022] GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:57:40.062469 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [req-d4d03f68-814b-418b-9c91-4077199821c1 req-f0a0e245-e42b-4b13-8e75-f9df0dbf7014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d1686fb-929d-4418-bc65-f419aefc4a71", "name": "network-vif-unplugged", "status": "completed", "tag": "4cf964e9-0a87-4e09-b347-e25fa602820e"}]} {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:57:40.073445 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d4d03f68-814b-418b-9c91-4077199821c1 req-f0a0e245-e42b-4b13-8e75-f9df0dbf7014 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:40.074908 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [req-d4d03f68-814b-418b-9c91-4077199821c1 req-f0a0e245-e42b-4b13-8e75-f9df0dbf7014 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:40.087025 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.compute.server_external_events [req-d4d03f68-814b-418b-9c91-4077199821c1 req-f0a0e245-e42b-4b13-8e75-f9df0dbf7014 service nova] Creating event network-vif-unplugged:4cf964e9-0a87-4e09-b347-e25fa602820e for instance 4d1686fb-929d-4418-bc65-f419aefc4a71 on n-h1-847009-3 Jul 19 23:57:40.092322 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [req-d4d03f68-814b-418b-9c91-4077199821c1 req-f0a0e245-e42b-4b13-8e75-f9df0dbf7014 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034189 Jul 19 23:57:40.092923 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3677/7362] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:57:40.896038 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-1081b2a3-2f48-4484-b42d-24aff2dfcb92 req-d4953dac-f2d4-48fb-8399-fba9ed822ead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d1686fb-929d-4418-bc65-f419aefc4a71", "name": "network-vif-deleted", "tag": "4cf964e9-0a87-4e09-b347-e25fa602820e"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:57:40.906288 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1081b2a3-2f48-4484-b42d-24aff2dfcb92 req-d4953dac-f2d4-48fb-8399-fba9ed822ead service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:40.906755 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-1081b2a3-2f48-4484-b42d-24aff2dfcb92 req-d4953dac-f2d4-48fb-8399-fba9ed822ead service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:40.920262 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-1081b2a3-2f48-4484-b42d-24aff2dfcb92 req-d4953dac-f2d4-48fb-8399-fba9ed822ead service nova] Creating event network-vif-deleted:4cf964e9-0a87-4e09-b347-e25fa602820e for instance 4d1686fb-929d-4418-bc65-f419aefc4a71 on n-h1-847009-3 Jul 19 23:57:40.922747 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-d254b871-36d1-4c23-9c34-be84081b7720 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:57:40.923857 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-d254b871-36d1-4c23-9c34-be84081b7720 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: 4d1686fb-929d-4418-bc65-f419aefc4a71] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:57:40.925885 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-1081b2a3-2f48-4484-b42d-24aff2dfcb92 req-d4953dac-f2d4-48fb-8399-fba9ed822ead service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097918 Jul 19 23:57:40.926496 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3686/7363] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:57:40.930704 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d254b871-36d1-4c23-9c34-be84081b7720 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:40.931178 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d254b871-36d1-4c23-9c34-be84081b7720 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:40.932078 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d254b871-36d1-4c23-9c34-be84081b7720 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:40.932513 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d254b871-36d1-4c23-9c34-be84081b7720 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:40.966149 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d254b871-36d1-4c23-9c34-be84081b7720 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:40.966593 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-d254b871-36d1-4c23-9c34-be84081b7720 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:40.967039 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-d254b871-36d1-4c23-9c34-be84081b7720 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lazy-loading 'fault' on Instance uuid 4d1686fb-929d-4418-bc65-f419aefc4a71 {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:57:41.010026 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-d254b871-36d1-4c23-9c34-be84081b7720 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:57:41.017507 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-d254b871-36d1-4c23-9c34-be84081b7720 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71" status: 200 len: 1338 microversion: 2.1 time: 0.099083 Jul 19 23:57:41.018081 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3678/7364] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:57:40 2022] GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71 => generated 1338 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 23:57:42.036298 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6bd8c1fc-0d43-44d3-873e-4e7a72061e30 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:57:42.037054 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-6bd8c1fc-0d43-44d3-873e-4e7a72061e30 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: 4d1686fb-929d-4418-bc65-f419aefc4a71] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:57:42.044924 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6bd8c1fc-0d43-44d3-873e-4e7a72061e30 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:42.045417 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6bd8c1fc-0d43-44d3-873e-4e7a72061e30 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:42.046191 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6bd8c1fc-0d43-44d3-873e-4e7a72061e30 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:42.046639 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-6bd8c1fc-0d43-44d3-873e-4e7a72061e30 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:42.060826 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-6bd8c1fc-0d43-44d3-873e-4e7a72061e30 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] HTTP exception thrown: Instance 4d1686fb-929d-4418-bc65-f419aefc4a71 could not be found. Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6bd8c1fc-0d43-44d3-873e-4e7a72061e30 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Request method failure captured: Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71 HTTP/1.1 Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi10PcYzQbsGEeXJSJiMJ5QmbePTSneLPpiZSN3m-4NaZkwjqkpUI4V0FxgE2bQotuqAjjr9PKBbOswYFEuma5AHRuDpxcIqzzDOErYenauMKwcZZr2FTQ5x0xyONQ7TVb3WoZc0pVZnohVXO8HCeZ7NbHDOJORrXUYmCw2BIDasykJ8w Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 563ce242cd3e439babb59bb8663a7db6 Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-TestSnapshotPattern-107316112 Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_563ce242cd3e439babb59bb8663a7db6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/563ce242cd3e439babb59bb8663a7db6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/563ce242cd3e439babb59bb8663a7db6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/563ce242cd3e439babb59bb8663a7db6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-TestSnapshotPattern-107316112 Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 563ce242cd3e439babb59bb8663a7db6 Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-TestSnapshotPattern-107316112 Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-TestSnapshotPattern-107316112-project Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 24654c4599c4418d80f94eeb264fbae0 Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-TestSnapshotPattern-107316112-project Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance 4d1686fb-929d-4418-bc65-f419aefc4a71 could not be found. Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': '4d1686fb-929d-4418-bc65-f419aefc4a71'} Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d1686fb-929d-4418-bc65-f419aefc4a71 could not be found. Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d1686fb-929d-4418-bc65-f419aefc4a71 could not be found. Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:57:42.062466 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:57:42.067199 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:57:42.067199 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:57:42.067199 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:57:42.067199 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:57:42.067199 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:57:42.067199 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d1686fb-929d-4418-bc65-f419aefc4a71 could not be found. Jul 19 23:57:42.067199 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:57:42.067199 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-6bd8c1fc-0d43-44d3-873e-4e7a72061e30 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Returning 404 to user: Instance 4d1686fb-929d-4418-bc65-f419aefc4a71 could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:57:42.067199 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-6bd8c1fc-0d43-44d3-873e-4e7a72061e30 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71" status: 404 len: 111 microversion: 2.1 time: 0.031798 Jul 19 23:57:42.067199 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3687/7365] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:57:42 2022] GET /compute/v2.1/servers/4d1686fb-929d-4418-bc65-f419aefc4a71 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:57:43.407195 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-cc46e2b7-4529-4509-ad1a-2020edd55984 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:57:43.408152 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cc46e2b7-4529-4509-ad1a-2020edd55984 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: d8fa9396-3e02-4e3c-8aca-0fbc1abb244f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:57:43.409760 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-60d00ba7-be15-428e-b38a-048ae3f56e68 req-c58508d3-30bc-47fd-997f-a6ffb9d06916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8fa9396-3e02-4e3c-8aca-0fbc1abb244f", "tag": "58fcf341-6378-4913-856a-58c69d1412ee"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:57:43.415603 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc46e2b7-4529-4509-ad1a-2020edd55984 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:43.417003 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc46e2b7-4529-4509-ad1a-2020edd55984 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:43.418128 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc46e2b7-4529-4509-ad1a-2020edd55984 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:43.418809 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-cc46e2b7-4529-4509-ad1a-2020edd55984 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:43.420387 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-60d00ba7-be15-428e-b38a-048ae3f56e68 req-c58508d3-30bc-47fd-997f-a6ffb9d06916 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:43.420839 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-60d00ba7-be15-428e-b38a-048ae3f56e68 req-c58508d3-30bc-47fd-997f-a6ffb9d06916 service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:43.431603 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-60d00ba7-be15-428e-b38a-048ae3f56e68 req-c58508d3-30bc-47fd-997f-a6ffb9d06916 service nova] Creating event network-changed:58fcf341-6378-4913-856a-58c69d1412ee for instance d8fa9396-3e02-4e3c-8aca-0fbc1abb244f on n-h2-847009-3 Jul 19 23:57:43.438961 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-60d00ba7-be15-428e-b38a-048ae3f56e68 req-c58508d3-30bc-47fd-997f-a6ffb9d06916 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032807 Jul 19 23:57:43.439953 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3688/7366] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 23:57:43.447759 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-cc46e2b7-4529-4509-ad1a-2020edd55984 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: d8fa9396-3e02-4e3c-8aca-0fbc1abb244f] Going to try to terminate instance {{(pid=119338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 23:57:43.546603 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-cc46e2b7-4529-4509-ad1a-2020edd55984 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f" status: 204 len: 0 microversion: 2.1 time: 0.143182 Jul 19 23:57:43.547869 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3679/7367] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 19 23:57:43 2022] DELETE /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 23:57:43.558814 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-7faef243-04a4-45ff-9416-98c6aadf5a47 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:57:43.560037 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-7faef243-04a4-45ff-9416-98c6aadf5a47 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: d8fa9396-3e02-4e3c-8aca-0fbc1abb244f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:57:43.566866 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7faef243-04a4-45ff-9416-98c6aadf5a47 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:43.567799 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7faef243-04a4-45ff-9416-98c6aadf5a47 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:43.568707 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7faef243-04a4-45ff-9416-98c6aadf5a47 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:43.569367 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-7faef243-04a4-45ff-9416-98c6aadf5a47 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:43.721813 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.policy [None req-7faef243-04a4-45ff-9416-98c6aadf5a47 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119337) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:57:43.731012 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-7faef243-04a4-45ff-9416-98c6aadf5a47 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f" status: 200 len: 1683 microversion: 2.1 time: 0.178482 Jul 19 23:57:43.731662 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3689/7368] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:57:43 2022] GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f => generated 1683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:57:44.751479 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-bd02ab23-8c2b-44a0-92ec-96c19c7fcd54 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:57:44.752104 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-bd02ab23-8c2b-44a0-92ec-96c19c7fcd54 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: d8fa9396-3e02-4e3c-8aca-0fbc1abb244f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:57:44.759408 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bd02ab23-8c2b-44a0-92ec-96c19c7fcd54 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:44.760338 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bd02ab23-8c2b-44a0-92ec-96c19c7fcd54 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:44.761480 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bd02ab23-8c2b-44a0-92ec-96c19c7fcd54 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:44.761921 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-bd02ab23-8c2b-44a0-92ec-96c19c7fcd54 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:44.916916 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-bd02ab23-8c2b-44a0-92ec-96c19c7fcd54 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:57:44.925041 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-bd02ab23-8c2b-44a0-92ec-96c19c7fcd54 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f" status: 200 len: 1683 microversion: 2.1 time: 0.178832 Jul 19 23:57:44.925637 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3680/7369] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:57:44 2022] GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f => generated 1683 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:57:45.794990 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [req-a96685ae-aac9-471f-8b10-1892b5d252a4 req-45e8bc0c-c26e-42d3-854a-dd5bafe7b8bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8fa9396-3e02-4e3c-8aca-0fbc1abb244f", "name": "network-vif-deleted", "tag": "58fcf341-6378-4913-856a-58c69d1412ee"}]} {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 23:57:45.806567 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a96685ae-aac9-471f-8b10-1892b5d252a4 req-45e8bc0c-c26e-42d3-854a-dd5bafe7b8bc service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:45.807596 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [req-a96685ae-aac9-471f-8b10-1892b5d252a4 req-45e8bc0c-c26e-42d3-854a-dd5bafe7b8bc service nova] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:45.819913 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.compute.server_external_events [req-a96685ae-aac9-471f-8b10-1892b5d252a4 req-45e8bc0c-c26e-42d3-854a-dd5bafe7b8bc service nova] Creating event network-vif-deleted:58fcf341-6378-4913-856a-58c69d1412ee for instance d8fa9396-3e02-4e3c-8aca-0fbc1abb244f on n-h2-847009-3 Jul 19 23:57:45.826930 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [req-a96685ae-aac9-471f-8b10-1892b5d252a4 req-45e8bc0c-c26e-42d3-854a-dd5bafe7b8bc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036379 Jul 19 23:57:45.827570 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3690/7370] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 19 23:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 23:57:45.946407 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-c016001c-c5f2-4ef3-b1d7-961584a6a17f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:57:45.947175 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.compute.api [None req-c016001c-c5f2-4ef3-b1d7-961584a6a17f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: d8fa9396-3e02-4e3c-8aca-0fbc1abb244f] Fetching instance by UUID {{(pid=119338) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:57:45.955625 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c016001c-c5f2-4ef3-b1d7-961584a6a17f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:45.956088 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c016001c-c5f2-4ef3-b1d7-961584a6a17f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:45.956869 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c016001c-c5f2-4ef3-b1d7-961584a6a17f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:45.957311 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c016001c-c5f2-4ef3-b1d7-961584a6a17f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:45.995991 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c016001c-c5f2-4ef3-b1d7-961584a6a17f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:45.996446 n-d-847009-3 devstack@n-api.service[119338]: DEBUG oslo_concurrency.lockutils [None req-c016001c-c5f2-4ef3-b1d7-961584a6a17f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:45.996914 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.objects.instance [None req-c016001c-c5f2-4ef3-b1d7-961584a6a17f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lazy-loading 'fault' on Instance uuid d8fa9396-3e02-4e3c-8aca-0fbc1abb244f {{(pid=119338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 23:57:46.043700 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.policy [None req-c016001c-c5f2-4ef3-b1d7-961584a6a17f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24654c4599c4418d80f94eeb264fbae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ce242cd3e439babb59bb8663a7db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119338) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 23:57:46.051387 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-c016001c-c5f2-4ef3-b1d7-961584a6a17f tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f" status: 200 len: 1338 microversion: 2.1 time: 0.108824 Jul 19 23:57:46.051965 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3681/7371] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:57:45 2022] GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f => generated 1338 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 23:57:47.071135 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d3d4e1f6-7ace-4128-8864-892ecbf905c5 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '>' {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:57:47.071867 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.compute.api [None req-d3d4e1f6-7ace-4128-8864-892ecbf905c5 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] [instance: d8fa9396-3e02-4e3c-8aca-0fbc1abb244f] Fetching instance by UUID {{(pid=119337) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 23:57:47.079697 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d3d4e1f6-7ace-4128-8864-892ecbf905c5 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:47.080169 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d3d4e1f6-7ace-4128-8864-892ecbf905c5 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:47.080946 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d3d4e1f6-7ace-4128-8864-892ecbf905c5 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 23:57:47.081403 n-d-847009-3 devstack@n-api.service[119337]: DEBUG oslo_concurrency.lockutils [None req-d3d4e1f6-7ace-4128-8864-892ecbf905c5 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Lock "c9ec50c5-1e53-4d76-a6eb-599548551fc7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 23:57:47.095423 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.wsgi [None req-d3d4e1f6-7ace-4128-8864-892ecbf905c5 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] HTTP exception thrown: Instance d8fa9396-3e02-4e3c-8aca-0fbc1abb244f could not be found. Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d3d4e1f6-7ace-4128-8864-892ecbf905c5 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Request method failure captured: Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: request: GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f HTTP/1.1 Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: Accept: application/json Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: Accept-Encoding: identity Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: Connection: close Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: Content-Length: 0 Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: Content-Type: application/json Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: Host: 10.222.0.25 Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: Openstack-System-Scope: None Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: User-Agent: python-urllib3/1.26.9 Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: X-Auth-Token: gAAAAABi10PcYzQbsGEeXJSJiMJ5QmbePTSneLPpiZSN3m-4NaZkwjqkpUI4V0FxgE2bQotuqAjjr9PKBbOswYFEuma5AHRuDpxcIqzzDOErYenauMKwcZZr2FTQ5x0xyONQ7TVb3WoZc0pVZnohVXO8HCeZ7NbHDOJORrXUYmCw2BIDasykJ8w Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Id: None Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: X-Domain-Name: None Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: X-Identity-Status: Confirmed Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: X-Is-Admin-Project: True Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Id: default Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Domain-Name: Default Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Id: 563ce242cd3e439babb59bb8663a7db6 Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: X-Project-Name: tempest-TestSnapshotPattern-107316112 Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: X-Role: member,reader Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: X-Roles: member,reader Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_563ce242cd3e439babb59bb8663a7db6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/563ce242cd3e439babb59bb8663a7db6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/563ce242cd3e439babb59bb8663a7db6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/563ce242cd3e439babb59bb8663a7db6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant: tempest-TestSnapshotPattern-107316112 Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Id: 563ce242cd3e439babb59bb8663a7db6 Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: X-Tenant-Name: tempest-TestSnapshotPattern-107316112 Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: X-User: tempest-TestSnapshotPattern-107316112-project Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Id: default Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: X-User-Domain-Name: Default Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: X-User-Id: 24654c4599c4418d80f94eeb264fbae0 Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: X-User-Name: tempest-TestSnapshotPattern-107316112-project Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: method: > Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: exception: Instance d8fa9396-3e02-4e3c-8aca-0fbc1abb244f could not be found. Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: action_args: {'id': 'd8fa9396-3e02-4e3c-8aca-0fbc1abb244f'} Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: {{(pid=119337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8fa9396-3e02-4e3c-8aca-0fbc1abb244f could not be found. Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8fa9396-3e02-4e3c-8aca-0fbc1abb244f could not be found. Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 23:57:47.097058 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:57:47.101634 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 23:57:47.101634 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 23:57:47.101634 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 23:57:47.101634 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 23:57:47.101634 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 23:57:47.101634 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8fa9396-3e02-4e3c-8aca-0fbc1abb244f could not be found. Jul 19 23:57:47.101634 n-d-847009-3 devstack@n-api.service[119337]: ERROR nova.api.openstack.wsgi Jul 19 23:57:47.101634 n-d-847009-3 devstack@n-api.service[119337]: DEBUG nova.api.openstack.wsgi [None req-d3d4e1f6-7ace-4128-8864-892ecbf905c5 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Returning 404 to user: Instance d8fa9396-3e02-4e3c-8aca-0fbc1abb244f could not be found. {{(pid=119337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 23:57:47.101634 n-d-847009-3 devstack@n-api.service[119337]: INFO nova.api.openstack.requestlog [None req-d3d4e1f6-7ace-4128-8864-892ecbf905c5 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f" status: 404 len: 111 microversion: 2.1 time: 0.031677 Jul 19 23:57:47.101634 n-d-847009-3 devstack@n-api.service[119337]: [pid: 119337|app: 0|req: 3691/7372] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 19 23:57:47 2022] GET /compute/v2.1/servers/d8fa9396-3e02-4e3c-8aca-0fbc1abb244f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 23:57:47.261107 n-d-847009-3 devstack@n-api.service[119338]: DEBUG nova.api.openstack.wsgi [None req-b54dc6ae-c31b-4015-8a9d-d2f041d71405 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] Calling method '.version_select at 0x7f7a10043430>' {{(pid=119338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 23:57:47.280646 n-d-847009-3 devstack@n-api.service[119338]: INFO nova.api.openstack.requestlog [None req-b54dc6ae-c31b-4015-8a9d-d2f041d71405 tempest-TestSnapshotPattern-107316112 tempest-TestSnapshotPattern-107316112-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1060441695" status: 202 len: 0 microversion: 2.1 time: 0.023876 Jul 19 23:57:47.281250 n-d-847009-3 devstack@n-api.service[119338]: [pid: 119338|app: 0|req: 3682/7373] 10.222.0.25 () {58 vars in 1256 bytes} [Tue Jul 19 23:57:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1060441695 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 23:58:15.344725 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:58:15.345443 n-d-847009-3 devstack@n-api.service[119338]: Tue Jul 19 23:58:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:58:16.435797 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:58:16.436334 n-d-847009-3 devstack@n-api.service[119337]: Tue Jul 19 23:58:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:58:17.148195 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:58:17.148409 n-d-847009-3 devstack@n-api.service[119337]: Tue Jul 19 23:58:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 23:59:55.442084 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 23:59:55.442714 n-d-847009-3 devstack@n-api.service[119338]: Tue Jul 19 23:59:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 00:00:17.421657 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 00:00:17.422324 n-d-847009-3 devstack@n-api.service[119337]: Wed Jul 20 00:00:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 00:01:35.353165 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 00:01:35.353791 n-d-847009-3 devstack@n-api.service[119338]: Wed Jul 20 00:01:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 00:01:36.443973 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 00:01:36.444575 n-d-847009-3 devstack@n-api.service[119337]: Wed Jul 20 00:01:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 00:01:37.156159 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 00:01:37.156384 n-d-847009-3 devstack@n-api.service[119337]: Wed Jul 20 00:01:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 00:03:15.451751 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 00:03:15.452343 n-d-847009-3 devstack@n-api.service[119338]: Wed Jul 20 00:03:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 00:03:29.866578 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 00:03:29.867228 n-d-847009-3 devstack@n-api.service[119338]: Wed Jul 20 00:03:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 00:03:37.430403 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 00:03:37.431034 n-d-847009-3 devstack@n-api.service[119337]: Wed Jul 20 00:03:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 00:04:55.363355 n-d-847009-3 devstack@n-api.service[119338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 00:04:55.363997 n-d-847009-3 devstack@n-api.service[119338]: Wed Jul 20 00:04:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 00:04:56.452364 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 00:04:56.452853 n-d-847009-3 devstack@n-api.service[119337]: Wed Jul 20 00:04:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 00:04:57.164336 n-d-847009-3 devstack@n-api.service[119337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 00:04:57.164578 n-d-847009-3 devstack@n-api.service[119337]: Wed Jul 20 00:04:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!